2021-06-25T04:33:47.337 INFO:root:teuthology version: 1.1.0-26631ede 2021-06-25T04:33:47.339 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --name yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131 --verbose -- /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/orig.config.yaml 2021-06-25T04:33:47.393 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-06-25T04:33:47.454 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131 branch: wip-yuri8-testing-2021-06-15-0839-octopus description: fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '6189131' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri8-testing-2021-06-15-0839-octopus ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - 'Failed to load ceph-mgr modules: rook' - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: da5e8184007182fa3cd5c8385fee4e08c5620fe2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: da5e8184007182fa3cd5c8385fee4e08c5620fe2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri8-testing-2021-06-15-0839-octopus sha1: da5e8184007182fa3cd5c8385fee4e08c5620fe2 owner: scheduled_yuriw@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 sha1: da5e8184007182fa3cd5c8385fee4e08c5620fe2 sleep_before_teardown: 0 suite: fs suite_branch: wip-yuri8-testing-2021-06-15-0839-octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: da5e8184007182fa3cd5c8385fee4e08c5620fe2 targets: smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxNRJdwZ8qWkd76W33yYVdCdwy7AGc9yGTVze1oPLAhkcYQdMjQlOXSrVyUSaugk3Uow5ECfT0yJfoBT5iZZecKyzcVgpYSUQqJeIqiFj/RksWmQM8eW7Uy+l4MsB1mJHE1sKDfyqn/CBDLsK/8HoYJSUiYQ042QgcghIJw0rKt8eby94joKczEcezrD9QZV+x5FjWqSoE0+Qb6n0Pma56B2+ivwlNqwCEGACX/7AnkI6T76fU3INnJpJlihhfLKbL2k8c1H4Iew9y6KZh0Lif2zX+tRblpmjkEKh52tz1UlFr4brFKIzfx7LIyw950bIBxcILOkEJ5pJ/5BzL5TBmxx7DxfIOzdCRQR0DGkvz5vMvysU37HapLga3qjmtgXjwYlRlDMalwfzIVX3g8B9R37wAafq6TlEtl/Wiwfzt8JqtweyIfucxjNLr6hzV8IXaUZSmOeRsFdoM1HkMdP2Q8tGQQ0ctgwHDaId1emPEnzO0FNe27oRmsKrMIjcTaAE= smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2E15/YMeBN9WNGqFUJZsNh8keujEt8r1lr9+wcxx3WQ9ft88rkjOua1r3eWg3ODo+zzc3gAtBLnEEHzgzUtsXDbb8lv46aPQe4ZnXC7sNDyIqfDvL2IL9rfi4Pj/mqktmsnHu5qXuMP9szsQGryEn9cTSY3LM4dt19mRGWTXKbBer6aD132UfiT1RhsZXi1mV+KmfZepESllN6dAcNpcaGj8YEZEWUf1JKH71Pd8WlIHaeN4ovScIl4I9cu2dTo6eDp6bVvQ/yJTmBrbm/HukQOtE8WydwevQh2ct4CzuUYyJkdyUfbor++t8P2QgF/Ua8DA+dEAFa/88QTeOjcnWZm6xFQZsF/YCDzhOev0NHdyducIy4rS5Hf9ekfkLv/CdTWQAe15qaFxSrFQZ4qnlZWKSV87VCequ2Tn8XSHsix8+DEYdUdE24mJpugECPe3co/Y3p9/JG6RgjNBzCarjzE9ba5jGns4jWga09VjP/BGeylNazilqYRG+WduIOLU= smithi102.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEoDdSlBe9ADvXwxDqxpFSATUzeH6oQAAxsyyXEJkSspGfp14xsBSzxXnT4BfWHPWEu0D0KIYRfWvcO75Z3FDEGPMA12P3ep5MONSRsri1vk5JSs7xY/i4rZYqBjmlqHPgsGW2kYRBlJpwHt/QFqMkIQRwKLkHwOknzF5K76tzYthU61RHTNrUITA5C1vZZ1PzzTSyK7+O5JMp+1ib9RIkT9O1GhqWt/vS1vtrlvmNomFuxQsocUweqS40AdUpa/a0ixZQihjBWxr1WkQ7q7G0/wwk3EspBRN/eeAsidMLTGdVJ0VbSn03kATt2r2m6UgfHl9Q+VPK9LQwPPp3cvcglSbQ9Hxl5ronv42T05RFK5kiNf0uOP5fHCW5rKzOEZrfzeQlYH28zCU6YS03T2ICxlzt7skeL9aNiBE12Ov2F764MxSy/wTyeeOKjHPv6hktnIz6g6rcvPxfJb7OTZdZPDNFMAki18uhlYZEeb7TE6jsG8NpMbKrUjEpI2Cetvc= smithi161.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHXYur8GmvgBntwtmSWCpFjY+8ImwVk/N/7i1SXZL7j8aRZTlglZ8KavO4PdOhVg7VacIaBygIgj1HfH8TwNnlacQGbC6QbIe7b6rhbFSAKiIAwmy5z71Z0XSHY8DhLb/UcUkqTyqYv5WTwWSAa2MK4DMTbsvrfUgvnzzn9Sbj01ZSJDUp3kFcV4FG8BNNm0hK1YMUDL2xE4A00RqwhdPgO1Hf41YfvfS+V4xIJfAW8B2Kbj47tyWHaBuPjXnVVS1Zsf2ogx5qxU6SDlU8A1LPkKwG/mvax3KMipQWSKw4ER1Q9wZPS98AXvAzQzMCZsAP/r0d7QMJiKaZNh6471MLItoUrt1+yOjJJYfsKKdW67k3mj6xxHH48z8bLMAe1YUmMSoZE5KJpM4u+DHblG8HeHRQ/C9MzDss4QIJ4yQY5MEQ6xOLJgJ1d2H+0LU1byBGJ8Idsji/3EG4qWb5VrINCvdgo4+F6G6XCgglwH0Y3Rw+6opg+9c2vpc7uhgMyic= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master teuthology_sha1: 26631ede9027a5643f2e47dacc5af6f1834aac45 timestamp: 2021-06-24_14:36:33 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.8274 2021-06-25T04:33:47.455 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa; will attempt to use it 2021-06-25T04:33:47.456 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks 2021-06-25T04:33:47.456 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-06-25T04:33:47.458 INFO:teuthology.task.internal:Checking packages... 2021-06-25T04:33:47.479 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'da5e8184007182fa3cd5c8385fee4e08c5620fe2' 2021-06-25T04:33:47.480 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-06-25T04:33:47.481 INFO:teuthology.packaging:ref: None 2021-06-25T04:33:47.481 INFO:teuthology.packaging:tag: None 2021-06-25T04:33:47.482 INFO:teuthology.packaging:branch: wip-yuri8-testing-2021-06-15-0839-octopus 2021-06-25T04:33:47.483 INFO:teuthology.packaging:sha1: da5e8184007182fa3cd5c8385fee4e08c5620fe2 2021-06-25T04:33:47.483 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri8-testing-2021-06-15-0839-octopus 2021-06-25T04:33:47.647 INFO:teuthology.task.internal:Found packages for ceph version 15.2.13-65-gda5e8184-1focal 2021-06-25T04:33:47.648 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-06-25T04:33:47.660 INFO:teuthology.task.internal:no buildpackages task found 2021-06-25T04:33:47.660 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-06-25T04:33:47.701 INFO:teuthology.task.internal:Saving configuration 2021-06-25T04:33:47.720 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-06-25T04:33:47.735 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-25T04:33:47.752 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-06-25 04:28:08.950375', 'description': '/home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILw/aAkd+C3YYYWFyixgPtSAx/bXEhk+dxH9adq+e3wv', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi057.front.sepia.ceph.com'} 2021-06-25T04:33:47.768 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-06-25 04:28:08.950354', 'description': '/home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOHIY0AsvhB4wCsoYLKrqLRSGYcN0VtPZAZ6PbgfoUx3', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi087.front.sepia.ceph.com'} 2021-06-25T04:33:47.784 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-06-25 04:28:08.950406', 'description': '/home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPAyJcXpbBAWpzpmA/fWoDxkJR+Fj8ptT5HpK8NhG4az', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi102.front.sepia.ceph.com'} 2021-06-25T04:33:47.800 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-06-25 04:28:08.950391', 'description': '/home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEtPGNQkQNTl7utvqFWPS4n21TA/ePliewqLgbaeDwCf', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi161.front.sepia.ceph.com'} 2021-06-25T04:33:47.801 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-06-25T04:33:47.814 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-06-25T04:33:47.815 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-06-25T04:33:47.815 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['client.0'] 2021-06-25T04:33:47.815 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['client.1'] 2021-06-25T04:33:47.816 INFO:teuthology.run_tasks:Running task console_log... 2021-06-25T04:33:47.955 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fce944e5ea0>, signals=[15]) 2021-06-25T04:33:47.957 INFO:teuthology.run_tasks:Running task internal.connect... 2021-06-25T04:33:47.973 INFO:teuthology.task.internal:Opening connections... 2021-06-25T04:33:47.973 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T04:33:47.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:33:48.026 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T04:33:48.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:33:48.078 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2021-06-25T04:33:48.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:33:48.131 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T04:33:48.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:33:48.182 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-06-25T04:33:48.205 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2021-06-25T04:33:48.214 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2021-06-25T04:33:48.215 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2021-06-25T04:33:48.261 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2021-06-25T04:33:48.261 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-06-25T04:33:48.261 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2021-06-25T04:33:48.261 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2021-06-25T04:33:48.262 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-06-25T04:33:48.262 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="20.04" 2021-06-25T04:33:48.262 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2021-06-25T04:33:48.262 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-06-25T04:33:48.263 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-06-25T04:33:48.263 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-06-25T04:33:48.263 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=focal 2021-06-25T04:33:48.263 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=focal 2021-06-25T04:33:48.264 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2021-06-25T04:33:48.279 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2021-06-25T04:33:48.288 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2021-06-25T04:33:48.288 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2021-06-25T04:33:48.295 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2021-06-25T04:33:48.295 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-06-25T04:33:48.296 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2021-06-25T04:33:48.296 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2021-06-25T04:33:48.296 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-06-25T04:33:48.296 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="20.04" 2021-06-25T04:33:48.296 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2021-06-25T04:33:48.297 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-06-25T04:33:48.297 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-06-25T04:33:48.297 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-06-25T04:33:48.297 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=focal 2021-06-25T04:33:48.298 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=focal 2021-06-25T04:33:48.298 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2021-06-25T04:33:48.312 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2021-06-25T04:33:48.319 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2021-06-25T04:33:48.320 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2021-06-25T04:33:48.366 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2021-06-25T04:33:48.366 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-06-25T04:33:48.367 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2021-06-25T04:33:48.367 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2021-06-25T04:33:48.367 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-06-25T04:33:48.367 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="20.04" 2021-06-25T04:33:48.367 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2021-06-25T04:33:48.368 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-06-25T04:33:48.368 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-06-25T04:33:48.368 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-06-25T04:33:48.368 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=focal 2021-06-25T04:33:48.369 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=focal 2021-06-25T04:33:48.369 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2021-06-25T04:33:48.383 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2021-06-25T04:33:48.391 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2021-06-25T04:33:48.391 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2021-06-25T04:33:48.398 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2021-06-25T04:33:48.399 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-06-25T04:33:48.399 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2021-06-25T04:33:48.399 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2021-06-25T04:33:48.400 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-06-25T04:33:48.400 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="20.04" 2021-06-25T04:33:48.401 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2021-06-25T04:33:48.401 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-06-25T04:33:48.401 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-06-25T04:33:48.402 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-06-25T04:33:48.402 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=focal 2021-06-25T04:33:48.403 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=focal 2021-06-25T04:33:48.403 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2021-06-25T04:33:48.418 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-06-25T04:33:48.433 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-06-25T04:33:48.586 INFO:teuthology.task.internal:Checking for old test directory... 2021-06-25T04:33:48.586 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2021-06-25T04:33:48.589 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2021-06-25T04:33:48.592 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2021-06-25T04:33:48.595 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2021-06-25T04:33:48.601 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-06-25T04:33:48.660 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-06-25T04:33:48.661 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2021-06-25T04:33:48.663 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2021-06-25T04:33:48.666 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2021-06-25T04:33:48.669 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2021-06-25T04:33:48.689 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-06-25T04:33:48.777 INFO:teuthology.run_tasks:Running task kernel... 2021-06-25T04:33:48.795 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'mds.c': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}} 2021-06-25T04:33:48.796 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-06-25T04:33:48.797 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2021-06-25T04:33:48.803 INFO:teuthology.orchestra.run.smithi057.stdout:5.4.0-66-generic 2021-06-25T04:33:48.804 INFO:teuthology.task.kernel:Running kernel on smithi057: 5.4.0-66-generic 2021-06-25T04:33:48.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2021-06-25T04:33:48.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2021-06-25T04:33:49.063 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-06-25T04:33:49.155 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:33:49.236 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-06-25T04:33:49.341 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [254 kB] 2021-06-25T04:33:49.396 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [741 kB] 2021-06-25T04:33:49.428 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [146 kB] 2021-06-25T04:33:49.430 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,960 B] 2021-06-25T04:33:49.433 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [16.4 kB] 2021-06-25T04:33:49.433 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [282 kB] 2021-06-25T04:33:49.438 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [40.9 kB] 2021-06-25T04:33:49.439 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [456 B] 2021-06-25T04:33:49.440 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [628 kB] 2021-06-25T04:33:49.444 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [502 kB] 2021-06-25T04:33:49.451 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [95.9 kB] 2021-06-25T04:33:49.451 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.6 kB] 2021-06-25T04:33:49.463 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [19.9 kB] 2021-06-25T04:33:49.463 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [5,384 B] 2021-06-25T04:33:49.463 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,316 B] 2021-06-25T04:33:49.464 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [528 B] 2021-06-25T04:33:49.564 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-06-25T04:33:49.778 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [499 kB] 2021-06-25T04:33:50.280 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,077 kB] 2021-06-25T04:33:50.499 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [237 kB] 2021-06-25T04:33:50.589 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.6 kB] 2021-06-25T04:33:50.670 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [17.7 kB] 2021-06-25T04:33:50.751 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [314 kB] 2021-06-25T04:33:50.842 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [45.7 kB] 2021-06-25T04:33:50.923 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [456 B] 2021-06-25T04:33:51.004 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [616 kB] 2021-06-25T04:33:51.105 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [825 kB] 2021-06-25T04:33:51.213 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [172 kB] 2021-06-25T04:33:51.301 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [17.8 kB] 2021-06-25T04:33:51.382 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [6,376 B] 2021-06-25T04:33:51.462 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [23.6 kB] 2021-06-25T04:33:51.544 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,376 B] 2021-06-25T04:33:51.745 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [648 B] 2021-06-25T04:33:51.825 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [2,932 B] 2021-06-25T04:33:51.906 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [4,032 B] 2021-06-25T04:33:51.987 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [224 B] 2021-06-25T04:33:54.989 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 6,963 kB in 3s (2,308 kB/s) 2021-06-25T04:33:56.124 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2021-06-25T04:33:56.146 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-06-25T04:33:56.219 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2021-06-25T04:33:56.387 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2021-06-25T04:33:56.387 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2021-06-25T04:33:56.469 INFO:teuthology.orchestra.run.smithi057.stderr:E: Unable to locate package linux-image-current-generic 2021-06-25T04:33:56.470 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-06-25T04:33:56.471 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-06-25T04:33:56.542 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2021-06-25T04:33:56.703 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2021-06-25T04:33:56.703 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2021-06-25T04:33:56.850 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2021-06-25T04:33:56.850 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-5.4.0-77 linux-headers-5.4.0-77-generic 2021-06-25T04:33:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-generic linux-image-5.4.0-77-generic 2021-06-25T04:33:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-5.4.0-77-generic linux-modules-extra-5.4.0-77-generic 2021-06-25T04:33:56.852 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2021-06-25T04:33:56.852 INFO:teuthology.orchestra.run.smithi057.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-06-25T04:33:56.852 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2021-06-25T04:33:56.853 INFO:teuthology.orchestra.run.smithi057.stdout: thermald 2021-06-25T04:33:56.883 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2021-06-25T04:33:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-5.4.0-77 linux-headers-5.4.0-77-generic 2021-06-25T04:33:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-77-generic linux-modules-5.4.0-77-generic 2021-06-25T04:33:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-extra-5.4.0-77-generic 2021-06-25T04:33:56.885 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2021-06-25T04:33:56.885 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-generic linux-image-generic 2021-06-25T04:33:57.061 INFO:teuthology.orchestra.run.smithi057.stdout:3 upgraded, 5 newly installed, 0 to remove and 153 not upgraded. 2021-06-25T04:33:57.062 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 75.6 MB of archives. 2021-06-25T04:33:57.063 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 377 MB of additional disk space will be used. 2021-06-25T04:33:57.063 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-77-generic amd64 5.4.0-77.86 [14.8 MB] 2021-06-25T04:33:58.176 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-77-generic amd64 5.4.0-77.86 [8,981 kB] 2021-06-25T04:33:58.426 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-77-generic amd64 5.4.0-77.86 [39.4 MB] 2021-06-25T04:33:59.640 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.77.80 [1,900 B] 2021-06-25T04:33:59.641 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.77.80 [2,576 B] 2021-06-25T04:33:59.641 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-77 all 5.4.0-77.86 [11.0 MB] 2021-06-25T04:33:59.916 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-77-generic amd64 5.4.0-77.86 [1,410 kB] 2021-06-25T04:33:59.929 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.77.80 [2,444 B] 2021-06-25T04:34:00.349 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 75.6 MB in 3s (24.9 MB/s) 2021-06-25T04:34:00.511 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-5.4.0-77-generic. 2021-06-25T04:34:02.026 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-06-25T04:34:02.030 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../0-linux-modules-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:34:02.125 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:34:04.057 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-image-5.4.0-77-generic. 2021-06-25T04:34:04.071 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../1-linux-image-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:34:04.190 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:34:05.232 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-77-generic. 2021-06-25T04:34:05.247 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:34:05.291 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-extra-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:34:10.311 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../3-linux-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:34:10.430 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:34:10.761 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:34:10.907 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:34:11.235 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-5.4.0-77. 2021-06-25T04:34:11.251 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../5-linux-headers-5.4.0-77_5.4.0-77.86_all.deb ... 2021-06-25T04:34:11.293 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-5.4.0-77 (5.4.0-77.86) ... 2021-06-25T04:34:17.518 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-5.4.0-77-generic. 2021-06-25T04:34:17.538 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../6-linux-headers-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:34:17.576 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:34:20.231 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:34:20.358 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:34:20.708 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:34:21.930 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:34:23.070 INFO:teuthology.orchestra.run.smithi057.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:34:23.071 INFO:teuthology.orchestra.run.smithi057.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-77-generic 2021-06-25T04:34:23.199 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-5.4.0-77 (5.4.0-77.86) ... 2021-06-25T04:34:23.325 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-extra-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:34:24.510 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-generic (5.4.0.77.80) ... 2021-06-25T04:34:24.636 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:34:24.762 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-generic (5.4.0.77.80) ... 2021-06-25T04:34:24.907 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-generic (5.4.0.77.80) ... 2021-06-25T04:34:25.039 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:34:25.212 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-06-25T04:34:25.212 INFO:teuthology.orchestra.run.smithi057.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:34:47.553 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-06-25T04:34:47.553 INFO:teuthology.orchestra.run.smithi057.stdout:Sourcing file `/etc/default/grub' 2021-06-25T04:34:47.570 INFO:teuthology.orchestra.run.smithi057.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-06-25T04:34:47.609 INFO:teuthology.orchestra.run.smithi057.stdout:Generating grub configuration file ... 2021-06-25T04:34:47.901 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:34:47.951 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:34:48.356 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-06-25T04:34:48.368 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-06-25T04:34:50.361 INFO:teuthology.orchestra.run.smithi057.stdout:done 2021-06-25T04:34:50.725 DEBUG:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2021-06-25T04:34:50.755 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2021-06-25T04:34:50.755 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2021-06-25T04:34:50.755 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2021-06-25T04:34:50.756 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2021-06-25T04:34:50.756 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 18 2021-06-25T04:34:50.756 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2021-06-25T04:34:50.756 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2021-06-25T04:34:50.756 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2021-06-25T04:34:50.757 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 5.4.0.77.80 2021-06-25T04:34:50.757 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.9) 2021-06-25T04:34:50.757 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-5.4.0-77-generic, linux-modules-extra-5.4.0-77-generic, linux-firmware, intel-microcode, amd64-microcode 2021-06-25T04:34:50.757 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2021-06-25T04:34:50.758 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2021-06-25T04:34:50.758 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2021-06-25T04:34:50.758 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2021-06-25T04:34:50.758 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-77-generic 2021-06-25T04:34:50.759 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2021-06-25T04:34:50.766 INFO:teuthology.orchestra.run.smithi087.stdout:5.4.0-66-generic 2021-06-25T04:34:50.767 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.4.0-66-generic 2021-06-25T04:34:50.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2021-06-25T04:34:50.875 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2021-06-25T04:34:51.039 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-06-25T04:34:51.150 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:34:51.230 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-06-25T04:34:51.330 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [741 kB] 2021-06-25T04:34:51.412 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [254 kB] 2021-06-25T04:34:51.414 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [146 kB] 2021-06-25T04:34:51.417 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,960 B] 2021-06-25T04:34:51.417 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [16.4 kB] 2021-06-25T04:34:51.418 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [282 kB] 2021-06-25T04:34:51.422 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [40.9 kB] 2021-06-25T04:34:51.423 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [456 B] 2021-06-25T04:34:51.424 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [502 kB] 2021-06-25T04:34:51.432 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [628 kB] 2021-06-25T04:34:51.442 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [95.9 kB] 2021-06-25T04:34:51.443 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.6 kB] 2021-06-25T04:34:51.452 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [19.9 kB] 2021-06-25T04:34:51.452 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [5,384 B] 2021-06-25T04:34:51.452 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,316 B] 2021-06-25T04:34:51.452 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [528 B] 2021-06-25T04:34:51.562 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-06-25T04:34:51.690 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,077 kB] 2021-06-25T04:34:52.006 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [499 kB] 2021-06-25T04:34:52.022 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [237 kB] 2021-06-25T04:34:52.028 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.6 kB] 2021-06-25T04:34:52.029 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [314 kB] 2021-06-25T04:34:52.038 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [17.7 kB] 2021-06-25T04:34:52.039 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [45.7 kB] 2021-06-25T04:34:52.041 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [456 B] 2021-06-25T04:34:52.041 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [825 kB] 2021-06-25T04:34:52.108 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [616 kB] 2021-06-25T04:34:52.129 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [172 kB] 2021-06-25T04:34:52.131 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [17.8 kB] 2021-06-25T04:34:52.132 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [6,376 B] 2021-06-25T04:34:52.132 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [23.6 kB] 2021-06-25T04:34:52.133 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,376 B] 2021-06-25T04:34:52.184 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [648 B] 2021-06-25T04:34:52.185 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [2,932 B] 2021-06-25T04:34:52.185 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [4,032 B] 2021-06-25T04:34:52.264 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [224 B] 2021-06-25T04:34:55.131 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 6,963 kB in 1s (4,999 kB/s) 2021-06-25T04:34:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-06-25T04:34:56.309 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-06-25T04:34:56.375 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-06-25T04:34:56.532 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-06-25T04:34:56.533 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-06-25T04:34:56.611 INFO:teuthology.orchestra.run.smithi087.stderr:E: Unable to locate package linux-image-current-generic 2021-06-25T04:34:56.612 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-06-25T04:34:56.613 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-06-25T04:34:56.684 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-06-25T04:34:56.841 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-06-25T04:34:56.842 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-06-25T04:34:56.983 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2021-06-25T04:34:56.983 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-5.4.0-77 linux-headers-5.4.0-77-generic 2021-06-25T04:34:56.984 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-generic linux-image-5.4.0-77-generic 2021-06-25T04:34:56.984 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-5.4.0-77-generic linux-modules-extra-5.4.0-77-generic 2021-06-25T04:34:56.984 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2021-06-25T04:34:56.985 INFO:teuthology.orchestra.run.smithi087.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-06-25T04:34:56.985 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2021-06-25T04:34:56.985 INFO:teuthology.orchestra.run.smithi087.stdout: thermald 2021-06-25T04:34:57.017 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2021-06-25T04:34:57.017 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-5.4.0-77 linux-headers-5.4.0-77-generic 2021-06-25T04:34:57.018 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-77-generic linux-modules-5.4.0-77-generic 2021-06-25T04:34:57.018 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-extra-5.4.0-77-generic 2021-06-25T04:34:57.019 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2021-06-25T04:34:57.019 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-generic linux-image-generic 2021-06-25T04:34:57.197 INFO:teuthology.orchestra.run.smithi087.stdout:3 upgraded, 5 newly installed, 0 to remove and 153 not upgraded. 2021-06-25T04:34:57.197 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 75.6 MB of archives. 2021-06-25T04:34:57.197 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 377 MB of additional disk space will be used. 2021-06-25T04:34:57.198 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-77-generic amd64 5.4.0-77.86 [14.8 MB] 2021-06-25T04:34:58.223 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-77-generic amd64 5.4.0-77.86 [8,981 kB] 2021-06-25T04:34:58.472 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-77-generic amd64 5.4.0-77.86 [39.4 MB] 2021-06-25T04:34:59.753 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.77.80 [1,900 B] 2021-06-25T04:34:59.753 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.77.80 [2,576 B] 2021-06-25T04:34:59.753 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-77 all 5.4.0-77.86 [11.0 MB] 2021-06-25T04:35:00.026 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-77-generic amd64 5.4.0-77.86 [1,410 kB] 2021-06-25T04:35:00.075 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.77.80 [2,444 B] 2021-06-25T04:35:00.474 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 75.6 MB in 3s (24.8 MB/s) 2021-06-25T04:35:00.643 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-5.4.0-77-generic. 2021-06-25T04:35:02.040 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-06-25T04:35:02.045 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../0-linux-modules-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:35:02.155 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:35:04.195 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-image-5.4.0-77-generic. 2021-06-25T04:35:04.208 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../1-linux-image-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:35:04.302 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:35:05.304 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-77-generic. 2021-06-25T04:35:05.317 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:35:05.362 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-extra-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:35:10.646 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../3-linux-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:35:10.757 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:35:11.108 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:35:11.232 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:35:11.587 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.4.0-77. 2021-06-25T04:35:11.604 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../5-linux-headers-5.4.0-77_5.4.0-77.86_all.deb ... 2021-06-25T04:35:11.646 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.4.0-77 (5.4.0-77.86) ... 2021-06-25T04:35:17.753 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.4.0-77-generic. 2021-06-25T04:35:17.773 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../6-linux-headers-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:35:17.802 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:35:20.390 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:35:20.511 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:35:20.866 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:35:22.042 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:35:23.181 INFO:teuthology.orchestra.run.smithi087.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:35:23.181 INFO:teuthology.orchestra.run.smithi087.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-77-generic 2021-06-25T04:35:23.310 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.4.0-77 (5.4.0-77.86) ... 2021-06-25T04:35:23.413 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-extra-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:35:24.764 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-generic (5.4.0.77.80) ... 2021-06-25T04:35:24.923 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:35:25.049 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-generic (5.4.0.77.80) ... 2021-06-25T04:35:25.175 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-generic (5.4.0.77.80) ... 2021-06-25T04:35:25.302 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:35:25.495 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-06-25T04:35:25.496 INFO:teuthology.orchestra.run.smithi087.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:35:47.165 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-06-25T04:35:47.165 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub' 2021-06-25T04:35:47.179 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-06-25T04:35:47.193 INFO:teuthology.orchestra.run.smithi087.stdout:Generating grub configuration file ... 2021-06-25T04:35:47.547 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:35:47.582 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:35:47.958 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-06-25T04:35:47.970 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-06-25T04:35:49.993 INFO:teuthology.orchestra.run.smithi087.stdout:done 2021-06-25T04:35:50.363 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2021-06-25T04:35:50.404 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2021-06-25T04:35:50.405 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2021-06-25T04:35:50.405 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2021-06-25T04:35:50.405 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2021-06-25T04:35:50.405 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 18 2021-06-25T04:35:50.406 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2021-06-25T04:35:50.406 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2021-06-25T04:35:50.406 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2021-06-25T04:35:50.406 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.4.0.77.80 2021-06-25T04:35:50.407 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.9) 2021-06-25T04:35:50.407 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.4.0-77-generic, linux-modules-extra-5.4.0-77-generic, linux-firmware, intel-microcode, amd64-microcode 2021-06-25T04:35:50.407 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2021-06-25T04:35:50.408 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2021-06-25T04:35:50.408 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2021-06-25T04:35:50.408 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2021-06-25T04:35:50.410 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-77-generic 2021-06-25T04:35:50.411 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2021-06-25T04:35:50.419 INFO:teuthology.orchestra.run.smithi102.stdout:5.4.0-66-generic 2021-06-25T04:35:50.419 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.4.0-66-generic 2021-06-25T04:35:50.420 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2021-06-25T04:35:50.587 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2021-06-25T04:35:50.765 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-06-25T04:35:50.860 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:35:50.940 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-06-25T04:35:51.042 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [741 kB] 2021-06-25T04:35:51.120 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [254 kB] 2021-06-25T04:35:51.124 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [146 kB] 2021-06-25T04:35:51.127 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,960 B] 2021-06-25T04:35:51.128 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [16.4 kB] 2021-06-25T04:35:51.129 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [282 kB] 2021-06-25T04:35:51.137 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [40.9 kB] 2021-06-25T04:35:51.137 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [456 B] 2021-06-25T04:35:51.138 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [628 kB] 2021-06-25T04:35:51.144 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [502 kB] 2021-06-25T04:35:51.151 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [95.9 kB] 2021-06-25T04:35:51.152 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.6 kB] 2021-06-25T04:35:51.170 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [19.9 kB] 2021-06-25T04:35:51.170 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [5,384 B] 2021-06-25T04:35:51.171 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,316 B] 2021-06-25T04:35:51.171 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [528 B] 2021-06-25T04:35:51.276 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-06-25T04:35:51.401 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [499 kB] 2021-06-25T04:35:51.616 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,077 kB] 2021-06-25T04:35:51.742 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [237 kB] 2021-06-25T04:35:51.762 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.6 kB] 2021-06-25T04:35:51.763 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [17.7 kB] 2021-06-25T04:35:51.764 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [314 kB] 2021-06-25T04:35:51.783 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [45.7 kB] 2021-06-25T04:35:51.785 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [456 B] 2021-06-25T04:35:51.786 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [825 kB] 2021-06-25T04:35:51.825 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [616 kB] 2021-06-25T04:35:51.850 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [172 kB] 2021-06-25T04:35:51.856 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [17.8 kB] 2021-06-25T04:35:51.867 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [23.6 kB] 2021-06-25T04:35:51.867 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [6,376 B] 2021-06-25T04:35:51.868 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,376 B] 2021-06-25T04:35:51.868 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [648 B] 2021-06-25T04:35:51.869 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [4,032 B] 2021-06-25T04:35:51.903 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [2,932 B] 2021-06-25T04:35:51.983 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [224 B] 2021-06-25T04:35:55.000 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 6,963 kB in 1s (4,814 kB/s) 2021-06-25T04:35:56.146 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-06-25T04:35:56.169 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-06-25T04:35:56.233 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-06-25T04:35:56.389 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2021-06-25T04:35:56.389 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2021-06-25T04:35:56.466 INFO:teuthology.orchestra.run.smithi102.stderr:E: Unable to locate package linux-image-current-generic 2021-06-25T04:35:56.467 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-06-25T04:35:56.468 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-06-25T04:35:56.539 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-06-25T04:35:56.695 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2021-06-25T04:35:56.695 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2021-06-25T04:35:56.835 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2021-06-25T04:35:56.835 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-5.4.0-77 linux-headers-5.4.0-77-generic 2021-06-25T04:35:56.835 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-generic linux-image-5.4.0-77-generic 2021-06-25T04:35:56.836 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-5.4.0-77-generic linux-modules-extra-5.4.0-77-generic 2021-06-25T04:35:56.837 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2021-06-25T04:35:56.837 INFO:teuthology.orchestra.run.smithi102.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-06-25T04:35:56.837 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2021-06-25T04:35:56.837 INFO:teuthology.orchestra.run.smithi102.stdout: thermald 2021-06-25T04:35:56.868 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2021-06-25T04:35:56.868 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-5.4.0-77 linux-headers-5.4.0-77-generic 2021-06-25T04:35:56.869 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-77-generic linux-modules-5.4.0-77-generic 2021-06-25T04:35:56.869 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-extra-5.4.0-77-generic 2021-06-25T04:35:56.869 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2021-06-25T04:35:56.870 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-generic linux-image-generic 2021-06-25T04:35:57.046 INFO:teuthology.orchestra.run.smithi102.stdout:3 upgraded, 5 newly installed, 0 to remove and 153 not upgraded. 2021-06-25T04:35:57.046 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 75.6 MB of archives. 2021-06-25T04:35:57.047 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 377 MB of additional disk space will be used. 2021-06-25T04:35:57.047 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-77-generic amd64 5.4.0-77.86 [14.8 MB] 2021-06-25T04:35:58.150 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-77-generic amd64 5.4.0-77.86 [8,981 kB] 2021-06-25T04:35:58.403 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-77-generic amd64 5.4.0-77.86 [39.4 MB] 2021-06-25T04:35:59.672 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.77.80 [1,900 B] 2021-06-25T04:35:59.672 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.77.80 [2,576 B] 2021-06-25T04:35:59.673 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-77 all 5.4.0-77.86 [11.0 MB] 2021-06-25T04:35:59.999 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-77-generic amd64 5.4.0-77.86 [1,410 kB] 2021-06-25T04:36:00.016 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.77.80 [2,444 B] 2021-06-25T04:36:00.407 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 75.6 MB in 3s (24.1 MB/s) 2021-06-25T04:36:00.537 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-5.4.0-77-generic. 2021-06-25T04:36:01.980 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-06-25T04:36:01.985 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../0-linux-modules-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:36:02.090 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:36:04.126 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-image-5.4.0-77-generic. 2021-06-25T04:36:04.138 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../1-linux-image-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:36:04.243 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:36:05.229 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-77-generic. 2021-06-25T04:36:05.243 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:36:05.283 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-extra-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:36:10.340 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../3-linux-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:36:10.452 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:36:10.772 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:36:10.920 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:36:11.247 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.4.0-77. 2021-06-25T04:36:11.262 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../5-linux-headers-5.4.0-77_5.4.0-77.86_all.deb ... 2021-06-25T04:36:11.314 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.4.0-77 (5.4.0-77.86) ... 2021-06-25T04:36:17.495 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.4.0-77-generic. 2021-06-25T04:36:17.516 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../6-linux-headers-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:36:17.545 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:36:20.058 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:36:20.203 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:36:20.519 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:36:22.001 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:36:23.112 INFO:teuthology.orchestra.run.smithi102.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:36:23.112 INFO:teuthology.orchestra.run.smithi102.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-77-generic 2021-06-25T04:36:23.244 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.4.0-77 (5.4.0-77.86) ... 2021-06-25T04:36:23.362 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-extra-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:36:24.505 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-generic (5.4.0.77.80) ... 2021-06-25T04:36:24.623 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:36:24.783 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-generic (5.4.0.77.80) ... 2021-06-25T04:36:24.908 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-generic (5.4.0.77.80) ... 2021-06-25T04:36:25.043 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:36:25.229 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-06-25T04:36:25.230 INFO:teuthology.orchestra.run.smithi102.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:36:46.816 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-06-25T04:36:46.817 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub' 2021-06-25T04:36:46.819 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-06-25T04:36:46.846 INFO:teuthology.orchestra.run.smithi102.stdout:Generating grub configuration file ... 2021-06-25T04:36:47.198 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:36:47.217 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:36:47.582 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-06-25T04:36:47.593 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-06-25T04:36:49.656 INFO:teuthology.orchestra.run.smithi102.stdout:done 2021-06-25T04:36:50.024 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2021-06-25T04:36:50.059 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2021-06-25T04:36:50.059 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2021-06-25T04:36:50.060 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2021-06-25T04:36:50.060 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2021-06-25T04:36:50.060 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 18 2021-06-25T04:36:50.060 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2021-06-25T04:36:50.061 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2021-06-25T04:36:50.061 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2021-06-25T04:36:50.061 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.4.0.77.80 2021-06-25T04:36:50.062 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.9) 2021-06-25T04:36:50.063 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.4.0-77-generic, linux-modules-extra-5.4.0-77-generic, linux-firmware, intel-microcode, amd64-microcode 2021-06-25T04:36:50.063 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2021-06-25T04:36:50.063 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2021-06-25T04:36:50.063 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2021-06-25T04:36:50.064 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2021-06-25T04:36:50.064 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-77-generic 2021-06-25T04:36:50.065 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2021-06-25T04:36:50.072 INFO:teuthology.orchestra.run.smithi161.stdout:5.4.0-66-generic 2021-06-25T04:36:50.073 INFO:teuthology.task.kernel:Running kernel on smithi161: 5.4.0-66-generic 2021-06-25T04:36:50.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2021-06-25T04:36:50.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2021-06-25T04:36:50.474 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-06-25T04:36:50.533 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:36:50.613 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-06-25T04:36:50.740 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [254 kB] 2021-06-25T04:36:50.819 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [741 kB] 2021-06-25T04:36:50.847 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [146 kB] 2021-06-25T04:36:50.851 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,960 B] 2021-06-25T04:36:50.852 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [282 kB] 2021-06-25T04:36:50.866 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [16.4 kB] 2021-06-25T04:36:50.866 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [40.9 kB] 2021-06-25T04:36:50.866 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [456 B] 2021-06-25T04:36:50.866 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [502 kB] 2021-06-25T04:36:50.867 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [628 kB] 2021-06-25T04:36:50.871 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [95.9 kB] 2021-06-25T04:36:50.872 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.6 kB] 2021-06-25T04:36:50.882 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [5,384 B] 2021-06-25T04:36:50.882 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [19.9 kB] 2021-06-25T04:36:50.883 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,316 B] 2021-06-25T04:36:50.883 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [528 B] 2021-06-25T04:36:50.947 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-06-25T04:36:51.072 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [499 kB] 2021-06-25T04:36:51.235 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,077 kB] 2021-06-25T04:36:51.355 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [237 kB] 2021-06-25T04:36:51.368 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.6 kB] 2021-06-25T04:36:51.370 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [17.7 kB] 2021-06-25T04:36:51.371 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [314 kB] 2021-06-25T04:36:51.387 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [45.7 kB] 2021-06-25T04:36:51.391 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [456 B] 2021-06-25T04:36:51.391 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [616 kB] 2021-06-25T04:36:51.418 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [825 kB] 2021-06-25T04:36:51.444 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [172 kB] 2021-06-25T04:36:51.449 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [17.8 kB] 2021-06-25T04:36:51.470 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [23.6 kB] 2021-06-25T04:36:51.472 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [6,376 B] 2021-06-25T04:36:51.472 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,376 B] 2021-06-25T04:36:51.512 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [648 B] 2021-06-25T04:36:51.513 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [2,932 B] 2021-06-25T04:36:51.513 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [4,032 B] 2021-06-25T04:36:51.514 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [224 B] 2021-06-25T04:36:54.517 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 6,963 kB in 1s (5,013 kB/s) 2021-06-25T04:36:55.608 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-06-25T04:36:55.632 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-06-25T04:36:55.703 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-06-25T04:36:55.866 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2021-06-25T04:36:55.866 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2021-06-25T04:36:55.945 INFO:teuthology.orchestra.run.smithi161.stderr:E: Unable to locate package linux-image-current-generic 2021-06-25T04:36:55.946 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-06-25T04:36:55.947 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-06-25T04:36:56.013 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-06-25T04:36:56.159 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2021-06-25T04:36:56.160 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2021-06-25T04:36:56.288 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2021-06-25T04:36:56.288 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-5.4.0-77 linux-headers-5.4.0-77-generic 2021-06-25T04:36:56.289 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-generic linux-image-5.4.0-77-generic 2021-06-25T04:36:56.289 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-5.4.0-77-generic linux-modules-extra-5.4.0-77-generic 2021-06-25T04:36:56.290 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2021-06-25T04:36:56.290 INFO:teuthology.orchestra.run.smithi161.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-06-25T04:36:56.290 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2021-06-25T04:36:56.290 INFO:teuthology.orchestra.run.smithi161.stdout: thermald 2021-06-25T04:36:56.319 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2021-06-25T04:36:56.319 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-5.4.0-77 linux-headers-5.4.0-77-generic 2021-06-25T04:36:56.320 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-77-generic linux-modules-5.4.0-77-generic 2021-06-25T04:36:56.320 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-extra-5.4.0-77-generic 2021-06-25T04:36:56.321 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2021-06-25T04:36:56.321 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-generic linux-image-generic 2021-06-25T04:36:56.503 INFO:teuthology.orchestra.run.smithi161.stdout:3 upgraded, 5 newly installed, 0 to remove and 153 not upgraded. 2021-06-25T04:36:56.503 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 75.6 MB of archives. 2021-06-25T04:36:56.504 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 377 MB of additional disk space will be used. 2021-06-25T04:36:56.504 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-77-generic amd64 5.4.0-77.86 [14.8 MB] 2021-06-25T04:36:57.612 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-77-generic amd64 5.4.0-77.86 [8,981 kB] 2021-06-25T04:36:57.860 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-77-generic amd64 5.4.0-77.86 [39.4 MB] 2021-06-25T04:36:59.109 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.77.80 [1,900 B] 2021-06-25T04:36:59.109 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.77.80 [2,576 B] 2021-06-25T04:36:59.110 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-77 all 5.4.0-77.86 [11.0 MB] 2021-06-25T04:36:59.429 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-77-generic amd64 5.4.0-77.86 [1,410 kB] 2021-06-25T04:36:59.468 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.77.80 [2,444 B] 2021-06-25T04:36:59.873 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 75.6 MB in 3s (24.1 MB/s) 2021-06-25T04:37:00.045 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-5.4.0-77-generic. 2021-06-25T04:37:01.416 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-06-25T04:37:01.420 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../0-linux-modules-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:37:01.504 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:37:03.468 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-image-5.4.0-77-generic. 2021-06-25T04:37:03.483 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../1-linux-image-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:37:03.581 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:37:04.571 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-77-generic. 2021-06-25T04:37:04.586 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:37:04.625 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-extra-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:37:09.584 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../3-linux-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:37:09.699 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:37:10.059 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:37:10.171 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:37:10.498 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-5.4.0-77. 2021-06-25T04:37:10.512 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../5-linux-headers-5.4.0-77_5.4.0-77.86_all.deb ... 2021-06-25T04:37:10.556 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-5.4.0-77 (5.4.0-77.86) ... 2021-06-25T04:37:16.792 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-5.4.0-77-generic. 2021-06-25T04:37:16.814 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../6-linux-headers-5.4.0-77-generic_5.4.0-77.86_amd64.deb ... 2021-06-25T04:37:16.858 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:37:19.407 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.77.80_amd64.deb ... 2021-06-25T04:37:19.535 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-generic (5.4.0.77.80) over (5.4.0.66.69) ... 2021-06-25T04:37:19.893 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:37:21.081 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:37:22.231 INFO:teuthology.orchestra.run.smithi161.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:37:22.231 INFO:teuthology.orchestra.run.smithi161.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-77-generic 2021-06-25T04:37:22.350 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-5.4.0-77 (5.4.0-77.86) ... 2021-06-25T04:37:22.985 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-extra-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:37:24.212 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-generic (5.4.0.77.80) ... 2021-06-25T04:37:24.338 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:37:24.463 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-generic (5.4.0.77.80) ... 2021-06-25T04:37:24.582 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-generic (5.4.0.77.80) ... 2021-06-25T04:37:24.691 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for linux-image-5.4.0-77-generic (5.4.0-77.86) ... 2021-06-25T04:37:24.844 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-06-25T04:37:24.844 INFO:teuthology.orchestra.run.smithi161.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:37:46.231 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-06-25T04:37:46.235 INFO:teuthology.orchestra.run.smithi161.stdout:Sourcing file `/etc/default/grub' 2021-06-25T04:37:46.239 INFO:teuthology.orchestra.run.smithi161.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-06-25T04:37:46.267 INFO:teuthology.orchestra.run.smithi161.stdout:Generating grub configuration file ... 2021-06-25T04:37:46.594 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:37:46.616 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:37:46.975 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-06-25T04:37:46.986 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-06-25T04:37:48.908 INFO:teuthology.orchestra.run.smithi161.stdout:done 2021-06-25T04:37:49.249 DEBUG:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2021-06-25T04:37:49.277 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2021-06-25T04:37:49.278 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2021-06-25T04:37:49.278 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2021-06-25T04:37:49.278 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2021-06-25T04:37:49.278 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 18 2021-06-25T04:37:49.279 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2021-06-25T04:37:49.279 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2021-06-25T04:37:49.279 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2021-06-25T04:37:49.279 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 5.4.0.77.80 2021-06-25T04:37:49.280 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.9) 2021-06-25T04:37:49.280 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-5.4.0-77-generic, linux-modules-extra-5.4.0-77-generic, linux-firmware, intel-microcode, amd64-microcode 2021-06-25T04:37:49.280 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2021-06-25T04:37:49.280 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2021-06-25T04:37:49.280 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2021-06-25T04:37:49.281 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2021-06-25T04:37:49.281 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-77-generic 2021-06-25T04:37:49.282 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-06-25T04:37:49.282 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-06-25T04:37:49.284 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-06-25T04:37:49.284 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-06-25T04:37:49.284 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-06-25T04:37:49.285 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-06-25T04:37:49.285 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=None, version=distro) 2021-06-25T04:37:49.286 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2021-06-25T04:37:49.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2021-06-25T04:37:49.530 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-06-25T04:37:49.644 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:37:49.725 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-06-25T04:37:49.805 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-06-25T04:37:51.008 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2021-06-25T04:37:51.031 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-06-25T04:37:51.099 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2021-06-25T04:37:51.243 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2021-06-25T04:37:51.244 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2021-06-25T04:37:51.318 INFO:teuthology.orchestra.run.smithi057.stderr:E: Unable to locate package linux-image-current-generic 2021-06-25T04:37:51.319 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-06-25T04:37:51.320 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-06-25T04:37:51.390 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2021-06-25T04:37:51.534 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2021-06-25T04:37:51.535 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2021-06-25T04:37:51.682 INFO:teuthology.orchestra.run.smithi057.stdout:linux-image-generic is already the newest version (5.4.0.77.80). 2021-06-25T04:37:51.682 INFO:teuthology.orchestra.run.smithi057.stdout:0 upgraded, 0 newly installed, 0 to remove and 153 not upgraded. 2021-06-25T04:37:51.683 DEBUG:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2021-06-25T04:37:51.704 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2021-06-25T04:37:51.705 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2021-06-25T04:37:51.705 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2021-06-25T04:37:51.706 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2021-06-25T04:37:51.706 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 18 2021-06-25T04:37:51.706 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2021-06-25T04:37:51.707 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2021-06-25T04:37:51.707 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2021-06-25T04:37:51.707 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 5.4.0.77.80 2021-06-25T04:37:51.708 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.9) 2021-06-25T04:37:51.708 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-5.4.0-77-generic, linux-modules-extra-5.4.0-77-generic, linux-firmware, intel-microcode, amd64-microcode 2021-06-25T04:37:51.708 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2021-06-25T04:37:51.709 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2021-06-25T04:37:51.709 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2021-06-25T04:37:51.709 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2021-06-25T04:37:51.710 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:37:51.753 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.CMP4WOxOop 2021-06-25T04:37:51.754 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub/grub.cfg /tmp/tmp.CMP4WOxOop 2021-06-25T04:37:51.770 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.CMP4WOxOop 2021-06-25T04:37:51.808 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.CMP4WOxOop is 8KB 2021-06-25T04:37:51.822 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.CMP4WOxOop 2021-06-25T04:37:51.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-06-25T04:37:51.888 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2021-06-25T04:37:51.888 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-06-25T04:37:51.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-06-25T04:37:51.933 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-77-generic 2021-06-25T04:37:51.934 DEBUG:teuthology.orchestra.run.smithi057:> sudo update-grub 2021-06-25T04:37:53.018 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2021-06-25T04:37:53.019 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-06-25T04:37:53.048 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2021-06-25T04:37:53.255 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:37:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:37:53.622 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-06-25T04:37:53.633 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-06-25T04:37:54.731 INFO:teuthology.orchestra.run.smithi057.stderr:done 2021-06-25T04:37:54.733 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2021-06-25T04:37:54.736 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-06-25T04:37:54.736 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2021-06-25T04:37:54.737 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2021-06-25T04:37:54.884 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2021-06-25T04:37:55.020 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-06-25T04:37:55.134 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:37:55.214 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-06-25T04:37:55.294 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-06-25T04:37:56.460 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-06-25T04:37:56.481 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-06-25T04:37:56.548 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-06-25T04:37:56.701 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-06-25T04:37:56.702 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-06-25T04:37:56.771 INFO:teuthology.orchestra.run.smithi087.stderr:E: Unable to locate package linux-image-current-generic 2021-06-25T04:37:56.772 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-06-25T04:37:56.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-06-25T04:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-06-25T04:37:56.984 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-06-25T04:37:56.985 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-06-25T04:37:57.128 INFO:teuthology.orchestra.run.smithi087.stdout:linux-image-generic is already the newest version (5.4.0.77.80). 2021-06-25T04:37:57.129 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 0 newly installed, 0 to remove and 153 not upgraded. 2021-06-25T04:37:57.130 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2021-06-25T04:37:57.152 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2021-06-25T04:37:57.152 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2021-06-25T04:37:57.152 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2021-06-25T04:37:57.153 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2021-06-25T04:37:57.153 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 18 2021-06-25T04:37:57.153 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2021-06-25T04:37:57.153 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2021-06-25T04:37:57.153 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2021-06-25T04:37:57.154 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.4.0.77.80 2021-06-25T04:37:57.154 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.9) 2021-06-25T04:37:57.154 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.4.0-77-generic, linux-modules-extra-5.4.0-77-generic, linux-firmware, intel-microcode, amd64-microcode 2021-06-25T04:37:57.155 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2021-06-25T04:37:57.155 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2021-06-25T04:37:57.155 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2021-06-25T04:37:57.155 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2021-06-25T04:37:57.156 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T04:37:57.200 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.ro48xqw25o 2021-06-25T04:37:57.201 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ro48xqw25o 2021-06-25T04:37:57.213 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.ro48xqw25o 2021-06-25T04:37:57.251 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.ro48xqw25o is 8KB 2021-06-25T04:37:57.267 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.ro48xqw25o 2021-06-25T04:37:57.273 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-06-25T04:37:57.329 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-06-25T04:37:57.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-06-25T04:37:57.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-06-25T04:37:57.383 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-77-generic 2021-06-25T04:37:57.383 DEBUG:teuthology.orchestra.run.smithi087:> sudo update-grub 2021-06-25T04:37:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub' 2021-06-25T04:37:58.411 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-06-25T04:37:58.432 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2021-06-25T04:37:58.692 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:37:58.703 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:37:59.085 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-06-25T04:37:59.095 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-06-25T04:38:00.164 INFO:teuthology.orchestra.run.smithi087.stderr:done 2021-06-25T04:38:00.166 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2021-06-25T04:38:00.168 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2021-06-25T04:38:00.169 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2021-06-25T04:38:00.169 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2021-06-25T04:38:00.284 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2021-06-25T04:38:00.417 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-06-25T04:38:00.531 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:38:00.611 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-06-25T04:38:00.691 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-06-25T04:38:01.865 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-06-25T04:38:01.886 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-06-25T04:38:01.958 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-06-25T04:38:02.116 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2021-06-25T04:38:02.116 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2021-06-25T04:38:02.194 INFO:teuthology.orchestra.run.smithi102.stderr:E: Unable to locate package linux-image-current-generic 2021-06-25T04:38:02.196 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-06-25T04:38:02.198 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-06-25T04:38:02.267 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-06-25T04:38:02.423 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2021-06-25T04:38:02.424 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2021-06-25T04:38:02.576 INFO:teuthology.orchestra.run.smithi102.stdout:linux-image-generic is already the newest version (5.4.0.77.80). 2021-06-25T04:38:02.577 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 0 newly installed, 0 to remove and 153 not upgraded. 2021-06-25T04:38:02.578 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2021-06-25T04:38:02.601 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2021-06-25T04:38:02.601 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2021-06-25T04:38:02.602 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2021-06-25T04:38:02.602 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2021-06-25T04:38:02.602 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 18 2021-06-25T04:38:02.602 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2021-06-25T04:38:02.603 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2021-06-25T04:38:02.603 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2021-06-25T04:38:02.603 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.4.0.77.80 2021-06-25T04:38:02.603 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.9) 2021-06-25T04:38:02.604 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.4.0-77-generic, linux-modules-extra-5.4.0-77-generic, linux-firmware, intel-microcode, amd64-microcode 2021-06-25T04:38:02.604 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2021-06-25T04:38:02.604 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2021-06-25T04:38:02.604 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2021-06-25T04:38:02.604 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2021-06-25T04:38:02.605 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2021-06-25T04:38:02.609 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.tfTVeVBIGa 2021-06-25T04:38:02.609 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub/grub.cfg /tmp/tmp.tfTVeVBIGa 2021-06-25T04:38:02.683 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.tfTVeVBIGa 2021-06-25T04:38:02.727 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.tfTVeVBIGa is 8KB 2021-06-25T04:38:02.741 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.tfTVeVBIGa 2021-06-25T04:38:02.750 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-06-25T04:38:02.805 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-06-25T04:38:02.806 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-06-25T04:38:02.806 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-06-25T04:38:02.857 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-77-generic 2021-06-25T04:38:02.857 DEBUG:teuthology.orchestra.run.smithi102:> sudo update-grub 2021-06-25T04:38:03.912 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2021-06-25T04:38:03.913 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-06-25T04:38:03.936 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2021-06-25T04:38:04.217 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:38:04.230 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:38:04.566 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-06-25T04:38:04.578 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-06-25T04:38:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:done 2021-06-25T04:38:05.750 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2021-06-25T04:38:05.753 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2021-06-25T04:38:05.754 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2021-06-25T04:38:05.754 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2021-06-25T04:38:05.851 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2021-06-25T04:38:05.989 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-06-25T04:38:06.103 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:38:06.183 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-06-25T04:38:06.263 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-06-25T04:38:07.448 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-06-25T04:38:07.470 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-06-25T04:38:07.535 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-06-25T04:38:07.692 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2021-06-25T04:38:07.693 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2021-06-25T04:38:07.769 INFO:teuthology.orchestra.run.smithi161.stderr:E: Unable to locate package linux-image-current-generic 2021-06-25T04:38:07.771 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-06-25T04:38:07.772 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-06-25T04:38:07.838 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-06-25T04:38:07.979 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2021-06-25T04:38:07.980 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2021-06-25T04:38:08.116 INFO:teuthology.orchestra.run.smithi161.stdout:linux-image-generic is already the newest version (5.4.0.77.80). 2021-06-25T04:38:08.117 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 0 newly installed, 0 to remove and 153 not upgraded. 2021-06-25T04:38:08.118 DEBUG:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2021-06-25T04:38:08.141 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2021-06-25T04:38:08.142 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2021-06-25T04:38:08.142 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2021-06-25T04:38:08.142 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2021-06-25T04:38:08.142 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 18 2021-06-25T04:38:08.143 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2021-06-25T04:38:08.143 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2021-06-25T04:38:08.143 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2021-06-25T04:38:08.144 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 5.4.0.77.80 2021-06-25T04:38:08.144 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.9) 2021-06-25T04:38:08.144 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-5.4.0-77-generic, linux-modules-extra-5.4.0-77-generic, linux-firmware, intel-microcode, amd64-microcode 2021-06-25T04:38:08.144 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2021-06-25T04:38:08.144 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2021-06-25T04:38:08.145 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2021-06-25T04:38:08.145 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2021-06-25T04:38:08.145 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2021-06-25T04:38:08.151 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.tJ6mrPafeg 2021-06-25T04:38:08.152 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub/grub.cfg /tmp/tmp.tJ6mrPafeg 2021-06-25T04:38:08.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.tJ6mrPafeg 2021-06-25T04:38:08.248 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.tJ6mrPafeg is 8KB 2021-06-25T04:38:08.262 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.tJ6mrPafeg 2021-06-25T04:38:08.269 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-06-25T04:38:08.324 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-06-25T04:38:08.325 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-06-25T04:38:08.325 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-06-25T04:38:08.374 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-77-generic 2021-06-25T04:38:08.374 DEBUG:teuthology.orchestra.run.smithi161:> sudo update-grub 2021-06-25T04:38:09.524 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2021-06-25T04:38:09.526 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-06-25T04:38:09.538 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2021-06-25T04:38:09.791 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-77-generic 2021-06-25T04:38:09.802 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-77-generic 2021-06-25T04:38:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-06-25T04:38:10.157 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-06-25T04:38:11.299 INFO:teuthology.orchestra.run.smithi161.stderr:done 2021-06-25T04:38:11.301 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2021-06-25T04:38:41.316 INFO:teuthology.misc:Re-opening connections... 2021-06-25T04:38:41.316 INFO:teuthology.misc:trying to connect to ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T04:38:41.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:38:41.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:38:59.791 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2021-06-25T04:38:59.792 INFO:teuthology.misc:trying to connect to ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T04:38:59.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:38:59.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:34.347 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2021-06-25T04:39:34.348 INFO:teuthology.misc:trying to connect to ubuntu@smithi102.front.sepia.ceph.com 2021-06-25T04:39:34.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:34.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:37.423 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2021-06-25T04:39:37.423 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T04:39:37.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:37.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:40.491 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-06-25T04:39:40.491 DEBUG:teuthology.misc:waited 59.17492604255676 2021-06-25T04:39:41.493 INFO:teuthology.misc:trying to connect to ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T04:39:41.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:41.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:41.797 DEBUG:teuthology.orchestra.run.smithi057:> true 2021-06-25T04:39:42.659 INFO:teuthology.misc:trying to connect to ubuntu@smithi102.front.sepia.ceph.com 2021-06-25T04:39:42.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:42.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:43.001 DEBUG:teuthology.orchestra.remote:No existing session 2021-06-25T04:39:43.003 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T04:39:43.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:43.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:43.563 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-06-25T04:39:43.563 DEBUG:teuthology.misc:waited 62.246833086013794 2021-06-25T04:39:44.565 INFO:teuthology.misc:trying to connect to ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T04:39:44.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:44.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:44.805 DEBUG:teuthology.orchestra.run.smithi087:> true 2021-06-25T04:39:45.347 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T04:39:45.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:45.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:48.427 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-06-25T04:39:48.427 DEBUG:teuthology.misc:waited 67.11087799072266 2021-06-25T04:39:49.428 INFO:teuthology.misc:trying to connect to ubuntu@smithi102.front.sepia.ceph.com 2021-06-25T04:39:49.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:49.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:49.475 DEBUG:teuthology.orchestra.run.smithi102:> true 2021-06-25T04:39:50.024 DEBUG:teuthology.misc:waited 68.70803618431091 2021-06-25T04:39:51.026 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T04:39:51.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:51.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:51.498 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-06-25T04:39:51.499 DEBUG:teuthology.misc:waited 70.1829342842102 2021-06-25T04:39:52.500 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T04:39:52.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:52.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:52.503 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-06-25T04:39:52.503 DEBUG:teuthology.misc:waited 71.18696236610413 2021-06-25T04:39:53.505 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T04:39:53.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:53.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:53.508 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-06-25T04:39:53.508 DEBUG:teuthology.misc:waited 72.19195675849915 2021-06-25T04:39:54.509 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T04:39:54.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:54.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:54.782 DEBUG:teuthology.orchestra.remote:No existing session 2021-06-25T04:39:54.783 DEBUG:teuthology.misc:waited 73.46651411056519 2021-06-25T04:39:55.784 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T04:39:55.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:55.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:55.818 DEBUG:teuthology.orchestra.remote:No existing session 2021-06-25T04:39:55.819 DEBUG:teuthology.misc:waited 74.50258255004883 2021-06-25T04:39:56.820 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T04:39:56.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:39:56.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:39:56.870 DEBUG:teuthology.orchestra.run.smithi161:> true 2021-06-25T04:39:57.465 DEBUG:teuthology.misc:waited 76.1484146118164 2021-06-25T04:39:58.466 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-06-25T04:39:58.466 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-77-generic"... 2021-06-25T04:39:58.467 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2021-06-25T04:39:58.475 INFO:teuthology.orchestra.run.smithi057.stdout:5.4.0-77-generic 2021-06-25T04:39:58.475 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-77-generic vs 5.4.0-77-generic 2021-06-25T04:39:58.475 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-06-25T04:39:58.476 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-06-25T04:39:58.476 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-06-25T04:39:58.476 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-77-generic"... 2021-06-25T04:39:58.477 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2021-06-25T04:39:58.484 INFO:teuthology.orchestra.run.smithi087.stdout:5.4.0-77-generic 2021-06-25T04:39:58.484 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-77-generic vs 5.4.0-77-generic 2021-06-25T04:39:58.484 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-06-25T04:39:58.485 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-06-25T04:39:58.485 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2021-06-25T04:39:58.485 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.4.0-77-generic"... 2021-06-25T04:39:58.485 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2021-06-25T04:39:58.492 INFO:teuthology.orchestra.run.smithi102.stdout:5.4.0-77-generic 2021-06-25T04:39:58.493 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-77-generic vs 5.4.0-77-generic 2021-06-25T04:39:58.493 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-06-25T04:39:58.493 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-06-25T04:39:58.494 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2021-06-25T04:39:58.494 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.4.0-77-generic"... 2021-06-25T04:39:58.494 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2021-06-25T04:39:58.502 INFO:teuthology.orchestra.run.smithi161.stdout:5.4.0-77-generic 2021-06-25T04:39:58.502 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-77-generic vs 5.4.0-77-generic 2021-06-25T04:39:58.503 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-06-25T04:39:58.503 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-06-25T04:39:59.504 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-06-25T04:39:59.505 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-06-25T04:39:59.575 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2021-06-25T04:39:59.606 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-06-25T04:39:59.607 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-06-25T04:39:59.702 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2021-06-25T04:39:59.726 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2021-06-25T04:39:59.727 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-06-25T04:39:59.803 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2021-06-25T04:39:59.842 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2021-06-25T04:39:59.843 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-06-25T04:39:59.910 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2021-06-25T04:39:59.937 INFO:teuthology.run_tasks:Running task internal.base... 2021-06-25T04:39:59.954 INFO:teuthology.task.internal:Creating test directory... 2021-06-25T04:39:59.955 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-06-25T04:39:59.960 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-06-25T04:39:59.963 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-06-25T04:39:59.966 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-06-25T04:39:59.973 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-06-25T04:39:59.989 INFO:teuthology.run_tasks:Running task internal.archive... 2021-06-25T04:40:00.022 INFO:teuthology.task.internal:Creating archive directory... 2021-06-25T04:40:00.023 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-06-25T04:40:00.031 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-06-25T04:40:00.035 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-06-25T04:40:00.037 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-06-25T04:40:00.077 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-06-25T04:40:00.100 INFO:teuthology.task.internal:Enabling coredump saving... 2021-06-25T04:40:00.100 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-06-25T04:40:00.111 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-06-25T04:40:00.113 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-06-25T04:40:00.116 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-06-25T04:40:00.145 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-06-25T04:40:00.145 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-06-25T04:40:00.146 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-06-25T04:40:00.150 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-06-25T04:40:00.150 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-06-25T04:40:00.151 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-06-25T04:40:00.156 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-06-25T04:40:00.161 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-06-25T04:40:00.162 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-06-25T04:40:00.179 INFO:teuthology.task.internal:Configuring sudo... 2021-06-25T04:40:00.180 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-06-25T04:40:00.184 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-06-25T04:40:00.189 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-06-25T04:40:00.193 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-06-25T04:40:00.208 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-06-25T04:40:00.230 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-06-25T04:40:00.231 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-06-25T04:40:00.241 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-06-25T04:40:00.247 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-06-25T04:40:00.251 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-06-25T04:40:00.259 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-06-25T04:40:00.267 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-06-25T04:40:00.320 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2021-06-25T04:40:00.320 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-06-25T04:40:00.348 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-06-25T04:40:00.359 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-06-25T04:40:00.409 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-06-25T04:40:00.409 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-06-25T04:40:00.431 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-06-25T04:40:00.446 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-06-25T04:40:00.496 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-06-25T04:40:00.497 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-06-25T04:40:00.517 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-06-25T04:40:00.525 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-06-25T04:40:00.534 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-06-25T04:40:00.534 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-06-25T04:40:00.562 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2021-06-25T04:40:00.565 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2021-06-25T04:40:00.568 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2021-06-25T04:40:00.571 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2021-06-25T04:40:00.658 INFO:teuthology.run_tasks:Running task internal.timer... 2021-06-25T04:40:00.669 INFO:teuthology.task.internal:Starting timer... 2021-06-25T04:40:00.670 INFO:teuthology.run_tasks:Running task pcp... 2021-06-25T04:40:00.695 INFO:teuthology.run_tasks:Running task selinux... 2021-06-25T04:40:00.727 DEBUG:teuthology.task.selinux:Excluding smithi057: OS 'ubuntu' does not support SELinux 2021-06-25T04:40:00.728 DEBUG:teuthology.task.selinux:Excluding smithi087: OS 'ubuntu' does not support SELinux 2021-06-25T04:40:00.728 DEBUG:teuthology.task.selinux:Excluding smithi102: OS 'ubuntu' does not support SELinux 2021-06-25T04:40:00.729 DEBUG:teuthology.task.selinux:Excluding smithi161: OS 'ubuntu' does not support SELinux 2021-06-25T04:40:00.729 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-06-25T04:40:00.729 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-06-25T04:40:00.730 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-06-25T04:40:00.730 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-06-25T04:40:00.760 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-06-25T04:40:00.761 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-06-25T04:40:00.781 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-06-25T04:40:00.783 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi087.front.sepia.ceph.com,smithi102.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-06-25T04:40:01.172 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-06-25T04:40:01.962 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-06-25T04:40:04.829 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-06-25T04:40:04.852 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:04 +0000 (0:00:00.039) 0:00:00.039 *********** 2021-06-25T04:40:04.863 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:04 +0000 (0:00:00.010) 0:00:00.050 *********** 2021-06-25T04:40:04.874 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:04 +0000 (0:00:00.010) 0:00:00.060 *********** 2021-06-25T04:40:04.884 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:04 +0000 (0:00:00.010) 0:00:00.071 *********** 2021-06-25T04:40:07.001 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-06-25T04:40:07.003 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi057.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi057.front.sepia.ceph.com] 2021-06-25T04:40:07.052 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:07 +0000 (0:00:02.168) 0:00:02.239 *********** 2021-06-25T04:40:07.073 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi087.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2021-06-25T04:40:07.076 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] 2021-06-25T04:40:07.235 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi161.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi161.front.sepia.ceph.com] 2021-06-25T04:40:07.250 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi102.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2021-06-25T04:40:07.252 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] 2021-06-25T04:40:07.285 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:07 +0000 (0:00:00.232) 0:00:02.472 *********** 2021-06-25T04:40:07.344 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:07 +0000 (0:00:00.058) 0:00:02.530 *********** 2021-06-25T04:40:07.370 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:07 +0000 (0:00:00.025) 0:00:02.556 *********** 2021-06-25T04:40:07.452 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-06-25T04:40:07.454 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-06-25T04:40:07.482 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:07 +0000 (0:00:00.112) 0:00:02.669 *********** 2021-06-25T04:40:07.502 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:07 +0000 (0:00:00.020) 0:00:02.689 *********** 2021-06-25T04:40:07.510 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-06-25T04:40:07.512 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-06-25T04:40:07.536 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:07 +0000 (0:00:00.033) 0:00:02.722 *********** 2021-06-25T04:40:07.558 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:07 +0000 (0:00:00.021) 0:00:02.744 *********** 2021-06-25T04:40:08.015 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** changed: [smithi087.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-06-25T04:40:08.016 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-06-25T04:40:08.045 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.487) 0:00:03.231 *********** 2021-06-25T04:40:08.071 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.026) 0:00:03.258 *********** 2021-06-25T04:40:08.077 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-06-25T04:40:08.078 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-06-25T04:40:08.110 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.038) 0:00:03.296 *********** 2021-06-25T04:40:08.148 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.038) 0:00:03.335 *********** 2021-06-25T04:40:08.410 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-06-25T04:40:08.412 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.052183", "end": "2021-06-25 04:40:08.834129", "rc": 0, "start": "2021-06-25 04:40:08.781946", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.052094", "end": "2021-06-25 04:40:08.953136", "rc": 0, "start": "2021-06-25 04:40:08.901042", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-06-25T04:40:08.435 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.286) 0:00:03.622 *********** 2021-06-25T04:40:08.457 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.021) 0:00:03.643 *********** 2021-06-25T04:40:08.470 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.055984", "end": "2021-06-25 04:40:07.968294", "rc": 0, "start": "2021-06-25 04:40:07.912310", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-06-25T04:40:08.471 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.068296", "end": "2021-06-25 04:40:08.651651", "rc": 0, "start": "2021-06-25 04:40:08.583355", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-06-25T04:40:08.502 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.045) 0:00:03.689 *********** 2021-06-25T04:40:08.525 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.020) 0:00:03.710 *********** 2021-06-25T04:40:08.697 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-06-25T04:40:08.699 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:40:08.722 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.199) 0:00:03.909 *********** 2021-06-25T04:40:08.744 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.021) 0:00:03.930 *********** 2021-06-25T04:40:08.750 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:40:08.752 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:40:08.779 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.035) 0:00:03.965 *********** 2021-06-25T04:40:08.799 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:08 +0000 (0:00:00.019) 0:00:03.985 *********** 2021-06-25T04:40:09.536 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-06-25T04:40:09.538 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596008.7564418-8753-127161218674087/source", "state": "file", "uid": 0} 2021-06-25T04:40:09.573 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:09 +0000 (0:00:00.774) 0:00:04.760 *********** 2021-06-25T04:40:09.581 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596008.775703-8755-184361855101510/source", "state": "file", "uid": 0} 2021-06-25T04:40:09.582 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596008.8339818-8762-33645658761656/source", "state": "file", "uid": 0} 2021-06-25T04:40:09.608 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:09 +0000 (0:00:00.034) 0:00:04.794 *********** 2021-06-25T04:40:09.630 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:09 +0000 (0:00:00.021) 0:00:04.816 *********** 2021-06-25T04:40:09.701 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596008.8122401-8760-128844254475479/source", "state": "file", "uid": 0} 2021-06-25T04:40:09.729 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:09 +0000 (0:00:00.098) 0:00:04.915 *********** 2021-06-25T04:40:10.049 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-06-25T04:40:10.050 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-06-25T04:40:10.052 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-06-25T04:40:10.054 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-06-25T04:40:10.056 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEz 2021-06-25T04:40:10.057 INFO:teuthology.task.ansible.out:IKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-06-25T04:40:10.097 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-06-25T04:40:10.099 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-06-25T04:40:10.193 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-06-25T04:40:10.195 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-06-25T04:40:10.209 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Friday 25 June 2021 04:40:10 +0000 (0:00:00.480) 0:00:05.396 *********** 2021-06-25T04:40:10.910 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] 2021-06-25T04:40:10.931 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] 2021-06-25T04:40:10.961 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] 2021-06-25T04:40:11.906 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] 2021-06-25T04:40:11.928 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Friday 25 June 2021 04:40:11 +0000 (0:00:01.719) 0:00:07.115 *********** 2021-06-25T04:40:11.958 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-06-25T04:40:11.981 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-06-25T04:40:12.003 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-06-25T04:40:12.014 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-06-25T04:40:12.020 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-06-25T04:40:12.185 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:12 +0000 (0:00:00.256) 0:00:07.372 *********** 2021-06-25T04:40:12.208 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:12 +0000 (0:00:00.022) 0:00:07.394 *********** 2021-06-25T04:40:12.230 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:12 +0000 (0:00:00.022) 0:00:07.417 *********** 2021-06-25T04:40:12.252 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:12 +0000 (0:00:00.021) 0:00:07.439 *********** 2021-06-25T04:40:13.069 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi057.front.sepia.ceph.com] 2021-06-25T04:40:13.118 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] 2021-06-25T04:40:13.135 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] 2021-06-25T04:40:13.145 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] 2021-06-25T04:40:13.175 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-06-25T04:40:13.178 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.923) 0:00:08.362 *********** 2021-06-25T04:40:13.247 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.070) 0:00:08.433 *********** 2021-06-25T04:40:13.275 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.028) 0:00:08.462 *********** 2021-06-25T04:40:13.305 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.030) 0:00:08.492 *********** 2021-06-25T04:40:13.620 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-06-25T04:40:13.622 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.174354", "end": "2021-06-25 04:40:13.591938", "rc": 0, "start": "2021-06-25 04:40:13.417584", "stderr": "", "stderr_lines": [], "stdout": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "stdout_lines": ["afed858f288ae8da2ecacf54fe96e9ad3d2a9e89"]} 2021-06-25T04:40:13.645 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.340) 0:00:08.832 *********** 2021-06-25T04:40:13.678 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.178236", "end": "2021-06-25 04:40:13.653845", "rc": 0, "start": "2021-06-25 04:40:13.475609", "stderr": "", "stderr_lines": [], "stdout": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "stdout_lines": ["afed858f288ae8da2ecacf54fe96e9ad3d2a9e89"]} 2021-06-25T04:40:13.703 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.058) 0:00:08.890 *********** 2021-06-25T04:40:13.711 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.160431", "end": "2021-06-25 04:40:13.667492", "rc": 0, "start": "2021-06-25 04:40:13.507061", "stderr": "", "stderr_lines": [], "stdout": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "stdout_lines": ["afed858f288ae8da2ecacf54fe96e9ad3d2a9e89"]} 2021-06-25T04:40:13.736 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.033) 0:00:08.923 *********** 2021-06-25T04:40:13.754 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.157490", "end": "2021-06-25 04:40:13.721606", "rc": 0, "start": "2021-06-25 04:40:13.564116", "stderr": "", "stderr_lines": [], "stdout": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "stdout_lines": ["afed858f288ae8da2ecacf54fe96e9ad3d2a9e89"]} 2021-06-25T04:40:13.779 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.042) 0:00:08.965 *********** 2021-06-25T04:40:13.795 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-06-25T04:40:13.796 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013972", "end": "2021-06-25 04:40:14.345732", "failed_when_result": false, "rc": 0, "start": "2021-06-25 04:40:14.331760", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-06-25T04:40:13.821 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.041) 0:00:09.007 *********** 2021-06-25T04:40:13.850 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010068", "end": "2021-06-25 04:40:14.276264", "failed_when_result": false, "rc": 0, "start": "2021-06-25 04:40:14.266196", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-06-25T04:40:13.875 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.054) 0:00:09.061 *********** 2021-06-25T04:40:13.903 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-06-25T04:40:13.904 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:13.927 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.051) 0:00:09.113 *********** 2021-06-25T04:40:13.933 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-06-25T04:40:13.935 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.026128", "end": "2021-06-25 04:40:14.139674", "failed_when_result": false, "rc": 0, "start": "2021-06-25 04:40:14.113546", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014655", "end": "2021-06-25 04:40:13.478489", "failed_when_result": false, "rc": 0, "start": "2021-06-25 04:40:13.463834", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-06-25T04:40:13.959 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.032) 0:00:09.146 *********** 2021-06-25T04:40:13.988 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:13 +0000 (0:00:00.028) 0:00:09.175 *********** 2021-06-25T04:40:13.996 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-06-25T04:40:13.997 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.022 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.034) 0:00:09.209 *********** 2021-06-25T04:40:14.030 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-06-25T04:40:14.032 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.058 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.035) 0:00:09.245 *********** 2021-06-25T04:40:14.081 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.022) 0:00:09.268 *********** 2021-06-25T04:40:14.090 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.091 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.116 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.035) 0:00:09.303 *********** 2021-06-25T04:40:14.139 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.022) 0:00:09.326 *********** 2021-06-25T04:40:14.147 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-06-25T04:40:14.148 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.148 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-06-25T04:40:14.149 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.174 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.034) 0:00:09.360 *********** 2021-06-25T04:40:14.196 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.022) 0:00:09.383 *********** 2021-06-25T04:40:14.204 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.229 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.033) 0:00:09.416 *********** 2021-06-25T04:40:14.236 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-06-25T04:40:14.238 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.263 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.033) 0:00:09.449 *********** 2021-06-25T04:40:14.264 INFO:teuthology.task.ansible.out: 2021-06-25T04:40:14.269 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-06-25T04:40:14.271 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.295 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.032) 0:00:09.482 *********** 2021-06-25T04:40:14.302 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-06-25T04:40:14.305 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.329 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.033) 0:00:09.516 *********** 2021-06-25T04:40:14.335 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-06-25T04:40:14.337 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.339 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-06-25T04:40:14.341 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.369 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.040) 0:00:09.556 *********** 2021-06-25T04:40:14.393 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.023) 0:00:09.579 *********** 2021-06-25T04:40:14.400 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-06-25T04:40:14.402 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.429 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.035) 0:00:09.615 *********** 2021-06-25T04:40:14.437 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-06-25T04:40:14.439 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.464 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.034) 0:00:09.650 *********** 2021-06-25T04:40:14.485 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.021) 0:00:09.671 *********** 2021-06-25T04:40:14.491 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.527 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.039) 0:00:09.710 *********** 2021-06-25T04:40:14.574 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-06-25T04:40:14.576 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.599 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.075) 0:00:09.786 *********** 2021-06-25T04:40:14.606 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:14.631 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.032) 0:00:09.818 *********** 2021-06-25T04:40:14.633 INFO:teuthology.task.ansible.out: 2021-06-25T04:40:14.638 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-06-25T04:40:14.640 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:40:14.665 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.034) 0:00:09.852 *********** 2021-06-25T04:40:14.673 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:40:14.700 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.034) 0:00:09.886 *********** 2021-06-25T04:40:14.783 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:40:14.807 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.106) 0:00:09.993 *********** 2021-06-25T04:40:14.835 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:40:14.860 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:14 +0000 (0:00:00.053) 0:00:10.046 *********** 2021-06-25T04:40:14.932 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-06-25T04:40:14.935 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-06-25T04:40:14.945 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-06-25T04:40:15.051 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-06-25T04:40:15.074 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-06-25T04:40:15.088 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-06-25T04:40:15.121 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-06-25T04:40:15.198 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-06-25T04:40:15.230 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-06-25T04:40:15.241 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-06-25T04:40:15.264 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-06-25T04:40:15.338 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-06-25T04:40:15.374 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "i 2021-06-25T04:40:15.376 INFO:teuthology.task.ansible.out:tem", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-06-25T04:40:15.407 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-06-25T04:40:15.483 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-06-25T04:40:15.520 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a 2021-06-25T04:40:15.522 INFO:teuthology.task.ansible.out:\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-06-25T04:40:15.553 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-06-25T04:40:15.664 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-06-25T04:40:15.697 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-06-25T04:40:15.762 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-06-25T04:40:15.809 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-06-25T04:40:15.810 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-06-25T04:40:15.853 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-06-25T04:40:15.907 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-06-25T04:40:15.961 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-06-25T04:40:15.962 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-06-25T04:40:15.995 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-06-25T04:40:16.062 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-06-25T04:40:16.106 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-06-25T04:40:16.150 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-06-25T04:40:16.204 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-06-25T04:40:16.248 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-06-25T04:40:16.273 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-06-25T04:40:16.296 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-06-25T04:40:16.340 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-06-25T04:40:16.394 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-06-25T04:40:16.406 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-06-25T04:40:16.440 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-06-25T04:40:16.483 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-06-25T04:40:16.541 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-06-25T04:40:16.554 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-06-25T04:40:16.587 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-06-25T04:40:16.642 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-06-25T04:40:16.685 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-06-25T04:40:16.740 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-06-25T04:40:16.784 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-06-25T04:40:16.828 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-06-25T04:40:16.841 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-06-25T04:40:16.884 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-06-25T04:40:16.937 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-06-25T04:40:16.982 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-06-25T04:40:16.993 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-06-25T04:40:17.040 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-06-25T04:40:17.097 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-06-25T04:40:17.121 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-06-25T04:40:17.134 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-06-25T04:40:17.190 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-06-25T04:40:17.236 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-06-25T04:40:17.269 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-06-25T04:40:17.281 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-06-25T04:40:17.335 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-06-25T04:40:17.378 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-06-25T04:40:17.410 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-06-25T04:40:17.423 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-06-25T04:40:17.476 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-06-25T04:40:17.520 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-06-25T04:40:17.564 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-06-25T04:40:17.566 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-06-25T04:40:17.622 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-06-25T04:40:17.657 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-06-25T04:40:17.712 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-06-25T04:40:17.714 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-06-25T04:40:17.759 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-06-25T04:40:17.802 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-06-25T04:40:17.858 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-06-25T04:40:17.881 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-06-25T04:40:17.903 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-06-25T04:40:17.957 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-06-25T04:40:18.012 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-06-25T04:40:18.033 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-06-25T04:40:18.057 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-06-25T04:40:18.112 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-06-25T04:40:18.163 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-06-25T04:40:18.175 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-06-25T04:40:18.209 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-06-25T04:40:18.263 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-06-25T04:40:18.306 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-06-25T04:40:18.317 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-06-25T04:40:18.351 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-06-25T04:40:18.405 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-06-25T04:40:18.449 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-06-25T04:40:18.470 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-06-25T04:40:18.492 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-06-25T04:40:18.568 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-06-25T04:40:18.601 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-06-25T04:40:18.623 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-06-25T04:40:18.634 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-06-25T04:40:18.712 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-06-25T04:40:18.745 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-06-25T04:40:18.781 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-06-25T04:40:18.783 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-06-25T04:40:18.859 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-06-25T04:40:18.892 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-06-25T04:40:18.928 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-06-25T04:40:19.015 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-06-25T04:40:19.049 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-06-25T04:40:19.072 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-06-25T04:40:19.073 INFO:teuthology.task.ansible.out: 2021-06-25T04:40:19.085 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-06-25T04:40:19.160 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-06-25T04:40:19.193 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-06-25T04:40:19.226 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-06-25T04:40:19.227 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-06-25T04:40:19.302 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-06-25T04:40:19.335 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-06-25T04:40:19.368 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-06-25T04:40:19.379 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-06-25T04:40:19.445 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-06-25T04:40:19.488 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-06-25T04:40:19.532 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-06-25T04:40:19.544 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-06-25T04:40:19.599 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-06-25T04:40:19.642 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-06-25T04:40:19.686 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-06-25T04:40:19.687 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-06-25T04:40:19.741 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-06-25T04:40:19.774 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-06-25T04:40:19.827 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-06-25T04:40:19.828 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-06-25T04:40:19.882 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-06-25T04:40:19.926 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-06-25T04:40:19.969 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-06-25T04:40:19.983 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-06-25T04:40:20.027 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-06-25T04:40:20.062 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-06-25T04:40:20.114 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-06-25T04:40:20.136 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-06-25T04:40:20.170 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-06-25T04:40:20.203 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-06-25T04:40:20.257 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-06-25T04:40:20.280 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-06-25T04:40:20.314 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-06-25T04:40:20.348 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-06-25T04:40:20.403 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-06-25T04:40:20.415 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-06-25T04:40:20.448 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-06-25T04:40:20.491 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-06-25T04:40:20.546 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-06-25T04:40:20.573 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-06-25T04:40:20.596 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-06-25T04:40:20.639 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-06-25T04:40:20.693 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-06-25T04:40:20.738 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-06-25T04:40:20.739 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-06-25T04:40:20.783 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-06-25T04:40:20.838 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-06-25T04:40:20.897 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-06-25T04:40:20.929 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-06-25T04:40:20.994 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-06-25T04:40:21.038 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-06-25T04:40:21.039 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-06-25T04:40:21.072 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-06-25T04:40:21.125 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-06-25T04:40:21.183 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-06-25T04:40:21.196 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-06-25T04:40:21.219 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-06-25T04:40:21.273 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-06-25T04:40:21.327 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-06-25T04:40:21.339 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-06-25T04:40:21.371 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-06-25T04:40:21.468 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-06-25T04:40:21.481 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-06-25T04:40:21.514 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-06-25T04:40:21.589 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-06-25T04:40:21.623 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-06-25T04:40:21.634 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-06-25T04:40:21.658 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-06-25T04:40:21.743 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-06-25T04:40:21.765 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-06-25T04:40:21.776 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-06-25T04:40:21.799 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-06-25T04:40:21.886 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-06-25T04:40:21.898 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-06-25T04:40:21.931 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-06-25T04:40:21.954 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-06-25T04:40:22.030 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-06-25T04:40:22.056 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-06-25T04:40:22.078 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-06-25T04:40:22.101 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-06-25T04:40:22.177 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-06-25T04:40:22.199 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-06-25T04:40:22.232 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-06-25T04:40:22.254 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-06-25T04:40:22.318 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-06-25T04:40:22.351 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-06-25T04:40:22.384 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-06-25T04:40:22.395 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-06-25T04:40:22.460 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-06-25T04:40:22.482 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-06-25T04:40:22.516 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-06-25T04:40:22.538 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-06-25T04:40:22.605 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-06-25T04:40:22.638 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-06-25T04:40:22.672 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-06-25T04:40:22.683 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-06-25T04:40:22.749 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-06-25T04:40:22.781 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-06-25T04:40:22.814 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-06-25T04:40:22.826 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-06-25T04:40:22.880 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-06-25T04:40:22.927 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-06-25T04:40:22.959 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-06-25T04:40:22.975 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-06-25T04:40:23.031 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-06-25T04:40:23.075 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-06-25T04:40:23.098 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-06-25T04:40:23.123 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-06-25T04:40:23.170 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-06-25T04:40:23.222 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-06-25T04:40:23.256 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-06-25T04:40:23.268 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-06-25T04:40:23.314 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-06-25T04:40:23.367 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-06-25T04:40:23.405 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-06-25T04:40:23.417 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-06-25T04:40:23.461 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-06-25T04:40:23.505 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-06-25T04:40:23.558 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-06-25T04:40:23.559 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-06-25T04:40:23.606 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-06-25T04:40:23.648 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-06-25T04:40:23.703 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-06-25T04:40:23.705 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-06-25T04:40:23.748 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-06-25T04:40:23.791 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-06-25T04:40:23.845 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-06-25T04:40:23.846 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-06-25T04:40:23.893 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-06-25T04:40:23.942 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-06-25T04:40:23.993 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-06-25T04:40:23.995 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-06-25T04:40:24.039 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-06-25T04:40:24.082 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-06-25T04:40:24.137 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-06-25T04:40:24.139 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-06-25T04:40:24.183 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-06-25T04:40:24.227 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-06-25T04:40:24.275 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-06-25T04:40:24.297 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-06-25T04:40:24.331 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-06-25T04:40:24.373 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-06-25T04:40:24.430 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-06-25T04:40:24.439 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-06-25T04:40:24.476 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-06-25T04:40:24.530 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-06-25T04:40:24.584 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-06-25T04:40:24.621 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-06-25T04:40:24.672 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-06-25T04:40:24.756 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-06-25T04:40:24.826 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-06-25T04:40:24.866 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-06-25T04:40:24.964 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-06-25T04:40:24.968 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-06-25T04:40:24.973 INFO:teuthology.task.ansible.out: 2021-06-25T04:40:25.017 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-06-25T04:40:25.045 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-06-25T04:40:25.139 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-06-25T04:40:25.184 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-06-25T04:40:25.240 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-06-25T04:40:25.290 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-06-25T04:40:25.297 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-06-25T04:40:25.341 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-06-25T04:40:25.407 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-06-25T04:40:25.453 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-06-25T04:40:25.466 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-06-25T04:40:25.516 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-06-25T04:40:25.560 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-06-25T04:40:25.625 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-06-25T04:40:25.637 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-06-25T04:40:25.702 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-06-25T04:40:25.724 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-06-25T04:40:25.790 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-06-25T04:40:25.814 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-06-25T04:40:25.859 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-06-25T04:40:25.871 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-06-25T04:40:25.934 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-06-25T04:40:25.957 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-06-25T04:40:26.002 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-06-25T04:40:26.024 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-06-25T04:40:26.077 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-06-25T04:40:26.100 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-06-25T04:40:26.155 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-06-25T04:40:26.158 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-06-25T04:40:26.222 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-06-25T04:40:26.246 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-06-25T04:40:26.301 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-06-25T04:40:26.312 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-06-25T04:40:26.366 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-06-25T04:40:26.388 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-06-25T04:40:26.453 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-06-25T04:40:26.465 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-06-25T04:40:26.509 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-06-25T04:40:26.532 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-06-25T04:40:26.597 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-06-25T04:40:26.621 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-06-25T04:40:26.664 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-06-25T04:40:26.676 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-06-25T04:40:26.754 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-06-25T04:40:26.756 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-06-25T04:40:26.810 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-06-25T04:40:26.821 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-06-25T04:40:26.886 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-06-25T04:40:26.898 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-06-25T04:40:26.952 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-06-25T04:40:26.964 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-06-25T04:40:27.041 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-06-25T04:40:27.042 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-06-25T04:40:27.098 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-06-25T04:40:27.111 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-06-25T04:40:27.187 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-06-25T04:40:27.188 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-06-25T04:40:27.242 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-06-25T04:40:27.275 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-06-25T04:40:27.339 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-06-25T04:40:27.341 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-06-25T04:40:27.385 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-06-25T04:40:27.408 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-06-25T04:40:27.483 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-06-25T04:40:27.486 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-06-25T04:40:27.527 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-06-25T04:40:27.559 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-06-25T04:40:27.624 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-06-25T04:40:27.635 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-06-25T04:40:27.668 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-06-25T04:40:27.701 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-06-25T04:40:27.776 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-06-25T04:40:27.787 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-06-25T04:40:27.810 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-06-25T04:40:27.853 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-06-25T04:40:27.917 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-06-25T04:40:27.929 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-06-25T04:40:27.951 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-06-25T04:40:27.995 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-06-25T04:40:28.059 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-06-25T04:40:28.081 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-06-25T04:40:28.103 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-06-25T04:40:28.136 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-06-25T04:40:28.212 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-06-25T04:40:28.224 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-06-25T04:40:28.236 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-06-25T04:40:28.279 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-06-25T04:40:28.355 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-06-25T04:40:28.378 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-06-25T04:40:28.379 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-06-25T04:40:28.425 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-06-25T04:40:28.500 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-06-25T04:40:28.512 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-06-25T04:40:28.534 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-06-25T04:40:28.579 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-06-25T04:40:28.655 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-06-25T04:40:28.656 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-06-25T04:40:28.679 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-06-25T04:40:28.722 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-06-25T04:40:28.787 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-06-25T04:40:28.809 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-06-25T04:40:28.821 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-06-25T04:40:28.864 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-06-25T04:40:28.938 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-06-25T04:40:28.950 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-06-25T04:40:28.961 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-06-25T04:40:29.018 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-06-25T04:40:29.079 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-06-25T04:40:29.101 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-06-25T04:40:29.104 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-06-25T04:40:29.158 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-06-25T04:40:29.233 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-06-25T04:40:29.244 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-06-25T04:40:29.256 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-06-25T04:40:29.299 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-06-25T04:40:29.385 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-06-25T04:40:29.386 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-06-25T04:40:29.397 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-06-25T04:40:29.433 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-06-25T04:40:29.435 INFO:teuthology.task.ansible.out: 2021-06-25T04:40:29.530 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-06-25T04:40:29.531 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-06-25T04:40:29.543 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-06-25T04:40:29.576 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-06-25T04:40:29.672 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-06-25T04:40:29.674 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-06-25T04:40:29.695 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-06-25T04:40:29.718 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-06-25T04:40:29.814 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-06-25T04:40:29.826 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-06-25T04:40:29.849 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-06-25T04:40:29.871 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-06-25T04:40:29.959 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-06-25T04:40:29.971 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-06-25T04:40:29.993 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-06-25T04:40:30.015 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-06-25T04:40:30.100 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-06-25T04:40:30.112 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-06-25T04:40:30.145 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-06-25T04:40:30.157 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-06-25T04:40:30.242 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-06-25T04:40:30.254 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-06-25T04:40:30.286 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-06-25T04:40:30.298 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-06-25T04:40:30.394 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-06-25T04:40:30.406 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-06-25T04:40:30.439 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-06-25T04:40:30.451 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-06-25T04:40:30.538 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-06-25T04:40:30.549 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-06-25T04:40:30.592 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-06-25T04:40:30.594 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-06-25T04:40:30.691 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-06-25T04:40:30.737 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-06-25T04:40:30.823 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-06-25T04:40:30.835 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-06-25T04:40:30.879 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-06-25T04:40:30.880 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-06-25T04:40:30.966 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-06-25T04:40:30.979 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-06-25T04:40:31.024 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-06-25T04:40:31.036 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-06-25T04:40:31.112 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-06-25T04:40:31.123 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-06-25T04:40:31.166 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-06-25T04:40:31.178 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-06-25T04:40:31.254 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-06-25T04:40:31.266 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-06-25T04:40:31.309 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-06-25T04:40:31.321 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-06-25T04:40:31.407 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-06-25T04:40:31.419 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-06-25T04:40:31.463 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-06-25T04:40:31.550 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-06-25T04:40:31.562 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-06-25T04:40:31.605 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-06-25T04:40:31.606 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-06-25T04:40:31.692 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-06-25T04:40:31.709 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-06-25T04:40:31.742 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-06-25T04:40:31.753 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-06-25T04:40:31.848 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-06-25T04:40:31.850 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-06-25T04:40:31.892 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-06-25T04:40:31.894 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-06-25T04:40:31.989 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-06-25T04:40:31.990 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-06-25T04:40:32.034 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-06-25T04:40:32.046 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-06-25T04:40:32.131 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-06-25T04:40:32.133 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-06-25T04:40:32.186 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-06-25T04:40:32.189 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-06-25T04:40:32.273 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-06-25T04:40:32.274 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-06-25T04:40:32.329 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-06-25T04:40:32.341 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-06-25T04:40:32.419 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-06-25T04:40:32.422 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-06-25T04:40:32.478 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-06-25T04:40:32.491 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-06-25T04:40:32.566 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-06-25T04:40:32.567 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-06-25T04:40:32.622 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-06-25T04:40:32.634 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-06-25T04:40:32.720 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-06-25T04:40:32.721 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-06-25T04:40:32.763 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-06-25T04:40:32.786 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-06-25T04:40:32.863 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-06-25T04:40:32.864 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-06-25T04:40:32.918 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-06-25T04:40:32.929 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-06-25T04:40:33.004 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-06-25T04:40:33.005 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-06-25T04:40:33.058 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-06-25T04:40:33.091 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-06-25T04:40:33.144 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-06-25T04:40:33.160 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-06-25T04:40:33.203 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-06-25T04:40:33.237 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-06-25T04:40:33.302 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-06-25T04:40:33.303 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-06-25T04:40:33.356 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-06-25T04:40:33.379 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-06-25T04:40:33.443 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-06-25T04:40:33.455 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-06-25T04:40:33.498 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-06-25T04:40:33.532 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-06-25T04:40:33.586 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-06-25T04:40:33.598 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-06-25T04:40:33.631 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-06-25T04:40:33.674 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-06-25T04:40:33.728 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-06-25T04:40:33.740 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-06-25T04:40:33.783 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-06-25T04:40:33.816 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-06-25T04:40:33.869 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-06-25T04:40:33.880 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-06-25T04:40:33.923 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-06-25T04:40:33.966 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-06-25T04:40:34.020 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-06-25T04:40:34.031 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-06-25T04:40:34.064 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-06-25T04:40:34.118 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-06-25T04:40:34.161 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-06-25T04:40:34.173 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-06-25T04:40:34.216 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-06-25T04:40:34.259 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-06-25T04:40:34.314 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-06-25T04:40:34.357 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-06-25T04:40:34.400 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-06-25T04:40:34.454 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-06-25T04:40:34.455 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-06-25T04:40:34.498 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-06-25T04:40:34.551 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-06-25T04:40:34.594 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-06-25T04:40:34.607 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-06-25T04:40:34.642 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-06-25T04:40:34.695 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-06-25T04:40:34.738 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-06-25T04:40:34.749 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-06-25T04:40:34.782 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-06-25T04:40:34.846 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-06-25T04:40:34.878 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-06-25T04:40:34.900 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-06-25T04:40:34.923 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-06-25T04:40:34.998 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-06-25T04:40:35.021 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-06-25T04:40:35.043 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-06-25T04:40:35.076 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-06-25T04:40:35.140 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-06-25T04:40:35.163 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-06-25T04:40:35.186 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-06-25T04:40:35.229 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-06-25T04:40:35.292 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-06-25T04:40:35.314 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-06-25T04:40:35.326 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-06-25T04:40:35.432 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-06-25T04:40:35.579 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-06-25T04:40:35.809 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-06-25T04:40:35.852 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-06-25T04:40:35.941 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-06-25T04:40:36.303 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-06-25T04:40:36.336 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-06-25T04:40:36.338 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-06-25T04:40:36.411 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-06-25T04:40:36.779 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-06-25T04:40:36.811 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-06-25T04:40:36.833 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-06-25T04:40:36.962 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-06-25T04:40:37.276 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-06-25T04:40:37.288 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-06-25T04:40:37.373 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-06-25T04:40:37.499 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-06-25T04:40:37.795 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-06-25T04:40:37.807 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-06-25T04:40:37.958 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-06-25T04:40:38.074 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-06-25T04:40:38.254 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-06-25T04:40:38.317 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-06-25T04:40:38.497 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-06-25T04:40:38.592 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-06-25T04:40:38.783 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-06-25T04:40:38.836 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-06-25T04:40:39.080 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-06-25T04:40:39.103 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-06-25T04:40:39.262 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-06-25T04:40:39.284 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-06-25T04:40:39.599 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-06-25T04:40:39.697 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-06-25T04:40:39.720 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-06-25T04:40:39.772 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-06-25T04:40:40.141 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-06-25T04:40:40.197 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-06-25T04:40:40.246 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-06-25T04:40:40.296 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-06-25T04:40:40.666 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-06-25T04:40:40.677 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-06-25T04:40:40.781 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-06-25T04:40:40.834 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-06-25T04:40:41.111 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-06-25T04:40:41.165 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-06-25T04:40:41.366 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-06-25T04:40:41.419 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-06-25T04:40:41.662 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-06-25T04:40:41.695 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-06-25T04:40:41.855 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-06-25T04:40:41.961 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-06-25T04:40:42.140 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-06-25T04:40:42.267 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-06-25T04:40:42.520 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-06-25T04:40:42.521 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-06-25T04:40:42.629 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:42 +0000 (0:00:27.769) 0:00:37.816 *********** 2021-06-25T04:40:42.654 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:42 +0000 (0:00:00.024) 0:00:37.841 *********** 2021-06-25T04:40:42.678 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-06-25T04:40:42.796 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-06-25T04:40:42.821 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:42 +0000 (0:00:00.166) 0:00:38.007 *********** 2021-06-25T04:40:42.848 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:42 +0000 (0:00:00.026) 0:00:38.034 *********** 2021-06-25T04:40:42.874 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:42 +0000 (0:00:00.026) 0:00:38.060 *********** 2021-06-25T04:40:42.882 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-06-25T04:40:42.883 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-06-25T04:40:42.913 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-06-25T04:40:42.915 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-06-25T04:40:42.917 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-06-25T04:40:42.918 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-06-25T04:40:42.920 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-06-25T04:40:42.921 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99 2021-06-25T04:40:42.922 INFO:teuthology.task.ansible.out:bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-06-25T04:40:42.923 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-06-25T04:40:42.925 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-06-25T04:40:42.927 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-06-25T04:40:42.929 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-06-25T04:40:42.930 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-06-25T04:40:42.932 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-06-25T04:40:42.933 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0 2021-06-25T04:40:42.934 INFO:teuthology.task.ansible.out:fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-06-25T04:40:42.935 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-06-25T04:40:42.937 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}]}, "changed": false} 2021-06-25T04:40:42.937 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-06-25T04:40:42.964 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:42 +0000 (0:00:00.090) 0:00:38.151 *********** 2021-06-25T04:40:42.986 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:42 +0000 (0:00:00.021) 0:00:38.172 *********** 2021-06-25T04:40:42.995 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-06-25T04:40:42.997 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-06-25T04:40:42.999 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-06-25T04:40:43.001 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-06-25T04:40:43.002 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-06-25T04:40:43.004 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-06-25T04:40:43.005 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-06-25T04:40:43.007 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn" 2021-06-25T04:40:43.008 INFO:teuthology.task.ansible.out:: "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-06-25T04:40:43.009 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-06-25T04:40:43.011 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-06-25T04:40:43.013 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-06-25T04:40:43.014 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e104 2021-06-25T04:40:43.015 INFO:teuthology.task.ansible.out:6655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-06-25T04:40:43.017 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-06-25T04:40:43.018 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-06-25T04:40:43.020 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}]}, "changed": false} 2021-06-25T04:40:43.046 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:43 +0000 (0:00:00.060) 0:00:38.233 *********** 2021-06-25T04:40:43.088 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-06-25T04:40:43.090 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-06-25T04:40:43.092 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-06-25T04:40:43.094 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-06-25T04:40:43.095 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang 2021-06-25T04:40:43.096 INFO:teuthology.task.ansible.out:@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-06-25T04:40:43.098 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-06-25T04:40:43.100 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-06-25T04:40:43.102 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-06-25T04:40:43.104 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-06-25T04:40:43.105 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-06-25T04:40:43.107 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c 2021-06-25T04:40:43.108 INFO:teuthology.task.ansible.out:74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-06-25T04:40:43.109 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-06-25T04:40:43.111 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-06-25T04:40:43.113 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}]}, "changed": false} 2021-06-25T04:40:43.139 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:43 +0000 (0:00:00.093) 0:00:38.326 *********** 2021-06-25T04:40:43.391 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-06-25T04:40:43.566 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:43 +0000 (0:00:00.426) 0:00:38.753 *********** 2021-06-25T04:40:43.640 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-06-25T04:40:43.663 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:43 +0000 (0:00:00.096) 0:00:38.849 *********** 2021-06-25T04:40:43.755 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-06-25T04:40:43.758 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-06-25T04:40:43.760 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-06-25T04:40:43.761 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-06-25T04:40:43.763 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-06-25T04:40:43.765 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-06-25T04:40:43.766 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-06-25T04:40:43.768 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn" 2021-06-25T04:40:43.769 INFO:teuthology.task.ansible.out:: "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw 2021-06-25T04:40:43.771 INFO:teuthology.task.ansible.out: b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {" 2021-06-25T04:40:43.773 INFO:teuthology.task.ansible.out:name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr 2021-06-25T04:40:43.774 INFO:teuthology.task.ansible.out:@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e104 2021-06-25T04:40:43.775 INFO:teuthology.task.ansible.out:6655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": 2021-06-25T04:40:43.776 INFO:teuthology.task.ansible.out: "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809 2021-06-25T04:40:43.778 INFO:teuthology.task.ansible.out:f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmu 2021-06-25T04:40:43.780 INFO:teuthology.task.ansible.out:njulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b 2021-06-25T04:40:43.781 INFO:teuthology.task.ansible.out:8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}]}, "changed": false} 2021-06-25T04:40:43.803 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:43 +0000 (0:00:00.140) 0:00:38.990 *********** 2021-06-25T04:40:43.874 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi087.front.sepia.ceph.com] => {"after": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "attempts": 1, "before": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "changed": false, "remote_url_changed": false} 2021-06-25T04:40:43.901 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:43 +0000 (0:00:00.098) 0:00:39.088 *********** 2021-06-25T04:40:43.910 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"after": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "attempts": 1, "before": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "changed": false, "remote_url_changed": false} 2021-06-25T04:40:43.912 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"after": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "attempts": 1, "before": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "changed": false, "remote_url_changed": false} 2021-06-25T04:40:43.938 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:43 +0000 (0:00:00.036) 0:00:39.125 *********** 2021-06-25T04:40:43.964 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:43 +0000 (0:00:00.024) 0:00:39.149 *********** 2021-06-25T04:40:44.160 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-06-25T04:40:44.162 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-06-25T04:40:44.183 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-06-25T04:40:44.216 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-06-25T04:40:44.313 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-06-25T04:40:44.315 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-06-25T04:40:44.348 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-06-25T04:40:44.422 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-06-25T04:40:44.424 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"after": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "attempts": 1, "before": "afed858f288ae8da2ecacf54fe96e9ad3d2a9e89", "changed": false, "remote_url_changed": false} 2021-06-25T04:40:44.446 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:40:44 +0000 (0:00:00.483) 0:00:39.633 *********** 2021-06-25T04:40:44.453 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-06-25T04:40:44.454 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-06-25T04:40:44.456 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-06-25T04:40:44.491 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-06-25T04:40:44.592 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-06-25T04:40:44.594 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-06-25T04:40:44.616 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-06-25T04:40:44.618 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-06-25T04:40:44.628 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-06-25T04:40:44.630 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-06-25T04:40:44.692 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-06-25T04:40:44.746 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-06-25T04:40:44.763 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-06-25T04:40:44.786 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-06-25T04:40:44.822 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-06-25T04:40:44.885 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-06-25T04:40:44.886 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-06-25T04:40:44.897 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-06-25T04:40:44.898 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-06-25T04:40:44.918 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-06-25T04:40:44.920 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-06-25T04:40:44.961 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-06-25T04:40:45.026 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-06-25T04:40:45.037 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-06-25T04:40:45.048 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-06-25T04:40:45.091 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-06-25T04:40:45.093 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-06-25T04:40:45.154 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-06-25T04:40:45.176 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-06-25T04:40:45.177 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-06-25T04:40:45.220 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-06-25T04:40:45.294 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-06-25T04:40:45.306 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:45.307 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-06-25T04:40:45.319 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-06-25T04:40:45.320 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:45.321 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:45.355 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-06-25T04:40:45.356 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-06-25T04:40:45.440 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-06-25T04:40:45.443 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAA 2021-06-25T04:40:45.445 INFO:teuthology.task.ansible.out:ADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-06-25T04:40:45.463 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-06-25T04:40:45.465 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-06-25T04:40:45.496 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-06-25T04:40:45.570 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-06-25T04:40:45.572 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-06-25T04:40:45.581 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:45.583 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:45.593 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-06-25T04:40:45.595 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-06-25T04:40:45.604 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:45.605 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-06-25T04:40:45.607 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:45.617 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:45.619 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:45.629 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-06-25T04:40:45.715 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-06-25T04:40:45.747 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-06-25T04:40:45.758 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-06-25T04:40:45.759 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-06-25T04:40:45.760 INFO:teuthology.task.ansible.out: 2021-06-25T04:40:45.771 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:45.856 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-06-25T04:40:45.858 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-06-25T04:40:45.877 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-06-25T04:40:45.879 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-06-25T04:40:45.899 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-06-25T04:40:45.901 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14 2021-06-25T04:40:45.902 INFO:teuthology.task.ansible.out:+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-06-25T04:40:45.986 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-06-25T04:40:46.010 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-06-25T04:40:46.032 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-06-25T04:40:46.034 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-06-25T04:40:46.035 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-06-25T04:40:46.044 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:46.046 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:40:46.122 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-06-25T04:40:46.124 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-06-25T04:40:46.144 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-06-25T04:40:46.145 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-06-25T04:40:46.178 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-06-25T04:40:46.182 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-06-25T04:40:46.189 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-06-25T04:40:46.245 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-06-25T04:40:46.267 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-06-25T04:40:46.268 INFO:teuthology.task.ansible.out: 2021-06-25T04:40:46.300 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-06-25T04:40:46.322 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-06-25T04:40:46.324 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-06-25T04:40:46.387 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-06-25T04:40:46.399 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-06-25T04:40:46.432 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-06-25T04:40:46.454 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-06-25T04:40:46.517 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-06-25T04:40:46.529 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-06-25T04:40:46.574 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-06-25T04:40:46.586 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-06-25T04:40:46.588 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-06-25T04:40:46.650 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-06-25T04:40:46.652 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-06-25T04:40:46.672 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-06-25T04:40:46.674 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-06-25T04:40:46.706 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-06-25T04:40:46.707 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-06-25T04:40:46.718 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-06-25T04:40:46.772 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-06-25T04:40:46.774 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-06-25T04:40:46.815 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-06-25T04:40:46.817 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-06-25T04:40:46.848 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-06-25T04:40:46.849 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-06-25T04:40:46.859 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-06-25T04:40:46.912 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-06-25T04:40:46.934 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-06-25T04:40:46.977 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-06-25T04:40:46.988 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-06-25T04:40:47.041 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-06-25T04:40:47.073 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-06-25T04:40:47.105 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-06-25T04:40:47.126 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-06-25T04:40:47.128 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-06-25T04:40:47.171 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-06-25T04:40:47.173 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-06-25T04:40:47.203 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-06-25T04:40:47.204 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-06-25T04:40:47.236 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-06-25T04:40:47.238 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-06-25T04:40:47.259 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-06-25T04:40:47.260 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-06-25T04:40:47.311 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-06-25T04:40:47.334 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-06-25T04:40:47.376 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-06-25T04:40:47.398 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-06-25T04:40:47.453 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-06-25T04:40:47.474 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-06-25T04:40:47.518 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-06-25T04:40:47.540 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-06-25T04:40:47.572 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-06-25T04:40:47.616 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-06-25T04:40:47.648 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-06-25T04:40:47.670 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-06-25T04:40:47.672 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-06-25T04:40:47.704 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-06-25T04:40:47.736 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-06-25T04:40:47.780 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-06-25T04:40:47.812 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-06-25T04:40:47.846 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-06-25T04:40:47.868 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-06-25T04:40:47.911 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-06-25T04:40:47.943 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-06-25T04:40:47.975 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-06-25T04:40:47.978 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-06-25T04:40:47.999 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-06-25T04:40:48.001 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-06-25T04:40:48.064 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-06-25T04:40:48.065 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-06-25T04:40:48.076 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-06-25T04:40:48.108 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-06-25T04:40:48.131 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-06-25T04:40:48.189 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-06-25T04:40:48.210 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-06-25T04:40:48.243 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-06-25T04:40:48.264 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-06-25T04:40:48.318 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-06-25T04:40:48.340 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-06-25T04:40:48.372 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-06-25T04:40:48.394 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-06-25T04:40:48.458 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-06-25T04:40:48.470 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-06-25T04:40:48.472 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-06-25T04:40:48.513 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-06-25T04:40:48.524 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-06-25T04:40:48.588 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-06-25T04:40:48.599 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-06-25T04:40:48.652 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-06-25T04:40:48.654 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-06-25T04:40:48.727 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-06-25T04:40:48.749 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-06-25T04:40:48.781 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-06-25T04:40:48.783 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-06-25T04:40:48.856 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-06-25T04:40:48.878 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-06-25T04:40:48.911 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-06-25T04:40:48.913 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-06-25T04:40:48.998 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-06-25T04:40:49.010 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-06-25T04:40:49.043 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-06-25T04:40:49.054 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-06-25T04:40:49.055 INFO:teuthology.task.ansible.out: 2021-06-25T04:40:49.129 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-06-25T04:40:49.140 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-06-25T04:40:49.172 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-06-25T04:40:49.174 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-06-25T04:40:49.184 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-06-25T04:40:49.185 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-06-25T04:40:49.258 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-06-25T04:40:49.260 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-06-25T04:40:49.280 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-06-25T04:40:49.302 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-06-25T04:40:49.304 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-06-25T04:40:49.313 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-06-25T04:40:49.314 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-06-25T04:40:49.388 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-06-25T04:40:49.389 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-06-25T04:40:49.409 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-06-25T04:40:49.431 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-06-25T04:40:49.453 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-06-25T04:40:49.527 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-06-25T04:40:49.538 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-06-25T04:40:49.560 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-06-25T04:40:49.583 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-06-25T04:40:49.662 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-06-25T04:40:49.674 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-06-25T04:40:49.676 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-06-25T04:40:49.707 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-06-25T04:40:49.708 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-06-25T04:40:49.782 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-06-25T04:40:49.805 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-06-25T04:40:49.807 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-06-25T04:40:49.838 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-06-25T04:40:49.839 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrS 2021-06-25T04:40:49.841 INFO:teuthology.task.ansible.out:oc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-06-25T04:40:49.916 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-06-25T04:40:49.918 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-06-25T04:40:49.937 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-06-25T04:40:49.970 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-06-25T04:40:49.972 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-06-25T04:40:49.974 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMS 2021-06-25T04:40:49.975 INFO:teuthology.task.ansible.out:woj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf 2021-06-25T04:40:49.977 INFO:teuthology.task.ansible.out:53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-06-25T04:40:50.059 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-06-25T04:40:50.061 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-06-25T04:40:50.063 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-06-25T04:40:50.069 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-06-25T04:40:50.102 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-06-25T04:40:50.106 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-06-25T04:40:50.190 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-06-25T04:40:50.202 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-06-25T04:40:50.234 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-06-25T04:40:50.266 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-06-25T04:40:50.330 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-06-25T04:40:50.331 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-06-25T04:40:50.334 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-06-25T04:40:50.374 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-06-25T04:40:50.396 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-06-25T04:40:50.465 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-06-25T04:40:50.489 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-06-25T04:40:50.491 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-06-25T04:40:50.494 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-06-25T04:40:50.502 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-06-25T04:40:50.561 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-06-25T04:40:50.596 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-06-25T04:40:50.670 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-06-25T04:40:50.687 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-06-25T04:40:50.700 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-06-25T04:40:50.731 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-06-25T04:40:50.806 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-06-25T04:40:50.817 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-06-25T04:40:50.819 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-06-25T04:40:50.842 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-06-25T04:40:50.844 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-06-25T04:40:50.864 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-06-25T04:40:50.866 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-06-25T04:40:50.928 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-06-25T04:40:50.949 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-06-25T04:40:50.971 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-06-25T04:40:50.993 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-06-25T04:40:51.067 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-06-25T04:40:51.078 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-06-25T04:40:51.110 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-06-25T04:40:51.132 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-06-25T04:40:51.207 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-06-25T04:40:51.218 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-06-25T04:40:51.219 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-06-25T04:40:51.241 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-06-25T04:40:51.242 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-06-25T04:40:51.263 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-06-25T04:40:51.265 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-06-25T04:40:51.337 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-06-25T04:40:51.339 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-06-25T04:40:51.348 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-06-25T04:40:51.370 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-06-25T04:40:51.403 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-06-25T04:40:51.469 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-06-25T04:40:51.481 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-06-25T04:40:51.503 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-06-25T04:40:51.547 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-06-25T04:40:51.622 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-06-25T04:40:51.624 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-06-25T04:40:51.645 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-06-25T04:40:51.647 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-06-25T04:40:51.666 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-06-25T04:40:51.668 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-06-25T04:40:51.752 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-06-25T04:40:51.753 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-06-25T04:40:51.785 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-06-25T04:40:51.807 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-06-25T04:40:51.891 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-06-25T04:40:51.893 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-06-25T04:40:51.894 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-06-25T04:40:51.913 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-06-25T04:40:52.020 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-06-25T04:40:52.022 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-06-25T04:40:52.043 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-06-25T04:40:52.097 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-06-25T04:40:52.151 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-06-25T04:40:52.153 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-06-25T04:40:52.230 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-06-25T04:40:52.284 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-06-25T04:40:52.286 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-06-25T04:40:52.306 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-06-25T04:40:52.317 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-06-25T04:40:52.361 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-06-25T04:40:52.426 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-06-25T04:40:52.448 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-06-25T04:40:52.459 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-06-25T04:40:52.503 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-06-25T04:40:52.556 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-06-25T04:40:52.578 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-06-25T04:40:52.589 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-06-25T04:40:52.643 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-06-25T04:40:52.687 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-06-25T04:40:52.720 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-06-25T04:40:52.775 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-06-25T04:40:52.828 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-06-25T04:40:52.840 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-06-25T04:40:52.862 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-06-25T04:40:52.907 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-06-25T04:40:52.961 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-06-25T04:40:52.973 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-06-25T04:40:52.995 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-06-25T04:40:53.038 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-06-25T04:40:53.126 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-06-25T04:40:53.128 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-06-25T04:40:53.185 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-06-25T04:40:53.261 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-06-25T04:40:53.263 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-06-25T04:40:53.265 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-06-25T04:40:53.318 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-06-25T04:40:53.394 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-06-25T04:40:53.395 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-06-25T04:40:53.407 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-06-25T04:40:53.462 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-06-25T04:40:53.531 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-06-25T04:40:53.541 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-06-25T04:40:53.596 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-06-25T04:40:53.663 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-06-25T04:40:53.665 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-06-25T04:40:53.677 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-06-25T04:40:53.742 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-06-25T04:40:53.785 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-06-25T04:40:53.796 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-06-25T04:40:53.818 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-06-25T04:40:53.873 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-06-25T04:40:53.916 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-06-25T04:40:53.938 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-06-25T04:40:53.960 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-06-25T04:40:54.014 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-06-25T04:40:54.048 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-06-25T04:40:54.092 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-06-25T04:40:54.103 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-06-25T04:40:54.146 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-06-25T04:40:54.180 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-06-25T04:40:54.224 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-06-25T04:40:54.236 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-06-25T04:40:54.268 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-06-25T04:40:54.333 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-06-25T04:40:54.355 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-06-25T04:40:54.366 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-06-25T04:40:54.409 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-06-25T04:40:54.484 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-06-25T04:40:54.486 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-06-25T04:40:54.507 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-06-25T04:40:54.540 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-06-25T04:40:54.614 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-06-25T04:40:54.616 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-06-25T04:40:54.638 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-06-25T04:40:54.640 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-06-25T04:40:54.671 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-06-25T04:40:54.673 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-06-25T04:40:54.756 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-06-25T04:40:54.757 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-06-25T04:40:54.769 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-06-25T04:40:54.801 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-06-25T04:40:54.880 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-06-25T04:40:54.891 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-06-25T04:40:54.902 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-06-25T04:40:54.935 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-06-25T04:40:55.008 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-06-25T04:40:55.020 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-06-25T04:40:55.032 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-06-25T04:40:55.064 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-06-25T04:40:55.151 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-06-25T04:40:55.153 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-06-25T04:40:55.162 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-06-25T04:40:55.206 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-06-25T04:40:55.281 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-06-25T04:40:55.283 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-06-25T04:40:55.284 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-06-25T04:40:55.293 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-06-25T04:40:55.294 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-06-25T04:40:55.337 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-06-25T04:40:55.339 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-06-25T04:40:55.412 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-06-25T04:40:55.414 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-06-25T04:40:55.435 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-06-25T04:40:55.437 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-06-25T04:40:55.468 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-06-25T04:40:55.470 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-06-25T04:40:55.554 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-06-25T04:40:55.566 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-06-25T04:40:55.568 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-06-25T04:40:55.601 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-06-25T04:40:55.727 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-06-25T04:40:55.749 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-06-25T04:40:55.762 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-06-25T04:40:55.773 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-06-25T04:40:55.858 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-06-25T04:40:55.903 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-06-25T04:40:55.905 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-06-25T04:40:55.905 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnI 2021-06-25T04:40:55.907 INFO:teuthology.task.ansible.out:iYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-06-25T04:40:56.001 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-06-25T04:40:56.034 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-06-25T04:40:56.036 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-06-25T04:40:56.046 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-06-25T04:40:56.132 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-06-25T04:40:56.164 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-06-25T04:40:56.165 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-06-25T04:40:56.176 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-06-25T04:40:56.263 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-06-25T04:40:56.295 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-06-25T04:40:56.297 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-06-25T04:40:56.307 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-06-25T04:40:56.394 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-06-25T04:40:56.428 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-06-25T04:40:56.439 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-06-25T04:40:56.450 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-06-25T04:40:56.525 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-06-25T04:40:56.527 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-06-25T04:40:56.568 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-06-25T04:40:56.570 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLg 2021-06-25T04:40:56.572 INFO:teuthology.task.ansible.out:SjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.local", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-06-25T04:40:56.580 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-06-25T04:40:56.665 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-06-25T04:40:56.709 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-06-25T04:40:56.710 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-06-25T04:40:56.721 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-06-25T04:40:56.796 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-06-25T04:40:56.839 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": 2021-06-25T04:40:56.841 INFO:teuthology.task.ansible.out: "present", "user": "rfriedma", "validate_certs": true} 2021-06-25T04:40:56.851 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-06-25T04:40:56.927 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-06-25T04:40:56.970 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-06-25T04:40:56.971 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-06-25T04:40:56.983 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-06-25T04:40:57.058 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-06-25T04:40:57.100 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-06-25T04:40:57.112 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-06-25T04:40:57.114 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-06-25T04:40:57.197 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-06-25T04:40:57.229 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-06-25T04:40:57.241 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-06-25T04:40:57.252 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-06-25T04:40:57.326 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-06-25T04:40:57.358 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-06-25T04:40:57.370 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-06-25T04:40:57.381 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-06-25T04:40:57.456 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-06-25T04:40:57.458 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-06-25T04:40:57.500 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-06-25T04:40:57.502 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-06-25T04:40:57.511 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-06-25T04:40:57.513 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-06-25T04:40:57.523 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-06-25T04:40:57.586 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-06-25T04:40:57.629 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-06-25T04:40:57.651 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-06-25T04:40:57.652 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-06-25T04:40:57.726 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-06-25T04:40:57.758 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-06-25T04:40:57.780 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-06-25T04:40:57.782 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-06-25T04:40:57.855 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-06-25T04:40:57.918 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-06-25T04:40:57.919 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-06-25T04:40:57.920 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-06-25T04:40:57.983 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-06-25T04:40:58.048 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-06-25T04:40:58.049 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2021-06-25T04:40:58.051 INFO:teuthology.task.ansible.out:": "mgfritch", "validate_certs": true} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-06-25T04:40:58.123 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-06-25T04:40:58.176 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-06-25T04:40:58.177 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-06-25T04:40:58.178 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs 2021-06-25T04:40:58.180 INFO:teuthology.task.ansible.out:": true} 2021-06-25T04:40:58.242 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-06-25T04:40:58.306 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-06-25T04:40:58.308 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-06-25T04:40:58.320 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-06-25T04:40:58.384 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-06-25T04:40:58.437 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-06-25T04:40:58.448 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-06-25T04:40:58.449 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-06-25T04:40:58.515 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-06-25T04:40:58.578 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-06-25T04:40:58.580 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-06-25T04:40:58.592 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-06-25T04:40:58.645 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-06-25T04:40:58.708 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-06-25T04:40:58.720 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-06-25T04:40:58.731 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-06-25T04:40:58.774 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-06-25T04:40:58.838 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-06-25T04:40:58.849 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-06-25T04:40:58.860 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-06-25T04:40:58.910 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-06-25T04:40:58.974 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-06-25T04:40:58.986 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-06-25T04:40:58.987 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-06-25T04:40:59.053 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-06-25T04:40:59.108 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-06-25T04:40:59.119 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-06-25T04:40:59.121 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-06-25T04:40:59.195 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-06-25T04:40:59.238 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-06-25T04:40:59.250 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-06-25T04:40:59.261 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-06-25T04:40:59.337 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-06-25T04:40:59.369 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-06-25T04:40:59.391 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-06-25T04:40:59.403 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-06-25T04:40:59.469 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-06-25T04:40:59.501 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-06-25T04:40:59.523 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-06-25T04:40:59.535 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-06-25T04:40:59.599 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-06-25T04:40:59.632 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-06-25T04:40:59.654 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-06-25T04:40:59.666 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-06-25T04:40:59.730 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-06-25T04:40:59.763 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-06-25T04:40:59.785 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-06-25T04:40:59.807 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-06-25T04:40:59.882 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-06-25T04:40:59.895 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-06-25T04:40:59.927 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-06-25T04:40:59.939 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-06-25T04:41:00.025 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-06-25T04:41:00.027 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFT 2021-06-25T04:41:00.028 INFO:teuthology.task.ansible.out:Vsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-06-25T04:41:00.070 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-06-25T04:41:00.072 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-06-25T04:41:00.153 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-06-25T04:41:00.175 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-06-25T04:41:00.198 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-06-25T04:41:00.209 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-06-25T04:41:00.285 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-06-25T04:41:00.297 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-06-25T04:41:00.350 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-06-25T04:41:00.352 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-06-25T04:41:00.415 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-06-25T04:41:00.437 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-06-25T04:41:00.483 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-06-25T04:41:00.495 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-06-25T04:41:00.570 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-06-25T04:41:00.572 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-06-25T04:41:00.625 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-06-25T04:41:00.627 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-06-25T04:41:00.637 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-06-25T04:41:00.704 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-06-25T04:41:00.716 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-06-25T04:41:00.773 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-06-25T04:41:00.784 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-06-25T04:41:00.871 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-06-25T04:41:00.905 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-06-25T04:41:00.940 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-06-25T04:41:00.941 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-06-25T04:41:01.030 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-06-25T04:41:01.076 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-06-25T04:41:01.089 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-06-25T04:41:01.112 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-06-25T04:41:01.169 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-06-25T04:41:01.224 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-06-25T04:41:01.237 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-06-25T04:41:01.269 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-06-25T04:41:01.302 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-06-25T04:41:01.367 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-06-25T04:41:01.379 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-06-25T04:41:01.413 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-06-25T04:41:01.449 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-06-25T04:41:01.500 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-06-25T04:41:01.522 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-06-25T04:41:01.566 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-06-25T04:41:01.577 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-06-25T04:41:01.641 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-06-25T04:41:01.663 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-06-25T04:41:01.696 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-06-25T04:41:01.707 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-06-25T04:41:01.773 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-06-25T04:41:01.794 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-06-25T04:41:01.827 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-06-25T04:41:01.838 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-06-25T04:41:01.903 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-06-25T04:41:01.935 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-06-25T04:41:01.968 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-06-25T04:41:01.979 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-06-25T04:41:02.034 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-06-25T04:41:02.068 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-06-25T04:41:02.101 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-06-25T04:41:02.113 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-06-25T04:41:02.168 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-06-25T04:41:02.200 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-06-25T04:41:02.233 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-06-25T04:41:02.255 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-06-25T04:41:02.310 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-06-25T04:41:02.366 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-06-25T04:41:02.367 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-06-25T04:41:02.402 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-06-25T04:41:02.404 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-06-25T04:41:02.445 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-06-25T04:41:02.447 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-06-25T04:41:02.499 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-06-25T04:41:02.500 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-06-25T04:41:02.502 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-06-25T04:41:02.522 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-06-25T04:41:02.575 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-06-25T04:41:02.640 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-06-25T04:41:02.642 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-06-25T04:41:02.652 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-06-25T04:41:02.712 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-06-25T04:41:02.767 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-06-25T04:41:02.777 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-06-25T04:41:02.789 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-06-25T04:41:02.843 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-06-25T04:41:02.908 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3n 2021-06-25T04:41:02.910 INFO:teuthology.task.ansible.out:H7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-06-25T04:41:02.920 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-06-25T04:41:02.976 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-06-25T04:41:03.039 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-06-25T04:41:03.051 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-06-25T04:41:03.053 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-06-25T04:41:03.072 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-06-25T04:41:03.116 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-06-25T04:41:03.170 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-06-25T04:41:03.181 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-06-25T04:41:03.195 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-06-25T04:41:03.239 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-06-25T04:41:03.303 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-06-25T04:41:03.315 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-06-25T04:41:03.326 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-06-25T04:41:03.380 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-06-25T04:41:03.434 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-06-25T04:41:03.445 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-06-25T04:41:03.456 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-06-25T04:41:03.512 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-06-25T04:41:03.565 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-06-25T04:41:03.588 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-06-25T04:41:03.643 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-06-25T04:41:03.707 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-06-25T04:41:03.708 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-06-25T04:41:03.719 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-06-25T04:41:03.773 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-06-25T04:41:03.847 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-06-25T04:41:03.849 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-06-25T04:41:03.861 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-06-25T04:41:03.905 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-06-25T04:41:03.980 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-06-25T04:41:03.981 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-06-25T04:41:03.993 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-06-25T04:41:04.037 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-06-25T04:41:04.112 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-06-25T04:41:04.114 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-06-25T04:41:04.145 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/Gyl/Xhn6OJ6mdvGv0a7LUMeEU6xDfecjod/OUf8yBFFLm/h0AMifHH8qQYoH9SkeUthXIggbi0fcx9nrgyqYgLOansWiEIPbBbVCpvBz1vT1UR0Bxg6B7bjcrMgKg3M1YhTiHt41PlxdW/nlhTlxyZ1+nM50Fu/WE1+4nVIUaTtyaKv8PnmLmnpDnNly9X9CPDyilx8xpNiZMTv7oaiilCIfnmrKaZEDuvpU0M6h5wa6wJCatxTGIt/RQo2c4/YL+Nmx0xkouoRwR1H6swhkZPbInFgy/IlmLuu+owFR5mCVdxmst04o18CyvlW//Wiepw/5uJA3Xivcu1hwwcesTO+xJgIQbM/hvJ/UmL/eJvnV9G9g1B7ttrVfITbYgXZ1gbtP4pJCUmq132o6q+qeyOsGl2k5f/rRl5Adch5lzepffSSfsYn2tS77b7uXf3ujGvwhlOwJRITRCDZ4nGFwijFwBg8ptFKTaXZsXjMQRtSP2kuHoRonmOm1XbD4ElM= root@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-06-25T04:41:04.200 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/Gyl/Xhn6OJ6mdvGv0a7LUMeEU6xDfecjod/OUf8yBFFLm/h0AMifHH8qQYoH9SkeUthXIggbi0fcx9nrgyqYgLOansWiEIPbBbVCpvBz1vT1UR0Bxg6B7bjcrMgKg3M1YhTiHt41PlxdW/nlhTlxyZ1+nM50Fu/WE1+4nVIUaTtyaKv8PnmLmnpDnNly9X9CPDyilx8xpNiZMTv7oaiilCIfnmrKaZEDuvpU0M6h5wa6wJCatxTGIt/RQo2c4/YL+Nmx0xkouoRwR1H6swhkZPbInFgy/IlmLuu+owFR5mCVdxmst04o18CyvlW//Wiepw/5uJA3Xivcu1hwwcesTO+xJgIQbM/hvJ/UmL/eJvnV9G9g1B7ttrVfITbYgXZ1gbtP4pJCUmq132o6q+qeyOsGl2k5f/rRl5Adch5lzepffSSfsYn2tS77b7uXf3ujGvwhlOwJRITRCDZ4nGFwijFwBg8ptFKTaXZsXjMQRtSP2kuHoRonmOm1XbD4ElM= root@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-06-25T04:41:04.244 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-06-25T04:41:04.277 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/Gyl/Xhn6OJ6mdvGv0a7LUMeEU6xDfecjod/OUf8yBFFLm/h0AMifHH8qQYoH9SkeUthXIggbi0fcx9nrgyqYgLOansWiEIPbBbVCpvBz1vT1UR0Bxg6B7bjcrMgKg3M1YhTiHt41PlxdW/nlhTlxyZ1+nM50Fu/WE1+4nVIUaTtyaKv8PnmLmnpDnNly9X9CPDyilx8xpNiZMTv7oaiilCIfnmrKaZEDuvpU0M6h5wa6wJCatxTGIt/RQo2c4/YL+Nmx0xkouoRwR1H6swhkZPbInFgy/IlmLuu+owFR5mCVdxmst04o18CyvlW//Wiepw/5uJA3Xivcu1hwwcesTO+xJgIQbM/hvJ/UmL/eJvnV9G9g1B7ttrVfITbYgXZ1gbtP4pJCUmq132o6q+qeyOsGl2k5f/rRl5Adch5lzepffSSfsYn2tS77b7uXf3ujGvwhlOwJRITRCDZ4nGFwijFwBg8ptFKTaXZsXjMQRtSP2kuHoRonmOm1XbD4ElM= root@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-06-25T04:41:04.279 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-06-25T04:41:04.335 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-06-25T04:41:04.378 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-06-25T04:41:04.410 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-06-25T04:41:04.411 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-06-25T04:41:04.484 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-06-25T04:41:04.611 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:04 +0000 (0:00:20.164) 0:00:59.798 *********** 2021-06-25T04:41:04.673 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28F 2021-06-25T04:41:04.675 INFO:teuthology.task.ansible.out:oYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-06-25T04:41:04.723 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-06-25T04:41:04.725 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.726 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6 2021-06-25T04:41:04.727 INFO:teuthology.task.ansible.out:/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.753 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:04 +0000 (0:00:00.141) 0:00:59.940 *********** 2021-06-25T04:41:04.778 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:04 +0000 (0:00:00.024) 0:00:59.964 *********** 2021-06-25T04:41:04.786 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.788 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.789 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.790 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-06-25T04:41:04.790 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/Gyl/Xhn6OJ6mdvGv0a7LUMeEU6xDfecjod/OUf8yBFFLm/h0AMifHH8qQYoH9SkeUthXIggbi0fcx9nrgyqYgLOansWiEIPbBbVCpvBz1vT1UR0Bxg6B7bjcrMgKg3M1YhTiHt41PlxdW/nlhTlxyZ1+nM50Fu/WE1+4nVIUaTtyaKv8PnmLmnpDnNly9X9CPDyilx8xpNiZMTv7oaiilCIfnmrKaZEDuvpU0M6h5wa6wJCatxTGIt/RQo2c4/YL+Nmx0xkouoRwR1H6swhkZPbInFgy/IlmLuu+owFR5mCVdxmst04o18CyvlW//Wiepw/5uJA3Xivcu1hwwcesTO+xJgIQbM/hvJ/UmL/eJvnV9G9g1B7ttrVfITbYgXZ1gbtP4pJCUmq132o6q+qeyOsGl2k5f/rRl5Adch5lzepffSSfsYn2tS77b7uXf3ujGvwhlOwJRITRCDZ4nGFwijFwBg8ptFKTaXZsXjMQRtSP2kuHoRonmOm1XbD4ElM= root@omri", "key_options": null, "keyfile": "/home/oz 2021-06-25T04:41:04.792 INFO:teuthology.task.ansible.out:eneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-06-25T04:41:04.841 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.852 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.854 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.864 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.866 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.876 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.878 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.888 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.889 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-06-25T04:41:04.890 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiM 2021-06-25T04:41:04.892 INFO:teuthology.task.ansible.out:whNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.902 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.905 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.914 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.916 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:04.928 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.037 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-06-25T04:41:05.049 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-06-25T04:41:05.050 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-06-25T04:41:05.050 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-06-25T04:41:05.051 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-06-25T04:41:05.051 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e2 2021-06-25T04:41:05.052 INFO:teuthology.task.ansible.out:94f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.067 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-06-25T04:41:05.069 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.086 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-06-25T04:41:05.120 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-06-25T04:41:05.122 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.144 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:05 +0000 (0:00:00.366) 0:01:00.331 *********** 2021-06-25T04:41:05.167 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-06-25T04:41:05.178 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.180 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.190 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.191 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d 2021-06-25T04:41:05.193 INFO:teuthology.task.ansible.out:2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.202 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.204 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) 2021-06-25T04:41:05.206 INFO:teuthology.task.ansible.out: => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.215 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.217 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.227 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.228 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.229 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.240 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.241 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False" 2021-06-25T04:41:05.243 INFO:teuthology.task.ansible.out:} 2021-06-25T04:41:05.252 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.253 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.253 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.265 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.265 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.266 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.266 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.277 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.279 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.290 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.301 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.303 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.313 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.324 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.326 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-06-25T04:41:05.336 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.338 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyW 2021-06-25T04:41:05.340 INFO:teuthology.task.ansible.out:uyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970 2021-06-25T04:41:05.341 INFO:teuthology.task.ansible.out:beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.350 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.352 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@la 2021-06-25T04:41:05.354 INFO:teuthology.task.ansible.out:ptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0 2021-06-25T04:41:05.356 INFO:teuthology.task.ansible.out:887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.364 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.366 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.366 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.367 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.377 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.379 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.380 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b00 2021-06-25T04:41:05.382 INFO:teuthology.task.ansible.out:94e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.391 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.393 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.393 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349d 2021-06-25T04:41:05.395 INFO:teuthology.task.ansible.out:e108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.405 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.406 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.407 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.407 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.407 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 2021-06-25T04:41:05.410 INFO:teuthology.task.ansible.out:NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditiona 2021-06-25T04:41:05.411 INFO:teuthology.task.ansible.out:l result was False"} 2021-06-25T04:41:05.419 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.421 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.432 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.434 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR 2021-06-25T04:41:05.436 INFO:teuthology.task.ansible.out:6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.436 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.438 INFO:teuthology.task.ansible.out: skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.449 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.451 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.451 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj 2021-06-25T04:41:05.453 INFO:teuthology.task.ansible.out:951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2021-06-25T04:41:05.455 INFO:teuthology.task.ansible.out: "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.463 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.465 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.466 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': ' 2021-06-25T04:41:05.468 INFO:teuthology.task.ansible.out:xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.477 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.479 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.479 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.480 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XA 2021-06-25T04:41:05.481 INFO:teuthology.task.ansible.out:US/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.490 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.492 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.503 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.504 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.504 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.504 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.505 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.506 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.516 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.518 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a 2021-06-25T04:41:05.520 INFO:teuthology.task.ansible.out:953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.520 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821d 2021-06-25T04:41:05.522 INFO:teuthology.task.ansible.out:d75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.531 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.533 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.534 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT 2021-06-25T04:41:05.536 INFO:teuthology.task.ansible.out:2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.545 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.546 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.548 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.s 2021-06-25T04:41:05.549 INFO:teuthology.task.ansible.out:epia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.559 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.560 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.572 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.574 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.574 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.575 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": 2021-06-25T04:41:05.577 INFO:teuthology.task.ansible.out:false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.586 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.588 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"an 2021-06-25T04:41:05.590 INFO:teuthology.task.ansible.out:sible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.591 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.592 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuval 2021-06-25T04:41:05.594 INFO:teuthology.task.ansible.out:if@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.603 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.605 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.605 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.616 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.618 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.618 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.620 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.620 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.631 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.633 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.635 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.635 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.646 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.648 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.648 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.659 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.661 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.661 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.662 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98 2021-06-25T04:41:05.664 INFO:teuthology.task.ansible.out:Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.674 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.674 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.676 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.678 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.678 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.689 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.692 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.702 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.704 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.705 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": " 2021-06-25T04:41:05.707 INFO:teuthology.task.ansible.out:admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.716 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.716 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.717 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.717 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.718 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3 2021-06-25T04:41:05.720 INFO:teuthology.task.ansible.out:NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.f 2021-06-25T04:41:05.722 INFO:teuthology.task.ansible.out:ront.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.732 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.734 INFO:teuthology.task.ansible.out: skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.735 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 5 2021-06-25T04:41:05.736 INFO:teuthology.task.ansible.out:0f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.747 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.749 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.749 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonso 2021-06-25T04:41:05.751 INFO:teuthology.task.ansible.out:mthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.751 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.752 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cm 2021-06-25T04:41:05.753 INFO:teuthology.task.ansible.out:eno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.754 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3 2021-06-25T04:41:05.756 INFO:teuthology.task.ansible.out:adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.768 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.770 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.770 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was 2021-06-25T04:41:05.772 INFO:teuthology.task.ansible.out:False"} 2021-06-25T04:41:05.773 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.774 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.775 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc 2021-06-25T04:41:05.776 INFO:teuthology.task.ansible.out:3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.785 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.787 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d 2021-06-25T04:41:05.790 INFO:teuthology.task.ansible.out:4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.800 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.802 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.803 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.804 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.806 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.807 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.808 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.809 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.809 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.809 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"n 2021-06-25T04:41:05.812 INFO:teuthology.task.ansible.out:ame": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.822 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.824 INFO:teuthology.task.ansible.out: skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.825 INFO:teuthology.task.ansible.out: 2021-06-25T04:41:05.826 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.826 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'g 2021-06-25T04:41:05.828 INFO:teuthology.task.ansible.out:kyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f 2021-06-25T04:41:05.830 INFO:teuthology.task.ansible.out:844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82 2021-06-25T04:41:05.833 INFO:teuthology.task.ansible.out:af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.841 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.843 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.844 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": " 2021-06-25T04:41:05.846 INFO:teuthology.task.ansible.out:lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.856 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.867 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.869 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.869 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.869 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => { 2021-06-25T04:41:05.871 INFO:teuthology.task.ansible.out:"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.872 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.872 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a 2021-06-25T04:41:05.874 INFO:teuthology.task.ansible.out:33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.894 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.896 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.896 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.907 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.909 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.909 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "o 2021-06-25T04:41:05.911 INFO:teuthology.task.ansible.out:vpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 K 2021-06-25T04:41:05.913 INFO:teuthology.task.ansible.out:EbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.923 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.924 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.935 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.936 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.937 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.938 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.939 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.951 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.951 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.953 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.954 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas 2021-06-25T04:41:05.955 INFO:teuthology.task.ansible.out:@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.956 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.956 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.957 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.958 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.958 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.959 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name 2021-06-25T04:41:05.959 INFO:teuthology.task.ansible.out:": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.960 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.960 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.962 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.972 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.974 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.974 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.975 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@z 2021-06-25T04:41:05.976 INFO:teuthology.task.ansible.out:ulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.977 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.977 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791 2021-06-25T04:41:05.979 INFO:teuthology.task.ansible.out:981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n" 2021-06-25T04:41:05.981 INFO:teuthology.task.ansible.out:}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.981 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.992 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.994 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.996 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.996 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.997 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:05.997 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn 2021-06-25T04:41:05.999 INFO:teuthology.task.ansible.out:": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.000 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.002 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.003 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.005 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.007 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.017 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.020 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.021 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.022 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.022 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.023 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thi 2021-06-25T04:41:06.024 INFO:teuthology.task.ansible.out:nkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.026 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.028 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.028 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.030 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.030 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.042 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.044 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.044 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.045 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name" 2021-06-25T04:41:06.047 INFO:teuthology.task.ansible.out:: "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.056 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.057 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.057 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.058 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.071 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.090 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.092 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.093 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"n 2021-06-25T04:41:06.094 INFO:teuthology.task.ansible.out:ame": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.099 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 2021-06-25T04:41:06.100 INFO:teuthology.task.ansible.out:'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.130 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:06 +0000 (0:00:00.982) 0:01:01.314 *********** 2021-06-25T04:41:06.137 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.139 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.139 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.142 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.142 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.144 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.144 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.144 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.145 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "chan 2021-06-25T04:41:06.148 INFO:teuthology.task.ansible.out:ged": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.148 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "it 2021-06-25T04:41:06.150 INFO:teuthology.task.ansible.out:em": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.151 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'nam 2021-06-25T04:41:06.154 INFO:teuthology.task.ansible.out:e': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5 2021-06-25T04:41:06.156 INFO:teuthology.task.ansible.out:nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923 2021-06-25T04:41:06.158 INFO:teuthology.task.ansible.out:288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.168 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.170 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.170 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.172 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.172 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.185 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS 2021-06-25T04:41:06.187 INFO:teuthology.task.ansible.out:0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.197 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.197 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.198 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.198 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.200 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.211 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.212 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.213 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.218 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.230 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.253 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.254 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} TASK [Filter the revoked_users list] ******************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.255 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.255 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": " 2021-06-25T04:41:06.257 INFO:teuthology.task.ansible.out:item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.257 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.259 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.260 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.279 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.281 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.304 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:06 +0000 (0:00:00.176) 0:01:01.490 *********** 2021-06-25T04:41:06.329 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:06 +0000 (0:00:00.025) 0:01:01.516 *********** 2021-06-25T04:41:06.353 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:06 +0000 (0:00:00.023) 0:01:01.540 *********** 2021-06-25T04:41:06.363 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.365 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@z 2021-06-25T04:41:06.367 INFO:teuthology.task.ansible.out:ulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.368 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.369 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvA 2021-06-25T04:41:06.371 INFO:teuthology.task.ansible.out:OJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.383 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.385 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} TASK [Filter the revoked_users list] ******************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.408 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:06 +0000 (0:00:00.055) 0:01:01.595 *********** 2021-06-25T04:41:06.417 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.419 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.419 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.420 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => 2021-06-25T04:41:06.421 INFO:teuthology.task.ansible.out:(item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} TASK [Filter the revoked_users list] ******************************************* 2021-06-25T04:41:06.422 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.447 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:06 +0000 (0:00:00.038) 0:01:01.634 *********** 2021-06-25T04:41:06.463 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.465 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.476 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.487 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.489 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.499 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.500 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.510 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.513 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.522 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.534 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.545 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.546 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.556 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.558 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.568 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.570 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi102.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.581 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.583 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.594 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.603 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.605 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.614 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu 7QJ1PI1rZkVWBQid3n3X9g d99ee0082309358492a82f648996bdc723273d961c4ef69a0b0cbf64fa40bd83"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.634 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-06-25T04:41:06.636 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-06-25T04:41:06.661 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:06 +0000 (0:00:00.213) 0:01:01.847 *********** 2021-06-25T04:41:06.670 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-06-25T04:41:06.703 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-06-25T04:41:06.735 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:06.759 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:06 +0000 (0:00:00.098) 0:01:01.945 *********** 2021-06-25T04:41:06.766 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-06-25T04:41:06.768 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-06-25T04:41:06.810 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-06-25T04:41:06.845 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-06-25T04:41:06.898 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-06-25T04:41:06.931 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-06-25T04:41:06.975 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-06-25T04:41:06.977 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-06-25T04:41:07.030 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-06-25T04:41:07.063 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-06-25T04:41:07.116 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-06-25T04:41:07.118 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-06-25T04:41:07.160 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-06-25T04:41:07.202 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-06-25T04:41:07.246 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-06-25T04:41:07.258 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-06-25T04:41:07.302 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-06-25T04:41:07.334 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-06-25T04:41:07.377 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-06-25T04:41:07.389 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-06-25T04:41:07.431 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-06-25T04:41:07.475 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-06-25T04:41:07.508 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-06-25T04:41:07.520 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-06-25T04:41:07.574 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-06-25T04:41:07.608 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-06-25T04:41:07.641 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-06-25T04:41:07.652 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-06-25T04:41:07.705 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-06-25T04:41:07.738 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-06-25T04:41:07.781 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-06-25T04:41:07.782 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-06-25T04:41:07.846 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-06-25T04:41:07.867 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-06-25T04:41:07.910 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-06-25T04:41:07.921 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-06-25T04:41:07.976 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-06-25T04:41:07.998 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-06-25T04:41:08.051 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-06-25T04:41:08.052 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-06-25T04:41:08.105 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-06-25T04:41:08.127 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-06-25T04:41:08.181 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-06-25T04:41:08.192 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-06-25T04:41:08.235 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-06-25T04:41:08.257 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-06-25T04:41:08.321 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-06-25T04:41:08.333 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-06-25T04:41:08.377 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-06-25T04:41:08.400 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-06-25T04:41:08.465 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-06-25T04:41:08.467 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-06-25T04:41:08.521 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-06-25T04:41:08.533 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-06-25T04:41:08.600 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} ok: [smithi057.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-06-25T04:41:08.645 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-06-25T04:41:08.678 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-06-25T04:41:08.734 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} ok: [smithi057.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-06-25T04:41:08.776 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-06-25T04:41:08.803 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-06-25T04:41:08.869 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-06-25T04:41:08.871 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-06-25T04:41:08.916 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-06-25T04:41:08.938 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-06-25T04:41:09.014 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-06-25T04:41:09.017 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-06-25T04:41:09.053 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-06-25T04:41:09.075 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-06-25T04:41:09.138 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-06-25T04:41:09.150 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-06-25T04:41:09.193 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-06-25T04:41:09.204 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-06-25T04:41:09.279 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-06-25T04:41:09.289 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-06-25T04:41:09.321 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-06-25T04:41:09.343 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-06-25T04:41:09.418 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} ok: [smithi102.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-06-25T04:41:09.461 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-06-25T04:41:09.474 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-06-25T04:41:09.559 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-06-25T04:41:09.561 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-06-25T04:41:09.593 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-06-25T04:41:09.614 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-06-25T04:41:09.689 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-06-25T04:41:09.689 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-06-25T04:41:09.732 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-06-25T04:41:09.744 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-06-25T04:41:09.818 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-06-25T04:41:09.830 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-06-25T04:41:09.862 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-06-25T04:41:09.884 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-06-25T04:41:09.948 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-06-25T04:41:09.959 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-06-25T04:41:10.002 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-06-25T04:41:10.015 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-06-25T04:41:10.089 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-06-25T04:41:10.101 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-06-25T04:41:10.133 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-06-25T04:41:10.157 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-06-25T04:41:10.221 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-06-25T04:41:10.234 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-06-25T04:41:10.267 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-06-25T04:41:10.289 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-06-25T04:41:10.354 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-06-25T04:41:10.377 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-06-25T04:41:10.399 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-06-25T04:41:10.430 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-06-25T04:41:10.485 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-06-25T04:41:10.518 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-06-25T04:41:10.542 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-06-25T04:41:10.564 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-06-25T04:41:10.618 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-06-25T04:41:10.651 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-06-25T04:41:10.685 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-06-25T04:41:10.696 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-06-25T04:41:10.761 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-06-25T04:41:10.793 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-06-25T04:41:10.816 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-06-25T04:41:10.827 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-06-25T04:41:10.893 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-06-25T04:41:10.937 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-06-25T04:41:10.949 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-06-25T04:41:10.960 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-06-25T04:41:11.026 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-06-25T04:41:11.069 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-06-25T04:41:11.081 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-06-25T04:41:11.103 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-06-25T04:41:11.159 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-06-25T04:41:11.288 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} ok: [smithi087.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} ok: [smithi161.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-06-25T04:41:11.335 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-06-25T04:41:11.389 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-06-25T04:41:11.392 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-06-25T04:41:11.415 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-06-25T04:41:11.508 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-06-25T04:41:11.534 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-06-25T04:41:11.536 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-06-25T04:41:11.552 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-06-25T04:41:11.649 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-06-25T04:41:11.671 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-06-25T04:41:11.683 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-06-25T04:41:11.708 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-06-25T04:41:11.825 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-06-25T04:41:11.963 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-06-25T04:41:12.102 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-06-25T04:41:12.124 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-06-25T04:41:12.178 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-06-25T04:41:12.178 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-06-25T04:41:12.264 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-06-25T04:41:12.318 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-06-25T04:41:12.320 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-06-25T04:41:12.408 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-06-25T04:41:12.451 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-06-25T04:41:12.451 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-06-25T04:41:12.537 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-06-25T04:41:12.591 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-06-25T04:41:12.602 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-06-25T04:41:12.614 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-06-25T04:41:12.670 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-06-25T04:41:12.723 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-06-25T04:41:12.745 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-06-25T04:41:12.746 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-06-25T04:41:12.811 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-06-25T04:41:12.854 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-06-25T04:41:12.876 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-06-25T04:41:12.888 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-06-25T04:41:12.941 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-06-25T04:41:12.995 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-06-25T04:41:13.025 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} ok: [smithi161.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-06-25T04:41:13.080 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-06-25T04:41:13.122 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-06-25T04:41:13.156 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-06-25T04:41:13.167 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-06-25T04:41:13.207 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-06-25T04:41:13.260 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-06-25T04:41:13.293 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-06-25T04:41:13.305 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-06-25T04:41:13.348 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-06-25T04:41:13.391 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-06-25T04:41:13.435 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-06-25T04:41:13.437 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-06-25T04:41:13.479 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-06-25T04:41:13.534 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:13 +0000 (0:00:06.774) 0:01:08.720 *********** 2021-06-25T04:41:13.543 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-06-25T04:41:13.590 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} ok: [smithi057.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-06-25T04:41:13.633 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:13 +0000 (0:00:00.099) 0:01:08.819 *********** 2021-06-25T04:41:13.656 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:13 +0000 (0:00:00.023) 0:01:08.843 *********** 2021-06-25T04:41:13.709 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-06-25T04:41:13.837 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-06-25T04:41:13.954 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-06-25T04:41:13.955 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "checksum": "b252f238ee8ca673e3cd3572f2224aa394d4bc46", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "020803d9b15f2fcc1b074d13ffaaf151", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596073.621568-15984-272848282697225/source", "state": "file", "uid": 0} 2021-06-25T04:41:13.983 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:13 +0000 (0:00:00.326) 0:01:09.170 *********** 2021-06-25T04:41:13.991 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-06-25T04:41:13.993 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-06-25T04:41:14.039 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.055) 0:01:09.225 *********** 2021-06-25T04:41:14.056 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-06-25T04:41:14.058 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "checksum": "b252f238ee8ca673e3cd3572f2224aa394d4bc46", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "020803d9b15f2fcc1b074d13ffaaf151", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596073.7176476-15996-223817478632082/source", "state": "file", "uid": 0} TASK [common : Log the OS name, version and release] *************************** ok: [smithi102.front.sepia.ceph.com] => { "msg": "Host smithi102.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-06-25T04:41:14.082 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.043) 0:01:09.268 *********** 2021-06-25T04:41:14.105 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.022) 0:01:09.291 *********** 2021-06-25T04:41:14.111 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-06-25T04:41:14.112 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "checksum": "b252f238ee8ca673e3cd3572f2224aa394d4bc46", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "020803d9b15f2fcc1b074d13ffaaf151", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596073.7428985-15999-159331703044684/source", "state": "file", "uid": 0} 2021-06-25T04:41:14.138 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.034) 0:01:09.325 *********** 2021-06-25T04:41:14.156 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-06-25T04:41:14.158 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => { "msg": "Host smithi087.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-06-25T04:41:14.183 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.044) 0:01:09.369 *********** 2021-06-25T04:41:14.191 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-06-25T04:41:14.192 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-06-25T04:41:14.218 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.035) 0:01:09.405 *********** 2021-06-25T04:41:14.226 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-06-25T04:41:14.228 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => { "msg": "Host smithi161.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-06-25T04:41:14.252 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.034) 0:01:09.439 *********** 2021-06-25T04:41:14.271 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-06-25T04:41:14.298 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.045) 0:01:09.484 *********** 2021-06-25T04:41:14.306 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-06-25T04:41:14.308 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:14.340 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.042) 0:01:09.526 *********** 2021-06-25T04:41:14.347 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-06-25T04:41:14.349 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-06-25T04:41:14.374 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.033) 0:01:09.560 *********** 2021-06-25T04:41:14.380 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-06-25T04:41:14.382 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:14.407 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.032) 0:01:09.593 *********** 2021-06-25T04:41:14.423 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-06-25T04:41:14.425 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:14.451 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.042) 0:01:09.635 *********** 2021-06-25T04:41:14.455 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-06-25T04:41:14.457 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "checksum": "b252f238ee8ca673e3cd3572f2224aa394d4bc46", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "020803d9b15f2fcc1b074d13ffaaf151", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596074.119294-16060-269386467931371/source", "state": "file", "uid": 0} 2021-06-25T04:41:14.487 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.038) 0:01:09.674 *********** 2021-06-25T04:41:14.515 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.027) 0:01:09.701 *********** 2021-06-25T04:41:14.523 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-06-25T04:41:14.525 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:14.550 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.035) 0:01:09.736 *********** 2021-06-25T04:41:14.574 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.023) 0:01:09.760 *********** 2021-06-25T04:41:14.582 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi057.front.sepia.ceph.com] => { "msg": "Host smithi057.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-06-25T04:41:14.616 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.042) 0:01:09.803 *********** 2021-06-25T04:41:14.625 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-06-25T04:41:14.628 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:14.660 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.043) 0:01:09.846 *********** 2021-06-25T04:41:14.683 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.023) 0:01:09.870 *********** 2021-06-25T04:41:14.691 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-06-25T04:41:14.693 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Including major version specific variables.] ******************** ok: [smithi057.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-06-25T04:41:14.719 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.035) 0:01:09.906 *********** 2021-06-25T04:41:14.741 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.021) 0:01:09.928 *********** 2021-06-25T04:41:14.748 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-06-25T04:41:14.749 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:14.774 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.032) 0:01:09.960 *********** 2021-06-25T04:41:14.781 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:14.807 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.033) 0:01:09.993 *********** 2021-06-25T04:41:14.814 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-06-25T04:41:14.815 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:14.844 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.037) 0:01:10.031 *********** 2021-06-25T04:41:14.882 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.036) 0:01:10.067 *********** 2021-06-25T04:41:14.890 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:14.892 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:14.916 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.035) 0:01:10.103 *********** 2021-06-25T04:41:14.939 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.022) 0:01:10.126 *********** 2021-06-25T04:41:14.946 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-06-25T04:41:14.949 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:14.974 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.034) 0:01:10.160 *********** 2021-06-25T04:41:14.996 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:14 +0000 (0:00:00.022) 0:01:10.182 *********** 2021-06-25T04:41:15.003 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.037 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.040) 0:01:10.223 *********** 2021-06-25T04:41:15.044 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-06-25T04:41:15.046 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.070 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.033) 0:01:10.257 *********** 2021-06-25T04:41:15.077 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-06-25T04:41:15.079 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.103 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.032) 0:01:10.290 *********** 2021-06-25T04:41:15.124 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.020) 0:01:10.311 *********** 2021-06-25T04:41:15.131 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.157 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.033) 0:01:10.344 *********** 2021-06-25T04:41:15.165 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-06-25T04:41:15.166 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.191 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.033) 0:01:10.378 *********** 2021-06-25T04:41:15.199 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.200 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.224 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.033) 0:01:10.411 *********** 2021-06-25T04:41:15.252 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.027) 0:01:10.439 *********** 2021-06-25T04:41:15.260 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.286 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.033) 0:01:10.473 *********** 2021-06-25T04:41:15.294 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-06-25T04:41:15.296 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.324 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.035) 0:01:10.508 *********** 2021-06-25T04:41:15.345 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.022) 0:01:10.531 *********** 2021-06-25T04:41:15.351 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-06-25T04:41:15.353 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:15.378 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.033) 0:01:10.565 *********** 2021-06-25T04:41:15.386 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:15.387 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:15.412 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.033) 0:01:10.598 *********** 2021-06-25T04:41:15.419 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-06-25T04:41:15.421 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.447 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.033) 0:01:10.632 *********** 2021-06-25T04:41:15.467 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.021) 0:01:10.653 *********** 2021-06-25T04:41:15.474 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-06-25T04:41:15.478 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.502 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.035) 0:01:10.689 *********** 2021-06-25T04:41:15.526 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.023) 0:01:10.713 *********** 2021-06-25T04:41:15.534 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-06-25T04:41:15.535 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.568 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.041) 0:01:10.754 *********** 2021-06-25T04:41:15.575 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-06-25T04:41:15.577 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi161.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:15.604 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.036) 0:01:10.790 *********** 2021-06-25T04:41:15.632 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.028) 0:01:10.819 *********** 2021-06-25T04:41:15.639 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-06-25T04:41:15.641 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.667 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.033) 0:01:10.853 *********** 2021-06-25T04:41:15.676 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.703 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.035) 0:01:10.889 *********** 2021-06-25T04:41:15.713 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.741 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.036) 0:01:10.926 *********** 2021-06-25T04:41:15.761 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.022) 0:01:10.948 *********** 2021-06-25T04:41:15.770 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.796 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.034) 0:01:10.982 *********** 2021-06-25T04:41:15.802 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-06-25T04:41:15.804 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:15.805 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:15.832 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.035) 0:01:11.018 *********** 2021-06-25T04:41:15.853 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.022) 0:01:11.040 *********** 2021-06-25T04:41:15.860 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-06-25T04:41:15.862 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.886 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.032) 0:01:11.073 *********** 2021-06-25T04:41:15.892 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-06-25T04:41:15.894 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:15.919 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.032) 0:01:11.106 *********** 2021-06-25T04:41:15.927 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-06-25T04:41:15.928 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:15.954 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.034) 0:01:11.141 *********** 2021-06-25T04:41:15.976 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:15 +0000 (0:00:00.021) 0:01:11.162 *********** 2021-06-25T04:41:15.983 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-06-25T04:41:15.985 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.013 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.037) 0:01:11.199 *********** 2021-06-25T04:41:16.021 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-06-25T04:41:16.022 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.047 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.034) 0:01:11.234 *********** 2021-06-25T04:41:16.054 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-06-25T04:41:16.056 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:16.085 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.038) 0:01:11.272 *********** 2021-06-25T04:41:16.108 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.023) 0:01:11.295 *********** 2021-06-25T04:41:16.117 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-06-25T04:41:16.119 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:16.148 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.039) 0:01:11.335 *********** 2021-06-25T04:41:16.156 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:16.182 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.033) 0:01:11.368 *********** 2021-06-25T04:41:16.189 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-06-25T04:41:16.191 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.219 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.034) 0:01:11.403 *********** 2021-06-25T04:41:16.224 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-06-25T04:41:16.226 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.252 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.035) 0:01:11.439 *********** 2021-06-25T04:41:16.276 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.023) 0:01:11.462 *********** 2021-06-25T04:41:16.284 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-06-25T04:41:16.284 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.285 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-06-25T04:41:16.285 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:16.311 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.035) 0:01:11.498 *********** 2021-06-25T04:41:16.336 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.024) 0:01:11.522 *********** 2021-06-25T04:41:16.346 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-06-25T04:41:16.349 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.379 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.043) 0:01:11.566 *********** 2021-06-25T04:41:16.388 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-06-25T04:41:16.390 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:16.419 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.039) 0:01:11.606 *********** 2021-06-25T04:41:16.427 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-06-25T04:41:16.429 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.455 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.035) 0:01:11.642 *********** 2021-06-25T04:41:16.477 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.022) 0:01:11.664 *********** 2021-06-25T04:41:16.486 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.488 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.512 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.035) 0:01:11.699 *********** 2021-06-25T04:41:16.538 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.023) 0:01:11.723 *********** 2021-06-25T04:41:16.543 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-06-25T04:41:16.546 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:16.572 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.035) 0:01:11.759 *********** 2021-06-25T04:41:16.579 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-06-25T04:41:16.582 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.607 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.034) 0:01:11.793 *********** 2021-06-25T04:41:16.630 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.023) 0:01:11.817 *********** 2021-06-25T04:41:16.638 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-06-25T04:41:16.639 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.641 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.666 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.035) 0:01:11.853 *********** 2021-06-25T04:41:16.689 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.022) 0:01:11.875 *********** 2021-06-25T04:41:16.718 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-06-25T04:41:16.720 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.748 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.058) 0:01:11.934 *********** 2021-06-25T04:41:16.756 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-06-25T04:41:16.757 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.758 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.784 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.036) 0:01:11.971 *********** 2021-06-25T04:41:16.824 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.038) 0:01:12.010 *********** 2021-06-25T04:41:16.833 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-06-25T04:41:16.834 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:16.836 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:16.876 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.052) 0:01:12.062 *********** 2021-06-25T04:41:16.905 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.029) 0:01:12.092 *********** 2021-06-25T04:41:16.918 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.954 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.049) 0:01:12.141 *********** 2021-06-25T04:41:16.966 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-06-25T04:41:16.969 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:16.997 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:16 +0000 (0:00:00.042) 0:01:12.183 *********** 2021-06-25T04:41:17.018 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.021) 0:01:12.205 *********** 2021-06-25T04:41:17.025 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.056 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.037) 0:01:12.242 *********** 2021-06-25T04:41:17.063 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-06-25T04:41:17.065 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.094 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.038) 0:01:12.281 *********** 2021-06-25T04:41:17.106 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.108 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:17.144 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.049) 0:01:12.330 *********** 2021-06-25T04:41:17.172 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.028) 0:01:12.359 *********** 2021-06-25T04:41:17.294 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.319 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.146) 0:01:12.506 *********** 2021-06-25T04:41:17.326 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-06-25T04:41:17.328 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:17.352 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.033) 0:01:12.539 *********** 2021-06-25T04:41:17.414 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-06-25T04:41:17.416 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.443 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.090) 0:01:12.630 *********** 2021-06-25T04:41:17.451 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-06-25T04:41:17.452 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.602 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.158) 0:01:12.788 *********** 2021-06-25T04:41:17.609 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-06-25T04:41:17.611 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.636 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.034) 0:01:12.823 *********** 2021-06-25T04:41:17.659 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.022) 0:01:12.845 *********** 2021-06-25T04:41:17.667 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-06-25T04:41:17.669 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* 2021-06-25T04:41:17.669 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.694 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.035) 0:01:12.881 *********** 2021-06-25T04:41:17.715 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.020) 0:01:12.902 *********** 2021-06-25T04:41:17.722 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.748 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.032) 0:01:12.935 *********** 2021-06-25T04:41:17.755 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-06-25T04:41:17.756 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.782 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.033) 0:01:12.968 *********** 2021-06-25T04:41:17.789 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-06-25T04:41:17.791 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.818 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.036) 0:01:13.005 *********** 2021-06-25T04:41:17.842 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.023) 0:01:13.028 *********** 2021-06-25T04:41:17.850 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.877 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.034) 0:01:13.063 *********** 2021-06-25T04:41:17.884 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-06-25T04:41:17.886 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.911 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.034) 0:01:13.097 *********** 2021-06-25T04:41:17.919 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.944 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.033) 0:01:13.131 *********** 2021-06-25T04:41:17.946 INFO:teuthology.task.ansible.out: 2021-06-25T04:41:17.952 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-06-25T04:41:17.952 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.953 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:17.982 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.038) 0:01:13.169 *********** 2021-06-25T04:41:18.005 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:17 +0000 (0:00:00.022) 0:01:13.191 *********** 2021-06-25T04:41:18.013 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-06-25T04:41:18.015 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.041 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.035) 0:01:13.227 *********** 2021-06-25T04:41:18.049 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-06-25T04:41:18.051 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:18.077 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.035) 0:01:13.263 *********** 2021-06-25T04:41:18.084 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-06-25T04:41:18.086 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.112 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.035) 0:01:13.299 *********** 2021-06-25T04:41:18.135 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.022) 0:01:13.322 *********** 2021-06-25T04:41:18.143 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-06-25T04:41:18.145 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:18.171 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.035) 0:01:13.357 *********** 2021-06-25T04:41:18.179 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-06-25T04:41:18.180 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.180 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-06-25T04:41:18.181 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.207 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.036) 0:01:13.394 *********** 2021-06-25T04:41:18.236 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.028) 0:01:13.423 *********** 2021-06-25T04:41:18.245 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.271 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.034) 0:01:13.457 *********** 2021-06-25T04:41:18.277 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-06-25T04:41:18.279 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.305 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.034) 0:01:13.492 *********** 2021-06-25T04:41:18.313 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-06-25T04:41:18.315 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:18.340 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.034) 0:01:13.526 *********** 2021-06-25T04:41:18.347 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-06-25T04:41:18.349 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:18.380 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.039) 0:01:13.566 *********** 2021-06-25T04:41:18.402 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.022) 0:01:13.588 *********** 2021-06-25T04:41:18.410 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-06-25T04:41:18.412 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.438 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.035) 0:01:13.624 *********** 2021-06-25T04:41:18.447 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-06-25T04:41:18.449 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.474 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.035) 0:01:13.660 *********** 2021-06-25T04:41:18.496 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.021) 0:01:13.682 *********** 2021-06-25T04:41:18.503 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-06-25T04:41:18.505 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.531 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.035) 0:01:13.717 *********** 2021-06-25T04:41:18.538 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-06-25T04:41:18.539 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.565 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.034) 0:01:13.752 *********** 2021-06-25T04:41:18.573 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-06-25T04:41:18.574 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.599 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.033) 0:01:13.785 *********** 2021-06-25T04:41:18.607 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-06-25T04:41:18.609 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.611 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.636 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.037) 0:01:13.823 *********** 2021-06-25T04:41:18.659 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.022) 0:01:13.846 *********** 2021-06-25T04:41:18.666 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-06-25T04:41:18.668 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.694 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.035) 0:01:13.881 *********** 2021-06-25T04:41:18.702 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-06-25T04:41:18.704 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.728 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.033) 0:01:13.915 *********** 2021-06-25T04:41:18.735 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-06-25T04:41:18.737 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.738 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.768 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.039) 0:01:13.954 *********** 2021-06-25T04:41:18.791 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.023) 0:01:13.978 *********** 2021-06-25T04:41:18.799 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-06-25T04:41:18.801 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.827 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.035) 0:01:14.014 *********** 2021-06-25T04:41:18.835 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-06-25T04:41:18.837 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.838 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.863 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.036) 0:01:14.050 *********** 2021-06-25T04:41:18.886 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.022) 0:01:14.073 *********** 2021-06-25T04:41:18.893 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-06-25T04:41:18.895 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.897 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.922 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.036) 0:01:14.109 *********** 2021-06-25T04:41:18.948 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.025) 0:01:14.134 *********** 2021-06-25T04:41:18.955 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-06-25T04:41:18.956 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:18.983 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:18 +0000 (0:00:00.035) 0:01:14.170 *********** 2021-06-25T04:41:18.985 INFO:teuthology.task.ansible.out: 2021-06-25T04:41:19.025 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:19.026 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:19.050 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.066) 0:01:14.237 *********** 2021-06-25T04:41:19.070 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-06-25T04:41:19.072 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:19.096 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.045) 0:01:14.282 *********** 2021-06-25T04:41:19.103 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-06-25T04:41:19.104 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.016900", "end": "2021-06-25 04:41:19.515901", "rc": 0, "start": "2021-06-25 04:41:19.499001", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-06-25T04:41:19.130 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.034) 0:01:14.316 *********** 2021-06-25T04:41:19.137 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-06-25T04:41:19.138 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015851", "end": "2021-06-25 04:41:19.351867", "rc": 0, "start": "2021-06-25 04:41:19.336016", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-06-25T04:41:19.164 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.033) 0:01:14.350 *********** 2021-06-25T04:41:19.193 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.029) 0:01:14.380 *********** 2021-06-25T04:41:19.211 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-06-25T04:41:19.213 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:19.238 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.044) 0:01:14.425 *********** 2021-06-25T04:41:19.247 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:19.273 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.034) 0:01:14.459 *********** 2021-06-25T04:41:19.300 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-06-25T04:41:19.301 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013915", "end": "2021-06-25 04:41:19.851760", "rc": 0, "start": "2021-06-25 04:41:19.837845", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-06-25T04:41:19.325 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.052) 0:01:14.512 *********** 2021-06-25T04:41:19.334 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-06-25T04:41:19.336 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:19.361 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.035) 0:01:14.548 *********** 2021-06-25T04:41:19.369 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:19.399 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.037) 0:01:14.586 *********** 2021-06-25T04:41:19.401 INFO:teuthology.task.ansible.out: 2021-06-25T04:41:19.406 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-06-25T04:41:19.408 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.016507", "end": "2021-06-25 04:41:18.954857", "rc": 0, "start": "2021-06-25 04:41:18.938350", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-06-25T04:41:19.432 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.033) 0:01:14.619 *********** 2021-06-25T04:41:19.454 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.021) 0:01:14.640 *********** 2021-06-25T04:41:19.502 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-06-25T04:41:19.503 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:19.526 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.072) 0:01:14.713 *********** 2021-06-25T04:41:19.534 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-06-25T04:41:19.535 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:19.559 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.032) 0:01:14.746 *********** 2021-06-25T04:41:19.638 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-06-25T04:41:19.640 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:19.663 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:19 +0000 (0:00:00.103) 0:01:14.850 *********** 2021-06-25T04:41:20.018 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [smithi161.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.030 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.031 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.033 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.207 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.219 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.219 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.221 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.379 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.380 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.392 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.393 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.552 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.554 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.579 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.916) 0:01:15.766 *********** 2021-06-25T04:41:20.603 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.023) 0:01:15.790 *********** 2021-06-25T04:41:20.612 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.616 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-06-25T04:41:20.650 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.046) 0:01:15.837 *********** 2021-06-25T04:41:20.689 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.038) 0:01:15.875 *********** 2021-06-25T04:41:20.698 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-06-25T04:41:20.700 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:20.725 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.036) 0:01:15.912 *********** 2021-06-25T04:41:20.747 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.022) 0:01:15.934 *********** 2021-06-25T04:41:20.754 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:20.780 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.032) 0:01:15.967 *********** 2021-06-25T04:41:20.788 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:20.815 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.035) 0:01:16.002 *********** 2021-06-25T04:41:20.823 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-06-25T04:41:20.825 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:20.851 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.034) 0:01:16.037 *********** 2021-06-25T04:41:20.874 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.023) 0:01:16.060 *********** 2021-06-25T04:41:20.883 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:20.908 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.034) 0:01:16.095 *********** 2021-06-25T04:41:20.931 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.022) 0:01:16.117 *********** 2021-06-25T04:41:20.938 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-06-25T04:41:20.940 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:20.965 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.034) 0:01:16.152 *********** 2021-06-25T04:41:20.987 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:20 +0000 (0:00:00.021) 0:01:16.174 *********** 2021-06-25T04:41:20.994 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:21.020 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:21 +0000 (0:00:00.032) 0:01:16.207 *********** 2021-06-25T04:41:21.028 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:21.029 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:21.054 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:21 +0000 (0:00:00.034) 0:01:16.241 *********** 2021-06-25T04:41:21.081 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:21 +0000 (0:00:00.026) 0:01:16.267 *********** 2021-06-25T04:41:21.089 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:21.091 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:21.115 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:21 +0000 (0:00:00.034) 0:01:16.301 *********** 2021-06-25T04:41:21.138 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:21 +0000 (0:00:00.023) 0:01:16.325 *********** 2021-06-25T04:41:21.145 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-06-25T04:41:21.147 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:21.175 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:21 +0000 (0:00:00.037) 0:01:16.362 *********** 2021-06-25T04:41:21.183 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-06-25T04:41:21.185 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:21.209 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:21 +0000 (0:00:00.033) 0:01:16.396 *********** 2021-06-25T04:41:21.217 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-06-25T04:41:21.218 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:21.243 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:21 +0000 (0:00:00.033) 0:01:16.429 *********** 2021-06-25T04:41:21.265 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:21 +0000 (0:00:00.021) 0:01:16.451 *********** 2021-06-25T04:41:21.281 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:21.306 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:21 +0000 (0:00:00.041) 0:01:16.492 *********** 2021-06-25T04:41:21.952 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-06-25T04:41:21.954 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.554272", "end": "2021-06-25 04:41:21.506928", "rc": 0, "start": "2021-06-25 04:41:20.952656", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:21.978 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:21 +0000 (0:00:00.672) 0:01:17.165 *********** 2021-06-25T04:41:22.047 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-06-25T04:41:22.049 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:22.071 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:22 +0000 (0:00:00.092) 0:01:17.258 *********** 2021-06-25T04:41:22.079 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.765898", "end": "2021-06-25 04:41:22.507707", "rc": 0, "start": "2021-06-25 04:41:21.741809", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:22.081 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.702673", "end": "2021-06-25 04:41:22.625522", "rc": 0, "start": "2021-06-25 04:41:21.922849", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:22.106 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:22 +0000 (0:00:00.034) 0:01:17.293 *********** 2021-06-25T04:41:22.129 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:22 +0000 (0:00:00.023) 0:01:17.316 *********** 2021-06-25T04:41:22.199 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-06-25T04:41:22.201 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:22.223 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:22 +0000 (0:00:00.094) 0:01:17.410 *********** 2021-06-25T04:41:22.229 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:22.259 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:22 +0000 (0:00:00.036) 0:01:17.446 *********** 2021-06-25T04:41:22.288 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-06-25T04:41:22.290 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.846863", "end": "2021-06-25 04:41:22.522133", "rc": 0, "start": "2021-06-25 04:41:21.675270", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:22.313 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:22 +0000 (0:00:00.053) 0:01:17.500 *********** 2021-06-25T04:41:22.373 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-06-25T04:41:22.375 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.116450", "end": "2021-06-25 04:41:21.923796", "rc": 0, "start": "2021-06-25 04:41:21.807346", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:22.398 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:22 +0000 (0:00:00.084) 0:01:17.584 *********** 2021-06-25T04:41:22.405 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-06-25T04:41:22.406 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:22.431 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:22 +0000 (0:00:00.033) 0:01:17.618 *********** 2021-06-25T04:41:22.470 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.066172", "end": "2021-06-25 04:41:23.016431", "rc": 0, "start": "2021-06-25 04:41:22.950259", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:22.495 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:22 +0000 (0:00:00.063) 0:01:17.681 *********** 2021-06-25T04:41:22.576 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.118892", "end": "2021-06-25 04:41:22.997244", "rc": 0, "start": "2021-06-25 04:41:22.878352", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:22.601 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:22 +0000 (0:00:00.105) 0:01:17.787 *********** 2021-06-25T04:41:22.756 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.148857", "end": "2021-06-25 04:41:22.988183", "rc": 0, "start": "2021-06-25 04:41:22.839326", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:22.780 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:22 +0000 (0:00:00.179) 0:01:17.967 *********** 2021-06-25T04:41:26.310 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-06-25T04:41:26.312 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:41:26.338 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:26 +0000 (0:00:03.555) 0:01:21.523 *********** 2021-06-25T04:41:26.346 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:41:26.347 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:41:26.378 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:26 +0000 (0:00:00.037) 0:01:21.560 *********** 2021-06-25T04:41:26.400 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:26 +0000 (0:00:00.026) 0:01:21.587 *********** 2021-06-25T04:41:26.408 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:41:26.438 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:26 +0000 (0:00:00.038) 0:01:21.625 *********** 2021-06-25T04:41:27.076 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-06-25T04:41:27.078 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:41:27.101 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:27 +0000 (0:00:00.662) 0:01:22.287 *********** 2021-06-25T04:41:27.107 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:41:27.136 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:27 +0000 (0:00:00.035) 0:01:22.323 *********** 2021-06-25T04:41:27.145 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:41:27.172 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:27 +0000 (0:00:00.035) 0:01:22.359 *********** 2021-06-25T04:41:27.180 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:41:27.182 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:27.209 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:27 +0000 (0:00:00.036) 0:01:22.395 *********** 2021-06-25T04:41:27.233 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:27 +0000 (0:00:00.024) 0:01:22.420 *********** 2021-06-25T04:41:27.241 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:27.268 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:27 +0000 (0:00:00.035) 0:01:22.455 *********** 2021-06-25T04:41:27.295 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:27 +0000 (0:00:00.025) 0:01:22.480 *********** 2021-06-25T04:41:27.302 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:27.330 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:27 +0000 (0:00:00.036) 0:01:22.517 *********** 2021-06-25T04:41:27.950 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-06-25T04:41:27.952 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-06-25T04:41:27.952 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-06-25T04:41:27.954 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-06-25T04:41:27.977 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:27 +0000 (0:00:00.646) 0:01:23.164 *********** 2021-06-25T04:41:28.000 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:27 +0000 (0:00:00.022) 0:01:23.187 *********** 2021-06-25T04:41:28.023 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:28 +0000 (0:00:00.023) 0:01:23.210 *********** 2021-06-25T04:41:28.053 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:28 +0000 (0:00:00.029) 0:01:23.239 *********** 2021-06-25T04:41:28.708 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-06-25T04:41:28.709 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:41:28.732 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:28 +0000 (0:00:00.679) 0:01:23.919 *********** 2021-06-25T04:41:28.740 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:41:28.741 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:41:28.767 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:28 +0000 (0:00:00.034) 0:01:23.954 *********** 2021-06-25T04:41:28.790 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:28 +0000 (0:00:00.023) 0:01:23.977 *********** 2021-06-25T04:41:28.797 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:41:28.834 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:28 +0000 (0:00:00.043) 0:01:24.020 *********** 2021-06-25T04:41:29.194 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-06-25T04:41:29.196 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-06-25T04:41:29.217 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-06-25T04:41:29.251 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-06-25T04:41:29.319 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-06-25T04:41:29.545 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-06-25T04:41:29.558 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-06-25T04:41:29.581 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-06-25T04:41:29.636 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-06-25T04:41:29.854 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-06-25T04:41:29.855 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-06-25T04:41:29.888 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:29 +0000 (0:00:01.054) 0:01:25.075 *********** 2021-06-25T04:41:29.911 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:29 +0000 (0:00:00.022) 0:01:25.098 *********** 2021-06-25T04:41:29.919 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-06-25T04:41:29.953 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:29 +0000 (0:00:00.041) 0:01:25.139 *********** 2021-06-25T04:41:29.961 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-06-25T04:41:29.998 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:29 +0000 (0:00:00.045) 0:01:25.185 *********** 2021-06-25T04:41:30.031 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-06-25T04:41:30.032 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:41:30.066 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:30 +0000 (0:00:00.067) 0:01:25.253 *********** 2021-06-25T04:41:30.079 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:41:30.115 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:30 +0000 (0:00:00.049) 0:01:25.302 *********** 2021-06-25T04:41:30.123 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:41:30.150 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:30 +0000 (0:00:00.035) 0:01:25.337 *********** 2021-06-25T04:41:30.158 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:41:30.183 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:30 +0000 (0:00:00.032) 0:01:25.370 *********** 2021-06-25T04:41:30.437 INFO:teuthology.task.ansible.out: 2021-06-25T04:41:30.438 INFO:teuthology.task.ansible.out:TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi087.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-06-25T04:41:30.440 INFO:teuthology.task.ansible.out: 2021-06-25T04:41:30.483 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-06-25T04:41:30.516 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-06-25T04:41:30.561 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-06-25T04:41:30.732 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-06-25T04:41:30.775 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-06-25T04:41:30.807 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-06-25T04:41:30.851 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-06-25T04:41:31.067 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596090.7512546-18023-71118014755644/source", "state": "file", "uid": 0} 2021-06-25T04:41:31.094 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.910) 0:01:26.281 *********** 2021-06-25T04:41:31.113 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596090.7953055-18028-248383364935478/source", "state": "file", "uid": 0} 2021-06-25T04:41:31.141 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.046) 0:01:26.328 *********** 2021-06-25T04:41:31.153 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596090.8252826-18032-92226403491619/source", "state": "file", "uid": 0} 2021-06-25T04:41:31.182 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.040) 0:01:26.368 *********** 2021-06-25T04:41:31.190 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-06-25T04:41:31.192 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-06-25T04:41:31.220 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.038) 0:01:26.407 *********** 2021-06-25T04:41:31.227 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-06-25T04:41:31.229 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596090.869924-18038-201322760919676/source", "state": "file", "uid": 0} 2021-06-25T04:41:31.231 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-06-25T04:41:31.232 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-06-25T04:41:31.258 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.037) 0:01:26.444 *********** 2021-06-25T04:41:31.280 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.022) 0:01:26.467 *********** 2021-06-25T04:41:31.288 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-06-25T04:41:31.314 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.034) 0:01:26.501 *********** 2021-06-25T04:41:31.322 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-06-25T04:41:31.323 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.349 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.034) 0:01:26.535 *********** 2021-06-25T04:41:31.356 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-06-25T04:41:31.358 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} TASK [common : Include yum_systems vars] *************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.383 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.034) 0:01:26.570 *********** 2021-06-25T04:41:31.406 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.023) 0:01:26.593 *********** 2021-06-25T04:41:31.414 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.441 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.034) 0:01:26.627 *********** 2021-06-25T04:41:31.447 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-06-25T04:41:31.449 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:31.473 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.032) 0:01:26.660 *********** 2021-06-25T04:41:31.481 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-06-25T04:41:31.481 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.483 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:31.508 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.034) 0:01:26.694 *********** 2021-06-25T04:41:31.528 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.020) 0:01:26.715 *********** 2021-06-25T04:41:31.536 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:31.562 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.033) 0:01:26.749 *********** 2021-06-25T04:41:31.580 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-06-25T04:41:31.582 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.591 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:31.593 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.625 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.062) 0:01:26.812 *********** 2021-06-25T04:41:31.632 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.634 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.663 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.038) 0:01:26.850 *********** 2021-06-25T04:41:31.673 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.674 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.676 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.676 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.706 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.041) 0:01:26.892 *********** 2021-06-25T04:41:31.717 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.719 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.720 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.746 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.040) 0:01:26.932 *********** 2021-06-25T04:41:31.752 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.753 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-06-25T04:41:31.754 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.754 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.781 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.035) 0:01:26.968 *********** 2021-06-25T04:41:31.803 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.021) 0:01:26.990 *********** 2021-06-25T04:41:31.811 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-06-25T04:41:31.813 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.838 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.034) 0:01:27.024 *********** 2021-06-25T04:41:31.845 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.879 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.040) 0:01:27.065 *********** 2021-06-25T04:41:31.887 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:31.914 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:31 +0000 (0:00:00.035) 0:01:27.100 *********** 2021-06-25T04:41:32.509 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-06-25T04:41:32.511 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:41:32.534 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:32 +0000 (0:00:00.620) 0:01:27.721 *********** 2021-06-25T04:41:32.573 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:41:32.613 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:32 +0000 (0:00:00.078) 0:01:27.800 *********** 2021-06-25T04:41:32.629 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:41:32.664 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:32 +0000 (0:00:00.050) 0:01:27.850 *********** 2021-06-25T04:41:32.686 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:41:32.714 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:32 +0000 (0:00:00.049) 0:01:27.899 *********** 2021-06-25T04:41:32.934 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-06-25T04:41:32.936 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-06-25T04:41:32.960 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:32 +0000 (0:00:00.247) 0:01:28.147 *********** 2021-06-25T04:41:33.001 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-06-25T04:41:33.027 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.066) 0:01:28.214 *********** 2021-06-25T04:41:33.047 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-06-25T04:41:33.076 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.048) 0:01:28.262 *********** 2021-06-25T04:41:33.115 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-06-25T04:41:33.139 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.063) 0:01:28.326 *********** 2021-06-25T04:41:33.369 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-06-25T04:41:33.371 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-06-25T04:41:33.394 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.254) 0:01:28.580 *********** 2021-06-25T04:41:33.424 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-06-25T04:41:33.449 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.055) 0:01:28.636 *********** 2021-06-25T04:41:33.470 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-06-25T04:41:33.507 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.057) 0:01:28.693 *********** 2021-06-25T04:41:33.537 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-06-25T04:41:33.562 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.055) 0:01:28.749 *********** 2021-06-25T04:41:33.603 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-06-25T04:41:33.605 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-06-25T04:41:33.669 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-06-25T04:41:33.713 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-06-25T04:41:33.725 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-06-25T04:41:33.752 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.189) 0:01:28.939 *********** 2021-06-25T04:41:33.769 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-06-25T04:41:33.793 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-06-25T04:41:33.825 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.072) 0:01:29.012 *********** 2021-06-25T04:41:33.844 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:33.846 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi161.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-06-25T04:41:33.871 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.045) 0:01:29.058 *********** 2021-06-25T04:41:33.895 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.023) 0:01:29.082 *********** 2021-06-25T04:41:33.903 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-06-25T04:41:33.905 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-06-25T04:41:33.907 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:33.932 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.037) 0:01:29.119 *********** 2021-06-25T04:41:33.955 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.023) 0:01:29.142 *********** 2021-06-25T04:41:33.963 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-06-25T04:41:33.965 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:33.990 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:33 +0000 (0:00:00.034) 0:01:29.177 *********** 2021-06-25T04:41:33.999 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-06-25T04:41:34.001 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:34.026 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.035) 0:01:29.212 *********** 2021-06-25T04:41:34.034 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:34.035 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi102.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:34.060 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.034) 0:01:29.247 *********** 2021-06-25T04:41:34.083 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.022) 0:01:29.269 *********** 2021-06-25T04:41:34.091 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:34.120 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.034) 0:01:29.304 *********** 2021-06-25T04:41:34.125 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-06-25T04:41:34.127 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:34.153 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.035) 0:01:29.340 *********** 2021-06-25T04:41:34.160 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-06-25T04:41:34.162 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:34.186 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.033) 0:01:29.373 *********** 2021-06-25T04:41:34.223 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.036) 0:01:29.410 *********** 2021-06-25T04:41:34.242 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:34.268 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.044) 0:01:29.454 *********** 2021-06-25T04:41:34.275 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:34.302 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.034) 0:01:29.489 *********** 2021-06-25T04:41:34.501 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-06-25T04:41:34.526 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.223) 0:01:29.713 *********** 2021-06-25T04:41:34.609 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-06-25T04:41:34.636 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.109) 0:01:29.823 *********** 2021-06-25T04:41:34.655 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-06-25T04:41:34.680 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.044) 0:01:29.867 *********** 2021-06-25T04:41:34.698 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-06-25T04:41:34.725 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.043) 0:01:29.911 *********** 2021-06-25T04:41:34.785 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-06-25T04:41:34.787 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:39:40 UTC", "ActiveEnterTimestampMonotonic": "16050186", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target system.slice systemd-tmpfiles-setup.service systemd-journald.socket basic.target time-sync.target var-run.mount -.mount local-fs.target remote-fs.target network.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:39:40 UTC", "AssertTimestampMonotonic": "16045285", "Before": "shutdown.target plymouth-quit.service xdm.service multi-user.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:39:40 UTC", "Co 2021-06-25T04:41:34.789 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16045285", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "893", "ExecMainStartTimestamp": "Fri 2021-06-25 04:39:40 UTC", "ExecMainStartTimestampMonotonic": "16050037", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-06-25 04:39:40 UTC] ; stop_time=[n/a] ; pid=893 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-06-25 04:39:40 UTC] ; stop_time=[n/a] ; pid=893 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-06-25T04:41:34.791 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:39:40 UTC", "InactiveExitTimestampMonotonic": "16050186", "InvocationID": "654ec14909964cce98cb9a0986099173", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "893", "MemoryAccounting": "yes", "MemoryCurrent": "1323008", "MemoryD 2021-06-25T04:41:34.792 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:39:40 UTC", "StateChangeTimestampMonotonic": "16050186", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-06-25T04:41:34.794 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38333", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:41:34.813 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.088) 0:01:29.999 *********** 2021-06-25T04:41:34.883 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-06-25T04:41:34.885 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:34.906 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.094) 0:01:30.093 *********** 2021-06-25T04:41:34.914 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-06-25T04:41:34.916 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:39:44 UTC", "ActiveEnterTimestampMonotonic": "15483228", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket time-sync.target remote-fs.target basic.target var-run.mount network.target nss-lookup.target systemd-tmpfiles-setup.service system.slice -.mount sysinit.target local-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:39:44 UTC", "AssertTimestampMonotonic": "15481331", "Before": "plymouth-quit.service shutdown.target multi-user.target getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:39:44 UTC", "Co 2021-06-25T04:41:34.918 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15481331", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "895", "ExecMainStartTimestamp": "Fri 2021-06-25 04:39:44 UTC", "ExecMainStartTimestampMonotonic": "15483068", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-06-25 04:39:44 UTC] ; stop_time=[n/a] ; pid=895 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-06-25 04:39:44 UTC] ; stop_time=[n/a] ; pid=895 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-06-25T04:41:34.919 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:39:44 UTC", "InactiveExitTimestampMonotonic": "15483228", "InvocationID": "457b5a90816e424681985fe6c5e2e903", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "895", "MemoryAccounting": "yes", "MemoryCurrent": "1265664", "MemoryD 2021-06-25T04:41:34.921 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:39:44 UTC", "StateChangeTimestampMonotonic": "15483228", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-06-25T04:41:34.923 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38333", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:41:34.942 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.035) 0:01:30.129 *********** 2021-06-25T04:41:34.952 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:39:55 UTC", "ActiveEnterTimestampMonotonic": "15769038", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target time-sync.target system.slice systemd-journald.socket sysinit.target nss-lookup.target -.mount systemd-tmpfiles-setup.service network.target var-run.mount basic.target local-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:39:55 UTC", "AssertTimestampMonotonic": "15764533", "Before": "shutdown.target xdm.service multi-user.target plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:39:55 UTC", "Co 2021-06-25T04:41:34.954 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15764533", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "903", "ExecMainStartTimestamp": "Fri 2021-06-25 04:39:55 UTC", "ExecMainStartTimestampMonotonic": "15768867", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-06-25 04:39:55 UTC] ; stop_time=[n/a] ; pid=903 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-06-25 04:39:55 UTC] ; stop_time=[n/a] ; pid=903 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-06-25T04:41:34.956 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:39:55 UTC", "InactiveExitTimestampMonotonic": "15769038", "InvocationID": "63245cf898454f9c994a3d523759c19c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "903", "MemoryAccounting": "yes", "MemoryCurrent": "1257472", "MemoryD 2021-06-25T04:41:34.957 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:39:55 UTC", "StateChangeTimestampMonotonic": "15769038", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-06-25T04:41:34.959 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", 2021-06-25T04:41:34.959 INFO:teuthology.task.ansible.out: "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38333", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:41:34.991 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:34 +0000 (0:00:00.048) 0:01:30.177 *********** 2021-06-25T04:41:34.998 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-06-25T04:41:35.001 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-06-25T04:41:35.002 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:39:33 UTC", "ActiveEnterTimestampMonotonic": "15595500", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target remote-fs.target var-run.mount local-fs.target nss-lookup.target network.target sysinit.target -.mount time-sync.target systemd-tmpfiles-setup.service system.slice systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:39:33 UTC", "AssertTimestampMonotonic": "15593309", "Before": "xdm.service multi-user.target shutdown.target getty@tty1.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:39:33 UTC", "Co 2021-06-25T04:41:35.004 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15593308", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "843", "ExecMainStartTimestamp": "Fri 2021-06-25 04:39:33 UTC", "ExecMainStartTimestampMonotonic": "15595343", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-06-25 04:39:33 UTC] ; stop_time=[n/a] ; pid=843 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-06-25 04:39:33 UTC] ; stop_time=[n/a] ; pid=843 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-06-25T04:41:35.005 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:39:33 UTC", "InactiveExitTimestampMonotonic": "15595500", "InvocationID": "13fec4eb126040b6b78696157e2a657b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127802", "LimitNPROCSoft": "127802", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127802", "LimitSIGPENDINGSoft": "127802", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "843", "MemoryAccounting": "yes", "MemoryCurrent": "1310720", "MemoryD 2021-06-25T04:41:35.007 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:39:33 UTC", "StateChangeTimestampMonotonic": "15595500", "StateDire 2021-06-25T04:41:35.007 INFO:teuthology.task.ansible.out:ctoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-06-25T04:41:35.009 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38340", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:41:35.034 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.043) 0:01:30.221 *********** 2021-06-25T04:41:35.058 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.023) 0:01:30.244 *********** 2021-06-25T04:41:35.066 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-06-25T04:41:35.068 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.092 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.034) 0:01:30.279 *********** 2021-06-25T04:41:35.115 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.022) 0:01:30.302 *********** 2021-06-25T04:41:35.122 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.123 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-06-25T04:41:35.124 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.162 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.046) 0:01:30.349 *********** 2021-06-25T04:41:35.193 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.031) 0:01:30.380 *********** 2021-06-25T04:41:35.202 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-06-25T04:41:35.205 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.232 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.038) 0:01:30.418 *********** 2021-06-25T04:41:35.254 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.022) 0:01:30.441 *********** 2021-06-25T04:41:35.262 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.263 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.288 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.033) 0:01:30.475 *********** 2021-06-25T04:41:35.309 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.020) 0:01:30.495 *********** 2021-06-25T04:41:35.327 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-06-25T04:41:35.329 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.352 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.043) 0:01:30.539 *********** 2021-06-25T04:41:35.359 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.361 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.390 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.037) 0:01:30.576 *********** 2021-06-25T04:41:35.411 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.021) 0:01:30.598 *********** 2021-06-25T04:41:35.419 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-06-25T04:41:35.420 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.421 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.446 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.034) 0:01:30.633 *********** 2021-06-25T04:41:35.469 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.022) 0:01:30.656 *********** 2021-06-25T04:41:35.476 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.502 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.033) 0:01:30.689 *********** 2021-06-25T04:41:35.510 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.511 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-06-25T04:41:35.511 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.537 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.034) 0:01:30.724 *********** 2021-06-25T04:41:35.559 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.021) 0:01:30.746 *********** 2021-06-25T04:41:35.566 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-06-25T04:41:35.567 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.567 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.593 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.034) 0:01:30.780 *********** 2021-06-25T04:41:35.617 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.023) 0:01:30.804 *********** 2021-06-25T04:41:35.624 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-06-25T04:41:35.626 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.650 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.032) 0:01:30.837 *********** 2021-06-25T04:41:35.658 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-06-25T04:41:35.660 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.685 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.034) 0:01:30.871 *********** 2021-06-25T04:41:35.692 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-06-25T04:41:35.694 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.719 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.034) 0:01:30.906 *********** 2021-06-25T04:41:35.750 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.030) 0:01:30.936 *********** 2021-06-25T04:41:35.758 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.760 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.787 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.036) 0:01:30.973 *********** 2021-06-25T04:41:35.813 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.026) 0:01:31.000 *********** 2021-06-25T04:41:35.821 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-06-25T04:41:35.823 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.849 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.035) 0:01:31.035 *********** 2021-06-25T04:41:35.872 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.022) 0:01:31.058 *********** 2021-06-25T04:41:35.879 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-06-25T04:41:35.881 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.906 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.034) 0:01:31.093 *********** 2021-06-25T04:41:35.929 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.022) 0:01:31.116 *********** 2021-06-25T04:41:35.936 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-06-25T04:41:35.937 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.938 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:35.963 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.034) 0:01:31.150 *********** 2021-06-25T04:41:35.985 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:35 +0000 (0:00:00.022) 0:01:31.172 *********** 2021-06-25T04:41:36.194 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:36.218 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.232) 0:01:31.405 *********** 2021-06-25T04:41:36.220 INFO:teuthology.task.ansible.out: 2021-06-25T04:41:36.242 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.023) 0:01:31.428 *********** 2021-06-25T04:41:36.249 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-06-25T04:41:36.251 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:36.276 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.034) 0:01:31.463 *********** 2021-06-25T04:41:36.307 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.030) 0:01:31.494 *********** 2021-06-25T04:41:36.340 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:36.365 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.057) 0:01:31.552 *********** 2021-06-25T04:41:36.374 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-06-25T04:41:36.376 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:36.407 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.041) 0:01:31.594 *********** 2021-06-25T04:41:36.414 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:36.445 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.037) 0:01:31.631 *********** 2021-06-25T04:41:36.452 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-06-25T04:41:36.454 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:36.480 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.035) 0:01:31.667 *********** 2021-06-25T04:41:36.504 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.023) 0:01:31.691 *********** 2021-06-25T04:41:36.511 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-06-25T04:41:36.513 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-06-25T04:41:36.538 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.034) 0:01:31.725 *********** 2021-06-25T04:41:36.546 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-06-25T04:41:36.572 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.033) 0:01:31.758 *********** 2021-06-25T04:41:36.739 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-06-25T04:41:36.741 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-06-25T04:41:36.764 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.192) 0:01:31.951 *********** 2021-06-25T04:41:36.771 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-06-25T04:41:36.773 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-06-25T04:41:36.799 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.034) 0:01:31.985 *********** 2021-06-25T04:41:36.807 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-06-25T04:41:36.807 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-06-25T04:41:36.810 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-06-25T04:41:36.842 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:36 +0000 (0:00:00.043) 0:01:32.029 *********** 2021-06-25T04:41:37.034 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.192) 0:01:32.221 *********** 2021-06-25T04:41:37.043 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-06-25T04:41:37.045 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-06-25T04:41:37.071 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.037) 0:01:32.258 *********** 2021-06-25T04:41:37.080 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-06-25T04:41:37.081 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-06-25T04:41:37.083 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-06-25T04:41:37.085 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-06-25T04:41:37.110 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.038) 0:01:32.296 *********** 2021-06-25T04:41:37.134 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.024) 0:01:32.321 *********** 2021-06-25T04:41:37.142 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-06-25T04:41:37.170 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.035) 0:01:32.356 *********** 2021-06-25T04:41:37.177 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-06-25T04:41:37.180 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-06-25T04:41:37.208 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.038) 0:01:32.395 *********** 2021-06-25T04:41:37.216 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-06-25T04:41:37.220 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-06-25T04:41:37.221 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-06-25T04:41:37.253 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.044) 0:01:32.439 *********** 2021-06-25T04:41:37.276 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.022) 0:01:32.461 *********** 2021-06-25T04:41:37.282 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-06-25T04:41:37.283 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-06-25T04:41:37.310 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.034) 0:01:32.496 *********** 2021-06-25T04:41:37.348 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-06-25T04:41:37.349 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-06-25T04:41:37.376 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.064) 0:01:32.561 *********** 2021-06-25T04:41:37.383 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-06-25T04:41:37.422 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.047) 0:01:32.608 *********** 2021-06-25T04:41:37.432 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-06-25T04:41:37.433 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-06-25T04:41:37.467 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.045) 0:01:32.654 *********** 2021-06-25T04:41:37.474 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-06-25T04:41:37.509 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.041) 0:01:32.696 *********** 2021-06-25T04:41:37.560 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-06-25T04:41:37.587 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.077) 0:01:32.773 *********** 2021-06-25T04:41:37.594 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-06-25T04:41:37.596 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-06-25T04:41:37.622 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.035) 0:01:32.809 *********** 2021-06-25T04:41:37.663 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-06-25T04:41:37.688 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.065) 0:01:32.875 *********** 2021-06-25T04:41:37.696 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-06-25T04:41:37.697 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-06-25T04:41:37.728 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.035) 0:01:32.910 *********** 2021-06-25T04:41:37.747 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.022) 0:01:32.933 *********** 2021-06-25T04:41:37.764 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-06-25T04:41:37.766 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-06-25T04:41:37.791 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.044) 0:01:32.978 *********** 2021-06-25T04:41:37.814 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.022) 0:01:33.001 *********** 2021-06-25T04:41:37.821 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-06-25T04:41:37.823 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:37.851 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.037) 0:01:33.038 *********** 2021-06-25T04:41:37.878 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.026) 0:01:33.065 *********** 2021-06-25T04:41:37.898 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:37.900 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:37.925 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.046) 0:01:33.111 *********** 2021-06-25T04:41:37.947 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.022) 0:01:33.134 *********** 2021-06-25T04:41:37.965 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:37.997 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:37 +0000 (0:00:00.050) 0:01:33.184 *********** 2021-06-25T04:41:38.026 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:38.052 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.054) 0:01:33.238 *********** 2021-06-25T04:41:38.082 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-06-25T04:41:38.084 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-06-25T04:41:38.108 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.056) 0:01:33.295 *********** 2021-06-25T04:41:38.151 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-06-25T04:41:38.188 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.079) 0:01:33.374 *********** 2021-06-25T04:41:38.242 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-06-25T04:41:38.270 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.077) 0:01:33.452 *********** 2021-06-25T04:41:38.283 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-06-25T04:41:38.311 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.045) 0:01:33.498 *********** 2021-06-25T04:41:38.607 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-06-25T04:41:38.610 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-06-25T04:41:38.632 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.320) 0:01:33.819 *********** 2021-06-25T04:41:38.660 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-06-25T04:41:38.686 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.053) 0:01:33.872 *********** 2021-06-25T04:41:38.728 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-06-25T04:41:38.730 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi087"}, "changed": false} 2021-06-25T04:41:38.754 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.067) 0:01:33.940 *********** 2021-06-25T04:41:38.761 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-06-25T04:41:38.763 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-06-25T04:41:38.787 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.033) 0:01:33.974 *********** 2021-06-25T04:41:38.795 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-06-25T04:41:38.796 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi057"}, "changed": false} TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-06-25T04:41:38.797 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-06-25T04:41:38.824 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.036) 0:01:34.010 *********** 2021-06-25T04:41:38.854 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.030) 0:01:34.041 *********** 2021-06-25T04:41:38.873 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-06-25T04:41:38.875 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi102"}, "changed": false} 2021-06-25T04:41:38.905 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.050) 0:01:34.092 *********** 2021-06-25T04:41:38.937 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi161"}, "changed": false} 2021-06-25T04:41:38.965 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:38 +0000 (0:00:00.057) 0:01:34.149 *********** 2021-06-25T04:41:39.635 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-06-25T04:41:39.637 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi057.front.sepia.ceph.com", "ansible_hostname": "smithi057", "ansible_nodename": "smithi057"}, "changed": true, "name": "smithi057"} changed: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi161.front.sepia.ceph.com", "ansible_hostname": "smithi161", "ansible_nodename": "smithi161"}, "changed": true, "name": "smithi161"} 2021-06-25T04:41:39.664 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:39 +0000 (0:00:00.701) 0:01:34.850 *********** 2021-06-25T04:41:39.699 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:39 +0000 (0:00:00.035) 0:01:34.886 *********** 2021-06-25T04:41:39.707 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi087.front.sepia.ceph.com", "ansible_hostname": "smithi087", "ansible_nodename": "smithi087"}, "changed": true, "name": "smithi087"} 2021-06-25T04:41:39.708 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi102.front.sepia.ceph.com", "ansible_hostname": "smithi102", "ansible_nodename": "smithi102"}, "changed": true, "name": "smithi102"} 2021-06-25T04:41:39.738 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:39 +0000 (0:00:00.038) 0:01:34.925 *********** 2021-06-25T04:41:39.766 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:39 +0000 (0:00:00.027) 0:01:34.953 *********** 2021-06-25T04:41:40.068 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-06-25T04:41:40.070 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-06-25T04:41:40.105 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:40 +0000 (0:00:00.339) 0:01:35.292 *********** 2021-06-25T04:41:40.136 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-06-25T04:41:40.137 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-06-25T04:41:40.171 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:40 +0000 (0:00:00.065) 0:01:35.358 *********** 2021-06-25T04:41:40.201 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:40 +0000 (0:00:00.030) 0:01:35.388 *********** 2021-06-25T04:41:40.213 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-06-25T04:41:40.251 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:40 +0000 (0:00:00.049) 0:01:35.438 *********** 2021-06-25T04:41:40.539 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-06-25T04:41:40.540 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-06-25T04:41:40.565 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:40 +0000 (0:00:00.313) 0:01:35.751 *********** 2021-06-25T04:41:40.573 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-06-25T04:41:40.602 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:40 +0000 (0:00:00.037) 0:01:35.789 *********** 2021-06-25T04:41:40.620 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-06-25T04:41:40.651 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:40 +0000 (0:00:00.049) 0:01:35.838 *********** 2021-06-25T04:41:40.669 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-06-25T04:41:40.696 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:40 +0000 (0:00:00.044) 0:01:35.882 *********** 2021-06-25T04:41:41.055 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-06-25T04:41:41.057 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-06-25T04:41:41.079 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.383) 0:01:36.266 *********** 2021-06-25T04:41:41.081 INFO:teuthology.task.ansible.out: 2021-06-25T04:41:41.099 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-06-25T04:41:41.135 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.055) 0:01:36.322 *********** 2021-06-25T04:41:41.146 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-06-25T04:41:41.178 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.042) 0:01:36.364 *********** 2021-06-25T04:41:41.185 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-06-25T04:41:41.186 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.213 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.034) 0:01:36.399 *********** 2021-06-25T04:41:41.220 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-06-25T04:41:41.222 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Create remote.conf] ******************************************* 2021-06-25T04:41:41.223 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.258 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.045) 0:01:36.445 *********** 2021-06-25T04:41:41.285 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.027) 0:01:36.472 *********** 2021-06-25T04:41:41.294 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.296 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.333 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.047) 0:01:36.519 *********** 2021-06-25T04:41:41.365 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.031) 0:01:36.551 *********** 2021-06-25T04:41:41.371 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.407 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.043) 0:01:36.594 *********** 2021-06-25T04:41:41.414 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-06-25T04:41:41.416 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.452 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.044) 0:01:36.639 *********** 2021-06-25T04:41:41.490 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.037) 0:01:36.676 *********** 2021-06-25T04:41:41.501 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.505 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.531 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.041) 0:01:36.718 *********** 2021-06-25T04:41:41.554 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.022) 0:01:36.740 *********** 2021-06-25T04:41:41.561 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-06-25T04:41:41.563 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.589 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.034) 0:01:36.775 *********** 2021-06-25T04:41:41.596 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-06-25T04:41:41.599 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.633 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.044) 0:01:36.820 *********** 2021-06-25T04:41:41.640 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-06-25T04:41:41.642 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.675 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.042) 0:01:36.862 *********** 2021-06-25T04:41:41.705 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.029) 0:01:36.892 *********** 2021-06-25T04:41:41.713 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-06-25T04:41:41.715 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.740 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.034) 0:01:36.926 *********** 2021-06-25T04:41:41.774 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.034) 0:01:36.961 *********** 2021-06-25T04:41:41.786 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.789 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.818 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.043) 0:01:37.004 *********** 2021-06-25T04:41:41.847 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.029) 0:01:37.034 *********** 2021-06-25T04:41:41.853 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-06-25T04:41:41.856 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.881 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.033) 0:01:37.067 *********** 2021-06-25T04:41:41.906 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.024) 0:01:37.092 *********** 2021-06-25T04:41:41.914 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-06-25T04:41:41.916 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.941 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.034) 0:01:37.127 *********** 2021-06-25T04:41:41.949 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-06-25T04:41:41.950 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:41.980 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:41 +0000 (0:00:00.038) 0:01:37.166 *********** 2021-06-25T04:41:41.988 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-06-25T04:41:41.991 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.020 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.040) 0:01:37.206 *********** 2021-06-25T04:41:42.027 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-06-25T04:41:42.029 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.054 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.034) 0:01:37.241 *********** 2021-06-25T04:41:42.076 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.021) 0:01:37.263 *********** 2021-06-25T04:41:42.083 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.117 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.040) 0:01:37.304 *********** 2021-06-25T04:41:42.209 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 25 June 2021 04:41:42 +0000 (0:00:00.035) 0:01:37.339 *********** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 25 June 2021 04:41:42 +0000 (0:00:00.039) 0:01:37.379 *********** 2021-06-25T04:41:42.218 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.025) 0:01:37.405 *********** 2021-06-25T04:41:42.225 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-06-25T04:41:42.227 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.253 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.034) 0:01:37.439 *********** 2021-06-25T04:41:42.279 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.026) 0:01:37.465 *********** 2021-06-25T04:41:42.285 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.287 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.312 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.033) 0:01:37.499 *********** 2021-06-25T04:41:42.338 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.022) 0:01:37.521 *********** 2021-06-25T04:41:42.342 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.368 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.032) 0:01:37.554 *********** 2021-06-25T04:41:42.375 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-06-25T04:41:42.377 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.413 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.045) 0:01:37.600 *********** 2021-06-25T04:41:42.422 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-06-25T04:41:42.425 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.449 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.035) 0:01:37.636 *********** 2021-06-25T04:41:42.473 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.024) 0:01:37.660 *********** 2021-06-25T04:41:42.481 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-06-25T04:41:42.516 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.042) 0:01:37.703 *********** 2021-06-25T04:41:42.524 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:41:42.526 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-06-25T04:41:42.554 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.037) 0:01:37.741 *********** 2021-06-25T04:41:42.579 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.024) 0:01:37.765 *********** 2021-06-25T04:41:42.589 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.625 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.046) 0:01:37.812 *********** 2021-06-25T04:41:42.633 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-06-25T04:41:42.673 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.047) 0:01:37.860 *********** 2021-06-25T04:41:42.682 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-06-25T04:41:42.686 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.715 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.040) 0:01:37.900 *********** 2021-06-25T04:41:42.735 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.021) 0:01:37.922 *********** 2021-06-25T04:41:42.742 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.771 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.034) 0:01:37.957 *********** 2021-06-25T04:41:42.779 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-06-25T04:41:42.807 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.036) 0:01:37.993 *********** 2021-06-25T04:41:42.814 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-06-25T04:41:42.843 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.035) 0:01:38.029 *********** 2021-06-25T04:41:42.869 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.026) 0:01:38.056 *********** 2021-06-25T04:41:42.908 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.039) 0:01:38.095 *********** 2021-06-25T04:41:42.917 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-06-25T04:41:42.920 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:42.956 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.048) 0:01:38.143 *********** 2021-06-25T04:41:42.986 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:42 +0000 (0:00:00.029) 0:01:38.172 *********** 2021-06-25T04:41:42.994 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-06-25T04:41:43.022 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.036) 0:01:38.208 *********** 2021-06-25T04:41:43.064 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.042) 0:01:38.251 *********** 2021-06-25T04:41:43.071 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-06-25T04:41:43.073 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.075 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.105 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.041) 0:01:38.292 *********** 2021-06-25T04:41:43.131 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.025) 0:01:38.317 *********** 2021-06-25T04:41:43.139 INFO:teuthology.task.ansible.out: 2021-06-25T04:41:43.141 INFO:teuthology.task.ansible.out:TASK [testnode : Enable copr repos] ******************************************** 2021-06-25T04:41:43.168 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.036) 0:01:38.354 *********** 2021-06-25T04:41:43.196 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.028) 0:01:38.382 *********** 2021-06-25T04:41:43.203 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-06-25T04:41:43.206 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.240 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.043) 0:01:38.426 *********** 2021-06-25T04:41:43.266 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.025) 0:01:38.452 *********** 2021-06-25T04:41:43.274 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-06-25T04:41:43.275 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.303 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.037) 0:01:38.489 *********** 2021-06-25T04:41:43.327 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.023) 0:01:38.513 *********** 2021-06-25T04:41:43.336 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.338 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.370 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.043) 0:01:38.557 *********** 2021-06-25T04:41:43.397 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.024) 0:01:38.581 *********** 2021-06-25T04:41:43.404 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-06-25T04:41:43.406 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.435 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.039) 0:01:38.621 *********** 2021-06-25T04:41:43.442 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.444 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.445 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.474 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.040) 0:01:38.661 *********** 2021-06-25T04:41:43.496 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.022) 0:01:38.683 *********** 2021-06-25T04:41:43.504 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.506 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.533 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.036) 0:01:38.720 *********** 2021-06-25T04:41:43.560 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.026) 0:01:38.746 *********** 2021-06-25T04:41:43.567 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-06-25T04:41:43.568 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.595 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.035) 0:01:38.781 *********** 2021-06-25T04:41:43.621 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.026) 0:01:38.808 *********** 2021-06-25T04:41:43.628 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-06-25T04:41:43.630 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.655 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.033) 0:01:38.841 *********** 2021-06-25T04:41:43.662 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:41:43.664 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.688 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.033) 0:01:38.875 *********** 2021-06-25T04:41:43.695 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-06-25T04:41:43.697 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.723 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.034) 0:01:38.910 *********** 2021-06-25T04:41:43.754 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.030) 0:01:38.940 *********** 2021-06-25T04:41:43.762 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.764 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.799 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.045) 0:01:38.986 *********** 2021-06-25T04:41:43.832 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.032) 0:01:39.018 *********** 2021-06-25T04:41:43.840 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-06-25T04:41:43.842 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.867 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.035) 0:01:39.053 *********** 2021-06-25T04:41:43.888 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.021) 0:01:39.075 *********** 2021-06-25T04:41:43.895 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-06-25T04:41:43.897 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** 2021-06-25T04:41:43.897 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:43.936 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.047) 0:01:39.123 *********** 2021-06-25T04:41:43.976 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:43 +0000 (0:00:00.039) 0:01:39.162 *********** 2021-06-25T04:41:43.986 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-06-25T04:41:43.989 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.018 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.042) 0:01:39.204 *********** 2021-06-25T04:41:44.041 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.023) 0:01:39.227 *********** 2021-06-25T04:41:44.048 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.074 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.033) 0:01:39.261 *********** 2021-06-25T04:41:44.082 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-06-25T04:41:44.083 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.109 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.034) 0:01:39.296 *********** 2021-06-25T04:41:44.116 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-06-25T04:41:44.118 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.141 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.032) 0:01:39.328 *********** 2021-06-25T04:41:44.149 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-06-25T04:41:44.152 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.182 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.040) 0:01:39.368 *********** 2021-06-25T04:41:44.192 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-06-25T04:41:44.194 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.222 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.040) 0:01:39.409 *********** 2021-06-25T04:41:44.249 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.026) 0:01:39.435 *********** 2021-06-25T04:41:44.258 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-06-25T04:41:44.260 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.286 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.037) 0:01:39.473 *********** 2021-06-25T04:41:44.319 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.033) 0:01:39.506 *********** 2021-06-25T04:41:44.329 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-06-25T04:41:44.330 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.360 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.040) 0:01:39.546 *********** 2021-06-25T04:41:44.382 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.022) 0:01:39.569 *********** 2021-06-25T04:41:44.389 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-06-25T04:41:44.390 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.391 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.427 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.044) 0:01:39.613 *********** 2021-06-25T04:41:44.454 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.026) 0:01:39.640 *********** 2021-06-25T04:41:44.463 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-06-25T04:41:44.465 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.492 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.038) 0:01:39.679 *********** 2021-06-25T04:41:44.515 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.022) 0:01:39.701 *********** 2021-06-25T04:41:44.522 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-06-25T04:41:44.524 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.548 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.033) 0:01:39.735 *********** 2021-06-25T04:41:44.555 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-06-25T04:41:44.557 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.590 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.039) 0:01:39.774 *********** 2021-06-25T04:41:44.596 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-06-25T04:41:44.600 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.625 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.036) 0:01:39.811 *********** 2021-06-25T04:41:44.634 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-06-25T04:41:44.635 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.668 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.043) 0:01:39.855 *********** 2021-06-25T04:41:44.699 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.030) 0:01:39.885 *********** 2021-06-25T04:41:44.708 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-06-25T04:41:44.710 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.737 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.038) 0:01:39.924 *********** 2021-06-25T04:41:44.768 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.030) 0:01:39.955 *********** 2021-06-25T04:41:44.775 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-06-25T04:41:44.777 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.803 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.034) 0:01:39.989 *********** 2021-06-25T04:41:44.813 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-06-25T04:41:44.816 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.851 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.048) 0:01:40.038 *********** 2021-06-25T04:41:44.862 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-06-25T04:41:44.864 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.900 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.048) 0:01:40.086 *********** 2021-06-25T04:41:44.922 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.022) 0:01:40.109 *********** 2021-06-25T04:41:44.929 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-06-25T04:41:44.931 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:44.957 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.034) 0:01:40.144 *********** 2021-06-25T04:41:44.978 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:44 +0000 (0:00:00.021) 0:01:40.165 *********** 2021-06-25T04:41:44.985 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-06-25T04:41:44.987 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.016 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.038) 0:01:40.203 *********** 2021-06-25T04:41:45.024 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-06-25T04:41:45.026 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.050 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.034) 0:01:40.237 *********** 2021-06-25T04:41:45.058 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-06-25T04:41:45.060 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.085 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.034) 0:01:40.272 *********** 2021-06-25T04:41:45.094 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.096 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.120 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.035) 0:01:40.307 *********** 2021-06-25T04:41:45.142 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.021) 0:01:40.329 *********** 2021-06-25T04:41:45.149 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-06-25T04:41:45.151 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.176 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.034) 0:01:40.363 *********** 2021-06-25T04:41:45.185 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.186 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.211 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.035) 0:01:40.398 *********** 2021-06-25T04:41:45.234 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.022) 0:01:40.420 *********** 2021-06-25T04:41:45.241 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-06-25T04:41:45.244 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.274 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.039) 0:01:40.460 *********** 2021-06-25T04:41:45.284 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.313 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.038) 0:01:40.499 *********** 2021-06-25T04:41:45.319 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-06-25T04:41:45.321 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.346 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.033) 0:01:40.533 *********** 2021-06-25T04:41:45.353 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.355 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.379 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.033) 0:01:40.566 *********** 2021-06-25T04:41:45.411 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.031) 0:01:40.597 *********** 2021-06-25T04:41:45.419 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.421 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.447 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.036) 0:01:40.633 *********** 2021-06-25T04:41:45.470 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.023) 0:01:40.657 *********** 2021-06-25T04:41:45.478 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.480 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.506 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.035) 0:01:40.693 *********** 2021-06-25T04:41:45.529 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.023) 0:01:40.716 *********** 2021-06-25T04:41:45.537 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-06-25T04:41:45.540 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.564 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.035) 0:01:40.751 *********** 2021-06-25T04:41:45.588 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.024) 0:01:40.775 *********** 2021-06-25T04:41:45.595 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-06-25T04:41:45.597 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.623 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.034) 0:01:40.809 *********** 2021-06-25T04:41:45.631 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-06-25T04:41:45.633 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.657 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.034) 0:01:40.844 *********** 2021-06-25T04:41:45.665 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-06-25T04:41:45.667 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.692 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.034) 0:01:40.879 *********** 2021-06-25T04:41:45.717 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.024) 0:01:40.903 *********** 2021-06-25T04:41:45.726 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-06-25T04:41:45.728 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.756 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.039) 0:01:40.942 *********** 2021-06-25T04:41:45.788 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.032) 0:01:40.975 *********** 2021-06-25T04:41:45.796 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.822 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.033) 0:01:41.008 *********** 2021-06-25T04:41:45.861 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-06-25T04:41:45.862 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.886 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.064) 0:01:41.073 *********** 2021-06-25T04:41:45.893 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-06-25T04:41:45.895 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005321", "end": "2021-06-25 04:41:46.436791", "rc": 0, "start": "2021-06-25 04:41:46.431470", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:45.920 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.033) 0:01:41.106 *********** 2021-06-25T04:41:45.929 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.955 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.035) 0:01:41.142 *********** 2021-06-25T04:41:45.962 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-06-25T04:41:45.964 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005347", "end": "2021-06-25 04:41:46.375684", "rc": 0, "start": "2021-06-25 04:41:46.370337", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:45.991 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:45 +0000 (0:00:00.035) 0:01:41.178 *********** 2021-06-25T04:41:46.014 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.022) 0:01:41.201 *********** 2021-06-25T04:41:46.022 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-06-25T04:41:46.049 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.034) 0:01:41.235 *********** 2021-06-25T04:41:46.057 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-06-25T04:41:46.060 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:46.084 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.033) 0:01:41.269 *********** 2021-06-25T04:41:46.089 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-06-25T04:41:46.125 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.042) 0:01:41.311 *********** 2021-06-25T04:41:46.134 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-06-25T04:41:46.136 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:46.161 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.036) 0:01:41.348 *********** 2021-06-25T04:41:46.168 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:46.194 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.033) 0:01:41.381 *********** 2021-06-25T04:41:46.353 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-06-25T04:41:46.355 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005191", "end": "2021-06-25 04:41:46.591200", "rc": 0, "start": "2021-06-25 04:41:46.586009", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:46.400 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.205) 0:01:41.587 *********** 2021-06-25T04:41:46.409 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005278", "end": "2021-06-25 04:41:45.950328", "rc": 0, "start": "2021-06-25 04:41:45.945050", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:46.437 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.036) 0:01:41.623 *********** 2021-06-25T04:41:46.446 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-06-25T04:41:46.449 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-06-25T04:41:46.479 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.042) 0:01:41.665 *********** 2021-06-25T04:41:46.487 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-06-25T04:41:46.517 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.038) 0:01:41.704 *********** 2021-06-25T04:41:46.526 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-06-25T04:41:46.528 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-06-25T04:41:46.558 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.040) 0:01:41.745 *********** 2021-06-25T04:41:46.586 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.027) 0:01:41.772 *********** 2021-06-25T04:41:46.594 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-06-25T04:41:46.596 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:46.624 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.037) 0:01:41.810 *********** 2021-06-25T04:41:46.645 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:46.677 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.053) 0:01:41.864 *********** 2021-06-25T04:41:46.901 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-06-25T04:41:46.903 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-06-25T04:41:46.926 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:46 +0000 (0:00:00.248) 0:01:42.112 *********** 2021-06-25T04:41:46.985 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-06-25T04:41:47.010 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:47 +0000 (0:00:00.083) 0:01:42.196 *********** 2021-06-25T04:41:47.017 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:47.043 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:47 +0000 (0:00:00.032) 0:01:42.229 *********** 2021-06-25T04:41:47.082 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:41:47.115 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:47 +0000 (0:00:00.072) 0:01:42.301 *********** 2021-06-25T04:41:47.997 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-06-25T04:41:47.999 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-06-25T04:41:48.051 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-06-25T04:41:48.114 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-06-25T04:41:48.189 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-06-25T04:41:48.954 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-06-25T04:41:48.980 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:48 +0000 (0:00:01.865) 0:01:44.167 *********** 2021-06-25T04:41:49.041 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-06-25T04:41:49.067 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:49 +0000 (0:00:00.086) 0:01:44.253 *********** 2021-06-25T04:41:49.075 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-06-25T04:41:49.113 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:49 +0000 (0:00:00.046) 0:01:44.300 *********** 2021-06-25T04:41:49.142 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-06-25T04:41:49.168 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:49 +0000 (0:00:00.054) 0:01:44.355 *********** 2021-06-25T04:41:49.698 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-06-25T04:41:49.700 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:41:49.723 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:49 +0000 (0:00:00.555) 0:01:44.910 *********** 2021-06-25T04:41:49.794 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-06-25T04:41:49.824 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:49 +0000 (0:00:00.100) 0:01:45.011 *********** 2021-06-25T04:41:49.833 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-06-25T04:41:49.834 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:41:49.835 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:41:49.870 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:49 +0000 (0:00:00.045) 0:01:45.057 *********** 2021-06-25T04:41:49.896 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:49 +0000 (0:00:00.026) 0:01:45.083 *********** 2021-06-25T04:41:49.905 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:41:49.937 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:49 +0000 (0:00:00.041) 0:01:45.124 *********** 2021-06-25T04:41:49.945 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-06-25T04:41:49.974 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:49 +0000 (0:00:00.035) 0:01:45.160 *********** 2021-06-25T04:41:50.009 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:50 +0000 (0:00:00.035) 0:01:45.195 *********** 2021-06-25T04:41:50.051 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:50 +0000 (0:00:00.041) 0:01:45.237 *********** 2021-06-25T04:41:50.059 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-06-25T04:41:50.061 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.029702", "end": "2021-06-25 04:41:50.463277", "rc": 0, "start": "2021-06-25 04:41:50.433575", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:50.087 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:50 +0000 (0:00:00.036) 0:01:45.273 *********** 2021-06-25T04:41:50.192 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033506", "end": "2021-06-25 04:41:50.739307", "rc": 0, "start": "2021-06-25 04:41:50.705801", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:50.222 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:50 +0000 (0:00:00.135) 0:01:45.409 *********** 2021-06-25T04:41:50.244 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031022", "end": "2021-06-25 04:41:50.474699", "rc": 0, "start": "2021-06-25 04:41:50.443677", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:50.272 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:50 +0000 (0:00:00.049) 0:01:45.458 *********** 2021-06-25T04:41:50.293 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.030584", "end": "2021-06-25 04:41:49.846074", "rc": 0, "start": "2021-06-25 04:41:49.815490", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:41:50.318 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:50 +0000 (0:00:00.046) 0:01:45.505 *********** 2021-06-25T04:41:52.259 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:41:52.283 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:52 +0000 (0:00:01.965) 0:01:47.470 *********** 2021-06-25T04:41:52.450 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:41:52.487 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:52 +0000 (0:00:00.203) 0:01:47.674 *********** 2021-06-25T04:41:52.498 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:41:52.498 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:41:52.525 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:52 +0000 (0:00:00.037) 0:01:47.712 *********** 2021-06-25T04:41:52.549 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:41:52 +0000 (0:00:00.023) 0:01:47.735 *********** 2021-06-25T04:42:03.347 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-06-25T04:42:03.348 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 147 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138110 files and directories currently installed.)\r 2021-06-25T04:42:03.350 INFO:teuthology.task.ansible.out:\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 147 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-06-25T04:42:03.352 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138110 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-06-25T04:42:03.374 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:03 +0000 (0:00:10.825) 0:01:58.560 *********** 2021-06-25T04:42:03.761 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 147 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138110 files and directories currently installed.)\r 2021-06-25T04:42:03.763 INFO:teuthology.task.ansible.out:\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 147 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-06-25T04:42:03.764 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138110 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-06-25T04:42:03.786 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:03 +0000 (0:00:00.411) 0:01:58.972 *********** 2021-06-25T04:42:03.836 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 147 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138110 files and directories currently installed.)\r 2021-06-25T04:42:03.838 INFO:teuthology.task.ansible.out:\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 147 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-06-25T04:42:03.841 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138110 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-06-25T04:42:03.862 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:03 +0000 (0:00:00.076) 0:01:59.048 *********** 2021-06-25T04:42:04.454 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 147 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138110 files and directories currently installed.)\r 2021-06-25T04:42:04.456 INFO:teuthology.task.ansible.out:\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 147 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-06-25T04:42:04.457 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138110 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-06-25T04:42:04.479 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:04 +0000 (0:00:00.616) 0:01:59.665 *********** 2021-06-25T04:42:28.302 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-06-25T04:42:28.305 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 140 not upgraded.\nNeed to get 3854 kB of archives.\nAfter this operation, 11.3 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.5 [834 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.5 [1290 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.5 [213 kB]\n 2021-06-25T04:42:28.306 INFO:teuthology.task.ansible.out:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.3 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.3 [1179 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.3 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.3 [84.0 kB]\nFetched 3854 kB in 1s (4139 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.5_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.5) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.5) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_2.0.5_amd64.deb ...\r\nUnpacking apt (2.0.5 2021-06-25T04:42:28.308 INFO:teuthology.task.ansible.out:) over (2.0.4) ...\r\nSetting up apt (2.0.5) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.5_amd64.deb ...\r\nUnpacking apt-utils (2.0.5) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.3_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.5) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.3) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer re 2021-06-25T04:42:28.310 INFO:teuthology.task.ansible.out:quired:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 140 not upgraded.", "Need to get 3854 kB of archives.", "After this operation, 11.3 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.5 [834 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.5 [1290 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.5 [213 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.3 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.3 [1179 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.3 [159 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.3 [84.0 kB] 2021-06-25T04:42:28.312 INFO:teuthology.task.ansible.out:", "Fetched 3854 kB in 1s (4139 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.5_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.5) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.5) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.5_amd64.deb ...", "Unpacking apt (2.0.5) over (2.0.4) ...", "Setting up apt (2.0.5) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading dat 2021-06-25T04:42:28.316 INFO:teuthology.task.ansible.out:abase ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.5_amd64.deb ...", "Unpacking apt-utils (2.0.5) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.3_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.5) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.3) ...", "Setting up apache2-data (2.4.41-4ubuntu3.3) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.3) ...", "Setting up apache2 (2.4.41-4ubuntu3.3) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-06-25T04:42:28.327 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:28 +0000 (0:00:23.848) 0:02:23.514 *********** 2021-06-25T04:42:28.409 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-06-25T04:42:28.411 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:28.434 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:28 +0000 (0:00:00.106) 0:02:23.620 *********** 2021-06-25T04:42:28.737 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-06-25T04:42:28.738 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 140 not upgraded.\nNeed to get 3854 kB of archives.\nAfter this operation, 11.3 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.5 [834 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.5 [1290 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.5 [213 kB]\n 2021-06-25T04:42:28.740 INFO:teuthology.task.ansible.out:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.3 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.3 [1179 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.3 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.3 [84.0 kB]\nFetched 3854 kB in 1s (4179 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.5_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.5) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.5) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_2.0.5_amd64.deb ...\r\nUnpacking apt (2.0.5 2021-06-25T04:42:28.742 INFO:teuthology.task.ansible.out:) over (2.0.4) ...\r\nSetting up apt (2.0.5) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.5_amd64.deb ...\r\nUnpacking apt-utils (2.0.5) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.3_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.5) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.3) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer re 2021-06-25T04:42:28.744 INFO:teuthology.task.ansible.out:quired:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 140 not upgraded.", "Need to get 3854 kB of archives.", "After this operation, 11.3 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.5 [834 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.5 [1290 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.5 [213 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.3 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.3 [1179 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.3 [159 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.3 [84.0 kB] 2021-06-25T04:42:28.746 INFO:teuthology.task.ansible.out:", "Fetched 3854 kB in 1s (4179 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.5_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.5) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.5) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.5_amd64.deb ...", "Unpacking apt (2.0.5) over (2.0.4) ...", "Setting up apt (2.0.5) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading dat 2021-06-25T04:42:28.748 INFO:teuthology.task.ansible.out:abase ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.5_amd64.deb ...", "Unpacking apt-utils (2.0.5) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.3_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.5) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.3) ...", "Setting up apache2-data (2.4.41-4ubuntu3.3) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.3) ...", "Setting up apache2 (2.4.41-4ubuntu3.3) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-06-25T04:42:28.765 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:28 +0000 (0:00:00.331) 0:02:23.951 *********** 2021-06-25T04:42:28.798 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 140 not upgraded.\nNeed to get 3854 kB of archives.\nAfter this operation, 11.3 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.5 [834 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.5 [1290 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.5 [213 kB]\n 2021-06-25T04:42:28.801 INFO:teuthology.task.ansible.out:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.3 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.3 [1179 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.3 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.3 [84.0 kB]\nFetched 3854 kB in 1s (4136 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.5_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.5) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.5) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_2.0.5_amd64.deb ...\r\nUnpacking apt (2.0.5 2021-06-25T04:42:28.803 INFO:teuthology.task.ansible.out:) over (2.0.4) ...\r\nSetting up apt (2.0.5) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.5_amd64.deb ...\r\nUnpacking apt-utils (2.0.5) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.3_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.5) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.3) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer re 2021-06-25T04:42:28.805 INFO:teuthology.task.ansible.out:quired:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 140 not upgraded.", "Need to get 3854 kB of archives.", "After this operation, 11.3 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.5 [834 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.5 [1290 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.5 [213 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.3 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.3 [1179 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.3 [159 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.3 [84.0 kB] 2021-06-25T04:42:28.806 INFO:teuthology.task.ansible.out:", "Fetched 3854 kB in 1s (4136 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading d 2021-06-25T04:42:28.807 INFO:teuthology.task.ansible.out:atabase ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.5_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.5) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.5) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.5_amd64.deb ...", "Unpacking apt (2.0.5) over (2.0.4) ...", "Setting up apt (2.0.5) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading dat 2021-06-25T04:42:28.808 INFO:teuthology.task.ansible.out:abase ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.5_amd64.deb ...", "Unpacking apt-utils (2.0.5) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.3_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.5) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.3) ...", "Setting up apache2-data (2.4.41-4ubuntu3.3) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.3) ...", "Setting up apache2 (2.4.41-4ubuntu3.3) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-06-25T04:42:28.844 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:28 +0000 (0:00:00.078) 0:02:24.030 *********** 2021-06-25T04:42:28.863 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-06-25T04:42:28.865 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:28.889 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:28 +0000 (0:00:00.045) 0:02:24.076 *********** 2021-06-25T04:42:28.929 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:28.961 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:28 +0000 (0:00:00.072) 0:02:24.148 *********** 2021-06-25T04:42:30.523 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-06-25T04:42:30.525 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 140 not upgraded.\nNeed to get 3854 kB of archives.\nAfter this operation, 11.3 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.5 [834 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.5 [1290 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.5 [213 kB]\n 2021-06-25T04:42:30.527 INFO:teuthology.task.ansible.out:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.3 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.3 [1179 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.3 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.3 [84.0 kB]\nFetched 3854 kB in 1s (4156 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.5_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.5) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.5) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_2.0.5_amd64.deb ...\r\nUnpacking apt (2.0.5 2021-06-25T04:42:30.529 INFO:teuthology.task.ansible.out:) over (2.0.4) ...\r\nSetting up apt (2.0.5) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.5_amd64.deb ...\r\nUnpacking apt-utils (2.0.5) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.3_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.3_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.5) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.3) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.3) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer re 2021-06-25T04:42:30.530 INFO:teuthology.task.ansible.out:quired:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 140 not upgraded.", "Need to get 3854 kB of archives.", "After this operation, 11.3 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.5 [834 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.5 [1290 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.5 [213 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.3 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.3 [1179 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.3 [159 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.3 [84.0 kB] 2021-06-25T04:42:30.532 INFO:teuthology.task.ansible.out:", "Fetched 3854 kB in 1s (4156 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.5_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.5) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.5) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.5_amd64.deb ...", "Unpacking apt (2.0.5) over (2.0.4) ...", "Setting up apt (2.0.5) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading dat 2021-06-25T04:42:30.534 INFO:teuthology.task.ansible.out:abase ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.5_amd64.deb ...", "Unpacking apt-utils (2.0.5) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.3_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.3_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.3) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.5) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.3) ...", "Setting up apache2-data (2.4.41-4ubuntu3.3) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.3) ...", "Setting up apache2 (2.4.41-4ubuntu3.3) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-06-25T04:42:30.549 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:30 +0000 (0:00:01.587) 0:02:25.735 *********** 2021-06-25T04:42:30.620 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-06-25T04:42:30.621 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:30.646 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:30 +0000 (0:00:00.096) 0:02:25.832 *********** 2021-06-25T04:42:42.460 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-06-25T04:42:42.462 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 137 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.12-0ubuntu0.20.04.1 [3216 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.12-0ubuntu0.20.04.1 [1619 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.16 [53.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.16 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.16 [562 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.16 [39.9 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-06-25T04:42:42.464 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.16 [6722 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.16 [973 kB]\nFetched 18.8 MB in 1s (14.6 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.12-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.12-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.12-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.12-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.16) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.16_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-06-25T04:42:42.466 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.16) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.16) ...\r\nSetting up librados2 (15.2.12-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.12-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.16) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 137 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-06-25T04:42:42.469 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.12-0ubuntu0.20.04.1 [3216 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.12-0ubuntu0.20.04.1 [1619 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.16 [53.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.16 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.16 [562 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.16 [39.9 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.16 [6722 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.16 [973 kB]", "Fetched 18.8 MB in 1s (14.6 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.12-0ubuntu0.20.04.1_amd64.deb . 2021-06-25T04:42:42.470 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.12-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.12-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.12-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.16) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.16_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.16) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.16) ...", "Setting up librados2 (15.2.12-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.12-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.16) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.16) ...", "Setting 2021-06-25T04:42:42.471 INFO:teuthology.task.ansible.out: up qemu-system-x86 (1:4.2-3ubuntu6.16) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.16) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing 2021-06-25T04:42:42.473 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-06-25T04:42:42.496 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:42 +0000 (0:00:11.850) 0:02:37.683 *********** 2021-06-25T04:42:42.644 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 137 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.12-0ubuntu0.20.04.1 [3216 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.12-0ubuntu0.20.04.1 [1619 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.16 [53.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.16 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.16 [562 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.16 [39.9 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-06-25T04:42:42.646 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.16 [6722 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.16 [973 kB]\nFetched 18.8 MB in 1s (14.5 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.12-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.12-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.12-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.12-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.16) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.16_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-06-25T04:42:42.648 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.16) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.16) ...\r\nSetting up librados2 (15.2.12-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.12-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.16) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 137 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-06-25T04:42:42.649 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.12-0ubuntu0.20.04.1 [3216 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.12-0ubuntu0.20.04.1 [1619 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.16 [53.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.16 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.16 [562 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.16 [39.9 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.16 [6722 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.16 [973 kB]", "Fetched 18.8 MB in 1s (14.5 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.12-0ubuntu0.20.04.1_amd64.deb . 2021-06-25T04:42:42.651 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.12-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.12-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.12-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.16) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.16_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.16) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.16) ...", "Setting up librados2 (15.2.12-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.12-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.16) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.16) ...", "Setting up 2021-06-25T04:42:42.651 INFO:teuthology.task.ansible.out:qemu-system-x86 (1:4.2-3ubuntu6.16) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.16) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing 2021-06-25T04:42:42.653 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-06-25T04:42:42.678 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:42 +0000 (0:00:00.181) 0:02:37.864 *********** 2021-06-25T04:42:42.741 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 137 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.12-0ubuntu0.20.04.1 [3216 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.12-0ubuntu0.20.04.1 [1619 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.16 [53.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.16 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.16 [562 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.16 [39.9 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-06-25T04:42:42.743 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.16 [6722 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.16 [973 kB]\nFetched 18.8 MB in 1s (14.6 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.12-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.12-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.12-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.12-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.16) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.16_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-06-25T04:42:42.744 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.16) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.16) ...\r\nSetting up librados2 (15.2.12-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.12-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.16) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 137 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-06-25T04:42:42.746 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.12-0ubuntu0.20.04.1 [3216 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.12-0ubuntu0.20.04.1 [1619 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.16 [53.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.16 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.16 [562 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.16 [39.9 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.16 [6722 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.16 [973 kB]", "Fetched 18.8 MB in 1s (14.6 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.12-0ubuntu0.20.04.1_amd64.deb . 2021-06-25T04:42:42.748 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.12-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.12-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.12-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.16) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.16_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.16) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.16) ...", "Setting up librados2 (15.2.12-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.12-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.16) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.16) ...", "Setting 2021-06-25T04:42:42.748 INFO:teuthology.task.ansible.out:up qemu-system-x86 (1:4.2-3ubuntu6.16) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.16) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing 2021-06-25T04:42:42.750 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-06-25T04:42:42.775 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:42 +0000 (0:00:00.096) 0:02:37.961 *********** 2021-06-25T04:42:43.198 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-06-25T04:42:43.200 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:42:43.229 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:43 +0000 (0:00:00.454) 0:02:38.416 *********** 2021-06-25T04:42:43.395 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:42:43.419 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:43 +0000 (0:00:00.190) 0:02:38.606 *********** 2021-06-25T04:42:43.479 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:42:43.505 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:43 +0000 (0:00:00.085) 0:02:38.691 *********** 2021-06-25T04:42:43.935 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-06-25T04:42:43.937 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:42:43.960 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:43 +0000 (0:00:00.455) 0:02:39.146 *********** 2021-06-25T04:42:44.137 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:42:44.139 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-06-25T04:42:44.139 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-06-25T04:42:44.175 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.215) 0:02:39.362 *********** 2021-06-25T04:42:44.206 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.030) 0:02:39.392 *********** 2021-06-25T04:42:44.224 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-06-25T04:42:44.227 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:42:44.251 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.045) 0:02:39.437 *********** 2021-06-25T04:42:44.258 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-06-25T04:42:44.260 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:44.289 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.038) 0:02:39.476 *********** 2021-06-25T04:42:44.417 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-06-25T04:42:44.450 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.160) 0:02:39.636 *********** 2021-06-25T04:42:44.462 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-06-25T04:42:44.490 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.040) 0:02:39.677 *********** 2021-06-25T04:42:44.519 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-06-25T04:42:44.521 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-06-25T04:42:44.547 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.056) 0:02:39.734 *********** 2021-06-25T04:42:44.555 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-06-25T04:42:44.557 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:44.587 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.039) 0:02:39.773 *********** 2021-06-25T04:42:44.594 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:44.634 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.047) 0:02:39.820 *********** 2021-06-25T04:42:44.779 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-06-25T04:42:44.781 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-06-25T04:42:44.803 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.169) 0:02:39.990 *********** 2021-06-25T04:42:44.820 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-06-25T04:42:44.845 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.042) 0:02:40.032 *********** 2021-06-25T04:42:44.896 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-06-25T04:42:44.897 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 137 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.12-0ubuntu0.20.04.1 [3216 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.12-0ubuntu0.20.04.1 [1619 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.16 [53.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.16 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.16 [562 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.16 [39.9 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-06-25T04:42:44.899 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.16 [6722 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.16 [973 kB]\nFetched 18.8 MB in 1s (14.7 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.12-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.12-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.12-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.12-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.16) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.16_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-06-25T04:42:44.901 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.16) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.16_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.16) ...\r\nSetting up librados2 (15.2.12-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.12-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.16) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.16) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 137 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-06-25T04:42:44.902 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.12-0ubuntu0.20.04.1 [3216 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.12-0ubuntu0.20.04.1 [1619 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.16 [53.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.16 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.16 [562 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.16 [39.9 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.16 [6722 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.16 [973 kB]", "Fetched 18.8 MB in 1s (14.7 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.12-0ubuntu0.20.04.1_amd64.deb . 2021-06-25T04:42:44.904 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.12-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.12-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.12-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.16) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.16_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.16) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.16_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.16) ...", "Setting up librados2 (15.2.12-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.16) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.12-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.16) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.16) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.16) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.16) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.16) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) .. 2021-06-25T04:42:44.904 INFO:teuthology.task.ansible.out:.", "Processing 2021-06-25T04:42:44.906 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-06-25T04:42:44.938 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.091) 0:02:40.124 *********** 2021-06-25T04:42:44.958 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-06-25T04:42:44.960 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-06-25T04:42:44.984 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:44 +0000 (0:00:00.046) 0:02:40.170 *********** 2021-06-25T04:42:45.203 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-06-25T04:42:45.204 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-06-25T04:42:45.205 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-06-25T04:42:45.205 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-06-25T04:42:45.229 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:45 +0000 (0:00:00.244) 0:02:40.415 *********** 2021-06-25T04:42:45.260 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:45 +0000 (0:00:00.031) 0:02:40.446 *********** 2021-06-25T04:42:45.270 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-06-25T04:42:45.301 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:45 +0000 (0:00:00.040) 0:02:40.487 *********** 2021-06-25T04:42:45.437 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-06-25T04:42:45.439 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:42:45.463 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:45 +0000 (0:00:00.162) 0:02:40.650 *********** 2021-06-25T04:42:45.504 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-06-25T04:42:45.506 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-06-25T04:42:45.533 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:45 +0000 (0:00:00.069) 0:02:40.720 *********** 2021-06-25T04:42:45.541 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-06-25T04:42:45.571 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:45 +0000 (0:00:00.038) 0:02:40.758 *********** 2021-06-25T04:42:45.667 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-06-25T04:42:45.670 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:42:45.693 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:45 +0000 (0:00:00.121) 0:02:40.880 *********** 2021-06-25T04:42:45.745 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-06-25T04:42:45.748 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:42:45.772 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:45 +0000 (0:00:00.079) 0:02:40.959 *********** 2021-06-25T04:42:45.780 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:42:45.807 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:45 +0000 (0:00:00.034) 0:02:40.994 *********** 2021-06-25T04:42:45.816 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-06-25T04:42:45.819 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ActiveEnterTimestampMonotonic": "177518100", "ActiveExitTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ActiveExitTimestampMonotonic": "177440922", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service network.target basic.target remote-fs.target -.mount nss-lookup.target sysinit.target system.slice systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:42:21 UTC", "AssertTimestampMonotonic": "177489507", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ConditionTimestampMonotonic": "177489507", "ConfigurationDirec 2021-06-25T04:42:45.821 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6530", "ExecMainStartTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ExecMainStartTimestampMonotonic": "177518070", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-06-25T04:42:45.822 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-06-25 04:42:21 UTC", "InactiveEnterTimestampMonotonic": "177487956", "InactiveExitTimestamp": "Fri 2021-06-25 04:42:21 UTC", "InactiveExitTimestampMonotonic": "177491928", "InvocationID": "23847344edcb4bddb9ecef09987bd18e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6530", "MemoryAccounting": "yes", "MemoryCurrent": "6762496", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-06-25T04:42:45.824 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:42:21 UTC", "StateChangeTimestampMonotonic": "177518100", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-06-25T04:42:45.826 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:42:45.845 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:45 +0000 (0:00:00.037) 0:02:41.032 *********** 2021-06-25T04:42:45.927 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-06-25T04:42:45.929 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:45.964 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:45 +0000 (0:00:00.118) 0:02:41.151 *********** 2021-06-25T04:42:46.039 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-06-25T04:42:46.041 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.065 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.100) 0:02:41.251 *********** 2021-06-25T04:42:46.084 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-06-25T04:42:46.087 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ActiveEnterTimestampMonotonic": "161066881", "ActiveExitTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ActiveExitTimestampMonotonic": "160980324", "ActiveState": "active", "After": "sysinit.target remote-fs.target system.slice nss-lookup.target basic.target systemd-tmpfiles-setup.service network.target systemd-journald.socket -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:42:21 UTC", "AssertTimestampMonotonic": "161032251", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ConditionTimestampMonotonic": "161032249", "ConfigurationDirec 2021-06-25T04:42:46.089 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6513", "ExecMainStartTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ExecMainStartTimestampMonotonic": "161066853", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-06-25T04:42:46.090 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-06-25 04:42:21 UTC", "InactiveEnterTimestampMonotonic": "161030724", "InactiveExitTimestamp": "Fri 2021-06-25 04:42:21 UTC", "InactiveExitTimestampMonotonic": "161034918", "InvocationID": "aa38cf04cda6414a9657f1c417e41cdd", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6513", "MemoryAccounting": "yes", "MemoryCurrent": "6746112", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-06-25T04:42:46.092 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:42:21 UTC", "StateChangeTimestampMonotonic": "161066881", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-06-25T04:42:46.093 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:42:46.125 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.060) 0:02:41.312 *********** 2021-06-25T04:42:46.147 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ActiveEnterTimestampMonotonic": "172700274", "ActiveExitTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ActiveExitTimestampMonotonic": "172617897", "ActiveState": "active", "After": "nss-lookup.target -.mount sysinit.target systemd-tmpfiles-setup.service network.target systemd-journald.socket remote-fs.target basic.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:42:21 UTC", "AssertTimestampMonotonic": "172666558", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ConditionTimestampMonotonic": "172666557", "ConfigurationDirec 2021-06-25T04:42:46.149 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6518", "ExecMainStartTimestamp": "Fri 2021-06-25 04:42:21 UTC", "ExecMainStartTimestampMonotonic": "172700257", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-06-25T04:42:46.150 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-06-25 04:42:21 UTC", "InactiveEnterTimestampMonotonic": "172665235", "InactiveExitTimestamp": "Fri 2021-06-25 04:42:21 UTC", "InactiveExitTimestampMonotonic": "172669667", "InvocationID": "e6bf81e3a8c74b1380aea97c46c59d34", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6518", "MemoryAccounting": "yes", "MemoryCurrent": "6729728", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-06-25T04:42:46.152 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:42:21 UTC", "StateChangeTimestampMonotonic": "172700274", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-06-25T04:42:46.153 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.178 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.052) 0:02:41.364 *********** 2021-06-25T04:42:46.202 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.024) 0:02:41.389 *********** 2021-06-25T04:42:46.209 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-06-25T04:42:46.211 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.236 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.033) 0:02:41.423 *********** 2021-06-25T04:42:46.253 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-06-25T04:42:46.255 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.279 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.042) 0:02:41.465 *********** 2021-06-25T04:42:46.285 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-06-25T04:42:46.287 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.317 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.037) 0:02:41.503 *********** 2021-06-25T04:42:46.324 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-06-25T04:42:46.326 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.352 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.035) 0:02:41.539 *********** 2021-06-25T04:42:46.361 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.388 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.035) 0:02:41.574 *********** 2021-06-25T04:42:46.405 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-06-25T04:42:46.407 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.434 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.046) 0:02:41.621 *********** 2021-06-25T04:42:46.441 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-06-25T04:42:46.443 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages with --no-install-recommends] **************** ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:42:46.469 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.034) 0:02:41.656 *********** 2021-06-25T04:42:46.492 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.022) 0:02:41.679 *********** 2021-06-25T04:42:46.499 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-06-25T04:42:46.501 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.530 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.037) 0:02:41.716 *********** 2021-06-25T04:42:46.539 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.574 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.044) 0:02:41.761 *********** 2021-06-25T04:42:46.595 INFO:teuthology.task.ansible.out: 2021-06-25T04:42:46.597 INFO:teuthology.task.ansible.out:TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.623 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.048) 0:02:41.809 *********** 2021-06-25T04:42:46.631 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-06-25T04:42:46.633 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.659 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.036) 0:02:41.846 *********** 2021-06-25T04:42:46.667 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-06-25T04:42:46.669 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.695 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.035) 0:02:41.881 *********** 2021-06-25T04:42:46.703 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-06-25T04:42:46.704 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-06-25T04:42:46.733 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.038) 0:02:41.920 *********** 2021-06-25T04:42:46.757 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.023) 0:02:41.944 *********** 2021-06-25T04:42:46.764 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-06-25T04:42:46.766 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.799 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.042) 0:02:41.986 *********** 2021-06-25T04:42:46.807 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-06-25T04:42:46.809 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.841 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.041) 0:02:42.028 *********** 2021-06-25T04:42:46.848 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-06-25T04:42:46.850 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.876 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.034) 0:02:42.062 *********** 2021-06-25T04:42:46.898 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.022) 0:02:42.085 *********** 2021-06-25T04:42:46.905 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:42:46.907 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.938 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.039) 0:02:42.125 *********** 2021-06-25T04:42:46.946 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-06-25T04:42:46.948 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:46.973 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:46 +0000 (0:00:00.034) 0:02:42.159 *********** 2021-06-25T04:42:46.991 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-06-25T04:42:46.993 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.021 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.048) 0:02:42.208 *********** 2021-06-25T04:42:47.029 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-06-25T04:42:47.031 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.057 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.035) 0:02:42.243 *********** 2021-06-25T04:42:47.065 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-06-25T04:42:47.067 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.093 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.036) 0:02:42.280 *********** 2021-06-25T04:42:47.100 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-06-25T04:42:47.102 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.127 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.033) 0:02:42.314 *********** 2021-06-25T04:42:47.150 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.023) 0:02:42.337 *********** 2021-06-25T04:42:47.158 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-06-25T04:42:47.159 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.185 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.034) 0:02:42.371 *********** 2021-06-25T04:42:47.193 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-06-25T04:42:47.195 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.220 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.035) 0:02:42.407 *********** 2021-06-25T04:42:47.227 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:42:47.229 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.254 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.033) 0:02:42.441 *********** 2021-06-25T04:42:47.272 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-06-25T04:42:47.274 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.299 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.045) 0:02:42.486 *********** 2021-06-25T04:42:47.317 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:42:47.318 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.343 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.043) 0:02:42.529 *********** 2021-06-25T04:42:47.350 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-06-25T04:42:47.352 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.377 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.034) 0:02:42.564 *********** 2021-06-25T04:42:47.384 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-06-25T04:42:47.386 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.411 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.033) 0:02:42.598 *********** 2021-06-25T04:42:47.429 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-06-25T04:42:47.431 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.460 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.048) 0:02:42.646 *********** 2021-06-25T04:42:47.467 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-06-25T04:42:47.469 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.495 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.034) 0:02:42.681 *********** 2021-06-25T04:42:47.502 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-06-25T04:42:47.504 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.530 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.035) 0:02:42.717 *********** 2021-06-25T04:42:47.538 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-06-25T04:42:47.539 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Install packages] ********************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.565 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.035) 0:02:42.752 *********** 2021-06-25T04:42:47.587 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.021) 0:02:42.774 *********** 2021-06-25T04:42:47.596 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-06-25T04:42:47.598 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.622 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.035) 0:02:42.809 *********** 2021-06-25T04:42:47.629 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-06-25T04:42:47.631 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.657 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.034) 0:02:42.844 *********** 2021-06-25T04:42:47.664 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-06-25T04:42:47.665 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.690 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.033) 0:02:42.877 *********** 2021-06-25T04:42:47.708 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-06-25T04:42:47.710 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.734 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.043) 0:02:42.921 *********** 2021-06-25T04:42:47.741 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-06-25T04:42:47.742 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.777 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.042) 0:02:42.963 *********** 2021-06-25T04:42:47.784 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-06-25T04:42:47.786 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.810 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.033) 0:02:42.997 *********** 2021-06-25T04:42:47.818 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-06-25T04:42:47.820 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-06-25T04:42:47.844 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.033) 0:02:43.030 *********** 2021-06-25T04:42:47.851 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-06-25T04:42:47.853 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.883 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.039) 0:02:43.070 *********** 2021-06-25T04:42:47.891 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-06-25T04:42:47.893 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.918 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.034) 0:02:43.105 *********** 2021-06-25T04:42:47.926 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-06-25T04:42:47.929 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.954 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.035) 0:02:43.140 *********** 2021-06-25T04:42:47.961 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-06-25T04:42:47.963 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:47.987 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:47 +0000 (0:00:00.033) 0:02:43.174 *********** 2021-06-25T04:42:48.005 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-06-25T04:42:48.006 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.030 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.043) 0:02:43.217 *********** 2021-06-25T04:42:48.038 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-06-25T04:42:48.042 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.065 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.034) 0:02:43.252 *********** 2021-06-25T04:42:48.073 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-06-25T04:42:48.075 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.108 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.042) 0:02:43.294 *********** 2021-06-25T04:42:48.137 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.029) 0:02:43.323 *********** 2021-06-25T04:42:48.144 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.148 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.171 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.034) 0:02:43.358 *********** 2021-06-25T04:42:48.193 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.021) 0:02:43.380 *********** 2021-06-25T04:42:48.211 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.238 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.044) 0:02:43.424 *********** 2021-06-25T04:42:48.244 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-06-25T04:42:48.246 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.271 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.033) 0:02:43.458 *********** 2021-06-25T04:42:48.279 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.316 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.044) 0:02:43.502 *********** 2021-06-25T04:42:48.324 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.361 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.045) 0:02:43.548 *********** 2021-06-25T04:42:48.372 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-06-25T04:42:48.374 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.404 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.043) 0:02:43.591 *********** 2021-06-25T04:42:48.412 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-06-25T04:42:48.414 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.443 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.038) 0:02:43.629 *********** 2021-06-25T04:42:48.451 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-06-25T04:42:48.453 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:42:23 UTC", "ActiveEnterTimestampMonotonic": "185381168", "ActiveExitTimestamp": "Fri 2021-06-25 04:42:23 UTC", "ActiveExitTimestampMonotonic": "185292204", "ActiveState": "active", "After": "nss-lookup.target systemd-tmpfiles-setup.service network.target remote-fs.target system.slice sysinit.target -.mount systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:42:23 UTC", "AssertTimestampMonotonic": "185344322", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:42:23 UTC", "ConditionTimestampMonotonic": "185344321", "ConfigurationDirec 2021-06-25T04:42:48.456 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6475", "ExecMainStartTimestamp": "Fri 2021-06-25 04:42:23 UTC", "ExecMainStartTimestampMonotonic": "185381144", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-06-25T04:42:48.457 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-06-25 04:42:23 UTC", "InactiveEnterTimestampMonotonic": "185342831", "InactiveExitTimestamp": "Fri 2021-06-25 04:42:23 UTC", "InactiveExitTimestampMonotonic": "185347610", "InvocationID": "b2e44ca045284fc7b528ade9cd4e4862", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127802", "LimitNPROCSoft": "127802", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127802", "LimitSIGPENDINGSoft": "127802", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6475", "MemoryAccounting": "yes", "MemoryCurrent": "6762496", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-06-25T04:42:48.459 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:42:23 UTC", "StateChangeTimestampMonotonic": "185381168", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-06-25T04:42:48.461 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38340", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.484 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.041) 0:02:43.671 *********** 2021-06-25T04:42:48.510 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.024) 0:02:43.696 *********** 2021-06-25T04:42:48.518 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-06-25T04:42:48.520 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.549 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.039) 0:02:43.736 *********** 2021-06-25T04:42:48.558 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.593 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.043) 0:02:43.780 *********** 2021-06-25T04:42:48.600 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-06-25T04:42:48.602 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.631 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.036) 0:02:43.817 *********** 2021-06-25T04:42:48.654 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.023) 0:02:43.841 *********** 2021-06-25T04:42:48.662 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-06-25T04:42:48.666 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.701 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.046) 0:02:43.887 *********** 2021-06-25T04:42:48.712 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-06-25T04:42:48.714 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.749 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.047) 0:02:43.935 *********** 2021-06-25T04:42:48.777 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.028) 0:02:43.963 *********** 2021-06-25T04:42:48.786 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.787 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.812 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.035) 0:02:43.999 *********** 2021-06-25T04:42:48.839 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.026) 0:02:44.026 *********** 2021-06-25T04:42:48.846 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-06-25T04:42:48.848 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.877 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.037) 0:02:44.063 *********** 2021-06-25T04:42:48.886 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-06-25T04:42:48.888 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.916 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.039) 0:02:44.103 *********** 2021-06-25T04:42:48.942 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.022) 0:02:44.125 *********** 2021-06-25T04:42:48.946 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-06-25T04:42:48.948 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:48.976 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:48 +0000 (0:00:00.037) 0:02:44.163 *********** 2021-06-25T04:42:48.983 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-06-25T04:42:48.985 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.013 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.036) 0:02:44.200 *********** 2021-06-25T04:42:49.020 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-06-25T04:42:49.022 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.052 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.039) 0:02:44.239 *********** 2021-06-25T04:42:49.077 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.023) 0:02:44.263 *********** 2021-06-25T04:42:49.086 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-06-25T04:42:49.087 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.123 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.046) 0:02:44.310 *********** 2021-06-25T04:42:49.158 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.034) 0:02:44.344 *********** 2021-06-25T04:42:49.176 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-06-25T04:42:49.178 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.202 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.044) 0:02:44.389 *********** 2021-06-25T04:42:49.211 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-06-25T04:42:49.213 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.241 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.038) 0:02:44.428 *********** 2021-06-25T04:42:49.250 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-06-25T04:42:49.252 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-06-25T04:42:49.278 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.036) 0:02:44.465 *********** 2021-06-25T04:42:49.300 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.022) 0:02:44.487 *********** 2021-06-25T04:42:49.309 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-06-25T04:42:49.311 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.335 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.034) 0:02:44.522 *********** 2021-06-25T04:42:49.342 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-06-25T04:42:49.344 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.369 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.033) 0:02:44.555 *********** 2021-06-25T04:42:49.376 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-06-25T04:42:49.378 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.404 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.035) 0:02:44.591 *********** 2021-06-25T04:42:49.411 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.439 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.034) 0:02:44.625 *********** 2021-06-25T04:42:49.456 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-06-25T04:42:49.458 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.483 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.044) 0:02:44.670 *********** 2021-06-25T04:42:49.491 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-06-25T04:42:49.493 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.519 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.036) 0:02:44.706 *********** 2021-06-25T04:42:49.527 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.553 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.033) 0:02:44.740 *********** 2021-06-25T04:42:49.560 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.591 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.037) 0:02:44.778 *********** 2021-06-25T04:42:49.662 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-06-25T04:42:49.664 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-06-25T04:42:49.687 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.096) 0:02:44.874 *********** 2021-06-25T04:42:49.710 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.023) 0:02:44.897 *********** 2021-06-25T04:42:49.728 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-06-25T04:42:49.730 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-06-25T04:42:49.756 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.045) 0:02:44.942 *********** 2021-06-25T04:42:49.762 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-06-25T04:42:49.764 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.793 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.037) 0:02:44.980 *********** 2021-06-25T04:42:49.819 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.025) 0:02:45.006 *********** 2021-06-25T04:42:49.826 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-06-25T04:42:49.828 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.855 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.035) 0:02:45.042 *********** 2021-06-25T04:42:49.873 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-06-25T04:42:49.874 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.899 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.044) 0:02:45.086 *********** 2021-06-25T04:42:49.970 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-06-25T04:42:49.972 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:49.994 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:49 +0000 (0:00:00.094) 0:02:45.181 *********** 2021-06-25T04:42:50.063 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:50.088 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.093) 0:02:45.275 *********** 2021-06-25T04:42:50.127 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-06-25T04:42:50.129 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-06-25T04:42:50.152 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.064) 0:02:45.339 *********** 2021-06-25T04:42:50.172 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-06-25T04:42:50.174 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:50.199 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.046) 0:02:45.386 *********** 2021-06-25T04:42:50.206 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-06-25T04:42:50.208 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-06-25T04:42:50.242 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.043) 0:02:45.429 *********** 2021-06-25T04:42:50.250 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-06-25T04:42:50.252 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-06-25T04:42:50.280 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.037) 0:02:45.467 *********** 2021-06-25T04:42:50.303 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.023) 0:02:45.490 *********** 2021-06-25T04:42:50.312 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-06-25T04:42:50.314 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:50.341 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.037) 0:02:45.527 *********** 2021-06-25T04:42:50.364 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.022) 0:02:45.550 *********** 2021-06-25T04:42:50.414 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:50.441 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.077) 0:02:45.627 *********** 2021-06-25T04:42:50.511 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-06-25T04:42:50.513 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:50.547 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.105) 0:02:45.733 *********** 2021-06-25T04:42:50.622 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:50.647 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.100) 0:02:45.834 *********** 2021-06-25T04:42:50.655 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-06-25T04:42:50.657 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-06-25T04:42:50.687 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.039) 0:02:45.873 *********** 2021-06-25T04:42:50.695 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-06-25T04:42:50.697 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-06-25T04:42:50.723 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.036) 0:02:45.910 *********** 2021-06-25T04:42:50.730 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-06-25T04:42:50.732 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:50.757 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.032) 0:02:45.943 *********** 2021-06-25T04:42:50.774 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-06-25T04:42:50.776 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-06-25T04:42:50.800 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.043) 0:02:45.986 *********** 2021-06-25T04:42:50.827 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-06-25T04:42:50.829 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:50.862 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.062) 0:02:46.049 *********** 2021-06-25T04:42:50.934 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-06-25T04:42:50.936 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:50.964 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:50 +0000 (0:00:00.102) 0:02:46.151 *********** 2021-06-25T04:42:51.034 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-06-25T04:42:51.036 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:51.059 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.094) 0:02:46.245 *********** 2021-06-25T04:42:51.065 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-06-25T04:42:51.067 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-06-25T04:42:51.095 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.036) 0:02:46.282 *********** 2021-06-25T04:42:51.113 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-06-25T04:42:51.115 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-06-25T04:42:51.140 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.045) 0:02:46.327 *********** 2021-06-25T04:42:51.148 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-06-25T04:42:51.150 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:51.176 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.035) 0:02:46.362 *********** 2021-06-25T04:42:51.198 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-06-25T04:42:51.223 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.047) 0:02:46.410 *********** 2021-06-25T04:42:51.254 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-06-25T04:42:51.256 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:51.283 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.059) 0:02:46.470 *********** 2021-06-25T04:42:51.291 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:42:51.323 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.039) 0:02:46.510 *********** 2021-06-25T04:42:51.353 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-06-25T04:42:51.356 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:51.391 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.065) 0:02:46.575 *********** 2021-06-25T04:42:51.398 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:51.427 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.038) 0:02:46.613 *********** 2021-06-25T04:42:51.500 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-06-25T04:42:51.501 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:51.524 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.096) 0:02:46.710 *********** 2021-06-25T04:42:51.532 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-06-25T04:42:51.533 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-06-25T04:42:51.565 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.040) 0:02:46.751 *********** 2021-06-25T04:42:51.583 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-06-25T04:42:51.584 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-06-25T04:42:51.611 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.046) 0:02:46.798 *********** 2021-06-25T04:42:51.620 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-06-25T04:42:51.622 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-06-25T04:42:51.648 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.036) 0:02:46.834 *********** 2021-06-25T04:42:51.671 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.023) 0:02:46.858 *********** 2021-06-25T04:42:51.744 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:51.774 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.102) 0:02:46.961 *********** 2021-06-25T04:42:51.782 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-06-25T04:42:51.784 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:42:51.814 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.039) 0:02:47.000 *********** 2021-06-25T04:42:51.842 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-06-25T04:42:51.844 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:51.868 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.054) 0:02:47.055 *********** 2021-06-25T04:42:51.876 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-06-25T04:42:51.878 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:42:51.903 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.034) 0:02:47.090 *********** 2021-06-25T04:42:51.911 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-06-25T04:42:51.912 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:51.938 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.034) 0:02:47.125 *********** 2021-06-25T04:42:51.966 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:42:51.968 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-06-25T04:42:51.993 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:51 +0000 (0:00:00.054) 0:02:47.179 *********** 2021-06-25T04:42:51.999 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-06-25T04:42:52.001 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-06-25T04:42:52.026 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.033) 0:02:47.213 *********** 2021-06-25T04:42:52.047 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.020) 0:02:47.234 *********** 2021-06-25T04:42:52.054 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-06-25T04:42:52.056 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.089 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.042) 0:02:47.276 *********** 2021-06-25T04:42:52.097 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-06-25T04:42:52.098 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.100 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.102 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi087.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.129 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.039) 0:02:47.315 *********** 2021-06-25T04:42:52.137 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-06-25T04:42:52.138 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.139 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.140 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-06-25T04:42:52.140 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.141 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.141 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.168 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.039) 0:02:47.355 *********** 2021-06-25T04:42:52.176 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.178 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi087.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.211 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.042) 0:02:47.397 *********** 2021-06-25T04:42:52.233 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.022) 0:02:47.420 *********** 2021-06-25T04:42:52.252 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.279 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.045) 0:02:47.466 *********** 2021-06-25T04:42:52.316 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-06-25T04:42:52.319 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.342 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.063) 0:02:47.529 *********** 2021-06-25T04:42:52.349 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.376 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.033) 0:02:47.563 *********** 2021-06-25T04:42:52.417 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.444 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.067) 0:02:47.630 *********** 2021-06-25T04:42:52.451 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.452 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-06-25T04:42:52.453 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.006184", "end": "2021-06-25 04:42:52.424483", "rc": 0, "start": "2021-06-25 04:42:52.418299", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology-lock"]} 2021-06-25T04:42:52.482 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.038) 0:02:47.669 *********** 2021-06-25T04:42:52.507 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.024) 0:02:47.694 *********** 2021-06-25T04:42:52.526 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:42:52.528 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-06-25T04:42:52.554 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.046) 0:02:47.741 *********** 2021-06-25T04:42:52.560 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-06-25T04:42:52.562 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.591 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.037) 0:02:47.778 *********** 2021-06-25T04:42:52.617 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.025) 0:02:47.803 *********** 2021-06-25T04:42:52.625 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-06-25T04:42:52.655 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.038) 0:02:47.841 *********** 2021-06-25T04:42:52.669 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-06-25T04:42:52.670 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.671 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.671 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.672 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.683 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-06-25T04:42:52.694 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.696 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi161.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.721 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.066) 0:02:47.908 *********** 2021-06-25T04:42:52.729 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.730 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.731 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.732 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.732 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.763 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.041) 0:02:47.950 *********** 2021-06-25T04:42:52.770 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.782 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.784 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.784 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.811 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.047) 0:02:47.997 *********** 2021-06-25T04:42:52.819 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-06-25T04:42:52.820 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-06-25T04:42:52.820 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.822 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.823 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.823 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.835 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.847 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:52.878 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:52 +0000 (0:00:00.067) 0:02:48.065 *********** 2021-06-25T04:42:53.001 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-06-25T04:42:53.003 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003082", "end": "2021-06-25 04:42:52.977413", "rc": 0, "start": "2021-06-25 04:42:52.974331", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology-lock"]} 2021-06-25T04:42:53.027 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.149) 0:02:48.214 *********** 2021-06-25T04:42:53.054 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.025) 0:02:48.239 *********** 2021-06-25T04:42:53.125 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003712", "end": "2021-06-25 04:42:53.103570", "rc": 0, "start": "2021-06-25 04:42:53.099858", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology-lock"]} 2021-06-25T04:42:53.126 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-06-25T04:42:53.127 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:53.154 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.101) 0:02:48.341 *********** 2021-06-25T04:42:53.182 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.027) 0:02:48.369 *********** 2021-06-25T04:42:53.233 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:53.263 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.081) 0:02:48.450 *********** 2021-06-25T04:42:53.271 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-06-25T04:42:53.273 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:53.305 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.041) 0:02:48.492 *********** 2021-06-25T04:42:53.345 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:53.371 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.065) 0:02:48.557 *********** 2021-06-25T04:42:53.389 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:53.416 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.044) 0:02:48.602 *********** 2021-06-25T04:42:53.424 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-06-25T04:42:53.425 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-06-25T04:42:53.454 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.038) 0:02:48.641 *********** 2021-06-25T04:42:53.462 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-06-25T04:42:53.464 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:53.490 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.034) 0:02:48.675 *********** 2021-06-25T04:42:53.517 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-06-25T04:42:53.519 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:42:53.543 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.054) 0:02:48.730 *********** 2021-06-25T04:42:53.616 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-06-25T04:42:53.617 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:53.639 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.096) 0:02:48.826 *********** 2021-06-25T04:42:53.647 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-06-25T04:42:53.648 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:42:53.674 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.034) 0:02:48.861 *********** 2021-06-25T04:42:53.723 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-06-25T04:42:53.725 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'block_used': 13858636, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236472, 'size_available': 926664589312, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150116, 'block_size': 4096, 'inode_available': 60904860}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236472, "block_size": 4096, "block_total": 240095108, "block_used": 13858636, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904860, "inode_total": 61054976, "inode_used": 150116, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664589312, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-06-25T04:42:53.750 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.075) 0:02:48.937 *********** 2021-06-25T04:42:53.757 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-06-25T04:42:53.758 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:53.783 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.033) 0:02:48.970 *********** 2021-06-25T04:42:53.866 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-06-25T04:42:53.868 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:53.890 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.106) 0:02:49.077 *********** 2021-06-25T04:42:53.951 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-06-25T04:42:53.952 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009377", "end": "2021-06-25 04:42:54.379815", "rc": 0, "start": "2021-06-25 04:42:54.370438", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:42:53.975 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:53 +0000 (0:00:00.085) 0:02:49.162 *********** 2021-06-25T04:42:53.985 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.020 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.045) 0:02:49.207 *********** 2021-06-25T04:42:54.060 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-06-25T04:42:54.062 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'block_used': 13858636, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236472, 'size_available': 926664589312, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150116, 'block_size': 4096, 'inode_available': 60904860}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236472, "block_size": 4096, "block_total": 240095108, "block_used": 13858636, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904860, "inode_total": 61054976, "inode_used": 150116, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664589312, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.087 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.065) 0:02:49.273 *********** 2021-06-25T04:42:54.104 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-06-25T04:42:54.106 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.130 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.043) 0:02:49.316 *********** 2021-06-25T04:42:54.137 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-06-25T04:42:54.140 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:42:54.169 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.038) 0:02:49.355 *********** 2021-06-25T04:42:54.182 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-06-25T04:42:54.210 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.041) 0:02:49.397 *********** 2021-06-25T04:42:54.218 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-06-25T04:42:54.219 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.246 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.036) 0:02:49.433 *********** 2021-06-25T04:42:54.279 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.031) 0:02:49.464 *********** 2021-06-25T04:42:54.291 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.326 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.047) 0:02:49.512 *********** 2021-06-25T04:42:54.334 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-06-25T04:42:54.335 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.337 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-06-25T04:42:54.368 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.042) 0:02:49.555 *********** 2021-06-25T04:42:54.377 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-06-25T04:42:54.379 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.406 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.037) 0:02:49.592 *********** 2021-06-25T04:42:54.426 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-06-25T04:42:54.430 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'block_used': 13858626, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236482, 'size_available': 926664630272, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150116, 'block_size': 4096, 'inode_available': 60904860}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236482, "block_size": 4096, "block_total": 240095108, "block_used": 13858626, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904860, "inode_total": 61054976, "inode_used": 150116, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664630272, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-06-25T04:42:54.462 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.055) 0:02:49.647 *********** 2021-06-25T04:42:54.470 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-06-25T04:42:54.472 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.484 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.495 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.497 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi102.front.sepia.ceph.com] => (item={'block_used': 13858635, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236473, 'size_available': 926664593408, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150116, 'block_size': 4096, 'inode_available': 60904860}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236473, "block_size": 4096, "block_total": 240095108, "block_used": 13858635, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904860, "inode_total": 61054976, "inode_used": 150116, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664593408, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-06-25T04:42:54.528 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.067) 0:02:49.715 *********** 2021-06-25T04:42:54.537 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-06-25T04:42:54.539 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi057.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi057.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.540 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.540 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.541 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.541 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.553 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.554 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.589 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.060) 0:02:49.776 *********** 2021-06-25T04:42:54.660 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009202", "end": "2021-06-25 04:42:54.219827", "rc": 0, "start": "2021-06-25 04:42:54.210625", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:42:54.685 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.096) 0:02:49.872 *********** 2021-06-25T04:42:54.737 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009152", "end": "2021-06-25 04:42:54.972812", "rc": 0, "start": "2021-06-25 04:42:54.963660", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:42:54.769 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.083) 0:02:49.956 *********** 2021-06-25T04:42:54.776 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-06-25T04:42:54.778 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'block_used': 13858626, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236482, 'size_available': 926664630272, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150116, 'block_size': 4096, 'inode_available': 60904860}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236482, "block_size": 4096, "block_total": 240095108, "block_used": 13858626, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904860, "inode_total": 61054976, "inode_used": 150116, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664630272, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.805 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.035) 0:02:49.991 *********** 2021-06-25T04:42:54.845 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'block_used': 13858635, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236473, 'size_available': 926664593408, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150116, 'block_size': 4096, 'inode_available': 60904860}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236473, "block_size": 4096, "block_total": 240095108, "block_used": 13858635, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904860, "inode_total": 61054976, "inode_used": 150116, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664593408, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:54.874 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.069) 0:02:50.060 *********** 2021-06-25T04:42:54.882 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-06-25T04:42:54.883 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-06-25T04:42:54.884 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003359", "end": "2021-06-25 04:42:54.853909", "rc": 0, "start": "2021-06-25 04:42:54.850550", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology-lock"]} 2021-06-25T04:42:54.918 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.044) 0:02:50.105 *********** 2021-06-25T04:42:54.958 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.035) 0:02:50.141 *********** 2021-06-25T04:42:54.964 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-06-25T04:42:54.998 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:54 +0000 (0:00:00.044) 0:02:50.185 *********** 2021-06-25T04:42:55.105 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:55.202 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:55.237 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:55 +0000 (0:00:00.238) 0:02:50.424 *********** 2021-06-25T04:42:55.245 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-06-25T04:42:55.247 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:55.321 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-06-25T04:42:55.323 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:55.356 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:55 +0000 (0:00:00.119) 0:02:50.543 *********** 2021-06-25T04:42:55.432 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-06-25T04:42:55.434 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:55.455 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:55 +0000 (0:00:00.098) 0:02:50.642 *********** 2021-06-25T04:42:56.017 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-06-25T04:42:56.019 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5Sl1pixhv0ZRAKzW1G3ZGDks0dt0pdOgT8'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.131142", "end": "2021-06-25 04:42:55.991498", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5Sl1pixhv0ZRAKzW1G3ZGDks0dt0pdOgT8"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:54.860356", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:42:56.031 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:56.169 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:42:56.192 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:56 +0000 (0:00:00.736) 0:02:51.378 *********** 2021-06-25T04:42:56.264 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:56.298 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:56 +0000 (0:00:00.106) 0:02:51.485 *********** 2021-06-25T04:42:56.382 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi057.front.sepia.ceph.com] => (item={'block_used': 13858648, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236460, 'size_available': 926664540160, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150119, 'block_size': 4096, 'inode_available': 60904857}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236460, "block_size": 4096, "block_total": 240095108, "block_used": 13858648, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904857, "inode_total": 61054976, "inode_used": 150119, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664540160, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-06-25T04:42:56.410 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:56 +0000 (0:00:00.111) 0:02:51.596 *********** 2021-06-25T04:42:56.597 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009323", "end": "2021-06-25 04:42:56.578015", "rc": 0, "start": "2021-06-25 04:42:56.568692", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:42:56.620 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:56 +0000 (0:00:00.209) 0:02:51.806 *********** 2021-06-25T04:42:56.798 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-06-25T04:42:56.800 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3w2uqTb8mCkMIgwS12mi4Dn1TdxonIPFY'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.554971", "end": "2021-06-25 04:42:57.019417", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3w2uqTb8mCkMIgwS12mi4Dn1TdxonIPFY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:55.464446", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-d 2021-06-25T04:42:56.801 INFO:teuthology.task.ansible.out:eadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:56.811 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:56.844 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-06-25T04:42:56.846 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'block_used': 13858648, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236460, 'size_available': 926664540160, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150119, 'block_size': 4096, 'inode_available': 60904857}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236460, "block_size": 4096, "block_total": 240095108, "block_used": 13858648, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904857, "inode_total": 61054976, "inode_used": 150119, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664540160, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:56.869 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:56 +0000 (0:00:00.249) 0:02:52.056 *********** 2021-06-25T04:42:56.988 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-06-25T04:42:56.990 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnd84sJcBSbG7cvKLaa1sDM9dEqqUgApqM'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.629408", "end": "2021-06-25 04:42:56.532450", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnd84sJcBSbG7cvKLaa1sDM9dEqqUgApqM"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:54.903042", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:42:57.014 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:57.074 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-06-25T04:42:57.098 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:42:57 +0000 (0:00:00.228) 0:02:52.285 *********** 2021-06-25T04:42:57.285 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-06-25T04:42:57.286 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SkfGVpMyGYVg33vMwcsZajn9EmqKQlnzs'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.122208", "end": "2021-06-25 04:42:57.258086", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SkfGVpMyGYVg33vMwcsZajn9EmqKQlnzs"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:56.135878", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:42:57.298 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP', 'wwn-0x5000c500918e7eca'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1', 'wwn-0x5000c500918e7eca-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918e7eca', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LGPP', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP", "wwn-0x5000c500918e7eca"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1", "wwn-0x5000c500918e7eca-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGPP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e7eca"}}, 2021-06-25T04:42:57.299 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-06-25T04:42:57.320 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:58.060 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3QmcF4yTeSIuWeR8dZf92kCR0QeBGb6Vc'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.123079", "end": "2021-06-25 04:42:58.291271", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3QmcF4yTeSIuWeR8dZf92kCR0QeBGb6Vc"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:57.168192", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:42:58.084 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPPM', 'wwn-0x5000c50091e0bcf8'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPPM-part1', 'wwn-0x5000c50091e0bcf8-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0bcf8', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QPPM', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPPM", "wwn-0x5000c50091e0bcf8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPPM-part1", "wwn-0x5000c50091e0bcf8-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QPPM", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0bcf8"}}, 2021-06-25T04:42:58.086 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-06-25T04:42:58.275 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKn5CJeXPfJv7u5sytpMRACK07GTu5N5BJG'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.122107", "end": "2021-06-25 04:42:57.822297", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKn5CJeXPfJv7u5sytpMRACK07GTu5N5BJG"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:56.700190", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:42:58.279 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E', 'wwn-0x5000c50092938c4f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1', 'wwn-0x5000c50092938c4f-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092938c4f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XV0E', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E", "wwn-0x5000c50092938c4f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1", "wwn-0x5000c50092938c4f-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XV0E", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092938c4f"}}, 2021-06-25T04:42:58.281 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-06-25T04:42:58.581 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-EbuFH5-NUbX-mPpZ-j0Sn-4ABY-NMoH-XTtGJ8', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN', 'nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.157552", "end": "2021-06-25 04:42:58.553365", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-EbuFH5-NUbX-mPpZ-j0Sn-4ABY-NMoH-XTtGJ8", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN", "nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:57.395813", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-06-25T04:42:58.583 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:42:58.592 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:58.594 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:59.036 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhjxd6c2GiKRMmLo2caUUSRidKFVoC6Pqd'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.578821", "end": "2021-06-25 04:42:59.001320", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhjxd6c2GiKRMmLo2caUUSRidKFVoC6Pqd"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:57.422499", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:42:59.051 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:59.359 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-17Io0j-vh2R-e0tG-sOp5-W2tb-ct2A-6R6IYa', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400VK400BGN', 'nvme-nvme.8086-50484654363230343030564b34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:00.900521", "end": "2021-06-25 04:42:59.328231", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-17Io0j-vh2R-e0tG-sOp5-W2tb-ct2A-6R6IYa", "nvme-INTEL_SSDPEDMD400G4_PHFT620400VK400BGN", "nvme-nvme.8086-50484654363230343030564b34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:58.427710", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-06-25T04:42:59.361 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:42:59.370 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:59.382 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:59.582 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-WhZSa2-RvDE-6nge-z0kX-JJKH-oJiK-OWIFOH', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN', 'nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.169419", "end": "2021-06-25 04:42:59.129897", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-WhZSa2-RvDE-6nge-z0kX-JJKH-oJiK-OWIFOH", "nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN", "nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:57.960478", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-06-25T04:42:59.584 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:42:59.594 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:59.606 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:59.863 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SmDqIy8VNO4WXupmF7ZykAQ3esHpXNUP7'], 'uuids': ['4cd4ad10-b135-4b06-bd53-8b3993c0bec9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.135479", "end": "2021-06-25 04:42:59.832786", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SmDqIy8VNO4WXupmF7ZykAQ3esHpXNUP7"], "labels": [], "masters": [], "uuids": ["4cd4ad10-b135-4b06-bd53-8b3993c0bec9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:58.697307", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:42:59.875 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:42:59.877 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:00.256 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhUHuUPnZ0TEkN1Ity2pPSFV1PIZopoEKu'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.077071", "end": "2021-06-25 04:43:00.226634", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhUHuUPnZ0TEkN1Ity2pPSFV1PIZopoEKu"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:59.149563", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:00.272 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQFM', 'wwn-0x5000c500871a80ed'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQFM-part1', 'wwn-0x5000c500871a80ed-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a80ed', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQFM', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQFM", "wwn-0x5000c500871a80ed"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQFM-part1", "wwn-0x5000c500871a80ed-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQFM", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a80ed"}}, 2021-06-25T04:43:00.273 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-06-25T04:43:00.683 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3ljLCaMWgxHJYKlrKqyqDvOtd9tD3fRh9'], 'uuids': ['6b671c5d-5400-46d2-a714-e7de11f655b1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.164510", "end": "2021-06-25 04:43:00.646936", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3ljLCaMWgxHJYKlrKqyqDvOtd9tD3fRh9"], "labels": [], "masters": [], "uuids": ["6b671c5d-5400-46d2-a714-e7de11f655b1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:59.482426", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:00.684 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:00.696 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:00.864 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnOMfBCZxRLydjWLLNX1deYQjduQ2I9pER'], 'uuids': ['c4bda0a1-cb83-4abe-83dc-673b8db514fe']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.132492", "end": "2021-06-25 04:43:00.406325", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnOMfBCZxRLydjWLLNX1deYQjduQ2I9pER"], "labels": [], "masters": [], "uuids": ["c4bda0a1-cb83-4abe-83dc-673b8db514fe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:59.273833", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:00.865 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:00.876 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:01.139 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SaeLWNuAYbPg46CJt836GuDAC4cJmZkvY'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.126629", "end": "2021-06-25 04:43:01.108783", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SaeLWNuAYbPg46CJt836GuDAC4cJmZkvY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:42:59.982154", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:01.141 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:01.507 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '7814037168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-13WxBg-1SN8-HXSn-gszS-eUac-DMJM-4hI0bZ', 'nvme-INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN', 'nvme-eui.0100000001000000e4d25c000034df14'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDKE040T7', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '3.64 TB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.109565", "end": "2021-06-25 04:43:01.474707", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]", "links": {"ids": ["lvm-pv-uuid-13WxBg-1SN8-HXSn-gszS-eUac-DMJM-4hI0bZ", "nvme-INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:00.365142", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", 2021-06-25T04:43:01.509 INFO:teuthology.task.ansible.out:"stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:01.520 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:01.980 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3MF9GqOVM5Bl44uCZY08IYhSM9TaiVD0K'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.160673", "end": "2021-06-25 04:43:01.954997", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3MF9GqOVM5Bl44uCZY08IYhSM9TaiVD0K"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:00.794324", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:01.992 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:02.173 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnDVO9fgEVlL40cthdqtkvWQNcRu61lKhD'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.166736", "end": "2021-06-25 04:43:01.722547", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnDVO9fgEVlL40cthdqtkvWQNcRu61lKhD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:00.555811", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:02.184 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:02.395 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SUNA1w1zjxoD8YbAbLL3J8X0OEq7izY1v'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.126834", "end": "2021-06-25 04:43:02.366223", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SUNA1w1zjxoD8YbAbLL3J8X0OEq7izY1v"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:01.239389", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:02.441 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:02 +0000 (0:00:05.341) 0:02:57.627 *********** 2021-06-25T04:43:02.683 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:02.850 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-06-25T04:43:02.852 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhoCZJ8C0aIZ4aYc0h1icPrOFRI3WCcEV9'], 'uuids': ['a9df6d04-ce3b-4704-9e14-81c368c345a9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.204932", "end": "2021-06-25 04:43:02.822943", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhoCZJ8C0aIZ4aYc0h1icPrOFRI3WCcEV9"], "labels": [], "masters": [], "uuids": ["a9df6d04-ce3b-4704-9e14-81c368c345a9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:01.618011", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:02.863 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:02.874 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:02.975 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5Sl1pixhv0ZRAKzW1G3ZGDks0dt0pdOgT8'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.163335", "end": "2021-06-25 04:43:02.948628", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5Sl1pixhv0ZRAKzW1G3ZGDks0dt0pdOgT8"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:02.785293", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158296 s, 729 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158296 s, 729 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:02.984 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:02.996 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:03.270 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-06-25T04:43:03.272 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3UzubWZO96j1jcFdr9CUlAfL3KVCi74IB'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.151255", "end": "2021-06-25 04:43:03.248446", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3UzubWZO96j1jcFdr9CUlAfL3KVCi74IB"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:02.097191", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:03.294 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SkfGVpMyGYVg33vMwcsZajn9EmqKQlnzs'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.165075", "end": "2021-06-25 04:43:03.265005", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SkfGVpMyGYVg33vMwcsZajn9EmqKQlnzs"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:03.099930", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16024 s, 720 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16024 s, 720 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:03.296 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP', 'wwn-0x5000c500918e7eca'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1', 'wwn-0x5000c500918e7eca-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918e7eca', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LGPP', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP", "wwn-0x5000c500918e7eca"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1", "wwn-0x5000c500918e7eca-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGPP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e7eca"}}, 2021-06-25T04:43:03.298 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-06-25T04:43:03.440 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-06-25T04:43:03.442 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnhQSZjY29eBYfof9Jz1qAC8LX3PPVT1iq'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.129813", "end": "2021-06-25 04:43:02.991260", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnhQSZjY29eBYfof9Jz1qAC8LX3PPVT1iq"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:01.861447", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:03.606 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:03 +0000 (0:00:01.166) 0:02:58.793 *********** 2021-06-25T04:43:03.629 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:03 +0000 (0:00:00.022) 0:02:58.816 *********** 2021-06-25T04:43:03.642 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-EbuFH5-NUbX-mPpZ-j0Sn-4ABY-NMoH-XTtGJ8', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN', 'nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.056917", "end": "2021-06-25 04:43:03.457507", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-EbuFH5-NUbX-mPpZ-j0Sn-4ABY-NMoH-XTtGJ8", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN", "nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:03.400590", "stderr": "110+0 records in\n110+0 2021-06-25T04:43:03.647 INFO:teuthology.task.ansible.out: records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0521124 s, 2.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0521124 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_ 2021-06-25T04:43:03.649 INFO:teuthology.task.ansible.out:discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:03.721 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:03.733 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:03.798 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SmDqIy8VNO4WXupmF7ZykAQ3esHpXNUP7'], 'uuids': ['4cd4ad10-b135-4b06-bd53-8b3993c0bec9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.161844", "end": "2021-06-25 04:43:03.760124", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SmDqIy8VNO4WXupmF7ZykAQ3esHpXNUP7"], "labels": [], "masters": [], "uuids": ["4cd4ad10-b135-4b06-bd53-8b3993c0bec9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:03.598280", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157049 s, 734 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157049 s, 734 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:03.799 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:03.801 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.027 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnd84sJcBSbG7cvKLaa1sDM9dEqqUgApqM'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.164022", "end": "2021-06-25 04:43:03.569795", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnd84sJcBSbG7cvKLaa1sDM9dEqqUgApqM"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:03.405773", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159112 s, 725 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159112 s, 725 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:04.028 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3w2uqTb8mCkMIgwS12mi4Dn1TdxonIPFY'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.171319", "end": "2021-06-25 04:43:03.999675", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3w2uqTb8mCkMIgwS12mi4Dn1TdxonIPFY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:03.828356", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16647 s, 693 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16647 s, 693 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:04.030 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.032 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.034 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.037 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.110 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-06-25T04:43:04.112 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhb8UcpSeeRQh5J0Q4CQGcMuVLRPxLovKo'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.103562", "end": "2021-06-25 04:43:04.070555", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhb8UcpSeeRQh5J0Q4CQGcMuVLRPxLovKo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:02.966993", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi08 2021-06-25T04:43:04.113 INFO:teuthology.task.ansible.out:7.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SaeLWNuAYbPg46CJt836GuDAC4cJmZkvY'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.169540", "end": "2021-06-25 04:43:04.080094", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SaeLWNuAYbPg46CJt836GuDAC4cJmZkvY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:03.910554", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.164688 s, 700 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.164688 s, 700 MB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0 2021-06-25T04:43:04.115 INFO:teuthology.task.ansible.out:.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.338 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKn5CJeXPfJv7u5sytpMRACK07GTu5N5BJG'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.166120", "end": "2021-06-25 04:43:03.880470", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKn5CJeXPfJv7u5sytpMRACK07GTu5N5BJG"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:03.714350", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.161138 s, 716 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.161138 s, 716 MB/s"], "stdout": "", "stdout_lines": []} changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3QmcF4yTeSIuWeR8dZf92kCR0QeBGb6Vc'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partition 2021-06-25T04:43:04.340 INFO:teuthology.task.ansible.out:s': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.166881", "end": "2021-06-25 04:43:04.305365", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3QmcF4yTeSIuWeR8dZf92kCR0QeBGb6Vc"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:04.138484", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16188 s, 713 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16188 s, 713 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E', 'wwn-0x5000c50092938c4f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1', 'wwn-0x5000c50092938c4f-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092938c4f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XV0E', 'siz 2021-06-25T04:43:04.342 INFO:teuthology.task.ansible.out:e': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E", "wwn-0x5000c50092938c4f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1", "wwn-0x5000c50092938c4f-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XV0E", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092938c4f"}}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPPM', 'wwn-0x5000c50091e0bcf8'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QPPM-part1', 'wwn-0x5000c50091e0bcf8-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0bcf8', 'model 2021-06-25T04:43:04.344 INFO:teuthology.task.ansible.out:': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QPPM', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPPM", "wwn-0x5000c50091e0bcf8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QPPM-part1", "wwn-0x5000c50091e0bcf8-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QPPM", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0bcf8"}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.406 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SUNA1w1zjxoD8YbAbLL3J8X0OEq7izY1v'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.162835", "end": "2021-06-25 04:43:04.380569", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-B5ULkhSQbep9GoG7ZJwHh7gCbPWu4k5SUNA1w1zjxoD8YbAbLL3J8X0OEq7izY1v"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:04.217734", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157858 s, 731 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157858 s, 731 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:04.456 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:04 +0000 (0:00:00.826) 0:02:59.642 *********** 2021-06-25T04:43:04.527 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-WhZSa2-RvDE-6nge-z0kX-JJKH-oJiK-OWIFOH', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN', 'nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.057805", "end": "2021-06-25 04:43:04.077427", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-WhZSa2-RvDE-6nge-z0kX-JJKH-oJiK-OWIFOH", "nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN", "nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:04.019622", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0530335 s, 2.2 GB/s", "std 2021-06-25T04:43:04.529 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0530335 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-17Io0j-vh2R-e0tG-sOp5-W2tb-ct2A-6R6IYa', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400VK400BGN', 'nvme-nvme.8086-50484654363230343030564b34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.055485", "end": "2021-06-25 04:43:04.500458", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-17Io0j-vh2R-e0tG-sOp5-W2tb-ct2A-6R6IYa", "nvme-INTEL_SSDPEDMD400G4_PHFT620400VK400BGN", "nvme-nvme.8086-50484654363230343030564b34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, 2021-06-25T04:43:04.531 INFO:teuthology.task.ansible.out:"start": "2021-06-25 04:43:04.444973", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0507269 s, 2.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0507269 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.542 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.544 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.556 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.781 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-06-25T04:43:04.783 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.137654", "end": "2021-06-25 04:43:04.709371", "rc": 0, "start": "2021-06-25 04:43:04.571717", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:04.805 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:04 +0000 (0:00:00.349) 0:02:59.991 *********** 2021-06-25T04:43:04.860 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-06-25T04:43:04.861 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnOMfBCZxRLydjWLLNX1deYQjduQ2I9pER'], 'uuids': ['c4bda0a1-cb83-4abe-83dc-673b8db514fe']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.163856", "end": "2021-06-25 04:43:04.405447", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnOMfBCZxRLydjWLLNX1deYQjduQ2I9pER"], "labels": [], "masters": [], "uuids": ["c4bda0a1-cb83-4abe-83dc-673b8db514fe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:04.241591", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159219 s, 724 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159219 s, 724 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:04.864 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.865 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3ljLCaMWgxHJYKlrKqyqDvOtd9tD3fRh9'], 'uuids': ['6b671c5d-5400-46d2-a714-e7de11f655b1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.175338", "end": "2021-06-25 04:43:04.837815", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3ljLCaMWgxHJYKlrKqyqDvOtd9tD3fRh9"], "labels": [], "masters": [], "uuids": ["6b671c5d-5400-46d2-a714-e7de11f655b1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:04.662477", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.170616 s, 676 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.170616 s, 676 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:04.866 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.878 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:04.880 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.019 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-06-25T04:43:05.020 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.075956", "end": "2021-06-25 04:43:04.998195", "rc": 0, "start": "2021-06-25 04:43:04.922239", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:05.043 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.238) 0:03:00.230 *********** 2021-06-25T04:43:05.116 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-06-25T04:43:05.181 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.137) 0:03:00.367 *********** 2021-06-25T04:43:05.189 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-06-25T04:43:05.190 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnDVO9fgEVlL40cthdqtkvWQNcRu61lKhD'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.163823", "end": "2021-06-25 04:43:04.712354", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnDVO9fgEVlL40cthdqtkvWQNcRu61lKhD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:04.548531", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159162 s, 725 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159162 s, 725 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:05.192 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.194 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3MF9GqOVM5Bl44uCZY08IYhSM9TaiVD0K'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.162461", "end": "2021-06-25 04:43:05.148067", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3MF9GqOVM5Bl44uCZY08IYhSM9TaiVD0K"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:04.985606", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157729 s, 731 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157729 s, 731 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:05.194 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, " 2021-06-25T04:43:05.196 INFO:teuthology.task.ansible.out:item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.207 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.242 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.060) 0:03:00.428 *********** 2021-06-25T04:43:05.269 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-06-25T04:43:05.272 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.294 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.052) 0:03:00.480 *********** 2021-06-25T04:43:05.322 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.327 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhnZcuwEE5mUrSBT5xSBh6ScN6cdHFjbh3'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.082626", "end": "2021-06-25 04:43:05.295019", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhnZcuwEE5mUrSBT5xSBh6ScN6cdHFjbh3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:04.212393", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-06-25T04:43:05.350 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.056) 0:03:00.536 *********** 2021-06-25T04:43:05.395 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.045) 0:03:00.582 *********** 2021-06-25T04:43:05.402 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-06-25T04:43:05.404 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.429 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.033) 0:03:00.616 *********** 2021-06-25T04:43:05.438 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-06-25T04:43:05.439 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.472 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnhQSZjY29eBYfof9Jz1qAC8LX3PPVT1iq'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.172721", "end": "2021-06-25 04:43:05.024037", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ySKGIWWgsC6slY54HilYfxjWSvUWcEKnhQSZjY29eBYfof9Jz1qAC8LX3PPVT1iq"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:04.851316", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.167692 s, 688 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.167692 s, 688 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:05.495 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3UzubWZO96j1jcFdr9CUlAfL3KVCi74IB'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.162352", "end": "2021-06-25 04:43:05.452313", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-IV5uPLzlyIX1BruAh8Uu98npJ9nl4RH3UzubWZO96j1jcFdr9CUlAfL3KVCi74IB"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:05.289961", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159133 s, 725 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159133 s, 725 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:05.533 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.103) 0:03:00.719 *********** 2021-06-25T04:43:05.556 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.023) 0:03:00.742 *********** 2021-06-25T04:43:05.578 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:43:05.603 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.047) 0:03:00.790 *********** 2021-06-25T04:43:05.642 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-06-25T04:43:05.644 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'block_used': 13858636, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236472, 'size_available': 926664589312, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150116, 'block_size': 4096, 'inode_available': 60904860}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236472, "block_size": 4096, "block_total": 240095108, "block_used": 13858636, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904860, "inode_total": 61054976, "inode_used": 150116, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664589312, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.668 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.063) 0:03:00.854 *********** 2021-06-25T04:43:05.695 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-06-25T04:43:05.697 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.719 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.052) 0:03:00.906 *********** 2021-06-25T04:43:05.748 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:05.750 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.778 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.057) 0:03:00.963 *********** 2021-06-25T04:43:05.787 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-06-25T04:43:05.789 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhjxd6c2GiKRMmLo2caUUSRidKFVoC6Pqd'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.181546", "end": "2021-06-25 04:43:05.722627", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhjxd6c2GiKRMmLo2caUUSRidKFVoC6Pqd"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:05.541081", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.176462 s, 654 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.176462 s, 654 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:05.791 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.793 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.806 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-06-25T04:43:05.808 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.118486", "end": "2021-06-25 04:43:05.768192", "rc": 0, "start": "2021-06-25 04:43:05.649706", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : set_fact] ***************************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.830 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.053) 0:03:01.017 *********** 2021-06-25T04:43:05.854 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.023) 0:03:01.040 *********** 2021-06-25T04:43:05.860 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-06-25T04:43:05.862 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.138924", "end": "2021-06-25 04:43:05.385961", "rc": 0, "start": "2021-06-25 04:43:05.247037", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.888 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.033) 0:03:01.074 *********** 2021-06-25T04:43:05.915 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.027) 0:03:01.101 *********** 2021-06-25T04:43:05.922 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-06-25T04:43:05.924 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:05.949 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.033) 0:03:01.135 *********** 2021-06-25T04:43:05.977 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.001 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:05 +0000 (0:00:00.052) 0:03:01.188 *********** 2021-06-25T04:43:06.083 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-06-25T04:43:06.085 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhUHuUPnZ0TEkN1Ity2pPSFV1PIZopoEKu'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.177138", "end": "2021-06-25 04:43:06.044018", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhUHuUPnZ0TEkN1Ity2pPSFV1PIZopoEKu"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:05.866880", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.172309 s, 669 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.172309 s, 669 MB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.090774", "end": "2021-06-25 04:43:06.056943", "rc": 0, "start": "2021-06-25 04:43:05.966169", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:06.125 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.123) 0:03:01.312 *********** 2021-06-25T04:43:06.133 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-06-25T04:43:06.135 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQFM', 'wwn-0x5000c500871a80ed'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQFM-part1', 'wwn-0x5000c500871a80ed-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a80ed', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQFM', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQFM", "wwn-0x5000c500871a80ed"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQFM-part1", "wwn-0x5000c500871a80ed-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQFM", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a80ed"}}, 2021-06-25T04:43:06.137 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.146 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-06-25T04:43:06.148 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.082861", "end": "2021-06-25 04:43:05.690697", "rc": 0, "start": "2021-06-25 04:43:05.607836", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Remove physical volumes] ************************************** 2021-06-25T04:43:06.173 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.048) 0:03:01.360 *********** 2021-06-25T04:43:06.199 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.025) 0:03:01.385 *********** 2021-06-25T04:43:06.206 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-06-25T04:43:06.208 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.234 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.035) 0:03:01.421 *********** 2021-06-25T04:43:06.242 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-06-25T04:43:06.270 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.035) 0:03:01.457 *********** 2021-06-25T04:43:06.277 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-06-25T04:43:06.279 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.307 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.037) 0:03:01.494 *********** 2021-06-25T04:43:06.314 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-06-25T04:43:06.316 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '7814037168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-13WxBg-1SN8-HXSn-gszS-eUac-DMJM-4hI0bZ', 'nvme-INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN', 'nvme-eui.0100000001000000e4d25c000034df14'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDKE040T7', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '3.64 TB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.056349", "end": "2021-06-25 04:43:06.242741", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]", "links": {"ids": ["lvm-pv-uuid-13WxBg-1SN8-HXSn-gszS-eUac-DMJM-4hI0bZ", "nvme-INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:06.186392", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.051546 s, 2.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 M 2021-06-25T04:43:06.318 INFO:teuthology.task.ansible.out:B, 110 MiB) copied, 0.051546 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.319 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.dev 2021-06-25T04:43:06.321 INFO:teuthology.task.ansible.out:ice }}] ******* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.344 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.037) 0:03:01.531 *********** 2021-06-25T04:43:06.351 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-06-25T04:43:06.353 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.380 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.035) 0:03:01.566 *********** 2021-06-25T04:43:06.386 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-06-25T04:43:06.388 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.412 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.032) 0:03:01.599 *********** 2021-06-25T04:43:06.419 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-06-25T04:43:06.421 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.445 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.032) 0:03:01.631 *********** 2021-06-25T04:43:06.451 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-06-25T04:43:06.453 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.481 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.035) 0:03:01.667 *********** 2021-06-25T04:43:06.518 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-06-25T04:43:06.520 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.541 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.061) 0:03:01.728 *********** 2021-06-25T04:43:06.579 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-06-25T04:43:06.581 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:43:06.615 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.073) 0:03:01.801 *********** 2021-06-25T04:43:06.624 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-06-25T04:43:06.626 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhoCZJ8C0aIZ4aYc0h1icPrOFRI3WCcEV9'], 'uuids': ['a9df6d04-ce3b-4704-9e14-81c368c345a9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.186329", "end": "2021-06-25 04:43:06.571324", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhoCZJ8C0aIZ4aYc0h1icPrOFRI3WCcEV9"], "labels": [], "masters": [], "uuids": ["a9df6d04-ce3b-4704-9e14-81c368c345a9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:06.384995", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.18234 s, 633 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.18234 s, 633 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:06.627 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'siz 2021-06-25T04:43:06.628 INFO:teuthology.task.ansible.out:e': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.650 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-06-25T04:43:06.651 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'block_used': 13858635, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236473, 'size_available': 926664593408, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150116, 'block_size': 4096, 'inode_available': 60904860}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236473, "block_size": 4096, "block_total": 240095108, "block_used": 13858635, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904860, "inode_total": 61054976, "inode_used": 150116, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664593408, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.675 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.060) 0:03:01.862 *********** 2021-06-25T04:43:06.685 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-06-25T04:43:06.686 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:43:06.717 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.041) 0:03:01.904 *********** 2021-06-25T04:43:06.727 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-06-25T04:43:06.729 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create volume group(s)] *************************************** 2021-06-25T04:43:06.729 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-06-25T04:43:06.757 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.039) 0:03:01.944 *********** 2021-06-25T04:43:06.781 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.024) 0:03:01.968 *********** 2021-06-25T04:43:06.789 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-06-25T04:43:06.791 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'block_used': 13858626, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236482, 'size_available': 926664630272, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150116, 'block_size': 4096, 'inode_available': 60904860}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236482, "block_size": 4096, "block_total": 240095108, "block_used": 13858626, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904860, "inode_total": 61054976, "inode_used": 150116, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664630272, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.821 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.039) 0:03:02.008 *********** 2021-06-25T04:43:06.828 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:06.829 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.856 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.035) 0:03:02.043 *********** 2021-06-25T04:43:06.863 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.889 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.033) 0:03:02.076 *********** 2021-06-25T04:43:06.895 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:06.897 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.927 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.037) 0:03:02.114 *********** 2021-06-25T04:43:06.935 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:06.937 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-06-25T04:43:06.937 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhb8UcpSeeRQh5J0Q4CQGcMuVLRPxLovKo'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.172406", "end": "2021-06-25 04:43:06.889186", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhb8UcpSeeRQh5J0Q4CQGcMuVLRPxLovKo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:06.716780", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.169069 s, 682 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.169069 s, 682 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:06.939 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:06.974 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.046) 0:03:02.160 *********** 2021-06-25T04:43:06.980 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-06-25T04:43:06.982 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:07.006 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:06 +0000 (0:00:00.032) 0:03:02.193 *********** 2021-06-25T04:43:07.013 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:07.015 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:07.038 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.031) 0:03:02.225 *********** 2021-06-25T04:43:07.046 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:07.076 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.037) 0:03:02.262 *********** 2021-06-25T04:43:07.083 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-06-25T04:43:07.085 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:07.108 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.032) 0:03:02.295 *********** 2021-06-25T04:43:07.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:07.142 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.032) 0:03:02.327 *********** 2021-06-25T04:43:07.147 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-06-25T04:43:07.149 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:07.174 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.032) 0:03:02.360 *********** 2021-06-25T04:43:07.201 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-06-25T04:43:07.203 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:07.225 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.052) 0:03:02.412 *********** 2021-06-25T04:43:07.243 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhnZcuwEE5mUrSBT5xSBh6ScN6cdHFjbh3'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.174579", "end": "2021-06-25 04:43:07.205085", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DSMX4y1PovEHDxSoObNhE3yXDtabyguhnZcuwEE5mUrSBT5xSBh6ScN6cdHFjbh3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-06-25 04:43:07.030506", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.169489 s, 681 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.169489 s, 681 MB/s"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:07.279 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.054) 0:03:02.466 *********** 2021-06-25T04:43:07.309 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:07.312 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:07.564 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi057.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.138474", "end": "2021-06-25 04:43:07.530842", "rc": 0, "start": "2021-06-25 04:43:07.392368", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:07.588 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.308) 0:03:02.774 *********** 2021-06-25T04:43:07.690 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-06-25T04:43:07.692 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:07.722 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.134) 0:03:02.909 *********** 2021-06-25T04:43:07.784 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-06-25T04:43:07.786 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-06-25T04:43:07.819 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.096) 0:03:03.005 *********** 2021-06-25T04:43:07.827 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-06-25T04:43:07.829 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.091918", "end": "2021-06-25 04:43:07.795627", "rc": 0, "start": "2021-06-25 04:43:07.703709", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:07.864 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.045) 0:03:03.051 *********** 2021-06-25T04:43:07.895 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-06-25T04:43:07.940 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.075) 0:03:03.126 *********** 2021-06-25T04:43:07.972 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-06-25T04:43:07.974 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:07.999 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:07 +0000 (0:00:00.059) 0:03:03.186 *********** 2021-06-25T04:43:08.026 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:08.050 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.050) 0:03:03.236 *********** 2021-06-25T04:43:08.077 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-06-25T04:43:08.079 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:08.104 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.054) 0:03:03.291 *********** 2021-06-25T04:43:08.112 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:08.114 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:08.135 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:08.160 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.055) 0:03:03.346 *********** 2021-06-25T04:43:08.198 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:08.200 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:08.273 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:08.295 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-06-25T04:43:08.297 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-06-25T04:43:08.319 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.159) 0:03:03.506 *********** 2021-06-25T04:43:08.361 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-06-25T04:43:08.363 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'block_used': 13858648, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226236460, 'size_available': 926664540160, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150119, 'block_size': 4096, 'inode_available': 60904857}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226236460, "block_size": 4096, "block_total": 240095108, "block_used": 13858648, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904857, "inode_total": 61054976, "inode_used": 150119, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926664540160, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:08.386 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.065) 0:03:03.572 *********** 2021-06-25T04:43:08.414 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:08.437 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.051) 0:03:03.624 *********** 2021-06-25T04:43:08.465 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:08.467 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:08.489 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.052) 0:03:03.676 *********** 2021-06-25T04:43:08.497 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:08.499 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:08.520 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:08.521 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:08.543 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.053) 0:03:03.730 *********** 2021-06-25T04:43:08.570 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-06-25T04:43:08.572 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:08.595 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.051) 0:03:03.781 *********** 2021-06-25T04:43:08.623 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-06-25T04:43:08.624 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:08.651 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.055) 0:03:03.837 *********** 2021-06-25T04:43:08.678 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-06-25T04:43:08.680 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:08.702 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.051) 0:03:03.888 *********** 2021-06-25T04:43:08.709 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:08.711 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:08.922 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:08.949 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:08 +0000 (0:00:00.247) 0:03:04.136 *********** 2021-06-25T04:43:08.969 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:09.087 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:09.088 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-06-25T04:43:09.113 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:09 +0000 (0:00:00.163) 0:03:04.300 *********** 2021-06-25T04:43:09.226 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-06-25T04:43:09.228 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-06-25T04:43:09.251 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:09 +0000 (0:00:00.138) 0:03:04.438 *********** 2021-06-25T04:43:09.270 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-06-25T04:43:09.271 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:09.345 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:09.347 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:09.410 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-06-25T04:43:09.412 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:09.476 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:09.478 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:09.532 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:09.649 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:09.661 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:09.692 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:09 +0000 (0:00:00.440) 0:03:04.879 *********** 2021-06-25T04:43:09.701 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:09.703 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:09.728 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:09.759 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:09 +0000 (0:00:00.066) 0:03:04.946 *********** 2021-06-25T04:43:09.770 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:09.771 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:09.802 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:09 +0000 (0:00:00.043) 0:03:04.989 *********** 2021-06-25T04:43:09.809 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-06-25T04:43:09.811 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:09.838 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:09 +0000 (0:00:00.035) 0:03:05.025 *********** 2021-06-25T04:43:09.856 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:09.858 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:09.892 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:09 +0000 (0:00:00.053) 0:03:05.079 *********** 2021-06-25T04:43:09.953 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-06-25T04:43:09.955 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-06-25T04:43:09.982 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:09 +0000 (0:00:00.089) 0:03:05.168 *********** 2021-06-25T04:43:09.991 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-06-25T04:43:09.993 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:10.018 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.035) 0:03:05.204 *********** 2021-06-25T04:43:10.047 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-06-25T04:43:10.049 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-06-25T04:43:10.075 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.057) 0:03:05.262 *********** 2021-06-25T04:43:10.099 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.023) 0:03:05.285 *********** 2021-06-25T04:43:10.106 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:10.108 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:10.131 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:10.258 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:10.270 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:10.389 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:10.402 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:10.500 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:10.502 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:10.512 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:10.524 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:10.526 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:10.553 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.454) 0:03:05.740 *********** 2021-06-25T04:43:10.581 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:10.605 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.051) 0:03:05.792 *********** 2021-06-25T04:43:10.633 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:10.635 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:10.657 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.052) 0:03:05.844 *********** 2021-06-25T04:43:10.664 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:10.694 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.037) 0:03:05.881 *********** 2021-06-25T04:43:10.704 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi087.front.sepia.ceph.com] => {"changed": true} 2021-06-25T04:43:10.733 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.038) 0:03:05.920 *********** 2021-06-25T04:43:10.741 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-06-25T04:43:10.743 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:10.777 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.043) 0:03:05.963 *********** 2021-06-25T04:43:10.795 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-06-25T04:43:10.797 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:10.820 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.043) 0:03:06.007 *********** 2021-06-25T04:43:10.828 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-06-25T04:43:10.830 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:10.853 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.032) 0:03:06.040 *********** 2021-06-25T04:43:10.860 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-06-25T04:43:10.862 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-06-25T04:43:10.886 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:10 +0000 (0:00:00.032) 0:03:06.073 *********** 2021-06-25T04:43:10.935 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:10.937 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:10.989 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-06-25T04:43:10.990 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:11.015 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.129) 0:03:06.202 *********** 2021-06-25T04:43:11.055 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-06-25T04:43:11.080 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.064) 0:03:06.266 *********** 2021-06-25T04:43:11.151 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-06-25T04:43:11.152 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true} 2021-06-25T04:43:11.176 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.096) 0:03:06.363 *********** 2021-06-25T04:43:11.259 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-06-25T04:43:11.261 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-06-25T04:43:11.285 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.108) 0:03:06.472 *********** 2021-06-25T04:43:11.313 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-06-25T04:43:11.317 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:11.341 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.053) 0:03:06.525 *********** 2021-06-25T04:43:11.347 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-06-25T04:43:11.349 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-06-25T04:43:11.377 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.037) 0:03:06.563 *********** 2021-06-25T04:43:11.384 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-06-25T04:43:11.386 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true} TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:11.415 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.038) 0:03:06.601 *********** 2021-06-25T04:43:11.441 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.026) 0:03:06.628 *********** 2021-06-25T04:43:11.448 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-06-25T04:43:11.449 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:11.488 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.046) 0:03:06.674 *********** 2021-06-25T04:43:11.510 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.021) 0:03:06.696 *********** 2021-06-25T04:43:11.528 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:11.529 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-06-25T04:43:11.553 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.043) 0:03:06.740 *********** 2021-06-25T04:43:11.578 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.023) 0:03:06.763 *********** 2021-06-25T04:43:11.586 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:11.613 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.035) 0:03:06.799 *********** 2021-06-25T04:43:11.640 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:11.671 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.059) 0:03:06.858 *********** 2021-06-25T04:43:11.692 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-06-25T04:43:11.694 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-06-25T04:43:11.694 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:11.719 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.047) 0:03:06.906 *********** 2021-06-25T04:43:11.741 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.022) 0:03:06.928 *********** 2021-06-25T04:43:11.747 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-06-25T04:43:11.751 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-06-25T04:43:11.775 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.033) 0:03:06.961 *********** 2021-06-25T04:43:11.796 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.020) 0:03:06.982 *********** 2021-06-25T04:43:11.803 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-06-25T04:43:11.805 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:11.829 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.033) 0:03:07.016 *********** 2021-06-25T04:43:11.847 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:11.859 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:11.883 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.053) 0:03:07.070 *********** 2021-06-25T04:43:11.914 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-06-25T04:43:11.916 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:11.945 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.061) 0:03:07.132 *********** 2021-06-25T04:43:11.958 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-06-25T04:43:11.960 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-06-25T04:43:11.984 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:11 +0000 (0:00:00.039) 0:03:07.171 *********** 2021-06-25T04:43:12.009 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.024) 0:03:07.195 *********** 2021-06-25T04:43:12.021 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-06-25T04:43:12.022 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:12.024 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:12.063 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.054) 0:03:07.249 *********** 2021-06-25T04:43:12.093 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-06-25T04:43:12.106 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:12.138 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.074) 0:03:07.324 *********** 2021-06-25T04:43:12.169 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-06-25T04:43:12.171 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Create filesystems] ******************************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:12.194 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.056) 0:03:07.381 *********** 2021-06-25T04:43:12.218 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.022) 0:03:07.404 *********** 2021-06-25T04:43:12.234 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-06-25T04:43:12.236 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-06-25T04:43:12.267 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.045) 0:03:07.450 *********** 2021-06-25T04:43:12.287 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.023) 0:03:07.473 *********** 2021-06-25T04:43:12.354 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-06-25T04:43:12.376 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.089) 0:03:07.563 *********** 2021-06-25T04:43:12.406 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-06-25T04:43:12.408 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:12.432 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.055) 0:03:07.619 *********** 2021-06-25T04:43:12.460 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-06-25T04:43:12.462 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:12.484 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.052) 0:03:07.671 *********** 2021-06-25T04:43:12.491 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-06-25T04:43:12.493 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-06-25T04:43:12.525 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.040) 0:03:07.711 *********** 2021-06-25T04:43:12.585 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-06-25T04:43:12.586 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-06-25T04:43:12.611 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.086) 0:03:07.798 *********** 2021-06-25T04:43:12.726 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-06-25T04:43:12.729 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-06-25T04:43:12.752 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.140) 0:03:07.939 *********** 2021-06-25T04:43:12.840 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-06-25T04:43:12.842 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-06-25T04:43:12.866 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.114) 0:03:08.053 *********** 2021-06-25T04:43:12.959 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-06-25T04:43:12.961 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi057.front.sepia.ceph.com] => {"changed": true} 2021-06-25T04:43:12.986 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:12 +0000 (0:00:00.119) 0:03:08.172 *********** 2021-06-25T04:43:13.010 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.023) 0:03:08.196 *********** 2021-06-25T04:43:13.221 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-06-25T04:43:13.223 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-06-25T04:43:13.250 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.239) 0:03:08.436 *********** 2021-06-25T04:43:13.272 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.022) 0:03:08.458 *********** 2021-06-25T04:43:13.288 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-06-25T04:43:13.290 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:13.316 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.044) 0:03:08.502 *********** 2021-06-25T04:43:13.346 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-06-25T04:43:13.348 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:13.376 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.056) 0:03:08.559 *********** 2021-06-25T04:43:13.405 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-06-25T04:43:13.406 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:43:13.433 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.061) 0:03:08.620 *********** 2021-06-25T04:43:13.460 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.026) 0:03:08.647 *********** 2021-06-25T04:43:13.470 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-06-25T04:43:13.472 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:13.510 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.049) 0:03:08.696 *********** 2021-06-25T04:43:13.669 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-06-25T04:43:13.670 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:43:13.693 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.183) 0:03:08.880 *********** 2021-06-25T04:43:13.702 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-06-25T04:43:13.704 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-06-25T04:43:13.731 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.037) 0:03:08.918 *********** 2021-06-25T04:43:13.739 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-06-25T04:43:13.741 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.121794", "end": "2021-06-25 04:43:13.700249", "rc": 0, "start": "2021-06-25 04:43:13.578455", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-06-25T04:43:13.767 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.036) 0:03:08.954 *********** 2021-06-25T04:43:13.796 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-06-25T04:43:13.797 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:13.820 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.052) 0:03:09.007 *********** 2021-06-25T04:43:13.849 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-06-25T04:43:13.851 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:13.873 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.052) 0:03:09.060 *********** 2021-06-25T04:43:13.891 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-06-25T04:43:13.893 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:13.918 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.045) 0:03:09.105 *********** 2021-06-25T04:43:13.936 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-06-25T04:43:13.937 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:43:13.961 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.043) 0:03:09.148 *********** 2021-06-25T04:43:13.974 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-06-25T04:43:13.976 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.112520", "end": "2021-06-25 04:43:13.930953", "rc": 0, "start": "2021-06-25 04:43:13.818433", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-06-25T04:43:14.001 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:13 +0000 (0:00:00.039) 0:03:09.188 *********** 2021-06-25T04:43:14.029 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:14.052 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.051) 0:03:09.239 *********** 2021-06-25T04:43:14.081 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-06-25T04:43:14.083 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:14.106 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.053) 0:03:09.292 *********** 2021-06-25T04:43:14.207 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-06-25T04:43:14.210 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.089603", "end": "2021-06-25 04:43:14.176570", "rc": 0, "start": "2021-06-25 04:43:14.086967", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-06-25T04:43:14.232 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.126) 0:03:09.419 *********** 2021-06-25T04:43:14.261 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:14.293 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.060) 0:03:09.480 *********** 2021-06-25T04:43:14.300 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-06-25T04:43:14.301 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-06-25T04:43:14.326 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.033) 0:03:09.513 *********** 2021-06-25T04:43:14.333 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-06-25T04:43:14.335 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:14.360 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.033) 0:03:09.547 *********** 2021-06-25T04:43:14.535 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-06-25T04:43:14.538 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:43:14.561 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.201) 0:03:09.748 *********** 2021-06-25T04:43:14.590 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-06-25T04:43:14.592 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:14.614 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.052) 0:03:09.800 *********** 2021-06-25T04:43:14.673 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-06-25T04:43:14.675 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-06-25T04:43:14.698 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.084) 0:03:09.885 *********** 2021-06-25T04:43:14.768 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-06-25T04:43:14.770 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:43:14.799 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.097) 0:03:09.982 *********** 2021-06-25T04:43:14.828 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-06-25T04:43:14.829 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:14.855 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.059) 0:03:10.042 *********** 2021-06-25T04:43:14.957 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-06-25T04:43:14.959 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-06-25T04:43:14.983 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:14 +0000 (0:00:00.127) 0:03:10.169 *********** 2021-06-25T04:43:15.022 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-06-25T04:43:15.024 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:43:15.058 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.074) 0:03:10.244 *********** 2021-06-25T04:43:15.083 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.024) 0:03:10.269 *********** 2021-06-25T04:43:15.112 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-06-25T04:43:15.114 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:15.136 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.053) 0:03:10.322 *********** 2021-06-25T04:43:15.196 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-06-25T04:43:15.198 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-06-25T04:43:15.234 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.097) 0:03:10.420 *********** 2021-06-25T04:43:15.264 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-06-25T04:43:15.266 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:15.289 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.055) 0:03:10.476 *********** 2021-06-25T04:43:15.298 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-06-25T04:43:15.301 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:39:37 UTC", "ActiveEnterTimestampMonotonic": "13225459", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target systemd-journald.socket systemd-tmpfiles-setup.service sysinit.target -.mount network.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:39:37 UTC", "AssertTimestampMonotonic": "13129064", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:39:37 UTC", "ConditionTimestampMonotonic": "13129063", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-06-25T04:43:15.303 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "826", "ExecMainStartTimestamp": "Fri 2021-06-25 04:39:37 UTC", "ExecMainStartTimestampMonotonic": "13225447", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:39:37 UTC", "InactiveExitTimestampMonotonic": "13129928", "InvocationID": "a59e5010e3e5400889e8b0eaa887dcce", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-06-25T04:43:15.305 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "826", "MemoryAccounting": "yes", "MemoryCurrent": "3817472", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "Requi 2021-06-25T04:43:15.307 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:39:37 UTC", "StateChangeTimestampMonotonic": "13225459", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:43:15.333 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.043) 0:03:10.519 *********** 2021-06-25T04:43:15.360 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:15.362 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-06-25T04:43:15.386 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.052) 0:03:10.572 *********** 2021-06-25T04:43:15.394 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-06-25T04:43:15.396 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:43:15.422 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.036) 0:03:10.609 *********** 2021-06-25T04:43:15.430 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:15.432 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-06-25T04:43:15.459 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.036) 0:03:10.645 *********** 2021-06-25T04:43:15.488 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:15.514 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.055) 0:03:10.700 *********** 2021-06-25T04:43:15.524 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-06-25T04:43:15.525 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-06-25T04:43:15.526 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:39:42 UTC", "ActiveEnterTimestampMonotonic": "13257522", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-journald.socket systemd-tmpfiles-setup.service -.mount system.slice network.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:39:42 UTC", "AssertTimestampMonotonic": "13141214", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:39:42 UTC", "ConditionTimestampMonotonic": "13141213", "ConfigurationDirectoryMode 2021-06-25T04:43:15.528 INFO:teuthology.task.ansible.out:": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "827", "ExecMainStartTimestamp": "Fri 2021-06-25 04:39:42 UTC", "ExecMainStartTimestampMonotonic": "13257510", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:39:42 UTC", "InactiveExitTimestampMonotonic": "13142194", "InvocationID": "15e5e47306c543078257e55ac598934f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": " 2021-06-25T04:43:15.529 INFO:teuthology.task.ansible.out:15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "827", "MemoryAccounting": "yes", "MemoryCurrent": "3600384", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit" 2021-06-25T04:43:15.531 INFO:teuthology.task.ansible.out:: "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:39:42 UTC", "StateChangeTimestampMonotonic": "13257522", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:43:15.559 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.044) 0:03:10.745 *********** 2021-06-25T04:43:15.592 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.033) 0:03:10.779 *********** 2021-06-25T04:43:15.600 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-06-25T04:43:15.631 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.038) 0:03:10.817 *********** 2021-06-25T04:43:15.640 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:15.669 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.038) 0:03:10.856 *********** 2021-06-25T04:43:15.678 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:15.680 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-06-25T04:43:15.719 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.050) 0:03:10.906 *********** 2021-06-25T04:43:15.730 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-06-25T04:43:15.732 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.112231", "end": "2021-06-25 04:43:15.649705", "rc": 0, "start": "2021-06-25 04:43:15.537474", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-06-25T04:43:15.758 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.038) 0:03:10.945 *********** 2021-06-25T04:43:15.766 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:15.792 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.033) 0:03:10.978 *********** 2021-06-25T04:43:15.799 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-06-25T04:43:15.801 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:15.826 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.033) 0:03:11.012 *********** 2021-06-25T04:43:15.853 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-06-25T04:43:15.855 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:15.878 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.052) 0:03:11.065 *********** 2021-06-25T04:43:15.897 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-06-25T04:43:15.898 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:39:53 UTC", "ActiveEnterTimestampMonotonic": "12829488", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice basic.target systemd-tmpfiles-setup.service systemd-journald.socket network.target sysinit.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:39:52 UTC", "AssertTimestampMonotonic": "12580332", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:39:52 UTC", "ConditionTimestampMonotonic": "12580331", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-06-25T04:43:15.900 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "828", "ExecMainStartTimestamp": "Fri 2021-06-25 04:39:53 UTC", "ExecMainStartTimestampMonotonic": "12829473", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:39:52 UTC", "InactiveExitTimestampMonotonic": "12581743", "InvocationID": "2c426f48f1c1492cbe45f7a8d04c1b8b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-06-25T04:43:15.902 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "828", "MemoryAccounting": "yes", "MemoryCurrent": "3653632", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "Requi 2021-06-25T04:43:15.903 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:39:53 UTC", "StateChangeTimestampMonotonic": "12829488", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:43:15.926 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.047) 0:03:11.112 *********** 2021-06-25T04:43:15.953 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:15.955 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-06-25T04:43:15.977 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:15 +0000 (0:00:00.051) 0:03:11.164 *********** 2021-06-25T04:43:16.016 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:16.018 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-06-25T04:43:16.040 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:16 +0000 (0:00:00.062) 0:03:11.227 *********** 2021-06-25T04:43:16.068 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:16.091 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:16 +0000 (0:00:00.051) 0:03:11.278 *********** 2021-06-25T04:43:16.549 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-06-25T04:43:16.551 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:43:16.574 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:16 +0000 (0:00:00.482) 0:03:11.760 *********** 2021-06-25T04:43:16.601 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:16.627 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:16 +0000 (0:00:00.053) 0:03:11.814 *********** 2021-06-25T04:43:16.656 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-06-25T04:43:16.658 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:43:16.689 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:16 +0000 (0:00:00.061) 0:03:11.875 *********** 2021-06-25T04:43:16.720 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:16.741 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:16 +0000 (0:00:00.052) 0:03:11.928 *********** 2021-06-25T04:43:16.875 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-06-25T04:43:16.876 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:43:16.901 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:16 +0000 (0:00:00.159) 0:03:12.088 *********** 2021-06-25T04:43:16.922 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-06-25T04:43:16.945 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:16 +0000 (0:00:00.043) 0:03:12.131 *********** 2021-06-25T04:43:16.953 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-06-25T04:43:16.954 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:16.980 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:16 +0000 (0:00:00.035) 0:03:12.167 *********** 2021-06-25T04:43:16.986 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-06-25T04:43:16.988 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-06-25T04:43:17.017 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.037) 0:03:12.204 *********** 2021-06-25T04:43:17.046 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-06-25T04:43:17.048 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:17.073 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.055) 0:03:12.259 *********** 2021-06-25T04:43:17.167 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-06-25T04:43:17.169 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-06-25T04:43:17.193 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.120) 0:03:12.380 *********** 2021-06-25T04:43:17.201 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-06-25T04:43:17.202 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:43:17.227 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.033) 0:03:12.414 *********** 2021-06-25T04:43:17.255 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-06-25T04:43:17.256 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:17.284 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.056) 0:03:12.471 *********** 2021-06-25T04:43:17.305 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-06-25T04:43:17.308 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:39:34 UTC", "ActiveEnterTimestampMonotonic": "15650763", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-tmpfiles-setup.service sysinit.target basic.target systemd-journald.socket system.slice network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:39:33 UTC", "AssertTimestampMonotonic": "15457054", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:39:33 UTC", "ConditionTimestampMonotonic": "15457052", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-06-25T04:43:17.310 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "826", "ExecMainStartTimestamp": "Fri 2021-06-25 04:39:34 UTC", "ExecMainStartTimestampMonotonic": "15650750", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:39:33 UTC", "InactiveExitTimestampMonotonic": "15458157", "InvocationID": "716b648a6aa54ee29a6a511a77a2e9b8", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-06-25T04:43:17.312 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127802", "LimitNPROCSoft": "127802", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127802", "LimitSIGPENDINGSoft": "127802", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "826", "MemoryAccounting": "yes", "MemoryCurrent": "3493888", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "Requi 2021-06-25T04:43:17.313 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:39:34 UTC", "StateChangeTimestampMonotonic": "15650763", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38340", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:43:17.339 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.054) 0:03:12.526 *********** 2021-06-25T04:43:17.367 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:17.370 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-06-25T04:43:17.393 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.053) 0:03:12.579 *********** 2021-06-25T04:43:17.400 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-06-25T04:43:17.402 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-06-25T04:43:17.435 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.042) 0:03:12.622 *********** 2021-06-25T04:43:17.444 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:17.446 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-06-25T04:43:17.473 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.038) 0:03:12.660 *********** 2021-06-25T04:43:17.481 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-06-25T04:43:17.483 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-06-25T04:43:17.514 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.040) 0:03:12.701 *********** 2021-06-25T04:43:17.526 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-06-25T04:43:17.528 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:17.563 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.048) 0:03:12.750 *********** 2021-06-25T04:43:17.624 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-06-25T04:43:17.626 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-06-25T04:43:17.658 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:17 +0000 (0:00:00.094) 0:03:12.844 *********** 2021-06-25T04:43:17.979 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-06-25T04:43:18.010 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:18 +0000 (0:00:00.351) 0:03:13.196 *********** 2021-06-25T04:43:18.735 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:43:18.762 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:18 +0000 (0:00:00.752) 0:03:13.949 *********** 2021-06-25T04:43:18.794 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-06-25T04:43:18.796 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:18.818 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:18 +0000 (0:00:00.055) 0:03:14.005 *********** 2021-06-25T04:43:19.010 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-06-25T04:43:19.035 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:19 +0000 (0:00:00.216) 0:03:14.221 *********** 2021-06-25T04:43:19.489 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-06-25T04:43:19.491 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-06-25T04:43:19.512 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:19 +0000 (0:00:00.477) 0:03:14.699 *********** 2021-06-25T04:43:19.753 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-06-25T04:43:19.755 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-06-25T04:43:19.780 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:19 +0000 (0:00:00.267) 0:03:14.967 *********** 2021-06-25T04:43:19.807 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:19 +0000 (0:00:00.026) 0:03:14.994 *********** 2021-06-25T04:43:20.111 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-06-25T04:43:20.138 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:20 +0000 (0:00:00.330) 0:03:15.324 *********** 2021-06-25T04:43:20.262 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-06-25T04:43:20.264 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false} 2021-06-25T04:43:20.293 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:20 +0000 (0:00:00.155) 0:03:15.480 *********** 2021-06-25T04:43:20.301 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false} 2021-06-25T04:43:20.330 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:20 +0000 (0:00:00.037) 0:03:15.517 *********** 2021-06-25T04:43:20.338 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-06-25T04:43:20.340 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-06-25T04:43:20.370 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:20 +0000 (0:00:00.039) 0:03:15.557 *********** 2021-06-25T04:43:20.382 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-06-25T04:43:20.417 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:20 +0000 (0:00:00.046) 0:03:15.603 *********** 2021-06-25T04:43:20.556 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-06-25T04:43:20.558 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1624595596.899582, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1624595596.8955817, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1624595596.8955817, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-06-25T04:43:20.592 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:20 +0000 (0:00:00.175) 0:03:15.779 *********** 2021-06-25T04:43:20.611 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1624595599.1348224, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1624595599.1308222, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1624595599.1308222, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-06-25T04:43:20.654 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:20 +0000 (0:00:00.062) 0:03:15.841 *********** 2021-06-25T04:43:20.663 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-06-25T04:43:20.666 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false} 2021-06-25T04:43:20.692 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:20 +0000 (0:00:00.037) 0:03:15.879 *********** 2021-06-25T04:43:20.722 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-06-25T04:43:20.724 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-06-25T04:43:20.747 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:20 +0000 (0:00:00.055) 0:03:15.934 *********** 2021-06-25T04:43:20.940 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-06-25T04:43:20.943 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1624595612.340843, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1624595611.052843, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1624595611.052843, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-06-25T04:43:20.967 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:20 +0000 (0:00:00.219) 0:03:16.154 *********** 2021-06-25T04:43:21.039 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-06-25T04:43:21.066 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.098) 0:03:16.252 *********** 2021-06-25T04:43:21.074 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-06-25T04:43:21.100 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.034) 0:03:16.287 *********** 2021-06-25T04:43:21.108 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-06-25T04:43:21.109 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-06-25T04:43:21.135 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.034) 0:03:16.321 *********** 2021-06-25T04:43:21.142 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-06-25T04:43:21.168 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.032) 0:03:16.354 *********** 2021-06-25T04:43:21.176 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-06-25T04:43:21.177 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "msg": ""} TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.202 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.034) 0:03:16.389 *********** 2021-06-25T04:43:21.224 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.021) 0:03:16.410 *********** 2021-06-25T04:43:21.231 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.258 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.034) 0:03:16.445 *********** 2021-06-25T04:43:21.266 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-06-25T04:43:21.268 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-06-25T04:43:21.299 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.039) 0:03:16.485 *********** 2021-06-25T04:43:21.328 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.366 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.067) 0:03:16.553 *********** 2021-06-25T04:43:21.386 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-06-25T04:43:21.388 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-06-25T04:43:21.418 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.051) 0:03:16.605 *********** 2021-06-25T04:43:21.448 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-06-25T04:43:21.475 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.056) 0:03:16.662 *********** 2021-06-25T04:43:21.551 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-06-25T04:43:21.584 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.109) 0:03:16.771 *********** 2021-06-25T04:43:21.605 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-06-25T04:43:21.607 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} TASK [testnode : Install packages via pip] ************************************* ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-06-25T04:43:21.633 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.048) 0:03:16.820 *********** 2021-06-25T04:43:21.658 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.025) 0:03:16.845 *********** 2021-06-25T04:43:21.666 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-06-25T04:43:21.670 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-06-25T04:43:21.699 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.040) 0:03:16.885 *********** 2021-06-25T04:43:21.708 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-06-25T04:43:21.710 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.737 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.038) 0:03:16.923 *********** 2021-06-25T04:43:21.744 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.770 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.033) 0:03:16.957 *********** 2021-06-25T04:43:21.778 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-06-25T04:43:21.780 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi087.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.813 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.042) 0:03:16.999 *********** 2021-06-25T04:43:21.822 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.826 INFO:teuthology.task.ansible.out: skipping: [smithi087.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.828 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.828 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.853 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.040) 0:03:17.040 *********** 2021-06-25T04:43:21.881 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.028) 0:03:17.068 *********** 2021-06-25T04:43:21.891 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-06-25T04:43:21.893 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.927 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.045) 0:03:17.113 *********** 2021-06-25T04:43:21.935 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-06-25T04:43:21.936 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.948 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.950 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.951 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.952 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.953 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi102.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:21.980 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.053) 0:03:17.167 *********** 2021-06-25T04:43:22.003 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:21 +0000 (0:00:00.022) 0:03:17.190 *********** 2021-06-25T04:43:22.010 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-06-25T04:43:22.011 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.012 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.012 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.014 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:22.015 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.055 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.045) 0:03:17.235 *********** 2021-06-25T04:43:22.073 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.022) 0:03:17.258 *********** 2021-06-25T04:43:22.079 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.081 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.111 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.038) 0:03:17.297 *********** 2021-06-25T04:43:22.149 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.038) 0:03:17.335 *********** 2021-06-25T04:43:22.156 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-06-25T04:43:22.159 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.160 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.163 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.188 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.039) 0:03:17.374 *********** 2021-06-25T04:43:22.196 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.199 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.200 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi057.front.sepia.ceph.com] => {"changed": false} TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.226 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.038) 0:03:17.413 *********** 2021-06-25T04:43:22.249 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.022) 0:03:17.435 *********** 2021-06-25T04:43:22.271 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.022) 0:03:17.458 *********** 2021-06-25T04:43:22.279 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-06-25T04:43:22.281 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.281 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.306 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.035) 0:03:17.493 *********** 2021-06-25T04:43:22.337 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.030) 0:03:17.523 *********** 2021-06-25T04:43:22.497 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.159) 0:03:17.683 *********** 2021-06-25T04:43:22.504 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-06-25T04:43:22.506 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1624595586.7885275, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1624595586.7845275, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1624595586.7845275, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-06-25T04:43:22.531 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.034) 0:03:17.717 *********** 2021-06-25T04:43:22.555 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.023) 0:03:17.741 *********** 2021-06-25T04:43:22.581 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.025) 0:03:17.767 *********** 2021-06-25T04:43:22.588 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-06-25T04:43:22.590 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.618 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.037) 0:03:17.805 *********** 2021-06-25T04:43:22.640 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.021) 0:03:17.826 *********** 2021-06-25T04:43:22.646 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-06-25T04:43:22.648 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.673 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.033) 0:03:17.860 *********** 2021-06-25T04:43:22.695 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.021) 0:03:17.881 *********** 2021-06-25T04:43:22.701 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-06-25T04:43:22.703 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.727 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.032) 0:03:17.914 *********** 2021-06-25T04:43:22.751 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.023) 0:03:17.937 *********** 2021-06-25T04:43:22.758 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-06-25T04:43:22.760 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "msg": ""} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.784 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.033) 0:03:17.971 *********** 2021-06-25T04:43:22.809 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.024) 0:03:17.995 *********** 2021-06-25T04:43:22.815 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-06-25T04:43:22.817 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-06-25T04:43:22.853 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.043) 0:03:18.039 *********** 2021-06-25T04:43:22.884 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.031) 0:03:18.070 *********** 2021-06-25T04:43:22.890 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-06-25T04:43:22.892 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.917 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.033) 0:03:18.103 *********** 2021-06-25T04:43:22.939 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.022) 0:03:18.126 *********** 2021-06-25T04:43:22.948 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:22.950 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi087.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010229", "end": "2021-06-25 04:43:22.900691", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-06-25 04:43:22.890462", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:22.977 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:22 +0000 (0:00:00.038) 0:03:18.164 *********** 2021-06-25T04:43:22.985 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-06-25T04:43:22.987 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.014 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.036) 0:03:18.200 *********** 2021-06-25T04:43:23.022 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.048 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.033) 0:03:18.233 *********** 2021-06-25T04:43:23.057 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.085 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.037) 0:03:18.271 *********** 2021-06-25T04:43:23.103 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-06-25T04:43:23.105 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005977", "end": "2021-06-25 04:43:23.068869", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-06-25 04:43:23.062892", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:23.106 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-06-25T04:43:23.131 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.045) 0:03:18.317 *********** 2021-06-25T04:43:23.139 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-06-25T04:43:23.140 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.170 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.039) 0:03:18.357 *********** 2021-06-25T04:43:23.198 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-06-25T04:43:23.200 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.222 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.052) 0:03:18.409 *********** 2021-06-25T04:43:23.261 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-06-25T04:43:23.263 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010432", "end": "2021-06-25 04:43:23.222460", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-06-25 04:43:23.212028", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ok: [smithi087.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005455", "end": "2021-06-25 04:43:23.231782", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-06-25 04:43:23.226327", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:23.307 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-06-25T04:43:23.309 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-06-25T04:43:23.334 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.111) 0:03:18.521 *********** 2021-06-25T04:43:23.362 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.394 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.059) 0:03:18.580 *********** 2021-06-25T04:43:23.421 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-06-25T04:43:23.423 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006037", "end": "2021-06-25 04:43:23.391969", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-06-25 04:43:23.385932", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ok: [smithi161.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010477", "end": "2021-06-25 04:43:23.390220", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-06-25 04:43:23.379743", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:23.434 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi057.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.446 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.457 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-06-25T04:43:23.459 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.027920", "end": "2021-06-25 04:43:23.415759", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-06-25 04:43:23.387839", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi057.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.461 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-06-25T04:43:23.485 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.091) 0:03:18.672 *********** 2021-06-25T04:43:23.510 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.023) 0:03:18.696 *********** 2021-06-25T04:43:23.527 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-06-25T04:43:23.530 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.540 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-06-25T04:43:23.542 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi057.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.565 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.055) 0:03:18.752 *********** 2021-06-25T04:43:23.589 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.022) 0:03:18.775 *********** 2021-06-25T04:43:23.596 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-06-25T04:43:23.599 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005343", "end": "2021-06-25 04:43:23.549725", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-06-25 04:43:23.544382", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} TASK [testnode : set_fact] ***************************************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi161.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005816", "end": "2021-06-25 04:43:23.562769", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-06-25 04:43:23.556953", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:23.625 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.036) 0:03:18.812 *********** 2021-06-25T04:43:23.633 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-06-25T04:43:23.635 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.660 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.683 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.057) 0:03:18.869 *********** 2021-06-25T04:43:23.718 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-06-25T04:43:23.720 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.743 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.060) 0:03:18.930 *********** 2021-06-25T04:43:23.762 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi102.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.029234", "end": "2021-06-25 04:43:23.729380", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-06-25 04:43:23.700146", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:23.765 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005623", "end": "2021-06-25 04:43:23.722572", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-06-25 04:43:23.716949", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:23.766 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.790 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.047) 0:03:18.977 *********** 2021-06-25T04:43:23.813 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.023) 0:03:19.000 *********** 2021-06-25T04:43:23.821 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.854 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.041) 0:03:19.041 *********** 2021-06-25T04:43:23.861 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-06-25T04:43:23.888 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.033) 0:03:19.075 *********** 2021-06-25T04:43:23.896 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-06-25T04:43:23.898 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.923 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.034) 0:03:19.109 *********** 2021-06-25T04:43:23.930 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-06-25T04:43:23.932 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.958 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:23.984 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:23 +0000 (0:00:00.060) 0:03:19.170 *********** 2021-06-25T04:43:24.008 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-06-25T04:43:24.009 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.037872", "end": "2021-06-25 04:43:23.933923", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-06-25 04:43:23.896051", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:24.010 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-06-25T04:43:24.012 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:24.033 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:24 +0000 (0:00:00.048) 0:03:19.219 *********** 2021-06-25T04:43:24.061 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:24 +0000 (0:00:00.028) 0:03:19.248 *********** 2021-06-25T04:43:24.090 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-06-25T04:43:24.115 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:24 +0000 (0:00:00.053) 0:03:19.301 *********** 2021-06-25T04:43:24.143 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-06-25T04:43:24.144 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:24.242 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-06-25T04:43:24.244 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010605", "end": "2021-06-25 04:43:24.208351", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-06-25 04:43:24.197746", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:24.410 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005826", "end": "2021-06-25 04:43:24.374070", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-06-25 04:43:24.368244", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:24.568 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005596", "end": "2021-06-25 04:43:24.534450", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-06-25 04:43:24.528854", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:24.759 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026218", "end": "2021-06-25 04:43:24.721205", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-06-25 04:43:24.694987", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:24.786 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:24 +0000 (0:00:00.670) 0:03:19.972 *********** 2021-06-25T04:43:24.817 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-06-25T04:43:24.840 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:24 +0000 (0:00:00.054) 0:03:20.027 *********** 2021-06-25T04:43:24.869 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-06-25T04:43:24.871 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:24.943 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-06-25T04:43:24.963 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:24 +0000 (0:00:00.122) 0:03:20.150 *********** 2021-06-25T04:43:24.986 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:24 +0000 (0:00:00.022) 0:03:20.172 *********** 2021-06-25T04:43:25.009 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:25 +0000 (0:00:00.023) 0:03:20.196 *********** 2021-06-25T04:43:25.030 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:25 +0000 (0:00:00.020) 0:03:20.216 *********** 2021-06-25T04:43:25.995 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi087.front.sepia.ceph.com] 2021-06-25T04:43:26.010 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] 2021-06-25T04:43:26.076 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:01.046) 0:03:21.263 *********** 2021-06-25T04:43:26.099 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:00.022) 0:03:21.286 *********** 2021-06-25T04:43:26.112 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] 2021-06-25T04:43:26.119 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-06-25T04:43:26.121 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-06-25T04:43:26.143 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:00.043) 0:03:21.330 *********** 2021-06-25T04:43:26.166 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-06-25T04:43:26.168 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:26.189 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:00.045) 0:03:21.376 *********** 2021-06-25T04:43:26.210 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:00.021) 0:03:21.397 *********** 2021-06-25T04:43:26.232 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:00.021) 0:03:21.419 *********** 2021-06-25T04:43:26.238 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-06-25T04:43:26.240 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} TASK [container-host : set_fact] *********************************************** 2021-06-25T04:43:26.240 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:26.265 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:00.032) 0:03:21.451 *********** 2021-06-25T04:43:26.285 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:00.020) 0:03:21.472 *********** 2021-06-25T04:43:26.292 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-06-25T04:43:26.297 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-06-25T04:43:26.318 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:00.032) 0:03:21.505 *********** 2021-06-25T04:43:26.337 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [smithi102.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-06-25T04:43:26.360 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:00.041) 0:03:21.547 *********** 2021-06-25T04:43:26.368 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-06-25T04:43:26.369 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:26.394 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:00.033) 0:03:21.580 *********** 2021-06-25T04:43:26.432 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-06-25T04:43:26.434 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-06-25T04:43:26.466 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:26 +0000 (0:00:00.072) 0:03:21.652 *********** 2021-06-25T04:43:26.960 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi057.front.sepia.ceph.com] 2021-06-25T04:43:27.025 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:27 +0000 (0:00:00.558) 0:03:22.211 *********** 2021-06-25T04:43:27.054 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-06-25T04:43:27.057 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-06-25T04:43:27.079 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:27 +0000 (0:00:00.054) 0:03:22.265 *********** 2021-06-25T04:43:27.107 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-06-25T04:43:27.109 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:27.131 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:27 +0000 (0:00:00.051) 0:03:22.317 *********** 2021-06-25T04:43:27.180 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-06-25T04:43:27.181 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-06-25T04:43:27.204 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:27 +0000 (0:00:00.073) 0:03:22.391 *********** 2021-06-25T04:43:42.273 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-06-25T04:43:42.275 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 136 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (19.7 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138110 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.2) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.2) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The followin 2021-06-25T04:43:42.277 INFO:teuthology.task.ansible.out:g packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 136 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (19.7 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138110 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.2) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.2) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-06-25T04:43:42.299 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:42 +0000 (0:00:15.095) 0:03:37.486 *********** 2021-06-25T04:43:42.319 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 136 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (19.2 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138110 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.2) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.2) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The followin 2021-06-25T04:43:42.322 INFO:teuthology.task.ansible.out:g packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 136 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (19.2 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138110 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.2) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.2) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-06-25T04:43:42.345 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:42 +0000 (0:00:00.045) 0:03:37.531 *********** 2021-06-25T04:43:42.356 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:42.382 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:42 +0000 (0:00:00.037) 0:03:37.569 *********** 2021-06-25T04:43:42.389 INFO:teuthology.task.ansible.out:skipping: [smithi102.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:42.414 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:42 +0000 (0:00:00.032) 0:03:37.601 *********** 2021-06-25T04:43:42.420 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-06-25T04:43:42.422 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-06-25T04:43:42.447 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:42 +0000 (0:00:00.032) 0:03:37.633 *********** 2021-06-25T04:43:42.454 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-06-25T04:43:42.480 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:42 +0000 (0:00:00.033) 0:03:37.667 *********** 2021-06-25T04:43:42.571 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-06-25T04:43:42.573 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 136 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (19.4 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138110 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.2) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.2) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The followin 2021-06-25T04:43:42.574 INFO:teuthology.task.ansible.out:g packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 136 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (19.4 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138110 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.2) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.2) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-06-25T04:43:42.597 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:42 +0000 (0:00:00.116) 0:03:37.783 *********** 2021-06-25T04:43:42.625 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-06-25T04:43:42.627 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:42.649 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:42 +0000 (0:00:00.052) 0:03:37.836 *********** 2021-06-25T04:43:42.656 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-06-25T04:43:42.658 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:42.679 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-06-25T04:43:42.681 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi102.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:42.707 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:42 +0000 (0:00:00.058) 0:03:37.894 *********** 2021-06-25T04:43:42.809 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:42.843 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:42 +0000 (0:00:00.135) 0:03:38.029 *********** 2021-06-25T04:43:42.851 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:42.879 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:42 +0000 (0:00:00.036) 0:03:38.066 *********** 2021-06-25T04:43:42.919 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:43.079 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:43.106 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:43 +0000 (0:00:00.227) 0:03:38.293 *********** 2021-06-25T04:43:43.308 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-06-25T04:43:43.310 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596222.8996294-753-42354509717685/source", "state": "file", "uid": 0} 2021-06-25T04:43:43.351 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596222.9397101-758-94694155169148/source", "state": "file", "uid": 0} 2021-06-25T04:43:43.588 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596223.172666-805-231235396265727/source", "state": "file", "uid": 0} 2021-06-25T04:43:43.716 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596223.3317857-753-139301252888104/source", "state": "file", "uid": 0} 2021-06-25T04:43:43.743 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:43 +0000 (0:00:00.636) 0:03:38.930 *********** 2021-06-25T04:43:43.751 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-06-25T04:43:43.753 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 136 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (19.7 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138110 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.2) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.2) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The followin 2021-06-25T04:43:43.755 INFO:teuthology.task.ansible.out:g packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 136 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (19.7 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138110 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.2) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.2) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-06-25T04:43:43.782 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:43 +0000 (0:00:00.038) 0:03:38.968 *********** 2021-06-25T04:43:43.791 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** changed: [smithi102.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596223.386998-758-280203380671025/source", "state": "file", "uid": 0} 2021-06-25T04:43:43.819 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:43 +0000 (0:00:00.036) 0:03:39.005 *********** 2021-06-25T04:43:43.827 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-06-25T04:43:43.829 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-06-25T04:43:43.854 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:43 +0000 (0:00:00.035) 0:03:39.041 *********** 2021-06-25T04:43:43.892 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-06-25T04:43:43.895 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-06-25T04:43:43.917 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:43 +0000 (0:00:00.062) 0:03:39.103 *********** 2021-06-25T04:43:44.008 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-06-25T04:43:44.010 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596223.6141465-805-159455172660434/source", "state": "file", "uid": 0} 2021-06-25T04:43:44.034 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:44 +0000 (0:00:00.118) 0:03:39.221 *********** 2021-06-25T04:43:44.135 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-06-25T04:43:44.137 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:44.297 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-06-25T04:43:44.343 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:44 +0000 (0:00:00.308) 0:03:39.530 *********** 2021-06-25T04:43:44.498 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-06-25T04:43:44.500 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1624595692, "cache_updated": false, "changed": false} 2021-06-25T04:43:44.524 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:44 +0000 (0:00:00.180) 0:03:39.710 *********** 2021-06-25T04:43:44.574 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"cache_update_time": 1624595752, "cache_updated": false, "changed": false} 2021-06-25T04:43:44.601 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:44 +0000 (0:00:00.076) 0:03:39.787 *********** 2021-06-25T04:43:44.799 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1624595811, "cache_updated": false, "changed": false} 2021-06-25T04:43:44.825 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:44 +0000 (0:00:00.223) 0:03:40.011 *********** 2021-06-25T04:43:44.832 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-06-25T04:43:44.834 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596224.4011724-985-47884400342009/source", "state": "file", "uid": 0} 2021-06-25T04:43:45.237 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596224.8446486-985-115660256937448/source", "state": "file", "uid": 0} 2021-06-25T04:43:45.266 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:45 +0000 (0:00:00.441) 0:03:40.452 *********** 2021-06-25T04:43:46.038 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-06-25T04:43:46.039 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1624595632, "cache_updated": false, "changed": false} 2021-06-25T04:43:46.062 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:46 +0000 (0:00:00.796) 0:03:41.249 *********** 2021-06-25T04:43:49.028 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-06-25T04:43:49.031 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-zf4w1hxi\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-zf4w1hxi"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-zf4w1hxi\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=52afeadc4479a6ead874ccdd9bdfb499c504ae8ed10d2a16be9ffaf922cf3b47\n Stored in directory: /tmp/pip-ephem-wheel-cache-rrbwwm3n/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=30f671f31b379d0aa07467db89b80889954089e620b8f7687def5d8671f5daf0\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-06-25T04:43:49.032 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-zf4w1hxi", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=52afeadc4479a6ead874ccdd9bdfb499c504ae8ed10d2a16be9ffaf922cf3b47", " Stored in directory: /tmp/pip-ephem-wheel-cache-rrbwwm3n/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=30f671f31b379d0aa07467db89b80889954089e620b8f7687def5d8671f5daf0", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-06-25T04:43:49.055 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:49 +0000 (0:00:02.993) 0:03:44.242 *********** 2021-06-25T04:43:49.077 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-yuulsmyj\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-yuulsmyj"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-yuulsmyj\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=52afeadc4479a6ead874ccdd9bdfb499c504ae8ed10d2a16be9ffaf922cf3b47\n Stored in directory: /tmp/pip-ephem-wheel-cache-0__saefr/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=30f671f31b379d0aa07467db89b80889954089e620b8f7687def5d8671f5daf0\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-06-25T04:43:49.078 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-yuulsmyj", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=52afeadc4479a6ead874ccdd9bdfb499c504ae8ed10d2a16be9ffaf922cf3b47", " Stored in directory: /tmp/pip-ephem-wheel-cache-0__saefr/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=30f671f31b379d0aa07467db89b80889954089e620b8f7687def5d8671f5daf0", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-06-25T04:43:49.103 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:49 +0000 (0:00:00.047) 0:03:44.290 *********** 2021-06-25T04:43:49.226 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-06-25T04:43:49.228 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-06-25T04:43:49.254 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:49 +0000 (0:00:00.150) 0:03:44.441 *********** 2021-06-25T04:43:49.282 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-06-25T04:43:49.308 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:49 +0000 (0:00:00.053) 0:03:44.494 *********** 2021-06-25T04:43:49.315 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-06-25T04:43:49.317 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-r3qpk_08\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-r3qpk_08"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-r3qpk_08\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=c2a19cc4392c1b11f120e820faab0725931dfc72c81cfdae80e3ca993734ccc8\n Stored in directory: /tmp/pip-ephem-wheel-cache-okt10dga/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=30f671f31b379d0aa07467db89b80889954089e620b8f7687def5d8671f5daf0\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-06-25T04:43:49.319 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-r3qpk_08", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=c2a19cc4392c1b11f120e820faab0725931dfc72c81cfdae80e3ca993734ccc8", " Stored in directory: /tmp/pip-ephem-wheel-cache-okt10dga/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=30f671f31b379d0aa07467db89b80889954089e620b8f7687def5d8671f5daf0", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-06-25T04:43:49.343 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:49 +0000 (0:00:00.035) 0:03:44.530 *********** 2021-06-25T04:43:49.521 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-06-25T04:43:49.523 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-06-25T04:43:49.560 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:49 +0000 (0:00:00.216) 0:03:44.746 *********** 2021-06-25T04:43:49.683 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-06-25T04:43:49.685 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596229.3050196-1452-273486200621159/source", "state": "file", "uid": 0} 2021-06-25T04:43:49.708 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:49 +0000 (0:00:00.148) 0:03:44.895 *********** 2021-06-25T04:43:49.773 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596229.3648486-1460-120860225650888/source", "state": "file", "uid": 0} 2021-06-25T04:43:49.808 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:49 +0000 (0:00:00.099) 0:03:44.994 *********** 2021-06-25T04:43:49.925 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-06-25T04:43:49.927 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.037391", "end": "2021-06-25 04:43:49.904959", "rc": 0, "start": "2021-06-25 04:43:49.867568", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:49.960 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:49 +0000 (0:00:00.152) 0:03:45.147 *********** 2021-06-25T04:43:50.000 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-06-25T04:43:50.002 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596229.6147947-1489-144179588488525/source", "state": "file", "uid": 0} 2021-06-25T04:43:50.027 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:50 +0000 (0:00:00.067) 0:03:45.214 *********** 2021-06-25T04:43:50.046 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-06-25T04:43:50.048 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.038713", "end": "2021-06-25 04:43:50.016019", "rc": 0, "start": "2021-06-25 04:43:49.977306", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:50.075 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:50 +0000 (0:00:00.047) 0:03:45.262 *********** 2021-06-25T04:43:50.242 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.034832", "end": "2021-06-25 04:43:50.215120", "rc": 0, "start": "2021-06-25 04:43:50.180288", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:50.274 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:50 +0000 (0:00:00.198) 0:03:45.460 *********** 2021-06-25T04:43:50.746 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-cctij2kn\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-cctij2kn"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-cctij2kn\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=f1fabfba0f8157c1b13f2841f56ba35ff89d02ec8c98b261439d9d0ba7eef059\n Stored in directory: /tmp/pip-ephem-wheel-cache-s_eh4o50/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=30f671f31b379d0aa07467db89b80889954089e620b8f7687def5d8671f5daf0\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 regi 2021-06-25T04:43:50.748 INFO:teuthology.task.ansible.out:stries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-cctij2kn", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=f1fabfba0f8157c1b13f2841f56ba35ff89d02ec8c98b261439d9d0ba7eef059", " Stored in directory: /tmp/pip-ephem-wheel-cache-s_eh4o50/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=30f671f31b379d0aa07467db89b80889954089e620b8f7687def5d8671f5daf0", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-06-25T04:43:50.771 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:50 +0000 (0:00:00.497) 0:03:45.957 *********** 2021-06-25T04:43:50.956 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-06-25T04:43:50.957 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-06-25T04:43:50.979 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:50 +0000 (0:00:00.208) 0:03:46.166 *********** 2021-06-25T04:43:51.426 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-06-25T04:43:51.428 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1624596231.033672-1628-16478194164077/source", "state": "file", "uid": 0} 2021-06-25T04:43:51.451 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:51 +0000 (0:00:00.471) 0:03:46.638 *********** 2021-06-25T04:43:51.679 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-06-25T04:43:51.680 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.038244", "end": "2021-06-25 04:43:51.651147", "rc": 0, "start": "2021-06-25 04:43:51.612903", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-06-25T04:43:51.703 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:51 +0000 (0:00:00.251) 0:03:46.889 *********** 2021-06-25T04:43:51.721 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-06-25T04:43:51.722 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:43:37 UTC", "ActiveEnterTimestampMonotonic": "248843912", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "containerd.service firewalld.service sysinit.target systemd-journald.socket basic.target docker.socket network-online.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:43:35 UTC", "AssertTimestampMonotonic": "246791976", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:43:35 UTC", "ConditionTimestampMonotonic": "246791975", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.sli 2021-06-25T04:43:51.724 INFO:teuthology.task.ansible.out:ce/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8830", "ExecMainStartTimestamp": "Fri 2021-06-25 04:43:35 UTC", "ExecMainStartTimestampMonotonic": "246792751", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Fri 2021-06-25 04:43:35 UTC] ; stop_time=[n/a] ; pid=8830 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Fri 2021-06-25 04:43:35 UTC] ; stop_time=[n/a] ; pid=8830 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngress 2021-06-25T04:43:51.726 INFO:teuthology.task.ansible.out:Packets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:43:35 UTC", "InactiveExitTimestampMonotonic": "246792978", "InvocationID": "55e093f845b24d16911df2f0d1f2978b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8830", "MemoryAccounting": "yes", "MemoryCurrent": "53878784", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "contin 2021-06-25T04:43:51.728 INFO:teuthology.task.ansible.out:ue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:43:37 UTC", "StateChangeTimestampMonotonic": "248843912", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": " 2021-06-25T04:43:51.729 INFO:teuthology.task.ansible.out:notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:43:51.967 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:43:38 UTC", "ActiveEnterTimestampMonotonic": "237504403", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "containerd.service firewalld.service network-online.target sysinit.target docker.socket system.slice systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:43:36 UTC", "AssertTimestampMonotonic": "235506515", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:43:36 UTC", "ConditionTimestampMonotonic": "235506515", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.sli 2021-06-25T04:43:51.969 INFO:teuthology.task.ansible.out:ce/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8832", "ExecMainStartTimestamp": "Fri 2021-06-25 04:43:36 UTC", "ExecMainStartTimestampMonotonic": "235507295", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Fri 2021-06-25 04:43:36 UTC] ; stop_time=[n/a] ; pid=8832 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Fri 2021-06-25 04:43:36 UTC] ; stop_time=[n/a] ; pid=8832 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngress 2021-06-25T04:43:51.970 INFO:teuthology.task.ansible.out:Packets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:43:36 UTC", "InactiveExitTimestampMonotonic": "235507521", "InvocationID": "e2552e7d098644fc92218234e5ef1ca1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8832", "MemoryAccounting": "yes", "MemoryCurrent": "53522432", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "contin 2021-06-25T04:43:51.972 INFO:teuthology.task.ansible.out:ue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:43:38 UTC", "StateChangeTimestampMonotonic": "237504403", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "15", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": " 2021-06-25T04:43:51.974 INFO:teuthology.task.ansible.out:notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target cont 2021-06-25T04:43:51.974 INFO:teuthology.task.ansible.out:ainerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:43:52.167 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:43:37 UTC", "ActiveEnterTimestampMonotonic": "253902548", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "containerd.service basic.target firewalld.service system.slice systemd-journald.socket docker.socket sysinit.target network-online.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:43:35 UTC", "AssertTimestampMonotonic": "251876341", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:43:35 UTC", "ConditionTimestampMonotonic": "251876340", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.sli 2021-06-25T04:43:52.169 INFO:teuthology.task.ansible.out:ce/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8814", "ExecMainStartTimestamp": "Fri 2021-06-25 04:43:35 UTC", "ExecMainStartTimestampMonotonic": "251877459", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Fri 2021-06-25 04:43:35 UTC] ; stop_time=[n/a] ; pid=8814 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Fri 2021-06-25 04:43:35 UTC] ; stop_time=[n/a] ; pid=8814 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngress 2021-06-25T04:43:52.171 INFO:teuthology.task.ansible.out:Packets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:43:35 UTC", "InactiveExitTimestampMonotonic": "251877689", "InvocationID": "f86925a789194bd5b4e10503a5fecae6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8814", "MemoryAccounting": "yes", "MemoryCurrent": "54173696", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "contin 2021-06-25T04:43:52.172 INFO:teuthology.task.ansible.out:ue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:43:37 UTC", "StateChangeTimestampMonotonic": "253902548", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "5000 2021-06-25T04:43:52.173 INFO:teuthology.task.ansible.out:0", "Transient": "no", "TriggeredBy": "docker.socket", "Type": " 2021-06-25T04:43:52.174 INFO:teuthology.task.ansible.out:notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:43:53.590 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-06-25 04:43:38 UTC", "ActiveEnterTimestampMonotonic": "261156353", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target firewalld.service system.slice docker.socket basic.target systemd-journald.socket network-online.target containerd.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-06-25 04:43:36 UTC", "AssertTimestampMonotonic": "259099655", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-06-25 04:43:36 UTC", "ConditionTimestampMonotonic": "259099655", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.sli 2021-06-25T04:43:53.591 INFO:teuthology.task.ansible.out:ce/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8758", "ExecMainStartTimestamp": "Fri 2021-06-25 04:43:36 UTC", "ExecMainStartTimestampMonotonic": "259100461", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Fri 2021-06-25 04:43:36 UTC] ; stop_time=[n/a] ; pid=8758 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Fri 2021-06-25 04:43:36 UTC] ; stop_time=[n/a] ; pid=8758 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngress 2021-06-25T04:43:53.592 INFO:teuthology.task.ansible.out:Packets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-06-25 04:43:36 UTC", "InactiveExitTimestampMonotonic": "259100689", "InvocationID": "9bfae2e100404f90bf4773997ce4d0d1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127802", "LimitSIGPENDINGSoft": "127802", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8758", "MemoryAccounting": "yes", "MemoryCurrent": "52678656", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "contin 2021-06-25T04:43:53.594 INFO:teuthology.task.ansible.out:ue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-06-25 04:43:38 UTC", "StateChangeTimestampMonotonic": "261156353", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "15", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": " 2021-06-25T04:43:53.596 INFO:teuthology.task.ansible.out:notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network 2021-06-25T04:43:53.596 INFO:teuthology.task.ansible.out:-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-06-25T04:43:53.666 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-06-25T04:43:53.668 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-06-25T04:43:53.669 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-06-25T04:43:53.671 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-06-25T04:43:53.684 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-06-25T04:43:53.685 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:53 +0000 (0:00:01.981) 0:03:48.871 *********** 2021-06-25T04:43:54.634 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] 2021-06-25T04:43:54.687 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] 2021-06-25T04:43:54.750 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] 2021-06-25T04:43:55.724 INFO:teuthology.task.ansible.out:ok: [smithi102.front.sepia.ceph.com] 2021-06-25T04:43:55.744 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** 2021-06-25T04:43:55.746 INFO:teuthology.task.ansible.out:Friday 25 June 2021 04:43:55 +0000 (0:00:02.060) 0:03:50.931 *********** 2021-06-25T04:43:55.930 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-06-25T04:43:55.952 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-06-25T04:43:55.985 INFO:teuthology.task.ansible.out:changed: [smithi102.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-06-25T04:43:55.996 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-06-25T04:43:55.998 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* 2021-06-25T04:43:56.000 INFO:teuthology.task.ansible.out:smithi057.front.sepia.ceph.com : ok=133 changed=41 unreachable=0 failed=0 skipped=186 rescued=0 ignored=0 smithi087.front.sepia.ceph.com : ok=133 changed=41 unreachable=0 failed=0 skipped=186 rescued=0 ignored=0 smithi102.front.sepia.ceph.com : ok=133 changed=41 unreachable=0 failed=0 skipped=186 rescued=0 ignored=0 smithi161.front.sepia.ceph.com : ok=133 changed=41 unreachable=0 failed=0 skipped=186 rescued=0 ignored=0 Friday 25 June 2021 04:43:55 +0000 (0:00:00.254) 0:03:51.186 *********** =============================================================================== 2021-06-25T04:43:56.001 INFO:teuthology.task.ansible.out:Create all admin users with sudo access. ------------------------------- 27.77s testnode : Upgrade packages -------------------------------------------- 23.85s users : Update authorized_keys using the keys repo --------------------- 20.16s container-host : Install container packages ---------------------------- 15.10s testnode : Install packages -------------------------------------------- 11.85s testnode : Ensure packages are not present. ---------------------------- 10.83s Remove revoked users ---------------------------------------------------- 6.77s testnode : Zap all non-root disks --------------------------------------- 5.34s common : Update apt cache ----------------------------------------------- 3.56s container-host : Install registries-conf-ctl ---------------------------- 2.99s Gathering Facts --------------------------------------------------------- 2.17s Gathering Facts --------------------------------------------------------- 2.06s container-host : Restart docker service --------------------------------- 1.98s testnode : Update apt cache. -------------------------------------------- 1.97s testnode : Install apt keys --------------------------------------------- 1.87s Gathering Facts --------------------------------------------------------- 1.72s common : Upload megacli and cli64 for raid mon 2021-06-25T04:43:56.002 INFO:teuthology.task.ansible.out:itoring and smart.pl to /usr/sbin/. --- 1.05s Gathering Facts --------------------------------------------------------- 1.05s users : Update authorized_keys for each user with literal keys ---------- 0.98s Gathering Facts --------------------------------------------------------- 0.92s 2021-06-25T04:43:56.412 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2021-06-25T04:43:56.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:43:56.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:43:56.467 DEBUG:teuthology.orchestra.run.smithi057:> true 2021-06-25T04:43:56.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:43:56.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:43:56.636 DEBUG:teuthology.orchestra.run.smithi087:> true 2021-06-25T04:43:56.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:43:56.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:43:56.799 DEBUG:teuthology.orchestra.run.smithi102:> true 2021-06-25T04:43:56.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-25T04:43:56.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-06-25T04:43:56.967 DEBUG:teuthology.orchestra.run.smithi161:> true 2021-06-25T04:43:57.084 INFO:teuthology.run_tasks:Running task clock... 2021-06-25T04:43:57.100 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-06-25T04:43:57.101 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-06-25T04:43:57.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-06-25T04:43:57.140 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-06-25T04:43:57.140 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: Command line: ntpd -gq 2021-06-25T04:43:57.142 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: proto: precision = 0.127 usec (-23) 2021-06-25T04:43:57.142 INFO:teuthology.orchestra.run.smithi057.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-06-25T04:43:57.143 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-06-25T04:43:57.143 INFO:teuthology.orchestra.run.smithi057.stderr:restrict ::: KOD does nothing without LIMITED. 2021-06-25T04:43:57.144 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: restrict ::: KOD does nothing without LIMITED. 2021-06-25T04:43:57.145 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: Listen and drop on 0 v6wildcard [::]:123 2021-06-25T04:43:57.145 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-06-25T04:43:57.145 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: Listen normally on 2 lo 127.0.0.1:123 2021-06-25T04:43:57.145 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: Listen normally on 3 ens1f0 172.21.15.57:123 2021-06-25T04:43:57.145 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: Listen normally on 4 lo [::1]:123 2021-06-25T04:43:57.146 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1562%3]:123 2021-06-25T04:43:57.147 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:43:57 ntpd[10131]: Listening on routing socket on fd #22 for interface updates 2021-06-25T04:43:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:58 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:43:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:58 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:43:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:58 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:43:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:58 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:43:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:58 ntpd[10131]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:43:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:58 ntpd[10131]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:43:59.141 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:59 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:43:59.141 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:59 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:43:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:59 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:43:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:59 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:43:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:59 ntpd[10131]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:43:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:43:59 ntpd[10131]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:00.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:00.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:00.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:00.143 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:00.143 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:00.143 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:00.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:00.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:00.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:00.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:00 ntpd[10131]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:01.141 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:01 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:01.141 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:01 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:01 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:01 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:01 ntpd[10131]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:01 ntpd[10131]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:02.143 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:02.143 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:02.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:02.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:02.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:02.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:02.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:02.145 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:02.145 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:02.145 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:02.145 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:02.146 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:02.146 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:02.146 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:02.146 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:02.146 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:02 ntpd[10131]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:03 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:03 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:03 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:03.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:03 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:03.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:03 ntpd[10131]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:03.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:03 ntpd[10131]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:04.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:04.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:04.142 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:04.143 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:04.143 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:04.143 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:04.143 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:04.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:04.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:04.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:04.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:04.144 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:04.145 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:04.145 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:04.145 INFO:teuthology.orchestra.run.smithi057.stdout:25 Jun 04:44:04 ntpd[10131]: ntpd: time slew -0.001050 s 2021-06-25T04:44:04.146 INFO:teuthology.orchestra.run.smithi057.stdout:ntpd: time slew -0.001050s 2021-06-25T04:44:04.146 INFO:teuthology.orchestra.run.smithi057.stderr:25 Jun 04:44:04 ntpd[10131]: can't open /var/log/ntpstats/loopstats.20210625: Permission denied 2021-06-25T04:44:04.199 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2021-06-25T04:44:04.200 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2021-06-25T04:44:04.200 INFO:teuthology.orchestra.run.smithi057.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:04.200 INFO:teuthology.orchestra.run.smithi057.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:04.201 INFO:teuthology.orchestra.run.smithi057.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:04.201 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:04.202 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-06-25T04:44:04.202 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-06-25T04:44:04.238 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-06-25T04:44:04.238 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: Command line: ntpd -gq 2021-06-25T04:44:04.239 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: proto: precision = 0.147 usec (-23) 2021-06-25T04:44:04.239 INFO:teuthology.orchestra.run.smithi087.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-06-25T04:44:04.240 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-06-25T04:44:04.240 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: restrict ::: KOD does nothing without LIMITED. 2021-06-25T04:44:04.241 INFO:teuthology.orchestra.run.smithi087.stderr:restrict ::: KOD does nothing without LIMITED. 2021-06-25T04:44:04.242 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: Listen and drop on 0 v6wildcard [::]:123 2021-06-25T04:44:04.242 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-06-25T04:44:04.242 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: Listen normally on 2 lo 127.0.0.1:123 2021-06-25T04:44:04.243 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: Listen normally on 3 enp3s0f1 172.21.15.87:123 2021-06-25T04:44:04.243 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: Listen normally on 4 lo [::1]:123 2021-06-25T04:44:04.243 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5f5%5]:123 2021-06-25T04:44:04.243 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:04 ntpd[10198]: Listening on routing socket on fd #22 for interface updates 2021-06-25T04:44:05.239 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:05 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:05.239 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:05 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:05.240 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:05 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:05.240 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:05 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:05.240 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:05 ntpd[10198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:05.240 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:05 ntpd[10198]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:07.242 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:07.245 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:07.245 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:07.246 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:07.246 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:07.246 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:07.247 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:07.248 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:07.248 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:07.248 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:07.249 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:07.249 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:07.249 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:07.249 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:07.250 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:07.250 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:07.250 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:07 ntpd[10198]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:09.240 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:09.241 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:09.241 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:09.241 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:09.243 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:09.243 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:09.243 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:09.243 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:09.244 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:09.244 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:09.244 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:09.244 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:09.245 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:09.245 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:09.245 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:09.245 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:09.245 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:09.246 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:09.246 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:09 ntpd[10198]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:11.240 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:11.241 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:11.241 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:11.241 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:11.242 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:11.242 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:11.242 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:11.242 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:11.243 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:11.243 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:11.244 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:11.244 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:11.244 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:11.244 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:11.245 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:11.245 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:11.245 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:11.245 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:11.246 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:11.246 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:11.246 INFO:teuthology.orchestra.run.smithi087.stdout:25 Jun 04:44:11 ntpd[10198]: ntpd: time slew -0.005536 s 2021-06-25T04:44:11.247 INFO:teuthology.orchestra.run.smithi087.stdout:ntpd: time slew -0.005536s 2021-06-25T04:44:11.247 INFO:teuthology.orchestra.run.smithi087.stderr:25 Jun 04:44:11 ntpd[10198]: can't open /var/log/ntpstats/loopstats.20210625: Permission denied 2021-06-25T04:44:11.306 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2021-06-25T04:44:11.306 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2021-06-25T04:44:11.306 INFO:teuthology.orchestra.run.smithi087.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:11.307 INFO:teuthology.orchestra.run.smithi087.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:11.307 INFO:teuthology.orchestra.run.smithi087.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:11.307 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:11.308 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-06-25T04:44:11.308 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-06-25T04:44:11.343 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-06-25T04:44:11.343 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: Command line: ntpd -gq 2021-06-25T04:44:11.344 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: proto: precision = 0.076 usec (-24) 2021-06-25T04:44:11.344 INFO:teuthology.orchestra.run.smithi102.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-06-25T04:44:11.345 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-06-25T04:44:11.345 INFO:teuthology.orchestra.run.smithi102.stderr:restrict ::: KOD does nothing without LIMITED. 2021-06-25T04:44:11.347 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: restrict ::: KOD does nothing without LIMITED. 2021-06-25T04:44:11.347 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: Listen and drop on 0 v6wildcard [::]:123 2021-06-25T04:44:11.347 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-06-25T04:44:11.348 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: Listen normally on 2 lo 127.0.0.1:123 2021-06-25T04:44:11.348 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: Listen normally on 3 enp3s0f1 172.21.15.102:123 2021-06-25T04:44:11.348 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: Listen normally on 4 lo [::1]:123 2021-06-25T04:44:11.348 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d769%5]:123 2021-06-25T04:44:11.349 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:11 ntpd[10214]: Listening on routing socket on fd #22 for interface updates 2021-06-25T04:44:12.343 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:12 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:12.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:12 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:12.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:12 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:12.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:12 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:12.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:12 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:12.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:12 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:13.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:13 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:13.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:13 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:13.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:13 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:13.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:13 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:13.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:13 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:13.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:13 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:14.343 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:14 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:14.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:14 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:14.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:14 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:14.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:14 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:14.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:14 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:14.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:14 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:15 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:16.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:16.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:16.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:16.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:16.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:16.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:16.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:16.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:16.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:16.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:16.347 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:16.347 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:16 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:17.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:17.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:17.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:17.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:17.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:17.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:17.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:17.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:17.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:17.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:17.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:17.347 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:17 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:18 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:18 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:18 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:18 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:18 ntpd[10214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:18 ntpd[10214]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:18 ntpd[10214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:18 ntpd[10214]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:18.346 INFO:teuthology.orchestra.run.smithi102.stdout:25 Jun 04:44:18 ntpd[10214]: ntpd: time slew -0.001635 s 2021-06-25T04:44:18.346 INFO:teuthology.orchestra.run.smithi102.stdout:ntpd: time slew -0.001635s 2021-06-25T04:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr:25 Jun 04:44:18 ntpd[10214]: can't open /var/log/ntpstats/loopstats.20210625: Permission denied 2021-06-25T04:44:18.427 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2021-06-25T04:44:18.428 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2021-06-25T04:44:18.428 INFO:teuthology.orchestra.run.smithi102.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:18.428 INFO:teuthology.orchestra.run.smithi102.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:18.428 INFO:teuthology.orchestra.run.smithi102.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:18.429 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:18.430 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-06-25T04:44:18.430 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-06-25T04:44:18.467 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-06-25T04:44:18.467 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: Command line: ntpd -gq 2021-06-25T04:44:18.468 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: proto: precision = 0.152 usec (-23) 2021-06-25T04:44:18.469 INFO:teuthology.orchestra.run.smithi161.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-06-25T04:44:18.469 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-06-25T04:44:18.470 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: restrict ::: KOD does nothing without LIMITED. 2021-06-25T04:44:18.471 INFO:teuthology.orchestra.run.smithi161.stderr:restrict ::: KOD does nothing without LIMITED. 2021-06-25T04:44:18.472 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: Listen and drop on 0 v6wildcard [::]:123 2021-06-25T04:44:18.472 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-06-25T04:44:18.472 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: Listen normally on 2 lo 127.0.0.1:123 2021-06-25T04:44:18.473 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: Listen normally on 3 enp3s0f1 172.21.15.161:123 2021-06-25T04:44:18.473 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: Listen normally on 4 lo [::1]:123 2021-06-25T04:44:18.473 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7251%5]:123 2021-06-25T04:44:18.473 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:18 ntpd[10204]: Listening on routing socket on fd #22 for interface updates 2021-06-25T04:44:19.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:19.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:19.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:19.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:19.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:19.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:19.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:19.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:19.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:19.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:19.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:19.471 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:19 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:20.467 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:20 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:20.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:20 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:20.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:20 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:20.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:20 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:20.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:20 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:20.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:20 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:21.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:21.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:21.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:21.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:21.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:21.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:21.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:21.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:21.471 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:21.471 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:21.471 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:21.471 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:21.472 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:21.472 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:21.472 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:21.472 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:21.472 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:21.473 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:21 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:22.467 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:22 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:22.467 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:22 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:22 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:22 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:22 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:22 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:23.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:23.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:23.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:23.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:23.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:23.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:23.471 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:23.471 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:23.471 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:23.471 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:23.471 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:23.472 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:23.472 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:23.472 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:23.472 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:23.473 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:23.473 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:23.473 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:23 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:24.467 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:24 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:24.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:24 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:24.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:24 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:24.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:24 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:24.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:24 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:24.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:24 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:25.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:25 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:25.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:25 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:25.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:25 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:25.468 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:25 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:25.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:25 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:25.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:25 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:25.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:25 ntpd[10204]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-06-25T04:44:25.469 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:25 ntpd[10204]: can't open /var/log/ntpstats/rawstats.20210625: Permission denied 2021-06-25T04:44:25.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:25 ntpd[10204]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-06-25T04:44:25.470 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:25 ntpd[10204]: can't open /var/log/ntpstats/peerstats.20210625: Permission denied 2021-06-25T04:44:25.470 INFO:teuthology.orchestra.run.smithi161.stdout:25 Jun 04:44:25 ntpd[10204]: ntpd: time slew +0.002104 s 2021-06-25T04:44:25.471 INFO:teuthology.orchestra.run.smithi161.stdout:ntpd: time slew +0.002104s 2021-06-25T04:44:25.471 INFO:teuthology.orchestra.run.smithi161.stderr:25 Jun 04:44:25 ntpd[10204]: can't open /var/log/ntpstats/loopstats.20210625: Permission denied 2021-06-25T04:44:25.522 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2021-06-25T04:44:25.522 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2021-06-25T04:44:25.523 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:25.523 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:25.523 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:25.523 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-06-25T04:44:25.524 INFO:teuthology.run_tasks:Running task install... 2021-06-25T04:44:25.536 DEBUG:teuthology.task.install:project ceph 2021-06-25T04:44:25.536 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'da5e8184007182fa3cd5c8385fee4e08c5620fe2'}} 2021-06-25T04:44:25.537 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'da5e8184007182fa3cd5c8385fee4e08c5620fe2'} 2021-06-25T04:44:25.537 INFO:teuthology.task.install:Using flavor: basic 2021-06-25T04:44:25.543 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-06-25T04:44:25.544 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2021-06-25T04:44:25.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo lsb_release -is 2021-06-25T04:44:25.597 INFO:teuthology.orchestra.run.smithi057.stdout:Ubuntu 2021-06-25T04:44:25.602 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:44:25.603 DEBUG:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2021-06-25T04:44:25.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-key list | grep Ceph 2021-06-25T04:44:25.655 INFO:teuthology.orchestra.run.smithi087.stdout:Ubuntu 2021-06-25T04:44:25.661 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:44:25.662 DEBUG:teuthology.orchestra.run.smithi102:> sudo lsb_release -is 2021-06-25T04:44:25.662 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-key list | grep Ceph 2021-06-25T04:44:25.708 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-06-25T04:44:25.712 INFO:teuthology.orchestra.run.smithi102.stdout:Ubuntu 2021-06-25T04:44:25.717 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:44:25.718 DEBUG:teuthology.orchestra.run.smithi161:> sudo lsb_release -is 2021-06-25T04:44:25.719 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-key list | grep Ceph 2021-06-25T04:44:25.763 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-06-25T04:44:25.763 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph.com (release key) 2021-06-25T04:44:25.764 DEBUG:teuthology.orchestra.run.smithi057:> sudo lsb_release -is 2021-06-25T04:44:25.766 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-06-25T04:44:25.768 INFO:teuthology.orchestra.run.smithi161.stdout:Ubuntu 2021-06-25T04:44:25.773 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:44:25.774 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-key list | grep Ceph 2021-06-25T04:44:25.812 INFO:teuthology.orchestra.run.smithi057.stdout:Ubuntu 2021-06-25T04:44:25.814 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-06-25T04:44:25.817 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:44:25.817 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-06-25T04:44:25.817 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-06-25T04:44:25.818 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=da5e8184007182fa3cd5c8385fee4e08c5620fe2 2021-06-25T04:44:25.824 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-06-25T04:44:25.824 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph.com (release key) 2021-06-25T04:44:25.824 DEBUG:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2021-06-25T04:44:25.860 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-06-25T04:44:25.873 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-06-25T04:44:25.873 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph.com (release key) 2021-06-25T04:44:25.875 INFO:teuthology.orchestra.run.smithi087.stdout:Ubuntu 2021-06-25T04:44:25.876 DEBUG:teuthology.orchestra.run.smithi102:> sudo lsb_release -is 2021-06-25T04:44:25.879 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:44:25.879 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-06-25T04:44:25.879 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-06-25T04:44:25.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=da5e8184007182fa3cd5c8385fee4e08c5620fe2 2021-06-25T04:44:25.923 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-06-25T04:44:25.923 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph.com (release key) 2021-06-25T04:44:25.924 DEBUG:teuthology.orchestra.run.smithi161:> sudo lsb_release -is 2021-06-25T04:44:25.930 INFO:teuthology.orchestra.run.smithi102.stdout:Ubuntu 2021-06-25T04:44:25.932 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:44:25.932 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-06-25T04:44:25.933 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-06-25T04:44:25.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=da5e8184007182fa3cd5c8385fee4e08c5620fe2 2021-06-25T04:44:25.971 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default/ 2021-06-25T04:44:25.972 INFO:teuthology.task.install.deb:Package version is 15.2.13-65-gda5e8184-1focal 2021-06-25T04:44:25.975 INFO:teuthology.orchestra.run.smithi161.stdout:Ubuntu 2021-06-25T04:44:25.978 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:44:25.978 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-06-25T04:44:25.979 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-06-25T04:44:25.980 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=da5e8184007182fa3cd5c8385fee4e08c5620fe2 2021-06-25T04:44:26.035 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default/ 2021-06-25T04:44:26.035 INFO:teuthology.task.install.deb:Package version is 15.2.13-65-gda5e8184-1focal 2021-06-25T04:44:26.076 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default/ 2021-06-25T04:44:26.076 INFO:teuthology.task.install.deb:Package version is 15.2.13-65-gda5e8184-1focal 2021-06-25T04:44:26.091 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2021-06-25T04:44:26.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-06-25T04:44:26.108 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2021-06-25T04:44:26.123 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default/ 2021-06-25T04:44:26.124 INFO:teuthology.task.install.deb:Package version is 15.2.13-65-gda5e8184-1focal 2021-06-25T04:44:26.149 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-06-25T04:44:26.149 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-06-25T04:44:26.173 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2021-06-25T04:44:26.188 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-06-25T04:44:26.189 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-06-25T04:44:26.205 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2021-06-25T04:44:26.238 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-06-25T04:44:26.238 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-06-25T04:44:26.246 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-06-25T04:44:26.255 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2021-06-25T04:44:26.299 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal InRelease 2021-06-25T04:44:26.320 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-06-25T04:44:26.344 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal Release.gpg 2021-06-25T04:44:26.356 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-06-25T04:44:26.359 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:44:26.367 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 Packages [15.9 kB] 2021-06-25T04:44:26.394 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-06-25T04:44:26.398 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main i386 Packages [3,074 B] 2021-06-25T04:44:26.410 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal InRelease 2021-06-25T04:44:26.431 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-06-25T04:44:26.439 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-06-25T04:44:26.439 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-06-25T04:44:26.447 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal InRelease 2021-06-25T04:44:26.454 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal Release.gpg 2021-06-25T04:44:26.469 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-06-25T04:44:26.470 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:44:26.475 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main i386 Packages [3,074 B] 2021-06-25T04:44:26.491 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal InRelease 2021-06-25T04:44:26.492 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal Release.gpg 2021-06-25T04:44:26.507 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:44:26.509 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 Packages [15.9 kB] 2021-06-25T04:44:26.512 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-06-25T04:44:26.513 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 Packages [15.9 kB] 2021-06-25T04:44:26.520 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-06-25T04:44:26.535 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal Release.gpg 2021-06-25T04:44:26.547 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main i386 Packages [3,074 B] 2021-06-25T04:44:26.550 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-06-25T04:44:26.552 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-06-25T04:44:26.556 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 Packages [15.9 kB] 2021-06-25T04:44:26.587 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-06-25T04:44:26.590 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main i386 Packages [3,074 B] 2021-06-25T04:44:26.631 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-06-25T04:44:26.632 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-06-25T04:44:26.667 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-06-25T04:44:26.712 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-06-25T04:44:26.928 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 26.6 kB in 1s (40.8 kB/s) 2021-06-25T04:44:27.004 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 26.6 kB in 1s (42.1 kB/s) 2021-06-25T04:44:27.058 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 26.6 kB in 1s (41.2 kB/s) 2021-06-25T04:44:27.083 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 26.6 kB in 1s (42.3 kB/s) 2021-06-25T04:44:27.709 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2021-06-25T04:44:27.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.13-65-gda5e8184-1focal cephadm=15.2.13-65-gda5e8184-1focal ceph-mds=15.2.13-65-gda5e8184-1focal ceph-mgr=15.2.13-65-gda5e8184-1focal ceph-common=15.2.13-65-gda5e8184-1focal ceph-fuse=15.2.13-65-gda5e8184-1focal ceph-test=15.2.13-65-gda5e8184-1focal radosgw=15.2.13-65-gda5e8184-1focal python3-rados=15.2.13-65-gda5e8184-1focal python3-rgw=15.2.13-65-gda5e8184-1focal python3-cephfs=15.2.13-65-gda5e8184-1focal python3-rbd=15.2.13-65-gda5e8184-1focal libcephfs2=15.2.13-65-gda5e8184-1focal libcephfs-dev=15.2.13-65-gda5e8184-1focal librados2=15.2.13-65-gda5e8184-1focal librbd1=15.2.13-65-gda5e8184-1focal rbd-fuse=15.2.13-65-gda5e8184-1focal python3-cephfs=15.2.13-65-gda5e8184-1focal cephfs-shell=15.2.13-65-gda5e8184-1focal 2021-06-25T04:44:27.754 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-06-25T04:44:27.775 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.13-65-gda5e8184-1focal cephadm=15.2.13-65-gda5e8184-1focal ceph-mds=15.2.13-65-gda5e8184-1focal ceph-mgr=15.2.13-65-gda5e8184-1focal ceph-common=15.2.13-65-gda5e8184-1focal ceph-fuse=15.2.13-65-gda5e8184-1focal ceph-test=15.2.13-65-gda5e8184-1focal radosgw=15.2.13-65-gda5e8184-1focal python3-rados=15.2.13-65-gda5e8184-1focal python3-rgw=15.2.13-65-gda5e8184-1focal python3-cephfs=15.2.13-65-gda5e8184-1focal python3-rbd=15.2.13-65-gda5e8184-1focal libcephfs2=15.2.13-65-gda5e8184-1focal libcephfs-dev=15.2.13-65-gda5e8184-1focal librados2=15.2.13-65-gda5e8184-1focal librbd1=15.2.13-65-gda5e8184-1focal rbd-fuse=15.2.13-65-gda5e8184-1focal python3-cephfs=15.2.13-65-gda5e8184-1focal cephfs-shell=15.2.13-65-gda5e8184-1focal 2021-06-25T04:44:27.800 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2021-06-25T04:44:27.818 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-06-25T04:44:27.833 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-06-25T04:44:27.839 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.13-65-gda5e8184-1focal cephadm=15.2.13-65-gda5e8184-1focal ceph-mds=15.2.13-65-gda5e8184-1focal ceph-mgr=15.2.13-65-gda5e8184-1focal ceph-common=15.2.13-65-gda5e8184-1focal ceph-fuse=15.2.13-65-gda5e8184-1focal ceph-test=15.2.13-65-gda5e8184-1focal radosgw=15.2.13-65-gda5e8184-1focal python3-rados=15.2.13-65-gda5e8184-1focal python3-rgw=15.2.13-65-gda5e8184-1focal python3-cephfs=15.2.13-65-gda5e8184-1focal python3-rbd=15.2.13-65-gda5e8184-1focal libcephfs2=15.2.13-65-gda5e8184-1focal libcephfs-dev=15.2.13-65-gda5e8184-1focal librados2=15.2.13-65-gda5e8184-1focal librbd1=15.2.13-65-gda5e8184-1focal rbd-fuse=15.2.13-65-gda5e8184-1focal python3-cephfs=15.2.13-65-gda5e8184-1focal cephfs-shell=15.2.13-65-gda5e8184-1focal 2021-06-25T04:44:27.844 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-06-25T04:44:27.863 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.13-65-gda5e8184-1focal cephadm=15.2.13-65-gda5e8184-1focal ceph-mds=15.2.13-65-gda5e8184-1focal ceph-mgr=15.2.13-65-gda5e8184-1focal ceph-common=15.2.13-65-gda5e8184-1focal ceph-fuse=15.2.13-65-gda5e8184-1focal ceph-test=15.2.13-65-gda5e8184-1focal radosgw=15.2.13-65-gda5e8184-1focal python3-rados=15.2.13-65-gda5e8184-1focal python3-rgw=15.2.13-65-gda5e8184-1focal python3-cephfs=15.2.13-65-gda5e8184-1focal python3-rbd=15.2.13-65-gda5e8184-1focal libcephfs2=15.2.13-65-gda5e8184-1focal libcephfs-dev=15.2.13-65-gda5e8184-1focal librados2=15.2.13-65-gda5e8184-1focal librbd1=15.2.13-65-gda5e8184-1focal rbd-fuse=15.2.13-65-gda5e8184-1focal python3-cephfs=15.2.13-65-gda5e8184-1focal cephfs-shell=15.2.13-65-gda5e8184-1focal 2021-06-25T04:44:27.905 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-06-25T04:44:27.927 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-06-25T04:44:27.965 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2021-06-25T04:44:27.966 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2021-06-25T04:44:28.004 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-06-25T04:44:28.004 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-06-25T04:44:28.063 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2021-06-25T04:44:28.064 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2021-06-25T04:44:28.087 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2021-06-25T04:44:28.088 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2021-06-25T04:44:28.104 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2021-06-25T04:44:28.105 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-06-25T04:44:28.105 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2021-06-25T04:44:28.106 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2021-06-25T04:44:28.106 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-06-25T04:44:28.106 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-06-25T04:44:28.106 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore 2021-06-25T04:44:28.107 INFO:teuthology.orchestra.run.smithi057.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-06-25T04:44:28.109 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 librdkafka1 librgw2 libxslt1.1 nvme-cli 2021-06-25T04:44:28.109 INFO:teuthology.orchestra.run.smithi057.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-06-25T04:44:28.109 INFO:teuthology.orchestra.run.smithi057.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-06-25T04:44:28.109 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2021-06-25T04:44:28.110 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2021-06-25T04:44:28.110 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-06-25T04:44:28.110 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-06-25T04:44:28.110 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-06-25T04:44:28.110 INFO:teuthology.orchestra.run.smithi057.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-06-25T04:44:28.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-06-25T04:44:28.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-06-25T04:44:28.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2021-06-25T04:44:28.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy python3-simplegeneric python3-simplejson 2021-06-25T04:44:28.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-06-25T04:44:28.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-06-25T04:44:28.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-06-25T04:44:28.112 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet 2021-06-25T04:44:28.112 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2021-06-25T04:44:28.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-06-25T04:44:28.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-06-25T04:44:28.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-06-25T04:44:28.113 INFO:teuthology.orchestra.run.smithi057.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-06-25T04:44:28.113 INFO:teuthology.orchestra.run.smithi057.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-06-25T04:44:28.114 INFO:teuthology.orchestra.run.smithi057.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-06-25T04:44:28.114 INFO:teuthology.orchestra.run.smithi057.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-06-25T04:44:28.114 INFO:teuthology.orchestra.run.smithi057.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-06-25T04:44:28.114 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2021-06-25T04:44:28.114 INFO:teuthology.orchestra.run.smithi057.stdout: btrfs-tools 2021-06-25T04:44:28.141 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2021-06-25T04:44:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-06-25T04:44:28.142 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2021-06-25T04:44:28.142 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2021-06-25T04:44:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-06-25T04:44:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-06-25T04:44:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore 2021-06-25T04:44:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-06-25T04:44:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 librdkafka1 librgw2 libxslt1.1 nvme-cli 2021-06-25T04:44:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-06-25T04:44:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-06-25T04:44:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2021-06-25T04:44:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2021-06-25T04:44:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-06-25T04:44:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-06-25T04:44:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-06-25T04:44:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-06-25T04:44:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-06-25T04:44:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-06-25T04:44:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2021-06-25T04:44:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy python3-simplegeneric python3-simplejson 2021-06-25T04:44:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-06-25T04:44:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-06-25T04:44:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-06-25T04:44:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet 2021-06-25T04:44:28.149 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2021-06-25T04:44:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-06-25T04:44:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-06-25T04:44:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-06-25T04:44:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-06-25T04:44:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-06-25T04:44:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-06-25T04:44:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-06-25T04:44:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-06-25T04:44:28.151 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2021-06-25T04:44:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: btrfs-tools 2021-06-25T04:44:28.198 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2021-06-25T04:44:28.199 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-06-25T04:44:28.199 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2021-06-25T04:44:28.200 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2021-06-25T04:44:28.200 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-06-25T04:44:28.200 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-06-25T04:44:28.201 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore 2021-06-25T04:44:28.201 INFO:teuthology.orchestra.run.smithi102.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-06-25T04:44:28.203 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 librdkafka1 librgw2 libxslt1.1 nvme-cli 2021-06-25T04:44:28.204 INFO:teuthology.orchestra.run.smithi102.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-06-25T04:44:28.204 INFO:teuthology.orchestra.run.smithi102.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-06-25T04:44:28.204 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2021-06-25T04:44:28.204 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2021-06-25T04:44:28.205 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-06-25T04:44:28.205 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-06-25T04:44:28.205 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-06-25T04:44:28.205 INFO:teuthology.orchestra.run.smithi102.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-06-25T04:44:28.206 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-06-25T04:44:28.206 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-06-25T04:44:28.206 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2021-06-25T04:44:28.206 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy python3-simplegeneric python3-simplejson 2021-06-25T04:44:28.207 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-06-25T04:44:28.208 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-06-25T04:44:28.208 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-06-25T04:44:28.208 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet 2021-06-25T04:44:28.208 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2021-06-25T04:44:28.209 INFO:teuthology.orchestra.run.smithi102.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-06-25T04:44:28.209 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-06-25T04:44:28.210 INFO:teuthology.orchestra.run.smithi102.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-06-25T04:44:28.210 INFO:teuthology.orchestra.run.smithi102.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-06-25T04:44:28.210 INFO:teuthology.orchestra.run.smithi102.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-06-25T04:44:28.210 INFO:teuthology.orchestra.run.smithi102.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-06-25T04:44:28.212 INFO:teuthology.orchestra.run.smithi102.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-06-25T04:44:28.212 INFO:teuthology.orchestra.run.smithi102.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-06-25T04:44:28.212 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2021-06-25T04:44:28.212 INFO:teuthology.orchestra.run.smithi102.stdout: btrfs-tools 2021-06-25T04:44:28.215 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2021-06-25T04:44:28.215 INFO:teuthology.orchestra.run.smithi057.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-06-25T04:44:28.215 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-06-25T04:44:28.215 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-06-25T04:44:28.216 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-06-25T04:44:28.216 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-06-25T04:44:28.217 INFO:teuthology.orchestra.run.smithi057.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-06-25T04:44:28.217 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-06-25T04:44:28.217 INFO:teuthology.orchestra.run.smithi057.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-06-25T04:44:28.217 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-06-25T04:44:28.217 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-06-25T04:44:28.218 INFO:teuthology.orchestra.run.smithi057.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-06-25T04:44:28.218 INFO:teuthology.orchestra.run.smithi057.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-jwt 2021-06-25T04:44:28.218 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-06-25T04:44:28.218 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-06-25T04:44:28.219 INFO:teuthology.orchestra.run.smithi057.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-06-25T04:44:28.219 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-06-25T04:44:28.219 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-06-25T04:44:28.219 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-06-25T04:44:28.220 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-06-25T04:44:28.220 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-06-25T04:44:28.220 INFO:teuthology.orchestra.run.smithi057.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-06-25T04:44:28.220 INFO:teuthology.orchestra.run.smithi057.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-06-25T04:44:28.220 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-06-25T04:44:28.221 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2021-06-25T04:44:28.221 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 librbd1 2021-06-25T04:44:28.224 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2021-06-25T04:44:28.225 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-06-25T04:44:28.225 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2021-06-25T04:44:28.225 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2021-06-25T04:44:28.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-06-25T04:44:28.226 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-06-25T04:44:28.226 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore 2021-06-25T04:44:28.226 INFO:teuthology.orchestra.run.smithi161.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-06-25T04:44:28.227 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 librdkafka1 librgw2 libxslt1.1 nvme-cli 2021-06-25T04:44:28.227 INFO:teuthology.orchestra.run.smithi161.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-06-25T04:44:28.228 INFO:teuthology.orchestra.run.smithi161.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-06-25T04:44:28.228 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2021-06-25T04:44:28.228 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2021-06-25T04:44:28.228 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-06-25T04:44:28.229 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-06-25T04:44:28.229 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-06-25T04:44:28.229 INFO:teuthology.orchestra.run.smithi161.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-06-25T04:44:28.229 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-06-25T04:44:28.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-06-25T04:44:28.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2021-06-25T04:44:28.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy python3-simplegeneric python3-simplejson 2021-06-25T04:44:28.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-06-25T04:44:28.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-06-25T04:44:28.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-06-25T04:44:28.231 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet 2021-06-25T04:44:28.231 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2021-06-25T04:44:28.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-06-25T04:44:28.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-06-25T04:44:28.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-06-25T04:44:28.232 INFO:teuthology.orchestra.run.smithi161.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-06-25T04:44:28.232 INFO:teuthology.orchestra.run.smithi161.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-06-25T04:44:28.232 INFO:teuthology.orchestra.run.smithi161.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-06-25T04:44:28.233 INFO:teuthology.orchestra.run.smithi161.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-06-25T04:44:28.233 INFO:teuthology.orchestra.run.smithi161.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-06-25T04:44:28.233 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2021-06-25T04:44:28.233 INFO:teuthology.orchestra.run.smithi161.stdout: btrfs-tools 2021-06-25T04:44:28.242 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2021-06-25T04:44:28.242 INFO:teuthology.orchestra.run.smithi087.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-06-25T04:44:28.242 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-06-25T04:44:28.242 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-06-25T04:44:28.243 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-06-25T04:44:28.243 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-06-25T04:44:28.243 INFO:teuthology.orchestra.run.smithi087.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-06-25T04:44:28.244 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-06-25T04:44:28.244 INFO:teuthology.orchestra.run.smithi087.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-06-25T04:44:28.245 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-06-25T04:44:28.245 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-06-25T04:44:28.245 INFO:teuthology.orchestra.run.smithi087.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-06-25T04:44:28.245 INFO:teuthology.orchestra.run.smithi087.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-jwt 2021-06-25T04:44:28.245 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-06-25T04:44:28.246 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-06-25T04:44:28.246 INFO:teuthology.orchestra.run.smithi087.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-06-25T04:44:28.246 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-06-25T04:44:28.246 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-06-25T04:44:28.247 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-06-25T04:44:28.247 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-06-25T04:44:28.247 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-06-25T04:44:28.247 INFO:teuthology.orchestra.run.smithi087.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-06-25T04:44:28.247 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-06-25T04:44:28.248 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-06-25T04:44:28.248 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2021-06-25T04:44:28.248 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 librbd1 2021-06-25T04:44:28.292 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2021-06-25T04:44:28.293 INFO:teuthology.orchestra.run.smithi102.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-06-25T04:44:28.293 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-06-25T04:44:28.293 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-06-25T04:44:28.293 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-06-25T04:44:28.294 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-06-25T04:44:28.294 INFO:teuthology.orchestra.run.smithi102.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-06-25T04:44:28.296 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-06-25T04:44:28.296 INFO:teuthology.orchestra.run.smithi102.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-06-25T04:44:28.296 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-06-25T04:44:28.296 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-06-25T04:44:28.297 INFO:teuthology.orchestra.run.smithi102.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-06-25T04:44:28.297 INFO:teuthology.orchestra.run.smithi102.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-jwt 2021-06-25T04:44:28.297 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-06-25T04:44:28.297 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-06-25T04:44:28.297 INFO:teuthology.orchestra.run.smithi102.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-06-25T04:44:28.298 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-06-25T04:44:28.298 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-06-25T04:44:28.298 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-06-25T04:44:28.298 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-06-25T04:44:28.298 INFO:teuthology.orchestra.run.smithi102.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-06-25T04:44:28.299 INFO:teuthology.orchestra.run.smithi102.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-06-25T04:44:28.299 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-06-25T04:44:28.299 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-06-25T04:44:28.299 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2021-06-25T04:44:28.300 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 librbd1 2021-06-25T04:44:28.324 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2021-06-25T04:44:28.325 INFO:teuthology.orchestra.run.smithi161.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-06-25T04:44:28.325 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-06-25T04:44:28.325 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-06-25T04:44:28.325 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-06-25T04:44:28.325 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-06-25T04:44:28.326 INFO:teuthology.orchestra.run.smithi161.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-06-25T04:44:28.327 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-06-25T04:44:28.327 INFO:teuthology.orchestra.run.smithi161.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-06-25T04:44:28.327 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-06-25T04:44:28.327 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-06-25T04:44:28.328 INFO:teuthology.orchestra.run.smithi161.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-06-25T04:44:28.328 INFO:teuthology.orchestra.run.smithi161.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-jwt 2021-06-25T04:44:28.328 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-06-25T04:44:28.328 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-06-25T04:44:28.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-06-25T04:44:28.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-06-25T04:44:28.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-06-25T04:44:28.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-06-25T04:44:28.329 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-06-25T04:44:28.330 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-06-25T04:44:28.330 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-06-25T04:44:28.330 INFO:teuthology.orchestra.run.smithi161.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-06-25T04:44:28.330 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-06-25T04:44:28.331 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2021-06-25T04:44:28.331 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 librbd1 2021-06-25T04:44:28.356 INFO:teuthology.orchestra.run.smithi057.stdout:2 upgraded, 104 newly installed, 0 to remove and 136 not upgraded. 2021-06-25T04:44:28.357 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 153 MB of archives. 2021-06-25T04:44:28.358 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 698 MB of additional disk space will be used. 2021-06-25T04:44:28.358 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.13-65-gda5e8184-1focal [1,701 kB] 2021-06-25T04:44:28.389 INFO:teuthology.orchestra.run.smithi087.stdout:2 upgraded, 104 newly installed, 0 to remove and 136 not upgraded. 2021-06-25T04:44:28.390 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 153 MB of archives. 2021-06-25T04:44:28.391 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 698 MB of additional disk space will be used. 2021-06-25T04:44:28.391 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.13-65-gda5e8184-1focal [1,701 kB] 2021-06-25T04:44:28.397 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-06-25T04:44:28.431 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-06-25T04:44:28.438 INFO:teuthology.orchestra.run.smithi102.stdout:2 upgraded, 104 newly installed, 0 to remove and 136 not upgraded. 2021-06-25T04:44:28.439 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 153 MB of archives. 2021-06-25T04:44:28.439 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 698 MB of additional disk space will be used. 2021-06-25T04:44:28.439 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.13-65-gda5e8184-1focal [1,701 kB] 2021-06-25T04:44:28.479 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-06-25T04:44:28.481 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-06-25T04:44:28.484 INFO:teuthology.orchestra.run.smithi161.stdout:2 upgraded, 104 newly installed, 0 to remove and 136 not upgraded. 2021-06-25T04:44:28.484 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 153 MB of archives. 2021-06-25T04:44:28.484 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 698 MB of additional disk space will be used. 2021-06-25T04:44:28.484 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.13-65-gda5e8184-1focal [1,701 kB] 2021-06-25T04:44:28.486 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-06-25T04:44:28.512 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-06-25T04:44:28.514 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-06-25T04:44:28.520 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.13-65-gda5e8184-1focal [3,244 kB] 2021-06-25T04:44:28.538 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-06-25T04:44:28.563 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-06-25T04:44:28.577 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-06-25T04:44:28.584 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.13-65-gda5e8184-1focal [3,244 kB] 2021-06-25T04:44:28.591 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-06-25T04:44:28.641 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-06-25T04:44:28.675 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-06-25T04:44:28.705 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-06-25T04:44:28.707 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-06-25T04:44:28.732 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.13-65-gda5e8184-1focal [463 kB] 2021-06-25T04:44:28.743 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-06-25T04:44:28.750 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-06-25T04:44:28.753 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-06-25T04:44:28.777 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-06-25T04:44:28.778 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-06-25T04:44:28.779 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.13-65-gda5e8184-1focal [365 kB] 2021-06-25T04:44:28.789 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-06-25T04:44:28.791 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.13-65-gda5e8184-1focal [20.8 kB] 2021-06-25T04:44:28.792 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.13-65-gda5e8184-1focal [156 kB] 2021-06-25T04:44:28.797 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.13-65-gda5e8184-1focal [29.0 kB] 2021-06-25T04:44:28.799 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.13-65-gda5e8184-1focal [364 kB] 2021-06-25T04:44:28.806 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-06-25T04:44:28.824 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.13-65-gda5e8184-1focal [463 kB] 2021-06-25T04:44:28.835 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-06-25T04:44:28.844 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-06-25T04:44:28.845 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.13-65-gda5e8184-1focal [3,140 kB] 2021-06-25T04:44:28.858 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-06-25T04:44:28.868 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-06-25T04:44:28.875 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.13-65-gda5e8184-1focal [365 kB] 2021-06-25T04:44:28.888 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.13-65-gda5e8184-1focal [20.8 kB] 2021-06-25T04:44:28.889 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.13-65-gda5e8184-1focal [156 kB] 2021-06-25T04:44:28.889 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-06-25T04:44:28.894 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.13-65-gda5e8184-1focal [29.0 kB] 2021-06-25T04:44:28.895 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-06-25T04:44:28.895 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.13-65-gda5e8184-1focal [364 kB] 2021-06-25T04:44:28.898 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-06-25T04:44:28.918 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-06-25T04:44:28.922 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-06-25T04:44:28.924 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-06-25T04:44:28.925 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-06-25T04:44:28.930 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-06-25T04:44:28.941 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-06-25T04:44:28.942 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-06-25T04:44:28.942 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-06-25T04:44:28.944 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-06-25T04:44:28.945 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.13-65-gda5e8184-1focal [3,140 kB] 2021-06-25T04:44:28.946 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-06-25T04:44:28.953 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-06-25T04:44:28.958 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-06-25T04:44:28.958 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-06-25T04:44:28.959 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-06-25T04:44:28.960 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-06-25T04:44:28.974 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-06-25T04:44:28.975 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-06-25T04:44:28.977 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-06-25T04:44:28.981 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-06-25T04:44:28.984 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-06-25T04:44:28.986 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-06-25T04:44:28.989 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-06-25T04:44:28.989 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-06-25T04:44:29.008 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-06-25T04:44:29.012 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-06-25T04:44:29.016 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-06-25T04:44:29.019 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-06-25T04:44:29.022 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-06-25T04:44:29.023 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-06-25T04:44:29.030 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-06-25T04:44:29.033 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-06-25T04:44:29.034 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-06-25T04:44:29.061 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-06-25T04:44:29.062 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.13-65-gda5e8184-1focal [116 kB] 2021-06-25T04:44:29.065 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.13-65-gda5e8184-1focal [361 kB] 2021-06-25T04:44:29.066 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-06-25T04:44:29.069 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-06-25T04:44:29.070 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-06-25T04:44:29.074 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-06-25T04:44:29.076 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.13-65-gda5e8184-1focal [20.0 MB] 2021-06-25T04:44:29.077 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-06-25T04:44:29.078 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-06-25T04:44:29.078 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-06-25T04:44:29.080 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-06-25T04:44:29.081 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-06-25T04:44:29.086 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-06-25T04:44:29.090 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-06-25T04:44:29.096 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-06-25T04:44:29.100 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-06-25T04:44:29.102 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-06-25T04:44:29.103 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-06-25T04:44:29.106 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-06-25T04:44:29.110 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-06-25T04:44:29.110 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-06-25T04:44:29.115 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-06-25T04:44:29.120 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-06-25T04:44:29.122 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-06-25T04:44:29.130 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-06-25T04:44:29.136 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-06-25T04:44:29.137 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-06-25T04:44:29.137 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-06-25T04:44:29.146 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-06-25T04:44:29.147 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-06-25T04:44:29.148 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-06-25T04:44:29.157 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-06-25T04:44:29.160 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-06-25T04:44:29.161 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-06-25T04:44:29.164 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-06-25T04:44:29.168 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-06-25T04:44:29.169 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-06-25T04:44:29.179 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-06-25T04:44:29.179 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.13-65-gda5e8184-1focal [116 kB] 2021-06-25T04:44:29.180 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-06-25T04:44:29.181 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-06-25T04:44:29.182 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.13-65-gda5e8184-1focal [361 kB] 2021-06-25T04:44:29.183 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-06-25T04:44:29.186 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-06-25T04:44:29.187 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-06-25T04:44:29.187 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-06-25T04:44:29.195 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.13-65-gda5e8184-1focal [20.0 MB] 2021-06-25T04:44:29.226 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-06-25T04:44:29.231 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-06-25T04:44:29.234 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-06-25T04:44:29.235 INFO:teuthology.orchestra.run.smithi057.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-06-25T04:44:29.237 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-06-25T04:44:29.237 INFO:teuthology.orchestra.run.smithi057.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-06-25T04:44:29.238 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-06-25T04:44:29.239 INFO:teuthology.orchestra.run.smithi057.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-06-25T04:44:29.239 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-06-25T04:44:29.240 INFO:teuthology.orchestra.run.smithi057.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-06-25T04:44:29.258 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-06-25T04:44:29.262 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-06-25T04:44:29.264 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-06-25T04:44:29.265 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-06-25T04:44:29.266 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-06-25T04:44:29.267 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-06-25T04:44:29.267 INFO:teuthology.orchestra.run.smithi087.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-06-25T04:44:29.270 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-06-25T04:44:29.270 INFO:teuthology.orchestra.run.smithi087.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-06-25T04:44:29.273 INFO:teuthology.orchestra.run.smithi087.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-06-25T04:44:29.273 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-06-25T04:44:29.274 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-06-25T04:44:29.274 INFO:teuthology.orchestra.run.smithi087.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-06-25T04:44:29.282 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.13-65-gda5e8184-1focal [3,244 kB] 2021-06-25T04:44:29.292 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-06-25T04:44:29.305 INFO:teuthology.orchestra.run.smithi057.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-06-25T04:44:29.306 INFO:teuthology.orchestra.run.smithi057.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-06-25T04:44:29.317 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-06-25T04:44:29.325 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-06-25T04:44:29.325 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-06-25T04:44:29.326 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-06-25T04:44:29.329 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-06-25T04:44:29.330 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-06-25T04:44:29.330 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-06-25T04:44:29.338 INFO:teuthology.orchestra.run.smithi087.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-06-25T04:44:29.339 INFO:teuthology.orchestra.run.smithi087.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-06-25T04:44:29.342 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-06-25T04:44:29.343 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-06-25T04:44:29.344 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-06-25T04:44:29.396 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-06-25T04:44:29.397 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-06-25T04:44:29.422 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-06-25T04:44:29.427 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-06-25T04:44:29.430 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-06-25T04:44:29.430 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-06-25T04:44:29.433 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-06-25T04:44:29.435 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-06-25T04:44:29.436 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-06-25T04:44:29.502 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-06-25T04:44:29.503 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-06-25T04:44:29.619 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.13-65-gda5e8184-1focal [3,244 kB] 2021-06-25T04:44:29.629 INFO:teuthology.orchestra.run.smithi057.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-06-25T04:44:29.667 INFO:teuthology.orchestra.run.smithi087.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-06-25T04:44:29.677 INFO:teuthology.orchestra.run.smithi057.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-06-25T04:44:29.678 INFO:teuthology.orchestra.run.smithi057.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-06-25T04:44:29.702 INFO:teuthology.orchestra.run.smithi087.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-06-25T04:44:29.723 INFO:teuthology.orchestra.run.smithi057.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-06-25T04:44:29.723 INFO:teuthology.orchestra.run.smithi057.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-06-25T04:44:29.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-06-25T04:44:29.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-06-25T04:44:29.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-06-25T04:44:29.725 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-06-25T04:44:29.741 INFO:teuthology.orchestra.run.smithi087.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-06-25T04:44:29.743 INFO:teuthology.orchestra.run.smithi057.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-06-25T04:44:29.743 INFO:teuthology.orchestra.run.smithi057.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-06-25T04:44:29.763 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-06-25T04:44:29.765 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-06-25T04:44:29.774 INFO:teuthology.orchestra.run.smithi087.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-06-25T04:44:29.775 INFO:teuthology.orchestra.run.smithi087.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-06-25T04:44:29.775 INFO:teuthology.orchestra.run.smithi087.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-06-25T04:44:29.776 INFO:teuthology.orchestra.run.smithi087.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-06-25T04:44:29.776 INFO:teuthology.orchestra.run.smithi087.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-06-25T04:44:29.778 INFO:teuthology.orchestra.run.smithi087.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-06-25T04:44:29.778 INFO:teuthology.orchestra.run.smithi087.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-06-25T04:44:29.791 INFO:teuthology.orchestra.run.smithi057.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-06-25T04:44:29.791 INFO:teuthology.orchestra.run.smithi057.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-06-25T04:44:29.828 INFO:teuthology.orchestra.run.smithi087.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-06-25T04:44:29.828 INFO:teuthology.orchestra.run.smithi087.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-06-25T04:44:29.835 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-06-25T04:44:29.836 INFO:teuthology.orchestra.run.smithi102.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-06-25T04:44:29.836 INFO:teuthology.orchestra.run.smithi102.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-06-25T04:44:29.837 INFO:teuthology.orchestra.run.smithi102.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-06-25T04:44:29.837 INFO:teuthology.orchestra.run.smithi102.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-06-25T04:44:29.838 INFO:teuthology.orchestra.run.smithi102.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-06-25T04:44:29.839 INFO:teuthology.orchestra.run.smithi102.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-06-25T04:44:29.871 INFO:teuthology.orchestra.run.smithi057.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-06-25T04:44:29.876 INFO:teuthology.orchestra.run.smithi057.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-06-25T04:44:29.877 INFO:teuthology.orchestra.run.smithi057.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-06-25T04:44:29.878 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-06-25T04:44:29.879 INFO:teuthology.orchestra.run.smithi057.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-06-25T04:44:29.881 INFO:teuthology.orchestra.run.smithi057.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-06-25T04:44:29.882 INFO:teuthology.orchestra.run.smithi057.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-06-25T04:44:29.883 INFO:teuthology.orchestra.run.smithi057.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-06-25T04:44:29.885 INFO:teuthology.orchestra.run.smithi057.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-06-25T04:44:29.887 INFO:teuthology.orchestra.run.smithi102.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-06-25T04:44:29.887 INFO:teuthology.orchestra.run.smithi102.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-06-25T04:44:29.900 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-06-25T04:44:29.901 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-06-25T04:44:29.907 INFO:teuthology.orchestra.run.smithi087.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-06-25T04:44:29.913 INFO:teuthology.orchestra.run.smithi087.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-06-25T04:44:29.914 INFO:teuthology.orchestra.run.smithi087.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-06-25T04:44:29.914 INFO:teuthology.orchestra.run.smithi087.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-06-25T04:44:29.918 INFO:teuthology.orchestra.run.smithi087.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-06-25T04:44:29.921 INFO:teuthology.orchestra.run.smithi087.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-06-25T04:44:29.922 INFO:teuthology.orchestra.run.smithi087.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-06-25T04:44:29.925 INFO:teuthology.orchestra.run.smithi087.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-06-25T04:44:29.951 INFO:teuthology.orchestra.run.smithi057.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-06-25T04:44:29.955 INFO:teuthology.orchestra.run.smithi057.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-06-25T04:44:29.966 INFO:teuthology.orchestra.run.smithi102.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-06-25T04:44:29.972 INFO:teuthology.orchestra.run.smithi102.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-06-25T04:44:29.973 INFO:teuthology.orchestra.run.smithi102.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-06-25T04:44:29.973 INFO:teuthology.orchestra.run.smithi102.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-06-25T04:44:29.977 INFO:teuthology.orchestra.run.smithi102.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-06-25T04:44:29.980 INFO:teuthology.orchestra.run.smithi102.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-06-25T04:44:29.981 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-06-25T04:44:29.981 INFO:teuthology.orchestra.run.smithi161.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-06-25T04:44:29.982 INFO:teuthology.orchestra.run.smithi102.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-06-25T04:44:29.982 INFO:teuthology.orchestra.run.smithi161.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-06-25T04:44:29.983 INFO:teuthology.orchestra.run.smithi161.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-06-25T04:44:29.984 INFO:teuthology.orchestra.run.smithi102.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-06-25T04:44:29.985 INFO:teuthology.orchestra.run.smithi161.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-06-25T04:44:29.985 INFO:teuthology.orchestra.run.smithi161.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-06-25T04:44:29.985 INFO:teuthology.orchestra.run.smithi161.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-06-25T04:44:29.987 INFO:teuthology.orchestra.run.smithi087.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-06-25T04:44:29.992 INFO:teuthology.orchestra.run.smithi087.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-06-25T04:44:30.031 INFO:teuthology.orchestra.run.smithi057.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-06-25T04:44:30.039 INFO:teuthology.orchestra.run.smithi057.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-06-25T04:44:30.039 INFO:teuthology.orchestra.run.smithi057.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-06-25T04:44:30.040 INFO:teuthology.orchestra.run.smithi161.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-06-25T04:44:30.040 INFO:teuthology.orchestra.run.smithi057.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-06-25T04:44:30.041 INFO:teuthology.orchestra.run.smithi161.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-06-25T04:44:30.041 INFO:teuthology.orchestra.run.smithi057.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-06-25T04:44:30.042 INFO:teuthology.orchestra.run.smithi057.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-06-25T04:44:30.047 INFO:teuthology.orchestra.run.smithi102.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-06-25T04:44:30.051 INFO:teuthology.orchestra.run.smithi102.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-06-25T04:44:30.055 INFO:teuthology.orchestra.run.smithi057.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-06-25T04:44:30.055 INFO:teuthology.orchestra.run.smithi057.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-06-25T04:44:30.067 INFO:teuthology.orchestra.run.smithi087.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-06-25T04:44:30.069 INFO:teuthology.orchestra.run.smithi087.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-06-25T04:44:30.070 INFO:teuthology.orchestra.run.smithi087.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-06-25T04:44:30.070 INFO:teuthology.orchestra.run.smithi087.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-06-25T04:44:30.071 INFO:teuthology.orchestra.run.smithi087.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-06-25T04:44:30.072 INFO:teuthology.orchestra.run.smithi087.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-06-25T04:44:30.088 INFO:teuthology.orchestra.run.smithi087.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-06-25T04:44:30.088 INFO:teuthology.orchestra.run.smithi087.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-06-25T04:44:30.110 INFO:teuthology.orchestra.run.smithi057.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-06-25T04:44:30.111 INFO:teuthology.orchestra.run.smithi057.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-06-25T04:44:30.120 INFO:teuthology.orchestra.run.smithi161.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-06-25T04:44:30.126 INFO:teuthology.orchestra.run.smithi161.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-06-25T04:44:30.126 INFO:teuthology.orchestra.run.smithi161.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-06-25T04:44:30.127 INFO:teuthology.orchestra.run.smithi102.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-06-25T04:44:30.127 INFO:teuthology.orchestra.run.smithi161.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-06-25T04:44:30.129 INFO:teuthology.orchestra.run.smithi161.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-06-25T04:44:30.133 INFO:teuthology.orchestra.run.smithi161.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-06-25T04:44:30.133 INFO:teuthology.orchestra.run.smithi102.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-06-25T04:44:30.134 INFO:teuthology.orchestra.run.smithi102.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-06-25T04:44:30.135 INFO:teuthology.orchestra.run.smithi161.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-06-25T04:44:30.135 INFO:teuthology.orchestra.run.smithi102.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-06-25T04:44:30.137 INFO:teuthology.orchestra.run.smithi161.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-06-25T04:44:30.137 INFO:teuthology.orchestra.run.smithi102.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-06-25T04:44:30.138 INFO:teuthology.orchestra.run.smithi102.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-06-25T04:44:30.146 INFO:teuthology.orchestra.run.smithi087.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-06-25T04:44:30.147 INFO:teuthology.orchestra.run.smithi087.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-06-25T04:44:30.152 INFO:teuthology.orchestra.run.smithi102.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-06-25T04:44:30.152 INFO:teuthology.orchestra.run.smithi102.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-06-25T04:44:30.191 INFO:teuthology.orchestra.run.smithi057.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-06-25T04:44:30.192 INFO:teuthology.orchestra.run.smithi057.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-06-25T04:44:30.193 INFO:teuthology.orchestra.run.smithi057.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-06-25T04:44:30.196 INFO:teuthology.orchestra.run.smithi057.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-06-25T04:44:30.199 INFO:teuthology.orchestra.run.smithi161.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-06-25T04:44:30.203 INFO:teuthology.orchestra.run.smithi161.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-06-25T04:44:30.206 INFO:teuthology.orchestra.run.smithi102.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-06-25T04:44:30.207 INFO:teuthology.orchestra.run.smithi102.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-06-25T04:44:30.226 INFO:teuthology.orchestra.run.smithi087.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-06-25T04:44:30.227 INFO:teuthology.orchestra.run.smithi087.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-06-25T04:44:30.228 INFO:teuthology.orchestra.run.smithi087.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-06-25T04:44:30.232 INFO:teuthology.orchestra.run.smithi087.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-06-25T04:44:30.280 INFO:teuthology.orchestra.run.smithi161.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-06-25T04:44:30.287 INFO:teuthology.orchestra.run.smithi161.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-06-25T04:44:30.287 INFO:teuthology.orchestra.run.smithi161.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-06-25T04:44:30.288 INFO:teuthology.orchestra.run.smithi161.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-06-25T04:44:30.289 INFO:teuthology.orchestra.run.smithi161.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-06-25T04:44:30.290 INFO:teuthology.orchestra.run.smithi102.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-06-25T04:44:30.290 INFO:teuthology.orchestra.run.smithi161.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-06-25T04:44:30.291 INFO:teuthology.orchestra.run.smithi102.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-06-25T04:44:30.292 INFO:teuthology.orchestra.run.smithi102.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-06-25T04:44:30.296 INFO:teuthology.orchestra.run.smithi102.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-06-25T04:44:30.305 INFO:teuthology.orchestra.run.smithi161.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-06-25T04:44:30.305 INFO:teuthology.orchestra.run.smithi161.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-06-25T04:44:30.359 INFO:teuthology.orchestra.run.smithi161.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-06-25T04:44:30.360 INFO:teuthology.orchestra.run.smithi161.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-06-25T04:44:30.439 INFO:teuthology.orchestra.run.smithi161.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-06-25T04:44:30.440 INFO:teuthology.orchestra.run.smithi161.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-06-25T04:44:30.441 INFO:teuthology.orchestra.run.smithi161.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-06-25T04:44:30.444 INFO:teuthology.orchestra.run.smithi161.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-06-25T04:44:30.486 INFO:teuthology.orchestra.run.smithi087.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.13-65-gda5e8184-1focal [5,302 kB] 2021-06-25T04:44:30.719 INFO:teuthology.orchestra.run.smithi102.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.13-65-gda5e8184-1focal [463 kB] 2021-06-25T04:44:30.738 INFO:teuthology.orchestra.run.smithi087.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.13-65-gda5e8184-1focal [162 kB] 2021-06-25T04:44:30.742 INFO:teuthology.orchestra.run.smithi087.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.13-65-gda5e8184-1focal [1,400 kB] 2021-06-25T04:44:30.830 INFO:teuthology.orchestra.run.smithi087.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.13-65-gda5e8184-1focal [6,170 kB] 2021-06-25T04:44:30.915 INFO:teuthology.orchestra.run.smithi102.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.13-65-gda5e8184-1focal [365 kB] 2021-06-25T04:44:31.051 INFO:teuthology.orchestra.run.smithi102.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.13-65-gda5e8184-1focal [20.8 kB] 2021-06-25T04:44:31.052 INFO:teuthology.orchestra.run.smithi102.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.13-65-gda5e8184-1focal [156 kB] 2021-06-25T04:44:31.116 INFO:teuthology.orchestra.run.smithi102.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.13-65-gda5e8184-1focal [29.0 kB] 2021-06-25T04:44:31.117 INFO:teuthology.orchestra.run.smithi102.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.13-65-gda5e8184-1focal [364 kB] 2021-06-25T04:44:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.13-65-gda5e8184-1focal [5,302 kB] 2021-06-25T04:44:31.168 INFO:teuthology.orchestra.run.smithi087.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.13-65-gda5e8184-1focal [23.8 MB] 2021-06-25T04:44:31.255 INFO:teuthology.orchestra.run.smithi102.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.13-65-gda5e8184-1focal [3,140 kB] 2021-06-25T04:44:31.587 INFO:teuthology.orchestra.run.smithi057.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.13-65-gda5e8184-1focal [162 kB] 2021-06-25T04:44:31.592 INFO:teuthology.orchestra.run.smithi057.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.13-65-gda5e8184-1focal [1,400 kB] 2021-06-25T04:44:31.742 INFO:teuthology.orchestra.run.smithi057.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.13-65-gda5e8184-1focal [6,170 kB] 2021-06-25T04:44:32.093 INFO:teuthology.orchestra.run.smithi161.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.13-65-gda5e8184-1focal [463 kB] 2021-06-25T04:44:32.418 INFO:teuthology.orchestra.run.smithi057.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.13-65-gda5e8184-1focal [23.8 MB] 2021-06-25T04:44:32.440 INFO:teuthology.orchestra.run.smithi161.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.13-65-gda5e8184-1focal [365 kB] 2021-06-25T04:44:32.586 INFO:teuthology.orchestra.run.smithi102.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.13-65-gda5e8184-1focal [116 kB] 2021-06-25T04:44:32.614 INFO:teuthology.orchestra.run.smithi102.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.13-65-gda5e8184-1focal [361 kB] 2021-06-25T04:44:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.13-65-gda5e8184-1focal [3,988 B] 2021-06-25T04:44:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.13-65-gda5e8184-1focal [538 kB] 2021-06-25T04:44:32.667 INFO:teuthology.orchestra.run.smithi087.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.13-65-gda5e8184-1focal [2,006 kB] 2021-06-25T04:44:32.674 INFO:teuthology.orchestra.run.smithi161.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.13-65-gda5e8184-1focal [20.8 kB] 2021-06-25T04:44:32.694 INFO:teuthology.orchestra.run.smithi161.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.13-65-gda5e8184-1focal [156 kB] 2021-06-25T04:44:32.710 INFO:teuthology.orchestra.run.smithi087.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.13-65-gda5e8184-1focal [52.9 kB] 2021-06-25T04:44:32.712 INFO:teuthology.orchestra.run.smithi087.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.13-65-gda5e8184-1focal [58.1 kB] 2021-06-25T04:44:32.714 INFO:teuthology.orchestra.run.smithi087.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.13-65-gda5e8184-1focal [3,199 kB] 2021-06-25T04:44:32.755 INFO:teuthology.orchestra.run.smithi102.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.13-65-gda5e8184-1focal [20.0 MB] 2021-06-25T04:44:32.823 INFO:teuthology.orchestra.run.smithi161.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.13-65-gda5e8184-1focal [29.0 kB] 2021-06-25T04:44:32.825 INFO:teuthology.orchestra.run.smithi161.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.13-65-gda5e8184-1focal [364 kB] 2021-06-25T04:44:32.883 INFO:teuthology.orchestra.run.smithi087.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.13-65-gda5e8184-1focal [34.4 kB] 2021-06-25T04:44:32.884 INFO:teuthology.orchestra.run.smithi087.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.13-65-gda5e8184-1focal [7,876 kB] 2021-06-25T04:44:33.125 INFO:teuthology.orchestra.run.smithi161.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.13-65-gda5e8184-1focal [3,140 kB] 2021-06-25T04:44:33.342 INFO:teuthology.orchestra.run.smithi087.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.13-65-gda5e8184-1focal [4,104 B] 2021-06-25T04:44:33.342 INFO:teuthology.orchestra.run.smithi087.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 15.2.13-65-gda5e8184-1focal [22.5 kB] 2021-06-25T04:44:33.343 INFO:teuthology.orchestra.run.smithi087.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.13-65-gda5e8184-1focal [39.9 MB] 2021-06-25T04:44:35.133 INFO:teuthology.orchestra.run.smithi057.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.13-65-gda5e8184-1focal [3,988 B] 2021-06-25T04:44:35.134 INFO:teuthology.orchestra.run.smithi057.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.13-65-gda5e8184-1focal [538 kB] 2021-06-25T04:44:35.151 INFO:teuthology.orchestra.run.smithi057.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.13-65-gda5e8184-1focal [2,006 kB] 2021-06-25T04:44:35.369 INFO:teuthology.orchestra.run.smithi161.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.13-65-gda5e8184-1focal [116 kB] 2021-06-25T04:44:35.425 INFO:teuthology.orchestra.run.smithi057.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.13-65-gda5e8184-1focal [52.9 kB] 2021-06-25T04:44:35.442 INFO:teuthology.orchestra.run.smithi057.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.13-65-gda5e8184-1focal [58.1 kB] 2021-06-25T04:44:35.444 INFO:teuthology.orchestra.run.smithi057.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.13-65-gda5e8184-1focal [3,199 kB] 2021-06-25T04:44:35.483 INFO:teuthology.orchestra.run.smithi161.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.13-65-gda5e8184-1focal [361 kB] 2021-06-25T04:44:35.714 INFO:teuthology.orchestra.run.smithi161.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.13-65-gda5e8184-1focal [20.0 MB] 2021-06-25T04:44:35.786 INFO:teuthology.orchestra.run.smithi057.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.13-65-gda5e8184-1focal [34.4 kB] 2021-06-25T04:44:35.789 INFO:teuthology.orchestra.run.smithi057.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.13-65-gda5e8184-1focal [7,876 kB] 2021-06-25T04:44:35.790 INFO:teuthology.orchestra.run.smithi087.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.13-65-gda5e8184-1focal [15.8 kB] 2021-06-25T04:44:35.790 INFO:teuthology.orchestra.run.smithi087.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.13-65-gda5e8184-1focal [18.1 kB] 2021-06-25T04:44:35.791 INFO:teuthology.orchestra.run.smithi087.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.13-65-gda5e8184-1focal [9,723 kB] 2021-06-25T04:44:36.118 INFO:teuthology.orchestra.run.smithi087.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.13-65-gda5e8184-1focal [61.0 kB] 2021-06-25T04:44:36.370 INFO:teuthology.orchestra.run.smithi057.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.13-65-gda5e8184-1focal [4,104 B] 2021-06-25T04:44:36.371 INFO:teuthology.orchestra.run.smithi057.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 15.2.13-65-gda5e8184-1focal [22.5 kB] 2021-06-25T04:44:36.371 INFO:teuthology.orchestra.run.smithi057.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.13-65-gda5e8184-1focal [39.9 MB] 2021-06-25T04:44:36.680 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 153 MB in 8s (19.4 MB/s) 2021-06-25T04:44:36.830 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyperclip. 2021-06-25T04:44:36.883 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138106 files and directories currently installed.) 2021-06-25T04:44:36.887 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-06-25T04:44:36.928 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-06-25T04:44:37.265 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-wcwidth. 2021-06-25T04:44:37.280 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-06-25T04:44:37.323 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-06-25T04:44:37.609 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cmd2. 2021-06-25T04:44:37.627 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-06-25T04:44:37.667 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-06-25T04:44:37.887 INFO:teuthology.orchestra.run.smithi102.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.13-65-gda5e8184-1focal [5,302 kB] 2021-06-25T04:44:38.029 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-06-25T04:44:38.044 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-06-25T04:44:38.128 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-06-25T04:44:38.472 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../004-librbd1_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:38.563 INFO:teuthology.orchestra.run.smithi102.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.13-65-gda5e8184-1focal [162 kB] 2021-06-25T04:44:38.574 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librbd1 (15.2.13-65-gda5e8184-1focal) over (15.2.12-0ubuntu0.20.04.1) ... 2021-06-25T04:44:38.591 INFO:teuthology.orchestra.run.smithi102.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.13-65-gda5e8184-1focal [1,400 kB] 2021-06-25T04:44:38.618 INFO:teuthology.orchestra.run.smithi057.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.13-65-gda5e8184-1focal [15.8 kB] 2021-06-25T04:44:38.618 INFO:teuthology.orchestra.run.smithi057.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.13-65-gda5e8184-1focal [18.1 kB] 2021-06-25T04:44:38.619 INFO:teuthology.orchestra.run.smithi057.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.13-65-gda5e8184-1focal [9,723 kB] 2021-06-25T04:44:38.763 INFO:teuthology.orchestra.run.smithi102.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.13-65-gda5e8184-1focal [6,170 kB] 2021-06-25T04:44:38.937 INFO:teuthology.orchestra.run.smithi057.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.13-65-gda5e8184-1focal [61.0 kB] 2021-06-25T04:44:39.063 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../005-librados2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:39.169 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librados2 (15.2.13-65-gda5e8184-1focal) over (15.2.12-0ubuntu0.20.04.1) ... 2021-06-25T04:44:39.311 INFO:teuthology.orchestra.run.smithi102.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.13-65-gda5e8184-1focal [23.8 MB] 2021-06-25T04:44:39.529 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 153 MB in 11s (14.3 MB/s) 2021-06-25T04:44:39.640 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyperclip. 2021-06-25T04:44:39.695 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138106 files and directories currently installed.) 2021-06-25T04:44:39.699 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-06-25T04:44:39.738 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-06-25T04:44:39.831 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs2. 2021-06-25T04:44:39.850 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../006-libcephfs2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:39.891 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:39.941 INFO:teuthology.orchestra.run.smithi161.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.13-65-gda5e8184-1focal [5,302 kB] 2021-06-25T04:44:40.016 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-wcwidth. 2021-06-25T04:44:40.034 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-06-25T04:44:40.091 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-06-25T04:44:40.184 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rados. 2021-06-25T04:44:40.202 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../007-python3-rados_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:40.233 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rados (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:40.401 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cmd2. 2021-06-25T04:44:40.422 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-06-25T04:44:40.451 INFO:teuthology.orchestra.run.smithi161.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.13-65-gda5e8184-1focal [162 kB] 2021-06-25T04:44:40.459 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-06-25T04:44:40.469 INFO:teuthology.orchestra.run.smithi161.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.13-65-gda5e8184-1focal [1,400 kB] 2021-06-25T04:44:40.536 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-06-25T04:44:40.552 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:44:40.594 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-argparse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:40.595 INFO:teuthology.orchestra.run.smithi161.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.13-65-gda5e8184-1focal [6,170 kB] 2021-06-25T04:44:40.863 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-06-25T04:44:40.879 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-06-25T04:44:40.921 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cephfs. 2021-06-25T04:44:40.937 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../009-python3-cephfs_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:40.963 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-06-25T04:44:40.988 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cephfs (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:41.021 INFO:teuthology.orchestra.run.smithi102.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.13-65-gda5e8184-1focal [3,988 B] 2021-06-25T04:44:41.022 INFO:teuthology.orchestra.run.smithi102.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.13-65-gda5e8184-1focal [538 kB] 2021-06-25T04:44:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.13-65-gda5e8184-1focal [2,006 kB] 2021-06-25T04:44:41.143 INFO:teuthology.orchestra.run.smithi161.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.13-65-gda5e8184-1focal [23.8 MB] 2021-06-25T04:44:41.144 INFO:teuthology.orchestra.run.smithi102.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.13-65-gda5e8184-1focal [52.9 kB] 2021-06-25T04:44:41.146 INFO:teuthology.orchestra.run.smithi102.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.13-65-gda5e8184-1focal [58.1 kB] 2021-06-25T04:44:41.147 INFO:teuthology.orchestra.run.smithi102.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.13-65-gda5e8184-1focal [3,199 kB] 2021-06-25T04:44:41.299 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-common. 2021-06-25T04:44:41.307 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../004-librbd1_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:41.318 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:44:41.333 INFO:teuthology.orchestra.run.smithi102.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.13-65-gda5e8184-1focal [34.4 kB] 2021-06-25T04:44:41.333 INFO:teuthology.orchestra.run.smithi102.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.13-65-gda5e8184-1focal [7,876 kB] 2021-06-25T04:44:41.357 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:41.425 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librbd1 (15.2.13-65-gda5e8184-1focal) over (15.2.12-0ubuntu0.20.04.1) ... 2021-06-25T04:44:41.668 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-prettytable. 2021-06-25T04:44:41.684 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-06-25T04:44:41.718 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-06-25T04:44:41.794 INFO:teuthology.orchestra.run.smithi102.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.13-65-gda5e8184-1focal [4,104 B] 2021-06-25T04:44:41.794 INFO:teuthology.orchestra.run.smithi102.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 15.2.13-65-gda5e8184-1focal [22.5 kB] 2021-06-25T04:44:41.795 INFO:teuthology.orchestra.run.smithi102.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.13-65-gda5e8184-1focal [39.9 MB] 2021-06-25T04:44:41.912 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rbd. 2021-06-25T04:44:41.930 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../012-python3-rbd_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:41.938 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../005-librados2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:41.970 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rbd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:42.095 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librados2 (15.2.13-65-gda5e8184-1focal) over (15.2.12-0ubuntu0.20.04.1) ... 2021-06-25T04:44:42.290 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-06-25T04:44:42.308 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-06-25T04:44:42.340 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-06-25T04:44:42.718 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-06-25T04:44:42.738 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-06-25T04:44:42.742 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs2. 2021-06-25T04:44:42.762 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../006-libcephfs2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:42.776 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-06-25T04:44:42.817 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:43.103 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librgw2. 2021-06-25T04:44:43.111 INFO:teuthology.orchestra.run.smithi161.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.13-65-gda5e8184-1focal [3,988 B] 2021-06-25T04:44:43.112 INFO:teuthology.orchestra.run.smithi161.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.13-65-gda5e8184-1focal [538 kB] 2021-06-25T04:44:43.122 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../015-librgw2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:43.123 INFO:teuthology.orchestra.run.smithi161.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.13-65-gda5e8184-1focal [2,006 kB] 2021-06-25T04:44:43.128 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rados. 2021-06-25T04:44:43.148 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../007-python3-rados_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:43.161 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librgw2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:43.186 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rados (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:43.266 INFO:teuthology.orchestra.run.smithi161.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.13-65-gda5e8184-1focal [52.9 kB] 2021-06-25T04:44:43.267 INFO:teuthology.orchestra.run.smithi161.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.13-65-gda5e8184-1focal [58.1 kB] 2021-06-25T04:44:43.269 INFO:teuthology.orchestra.run.smithi161.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.13-65-gda5e8184-1focal [3,199 kB] 2021-06-25T04:44:43.521 INFO:teuthology.orchestra.run.smithi161.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.13-65-gda5e8184-1focal [34.4 kB] 2021-06-25T04:44:43.522 INFO:teuthology.orchestra.run.smithi161.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.13-65-gda5e8184-1focal [7,876 kB] 2021-06-25T04:44:43.539 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-06-25T04:44:43.558 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:44:43.622 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-argparse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:43.697 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rgw. 2021-06-25T04:44:43.715 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../016-python3-rgw_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:43.747 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:43.958 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cephfs. 2021-06-25T04:44:43.974 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../009-python3-cephfs_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:44.016 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cephfs (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:44.050 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-06-25T04:44:44.070 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-06-25T04:44:44.107 INFO:teuthology.orchestra.run.smithi161.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.13-65-gda5e8184-1focal [4,104 B] 2021-06-25T04:44:44.107 INFO:teuthology.orchestra.run.smithi161.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 15.2.13-65-gda5e8184-1focal [22.5 kB] 2021-06-25T04:44:44.108 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-06-25T04:44:44.109 INFO:teuthology.orchestra.run.smithi161.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.13-65-gda5e8184-1focal [39.9 MB] 2021-06-25T04:44:44.215 INFO:teuthology.orchestra.run.smithi102.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.13-65-gda5e8184-1focal [15.8 kB] 2021-06-25T04:44:44.216 INFO:teuthology.orchestra.run.smithi102.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.13-65-gda5e8184-1focal [18.1 kB] 2021-06-25T04:44:44.216 INFO:teuthology.orchestra.run.smithi102.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.13-65-gda5e8184-1focal [9,723 kB] 2021-06-25T04:44:44.319 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-common. 2021-06-25T04:44:44.338 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:44:44.385 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:44.444 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liboath0. 2021-06-25T04:44:44.463 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-06-25T04:44:44.502 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-06-25T04:44:44.646 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-prettytable. 2021-06-25T04:44:44.663 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-06-25T04:44:44.696 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-06-25T04:44:44.706 INFO:teuthology.orchestra.run.smithi102.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.13-65-gda5e8184-1focal [61.0 kB] 2021-06-25T04:44:44.855 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libradosstriper1. 2021-06-25T04:44:44.872 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../019-libradosstriper1_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:44.913 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libradosstriper1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:44.974 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rbd. 2021-06-25T04:44:44.991 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../012-python3-rbd_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:45.032 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rbd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:45.293 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 153 MB in 16s (9,310 kB/s) 2021-06-25T04:44:45.308 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-common. 2021-06-25T04:44:45.324 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../020-ceph-common_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:45.358 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:45.437 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyperclip. 2021-06-25T04:44:45.451 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-06-25T04:44:45.468 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-06-25T04:44:45.491 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138106 files and directories currently installed.) 2021-06-25T04:44:45.496 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-06-25T04:44:45.510 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-06-25T04:44:45.535 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-06-25T04:44:45.829 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-06-25T04:44:45.846 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-wcwidth. 2021-06-25T04:44:45.847 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-06-25T04:44:45.865 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-06-25T04:44:45.896 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-06-25T04:44:45.905 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-06-25T04:44:46.182 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cmd2. 2021-06-25T04:44:46.201 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-06-25T04:44:46.232 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librgw2. 2021-06-25T04:44:46.233 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-06-25T04:44:46.248 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../015-librgw2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:46.290 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librgw2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:46.510 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-06-25T04:44:46.526 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-06-25T04:44:46.562 INFO:teuthology.orchestra.run.smithi161.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.13-65-gda5e8184-1focal [15.8 kB] 2021-06-25T04:44:46.563 INFO:teuthology.orchestra.run.smithi161.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.13-65-gda5e8184-1focal [18.1 kB] 2021-06-25T04:44:46.563 INFO:teuthology.orchestra.run.smithi161.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.13-65-gda5e8184-1focal [9,723 kB] 2021-06-25T04:44:46.610 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-06-25T04:44:46.901 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rgw. 2021-06-25T04:44:46.919 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../016-python3-rgw_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:46.959 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:47.027 INFO:teuthology.orchestra.run.smithi161.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2021-06-15-0839-octopus/da5e8184007182fa3cd5c8385fee4e08c5620fe2/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.13-65-gda5e8184-1focal [61.0 kB] 2021-06-25T04:44:47.027 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../004-librbd1_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:47.115 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librbd1 (15.2.13-65-gda5e8184-1focal) over (15.2.12-0ubuntu0.20.04.1) ... 2021-06-25T04:44:47.287 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-06-25T04:44:47.304 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-06-25T04:44:47.337 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-06-25T04:44:47.413 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-base. 2021-06-25T04:44:47.430 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../021-ceph-base_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:47.481 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-base (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:47.565 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 153 MB in 19s (8,191 kB/s) 2021-06-25T04:44:47.621 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../005-librados2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:47.672 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liboath0. 2021-06-25T04:44:47.673 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyperclip. 2021-06-25T04:44:47.691 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-06-25T04:44:47.718 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librados2 (15.2.13-65-gda5e8184-1focal) over (15.2.12-0ubuntu0.20.04.1) ... 2021-06-25T04:44:47.722 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-06-25T04:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138106 files and directories currently installed.) 2021-06-25T04:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-06-25T04:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-06-25T04:44:48.050 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libradosstriper1. 2021-06-25T04:44:48.067 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../019-libradosstriper1_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:48.091 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-wcwidth. 2021-06-25T04:44:48.111 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-06-25T04:44:48.130 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libradosstriper1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:48.149 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-06-25T04:44:48.389 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs2. 2021-06-25T04:44:48.392 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cryptography. 2021-06-25T04:44:48.404 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../006-libcephfs2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:48.410 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-06-25T04:44:48.447 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:48.450 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-06-25T04:44:48.460 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cmd2. 2021-06-25T04:44:48.479 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-06-25T04:44:48.527 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-06-25T04:44:48.661 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-common. 2021-06-25T04:44:48.680 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../020-ceph-common_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:48.724 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:48.750 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rados. 2021-06-25T04:44:48.769 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../007-python3-rados_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:48.796 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-06-25T04:44:48.808 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rados (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:48.813 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-06-25T04:44:48.846 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-openssl. 2021-06-25T04:44:48.861 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-06-25T04:44:48.880 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-06-25T04:44:48.903 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-06-25T04:44:49.177 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-06-25T04:44:49.193 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../004-librbd1_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:49.196 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:44:49.223 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-06-25T04:44:49.235 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-argparse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:49.240 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:44:49.281 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-modules-core (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:49.308 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librbd1 (15.2.13-65-gda5e8184-1focal) over (15.2.12-0ubuntu0.20.04.1) ... 2021-06-25T04:44:49.513 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cephfs. 2021-06-25T04:44:49.530 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../009-python3-cephfs_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:49.563 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cephfs (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:49.660 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bcrypt. 2021-06-25T04:44:49.676 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-06-25T04:44:49.718 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-06-25T04:44:49.866 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-common. 2021-06-25T04:44:49.882 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:44:49.886 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../005-librados2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:49.924 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:50.021 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cherrypy3. 2021-06-25T04:44:50.036 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-06-25T04:44:50.079 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-06-25T04:44:50.162 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librados2 (15.2.13-65-gda5e8184-1focal) over (15.2.12-0ubuntu0.20.04.1) ... 2021-06-25T04:44:50.261 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-prettytable. 2021-06-25T04:44:50.279 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-06-25T04:44:50.319 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-06-25T04:44:50.441 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jwt. 2021-06-25T04:44:50.457 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-06-25T04:44:50.499 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-06-25T04:44:50.613 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rbd. 2021-06-25T04:44:50.628 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../012-python3-rbd_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:50.671 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rbd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:50.766 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs2. 2021-06-25T04:44:50.784 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../006-libcephfs2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:50.793 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-logutils. 2021-06-25T04:44:50.813 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-06-25T04:44:50.815 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:50.853 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-06-25T04:44:50.975 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-base. 2021-06-25T04:44:50.991 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-06-25T04:44:50.991 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../021-ceph-base_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:51.009 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-06-25T04:44:51.043 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-base (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:51.066 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-06-25T04:44:51.112 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-markupsafe. 2021-06-25T04:44:51.130 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-06-25T04:44:51.143 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rados. 2021-06-25T04:44:51.158 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../007-python3-rados_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:51.162 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-06-25T04:44:51.201 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rados (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:51.394 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-06-25T04:44:51.411 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-06-25T04:44:51.441 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-mako. 2021-06-25T04:44:51.452 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-06-25T04:44:51.456 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-06-25T04:44:51.532 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-06-25T04:44:51.554 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-06-25T04:44:51.572 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:44:51.637 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-argparse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:51.827 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplegeneric. 2021-06-25T04:44:51.838 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librgw2. 2021-06-25T04:44:51.846 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-06-25T04:44:51.855 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../015-librgw2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:51.884 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-06-25T04:44:51.897 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librgw2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:51.915 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cephfs. 2021-06-25T04:44:51.930 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../009-python3-cephfs_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:51.962 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cryptography. 2021-06-25T04:44:51.964 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cephfs (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:51.981 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-06-25T04:44:52.045 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-06-25T04:44:52.179 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-singledispatch. 2021-06-25T04:44:52.196 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-06-25T04:44:52.226 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-common. 2021-06-25T04:44:52.237 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-06-25T04:44:52.241 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:44:52.309 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:52.416 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rgw. 2021-06-25T04:44:52.433 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../016-python3-rgw_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:52.457 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-openssl. 2021-06-25T04:44:52.473 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-06-25T04:44:52.474 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:52.525 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webob. 2021-06-25T04:44:52.540 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-06-25T04:44:52.543 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-06-25T04:44:52.583 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-06-25T04:44:52.604 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-prettytable. 2021-06-25T04:44:52.623 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-06-25T04:44:52.662 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-06-25T04:44:52.777 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-06-25T04:44:52.796 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-06-25T04:44:52.810 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-06-25T04:44:52.829 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:44:52.835 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-06-25T04:44:52.868 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-modules-core (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:52.886 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-soupsieve. 2021-06-25T04:44:52.898 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rbd. 2021-06-25T04:44:52.901 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-06-25T04:44:52.915 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../012-python3-rbd_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:52.936 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-06-25T04:44:52.981 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rbd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:53.189 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bs4. 2021-06-25T04:44:53.207 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-06-25T04:44:53.239 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-06-25T04:44:53.288 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bcrypt. 2021-06-25T04:44:53.307 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-06-25T04:44:53.347 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-06-25T04:44:53.350 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-06-25T04:44:53.369 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-06-25T04:44:53.409 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-06-25T04:44:53.471 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liboath0. 2021-06-25T04:44:53.487 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-06-25T04:44:53.529 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-06-25T04:44:53.575 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-waitress. 2021-06-25T04:44:53.591 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-06-25T04:44:53.636 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-06-25T04:44:53.700 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cherrypy3. 2021-06-25T04:44:53.703 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-06-25T04:44:53.716 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-06-25T04:44:53.720 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-06-25T04:44:53.761 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-06-25T04:44:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-06-25T04:44:53.882 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libradosstriper1. 2021-06-25T04:44:53.898 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../019-libradosstriper1_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:53.932 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libradosstriper1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:53.978 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempita. 2021-06-25T04:44:53.995 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-06-25T04:44:54.053 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-06-25T04:44:54.106 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librgw2. 2021-06-25T04:44:54.121 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../015-librgw2_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:54.164 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librgw2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:54.186 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jwt. 2021-06-25T04:44:54.203 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-06-25T04:44:54.244 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-06-25T04:44:54.285 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-common. 2021-06-25T04:44:54.304 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../020-ceph-common_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:54.339 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-paste. 2021-06-25T04:44:54.358 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-06-25T04:44:54.359 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:54.397 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-06-25T04:44:54.614 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-logutils. 2021-06-25T04:44:54.630 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-06-25T04:44:54.672 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-06-25T04:44:54.708 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rgw. 2021-06-25T04:44:54.724 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../016-python3-rgw_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:54.759 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-06-25T04:44:54.768 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:54.775 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-06-25T04:44:54.817 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-06-25T04:44:55.069 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-06-25T04:44:55.085 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-06-25T04:44:55.120 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastedeploy. 2021-06-25T04:44:55.127 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-06-25T04:44:55.136 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-06-25T04:44:55.178 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-06-25T04:44:55.208 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-markupsafe. 2021-06-25T04:44:55.224 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-06-25T04:44:55.258 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-06-25T04:44:55.455 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liboath0. 2021-06-25T04:44:55.471 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-06-25T04:44:55.513 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-06-25T04:44:55.514 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webtest. 2021-06-25T04:44:55.531 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-06-25T04:44:55.560 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-mako. 2021-06-25T04:44:55.572 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-06-25T04:44:55.577 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-06-25T04:44:55.652 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-06-25T04:44:55.849 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libradosstriper1. 2021-06-25T04:44:55.864 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../019-libradosstriper1_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:55.907 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libradosstriper1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:55.951 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pecan. 2021-06-25T04:44:55.967 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-06-25T04:44:56.005 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplegeneric. 2021-06-25T04:44:56.025 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-06-25T04:44:56.053 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-06-25T04:44:56.063 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-06-25T04:44:56.333 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-singledispatch. 2021-06-25T04:44:56.351 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-06-25T04:44:56.377 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-common. 2021-06-25T04:44:56.393 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../020-ceph-common_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:56.416 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-06-25T04:44:56.427 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:56.491 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-base. 2021-06-25T04:44:56.507 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../021-ceph-base_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:56.585 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-base (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:56.752 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webob. 2021-06-25T04:44:56.768 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-06-25T04:44:56.783 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-werkzeug. 2021-06-25T04:44:56.797 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-06-25T04:44:56.810 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-06-25T04:44:56.839 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-06-25T04:44:57.205 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-soupsieve. 2021-06-25T04:44:57.221 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-06-25T04:44:57.251 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr. 2021-06-25T04:44:57.263 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-06-25T04:44:57.268 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../044-ceph-mgr_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:57.309 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:57.504 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cryptography. 2021-06-25T04:44:57.520 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-06-25T04:44:57.562 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-06-25T04:44:57.599 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bs4. 2021-06-25T04:44:57.616 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-06-25T04:44:57.682 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-06-25T04:44:57.771 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mon. 2021-06-25T04:44:57.787 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../045-ceph-mon_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:57.837 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mon (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:57.908 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-openssl. 2021-06-25T04:44:57.927 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-06-25T04:44:57.957 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-06-25T04:44:58.052 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-waitress. 2021-06-25T04:44:58.069 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-06-25T04:44:58.105 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-06-25T04:44:58.244 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-06-25T04:44:58.260 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:44:58.302 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-modules-core (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:58.480 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempita. 2021-06-25T04:44:58.497 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-06-25T04:44:58.538 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-06-25T04:44:58.824 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-paste. 2021-06-25T04:44:58.842 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-06-25T04:44:58.874 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-06-25T04:44:58.874 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-osd. 2021-06-25T04:44:58.891 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../046-ceph-osd_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:58.924 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-osd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:58.941 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-base. 2021-06-25T04:44:58.958 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../021-ceph-base_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:44:59.009 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-base (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:44:59.261 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-06-25T04:44:59.276 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-06-25T04:44:59.335 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-06-25T04:44:59.365 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bcrypt. 2021-06-25T04:44:59.382 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-06-25T04:44:59.414 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-06-25T04:44:59.705 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastedeploy. 2021-06-25T04:44:59.717 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cherrypy3. 2021-06-25T04:44:59.723 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-06-25T04:44:59.734 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-06-25T04:44:59.763 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-06-25T04:44:59.775 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-06-25T04:44:59.895 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cryptography. 2021-06-25T04:44:59.915 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-06-25T04:44:59.953 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-06-25T04:45:00.162 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jwt. 2021-06-25T04:45:00.179 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-06-25T04:45:00.221 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-06-25T04:45:00.316 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-openssl. 2021-06-25T04:45:00.332 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-06-25T04:45:00.407 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-06-25T04:45:00.566 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-logutils. 2021-06-25T04:45:00.583 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-06-25T04:45:00.624 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-06-25T04:45:00.679 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-06-25T04:45:00.692 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:00.734 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-modules-core (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:00.875 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webtest. 2021-06-25T04:45:00.892 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-06-25T04:45:00.933 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-06-25T04:45:00.943 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-markupsafe. 2021-06-25T04:45:00.961 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-06-25T04:45:01.001 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-06-25T04:45:01.048 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bcrypt. 2021-06-25T04:45:01.067 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-06-25T04:45:01.105 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-06-25T04:45:01.296 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph. 2021-06-25T04:45:01.304 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-mako. 2021-06-25T04:45:01.315 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../047-ceph_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:01.324 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-06-25T04:45:01.327 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pecan. 2021-06-25T04:45:01.344 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-06-25T04:45:01.354 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:01.363 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-06-25T04:45:01.383 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cherrypy3. 2021-06-25T04:45:01.385 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-06-25T04:45:01.398 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-06-25T04:45:01.457 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-06-25T04:45:01.725 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplegeneric. 2021-06-25T04:45:01.741 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-06-25T04:45:01.748 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-werkzeug. 2021-06-25T04:45:01.764 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-06-25T04:45:01.783 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-06-25T04:45:01.828 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jwt. 2021-06-25T04:45:01.844 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-06-25T04:45:01.848 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-06-25T04:45:01.877 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-06-25T04:45:02.111 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-singledispatch. 2021-06-25T04:45:02.127 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-06-25T04:45:02.169 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-06-25T04:45:02.174 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-fuse. 2021-06-25T04:45:02.176 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr. 2021-06-25T04:45:02.189 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-logutils. 2021-06-25T04:45:02.192 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../044-ceph-mgr_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:02.194 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../048-ceph-fuse_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:02.205 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-06-25T04:45:02.235 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:02.247 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-06-25T04:45:02.274 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:02.472 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webob. 2021-06-25T04:45:02.491 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-06-25T04:45:02.531 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-06-25T04:45:02.583 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-markupsafe. 2021-06-25T04:45:02.600 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-06-25T04:45:02.633 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-06-25T04:45:02.685 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mds. 2021-06-25T04:45:02.701 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../049-ceph-mds_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:02.744 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mds (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:02.754 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mon. 2021-06-25T04:45:02.771 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../045-ceph-mon_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:02.837 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mon (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:02.901 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-soupsieve. 2021-06-25T04:45:02.903 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-mako. 2021-06-25T04:45:02.918 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-06-25T04:45:02.919 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-06-25T04:45:02.953 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-06-25T04:45:02.958 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-06-25T04:45:03.256 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplegeneric. 2021-06-25T04:45:03.275 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-06-25T04:45:03.288 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephadm. 2021-06-25T04:45:03.304 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../050-cephadm_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:03.314 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-06-25T04:45:03.346 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:03.362 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bs4. 2021-06-25T04:45:03.378 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-06-25T04:45:03.420 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-06-25T04:45:03.625 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-singledispatch. 2021-06-25T04:45:03.641 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-06-25T04:45:03.683 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-06-25T04:45:03.691 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jinja2. 2021-06-25T04:45:03.708 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-06-25T04:45:03.758 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-06-25T04:45:03.815 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-waitress. 2021-06-25T04:45:03.833 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-06-25T04:45:03.876 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-06-25T04:45:03.933 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-osd. 2021-06-25T04:45:03.948 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../046-ceph-osd_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:03.982 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-osd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:04.019 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webob. 2021-06-25T04:45:04.036 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-06-25T04:45:04.069 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-06-25T04:45:04.094 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-06-25T04:45:04.111 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:04.152 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:04.226 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempita. 2021-06-25T04:45:04.243 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-06-25T04:45:04.284 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-06-25T04:45:04.372 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-soupsieve. 2021-06-25T04:45:04.389 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-06-25T04:45:04.447 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-06-25T04:45:04.522 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-repoze.lru. 2021-06-25T04:45:04.542 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-06-25T04:45:04.580 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-06-25T04:45:04.588 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-paste. 2021-06-25T04:45:04.603 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-06-25T04:45:04.646 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-06-25T04:45:04.708 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bs4. 2021-06-25T04:45:04.727 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-06-25T04:45:04.758 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-06-25T04:45:04.879 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjs-underscore. 2021-06-25T04:45:04.898 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-06-25T04:45:04.941 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-06-25T04:45:04.983 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-06-25T04:45:04.998 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-06-25T04:45:05.041 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-06-25T04:45:05.163 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-waitress. 2021-06-25T04:45:05.180 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-06-25T04:45:05.219 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-06-25T04:45:05.224 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-06-25T04:45:05.235 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-06-25T04:45:05.277 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-06-25T04:45:05.368 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastedeploy. 2021-06-25T04:45:05.386 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-06-25T04:45:05.427 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-06-25T04:45:05.558 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempita. 2021-06-25T04:45:05.574 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-06-25T04:45:05.616 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-06-25T04:45:05.622 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-routes. 2021-06-25T04:45:05.639 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-06-25T04:45:05.680 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-06-25T04:45:05.730 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webtest. 2021-06-25T04:45:05.746 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-06-25T04:45:05.788 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-06-25T04:45:05.894 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-paste. 2021-06-25T04:45:05.914 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-06-25T04:45:05.943 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-06-25T04:45:06.016 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-06-25T04:45:06.032 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:06.075 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-dashboard (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:06.150 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pecan. 2021-06-25T04:45:06.166 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-06-25T04:45:06.207 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-06-25T04:45:06.264 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-06-25T04:45:06.280 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-06-25T04:45:06.322 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-06-25T04:45:06.412 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph. 2021-06-25T04:45:06.430 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../047-ceph_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:06.470 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:06.604 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-werkzeug. 2021-06-25T04:45:06.619 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-06-25T04:45:06.662 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-06-25T04:45:06.666 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastedeploy. 2021-06-25T04:45:06.686 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-06-25T04:45:06.724 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-06-25T04:45:06.819 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-fuse. 2021-06-25T04:45:06.838 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../048-ceph-fuse_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:06.889 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:07.027 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webtest. 2021-06-25T04:45:07.041 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-06-25T04:45:07.044 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-06-25T04:45:07.057 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:07.066 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr. 2021-06-25T04:45:07.083 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../044-ceph-mgr_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:07.098 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:07.119 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-06-25T04:45:07.132 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:07.259 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mds. 2021-06-25T04:45:07.276 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../049-ceph-mds_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:07.342 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mds (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:07.430 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pecan. 2021-06-25T04:45:07.450 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-06-25T04:45:07.488 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-06-25T04:45:07.502 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-decorator. 2021-06-25T04:45:07.519 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-06-25T04:45:07.560 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-06-25T04:45:07.619 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mon. 2021-06-25T04:45:07.637 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../045-ceph-mon_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:07.677 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mon (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:07.847 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-06-25T04:45:07.851 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-werkzeug. 2021-06-25T04:45:07.866 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-06-25T04:45:07.868 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-06-25T04:45:07.904 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephadm. 2021-06-25T04:45:07.904 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-06-25T04:45:07.909 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-06-25T04:45:07.922 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../050-cephadm_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:07.962 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:08.271 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr. 2021-06-25T04:45:08.274 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-scipy. 2021-06-25T04:45:08.288 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../044-ceph-mgr_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:08.291 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-06-25T04:45:08.314 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jinja2. 2021-06-25T04:45:08.329 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:08.331 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-06-25T04:45:08.332 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-06-25T04:45:08.415 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-06-25T04:45:08.706 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-osd. 2021-06-25T04:45:08.723 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../046-ceph-osd_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:08.764 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-osd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:08.776 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-06-25T04:45:08.792 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:08.799 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mon. 2021-06-25T04:45:08.816 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../045-ceph-mon_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:08.834 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:08.857 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mon (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:09.204 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-repoze.lru. 2021-06-25T04:45:09.220 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-06-25T04:45:09.262 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-06-25T04:45:09.539 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-underscore. 2021-06-25T04:45:09.555 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-06-25T04:45:09.593 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-06-25T04:45:09.597 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-06-25T04:45:09.610 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-06-25T04:45:09.650 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:09.917 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-06-25T04:45:09.919 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-osd. 2021-06-25T04:45:09.933 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-06-25T04:45:09.936 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../046-ceph-osd_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:09.975 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-06-25T04:45:09.977 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-osd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:10.254 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-joblib. 2021-06-25T04:45:10.271 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-06-25T04:45:10.312 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-06-25T04:45:10.353 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-routes. 2021-06-25T04:45:10.369 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-06-25T04:45:10.419 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-06-25T04:45:10.691 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn. 2021-06-25T04:45:10.707 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-06-25T04:45:10.749 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:10.814 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-06-25T04:45:10.834 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:10.872 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-dashboard (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:11.102 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph. 2021-06-25T04:45:11.118 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../047-ceph_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:11.160 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:11.483 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-06-25T04:45:11.488 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-fuse. 2021-06-25T04:45:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:11.506 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../048-ceph-fuse_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:11.541 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:11.546 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:11.983 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mds. 2021-06-25T04:45:11.996 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-06-25T04:45:11.999 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../049-ceph-mds_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:12.015 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:12.041 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mds (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:12.054 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:12.349 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph. 2021-06-25T04:45:12.366 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../047-ceph_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:12.398 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-decorator. 2021-06-25T04:45:12.407 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:12.415 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-06-25T04:45:12.490 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-06-25T04:45:12.503 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephadm. 2021-06-25T04:45:12.519 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../050-cephadm_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:12.553 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:12.603 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cachetools. 2021-06-25T04:45:12.622 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-06-25T04:45:12.660 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-06-25T04:45:12.751 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-fuse. 2021-06-25T04:45:12.768 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../048-ceph-fuse_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:12.809 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:12.810 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-06-25T04:45:12.826 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-06-25T04:45:12.868 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-06-25T04:45:12.881 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jinja2. 2021-06-25T04:45:12.900 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-06-25T04:45:12.939 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-06-25T04:45:12.988 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1. 2021-06-25T04:45:13.006 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-06-25T04:45:13.046 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-06-25T04:45:13.262 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-scipy. 2021-06-25T04:45:13.263 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mds. 2021-06-25T04:45:13.278 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../049-ceph-mds_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:13.282 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-06-25T04:45:13.292 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-06-25T04:45:13.307 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:13.320 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-06-25T04:45:13.321 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mds (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:13.350 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:13.358 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-06-25T04:45:13.377 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-06-25T04:45:13.416 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-06-25T04:45:13.703 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-repoze.lru. 2021-06-25T04:45:13.719 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-06-25T04:45:13.753 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rsa. 2021-06-25T04:45:13.761 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-06-25T04:45:13.769 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-06-25T04:45:13.802 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rsa (4.0-3) ... 2021-06-25T04:45:13.841 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephadm. 2021-06-25T04:45:13.859 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../050-cephadm_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:13.899 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:14.023 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjs-underscore. 2021-06-25T04:45:14.041 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-06-25T04:45:14.064 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-google-auth. 2021-06-25T04:45:14.080 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-06-25T04:45:14.093 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-06-25T04:45:14.114 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-06-25T04:45:14.325 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-06-25T04:45:14.341 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-06-25T04:45:14.375 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-06-25T04:45:14.400 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-blinker. 2021-06-25T04:45:14.416 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-06-25T04:45:14.458 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-06-25T04:45:14.635 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jinja2. 2021-06-25T04:45:14.652 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-06-25T04:45:14.663 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-06-25T04:45:14.678 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-routes. 2021-06-25T04:45:14.683 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-06-25T04:45:14.693 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-06-25T04:45:14.694 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-06-25T04:45:14.721 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:14.736 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-06-25T04:45:14.762 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-oauthlib. 2021-06-25T04:45:14.779 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-06-25T04:45:14.820 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-06-25T04:45:15.013 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-06-25T04:45:15.029 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:15.073 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-06-25T04:45:15.079 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:15.088 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:15.131 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-dashboard (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:15.167 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-06-25T04:45:15.184 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-06-25T04:45:15.236 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-06-25T04:45:15.325 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-joblib. 2021-06-25T04:45:15.345 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-06-25T04:45:15.383 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-06-25T04:45:15.416 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-repoze.lru. 2021-06-25T04:45:15.435 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-06-25T04:45:15.474 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-06-25T04:45:15.575 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-websocket. 2021-06-25T04:45:15.591 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-06-25T04:45:15.633 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-06-25T04:45:15.727 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjs-underscore. 2021-06-25T04:45:15.746 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-06-25T04:45:15.753 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn. 2021-06-25T04:45:15.774 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-06-25T04:45:15.784 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-06-25T04:45:15.828 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:15.945 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-kubernetes. 2021-06-25T04:45:15.961 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-06-25T04:45:16.011 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-06-25T04:45:16.112 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-06-25T04:45:16.128 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-06-25T04:45:16.155 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-06-25T04:45:16.172 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:16.178 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-06-25T04:45:16.213 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:16.490 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-routes. 2021-06-25T04:45:16.506 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-06-25T04:45:16.548 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-06-25T04:45:16.560 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-decorator. 2021-06-25T04:45:16.575 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-06-25T04:45:16.576 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-06-25T04:45:16.592 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:16.594 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-06-25T04:45:16.615 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:16.618 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-06-25T04:45:16.632 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-k8sevents (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:16.652 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:16.918 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-06-25T04:45:16.934 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:16.971 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-06-25T04:45:16.976 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-dashboard (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:16.985 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-json-pointer. 2021-06-25T04:45:16.987 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-06-25T04:45:17.005 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../077-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-06-25T04:45:17.029 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-06-25T04:45:17.044 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-06-25T04:45:17.341 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-scipy. 2021-06-25T04:45:17.355 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jsonpatch. 2021-06-25T04:45:17.356 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-06-25T04:45:17.374 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../078-python3-jsonpatch_1.23-3_all.deb ... 2021-06-25T04:45:17.399 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-06-25T04:45:17.413 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-06-25T04:45:17.750 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-06-25T04:45:17.767 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../079-ceph-mgr-rook_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:17.808 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-rook (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:17.814 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cachetools. 2021-06-25T04:45:17.834 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-06-25T04:45:17.905 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-06-25T04:45:18.000 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-06-25T04:45:18.017 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:18.058 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:18.178 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libonig5:amd64. 2021-06-25T04:45:18.195 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../080-libonig5_6.9.4-1_amd64.deb ... 2021-06-25T04:45:18.236 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-06-25T04:45:18.250 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1. 2021-06-25T04:45:18.267 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-06-25T04:45:18.308 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-06-25T04:45:18.369 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-decorator. 2021-06-25T04:45:18.385 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-06-25T04:45:18.427 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-06-25T04:45:18.624 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjq1:amd64. 2021-06-25T04:45:18.642 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../081-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-06-25T04:45:18.673 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:45:18.694 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-06-25T04:45:18.712 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-06-25T04:45:18.754 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-06-25T04:45:18.764 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-06-25T04:45:18.780 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-06-25T04:45:18.801 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-06-25T04:45:18.821 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-06-25T04:45:18.822 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-06-25T04:45:18.867 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:18.935 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package jq. 2021-06-25T04:45:18.952 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../082-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-06-25T04:45:18.992 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:45:19.080 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rsa. 2021-06-25T04:45:19.096 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-06-25T04:45:19.124 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-scipy. 2021-06-25T04:45:19.143 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-06-25T04:45:19.163 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rsa (4.0-3) ... 2021-06-25T04:45:19.183 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-06-25T04:45:19.254 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package socat. 2021-06-25T04:45:19.273 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../083-socat_1.7.3.3-2_amd64.deb ... 2021-06-25T04:45:19.312 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking socat (1.7.3.3-2) ... 2021-06-25T04:45:19.429 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-joblib. 2021-06-25T04:45:19.449 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-06-25T04:45:19.488 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-06-25T04:45:19.534 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-google-auth. 2021-06-25T04:45:19.551 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-06-25T04:45:19.592 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-06-25T04:45:19.699 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-06-25T04:45:19.718 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../084-libxslt1.1_1.1.34-4_amd64.deb ... 2021-06-25T04:45:19.757 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-06-25T04:45:19.941 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn. 2021-06-25T04:45:19.959 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-06-25T04:45:19.973 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-blinker. 2021-06-25T04:45:19.989 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-06-25T04:45:19.999 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:20.001 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package xmlstarlet. 2021-06-25T04:45:20.019 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-06-25T04:45:20.034 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-06-25T04:45:20.077 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-06-25T04:45:20.355 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-oauthlib. 2021-06-25T04:45:20.374 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-06-25T04:45:20.423 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-test. 2021-06-25T04:45:20.429 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-06-25T04:45:20.439 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../086-ceph-test_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:20.480 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-test (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:20.526 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-06-25T04:45:20.544 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-06-25T04:45:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:20.641 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-06-25T04:45:20.661 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:20.725 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:20.783 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-06-25T04:45:20.802 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-06-25T04:45:20.841 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-06-25T04:45:21.121 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-joblib. 2021-06-25T04:45:21.139 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-06-25T04:45:21.179 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-06-25T04:45:21.210 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-websocket. 2021-06-25T04:45:21.228 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-06-25T04:45:21.268 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-06-25T04:45:21.533 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn. 2021-06-25T04:45:21.552 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-06-25T04:45:21.582 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:21.596 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-kubernetes. 2021-06-25T04:45:21.615 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-06-25T04:45:21.679 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-06-25T04:45:21.836 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cachetools. 2021-06-25T04:45:21.855 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-06-25T04:45:21.894 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-06-25T04:45:22.197 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1. 2021-06-25T04:45:22.213 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-06-25T04:45:22.255 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-06-25T04:45:22.268 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-06-25T04:45:22.274 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-06-25T04:45:22.286 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:22.294 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:22.326 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-k8sevents (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:22.332 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:22.659 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-06-25T04:45:22.676 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-06-25T04:45:22.712 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-json-pointer. 2021-06-25T04:45:22.725 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-06-25T04:45:22.729 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../077-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-06-25T04:45:22.770 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-06-25T04:45:23.087 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rsa. 2021-06-25T04:45:23.105 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-06-25T04:45:23.139 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jsonpatch. 2021-06-25T04:45:23.153 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rsa (4.0-3) ... 2021-06-25T04:45:23.156 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../078-python3-jsonpatch_1.23-3_all.deb ... 2021-06-25T04:45:23.223 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-06-25T04:45:23.435 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cachetools. 2021-06-25T04:45:23.451 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-06-25T04:45:23.490 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-google-auth. 2021-06-25T04:45:23.493 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-06-25T04:45:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-06-25T04:45:23.548 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-06-25T04:45:23.559 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-06-25T04:45:23.576 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../079-ceph-mgr-rook_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:23.617 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-rook (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:23.779 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1. 2021-06-25T04:45:23.799 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-06-25T04:45:23.834 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-colorama. 2021-06-25T04:45:23.837 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-06-25T04:45:23.854 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../087-python3-colorama_0.4.3-1build1_all.deb ... 2021-06-25T04:45:23.884 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-06-25T04:45:23.885 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-blinker. 2021-06-25T04:45:23.902 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-06-25T04:45:23.943 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-06-25T04:45:23.995 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libonig5:amd64. 2021-06-25T04:45:24.012 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../080-libonig5_6.9.4-1_amd64.deb ... 2021-06-25T04:45:24.053 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-06-25T04:45:24.146 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-shell. 2021-06-25T04:45:24.161 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../088-cephfs-shell_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:24.203 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-shell (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:24.216 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-06-25T04:45:24.232 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-06-25T04:45:24.271 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-oauthlib. 2021-06-25T04:45:24.282 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-06-25T04:45:24.288 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-06-25T04:45:24.329 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-06-25T04:45:24.481 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs-dev. 2021-06-25T04:45:24.499 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../089-libcephfs-dev_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:24.539 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs-dev (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:24.568 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjq1:amd64. 2021-06-25T04:45:24.585 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../081-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-06-25T04:45:24.594 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rsa. 2021-06-25T04:45:24.611 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-06-25T04:45:24.626 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:45:24.699 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-06-25T04:45:24.710 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rsa (4.0-3) ... 2021-06-25T04:45:24.715 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-06-25T04:45:24.897 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-06-25T04:45:24.921 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package jq. 2021-06-25T04:45:24.934 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package nvme-cli. 2021-06-25T04:45:24.939 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../082-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-06-25T04:45:24.951 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-06-25T04:45:25.007 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:45:25.009 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-06-25T04:45:25.021 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-google-auth. 2021-06-25T04:45:25.042 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-06-25T04:45:25.080 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-06-25T04:45:25.273 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package socat. 2021-06-25T04:45:25.291 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../083-socat_1.7.3.3-2_amd64.deb ... 2021-06-25T04:45:25.332 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking socat (1.7.3.3-2) ... 2021-06-25T04:45:25.373 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-atomicwrites. 2021-06-25T04:45:25.389 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-06-25T04:45:25.423 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-06-25T04:45:25.442 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-blinker. 2021-06-25T04:45:25.460 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-06-25T04:45:25.476 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-websocket. 2021-06-25T04:45:25.492 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-06-25T04:45:25.500 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-06-25T04:45:25.543 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-06-25T04:45:25.659 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-attr. 2021-06-25T04:45:25.676 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2021-06-25T04:45:25.726 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-06-25T04:45:25.786 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-06-25T04:45:25.803 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../084-libxslt1.1_1.1.34-4_amd64.deb ... 2021-06-25T04:45:25.807 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-oauthlib. 2021-06-25T04:45:25.824 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-06-25T04:45:25.844 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-06-25T04:45:25.867 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-06-25T04:45:25.913 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-kubernetes. 2021-06-25T04:45:25.930 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-06-25T04:45:25.971 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-06-25T04:45:26.054 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webencodings. 2021-06-25T04:45:26.069 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-06-25T04:45:26.112 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-06-25T04:45:26.155 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package xmlstarlet. 2021-06-25T04:45:26.172 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-06-25T04:45:26.205 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-06-25T04:45:26.230 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-06-25T04:45:26.247 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-06-25T04:45:26.288 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-06-25T04:45:26.423 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-html5lib. 2021-06-25T04:45:26.442 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2021-06-25T04:45:26.475 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-06-25T04:45:26.518 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-06-25T04:45:26.537 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:26.576 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-k8sevents (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:26.599 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-websocket. 2021-06-25T04:45:26.616 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-06-25T04:45:26.657 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-06-25T04:45:26.778 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-06-25T04:45:26.798 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-06-25T04:45:26.828 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-06-25T04:45:26.920 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-json-pointer. 2021-06-25T04:45:26.940 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../077-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-06-25T04:45:26.978 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-06-25T04:45:27.002 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-kubernetes. 2021-06-25T04:45:27.018 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-06-25T04:45:27.060 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-06-25T04:45:27.068 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-test. 2021-06-25T04:45:27.086 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../086-ceph-test_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:27.151 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-test (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:27.248 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-packaging. 2021-06-25T04:45:27.266 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2021-06-25T04:45:27.298 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-packaging (20.3-1) ... 2021-06-25T04:45:27.307 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jsonpatch. 2021-06-25T04:45:27.323 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../078-python3-jsonpatch_1.23-3_all.deb ... 2021-06-25T04:45:27.390 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-06-25T04:45:27.584 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastescript. 2021-06-25T04:45:27.600 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2021-06-25T04:45:27.632 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-06-25T04:45:27.648 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:27.675 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-06-25T04:45:27.690 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-k8sevents (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:27.718 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-06-25T04:45:27.735 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../079-ceph-mgr-rook_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:27.776 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-rook (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:28.076 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-json-pointer. 2021-06-25T04:45:28.095 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../077-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-06-25T04:45:28.129 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libonig5:amd64. 2021-06-25T04:45:28.133 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-06-25T04:45:28.146 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../080-libonig5_6.9.4-1_amd64.deb ... 2021-06-25T04:45:28.187 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-06-25T04:45:28.466 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jsonpatch. 2021-06-25T04:45:28.482 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../078-python3-jsonpatch_1.23-3_all.deb ... 2021-06-25T04:45:28.520 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-06-25T04:45:28.543 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pluggy. 2021-06-25T04:45:28.559 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2021-06-25T04:45:28.593 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-06-25T04:45:28.651 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjq1:amd64. 2021-06-25T04:45:28.667 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../081-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-06-25T04:45:28.708 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:45:28.848 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-06-25T04:45:28.864 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../079-ceph-mgr-rook_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:28.898 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-psutil. 2021-06-25T04:45:28.906 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-rook (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:28.915 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-06-25T04:45:28.981 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-06-25T04:45:29.039 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package jq. 2021-06-25T04:45:29.057 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../082-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-06-25T04:45:29.095 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:45:29.234 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libonig5:amd64. 2021-06-25T04:45:29.250 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../080-libonig5_6.9.4-1_amd64.deb ... 2021-06-25T04:45:29.266 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-py. 2021-06-25T04:45:29.282 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../100-python3-py_1.8.1-1_all.deb ... 2021-06-25T04:45:29.292 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-06-25T04:45:29.316 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-py (1.8.1-1) ... 2021-06-25T04:45:29.348 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package socat. 2021-06-25T04:45:29.364 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../083-socat_1.7.3.3-2_amd64.deb ... 2021-06-25T04:45:29.406 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking socat (1.7.3.3-2) ... 2021-06-25T04:45:29.619 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyinotify. 2021-06-25T04:45:29.638 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-06-25T04:45:29.677 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-06-25T04:45:29.839 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjq1:amd64. 2021-06-25T04:45:29.842 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-06-25T04:45:29.858 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../081-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-06-25T04:45:29.859 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../084-libxslt1.1_1.1.34-4_amd64.deb ... 2021-06-25T04:45:29.897 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:45:29.901 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-06-25T04:45:29.980 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pytest. 2021-06-25T04:45:29.996 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2021-06-25T04:45:30.038 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-06-25T04:45:30.187 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package xmlstarlet. 2021-06-25T04:45:30.191 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package jq. 2021-06-25T04:45:30.205 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-06-25T04:45:30.207 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../082-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-06-25T04:45:30.245 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-06-25T04:45:30.249 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:45:30.399 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplejson. 2021-06-25T04:45:30.419 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-06-25T04:45:30.457 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-06-25T04:45:30.485 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package socat. 2021-06-25T04:45:30.504 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../083-socat_1.7.3.3-2_amd64.deb ... 2021-06-25T04:45:30.543 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking socat (1.7.3.3-2) ... 2021-06-25T04:45:30.591 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-test. 2021-06-25T04:45:30.610 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../086-ceph-test_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:30.675 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-test (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:30.714 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-colorama. 2021-06-25T04:45:30.734 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../087-python3-colorama_0.4.3-1build1_all.deb ... 2021-06-25T04:45:30.772 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-06-25T04:45:30.923 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package radosgw. 2021-06-25T04:45:30.940 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../104-radosgw_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:30.955 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-06-25T04:45:30.972 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../084-libxslt1.1_1.1.34-4_amd64.deb ... 2021-06-25T04:45:30.981 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking radosgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:31.013 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-06-25T04:45:31.058 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-shell. 2021-06-25T04:45:31.075 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../088-cephfs-shell_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:31.116 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-shell (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:31.325 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package xmlstarlet. 2021-06-25T04:45:31.343 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-06-25T04:45:31.361 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs-dev. 2021-06-25T04:45:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../089-libcephfs-dev_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:31.382 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-06-25T04:45:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs-dev (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:31.729 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-test. 2021-06-25T04:45:31.747 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../086-ceph-test_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:31.786 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-test (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:31.881 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package nvme-cli. 2021-06-25T04:45:31.901 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-06-25T04:45:31.985 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-06-25T04:45:32.077 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package rbd-fuse. 2021-06-25T04:45:32.097 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../105-rbd-fuse_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:32.143 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking rbd-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:32.353 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-atomicwrites. 2021-06-25T04:45:32.373 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-06-25T04:45:32.411 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-06-25T04:45:32.438 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-attr (19.3.0-2) ... 2021-06-25T04:45:32.758 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-06-25T04:45:32.759 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-attr. 2021-06-25T04:45:32.778 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2021-06-25T04:45:32.817 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-06-25T04:45:32.875 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-06-25T04:45:32.977 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-06-25T04:45:33.146 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webencodings. 2021-06-25T04:45:33.154 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:33.166 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-06-25T04:45:33.204 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-06-25T04:45:33.524 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-html5lib. 2021-06-25T04:45:33.540 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2021-06-25T04:45:33.573 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-06-25T04:45:33.740 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user cephadm....done 2021-06-25T04:45:33.901 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-06-25T04:45:33.919 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-06-25T04:45:33.938 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-06-25T04:45:34.003 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-06-25T04:45:34.054 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-colorama. 2021-06-25T04:45:34.070 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../087-python3-colorama_0.4.3-1build1_all.deb ... 2021-06-25T04:45:34.111 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-06-25T04:45:34.278 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-06-25T04:45:34.390 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-shell. 2021-06-25T04:45:34.406 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../088-cephfs-shell_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:34.456 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-shell (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:34.566 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-packaging. 2021-06-25T04:45:34.582 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2021-06-25T04:45:34.596 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-06-25T04:45:34.624 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-packaging (20.3-1) ... 2021-06-25T04:45:34.713 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-py (1.8.1-1) ... 2021-06-25T04:45:34.750 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs-dev. 2021-06-25T04:45:34.767 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../089-libcephfs-dev_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:34.808 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs-dev (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:34.950 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastescript. 2021-06-25T04:45:34.970 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2021-06-25T04:45:35.007 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-06-25T04:45:35.044 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-06-25T04:45:35.191 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-colorama. 2021-06-25T04:45:35.208 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../087-python3-colorama_0.4.3-1build1_all.deb ... 2021-06-25T04:45:35.248 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-06-25T04:45:35.304 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package nvme-cli. 2021-06-25T04:45:35.322 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-06-25T04:45:35.386 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pluggy. 2021-06-25T04:45:35.388 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-06-25T04:45:35.392 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-06-25T04:45:35.404 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2021-06-25T04:45:35.453 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-06-25T04:45:35.535 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-shell. 2021-06-25T04:45:35.552 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../088-cephfs-shell_15.2.13-65-gda5e8184-1focal_all.deb ... 2021-06-25T04:45:35.593 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-shell (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:35.685 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-06-25T04:45:35.776 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-atomicwrites. 2021-06-25T04:45:35.792 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-06-25T04:45:35.829 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs-dev. 2021-06-25T04:45:35.833 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-06-25T04:45:35.839 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-psutil. 2021-06-25T04:45:35.845 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../089-libcephfs-dev_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:35.856 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-06-25T04:45:35.887 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs-dev (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:35.903 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-06-25T04:45:35.970 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-06-25T04:45:36.145 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-attr. 2021-06-25T04:45:36.162 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2021-06-25T04:45:36.211 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-06-25T04:45:36.263 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-06-25T04:45:36.290 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package nvme-cli. 2021-06-25T04:45:36.292 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-py. 2021-06-25T04:45:36.306 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-06-25T04:45:36.309 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../100-python3-py_1.8.1-1_all.deb ... 2021-06-25T04:45:36.351 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-py (1.8.1-1) ... 2021-06-25T04:45:36.368 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-06-25T04:45:36.539 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-06-25T04:45:36.548 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webencodings. 2021-06-25T04:45:36.564 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-06-25T04:45:36.617 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-06-25T04:45:36.703 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-atomicwrites. 2021-06-25T04:45:36.716 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyinotify. 2021-06-25T04:45:36.722 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-06-25T04:45:36.733 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-06-25T04:45:36.761 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-06-25T04:45:36.791 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-06-25T04:45:36.815 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-argparse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:36.970 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-html5lib. 2021-06-25T04:45:36.987 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2021-06-25T04:45:37.028 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-06-25T04:45:37.098 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-attr. 2021-06-25T04:45:37.110 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:37.118 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2021-06-25T04:45:37.136 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pytest. 2021-06-25T04:45:37.153 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2021-06-25T04:45:37.164 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-06-25T04:45:37.194 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-06-25T04:45:37.245 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-06-25T04:45:37.431 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-06-25T04:45:37.449 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-06-25T04:45:37.489 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-06-25T04:45:37.519 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webencodings. 2021-06-25T04:45:37.536 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-06-25T04:45:37.538 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-06-25T04:45:37.577 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-06-25T04:45:37.607 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplejson. 2021-06-25T04:45:37.626 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-06-25T04:45:37.665 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-06-25T04:45:37.806 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-06-25T04:45:37.863 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-html5lib. 2021-06-25T04:45:37.879 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2021-06-25T04:45:37.921 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-06-25T04:45:37.993 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-packaging. 2021-06-25T04:45:38.013 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2021-06-25T04:45:38.051 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-packaging (20.3-1) ... 2021-06-25T04:45:38.083 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-06-25T04:45:38.136 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package radosgw. 2021-06-25T04:45:38.155 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../104-radosgw_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:38.194 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking radosgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:38.275 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-06-25T04:45:38.295 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-06-25T04:45:38.332 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-06-25T04:45:38.384 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastescript. 2021-06-25T04:45:38.402 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2021-06-25T04:45:38.451 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-06-25T04:45:38.459 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-06-25T04:45:38.752 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-06-25T04:45:38.798 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pluggy. 2021-06-25T04:45:38.814 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2021-06-25T04:45:38.837 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-packaging. 2021-06-25T04:45:38.854 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2021-06-25T04:45:38.855 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-06-25T04:45:38.896 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-packaging (20.3-1) ... 2021-06-25T04:45:39.086 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-06-25T04:45:39.205 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastescript. 2021-06-25T04:45:39.206 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-psutil. 2021-06-25T04:45:39.223 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-06-25T04:45:39.223 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2021-06-25T04:45:39.263 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-06-25T04:45:39.264 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-06-25T04:45:39.371 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-06-25T04:45:39.390 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package rbd-fuse. 2021-06-25T04:45:39.407 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../105-rbd-fuse_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:39.449 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking rbd-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:39.612 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pluggy. 2021-06-25T04:45:39.617 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-py. 2021-06-25T04:45:39.629 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2021-06-25T04:45:39.634 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../100-python3-py_1.8.1-1_all.deb ... 2021-06-25T04:45:39.671 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-06-25T04:45:39.675 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-py (1.8.1-1) ... 2021-06-25T04:45:39.705 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-06-25T04:45:39.787 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-attr (19.3.0-2) ... 2021-06-25T04:45:39.982 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-psutil. 2021-06-25T04:45:39.998 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-packaging (20.3-1) ... 2021-06-25T04:45:40.000 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-06-25T04:45:40.029 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyinotify. 2021-06-25T04:45:40.040 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-06-25T04:45:40.045 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-06-25T04:45:40.087 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-06-25T04:45:40.139 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-06-25T04:45:40.265 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-06-25T04:45:40.274 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-06-25T04:45:40.400 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-06-25T04:45:40.406 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pytest. 2021-06-25T04:45:40.410 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-py. 2021-06-25T04:45:40.416 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-06-25T04:45:40.425 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2021-06-25T04:45:40.428 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../100-python3-py_1.8.1-1_all.deb ... 2021-06-25T04:45:40.464 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-06-25T04:45:40.468 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-py (1.8.1-1) ... 2021-06-25T04:45:40.642 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:40.685 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-06-25T04:45:40.824 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyinotify. 2021-06-25T04:45:40.844 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-06-25T04:45:40.847 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplejson. 2021-06-25T04:45:40.863 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-06-25T04:45:40.888 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-06-25T04:45:40.905 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-06-25T04:45:41.087 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-06-25T04:45:41.210 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pytest. 2021-06-25T04:45:41.230 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user cephadm....done 2021-06-25T04:45:41.231 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2021-06-25T04:45:41.268 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-06-25T04:45:41.367 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package radosgw. 2021-06-25T04:45:41.384 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../104-radosgw_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:41.388 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-06-25T04:45:41.425 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-06-25T04:45:41.426 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking radosgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:41.647 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplejson. 2021-06-25T04:45:41.664 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-06-25T04:45:41.705 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-06-25T04:45:41.756 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-06-25T04:45:41.818 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-06-25T04:45:42.111 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-06-25T04:45:42.125 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package radosgw. 2021-06-25T04:45:42.133 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up socat (1.7.3.3-2) ... 2021-06-25T04:45:42.141 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../104-radosgw_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:42.208 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking radosgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:42.246 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-py (1.8.1-1) ... 2021-06-25T04:45:42.259 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:42.471 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package rbd-fuse. 2021-06-25T04:45:42.487 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../105-rbd-fuse_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:42.529 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking rbd-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:42.552 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-06-25T04:45:42.614 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-06-25T04:45:42.877 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-attr (19.3.0-2) ... 2021-06-25T04:45:42.912 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-06-25T04:45:43.038 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-06-25T04:45:43.086 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-06-25T04:45:43.211 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-06-25T04:45:43.279 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-fuse. 2021-06-25T04:45:43.298 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../105-rbd-fuse_15.2.13-65-gda5e8184-1focal_amd64.deb ... 2021-06-25T04:45:43.337 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:43.339 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-06-25T04:45:43.362 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-06-25T04:45:43.380 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-06-25T04:45:43.488 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-06-25T04:45:43.624 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-06-25T04:45:43.663 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-attr (19.3.0-2) ... 2021-06-25T04:45:43.673 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-06-25T04:45:43.698 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:43.767 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-06-25T04:45:43.974 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-06-25T04:45:43.976 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-06-25T04:45:44.077 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-06-25T04:45:44.093 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-06-25T04:45:44.220 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-06-25T04:45:44.250 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user cephadm....done 2021-06-25T04:45:44.284 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-06-25T04:45:44.387 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-06-25T04:45:44.413 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:44.420 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-06-25T04:45:44.610 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-argparse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:44.688 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-06-25T04:45:44.780 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-06-25T04:45:44.814 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-06-25T04:45:44.911 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:44.999 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user cephadm....done 2021-06-25T04:45:45.038 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-06-25T04:45:45.099 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-06-25T04:45:45.099 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-06-25T04:45:45.225 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-py (1.8.1-1) ... 2021-06-25T04:45:45.355 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-06-25T04:45:45.416 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-06-25T04:45:45.543 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-06-25T04:45:45.595 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-06-25T04:45:45.657 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-06-25T04:45:45.734 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-06-25T04:45:45.929 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-06-25T04:45:45.950 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-06-25T04:45:45.987 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-06-25T04:45:46.109 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-06-25T04:45:46.255 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-06-25T04:45:46.289 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-06-25T04:45:46.351 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-06-25T04:45:46.378 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-06-25T04:45:46.381 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-py (1.8.1-1) ... 2021-06-25T04:45:46.499 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-06-25T04:45:46.598 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-06-25T04:45:46.636 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-06-25T04:45:46.699 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-06-25T04:45:46.836 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-06-25T04:45:46.892 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-06-25T04:45:46.979 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-06-25T04:45:47.160 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-06-25T04:45:47.189 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-06-25T04:45:47.195 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-06-25T04:45:47.297 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-06-25T04:45:47.315 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-06-25T04:45:47.428 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-06-25T04:45:47.440 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-06-25T04:45:47.488 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-argparse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:47.657 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-06-25T04:45:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-06-25T04:45:47.774 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-06-25T04:45:47.781 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:47.907 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-06-25T04:45:47.959 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-packaging (20.3-1) ... 2021-06-25T04:45:47.966 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-06-25T04:45:48.059 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librados2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:48.185 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-06-25T04:45:48.191 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-06-25T04:45:48.249 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-06-25T04:45:48.345 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-06-25T04:45:48.485 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-06-25T04:45:48.493 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-06-25T04:45:48.527 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-argparse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:48.786 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-06-25T04:45:48.795 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:48.842 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-06-25T04:45:48.895 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-06-25T04:45:49.156 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-06-25T04:45:49.196 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-06-25T04:45:49.381 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-06-25T04:45:49.457 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-06-25T04:45:49.481 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-06-25T04:45:49.659 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librgw2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:49.716 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-06-25T04:45:49.774 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-06-25T04:45:49.784 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:45:49.816 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-06-25T04:45:49.910 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-06-25T04:45:50.092 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-06-25T04:45:50.109 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-06-25T04:45:50.150 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-06-25T04:45:50.279 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-06-25T04:45:50.417 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-06-25T04:45:50.419 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-06-25T04:45:50.486 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up socat (1.7.3.3-2) ... 2021-06-25T04:45:50.588 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-06-25T04:45:50.654 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:50.678 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-06-25T04:45:50.703 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-packaging (20.3-1) ... 2021-06-25T04:45:50.752 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-06-25T04:45:50.907 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-06-25T04:45:50.965 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-06-25T04:45:50.979 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-06-25T04:45:51.012 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-06-25T04:45:51.081 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-06-25T04:45:51.208 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-06-25T04:45:51.337 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-06-25T04:45:51.338 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-06-25T04:45:51.348 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-06-25T04:45:51.468 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-06-25T04:45:51.542 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:51.647 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-packaging (20.3-1) ... 2021-06-25T04:45:51.669 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-06-25T04:45:51.744 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-06-25T04:45:51.767 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-06-25T04:45:51.940 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-06-25T04:45:52.012 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libradosstriper1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:52.066 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-06-25T04:45:52.068 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-06-25T04:45:52.112 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-06-25T04:45:52.139 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-06-25T04:45:52.238 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-06-25T04:45:52.342 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-06-25T04:45:52.429 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-06-25T04:45:52.456 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-06-25T04:45:52.615 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-06-25T04:45:52.711 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-06-25T04:45:52.797 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up socat (1.7.3.3-2) ... 2021-06-25T04:45:52.906 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:52.911 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-06-25T04:45:52.987 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-06-25T04:45:53.201 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-06-25T04:45:53.216 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-06-25T04:45:53.330 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-06-25T04:45:53.355 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-06-25T04:45:53.493 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librbd1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:53.609 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-06-25T04:45:53.621 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-06-25T04:45:53.639 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-06-25T04:45:53.682 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up socat (1.7.3.3-2) ... 2021-06-25T04:45:53.735 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-06-25T04:45:53.746 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-06-25T04:45:53.807 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:53.898 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-06-25T04:45:53.923 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-06-25T04:45:54.019 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-06-25T04:45:54.125 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-06-25T04:45:54.216 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:45:54.223 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-06-25T04:45:54.289 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-06-25T04:45:54.342 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rsa (4.0-3) ... 2021-06-25T04:45:54.389 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-06-25T04:45:54.452 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-06-25T04:45:54.553 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-06-25T04:45:54.591 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-06-25T04:45:54.647 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-06-25T04:45:54.716 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-06-25T04:45:54.822 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-06-25T04:45:54.893 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-06-25T04:45:54.941 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-modules-core (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:55.000 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-06-25T04:45:55.020 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-06-25T04:45:55.091 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:55.106 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-06-25T04:45:55.232 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-06-25T04:45:55.285 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-06-25T04:45:55.315 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-06-25T04:45:55.315 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-06-25T04:45:55.379 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-06-25T04:45:55.410 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-06-25T04:45:55.558 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-06-25T04:45:55.695 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-06-25T04:45:55.742 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-06-25T04:45:55.743 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs-dev (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:55.869 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-06-25T04:45:55.884 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-06-25T04:45:55.884 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-06-25T04:45:55.993 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-06-25T04:45:56.154 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-06-25T04:45:56.161 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-06-25T04:45:56.262 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-06-25T04:45:56.369 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-06-25T04:45:56.405 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-06-25T04:45:56.483 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-06-25T04:45:56.547 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-06-25T04:45:56.654 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librados2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:56.700 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-06-25T04:45:56.779 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-06-25T04:45:56.836 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-06-25T04:45:56.843 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rados (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:56.994 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rbd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:57.075 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-06-25T04:45:57.127 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-06-25T04:45:57.214 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up rbd-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:57.340 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-routes (2.4.1-2) ... 2021-06-25T04:45:57.357 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-06-25T04:45:57.507 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-06-25T04:45:57.507 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-06-25T04:45:57.633 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-06-25T04:45:57.747 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-06-25T04:45:57.849 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-06-25T04:45:57.871 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-06-25T04:45:57.926 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:58.052 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cephfs (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:58.197 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-06-25T04:45:58.217 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-06-25T04:45:58.310 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librgw2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:58.334 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-06-25T04:45:58.354 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-shell (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:58.436 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-06-25T04:45:58.454 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-06-25T04:45:58.469 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:45:58.540 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-06-25T04:45:58.595 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-06-25T04:45:58.666 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-06-25T04:45:58.737 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-06-25T04:45:58.784 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-06-25T04:45:59.005 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-06-25T04:45:59.013 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librados2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:59.085 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-06-25T04:45:59.164 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-06-25T04:45:59.306 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-06-25T04:45:59.353 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librados2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:59.405 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-06-25T04:45:59.427 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:45:59.454 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-06-25T04:45:59.666 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-06-25T04:45:59.934 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-06-25T04:45:59.952 INFO:teuthology.orchestra.run.smithi087.stdout:Adding group ceph....done 2021-06-25T04:46:00.285 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:00.350 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user ceph....done 2021-06-25T04:46:00.446 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-06-25T04:46:00.543 INFO:teuthology.orchestra.run.smithi087.stdout:Setting system user ceph properties....done 2021-06-25T04:46:00.568 INFO:teuthology.orchestra.run.smithi087.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-06-25T04:46:00.629 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librgw2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:00.718 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-06-25T04:46:00.755 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libradosstriper1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:00.788 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:46:00.902 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librgw2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:00.916 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-06-25T04:46:00.917 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-06-25T04:46:01.027 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:46:01.050 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-06-25T04:46:01.128 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-06-25T04:46:01.232 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-06-25T04:46:01.299 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-06-25T04:46:01.488 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-06-25T04:46:01.489 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-test (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:01.584 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-06-25T04:46:01.607 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up radosgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:01.658 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-06-25T04:46:01.798 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-06-25T04:46:01.869 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-06-25T04:46:01.883 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-06-25T04:46:01.883 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-06-25T04:46:01.887 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-06-25T04:46:02.116 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-06-25T04:46:02.136 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-06-25T04:46:02.296 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librbd1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:02.417 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-06-25T04:46:02.447 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-06-25T04:46:02.471 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:02.525 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-base (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:02.573 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-06-25T04:46:02.597 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-06-25T04:46:02.707 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-06-25T04:46:02.735 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs2 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:02.844 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-06-25T04:46:02.886 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-06-25T04:46:02.933 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libradosstriper1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:03.009 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:46:03.033 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-06-25T04:46:03.146 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libradosstriper1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:03.153 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rsa (4.0-3) ... 2021-06-25T04:46:03.264 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-06-25T04:46:03.344 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mds (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:03.351 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-06-25T04:46:03.454 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-06-25T04:46:03.567 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-06-25T04:46:03.568 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-06-25T04:46:03.598 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-06-25T04:46:03.772 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-modules-core (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:03.923 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:04.021 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:04.134 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-06-25T04:46:04.135 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-06-25T04:46:04.250 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-06-25T04:46:04.251 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-06-25T04:46:04.407 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librbd1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:04.541 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-06-25T04:46:04.591 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs-dev (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:04.642 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-06-25T04:46:04.662 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librbd1 (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:04.680 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:04.743 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-06-25T04:46:04.751 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-06-25T04:46:04.762 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-06-25T04:46:04.840 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-rook (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:04.880 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-06-25T04:46:04.983 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-osd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:05.008 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-06-25T04:46:05.060 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-06-25T04:46:05.096 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:46:05.223 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rsa (4.0-3) ... 2021-06-25T04:46:05.353 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-06-25T04:46:05.428 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-06-25T04:46:05.452 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rsa (4.0-3) ... 2021-06-25T04:46:05.532 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-06-25T04:46:05.542 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-06-25T04:46:05.542 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-06-25T04:46:05.736 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-06-25T04:46:05.780 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rados (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:05.859 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-modules-core (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:05.939 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rbd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:05.959 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:05.968 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-k8sevents (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:06.013 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-modules-core (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:06.094 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-diskprediction-local (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:06.125 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up rbd-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:06.138 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:06.170 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-06-25T04:46:06.171 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-06-25T04:46:06.237 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mon (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:06.260 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-routes (2.4.1-2) ... 2021-06-25T04:46:06.373 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-06-25T04:46:06.373 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-06-25T04:46:06.486 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-06-25T04:46:06.487 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-06-25T04:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-06-25T04:46:06.628 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs-dev (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:06.789 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-06-25T04:46:06.846 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:06.851 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs-dev (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:06.930 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:06.960 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-06-25T04:46:07.005 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cephfs (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:07.081 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:07.082 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-06-25T04:46:07.207 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-dashboard (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:07.228 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-06-25T04:46:07.314 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-shell (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:07.360 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-06-25T04:46:07.400 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-06-25T04:46:07.473 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-06-25T04:46:07.538 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-06-25T04:46:07.657 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-06-25T04:46:07.761 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rados (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:07.899 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rados (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:07.913 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rbd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:08.024 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rbd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:08.124 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up rbd-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:08.235 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-fuse (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:08.250 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-routes (2.4.1-2) ... 2021-06-25T04:46:08.361 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-routes (2.4.1-2) ... 2021-06-25T04:46:08.418 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:08.552 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-06-25T04:46:08.688 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-06-25T04:46:08.852 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:08.990 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:09.012 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cephfs (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:09.017 INFO:teuthology.orchestra.run.smithi057.stdout:Adding group ceph....done 2021-06-25T04:46:09.132 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cephfs (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:09.296 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-shell (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:09.400 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-shell (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:09.414 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-06-25T04:46:09.469 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user ceph....done 2021-06-25T04:46:09.525 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-06-25T04:46:09.645 INFO:teuthology.orchestra.run.smithi057.stdout:Setting system user ceph properties....done 2021-06-25T04:46:09.671 INFO:teuthology.orchestra.run.smithi057.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-06-25T04:46:09.825 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-06-25T04:46:10.148 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-06-25T04:46:10.367 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:10.462 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-common (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:10.607 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-test (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:10.783 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up radosgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:10.889 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-06-25T04:46:10.891 INFO:teuthology.orchestra.run.smithi102.stdout:Adding group ceph....done 2021-06-25T04:46:10.994 INFO:teuthology.orchestra.run.smithi161.stdout:Adding group ceph....done 2021-06-25T04:46:11.048 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-06-25T04:46:11.049 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-06-25T04:46:11.285 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-06-25T04:46:11.288 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-06-25T04:46:11.293 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user ceph....done 2021-06-25T04:46:11.357 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-06-25T04:46:11.414 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user ceph....done 2021-06-25T04:46:11.469 INFO:teuthology.orchestra.run.smithi102.stdout:Setting system user ceph properties....done 2021-06-25T04:46:11.490 INFO:teuthology.orchestra.run.smithi102.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-06-25T04:46:11.517 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-06-25T04:46:11.518 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-06-25T04:46:11.590 INFO:teuthology.orchestra.run.smithi161.stdout:Setting system user ceph properties....done 2021-06-25T04:46:11.611 INFO:teuthology.orchestra.run.smithi161.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-06-25T04:46:11.632 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-06-25T04:46:11.653 INFO:teuthology.orchestra.run.smithi087.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-06-25T04:46:11.654 INFO:teuthology.orchestra.run.smithi087.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-06-25T04:46:11.654 INFO:teuthology.orchestra.run.smithi087.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-06-25T04:46:11.655 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2021-06-25T04:46:11.656 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-06-25T04:46:11.656 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2021-06-25T04:46:11.656 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2021-06-25T04:46:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-06-25T04:46:11.657 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2021-06-25T04:46:11.657 INFO:teuthology.orchestra.run.smithi087.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-06-25T04:46:11.678 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2021-06-25T04:46:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-06-25T04:46:11.679 INFO:teuthology.orchestra.run.smithi087.stdout: libssl-dev 2021-06-25T04:46:11.680 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2021-06-25T04:46:11.680 INFO:teuthology.orchestra.run.smithi087.stdout: libssl1.1 2021-06-25T04:46:11.727 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-base (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:11.767 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-06-25T04:46:11.855 INFO:teuthology.orchestra.run.smithi087.stdout:1 upgraded, 10 newly installed, 0 to remove and 135 not upgraded. 2021-06-25T04:46:11.855 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 4,231 kB of archives. 2021-06-25T04:46:11.856 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-06-25T04:46:11.856 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-06-25T04:46:11.946 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-06-25T04:46:12.074 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-06-25T04:46:12.088 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-06-25T04:46:12.301 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.4 [1,319 kB] 2021-06-25T04:46:12.399 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-test (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:12.500 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up radosgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:12.503 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-06-25T04:46:12.537 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mds (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:12.550 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-06-25T04:46:12.550 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-06-25T04:46:12.556 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-06-25T04:46:12.559 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-06-25T04:46:12.559 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-06-25T04:46:12.562 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-06-25T04:46:12.563 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-06-25T04:46:12.563 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.4 [1,583 kB] 2021-06-25T04:46:12.569 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-test (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:12.695 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up radosgw (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:12.751 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-06-25T04:46:12.751 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-06-25T04:46:12.769 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-06-25T04:46:12.769 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-06-25T04:46:12.918 INFO:teuthology.orchestra.run.smithi087.stdout:Preconfiguring packages ... 2021-06-25T04:46:12.965 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-06-25T04:46:12.966 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-06-25T04:46:13.040 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 4,231 kB in 1s (4,509 kB/s) 2021-06-25T04:46:13.141 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package flex. 2021-06-25T04:46:13.194 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145542 files and directories currently installed.) 2021-06-25T04:46:13.199 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:13.247 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:13.278 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking flex (2.6.4-6.2) ... 2021-06-25T04:46:13.385 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-base (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:13.490 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-06-25T04:46:13.490 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-06-25T04:46:13.664 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-base (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:13.719 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-06-25T04:46:13.874 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.4_amd64.deb ... 2021-06-25T04:46:13.982 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:13.993 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-06-25T04:46:14.090 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.4) over (1.1.1f-1ubuntu2.2) ... 2021-06-25T04:46:14.124 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-rook (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:14.170 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mds (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:14.300 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-osd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:14.395 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-06-25T04:46:14.395 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-06-25T04:46:14.407 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mds (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:14.654 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-06-25T04:46:14.654 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-06-25T04:46:14.745 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package bison. 2021-06-25T04:46:14.765 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-06-25T04:46:14.816 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-06-25T04:46:14.847 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:14.887 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-06-25T04:46:14.888 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-06-25T04:46:15.083 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-06-25T04:46:15.084 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-06-25T04:46:15.100 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:15.277 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-06-25T04:46:15.294 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-06-25T04:46:15.332 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-06-25T04:46:15.346 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-k8sevents (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:15.352 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-06-25T04:46:15.352 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-06-25T04:46:15.481 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-diskprediction-local (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:15.539 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:15.598 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mon (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:15.657 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-rook (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:15.703 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package dump. 2021-06-25T04:46:15.719 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-06-25T04:46:15.775 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-osd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:15.795 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking dump (0.4b46-6) ... 2021-06-25T04:46:15.801 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:15.812 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-06-25T04:46:15.813 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-06-25T04:46:15.961 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-rook (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:16.093 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package indent. 2021-06-25T04:46:16.110 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-06-25T04:46:16.151 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking indent (2.2.12-1) ... 2021-06-25T04:46:16.170 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-osd (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:16.268 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:16.289 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-06-25T04:46:16.289 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-06-25T04:46:16.411 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:16.445 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-06-25T04:46:16.462 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-06-25T04:46:16.503 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-06-25T04:46:16.562 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-dashboard (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:16.684 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-06-25T04:46:16.785 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-k8sevents (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:16.807 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-06-25T04:46:16.825 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-06-25T04:46:16.865 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-06-25T04:46:17.002 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-06-25T04:46:17.133 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-diskprediction-local (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:17.252 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libfl2:amd64. 2021-06-25T04:46:17.272 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:17.310 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:17.405 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mon (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:17.433 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-06-25T04:46:17.433 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-06-25T04:46:17.563 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-06-25T04:46:17.579 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:17.633 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-06-25T04:46:17.634 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-06-25T04:46:17.645 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:17.881 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-k8sevents (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:17.898 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-06-25T04:46:17.915 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.4_amd64.deb ... 2021-06-25T04:46:17.965 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:18.041 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-local (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:18.098 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:18.192 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mon (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:18.292 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:18.418 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-06-25T04:46:18.418 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-06-25T04:46:18.425 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-dashboard (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:18.442 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up flex (2.6.4-6.2) ... 2021-06-25T04:46:18.553 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:18.561 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-06-25T04:46:18.862 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-06-25T04:46:18.888 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-06-25T04:46:18.901 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-cephadm (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:19.005 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-06-25T04:46:19.041 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:19.131 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:19.144 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-dashboard (15.2.13-65-gda5e8184-1focal) ... 2021-06-25T04:46:19.257 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-06-25T04:46:19.296 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-06-25T04:46:19.383 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:19.525 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up dump (0.4b46-6) ... 2021-06-25T04:46:19.580 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-06-25T04:46:19.621 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-06-25T04:46:19.669 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-06-25T04:46:19.742 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-06-25T04:46:19.804 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up indent (2.2.12-1) ... 2021-06-25T04:46:19.904 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:20.178 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-06-25T04:46:20.282 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-06-25T04:46:20.509 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-06-25T04:46:20.623 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-06-25T04:46:20.625 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-06-25T04:46:20.698 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2021-06-25T04:46:20.863 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2021-06-25T04:46:20.864 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2021-06-25T04:46:21.009 INFO:teuthology.orchestra.run.smithi057.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-06-25T04:46:21.010 INFO:teuthology.orchestra.run.smithi057.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-06-25T04:46:21.010 INFO:teuthology.orchestra.run.smithi057.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-06-25T04:46:21.011 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2021-06-25T04:46:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-06-25T04:46:21.012 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2021-06-25T04:46:21.012 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2021-06-25T04:46:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-06-25T04:46:21.014 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2021-06-25T04:46:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-06-25T04:46:21.033 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2021-06-25T04:46:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-06-25T04:46:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: libssl-dev 2021-06-25T04:46:21.036 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2021-06-25T04:46:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: libssl1.1 2021-06-25T04:46:21.212 INFO:teuthology.orchestra.run.smithi057.stdout:1 upgraded, 10 newly installed, 0 to remove and 135 not upgraded. 2021-06-25T04:46:21.212 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 4,231 kB of archives. 2021-06-25T04:46:21.213 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-06-25T04:46:21.214 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-06-25T04:46:21.673 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.4 [1,319 kB] 2021-06-25T04:46:21.873 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-06-25T04:46:21.921 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-06-25T04:46:21.922 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-06-25T04:46:21.928 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-06-25T04:46:21.930 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-06-25T04:46:21.931 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-06-25T04:46:21.933 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-06-25T04:46:21.933 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-06-25T04:46:21.934 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.4 [1,583 kB] 2021-06-25T04:46:22.074 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-06-25T04:46:22.300 INFO:teuthology.orchestra.run.smithi057.stdout:Preconfiguring packages ... 2021-06-25T04:46:22.433 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 4,231 kB in 1s (4,445 kB/s) 2021-06-25T04:46:22.448 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-06-25T04:46:22.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-06-25T04:46:22.517 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2021-06-25T04:46:22.620 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package flex. 2021-06-25T04:46:22.676 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-06-25T04:46:22.677 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145542 files and directories currently installed.) 2021-06-25T04:46:22.679 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2021-06-25T04:46:22.680 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2021-06-25T04:46:22.681 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:22.686 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-06-25T04:46:22.752 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking flex (2.6.4-6.2) ... 2021-06-25T04:46:22.818 INFO:teuthology.orchestra.run.smithi102.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-06-25T04:46:22.819 INFO:teuthology.orchestra.run.smithi102.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-06-25T04:46:22.819 INFO:teuthology.orchestra.run.smithi102.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-06-25T04:46:22.819 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2021-06-25T04:46:22.820 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-06-25T04:46:22.820 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2021-06-25T04:46:22.820 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2021-06-25T04:46:22.821 INFO:teuthology.orchestra.run.smithi102.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-06-25T04:46:22.821 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2021-06-25T04:46:22.821 INFO:teuthology.orchestra.run.smithi102.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-06-25T04:46:22.844 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2021-06-25T04:46:22.845 INFO:teuthology.orchestra.run.smithi102.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-06-25T04:46:22.845 INFO:teuthology.orchestra.run.smithi102.stdout: libssl-dev 2021-06-25T04:46:22.846 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2021-06-25T04:46:22.847 INFO:teuthology.orchestra.run.smithi102.stdout: libssl1.1 2021-06-25T04:46:23.023 INFO:teuthology.orchestra.run.smithi102.stdout:1 upgraded, 10 newly installed, 0 to remove and 135 not upgraded. 2021-06-25T04:46:23.024 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 4,231 kB of archives. 2021-06-25T04:46:23.025 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-06-25T04:46:23.026 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-06-25T04:46:23.089 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-06-25T04:46:23.091 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-06-25T04:46:23.164 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-06-25T04:46:23.325 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2021-06-25T04:46:23.326 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2021-06-25T04:46:23.371 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-06-25T04:46:23.374 DEBUG:teuthology.parallel:result is None 2021-06-25T04:46:23.463 INFO:teuthology.orchestra.run.smithi161.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-06-25T04:46:23.463 INFO:teuthology.orchestra.run.smithi161.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-06-25T04:46:23.464 INFO:teuthology.orchestra.run.smithi161.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-06-25T04:46:23.464 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2021-06-25T04:46:23.465 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-06-25T04:46:23.465 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2021-06-25T04:46:23.466 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2021-06-25T04:46:23.466 INFO:teuthology.orchestra.run.smithi161.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2021-06-25T04:46:23.475 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2021-06-25T04:46:23.475 INFO:teuthology.orchestra.run.smithi161.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-06-25T04:46:23.477 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.4 [1,319 kB] 2021-06-25T04:46:23.489 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2021-06-25T04:46:23.489 INFO:teuthology.orchestra.run.smithi161.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-06-25T04:46:23.490 INFO:teuthology.orchestra.run.smithi161.stdout: libssl-dev 2021-06-25T04:46:23.491 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2021-06-25T04:46:23.491 INFO:teuthology.orchestra.run.smithi161.stdout: libssl1.1 2021-06-25T04:46:23.508 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.4_amd64.deb ... 2021-06-25T04:46:23.667 INFO:teuthology.orchestra.run.smithi161.stdout:1 upgraded, 10 newly installed, 0 to remove and 135 not upgraded. 2021-06-25T04:46:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 4,231 kB of archives. 2021-06-25T04:46:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-06-25T04:46:23.668 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-06-25T04:46:23.678 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-06-25T04:46:23.724 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-06-25T04:46:23.726 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-06-25T04:46:23.729 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.4) over (1.1.1f-1ubuntu2.2) ... 2021-06-25T04:46:23.730 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-06-25T04:46:23.734 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-06-25T04:46:23.734 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-06-25T04:46:23.737 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-06-25T04:46:23.738 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-06-25T04:46:23.738 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.4 [1,583 kB] 2021-06-25T04:46:24.093 INFO:teuthology.orchestra.run.smithi102.stdout:Preconfiguring packages ... 2021-06-25T04:46:24.123 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.4 [1,319 kB] 2021-06-25T04:46:24.244 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package bison. 2021-06-25T04:46:24.247 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 4,231 kB in 1s (4,474 kB/s) 2021-06-25T04:46:24.262 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-06-25T04:46:24.328 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-06-25T04:46:24.332 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-06-25T04:46:24.378 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-06-25T04:46:24.379 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-06-25T04:46:24.385 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-06-25T04:46:24.388 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package flex. 2021-06-25T04:46:24.389 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-06-25T04:46:24.389 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-06-25T04:46:24.391 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-06-25T04:46:24.392 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-06-25T04:46:24.392 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.4 [1,583 kB] 2021-06-25T04:46:24.448 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145542 files and directories currently installed.) 2021-06-25T04:46:24.452 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:24.496 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking flex (2.6.4-6.2) ... 2021-06-25T04:46:24.746 INFO:teuthology.orchestra.run.smithi161.stdout:Preconfiguring packages ... 2021-06-25T04:46:24.804 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-06-25T04:46:24.822 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-06-25T04:46:24.862 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-06-25T04:46:24.877 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 4,231 kB in 1s (4,433 kB/s) 2021-06-25T04:46:24.984 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package flex. 2021-06-25T04:46:25.036 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.4_amd64.deb ... 2021-06-25T04:46:25.042 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145542 files and directories currently installed.) 2021-06-25T04:46:25.046 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:25.091 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking flex (2.6.4-6.2) ... 2021-06-25T04:46:25.204 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.4) over (1.1.1f-1ubuntu2.2) ... 2021-06-25T04:46:25.257 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package dump. 2021-06-25T04:46:25.274 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-06-25T04:46:25.340 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking dump (0.4b46-6) ... 2021-06-25T04:46:25.669 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package indent. 2021-06-25T04:46:25.674 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package bison. 2021-06-25T04:46:25.686 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-06-25T04:46:25.693 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-06-25T04:46:25.699 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.4_amd64.deb ... 2021-06-25T04:46:25.727 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking indent (2.2.12-1) ... 2021-06-25T04:46:25.728 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-06-25T04:46:25.856 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.4) over (1.1.1f-1ubuntu2.2) ... 2021-06-25T04:46:26.072 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-06-25T04:46:26.093 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-06-25T04:46:26.123 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-06-25T04:46:26.131 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-06-25T04:46:26.141 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-06-25T04:46:26.181 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-06-25T04:46:26.285 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package bison. 2021-06-25T04:46:26.303 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-06-25T04:46:26.339 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-06-25T04:46:26.436 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-06-25T04:46:26.451 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-06-25T04:46:26.492 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-06-25T04:46:26.553 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package dump. 2021-06-25T04:46:26.572 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-06-25T04:46:26.610 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking dump (0.4b46-6) ... 2021-06-25T04:46:26.781 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-06-25T04:46:26.799 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2021-06-25T04:46:26.840 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-06-25T04:46:26.887 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libfl2:amd64. 2021-06-25T04:46:26.906 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:26.934 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package indent. 2021-06-25T04:46:26.945 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:26.952 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-06-25T04:46:26.993 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking indent (2.2.12-1) ... 2021-06-25T04:46:27.176 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package dump. 2021-06-25T04:46:27.193 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2021-06-25T04:46:27.235 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking dump (0.4b46-6) ... 2021-06-25T04:46:27.248 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-06-25T04:46:27.262 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-06-25T04:46:27.265 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:27.280 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-06-25T04:46:27.322 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-06-25T04:46:27.348 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:27.565 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-06-25T04:46:27.582 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-06-25T04:46:27.615 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-06-25T04:46:27.626 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-06-25T04:46:27.646 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.4_amd64.deb ... 2021-06-25T04:46:27.684 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:27.742 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package indent. 2021-06-25T04:46:27.760 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2021-06-25T04:46:27.800 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking indent (2.2.12-1) ... 2021-06-25T04:46:28.111 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-06-25T04:46:28.128 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2021-06-25T04:46:28.170 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-06-25T04:46:28.416 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-06-25T04:46:28.417 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up flex (2.6.4-6.2) ... 2021-06-25T04:46:28.430 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-06-25T04:46:28.464 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-06-25T04:46:28.517 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:28.578 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libfl2:amd64. 2021-06-25T04:46:28.596 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:28.636 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:28.793 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl2:amd64. 2021-06-25T04:46:28.813 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:28.850 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:28.857 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-06-25T04:46:28.868 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-06-25T04:46:28.874 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:28.907 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:28.994 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-06-25T04:46:29.103 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-06-25T04:46:29.119 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-06-25T04:46:29.143 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-06-25T04:46:29.145 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:29.161 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:29.163 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.4_amd64.deb ... 2021-06-25T04:46:29.201 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:29.271 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-06-25T04:46:29.415 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:29.439 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-06-25T04:46:29.458 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.4_amd64.deb ... 2021-06-25T04:46:29.497 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:29.520 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up dump (0.4b46-6) ... 2021-06-25T04:46:29.627 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-06-25T04:46:29.636 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up flex (2.6.4-6.2) ... 2021-06-25T04:46:29.683 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-06-25T04:46:29.757 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:29.758 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-06-25T04:46:29.869 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up indent (2.2.12-1) ... 2021-06-25T04:46:29.941 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up flex (2.6.4-6.2) ... 2021-06-25T04:46:29.995 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:30.043 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-06-25T04:46:30.094 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:30.147 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-06-25T04:46:30.151 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-06-25T04:46:30.298 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-06-25T04:46:30.310 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:30.403 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-06-25T04:46:30.436 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-06-25T04:46:30.529 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-06-25T04:46:30.562 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:30.656 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.4) ... 2021-06-25T04:46:30.688 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up dump (0.4b46-6) ... 2021-06-25T04:46:30.806 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-06-25T04:46:30.808 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-06-25T04:46:30.873 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-06-25T04:46:30.932 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:30.946 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-06-25T04:46:31.008 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up indent (2.2.12-1) ... 2021-06-25T04:46:31.058 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up dump (0.4b46-6) ... 2021-06-25T04:46:31.109 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:31.164 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-06-25T04:46:31.230 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-06-25T04:46:31.230 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-06-25T04:46:31.316 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-06-25T04:46:31.388 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-06-25T04:46:31.420 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up indent (2.2.12-1) ... 2021-06-25T04:46:31.546 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-06-25T04:46:31.673 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-06-25T04:46:31.824 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-06-25T04:46:32.484 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-06-25T04:46:33.194 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-06-25T04:46:33.197 DEBUG:teuthology.parallel:result is None 2021-06-25T04:46:33.581 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-06-25T04:46:33.986 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-06-25T04:46:34.512 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-06-25T04:46:34.516 DEBUG:teuthology.parallel:result is None 2021-06-25T04:46:34.705 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-06-25T04:46:34.707 DEBUG:teuthology.parallel:result is None 2021-06-25T04:46:34.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo lsb_release -is 2021-06-25T04:46:34.760 INFO:teuthology.orchestra.run.smithi057.stdout:Ubuntu 2021-06-25T04:46:34.766 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:46:34.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=da5e8184007182fa3cd5c8385fee4e08c5620fe2 2021-06-25T04:46:34.921 DEBUG:teuthology.orchestra.run.smithi057:> dpkg-query -W -f '${Version}' ceph 2021-06-25T04:46:34.944 INFO:teuthology.orchestra.run.smithi057.stdout:15.2.13-65-gda5e8184-1focal 2021-06-25T04:46:34.945 INFO:teuthology.packaging:The installed version of ceph is 15.2.13-65-gda5e8184-1focal 2021-06-25T04:46:34.945 INFO:teuthology.task.install:The correct ceph version 15.2.13-65-gda5e8184-1focal is installed. 2021-06-25T04:46:34.946 DEBUG:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2021-06-25T04:46:34.998 INFO:teuthology.orchestra.run.smithi087.stdout:Ubuntu 2021-06-25T04:46:35.004 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:46:35.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=da5e8184007182fa3cd5c8385fee4e08c5620fe2 2021-06-25T04:46:35.159 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-query -W -f '${Version}' ceph 2021-06-25T04:46:35.183 INFO:teuthology.orchestra.run.smithi087.stdout:15.2.13-65-gda5e8184-1focal 2021-06-25T04:46:35.184 INFO:teuthology.packaging:The installed version of ceph is 15.2.13-65-gda5e8184-1focal 2021-06-25T04:46:35.184 INFO:teuthology.task.install:The correct ceph version 15.2.13-65-gda5e8184-1focal is installed. 2021-06-25T04:46:35.184 DEBUG:teuthology.orchestra.run.smithi102:> sudo lsb_release -is 2021-06-25T04:46:35.238 INFO:teuthology.orchestra.run.smithi102.stdout:Ubuntu 2021-06-25T04:46:35.243 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:46:35.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=da5e8184007182fa3cd5c8385fee4e08c5620fe2 2021-06-25T04:46:35.395 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-query -W -f '${Version}' ceph 2021-06-25T04:46:35.418 INFO:teuthology.orchestra.run.smithi102.stdout:15.2.13-65-gda5e8184-1focal 2021-06-25T04:46:35.419 INFO:teuthology.packaging:The installed version of ceph is 15.2.13-65-gda5e8184-1focal 2021-06-25T04:46:35.419 INFO:teuthology.task.install:The correct ceph version 15.2.13-65-gda5e8184-1focal is installed. 2021-06-25T04:46:35.419 DEBUG:teuthology.orchestra.run.smithi161:> sudo lsb_release -is 2021-06-25T04:46:35.468 INFO:teuthology.orchestra.run.smithi161.stdout:Ubuntu 2021-06-25T04:46:35.473 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-06-25T04:46:35.474 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=da5e8184007182fa3cd5c8385fee4e08c5620fe2 2021-06-25T04:46:35.624 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-query -W -f '${Version}' ceph 2021-06-25T04:46:35.647 INFO:teuthology.orchestra.run.smithi161.stdout:15.2.13-65-gda5e8184-1focal 2021-06-25T04:46:35.648 INFO:teuthology.packaging:The installed version of ceph is 15.2.13-65-gda5e8184-1focal 2021-06-25T04:46:35.649 INFO:teuthology.task.install:The correct ceph version 15.2.13-65-gda5e8184-1focal is installed. 2021-06-25T04:46:35.649 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-06-25T04:46:35.650 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2021-06-25T04:46:35.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-06-25T04:46:35.667 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-06-25T04:46:35.668 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-06-25T04:46:35.687 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-06-25T04:46:35.687 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-06-25T04:46:35.705 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-06-25T04:46:35.705 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-06-25T04:46:35.722 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-06-25T04:46:35.722 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2021-06-25T04:46:35.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2021-06-25T04:46:35.743 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-06-25T04:46:35.754 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-06-25T04:46:35.754 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2021-06-25T04:46:35.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-06-25T04:46:35.829 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-06-25T04:46:35.830 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2021-06-25T04:46:35.847 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-06-25T04:46:35.908 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-06-25T04:46:35.908 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2021-06-25T04:46:35.925 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-06-25T04:46:35.940 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-06-25T04:46:35.940 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2021-06-25T04:46:35.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2021-06-25T04:46:35.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-06-25T04:46:35.972 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-06-25T04:46:35.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2021-06-25T04:46:35.990 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-06-25T04:46:36.001 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-06-25T04:46:36.001 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2021-06-25T04:46:36.017 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-06-25T04:46:36.075 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-06-25T04:46:36.075 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2021-06-25T04:46:36.096 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-06-25T04:46:36.108 INFO:teuthology.run_tasks:Running task ceph... 2021-06-25T04:46:36.175 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-06-25T04:46:36.176 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2021-06-25T04:46:36.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2021-06-25T04:46:36.185 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2021-06-25T04:46:36.188 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2021-06-25T04:46:36.205 INFO:tasks.ceph:Disabling ceph logrotate... 2021-06-25T04:46:36.205 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2021-06-25T04:46:36.208 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2021-06-25T04:46:36.211 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2021-06-25T04:46:36.247 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2021-06-25T04:46:36.263 INFO:tasks.ceph:Creating extra log directories... 2021-06-25T04:46:36.264 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-06-25T04:46:36.266 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-06-25T04:46:36.268 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-06-25T04:46:36.271 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-06-25T04:46:36.285 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-06-25T04:46:36.286 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-06-25T04:46:36.286 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-06-25T04:46:36.287 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2021-06-25T04:46:36.287 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-06-25T04:46:36.295 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-06-25T04:46:36.388 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-06-25T04:46:36.389 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-06-25T04:46:36.398 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-06-25T04:46:36.481 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-06-25T04:46:36.482 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-06-25T04:46:36.489 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-06-25T04:46:36.569 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-06-25T04:46:36.569 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-06-25T04:46:36.577 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-06-25T04:46:36.615 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-06-25T04:46:36.616 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Failed to load ceph-mgr modules: rook', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-06-25T04:46:36.617 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131', 'branch': 'wip-yuri8-testing-2021-06-15-0839-octopus', 'description': 'fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6189131', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri8-testing-2021-06-15-0839-octopus'}, 'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Failed to load ceph-mgr modules: rook', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'da5e8184007182fa3cd5c8385fee4e08c5620fe2'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'da5e8184007182fa3cd5c8385fee4e08c5620fe2'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri8-testing-2021-06-15-0839-octopus', 'sha1': 'da5e8184007182fa3cd5c8385fee4e08c5620fe2'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1']], 'sha1': 'da5e8184007182fa3cd5c8385fee4e08c5620fe2', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-yuri8-testing-2021-06-15-0839-octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'da5e8184007182fa3cd5c8385fee4e08c5620fe2', 'targets': {'smithi057.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxNRJdwZ8qWkd76W33yYVdCdwy7AGc9yGTVze1oPLAhkcYQdMjQlOXSrVyUSaugk3Uow5ECfT0yJfoBT5iZZecKyzcVgpYSUQqJeIqiFj/RksWmQM8eW7Uy+l4MsB1mJHE1sKDfyqn/CBDLsK/8HoYJSUiYQ042QgcghIJw0rKt8eby94joKczEcezrD9QZV+x5FjWqSoE0+Qb6n0Pma56B2+ivwlNqwCEGACX/7AnkI6T76fU3INnJpJlihhfLKbL2k8c1H4Iew9y6KZh0Lif2zX+tRblpmjkEKh52tz1UlFr4brFKIzfx7LIyw950bIBxcILOkEJ5pJ/5BzL5TBmxx7DxfIOzdCRQR0DGkvz5vMvysU37HapLga3qjmtgXjwYlRlDMalwfzIVX3g8B9R37wAafq6TlEtl/Wiwfzt8JqtweyIfucxjNLr6hzV8IXaUZSmOeRsFdoM1HkMdP2Q8tGQQ0ctgwHDaId1emPEnzO0FNe27oRmsKrMIjcTaAE=', 'smithi087.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2E15/YMeBN9WNGqFUJZsNh8keujEt8r1lr9+wcxx3WQ9ft88rkjOua1r3eWg3ODo+zzc3gAtBLnEEHzgzUtsXDbb8lv46aPQe4ZnXC7sNDyIqfDvL2IL9rfi4Pj/mqktmsnHu5qXuMP9szsQGryEn9cTSY3LM4dt19mRGWTXKbBer6aD132UfiT1RhsZXi1mV+KmfZepESllN6dAcNpcaGj8YEZEWUf1JKH71Pd8WlIHaeN4ovScIl4I9cu2dTo6eDp6bVvQ/yJTmBrbm/HukQOtE8WydwevQh2ct4CzuUYyJkdyUfbor++t8P2QgF/Ua8DA+dEAFa/88QTeOjcnWZm6xFQZsF/YCDzhOev0NHdyducIy4rS5Hf9ekfkLv/CdTWQAe15qaFxSrFQZ4qnlZWKSV87VCequ2Tn8XSHsix8+DEYdUdE24mJpugECPe3co/Y3p9/JG6RgjNBzCarjzE9ba5jGns4jWga09VjP/BGeylNazilqYRG+WduIOLU=', 'smithi102.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEoDdSlBe9ADvXwxDqxpFSATUzeH6oQAAxsyyXEJkSspGfp14xsBSzxXnT4BfWHPWEu0D0KIYRfWvcO75Z3FDEGPMA12P3ep5MONSRsri1vk5JSs7xY/i4rZYqBjmlqHPgsGW2kYRBlJpwHt/QFqMkIQRwKLkHwOknzF5K76tzYthU61RHTNrUITA5C1vZZ1PzzTSyK7+O5JMp+1ib9RIkT9O1GhqWt/vS1vtrlvmNomFuxQsocUweqS40AdUpa/a0ixZQihjBWxr1WkQ7q7G0/wwk3EspBRN/eeAsidMLTGdVJ0VbSn03kATt2r2m6UgfHl9Q+VPK9LQwPPp3cvcglSbQ9Hxl5ronv42T05RFK5kiNf0uOP5fHCW5rKzOEZrfzeQlYH28zCU6YS03T2ICxlzt7skeL9aNiBE12Ov2F764MxSy/wTyeeOKjHPv6hktnIz6g6rcvPxfJb7OTZdZPDNFMAki18uhlYZEeb7TE6jsG8NpMbKrUjEpI2Cetvc=', 'smithi161.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHXYur8GmvgBntwtmSWCpFjY+8ImwVk/N/7i1SXZL7j8aRZTlglZ8KavO4PdOhVg7VacIaBygIgj1HfH8TwNnlacQGbC6QbIe7b6rhbFSAKiIAwmy5z71Z0XSHY8DhLb/UcUkqTyqYv5WTwWSAa2MK4DMTbsvrfUgvnzzn9Sbj01ZSJDUp3kFcV4FG8BNNm0hK1YMUDL2xE4A00RqwhdPgO1Hf41YfvfS+V4xIJfAW8B2Kbj47tyWHaBuPjXnVVS1Zsf2ogx5qxU6SDlU8A1LPkKwG/mvax3KMipQWSKw4ER1Q9wZPS98AXvAzQzMCZsAP/r0d7QMJiKaZNh6471MLItoUrt1+yOjJJYfsKKdW67k3mj6xxHH48z8bLMAe1YUmMSoZE5KJpM4u+DHblG8HeHRQ/C9MzDss4QIJ4yQY5MEQ6xOLJgJ1d2H+0LU1byBGJ8Idsji/3EG4qWb5VrINCvdgo4+F6G6XCgglwH0Y3Rw+6opg+9c2vpc7uhgMyic='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'da5e8184007182fa3cd5c8385fee4e08c5620fe2'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'teuthology_sha1': '26631ede9027a5643f2e47dacc5af6f1834aac45', 'timestamp': '2021-06-24_14:36:33', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.8274'} 2021-06-25T04:46:36.619 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-06-25T04:46:36.622 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-06-25T04:46:36.625 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-06-25T04:46:36.628 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-06-25T04:46:36.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2021-06-25T04:46:36.669 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2021-06-25T04:46:36.672 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2021-06-25T04:46:36.674 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2021-06-25T04:46:36.691 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2021-06-25T04:46:36.692 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2021-06-25T04:46:36.733 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-06-25T04:46:36.733 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-06-25T04:46:36.740 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-06-25T04:46:36.741 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-06-25T04:46:36.741 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 343 Links: 1 2021-06-25T04:46:36.741 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-06-25T04:46:36.741 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2021-06-25 04:43:09.795746008 +0000 2021-06-25T04:46:36.742 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2021-06-25 04:43:09.631746008 +0000 2021-06-25T04:46:36.742 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2021-06-25 04:43:09.631746008 +0000 2021-06-25T04:46:36.742 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2021-06-25T04:46:36.751 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2021-06-25T04:46:36.751 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2021-06-25T04:46:36.752 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000527127 s, 971 kB/s 2021-06-25T04:46:36.756 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-06-25T04:46:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-06-25T04:46:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-06-25T04:46:36.763 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 351 Links: 1 2021-06-25T04:46:36.764 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-06-25T04:46:36.764 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2021-06-25 04:43:10.187746008 +0000 2021-06-25T04:46:36.764 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2021-06-25 04:43:10.027746008 +0000 2021-06-25T04:46:36.764 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2021-06-25 04:43:10.027746008 +0000 2021-06-25T04:46:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2021-06-25T04:46:36.773 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2021-06-25T04:46:36.773 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2021-06-25T04:46:36.773 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.00047415 s, 1.1 MB/s 2021-06-25T04:46:36.777 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-06-25T04:46:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-06-25T04:46:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-06-25T04:46:36.826 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-06-25T04:46:36.826 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-06-25T04:46:36.827 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2021-06-25 04:43:10.615746008 +0000 2021-06-25T04:46:36.827 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2021-06-25 04:43:10.475746008 +0000 2021-06-25T04:46:36.827 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2021-06-25 04:43:10.475746008 +0000 2021-06-25T04:46:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2021-06-25T04:46:36.836 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2021-06-25T04:46:36.836 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2021-06-25T04:46:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000464741 s, 1.1 MB/s 2021-06-25T04:46:36.841 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-06-25T04:46:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-06-25T04:46:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-06-25T04:46:36.848 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 363 Links: 1 2021-06-25T04:46:36.848 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-06-25T04:46:36.848 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2021-06-25 04:43:10.907746009 +0000 2021-06-25T04:46:36.849 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2021-06-25 04:43:10.903746009 +0000 2021-06-25T04:46:36.849 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2021-06-25 04:43:10.903746009 +0000 2021-06-25T04:46:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2021-06-25T04:46:36.857 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2021-06-25T04:46:36.858 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2021-06-25T04:46:36.858 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000462603 s, 1.1 MB/s 2021-06-25T04:46:36.862 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-06-25T04:46:36.862 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-06-25T04:46:36.863 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2021-06-25T04:46:36.870 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-06-25T04:46:36.870 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-06-25T04:46:36.878 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-06-25T04:46:36.878 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-06-25T04:46:36.878 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-06-25T04:46:36.878 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-06-25T04:46:36.879 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2021-06-25 04:43:07.256650395 +0000 2021-06-25T04:46:36.879 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2021-06-25 04:43:07.252650395 +0000 2021-06-25T04:46:36.879 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2021-06-25 04:43:07.252650395 +0000 2021-06-25T04:46:36.879 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2021-06-25T04:46:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2021-06-25T04:46:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2021-06-25T04:46:36.889 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000421834 s, 1.2 MB/s 2021-06-25T04:46:36.893 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-06-25T04:46:36.941 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-06-25T04:46:36.941 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-06-25T04:46:36.942 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-06-25T04:46:36.942 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-06-25T04:46:36.942 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2021-06-25 04:43:07.816650413 +0000 2021-06-25T04:46:36.942 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2021-06-25 04:43:07.640650408 +0000 2021-06-25T04:46:36.943 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2021-06-25 04:43:07.640650408 +0000 2021-06-25T04:46:36.943 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2021-06-25T04:46:36.951 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2021-06-25T04:46:36.951 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2021-06-25T04:46:36.951 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000383498 s, 1.3 MB/s 2021-06-25T04:46:36.955 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-06-25T04:46:36.961 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-06-25T04:46:36.962 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-06-25T04:46:36.962 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-06-25T04:46:36.962 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-06-25T04:46:36.962 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2021-06-25 04:43:08.052650421 +0000 2021-06-25T04:46:36.963 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2021-06-25 04:43:08.048650421 +0000 2021-06-25T04:46:36.963 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2021-06-25 04:43:08.048650421 +0000 2021-06-25T04:46:36.963 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2021-06-25T04:46:36.971 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2021-06-25T04:46:36.972 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2021-06-25T04:46:36.972 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000349398 s, 1.5 MB/s 2021-06-25T04:46:36.977 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-06-25T04:46:36.983 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-06-25T04:46:36.983 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-06-25T04:46:36.983 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 368 Links: 1 2021-06-25T04:46:36.984 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-06-25T04:46:36.984 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2021-06-25 04:43:08.448650434 +0000 2021-06-25T04:46:36.985 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2021-06-25 04:43:08.444650433 +0000 2021-06-25T04:46:36.985 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2021-06-25 04:43:08.444650433 +0000 2021-06-25T04:46:36.985 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2021-06-25T04:46:36.992 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2021-06-25T04:46:36.992 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2021-06-25T04:46:36.993 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000346689 s, 1.5 MB/s 2021-06-25T04:46:36.997 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-06-25T04:46:36.997 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-06-25T04:46:36.998 INFO:tasks.ceph:Generating config... 2021-06-25T04:46:36.999 INFO:tasks.ceph:[client] client mount timeout = 600 2021-06-25T04:46:37.000 INFO:tasks.ceph:[client] debug client = 20 2021-06-25T04:46:37.000 INFO:tasks.ceph:[client] debug ms = 1 2021-06-25T04:46:37.000 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-06-25T04:46:37.001 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-06-25T04:46:37.001 INFO:tasks.ceph:[mds] debug mds = 20 2021-06-25T04:46:37.001 INFO:tasks.ceph:[mds] debug ms = 1 2021-06-25T04:46:37.002 INFO:tasks.ceph:[mds] mds bal frag = True 2021-06-25T04:46:37.002 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-06-25T04:46:37.002 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-06-25T04:46:37.003 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-06-25T04:46:37.003 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-06-25T04:46:37.003 INFO:tasks.ceph:[mds] mds debug frag = True 2021-06-25T04:46:37.004 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-06-25T04:46:37.004 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-06-25T04:46:37.004 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-06-25T04:46:37.005 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-06-25T04:46:37.005 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-06-25T04:46:37.006 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-06-25T04:46:37.006 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-06-25T04:46:37.006 INFO:tasks.ceph:[mgr] debug ms = 1 2021-06-25T04:46:37.007 INFO:tasks.ceph:[mon] debug mon = 20 2021-06-25T04:46:37.007 INFO:tasks.ceph:[mon] debug ms = 1 2021-06-25T04:46:37.007 INFO:tasks.ceph:[mon] debug paxos = 20 2021-06-25T04:46:37.007 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-06-25T04:46:37.008 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-06-25T04:46:37.008 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2021-06-25T04:46:37.008 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-06-25T04:46:37.009 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-06-25T04:46:37.009 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-06-25T04:46:37.009 INFO:tasks.ceph:[osd] debug ms = 1 2021-06-25T04:46:37.009 INFO:tasks.ceph:[osd] debug osd = 20 2021-06-25T04:46:37.010 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-06-25T04:46:37.010 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-06-25T04:46:37.010 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-06-25T04:46:37.011 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-06-25T04:46:37.011 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-06-25T04:46:37.011 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-06-25T04:46:37.012 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-06-25T04:46:37.012 INFO:tasks.ceph:Setting up mon.a... 2021-06-25T04:46:37.012 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-06-25T04:46:37.059 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2021-06-25T04:46:37.062 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-06-25T04:46:37.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-06-25T04:46:37.154 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57'), ('mon.b', '172.21.15.87'), ('mon.c', '[v2:172.21.15.87:3301,v1:172.21.15.87:6790]')] 2021-06-25T04:46:37.155 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.57 --add b 172.21.15.87 --addv c '[v2:172.21.15.87:3301,v1:172.21.15.87:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:37.188 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:37.188 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:46:37.189 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2021-06-25T04:46:37.189 INFO:teuthology.orchestra.run.smithi057.stdout:fsid d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:46:37.189 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2021-06-25T04:46:37.186399+0000 2021-06-25T04:46:37.189 INFO:teuthology.orchestra.run.smithi057.stdout:created 2021-06-25T04:46:37.186399+0000 2021-06-25T04:46:37.190 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 0 (unknown) 2021-06-25T04:46:37.190 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2021-06-25T04:46:37.191 INFO:teuthology.orchestra.run.smithi057.stdout:1: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.b 2021-06-25T04:46:37.191 INFO:teuthology.orchestra.run.smithi057.stdout:2: [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] mon.c 2021-06-25T04:46:37.191 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-06-25T04:46:37.192 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d067c0ce-62d7-4088-9fe1-bc0002e5c6e5... 2021-06-25T04:46:37.193 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:46:37.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:46:37.199 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:46:37.202 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:46:37.231 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2021-06-25T04:46:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2021-06-25T04:46:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:46:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2021-06-25T04:46:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2021-06-25T04:46:37.233 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.233 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2021-06-25T04:46:37.233 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.233 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2021-06-25T04:46:37.234 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2021-06-25T04:46:37.234 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.234 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2021-06-25T04:46:37.234 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2021-06-25T04:46:37.235 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.235 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:46:37.235 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2021-06-25T04:46:37.235 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.236 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:46:37.236 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:46:37.236 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.236 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2021-06-25T04:46:37.237 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.237 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2021-06-25T04:46:37.237 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2021-06-25T04:46:37.237 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:46:37.237 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:46:37.238 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2021-06-25T04:46:37.238 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:46:37.238 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2021-06-25T04:46:37.238 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:46:37.239 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:46:37.239 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.240 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:46:37.240 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.240 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2021-06-25T04:46:37.240 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.240 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2021-06-25T04:46:37.241 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.241 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2021-06-25T04:46:37.241 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2021-06-25T04:46:37.241 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2021-06-25T04:46:37.242 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:46:37.242 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:46:37.242 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.242 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2021-06-25T04:46:37.242 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2021-06-25T04:46:37.243 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.243 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2021-06-25T04:46:37.243 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2021-06-25T04:46:37.243 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.244 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2021-06-25T04:46:37.244 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2021-06-25T04:46:37.244 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.244 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2021-06-25T04:46:37.244 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2021-06-25T04:46:37.245 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2021-06-25T04:46:37.245 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.245 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2021-06-25T04:46:37.245 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2021-06-25T04:46:37.245 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.246 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:46:37.246 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.246 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2021-06-25T04:46:37.246 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.247 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2021-06-25T04:46:37.247 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.247 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:46:37.247 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2021-06-25T04:46:37.247 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.248 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2021-06-25T04:46:37.248 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2021-06-25T04:46:37.248 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2021-06-25T04:46:37.248 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore compression mode = aggressive 2021-06-25T04:46:37.249 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2021-06-25T04:46:37.249 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 20 2021-06-25T04:46:37.250 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 20 2021-06-25T04:46:37.251 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:46:37.251 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2021-06-25T04:46:37.254 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 10 2021-06-25T04:46:37.254 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:46:37.254 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2021-06-25T04:46:37.254 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:46:37.255 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:46:37.255 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2021-06-25T04:46:37.255 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2021-06-25T04:46:37.255 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.256 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2021-06-25T04:46:37.256 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:46:37.256 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2021-06-25T04:46:37.256 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2021-06-25T04:46:37.256 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2021-06-25T04:46:37.257 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:46:37.257 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:46:37.257 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2021-06-25T04:46:37.257 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.258 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2021-06-25T04:46:37.258 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:46:37.258 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2021-06-25T04:46:37.258 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2021-06-25T04:46:37.258 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2021-06-25T04:46:37.259 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2021-06-25T04:46:37.259 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2021-06-25T04:46:37.259 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:46:37.259 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2021-06-25T04:46:37.260 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2021-06-25T04:46:37.260 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:46:37.260 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.260 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:46:37.261 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:46:37.261 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:46:37.261 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.261 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:46:37.261 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:46:37.262 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:46:37.262 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2021-06-25T04:46:37.262 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:46:37.262 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2021-06-25T04:46:37.263 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2021-06-25T04:46:37.263 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2021-06-25T04:46:37.263 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2021-06-25T04:46:37.263 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:46:37.264 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:46:37.264 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2021-06-25T04:46:37.264 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2021-06-25T04:46:37.264 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:46:37.264 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 15m 2021-06-25T04:46:37.265 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 15m 2021-06-25T04:46:37.265 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2021-06-25T04:46:37.265 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2021-06-25T04:46:37.265 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2021-06-25T04:46:37.266 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2021-06-25T04:46:37.266 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2021-06-25T04:46:37.266 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2021-06-25T04:46:37.266 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2021-06-25T04:46:37.267 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2021-06-25T04:46:37.267 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:46:37.267 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal frag = True 2021-06-25T04:46:37.267 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal fragment size max = 10000 2021-06-25T04:46:37.267 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal merge size = 5 2021-06-25T04:46:37.268 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal split bits = 3 2021-06-25T04:46:37.268 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal split size = 100 2021-06-25T04:46:37.268 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2021-06-25T04:46:37.268 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2021-06-25T04:46:37.269 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2021-06-25T04:46:37.269 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2021-06-25T04:46:37.269 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2021-06-25T04:46:37.269 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 15m 2021-06-25T04:46:37.269 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 15m 2021-06-25T04:46:37.272 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2021-06-25T04:46:37.273 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2021-06-25T04:46:37.273 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:46:37.273 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2021-06-25T04:46:37.273 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.274 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2021-06-25T04:46:37.274 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.274 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2021-06-25T04:46:37.274 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.275 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2021-06-25T04:46:37.275 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2021-06-25T04:46:37.275 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.275 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2021-06-25T04:46:37.276 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2021-06-25T04:46:37.276 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.276 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:46:37.277 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2021-06-25T04:46:37.277 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.278 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:46:37.278 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:46:37.278 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.278 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2021-06-25T04:46:37.279 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.279 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2021-06-25T04:46:37.279 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2021-06-25T04:46:37.279 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:46:37.280 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:46:37.280 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2021-06-25T04:46:37.280 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:46:37.280 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2021-06-25T04:46:37.280 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:46:37.281 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:46:37.281 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.281 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:46:37.281 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.282 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2021-06-25T04:46:37.282 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.282 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2021-06-25T04:46:37.282 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.282 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2021-06-25T04:46:37.283 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2021-06-25T04:46:37.283 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2021-06-25T04:46:37.283 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:46:37.283 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:46:37.284 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.284 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2021-06-25T04:46:37.284 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2021-06-25T04:46:37.284 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.285 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2021-06-25T04:46:37.285 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2021-06-25T04:46:37.285 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.285 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2021-06-25T04:46:37.286 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2021-06-25T04:46:37.286 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.286 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2021-06-25T04:46:37.286 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2021-06-25T04:46:37.286 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2021-06-25T04:46:37.287 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.287 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2021-06-25T04:46:37.287 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2021-06-25T04:46:37.287 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.288 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:46:37.288 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.288 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2021-06-25T04:46:37.289 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.289 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2021-06-25T04:46:37.289 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.289 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:46:37.289 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2021-06-25T04:46:37.290 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.290 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2021-06-25T04:46:37.290 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2021-06-25T04:46:37.290 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2021-06-25T04:46:37.291 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore compression mode = aggressive 2021-06-25T04:46:37.291 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2021-06-25T04:46:37.291 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 20 2021-06-25T04:46:37.291 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 20 2021-06-25T04:46:37.292 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:46:37.292 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2021-06-25T04:46:37.292 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 10 2021-06-25T04:46:37.292 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:46:37.292 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2021-06-25T04:46:37.293 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:46:37.293 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:46:37.293 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2021-06-25T04:46:37.293 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2021-06-25T04:46:37.294 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.294 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2021-06-25T04:46:37.294 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:46:37.294 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2021-06-25T04:46:37.294 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2021-06-25T04:46:37.295 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2021-06-25T04:46:37.295 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:46:37.295 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:46:37.295 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2021-06-25T04:46:37.296 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.296 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2021-06-25T04:46:37.296 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:46:37.296 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2021-06-25T04:46:37.296 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2021-06-25T04:46:37.297 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2021-06-25T04:46:37.297 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2021-06-25T04:46:37.297 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2021-06-25T04:46:37.297 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:46:37.297 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2021-06-25T04:46:37.298 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2021-06-25T04:46:37.298 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:46:37.298 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.299 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:46:37.299 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:46:37.299 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:46:37.299 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.300 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:46:37.300 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:46:37.300 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:46:37.300 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2021-06-25T04:46:37.300 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:46:37.301 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2021-06-25T04:46:37.301 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2021-06-25T04:46:37.301 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2021-06-25T04:46:37.301 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2021-06-25T04:46:37.302 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:46:37.302 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:46:37.302 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2021-06-25T04:46:37.302 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2021-06-25T04:46:37.303 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:46:37.303 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 15m 2021-06-25T04:46:37.303 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 15m 2021-06-25T04:46:37.303 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2021-06-25T04:46:37.303 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2021-06-25T04:46:37.304 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2021-06-25T04:46:37.304 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2021-06-25T04:46:37.304 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2021-06-25T04:46:37.304 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2021-06-25T04:46:37.304 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2021-06-25T04:46:37.305 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2021-06-25T04:46:37.305 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:46:37.305 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal frag = True 2021-06-25T04:46:37.305 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal fragment size max = 10000 2021-06-25T04:46:37.306 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal merge size = 5 2021-06-25T04:46:37.306 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal split bits = 3 2021-06-25T04:46:37.306 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal split size = 100 2021-06-25T04:46:37.306 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2021-06-25T04:46:37.307 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2021-06-25T04:46:37.307 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2021-06-25T04:46:37.307 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2021-06-25T04:46:37.307 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2021-06-25T04:46:37.308 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 15m 2021-06-25T04:46:37.308 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 15m 2021-06-25T04:46:37.308 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2021-06-25T04:46:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2021-06-25T04:46:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:46:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2021-06-25T04:46:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.309 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2021-06-25T04:46:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2021-06-25T04:46:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.310 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2021-06-25T04:46:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2021-06-25T04:46:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2021-06-25T04:46:37.311 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2021-06-25T04:46:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:46:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2021-06-25T04:46:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.312 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:46:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:46:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2021-06-25T04:46:37.313 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2021-06-25T04:46:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2021-06-25T04:46:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:46:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:46:37.314 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2021-06-25T04:46:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:46:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2021-06-25T04:46:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:46:37.315 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:46:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:46:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2021-06-25T04:46:37.316 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2021-06-25T04:46:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2021-06-25T04:46:37.317 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2021-06-25T04:46:37.318 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2021-06-25T04:46:37.318 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:46:37.318 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:46:37.318 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2021-06-25T04:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2021-06-25T04:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2021-06-25T04:46:37.320 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2021-06-25T04:46:37.320 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.320 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2021-06-25T04:46:37.320 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2021-06-25T04:46:37.320 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2021-06-25T04:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2021-06-25T04:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2021-06-25T04:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2021-06-25T04:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2021-06-25T04:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.323 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2021-06-25T04:46:37.323 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.323 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2021-06-25T04:46:37.323 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.324 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:46:37.324 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2021-06-25T04:46:37.324 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.324 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2021-06-25T04:46:37.324 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2021-06-25T04:46:37.325 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2021-06-25T04:46:37.325 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore compression mode = aggressive 2021-06-25T04:46:37.325 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2021-06-25T04:46:37.325 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2021-06-25T04:46:37.325 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2021-06-25T04:46:37.326 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:46:37.326 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2021-06-25T04:46:37.326 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2021-06-25T04:46:37.326 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:46:37.327 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2021-06-25T04:46:37.327 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:46:37.327 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:46:37.327 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2021-06-25T04:46:37.327 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-06-25T04:46:37.328 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.328 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2021-06-25T04:46:37.328 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:46:37.328 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2021-06-25T04:46:37.329 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-06-25T04:46:37.329 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-06-25T04:46:37.329 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:46:37.329 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:46:37.329 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2021-06-25T04:46:37.330 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.330 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2021-06-25T04:46:37.330 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:46:37.330 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-06-25T04:46:37.331 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2021-06-25T04:46:37.331 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-06-25T04:46:37.331 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2021-06-25T04:46:37.331 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2021-06-25T04:46:37.331 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:46:37.332 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2021-06-25T04:46:37.332 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2021-06-25T04:46:37.332 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:46:37.332 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.333 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:46:37.333 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:46:37.333 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:46:37.333 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.333 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:46:37.334 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:46:37.334 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:46:37.334 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2021-06-25T04:46:37.334 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:46:37.335 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2021-06-25T04:46:37.335 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2021-06-25T04:46:37.335 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2021-06-25T04:46:37.335 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2021-06-25T04:46:37.335 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:46:37.336 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:46:37.336 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2021-06-25T04:46:37.336 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2021-06-25T04:46:37.336 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:46:37.336 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-06-25T04:46:37.337 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-06-25T04:46:37.337 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2021-06-25T04:46:37.337 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2021-06-25T04:46:37.337 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2021-06-25T04:46:37.338 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2021-06-25T04:46:37.338 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2021-06-25T04:46:37.338 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2021-06-25T04:46:37.338 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2021-06-25T04:46:37.338 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2021-06-25T04:46:37.339 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:46:37.339 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal frag = True 2021-06-25T04:46:37.339 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal fragment size max = 10000 2021-06-25T04:46:37.339 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal merge size = 5 2021-06-25T04:46:37.339 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split bits = 3 2021-06-25T04:46:37.340 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split size = 100 2021-06-25T04:46:37.340 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2021-06-25T04:46:37.340 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2021-06-25T04:46:37.340 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2021-06-25T04:46:37.341 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2021-06-25T04:46:37.341 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-06-25T04:46:37.341 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-06-25T04:46:37.341 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-06-25T04:46:37.341 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2021-06-25T04:46:37.342 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2021-06-25T04:46:37.342 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:46:37.342 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2021-06-25T04:46:37.342 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.343 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2021-06-25T04:46:37.343 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.343 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2021-06-25T04:46:37.343 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.343 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2021-06-25T04:46:37.344 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2021-06-25T04:46:37.344 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.344 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2021-06-25T04:46:37.344 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2021-06-25T04:46:37.345 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.345 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:46:37.345 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2021-06-25T04:46:37.345 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.345 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:46:37.346 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:46:37.346 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.346 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2021-06-25T04:46:37.346 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.346 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2021-06-25T04:46:37.347 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2021-06-25T04:46:37.347 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:46:37.347 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:46:37.347 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2021-06-25T04:46:37.348 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:46:37.348 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2021-06-25T04:46:37.348 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:46:37.348 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:46:37.348 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.349 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:46:37.349 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.349 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2021-06-25T04:46:37.349 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.349 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2021-06-25T04:46:37.350 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.350 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2021-06-25T04:46:37.350 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2021-06-25T04:46:37.350 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2021-06-25T04:46:37.351 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:46:37.351 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:46:37.351 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.351 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2021-06-25T04:46:37.351 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2021-06-25T04:46:37.352 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.352 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2021-06-25T04:46:37.352 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2021-06-25T04:46:37.352 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.353 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2021-06-25T04:46:37.353 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2021-06-25T04:46:37.353 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.353 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2021-06-25T04:46:37.353 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2021-06-25T04:46:37.354 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2021-06-25T04:46:37.354 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.354 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2021-06-25T04:46:37.354 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2021-06-25T04:46:37.354 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.355 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:46:37.355 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.355 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2021-06-25T04:46:37.355 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.355 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2021-06-25T04:46:37.356 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.356 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:46:37.356 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2021-06-25T04:46:37.356 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.357 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2021-06-25T04:46:37.357 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2021-06-25T04:46:37.357 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2021-06-25T04:46:37.357 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore compression mode = aggressive 2021-06-25T04:46:37.357 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2021-06-25T04:46:37.358 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 20 2021-06-25T04:46:37.358 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 20 2021-06-25T04:46:37.358 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:46:37.358 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2021-06-25T04:46:37.358 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 10 2021-06-25T04:46:37.359 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:46:37.359 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2021-06-25T04:46:37.359 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:46:37.359 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:46:37.360 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2021-06-25T04:46:37.360 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2021-06-25T04:46:37.360 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.360 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2021-06-25T04:46:37.360 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:46:37.361 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2021-06-25T04:46:37.361 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2021-06-25T04:46:37.361 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2021-06-25T04:46:37.361 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:46:37.362 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:46:37.362 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2021-06-25T04:46:37.362 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.362 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2021-06-25T04:46:37.362 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:46:37.363 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2021-06-25T04:46:37.363 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2021-06-25T04:46:37.363 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2021-06-25T04:46:37.363 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2021-06-25T04:46:37.363 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2021-06-25T04:46:37.364 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:46:37.364 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2021-06-25T04:46:37.364 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2021-06-25T04:46:37.364 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:46:37.365 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.365 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:46:37.365 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:46:37.365 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:46:37.365 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.366 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:46:37.366 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:46:37.366 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:46:37.366 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2021-06-25T04:46:37.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:46:37.367 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2021-06-25T04:46:37.367 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2021-06-25T04:46:37.367 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2021-06-25T04:46:37.367 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2021-06-25T04:46:37.368 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:46:37.368 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:46:37.368 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2021-06-25T04:46:37.368 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2021-06-25T04:46:37.369 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:46:37.369 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 15m 2021-06-25T04:46:37.369 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 15m 2021-06-25T04:46:37.369 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2021-06-25T04:46:37.369 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2021-06-25T04:46:37.370 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2021-06-25T04:46:37.370 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2021-06-25T04:46:37.370 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2021-06-25T04:46:37.370 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2021-06-25T04:46:37.370 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2021-06-25T04:46:37.371 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2021-06-25T04:46:37.371 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:46:37.371 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal frag = True 2021-06-25T04:46:37.371 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal fragment size max = 10000 2021-06-25T04:46:37.372 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal merge size = 5 2021-06-25T04:46:37.372 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split bits = 3 2021-06-25T04:46:37.372 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split size = 100 2021-06-25T04:46:37.372 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2021-06-25T04:46:37.372 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2021-06-25T04:46:37.373 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2021-06-25T04:46:37.373 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2021-06-25T04:46:37.373 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2021-06-25T04:46:37.373 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 15m 2021-06-25T04:46:37.373 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 15m 2021-06-25T04:46:37.374 INFO:tasks.ceph:Creating admin key on mon.a... 2021-06-25T04:46:37.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-06-25T04:46:37.423 INFO:tasks.ceph:Copying monmap to all nodes... 2021-06-25T04:46:37.437 DEBUG:teuthology.orchestra.remote:smithi057:/etc/ceph/ceph.keyring is 206B 2021-06-25T04:46:37.461 DEBUG:teuthology.orchestra.remote:smithi057:/home/ubuntu/cephtest/ceph.monmap is 379B 2021-06-25T04:46:37.476 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T04:46:37.476 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2021-06-25T04:46:37.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2021-06-25T04:46:37.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-06-25T04:46:37.504 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2021-06-25T04:46:37.505 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:37.554 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T04:46:37.555 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-06-25T04:46:37.555 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2021-06-25T04:46:37.556 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-06-25T04:46:37.585 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-06-25T04:46:37.585 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:37.592 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2021-06-25T04:46:37.592 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-06-25T04:46:37.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2021-06-25T04:46:37.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-06-25T04:46:37.619 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2021-06-25T04:46:37.621 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:37.668 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T04:46:37.669 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-06-25T04:46:37.669 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2021-06-25T04:46:37.670 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-06-25T04:46:37.697 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-06-25T04:46:37.697 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:37.704 INFO:tasks.ceph:Setting up mon nodes... 2021-06-25T04:46:37.704 INFO:tasks.ceph:Setting up mgr nodes... 2021-06-25T04:46:37.705 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-06-25T04:46:37.750 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-06-25T04:46:37.753 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-06-25T04:46:37.802 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-06-25T04:46:37.805 INFO:tasks.ceph:Setting up mds nodes... 2021-06-25T04:46:37.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-06-25T04:46:37.851 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-06-25T04:46:37.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-06-25T04:46:37.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2021-06-25T04:46:37.956 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2021-06-25T04:46:37.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2021-06-25T04:46:37.974 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-06-25T04:46:38.016 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-06-25T04:46:38.019 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-06-25T04:46:38.029 INFO:tasks.ceph_client:Setting up client nodes... 2021-06-25T04:46:38.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-06-25T04:46:38.080 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-06-25T04:46:38.093 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-06-25T04:46:38.135 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-06-25T04:46:38.148 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-06-25T04:46:38.149 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-06-25T04:46:38.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-06-25T04:46:38.168 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-06-25T04:46:38.168 INFO:tasks.ceph:role: osd.0 2021-06-25T04:46:38.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T04:46:38.171 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-06-25T04:46:39.522 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-06-25T04:46:39.522 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2021-06-25T04:46:39.522 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-06-25T04:46:39.523 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2021-06-25T04:46:39.523 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-06-25T04:46:39.523 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2021-06-25T04:46:39.523 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-06-25T04:46:39.524 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-06-25T04:46:39.524 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-06-25T04:46:39.524 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-06-25T04:46:39.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2021-06-25T04:46:39.526 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-06-25T04:46:39.553 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-06-25T04:46:39.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:46:39.562 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2021-06-25T04:46:39.563 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-06-25T04:46:39.575 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-06-25T04:46:39.575 INFO:tasks.ceph:role: osd.1 2021-06-25T04:46:39.576 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T04:46:39.576 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-06-25T04:46:40.934 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-06-25T04:46:40.934 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2021-06-25T04:46:40.934 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-06-25T04:46:40.935 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2021-06-25T04:46:40.935 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-06-25T04:46:40.935 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2021-06-25T04:46:40.935 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-06-25T04:46:40.935 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-06-25T04:46:40.936 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-06-25T04:46:40.936 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-06-25T04:46:40.937 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2021-06-25T04:46:40.937 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-06-25T04:46:40.962 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-06-25T04:46:40.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:46:40.974 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2021-06-25T04:46:40.975 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-06-25T04:46:40.986 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-06-25T04:46:40.988 INFO:tasks.ceph:role: osd.2 2021-06-25T04:46:40.988 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T04:46:40.989 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-06-25T04:46:42.365 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-06-25T04:46:42.366 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2021-06-25T04:46:42.366 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-06-25T04:46:42.366 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2021-06-25T04:46:42.366 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-06-25T04:46:42.367 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2021-06-25T04:46:42.367 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-06-25T04:46:42.367 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-06-25T04:46:42.368 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-06-25T04:46:42.368 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-06-25T04:46:42.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2021-06-25T04:46:42.370 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-06-25T04:46:42.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-06-25T04:46:42.407 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:46:42.408 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2021-06-25T04:46:42.411 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-06-25T04:46:42.466 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-06-25T04:46:42.467 INFO:tasks.ceph:role: osd.3 2021-06-25T04:46:42.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T04:46:42.468 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-06-25T04:46:43.815 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-06-25T04:46:43.816 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2021-06-25T04:46:43.816 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-06-25T04:46:43.816 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2021-06-25T04:46:43.817 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-06-25T04:46:43.817 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2021-06-25T04:46:43.818 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-06-25T04:46:43.818 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-06-25T04:46:43.819 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-06-25T04:46:43.819 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-06-25T04:46:43.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2021-06-25T04:46:43.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-06-25T04:46:43.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-06-25T04:46:43.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:46:43.900 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2021-06-25T04:46:43.901 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:43.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:43.962+0000 7f5fa95fad80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-06-25T04:46:43.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:43.962+0000 7f5fa95fad80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-06-25T04:46:43.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:43.962+0000 7f5fa95fad80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-06-25T04:46:43.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:43.962+0000 7f5fa95fad80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-06-25T04:46:43.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:43.962+0000 7f5fa95fad80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-06-25T04:46:43.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:43.966+0000 7f5fa95fad80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-06-25T04:46:44.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:43.994+0000 7f5fa95fad80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-06-25T04:46:46.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-06-25T04:46:46.443 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:46.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:46.522+0000 7fc1d2218d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-06-25T04:46:46.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:46.522+0000 7fc1d2218d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-06-25T04:46:46.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:46.522+0000 7fc1d2218d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-06-25T04:46:46.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:46.522+0000 7fc1d2218d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-06-25T04:46:46.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:46.522+0000 7fc1d2218d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-06-25T04:46:46.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:46.522+0000 7fc1d2218d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-06-25T04:46:46.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:46.546+0000 7fc1d2218d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-06-25T04:46:48.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-06-25T04:46:49.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:49.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:49.034+0000 7f902560ed80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-06-25T04:46:49.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:49.034+0000 7f902560ed80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-06-25T04:46:49.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:49.034+0000 7f902560ed80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-06-25T04:46:49.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:49.034+0000 7f902560ed80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-06-25T04:46:49.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:49.034+0000 7f902560ed80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-06-25T04:46:49.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:49.038+0000 7f902560ed80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-06-25T04:46:49.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:49.058+0000 7f902560ed80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-06-25T04:46:51.525 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-06-25T04:46:51.588 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:51.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:51.626+0000 7fc76ecfdd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-06-25T04:46:51.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:51.626+0000 7fc76ecfdd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-06-25T04:46:51.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:51.626+0000 7fc76ecfdd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-06-25T04:46:51.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:51.626+0000 7fc76ecfdd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-06-25T04:46:51.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:51.626+0000 7fc76ecfdd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-06-25T04:46:51.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:51.626+0000 7fc76ecfdd80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-06-25T04:46:51.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:46:51.654+0000 7fc76ecfdd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-06-25T04:46:54.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-06-25T04:46:54.153 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-06-25T04:46:54.171 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-06-25T04:46:54.172 INFO:tasks.ceph:role: osd.4 2021-06-25T04:46:54.172 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T04:46:54.172 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-06-25T04:46:54.754 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-06-25T04:46:54.754 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2021-06-25T04:46:54.755 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-06-25T04:46:54.755 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2021-06-25T04:46:54.755 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-06-25T04:46:54.755 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2021-06-25T04:46:54.755 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-06-25T04:46:54.756 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-06-25T04:46:54.756 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-06-25T04:46:54.756 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-06-25T04:46:54.757 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2021-06-25T04:46:54.758 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-06-25T04:46:54.854 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-06-25T04:46:54.866 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2021-06-25T04:46:54.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:46:54.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-06-25T04:46:54.926 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-06-25T04:46:54.926 INFO:tasks.ceph:role: osd.5 2021-06-25T04:46:54.927 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T04:46:54.927 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-06-25T04:46:55.434 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-06-25T04:46:55.435 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2021-06-25T04:46:55.435 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-06-25T04:46:55.435 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2021-06-25T04:46:55.435 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-06-25T04:46:55.436 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2021-06-25T04:46:55.436 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-06-25T04:46:55.436 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-06-25T04:46:55.436 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-06-25T04:46:55.437 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-06-25T04:46:55.438 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2021-06-25T04:46:55.438 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-06-25T04:46:55.472 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-06-25T04:46:55.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:46:55.525 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2021-06-25T04:46:55.525 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-06-25T04:46:55.542 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-06-25T04:46:55.542 INFO:tasks.ceph:role: osd.6 2021-06-25T04:46:55.542 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T04:46:55.543 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-06-25T04:46:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-06-25T04:46:56.008 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2021-06-25T04:46:56.009 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-06-25T04:46:56.009 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2021-06-25T04:46:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-06-25T04:46:56.009 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2021-06-25T04:46:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-06-25T04:46:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-06-25T04:46:56.010 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-06-25T04:46:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-06-25T04:46:56.011 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2021-06-25T04:46:56.012 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-06-25T04:46:56.069 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-06-25T04:46:56.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:46:56.084 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2021-06-25T04:46:56.085 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-06-25T04:46:56.096 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-06-25T04:46:56.097 INFO:tasks.ceph:role: osd.7 2021-06-25T04:46:56.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T04:46:56.098 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-06-25T04:46:56.634 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-06-25T04:46:56.634 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2021-06-25T04:46:56.634 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-06-25T04:46:56.635 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2021-06-25T04:46:56.635 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-06-25T04:46:56.635 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2021-06-25T04:46:56.635 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-06-25T04:46:56.636 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-06-25T04:46:56.636 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-06-25T04:46:56.636 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-06-25T04:46:56.639 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2021-06-25T04:46:56.639 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-06-25T04:46:56.703 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-06-25T04:46:56.716 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2021-06-25T04:46:56.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:46:56.719 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:56.777 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:56.775+0000 7fe164045d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-06-25T04:46:56.780 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:56.779+0000 7fe164045d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-06-25T04:46:56.780 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:56.779+0000 7fe164045d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-06-25T04:46:56.781 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:56.779+0000 7fe164045d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-06-25T04:46:56.781 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:56.779+0000 7fe164045d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-06-25T04:46:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:56.783+0000 7fe164045d80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-06-25T04:46:56.809 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:56.807+0000 7fe164045d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-06-25T04:46:59.277 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-06-25T04:46:59.291 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:46:59.327 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:59.327+0000 7ff674dead80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-06-25T04:46:59.328 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:59.327+0000 7ff674dead80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-06-25T04:46:59.328 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:59.327+0000 7ff674dead80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-06-25T04:46:59.328 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:59.327+0000 7ff674dead80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-06-25T04:46:59.328 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:59.327+0000 7ff674dead80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-06-25T04:46:59.329 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:59.327+0000 7ff674dead80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-06-25T04:46:59.345 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:46:59.343+0000 7ff674dead80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-06-25T04:47:01.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-06-25T04:47:01.842 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:47:01.880 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:01.879+0000 7f09b02e5d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-06-25T04:47:01.881 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:01.879+0000 7f09b02e5d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-06-25T04:47:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:01.879+0000 7f09b02e5d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-06-25T04:47:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:01.879+0000 7f09b02e5d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-06-25T04:47:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:01.879+0000 7f09b02e5d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-06-25T04:47:01.883 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:01.879+0000 7f09b02e5d80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-06-25T04:47:01.898 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:01.899+0000 7f09b02e5d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-06-25T04:47:04.343 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-06-25T04:47:04.359 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:47:04.402 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:04.403+0000 7f8231a24d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-06-25T04:47:04.403 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:04.403+0000 7f8231a24d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-06-25T04:47:04.403 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:04.403+0000 7f8231a24d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-06-25T04:47:04.403 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:04.403+0000 7f8231a24d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-06-25T04:47:04.403 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:04.403+0000 7f8231a24d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-06-25T04:47:04.404 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:04.403+0000 7f8231a24d80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-06-25T04:47:04.422 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:04.423+0000 7f8231a24d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-06-25T04:47:06.620 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:47:06.623 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:47:06.626 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:47:06.628 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:47:06.871 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-06-25T04:47:06.888 INFO:tasks.ceph:Reading keys from all nodes... 2021-06-25T04:47:06.888 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:47:06.895 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.v5DoXCipUL 2021-06-25T04:47:06.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.v5DoXCipUL 2021-06-25T04:47:06.955 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.v5DoXCipUL 2021-06-25T04:47:06.976 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.v5DoXCipUL is 56B 2021-06-25T04:47:06.991 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.v5DoXCipUL 2021-06-25T04:47:06.998 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:47:07.049 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.VyrZ7VJ7s0 2021-06-25T04:47:07.050 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.VyrZ7VJ7s0 2021-06-25T04:47:07.066 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.VyrZ7VJ7s0 2021-06-25T04:47:07.133 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.VyrZ7VJ7s0 is 56B 2021-06-25T04:47:07.148 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.VyrZ7VJ7s0 2021-06-25T04:47:07.154 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:47:07.204 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.HpDpkl4UTN 2021-06-25T04:47:07.205 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /var/lib/ceph/mds/ceph-c/keyring /tmp/tmp.HpDpkl4UTN 2021-06-25T04:47:07.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.HpDpkl4UTN 2021-06-25T04:47:07.242 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.HpDpkl4UTN is 56B 2021-06-25T04:47:07.257 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.HpDpkl4UTN 2021-06-25T04:47:07.264 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:47:07.312 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.6xb3kQE7EG 2021-06-25T04:47:07.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.6xb3kQE7EG 2021-06-25T04:47:07.330 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.6xb3kQE7EG 2021-06-25T04:47:07.394 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.6xb3kQE7EG is 56B 2021-06-25T04:47:07.411 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.6xb3kQE7EG 2021-06-25T04:47:07.417 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:47:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.o78EeMBC6V 2021-06-25T04:47:07.469 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.o78EeMBC6V 2021-06-25T04:47:07.484 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.o78EeMBC6V 2021-06-25T04:47:07.502 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.o78EeMBC6V is 56B 2021-06-25T04:47:07.554 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.o78EeMBC6V 2021-06-25T04:47:07.561 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:47:07.608 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.DmYclHOGI3 2021-06-25T04:47:07.609 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.DmYclHOGI3 2021-06-25T04:47:07.625 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.DmYclHOGI3 2021-06-25T04:47:07.693 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.DmYclHOGI3 is 56B 2021-06-25T04:47:07.707 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.DmYclHOGI3 2021-06-25T04:47:07.714 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:47:07.761 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.Bt5SM7RYID 2021-06-25T04:47:07.761 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.Bt5SM7RYID 2021-06-25T04:47:07.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.Bt5SM7RYID 2021-06-25T04:47:07.841 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.Bt5SM7RYID is 56B 2021-06-25T04:47:07.857 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.Bt5SM7RYID 2021-06-25T04:47:07.863 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T04:47:07.870 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.AsgZw6MMZL 2021-06-25T04:47:07.871 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.AsgZw6MMZL 2021-06-25T04:47:07.887 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.AsgZw6MMZL 2021-06-25T04:47:07.911 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.AsgZw6MMZL is 56B 2021-06-25T04:47:07.923 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.AsgZw6MMZL 2021-06-25T04:47:07.929 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T04:47:07.976 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.1R47YFsJMJ 2021-06-25T04:47:07.977 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.1R47YFsJMJ 2021-06-25T04:47:07.993 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.1R47YFsJMJ 2021-06-25T04:47:08.061 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.1R47YFsJMJ is 56B 2021-06-25T04:47:08.075 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.1R47YFsJMJ 2021-06-25T04:47:08.081 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T04:47:08.131 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.I2fFMJKptJ 2021-06-25T04:47:08.133 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.I2fFMJKptJ 2021-06-25T04:47:08.148 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.I2fFMJKptJ 2021-06-25T04:47:08.213 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.I2fFMJKptJ is 56B 2021-06-25T04:47:08.228 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.I2fFMJKptJ 2021-06-25T04:47:08.235 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T04:47:08.283 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.YwXQDfaNqG 2021-06-25T04:47:08.284 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.YwXQDfaNqG 2021-06-25T04:47:08.300 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.YwXQDfaNqG 2021-06-25T04:47:08.365 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.YwXQDfaNqG is 56B 2021-06-25T04:47:08.380 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.YwXQDfaNqG 2021-06-25T04:47:08.387 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T04:47:08.435 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.MCIhZAgXuJ 2021-06-25T04:47:08.436 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.MCIhZAgXuJ 2021-06-25T04:47:08.455 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.MCIhZAgXuJ 2021-06-25T04:47:08.521 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.MCIhZAgXuJ is 56B 2021-06-25T04:47:08.537 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.MCIhZAgXuJ 2021-06-25T04:47:08.544 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T04:47:08.592 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.n5180oy1O8 2021-06-25T04:47:08.592 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.n5180oy1O8 2021-06-25T04:47:08.606 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.n5180oy1O8 2021-06-25T04:47:08.634 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.n5180oy1O8 is 56B 2021-06-25T04:47:08.647 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.n5180oy1O8 2021-06-25T04:47:08.665 DEBUG:teuthology.orchestra.remote:smithi102:/etc/ceph/ceph.client.0.keyring is 59B 2021-06-25T04:47:08.694 DEBUG:teuthology.orchestra.remote:smithi161:/etc/ceph/ceph.client.1.keyring is 59B 2021-06-25T04:47:08.710 INFO:tasks.ceph:Adding keys to all mons... 2021-06-25T04:47:08.710 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2021-06-25T04:47:08.713 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2021-06-25T04:47:08.725 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2021-06-25T04:47:08.726 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw== 2021-06-25T04:47:08.726 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2021-06-25T04:47:08.726 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ== 2021-06-25T04:47:08.726 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2021-06-25T04:47:08.727 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw== 2021-06-25T04:47:08.727 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2021-06-25T04:47:08.727 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw== 2021-06-25T04:47:08.727 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2021-06-25T04:47:08.728 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ== 2021-06-25T04:47:08.728 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2021-06-25T04:47:08.728 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg== 2021-06-25T04:47:08.728 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2021-06-25T04:47:08.728 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA== 2021-06-25T04:47:08.729 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2021-06-25T04:47:08.729 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA== 2021-06-25T04:47:08.729 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2021-06-25T04:47:08.729 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ== 2021-06-25T04:47:08.730 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.4] 2021-06-25T04:47:08.730 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ== 2021-06-25T04:47:08.730 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.5] 2021-06-25T04:47:08.730 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw== 2021-06-25T04:47:08.730 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.6] 2021-06-25T04:47:08.731 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA== 2021-06-25T04:47:08.731 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.7] 2021-06-25T04:47:08.731 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA== 2021-06-25T04:47:08.731 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2021-06-25T04:47:08.731 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA== 2021-06-25T04:47:08.732 INFO:teuthology.orchestra.run.smithi057.stdout:[client.1] 2021-06-25T04:47:08.732 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA== 2021-06-25T04:47:08.734 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.y] 2021-06-25T04:47:08.734 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw== 2021-06-25T04:47:08.734 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2021-06-25T04:47:08.735 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ== 2021-06-25T04:47:08.735 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2021-06-25T04:47:08.735 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw== 2021-06-25T04:47:08.735 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2021-06-25T04:47:08.736 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw== 2021-06-25T04:47:08.736 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2021-06-25T04:47:08.736 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ== 2021-06-25T04:47:08.736 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2021-06-25T04:47:08.736 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg== 2021-06-25T04:47:08.737 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2021-06-25T04:47:08.737 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA== 2021-06-25T04:47:08.737 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2021-06-25T04:47:08.738 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA== 2021-06-25T04:47:08.738 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2021-06-25T04:47:08.738 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ== 2021-06-25T04:47:08.738 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.4] 2021-06-25T04:47:08.739 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ== 2021-06-25T04:47:08.739 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2021-06-25T04:47:08.739 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw== 2021-06-25T04:47:08.739 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.6] 2021-06-25T04:47:08.739 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA== 2021-06-25T04:47:08.740 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.7] 2021-06-25T04:47:08.740 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA== 2021-06-25T04:47:08.740 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2021-06-25T04:47:08.740 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA== 2021-06-25T04:47:08.741 INFO:teuthology.orchestra.run.smithi087.stdout:[client.1] 2021-06-25T04:47:08.741 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA== 2021-06-25T04:47:08.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-06-25T04:47:08.744 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-06-25T04:47:08.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-06-25T04:47:08.828 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-06-25T04:47:08.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-06-25T04:47:08.876 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-06-25T04:47:08.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:08.922 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.005 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.047 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.094 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.136 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.180 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-06-25T04:47:09.183 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-06-25T04:47:09.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-06-25T04:47:09.225 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-06-25T04:47:09.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.308 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.351 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.355 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.440 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.488 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-06-25T04:47:09.573 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-06-25T04:47:09.576 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-06-25T04:47:09.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-06-25T04:47:09.625 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-06-25T04:47:09.707 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-06-25T04:47:09.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-06-25T04:47:09.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-06-25T04:47:09.806 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-06-25T04:47:09.824 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-06-25T04:47:09.847 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-06-25T04:47:09.905 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-06-25T04:47:09.919 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-06-25T04:47:09.933 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-06-25T04:47:09.987 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-06-25T04:47:09.999 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:47:10.003 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-06-25T04:47:10.009 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-06-25T04:47:10.010 INFO:tasks.ceph.mon.a:Restarting daemon 2021-06-25T04:47:10.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-06-25T04:47:10.014 INFO:tasks.ceph.mon.a:Started 2021-06-25T04:47:10.015 INFO:tasks.ceph.mon.b:Restarting daemon 2021-06-25T04:47:10.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-06-25T04:47:10.055 INFO:tasks.ceph.mon.b:Started 2021-06-25T04:47:10.056 INFO:tasks.ceph.mon.c:Restarting daemon 2021-06-25T04:47:10.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-06-25T04:47:10.058 INFO:tasks.ceph.mon.c:Started 2021-06-25T04:47:10.059 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-06-25T04:47:10.059 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-06-25T04:47:10.060 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-06-25T04:47:10.062 INFO:tasks.ceph.mgr.y:Started 2021-06-25T04:47:10.063 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-06-25T04:47:10.063 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-06-25T04:47:10.065 INFO:tasks.ceph.mgr.x:Started 2021-06-25T04:47:10.066 INFO:tasks.ceph:Setting crush tunables to default 2021-06-25T04:47:10.066 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2021-06-25T04:47:10.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.198+0000 7f846ebc7700 1 Processor -- start 2021-06-25T04:47:10.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.198+0000 7f846ebc7700 1 -- start start 2021-06-25T04:47:10.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.198+0000 7f846ebc7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:10.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.198+0000 7f846ebc7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:10.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.198+0000 7f846ebc7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8468143b20 con 0x7f84680b4140 2021-06-25T04:47:10.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.198+0000 7f846ebc7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84681474d0 con 0x7f84680b4650 2021-06-25T04:47:10.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.198+0000 7f846ebc7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8468143dc0 con 0x7f8468146910 2021-06-25T04:47:10.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f8467fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f84680b4140 0x7f84681406e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51720/0 (socket says 172.21.15.57:51720) 2021-06-25T04:47:10.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 learned_addr learned my addr 172.21.15.57:0/2344069659 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:10.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:10.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:10.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 msgr2=0x7f84681401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-06-25T04:47:10.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 msgr2=0x7f84681401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:10.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:10.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-06-25T04:47:10.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f846d164700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 msgr2=0x7f84680b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:10.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f846d164700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 msgr2=0x7f84680b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:10.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:10.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.202+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-06-25T04:47:10.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.402+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:10.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.402+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:10.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.402+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 msgr2=0x7f84681401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-06-25T04:47:10.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.402+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 msgr2=0x7f84681401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:10.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.402+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:10.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.402+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-06-25T04:47:10.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.402+0000 7f846d164700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 msgr2=0x7f84680b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:10.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.402+0000 7f846d164700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 msgr2=0x7f84680b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:10.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.402+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:10.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.402+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-06-25T04:47:10.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.802+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:10.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.802+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:10.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.802+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 msgr2=0x7f84681401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-06-25T04:47:10.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.802+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 msgr2=0x7f84681401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:10.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.802+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:10.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.802+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-06-25T04:47:10.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.802+0000 7f846d164700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 msgr2=0x7f84680b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:10.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.802+0000 7f846d164700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 msgr2=0x7f84680b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:10.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.802+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:10.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:10.802+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-06-25T04:47:11.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:11.606+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:11.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:11.606+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:11.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:11.606+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 msgr2=0x7f84681401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-06-25T04:47:11.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:11.606+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 msgr2=0x7f84681401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:11.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:11.606+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:11.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:11.606+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-06-25T04:47:11.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:11.606+0000 7f846d164700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 msgr2=0x7f84680b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:11.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:11.606+0000 7f846d164700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 msgr2=0x7f84680b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:11.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:11.606+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:11.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:11.606+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-06-25T04:47:13.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 msgr2=0x7f84681401f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-06-25T04:47:13.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f84667fc700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8468146910 0x7f84681401f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:13.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 msgr2=0x7f84680b4e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-06-25T04:47:13.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f84667fc700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f84680b4650 0x7f84680b4e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:13.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 >> v1:172.21.15.57:6789/0 conn(0x7f84680b4140 legacy=0x7f84681406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:13.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f84667fc700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:13.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84680b0c50 con 0x7f844c0033f0 2021-06-25T04:47:13.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84681474d0 con 0x7f844c007060 2021-06-25T04:47:13.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:13.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 msgr2=0x7f844c009520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:13.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 msgr2=0x7f844c009520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:13.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:13.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.202+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-06-25T04:47:13.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.406+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:13.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.406+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 msgr2=0x7f844c009520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:13.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.406+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 msgr2=0x7f844c009520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:13.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.406+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:13.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.406+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-06-25T04:47:13.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.806+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:13.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.806+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 msgr2=0x7f844c009520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:13.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.806+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 msgr2=0x7f844c009520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:13.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.806+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:13.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:13.806+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-06-25T04:47:14.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:14.610+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:14.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:14.610+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 msgr2=0x7f844c009520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:14.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:14.610+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 msgr2=0x7f844c009520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:14.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:14.610+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:14.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:14.610+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-06-25T04:47:16.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 msgr2=0x7f844c009520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-06-25T04:47:16.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f84667fc700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c007060 0x7f844c009520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:16.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 >> v1:172.21.15.87:6789/0 conn(0x7f844c0033f0 legacy=0x7f844c005830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:16.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f846d164700 1 -- 172.21.15.57:0/2344069659 reap_dead start 2021-06-25T04:47:16.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f84667fc700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:16.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f84667fc700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:16.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844c00ac40 con 0x7f844c005ff0 2021-06-25T04:47:16.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84681474d0 con 0x7f844c009ca0 2021-06-25T04:47:16.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8468143dc0 con 0x7f844c00a6c0 2021-06-25T04:47:16.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:16.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:16.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 msgr2=0x7f844c00a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-06-25T04:47:16.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 msgr2=0x7f844c00a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:16.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:16.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 msgr2=0x7f844c0094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:16.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 msgr2=0x7f844c0094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:16.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:16.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-06-25T04:47:16.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.202+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-06-25T04:47:16.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.402+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:16.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.402+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:16.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.402+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 msgr2=0x7f844c00a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-06-25T04:47:16.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.402+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 msgr2=0x7f844c00a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:16.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.402+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:16.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.402+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-06-25T04:47:16.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.402+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 msgr2=0x7f844c0094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:16.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.402+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 msgr2=0x7f844c0094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:16.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.402+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:16.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.402+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-06-25T04:47:16.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.802+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:16.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.802+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 msgr2=0x7f844c00a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-06-25T04:47:16.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.802+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 msgr2=0x7f844c00a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:16.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.802+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:16.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.802+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:16.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.802+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-06-25T04:47:16.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.802+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 msgr2=0x7f844c0094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:16.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.802+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 msgr2=0x7f844c0094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:16.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.802+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:16.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:16.802+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-06-25T04:47:17.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:17.606+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:17.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:17.606+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 msgr2=0x7f844c00a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-06-25T04:47:17.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:17.606+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 msgr2=0x7f844c00a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:17.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:17.606+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:17.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:17.606+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-06-25T04:47:17.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:17.606+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:17.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:17.606+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 msgr2=0x7f844c0094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:17.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:17.606+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 msgr2=0x7f844c0094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:17.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:17.606+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:17.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:17.606+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-06-25T04:47:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 msgr2=0x7f844c0094a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-06-25T04:47:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f84667fc700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.87:3300/0 conn(0x7f844c00a6c0 0x7f844c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 msgr2=0x7f844c00a0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-06-25T04:47:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f84667fc700 1 --2- 172.21.15.57:0/2344069659 >> v2:172.21.15.57:3300/0 conn(0x7f844c009ca0 0x7f844c00a0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 >> v1:172.21.15.57:6789/0 conn(0x7f844c005ff0 legacy=0x7f844c005830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f84667fc700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 0x7f844c013b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:19.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844c006740 con 0x7f844c006af0 2021-06-25T04:47:19.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f84667fc700 1 -- 172.21.15.57:0/2344069659 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84681474d0 con 0x7f844c011730 2021-06-25T04:47:19.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 0x7f844c013b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:19.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 msgr2=0x7f844c013b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:19.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 msgr2=0x7f844c013b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:19.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 0x7f844c013b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:19.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.202+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 0x7f844c013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-06-25T04:47:19.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.402+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 0x7f844c013b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.402+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 msgr2=0x7f844c013b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.402+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 msgr2=0x7f844c013b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.402+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 0x7f844c013b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:19.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.402+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 0x7f844c013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-06-25T04:47:19.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.802+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 0x7f844c013b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:19.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.802+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 msgr2=0x7f844c013b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-06-25T04:47:19.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.806+0000 7f8467fff700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 msgr2=0x7f844c013b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-06-25T04:47:19.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.806+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 0x7f844c013b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-06-25T04:47:19.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:19.806+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 0x7f844c013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-06-25T04:47:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.438+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772802338 0 0) 0x7f844c006740 con 0x7f844c006af0 2021-06-25T04:47:20.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.438+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8448003260 con 0x7f844c006af0 2021-06-25T04:47:20.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2611061378 0 0) 0x7f8448003260 con 0x7f844c006af0 2021-06-25T04:47:20.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 msgr2=0x7f844c013b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-06-25T04:47:20.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f844c011730 0x7f844c013b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:20.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c015240 con 0x7f844c006af0 2021-06-25T04:47:20.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f8460016700 con 0x7f844c006af0 2021-06-25T04:47:20.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 >> v1:172.21.15.87:6789/0 conn(0x7f844c006af0 legacy=0x7f844c00ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:20.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f846d164700 1 -- 172.21.15.57:0/2344069659 reap_dead start 2021-06-25T04:47:20.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8448003780 0x7f8448003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:20.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8448004500 0x7f8448004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:20.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448004e70 0x7f844800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:20.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84681474d0 con 0x7f8448004e70 2021-06-25T04:47:20.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844800bdd0 con 0x7f8448003780 2021-06-25T04:47:20.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.442+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844800bf60 con 0x7f8448004500 2021-06-25T04:47:20.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.446+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448004e70 0x7f844800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:20.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.446+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8448003780 0x7f8448003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:20.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.446+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8448004500 0x7f8448004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:20.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.446+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8448004500 msgr2=0x7f8448004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:20.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.446+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8448004500 0x7f8448004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:20.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.446+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448004e70 msgr2=0x7f844800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:20.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.446+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448004e70 0x7f844800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:20.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.446+0000 7f846c963700 1 -- 172.21.15.57:0/2344069659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448003260 con 0x7f8448003780 2021-06-25T04:47:20.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.446+0000 7f8467fff700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8448004500 0x7f8448004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:20.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.446+0000 7f846d164700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448004e70 0x7f844800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:20.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.446+0000 7f846c963700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8448003780 0x7f8448003b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f84600032f0 tx=0x7f8460008040).ready entity=mon.1 client_cookie=8979553ed3b3f81f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:20.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f846001e070 con 0x7f8448003780 2021-06-25T04:47:20.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000c040 con 0x7f8448003780 2021-06-25T04:47:20.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f84677fe700 1 -- 172.21.15.57:0/2344069659 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8460023800 con 0x7f8448003780 2021-06-25T04:47:20.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f846ebc7700 1 -- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8448003780 msgr2=0x7f8448003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:20.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f846ebc7700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8448003780 0x7f8448003b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f84600032f0 tx=0x7f8460008040).stop 2021-06-25T04:47:20.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f846ebc7700 1 -- 172.21.15.57:0/2344069659 shutdown_connections 2021-06-25T04:47:20.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f846ebc7700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448004e70 0x7f844800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:20.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f846ebc7700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8448004500 0x7f8448004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:20.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f846ebc7700 1 --2- 172.21.15.57:0/2344069659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8448003780 0x7f8448003b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:20.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f846ebc7700 1 -- 172.21.15.57:0/2344069659 >> 172.21.15.57:0/2344069659 conn(0x7f846805c450 msgr2=0x7f846805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:20.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f846ebc7700 1 -- 172.21.15.57:0/2344069659 shutdown_connections 2021-06-25T04:47:20.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.450+0000 7f846ebc7700 1 -- 172.21.15.57:0/2344069659 wait complete. 2021-06-25T04:47:20.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846ebc7700 1 Processor -- start 2021-06-25T04:47:20.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846ebc7700 1 -- start start 2021-06-25T04:47:20.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846ebc7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448003780 0x7f84680b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:20.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846ebc7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8448004500 0x7f846813a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:20.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846ebc7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8448004e70 0x7f84681558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:20.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846ebc7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846813b8f0 con 0x7f8448003780 2021-06-25T04:47:20.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846ebc7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846813bb50 con 0x7f8448004500 2021-06-25T04:47:20.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846ebc7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8468140ea0 con 0x7f8448004e70 2021-06-25T04:47:20.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846c963700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448003780 0x7f84680b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:20.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846c963700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448003780 0x7f84680b6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34608/0 (socket says 172.21.15.57:34608) 2021-06-25T04:47:20.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846c963700 1 -- 172.21.15.57:0/709769392 learned_addr learned my addr 172.21.15.57:0/709769392 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:20.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f8467fff700 1 --2- 172.21.15.57:0/709769392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8448004500 0x7f846813a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:20.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846d164700 1 --2- 172.21.15.57:0/709769392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8448004e70 0x7f84681558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:20.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846c963700 1 -- 172.21.15.57:0/709769392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8448004e70 msgr2=0x7f84681558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:20.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846c963700 1 --2- 172.21.15.57:0/709769392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8448004e70 0x7f84681558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:20.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846c963700 1 -- 172.21.15.57:0/709769392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8448004500 msgr2=0x7f846813a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846c963700 1 --2- 172.21.15.57:0/709769392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8448004500 0x7f846813a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846c963700 1 -- 172.21.15.57:0/709769392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846813f3f0 con 0x7f8448003780 2021-06-25T04:47:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.454+0000 7f846c963700 1 --2- 172.21.15.57:0/709769392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448003780 0x7f84680b6570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f84600032f0 tx=0x7f8460026000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:20.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.458+0000 7f8465ffb700 1 -- 172.21.15.57:0/709769392 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8460023b00 con 0x7f8448003780 2021-06-25T04:47:20.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.458+0000 7f8465ffb700 1 -- 172.21.15.57:0/709769392 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000c040 con 0x7f8448003780 2021-06-25T04:47:20.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.458+0000 7f846ebc7700 1 -- 172.21.15.57:0/709769392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84680b8e50 con 0x7f8448003780 2021-06-25T04:47:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.458+0000 7f8465ffb700 1 -- 172.21.15.57:0/709769392 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8460023e50 con 0x7f8448003780 2021-06-25T04:47:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.458+0000 7f846ebc7700 1 -- 172.21.15.57:0/709769392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84680b9120 con 0x7f8448003780 2021-06-25T04:47:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.458+0000 7f8465ffb700 1 -- 172.21.15.57:0/709769392 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f846002b040 con 0x7f8448003780 2021-06-25T04:47:20.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.458+0000 7f8465ffb700 1 -- 172.21.15.57:0/709769392 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f846002de20 con 0x7f8448003780 2021-06-25T04:47:20.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.458+0000 7f846ebc7700 1 -- 172.21.15.57:0/709769392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84680b9120 con 0x7f8448003780 2021-06-25T04:47:20.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.462+0000 7f8465ffb700 1 -- 172.21.15.57:0/709769392 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f8460032070 con 0x7f8448003780 2021-06-25T04:47:20.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.530+0000 7f846ebc7700 1 -- 172.21.15.57:0/709769392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f84680b9120 con 0x7f8448003780 2021-06-25T04:47:20.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.538+0000 7f8465ffb700 1 -- 172.21.15.57:0/709769392 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8460028040 con 0x7f8448003780 2021-06-25T04:47:20.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.538+0000 7f846ebc7700 1 -- 172.21.15.57:0/709769392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448003780 msgr2=0x7f84680b6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:20.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.538+0000 7f846ebc7700 1 --2- 172.21.15.57:0/709769392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448003780 0x7f84680b6570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f84600032f0 tx=0x7f8460026000).stop 2021-06-25T04:47:20.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.538+0000 7f846ebc7700 1 -- 172.21.15.57:0/709769392 shutdown_connections 2021-06-25T04:47:20.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.538+0000 7f846ebc7700 1 --2- 172.21.15.57:0/709769392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8448004e70 0x7f84681558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:20.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.538+0000 7f846ebc7700 1 --2- 172.21.15.57:0/709769392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8448004500 0x7f846813a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:20.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.538+0000 7f846ebc7700 1 --2- 172.21.15.57:0/709769392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8448003780 0x7f84680b6570 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:20.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.538+0000 7f846ebc7700 1 -- 172.21.15.57:0/709769392 >> 172.21.15.57:0/709769392 conn(0x7f846805c450 msgr2=0x7f8468145510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:20.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.538+0000 7f846ebc7700 1 -- 172.21.15.57:0/709769392 shutdown_connections 2021-06-25T04:47:20.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:20.538+0000 7f846ebc7700 1 -- 172.21.15.57:0/709769392 wait complete. 2021-06-25T04:47:20.547 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2021-06-25T04:47:20.559 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-06-25T04:47:20.560 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:47:20.569 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.aUweV1nS1h 2021-06-25T04:47:20.570 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.aUweV1nS1h 2021-06-25T04:47:20.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.aUweV1nS1h 2021-06-25T04:47:20.652 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.aUweV1nS1h is 37B 2021-06-25T04:47:20.670 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.aUweV1nS1h 2021-06-25T04:47:20.678 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:47:20.729 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.dtIbykSqpd 2021-06-25T04:47:20.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.dtIbykSqpd 2021-06-25T04:47:20.745 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.dtIbykSqpd 2021-06-25T04:47:20.767 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.dtIbykSqpd is 37B 2021-06-25T04:47:20.783 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.dtIbykSqpd 2021-06-25T04:47:20.789 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:47:20.841 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.fexubO29Vt 2021-06-25T04:47:20.841 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.fexubO29Vt 2021-06-25T04:47:20.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.fexubO29Vt 2021-06-25T04:47:20.927 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.fexubO29Vt is 37B 2021-06-25T04:47:20.945 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.fexubO29Vt 2021-06-25T04:47:20.954 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T04:47:21.001 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.JMMuS7t5ji 2021-06-25T04:47:21.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.JMMuS7t5ji 2021-06-25T04:47:21.019 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.JMMuS7t5ji 2021-06-25T04:47:21.085 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.JMMuS7t5ji is 37B 2021-06-25T04:47:21.098 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.JMMuS7t5ji 2021-06-25T04:47:21.106 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T04:47:21.115 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.ADTgDXzkQO 2021-06-25T04:47:21.116 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.ADTgDXzkQO 2021-06-25T04:47:21.173 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.ADTgDXzkQO 2021-06-25T04:47:21.196 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.ADTgDXzkQO is 37B 2021-06-25T04:47:21.246 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.ADTgDXzkQO 2021-06-25T04:47:21.257 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T04:47:21.307 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.0nwkIDsWDj 2021-06-25T04:47:21.308 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.0nwkIDsWDj 2021-06-25T04:47:21.320 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.0nwkIDsWDj 2021-06-25T04:47:21.383 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.0nwkIDsWDj is 37B 2021-06-25T04:47:21.437 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.0nwkIDsWDj 2021-06-25T04:47:21.444 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T04:47:21.491 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.U10P0W3eoK 2021-06-25T04:47:21.492 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.U10P0W3eoK 2021-06-25T04:47:21.507 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.U10P0W3eoK 2021-06-25T04:47:21.533 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.U10P0W3eoK is 37B 2021-06-25T04:47:21.547 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.U10P0W3eoK 2021-06-25T04:47:21.556 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T04:47:21.607 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.M7aFFlTF5q 2021-06-25T04:47:21.607 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.M7aFFlTF5q 2021-06-25T04:47:21.622 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.M7aFFlTF5q 2021-06-25T04:47:21.684 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.M7aFFlTF5q is 37B 2021-06-25T04:47:21.700 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.M7aFFlTF5q 2021-06-25T04:47:21.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 99a627d2-6f82-4862-b866-ad32e153b1a3 0 2021-06-25T04:47:21.849 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.847+0000 7f4ee0810700 1 Processor -- start 2021-06-25T04:47:21.849 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.847+0000 7f4ee0810700 1 -- start start 2021-06-25T04:47:21.853 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ee0810700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4edc0a9e80 0x7f4edc0aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:21.853 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ee0810700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc13f750 0x7f4edc13fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ee0810700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4edc061950 con 0x7f4edc060390 2021-06-25T04:47:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ee0810700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc1400b0 con 0x7f4edc0a9e80 2021-06-25T04:47:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ee0810700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc061bf0 con 0x7f4edc13f750 2021-06-25T04:47:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ed9d9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4edc060390 0x7f4edc13cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34318/0 (socket says 172.21.15.87:34318) 2021-06-25T04:47:21.854 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ed9d9b700 1 -- 172.21.15.87:0/85984759 learned_addr learned my addr 172.21.15.87:0/85984759 (peer_addr_for_me v1:172.21.15.87:0/0) 2021-06-25T04:47:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4edad9d700 1 --2- 172.21.15.87:0/85984759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc13f750 0x7f4edc13fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4eda59c700 1 --2- 172.21.15.87:0/85984759 >> v2:172.21.15.57:3300/0 conn(0x7f4edc0a9e80 0x7f4edc0aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ed959a700 1 -- 172.21.15.87:0/85984759 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253528552 0 0) 0x7f4edc061950 con 0x7f4edc060390 2021-06-25T04:47:21.855 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ed959a700 1 -- 172.21.15.87:0/85984759 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec0003260 con 0x7f4edc060390 2021-06-25T04:47:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4edad9d700 1 -- 172.21.15.87:0/85984759 >> v2:172.21.15.57:3300/0 conn(0x7f4edc0a9e80 msgr2=0x7f4edc0aa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4edad9d700 1 --2- 172.21.15.87:0/85984759 >> v2:172.21.15.57:3300/0 conn(0x7f4edc0a9e80 0x7f4edc0aa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4edad9d700 1 -- 172.21.15.87:0/85984759 >> v1:172.21.15.87:6789/0 conn(0x7f4edc060390 legacy=0x7f4edc13cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4edad9d700 1 -- 172.21.15.87:0/85984759 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc060b50 con 0x7f4edc13f750 2021-06-25T04:47:21.856 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4edad9d700 1 --2- 172.21.15.87:0/85984759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc13f750 0x7f4edc13fbc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4ed40032f0 tx=0x7f4ed40091d0).ready entity=mon.2 client_cookie=2e20141d3f9159fe server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ed959a700 1 -- 172.21.15.87:0/85984759 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed400b600 con 0x7f4edc13f750 2021-06-25T04:47:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ed959a700 1 -- 172.21.15.87:0/85984759 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed400b760 con 0x7f4edc13f750 2021-06-25T04:47:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ed959a700 1 -- 172.21.15.87:0/85984759 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed400b8d0 con 0x7f4edc13f750 2021-06-25T04:47:21.857 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ee0810700 1 -- 172.21.15.87:0/85984759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc13f750 msgr2=0x7f4edc13fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ee0810700 1 --2- 172.21.15.87:0/85984759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc13f750 0x7f4edc13fbc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4ed40032f0 tx=0x7f4ed40091d0).stop 2021-06-25T04:47:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.851+0000 7f4ee0810700 1 -- 172.21.15.87:0/85984759 shutdown_connections 2021-06-25T04:47:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 --2- 172.21.15.87:0/85984759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc13f750 0x7f4edc13fbc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 --2- 172.21.15.87:0/85984759 >> v2:172.21.15.57:3300/0 conn(0x7f4edc0a9e80 0x7f4edc0aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:21.858 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 -- 172.21.15.87:0/85984759 >> 172.21.15.87:0/85984759 conn(0x7f4edc0b2930 msgr2=0x7f4edc0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:21.859 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 -- 172.21.15.87:0/85984759 shutdown_connections 2021-06-25T04:47:21.859 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 -- 172.21.15.87:0/85984759 wait complete. 2021-06-25T04:47:21.863 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 Processor -- start 2021-06-25T04:47:21.863 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 -- start start 2021-06-25T04:47:21.864 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4edc060390 0x7f4edc0af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:21.864 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc0a9e80 0x7f4edc066ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:21.864 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4edc13f750 0x7f4edc1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:21.864 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc063170 con 0x7f4edc13f750 2021-06-25T04:47:21.864 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc150e80 con 0x7f4edc060390 2021-06-25T04:47:21.865 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ee0810700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc151120 con 0x7f4edc0a9e80 2021-06-25T04:47:21.865 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ed9d9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc0a9e80 0x7f4edc066ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:21.865 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4eda59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4edc060390 0x7f4edc0af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:21.865 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ed9d9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc0a9e80 0x7f4edc066ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:57636/0 (socket says 172.21.15.87:57636) 2021-06-25T04:47:21.866 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4eda59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4edc060390 0x7f4edc0af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49460/0 (socket says 172.21.15.87:49460) 2021-06-25T04:47:21.866 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ed9d9b700 1 -- 172.21.15.87:0/2087362837 learned_addr learned my addr 172.21.15.87:0/2087362837 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:21.866 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4edad9d700 1 --2- 172.21.15.87:0/2087362837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4edc13f750 0x7f4edc1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:21.866 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ed9d9b700 1 -- 172.21.15.87:0/2087362837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4edc060390 msgr2=0x7f4edc0af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:21.867 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ed9d9b700 1 --2- 172.21.15.87:0/2087362837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4edc060390 0x7f4edc0af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:21.867 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ed9d9b700 1 -- 172.21.15.87:0/2087362837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4edc13f750 msgr2=0x7f4edc1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:21.867 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ed9d9b700 1 --2- 172.21.15.87:0/2087362837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4edc13f750 0x7f4edc1537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:21.867 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ed9d9b700 1 -- 172.21.15.87:0/2087362837 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4009470 con 0x7f4edc0a9e80 2021-06-25T04:47:21.868 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.855+0000 7f4ed9d9b700 1 --2- 172.21.15.87:0/2087362837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc0a9e80 0x7f4edc066ac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4ed0001110 tx=0x7f4ed0007aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:21.868 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.859+0000 7f4ecb7fe700 1 -- 172.21.15.87:0/2087362837 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed000ce80 con 0x7f4edc0a9e80 2021-06-25T04:47:21.868 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.859+0000 7f4ecb7fe700 1 -- 172.21.15.87:0/2087362837 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed00070d0 con 0x7f4edc0a9e80 2021-06-25T04:47:21.868 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.859+0000 7f4ee0810700 1 -- 172.21.15.87:0/2087362837 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc0635e0 con 0x7f4edc0a9e80 2021-06-25T04:47:21.869 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.859+0000 7f4ecb7fe700 1 -- 172.21.15.87:0/2087362837 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ed0007430 con 0x7f4edc0a9e80 2021-06-25T04:47:21.869 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.859+0000 7f4ee0810700 1 -- 172.21.15.87:0/2087362837 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc153e80 con 0x7f4edc0a9e80 2021-06-25T04:47:21.869 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.859+0000 7f4ecb7fe700 1 -- 172.21.15.87:0/2087362837 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f4ed0010070 con 0x7f4edc0a9e80 2021-06-25T04:47:21.869 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.859+0000 7f4ecb7fe700 1 -- 172.21.15.87:0/2087362837 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f4ed00137c0 con 0x7f4edc0a9e80 2021-06-25T04:47:21.869 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.859+0000 7f4ee0810700 1 -- 172.21.15.87:0/2087362837 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc0ab0a0 con 0x7f4edc0a9e80 2021-06-25T04:47:21.870 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.863+0000 7f4ecb7fe700 1 -- 172.21.15.87:0/2087362837 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f4ed0031870 con 0x7f4edc0a9e80 2021-06-25T04:47:21.936 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.931+0000 7f4ee0810700 1 -- 172.21.15.87:0/2087362837 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", "id": 0} v 0) v1 -- 0x7f4edc057310 con 0x7f4edc0a9e80 2021-06-25T04:47:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.943+0000 7f4ecb7fe700 1 -- 172.21.15.87:0/2087362837 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ed0021070 con 0x7f4edc0a9e80 2021-06-25T04:47:21.946 INFO:teuthology.orchestra.run.smithi087.stdout:0 2021-06-25T04:47:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.947+0000 7f4ee0810700 1 -- 172.21.15.87:0/2087362837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc0a9e80 msgr2=0x7f4edc066ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.947+0000 7f4ee0810700 1 --2- 172.21.15.87:0/2087362837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc0a9e80 0x7f4edc066ac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4ed0001110 tx=0x7f4ed0007aa0).stop 2021-06-25T04:47:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.947+0000 7f4ee0810700 1 -- 172.21.15.87:0/2087362837 shutdown_connections 2021-06-25T04:47:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.947+0000 7f4ee0810700 1 --2- 172.21.15.87:0/2087362837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4edc13f750 0x7f4edc1537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.947+0000 7f4ee0810700 1 --2- 172.21.15.87:0/2087362837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4edc0a9e80 0x7f4edc066ac0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:21.949 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.947+0000 7f4ee0810700 1 --2- 172.21.15.87:0/2087362837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4edc060390 0x7f4edc0af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:21.949 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.947+0000 7f4ee0810700 1 -- 172.21.15.87:0/2087362837 >> 172.21.15.87:0/2087362837 conn(0x7f4edc0b2930 msgr2=0x7f4edc05bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:21.949 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.947+0000 7f4ee0810700 1 -- 172.21.15.87:0/2087362837 shutdown_connections 2021-06-25T04:47:21.949 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:21.947+0000 7f4ee0810700 1 -- 172.21.15.87:0/2087362837 wait complete. 2021-06-25T04:47:21.958 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 1ce151cf-5006-4549-98dd-18dddd863605 1 2021-06-25T04:47:22.061 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.059+0000 7f3fc56f7700 1 Processor -- start 2021-06-25T04:47:22.062 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 -- start start 2021-06-25T04:47:22.064 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3fc00b2fc0 0x7f3fc00b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.064 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 0x7f3fc00654d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.064 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fc00a9bd0 0x7f3fc00659c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.065 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00b27b0 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.065 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00b33a0 con 0x7f3fc00a9bd0 2021-06-25T04:47:22.065 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00b0c30 con 0x7f3fc00b18b0 2021-06-25T04:47:22.065 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc4ef6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fc00a9bd0 0x7f3fc00659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.065 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fbf7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 0x7f3fc00654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.066 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc4ef6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fc00a9bd0 0x7f3fc00659c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49470/0 (socket says 172.21.15.87:49470) 2021-06-25T04:47:22.066 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fbf7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 0x7f3fc00654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:57642/0 (socket says 172.21.15.87:57642) 2021-06-25T04:47:22.067 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc4ef6700 1 -- 172.21.15.87:0/3942209632 learned_addr learned my addr 172.21.15.87:0/3942209632 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:22.068 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fbffff700 1 --2- 172.21.15.87:0/3942209632 >> v2:172.21.15.57:3300/0 conn(0x7f3fc00b2fc0 0x7f3fc00b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.068 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc4ef6700 1 -- 172.21.15.87:0/3942209632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 msgr2=0x7f3fc00654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:22.068 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc4ef6700 1 --2- 172.21.15.87:0/3942209632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 0x7f3fc00654d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.069 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc4ef6700 1 -- 172.21.15.87:0/3942209632 >> v2:172.21.15.57:3300/0 conn(0x7f3fc00b2fc0 msgr2=0x7f3fc00b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:22.069 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc4ef6700 1 --2- 172.21.15.87:0/3942209632 >> v2:172.21.15.57:3300/0 conn(0x7f3fc00b2fc0 0x7f3fc00b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.070 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc4ef6700 1 -- 172.21.15.87:0/3942209632 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc00b0ed0 con 0x7f3fc00a9bd0 2021-06-25T04:47:22.070 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fbffff700 1 --2- 172.21.15.87:0/3942209632 >> v2:172.21.15.57:3300/0 conn(0x7f3fc00b2fc0 0x7f3fc00b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:22.070 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc4ef6700 1 --2- 172.21.15.87:0/3942209632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00a9bd0 0x7f3fc00659c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f3fb8002f70 tx=0x7f3fb8006eb0).ready entity=mon.1 client_cookie=a4af6e3d6021478 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:22.070 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fbeffd700 1 -- 172.21.15.87:0/3942209632 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb800d570 con 0x7f3fc00a9bd0 2021-06-25T04:47:22.071 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fbeffd700 1 -- 172.21.15.87:0/3942209632 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb8000e90 con 0x7f3fc00a9bd0 2021-06-25T04:47:22.071 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fbeffd700 1 -- 172.21.15.87:0/3942209632 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb800d900 con 0x7f3fc00a9bd0 2021-06-25T04:47:22.071 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 -- 172.21.15.87:0/3942209632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00a9bd0 msgr2=0x7f3fc00659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.071 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 --2- 172.21.15.87:0/3942209632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00a9bd0 0x7f3fc00659c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f3fb8002f70 tx=0x7f3fb8006eb0).stop 2021-06-25T04:47:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 -- 172.21.15.87:0/3942209632 shutdown_connections 2021-06-25T04:47:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 --2- 172.21.15.87:0/3942209632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00a9bd0 0x7f3fc00659c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 --2- 172.21.15.87:0/3942209632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 0x7f3fc00654d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.077 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 --2- 172.21.15.87:0/3942209632 >> v2:172.21.15.57:3300/0 conn(0x7f3fc00b2fc0 0x7f3fc00b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.078 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 -- 172.21.15.87:0/3942209632 >> 172.21.15.87:0/3942209632 conn(0x7f3fc00636a0 msgr2=0x7f3fc0063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:22.078 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 -- 172.21.15.87:0/3942209632 shutdown_connections 2021-06-25T04:47:22.078 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.063+0000 7f3fc56f7700 1 -- 172.21.15.87:0/3942209632 wait complete. 2021-06-25T04:47:22.078 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc56f7700 1 Processor -- start 2021-06-25T04:47:22.078 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc56f7700 1 -- start start 2021-06-25T04:47:22.079 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc56f7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00a9bd0 0x7f3fc00b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.079 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc56f7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 0x7f3fc014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.079 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc56f7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00b2fc0 0x7f3fc01561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.079 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc56f7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc015a580 con 0x7f3fc00a9bd0 2021-06-25T04:47:22.080 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc56f7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00aa180 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.080 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc56f7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00aa420 con 0x7f3fc00b18b0 2021-06-25T04:47:22.080 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fbf7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 0x7f3fc014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.080 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc4ef6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00b2fc0 0x7f3fc01561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.080 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc4ef6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00b2fc0 0x7f3fc01561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49476/0 (socket says 172.21.15.87:49476) 2021-06-25T04:47:22.081 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fbf7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 0x7f3fc014a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:57648/0 (socket says 172.21.15.87:57648) 2021-06-25T04:47:22.081 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc4ef6700 1 -- 172.21.15.87:0/1795435554 learned_addr learned my addr 172.21.15.87:0/1795435554 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:22.081 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fbffff700 1 --2- 172.21.15.87:0/1795435554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00a9bd0 0x7f3fc00b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.082 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc4ef6700 1 -- 172.21.15.87:0/1795435554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 msgr2=0x7f3fc014a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.082 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc4ef6700 1 --2- 172.21.15.87:0/1795435554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 0x7f3fc014a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.082 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc4ef6700 1 -- 172.21.15.87:0/1795435554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00a9bd0 msgr2=0x7f3fc00b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.082 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc4ef6700 1 --2- 172.21.15.87:0/1795435554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00a9bd0 0x7f3fc00b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.083 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc4ef6700 1 -- 172.21.15.87:0/1795435554 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb800b1e0 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.083 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fbf7fe700 1 --2- 172.21.15.87:0/1795435554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 0x7f3fc014a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:22.083 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc4ef6700 1 --2- 172.21.15.87:0/1795435554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00b2fc0 0x7f3fc01561f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f3fb8002f70 tx=0x7f3fb8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:22.083 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fbd7fa700 1 -- 172.21.15.87:0/1795435554 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb8006b60 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.084 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fbd7fa700 1 -- 172.21.15.87:0/1795435554 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb800de20 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.084 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc56f7700 1 -- 172.21.15.87:0/1795435554 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc00aa6c0 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.084 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fbd7fa700 1 -- 172.21.15.87:0/1795435554 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb8011de0 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.085 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fc56f7700 1 -- 172.21.15.87:0/1795435554 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc01566e0 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.085 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fbd7fa700 1 -- 172.21.15.87:0/1795435554 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f3fb800f070 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.085 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.067+0000 7f3fbd7fa700 1 -- 172.21.15.87:0/1795435554 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f3fb80275d0 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.086 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.071+0000 7f3fc56f7700 1 -- 172.21.15.87:0/1795435554 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc0057310 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.086 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.075+0000 7f3fbd7fa700 1 -- 172.21.15.87:0/1795435554 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f3fb8027860 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.143+0000 7f3fc56f7700 1 -- 172.21.15.87:0/1795435554 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", "id": 1} v 0) v1 -- 0x7f3fc00698a0 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.152 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.151+0000 7f3fbd7fa700 1 -- 172.21.15.87:0/1795435554 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3fb8027a00 con 0x7f3fc00b2fc0 2021-06-25T04:47:22.153 INFO:teuthology.orchestra.run.smithi087.stdout:1 2021-06-25T04:47:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.155+0000 7f3fc56f7700 1 -- 172.21.15.87:0/1795435554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00b2fc0 msgr2=0x7f3fc01561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.155+0000 7f3fc56f7700 1 --2- 172.21.15.87:0/1795435554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00b2fc0 0x7f3fc01561f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f3fb8002f70 tx=0x7f3fb8015000).stop 2021-06-25T04:47:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.155+0000 7f3fc56f7700 1 -- 172.21.15.87:0/1795435554 shutdown_connections 2021-06-25T04:47:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.155+0000 7f3fc56f7700 1 --2- 172.21.15.87:0/1795435554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00b2fc0 0x7f3fc01561f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.155+0000 7f3fc56f7700 1 --2- 172.21.15.87:0/1795435554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00b18b0 0x7f3fc014a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.155+0000 7f3fc56f7700 1 --2- 172.21.15.87:0/1795435554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00a9bd0 0x7f3fc00b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.155+0000 7f3fc56f7700 1 -- 172.21.15.87:0/1795435554 >> 172.21.15.87:0/1795435554 conn(0x7f3fc00636a0 msgr2=0x7f3fc0144d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.155+0000 7f3fc56f7700 1 -- 172.21.15.87:0/1795435554 shutdown_connections 2021-06-25T04:47:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.155+0000 7f3fc56f7700 1 -- 172.21.15.87:0/1795435554 wait complete. 2021-06-25T04:47:22.164 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new f55562f2-e1ee-45bf-8a10-1538ce97cd5b 2 2021-06-25T04:47:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.267+0000 7f404ccda700 1 Processor -- start 2021-06-25T04:47:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.267+0000 7f404ccda700 1 -- start start 2021-06-25T04:47:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.267+0000 7f404ccda700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f40480612e0 0x7f40480616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.267+0000 7f404ccda700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4048140400 0x7f4048140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.267+0000 7f404ccda700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40480aecb0 con 0x7f40480ad580 2021-06-25T04:47:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.267+0000 7f404ccda700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40480b6ee0 con 0x7f4048140400 2021-06-25T04:47:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.267+0000 7f404ccda700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40480aeee0 con 0x7f40480612e0 2021-06-25T04:47:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.267+0000 7f40477fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f40480612e0 0x7f40480616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.267+0000 7f4046ffd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f40480ad580 0x7f40480b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34342/0 (socket says 172.21.15.87:34342) 2021-06-25T04:47:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.267+0000 7f4046ffd700 1 -- 172.21.15.87:0/1028998145 learned_addr learned my addr 172.21.15.87:0/1028998145 (peer_addr_for_me v1:172.21.15.87:0/0) 2021-06-25T04:47:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f4047fff700 1 --2- 172.21.15.87:0/1028998145 >> v2:172.21.15.57:3300/0 conn(0x7f4048140400 0x7f4048140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f40477fe700 1 -- 172.21.15.87:0/1028998145 >> v2:172.21.15.57:3300/0 conn(0x7f4048140400 msgr2=0x7f4048140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:22.275 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f40477fe700 1 --2- 172.21.15.87:0/1028998145 >> v2:172.21.15.57:3300/0 conn(0x7f4048140400 0x7f4048140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.277 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f40477fe700 1 -- 172.21.15.87:0/1028998145 >> v1:172.21.15.87:6789/0 conn(0x7f40480ad580 legacy=0x7f40480b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.277 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f40477fe700 1 -- 172.21.15.87:0/1028998145 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40480af180 con 0x7f40480612e0 2021-06-25T04:47:22.277 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f40477fe700 1 --2- 172.21.15.87:0/1028998145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40480612e0 0x7f40480616c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f40480aeb60 tx=0x7f40400091d0).ready entity=mon.1 client_cookie=4e16477f7908400d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:22.278 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f40467fc700 1 -- 172.21.15.87:0/1028998145 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4040009ea0 con 0x7f40480612e0 2021-06-25T04:47:22.278 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f40467fc700 1 -- 172.21.15.87:0/1028998145 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404000b860 con 0x7f40480612e0 2021-06-25T04:47:22.279 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f40467fc700 1 -- 172.21.15.87:0/1028998145 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f404000b9d0 con 0x7f40480612e0 2021-06-25T04:47:22.279 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f404ccda700 1 -- 172.21.15.87:0/1028998145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40480612e0 msgr2=0x7f40480616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.279 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f404ccda700 1 --2- 172.21.15.87:0/1028998145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40480612e0 0x7f40480616c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f40480aeb60 tx=0x7f40400091d0).stop 2021-06-25T04:47:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f404ccda700 1 -- 172.21.15.87:0/1028998145 shutdown_connections 2021-06-25T04:47:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f404ccda700 1 --2- 172.21.15.87:0/1028998145 >> v2:172.21.15.57:3300/0 conn(0x7f4048140400 0x7f4048140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f404ccda700 1 --2- 172.21.15.87:0/1028998145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40480612e0 0x7f40480616c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.283 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f404ccda700 1 -- 172.21.15.87:0/1028998145 >> 172.21.15.87:0/1028998145 conn(0x7f4048066da0 msgr2=0x7f4048067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:22.283 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f404ccda700 1 -- 172.21.15.87:0/1028998145 shutdown_connections 2021-06-25T04:47:22.283 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f404ccda700 1 -- 172.21.15.87:0/1028998145 wait complete. 2021-06-25T04:47:22.287 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f404ccda700 1 Processor -- start 2021-06-25T04:47:22.287 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.271+0000 7f404ccda700 1 -- start start 2021-06-25T04:47:22.287 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f404ccda700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40480612e0 0x7f4048152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.287 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f404ccda700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40480ad580 0x7f40480ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f404ccda700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4048140400 0x7f4048140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f404ccda700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40480b1840 con 0x7f40480612e0 2021-06-25T04:47:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f404ccda700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40480b0e60 con 0x7f40480ad580 2021-06-25T04:47:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f404ccda700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40480b1100 con 0x7f4048140400 2021-06-25T04:47:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4046ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40480ad580 0x7f40480ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4047fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4048140400 0x7f4048140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4046ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40480ad580 0x7f40480ab930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49486/0 (socket says 172.21.15.87:49486) 2021-06-25T04:47:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4046ffd700 1 -- 172.21.15.87:0/2866382365 learned_addr learned my addr 172.21.15.87:0/2866382365 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f40477fe700 1 --2- 172.21.15.87:0/2866382365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40480612e0 0x7f4048152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4046ffd700 1 -- 172.21.15.87:0/2866382365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4048140400 msgr2=0x7f4048140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4046ffd700 1 --2- 172.21.15.87:0/2866382365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4048140400 0x7f4048140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4046ffd700 1 -- 172.21.15.87:0/2866382365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40480612e0 msgr2=0x7f4048152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4046ffd700 1 --2- 172.21.15.87:0/2866382365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40480612e0 0x7f4048152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4046ffd700 1 -- 172.21.15.87:0/2866382365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040009470 con 0x7f40480ad580 2021-06-25T04:47:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4046ffd700 1 --2- 172.21.15.87:0/2866382365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40480ad580 0x7f40480ab930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f40480ae0e0 tx=0x7f403c007ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4044ff9700 1 -- 172.21.15.87:0/2866382365 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f403c0070d0 con 0x7f40480ad580 2021-06-25T04:47:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4044ff9700 1 -- 172.21.15.87:0/2866382365 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c007230 con 0x7f40480ad580 2021-06-25T04:47:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f404ccda700 1 -- 172.21.15.87:0/2866382365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40480b13a0 con 0x7f40480ad580 2021-06-25T04:47:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4044ff9700 1 -- 172.21.15.87:0/2866382365 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f403c005610 con 0x7f40480ad580 2021-06-25T04:47:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f404ccda700 1 -- 172.21.15.87:0/2866382365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40480ad190 con 0x7f40480ad580 2021-06-25T04:47:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4044ff9700 1 -- 172.21.15.87:0/2866382365 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f403c010070 con 0x7f40480ad580 2021-06-25T04:47:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f4044ff9700 1 -- 172.21.15.87:0/2866382365 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f403c005da0 con 0x7f40480ad580 2021-06-25T04:47:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.275+0000 7f404ccda700 1 -- 172.21.15.87:0/2866382365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40480b1530 con 0x7f40480ad580 2021-06-25T04:47:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.279+0000 7f4044ff9700 1 -- 172.21.15.87:0/2866382365 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f403c018020 con 0x7f40480ad580 2021-06-25T04:47:22.346 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.347+0000 7f404ccda700 1 -- 172.21.15.87:0/2866382365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", "id": 2} v 0) v1 -- 0x7f4048057310 con 0x7f40480ad580 2021-06-25T04:47:22.354 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.355+0000 7f4044ff9700 1 -- 172.21.15.87:0/2866382365 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f403c013450 con 0x7f40480ad580 2021-06-25T04:47:22.355 INFO:teuthology.orchestra.run.smithi087.stdout:2 2021-06-25T04:47:22.356 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.355+0000 7f404ccda700 1 -- 172.21.15.87:0/2866382365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40480ad580 msgr2=0x7f40480ab930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.355+0000 7f404ccda700 1 --2- 172.21.15.87:0/2866382365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40480ad580 0x7f40480ab930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f40480ae0e0 tx=0x7f403c007ba0).stop 2021-06-25T04:47:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.355+0000 7f404ccda700 1 -- 172.21.15.87:0/2866382365 shutdown_connections 2021-06-25T04:47:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.355+0000 7f404ccda700 1 --2- 172.21.15.87:0/2866382365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4048140400 0x7f4048140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.357 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.355+0000 7f404ccda700 1 --2- 172.21.15.87:0/2866382365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40480ad580 0x7f40480ab930 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.355+0000 7f404ccda700 1 --2- 172.21.15.87:0/2866382365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40480612e0 0x7f4048152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.355+0000 7f404ccda700 1 -- 172.21.15.87:0/2866382365 >> 172.21.15.87:0/2866382365 conn(0x7f4048066da0 msgr2=0x7f40480b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.355+0000 7f404ccda700 1 -- 172.21.15.87:0/2866382365 shutdown_connections 2021-06-25T04:47:22.358 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.355+0000 7f404ccda700 1 -- 172.21.15.87:0/2866382365 wait complete. 2021-06-25T04:47:22.367 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c 3 2021-06-25T04:47:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.467+0000 7f46f359e700 1 Processor -- start 2021-06-25T04:47:22.469 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.467+0000 7f46f359e700 1 -- start start 2021-06-25T04:47:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f46f40ad4a0 0x7f46f40b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46f413f870 0x7f46f413fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f40b0a70 con 0x7f46f40aef50 2021-06-25T04:47:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f40b0d10 con 0x7f46f40ad4a0 2021-06-25T04:47:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40ae810 con 0x7f46f413f870 2021-06-25T04:47:22.473 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f2d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46f413f870 0x7f46f413fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f2d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46f413f870 0x7f46f413fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:57668/0 (socket says 172.21.15.87:57668) 2021-06-25T04:47:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f2d9d700 1 -- 172.21.15.87:0/1691714102 learned_addr learned my addr 172.21.15.87:0/1691714102 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f259c700 1 --2- 172.21.15.87:0/1691714102 >> v2:172.21.15.87:3300/0 conn(0x7f46f40ad4a0 0x7f46f40b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.474 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f259c700 1 -- 172.21.15.87:0/1691714102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46f413f870 msgr2=0x7f46f413fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f259c700 1 --2- 172.21.15.87:0/1691714102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46f413f870 0x7f46f413fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f259c700 1 -- 172.21.15.87:0/1691714102 >> v1:172.21.15.57:6789/0 conn(0x7f46f40aef50 legacy=0x7f46f40b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f259c700 1 -- 172.21.15.87:0/1691714102 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f40aeab0 con 0x7f46f40ad4a0 2021-06-25T04:47:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f259c700 1 --2- 172.21.15.87:0/1691714102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f40ad4a0 0x7f46f40b03a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f46e4002f70 tx=0x7f46e4006df0).ready entity=mon.1 client_cookie=ba3d43132f0b6c1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:22.475 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f159a700 1 -- 172.21.15.87:0/1691714102 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46e400d570 con 0x7f46f40ad4a0 2021-06-25T04:47:22.476 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f159a700 1 -- 172.21.15.87:0/1691714102 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e4000e90 con 0x7f46f40ad4a0 2021-06-25T04:47:22.476 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f159a700 1 -- 172.21.15.87:0/1691714102 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46e400d8c0 con 0x7f46f40ad4a0 2021-06-25T04:47:22.476 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 -- 172.21.15.87:0/1691714102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f40ad4a0 msgr2=0x7f46f40b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.476 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 --2- 172.21.15.87:0/1691714102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f40ad4a0 0x7f46f40b03a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f46e4002f70 tx=0x7f46e4006df0).stop 2021-06-25T04:47:22.477 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 -- 172.21.15.87:0/1691714102 shutdown_connections 2021-06-25T04:47:22.477 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 --2- 172.21.15.87:0/1691714102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46f413f870 0x7f46f413fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.477 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 --2- 172.21.15.87:0/1691714102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f40ad4a0 0x7f46f40b03a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.477 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 -- 172.21.15.87:0/1691714102 >> 172.21.15.87:0/1691714102 conn(0x7f46f4061190 msgr2=0x7f46f4062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:22.478 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 -- 172.21.15.87:0/1691714102 shutdown_connections 2021-06-25T04:47:22.478 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.471+0000 7f46f359e700 1 -- 172.21.15.87:0/1691714102 wait complete. 2021-06-25T04:47:22.481 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f359e700 1 Processor -- start 2021-06-25T04:47:22.481 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f359e700 1 -- start start 2021-06-25T04:47:22.481 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f40ad4a0 0x7f46f414e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.482 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40aef50 0x7f46f4067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.482 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46f413f870 0x7f46f414af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.482 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f414ec30 con 0x7f46f40aef50 2021-06-25T04:47:22.482 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f4063bf0 con 0x7f46f40ad4a0 2021-06-25T04:47:22.483 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f4063e90 con 0x7f46f413f870 2021-06-25T04:47:22.483 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f40ad4a0 0x7f46f414e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.483 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f40ad4a0 0x7f46f414e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49496/0 (socket says 172.21.15.87:49496) 2021-06-25T04:47:22.483 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f259c700 1 -- 172.21.15.87:0/2180655723 learned_addr learned my addr 172.21.15.87:0/2180655723 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:22.484 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f2d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46f413f870 0x7f46f414af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.484 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f1d9b700 1 --2- 172.21.15.87:0/2180655723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40aef50 0x7f46f4067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.484 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f259c700 1 -- 172.21.15.87:0/2180655723 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46f413f870 msgr2=0x7f46f414af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.484 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f259c700 1 --2- 172.21.15.87:0/2180655723 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46f413f870 0x7f46f414af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.484 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f259c700 1 -- 172.21.15.87:0/2180655723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40aef50 msgr2=0x7f46f4067280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.485 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f259c700 1 --2- 172.21.15.87:0/2180655723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40aef50 0x7f46f4067280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.485 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f259c700 1 -- 172.21.15.87:0/2180655723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e400b180 con 0x7f46f40ad4a0 2021-06-25T04:47:22.485 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f259c700 1 --2- 172.21.15.87:0/2180655723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f40ad4a0 0x7f46f414e740 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f46e4002f70 tx=0x7f46e4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:22.485 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46e37fe700 1 -- 172.21.15.87:0/2180655723 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46e4006b20 con 0x7f46f40ad4a0 2021-06-25T04:47:22.486 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46e37fe700 1 -- 172.21.15.87:0/2180655723 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e4012e40 con 0x7f46f40ad4a0 2021-06-25T04:47:22.486 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f359e700 1 -- 172.21.15.87:0/2180655723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f4064130 con 0x7f46f40ad4a0 2021-06-25T04:47:22.486 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46e37fe700 1 -- 172.21.15.87:0/2180655723 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46e401f630 con 0x7f46f40ad4a0 2021-06-25T04:47:22.486 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46f359e700 1 -- 172.21.15.87:0/2180655723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f4067770 con 0x7f46f40ad4a0 2021-06-25T04:47:22.487 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46e37fe700 1 -- 172.21.15.87:0/2180655723 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f46e4025020 con 0x7f46f40ad4a0 2021-06-25T04:47:22.487 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.475+0000 7f46e37fe700 1 -- 172.21.15.87:0/2180655723 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f46e4028900 con 0x7f46f40ad4a0 2021-06-25T04:47:22.487 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.479+0000 7f46f359e700 1 -- 172.21.15.87:0/2180655723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc003410 con 0x7f46f40ad4a0 2021-06-25T04:47:22.487 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.479+0000 7f46e37fe700 1 -- 172.21.15.87:0/2180655723 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f46e4028b60 con 0x7f46f40ad4a0 2021-06-25T04:47:22.549 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.547+0000 7f46f359e700 1 -- 172.21.15.87:0/2180655723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", "id": 3} v 0) v1 -- 0x7f46cc003990 con 0x7f46f40ad4a0 2021-06-25T04:47:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.559+0000 7f46e37fe700 1 -- 172.21.15.87:0/2180655723 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f46e4028d80 con 0x7f46f40ad4a0 2021-06-25T04:47:22.559 INFO:teuthology.orchestra.run.smithi087.stdout:3 2021-06-25T04:47:22.560 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.559+0000 7f46f359e700 1 -- 172.21.15.87:0/2180655723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f40ad4a0 msgr2=0x7f46f414e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.559+0000 7f46f359e700 1 --2- 172.21.15.87:0/2180655723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f40ad4a0 0x7f46f414e740 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f46e4002f70 tx=0x7f46e4014000).stop 2021-06-25T04:47:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.559+0000 7f46f359e700 1 -- 172.21.15.87:0/2180655723 shutdown_connections 2021-06-25T04:47:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.559+0000 7f46f359e700 1 --2- 172.21.15.87:0/2180655723 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46f413f870 0x7f46f414af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.559+0000 7f46f359e700 1 --2- 172.21.15.87:0/2180655723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f40aef50 0x7f46f4067280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.559+0000 7f46f359e700 1 --2- 172.21.15.87:0/2180655723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f40ad4a0 0x7f46f414e740 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.559+0000 7f46f359e700 1 -- 172.21.15.87:0/2180655723 >> 172.21.15.87:0/2180655723 conn(0x7f46f4061190 msgr2=0x7f46f413ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.559+0000 7f46f359e700 1 -- 172.21.15.87:0/2180655723 shutdown_connections 2021-06-25T04:47:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.559+0000 7f46f359e700 1 -- 172.21.15.87:0/2180655723 wait complete. 2021-06-25T04:47:22.573 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 6b6d8788-2f26-4b45-84bd-651eaa34cada 4 2021-06-25T04:47:22.672 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.671+0000 7f53370b4700 1 Processor -- start 2021-06-25T04:47:22.673 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.671+0000 7f53370b4700 1 -- start start 2021-06-25T04:47:22.676 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.671+0000 7f53370b4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b7330 0x7f53300b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.676 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.671+0000 7f53370b4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f53300aabe0 0x7f5330064b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.676 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.671+0000 7f53370b4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53300b2340 con 0x7f53300b3020 2021-06-25T04:47:22.676 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.671+0000 7f53370b4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5330144210 con 0x7f53300aabe0 2021-06-25T04:47:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53370b4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53300b3530 con 0x7f53300b7330 2021-06-25T04:47:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53360b2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b7330 0x7f53300b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53360b2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b7330 0x7f53300b7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:57678/0 (socket says 172.21.15.87:57678) 2021-06-25T04:47:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53360b2700 1 -- 172.21.15.87:0/4279101730 learned_addr learned my addr 172.21.15.87:0/4279101730 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:22.677 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53368b3700 1 --2- 172.21.15.87:0/4279101730 >> v2:172.21.15.57:3300/0 conn(0x7f53300aabe0 0x7f5330064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.678 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53360b2700 1 -- 172.21.15.87:0/4279101730 >> v2:172.21.15.57:3300/0 conn(0x7f53300aabe0 msgr2=0x7f5330064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:22.678 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53360b2700 1 --2- 172.21.15.87:0/4279101730 >> v2:172.21.15.57:3300/0 conn(0x7f53300aabe0 0x7f5330064b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.678 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53360b2700 1 -- 172.21.15.87:0/4279101730 >> v1:172.21.15.57:6789/0 conn(0x7f53300b3020 legacy=0x7f533013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.679 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53360b2700 1 -- 172.21.15.87:0/4279101730 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300b2570 con 0x7f53300b7330 2021-06-25T04:47:22.679 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53360b2700 1 --2- 172.21.15.87:0/4279101730 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b7330 0x7f53300b7710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f532c002f70 tx=0x7f532c006e50).ready entity=mon.2 client_cookie=b8729fd878f0c878 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:22.679 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53350b0700 1 -- 172.21.15.87:0/4279101730 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f532c00d5c0 con 0x7f53300b7330 2021-06-25T04:47:22.679 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53350b0700 1 -- 172.21.15.87:0/4279101730 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c000e90 con 0x7f53300b7330 2021-06-25T04:47:22.680 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53350b0700 1 -- 172.21.15.87:0/4279101730 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f532c00d950 con 0x7f53300b7330 2021-06-25T04:47:22.680 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53370b4700 1 -- 172.21.15.87:0/4279101730 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b7330 msgr2=0x7f53300b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.680 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53370b4700 1 --2- 172.21.15.87:0/4279101730 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b7330 0x7f53300b7710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f532c002f70 tx=0x7f532c006e50).stop 2021-06-25T04:47:22.680 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53370b4700 1 -- 172.21.15.87:0/4279101730 shutdown_connections 2021-06-25T04:47:22.681 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53370b4700 1 --2- 172.21.15.87:0/4279101730 >> v2:172.21.15.57:3300/0 conn(0x7f53300aabe0 0x7f5330064b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.681 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53370b4700 1 --2- 172.21.15.87:0/4279101730 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b7330 0x7f53300b7710 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.681 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53370b4700 1 -- 172.21.15.87:0/4279101730 >> 172.21.15.87:0/4279101730 conn(0x7f533005f670 msgr2=0x7f533005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:22.681 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53370b4700 1 -- 172.21.15.87:0/4279101730 shutdown_connections 2021-06-25T04:47:22.682 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.675+0000 7f53370b4700 1 -- 172.21.15.87:0/4279101730 wait complete. 2021-06-25T04:47:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53370b4700 1 Processor -- start 2021-06-25T04:47:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53370b4700 1 -- start start 2021-06-25T04:47:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53370b4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53300aabe0 0x7f53300afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.688 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53370b4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b3020 0x7f533005bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53370b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53300b7330 0x7f5330061670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53370b4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53301555f0 con 0x7f53300b7330 2021-06-25T04:47:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53370b4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53300b10d0 con 0x7f53300aabe0 2021-06-25T04:47:22.689 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53370b4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53300b1300 con 0x7f53300b3020 2021-06-25T04:47:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53358b1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b3020 0x7f533005bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53360b2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53300aabe0 0x7f53300afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.690 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53360b2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53300aabe0 0x7f53300afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49508/0 (socket says 172.21.15.87:49508) 2021-06-25T04:47:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53358b1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b3020 0x7f533005bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:57684/0 (socket says 172.21.15.87:57684) 2021-06-25T04:47:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53360b2700 1 -- 172.21.15.87:0/670635361 learned_addr learned my addr 172.21.15.87:0/670635361 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:22.691 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53368b3700 1 --2- 172.21.15.87:0/670635361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53300b7330 0x7f5330061670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53358b1700 1 -- 172.21.15.87:0/670635361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53300aabe0 msgr2=0x7f53300afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53358b1700 1 --2- 172.21.15.87:0/670635361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53300aabe0 0x7f53300afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53358b1700 1 -- 172.21.15.87:0/670635361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53300b7330 msgr2=0x7f5330061670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53358b1700 1 --2- 172.21.15.87:0/670635361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53300b7330 0x7f5330061670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.692 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53358b1700 1 -- 172.21.15.87:0/670635361 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c00b1e0 con 0x7f53300b3020 2021-06-25T04:47:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53358b1700 1 --2- 172.21.15.87:0/670635361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b3020 0x7f533005bc60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f53300b4f60 tx=0x7f5324007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53237fe700 1 -- 172.21.15.87:0/670635361 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5324012400 con 0x7f53300b3020 2021-06-25T04:47:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53237fe700 1 -- 172.21.15.87:0/670635361 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324012560 con 0x7f53300b3020 2021-06-25T04:47:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53370b4700 1 -- 172.21.15.87:0/670635361 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533005c300 con 0x7f53300b3020 2021-06-25T04:47:22.693 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53237fe700 1 -- 172.21.15.87:0/670635361 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53240128c0 con 0x7f53300b3020 2021-06-25T04:47:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53370b4700 1 -- 172.21.15.87:0/670635361 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533009e870 con 0x7f53300b3020 2021-06-25T04:47:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53237fe700 1 -- 172.21.15.87:0/670635361 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f5324019030 con 0x7f53300b3020 2021-06-25T04:47:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53237fe700 1 -- 172.21.15.87:0/670635361 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f532401b8e0 con 0x7f53300b3020 2021-06-25T04:47:22.694 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.679+0000 7f53370b4700 1 -- 172.21.15.87:0/670635361 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5330057310 con 0x7f53300b3020 2021-06-25T04:47:22.695 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.683+0000 7f53237fe700 1 -- 172.21.15.87:0/670635361 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f5324017070 con 0x7f53300b3020 2021-06-25T04:47:22.752 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.751+0000 7f53370b4700 1 -- 172.21.15.87:0/670635361 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", "id": 4} v 0) v1 -- 0x7f5330060160 con 0x7f53300b3020 2021-06-25T04:47:22.759 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.759+0000 7f53237fe700 1 -- 172.21.15.87:0/670635361 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f532401bb70 con 0x7f53300b3020 2021-06-25T04:47:22.760 INFO:teuthology.orchestra.run.smithi087.stdout:4 2021-06-25T04:47:22.761 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.759+0000 7f53370b4700 1 -- 172.21.15.87:0/670635361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b3020 msgr2=0x7f533005bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.761 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.759+0000 7f53370b4700 1 --2- 172.21.15.87:0/670635361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b3020 0x7f533005bc60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f53300b4f60 tx=0x7f5324007b90).stop 2021-06-25T04:47:22.762 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.759+0000 7f53370b4700 1 -- 172.21.15.87:0/670635361 shutdown_connections 2021-06-25T04:47:22.762 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.759+0000 7f53370b4700 1 --2- 172.21.15.87:0/670635361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53300b7330 0x7f5330061670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.762 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.759+0000 7f53370b4700 1 --2- 172.21.15.87:0/670635361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53300b3020 0x7f533005bc60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.762 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.759+0000 7f53370b4700 1 --2- 172.21.15.87:0/670635361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53300aabe0 0x7f53300afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.763 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.759+0000 7f53370b4700 1 -- 172.21.15.87:0/670635361 >> 172.21.15.87:0/670635361 conn(0x7f533005f670 msgr2=0x7f533013f620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:22.763 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.759+0000 7f53370b4700 1 -- 172.21.15.87:0/670635361 shutdown_connections 2021-06-25T04:47:22.763 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.759+0000 7f53370b4700 1 -- 172.21.15.87:0/670635361 wait complete. 2021-06-25T04:47:22.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new b57c1968-cc07-4542-82e5-5c924cb09858 5 2021-06-25T04:47:22.864 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.863+0000 7efc9e110700 1 Processor -- start 2021-06-25T04:47:22.865 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.863+0000 7efc9e110700 1 -- start start 2021-06-25T04:47:22.868 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc980b4140 0x7efc98140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.868 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc980b4650 0x7efc980b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.868 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc98143b20 con 0x7efc98146910 2021-06-25T04:47:22.868 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc981474d0 con 0x7efc980b4650 2021-06-25T04:47:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc98143dc0 con 0x7efc980b4140 2021-06-25T04:47:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc8effd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc980b4140 0x7efc98140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc8effd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc980b4140 0x7efc98140900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49516/0 (socket says 172.21.15.87:49516) 2021-06-25T04:47:22.869 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc977fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efc98146910 0x7efc981401f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34376/0 (socket says 172.21.15.87:34376) 2021-06-25T04:47:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc8effd700 1 -- 172.21.15.87:0/3012929053 learned_addr learned my addr 172.21.15.87:0/3012929053 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc97fff700 1 --2- 172.21.15.87:0/3012929053 >> v2:172.21.15.57:3300/0 conn(0x7efc980b4650 0x7efc980b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc8effd700 1 -- 172.21.15.87:0/3012929053 >> v2:172.21.15.57:3300/0 conn(0x7efc980b4650 msgr2=0x7efc980b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc8effd700 1 --2- 172.21.15.87:0/3012929053 >> v2:172.21.15.57:3300/0 conn(0x7efc980b4650 0x7efc980b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc8effd700 1 -- 172.21.15.87:0/3012929053 >> v1:172.21.15.87:6789/0 conn(0x7efc98146910 legacy=0x7efc981401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc8effd700 1 -- 172.21.15.87:0/3012929053 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc980b0c50 con 0x7efc980b4140 2021-06-25T04:47:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc96ffd700 1 -- 172.21.15.87:0/3012929053 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424876311 0 0) 0x7efc98143b20 con 0x7efc98146910 2021-06-25T04:47:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc8effd700 1 --2- 172.21.15.87:0/3012929053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc980b4140 0x7efc98140900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efc80002f70 tx=0x7efc80006eb0).ready entity=mon.1 client_cookie=17fd3693821f9b65 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc96ffd700 1 -- 172.21.15.87:0/3012929053 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8000d610 con 0x7efc980b4140 2021-06-25T04:47:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc96ffd700 1 -- 172.21.15.87:0/3012929053 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc80000e90 con 0x7efc980b4140 2021-06-25T04:47:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc96ffd700 1 -- 172.21.15.87:0/3012929053 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8000d960 con 0x7efc980b4140 2021-06-25T04:47:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 -- 172.21.15.87:0/3012929053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc980b4140 msgr2=0x7efc98140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 --2- 172.21.15.87:0/3012929053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc980b4140 0x7efc98140900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efc80002f70 tx=0x7efc80006eb0).stop 2021-06-25T04:47:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 -- 172.21.15.87:0/3012929053 shutdown_connections 2021-06-25T04:47:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 --2- 172.21.15.87:0/3012929053 >> v2:172.21.15.57:3300/0 conn(0x7efc980b4650 0x7efc980b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 --2- 172.21.15.87:0/3012929053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc980b4140 0x7efc98140900 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 -- 172.21.15.87:0/3012929053 >> 172.21.15.87:0/3012929053 conn(0x7efc9805c450 msgr2=0x7efc9805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 -- 172.21.15.87:0/3012929053 shutdown_connections 2021-06-25T04:47:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 -- 172.21.15.87:0/3012929053 wait complete. 2021-06-25T04:47:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 Processor -- start 2021-06-25T04:47:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.867+0000 7efc9e110700 1 -- start start 2021-06-25T04:47:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc9e110700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc980b4140 0x7efc9813cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc9e110700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc980b4650 0x7efc980b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc9e110700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc98146910 0x7efc98155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc9e110700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980b6500 con 0x7efc980b4650 2021-06-25T04:47:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc9e110700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980b73a0 con 0x7efc980b4140 2021-06-25T04:47:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc9e110700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc980b9f70 con 0x7efc98146910 2021-06-25T04:47:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc977fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc980b4140 0x7efc9813cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc97fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc98146910 0x7efc98155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.879 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc97fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc98146910 0x7efc98155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:57698/0 (socket says 172.21.15.87:57698) 2021-06-25T04:47:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc977fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc980b4140 0x7efc9813cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49520/0 (socket says 172.21.15.87:49520) 2021-06-25T04:47:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc97fff700 1 -- 172.21.15.87:0/1140706379 learned_addr learned my addr 172.21.15.87:0/1140706379 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc8effd700 1 --2- 172.21.15.87:0/1140706379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc980b4650 0x7efc980b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:22.880 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc97fff700 1 -- 172.21.15.87:0/1140706379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc980b4140 msgr2=0x7efc9813cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc97fff700 1 --2- 172.21.15.87:0/1140706379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc980b4140 0x7efc9813cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc97fff700 1 -- 172.21.15.87:0/1140706379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc980b4650 msgr2=0x7efc980b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc97fff700 1 --2- 172.21.15.87:0/1140706379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc980b4650 0x7efc980b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc97fff700 1 -- 172.21.15.87:0/1140706379 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8000b1e0 con 0x7efc98146910 2021-06-25T04:47:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc97fff700 1 --2- 172.21.15.87:0/1140706379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc98146910 0x7efc98155e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7efc9000a000 tx=0x7efc90008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc957fa700 1 -- 172.21.15.87:0/1140706379 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc90013620 con 0x7efc98146910 2021-06-25T04:47:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc957fa700 1 -- 172.21.15.87:0/1140706379 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc90013780 con 0x7efc98146910 2021-06-25T04:47:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc9e110700 1 -- 172.21.15.87:0/1140706379 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc980ba210 con 0x7efc98146910 2021-06-25T04:47:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc957fa700 1 -- 172.21.15.87:0/1140706379 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc90013ae0 con 0x7efc98146910 2021-06-25T04:47:22.883 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc9e110700 1 -- 172.21.15.87:0/1140706379 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9813d220 con 0x7efc98146910 2021-06-25T04:47:22.883 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc957fa700 1 -- 172.21.15.87:0/1140706379 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7efc90005a70 con 0x7efc98146910 2021-06-25T04:47:22.883 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc957fa700 1 -- 172.21.15.87:0/1140706379 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7efc90006580 con 0x7efc98146910 2021-06-25T04:47:22.883 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.871+0000 7efc9e110700 1 -- 172.21.15.87:0/1140706379 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc980b5f30 con 0x7efc98146910 2021-06-25T04:47:22.884 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.879+0000 7efc957fa700 1 -- 172.21.15.87:0/1140706379 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7efc9000f040 con 0x7efc98146910 2021-06-25T04:47:22.946 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.947+0000 7efc9e110700 1 -- 172.21.15.87:0/1140706379 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", "id": 5} v 0) v1 -- 0x7efc980ba3a0 con 0x7efc98146910 2021-06-25T04:47:22.955 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.955+0000 7efc957fa700 1 -- 172.21.15.87:0/1140706379 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7efc9002c0b0 con 0x7efc98146910 2021-06-25T04:47:22.955 INFO:teuthology.orchestra.run.smithi087.stdout:5 2021-06-25T04:47:22.957 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.955+0000 7efc9e110700 1 -- 172.21.15.87:0/1140706379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc98146910 msgr2=0x7efc98155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:22.957 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.955+0000 7efc9e110700 1 --2- 172.21.15.87:0/1140706379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc98146910 0x7efc98155e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7efc9000a000 tx=0x7efc90008040).stop 2021-06-25T04:47:22.957 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.955+0000 7efc9e110700 1 -- 172.21.15.87:0/1140706379 shutdown_connections 2021-06-25T04:47:22.958 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.955+0000 7efc9e110700 1 --2- 172.21.15.87:0/1140706379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc98146910 0x7efc98155e40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.958 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.955+0000 7efc9e110700 1 --2- 172.21.15.87:0/1140706379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc980b4650 0x7efc980b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.958 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.955+0000 7efc9e110700 1 --2- 172.21.15.87:0/1140706379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc980b4140 0x7efc9813cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:22.958 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.955+0000 7efc9e110700 1 -- 172.21.15.87:0/1140706379 >> 172.21.15.87:0/1140706379 conn(0x7efc9805c450 msgr2=0x7efc9813ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.955+0000 7efc9e110700 1 -- 172.21.15.87:0/1140706379 shutdown_connections 2021-06-25T04:47:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:22.955+0000 7efc9e110700 1 -- 172.21.15.87:0/1140706379 wait complete. 2021-06-25T04:47:22.969 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 72622640-3724-4a46-8f2d-9c797e8d7fcf 6 2021-06-25T04:47:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.063+0000 7f60d7fff700 1 Processor -- start 2021-06-25T04:47:23.064 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.063+0000 7f60d7fff700 1 -- start start 2021-06-25T04:47:23.069 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.063+0000 7f60d7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60d8066bf0 0x7f60d814e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.069 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.063+0000 7f60d7fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d80652f0 con 0x7f60d80b2fc0 2021-06-25T04:47:23.069 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.063+0000 7f60d7fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d80b33a0 con 0x7f60d80b2560 2021-06-25T04:47:23.070 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.063+0000 7f60d7fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d8061fc0 con 0x7f60d8066bf0 2021-06-25T04:47:23.070 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.063+0000 7f60d67fc700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f60d80b2560 0x7f60d80664e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34390/0 (socket says 172.21.15.87:34390) 2021-06-25T04:47:23.070 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.063+0000 7f60d67fc700 1 -- 172.21.15.87:0/2142940035 learned_addr learned my addr 172.21.15.87:0/2142940035 (peer_addr_for_me v1:172.21.15.87:0/0) 2021-06-25T04:47:23.070 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.063+0000 7f60d77fe700 1 --2- 172.21.15.87:0/2142940035 >> v2:172.21.15.57:3300/0 conn(0x7f60d8066bf0 0x7f60d814e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.063+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212854416 0 0) 0x7f60d80b33a0 con 0x7f60d80b2560 2021-06-25T04:47:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.063+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b8003260 con 0x7f60d80b2560 2021-06-25T04:47:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2676629312 0 0) 0x7f60b8003260 con 0x7f60d80b2560 2021-06-25T04:47:23.072 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 >> v2:172.21.15.57:3300/0 conn(0x7f60d8066bf0 msgr2=0x7f60d814e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:23.072 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 --2- 172.21.15.87:0/2142940035 >> v2:172.21.15.57:3300/0 conn(0x7f60d8066bf0 0x7f60d814e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.072 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 >> v1:172.21.15.57:6789/0 conn(0x7f60d80b2fc0 legacy=0x7f60d8060ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:23.072 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d805fa20 con 0x7f60d80b2560 2021-06-25T04:47:23.073 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f60c0001660 con 0x7f60d80b2560 2021-06-25T04:47:23.073 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d77fe700 1 --2- 172.21.15.87:0/2142940035 >> v2:172.21.15.57:3300/0 conn(0x7f60d8066bf0 0x7f60d814e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:23.073 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 >> v1:172.21.15.87:6789/0 conn(0x7f60d80b2560 legacy=0x7f60d80664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:23.073 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60b8003750 0x7f60b8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.073 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60b8004500 0x7f60b8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.074 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60b8004e70 0x7f60b800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.074 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d8061fc0 con 0x7f60b8003750 2021-06-25T04:47:23.074 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b800bd20 con 0x7f60b8004e70 2021-06-25T04:47:23.074 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b800bee0 con 0x7f60b8004500 2021-06-25T04:47:23.075 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d77fe700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60b8004e70 0x7f60b800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.075 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d67fc700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60b8004500 0x7f60b8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.075 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d6ffd700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60b8003750 0x7f60b8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.075 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d77fe700 1 -- 172.21.15.87:0/2142940035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60b8004500 msgr2=0x7f60b8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:23.075 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d77fe700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60b8004500 0x7f60b8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.076 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d77fe700 1 -- 172.21.15.87:0/2142940035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60b8003750 msgr2=0x7f60b8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:23.076 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d77fe700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60b8003750 0x7f60b8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.077 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d77fe700 1 -- 172.21.15.87:0/2142940035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8003260 con 0x7f60b8004e70 2021-06-25T04:47:23.077 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d67fc700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60b8004500 0x7f60b8004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:23.078 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d77fe700 1 -- 172.21.15.87:0/2142940035 reap_dead start 2021-06-25T04:47:23.078 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d77fe700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60b8004e70 0x7f60b800b750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f60d000c000 tx=0x7f60d00091d0).ready entity=mon.1 client_cookie=31eab8aa0a5915a4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:23.078 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60d000e920 con 0x7f60b8004e70 2021-06-25T04:47:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d000ea80 con 0x7f60b8004e70 2021-06-25T04:47:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d5ffb700 1 -- 172.21.15.87:0/2142940035 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60d000ede0 con 0x7f60b8004e70 2021-06-25T04:47:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d7fff700 1 -- 172.21.15.87:0/2142940035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60b8004e70 msgr2=0x7f60b800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:23.079 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d7fff700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60b8004e70 0x7f60b800b750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f60d000c000 tx=0x7f60d00091d0).stop 2021-06-25T04:47:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d7fff700 1 -- 172.21.15.87:0/2142940035 shutdown_connections 2021-06-25T04:47:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d7fff700 1 --2- 172.21.15.87:0/2142940035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60b8004e70 0x7f60b800b750 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d7fff700 1 -- 172.21.15.87:0/2142940035 >> 172.21.15.87:0/2142940035 conn(0x7f60d80636a0 msgr2=0x7f60d8063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:23.080 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d7fff700 1 -- 172.21.15.87:0/2142940035 shutdown_connections 2021-06-25T04:47:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d7fff700 1 -- 172.21.15.87:0/2142940035 wait complete. 2021-06-25T04:47:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d7fff700 1 Processor -- start 2021-06-25T04:47:23.081 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.067+0000 7f60d7fff700 1 -- start start 2021-06-25T04:47:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60b8004e70 0x7f60d80a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60d8152820 0x7f60d80a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60d80a91a0 0x7f60d80a9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d7fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d8152cd0 con 0x7f60b8004e70 2021-06-25T04:47:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d7fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d8148210 con 0x7f60d80a91a0 2021-06-25T04:47:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d7fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d81484b0 con 0x7f60d8152820 2021-06-25T04:47:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d77fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60d80a91a0 0x7f60d80a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d67fc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60d8152820 0x7f60d80a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d67fc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60d8152820 0x7f60d80a47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:57714/0 (socket says 172.21.15.87:57714) 2021-06-25T04:47:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d77fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60d80a91a0 0x7f60d80a9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49542/0 (socket says 172.21.15.87:49542) 2021-06-25T04:47:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d67fc700 1 -- 172.21.15.87:0/908693184 learned_addr learned my addr 172.21.15.87:0/908693184 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d6ffd700 1 --2- 172.21.15.87:0/908693184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60b8004e70 0x7f60d80a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d77fe700 1 -- 172.21.15.87:0/908693184 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60d8152820 msgr2=0x7f60d80a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d77fe700 1 --2- 172.21.15.87:0/908693184 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60d8152820 0x7f60d80a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d77fe700 1 -- 172.21.15.87:0/908693184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60b8004e70 msgr2=0x7f60d80a2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d77fe700 1 --2- 172.21.15.87:0/908693184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60b8004e70 0x7f60d80a2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d77fe700 1 -- 172.21.15.87:0/908693184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d8148750 con 0x7f60d80a91a0 2021-06-25T04:47:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d77fe700 1 --2- 172.21.15.87:0/908693184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60d80a91a0 0x7f60d80a9650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f60d000c000 tx=0x7f60d001a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60cffff700 1 -- 172.21.15.87:0/908693184 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60d0006ea0 con 0x7f60d80a91a0 2021-06-25T04:47:23.091 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60cffff700 1 -- 172.21.15.87:0/908693184 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0012ba0 con 0x7f60d80a91a0 2021-06-25T04:47:23.091 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d7fff700 1 -- 172.21.15.87:0/908693184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d80a9b40 con 0x7f60d80a91a0 2021-06-25T04:47:23.091 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60cffff700 1 -- 172.21.15.87:0/908693184 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60d001c430 con 0x7f60d80a91a0 2021-06-25T04:47:23.091 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d7fff700 1 -- 172.21.15.87:0/908693184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d8149300 con 0x7f60d80a91a0 2021-06-25T04:47:23.092 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60cffff700 1 -- 172.21.15.87:0/908693184 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f60d002b070 con 0x7f60d80a91a0 2021-06-25T04:47:23.092 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60cffff700 1 -- 172.21.15.87:0/908693184 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f60d001cb70 con 0x7f60d80a91a0 2021-06-25T04:47:23.092 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.071+0000 7f60d7fff700 1 -- 172.21.15.87:0/908693184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d8057310 con 0x7f60d80a91a0 2021-06-25T04:47:23.092 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.075+0000 7f60cffff700 1 -- 172.21.15.87:0/908693184 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f60d0029060 con 0x7f60d80a91a0 2021-06-25T04:47:23.138 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.139+0000 7f60d7fff700 1 -- 172.21.15.87:0/908693184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", "id": 6} v 0) v1 -- 0x7f60d80698a0 con 0x7f60d80a91a0 2021-06-25T04:47:23.146 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.147+0000 7f60cffff700 1 -- 172.21.15.87:0/908693184 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f60d00330b0 con 0x7f60d80a91a0 2021-06-25T04:47:23.148 INFO:teuthology.orchestra.run.smithi087.stdout:6 2021-06-25T04:47:23.149 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.147+0000 7f60d7fff700 1 -- 172.21.15.87:0/908693184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60d80a91a0 msgr2=0x7f60d80a9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:23.149 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.147+0000 7f60d7fff700 1 --2- 172.21.15.87:0/908693184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60d80a91a0 0x7f60d80a9650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f60d000c000 tx=0x7f60d001a000).stop 2021-06-25T04:47:23.150 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.147+0000 7f60d7fff700 1 -- 172.21.15.87:0/908693184 shutdown_connections 2021-06-25T04:47:23.150 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.147+0000 7f60d7fff700 1 --2- 172.21.15.87:0/908693184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60d80a91a0 0x7f60d80a9650 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.150 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.147+0000 7f60d7fff700 1 --2- 172.21.15.87:0/908693184 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60d8152820 0x7f60d80a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.151 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.147+0000 7f60d7fff700 1 --2- 172.21.15.87:0/908693184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60b8004e70 0x7f60d80a2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.151 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.147+0000 7f60d7fff700 1 -- 172.21.15.87:0/908693184 >> 172.21.15.87:0/908693184 conn(0x7f60d80636a0 msgr2=0x7f60d8142b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:23.151 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.147+0000 7f60d7fff700 1 -- 172.21.15.87:0/908693184 shutdown_connections 2021-06-25T04:47:23.151 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.147+0000 7f60d7fff700 1 -- 172.21.15.87:0/908693184 wait complete. 2021-06-25T04:47:23.159 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new f58d446d-b419-4746-b3ca-f6b61e89abb7 7 2021-06-25T04:47:23.251 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e95e8700 1 Processor -- start 2021-06-25T04:47:23.251 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e95e8700 1 -- start start 2021-06-25T04:47:23.254 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e95e8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f20e40b3170 0x7f20e413e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.254 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e95e8700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20e4145050 0x7f20e413ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.255 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e95e8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e40ad8b0 con 0x7f20e40b3550 2021-06-25T04:47:23.255 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e95e8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e40afec0 con 0x7f20e40b3170 2021-06-25T04:47:23.255 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e95e8700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e4145520 con 0x7f20e4145050 2021-06-25T04:47:23.255 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e37fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20e4145050 0x7f20e413ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.256 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e37fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20e4145050 0x7f20e413ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49548/0 (socket says 172.21.15.87:49548) 2021-06-25T04:47:23.256 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e37fe700 1 -- 172.21.15.87:0/1064077818 learned_addr learned my addr 172.21.15.87:0/1064077818 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:23.256 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e2ffd700 1 --2- 172.21.15.87:0/1064077818 >> v2:172.21.15.57:3300/0 conn(0x7f20e40b3170 0x7f20e413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.256 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e37fe700 1 -- 172.21.15.87:0/1064077818 >> v2:172.21.15.57:3300/0 conn(0x7f20e40b3170 msgr2=0x7f20e413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:23.257 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e37fe700 1 --2- 172.21.15.87:0/1064077818 >> v2:172.21.15.57:3300/0 conn(0x7f20e40b3170 0x7f20e413e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.257 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e37fe700 1 -- 172.21.15.87:0/1064077818 >> v1:172.21.15.57:6789/0 conn(0x7f20e40b3550 legacy=0x7f20e41413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:23.257 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e37fe700 1 -- 172.21.15.87:0/1064077818 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e40b0120 con 0x7f20e4145050 2021-06-25T04:47:23.257 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e37fe700 1 --2- 172.21.15.87:0/1064077818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20e4145050 0x7f20e413ea10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f20e4141150 tx=0x7f20dc009290).ready entity=mon.1 client_cookie=4ff907c40cf6e349 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:23.257 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e1ffb700 1 -- 172.21.15.87:0/1064077818 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20dc00b860 con 0x7f20e4145050 2021-06-25T04:47:23.258 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.251+0000 7f20e1ffb700 1 -- 172.21.15.87:0/1064077818 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc00b9c0 con 0x7f20e4145050 2021-06-25T04:47:23.258 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e1ffb700 1 -- 172.21.15.87:0/1064077818 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20dc00bb30 con 0x7f20e4145050 2021-06-25T04:47:23.258 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 -- 172.21.15.87:0/1064077818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20e4145050 msgr2=0x7f20e413ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:23.259 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 --2- 172.21.15.87:0/1064077818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20e4145050 0x7f20e413ea10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f20e4141150 tx=0x7f20dc009290).stop 2021-06-25T04:47:23.259 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 -- 172.21.15.87:0/1064077818 shutdown_connections 2021-06-25T04:47:23.260 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 --2- 172.21.15.87:0/1064077818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20e4145050 0x7f20e413ea10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.260 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 --2- 172.21.15.87:0/1064077818 >> v2:172.21.15.57:3300/0 conn(0x7f20e40b3170 0x7f20e413e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.261 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 -- 172.21.15.87:0/1064077818 >> 172.21.15.87:0/1064077818 conn(0x7f20e4060780 msgr2=0x7f20e4060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:23.261 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 -- 172.21.15.87:0/1064077818 shutdown_connections 2021-06-25T04:47:23.261 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 -- 172.21.15.87:0/1064077818 wait complete. 2021-06-25T04:47:23.269 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 Processor -- start 2021-06-25T04:47:23.269 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 -- start start 2021-06-25T04:47:23.270 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20e40b3170 0x7f20e4150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.270 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20e40b3550 0x7f20e40652f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.271 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20e4145050 0x7f20e40657e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:23.271 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4065cd0 con 0x7f20e4145050 2021-06-25T04:47:23.272 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40639a0 con 0x7f20e40b3550 2021-06-25T04:47:23.272 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e95e8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e41442c0 con 0x7f20e40b3170 2021-06-25T04:47:23.272 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e2ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20e40b3170 0x7f20e4150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.273 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e2ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20e40b3170 0x7f20e4150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:57724/0 (socket says 172.21.15.87:57724) 2021-06-25T04:47:23.273 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.255+0000 7f20e27fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20e40b3550 0x7f20e40652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.274 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e2ffd700 1 -- 172.21.15.87:0/2622594382 learned_addr learned my addr 172.21.15.87:0/2622594382 (peer_addr_for_me v2:172.21.15.87:0/0) 2021-06-25T04:47:23.274 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e37fe700 1 --2- 172.21.15.87:0/2622594382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20e4145050 0x7f20e40657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:23.275 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e27fc700 1 -- 172.21.15.87:0/2622594382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20e40b3170 msgr2=0x7f20e4150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:23.275 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e27fc700 1 --2- 172.21.15.87:0/2622594382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20e40b3170 0x7f20e4150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.275 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e27fc700 1 -- 172.21.15.87:0/2622594382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20e4145050 msgr2=0x7f20e40657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:23.276 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e27fc700 1 --2- 172.21.15.87:0/2622594382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20e4145050 0x7f20e40657e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.276 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e27fc700 1 -- 172.21.15.87:0/2622594382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc009530 con 0x7f20e40b3550 2021-06-25T04:47:23.277 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e2ffd700 1 --2- 172.21.15.87:0/2622594382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20e40b3170 0x7f20e4150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:23.277 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e27fc700 1 --2- 172.21.15.87:0/2622594382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20e40b3550 0x7f20e40652f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f20e40638c0 tx=0x7f20cc007b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:23.278 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20dbfff700 1 -- 172.21.15.87:0/2622594382 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20cc00cea0 con 0x7f20e40b3550 2021-06-25T04:47:23.278 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20dbfff700 1 -- 172.21.15.87:0/2622594382 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc007030 con 0x7f20e40b3550 2021-06-25T04:47:23.279 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20dbfff700 1 -- 172.21.15.87:0/2622594382 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20cc007390 con 0x7f20e40b3550 2021-06-25T04:47:23.279 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e95e8700 1 -- 172.21.15.87:0/2622594382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e4144020 con 0x7f20e40b3550 2021-06-25T04:47:23.279 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e95e8700 1 -- 172.21.15.87:0/2622594382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e4140820 con 0x7f20e40b3550 2021-06-25T04:47:23.280 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20dbfff700 1 -- 172.21.15.87:0/2622594382 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f20cc010030 con 0x7f20e40b3550 2021-06-25T04:47:23.280 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20dbfff700 1 -- 172.21.15.87:0/2622594382 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f20cc006be0 con 0x7f20e40b3550 2021-06-25T04:47:23.281 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.259+0000 7f20e95e8700 1 -- 172.21.15.87:0/2622594382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e4063c90 con 0x7f20e40b3550 2021-06-25T04:47:23.281 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.263+0000 7f20dbfff700 1 -- 172.21.15.87:0/2622594382 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f20cc013410 con 0x7f20e40b3550 2021-06-25T04:47:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.331+0000 7f20e95e8700 1 -- 172.21.15.87:0/2622594382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", "id": 7} v 0) v1 -- 0x7f20e4057310 con 0x7f20e40b3550 2021-06-25T04:47:23.343 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.343+0000 7f20dbfff700 1 -- 172.21.15.87:0/2622594382 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f20cc0135b0 con 0x7f20e40b3550 2021-06-25T04:47:23.345 INFO:teuthology.orchestra.run.smithi087.stdout:7 2021-06-25T04:47:23.347 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.343+0000 7f20e95e8700 1 -- 172.21.15.87:0/2622594382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20e40b3550 msgr2=0x7f20e40652f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:23.347 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.343+0000 7f20e95e8700 1 --2- 172.21.15.87:0/2622594382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20e40b3550 0x7f20e40652f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f20e40638c0 tx=0x7f20cc007b50).stop 2021-06-25T04:47:23.347 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.343+0000 7f20e95e8700 1 -- 172.21.15.87:0/2622594382 shutdown_connections 2021-06-25T04:47:23.348 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.343+0000 7f20e95e8700 1 --2- 172.21.15.87:0/2622594382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20e4145050 0x7f20e40657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.348 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.343+0000 7f20e95e8700 1 --2- 172.21.15.87:0/2622594382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20e40b3550 0x7f20e40652f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.348 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.343+0000 7f20e95e8700 1 --2- 172.21.15.87:0/2622594382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20e40b3170 0x7f20e4150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:23.349 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.343+0000 7f20e95e8700 1 -- 172.21.15.87:0/2622594382 >> 172.21.15.87:0/2622594382 conn(0x7f20e4060780 msgr2=0x7f20e40b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:23.349 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.343+0000 7f20e95e8700 1 -- 172.21.15.87:0/2622594382 shutdown_connections 2021-06-25T04:47:23.349 INFO:teuthology.orchestra.run.smithi087.stderr:2021-06-25T04:47:23.343+0000 7f20e95e8700 1 -- 172.21.15.87:0/2622594382 wait complete. 2021-06-25T04:47:23.355 INFO:tasks.ceph.osd.0:Restarting daemon 2021-06-25T04:47:23.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-06-25T04:47:23.358 INFO:tasks.ceph.osd.0:Started 2021-06-25T04:47:23.358 INFO:tasks.ceph.osd.1:Restarting daemon 2021-06-25T04:47:23.359 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-06-25T04:47:23.361 INFO:tasks.ceph.osd.1:Started 2021-06-25T04:47:23.361 INFO:tasks.ceph.osd.2:Restarting daemon 2021-06-25T04:47:23.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-06-25T04:47:23.364 INFO:tasks.ceph.osd.2:Started 2021-06-25T04:47:23.364 INFO:tasks.ceph.osd.3:Restarting daemon 2021-06-25T04:47:23.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-06-25T04:47:23.368 INFO:tasks.ceph.osd.3:Started 2021-06-25T04:47:23.368 INFO:tasks.ceph.osd.4:Restarting daemon 2021-06-25T04:47:23.369 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-06-25T04:47:23.371 INFO:tasks.ceph.osd.4:Started 2021-06-25T04:47:23.371 INFO:tasks.ceph.osd.5:Restarting daemon 2021-06-25T04:47:23.372 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-06-25T04:47:23.375 INFO:tasks.ceph.osd.5:Started 2021-06-25T04:47:23.375 INFO:tasks.ceph.osd.6:Restarting daemon 2021-06-25T04:47:23.375 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-06-25T04:47:23.378 INFO:tasks.ceph.osd.6:Started 2021-06-25T04:47:23.378 INFO:tasks.ceph.osd.7:Restarting daemon 2021-06-25T04:47:23.379 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-06-25T04:47:23.381 INFO:tasks.ceph.osd.7:Started 2021-06-25T04:47:23.382 INFO:tasks.ceph:Waiting for OSDs to come up 2021-06-25T04:47:23.719 INFO:tasks.ceph.osd.0.smithi057.stderr:2021-06-25T04:47:23.713+0000 7f2f45555d80 -1 Falling back to public interface 2021-06-25T04:47:23.726 INFO:tasks.ceph.osd.1.smithi057.stderr:2021-06-25T04:47:23.721+0000 7fa8e7f96d80 -1 Falling back to public interface 2021-06-25T04:47:23.735 INFO:tasks.ceph.osd.7.smithi087.stderr:2021-06-25T04:47:23.735+0000 7fcef3603d80 -1 Falling back to public interface 2021-06-25T04:47:23.819 INFO:tasks.ceph.mgr.x.smithi087.stderr:2021-06-25T04:47:23.819+0000 7f47df8cb040 -1 mgr[py] Module not found: 'rook' 2021-06-25T04:47:23.844 INFO:tasks.ceph.mgr.x.smithi087.stderr:2021-06-25T04:47:23.819+0000 7f47df8cb040 -1 mgr[py] Traceback (most recent call last): 2021-06-25T04:47:23.844 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/share/ceph/mgr/rook/__init__.py", line 2, in 2021-06-25T04:47:23.844 INFO:tasks.ceph.mgr.x.smithi087.stderr: from .module import RookOrchestrator 2021-06-25T04:47:23.845 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/share/ceph/mgr/rook/module.py", line 17, in 2021-06-25T04:47:23.845 INFO:tasks.ceph.mgr.x.smithi087.stderr: from kubernetes import client, config 2021-06-25T04:47:23.845 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/lib/python3/dist-packages/kubernetes/__init__.py", line 22, in 2021-06-25T04:47:23.845 INFO:tasks.ceph.mgr.x.smithi087.stderr: import kubernetes.stream 2021-06-25T04:47:23.845 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/lib/python3/dist-packages/kubernetes/stream/__init__.py", line 15, in 2021-06-25T04:47:23.846 INFO:tasks.ceph.mgr.x.smithi087.stderr: from .stream import stream 2021-06-25T04:47:23.846 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/lib/python3/dist-packages/kubernetes/stream/stream.py", line 13, in 2021-06-25T04:47:23.846 INFO:tasks.ceph.mgr.x.smithi087.stderr: from . import ws_client 2021-06-25T04:47:23.847 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/lib/python3/dist-packages/kubernetes/stream/ws_client.py", line 19, in 2021-06-25T04:47:23.847 INFO:tasks.ceph.mgr.x.smithi087.stderr: from websocket import WebSocket, ABNF, enableTrace 2021-06-25T04:47:23.847 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/lib/python3/dist-packages/websocket/__init__.py", line 22, in 2021-06-25T04:47:23.847 INFO:tasks.ceph.mgr.x.smithi087.stderr: from ._abnf import * 2021-06-25T04:47:23.848 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/lib/python3/dist-packages/websocket/_abnf.py", line 34, in 2021-06-25T04:47:23.848 INFO:tasks.ceph.mgr.x.smithi087.stderr: import numpy 2021-06-25T04:47:23.848 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/lib/python3/dist-packages/numpy/__init__.py", line 142, in 2021-06-25T04:47:23.848 INFO:tasks.ceph.mgr.x.smithi087.stderr: from . import core 2021-06-25T04:47:23.849 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/lib/python3/dist-packages/numpy/core/__init__.py", line 17, in 2021-06-25T04:47:23.849 INFO:tasks.ceph.mgr.x.smithi087.stderr: from . import multiarray 2021-06-25T04:47:23.849 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/lib/python3/dist-packages/numpy/core/multiarray.py", line 14, in 2021-06-25T04:47:23.849 INFO:tasks.ceph.mgr.x.smithi087.stderr: from . import overrides 2021-06-25T04:47:23.849 INFO:tasks.ceph.mgr.x.smithi087.stderr: File "/usr/lib/python3/dist-packages/numpy/core/overrides.py", line 16, in 2021-06-25T04:47:23.850 INFO:tasks.ceph.mgr.x.smithi087.stderr: add_docstring( 2021-06-25T04:47:23.850 INFO:tasks.ceph.mgr.x.smithi087.stderr:RuntimeError: implement_array_function method already has a docstring 2021-06-25T04:47:23.850 INFO:tasks.ceph.mgr.x.smithi087.stderr: 2021-06-25T04:47:23.850 INFO:tasks.ceph.mgr.x.smithi087.stderr:2021-06-25T04:47:23.843+0000 7f47df8cb040 -1 mgr[py] Class not found in module 'rook' 2021-06-25T04:47:23.851 INFO:tasks.ceph.mgr.x.smithi087.stderr:2021-06-25T04:47:23.843+0000 7f47df8cb040 -1 mgr[py] Error loading module 'rook': (2) No such file or directory 2021-06-25T04:47:23.964 INFO:tasks.ceph.osd.4.smithi087.stderr:2021-06-25T04:47:23.963+0000 7f5345c24d80 -1 Falling back to public interface 2021-06-25T04:47:23.971 INFO:tasks.ceph.osd.3.smithi057.stderr:2021-06-25T04:47:23.965+0000 7f67300d6d80 -1 Falling back to public interface 2021-06-25T04:47:23.990 INFO:tasks.ceph.mgr.y.smithi057.stderr:2021-06-25T04:47:23.985+0000 7f3ffbec6040 -1 mgr[py] Module not found: 'rook' 2021-06-25T04:47:23.998 INFO:tasks.ceph.osd.2.smithi057.stderr:2021-06-25T04:47:23.993+0000 7feb68c04d80 -1 Falling back to public interface 2021-06-25T04:47:23.999 INFO:tasks.ceph.osd.6.smithi087.stderr:2021-06-25T04:47:23.999+0000 7f32e98b8d80 -1 Falling back to public interface 2021-06-25T04:47:24.010 INFO:tasks.ceph.mgr.y.smithi057.stderr:2021-06-25T04:47:23.985+0000 7f3ffbec6040 -1 mgr[py] Traceback (most recent call last): 2021-06-25T04:47:24.010 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/share/ceph/mgr/rook/__init__.py", line 2, in 2021-06-25T04:47:24.010 INFO:tasks.ceph.mgr.y.smithi057.stderr: from .module import RookOrchestrator 2021-06-25T04:47:24.010 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/share/ceph/mgr/rook/module.py", line 17, in 2021-06-25T04:47:24.011 INFO:tasks.ceph.mgr.y.smithi057.stderr: from kubernetes import client, config 2021-06-25T04:47:24.011 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/lib/python3/dist-packages/kubernetes/__init__.py", line 22, in 2021-06-25T04:47:24.011 INFO:tasks.ceph.mgr.y.smithi057.stderr: import kubernetes.stream 2021-06-25T04:47:24.011 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/lib/python3/dist-packages/kubernetes/stream/__init__.py", line 15, in 2021-06-25T04:47:24.012 INFO:tasks.ceph.mgr.y.smithi057.stderr: from .stream import stream 2021-06-25T04:47:24.012 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/lib/python3/dist-packages/kubernetes/stream/stream.py", line 13, in 2021-06-25T04:47:24.012 INFO:tasks.ceph.mgr.y.smithi057.stderr: from . import ws_client 2021-06-25T04:47:24.012 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/lib/python3/dist-packages/kubernetes/stream/ws_client.py", line 19, in 2021-06-25T04:47:24.012 INFO:tasks.ceph.mgr.y.smithi057.stderr: from websocket import WebSocket, ABNF, enableTrace 2021-06-25T04:47:24.013 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/lib/python3/dist-packages/websocket/__init__.py", line 22, in 2021-06-25T04:47:24.013 INFO:tasks.ceph.mgr.y.smithi057.stderr: from ._abnf import * 2021-06-25T04:47:24.013 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/lib/python3/dist-packages/websocket/_abnf.py", line 34, in 2021-06-25T04:47:24.013 INFO:tasks.ceph.mgr.y.smithi057.stderr: import numpy 2021-06-25T04:47:24.014 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/lib/python3/dist-packages/numpy/__init__.py", line 142, in 2021-06-25T04:47:24.014 INFO:tasks.ceph.mgr.y.smithi057.stderr: from . import core 2021-06-25T04:47:24.014 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/lib/python3/dist-packages/numpy/core/__init__.py", line 17, in 2021-06-25T04:47:24.014 INFO:tasks.ceph.mgr.y.smithi057.stderr: from . import multiarray 2021-06-25T04:47:24.015 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/lib/python3/dist-packages/numpy/core/multiarray.py", line 14, in 2021-06-25T04:47:24.015 INFO:tasks.ceph.mgr.y.smithi057.stderr: from . import overrides 2021-06-25T04:47:24.015 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/lib/python3/dist-packages/numpy/core/overrides.py", line 16, in 2021-06-25T04:47:24.015 INFO:tasks.ceph.mgr.y.smithi057.stderr: add_docstring( 2021-06-25T04:47:24.015 INFO:tasks.ceph.mgr.y.smithi057.stderr:RuntimeError: implement_array_function method already has a docstring 2021-06-25T04:47:24.016 INFO:tasks.ceph.mgr.y.smithi057.stderr: 2021-06-25T04:47:24.016 INFO:tasks.ceph.mgr.y.smithi057.stderr:2021-06-25T04:47:24.005+0000 7f3ffbec6040 -1 mgr[py] Class not found in module 'rook' 2021-06-25T04:47:24.016 INFO:tasks.ceph.mgr.y.smithi057.stderr:2021-06-25T04:47:24.005+0000 7f3ffbec6040 -1 mgr[py] Error loading module 'rook': (2) No such file or directory 2021-06-25T04:47:24.018 INFO:tasks.ceph.osd.5.smithi087.stderr:2021-06-25T04:47:24.019+0000 7f3508b13d80 -1 Falling back to public interface 2021-06-25T04:47:24.187 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:24.274 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56759e700 1 Processor -- start 2021-06-25T04:47:24.275 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56759e700 1 -- start start 2021-06-25T04:47:24.282 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5680b3590 0x7fc568060c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:24.282 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56759e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc5680b0620 0x7fc5680ae570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:24.283 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56805f5b0 con 0x7fc5680aea60 2021-06-25T04:47:24.283 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56759e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56805fc80 con 0x7fc5680b0620 2021-06-25T04:47:24.283 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680b3970 con 0x7fc5680b3590 2021-06-25T04:47:24.283 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc566d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc5680aea60 0x7fc568140200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51870/0 (socket says 172.21.15.57:51870) 2021-06-25T04:47:24.284 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc566d9d700 1 -- 172.21.15.57:0/1577288831 learned_addr learned my addr 172.21.15.57:0/1577288831 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:24.284 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56659c700 1 --2- 172.21.15.57:0/1577288831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5680b3590 0x7fc568060c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:24.285 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc565d9b700 1 --2- 172.21.15.57:0/1577288831 >> v2:172.21.15.87:3300/0 conn(0x7fc5680b0620 0x7fc5680ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:24.285 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56559a700 1 -- 172.21.15.57:0/1577288831 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317982533 0 0) 0x7fc56805f5b0 con 0x7fc5680aea60 2021-06-25T04:47:24.285 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56559a700 1 -- 172.21.15.57:0/1577288831 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc54c003260 con 0x7fc5680aea60 2021-06-25T04:47:24.286 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56659c700 1 -- 172.21.15.57:0/1577288831 >> v2:172.21.15.87:3300/0 conn(0x7fc5680b0620 msgr2=0x7fc5680ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:24.286 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56659c700 1 --2- 172.21.15.57:0/1577288831 >> v2:172.21.15.87:3300/0 conn(0x7fc5680b0620 0x7fc5680ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:24.287 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56659c700 1 -- 172.21.15.57:0/1577288831 >> v1:172.21.15.57:6789/0 conn(0x7fc5680aea60 legacy=0x7fc568140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:24.287 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56659c700 1 -- 172.21.15.57:0/1577288831 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568060510 con 0x7fc5680b3590 2021-06-25T04:47:24.288 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56659c700 1 --2- 172.21.15.57:0/1577288831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5680b3590 0x7fc568060c90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fc558002f70 tx=0x7fc558006df0).ready entity=mon.2 client_cookie=88c9136cef12bc5c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:24.288 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56559a700 1 -- 172.21.15.57:0/1577288831 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc55800d4a0 con 0x7fc5680b3590 2021-06-25T04:47:24.288 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56559a700 1 -- 172.21.15.57:0/1577288831 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558000e90 con 0x7fc5680b3590 2021-06-25T04:47:24.289 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56559a700 1 -- 172.21.15.57:0/1577288831 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc55800d7f0 con 0x7fc5680b3590 2021-06-25T04:47:24.289 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56759e700 1 -- 172.21.15.57:0/1577288831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5680b3590 msgr2=0x7fc568060c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:24.290 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.269+0000 7fc56759e700 1 --2- 172.21.15.57:0/1577288831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5680b3590 0x7fc568060c90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fc558002f70 tx=0x7fc558006df0).stop 2021-06-25T04:47:24.290 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 -- 172.21.15.57:0/1577288831 shutdown_connections 2021-06-25T04:47:24.291 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 --2- 172.21.15.57:0/1577288831 >> v2:172.21.15.87:3300/0 conn(0x7fc5680b0620 0x7fc5680ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:24.291 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 --2- 172.21.15.57:0/1577288831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5680b3590 0x7fc568060c90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:24.291 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 -- 172.21.15.57:0/1577288831 >> 172.21.15.57:0/1577288831 conn(0x7fc56805c7f0 msgr2=0x7fc56805cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:24.292 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 -- 172.21.15.57:0/1577288831 shutdown_connections 2021-06-25T04:47:24.292 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 -- 172.21.15.57:0/1577288831 wait complete. 2021-06-25T04:47:24.293 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 Processor -- start 2021-06-25T04:47:24.293 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 -- start start 2021-06-25T04:47:24.293 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5680aea60 0x7fc5680657e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:24.293 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5680b0620 0x7fc568151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:24.293 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5680b3590 0x7fc568152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:24.294 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc568152820 con 0x7fc5680b3590 2021-06-25T04:47:24.294 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc568155390 con 0x7fc5680aea60 2021-06-25T04:47:24.295 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc568155630 con 0x7fc5680b0620 2021-06-25T04:47:24.295 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc566d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5680b3590 0x7fc568152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:24.295 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc566d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5680b3590 0x7fc568152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34656/0 (socket says 172.21.15.57:34656) 2021-06-25T04:47:24.295 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc566d9d700 1 -- 172.21.15.57:0/2973144200 learned_addr learned my addr 172.21.15.57:0/2973144200 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:24.295 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc565d9b700 1 --2- 172.21.15.57:0/2973144200 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5680b0620 0x7fc568151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:24.296 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.273+0000 7fc56659c700 1 --2- 172.21.15.57:0/2973144200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5680aea60 0x7fc5680657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:24.296 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc566d9d700 1 -- 172.21.15.57:0/2973144200 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5680b0620 msgr2=0x7fc568151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:24.296 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc566d9d700 1 --2- 172.21.15.57:0/2973144200 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5680b0620 0x7fc568151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:24.296 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc566d9d700 1 -- 172.21.15.57:0/2973144200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5680aea60 msgr2=0x7fc5680657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:24.297 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc566d9d700 1 --2- 172.21.15.57:0/2973144200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5680aea60 0x7fc5680657e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:24.297 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc566d9d700 1 -- 172.21.15.57:0/2973144200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55800b180 con 0x7fc5680b3590 2021-06-25T04:47:24.297 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc566d9d700 1 --2- 172.21.15.57:0/2973144200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5680b3590 0x7fc568152330 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc560001490 tx=0x7fc560007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:24.297 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc5577fe700 1 -- 172.21.15.57:0/2973144200 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc560005ba0 con 0x7fc5680b3590 2021-06-25T04:47:24.297 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc5577fe700 1 -- 172.21.15.57:0/2973144200 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc560005d00 con 0x7fc5680b3590 2021-06-25T04:47:24.298 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc56759e700 1 -- 172.21.15.57:0/2973144200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5681558d0 con 0x7fc5680b3590 2021-06-25T04:47:24.298 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc5577fe700 1 -- 172.21.15.57:0/2973144200 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5600072c0 con 0x7fc5680b3590 2021-06-25T04:47:24.298 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc56759e700 1 -- 172.21.15.57:0/2973144200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc568156230 con 0x7fc5680b3590 2021-06-25T04:47:24.299 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc5577fe700 1 -- 172.21.15.57:0/2973144200 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fc560010070 con 0x7fc5680b3590 2021-06-25T04:47:24.299 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc5577fe700 1 -- 172.21.15.57:0/2973144200 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fc5600075f0 con 0x7fc5680b3590 2021-06-25T04:47:24.299 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.277+0000 7fc56759e700 1 -- 172.21.15.57:0/2973144200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc568155a60 con 0x7fc5680b3590 2021-06-25T04:47:24.300 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.281+0000 7fc5577fe700 1 -- 172.21.15.57:0/2973144200 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fc560018020 con 0x7fc5680b3590 2021-06-25T04:47:24.342 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.337+0000 7fc56759e700 1 -- 172.21.15.57:0/2973144200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc568057310 con 0x7fc5680b3590 2021-06-25T04:47:24.343 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.337+0000 7fc5577fe700 1 -- 172.21.15.57:0/2973144200 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7fc560026460 con 0x7fc5680b3590 2021-06-25T04:47:24.344 INFO:teuthology.misc.health.smithi057.stdout: 2021-06-25T04:47:24.345 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":10,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:23.332504+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:24.346 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.341+0000 7fc56759e700 1 -- 172.21.15.57:0/2973144200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5680b3590 msgr2=0x7fc568152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:24.346 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.341+0000 7fc56759e700 1 --2- 172.21.15.57:0/2973144200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5680b3590 0x7fc568152330 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc560001490 tx=0x7fc560007e00).stop 2021-06-25T04:47:24.346 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.341+0000 7fc56759e700 1 -- 172.21.15.57:0/2973144200 shutdown_connections 2021-06-25T04:47:24.347 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.341+0000 7fc56759e700 1 --2- 172.21.15.57:0/2973144200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5680b3590 0x7fc568152330 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:24.347 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.341+0000 7fc56759e700 1 --2- 172.21.15.57:0/2973144200 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5680b0620 0x7fc568151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:24.347 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.341+0000 7fc56759e700 1 --2- 172.21.15.57:0/2973144200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5680aea60 0x7fc5680657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:24.347 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.341+0000 7fc56759e700 1 -- 172.21.15.57:0/2973144200 >> 172.21.15.57:0/2973144200 conn(0x7fc56805c7f0 msgr2=0x7fc568061640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:24.347 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.341+0000 7fc56759e700 1 -- 172.21.15.57:0/2973144200 shutdown_connections 2021-06-25T04:47:24.348 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:24.341+0000 7fc56759e700 1 -- 172.21.15.57:0/2973144200 wait complete. 2021-06-25T04:47:24.357 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-06-25T04:47:24.411 INFO:tasks.ceph.mgr.x.smithi087.stderr:2021-06-25T04:47:24.411+0000 7f47df8cb040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: rook 2021-06-25T04:47:24.624 INFO:tasks.ceph.mgr.y.smithi057.stderr:2021-06-25T04:47:24.620+0000 7f3ffbec6040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: rook 2021-06-25T04:47:24.927 INFO:tasks.ceph.osd.7.smithi087.stderr:2021-06-25T04:47:24.927+0000 7fcef3603d80 -1 osd.7 0 log_to_monitors {default=true} 2021-06-25T04:47:24.934 INFO:tasks.ceph.osd.1.smithi057.stderr:2021-06-25T04:47:24.928+0000 7fa8e7f96d80 -1 osd.1 0 log_to_monitors {default=true} 2021-06-25T04:47:24.937 INFO:tasks.ceph.osd.0.smithi057.stderr:2021-06-25T04:47:24.932+0000 7f2f45555d80 -1 osd.0 0 log_to_monitors {default=true} 2021-06-25T04:47:24.978 INFO:tasks.ceph.osd.5.smithi087.stderr:2021-06-25T04:47:24.979+0000 7f3508b13d80 -1 osd.5 0 log_to_monitors {default=true} 2021-06-25T04:47:25.099 INFO:tasks.ceph.osd.4.smithi087.stderr:2021-06-25T04:47:25.099+0000 7f5345c24d80 -1 osd.4 0 log_to_monitors {default=true} 2021-06-25T04:47:25.142 INFO:tasks.ceph.osd.3.smithi057.stderr:2021-06-25T04:47:25.136+0000 7f67300d6d80 -1 osd.3 0 log_to_monitors {default=true} 2021-06-25T04:47:25.179 INFO:tasks.ceph.osd.6.smithi087.stderr:2021-06-25T04:47:25.179+0000 7f32e98b8d80 -1 osd.6 0 log_to_monitors {default=true} 2021-06-25T04:47:25.194 INFO:tasks.ceph.osd.2.smithi057.stderr:2021-06-25T04:47:25.188+0000 7feb68c04d80 -1 osd.2 0 log_to_monitors {default=true} 2021-06-25T04:47:26.477 INFO:tasks.ceph.osd.6.smithi087.stderr:2021-06-25T04:47:26.475+0000 7f32db973700 -1 osd.6 0 waiting for initial osdmap 2021-06-25T04:47:26.477 INFO:tasks.ceph.osd.7.smithi087.stderr:2021-06-25T04:47:26.479+0000 7fcee56be700 -1 osd.7 0 waiting for initial osdmap 2021-06-25T04:47:26.480 INFO:tasks.ceph.osd.0.smithi057.stderr:2021-06-25T04:47:26.472+0000 7f2f37610700 -1 osd.0 0 waiting for initial osdmap 2021-06-25T04:47:26.480 INFO:tasks.ceph.osd.1.smithi057.stderr:2021-06-25T04:47:26.472+0000 7fa8da051700 -1 osd.1 0 waiting for initial osdmap 2021-06-25T04:47:26.487 INFO:tasks.ceph.osd.2.smithi057.stderr:2021-06-25T04:47:26.480+0000 7feb5acbf700 -1 osd.2 0 waiting for initial osdmap 2021-06-25T04:47:26.488 INFO:tasks.ceph.osd.3.smithi057.stderr:2021-06-25T04:47:26.480+0000 7f6722191700 -1 osd.3 0 waiting for initial osdmap 2021-06-25T04:47:26.488 INFO:tasks.ceph.osd.4.smithi087.stderr:2021-06-25T04:47:26.487+0000 7f5337cdf700 -1 osd.4 0 waiting for initial osdmap 2021-06-25T04:47:26.489 INFO:tasks.ceph.osd.5.smithi087.stderr:2021-06-25T04:47:26.487+0000 7f34fabce700 -1 osd.5 0 waiting for initial osdmap 2021-06-25T04:47:31.165 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:31.264 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.255+0000 7fd147550700 1 Processor -- start 2021-06-25T04:47:31.265 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.255+0000 7fd147550700 1 -- start start 2021-06-25T04:47:31.269 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd1400af700 0x7fd1400afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.270 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1400b1370 0x7fd14013c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.270 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1400b1e60 con 0x7fd14013ceb0 2021-06-25T04:47:31.270 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400b2100 con 0x7fd1400b1370 2021-06-25T04:47:31.271 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd140140260 con 0x7fd1400af700 2021-06-25T04:47:31.271 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd145d4d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1400b1370 0x7fd14013c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.271 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd145d4d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1400b1370 0x7fd14013c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34880/0 (socket says 172.21.15.57:34880) 2021-06-25T04:47:31.271 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd145d4d700 1 -- 172.21.15.57:0/267378550 learned_addr learned my addr 172.21.15.57:0/267378550 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:31.272 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd14654e700 1 --2- 172.21.15.57:0/267378550 >> v2:172.21.15.87:3300/0 conn(0x7fd1400af700 0x7fd1400afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.272 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd145d4d700 1 -- 172.21.15.57:0/267378550 >> v2:172.21.15.87:3300/0 conn(0x7fd1400af700 msgr2=0x7fd1400afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:31.272 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd145d4d700 1 --2- 172.21.15.57:0/267378550 >> v2:172.21.15.87:3300/0 conn(0x7fd1400af700 0x7fd1400afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.272 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd145d4d700 1 -- 172.21.15.57:0/267378550 >> v1:172.21.15.87:6789/0 conn(0x7fd14013ceb0 legacy=0x7fd1400ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:31.272 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd145d4d700 1 -- 172.21.15.57:0/267378550 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14013ff80 con 0x7fd1400b1370 2021-06-25T04:47:31.273 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd145d4d700 1 --2- 172.21.15.57:0/267378550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1400b1370 0x7fd14013c9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd130002f70 tx=0x7fd130006f40).ready entity=mon.0 client_cookie=61d4bb68a366524d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:31.273 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd14554c700 1 -- 172.21.15.57:0/267378550 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd13000c880 con 0x7fd1400b1370 2021-06-25T04:47:31.273 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd14554c700 1 -- 172.21.15.57:0/267378550 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd130000e90 con 0x7fd1400b1370 2021-06-25T04:47:31.273 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd14554c700 1 -- 172.21.15.57:0/267378550 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd13000cc10 con 0x7fd1400b1370 2021-06-25T04:47:31.274 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 -- 172.21.15.57:0/267378550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1400b1370 msgr2=0x7fd14013c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:31.274 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 --2- 172.21.15.57:0/267378550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1400b1370 0x7fd14013c9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd130002f70 tx=0x7fd130006f40).stop 2021-06-25T04:47:31.274 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 -- 172.21.15.57:0/267378550 shutdown_connections 2021-06-25T04:47:31.274 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 --2- 172.21.15.57:0/267378550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1400b1370 0x7fd14013c9c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.275 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 --2- 172.21.15.57:0/267378550 >> v2:172.21.15.87:3300/0 conn(0x7fd1400af700 0x7fd1400afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.275 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 -- 172.21.15.57:0/267378550 >> 172.21.15.57:0/267378550 conn(0x7fd1400b5b80 msgr2=0x7fd1400b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:31.275 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 -- 172.21.15.57:0/267378550 shutdown_connections 2021-06-25T04:47:31.275 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.259+0000 7fd147550700 1 -- 172.21.15.57:0/267378550 wait complete. 2021-06-25T04:47:31.278 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd147550700 1 Processor -- start 2021-06-25T04:47:31.278 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd147550700 1 -- start start 2021-06-25T04:47:31.279 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd147550700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1400af700 0x7fd140146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.279 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd147550700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1400b1370 0x7fd140156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.279 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd147550700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd14013ceb0 0x7fd140156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.279 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd147550700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14014a600 con 0x7fd14013ceb0 2021-06-25T04:47:31.280 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd147550700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1401491b0 con 0x7fd1400b1370 2021-06-25T04:47:31.280 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd147550700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd140147570 con 0x7fd1400af700 2021-06-25T04:47:31.280 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd146d4f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd14013ceb0 0x7fd140156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.280 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd14654e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1400af700 0x7fd140146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.280 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd146d4f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd14013ceb0 0x7fd140156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34888/0 (socket says 172.21.15.57:34888) 2021-06-25T04:47:31.281 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd145d4d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1400b1370 0x7fd140156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.281 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd146d4f700 1 -- 172.21.15.57:0/1284026888 learned_addr learned my addr 172.21.15.57:0/1284026888 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:31.281 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd146d4f700 1 -- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1400af700 msgr2=0x7fd140146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:31.281 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd146d4f700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1400af700 0x7fd140146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.282 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd146d4f700 1 -- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1400b1370 msgr2=0x7fd140156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:31.282 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd146d4f700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1400b1370 0x7fd140156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.282 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd146d4f700 1 -- 172.21.15.57:0/1284026888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13000a360 con 0x7fd14013ceb0 2021-06-25T04:47:31.282 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd146d4f700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd14013ceb0 0x7fd140156a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd1400b6740 tx=0x7fd138007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:31.282 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd12f7fe700 1 -- 172.21.15.57:0/1284026888 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd13800f470 con 0x7fd14013ceb0 2021-06-25T04:47:31.283 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd12f7fe700 1 -- 172.21.15.57:0/1284026888 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13800f5d0 con 0x7fd14013ceb0 2021-06-25T04:47:31.283 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd147550700 1 -- 172.21.15.57:0/1284026888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14014a830 con 0x7fd14013ceb0 2021-06-25T04:47:31.283 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd12f7fe700 1 -- 172.21.15.57:0/1284026888 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd13800f930 con 0x7fd14013ceb0 2021-06-25T04:47:31.283 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.263+0000 7fd147550700 1 -- 172.21.15.57:0/1284026888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd140145d10 con 0x7fd14013ceb0 2021-06-25T04:47:31.284 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.267+0000 7fd147550700 1 -- 172.21.15.57:0/1284026888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd140057310 con 0x7fd14013ceb0 2021-06-25T04:47:31.284 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.267+0000 7fd12f7fe700 1 -- 172.21.15.57:0/1284026888 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd138019030 con 0x7fd14013ceb0 2021-06-25T04:47:31.284 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.267+0000 7fd12f7fe700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd120055450 0x7fd120057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.284 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.267+0000 7fd12f7fe700 1 -- 172.21.15.57:0/1284026888 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fd13806cf30 con 0x7fd14013ceb0 2021-06-25T04:47:31.285 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.267+0000 7fd14654e700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd120055450 0x7fd120057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.285 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.267+0000 7fd14654e700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd120055450 0x7fd120057910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd13c00b000 tx=0x7fd13c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:31.285 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.275+0000 7fd12f7fe700 1 -- 172.21.15.57:0/1284026888 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd1380436d0 con 0x7fd14013ceb0 2021-06-25T04:47:31.410 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.399+0000 7fd147550700 1 -- 172.21.15.57:0/1284026888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1400affe0 con 0x7fd14013ceb0 2021-06-25T04:47:31.410 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd12f7fe700 1 -- 172.21.15.57:0/1284026888 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11805 (secure 0 0 0) 0x7fd138046cf0 con 0x7fd14013ceb0 2021-06-25T04:47:31.411 INFO:teuthology.misc.health.smithi057.stdout: 2021-06-25T04:47:31.411 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":15,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:29.499218+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:31.413 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 -- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd120055450 msgr2=0x7fd120057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:31.413 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd120055450 0x7fd120057910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd13c00b000 tx=0x7fd13c006df0).stop 2021-06-25T04:47:31.413 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 -- 172.21.15.57:0/1284026888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd14013ceb0 msgr2=0x7fd140156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:31.414 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd14013ceb0 0x7fd140156a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd1400b6740 tx=0x7fd138007f40).stop 2021-06-25T04:47:31.414 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 -- 172.21.15.57:0/1284026888 shutdown_connections 2021-06-25T04:47:31.414 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd120055450 0x7fd120057910 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.414 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd14013ceb0 0x7fd140156a10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.415 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1400b1370 0x7fd140156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.415 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 --2- 172.21.15.57:0/1284026888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1400af700 0x7fd140146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.415 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 -- 172.21.15.57:0/1284026888 >> 172.21.15.57:0/1284026888 conn(0x7fd1400b5b80 msgr2=0x7fd14013ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:31.415 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 -- 172.21.15.57:0/1284026888 shutdown_connections 2021-06-25T04:47:31.415 INFO:teuthology.misc.health.smithi057.stderr:2021-06-25T04:47:31.403+0000 7fd147550700 1 -- 172.21.15.57:0/1284026888 wait complete. 2021-06-25T04:47:31.422 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-06-25T04:47:31.422 INFO:tasks.ceph:Creating RBD pool 2021-06-25T04:47:31.423 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool create rbd 8 2021-06-25T04:47:31.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.519+0000 7f00fc834700 1 Processor -- start 2021-06-25T04:47:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00fc834700 1 -- start start 2021-06-25T04:47:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00fc834700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f00f80b2760 0x7f00f8061120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00fc834700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8143230 0x7f00f8143690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00fc834700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f8067010 con 0x7f00f80b7670 2021-06-25T04:47:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00fc834700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f8065370 con 0x7f00f80b2760 2021-06-25T04:47:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00fc834700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80b7a50 con 0x7f00f8143230 2021-06-25T04:47:31.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f6d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f00f80b7670 0x7f00f8060a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52110/0 (socket says 172.21.15.57:52110) 2021-06-25T04:47:31.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f6d9d700 1 -- 172.21.15.57:0/4126145636 learned_addr learned my addr 172.21.15.57:0/4126145636 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:31.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f659c700 1 --2- 172.21.15.57:0/4126145636 >> v2:172.21.15.87:3300/0 conn(0x7f00f80b2760 0x7f00f8061120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f759e700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8143230 0x7f00f8143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256178502 0 0) 0x7f00f8067010 con 0x7f00f80b7670 2021-06-25T04:47:31.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00dc003260 con 0x7f00f80b7670 2021-06-25T04:47:31.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4134795330 0 0) 0x7f00dc003260 con 0x7f00f80b7670 2021-06-25T04:47:31.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8143230 msgr2=0x7f00f8143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:31.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8143230 0x7f00f8143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 >> v2:172.21.15.87:3300/0 conn(0x7f00f80b2760 msgr2=0x7f00f8061120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:31.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 --2- 172.21.15.57:0/4126145636 >> v2:172.21.15.87:3300/0 conn(0x7f00f80b2760 0x7f00f8061120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f8061610 con 0x7f00f80b7670 2021-06-25T04:47:31.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f00e80017e0 con 0x7f00f80b7670 2021-06-25T04:47:31.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 >> v1:172.21.15.57:6789/0 conn(0x7f00f80b7670 legacy=0x7f00f8060a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:31.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00dc003750 0x7f00dc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8143230 0x7f00dc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc0049f0 0x7f00dc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f8065370 con 0x7f00dc003750 2021-06-25T04:47:31.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80b7a50 con 0x7f00dc0049f0 2021-06-25T04:47:31.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc00b750 con 0x7f00f8143230 2021-06-25T04:47:31.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f6d9d700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00dc003750 0x7f00dc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f659c700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8143230 0x7f00dc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f759e700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc0049f0 0x7f00dc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f6d9d700 1 -- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8143230 msgr2=0x7f00dc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:31.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f6d9d700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8143230 0x7f00dc004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f6d9d700 1 -- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc0049f0 msgr2=0x7f00dc004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:31.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f6d9d700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc0049f0 0x7f00dc004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f6d9d700 1 -- 172.21.15.57:0/4126145636 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc003260 con 0x7f00dc003750 2021-06-25T04:47:31.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f759e700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc0049f0 0x7f00dc004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:47:31.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.523+0000 7f00f6d9d700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00dc003750 0x7f00dc003b70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f00e80014f0 tx=0x7f00f8061b70).ready entity=mon.0 client_cookie=7520123cc49c3d05 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:31.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e80071e0 con 0x7f00dc003750 2021-06-25T04:47:31.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8007340 con 0x7f00dc003750 2021-06-25T04:47:31.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00f5d9b700 1 -- 172.21.15.57:0/4126145636 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e8001d60 con 0x7f00dc003750 2021-06-25T04:47:31.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00fc834700 1 -- 172.21.15.57:0/4126145636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00dc003750 msgr2=0x7f00dc003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:31.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00fc834700 1 --2- 172.21.15.57:0/4126145636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00dc003750 0x7f00dc003b70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f00e80014f0 tx=0x7f00f8061b70).stop 2021-06-25T04:47:31.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00f759e700 1 -- 172.21.15.57:0/4126145636 reap_dead start 2021-06-25T04:47:31.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00fc834700 1 -- 172.21.15.57:0/4126145636 shutdown_connections 2021-06-25T04:47:31.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00fc834700 1 -- 172.21.15.57:0/4126145636 >> 172.21.15.57:0/4126145636 conn(0x7f00f805f670 msgr2=0x7f00f805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:31.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00fc834700 1 -- 172.21.15.57:0/4126145636 shutdown_connections 2021-06-25T04:47:31.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00fc834700 1 -- 172.21.15.57:0/4126145636 wait complete. 2021-06-25T04:47:31.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00fc834700 1 Processor -- start 2021-06-25T04:47:31.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.527+0000 7f00fc834700 1 -- start start 2021-06-25T04:47:31.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00fc834700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8144df0 0x7f00f8152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00fc834700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f80b1200 0x7f00f80ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00fc834700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8155930 0x7f00f8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00fc834700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f81451d0 con 0x7f00f8144df0 2021-06-25T04:47:31.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00fc834700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f8152520 con 0x7f00f80b1200 2021-06-25T04:47:31.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00fc834700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80aeb60 con 0x7f00f8155930 2021-06-25T04:47:31.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8144df0 0x7f00f8152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8144df0 0x7f00f8152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34904/0 (socket says 172.21.15.57:34904) 2021-06-25T04:47:31.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f6d9d700 1 -- 172.21.15.57:0/814605966 learned_addr learned my addr 172.21.15.57:0/814605966 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:31.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f759e700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8155930 0x7f00f8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f659c700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f80b1200 0x7f00f80ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f6d9d700 1 -- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8155930 msgr2=0x7f00f8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:31.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f6d9d700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8155930 0x7f00f8155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f6d9d700 1 -- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f80b1200 msgr2=0x7f00f80ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:31.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f6d9d700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f80b1200 0x7f00f80ab2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:31.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f6d9d700 1 -- 172.21.15.57:0/814605966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f8152780 con 0x7f00f8144df0 2021-06-25T04:47:31.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f659c700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f80b1200 0x7f00f80ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:31.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00f6d9d700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8144df0 0x7f00f8152ec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f00e80014f0 tx=0x7f00e8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:31.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00e7fff700 1 -- 172.21.15.57:0/814605966 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e800c9f0 con 0x7f00f8144df0 2021-06-25T04:47:31.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00e7fff700 1 -- 172.21.15.57:0/814605966 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8018070 con 0x7f00f8144df0 2021-06-25T04:47:31.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00e7fff700 1 -- 172.21.15.57:0/814605966 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e800cd40 con 0x7f00f8144df0 2021-06-25T04:47:31.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00fc834700 1 -- 172.21.15.57:0/814605966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f8152a20 con 0x7f00f8144df0 2021-06-25T04:47:31.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00fc834700 1 -- 172.21.15.57:0/814605966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f80ae820 con 0x7f00f8144df0 2021-06-25T04:47:31.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00fc834700 1 -- 172.21.15.57:0/814605966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f80ab980 con 0x7f00f8144df0 2021-06-25T04:47:31.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.531+0000 7f00e7fff700 1 -- 172.21.15.57:0/814605966 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f00e801d070 con 0x7f00f8144df0 2021-06-25T04:47:31.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.535+0000 7f00e7fff700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00d4055490 0x7f00d4057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:31.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.535+0000 7f00e7fff700 1 -- 172.21.15.57:0/814605966 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f00e806e390 con 0x7f00f8144df0 2021-06-25T04:47:31.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.535+0000 7f00f659c700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00d4055490 0x7f00d4057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:31.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.535+0000 7f00f659c700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00d4055490 0x7f00d4057950 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f00ec00b000 tx=0x7f00ec008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:31.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.539+0000 7f00e7fff700 1 -- 172.21.15.57:0/814605966 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f00e8044b30 con 0x7f00f8144df0 2021-06-25T04:47:31.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:31.667+0000 7f00fc834700 1 -- 172.21.15.57:0/814605966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f00f8057310 con 0x7f00f8144df0 2021-06-25T04:47:32.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.531+0000 7f00e7fff700 1 -- 172.21.15.57:0/814605966 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f00e801a070 con 0x7f00f8144df0 2021-06-25T04:47:32.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 -- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00d4055490 msgr2=0x7f00d4057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:32.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00d4055490 0x7f00d4057950 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f00ec00b000 tx=0x7f00ec008040).stop 2021-06-25T04:47:32.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 -- 172.21.15.57:0/814605966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8144df0 msgr2=0x7f00f8152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:32.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8144df0 0x7f00f8152ec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f00e80014f0 tx=0x7f00e8015000).stop 2021-06-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 -- 172.21.15.57:0/814605966 shutdown_connections 2021-06-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00d4055490 0x7f00d4057950 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00f8155930 0x7f00f8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f80b1200 0x7f00f80ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 --2- 172.21.15.57:0/814605966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8144df0 0x7f00f8152ec0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 -- 172.21.15.57:0/814605966 >> 172.21.15.57:0/814605966 conn(0x7f00f805f670 msgr2=0x7f00f80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 -- 172.21.15.57:0/814605966 shutdown_connections 2021-06-25T04:47:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.539+0000 7f00fc834700 1 -- 172.21.15.57:0/814605966 wait complete. 2021-06-25T04:47:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'rbd' created 2021-06-25T04:47:32.559 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-06-25T04:47:32.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.655+0000 7f567ffff700 1 Processor -- start 2021-06-25T04:47:32.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.655+0000 7f567ffff700 1 -- start start 2021-06-25T04:47:32.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56800b2fc0 0x7f5680060ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:32.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f56800b2560 0x7f5680060fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:32.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567ffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56800652f0 con 0x7f56800664e0 2021-06-25T04:47:32.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567ffff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5680061fc0 con 0x7f56800b2560 2021-06-25T04:47:32.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567ffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56800b33a0 con 0x7f56800b2fc0 2021-06-25T04:47:32.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f56800664e0 0x7f5680066950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52132/0 (socket says 172.21.15.57:52132) 2021-06-25T04:47:32.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567f7fe700 1 -- 172.21.15.57:0/415285745 learned_addr learned my addr 172.21.15.57:0/415285745 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:32.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567e7fc700 1 --2- 172.21.15.57:0/415285745 >> v2:172.21.15.87:3300/0 conn(0x7f56800b2560 0x7f5680060fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:32.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567effd700 1 --2- 172.21.15.57:0/415285745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56800b2fc0 0x7f5680060ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:32.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567dffb700 1 -- 172.21.15.57:0/415285745 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780334397 0 0) 0x7f56800652f0 con 0x7f56800664e0 2021-06-25T04:47:32.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567dffb700 1 -- 172.21.15.57:0/415285745 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5660003260 con 0x7f56800664e0 2021-06-25T04:47:32.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567e7fc700 1 -- 172.21.15.57:0/415285745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56800b2fc0 msgr2=0x7f5680060ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:32.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567e7fc700 1 --2- 172.21.15.57:0/415285745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56800b2fc0 0x7f5680060ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567e7fc700 1 -- 172.21.15.57:0/415285745 >> v1:172.21.15.57:6789/0 conn(0x7f56800664e0 legacy=0x7f5680066950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567e7fc700 1 -- 172.21.15.57:0/415285745 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568005fa20 con 0x7f56800b2560 2021-06-25T04:47:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567e7fc700 1 --2- 172.21.15.57:0/415285745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800b2560 0x7f5680060fc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5670002f70 tx=0x7f5670006df0).ready entity=mon.1 client_cookie=2a6608bf77f934a5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567dffb700 1 -- 172.21.15.57:0/415285745 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f567000d4a0 con 0x7f56800b2560 2021-06-25T04:47:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567dffb700 1 -- 172.21.15.57:0/415285745 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5670000e90 con 0x7f56800b2560 2021-06-25T04:47:32.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567dffb700 1 -- 172.21.15.57:0/415285745 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f567000d7f0 con 0x7f56800b2560 2021-06-25T04:47:32.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567ffff700 1 -- 172.21.15.57:0/415285745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800b2560 msgr2=0x7f5680060fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:32.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.659+0000 7f567ffff700 1 --2- 172.21.15.57:0/415285745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800b2560 0x7f5680060fc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5670002f70 tx=0x7f5670006df0).stop 2021-06-25T04:47:32.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 -- 172.21.15.57:0/415285745 shutdown_connections 2021-06-25T04:47:32.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 --2- 172.21.15.57:0/415285745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800b2560 0x7f5680060fc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:32.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 --2- 172.21.15.57:0/415285745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56800b2fc0 0x7f5680060ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:32.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 -- 172.21.15.57:0/415285745 >> 172.21.15.57:0/415285745 conn(0x7f56800636a0 msgr2=0x7f5680063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:32.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 -- 172.21.15.57:0/415285745 shutdown_connections 2021-06-25T04:47:32.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 -- 172.21.15.57:0/415285745 wait complete. 2021-06-25T04:47:32.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 Processor -- start 2021-06-25T04:47:32.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 -- start start 2021-06-25T04:47:32.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800664e0 0x7f5680061500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:32.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56800b2560 0x7f56800affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:32.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56800b2fc0 0x7f56800b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:32.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56800b09b0 con 0x7f56800b2560 2021-06-25T04:47:32.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56800b4640 con 0x7f56800664e0 2021-06-25T04:47:32.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567ffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56800b48e0 con 0x7f56800b2fc0 2021-06-25T04:47:32.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567e7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56800b2560 0x7f56800affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:32.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567e7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56800b2560 0x7f56800affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34920/0 (socket says 172.21.15.57:34920) 2021-06-25T04:47:32.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567e7fc700 1 -- 172.21.15.57:0/3479132850 learned_addr learned my addr 172.21.15.57:0/3479132850 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:32.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567effd700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800664e0 0x7f5680061500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:32.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567f7fe700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56800b2fc0 0x7f56800b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:32.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567e7fc700 1 -- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56800b2fc0 msgr2=0x7f56800b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:32.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567e7fc700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56800b2fc0 0x7f56800b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:32.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567e7fc700 1 -- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800664e0 msgr2=0x7f5680061500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:32.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567e7fc700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800664e0 0x7f5680061500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:32.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567e7fc700 1 -- 172.21.15.57:0/3479132850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567000b180 con 0x7f56800b2560 2021-06-25T04:47:32.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567effd700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800664e0 0x7f5680061500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:32.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.663+0000 7f567e7fc700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56800b2560 0x7f56800affd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5670002f70 tx=0x7f5670014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:32.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.667+0000 7f5677fff700 1 -- 172.21.15.57:0/3479132850 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5670012a30 con 0x7f56800b2560 2021-06-25T04:47:32.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.667+0000 7f5677fff700 1 -- 172.21.15.57:0/3479132850 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5670000e90 con 0x7f56800b2560 2021-06-25T04:47:32.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.667+0000 7f567ffff700 1 -- 172.21.15.57:0/3479132850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56800b4b80 con 0x7f56800b2560 2021-06-25T04:47:32.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.667+0000 7f5677fff700 1 -- 172.21.15.57:0/3479132850 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5670012d80 con 0x7f56800b2560 2021-06-25T04:47:32.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.667+0000 7f567ffff700 1 -- 172.21.15.57:0/3479132850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56800aba40 con 0x7f56800b2560 2021-06-25T04:47:32.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.667+0000 7f567ffff700 1 -- 172.21.15.57:0/3479132850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5680057310 con 0x7f56800b2560 2021-06-25T04:47:32.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.667+0000 7f5677fff700 1 -- 172.21.15.57:0/3479132850 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5670024020 con 0x7f56800b2560 2021-06-25T04:47:32.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.667+0000 7f5677fff700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56640553d0 0x7f5664057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:32.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.667+0000 7f5677fff700 1 -- 172.21.15.57:0/3479132850 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f567006e800 con 0x7f56800b2560 2021-06-25T04:47:32.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.667+0000 7f567effd700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56640553d0 0x7f5664057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:32.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.671+0000 7f567effd700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56640553d0 0x7f5664057890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f566800b000 tx=0x7f5668008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.679+0000 7f5677fff700 1 -- 172.21.15.57:0/3479132850 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5670044db0 con 0x7f56800b2560 2021-06-25T04:47:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:32.807+0000 7f567ffff700 1 -- 172.21.15.57:0/3479132850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f56801473e0 con 0x7f56800b2560 2021-06-25T04:47:33.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.543+0000 7f5677fff700 1 -- 172.21.15.57:0/3479132850 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f56700483d0 con 0x7f56800b2560 2021-06-25T04:47:33.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 -- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56640553d0 msgr2=0x7f5664057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:33.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56640553d0 0x7f5664057890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f566800b000 tx=0x7f5668008040).stop 2021-06-25T04:47:33.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 -- 172.21.15.57:0/3479132850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56800b2560 msgr2=0x7f56800affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:33.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56800b2560 0x7f56800affd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5670002f70 tx=0x7f5670014000).stop 2021-06-25T04:47:33.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 -- 172.21.15.57:0/3479132850 shutdown_connections 2021-06-25T04:47:33.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56640553d0 0x7f5664057890 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56800b2fc0 0x7f56800b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56800b2560 0x7f56800affd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 --2- 172.21.15.57:0/3479132850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800664e0 0x7f5680061500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 -- 172.21.15.57:0/3479132850 >> 172.21.15.57:0/3479132850 conn(0x7f56800636a0 msgr2=0x7f5680146cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:33.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 -- 172.21.15.57:0/3479132850 shutdown_connections 2021-06-25T04:47:33.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.551+0000 7f567ffff700 1 -- 172.21.15.57:0/3479132850 wait complete. 2021-06-25T04:47:33.561 INFO:teuthology.orchestra.run.smithi057.stderr:enabled application 'rbd' on pool 'rbd' 2021-06-25T04:47:33.572 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-06-25T04:47:33.575 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:47:33.576 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:47:33.578 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:47:33.579 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:47:33.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:47:33.581 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:47:33.581 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:47:33.582 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:47:33.584 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:47:33.585 INFO:tasks.ceph:Setting up CephFS filesystem... 2021-06-25T04:47:33.585 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:33.646 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:47:33.660 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:47:33.661 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:47:33.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f17372d6700 1 Processor -- start 2021-06-25T04:47:33.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f17372d6700 1 -- start start 2021-06-25T04:47:33.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f17372d6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17300aea00 0x7f1730143770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f17372d6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17300acfc0 0x7f1730143c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f17372d6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f17300b0440 0x7f1730146af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f17372d6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17300adc10 con 0x7f17300acfc0 2021-06-25T04:47:33.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f17372d6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17300b0950 con 0x7f17300b0440 2021-06-25T04:47:33.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f17372d6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17301466c0 con 0x7f17300aea00 2021-06-25T04:47:33.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f1735ad3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17300acfc0 0x7f1730143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f1735ad3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17300acfc0 0x7f1730143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34954/0 (socket says 172.21.15.57:34954) 2021-06-25T04:47:33.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f1735ad3700 1 -- 172.21.15.57:0/2353263361 learned_addr learned my addr 172.21.15.57:0/2353263361 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:33.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.679+0000 7f17362d4700 1 --2- 172.21.15.57:0/2353263361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17300aea00 0x7f1730143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f1736ad5700 1 --2- 172.21.15.57:0/2353263361 >> v2:172.21.15.87:3300/0 conn(0x7f17300b0440 0x7f1730146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f1735ad3700 1 -- 172.21.15.57:0/2353263361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17300aea00 msgr2=0x7f1730143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:33.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f1735ad3700 1 --2- 172.21.15.57:0/2353263361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17300aea00 0x7f1730143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f1735ad3700 1 -- 172.21.15.57:0/2353263361 >> v2:172.21.15.87:3300/0 conn(0x7f17300b0440 msgr2=0x7f1730146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:33.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f1735ad3700 1 --2- 172.21.15.57:0/2353263361 >> v2:172.21.15.87:3300/0 conn(0x7f17300b0440 0x7f1730146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f1735ad3700 1 -- 172.21.15.57:0/2353263361 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17300aede0 con 0x7f17300acfc0 2021-06-25T04:47:33.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f1735ad3700 1 --2- 172.21.15.57:0/2353263361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17300acfc0 0x7f1730143c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f172c0032f0 tx=0x7f172c009290).ready entity=mon.0 client_cookie=219b120b110f7df3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:33.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17352d2700 1 -- 172.21.15.57:0/2353263361 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f172c00b680 con 0x7f17300acfc0 2021-06-25T04:47:33.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17352d2700 1 -- 172.21.15.57:0/2353263361 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c00b7e0 con 0x7f17300acfc0 2021-06-25T04:47:33.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17352d2700 1 -- 172.21.15.57:0/2353263361 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f172c00b950 con 0x7f17300acfc0 2021-06-25T04:47:33.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17372d6700 1 -- 172.21.15.57:0/2353263361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17300acfc0 msgr2=0x7f1730143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:33.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17372d6700 1 --2- 172.21.15.57:0/2353263361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17300acfc0 0x7f1730143c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f172c0032f0 tx=0x7f172c009290).stop 2021-06-25T04:47:33.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17372d6700 1 -- 172.21.15.57:0/2353263361 shutdown_connections 2021-06-25T04:47:33.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17372d6700 1 --2- 172.21.15.57:0/2353263361 >> v2:172.21.15.87:3300/0 conn(0x7f17300b0440 0x7f1730146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17372d6700 1 --2- 172.21.15.57:0/2353263361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17300acfc0 0x7f1730143c60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17372d6700 1 --2- 172.21.15.57:0/2353263361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17300aea00 0x7f1730143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17372d6700 1 -- 172.21.15.57:0/2353263361 >> 172.21.15.57:0/2353263361 conn(0x7f17300611f0 msgr2=0x7f1730062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:33.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17372d6700 1 -- 172.21.15.57:0/2353263361 shutdown_connections 2021-06-25T04:47:33.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17372d6700 1 -- 172.21.15.57:0/2353263361 wait complete. 2021-06-25T04:47:33.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17372d6700 1 Processor -- start 2021-06-25T04:47:33.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.683+0000 7f17372d6700 1 -- start start 2021-06-25T04:47:33.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17372d6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17300acfc0 0x7f173013d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17372d6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17300aea00 0x7f1730152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17372d6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17300b0440 0x7f1730152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17372d6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1730142210 con 0x7f17300acfc0 2021-06-25T04:47:33.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17372d6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17300b5050 con 0x7f17300b0440 2021-06-25T04:47:33.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17372d6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17300b3620 con 0x7f17300aea00 2021-06-25T04:47:33.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17362d4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17300acfc0 0x7f173013d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17362d4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17300acfc0 0x7f173013d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34958/0 (socket says 172.21.15.57:34958) 2021-06-25T04:47:33.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17362d4700 1 -- 172.21.15.57:0/311266104 learned_addr learned my addr 172.21.15.57:0/311266104 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:33.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f1735ad3700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17300aea00 0x7f1730152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f1736ad5700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17300b0440 0x7f1730152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f1735ad3700 1 -- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17300b0440 msgr2=0x7f1730152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:33.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f1735ad3700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17300b0440 0x7f1730152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f1735ad3700 1 -- 172.21.15.57:0/311266104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17300acfc0 msgr2=0x7f173013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:33.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f1735ad3700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17300acfc0 0x7f173013d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f1735ad3700 1 -- 172.21.15.57:0/311266104 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c009530 con 0x7f17300aea00 2021-06-25T04:47:33.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17362d4700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17300acfc0 0x7f173013d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:33.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f1735ad3700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17300aea00 0x7f1730152960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f173013db30 tx=0x7f172c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:33.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17237fe700 1 -- 172.21.15.57:0/311266104 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f172c011bf0 con 0x7f17300aea00 2021-06-25T04:47:33.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17237fe700 1 -- 172.21.15.57:0/311266104 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c011d50 con 0x7f17300aea00 2021-06-25T04:47:33.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17372d6700 1 -- 172.21.15.57:0/311266104 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1730141f70 con 0x7f17300aea00 2021-06-25T04:47:33.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17237fe700 1 -- 172.21.15.57:0/311266104 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f172c01b630 con 0x7f17300aea00 2021-06-25T04:47:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17372d6700 1 -- 172.21.15.57:0/311266104 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17301524c0 con 0x7f17300aea00 2021-06-25T04:47:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.687+0000 7f17372d6700 1 -- 172.21.15.57:0/311266104 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1730057310 con 0x7f17300aea00 2021-06-25T04:47:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.691+0000 7f17237fe700 1 -- 172.21.15.57:0/311266104 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f172c00f070 con 0x7f17300aea00 2021-06-25T04:47:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.691+0000 7f17237fe700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1710055340 0x7f1710057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.691+0000 7f17237fe700 1 -- 172.21.15.57:0/311266104 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f172c06e8a0 con 0x7f17300aea00 2021-06-25T04:47:33.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.691+0000 7f17362d4700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1710055340 0x7f1710057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.691+0000 7f17362d4700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1710055340 0x7f1710057800 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f172400b000 tx=0x7f1724006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:33.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.699+0000 7f17237fe700 1 -- 172.21.15.57:0/311266104 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f172c044ee0 con 0x7f17300aea00 2021-06-25T04:47:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.827+0000 7f17372d6700 1 -- 172.21.15.57:0/311266104 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17300b0e50 con 0x7f17300aea00 2021-06-25T04:47:33.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.827+0000 7f17237fe700 1 -- 172.21.15.57:0/311266104 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f172c048500 con 0x7f17300aea00 2021-06-25T04:47:33.837 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:33.838 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:33.532505+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:33.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 -- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1710055340 msgr2=0x7f1710057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:33.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1710055340 0x7f1710057800 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f172400b000 tx=0x7f1724006df0).stop 2021-06-25T04:47:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 -- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17300aea00 msgr2=0x7f1730152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17300aea00 0x7f1730152960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f173013db30 tx=0x7f172c017000).stop 2021-06-25T04:47:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 -- 172.21.15.57:0/311266104 shutdown_connections 2021-06-25T04:47:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1710055340 0x7f1710057800 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17300b0440 0x7f1730152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17300aea00 0x7f1730152960 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 --2- 172.21.15.57:0/311266104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17300acfc0 0x7f173013d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 -- 172.21.15.57:0/311266104 >> 172.21.15.57:0/311266104 conn(0x7f17300611f0 msgr2=0x7f17300b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:33.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 -- 172.21.15.57:0/311266104 shutdown_connections 2021-06-25T04:47:33.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.831+0000 7f17372d6700 1 -- 172.21.15.57:0/311266104 wait complete. 2021-06-25T04:47:33.850 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:47:33.850 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:47:33.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1bacaf1700 1 Processor -- start 2021-06-25T04:47:33.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1bacaf1700 1 -- start start 2021-06-25T04:47:33.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1bacaf1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1ba80b7670 0x7f1ba8060a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1bacaf1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ba80b2760 0x7f1ba8060f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1bacaf1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba8067010 con 0x7f1ba8146550 2021-06-25T04:47:33.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1bacaf1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba8065370 con 0x7f1ba80b2760 2021-06-25T04:47:33.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1bacaf1700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba80b7a50 con 0x7f1ba80b7670 2021-06-25T04:47:33.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ba80b2760 0x7f1ba8060f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ba80b2760 0x7f1ba8060f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34968/0 (socket says 172.21.15.57:34968) 2021-06-25T04:47:33.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba6ffd700 1 -- 172.21.15.57:0/1902129795 learned_addr learned my addr 172.21.15.57:0/1902129795 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:33.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba77fe700 1 --2- 172.21.15.57:0/1902129795 >> v2:172.21.15.87:3300/0 conn(0x7f1ba80b7670 0x7f1ba8060a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba6ffd700 1 -- 172.21.15.57:0/1902129795 >> v2:172.21.15.87:3300/0 conn(0x7f1ba80b7670 msgr2=0x7f1ba8060a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:33.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba6ffd700 1 --2- 172.21.15.57:0/1902129795 >> v2:172.21.15.87:3300/0 conn(0x7f1ba80b7670 0x7f1ba8060a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba6ffd700 1 -- 172.21.15.57:0/1902129795 >> v1:172.21.15.87:6789/0 conn(0x7f1ba8146550 legacy=0x7f1ba81469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:33.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba6ffd700 1 -- 172.21.15.57:0/1902129795 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba8066b10 con 0x7f1ba80b2760 2021-06-25T04:47:33.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba77fe700 1 --2- 172.21.15.57:0/1902129795 >> v2:172.21.15.87:3300/0 conn(0x7f1ba80b7670 0x7f1ba8060a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:33.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba6ffd700 1 --2- 172.21.15.57:0/1902129795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ba80b2760 0x7f1ba8060f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1b9c002f70 tx=0x7f1b9c006eb0).ready entity=mon.0 client_cookie=e95f8316d5b42985 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:33.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba67fc700 1 -- 172.21.15.57:0/1902129795 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b9c00d610 con 0x7f1ba80b2760 2021-06-25T04:47:33.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba67fc700 1 -- 172.21.15.57:0/1902129795 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c000e90 con 0x7f1ba80b2760 2021-06-25T04:47:33.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1ba67fc700 1 -- 172.21.15.57:0/1902129795 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b9c00d9a0 con 0x7f1ba80b2760 2021-06-25T04:47:33.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1bacaf1700 1 -- 172.21.15.57:0/1902129795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ba80b2760 msgr2=0x7f1ba8060f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:33.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.947+0000 7f1bacaf1700 1 --2- 172.21.15.57:0/1902129795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ba80b2760 0x7f1ba8060f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1b9c002f70 tx=0x7f1b9c006eb0).stop 2021-06-25T04:47:33.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.951+0000 7f1bacaf1700 1 -- 172.21.15.57:0/1902129795 shutdown_connections 2021-06-25T04:47:33.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.951+0000 7f1bacaf1700 1 --2- 172.21.15.57:0/1902129795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ba80b2760 0x7f1ba8060f00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.951+0000 7f1bacaf1700 1 --2- 172.21.15.57:0/1902129795 >> v2:172.21.15.87:3300/0 conn(0x7f1ba80b7670 0x7f1ba8060a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.951+0000 7f1bacaf1700 1 -- 172.21.15.57:0/1902129795 >> 172.21.15.57:0/1902129795 conn(0x7f1ba805f670 msgr2=0x7f1ba805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:33.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.951+0000 7f1bacaf1700 1 -- 172.21.15.57:0/1902129795 shutdown_connections 2021-06-25T04:47:33.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.951+0000 7f1bacaf1700 1 -- 172.21.15.57:0/1902129795 wait complete. 2021-06-25T04:47:33.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.951+0000 7f1bacaf1700 1 Processor -- start 2021-06-25T04:47:33.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.951+0000 7f1bacaf1700 1 -- start start 2021-06-25T04:47:33.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.951+0000 7f1bacaf1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ba80b2760 0x7f1ba80aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.951+0000 7f1bacaf1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ba80b7670 0x7f1ba81527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1bacaf1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ba8146550 0x7f1ba8152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1bacaf1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba81531c0 con 0x7f1ba80b7670 2021-06-25T04:47:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1bacaf1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8149a50 con 0x7f1ba80b2760 2021-06-25T04:47:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1bacaf1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8148b20 con 0x7f1ba8146550 2021-06-25T04:47:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ba80b7670 0x7f1ba81527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ba80b7670 0x7f1ba81527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34974/0 (socket says 172.21.15.57:34974) 2021-06-25T04:47:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba6ffd700 1 -- 172.21.15.57:0/2258496275 learned_addr learned my addr 172.21.15.57:0/2258496275 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:33.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba77fe700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ba80b2760 0x7f1ba80aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba7fff700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ba8146550 0x7f1ba8152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba6ffd700 1 -- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ba8146550 msgr2=0x7f1ba8152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:33.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba6ffd700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ba8146550 0x7f1ba8152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba6ffd700 1 -- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ba80b2760 msgr2=0x7f1ba80aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:33.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba6ffd700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ba80b2760 0x7f1ba80aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:33.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba6ffd700 1 -- 172.21.15.57:0/2258496275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c00b1e0 con 0x7f1ba80b7670 2021-06-25T04:47:33.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba77fe700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ba80b2760 0x7f1ba80aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:33.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba7fff700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ba8146550 0x7f1ba8152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:33.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba6ffd700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ba80b7670 0x7f1ba81527e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1b9c002f70 tx=0x7f1b9c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:33.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba4ff9700 1 -- 172.21.15.57:0/2258496275 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b9c011990 con 0x7f1ba80b7670 2021-06-25T04:47:33.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba4ff9700 1 -- 172.21.15.57:0/2258496275 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c011af0 con 0x7f1ba80b7670 2021-06-25T04:47:33.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1bacaf1700 1 -- 172.21.15.57:0/2258496275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba8148dc0 con 0x7f1ba80b7670 2021-06-25T04:47:33.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba4ff9700 1 -- 172.21.15.57:0/2258496275 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b9c011e50 con 0x7f1ba80b7670 2021-06-25T04:47:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1bacaf1700 1 -- 172.21.15.57:0/2258496275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba80ad690 con 0x7f1ba80b7670 2021-06-25T04:47:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1bacaf1700 1 -- 172.21.15.57:0/2258496275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba8149260 con 0x7f1ba80b7670 2021-06-25T04:47:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.955+0000 7f1ba4ff9700 1 -- 172.21.15.57:0/2258496275 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1b9c00f070 con 0x7f1ba80b7670 2021-06-25T04:47:33.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.959+0000 7f1ba4ff9700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b880553f0 0x7f1b880578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.959+0000 7f1ba4ff9700 1 -- 172.21.15.57:0/2258496275 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1b9c06f290 con 0x7f1ba80b7670 2021-06-25T04:47:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.959+0000 7f1ba77fe700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b880553f0 0x7f1b880578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.959+0000 7f1ba77fe700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b880553f0 0x7f1b880578b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1b9800c000 tx=0x7f1b98008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:33.963+0000 7f1ba4ff9700 1 -- 172.21.15.57:0/2258496275 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1b9c0458d0 con 0x7f1ba80b7670 2021-06-25T04:47:34.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.095+0000 7f1bacaf1700 1 -- 172.21.15.57:0/2258496275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1ba8057310 con 0x7f1ba80b7670 2021-06-25T04:47:34.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.095+0000 7f1ba4ff9700 1 -- 172.21.15.57:0/2258496275 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1b9c048ef0 con 0x7f1ba80b7670 2021-06-25T04:47:34.106 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:47:34.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 -- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b880553f0 msgr2=0x7f1b880578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b880553f0 0x7f1b880578b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1b9800c000 tx=0x7f1b98008040).stop 2021-06-25T04:47:34.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 -- 172.21.15.57:0/2258496275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ba80b7670 msgr2=0x7f1ba81527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ba80b7670 0x7f1ba81527e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1b9c002f70 tx=0x7f1b9c015000).stop 2021-06-25T04:47:34.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 -- 172.21.15.57:0/2258496275 shutdown_connections 2021-06-25T04:47:34.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b880553f0 0x7f1b880578b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ba8146550 0x7f1ba8152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ba80b7670 0x7f1ba81527e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 --2- 172.21.15.57:0/2258496275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ba80b2760 0x7f1ba80aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 -- 172.21.15.57:0/2258496275 >> 172.21.15.57:0/2258496275 conn(0x7f1ba805f670 msgr2=0x7f1ba80b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 -- 172.21.15.57:0/2258496275 shutdown_connections 2021-06-25T04:47:34.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.099+0000 7f1bacaf1700 1 -- 172.21.15.57:0/2258496275 wait complete. 2021-06-25T04:47:34.120 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:47:34.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.219+0000 7f0c2b59e700 1 Processor -- start 2021-06-25T04:47:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.219+0000 7f0c2b59e700 1 -- start start 2021-06-25T04:47:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.219+0000 7f0c2b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0c2c0a9150 0x7f0c2c146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.219+0000 7f0c2b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0c2c0b0390 0x7f0c2c140180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.219+0000 7f0c2b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2c0b1100 con 0x7f0c2c0b0b40 2021-06-25T04:47:34.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.219+0000 7f0c2b59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2c0a9530 con 0x7f0c2c0a9150 2021-06-25T04:47:34.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.219+0000 7f0c2b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2c0b1330 con 0x7f0c2c0b0390 2021-06-25T04:47:34.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2a59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0c2c0a9150 0x7f0c2c146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c23fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0c2c0b0b40 0x7f0c2c146a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52202/0 (socket says 172.21.15.57:52202) 2021-06-25T04:47:34.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c23fff700 1 -- 172.21.15.57:0/1534257874 learned_addr learned my addr 172.21.15.57:0/1534257874 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:34.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2ad9d700 1 --2- 172.21.15.57:0/1534257874 >> v2:172.21.15.87:3300/0 conn(0x7f0c2c0b0390 0x7f0c2c140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c29d9b700 1 -- 172.21.15.57:0/1534257874 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470491009 0 0) 0x7f0c2c0b1100 con 0x7f0c2c0b0b40 2021-06-25T04:47:34.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c29d9b700 1 -- 172.21.15.57:0/1534257874 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c0c003260 con 0x7f0c2c0b0b40 2021-06-25T04:47:34.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2a59c700 1 -- 172.21.15.57:0/1534257874 >> v2:172.21.15.87:3300/0 conn(0x7f0c2c0b0390 msgr2=0x7f0c2c140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:34.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2a59c700 1 --2- 172.21.15.57:0/1534257874 >> v2:172.21.15.87:3300/0 conn(0x7f0c2c0b0390 0x7f0c2c140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2a59c700 1 -- 172.21.15.57:0/1534257874 >> v1:172.21.15.57:6789/0 conn(0x7f0c2c0b0b40 legacy=0x7f0c2c146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2a59c700 1 -- 172.21.15.57:0/1534257874 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c0b15d0 con 0x7f0c2c0a9150 2021-06-25T04:47:34.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2a59c700 1 --2- 172.21.15.57:0/1534257874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c2c0a9150 0x7f0c2c146510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0c1c002f70 tx=0x7f0c1c006df0).ready entity=mon.0 client_cookie=73ebd58bb0741d9f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:34.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c29d9b700 1 -- 172.21.15.57:0/1534257874 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1c00d4f0 con 0x7f0c2c0a9150 2021-06-25T04:47:34.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c29d9b700 1 -- 172.21.15.57:0/1534257874 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c000e90 con 0x7f0c2c0a9150 2021-06-25T04:47:34.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c29d9b700 1 -- 172.21.15.57:0/1534257874 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1c00d840 con 0x7f0c2c0a9150 2021-06-25T04:47:34.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2b59e700 1 -- 172.21.15.57:0/1534257874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c2c0a9150 msgr2=0x7f0c2c146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2b59e700 1 --2- 172.21.15.57:0/1534257874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c2c0a9150 0x7f0c2c146510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0c1c002f70 tx=0x7f0c1c006df0).stop 2021-06-25T04:47:34.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2b59e700 1 -- 172.21.15.57:0/1534257874 shutdown_connections 2021-06-25T04:47:34.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2b59e700 1 --2- 172.21.15.57:0/1534257874 >> v2:172.21.15.87:3300/0 conn(0x7f0c2c0b0390 0x7f0c2c140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2b59e700 1 --2- 172.21.15.57:0/1534257874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c2c0a9150 0x7f0c2c146510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2b59e700 1 -- 172.21.15.57:0/1534257874 >> 172.21.15.57:0/1534257874 conn(0x7f0c2c061100 msgr2=0x7f0c2c062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:34.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2b59e700 1 -- 172.21.15.57:0/1534257874 shutdown_connections 2021-06-25T04:47:34.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2b59e700 1 -- 172.21.15.57:0/1534257874 wait complete. 2021-06-25T04:47:34.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2b59e700 1 Processor -- start 2021-06-25T04:47:34.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.223+0000 7f0c2b59e700 1 -- start start 2021-06-25T04:47:34.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c2c0a9150 0x7f0c2c0ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c2c0b0390 0x7f0c2c13f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c2c0b0b40 0x7f0c2c0aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c0a9e50 con 0x7f0c2c0a9150 2021-06-25T04:47:34.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c0638a0 con 0x7f0c2c0b0390 2021-06-25T04:47:34.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c063b40 con 0x7f0c2c0b0b40 2021-06-25T04:47:34.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c2c0a9150 0x7f0c2c0ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c2c0a9150 0x7f0c2c0ac520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34988/0 (socket says 172.21.15.57:34988) 2021-06-25T04:47:34.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2a59c700 1 -- 172.21.15.57:0/3560492402 learned_addr learned my addr 172.21.15.57:0/3560492402 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:34.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c23fff700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c2c0b0390 0x7f0c2c13f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2ad9d700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c2c0b0b40 0x7f0c2c0aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2a59c700 1 -- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c2c0b0b40 msgr2=0x7f0c2c0aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2a59c700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c2c0b0b40 0x7f0c2c0aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2a59c700 1 -- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c2c0b0390 msgr2=0x7f0c2c13f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2a59c700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c2c0b0390 0x7f0c2c13f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2a59c700 1 -- 172.21.15.57:0/3560492402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c00b180 con 0x7f0c2c0a9150 2021-06-25T04:47:34.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c23fff700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c2c0b0390 0x7f0c2c13f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:34.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2a59c700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c2c0a9150 0x7f0c2c0ac520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0c1c002f70 tx=0x7f0c1c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:34.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c237fe700 1 -- 172.21.15.57:0/3560492402 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1c0129b0 con 0x7f0c2c0a9150 2021-06-25T04:47:34.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c237fe700 1 -- 172.21.15.57:0/3560492402 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c000e90 con 0x7f0c2c0a9150 2021-06-25T04:47:34.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2b59e700 1 -- 172.21.15.57:0/3560492402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2c0b6250 con 0x7f0c2c0a9150 2021-06-25T04:47:34.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c237fe700 1 -- 172.21.15.57:0/3560492402 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1c012d00 con 0x7f0c2c0a9150 2021-06-25T04:47:34.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.227+0000 7f0c2b59e700 1 -- 172.21.15.57:0/3560492402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2c143950 con 0x7f0c2c0a9150 2021-06-25T04:47:34.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.231+0000 7f0c2b59e700 1 -- 172.21.15.57:0/3560492402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2c0aa050 con 0x7f0c2c0a9150 2021-06-25T04:47:34.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.231+0000 7f0c237fe700 1 -- 172.21.15.57:0/3560492402 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0c1c024020 con 0x7f0c2c0a9150 2021-06-25T04:47:34.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.231+0000 7f0c237fe700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0c10055450 0x7f0c10057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.231+0000 7f0c237fe700 1 -- 172.21.15.57:0/3560492402 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0c1c06e5f0 con 0x7f0c2c0a9150 2021-06-25T04:47:34.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.231+0000 7f0c23fff700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0c10055450 0x7f0c10057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.231+0000 7f0c23fff700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0c10055450 0x7f0c10057910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0c1400d000 tx=0x7f0c14009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:34.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.235+0000 7f0c237fe700 1 -- 172.21.15.57:0/3560492402 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0c1c044bd0 con 0x7f0c2c0a9150 2021-06-25T04:47:34.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.363+0000 7f0c2b59e700 1 -- 172.21.15.57:0/3560492402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0c2c063d00 con 0x7f0c2c0a9150 2021-06-25T04:47:34.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.363+0000 7f0c237fe700 1 -- 172.21.15.57:0/3560492402 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0c1c0481f0 con 0x7f0c2c0a9150 2021-06-25T04:47:34.372 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:34.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 -- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0c10055450 msgr2=0x7f0c10057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0c10055450 0x7f0c10057910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0c1400d000 tx=0x7f0c14009040).stop 2021-06-25T04:47:34.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 -- 172.21.15.57:0/3560492402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c2c0a9150 msgr2=0x7f0c2c0ac520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c2c0a9150 0x7f0c2c0ac520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0c1c002f70 tx=0x7f0c1c014000).stop 2021-06-25T04:47:34.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 -- 172.21.15.57:0/3560492402 shutdown_connections 2021-06-25T04:47:34.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0c10055450 0x7f0c10057910 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c2c0b0b40 0x7f0c2c0aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c2c0b0390 0x7f0c2c13f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 --2- 172.21.15.57:0/3560492402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c2c0a9150 0x7f0c2c0ac520 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 -- 172.21.15.57:0/3560492402 >> 172.21.15.57:0/3560492402 conn(0x7f0c2c061100 msgr2=0x7f0c2c1417c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:34.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 -- 172.21.15.57:0/3560492402 shutdown_connections 2021-06-25T04:47:34.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.367+0000 7f0c2b59e700 1 -- 172.21.15.57:0/3560492402 wait complete. 2021-06-25T04:47:34.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:47:34.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.479+0000 7f69fe684700 1 Processor -- start 2021-06-25T04:47:34.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.479+0000 7f69fe684700 1 -- start start 2021-06-25T04:47:34.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.479+0000 7f69fe684700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80af0f0 0x7f69f8067820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.479+0000 7f69fe684700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69f80afd20 0x7f69f8140e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.479+0000 7f69fe684700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f8144410 con 0x7f69f80b2810 2021-06-25T04:47:34.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.479+0000 7f69fe684700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f80b2bf0 con 0x7f69f80afd20 2021-06-25T04:47:34.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.479+0000 7f69fe684700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f81452c0 con 0x7f69f80af0f0 2021-06-25T04:47:34.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fd682700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f69f80b2810 0x7f69f8067110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52212/0 (socket says 172.21.15.57:52212) 2021-06-25T04:47:34.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fd682700 1 -- 172.21.15.57:0/3566202565 learned_addr learned my addr 172.21.15.57:0/3566202565 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:34.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fce81700 1 --2- 172.21.15.57:0/3566202565 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80af0f0 0x7f69f8067820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fde83700 1 --2- 172.21.15.57:0/3566202565 >> v2:172.21.15.87:3300/0 conn(0x7f69f80afd20 0x7f69f8140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fce81700 1 -- 172.21.15.57:0/3566202565 >> v2:172.21.15.87:3300/0 conn(0x7f69f80afd20 msgr2=0x7f69f8140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:34.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fce81700 1 --2- 172.21.15.57:0/3566202565 >> v2:172.21.15.87:3300/0 conn(0x7f69f80afd20 0x7f69f8140e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fce81700 1 -- 172.21.15.57:0/3566202565 >> v1:172.21.15.57:6789/0 conn(0x7f69f80b2810 legacy=0x7f69f8067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69effff700 1 -- 172.21.15.57:0/3566202565 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500951205 0 0) 0x7f69f8144410 con 0x7f69f80b2810 2021-06-25T04:47:34.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fce81700 1 -- 172.21.15.57:0/3566202565 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f8144640 con 0x7f69f80af0f0 2021-06-25T04:47:34.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fde83700 1 --2- 172.21.15.57:0/3566202565 >> v2:172.21.15.87:3300/0 conn(0x7f69f80afd20 0x7f69f8140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:34.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fce81700 1 --2- 172.21.15.57:0/3566202565 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80af0f0 0x7f69f8067820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f69e8002f70 tx=0x7f69e8006df0).ready entity=mon.2 client_cookie=742bde960796d8c4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:34.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69effff700 1 -- 172.21.15.57:0/3566202565 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e800d570 con 0x7f69f80af0f0 2021-06-25T04:47:34.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69effff700 1 -- 172.21.15.57:0/3566202565 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e8000e90 con 0x7f69f80af0f0 2021-06-25T04:47:34.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69effff700 1 -- 172.21.15.57:0/3566202565 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e800d8c0 con 0x7f69f80af0f0 2021-06-25T04:47:34.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fe684700 1 -- 172.21.15.57:0/3566202565 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80af0f0 msgr2=0x7f69f8067820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fe684700 1 --2- 172.21.15.57:0/3566202565 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80af0f0 0x7f69f8067820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f69e8002f70 tx=0x7f69e8006df0).stop 2021-06-25T04:47:34.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fe684700 1 -- 172.21.15.57:0/3566202565 shutdown_connections 2021-06-25T04:47:34.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fe684700 1 --2- 172.21.15.57:0/3566202565 >> v2:172.21.15.87:3300/0 conn(0x7f69f80afd20 0x7f69f8140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fe684700 1 --2- 172.21.15.57:0/3566202565 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80af0f0 0x7f69f8067820 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fe684700 1 -- 172.21.15.57:0/3566202565 >> 172.21.15.57:0/3566202565 conn(0x7f69f80611f0 msgr2=0x7f69f8062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:34.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fe684700 1 -- 172.21.15.57:0/3566202565 shutdown_connections 2021-06-25T04:47:34.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.483+0000 7f69fe684700 1 -- 172.21.15.57:0/3566202565 wait complete. 2021-06-25T04:47:34.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fe684700 1 Processor -- start 2021-06-25T04:47:34.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fe684700 1 -- start start 2021-06-25T04:47:34.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fe684700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80af0f0 0x7f69f80b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fe684700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80afd20 0x7f69f8145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fe684700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69f80b2810 0x7f69f81463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fe684700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f813ac20 con 0x7f69f80af0f0 2021-06-25T04:47:34.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fe684700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f813de00 con 0x7f69f80b2810 2021-06-25T04:47:34.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fe684700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f813e060 con 0x7f69f80afd20 2021-06-25T04:47:34.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fd682700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80af0f0 0x7f69f80b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fd682700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80af0f0 0x7f69f80b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35000/0 (socket says 172.21.15.57:35000) 2021-06-25T04:47:34.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fd682700 1 -- 172.21.15.57:0/2302779064 learned_addr learned my addr 172.21.15.57:0/2302779064 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:34.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fde83700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69f80b2810 0x7f69f81463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fce81700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80afd20 0x7f69f8145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fd682700 1 -- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80afd20 msgr2=0x7f69f8145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fd682700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80afd20 0x7f69f8145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fd682700 1 -- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69f80b2810 msgr2=0x7f69f81463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fd682700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69f80b2810 0x7f69f81463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fd682700 1 -- 172.21.15.57:0/2302779064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f0009470 con 0x7f69f80af0f0 2021-06-25T04:47:34.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fd682700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80af0f0 0x7f69f80b3b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f69f4000bc0 tx=0x7f69f4007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:34.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69ee7fc700 1 -- 172.21.15.57:0/2302779064 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69f400ce00 con 0x7f69f80af0f0 2021-06-25T04:47:34.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69ee7fc700 1 -- 172.21.15.57:0/2302779064 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f40070d0 con 0x7f69f80af0f0 2021-06-25T04:47:34.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69ee7fc700 1 -- 172.21.15.57:0/2302779064 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69f4007430 con 0x7f69f80af0f0 2021-06-25T04:47:34.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fe684700 1 -- 172.21.15.57:0/2302779064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e800b180 con 0x7f69f80af0f0 2021-06-25T04:47:34.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.487+0000 7f69fe684700 1 -- 172.21.15.57:0/2302779064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f80b4230 con 0x7f69f80af0f0 2021-06-25T04:47:34.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.491+0000 7f69fe684700 1 -- 172.21.15.57:0/2302779064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f8145bf0 con 0x7f69f80af0f0 2021-06-25T04:47:34.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.491+0000 7f69ee7fc700 1 -- 172.21.15.57:0/2302779064 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f69f4010070 con 0x7f69f80af0f0 2021-06-25T04:47:34.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.491+0000 7f69ee7fc700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69e00553d0 0x7f69e0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.491+0000 7f69ee7fc700 1 -- 172.21.15.57:0/2302779064 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f69f406cfe0 con 0x7f69f80af0f0 2021-06-25T04:47:34.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.491+0000 7f69fce81700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69e00553d0 0x7f69e0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.491+0000 7f69fce81700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69e00553d0 0x7f69e0057890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f69e8019000 tx=0x7f69e8014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:34.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.499+0000 7f69ee7fc700 1 -- 172.21.15.57:0/2302779064 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f69f8145bf0 con 0x7f69f80af0f0 2021-06-25T04:47:34.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.631+0000 7f69fe684700 1 -- 172.21.15.57:0/2302779064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f69f8145bf0 con 0x7f69f80af0f0 2021-06-25T04:47:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.631+0000 7f69ee7fc700 1 -- 172.21.15.57:0/2302779064 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f69f8145bf0 con 0x7f69f80af0f0 2021-06-25T04:47:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:34.641 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:47:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:47:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:47:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:47:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:47:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:47:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:47:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:47:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:47:34.644 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:47:34.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 -- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69e00553d0 msgr2=0x7f69e0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69e00553d0 0x7f69e0057890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f69e8019000 tx=0x7f69e8014000).stop 2021-06-25T04:47:34.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 -- 172.21.15.57:0/2302779064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80af0f0 msgr2=0x7f69f80b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80af0f0 0x7f69f80b3b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f69f4000bc0 tx=0x7f69f4007c90).stop 2021-06-25T04:47:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 -- 172.21.15.57:0/2302779064 shutdown_connections 2021-06-25T04:47:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69e00553d0 0x7f69e0057890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69f80b2810 0x7f69f81463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80afd20 0x7f69f8145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 --2- 172.21.15.57:0/2302779064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80af0f0 0x7f69f80b3b30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 -- 172.21.15.57:0/2302779064 >> 172.21.15.57:0/2302779064 conn(0x7f69f80611f0 msgr2=0x7f69f80b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 -- 172.21.15.57:0/2302779064 shutdown_connections 2021-06-25T04:47:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.635+0000 7f69fe684700 1 -- 172.21.15.57:0/2302779064 wait complete. 2021-06-25T04:47:34.658 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:47:34.659 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:47:34.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.755+0000 7ff435ab3700 1 Processor -- start 2021-06-25T04:47:34.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.755+0000 7ff435ab3700 1 -- start start 2021-06-25T04:47:34.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff430060160 0x7ff4300b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 0x7ff4300a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4300aa460 con 0x7ff4300af380 2021-06-25T04:47:34.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4300b1410 con 0x7ff430060160 2021-06-25T04:47:34.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300af760 con 0x7ff43005c520 2021-06-25T04:47:34.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff4352b2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 0x7ff4300a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff42ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff430060160 0x7ff4300b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff4352b2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 0x7ff4300a8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:46178/0 (socket says 172.21.15.57:46178) 2021-06-25T04:47:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff4352b2700 1 -- 172.21.15.57:0/3618883911 learned_addr learned my addr 172.21.15.57:0/3618883911 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff4352b2700 1 -- 172.21.15.57:0/3618883911 >> v2:172.21.15.87:3300/0 conn(0x7ff430060160 msgr2=0x7ff4300b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:34.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff4352b2700 1 --2- 172.21.15.57:0/3618883911 >> v2:172.21.15.87:3300/0 conn(0x7ff430060160 0x7ff4300b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff4352b2700 1 -- 172.21.15.57:0/3618883911 >> v1:172.21.15.87:6789/0 conn(0x7ff4300af380 legacy=0x7ff430144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff4352b2700 1 -- 172.21.15.57:0/3618883911 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43005fb40 con 0x7ff43005c520 2021-06-25T04:47:34.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff42ffff700 1 --2- 172.21.15.57:0/3618883911 >> v2:172.21.15.87:3300/0 conn(0x7ff430060160 0x7ff4300b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:34.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff4352b2700 1 --2- 172.21.15.57:0/3618883911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 0x7ff4300a8bb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff4280032f0 tx=0x7ff428009290).ready entity=mon.2 client_cookie=a345629ab38644d3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:34.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff42f7fe700 1 -- 172.21.15.57:0/3618883911 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff42800b8a0 con 0x7ff43005c520 2021-06-25T04:47:34.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff42f7fe700 1 -- 172.21.15.57:0/3618883911 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42800ba00 con 0x7ff43005c520 2021-06-25T04:47:34.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 -- 172.21.15.57:0/3618883911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 msgr2=0x7ff4300a8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 --2- 172.21.15.57:0/3618883911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 0x7ff4300a8bb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff4280032f0 tx=0x7ff428009290).stop 2021-06-25T04:47:34.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff42f7fe700 1 -- 172.21.15.57:0/3618883911 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff42800bb70 con 0x7ff43005c520 2021-06-25T04:47:34.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 -- 172.21.15.57:0/3618883911 shutdown_connections 2021-06-25T04:47:34.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 --2- 172.21.15.57:0/3618883911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 0x7ff4300a8bb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 --2- 172.21.15.57:0/3618883911 >> v2:172.21.15.87:3300/0 conn(0x7ff430060160 0x7ff4300b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 -- 172.21.15.57:0/3618883911 >> 172.21.15.57:0/3618883911 conn(0x7ff430061100 msgr2=0x7ff430062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:34.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 -- 172.21.15.57:0/3618883911 shutdown_connections 2021-06-25T04:47:34.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.759+0000 7ff435ab3700 1 -- 172.21.15.57:0/3618883911 wait complete. 2021-06-25T04:47:34.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff435ab3700 1 Processor -- start 2021-06-25T04:47:34.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff435ab3700 1 -- start start 2021-06-25T04:47:34.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff435ab3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 0x7ff430141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff435ab3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff430060160 0x7ff430143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff435ab3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4300af380 0x7ff430144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff435ab3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff430143f00 con 0x7ff430060160 2021-06-25T04:47:34.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff435ab3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff430142e50 con 0x7ff4300af380 2021-06-25T04:47:34.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff435ab3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4301430f0 con 0x7ff43005c520 2021-06-25T04:47:34.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff430060160 0x7ff430143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff4352b2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4300af380 0x7ff430144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff430060160 0x7ff430143860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35018/0 (socket says 172.21.15.57:35018) 2021-06-25T04:47:34.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42ffff700 1 -- 172.21.15.57:0/4250090135 learned_addr learned my addr 172.21.15.57:0/4250090135 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:34.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff434ab1700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 0x7ff430141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42ffff700 1 -- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 msgr2=0x7ff430141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42ffff700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 0x7ff430141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42ffff700 1 -- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4300af380 msgr2=0x7ff430144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:34.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42ffff700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4300af380 0x7ff430144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:34.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42ffff700 1 -- 172.21.15.57:0/4250090135 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c00b180 con 0x7ff430060160 2021-06-25T04:47:34.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff4352b2700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4300af380 0x7ff430144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:34.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42ffff700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff430060160 0x7ff430143860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff41c00c000 tx=0x7ff41c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:34.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42dffb700 1 -- 172.21.15.57:0/4250090135 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff41c00c5f0 con 0x7ff430060160 2021-06-25T04:47:34.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42dffb700 1 -- 172.21.15.57:0/4250090135 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c00c750 con 0x7ff430060160 2021-06-25T04:47:34.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff435ab3700 1 -- 172.21.15.57:0/4250090135 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff428009530 con 0x7ff430060160 2021-06-25T04:47:34.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff42dffb700 1 -- 172.21.15.57:0/4250090135 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff41c00cab0 con 0x7ff430060160 2021-06-25T04:47:34.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.763+0000 7ff435ab3700 1 -- 172.21.15.57:0/4250090135 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43005f670 con 0x7ff430060160 2021-06-25T04:47:34.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.767+0000 7ff435ab3700 1 -- 172.21.15.57:0/4250090135 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff430144610 con 0x7ff430060160 2021-06-25T04:47:34.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.767+0000 7ff42dffb700 1 -- 172.21.15.57:0/4250090135 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff41c00cc10 con 0x7ff430060160 2021-06-25T04:47:34.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.767+0000 7ff42dffb700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff418055340 0x7ff418057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:34.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.767+0000 7ff42dffb700 1 -- 172.21.15.57:0/4250090135 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff41c06dff0 con 0x7ff430060160 2021-06-25T04:47:34.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.767+0000 7ff434ab1700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff418055340 0x7ff418057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:34.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.767+0000 7ff434ab1700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff418055340 0x7ff418057800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff42400d000 tx=0x7ff424007b70).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:34.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.775+0000 7ff42dffb700 1 -- 172.21.15.57:0/4250090135 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff41c044540 con 0x7ff430060160 2021-06-25T04:47:34.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:34.899+0000 7ff435ab3700 1 -- 172.21.15.57:0/4250090135 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7ff430057310 con 0x7ff430060160 2021-06-25T04:47:35.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.675+0000 7ff42dffb700 1 -- 172.21.15.57:0/4250090135 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff41c047b60 con 0x7ff430060160 2021-06-25T04:47:35.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 -- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff418055340 msgr2=0x7ff418057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:35.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff418055340 0x7ff418057800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff42400d000 tx=0x7ff424007b70).stop 2021-06-25T04:47:35.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 -- 172.21.15.57:0/4250090135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff430060160 msgr2=0x7ff430143860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:35.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff430060160 0x7ff430143860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff41c00c000 tx=0x7ff41c006df0).stop 2021-06-25T04:47:35.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 -- 172.21.15.57:0/4250090135 shutdown_connections 2021-06-25T04:47:35.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff418055340 0x7ff418057800 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:35.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4300af380 0x7ff430144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:35.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff430060160 0x7ff430143860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:35.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 --2- 172.21.15.57:0/4250090135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff43005c520 0x7ff430141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:35.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 -- 172.21.15.57:0/4250090135 >> 172.21.15.57:0/4250090135 conn(0x7ff430061100 msgr2=0x7ff4300b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:35.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 -- 172.21.15.57:0/4250090135 shutdown_connections 2021-06-25T04:47:35.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.679+0000 7ff435ab3700 1 -- 172.21.15.57:0/4250090135 wait complete. 2021-06-25T04:47:35.691 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:47:35.702 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2021-06-25T04:47:35.703 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2021-06-25T04:47:35.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.799+0000 7f01655a9700 1 Processor -- start 2021-06-25T04:47:35.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.799+0000 7f01655a9700 1 -- start start 2021-06-25T04:47:35.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f01655a9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 0x7f016005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:35.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f01655a9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f01600b1930 0x7f016005fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:35.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f01655a9700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01600a7a50 con 0x7f01600a7670 2021-06-25T04:47:35.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f01655a9700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01601475e0 con 0x7f01600b1930 2021-06-25T04:47:35.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f01655a9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0160147880 con 0x7f0160067140 2021-06-25T04:47:35.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015e7fc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 0x7f016005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:35.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015f7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f01600b1930 0x7f016005fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:35.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015e7fc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 0x7f016005f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:46190/0 (socket says 172.21.15.57:46190) 2021-06-25T04:47:35.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015f7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f01600b1930 0x7f016005fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:43522/0 (socket says 172.21.15.57:43522) 2021-06-25T04:47:35.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015e7fc700 1 -- 172.21.15.57:0/2139745614 learned_addr learned my addr 172.21.15.57:0/2139745614 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:35.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015effd700 1 --1- 172.21.15.57:0/2139745614 >> v1:172.21.15.87:6789/0 conn(0x7f01600a7670 0x7f0160066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:52990/0 (socket says 172.21.15.57:52990) 2021-06-25T04:47:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015e7fc700 1 -- 172.21.15.57:0/2139745614 >> v2:172.21.15.87:3300/0 conn(0x7f01600b1930 msgr2=0x7f016005fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015e7fc700 1 --2- 172.21.15.57:0/2139745614 >> v2:172.21.15.87:3300/0 conn(0x7f01600b1930 0x7f016005fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015e7fc700 1 -- 172.21.15.57:0/2139745614 >> v1:172.21.15.87:6789/0 conn(0x7f01600a7670 legacy=0x7f0160066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015e7fc700 1 -- 172.21.15.57:0/2139745614 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0160147b20 con 0x7f0160067140 2021-06-25T04:47:35.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015f7fe700 1 --2- 172.21.15.57:0/2139745614 >> v2:172.21.15.87:3300/0 conn(0x7f01600b1930 0x7f016005fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:35.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015e7fc700 1 --2- 172.21.15.57:0/2139745614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 0x7f016005f670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0150002f70 tx=0x7f0150006eb0).ready entity=mon.2 client_cookie=e05fdb31e8e3ec7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:35.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015dffb700 1 -- 172.21.15.57:0/2139745614 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015000d570 con 0x7f0160067140 2021-06-25T04:47:35.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015dffb700 1 -- 172.21.15.57:0/2139745614 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0150000e90 con 0x7f0160067140 2021-06-25T04:47:35.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f015dffb700 1 -- 172.21.15.57:0/2139745614 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015000d900 con 0x7f0160067140 2021-06-25T04:47:35.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f01655a9700 1 -- 172.21.15.57:0/2139745614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 msgr2=0x7f016005f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:35.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.803+0000 7f01655a9700 1 --2- 172.21.15.57:0/2139745614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 0x7f016005f670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0150002f70 tx=0x7f0150006eb0).stop 2021-06-25T04:47:35.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.807+0000 7f01655a9700 1 -- 172.21.15.57:0/2139745614 shutdown_connections 2021-06-25T04:47:35.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.807+0000 7f01655a9700 1 --2- 172.21.15.57:0/2139745614 >> v2:172.21.15.87:3300/0 conn(0x7f01600b1930 0x7f016005fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:35.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.807+0000 7f01655a9700 1 --2- 172.21.15.57:0/2139745614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 0x7f016005f670 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:35.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.807+0000 7f01655a9700 1 -- 172.21.15.57:0/2139745614 >> 172.21.15.57:0/2139745614 conn(0x7f01600b53a0 msgr2=0x7f01600b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:35.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.807+0000 7f01655a9700 1 -- 172.21.15.57:0/2139745614 shutdown_connections 2021-06-25T04:47:35.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.807+0000 7f01655a9700 1 -- 172.21.15.57:0/2139745614 wait complete. 2021-06-25T04:47:35.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.807+0000 7f01655a9700 1 Processor -- start 2021-06-25T04:47:35.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.807+0000 7f01655a9700 1 -- start start 2021-06-25T04:47:35.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f01655a9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 0x7f01600ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:35.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f01655a9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01600a7670 0x7f016015a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:35.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f01655a9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01600b1930 0x7f0160145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:35.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f01655a9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01600ab830 con 0x7f01600b1930 2021-06-25T04:47:35.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f01655a9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0160159c40 con 0x7f01600a7670 2021-06-25T04:47:35.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f01655a9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0160159ee0 con 0x7f0160067140 2021-06-25T04:47:35.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f015f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01600b1930 0x7f0160145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:35.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f015f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01600b1930 0x7f0160145780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35034/0 (socket says 172.21.15.57:35034) 2021-06-25T04:47:35.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f015f7fe700 1 -- 172.21.15.57:0/1081053346 learned_addr learned my addr 172.21.15.57:0/1081053346 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:35.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f015effd700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 0x7f01600ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:35.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f015e7fc700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01600a7670 0x7f016015a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:35.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f015f7fe700 1 -- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 msgr2=0x7f01600ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:35.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f015f7fe700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 0x7f01600ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:35.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f015f7fe700 1 -- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01600a7670 msgr2=0x7f016015a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:35.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f015f7fe700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01600a7670 0x7f016015a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:35.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f015f7fe700 1 -- 172.21.15.57:0/1081053346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158009470 con 0x7f01600b1930 2021-06-25T04:47:35.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f015f7fe700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01600b1930 0x7f0160145780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f015800c000 tx=0x7f01580091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:35.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f0157fff700 1 -- 172.21.15.57:0/1081053346 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015800c6a0 con 0x7f01600b1930 2021-06-25T04:47:35.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f0157fff700 1 -- 172.21.15.57:0/1081053346 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015800c800 con 0x7f01600b1930 2021-06-25T04:47:35.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f01655a9700 1 -- 172.21.15.57:0/1081053346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015000b1e0 con 0x7f01600b1930 2021-06-25T04:47:35.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f0157fff700 1 -- 172.21.15.57:0/1081053346 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015800cb60 con 0x7f01600b1930 2021-06-25T04:47:35.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f01655a9700 1 -- 172.21.15.57:0/1081053346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01600ab520 con 0x7f01600b1930 2021-06-25T04:47:35.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.811+0000 7f01655a9700 1 -- 172.21.15.57:0/1081053346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0160057310 con 0x7f01600b1930 2021-06-25T04:47:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.815+0000 7f0157fff700 1 -- 172.21.15.57:0/1081053346 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0158022070 con 0x7f01600b1930 2021-06-25T04:47:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.815+0000 7f0157fff700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0144055450 0x7f0144057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.815+0000 7f0157fff700 1 -- 172.21.15.57:0/1081053346 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f015806e830 con 0x7f01600b1930 2021-06-25T04:47:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.815+0000 7f015effd700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0144055450 0x7f0144057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:35.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.815+0000 7f015effd700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0144055450 0x7f0144057910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f014800d000 tx=0x7f0148009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:35.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.823+0000 7f0157fff700 1 -- 172.21.15.57:0/1081053346 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0158044d10 con 0x7f01600b1930 2021-06-25T04:47:35.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:35.959+0000 7f01655a9700 1 -- 172.21.15.57:0/1081053346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f01600698a0 con 0x7f01600b1930 2021-06-25T04:47:36.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.683+0000 7f0157fff700 1 -- 172.21.15.57:0/1081053346 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 154+0+0 (secure 0 0 0) 0x7f01580160e0 con 0x7f01600b1930 2021-06-25T04:47:36.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 -- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0144055450 msgr2=0x7f0144057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:36.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0144055450 0x7f0144057910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f014800d000 tx=0x7f0148009040).stop 2021-06-25T04:47:36.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 -- 172.21.15.57:0/1081053346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01600b1930 msgr2=0x7f0160145780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:36.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01600b1930 0x7f0160145780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f015800c000 tx=0x7f01580091d0).stop 2021-06-25T04:47:36.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 -- 172.21.15.57:0/1081053346 shutdown_connections 2021-06-25T04:47:36.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0144055450 0x7f0144057910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:36.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01600b1930 0x7f0160145780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:36.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01600a7670 0x7f016015a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:36.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 --2- 172.21.15.57:0/1081053346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0160067140 0x7f01600ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:36.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 -- 172.21.15.57:0/1081053346 >> 172.21.15.57:0/1081053346 conn(0x7f01600b53a0 msgr2=0x7f0160149860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:36.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 -- 172.21.15.57:0/1081053346 shutdown_connections 2021-06-25T04:47:36.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.691+0000 7f01655a9700 1 -- 172.21.15.57:0/1081053346 wait complete. 2021-06-25T04:47:36.713 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2021-06-25T04:47:36.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:47:36.758 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:47:36.761 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:47:36.766 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:47:36.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.807+0000 7fbe4f59e700 1 Processor -- start 2021-06-25T04:47:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.807+0000 7fbe4f59e700 1 -- start start 2021-06-25T04:47:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.807+0000 7fbe4f59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbe50066bf0 0x7fbe5014e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.807+0000 7fbe4f59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500652f0 con 0x7fbe500b2560 2021-06-25T04:47:36.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.807+0000 7fbe4f59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500b33a0 con 0x7fbe500b2fc0 2021-06-25T04:47:36.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.807+0000 7fbe4f59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe50061fc0 con 0x7fbe50066bf0 2021-06-25T04:47:36.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.807+0000 7fbe45d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbe500b2560 0x7fbe500664e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52258/0 (socket says 172.21.15.57:52258) 2021-06-25T04:47:36.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe45d9b700 1 -- 172.21.15.57:0/1420109807 learned_addr learned my addr 172.21.15.57:0/1420109807 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:36.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4ed9d700 1 --2- 172.21.15.57:0/1420109807 >> v2:172.21.15.87:3300/0 conn(0x7fbe50066bf0 0x7fbe5014e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:36.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4dd9b700 1 -- 172.21.15.57:0/1420109807 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873544289 0 0) 0x7fbe500652f0 con 0x7fbe500b2560 2021-06-25T04:47:36.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4dd9b700 1 -- 172.21.15.57:0/1420109807 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe30003260 con 0x7fbe500b2560 2021-06-25T04:47:36.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4ed9d700 1 -- 172.21.15.57:0/1420109807 >> v1:172.21.15.87:6789/0 conn(0x7fbe500b2fc0 legacy=0x7fbe50060ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:36.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4ed9d700 1 -- 172.21.15.57:0/1420109807 >> v1:172.21.15.57:6789/0 conn(0x7fbe500b2560 legacy=0x7fbe500664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:36.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4ed9d700 1 -- 172.21.15.57:0/1420109807 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5005fa20 con 0x7fbe50066bf0 2021-06-25T04:47:36.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4ed9d700 1 --2- 172.21.15.57:0/1420109807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50066bf0 0x7fbe5014e8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fbe480032f0 tx=0x7fbe480091d0).ready entity=mon.1 client_cookie=49434b0e9cdd6f70 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:36.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4dd9b700 1 -- 172.21.15.57:0/1420109807 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe4800b6c0 con 0x7fbe50066bf0 2021-06-25T04:47:36.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4dd9b700 1 -- 172.21.15.57:0/1420109807 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4800b820 con 0x7fbe50066bf0 2021-06-25T04:47:36.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4dd9b700 1 -- 172.21.15.57:0/1420109807 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe4800b990 con 0x7fbe50066bf0 2021-06-25T04:47:36.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4f59e700 1 -- 172.21.15.57:0/1420109807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50066bf0 msgr2=0x7fbe5014e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:36.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4f59e700 1 --2- 172.21.15.57:0/1420109807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50066bf0 0x7fbe5014e8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fbe480032f0 tx=0x7fbe480091d0).stop 2021-06-25T04:47:36.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4f59e700 1 -- 172.21.15.57:0/1420109807 shutdown_connections 2021-06-25T04:47:36.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4f59e700 1 --2- 172.21.15.57:0/1420109807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50066bf0 0x7fbe5014e8f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:36.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4f59e700 1 -- 172.21.15.57:0/1420109807 >> 172.21.15.57:0/1420109807 conn(0x7fbe500636a0 msgr2=0x7fbe50063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:36.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4f59e700 1 -- 172.21.15.57:0/1420109807 shutdown_connections 2021-06-25T04:47:36.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.811+0000 7fbe4f59e700 1 -- 172.21.15.57:0/1420109807 wait complete. 2021-06-25T04:47:36.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe4f59e700 1 Processor -- start 2021-06-25T04:47:36.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe4f59e700 1 -- start start 2021-06-25T04:47:36.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe4f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe50066bf0 0x7fbe501457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:36.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe4f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500b2560 0x7fbe501534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:36.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe4f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe500b2fc0 0x7fbe501539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:36.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe4f59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50152c10 con 0x7fbe500b2560 2021-06-25T04:47:36.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe4f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50152eb0 con 0x7fbe500b2fc0 2021-06-25T04:47:36.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe4f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500a2c80 con 0x7fbe50066bf0 2021-06-25T04:47:36.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe45d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500b2560 0x7fbe501534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe45d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500b2560 0x7fbe501534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35046/0 (socket says 172.21.15.57:35046) 2021-06-25T04:47:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe45d9b700 1 -- 172.21.15.57:0/2059228321 learned_addr learned my addr 172.21.15.57:0/2059228321 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe4ed9d700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe500b2fc0 0x7fbe501539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:36.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.815+0000 7fbe4e59c700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe50066bf0 0x7fbe501457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:36.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe45d9b700 1 -- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe50066bf0 msgr2=0x7fbe501457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:36.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe45d9b700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe50066bf0 0x7fbe501457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:36.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe45d9b700 1 -- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe500b2fc0 msgr2=0x7fbe501539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe45d9b700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe500b2fc0 0x7fbe501539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe45d9b700 1 -- 172.21.15.57:0/2059228321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48009470 con 0x7fbe500b2560 2021-06-25T04:47:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe45d9b700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500b2560 0x7fbe501534d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbe38001110 tx=0x7fbe38007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe47fff700 1 -- 172.21.15.57:0/2059228321 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe380070d0 con 0x7fbe500b2560 2021-06-25T04:47:36.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe47fff700 1 -- 172.21.15.57:0/2059228321 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe38007230 con 0x7fbe500b2560 2021-06-25T04:47:36.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe4f59e700 1 -- 172.21.15.57:0/2059228321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe500a2f20 con 0x7fbe500b2560 2021-06-25T04:47:36.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe47fff700 1 -- 172.21.15.57:0/2059228321 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe38005610 con 0x7fbe500b2560 2021-06-25T04:47:36.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe4f59e700 1 -- 172.21.15.57:0/2059228321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe50153eb0 con 0x7fbe500b2560 2021-06-25T04:47:36.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe4f59e700 1 -- 172.21.15.57:0/2059228321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe500a30b0 con 0x7fbe500b2560 2021-06-25T04:47:36.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe47fff700 1 -- 172.21.15.57:0/2059228321 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbe3801a060 con 0x7fbe500b2560 2021-06-25T04:47:36.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe47fff700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe34055340 0x7fbe34057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:36.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe47fff700 1 -- 172.21.15.57:0/2059228321 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5863+0+0 (secure 0 0 0) 0x7fbe3806d3f0 con 0x7fbe500b2560 2021-06-25T04:47:36.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.819+0000 7fbe4e59c700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe34055340 0x7fbe34057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:36.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.823+0000 7fbe4e59c700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe34055340 0x7fbe34057800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbe4000d000 tx=0x7fbe40007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:36.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.823+0000 7fbe47fff700 1 -- 172.21.15.57:0/2059228321 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbe380437d0 con 0x7fbe500b2560 2021-06-25T04:47:36.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:36.951+0000 7fbe4f59e700 1 -- 172.21.15.57:0/2059228321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7fbe50057310 con 0x7fbe500b2560 2021-06-25T04:47:38.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.699+0000 7fbe47fff700 1 -- 172.21.15.57:0/2059228321 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v22) v1 ==== 188+0+0 (secure 0 0 0) 0x7fbe38018020 con 0x7fbe500b2560 2021-06-25T04:47:38.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 -- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe34055340 msgr2=0x7fbe34057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:38.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe34055340 0x7fbe34057800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbe4000d000 tx=0x7fbe40007b90).stop 2021-06-25T04:47:38.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 -- 172.21.15.57:0/2059228321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500b2560 msgr2=0x7fbe501534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:38.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500b2560 0x7fbe501534d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbe38001110 tx=0x7fbe38007aa0).stop 2021-06-25T04:47:38.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 -- 172.21.15.57:0/2059228321 shutdown_connections 2021-06-25T04:47:38.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe34055340 0x7fbe34057800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:38.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe500b2fc0 0x7fbe501539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:38.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500b2560 0x7fbe501534d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:38.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 --2- 172.21.15.57:0/2059228321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe50066bf0 0x7fbe501457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:38.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 -- 172.21.15.57:0/2059228321 >> 172.21.15.57:0/2059228321 conn(0x7fbe500636a0 msgr2=0x7fbe50143290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:38.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 -- 172.21.15.57:0/2059228321 shutdown_connections 2021-06-25T04:47:38.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.707+0000 7fbe4f59e700 1 -- 172.21.15.57:0/2059228321 wait complete. 2021-06-25T04:47:38.718 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:47:38.725 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2021-06-25T04:47:38.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa81d077700 1 Processor -- start 2021-06-25T04:47:38.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa81d077700 1 -- start start 2021-06-25T04:47:38.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa81d077700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8180b11f0 0x7fa8180b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:38.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa81d077700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa8180afbb0 0x7fa818142740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:38.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa81d077700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8180ac350 con 0x7fa818142c30 2021-06-25T04:47:38.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa81d077700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa818143030 con 0x7fa8180b11f0 2021-06-25T04:47:38.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa81d077700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8180b15d0 con 0x7fa8180afbb0 2021-06-25T04:47:38.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa817fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8180b11f0 0x7fa8180b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:38.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa81c876700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa818142c30 0x7fa8180ae6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52274/0 (socket says 172.21.15.57:52274) 2021-06-25T04:47:38.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa81c876700 1 -- 172.21.15.57:0/696398120 learned_addr learned my addr 172.21.15.57:0/696398120 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:38.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa817fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8180b11f0 0x7fa8180b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35052/0 (socket says 172.21.15.57:35052) 2021-06-25T04:47:38.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa80f7fe700 1 --2- 172.21.15.57:0/696398120 >> v2:172.21.15.87:3300/0 conn(0x7fa8180afbb0 0x7fa818142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:38.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa817fff700 1 -- 172.21.15.57:0/696398120 >> v2:172.21.15.87:3300/0 conn(0x7fa8180afbb0 msgr2=0x7fa818142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:38.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa817fff700 1 --2- 172.21.15.57:0/696398120 >> v2:172.21.15.87:3300/0 conn(0x7fa8180afbb0 0x7fa818142740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:38.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa817fff700 1 -- 172.21.15.57:0/696398120 >> v1:172.21.15.57:6789/0 conn(0x7fa818142c30 legacy=0x7fa8180ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:38.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa8177fe700 1 -- 172.21.15.57:0/696398120 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494040730 0 0) 0x7fa8180ac350 con 0x7fa818142c30 2021-06-25T04:47:38.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa817fff700 1 -- 172.21.15.57:0/696398120 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8180b0280 con 0x7fa8180b11f0 2021-06-25T04:47:38.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa80f7fe700 1 --2- 172.21.15.57:0/696398120 >> v2:172.21.15.87:3300/0 conn(0x7fa8180afbb0 0x7fa818142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:38.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa817fff700 1 --2- 172.21.15.57:0/696398120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8180b11f0 0x7fa8180b0950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa808002f70 tx=0x7fa808006df0).ready entity=mon.0 client_cookie=faee6e400b5a7207 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:38.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa8177fe700 1 -- 172.21.15.57:0/696398120 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80800d5c0 con 0x7fa8180b11f0 2021-06-25T04:47:38.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa8177fe700 1 -- 172.21.15.57:0/696398120 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa808000e90 con 0x7fa8180b11f0 2021-06-25T04:47:38.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa8177fe700 1 -- 172.21.15.57:0/696398120 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80800d910 con 0x7fa8180b11f0 2021-06-25T04:47:38.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa81d077700 1 -- 172.21.15.57:0/696398120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8180b11f0 msgr2=0x7fa8180b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:38.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.827+0000 7fa81d077700 1 --2- 172.21.15.57:0/696398120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8180b11f0 0x7fa8180b0950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa808002f70 tx=0x7fa808006df0).stop 2021-06-25T04:47:38.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 -- 172.21.15.57:0/696398120 shutdown_connections 2021-06-25T04:47:38.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 --2- 172.21.15.57:0/696398120 >> v2:172.21.15.87:3300/0 conn(0x7fa8180afbb0 0x7fa818142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:38.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 --2- 172.21.15.57:0/696398120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8180b11f0 0x7fa8180b0950 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:38.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 -- 172.21.15.57:0/696398120 >> 172.21.15.57:0/696398120 conn(0x7fa818062520 msgr2=0x7fa818062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:38.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 -- 172.21.15.57:0/696398120 shutdown_connections 2021-06-25T04:47:38.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 -- 172.21.15.57:0/696398120 wait complete. 2021-06-25T04:47:38.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 Processor -- start 2021-06-25T04:47:38.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 -- start start 2021-06-25T04:47:38.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8180afbb0 0x7fa818146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:38.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8180b11f0 0x7fa8180b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:38.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa818142c30 0x7fa818155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:38.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8181522f0 con 0x7fa8180afbb0 2021-06-25T04:47:38.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81809f480 con 0x7fa8180b11f0 2021-06-25T04:47:38.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81809f720 con 0x7fa818142c30 2021-06-25T04:47:38.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa817fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8180afbb0 0x7fa818146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:38.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa817fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8180afbb0 0x7fa818146570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35058/0 (socket says 172.21.15.57:35058) 2021-06-25T04:47:38.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa817fff700 1 -- 172.21.15.57:0/1654418996 learned_addr learned my addr 172.21.15.57:0/1654418996 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:38.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa80f7fe700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8180b11f0 0x7fa8180b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:38.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81c876700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa818142c30 0x7fa818155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa817fff700 1 -- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa818142c30 msgr2=0x7fa818155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa817fff700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa818142c30 0x7fa818155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa817fff700 1 -- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8180b11f0 msgr2=0x7fa8180b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:38.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa817fff700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8180b11f0 0x7fa8180b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:38.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa817fff700 1 -- 172.21.15.57:0/1654418996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80800b180 con 0x7fa8180afbb0 2021-06-25T04:47:38.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa80f7fe700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8180b11f0 0x7fa8180b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:38.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa817fff700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8180afbb0 0x7fa818146570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa808002f70 tx=0x7fa808014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:38.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa815ffb700 1 -- 172.21.15.57:0/1654418996 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80801f440 con 0x7fa8180afbb0 2021-06-25T04:47:38.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa815ffb700 1 -- 172.21.15.57:0/1654418996 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80801f5a0 con 0x7fa8180afbb0 2021-06-25T04:47:38.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 -- 172.21.15.57:0/1654418996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81809f9c0 con 0x7fa8180afbb0 2021-06-25T04:47:38.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa815ffb700 1 -- 172.21.15.57:0/1654418996 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80801f900 con 0x7fa8180afbb0 2021-06-25T04:47:38.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.831+0000 7fa81d077700 1 -- 172.21.15.57:0/1654418996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81809ff00 con 0x7fa8180afbb0 2021-06-25T04:47:38.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.835+0000 7fa81d077700 1 -- 172.21.15.57:0/1654418996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8181557d0 con 0x7fa8180afbb0 2021-06-25T04:47:38.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.835+0000 7fa815ffb700 1 -- 172.21.15.57:0/1654418996 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa808025020 con 0x7fa8180afbb0 2021-06-25T04:47:38.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.835+0000 7fa815ffb700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7fc0553d0 0x7fa7fc057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:38.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.835+0000 7fa815ffb700 1 -- 172.21.15.57:0/1654418996 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6315+0+0 (secure 0 0 0) 0x7fa80806eff0 con 0x7fa8180afbb0 2021-06-25T04:47:38.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.835+0000 7fa80f7fe700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7fc0553d0 0x7fa7fc057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:38.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.839+0000 7fa80f7fe700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7fc0553d0 0x7fa7fc057890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fa80000c000 tx=0x7fa800008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:38.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.843+0000 7fa815ffb700 1 -- 172.21.15.57:0/1654418996 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa808045160 con 0x7fa8180afbb0 2021-06-25T04:47:38.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:38.971+0000 7fa81d077700 1 -- 172.21.15.57:0/1654418996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa818057310 con 0x7fa8180afbb0 2021-06-25T04:47:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.703+0000 7fa815ffb700 1 -- 172.21.15.57:0/1654418996 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 166+0+0 (secure 0 0 0) 0x7fa808006980 con 0x7fa8180afbb0 2021-06-25T04:47:39.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 -- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7fc0553d0 msgr2=0x7fa7fc057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:39.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7fc0553d0 0x7fa7fc057890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fa80000c000 tx=0x7fa800008040).stop 2021-06-25T04:47:39.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 -- 172.21.15.57:0/1654418996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8180afbb0 msgr2=0x7fa818146570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:39.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8180afbb0 0x7fa818146570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa808002f70 tx=0x7fa808014000).stop 2021-06-25T04:47:39.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 -- 172.21.15.57:0/1654418996 shutdown_connections 2021-06-25T04:47:39.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7fc0553d0 0x7fa7fc057890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:39.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa818142c30 0x7fa818155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:39.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8180b11f0 0x7fa8180b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:39.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 --2- 172.21.15.57:0/1654418996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8180afbb0 0x7fa818146570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:39.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 -- 172.21.15.57:0/1654418996 >> 172.21.15.57:0/1654418996 conn(0x7fa818062520 msgr2=0x7fa8180b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:39.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 -- 172.21.15.57:0/1654418996 shutdown_connections 2021-06-25T04:47:39.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.711+0000 7fa81d077700 1 -- 172.21.15.57:0/1654418996 wait complete. 2021-06-25T04:47:39.723 INFO:teuthology.orchestra.run.smithi057.stderr:set pool 4 allow_ec_overwrites to true 2021-06-25T04:47:39.732 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:47:39.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.835+0000 7f353759e700 1 Processor -- start 2021-06-25T04:47:39.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.835+0000 7f353759e700 1 -- start start 2021-06-25T04:47:39.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3538061640 0x7f35380b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:39.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380b68d0 con 0x7f3538143960 2021-06-25T04:47:39.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353759e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380b6b70 con 0x7f35380b46d0 2021-06-25T04:47:39.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35380b9640 con 0x7f3538061640 2021-06-25T04:47:39.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3538061640 0x7f35380b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:39.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f3536d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3538143960 0x7f353814d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52288/0 (socket says 172.21.15.57:52288) 2021-06-25T04:47:39.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f3536d9d700 1 -- 172.21.15.57:0/3391407837 learned_addr learned my addr 172.21.15.57:0/3391407837 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:39.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353659c700 1 -- 172.21.15.57:0/3391407837 >> v1:172.21.15.87:6789/0 conn(0x7f35380b46d0 legacy=0x7f353813fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:39.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353659c700 1 -- 172.21.15.57:0/3391407837 >> v1:172.21.15.57:6789/0 conn(0x7f3538143960 legacy=0x7f353814d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:39.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353659c700 1 -- 172.21.15.57:0/3391407837 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380b6e10 con 0x7f3538061640 2021-06-25T04:47:39.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353559a700 1 -- 172.21.15.57:0/3391407837 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359150471 0 0) 0x7f35380b68d0 con 0x7f3538143960 2021-06-25T04:47:39.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353659c700 1 --2- 172.21.15.57:0/3391407837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3538061640 0x7f35380b9cd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3528002f70 tx=0x7f3528006df0).ready entity=mon.0 client_cookie=74c63eb433663db4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:39.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353559a700 1 -- 172.21.15.57:0/3391407837 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f352800d610 con 0x7f3538061640 2021-06-25T04:47:39.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353559a700 1 -- 172.21.15.57:0/3391407837 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3528000e90 con 0x7f3538061640 2021-06-25T04:47:39.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353759e700 1 -- 172.21.15.57:0/3391407837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3538061640 msgr2=0x7f35380b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:39.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353559a700 1 -- 172.21.15.57:0/3391407837 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f352800d960 con 0x7f3538061640 2021-06-25T04:47:39.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353759e700 1 --2- 172.21.15.57:0/3391407837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3538061640 0x7f35380b9cd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3528002f70 tx=0x7f3528006df0).stop 2021-06-25T04:47:39.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353759e700 1 -- 172.21.15.57:0/3391407837 shutdown_connections 2021-06-25T04:47:39.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353759e700 1 --2- 172.21.15.57:0/3391407837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3538061640 0x7f35380b9cd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:39.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353759e700 1 -- 172.21.15.57:0/3391407837 >> 172.21.15.57:0/3391407837 conn(0x7f353806adb0 msgr2=0x7f353805f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:39.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353759e700 1 -- 172.21.15.57:0/3391407837 shutdown_connections 2021-06-25T04:47:39.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.839+0000 7f353759e700 1 -- 172.21.15.57:0/3391407837 wait complete. 2021-06-25T04:47:39.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f353759e700 1 Processor -- start 2021-06-25T04:47:39.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f353759e700 1 -- start start 2021-06-25T04:47:39.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f353759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3538061640 0x7f35381488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:39.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f353759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3538143960 0x7f35381556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:39.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f353759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353813b9a0 0x7f3538155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:39.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f353759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538152d60 con 0x7f353813b9a0 2021-06-25T04:47:39.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f353759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538153000 con 0x7f3538061640 2021-06-25T04:47:39.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f353759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35380b7390 con 0x7f3538143960 2021-06-25T04:47:39.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f3536d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353813b9a0 0x7f3538155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:39.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f353659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3538061640 0x7f35381488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:39.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f3536d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353813b9a0 0x7f3538155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35076/0 (socket says 172.21.15.57:35076) 2021-06-25T04:47:39.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f3536d9d700 1 -- 172.21.15.57:0/2227082059 learned_addr learned my addr 172.21.15.57:0/2227082059 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:39.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f3535d9b700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3538143960 0x7f35381556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:39.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f3536d9d700 1 -- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3538143960 msgr2=0x7f35381556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:39.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f3536d9d700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3538143960 0x7f35381556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:39.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f3536d9d700 1 -- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3538061640 msgr2=0x7f35381488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:39.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f3536d9d700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3538061640 0x7f35381488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:39.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f3536d9d700 1 -- 172.21.15.57:0/2227082059 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352800b180 con 0x7f353813b9a0 2021-06-25T04:47:39.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f3535d9b700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3538143960 0x7f35381556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:39.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.843+0000 7f3536d9d700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353813b9a0 0x7f3538155bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3530001250 tx=0x7f3530001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:39.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.847+0000 7f35277fe700 1 -- 172.21.15.57:0/2227082059 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3530005c70 con 0x7f353813b9a0 2021-06-25T04:47:39.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.847+0000 7f35277fe700 1 -- 172.21.15.57:0/2227082059 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3530005dd0 con 0x7f353813b9a0 2021-06-25T04:47:39.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.847+0000 7f35277fe700 1 -- 172.21.15.57:0/2227082059 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3530004a90 con 0x7f353813b9a0 2021-06-25T04:47:39.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.847+0000 7f353759e700 1 -- 172.21.15.57:0/2227082059 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35380b9200 con 0x7f353813b9a0 2021-06-25T04:47:39.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.847+0000 7f353759e700 1 -- 172.21.15.57:0/2227082059 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35380b7ce0 con 0x7f353813b9a0 2021-06-25T04:47:39.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.847+0000 7f353759e700 1 -- 172.21.15.57:0/2227082059 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35380b7550 con 0x7f353813b9a0 2021-06-25T04:47:39.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.847+0000 7f35277fe700 1 -- 172.21.15.57:0/2227082059 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3530004bf0 con 0x7f353813b9a0 2021-06-25T04:47:39.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.847+0000 7f35277fe700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35140553d0 0x7f3514057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:39.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.847+0000 7f35277fe700 1 -- 172.21.15.57:0/2227082059 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6315+0+0 (secure 0 0 0) 0x7f353006db10 con 0x7f353813b9a0 2021-06-25T04:47:39.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.847+0000 7f353659c700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35140553d0 0x7f3514057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:39.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.851+0000 7f353659c700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35140553d0 0x7f3514057890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f352801b000 tx=0x7f3528015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:39.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:39.855+0000 7f35277fe700 1 -- 172.21.15.57:0/2227082059 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3530043d30 con 0x7f353813b9a0 2021-06-25T04:47:40.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.015+0000 7f353759e700 1 -- 172.21.15.57:0/2227082059 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f3538057310 con 0x7f353813b9a0 2021-06-25T04:47:40.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.023+0000 7f35277fe700 1 -- 172.21.15.57:0/2227082059 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v5) v1 ==== 187+0+0 (secure 0 0 0) 0x7f3530047350 con 0x7f353813b9a0 2021-06-25T04:47:40.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.023+0000 7f353759e700 1 -- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35140553d0 msgr2=0x7f3514057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.023+0000 7f353759e700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35140553d0 0x7f3514057890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f352801b000 tx=0x7f3528015000).stop 2021-06-25T04:47:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.023+0000 7f353759e700 1 -- 172.21.15.57:0/2227082059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353813b9a0 msgr2=0x7f3538155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.023+0000 7f353759e700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353813b9a0 0x7f3538155bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f3530001250 tx=0x7f3530001360).stop 2021-06-25T04:47:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.023+0000 7f353759e700 1 -- 172.21.15.57:0/2227082059 shutdown_connections 2021-06-25T04:47:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.023+0000 7f353759e700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35140553d0 0x7f3514057890 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.023+0000 7f353759e700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353813b9a0 0x7f3538155bc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.023+0000 7f353759e700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3538143960 0x7f35381556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.023+0000 7f353759e700 1 --2- 172.21.15.57:0/2227082059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3538061640 0x7f35381488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.023+0000 7f353759e700 1 -- 172.21.15.57:0/2227082059 >> 172.21.15.57:0/2227082059 conn(0x7f353806adb0 msgr2=0x7f3538142580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:40.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.027+0000 7f353759e700 1 -- 172.21.15.57:0/2227082059 shutdown_connections 2021-06-25T04:47:40.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.027+0000 7f353759e700 1 -- 172.21.15.57:0/2227082059 wait complete. 2021-06-25T04:47:40.036 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 3 and data pool 4 2021-06-25T04:47:40.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:40.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13d18e700 1 Processor -- start 2021-06-25T04:47:40.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13d18e700 1 -- start start 2021-06-25T04:47:40.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13d18e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1380b2620 0x7fc13805f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13d18e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc138096c80 0x7fc1380970c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13d18e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1380b2a00 con 0x7fc13813f520 2021-06-25T04:47:40.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13d18e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1380975b0 con 0x7fc1380b2620 2021-06-25T04:47:40.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13d18e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc138097b40 con 0x7fc138096c80 2021-06-25T04:47:40.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13659c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc138096c80 0x7fc1380970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc136d9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1380b2620 0x7fc13805f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13659c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc138096c80 0x7fc1380970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:46256/0 (socket says 172.21.15.57:46256) 2021-06-25T04:47:40.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13659c700 1 -- 172.21.15.57:0/3029884034 learned_addr learned my addr 172.21.15.57:0/3029884034 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:40.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc136d9d700 1 -- 172.21.15.57:0/3029884034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc138096c80 msgr2=0x7fc1380970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:40.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc136d9d700 1 --2- 172.21.15.57:0/3029884034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc138096c80 0x7fc1380970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc136d9d700 1 -- 172.21.15.57:0/3029884034 >> v1:172.21.15.87:6789/0 conn(0x7fc13813f520 legacy=0x7fc13813f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc136d9d700 1 -- 172.21.15.57:0/3029884034 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc138097de0 con 0x7fc1380b2620 2021-06-25T04:47:40.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc136d9d700 1 --2- 172.21.15.57:0/3029884034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1380b2620 0x7fc13805f670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc120002f70 tx=0x7fc120006df0).ready entity=mon.1 client_cookie=e0924469434d39d7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:40.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc135d9b700 1 -- 172.21.15.57:0/3029884034 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12000d570 con 0x7fc1380b2620 2021-06-25T04:47:40.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc135d9b700 1 -- 172.21.15.57:0/3029884034 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc120000e90 con 0x7fc1380b2620 2021-06-25T04:47:40.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc135d9b700 1 -- 172.21.15.57:0/3029884034 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12000d8c0 con 0x7fc1380b2620 2021-06-25T04:47:40.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13d18e700 1 -- 172.21.15.57:0/3029884034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1380b2620 msgr2=0x7fc13805f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.131+0000 7fc13d18e700 1 --2- 172.21.15.57:0/3029884034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1380b2620 0x7fc13805f670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc120002f70 tx=0x7fc120006df0).stop 2021-06-25T04:47:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 -- 172.21.15.57:0/3029884034 shutdown_connections 2021-06-25T04:47:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 --2- 172.21.15.57:0/3029884034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc138096c80 0x7fc1380970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 --2- 172.21.15.57:0/3029884034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1380b2620 0x7fc13805f670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 -- 172.21.15.57:0/3029884034 >> 172.21.15.57:0/3029884034 conn(0x7fc138062ed0 msgr2=0x7fc1380632b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 -- 172.21.15.57:0/3029884034 shutdown_connections 2021-06-25T04:47:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 -- 172.21.15.57:0/3029884034 wait complete. 2021-06-25T04:47:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 Processor -- start 2021-06-25T04:47:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 -- start start 2021-06-25T04:47:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138096c80 0x7fc1380af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1380b2620 0x7fc1380af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc13813f520 0x7fc1380abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc138066d40 con 0x7fc138096c80 2021-06-25T04:47:40.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc138066af0 con 0x7fc1380b2620 2021-06-25T04:47:40.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.135+0000 7fc13d18e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380ab450 con 0x7fc13813f520 2021-06-25T04:47:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc136d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138096c80 0x7fc1380af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc136d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138096c80 0x7fc1380af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35096/0 (socket says 172.21.15.57:35096) 2021-06-25T04:47:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc136d9d700 1 -- 172.21.15.57:0/312988507 learned_addr learned my addr 172.21.15.57:0/312988507 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc13759e700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc13813f520 0x7fc1380abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc13659c700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1380b2620 0x7fc1380af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc136d9d700 1 -- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc13813f520 msgr2=0x7fc1380abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc136d9d700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc13813f520 0x7fc1380abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc136d9d700 1 -- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1380b2620 msgr2=0x7fc1380af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc136d9d700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1380b2620 0x7fc1380af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc136d9d700 1 -- 172.21.15.57:0/312988507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12000b180 con 0x7fc138096c80 2021-06-25T04:47:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc136d9d700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138096c80 0x7fc1380af200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc120002f70 tx=0x7fc120014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc12ffff700 1 -- 172.21.15.57:0/312988507 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1200129b0 con 0x7fc138096c80 2021-06-25T04:47:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc12ffff700 1 -- 172.21.15.57:0/312988507 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc120000e90 con 0x7fc138096c80 2021-06-25T04:47:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc13d18e700 1 -- 172.21.15.57:0/312988507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc138066820 con 0x7fc138096c80 2021-06-25T04:47:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc12ffff700 1 -- 172.21.15.57:0/312988507 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc120012d00 con 0x7fc138096c80 2021-06-25T04:47:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc13d18e700 1 -- 172.21.15.57:0/312988507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1380ab0e0 con 0x7fc138096c80 2021-06-25T04:47:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc13d18e700 1 -- 172.21.15.57:0/312988507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc138057310 con 0x7fc138096c80 2021-06-25T04:47:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.139+0000 7fc12ffff700 1 -- 172.21.15.57:0/312988507 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc120024020 con 0x7fc138096c80 2021-06-25T04:47:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.143+0000 7fc12ffff700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc11c055450 0x7fc11c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.143+0000 7fc12ffff700 1 -- 172.21.15.57:0/312988507 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc12006eeb0 con 0x7fc138096c80 2021-06-25T04:47:40.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.143+0000 7fc13659c700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc11c055450 0x7fc11c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.143+0000 7fc13659c700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc11c055450 0x7fc11c057910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc13000b000 tx=0x7fc130009290).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.147+0000 7fc12ffff700 1 -- 172.21.15.57:0/312988507 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc120045060 con 0x7fc138096c80 2021-06-25T04:47:40.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.275+0000 7fc13d18e700 1 -- 172.21.15.57:0/312988507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc138057310 con 0x7fc138096c80 2021-06-25T04:47:40.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.275+0000 7fc12ffff700 1 -- 172.21.15.57:0/312988507 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16312 (secure 0 0 0) 0x7fc120048680 con 0x7fc138096c80 2021-06-25T04:47:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:40.285 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:40.019385+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:40.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 -- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc11c055450 msgr2=0x7fc11c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc11c055450 0x7fc11c057910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc13000b000 tx=0x7fc130009290).stop 2021-06-25T04:47:40.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 -- 172.21.15.57:0/312988507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138096c80 msgr2=0x7fc1380af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138096c80 0x7fc1380af200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fc120002f70 tx=0x7fc120014000).stop 2021-06-25T04:47:40.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 -- 172.21.15.57:0/312988507 shutdown_connections 2021-06-25T04:47:40.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc11c055450 0x7fc11c057910 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc13813f520 0x7fc1380abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1380b2620 0x7fc1380af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 --2- 172.21.15.57:0/312988507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc138096c80 0x7fc1380af200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 -- 172.21.15.57:0/312988507 >> 172.21.15.57:0/312988507 conn(0x7fc138062ed0 msgr2=0x7fc13805bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:40.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 -- 172.21.15.57:0/312988507 shutdown_connections 2021-06-25T04:47:40.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.279+0000 7fc13d18e700 1 -- 172.21.15.57:0/312988507 wait complete. 2021-06-25T04:47:40.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:40.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3f59e700 1 Processor -- start 2021-06-25T04:47:40.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3f59e700 1 -- start start 2021-06-25T04:47:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d400b0440 0x7f3d400aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3f59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3d40146e90 0x7f3d4013ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3f59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d400affc0 con 0x7f3d400aea70 2021-06-25T04:47:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3f59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d400adf00 con 0x7f3d40146e90 2021-06-25T04:47:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400ad060 con 0x7f3d400b0440 2021-06-25T04:47:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3ed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3d40146e90 0x7f3d4013ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3e59c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3d400aea70 0x7f3d40146780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:53070/0 (socket says 172.21.15.57:53070) 2021-06-25T04:47:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3e59c700 1 -- 172.21.15.57:0/2556962123 learned_addr learned my addr 172.21.15.57:0/2556962123 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3dd9b700 1 --2- 172.21.15.57:0/2556962123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d400b0440 0x7f3d400aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3ed9d700 1 -- 172.21.15.57:0/2556962123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d400b0440 msgr2=0x7f3d400aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3ed9d700 1 --2- 172.21.15.57:0/2556962123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d400b0440 0x7f3d400aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3d59a700 1 -- 172.21.15.57:0/2556962123 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003036496 0 0) 0x7f3d400affc0 con 0x7f3d400aea70 2021-06-25T04:47:40.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3ed9d700 1 -- 172.21.15.57:0/2556962123 >> v1:172.21.15.87:6789/0 conn(0x7f3d400aea70 legacy=0x7f3d40146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3ed9d700 1 -- 172.21.15.57:0/2556962123 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40147300 con 0x7f3d40146e90 2021-06-25T04:47:40.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.395+0000 7f3d3ed9d700 1 --2- 172.21.15.57:0/2556962123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d40146e90 0x7f3d4013ff40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3d380032f0 tx=0x7f3d380091d0).ready entity=mon.0 client_cookie=aea816c50040244a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:40.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3d59a700 1 -- 172.21.15.57:0/2556962123 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3800b6c0 con 0x7f3d40146e90 2021-06-25T04:47:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3d59a700 1 -- 172.21.15.57:0/2556962123 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3800b820 con 0x7f3d40146e90 2021-06-25T04:47:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3d59a700 1 -- 172.21.15.57:0/2556962123 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3800b990 con 0x7f3d40146e90 2021-06-25T04:47:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3f59e700 1 -- 172.21.15.57:0/2556962123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d40146e90 msgr2=0x7f3d4013ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3f59e700 1 --2- 172.21.15.57:0/2556962123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d40146e90 0x7f3d4013ff40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3d380032f0 tx=0x7f3d380091d0).stop 2021-06-25T04:47:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3f59e700 1 -- 172.21.15.57:0/2556962123 shutdown_connections 2021-06-25T04:47:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3f59e700 1 --2- 172.21.15.57:0/2556962123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d40146e90 0x7f3d4013ff40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3f59e700 1 --2- 172.21.15.57:0/2556962123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d400b0440 0x7f3d400aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3f59e700 1 -- 172.21.15.57:0/2556962123 >> 172.21.15.57:0/2556962123 conn(0x7f3d400611f0 msgr2=0x7f3d40062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3f59e700 1 -- 172.21.15.57:0/2556962123 shutdown_connections 2021-06-25T04:47:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3f59e700 1 -- 172.21.15.57:0/2556962123 wait complete. 2021-06-25T04:47:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3f59e700 1 Processor -- start 2021-06-25T04:47:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.399+0000 7f3d3f59e700 1 -- start start 2021-06-25T04:47:40.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d400aea70 0x7f3d40146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d400b0440 0x7f3d40152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40146e90 0x7f3d40152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3f59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4014a650 con 0x7f3d400b0440 2021-06-25T04:47:40.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40149fc0 con 0x7f3d40146e90 2021-06-25T04:47:40.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40155950 con 0x7f3d400aea70 2021-06-25T04:47:40.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d400b0440 0x7f3d40152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d400b0440 0x7f3d40152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35112/0 (socket says 172.21.15.57:35112) 2021-06-25T04:47:40.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3dd9b700 1 -- 172.21.15.57:0/800433224 learned_addr learned my addr 172.21.15.57:0/800433224 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:40.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3ed9d700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40146e90 0x7f3d40152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3e59c700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d400aea70 0x7f3d40146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3dd9b700 1 -- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d400aea70 msgr2=0x7f3d40146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3dd9b700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d400aea70 0x7f3d40146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3dd9b700 1 -- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40146e90 msgr2=0x7f3d40152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3dd9b700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40146e90 0x7f3d40152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3dd9b700 1 -- 172.21.15.57:0/800433224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d38009470 con 0x7f3d400b0440 2021-06-25T04:47:40.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3ed9d700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40146e90 0x7f3d40152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:40.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3dd9b700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d400b0440 0x7f3d40152380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f3d40155ae0 tx=0x7f3d34006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:40.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d2f7fe700 1 -- 172.21.15.57:0/800433224 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d34010780 con 0x7f3d400b0440 2021-06-25T04:47:40.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d2f7fe700 1 -- 172.21.15.57:0/800433224 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3400b3b0 con 0x7f3d400b0440 2021-06-25T04:47:40.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d2f7fe700 1 -- 172.21.15.57:0/800433224 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d34010ad0 con 0x7f3d400b0440 2021-06-25T04:47:40.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3f59e700 1 -- 172.21.15.57:0/800433224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d40149d20 con 0x7f3d400b0440 2021-06-25T04:47:40.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3f59e700 1 -- 172.21.15.57:0/800433224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d40148d80 con 0x7f3d400b0440 2021-06-25T04:47:40.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d3f59e700 1 -- 172.21.15.57:0/800433224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d40057310 con 0x7f3d400b0440 2021-06-25T04:47:40.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d2f7fe700 1 -- 172.21.15.57:0/800433224 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3d34010c30 con 0x7f3d400b0440 2021-06-25T04:47:40.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.403+0000 7f3d2f7fe700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d1c0553d0 0x7f3d1c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.407+0000 7f3d2f7fe700 1 -- 172.21.15.57:0/800433224 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3d3406e380 con 0x7f3d400b0440 2021-06-25T04:47:40.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.407+0000 7f3d3e59c700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d1c0553d0 0x7f3d1c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.407+0000 7f3d3e59c700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d1c0553d0 0x7f3d1c057890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3d3000d000 tx=0x7f3d30007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:40.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.411+0000 7f3d2f7fe700 1 -- 172.21.15.57:0/800433224 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3d34044430 con 0x7f3d400b0440 2021-06-25T04:47:40.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.539+0000 7f3d3f59e700 1 -- 172.21.15.57:0/800433224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d4005f200 con 0x7f3d400b0440 2021-06-25T04:47:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.539+0000 7f3d2f7fe700 1 -- 172.21.15.57:0/800433224 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16312 (secure 0 0 0) 0x7f3d34047a50 con 0x7f3d400b0440 2021-06-25T04:47:40.548 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:40.548 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:40.019385+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:40.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 -- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d1c0553d0 msgr2=0x7f3d1c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d1c0553d0 0x7f3d1c057890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3d3000d000 tx=0x7f3d30007a00).stop 2021-06-25T04:47:40.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 -- 172.21.15.57:0/800433224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d400b0440 msgr2=0x7f3d40152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d400b0440 0x7f3d40152380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f3d40155ae0 tx=0x7f3d34006df0).stop 2021-06-25T04:47:40.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 -- 172.21.15.57:0/800433224 shutdown_connections 2021-06-25T04:47:40.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d1c0553d0 0x7f3d1c057890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40146e90 0x7f3d40152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d400b0440 0x7f3d40152380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 --2- 172.21.15.57:0/800433224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d400aea70 0x7f3d40146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 -- 172.21.15.57:0/800433224 >> 172.21.15.57:0/800433224 conn(0x7f3d400611f0 msgr2=0x7f3d400b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 -- 172.21.15.57:0/800433224 shutdown_connections 2021-06-25T04:47:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.543+0000 7f3d3f59e700 1 -- 172.21.15.57:0/800433224 wait complete. 2021-06-25T04:47:40.562 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:47:40.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.659+0000 7f91faa5d700 1 Processor -- start 2021-06-25T04:47:40.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.659+0000 7f91faa5d700 1 -- start start 2021-06-25T04:47:40.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91f40b4140 0x7f91f4140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91f40b4650 0x7f91f40b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f4143b20 con 0x7f91f4146910 2021-06-25T04:47:40.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f41474d0 con 0x7f91f40b4140 2021-06-25T04:47:40.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f4143dc0 con 0x7f91f40b4650 2021-06-25T04:47:40.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f37fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91f40b4140 0x7f91f4140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f8ffa700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91f40b4650 0x7f91f40b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f37fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91f40b4140 0x7f91f4140900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:43614/0 (socket says 172.21.15.57:43614) 2021-06-25T04:47:40.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f37fe700 1 -- 172.21.15.57:0/1368509754 learned_addr learned my addr 172.21.15.57:0/1368509754 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:40.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f3fff700 1 --1- 172.21.15.57:0/1368509754 >> v1:172.21.15.87:6789/0 conn(0x7f91f4146910 0x7f91f41401f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:53084/0 (socket says 172.21.15.57:53084) 2021-06-25T04:47:40.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f37fe700 1 -- 172.21.15.57:0/1368509754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91f40b4650 msgr2=0x7f91f40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:40.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f37fe700 1 --2- 172.21.15.57:0/1368509754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91f40b4650 0x7f91f40b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f37fe700 1 -- 172.21.15.57:0/1368509754 >> v1:172.21.15.87:6789/0 conn(0x7f91f4146910 legacy=0x7f91f41401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f37fe700 1 -- 172.21.15.57:0/1368509754 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f40b0c50 con 0x7f91f40b4140 2021-06-25T04:47:40.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f37fe700 1 --2- 172.21.15.57:0/1368509754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91f40b4140 0x7f91f4140900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f91dc002f70 tx=0x7f91dc006eb0).ready entity=mon.1 client_cookie=cbfc57eb17f20ca8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:40.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f2ffd700 1 -- 172.21.15.57:0/1368509754 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91dc00d570 con 0x7f91f40b4140 2021-06-25T04:47:40.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f2ffd700 1 -- 172.21.15.57:0/1368509754 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc000e90 con 0x7f91f40b4140 2021-06-25T04:47:40.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91f2ffd700 1 -- 172.21.15.57:0/1368509754 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91dc00d900 con 0x7f91f40b4140 2021-06-25T04:47:40.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 -- 172.21.15.57:0/1368509754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91f40b4140 msgr2=0x7f91f4140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 --2- 172.21.15.57:0/1368509754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91f40b4140 0x7f91f4140900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f91dc002f70 tx=0x7f91dc006eb0).stop 2021-06-25T04:47:40.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 -- 172.21.15.57:0/1368509754 shutdown_connections 2021-06-25T04:47:40.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 --2- 172.21.15.57:0/1368509754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91f40b4650 0x7f91f40b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 --2- 172.21.15.57:0/1368509754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91f40b4140 0x7f91f4140900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 -- 172.21.15.57:0/1368509754 >> 172.21.15.57:0/1368509754 conn(0x7f91f405c450 msgr2=0x7f91f405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:40.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 -- 172.21.15.57:0/1368509754 shutdown_connections 2021-06-25T04:47:40.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.663+0000 7f91faa5d700 1 -- 172.21.15.57:0/1368509754 wait complete. 2021-06-25T04:47:40.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91faa5d700 1 Processor -- start 2021-06-25T04:47:40.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91faa5d700 1 -- start start 2021-06-25T04:47:40.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91faa5d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91f40b4140 0x7f91f40b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91faa5d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91f40b4650 0x7f91f413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91faa5d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91f4146910 0x7f91f413b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91faa5d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f4152c40 con 0x7f91f4146910 2021-06-25T04:47:40.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91faa5d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40b06a0 con 0x7f91f40b4650 2021-06-25T04:47:40.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91faa5d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f4152eb0 con 0x7f91f40b4140 2021-06-25T04:47:40.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f8ffa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91f4146910 0x7f91f413b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f8ffa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91f4146910 0x7f91f413b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35128/0 (socket says 172.21.15.57:35128) 2021-06-25T04:47:40.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f8ffa700 1 -- 172.21.15.57:0/2238026804 learned_addr learned my addr 172.21.15.57:0/2238026804 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:40.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f3fff700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91f40b4140 0x7f91f40b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f37fe700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91f40b4650 0x7f91f413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f8ffa700 1 -- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91f40b4140 msgr2=0x7f91f40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f8ffa700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91f40b4140 0x7f91f40b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f8ffa700 1 -- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91f40b4650 msgr2=0x7f91f413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:40.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f8ffa700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91f40b4650 0x7f91f413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:40.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f8ffa700 1 -- 172.21.15.57:0/2238026804 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc00b1e0 con 0x7f91f4146910 2021-06-25T04:47:40.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f37fe700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91f40b4650 0x7f91f413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:40.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f3fff700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91f40b4140 0x7f91f40b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:40.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f8ffa700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91f4146910 0x7f91f413b100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f91ec006e00 tx=0x7f91ec0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:40.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f17fa700 1 -- 172.21.15.57:0/2238026804 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91ec00c640 con 0x7f91f4146910 2021-06-25T04:47:40.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f17fa700 1 -- 172.21.15.57:0/2238026804 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec00c7a0 con 0x7f91f4146910 2021-06-25T04:47:40.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91faa5d700 1 -- 172.21.15.57:0/2238026804 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f4153150 con 0x7f91f4146910 2021-06-25T04:47:40.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91f17fa700 1 -- 172.21.15.57:0/2238026804 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91ec00cb00 con 0x7f91f4146910 2021-06-25T04:47:40.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.667+0000 7f91faa5d700 1 -- 172.21.15.57:0/2238026804 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f40b0200 con 0x7f91f4146910 2021-06-25T04:47:40.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.671+0000 7f91faa5d700 1 -- 172.21.15.57:0/2238026804 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f4057310 con 0x7f91f4146910 2021-06-25T04:47:40.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.671+0000 7f91f17fa700 1 -- 172.21.15.57:0/2238026804 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f91ec00cc60 con 0x7f91f4146910 2021-06-25T04:47:40.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.671+0000 7f91f17fa700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91d8055450 0x7f91d8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:40.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.671+0000 7f91f17fa700 1 -- 172.21.15.57:0/2238026804 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f91ec06e140 con 0x7f91f4146910 2021-06-25T04:47:40.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.671+0000 7f91f3fff700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91d8055450 0x7f91d8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:40.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.675+0000 7f91f3fff700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91d8055450 0x7f91d8057910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f91e400d000 tx=0x7f91e4007b80).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:40.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.679+0000 7f91f17fa700 1 -- 172.21.15.57:0/2238026804 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f91ec0442f0 con 0x7f91f4146910 2021-06-25T04:47:40.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:40.847+0000 7f91faa5d700 1 -- 172.21.15.57:0/2238026804 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f91f40698a0 con 0x7f91f4146910 2021-06-25T04:47:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.759+0000 7f91f17fa700 1 -- 172.21.15.57:0/2238026804 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f91ec06ae60 con 0x7f91f4146910 2021-06-25T04:47:41.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 -- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91d8055450 msgr2=0x7f91d8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:41.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91d8055450 0x7f91d8057910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f91e400d000 tx=0x7f91e4007b80).stop 2021-06-25T04:47:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 -- 172.21.15.57:0/2238026804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91f4146910 msgr2=0x7f91f413b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91f4146910 0x7f91f413b100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f91ec006e00 tx=0x7f91ec0091d0).stop 2021-06-25T04:47:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 -- 172.21.15.57:0/2238026804 shutdown_connections 2021-06-25T04:47:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91d8055450 0x7f91d8057910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91f4146910 0x7f91f413b100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:41.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91f40b4650 0x7f91f413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:41.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 --2- 172.21.15.57:0/2238026804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91f40b4140 0x7f91f40b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:41.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 -- 172.21.15.57:0/2238026804 >> 172.21.15.57:0/2238026804 conn(0x7f91f405c450 msgr2=0x7f91f413f340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:41.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 -- 172.21.15.57:0/2238026804 shutdown_connections 2021-06-25T04:47:41.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.763+0000 7f91faa5d700 1 -- 172.21.15.57:0/2238026804 wait complete. 2021-06-25T04:47:41.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:47:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.883+0000 7f7cf3ee7700 1 Processor -- start 2021-06-25T04:47:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.883+0000 7f7cf3ee7700 1 -- start start 2021-06-25T04:47:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf3ee7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7cec0670e0 0x7f7cec0b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf3ee7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cec0b9b90 con 0x7f7cec143970 2021-06-25T04:47:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf3ee7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cec0674c0 con 0x7f7cec13ffb0 2021-06-25T04:47:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf3ee7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cec143040 con 0x7f7cec0670e0 2021-06-25T04:47:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf1c83700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7cec0670e0 0x7f7cec0b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf1482700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7cec143970 0x7f7cec0aebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52350/0 (socket says 172.21.15.57:52350) 2021-06-25T04:47:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf1482700 1 -- 172.21.15.57:0/4281802755 learned_addr learned my addr 172.21.15.57:0/4281802755 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:41.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf0c81700 1 -- 172.21.15.57:0/4281802755 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383236713 0 0) 0x7f7cdc001110 con 0x7f7cec143970 2021-06-25T04:47:41.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf0c81700 1 -- 172.21.15.57:0/4281802755 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd4003260 con 0x7f7cec143970 2021-06-25T04:47:41.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf1c83700 1 -- 172.21.15.57:0/4281802755 >> v1:172.21.15.87:6789/0 conn(0x7f7cec13ffb0 legacy=0x7f7cec140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:41.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf0c81700 1 -- 172.21.15.57:0/4281802755 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14544541 0 0) 0x7f7cec0674c0 con 0x7f7cec13ffb0 2021-06-25T04:47:41.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf1c83700 1 -- 172.21.15.57:0/4281802755 >> v1:172.21.15.57:6789/0 conn(0x7f7cec143970 legacy=0x7f7cec0aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:41.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf1c83700 1 -- 172.21.15.57:0/4281802755 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec0af490 con 0x7f7cec0670e0 2021-06-25T04:47:41.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf1c83700 1 --2- 172.21.15.57:0/4281802755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cec0670e0 0x7f7cec0b96a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7ce8002f70 tx=0x7f7ce8006df0).ready entity=mon.0 client_cookie=d7fd1fa67660c7ab server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:41.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf0c81700 1 -- 172.21.15.57:0/4281802755 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ce800d610 con 0x7f7cec0670e0 2021-06-25T04:47:41.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf0c81700 1 -- 172.21.15.57:0/4281802755 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce8000e90 con 0x7f7cec0670e0 2021-06-25T04:47:41.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf0c81700 1 -- 172.21.15.57:0/4281802755 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ce800d960 con 0x7f7cec0670e0 2021-06-25T04:47:41.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4281802755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cec0670e0 msgr2=0x7f7cec0b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:41.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf3ee7700 1 --2- 172.21.15.57:0/4281802755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cec0670e0 0x7f7cec0b96a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7ce8002f70 tx=0x7f7ce8006df0).stop 2021-06-25T04:47:41.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4281802755 shutdown_connections 2021-06-25T04:47:41.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf3ee7700 1 --2- 172.21.15.57:0/4281802755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cec0670e0 0x7f7cec0b96a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:41.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4281802755 >> 172.21.15.57:0/4281802755 conn(0x7f7cec05f9b0 msgr2=0x7f7cec061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:41.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4281802755 shutdown_connections 2021-06-25T04:47:41.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.887+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4281802755 wait complete. 2021-06-25T04:47:41.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf3ee7700 1 Processor -- start 2021-06-25T04:47:41.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf3ee7700 1 -- start start 2021-06-25T04:47:41.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf3ee7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cec0670e0 0x7f7cec155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:41.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf3ee7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cec13ffb0 0x7f7cec145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:41.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf3ee7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cec143970 0x7f7cec0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:41.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf3ee7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0b4010 con 0x7f7cec0670e0 2021-06-25T04:47:41.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf3ee7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0b94e0 con 0x7f7cec13ffb0 2021-06-25T04:47:41.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf3ee7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0b14d0 con 0x7f7cec143970 2021-06-25T04:47:41.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf1c83700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cec0670e0 0x7f7cec155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:41.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf1c83700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cec0670e0 0x7f7cec155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35138/0 (socket says 172.21.15.57:35138) 2021-06-25T04:47:41.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf1c83700 1 -- 172.21.15.57:0/4151678793 learned_addr learned my addr 172.21.15.57:0/4151678793 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:41.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf1482700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cec13ffb0 0x7f7cec145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:41.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf2484700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cec143970 0x7f7cec0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:41.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf1c83700 1 -- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cec143970 msgr2=0x7f7cec0b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:41.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf1c83700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cec143970 0x7f7cec0b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:41.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf1c83700 1 -- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cec13ffb0 msgr2=0x7f7cec145440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:41.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf1c83700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cec13ffb0 0x7f7cec145440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:41.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf1c83700 1 -- 172.21.15.57:0/4151678793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce800b180 con 0x7f7cec0670e0 2021-06-25T04:47:41.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf1c83700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cec0670e0 0x7f7cec155680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f7cec0b4150 tx=0x7f7ce8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:41.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cdaffd700 1 -- 172.21.15.57:0/4151678793 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ce8006b20 con 0x7f7cec0670e0 2021-06-25T04:47:41.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cdaffd700 1 -- 172.21.15.57:0/4151678793 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce8000e90 con 0x7f7cec0670e0 2021-06-25T04:47:41.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4151678793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cec0b8e40 con 0x7f7cec0670e0 2021-06-25T04:47:41.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cdaffd700 1 -- 172.21.15.57:0/4151678793 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ce800d290 con 0x7f7cec0670e0 2021-06-25T04:47:41.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.891+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4151678793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cec145f20 con 0x7f7cec0670e0 2021-06-25T04:47:41.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.895+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4151678793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cec0b12a0 con 0x7f7cec0670e0 2021-06-25T04:47:41.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.895+0000 7f7cdaffd700 1 -- 172.21.15.57:0/4151678793 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7ce8024020 con 0x7f7cec0670e0 2021-06-25T04:47:41.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.895+0000 7f7cdaffd700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ccc055340 0x7f7ccc057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:41.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.895+0000 7f7cdaffd700 1 -- 172.21.15.57:0/4151678793 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7ce806eba0 con 0x7f7cec0670e0 2021-06-25T04:47:41.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.895+0000 7f7cf1482700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ccc055340 0x7f7ccc057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:41.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.895+0000 7f7cf1482700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ccc055340 0x7f7ccc057800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7cdc00d000 tx=0x7f7cdc000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:41.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:41.903+0000 7f7cdaffd700 1 -- 172.21.15.57:0/4151678793 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7ce8044bc0 con 0x7f7cec0670e0 2021-06-25T04:47:42.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.067+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4151678793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cec057310 con 0x7f7cec0670e0 2021-06-25T04:47:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.067+0000 7f7cdaffd700 1 -- 172.21.15.57:0/4151678793 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f7ce806e020 con 0x7f7cec0670e0 2021-06-25T04:47:42.078 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:42.078 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/1675349577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1675349577},{"type":"v1","addr":"172.21.15.87:6835","nonce":1675349577}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/4129321821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4129321821},{"type":"v1","addr":"172.21.15.57:6833","nonce":4129321821}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:47:40.019558+0000","modified":"2021-06-25T04:47:41.749060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1050167707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1050167707},{"type":"v1","addr":"172.21.15.57:6835","nonce":1050167707}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-06-25T04:47:42.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.071+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ccc055340 msgr2=0x7f7ccc057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.071+0000 7f7cf3ee7700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ccc055340 0x7f7ccc057800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7cdc00d000 tx=0x7f7cdc000bc0).stop 2021-06-25T04:47:42.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.071+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4151678793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cec0670e0 msgr2=0x7f7cec155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.071+0000 7f7cf3ee7700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cec0670e0 0x7f7cec155680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f7cec0b4150 tx=0x7f7ce8014000).stop 2021-06-25T04:47:42.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.071+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4151678793 shutdown_connections 2021-06-25T04:47:42.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.071+0000 7f7cf3ee7700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ccc055340 0x7f7ccc057800 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.071+0000 7f7cf3ee7700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cec143970 0x7f7cec0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.071+0000 7f7cf3ee7700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cec13ffb0 0x7f7cec145440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.071+0000 7f7cf3ee7700 1 --2- 172.21.15.57:0/4151678793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cec0670e0 0x7f7cec155680 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.071+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4151678793 >> 172.21.15.57:0/4151678793 conn(0x7f7cec05f9b0 msgr2=0x7f7cec0b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:42.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.071+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4151678793 shutdown_connections 2021-06-25T04:47:42.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.075+0000 7f7cf3ee7700 1 -- 172.21.15.57:0/4151678793 wait complete. 2021-06-25T04:47:42.088 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2021-06-25T04:47:42.099 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:42.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.191+0000 7f00b1f65700 1 Processor -- start 2021-06-25T04:47:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.191+0000 7f00b1f65700 1 -- start start 2021-06-25T04:47:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f00ac0aad40 0x7f00ac0672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 0x7f00ac0647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f00ac064cb0 0x7f00ac0b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00ac065920 con 0x7f00ac0aad40 2021-06-25T04:47:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00ac0b3ca0 con 0x7f00ac064cb0 2021-06-25T04:47:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac066e20 con 0x7f00ac0ab120 2021-06-25T04:47:42.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b0f63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f00ac0aad40 0x7f00ac0672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00abfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 0x7f00ac0647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00abfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 0x7f00ac0647c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:46310/0 (socket says 172.21.15.57:46310) 2021-06-25T04:47:42.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00abfff700 1 -- 172.21.15.57:0/3984412045 learned_addr learned my addr 172.21.15.57:0/3984412045 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:42.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1764700 1 --2- 172.21.15.57:0/3984412045 >> v2:172.21.15.87:3300/0 conn(0x7f00ac064cb0 0x7f00ac0b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b0f63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f00ac0aad40 0x7f00ac0672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35148/0 (socket says 172.21.15.57:35148) 2021-06-25T04:47:42.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00abfff700 1 -- 172.21.15.57:0/3984412045 >> v2:172.21.15.87:3300/0 conn(0x7f00ac064cb0 msgr2=0x7f00ac0b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:42.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00abfff700 1 --2- 172.21.15.57:0/3984412045 >> v2:172.21.15.87:3300/0 conn(0x7f00ac064cb0 0x7f00ac0b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00abfff700 1 -- 172.21.15.57:0/3984412045 >> v2:172.21.15.57:3300/0 conn(0x7f00ac0aad40 msgr2=0x7f00ac0672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:42.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00abfff700 1 --2- 172.21.15.57:0/3984412045 >> v2:172.21.15.57:3300/0 conn(0x7f00ac0aad40 0x7f00ac0672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00abfff700 1 -- 172.21.15.57:0/3984412045 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac0655a0 con 0x7f00ac0ab120 2021-06-25T04:47:42.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00abfff700 1 --2- 172.21.15.57:0/3984412045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 0x7f00ac0647c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f00a0002f70 tx=0x7f00a0006e50).ready entity=mon.2 client_cookie=87f1070ea24accad server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:42.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00ab7fe700 1 -- 172.21.15.57:0/3984412045 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00a000d570 con 0x7f00ac0ab120 2021-06-25T04:47:42.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00ab7fe700 1 -- 172.21.15.57:0/3984412045 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a0000e90 con 0x7f00ac0ab120 2021-06-25T04:47:42.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00ab7fe700 1 -- 172.21.15.57:0/3984412045 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00a000d900 con 0x7f00ac0ab120 2021-06-25T04:47:42.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 -- 172.21.15.57:0/3984412045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 msgr2=0x7f00ac0647c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 --2- 172.21.15.57:0/3984412045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 0x7f00ac0647c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f00a0002f70 tx=0x7f00a0006e50).stop 2021-06-25T04:47:42.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 -- 172.21.15.57:0/3984412045 shutdown_connections 2021-06-25T04:47:42.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 --2- 172.21.15.57:0/3984412045 >> v2:172.21.15.87:3300/0 conn(0x7f00ac064cb0 0x7f00ac0b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 --2- 172.21.15.57:0/3984412045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 0x7f00ac0647c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 --2- 172.21.15.57:0/3984412045 >> v2:172.21.15.57:3300/0 conn(0x7f00ac0aad40 0x7f00ac0672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 -- 172.21.15.57:0/3984412045 >> 172.21.15.57:0/3984412045 conn(0x7f00ac062ba0 msgr2=0x7f00ac05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:42.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 -- 172.21.15.57:0/3984412045 shutdown_connections 2021-06-25T04:47:42.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.195+0000 7f00b1f65700 1 -- 172.21.15.57:0/3984412045 wait complete. 2021-06-25T04:47:42.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1f65700 1 Processor -- start 2021-06-25T04:47:42.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1f65700 1 -- start start 2021-06-25T04:47:42.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1f65700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00ac0aad40 0x7f00ac13fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1f65700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 0x7f00ac0ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1f65700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac0b15b0 0x7f00ac0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1f65700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac145000 con 0x7f00ac0b15b0 2021-06-25T04:47:42.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1f65700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac0b0e00 con 0x7f00ac0aad40 2021-06-25T04:47:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1f65700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac0b08c0 con 0x7f00ac0ab120 2021-06-25T04:47:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1764700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac0b15b0 0x7f00ac0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1764700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac0b15b0 0x7f00ac0aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35156/0 (socket says 172.21.15.57:35156) 2021-06-25T04:47:42.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1764700 1 -- 172.21.15.57:0/3292553771 learned_addr learned my addr 172.21.15.57:0/3292553771 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:42.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b0f63700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00ac0aad40 0x7f00ac13fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00abfff700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 0x7f00ac0ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1764700 1 -- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 msgr2=0x7f00ac0ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1764700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 0x7f00ac0ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1764700 1 -- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00ac0aad40 msgr2=0x7f00ac13fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1764700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00ac0aad40 0x7f00ac13fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b1764700 1 -- 172.21.15.57:0/3292553771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a000b1e0 con 0x7f00ac0b15b0 2021-06-25T04:47:42.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00abfff700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 0x7f00ac0ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.199+0000 7f00b0f63700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00ac0aad40 0x7f00ac13fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00b1764700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac0b15b0 0x7f00ac0aeed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f00a400c000 tx=0x7f00a40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00a9ffb700 1 -- 172.21.15.57:0/3292553771 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00a400c850 con 0x7f00ac0b15b0 2021-06-25T04:47:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00a9ffb700 1 -- 172.21.15.57:0/3292553771 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a400c9b0 con 0x7f00ac0b15b0 2021-06-25T04:47:42.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00a9ffb700 1 -- 172.21.15.57:0/3292553771 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00a400cd10 con 0x7f00ac0b15b0 2021-06-25T04:47:42.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00b1f65700 1 -- 172.21.15.57:0/3292553771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ac0b0b60 con 0x7f00ac0b15b0 2021-06-25T04:47:42.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00b1f65700 1 -- 172.21.15.57:0/3292553771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ac0b5e00 con 0x7f00ac0b15b0 2021-06-25T04:47:42.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00b1f65700 1 -- 172.21.15.57:0/3292553771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ac057310 con 0x7f00ac0b15b0 2021-06-25T04:47:42.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00a9ffb700 1 -- 172.21.15.57:0/3292553771 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f00a4022070 con 0x7f00ac0b15b0 2021-06-25T04:47:42.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00a9ffb700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f008c0554e0 0x7f008c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00a9ffb700 1 -- 172.21.15.57:0/3292553771 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f00a406e620 con 0x7f00ac0b15b0 2021-06-25T04:47:42.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00b0f63700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f008c0554e0 0x7f008c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.203+0000 7f00b0f63700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f008c0554e0 0x7f008c0579a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f009c00f000 tx=0x7f009c00f040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.215+0000 7f00a9ffb700 1 -- 172.21.15.57:0/3292553771 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f00a40447d0 con 0x7f00ac0b15b0 2021-06-25T04:47:42.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.343+0000 7f00b1f65700 1 -- 172.21.15.57:0/3292553771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00ac05d990 con 0x7f00ac0b15b0 2021-06-25T04:47:42.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00a9ffb700 1 -- 172.21.15.57:0/3292553771 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f00a4016020 con 0x7f00ac0b15b0 2021-06-25T04:47:42.354 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:42.354 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:41.021834+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:42.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 -- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f008c0554e0 msgr2=0x7f008c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f008c0554e0 0x7f008c0579a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f009c00f000 tx=0x7f009c00f040).stop 2021-06-25T04:47:42.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 -- 172.21.15.57:0/3292553771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac0b15b0 msgr2=0x7f00ac0aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac0b15b0 0x7f00ac0aeed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f00a400c000 tx=0x7f00a40091d0).stop 2021-06-25T04:47:42.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 -- 172.21.15.57:0/3292553771 shutdown_connections 2021-06-25T04:47:42.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f008c0554e0 0x7f008c0579a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac0b15b0 0x7f00ac0aeed0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00ac0ab120 0x7f00ac0ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 --2- 172.21.15.57:0/3292553771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00ac0aad40 0x7f00ac13fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 -- 172.21.15.57:0/3292553771 >> 172.21.15.57:0/3292553771 conn(0x7f00ac062ba0 msgr2=0x7f00ac05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:42.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 -- 172.21.15.57:0/3292553771 shutdown_connections 2021-06-25T04:47:42.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.347+0000 7f00b1f65700 1 -- 172.21.15.57:0/3292553771 wait complete. 2021-06-25T04:47:42.367 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:42.369 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-06-25T04:47:42.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5e49a700 1 Processor -- start 2021-06-25T04:47:42.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5e49a700 1 -- start start 2021-06-25T04:47:42.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5e49a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e580a7670 0x7f8e58066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5e49a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8e580b1930 0x7f8e58066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5e49a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e580b0020 0x7f8e5805f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5e49a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e58067410 con 0x7f8e580b0020 2021-06-25T04:47:42.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5e49a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e580a7a50 con 0x7f8e580b1930 2021-06-25T04:47:42.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5e49a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e581475e0 con 0x7f8e580a7670 2021-06-25T04:47:42.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5ca37700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e580b0020 0x7f8e5805f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5ca37700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e580b0020 0x7f8e5805f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35164/0 (socket says 172.21.15.57:35164) 2021-06-25T04:47:42.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5ca37700 1 -- 172.21.15.57:0/391949767 learned_addr learned my addr 172.21.15.57:0/391949767 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:42.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e57fff700 1 --2- 172.21.15.57:0/391949767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e580a7670 0x7f8e58066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e577fe700 1 --2- 172.21.15.57:0/391949767 >> v2:172.21.15.87:3300/0 conn(0x7f8e580b1930 0x7f8e58066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5ca37700 1 -- 172.21.15.57:0/391949767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e580a7670 msgr2=0x7f8e58066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:42.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5ca37700 1 --2- 172.21.15.57:0/391949767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e580a7670 0x7f8e58066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5ca37700 1 -- 172.21.15.57:0/391949767 >> v2:172.21.15.87:3300/0 conn(0x7f8e580b1930 msgr2=0x7f8e58066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:42.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5ca37700 1 --2- 172.21.15.57:0/391949767 >> v2:172.21.15.87:3300/0 conn(0x7f8e580b1930 0x7f8e58066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5ca37700 1 -- 172.21.15.57:0/391949767 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58147880 con 0x7f8e580b0020 2021-06-25T04:47:42.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.459+0000 7f8e5ca37700 1 --2- 172.21.15.57:0/391949767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e580b0020 0x7f8e5805f670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8e50002f70 tx=0x7f8e50006eb0).ready entity=mon.0 client_cookie=74ee8fa6607979d1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:42.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e56ffd700 1 -- 172.21.15.57:0/391949767 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e5000d570 con 0x7f8e580b0020 2021-06-25T04:47:42.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e56ffd700 1 -- 172.21.15.57:0/391949767 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e50000e90 con 0x7f8e580b0020 2021-06-25T04:47:42.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e56ffd700 1 -- 172.21.15.57:0/391949767 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e5000d900 con 0x7f8e580b0020 2021-06-25T04:47:42.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e5e49a700 1 -- 172.21.15.57:0/391949767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e580b0020 msgr2=0x7f8e5805f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e5e49a700 1 --2- 172.21.15.57:0/391949767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e580b0020 0x7f8e5805f670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8e50002f70 tx=0x7f8e50006eb0).stop 2021-06-25T04:47:42.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e5e49a700 1 -- 172.21.15.57:0/391949767 shutdown_connections 2021-06-25T04:47:42.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e5e49a700 1 --2- 172.21.15.57:0/391949767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e580b0020 0x7f8e5805f670 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e5e49a700 1 --2- 172.21.15.57:0/391949767 >> v2:172.21.15.87:3300/0 conn(0x7f8e580b1930 0x7f8e58066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e5e49a700 1 --2- 172.21.15.57:0/391949767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e580a7670 0x7f8e58066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e5e49a700 1 -- 172.21.15.57:0/391949767 >> 172.21.15.57:0/391949767 conn(0x7f8e580b53a0 msgr2=0x7f8e580b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:42.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e5e49a700 1 -- 172.21.15.57:0/391949767 shutdown_connections 2021-06-25T04:47:42.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.463+0000 7f8e5e49a700 1 -- 172.21.15.57:0/391949767 wait complete. 2021-06-25T04:47:42.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e5e49a700 1 Processor -- start 2021-06-25T04:47:42.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e5e49a700 1 -- start start 2021-06-25T04:47:42.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e5e49a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e580a7670 0x7f8e580b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e5e49a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e580b0020 0x7f8e58159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e5e49a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e580b1930 0x7f8e5815a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e5e49a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580aa730 con 0x7f8e580a7670 2021-06-25T04:47:42.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e5e49a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580abe10 con 0x7f8e580b0020 2021-06-25T04:47:42.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e5e49a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580b4d90 con 0x7f8e580b1930 2021-06-25T04:47:42.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e57fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e580a7670 0x7f8e580b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e57fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e580a7670 0x7f8e580b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35166/0 (socket says 172.21.15.57:35166) 2021-06-25T04:47:42.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e57fff700 1 -- 172.21.15.57:0/858625578 learned_addr learned my addr 172.21.15.57:0/858625578 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:42.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e5ca37700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e580b1930 0x7f8e5815a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e577fe700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e580b0020 0x7f8e58159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e57fff700 1 -- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e580b1930 msgr2=0x7f8e5815a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e57fff700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e580b1930 0x7f8e5815a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e57fff700 1 -- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e580b0020 msgr2=0x7f8e58159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e57fff700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e580b0020 0x7f8e58159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e57fff700 1 -- 172.21.15.57:0/858625578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5000b1e0 con 0x7f8e580a7670 2021-06-25T04:47:42.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e577fe700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e580b0020 0x7f8e58159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:47:42.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e57fff700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e580a7670 0x7f8e580b4460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8e4000c000 tx=0x7f8e40006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:42.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e557fa700 1 -- 172.21.15.57:0/858625578 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e40010780 con 0x7f8e580a7670 2021-06-25T04:47:42.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e557fa700 1 -- 172.21.15.57:0/858625578 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e400108e0 con 0x7f8e580a7670 2021-06-25T04:47:42.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e5e49a700 1 -- 172.21.15.57:0/858625578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e580aabc0 con 0x7f8e580a7670 2021-06-25T04:47:42.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e557fa700 1 -- 172.21.15.57:0/858625578 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e40010c40 con 0x7f8e580a7670 2021-06-25T04:47:42.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.467+0000 7f8e5e49a700 1 -- 172.21.15.57:0/858625578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e580ab8a0 con 0x7f8e580a7670 2021-06-25T04:47:42.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.471+0000 7f8e5e49a700 1 -- 172.21.15.57:0/858625578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e580abc50 con 0x7f8e580a7670 2021-06-25T04:47:42.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.471+0000 7f8e557fa700 1 -- 172.21.15.57:0/858625578 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8e4001c460 con 0x7f8e580a7670 2021-06-25T04:47:42.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.471+0000 7f8e557fa700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e3c055450 0x7f8e3c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.471+0000 7f8e557fa700 1 -- 172.21.15.57:0/858625578 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8e4006e4d0 con 0x7f8e580a7670 2021-06-25T04:47:42.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.471+0000 7f8e577fe700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e3c055450 0x7f8e3c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.471+0000 7f8e577fe700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e3c055450 0x7f8e3c057910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8e4800b000 tx=0x7f8e48008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:42.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.479+0000 7f8e557fa700 1 -- 172.21.15.57:0/858625578 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8e40044490 con 0x7f8e580a7670 2021-06-25T04:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.607+0000 7f8e5e49a700 1 -- 172.21.15.57:0/858625578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e58057310 con 0x7f8e580a7670 2021-06-25T04:47:42.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e557fa700 1 -- 172.21.15.57:0/858625578 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f8e40047ab0 con 0x7f8e580a7670 2021-06-25T04:47:42.618 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:42.619 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:41.021834+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 -- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e3c055450 msgr2=0x7f8e3c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e3c055450 0x7f8e3c057910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8e4800b000 tx=0x7f8e48008040).stop 2021-06-25T04:47:42.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 -- 172.21.15.57:0/858625578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e580a7670 msgr2=0x7f8e580b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e580a7670 0x7f8e580b4460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8e4000c000 tx=0x7f8e40006df0).stop 2021-06-25T04:47:42.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 -- 172.21.15.57:0/858625578 shutdown_connections 2021-06-25T04:47:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e3c055450 0x7f8e3c057910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e580b1930 0x7f8e5815a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e580b0020 0x7f8e58159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 --2- 172.21.15.57:0/858625578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e580a7670 0x7f8e580b4460 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 -- 172.21.15.57:0/858625578 >> 172.21.15.57:0/858625578 conn(0x7f8e580b53a0 msgr2=0x7f8e5805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:42.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 -- 172.21.15.57:0/858625578 shutdown_connections 2021-06-25T04:47:42.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.611+0000 7f8e5e49a700 1 -- 172.21.15.57:0/858625578 wait complete. 2021-06-25T04:47:42.632 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:47:34.957337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:47:37.729999+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:47:42.632 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:47:42.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.735+0000 7fddbf0e7700 1 Processor -- start 2021-06-25T04:47:42.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 -- start start 2021-06-25T04:47:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddb80b0570 0x7fddb80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fddb80b36d0 0x7fddb813d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb81438e0 con 0x7fddb813da00 2021-06-25T04:47:42.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb8143b80 con 0x7fddb80b36d0 2021-06-25T04:47:42.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8143e20 con 0x7fddb80b0570 2021-06-25T04:47:42.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbd684700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fddb813da00 0x7fddb80b1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52394/0 (socket says 172.21.15.57:52394) 2021-06-25T04:47:42.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbd684700 1 -- 172.21.15.57:0/1323913416 learned_addr learned my addr 172.21.15.57:0/1323913416 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:42.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaffff700 1 --2- 172.21.15.57:0/1323913416 >> v2:172.21.15.87:3300/0 conn(0x7fddb80b36d0 0x7fddb813d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbce83700 1 --2- 172.21.15.57:0/1323913416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddb80b0570 0x7fddb80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaf7fe700 1 -- 172.21.15.57:0/1323913416 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742133988 0 0) 0x7fddb81438e0 con 0x7fddb813da00 2021-06-25T04:47:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaf7fe700 1 -- 172.21.15.57:0/1323913416 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdda4003260 con 0x7fddb813da00 2021-06-25T04:47:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaffff700 1 -- 172.21.15.57:0/1323913416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddb80b0570 msgr2=0x7fddb80b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaffff700 1 --2- 172.21.15.57:0/1323913416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddb80b0570 0x7fddb80b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaffff700 1 -- 172.21.15.57:0/1323913416 >> v1:172.21.15.57:6789/0 conn(0x7fddb813da00 legacy=0x7fddb80b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaf7fe700 1 -- 172.21.15.57:0/1323913416 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 123199713 0 0) 0x7fdda4003260 con 0x7fddb813da00 2021-06-25T04:47:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaffff700 1 -- 172.21.15.57:0/1323913416 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb81440c0 con 0x7fddb80b36d0 2021-06-25T04:47:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaffff700 1 --2- 172.21.15.57:0/1323913416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb80b36d0 0x7fddb813d510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fddb0001b80 tx=0x7fdda8006df0).ready entity=mon.1 client_cookie=6c984188cd8d8297 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaf7fe700 1 -- 172.21.15.57:0/1323913416 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddb00019e0 con 0x7fddb80b36d0 2021-06-25T04:47:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaf7fe700 1 -- 172.21.15.57:0/1323913416 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda8000e90 con 0x7fddb80b36d0 2021-06-25T04:47:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddaf7fe700 1 -- 172.21.15.57:0/1323913416 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda8012460 con 0x7fddb80b36d0 2021-06-25T04:47:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 -- 172.21.15.57:0/1323913416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb80b36d0 msgr2=0x7fddb813d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 --2- 172.21.15.57:0/1323913416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb80b36d0 0x7fddb813d510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fddb0001b80 tx=0x7fdda8006df0).stop 2021-06-25T04:47:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 -- 172.21.15.57:0/1323913416 shutdown_connections 2021-06-25T04:47:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 --2- 172.21.15.57:0/1323913416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb80b36d0 0x7fddb813d510 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 --2- 172.21.15.57:0/1323913416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddb80b0570 0x7fddb80b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 -- 172.21.15.57:0/1323913416 >> 172.21.15.57:0/1323913416 conn(0x7fddb8060780 msgr2=0x7fddb8060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 -- 172.21.15.57:0/1323913416 shutdown_connections 2021-06-25T04:47:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.739+0000 7fddbf0e7700 1 -- 172.21.15.57:0/1323913416 wait complete. 2021-06-25T04:47:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddbf0e7700 1 Processor -- start 2021-06-25T04:47:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddbf0e7700 1 -- start start 2021-06-25T04:47:42.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddbf0e7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb80b0570 0x7fddb81401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddbf0e7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddb80b36d0 0x7fddb8064ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddbf0e7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddb813da00 0x7fddb8064fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddbf0e7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80654a0 con 0x7fddb80b36d0 2021-06-25T04:47:42.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddbf0e7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80639a0 con 0x7fddb80b0570 2021-06-25T04:47:42.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddbf0e7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8064810 con 0x7fddb813da00 2021-06-25T04:47:42.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddaffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddb80b36d0 0x7fddb8064ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddaffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddb80b36d0 0x7fddb8064ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35182/0 (socket says 172.21.15.57:35182) 2021-06-25T04:47:42.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddaffff700 1 -- 172.21.15.57:0/4053494749 learned_addr learned my addr 172.21.15.57:0/4053494749 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:42.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddbd684700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddb813da00 0x7fddb8064fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddbce83700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb80b0570 0x7fddb81401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddaffff700 1 -- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddb813da00 msgr2=0x7fddb8064fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddaffff700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddb813da00 0x7fddb8064fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddaffff700 1 -- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb80b0570 msgr2=0x7fddb81401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddaffff700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb80b0570 0x7fddb81401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddaffff700 1 -- 172.21.15.57:0/4053494749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda800b180 con 0x7fddb80b36d0 2021-06-25T04:47:42.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddbd684700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddb813da00 0x7fddb8064fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:42.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddaffff700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddb80b36d0 0x7fddb8064ac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fddb81466e0 tx=0x7fdda8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:42.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.743+0000 7fddadffb700 1 -- 172.21.15.57:0/4053494749 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda8006b20 con 0x7fddb80b36d0 2021-06-25T04:47:42.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.747+0000 7fddadffb700 1 -- 172.21.15.57:0/4053494749 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda800de20 con 0x7fddb80b36d0 2021-06-25T04:47:42.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.747+0000 7fddbf0e7700 1 -- 172.21.15.57:0/4053494749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80aa4e0 con 0x7fddb80b36d0 2021-06-25T04:47:42.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.747+0000 7fddadffb700 1 -- 172.21.15.57:0/4053494749 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda801f630 con 0x7fddb80b36d0 2021-06-25T04:47:42.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.747+0000 7fddbf0e7700 1 -- 172.21.15.57:0/4053494749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb8064570 con 0x7fddb80b36d0 2021-06-25T04:47:42.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.747+0000 7fddbf0e7700 1 -- 172.21.15.57:0/4053494749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb8063b60 con 0x7fddb80b36d0 2021-06-25T04:47:42.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.747+0000 7fddadffb700 1 -- 172.21.15.57:0/4053494749 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdda8025020 con 0x7fddb80b36d0 2021-06-25T04:47:42.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.747+0000 7fddadffb700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd980553f0 0x7fdd980578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:42.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.747+0000 7fddadffb700 1 -- 172.21.15.57:0/4053494749 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdda806ee50 con 0x7fddb80b36d0 2021-06-25T04:47:42.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.747+0000 7fddbce83700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd980553f0 0x7fdd980578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.751+0000 7fddbce83700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd980553f0 0x7fdd980578b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fddb400b000 tx=0x7fddb4008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.755+0000 7fddadffb700 1 -- 172.21.15.57:0/4053494749 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fddb8063b60 con 0x7fddb80b36d0 2021-06-25T04:47:42.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.887+0000 7fddbf0e7700 1 -- 172.21.15.57:0/4053494749 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fddb8063b60 con 0x7fddb80b36d0 2021-06-25T04:47:42.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.887+0000 7fddadffb700 1 -- 172.21.15.57:0/4053494749 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fddb8063b60 con 0x7fddb80b36d0 2021-06-25T04:47:42.896 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:47:42.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 -- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd980553f0 msgr2=0x7fdd980578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd980553f0 0x7fdd980578b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fddb400b000 tx=0x7fddb4008040).stop 2021-06-25T04:47:42.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 -- 172.21.15.57:0/4053494749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddb80b36d0 msgr2=0x7fddb8064ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:42.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddb80b36d0 0x7fddb8064ac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fddb81466e0 tx=0x7fdda8014000).stop 2021-06-25T04:47:42.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 -- 172.21.15.57:0/4053494749 shutdown_connections 2021-06-25T04:47:42.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd980553f0 0x7fdd980578b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddb813da00 0x7fddb8064fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddb80b36d0 0x7fddb8064ac0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 --2- 172.21.15.57:0/4053494749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb80b0570 0x7fddb81401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:42.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 -- 172.21.15.57:0/4053494749 >> 172.21.15.57:0/4053494749 conn(0x7fddb8060780 msgr2=0x7fddb80ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:42.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 -- 172.21.15.57:0/4053494749 shutdown_connections 2021-06-25T04:47:42.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:42.891+0000 7fddbf0e7700 1 -- 172.21.15.57:0/4053494749 wait complete. 2021-06-25T04:47:42.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:47:43.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.007+0000 7fd782124700 1 Processor -- start 2021-06-25T04:47:43.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.007+0000 7fd782124700 1 -- start start 2021-06-25T04:47:43.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.007+0000 7fd782124700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd77c0b3510 0x7fd77c0670d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.007+0000 7fd782124700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd77c144ca0 0x7fd77c1410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.007+0000 7fd782124700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77c0664c0 con 0x7fd77c064940 2021-06-25T04:47:43.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.007+0000 7fd782124700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77c0b3e60 con 0x7fd77c144ca0 2021-06-25T04:47:43.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.007+0000 7fd782124700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77c140d00 con 0x7fd77c0b3510 2021-06-25T04:47:43.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd781923700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd77c144ca0 0x7fd77c1410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.007+0000 7fd781122700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd77c064940 0x7fd77c0669c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52406/0 (socket says 172.21.15.57:52406) 2021-06-25T04:47:43.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd781122700 1 -- 172.21.15.57:0/2583833555 learned_addr learned my addr 172.21.15.57:0/2583833555 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:43.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd780921700 1 --2- 172.21.15.57:0/2583833555 >> v2:172.21.15.87:3300/0 conn(0x7fd77c0b3510 0x7fd77c0670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd781923700 1 -- 172.21.15.57:0/2583833555 >> v2:172.21.15.87:3300/0 conn(0x7fd77c0b3510 msgr2=0x7fd77c0670d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:43.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd781923700 1 --2- 172.21.15.57:0/2583833555 >> v2:172.21.15.87:3300/0 conn(0x7fd77c0b3510 0x7fd77c0670d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd781923700 1 -- 172.21.15.57:0/2583833555 >> v1:172.21.15.57:6789/0 conn(0x7fd77c064940 legacy=0x7fd77c0669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd773fff700 1 -- 172.21.15.57:0/2583833555 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743945359 0 0) 0x7fd77c0664c0 con 0x7fd77c064940 2021-06-25T04:47:43.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd781923700 1 -- 172.21.15.57:0/2583833555 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c0b4680 con 0x7fd77c144ca0 2021-06-25T04:47:43.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd781923700 1 --2- 172.21.15.57:0/2583833555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd77c144ca0 0x7fd77c1410f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd7740032f0 tx=0x7fd7740091d0).ready entity=mon.0 client_cookie=16831bad190fdfc0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd773fff700 1 -- 172.21.15.57:0/2583833555 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77400b680 con 0x7fd77c144ca0 2021-06-25T04:47:43.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd773fff700 1 -- 172.21.15.57:0/2583833555 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77400b7e0 con 0x7fd77c144ca0 2021-06-25T04:47:43.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd773fff700 1 -- 172.21.15.57:0/2583833555 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77400b950 con 0x7fd77c144ca0 2021-06-25T04:47:43.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd782124700 1 -- 172.21.15.57:0/2583833555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd77c144ca0 msgr2=0x7fd77c1410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd782124700 1 --2- 172.21.15.57:0/2583833555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd77c144ca0 0x7fd77c1410f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd7740032f0 tx=0x7fd7740091d0).stop 2021-06-25T04:47:43.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd782124700 1 -- 172.21.15.57:0/2583833555 shutdown_connections 2021-06-25T04:47:43.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd782124700 1 --2- 172.21.15.57:0/2583833555 >> v2:172.21.15.87:3300/0 conn(0x7fd77c0b3510 0x7fd77c0670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd782124700 1 --2- 172.21.15.57:0/2583833555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd77c144ca0 0x7fd77c1410f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd782124700 1 -- 172.21.15.57:0/2583833555 >> 172.21.15.57:0/2583833555 conn(0x7fd77c05f670 msgr2=0x7fd77c05fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd782124700 1 -- 172.21.15.57:0/2583833555 shutdown_connections 2021-06-25T04:47:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd782124700 1 -- 172.21.15.57:0/2583833555 wait complete. 2021-06-25T04:47:43.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd782124700 1 Processor -- start 2021-06-25T04:47:43.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.011+0000 7fd782124700 1 -- start start 2021-06-25T04:47:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd782124700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd77c064940 0x7fd77c13cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd782124700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd77c0b3510 0x7fd77c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd782124700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd77c144ca0 0x7fd77c1476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd782124700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c13b830 con 0x7fd77c064940 2021-06-25T04:47:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd782124700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c0b7910 con 0x7fd77c144ca0 2021-06-25T04:47:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd782124700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c0b5670 con 0x7fd77c0b3510 2021-06-25T04:47:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd781122700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd77c064940 0x7fd77c13cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd781122700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd77c064940 0x7fd77c13cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35196/0 (socket says 172.21.15.57:35196) 2021-06-25T04:47:43.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd781122700 1 -- 172.21.15.57:0/2819436571 learned_addr learned my addr 172.21.15.57:0/2819436571 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:43.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd780921700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd77c0b3510 0x7fd77c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd781923700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd77c144ca0 0x7fd77c1476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd781122700 1 -- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd77c0b3510 msgr2=0x7fd77c0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd781122700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd77c0b3510 0x7fd77c0b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd781122700 1 -- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd77c144ca0 msgr2=0x7fd77c1476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd781122700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd77c144ca0 0x7fd77c1476c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd781122700 1 -- 172.21.15.57:0/2819436571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd774009470 con 0x7fd77c064940 2021-06-25T04:47:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd781122700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd77c064940 0x7fd77c13cd30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd76c000ed0 tx=0x7fd76c007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd7727fc700 1 -- 172.21.15.57:0/2819436571 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd76c0070d0 con 0x7fd77c064940 2021-06-25T04:47:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd7727fc700 1 -- 172.21.15.57:0/2819436571 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c007230 con 0x7fd77c064940 2021-06-25T04:47:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd782124700 1 -- 172.21.15.57:0/2819436571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77c13ca60 con 0x7fd77c064940 2021-06-25T04:47:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd7727fc700 1 -- 172.21.15.57:0/2819436571 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd76c005610 con 0x7fd77c064940 2021-06-25T04:47:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd782124700 1 -- 172.21.15.57:0/2819436571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c0b6ac0 con 0x7fd77c064940 2021-06-25T04:47:43.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.015+0000 7fd782124700 1 -- 172.21.15.57:0/2819436571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c0b5870 con 0x7fd77c064940 2021-06-25T04:47:43.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.019+0000 7fd7727fc700 1 -- 172.21.15.57:0/2819436571 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd76c01a060 con 0x7fd77c064940 2021-06-25T04:47:43.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.019+0000 7fd7727fc700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640553d0 0x7fd764057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.019+0000 7fd7727fc700 1 -- 172.21.15.57:0/2819436571 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd76c06d430 con 0x7fd77c064940 2021-06-25T04:47:43.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.019+0000 7fd780921700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640553d0 0x7fd764057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.019+0000 7fd780921700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640553d0 0x7fd764057890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd77800b000 tx=0x7fd778006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.027+0000 7fd7727fc700 1 -- 172.21.15.57:0/2819436571 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd77c0b5870 con 0x7fd77c064940 2021-06-25T04:47:43.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.155+0000 7fd782124700 1 -- 172.21.15.57:0/2819436571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd77c0b5870 con 0x7fd77c064940 2021-06-25T04:47:43.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.155+0000 7fd7727fc700 1 -- 172.21.15.57:0/2819436571 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd77c0b5870 con 0x7fd77c064940 2021-06-25T04:47:43.165 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:43.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 -- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640553d0 msgr2=0x7fd764057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640553d0 0x7fd764057890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd77800b000 tx=0x7fd778006df0).stop 2021-06-25T04:47:43.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 -- 172.21.15.57:0/2819436571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd77c064940 msgr2=0x7fd77c13cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd77c064940 0x7fd77c13cd30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd76c000ed0 tx=0x7fd76c007ac0).stop 2021-06-25T04:47:43.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 -- 172.21.15.57:0/2819436571 shutdown_connections 2021-06-25T04:47:43.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640553d0 0x7fd764057890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd77c144ca0 0x7fd77c1476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd77c0b3510 0x7fd77c0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 --2- 172.21.15.57:0/2819436571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd77c064940 0x7fd77c13cd30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 -- 172.21.15.57:0/2819436571 >> 172.21.15.57:0/2819436571 conn(0x7fd77c05f670 msgr2=0x7fd77c139c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:43.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 -- 172.21.15.57:0/2819436571 shutdown_connections 2021-06-25T04:47:43.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.159+0000 7fd782124700 1 -- 172.21.15.57:0/2819436571 wait complete. 2021-06-25T04:47:43.178 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:47:43.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.275+0000 7fd14f59e700 1 Processor -- start 2021-06-25T04:47:43.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.275+0000 7fd14f59e700 1 -- start start 2021-06-25T04:47:43.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14f59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd1500b4a60 0x7fd1500b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14f59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1500b8050 con 0x7fd150064600 2021-06-25T04:47:43.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14f59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1501430f0 con 0x7fd1500649e0 2021-06-25T04:47:43.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14f59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd150142f00 con 0x7fd1500b4a60 2021-06-25T04:47:43.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14e59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd150064600 0x7fd150143830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52420/0 (socket says 172.21.15.57:52420) 2021-06-25T04:47:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14e59c700 1 -- 172.21.15.57:0/1146651813 learned_addr learned my addr 172.21.15.57:0/1146651813 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14dd9b700 1 --2- 172.21.15.57:0/1146651813 >> v2:172.21.15.87:3300/0 conn(0x7fd1500b4a60 0x7fd1500b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945460057 0 0) 0x7fd1500b8050 con 0x7fd150064600 2021-06-25T04:47:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd134003260 con 0x7fd150064600 2021-06-25T04:47:43.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184212936 0 0) 0x7fd1501430f0 con 0x7fd1500649e0 2021-06-25T04:47:43.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1500b8050 con 0x7fd1500649e0 2021-06-25T04:47:43.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2823242557 0 0) 0x7fd134003260 con 0x7fd150064600 2021-06-25T04:47:43.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 >> v2:172.21.15.87:3300/0 conn(0x7fd1500b4a60 msgr2=0x7fd1500b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:43.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 --2- 172.21.15.57:0/1146651813 >> v2:172.21.15.87:3300/0 conn(0x7fd1500b4a60 0x7fd1500b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 >> v1:172.21.15.87:6789/0 conn(0x7fd1500649e0 legacy=0x7fd1500664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd150143390 con 0x7fd150064600 2021-06-25T04:47:43.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fd140001660 con 0x7fd150064600 2021-06-25T04:47:43.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 >> v1:172.21.15.57:6789/0 conn(0x7fd150064600 legacy=0x7fd150143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 --2- 172.21.15.57:0/1146651813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1340038e0 0x7fd134003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 --2- 172.21.15.57:0/1146651813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd134004500 0x7fd134004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 --2- 172.21.15.57:0/1146651813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd134004e70 0x7fd13400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13400bcf0 con 0x7fd1340038e0 2021-06-25T04:47:43.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13400be30 con 0x7fd134004e70 2021-06-25T04:47:43.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13400bff0 con 0x7fd134004500 2021-06-25T04:47:43.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14e59c700 1 --2- 172.21.15.57:0/1146651813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1340038e0 0x7fd134003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14ed9d700 1 --2- 172.21.15.57:0/1146651813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd134004e70 0x7fd13400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14dd9b700 1 --2- 172.21.15.57:0/1146651813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd134004500 0x7fd134004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14e59c700 1 -- 172.21.15.57:0/1146651813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd134004500 msgr2=0x7fd134004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:43.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14e59c700 1 --2- 172.21.15.57:0/1146651813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd134004500 0x7fd134004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14e59c700 1 -- 172.21.15.57:0/1146651813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd134004e70 msgr2=0x7fd13400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:43.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14e59c700 1 --2- 172.21.15.57:0/1146651813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd134004e70 0x7fd13400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14ed9d700 1 -- 172.21.15.57:0/1146651813 reap_dead start 2021-06-25T04:47:43.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14e59c700 1 -- 172.21.15.57:0/1146651813 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134003260 con 0x7fd1340038e0 2021-06-25T04:47:43.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.279+0000 7fd14e59c700 1 --2- 172.21.15.57:0/1146651813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1340038e0 0x7fd134003ce0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd140001430 tx=0x7fd1500b81e0).ready entity=mon.0 client_cookie=9aacb0ea94758d7c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1400070d0 con 0x7fd1340038e0 2021-06-25T04:47:43.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140007230 con 0x7fd1340038e0 2021-06-25T04:47:43.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14d59a700 1 -- 172.21.15.57:0/1146651813 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14000c8f0 con 0x7fd1340038e0 2021-06-25T04:47:43.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14f59e700 1 -- 172.21.15.57:0/1146651813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1340038e0 msgr2=0x7fd134003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14f59e700 1 --2- 172.21.15.57:0/1146651813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1340038e0 0x7fd134003ce0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd140001430 tx=0x7fd1500b81e0).stop 2021-06-25T04:47:43.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14f59e700 1 -- 172.21.15.57:0/1146651813 shutdown_connections 2021-06-25T04:47:43.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14f59e700 1 --2- 172.21.15.57:0/1146651813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1340038e0 0x7fd134003ce0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14f59e700 1 -- 172.21.15.57:0/1146651813 >> 172.21.15.57:0/1146651813 conn(0x7fd15005f670 msgr2=0x7fd15005fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:43.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14f59e700 1 -- 172.21.15.57:0/1146651813 shutdown_connections 2021-06-25T04:47:43.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14f59e700 1 -- 172.21.15.57:0/1146651813 wait complete. 2021-06-25T04:47:43.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14f59e700 1 Processor -- start 2021-06-25T04:47:43.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.283+0000 7fd14f59e700 1 -- start start 2021-06-25T04:47:43.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1340038e0 0x7fd15013f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd150147090 0x7fd1501443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd150144890 0x7fd150144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14f59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500ae7a0 con 0x7fd150144890 2021-06-25T04:47:43.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500aea40 con 0x7fd1340038e0 2021-06-25T04:47:43.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500aece0 con 0x7fd150147090 2021-06-25T04:47:43.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd150144890 0x7fd150144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd150144890 0x7fd150144cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35218/0 (socket says 172.21.15.57:35218) 2021-06-25T04:47:43.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14ed9d700 1 -- 172.21.15.57:0/487315454 learned_addr learned my addr 172.21.15.57:0/487315454 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:43.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14e59c700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1340038e0 0x7fd15013f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14dd9b700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd150147090 0x7fd1501443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14ed9d700 1 -- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd150147090 msgr2=0x7fd1501443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14ed9d700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd150147090 0x7fd1501443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14ed9d700 1 -- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1340038e0 msgr2=0x7fd15013f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14ed9d700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1340038e0 0x7fd15013f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14ed9d700 1 -- 172.21.15.57:0/487315454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1500aef80 con 0x7fd150144890 2021-06-25T04:47:43.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14ed9d700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd150144890 0x7fd150144cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd1500ae590 tx=0x7fd148007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd13f7fe700 1 -- 172.21.15.57:0/487315454 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd148010710 con 0x7fd150144890 2021-06-25T04:47:43.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd13f7fe700 1 -- 172.21.15.57:0/487315454 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148010870 con 0x7fd150144890 2021-06-25T04:47:43.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14f59e700 1 -- 172.21.15.57:0/487315454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1500b1040 con 0x7fd150144890 2021-06-25T04:47:43.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd13f7fe700 1 -- 172.21.15.57:0/487315454 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd148010bd0 con 0x7fd150144890 2021-06-25T04:47:43.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.287+0000 7fd14f59e700 1 -- 172.21.15.57:0/487315454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd150140480 con 0x7fd150144890 2021-06-25T04:47:43.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.291+0000 7fd14f59e700 1 -- 172.21.15.57:0/487315454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd150057310 con 0x7fd150144890 2021-06-25T04:47:43.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.291+0000 7fd13f7fe700 1 -- 172.21.15.57:0/487315454 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd14801b030 con 0x7fd150144890 2021-06-25T04:47:43.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.291+0000 7fd13f7fe700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd12c0553f0 0x7fd12c0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.291+0000 7fd13f7fe700 1 -- 172.21.15.57:0/487315454 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd14806dcc0 con 0x7fd150144890 2021-06-25T04:47:43.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.291+0000 7fd14e59c700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd12c0553f0 0x7fd12c0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.291+0000 7fd14e59c700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd12c0553f0 0x7fd12c0578b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd140019000 tx=0x7fd140015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.299+0000 7fd13f7fe700 1 -- 172.21.15.57:0/487315454 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd148043dd0 con 0x7fd150144890 2021-06-25T04:47:43.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 -- 172.21.15.57:0/487315454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd15005f1b0 con 0x7fd150144890 2021-06-25T04:47:43.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd13f7fe700 1 -- 172.21.15.57:0/487315454 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd1480473f0 con 0x7fd150144890 2021-06-25T04:47:43.434 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:43.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 -- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd12c0553f0 msgr2=0x7fd12c0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd12c0553f0 0x7fd12c0578b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd140019000 tx=0x7fd140015000).stop 2021-06-25T04:47:43.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 -- 172.21.15.57:0/487315454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd150144890 msgr2=0x7fd150144cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd150144890 0x7fd150144cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd1500ae590 tx=0x7fd148007d80).stop 2021-06-25T04:47:43.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 -- 172.21.15.57:0/487315454 shutdown_connections 2021-06-25T04:47:43.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd12c0553f0 0x7fd12c0578b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd150144890 0x7fd150144cf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd150147090 0x7fd1501443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 --2- 172.21.15.57:0/487315454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1340038e0 0x7fd15013f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 -- 172.21.15.57:0/487315454 >> 172.21.15.57:0/487315454 conn(0x7fd15005f670 msgr2=0x7fd1500b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 -- 172.21.15.57:0/487315454 shutdown_connections 2021-06-25T04:47:43.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.427+0000 7fd14f59e700 1 -- 172.21.15.57:0/487315454 wait complete. 2021-06-25T04:47:43.447 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:47:43.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.551+0000 7f44566e6700 1 Processor -- start 2021-06-25T04:47:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.551+0000 7f44566e6700 1 -- start start 2021-06-25T04:47:43.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f445005d070 0x7f44500b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f445013f350 0x7f44500aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445005cb70 con 0x7f445005c790 2021-06-25T04:47:43.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44500ad500 con 0x7f445013f350 2021-06-25T04:47:43.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4450067d30 con 0x7f445005d070 2021-06-25T04:47:43.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f4455ee5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f445013f350 0x7f44500aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f4455ee5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f445013f350 0x7f44500aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35226/0 (socket says 172.21.15.57:35226) 2021-06-25T04:47:43.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f4455ee5700 1 -- 172.21.15.57:0/4193103179 learned_addr learned my addr 172.21.15.57:0/4193103179 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f4454ee3700 1 --2- 172.21.15.57:0/4193103179 >> v2:172.21.15.87:3300/0 conn(0x7f445005d070 0x7f44500b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f4455ee5700 1 -- 172.21.15.57:0/4193103179 >> v2:172.21.15.87:3300/0 conn(0x7f445005d070 msgr2=0x7f44500b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f4455ee5700 1 --2- 172.21.15.57:0/4193103179 >> v2:172.21.15.87:3300/0 conn(0x7f445005d070 0x7f44500b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f4455ee5700 1 -- 172.21.15.57:0/4193103179 >> v1:172.21.15.87:6789/0 conn(0x7f445005c790 legacy=0x7f44500acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f443ffff700 1 -- 172.21.15.57:0/4193103179 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601378777 0 0) 0x7f445005cb70 con 0x7f445005c790 2021-06-25T04:47:43.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f4455ee5700 1 -- 172.21.15.57:0/4193103179 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44500b1750 con 0x7f445013f350 2021-06-25T04:47:43.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f4455ee5700 1 --2- 172.21.15.57:0/4193103179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445013f350 0x7f44500aeca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f44480032f0 tx=0x7f4448009290).ready entity=mon.0 client_cookie=e7c1f5b33ecf5e9a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f443ffff700 1 -- 172.21.15.57:0/4193103179 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f444800b870 con 0x7f445013f350 2021-06-25T04:47:43.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f443ffff700 1 -- 172.21.15.57:0/4193103179 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444800b9d0 con 0x7f445013f350 2021-06-25T04:47:43.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f443ffff700 1 -- 172.21.15.57:0/4193103179 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f444800bb40 con 0x7f445013f350 2021-06-25T04:47:43.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 -- 172.21.15.57:0/4193103179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445013f350 msgr2=0x7f44500aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 --2- 172.21.15.57:0/4193103179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445013f350 0x7f44500aeca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f44480032f0 tx=0x7f4448009290).stop 2021-06-25T04:47:43.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 -- 172.21.15.57:0/4193103179 shutdown_connections 2021-06-25T04:47:43.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 --2- 172.21.15.57:0/4193103179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445013f350 0x7f44500aeca0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 --2- 172.21.15.57:0/4193103179 >> v2:172.21.15.87:3300/0 conn(0x7f445005d070 0x7f44500b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 -- 172.21.15.57:0/4193103179 >> 172.21.15.57:0/4193103179 conn(0x7f4450060140 msgr2=0x7f44500b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:43.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 -- 172.21.15.57:0/4193103179 shutdown_connections 2021-06-25T04:47:43.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.555+0000 7f44566e6700 1 -- 172.21.15.57:0/4193103179 wait complete. 2021-06-25T04:47:43.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44566e6700 1 Processor -- start 2021-06-25T04:47:43.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44566e6700 1 -- start start 2021-06-25T04:47:43.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44566e6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445005c790 0x7f445014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44566e6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f445005d070 0x7f44500a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44566e6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f445013f350 0x7f44501522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44566e6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4450140dc0 con 0x7f445005c790 2021-06-25T04:47:43.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44566e6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4450151bb0 con 0x7f445013f350 2021-06-25T04:47:43.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44566e6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4450151e50 con 0x7f445005d070 2021-06-25T04:47:43.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44556e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445005c790 0x7f445014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44556e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445005c790 0x7f445014e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35228/0 (socket says 172.21.15.57:35228) 2021-06-25T04:47:43.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44556e4700 1 -- 172.21.15.57:0/3777173451 learned_addr learned my addr 172.21.15.57:0/3777173451 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:43.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f4454ee3700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f445005d070 0x7f44500a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f4455ee5700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f445013f350 0x7f44501522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44556e4700 1 -- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f445005d070 msgr2=0x7f44500a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44556e4700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f445005d070 0x7f44500a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44556e4700 1 -- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f445013f350 msgr2=0x7f44501522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44556e4700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f445013f350 0x7f44501522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.559+0000 7f44556e4700 1 -- 172.21.15.57:0/3777173451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4448009530 con 0x7f445005c790 2021-06-25T04:47:43.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.563+0000 7f44556e4700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445005c790 0x7f445014e460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f444c000bc0 tx=0x7f444c007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.563+0000 7f443e7fc700 1 -- 172.21.15.57:0/3777173451 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f444c012400 con 0x7f445005c790 2021-06-25T04:47:43.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.563+0000 7f443e7fc700 1 -- 172.21.15.57:0/3777173451 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c012560 con 0x7f445005c790 2021-06-25T04:47:43.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.563+0000 7f44566e6700 1 -- 172.21.15.57:0/3777173451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445014e950 con 0x7f445005c790 2021-06-25T04:47:43.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.563+0000 7f443e7fc700 1 -- 172.21.15.57:0/3777173451 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f444c0128c0 con 0x7f445005c790 2021-06-25T04:47:43.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.563+0000 7f44566e6700 1 -- 172.21.15.57:0/3777173451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4450141680 con 0x7f445005c790 2021-06-25T04:47:43.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.563+0000 7f44566e6700 1 -- 172.21.15.57:0/3777173451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4450140f80 con 0x7f445005c790 2021-06-25T04:47:43.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.563+0000 7f443e7fc700 1 -- 172.21.15.57:0/3777173451 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f444c019030 con 0x7f445005c790 2021-06-25T04:47:43.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.563+0000 7f443e7fc700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44300554e0 0x7f44300579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.563+0000 7f443e7fc700 1 -- 172.21.15.57:0/3777173451 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f444c06d1c0 con 0x7f445005c790 2021-06-25T04:47:43.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.563+0000 7f4454ee3700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44300554e0 0x7f44300579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.567+0000 7f4454ee3700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44300554e0 0x7f44300579a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f444000b000 tx=0x7f4440006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.571+0000 7f443e7fc700 1 -- 172.21.15.57:0/3777173451 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f444c042c50 con 0x7f445005c790 2021-06-25T04:47:43.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.695+0000 7f44566e6700 1 -- 172.21.15.57:0/3777173451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4450057310 con 0x7f445005c790 2021-06-25T04:47:43.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f443e7fc700 1 -- 172.21.15.57:0/3777173451 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f444c043420 con 0x7f445005c790 2021-06-25T04:47:43.706 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:43.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 -- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44300554e0 msgr2=0x7f44300579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44300554e0 0x7f44300579a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f444000b000 tx=0x7f4440006df0).stop 2021-06-25T04:47:43.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 -- 172.21.15.57:0/3777173451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445005c790 msgr2=0x7f445014e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445005c790 0x7f445014e460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f444c000bc0 tx=0x7f444c007a70).stop 2021-06-25T04:47:43.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 -- 172.21.15.57:0/3777173451 shutdown_connections 2021-06-25T04:47:43.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44300554e0 0x7f44300579a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f445013f350 0x7f44501522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f445005d070 0x7f44500a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 --2- 172.21.15.57:0/3777173451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445005c790 0x7f445014e460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 -- 172.21.15.57:0/3777173451 >> 172.21.15.57:0/3777173451 conn(0x7f4450060140 msgr2=0x7f44500b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:43.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 -- 172.21.15.57:0/3777173451 shutdown_connections 2021-06-25T04:47:43.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.699+0000 7f44566e6700 1 -- 172.21.15.57:0/3777173451 wait complete. 2021-06-25T04:47:43.719 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-06-25T04:47:43.720 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-06-25T04:47:43.720 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-06-25T04:47:43.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.815+0000 7ff39cf78700 1 Processor -- start 2021-06-25T04:47:43.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.815+0000 7ff39cf78700 1 -- start start 2021-06-25T04:47:43.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.815+0000 7ff39cf78700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3980ac9f0 0x7ff3980b5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.815+0000 7ff39cf78700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3980acdd0 con 0x7ff3980b13f0 2021-06-25T04:47:43.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.815+0000 7ff39cf78700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3980b5120 con 0x7ff3980ad830 2021-06-25T04:47:43.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.815+0000 7ff39cf78700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3980adea0 con 0x7ff3980ac9f0 2021-06-25T04:47:43.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.815+0000 7ff397fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff3980b13f0 0x7ff398066fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52456/0 (socket says 172.21.15.57:52456) 2021-06-25T04:47:43.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.815+0000 7ff397fff700 1 -- 172.21.15.57:0/4245952522 learned_addr learned my addr 172.21.15.57:0/4245952522 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:43.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.815+0000 7ff3977fe700 1 --2- 172.21.15.57:0/4245952522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3980ac9f0 0x7ff3980b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff3967fc700 1 -- 172.21.15.57:0/4245952522 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615279381 0 0) 0x7ff3980acdd0 con 0x7ff3980b13f0 2021-06-25T04:47:43.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff3967fc700 1 -- 172.21.15.57:0/4245952522 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff378003260 con 0x7ff3980b13f0 2021-06-25T04:47:43.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff3967fc700 1 -- 172.21.15.57:0/4245952522 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710008961 0 0) 0x7ff3980b5120 con 0x7ff3980ad830 2021-06-25T04:47:43.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff3967fc700 1 -- 172.21.15.57:0/4245952522 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3980acdd0 con 0x7ff3980ad830 2021-06-25T04:47:43.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff3977fe700 1 -- 172.21.15.57:0/4245952522 >> v1:172.21.15.87:6789/0 conn(0x7ff3980ad830 legacy=0x7ff398143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff3977fe700 1 -- 172.21.15.57:0/4245952522 >> v1:172.21.15.57:6789/0 conn(0x7ff3980b13f0 legacy=0x7ff398066fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff3977fe700 1 -- 172.21.15.57:0/4245952522 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3980ae140 con 0x7ff3980ac9f0 2021-06-25T04:47:43.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff3977fe700 1 --2- 172.21.15.57:0/4245952522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3980ac9f0 0x7ff3980b5580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff388002f70 tx=0x7ff388006df0).ready entity=mon.2 client_cookie=a1b292991ea55e47 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff3967fc700 1 -- 172.21.15.57:0/4245952522 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff38800d5c0 con 0x7ff3980ac9f0 2021-06-25T04:47:43.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff3967fc700 1 -- 172.21.15.57:0/4245952522 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff388000e90 con 0x7ff3980ac9f0 2021-06-25T04:47:43.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff3967fc700 1 -- 172.21.15.57:0/4245952522 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff38800d910 con 0x7ff3980ac9f0 2021-06-25T04:47:43.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff39cf78700 1 -- 172.21.15.57:0/4245952522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3980ac9f0 msgr2=0x7ff3980b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff39cf78700 1 --2- 172.21.15.57:0/4245952522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3980ac9f0 0x7ff3980b5580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff388002f70 tx=0x7ff388006df0).stop 2021-06-25T04:47:43.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff39cf78700 1 -- 172.21.15.57:0/4245952522 shutdown_connections 2021-06-25T04:47:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff39cf78700 1 --2- 172.21.15.57:0/4245952522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3980ac9f0 0x7ff3980b5580 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff39cf78700 1 -- 172.21.15.57:0/4245952522 >> 172.21.15.57:0/4245952522 conn(0x7ff398062520 msgr2=0x7ff398062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff39cf78700 1 -- 172.21.15.57:0/4245952522 shutdown_connections 2021-06-25T04:47:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff39cf78700 1 -- 172.21.15.57:0/4245952522 wait complete. 2021-06-25T04:47:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff39cf78700 1 Processor -- start 2021-06-25T04:47:43.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.819+0000 7ff39cf78700 1 -- start start 2021-06-25T04:47:43.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff39cf78700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3980ac9f0 0x7ff398064550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff39cf78700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3980ad830 0x7ff39813d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff39cf78700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3980b13f0 0x7ff39813dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff39cf78700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff398147c80 con 0x7ff3980ad830 2021-06-25T04:47:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff39cf78700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff398147f20 con 0x7ff3980ac9f0 2021-06-25T04:47:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff39cf78700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3981481c0 con 0x7ff3980b13f0 2021-06-25T04:47:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff396ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3980ad830 0x7ff39813d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff396ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3980ad830 0x7ff39813d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35242/0 (socket says 172.21.15.57:35242) 2021-06-25T04:47:43.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff396ffd700 1 -- 172.21.15.57:0/2360010159 learned_addr learned my addr 172.21.15.57:0/2360010159 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:43.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff3977fe700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3980ac9f0 0x7ff398064550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff397fff700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3980b13f0 0x7ff39813dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff396ffd700 1 -- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3980b13f0 msgr2=0x7ff39813dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff396ffd700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3980b13f0 0x7ff39813dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff396ffd700 1 -- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3980ac9f0 msgr2=0x7ff398064550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:43.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff396ffd700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3980ac9f0 0x7ff398064550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:43.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff396ffd700 1 -- 172.21.15.57:0/2360010159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38800b180 con 0x7ff3980ad830 2021-06-25T04:47:43.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff396ffd700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3980ad830 0x7ff39813d6c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ff380001110 tx=0x7ff380007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff394ff9700 1 -- 172.21.15.57:0/2360010159 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff380012400 con 0x7ff3980ad830 2021-06-25T04:47:43.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff394ff9700 1 -- 172.21.15.57:0/2360010159 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff380012560 con 0x7ff3980ad830 2021-06-25T04:47:43.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff39cf78700 1 -- 172.21.15.57:0/2360010159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff398148460 con 0x7ff3980ad830 2021-06-25T04:47:43.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff394ff9700 1 -- 172.21.15.57:0/2360010159 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3800128c0 con 0x7ff3980ad830 2021-06-25T04:47:43.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.823+0000 7ff39cf78700 1 -- 172.21.15.57:0/2360010159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39813e0a0 con 0x7ff3980ad830 2021-06-25T04:47:43.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.827+0000 7ff394ff9700 1 -- 172.21.15.57:0/2360010159 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff380019030 con 0x7ff3980ad830 2021-06-25T04:47:43.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.827+0000 7ff39cf78700 1 -- 172.21.15.57:0/2360010159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3981485f0 con 0x7ff3980ad830 2021-06-25T04:47:43.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.827+0000 7ff394ff9700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff37c055450 0x7ff37c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:43.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.827+0000 7ff394ff9700 1 -- 172.21.15.57:0/2360010159 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff38006d380 con 0x7ff3980ad830 2021-06-25T04:47:43.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.827+0000 7ff3977fe700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff37c055450 0x7ff37c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:43.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.827+0000 7ff3977fe700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff37c055450 0x7ff37c057910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff388019000 tx=0x7ff388014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:43.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.831+0000 7ff394ff9700 1 -- 172.21.15.57:0/2360010159 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff380043530 con 0x7ff3980ad830 2021-06-25T04:47:43.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.983+0000 7ff39cf78700 1 -- 172.21.15.57:0/2360010159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff398057310 con 0x7ff3980ad830 2021-06-25T04:47:43.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.991+0000 7ff394ff9700 1 -- 172.21.15.57:0/2360010159 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+134178 (secure 0 0 0) 0x7ff380046b50 con 0x7ff3980ad830 2021-06-25T04:47:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:44.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 -- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff37c055450 msgr2=0x7ff37c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff37c055450 0x7ff37c057910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff388019000 tx=0x7ff388014000).stop 2021-06-25T04:47:44.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 -- 172.21.15.57:0/2360010159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3980ad830 msgr2=0x7ff39813d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3980ad830 0x7ff39813d6c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ff380001110 tx=0x7ff380007ab0).stop 2021-06-25T04:47:44.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 -- 172.21.15.57:0/2360010159 shutdown_connections 2021-06-25T04:47:44.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff37c055450 0x7ff37c057910 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3980b13f0 0x7ff39813dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3980ad830 0x7ff39813d6c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 --2- 172.21.15.57:0/2360010159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3980ac9f0 0x7ff398064550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 -- 172.21.15.57:0/2360010159 >> 172.21.15.57:0/2360010159 conn(0x7ff398062520 msgr2=0x7ff3980b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:44.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 -- 172.21.15.57:0/2360010159 shutdown_connections 2021-06-25T04:47:44.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:43.995+0000 7ff39cf78700 1 -- 172.21.15.57:0/2360010159 wait complete. 2021-06-25T04:47:44.018 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"active_gid":4114,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":15156},{"type":"v1","addr":"172.21.15.87:6833","nonce":15156}]},"active_addr":"172.21.15.87:6833/15156","active_change":"2021-06-25T04:47:24.429243+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":false,"error_string":"implement_array_function method already has a docstring","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":false,"error_string":"implement_array_function method already has a docstring","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":1755516361}]},{"addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":2206601394}]},{"addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":1002691871}]}]}} 2021-06-25T04:47:44.023 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-06-25T04:47:44.024 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-06-25T04:47:44.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:44.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7facac8e2700 1 Processor -- start 2021-06-25T04:47:44.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7facac8e2700 1 -- start start 2021-06-25T04:47:44.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7facac8e2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faca80b5460 0x7faca80af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7facac8e2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca80b5840 con 0x7faca8147560 2021-06-25T04:47:44.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7facac8e2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca80ac7c0 con 0x7faca80b05d0 2021-06-25T04:47:44.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7facac8e2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca81452a0 con 0x7faca80b5460 2021-06-25T04:47:44.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7faca7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faca8147560 0x7faca80acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52472/0 (socket says 172.21.15.57:52472) 2021-06-25T04:47:44.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7faca7fff700 1 -- 172.21.15.57:0/1785433974 learned_addr learned my addr 172.21.15.57:0/1785433974 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:44.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7faca77fe700 1 --2- 172.21.15.57:0/1785433974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faca80b5460 0x7faca80af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7faca6ffd700 1 -- 172.21.15.57:0/1785433974 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860483252 0 0) 0x7faca80b5840 con 0x7faca8147560 2021-06-25T04:47:44.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7faca6ffd700 1 -- 172.21.15.57:0/1785433974 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac88003260 con 0x7faca8147560 2021-06-25T04:47:44.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7faca6ffd700 1 -- 172.21.15.57:0/1785433974 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450766031 0 0) 0x7faca80ac7c0 con 0x7faca80b05d0 2021-06-25T04:47:44.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7faca6ffd700 1 -- 172.21.15.57:0/1785433974 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faca80b5840 con 0x7faca80b05d0 2021-06-25T04:47:44.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7faca6ffd700 1 -- 172.21.15.57:0/1785433974 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 889400037 0 0) 0x7fac88003260 con 0x7faca8147560 2021-06-25T04:47:44.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7faca77fe700 1 -- 172.21.15.57:0/1785433974 >> v1:172.21.15.87:6789/0 conn(0x7faca80b05d0 legacy=0x7faca8067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7faca77fe700 1 -- 172.21.15.57:0/1785433974 >> v1:172.21.15.57:6789/0 conn(0x7faca8147560 legacy=0x7faca80acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.119+0000 7faca77fe700 1 -- 172.21.15.57:0/1785433974 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca80b19f0 con 0x7faca80b5460 2021-06-25T04:47:44.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7faca77fe700 1 --2- 172.21.15.57:0/1785433974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faca80b5460 0x7faca80af510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7faca0001490 tx=0x7fac98006df0).ready entity=mon.2 client_cookie=207f8500a5ec5847 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7faca6ffd700 1 -- 172.21.15.57:0/1785433974 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faca00019e0 con 0x7faca80b5460 2021-06-25T04:47:44.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7faca6ffd700 1 -- 172.21.15.57:0/1785433974 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac98000e90 con 0x7faca80b5460 2021-06-25T04:47:44.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7faca6ffd700 1 -- 172.21.15.57:0/1785433974 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac98012460 con 0x7faca80b5460 2021-06-25T04:47:44.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7facac8e2700 1 -- 172.21.15.57:0/1785433974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faca80b5460 msgr2=0x7faca80af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7facac8e2700 1 --2- 172.21.15.57:0/1785433974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faca80b5460 0x7faca80af510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7faca0001490 tx=0x7fac98006df0).stop 2021-06-25T04:47:44.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7facac8e2700 1 -- 172.21.15.57:0/1785433974 shutdown_connections 2021-06-25T04:47:44.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7facac8e2700 1 --2- 172.21.15.57:0/1785433974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faca80b5460 0x7faca80af510 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7facac8e2700 1 -- 172.21.15.57:0/1785433974 >> 172.21.15.57:0/1785433974 conn(0x7faca8062520 msgr2=0x7faca8062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:44.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7facac8e2700 1 -- 172.21.15.57:0/1785433974 shutdown_connections 2021-06-25T04:47:44.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7facac8e2700 1 -- 172.21.15.57:0/1785433974 wait complete. 2021-06-25T04:47:44.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7facac8e2700 1 Processor -- start 2021-06-25T04:47:44.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.123+0000 7facac8e2700 1 -- start start 2021-06-25T04:47:44.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7facac8e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faca80b05d0 0x7faca8144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7facac8e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faca80b5460 0x7faca8145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7facac8e2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faca8147560 0x7faca8141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7facac8e2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca80adfb0 con 0x7faca80b5460 2021-06-25T04:47:44.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7facac8e2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca8146600 con 0x7faca80b05d0 2021-06-25T04:47:44.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7facac8e2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca813f800 con 0x7faca8147560 2021-06-25T04:47:44.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7fac9ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faca80b5460 0x7faca8145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7fac9ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faca80b5460 0x7faca8145ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35258/0 (socket says 172.21.15.57:35258) 2021-06-25T04:47:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7fac9ffff700 1 -- 172.21.15.57:0/3588483692 learned_addr learned my addr 172.21.15.57:0/3588483692 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7faca77fe700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faca80b05d0 0x7faca8144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7faca7fff700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faca8147560 0x7faca8141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7fac9ffff700 1 -- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faca8147560 msgr2=0x7faca8141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7fac9ffff700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faca8147560 0x7faca8141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7fac9ffff700 1 -- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faca80b05d0 msgr2=0x7faca8144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7fac9ffff700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faca80b05d0 0x7faca8144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7fac9ffff700 1 -- 172.21.15.57:0/3588483692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9800b180 con 0x7faca80b5460 2021-06-25T04:47:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7fac9ffff700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faca80b5460 0x7faca8145ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7faca813f940 tx=0x7fac90007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7faca57fa700 1 -- 172.21.15.57:0/3588483692 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac90012400 con 0x7faca80b5460 2021-06-25T04:47:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7faca57fa700 1 -- 172.21.15.57:0/3588483692 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac90012560 con 0x7faca80b5460 2021-06-25T04:47:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7facac8e2700 1 -- 172.21.15.57:0/3588483692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca8145920 con 0x7faca80b5460 2021-06-25T04:47:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7faca57fa700 1 -- 172.21.15.57:0/3588483692 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac900128c0 con 0x7faca80b5460 2021-06-25T04:47:44.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7facac8e2700 1 -- 172.21.15.57:0/3588483692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca8145b50 con 0x7faca80b5460 2021-06-25T04:47:44.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.127+0000 7facac8e2700 1 -- 172.21.15.57:0/3588483692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca8057310 con 0x7faca80b5460 2021-06-25T04:47:44.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.131+0000 7faca57fa700 1 -- 172.21.15.57:0/3588483692 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fac90019030 con 0x7faca80b5460 2021-06-25T04:47:44.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.131+0000 7faca57fa700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac8c0553f0 0x7fac8c0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.131+0000 7faca57fa700 1 -- 172.21.15.57:0/3588483692 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fac9006d230 con 0x7faca80b5460 2021-06-25T04:47:44.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.131+0000 7faca77fe700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac8c0553f0 0x7fac8c0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.131+0000 7faca77fe700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac8c0553f0 0x7fac8c0578b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fac98019000 tx=0x7fac98014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.135+0000 7faca57fa700 1 -- 172.21.15.57:0/3588483692 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fac900433e0 con 0x7faca80b5460 2021-06-25T04:47:44.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.263+0000 7facac8e2700 1 -- 172.21.15.57:0/3588483692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faca8060e50 con 0x7faca80b5460 2021-06-25T04:47:44.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7faca57fa700 1 -- 172.21.15.57:0/3588483692 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fac90046a00 con 0x7faca80b5460 2021-06-25T04:47:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:44.275 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:41.021834+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 -- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac8c0553f0 msgr2=0x7fac8c0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac8c0553f0 0x7fac8c0578b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fac98019000 tx=0x7fac98014000).stop 2021-06-25T04:47:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 -- 172.21.15.57:0/3588483692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faca80b5460 msgr2=0x7faca8145ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faca80b5460 0x7faca8145ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7faca813f940 tx=0x7fac90007a60).stop 2021-06-25T04:47:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 -- 172.21.15.57:0/3588483692 shutdown_connections 2021-06-25T04:47:44.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac8c0553f0 0x7fac8c0578b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faca8147560 0x7faca8141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faca80b5460 0x7faca8145ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 --2- 172.21.15.57:0/3588483692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faca80b05d0 0x7faca8144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 -- 172.21.15.57:0/3588483692 >> 172.21.15.57:0/3588483692 conn(0x7faca8062520 msgr2=0x7faca80aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:44.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 -- 172.21.15.57:0/3588483692 shutdown_connections 2021-06-25T04:47:44.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.267+0000 7facac8e2700 1 -- 172.21.15.57:0/3588483692 wait complete. 2021-06-25T04:47:44.288 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-06-25T04:47:44.289 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:44.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538c9f7700 1 Processor -- start 2021-06-25T04:47:44.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538c9f7700 1 -- start start 2021-06-25T04:47:44.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538c9f7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53880b77d0 0x7f5388144560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538c9f7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 0x7f5388144a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538c9f7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5388064830 0x7f5388064c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538c9f7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53880b3190 con 0x7f5388064830 2021-06-25T04:47:44.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538c9f7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53880b7bb0 con 0x7f53880b77d0 2021-06-25T04:47:44.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538c9f7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5388067580 con 0x7f53880b1130 2021-06-25T04:47:44.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f5385d9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 0x7f5388144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f5386d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5388064830 0x7f5388064c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f5386d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5388064830 0x7f5388064c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35268/0 (socket says 172.21.15.57:35268) 2021-06-25T04:47:44.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f5386d9d700 1 -- 172.21.15.57:0/3207460602 learned_addr learned my addr 172.21.15.57:0/3207460602 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:44.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538659c700 1 --2- 172.21.15.57:0/3207460602 >> v2:172.21.15.87:3300/0 conn(0x7f53880b77d0 0x7f5388144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f5385d9b700 1 -- 172.21.15.57:0/3207460602 >> v2:172.21.15.87:3300/0 conn(0x7f53880b77d0 msgr2=0x7f5388144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:44.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f5385d9b700 1 --2- 172.21.15.57:0/3207460602 >> v2:172.21.15.87:3300/0 conn(0x7f53880b77d0 0x7f5388144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f5385d9b700 1 -- 172.21.15.57:0/3207460602 >> v2:172.21.15.57:3300/0 conn(0x7f5388064830 msgr2=0x7f5388064c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:44.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f5385d9b700 1 --2- 172.21.15.57:0/3207460602 >> v2:172.21.15.57:3300/0 conn(0x7f5388064830 0x7f5388064c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f5385d9b700 1 -- 172.21.15.57:0/3207460602 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53880aae30 con 0x7f53880b1130 2021-06-25T04:47:44.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f5386d9d700 1 --2- 172.21.15.57:0/3207460602 >> v2:172.21.15.57:3300/0 conn(0x7f5388064830 0x7f5388064c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:44.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f5385d9b700 1 --2- 172.21.15.57:0/3207460602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 0x7f5388144a50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5370002f70 tx=0x7f5370006df0).ready entity=mon.2 client_cookie=92d9782ebb5f2cc3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538559a700 1 -- 172.21.15.57:0/3207460602 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f537000d4a0 con 0x7f53880b1130 2021-06-25T04:47:44.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538559a700 1 -- 172.21.15.57:0/3207460602 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5370000e90 con 0x7f53880b1130 2021-06-25T04:47:44.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538559a700 1 -- 172.21.15.57:0/3207460602 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f537000d7f0 con 0x7f53880b1130 2021-06-25T04:47:44.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538c9f7700 1 -- 172.21.15.57:0/3207460602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 msgr2=0x7f5388144a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.383+0000 7f538c9f7700 1 --2- 172.21.15.57:0/3207460602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 0x7f5388144a50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5370002f70 tx=0x7f5370006df0).stop 2021-06-25T04:47:44.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 -- 172.21.15.57:0/3207460602 shutdown_connections 2021-06-25T04:47:44.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 --2- 172.21.15.57:0/3207460602 >> v2:172.21.15.57:3300/0 conn(0x7f5388064830 0x7f5388064c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 --2- 172.21.15.57:0/3207460602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 0x7f5388144a50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 --2- 172.21.15.57:0/3207460602 >> v2:172.21.15.87:3300/0 conn(0x7f53880b77d0 0x7f5388144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 -- 172.21.15.57:0/3207460602 >> 172.21.15.57:0/3207460602 conn(0x7f538805f670 msgr2=0x7f538805fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:44.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 -- 172.21.15.57:0/3207460602 shutdown_connections 2021-06-25T04:47:44.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 -- 172.21.15.57:0/3207460602 wait complete. 2021-06-25T04:47:44.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 Processor -- start 2021-06-25T04:47:44.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 -- start start 2021-06-25T04:47:44.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5388064830 0x7f538809fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 0x7f53880a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880b77d0 0x7f53880aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53880ac3c0 con 0x7f53880b77d0 2021-06-25T04:47:44.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5388154020 con 0x7f5388064830 2021-06-25T04:47:44.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f538c9f7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53881542c0 con 0x7f53880b1130 2021-06-25T04:47:44.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.387+0000 7f5386d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880b77d0 0x7f53880aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f5386d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880b77d0 0x7f53880aa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35274/0 (socket says 172.21.15.57:35274) 2021-06-25T04:47:44.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f5386d9d700 1 -- 172.21.15.57:0/719985280 learned_addr learned my addr 172.21.15.57:0/719985280 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:44.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f538659c700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5388064830 0x7f538809fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f5385d9b700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 0x7f53880a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f5386d9d700 1 -- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 msgr2=0x7f53880a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f5386d9d700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 0x7f53880a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f5386d9d700 1 -- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5388064830 msgr2=0x7f538809fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f5386d9d700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5388064830 0x7f538809fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f5386d9d700 1 -- 172.21.15.57:0/719985280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538000b1e0 con 0x7f53880b77d0 2021-06-25T04:47:44.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f5385d9b700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 0x7f53880a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:44.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f5386d9d700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880b77d0 0x7f53880aa070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f538000c000 tx=0x7f5380006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f537f7fe700 1 -- 172.21.15.57:0/719985280 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5380012600 con 0x7f53880b77d0 2021-06-25T04:47:44.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f537f7fe700 1 -- 172.21.15.57:0/719985280 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5380012760 con 0x7f53880b77d0 2021-06-25T04:47:44.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f538c9f7700 1 -- 172.21.15.57:0/719985280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537000b180 con 0x7f53880b77d0 2021-06-25T04:47:44.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f537f7fe700 1 -- 172.21.15.57:0/719985280 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5380012ac0 con 0x7f53880b77d0 2021-06-25T04:47:44.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f538c9f7700 1 -- 172.21.15.57:0/719985280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53880ae550 con 0x7f53880b77d0 2021-06-25T04:47:44.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f538c9f7700 1 -- 172.21.15.57:0/719985280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5388057310 con 0x7f53880b77d0 2021-06-25T04:47:44.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.391+0000 7f537f7fe700 1 -- 172.21.15.57:0/719985280 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5380022070 con 0x7f53880b77d0 2021-06-25T04:47:44.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.395+0000 7f537f7fe700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53600553d0 0x7f5360057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.395+0000 7f537f7fe700 1 -- 172.21.15.57:0/719985280 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f538006e460 con 0x7f53880b77d0 2021-06-25T04:47:44.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.395+0000 7f538659c700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53600553d0 0x7f5360057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.395+0000 7f538659c700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53600553d0 0x7f5360057890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f537800b000 tx=0x7f53780091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.403+0000 7f537f7fe700 1 -- 172.21.15.57:0/719985280 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5380044570 con 0x7f53880b77d0 2021-06-25T04:47:44.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.527+0000 7f538c9f7700 1 -- 172.21.15.57:0/719985280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53880698a0 con 0x7f53880b77d0 2021-06-25T04:47:44.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f537f7fe700 1 -- 172.21.15.57:0/719985280 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f5380016090 con 0x7f53880b77d0 2021-06-25T04:47:44.540 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:44.540 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:41.021834+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:44.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 -- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53600553d0 msgr2=0x7f5360057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53600553d0 0x7f5360057890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f537800b000 tx=0x7f53780091d0).stop 2021-06-25T04:47:44.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 -- 172.21.15.57:0/719985280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880b77d0 msgr2=0x7f53880aa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880b77d0 0x7f53880aa070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f538000c000 tx=0x7f5380006eb0).stop 2021-06-25T04:47:44.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 -- 172.21.15.57:0/719985280 shutdown_connections 2021-06-25T04:47:44.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53600553d0 0x7f5360057890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880b77d0 0x7f53880aa070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53880b1130 0x7f53880a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 --2- 172.21.15.57:0/719985280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5388064830 0x7f538809fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 -- 172.21.15.57:0/719985280 >> 172.21.15.57:0/719985280 conn(0x7f538805f670 msgr2=0x7f538805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:44.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 -- 172.21.15.57:0/719985280 shutdown_connections 2021-06-25T04:47:44.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.531+0000 7f538c9f7700 1 -- 172.21.15.57:0/719985280 wait complete. 2021-06-25T04:47:44.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-06-25T04:47:44.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d7cc5700 1 Processor -- start 2021-06-25T04:47:44.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d7cc5700 1 -- start start 2021-06-25T04:47:44.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d7cc5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa3d00a7670 0x7fa3d0066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d7cc5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3d00b0020 0x7fa3d005fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d7cc5700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d00a7a50 con 0x7fa3d00b1930 2021-06-25T04:47:44.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d7cc5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d01475e0 con 0x7fa3d00a7670 2021-06-25T04:47:44.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d7cc5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d0147880 con 0x7fa3d00b0020 2021-06-25T04:47:44.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d5a61700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa3d00a7670 0x7fa3d0066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d5a61700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa3d00a7670 0x7fa3d0066a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35280/0 (socket says 172.21.15.57:35280) 2021-06-25T04:47:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d5a61700 1 -- 172.21.15.57:0/3638376495 learned_addr learned my addr 172.21.15.57:0/3638376495 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d6262700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3d00b0020 0x7fa3d005fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d5a61700 1 -- 172.21.15.57:0/3638376495 >> v2:172.21.15.87:3300/0 conn(0x7fa3d00b0020 msgr2=0x7fa3d005fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d5a61700 1 --2- 172.21.15.57:0/3638376495 >> v2:172.21.15.87:3300/0 conn(0x7fa3d00b0020 0x7fa3d005fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d5a61700 1 -- 172.21.15.57:0/3638376495 >> v1:172.21.15.87:6789/0 conn(0x7fa3d00b1930 legacy=0x7fa3d005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.647+0000 7fa3d5a61700 1 -- 172.21.15.57:0/3638376495 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0147b20 con 0x7fa3d00a7670 2021-06-25T04:47:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d5a61700 1 --2- 172.21.15.57:0/3638376495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d00a7670 0x7fa3d0066a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa3c4002f70 tx=0x7fa3c4006eb0).ready entity=mon.0 client_cookie=10a6849a0600477 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d4a5f700 1 -- 172.21.15.57:0/3638376495 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3c400d5c0 con 0x7fa3d00a7670 2021-06-25T04:47:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d4a5f700 1 -- 172.21.15.57:0/3638376495 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c4000e90 con 0x7fa3d00a7670 2021-06-25T04:47:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d4a5f700 1 -- 172.21.15.57:0/3638376495 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3c400d950 con 0x7fa3d00a7670 2021-06-25T04:47:44.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3638376495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d00a7670 msgr2=0x7fa3d0066a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d7cc5700 1 --2- 172.21.15.57:0/3638376495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d00a7670 0x7fa3d0066a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa3c4002f70 tx=0x7fa3c4006eb0).stop 2021-06-25T04:47:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3638376495 shutdown_connections 2021-06-25T04:47:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d7cc5700 1 --2- 172.21.15.57:0/3638376495 >> v2:172.21.15.87:3300/0 conn(0x7fa3d00b0020 0x7fa3d005fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d7cc5700 1 --2- 172.21.15.57:0/3638376495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d00a7670 0x7fa3d0066a30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3638376495 >> 172.21.15.57:0/3638376495 conn(0x7fa3d00b53a0 msgr2=0x7fa3d00b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3638376495 shutdown_connections 2021-06-25T04:47:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3638376495 wait complete. 2021-06-25T04:47:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d7cc5700 1 Processor -- start 2021-06-25T04:47:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.651+0000 7fa3d7cc5700 1 -- start start 2021-06-25T04:47:44.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d7cc5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00a7670 0x7fa3d00aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d7cc5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d00b0020 0x7fa3d0156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d7cc5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d00b1930 0x7fa3d0157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d7cc5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00ad680 con 0x7fa3d00b0020 2021-06-25T04:47:44.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d7cc5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00ad140 con 0x7fa3d00a7670 2021-06-25T04:47:44.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d7cc5700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00ad3e0 con 0x7fa3d00b1930 2021-06-25T04:47:44.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d5260700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d00b0020 0x7fa3d0156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d5260700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d00b0020 0x7fa3d0156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35286/0 (socket says 172.21.15.57:35286) 2021-06-25T04:47:44.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d5260700 1 -- 172.21.15.57:0/3134579141 learned_addr learned my addr 172.21.15.57:0/3134579141 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:44.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d6262700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d00b1930 0x7fa3d0157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d5a61700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00a7670 0x7fa3d00aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d5260700 1 -- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d00b1930 msgr2=0x7fa3d0157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d5260700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d00b1930 0x7fa3d0157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d5260700 1 -- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00a7670 msgr2=0x7fa3d00aad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d5260700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00a7670 0x7fa3d00aad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d5260700 1 -- 172.21.15.57:0/3134579141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c400b1e0 con 0x7fa3d00b0020 2021-06-25T04:47:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d5a61700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00a7670 0x7fa3d00aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:44.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d5260700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d00b0020 0x7fa3d0156d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa3d006a0a0 tx=0x7fa3c0007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3ceffd700 1 -- 172.21.15.57:0/3134579141 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3c000e4a0 con 0x7fa3d00b0020 2021-06-25T04:47:44.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3ceffd700 1 -- 172.21.15.57:0/3134579141 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c000e600 con 0x7fa3d00b0020 2021-06-25T04:47:44.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3134579141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d00a91f0 con 0x7fa3d00b0020 2021-06-25T04:47:44.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3ceffd700 1 -- 172.21.15.57:0/3134579141 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3c000e960 con 0x7fa3d00b0020 2021-06-25T04:47:44.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.655+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3134579141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d01578b0 con 0x7fa3d00b0020 2021-06-25T04:47:44.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3134579141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3d00a7f00 con 0x7fa3d00b0020 2021-06-25T04:47:44.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3ceffd700 1 -- 172.21.15.57:0/3134579141 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa3c0010030 con 0x7fa3d00b0020 2021-06-25T04:47:44.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3ceffd700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3b00554e0 0x7fa3b00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3ceffd700 1 -- 172.21.15.57:0/3134579141 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa3c006e290 con 0x7fa3d00b0020 2021-06-25T04:47:44.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3ceffd700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x7fa3b005cee0 0x7fa3b005f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3ceffd700 1 -- 172.21.15.57:0/3134579141 --> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3b005f8c0 con 0x7fa3b005cee0 2021-06-25T04:47:44.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3ceffd700 1 -- 172.21.15.57:0/3134579141 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3c0070810 con 0x7fa3d00b0020 2021-06-25T04:47:44.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3d5a61700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3b00554e0 0x7fa3b00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3d6262700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x7fa3b005cee0 0x7fa3b005f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3d6262700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x7fa3b005cee0 0x7fa3b005f300 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3d5a61700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3b00554e0 0x7fa3b00579a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa3c4019000 tx=0x7fa3c4015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.659+0000 7fa3ceffd700 1 -- 172.21.15.57:0/3134579141 <== osd.0 v2:172.21.15.57:6800/15205 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fa3b005f8c0 con 0x7fa3b005cee0 2021-06-25T04:47:44.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.679+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3134579141 --> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3d00acfc0 con 0x7fa3b005cee0 2021-06-25T04:47:44.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.679+0000 7fa3ceffd700 1 -- 172.21.15.57:0/3134579141 <== osd.0 v2:172.21.15.57:6800/15205 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3c8000e90 con 0x7fa3b005cee0 2021-06-25T04:47:44.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.683+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3134579141 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x7fa3b005cee0 msgr2=0x7fa3b005f300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.683+0000 7fa3d7cc5700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x7fa3b005cee0 0x7fa3b005f300 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.683+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3b00554e0 msgr2=0x7fa3b00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.683+0000 7fa3d7cc5700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3b00554e0 0x7fa3b00579a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa3c4019000 tx=0x7fa3c4015000).stop 2021-06-25T04:47:44.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.683+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3134579141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d00b0020 msgr2=0x7fa3d0156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.683+0000 7fa3d7cc5700 1 --2- 172.21.15.57:0/3134579141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d00b0020 0x7fa3d0156d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa3d006a0a0 tx=0x7fa3c0007f70).stop 2021-06-25T04:47:44.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.683+0000 7fa3d6262700 1 -- 172.21.15.57:0/3134579141 reap_dead start 2021-06-25T04:47:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.683+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3134579141 shutdown_connections 2021-06-25T04:47:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.683+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3134579141 >> 172.21.15.57:0/3134579141 conn(0x7fa3d00b53a0 msgr2=0x7fa3d00667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.683+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3134579141 shutdown_connections 2021-06-25T04:47:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.683+0000 7fa3d7cc5700 1 -- 172.21.15.57:0/3134579141 wait complete. 2021-06-25T04:47:44.707 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2021-06-25T04:47:44.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-06-25T04:47:44.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18e1ca700 1 Processor -- start 2021-06-25T04:47:44.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18e1ca700 1 -- start start 2021-06-25T04:47:44.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18e1ca700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1880b2cb0 0x7fc1880b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18e1ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc188143f70 0x7fc1880b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18e1ca700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1880b2230 con 0x7fc188064b00 2021-06-25T04:47:44.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18e1ca700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1880621f0 con 0x7fc188143f70 2021-06-25T04:47:44.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18e1ca700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc188064ee0 con 0x7fc1880b2cb0 2021-06-25T04:47:44.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18d9c9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc188143f70 0x7fc1880b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18d1c8700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc188064b00 0x7fc188143860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52514/0 (socket says 172.21.15.57:52514) 2021-06-25T04:47:44.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18d1c8700 1 -- 172.21.15.57:0/208402882 learned_addr learned my addr 172.21.15.57:0/208402882 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:44.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18c9c7700 1 --2- 172.21.15.57:0/208402882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1880b2cb0 0x7fc1880b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc17bfff700 1 -- 172.21.15.57:0/208402882 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852398923 0 0) 0x7fc1880b2230 con 0x7fc188064b00 2021-06-25T04:47:44.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc17bfff700 1 -- 172.21.15.57:0/208402882 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc16c003260 con 0x7fc188064b00 2021-06-25T04:47:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18d9c9700 1 -- 172.21.15.57:0/208402882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1880b2cb0 msgr2=0x7fc1880b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18d9c9700 1 --2- 172.21.15.57:0/208402882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1880b2cb0 0x7fc1880b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18d9c9700 1 -- 172.21.15.57:0/208402882 >> v1:172.21.15.57:6789/0 conn(0x7fc188064b00 legacy=0x7fc188143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18d9c9700 1 -- 172.21.15.57:0/208402882 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188065720 con 0x7fc188143f70 2021-06-25T04:47:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18d9c9700 1 --2- 172.21.15.57:0/208402882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc188143f70 0x7fc1880b36e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc184002f70 tx=0x7fc184006df0).ready entity=mon.0 client_cookie=56fdd361088b1cde server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc17bfff700 1 -- 172.21.15.57:0/208402882 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc18400d4a0 con 0x7fc188143f70 2021-06-25T04:47:44.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc17bfff700 1 -- 172.21.15.57:0/208402882 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc184000e90 con 0x7fc188143f70 2021-06-25T04:47:44.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc17bfff700 1 -- 172.21.15.57:0/208402882 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc18400d7f0 con 0x7fc188143f70 2021-06-25T04:47:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18e1ca700 1 -- 172.21.15.57:0/208402882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc188143f70 msgr2=0x7fc1880b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.815+0000 7fc18e1ca700 1 --2- 172.21.15.57:0/208402882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc188143f70 0x7fc1880b36e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc184002f70 tx=0x7fc184006df0).stop 2021-06-25T04:47:44.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.819+0000 7fc18e1ca700 1 -- 172.21.15.57:0/208402882 shutdown_connections 2021-06-25T04:47:44.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.819+0000 7fc18e1ca700 1 --2- 172.21.15.57:0/208402882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1880b2cb0 0x7fc1880b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.819+0000 7fc18e1ca700 1 --2- 172.21.15.57:0/208402882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc188143f70 0x7fc1880b36e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.819+0000 7fc18e1ca700 1 -- 172.21.15.57:0/208402882 >> 172.21.15.57:0/208402882 conn(0x7fc188062ba0 msgr2=0x7fc18805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:44.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.819+0000 7fc18e1ca700 1 -- 172.21.15.57:0/208402882 shutdown_connections 2021-06-25T04:47:44.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.819+0000 7fc18e1ca700 1 -- 172.21.15.57:0/208402882 wait complete. 2021-06-25T04:47:44.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.819+0000 7fc18e1ca700 1 Processor -- start 2021-06-25T04:47:44.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.819+0000 7fc18e1ca700 1 -- start start 2021-06-25T04:47:44.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18e1ca700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc188064b00 0x7fc1880a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18e1ca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1880b2cb0 0x7fc188140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18e1ca700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188143f70 0x7fc188140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18e1ca700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1881443b0 con 0x7fc1880b2cb0 2021-06-25T04:47:44.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18e1ca700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc188152900 con 0x7fc188143f70 2021-06-25T04:47:44.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18e1ca700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc188152ba0 con 0x7fc188064b00 2021-06-25T04:47:44.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18c9c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1880b2cb0 0x7fc188140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18c9c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1880b2cb0 0x7fc188140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35302/0 (socket says 172.21.15.57:35302) 2021-06-25T04:47:44.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18c9c7700 1 -- 172.21.15.57:0/2146486342 learned_addr learned my addr 172.21.15.57:0/2146486342 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:44.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18d1c8700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc188064b00 0x7fc1880a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18d9c9700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188143f70 0x7fc188140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18c9c7700 1 -- 172.21.15.57:0/2146486342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc188064b00 msgr2=0x7fc1880a33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18c9c7700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc188064b00 0x7fc1880a33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18c9c7700 1 -- 172.21.15.57:0/2146486342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188143f70 msgr2=0x7fc188140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18c9c7700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188143f70 0x7fc188140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18c9c7700 1 -- 172.21.15.57:0/2146486342 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18400b180 con 0x7fc1880b2cb0 2021-06-25T04:47:44.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18c9c7700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1880b2cb0 0x7fc188140640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc18000c000 tx=0x7fc1800091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc17a7fc700 1 -- 172.21.15.57:0/2146486342 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc180006030 con 0x7fc1880b2cb0 2021-06-25T04:47:44.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc17a7fc700 1 -- 172.21.15.57:0/2146486342 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc180006190 con 0x7fc1880b2cb0 2021-06-25T04:47:44.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18e1ca700 1 -- 172.21.15.57:0/2146486342 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc188144610 con 0x7fc1880b2cb0 2021-06-25T04:47:44.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc17a7fc700 1 -- 172.21.15.57:0/2146486342 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1800064f0 con 0x7fc1880b2cb0 2021-06-25T04:47:44.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18e1ca700 1 -- 172.21.15.57:0/2146486342 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc188141020 con 0x7fc1880b2cb0 2021-06-25T04:47:44.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.823+0000 7fc18e1ca700 1 -- 172.21.15.57:0/2146486342 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc188057310 con 0x7fc1880b2cb0 2021-06-25T04:47:44.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.827+0000 7fc17a7fc700 1 -- 172.21.15.57:0/2146486342 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc180006650 con 0x7fc1880b2cb0 2021-06-25T04:47:44.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.827+0000 7fc17a7fc700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc170055450 0x7fc170057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.827+0000 7fc17a7fc700 1 -- 172.21.15.57:0/2146486342 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc18006f0a0 con 0x7fc1880b2cb0 2021-06-25T04:47:44.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.827+0000 7fc18d1c8700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc170055450 0x7fc170057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.827+0000 7fc17a7fc700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] conn(0x7fc17005ced0 0x7fc17005f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.827+0000 7fc17a7fc700 1 -- 172.21.15.57:0/2146486342 --> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc17005f8b0 con 0x7fc17005ced0 2021-06-25T04:47:44.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.827+0000 7fc17a7fc700 1 -- 172.21.15.57:0/2146486342 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc18006f480 con 0x7fc1880b2cb0 2021-06-25T04:47:44.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.827+0000 7fc18d9c9700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] conn(0x7fc17005ced0 0x7fc17005f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.827+0000 7fc18d1c8700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc170055450 0x7fc170057910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc17c00d000 tx=0x7fc17c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.827+0000 7fc18d9c9700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] conn(0x7fc17005ced0 0x7fc17005f2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.827+0000 7fc17a7fc700 1 -- 172.21.15.57:0/2146486342 <== osd.1 v2:172.21.15.57:6808/15206 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fc17005f8b0 con 0x7fc17005ced0 2021-06-25T04:47:44.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18e1ca700 1 -- 172.21.15.57:0/2146486342 --> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc1880a3c30 con 0x7fc17005ced0 2021-06-25T04:47:44.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc17a7fc700 1 -- 172.21.15.57:0/2146486342 <== osd.1 v2:172.21.15.57:6808/15206 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc184000e90 con 0x7fc17005ced0 2021-06-25T04:47:44.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18e1ca700 1 -- 172.21.15.57:0/2146486342 >> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] conn(0x7fc17005ced0 msgr2=0x7fc17005f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18e1ca700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] conn(0x7fc17005ced0 0x7fc17005f2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18e1ca700 1 -- 172.21.15.57:0/2146486342 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc170055450 msgr2=0x7fc170057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18e1ca700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc170055450 0x7fc170057910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc17c00d000 tx=0x7fc17c009040).stop 2021-06-25T04:47:44.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18e1ca700 1 -- 172.21.15.57:0/2146486342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1880b2cb0 msgr2=0x7fc188140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18e1ca700 1 --2- 172.21.15.57:0/2146486342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1880b2cb0 0x7fc188140640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc18000c000 tx=0x7fc1800091a0).stop 2021-06-25T04:47:44.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18d9c9700 1 -- 172.21.15.57:0/2146486342 reap_dead start 2021-06-25T04:47:44.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18e1ca700 1 -- 172.21.15.57:0/2146486342 shutdown_connections 2021-06-25T04:47:44.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18e1ca700 1 -- 172.21.15.57:0/2146486342 >> 172.21.15.57:0/2146486342 conn(0x7fc188062ba0 msgr2=0x7fc18805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:44.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18e1ca700 1 -- 172.21.15.57:0/2146486342 shutdown_connections 2021-06-25T04:47:44.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.847+0000 7fc18e1ca700 1 -- 172.21.15.57:0/2146486342 wait complete. 2021-06-25T04:47:44.867 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2021-06-25T04:47:44.868 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-06-25T04:47:44.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f492a5b9700 1 Processor -- start 2021-06-25T04:47:44.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f492a5b9700 1 -- start start 2021-06-25T04:47:44.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f492a5b9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4924060cc0 0x7f49240aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f492a5b9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49240afd40 0x7f4924143420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:44.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f492a5b9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49240671a0 con 0x7f4924066dc0 2021-06-25T04:47:44.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f492a5b9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49240b0150 con 0x7f4924060cc0 2021-06-25T04:47:44.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f492a5b9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240a9410 con 0x7f49240afd40 2021-06-25T04:47:44.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f49237fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4924060cc0 0x7f49240aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f4923fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4924066dc0 0x7f49240aa7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52528/0 (socket says 172.21.15.57:52528) 2021-06-25T04:47:44.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f4923fff700 1 -- 172.21.15.57:0/620604749 learned_addr learned my addr 172.21.15.57:0/620604749 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:44.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f4928b56700 1 --2- 172.21.15.57:0/620604749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49240afd40 0x7f4924143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:44.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f49237fe700 1 -- 172.21.15.57:0/620604749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49240afd40 msgr2=0x7f4924143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:44.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f49237fe700 1 --2- 172.21.15.57:0/620604749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49240afd40 0x7f4924143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f4922ffd700 1 -- 172.21.15.57:0/620604749 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686264521 0 0) 0x7f49240671a0 con 0x7f4924066dc0 2021-06-25T04:47:44.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f49237fe700 1 -- 172.21.15.57:0/620604749 >> v1:172.21.15.57:6789/0 conn(0x7f4924066dc0 legacy=0x7f49240aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.979+0000 7f49237fe700 1 -- 172.21.15.57:0/620604749 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240b0370 con 0x7f4924060cc0 2021-06-25T04:47:44.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f49237fe700 1 --2- 172.21.15.57:0/620604749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4924060cc0 0x7f49240aaed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f49140032f0 tx=0x7f49140091d0).ready entity=mon.0 client_cookie=ecba907765deae01 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f4922ffd700 1 -- 172.21.15.57:0/620604749 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f491400b6c0 con 0x7f4924060cc0 2021-06-25T04:47:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f4922ffd700 1 -- 172.21.15.57:0/620604749 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491400b820 con 0x7f4924060cc0 2021-06-25T04:47:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f4922ffd700 1 -- 172.21.15.57:0/620604749 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f491400b990 con 0x7f4924060cc0 2021-06-25T04:47:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 -- 172.21.15.57:0/620604749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4924060cc0 msgr2=0x7f49240aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:44.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 --2- 172.21.15.57:0/620604749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4924060cc0 0x7f49240aaed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f49140032f0 tx=0x7f49140091d0).stop 2021-06-25T04:47:44.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 -- 172.21.15.57:0/620604749 shutdown_connections 2021-06-25T04:47:44.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 --2- 172.21.15.57:0/620604749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49240afd40 0x7f4924143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 --2- 172.21.15.57:0/620604749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4924060cc0 0x7f49240aaed0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:44.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 -- 172.21.15.57:0/620604749 >> 172.21.15.57:0/620604749 conn(0x7f49240b53a0 msgr2=0x7f49240b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 -- 172.21.15.57:0/620604749 shutdown_connections 2021-06-25T04:47:45.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 -- 172.21.15.57:0/620604749 wait complete. 2021-06-25T04:47:45.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 Processor -- start 2021-06-25T04:47:45.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 -- start start 2021-06-25T04:47:45.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4924060cc0 0x7f49240aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4924066dc0 0x7f49240b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49240afd40 0x7f4924146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.983+0000 7f492a5b9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240ad280 con 0x7f4924060cc0 2021-06-25T04:47:45.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f492a5b9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4924146570 con 0x7f49240afd40 2021-06-25T04:47:45.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f492a5b9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240a9100 con 0x7f4924066dc0 2021-06-25T04:47:45.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f4923fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4924060cc0 0x7f49240aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f49237fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4924066dc0 0x7f49240b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f4923fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4924060cc0 0x7f49240aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35316/0 (socket says 172.21.15.57:35316) 2021-06-25T04:47:45.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f4928b56700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49240afd40 0x7f4924146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f49237fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4924066dc0 0x7f49240b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:46482/0 (socket says 172.21.15.57:46482) 2021-06-25T04:47:45.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f4923fff700 1 -- 172.21.15.57:0/3367914503 learned_addr learned my addr 172.21.15.57:0/3367914503 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:45.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f4923fff700 1 -- 172.21.15.57:0/3367914503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4924066dc0 msgr2=0x7f49240b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f4923fff700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4924066dc0 0x7f49240b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f4923fff700 1 -- 172.21.15.57:0/3367914503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49240afd40 msgr2=0x7f4924146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f4923fff700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49240afd40 0x7f4924146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f4923fff700 1 -- 172.21.15.57:0/3367914503 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914009470 con 0x7f4924060cc0 2021-06-25T04:47:45.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f4928b56700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49240afd40 0x7f4924146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:45.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f4923fff700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4924060cc0 0x7f49240aecb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f49240af1d0 tx=0x7f490c007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f49217fa700 1 -- 172.21.15.57:0/3367914503 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f490c0070d0 con 0x7f4924060cc0 2021-06-25T04:47:45.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f49217fa700 1 -- 172.21.15.57:0/3367914503 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c007230 con 0x7f4924060cc0 2021-06-25T04:47:45.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f492a5b9700 1 -- 172.21.15.57:0/3367914503 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4924145d90 con 0x7f4924060cc0 2021-06-25T04:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f49217fa700 1 -- 172.21.15.57:0/3367914503 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f490c005610 con 0x7f4924060cc0 2021-06-25T04:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f492a5b9700 1 -- 172.21.15.57:0/3367914503 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4924147430 con 0x7f4924060cc0 2021-06-25T04:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f492a5b9700 1 -- 172.21.15.57:0/3367914503 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49241463e0 con 0x7f4924060cc0 2021-06-25T04:47:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.987+0000 7f49217fa700 1 -- 172.21.15.57:0/3367914503 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f490c010070 con 0x7f4924060cc0 2021-06-25T04:47:45.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.991+0000 7f49217fa700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f49080553f0 0x7f49080578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.991+0000 7f49217fa700 1 -- 172.21.15.57:0/3367914503 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f490c06d550 con 0x7f4924060cc0 2021-06-25T04:47:45.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.991+0000 7f49237fe700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f49080553f0 0x7f49080578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.991+0000 7f49217fa700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] conn(0x7f490805ce70 0x7f490805f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.991+0000 7f49217fa700 1 -- 172.21.15.57:0/3367914503 --> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f490805f8f0 con 0x7f490805ce70 2021-06-25T04:47:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.991+0000 7f49217fa700 1 -- 172.21.15.57:0/3367914503 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f490c06fbe0 con 0x7f4924060cc0 2021-06-25T04:47:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.991+0000 7f4928b56700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] conn(0x7f490805ce70 0x7f490805f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.991+0000 7f49237fe700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f49080553f0 0x7f49080578b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f491401b000 tx=0x7f4914016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.991+0000 7f4928b56700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] conn(0x7f490805ce70 0x7f490805f290 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:44.991+0000 7f49217fa700 1 -- 172.21.15.57:0/3367914503 <== osd.2 v2:172.21.15.57:6824/15216 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f490805f8f0 con 0x7f490805ce70 2021-06-25T04:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.007+0000 7f492a5b9700 1 -- 172.21.15.57:0/3367914503 --> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f49240ae730 con 0x7f490805ce70 2021-06-25T04:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.007+0000 7f49217fa700 1 -- 172.21.15.57:0/3367914503 <== osd.2 v2:172.21.15.57:6824/15216 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f49240ae730 con 0x7f490805ce70 2021-06-25T04:47:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.011+0000 7f492a5b9700 1 -- 172.21.15.57:0/3367914503 >> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] conn(0x7f490805ce70 msgr2=0x7f490805f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.011+0000 7f492a5b9700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] conn(0x7f490805ce70 0x7f490805f290 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.011+0000 7f492a5b9700 1 -- 172.21.15.57:0/3367914503 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f49080553f0 msgr2=0x7f49080578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.011+0000 7f492a5b9700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f49080553f0 0x7f49080578b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f491401b000 tx=0x7f4914016000).stop 2021-06-25T04:47:45.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.011+0000 7f492a5b9700 1 -- 172.21.15.57:0/3367914503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4924060cc0 msgr2=0x7f49240aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.011+0000 7f492a5b9700 1 --2- 172.21.15.57:0/3367914503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4924060cc0 0x7f49240aecb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f49240af1d0 tx=0x7f490c007a60).stop 2021-06-25T04:47:45.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.011+0000 7f4928b56700 1 -- 172.21.15.57:0/3367914503 reap_dead start 2021-06-25T04:47:45.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.011+0000 7f492a5b9700 1 -- 172.21.15.57:0/3367914503 shutdown_connections 2021-06-25T04:47:45.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.011+0000 7f492a5b9700 1 -- 172.21.15.57:0/3367914503 >> 172.21.15.57:0/3367914503 conn(0x7f49240b53a0 msgr2=0x7f4924141350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.011+0000 7f492a5b9700 1 -- 172.21.15.57:0/3367914503 shutdown_connections 2021-06-25T04:47:45.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.011+0000 7f492a5b9700 1 -- 172.21.15.57:0/3367914503 wait complete. 2021-06-25T04:47:45.029 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2021-06-25T04:47:45.029 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-06-25T04:47:45.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.135+0000 7f08427a5700 1 Processor -- start 2021-06-25T04:47:45.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.135+0000 7f08427a5700 1 -- start start 2021-06-25T04:47:45.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.135+0000 7f08427a5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f083c0ad110 0x7f083c0b1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.135+0000 7f08427a5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f083c0a9d60 0x7f083c140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.135+0000 7f08427a5700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083c0ac330 con 0x7f083c0aa820 2021-06-25T04:47:45.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.135+0000 7f08427a5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083c0abb10 con 0x7f083c0a9d60 2021-06-25T04:47:45.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.135+0000 7f08427a5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083c0aac00 con 0x7f083c0ad110 2021-06-25T04:47:45.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.135+0000 7f0840d42700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f083c0a9d60 0x7f083c140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.135+0000 7f0840d42700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f083c0a9d60 0x7f083c140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35330/0 (socket says 172.21.15.57:35330) 2021-06-25T04:47:45.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.135+0000 7f0840d42700 1 -- 172.21.15.57:0/622039772 learned_addr learned my addr 172.21.15.57:0/622039772 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:45.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.135+0000 7f083b7fe700 1 --2- 172.21.15.57:0/622039772 >> v2:172.21.15.87:3300/0 conn(0x7f083c0ad110 0x7f083c0b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f0840d42700 1 -- 172.21.15.57:0/622039772 >> v2:172.21.15.87:3300/0 conn(0x7f083c0ad110 msgr2=0x7f083c0b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:45.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f0840d42700 1 --2- 172.21.15.57:0/622039772 >> v2:172.21.15.87:3300/0 conn(0x7f083c0ad110 0x7f083c0b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f0840d42700 1 -- 172.21.15.57:0/622039772 >> v1:172.21.15.87:6789/0 conn(0x7f083c0aa820 legacy=0x7f083c0aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f0840d42700 1 -- 172.21.15.57:0/622039772 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c0b1670 con 0x7f083c0a9d60 2021-06-25T04:47:45.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f0840d42700 1 --2- 172.21.15.57:0/622039772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f083c0a9d60 0x7f083c140300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f08340032f0 tx=0x7f0834009290).ready entity=mon.0 client_cookie=3ef7c3cafcd03d91 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f083affd700 1 -- 172.21.15.57:0/622039772 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f083400b870 con 0x7f083c0a9d60 2021-06-25T04:47:45.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f083affd700 1 -- 172.21.15.57:0/622039772 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083400b9d0 con 0x7f083c0a9d60 2021-06-25T04:47:45.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f083affd700 1 -- 172.21.15.57:0/622039772 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f083400bb40 con 0x7f083c0a9d60 2021-06-25T04:47:45.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f08427a5700 1 -- 172.21.15.57:0/622039772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f083c0a9d60 msgr2=0x7f083c140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f08427a5700 1 --2- 172.21.15.57:0/622039772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f083c0a9d60 0x7f083c140300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f08340032f0 tx=0x7f0834009290).stop 2021-06-25T04:47:45.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f08427a5700 1 -- 172.21.15.57:0/622039772 shutdown_connections 2021-06-25T04:47:45.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f08427a5700 1 --2- 172.21.15.57:0/622039772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f083c0a9d60 0x7f083c140300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f08427a5700 1 --2- 172.21.15.57:0/622039772 >> v2:172.21.15.87:3300/0 conn(0x7f083c0ad110 0x7f083c0b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f08427a5700 1 -- 172.21.15.57:0/622039772 >> 172.21.15.57:0/622039772 conn(0x7f083c0b6490 msgr2=0x7f083c0b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f08427a5700 1 -- 172.21.15.57:0/622039772 shutdown_connections 2021-06-25T04:47:45.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f08427a5700 1 -- 172.21.15.57:0/622039772 wait complete. 2021-06-25T04:47:45.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f08427a5700 1 Processor -- start 2021-06-25T04:47:45.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.139+0000 7f08427a5700 1 -- start start 2021-06-25T04:47:45.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f08427a5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c0a9d60 0x7f083c148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f08427a5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f083c0aa820 0x7f083c0637c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f08427a5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f083c0ad110 0x7f083c0a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f08427a5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c0af060 con 0x7f083c0aa820 2021-06-25T04:47:45.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f08427a5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c0aff10 con 0x7f083c0a9d60 2021-06-25T04:47:45.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f08427a5700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c0af290 con 0x7f083c0ad110 2021-06-25T04:47:45.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f083b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f083c0aa820 0x7f083c0637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f083b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f083c0aa820 0x7f083c0637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35334/0 (socket says 172.21.15.57:35334) 2021-06-25T04:47:45.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f083b7fe700 1 -- 172.21.15.57:0/342663123 learned_addr learned my addr 172.21.15.57:0/342663123 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:45.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f0840d42700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f083c0ad110 0x7f083c0a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f083bfff700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c0a9d60 0x7f083c148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f083b7fe700 1 -- 172.21.15.57:0/342663123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f083c0ad110 msgr2=0x7f083c0a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f083b7fe700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f083c0ad110 0x7f083c0a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f083b7fe700 1 -- 172.21.15.57:0/342663123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c0a9d60 msgr2=0x7f083c148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f083b7fe700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c0a9d60 0x7f083c148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f083b7fe700 1 -- 172.21.15.57:0/342663123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834009530 con 0x7f083c0aa820 2021-06-25T04:47:45.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f083b7fe700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f083c0aa820 0x7f083c0637c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f082c00c000 tx=0x7f082c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f08397fa700 1 -- 172.21.15.57:0/342663123 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f082c011750 con 0x7f083c0aa820 2021-06-25T04:47:45.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f08397fa700 1 -- 172.21.15.57:0/342663123 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c0118b0 con 0x7f083c0aa820 2021-06-25T04:47:45.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f08427a5700 1 -- 172.21.15.57:0/342663123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083c0af530 con 0x7f083c0aa820 2021-06-25T04:47:45.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f08397fa700 1 -- 172.21.15.57:0/342663123 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f082c011c10 con 0x7f083c0aa820 2021-06-25T04:47:45.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.143+0000 7f08427a5700 1 -- 172.21.15.57:0/342663123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083c0afa70 con 0x7f083c0aa820 2021-06-25T04:47:45.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f08427a5700 1 -- 172.21.15.57:0/342663123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f083c0a3c50 con 0x7f083c0aa820 2021-06-25T04:47:45.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f08397fa700 1 -- 172.21.15.57:0/342663123 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f082c011d70 con 0x7f083c0aa820 2021-06-25T04:47:45.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f08397fa700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f081c055450 0x7f081c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f08397fa700 1 -- 172.21.15.57:0/342663123 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f082c06e2a0 con 0x7f083c0aa820 2021-06-25T04:47:45.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f08397fa700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] conn(0x7f081c05ced0 0x7f081c05f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f08397fa700 1 -- 172.21.15.57:0/342663123 --> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f081c05f8b0 con 0x7f081c05ced0 2021-06-25T04:47:45.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f08397fa700 1 -- 172.21.15.57:0/342663123 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f082c070930 con 0x7f083c0aa820 2021-06-25T04:47:45.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f083bfff700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f081c055450 0x7f081c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f0840d42700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] conn(0x7f081c05ced0 0x7f081c05f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f0840d42700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] conn(0x7f081c05ced0 0x7f081c05f2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f083bfff700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f081c055450 0x7f081c057910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f083000d000 tx=0x7f0830000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.147+0000 7f08397fa700 1 -- 172.21.15.57:0/342663123 <== osd.3 v2:172.21.15.57:6816/15207 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f081c05f8b0 con 0x7f081c05ced0 2021-06-25T04:47:45.174 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08427a5700 1 -- 172.21.15.57:0/342663123 --> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f083c0a9650 con 0x7f081c05ced0 2021-06-25T04:47:45.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08397fa700 1 -- 172.21.15.57:0/342663123 <== osd.3 v2:172.21.15.57:6816/15207 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f083c0a9650 con 0x7f081c05ced0 2021-06-25T04:47:45.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08427a5700 1 -- 172.21.15.57:0/342663123 >> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] conn(0x7f081c05ced0 msgr2=0x7f081c05f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08427a5700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] conn(0x7f081c05ced0 0x7f081c05f2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08427a5700 1 -- 172.21.15.57:0/342663123 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f081c055450 msgr2=0x7f081c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08427a5700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f081c055450 0x7f081c057910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f083000d000 tx=0x7f0830000bc0).stop 2021-06-25T04:47:45.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08427a5700 1 -- 172.21.15.57:0/342663123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f083c0aa820 msgr2=0x7f083c0637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08427a5700 1 --2- 172.21.15.57:0/342663123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f083c0aa820 0x7f083c0637c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f082c00c000 tx=0x7f082c006df0).stop 2021-06-25T04:47:45.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f0840d42700 1 -- 172.21.15.57:0/342663123 reap_dead start 2021-06-25T04:47:45.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08427a5700 1 -- 172.21.15.57:0/342663123 shutdown_connections 2021-06-25T04:47:45.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08427a5700 1 -- 172.21.15.57:0/342663123 >> 172.21.15.57:0/342663123 conn(0x7f083c0b6490 msgr2=0x7f083c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08427a5700 1 -- 172.21.15.57:0/342663123 shutdown_connections 2021-06-25T04:47:45.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.167+0000 7f08427a5700 1 -- 172.21.15.57:0/342663123 wait complete. 2021-06-25T04:47:45.194 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2021-06-25T04:47:45.194 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-06-25T04:47:45.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5adda63700 1 Processor -- start 2021-06-25T04:47:45.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5adda63700 1 -- start start 2021-06-25T04:47:45.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5adda63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ad80ab120 0x7f5ad80672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5adda63700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad8065920 con 0x7f5ad80aad40 2021-06-25T04:47:45.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5adda63700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad8064ed0 con 0x7f5ad80b4d10 2021-06-25T04:47:45.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5adda63700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad80b3ca0 con 0x7f5ad80ab120 2021-06-25T04:47:45.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5ad7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ad80ab120 0x7f5ad80672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5ad7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ad80ab120 0x7f5ad80672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35342/0 (socket says 172.21.15.57:35342) 2021-06-25T04:47:45.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5ad7fff700 1 -- 172.21.15.57:0/119057695 learned_addr learned my addr 172.21.15.57:0/119057695 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:45.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5ad7fff700 1 -- 172.21.15.57:0/119057695 >> v1:172.21.15.87:6789/0 conn(0x7f5ad80b4d10 legacy=0x7f5ad80b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:45.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5ad7fff700 1 -- 172.21.15.57:0/119057695 >> v1:172.21.15.57:6789/0 conn(0x7f5ad80aad40 legacy=0x7f5ad80647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5ad7fff700 1 -- 172.21.15.57:0/119057695 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8066e20 con 0x7f5ad80ab120 2021-06-25T04:47:45.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5ad7fff700 1 --2- 172.21.15.57:0/119057695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80ab120 0x7f5ad80672c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5ad8063520 tx=0x7f5ac8006e50).ready entity=mon.0 client_cookie=359d66a20b054b1f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5ad77fe700 1 -- 172.21.15.57:0/119057695 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac800d610 con 0x7f5ad80ab120 2021-06-25T04:47:45.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5ad77fe700 1 -- 172.21.15.57:0/119057695 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac8000e90 con 0x7f5ad80ab120 2021-06-25T04:47:45.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5ad77fe700 1 -- 172.21.15.57:0/119057695 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac800d9a0 con 0x7f5ad80ab120 2021-06-25T04:47:45.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5adda63700 1 -- 172.21.15.57:0/119057695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80ab120 msgr2=0x7f5ad80672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.299+0000 7f5adda63700 1 --2- 172.21.15.57:0/119057695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80ab120 0x7f5ad80672c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5ad8063520 tx=0x7f5ac8006e50).stop 2021-06-25T04:47:45.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.303+0000 7f5adda63700 1 -- 172.21.15.57:0/119057695 shutdown_connections 2021-06-25T04:47:45.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.303+0000 7f5adda63700 1 --2- 172.21.15.57:0/119057695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80ab120 0x7f5ad80672c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.303+0000 7f5adda63700 1 -- 172.21.15.57:0/119057695 >> 172.21.15.57:0/119057695 conn(0x7f5ad8062ba0 msgr2=0x7f5ad805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.303+0000 7f5adda63700 1 -- 172.21.15.57:0/119057695 shutdown_connections 2021-06-25T04:47:45.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.303+0000 7f5adda63700 1 -- 172.21.15.57:0/119057695 wait complete. 2021-06-25T04:47:45.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.303+0000 7f5adda63700 1 Processor -- start 2021-06-25T04:47:45.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.303+0000 7f5adda63700 1 -- start start 2021-06-25T04:47:45.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adda63700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80aad40 0x7f5ad80613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adda63700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad80ab120 0x7f5ad8143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adda63700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ad80b4d10 0x7f5ad80b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adda63700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8062040 con 0x7f5ad80aad40 2021-06-25T04:47:45.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adda63700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8060f40 con 0x7f5ad80ab120 2021-06-25T04:47:45.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adda63700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8060780 con 0x7f5ad80b4d10 2021-06-25T04:47:45.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adca61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80aad40 0x7f5ad80613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adca61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80aad40 0x7f5ad80613a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35348/0 (socket says 172.21.15.57:35348) 2021-06-25T04:47:45.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adca61700 1 -- 172.21.15.57:0/3031814164 learned_addr learned my addr 172.21.15.57:0/3031814164 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:45.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5add262700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ad80b4d10 0x7f5ad80b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5ad7fff700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad80ab120 0x7f5ad8143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5add262700 1 -- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad80ab120 msgr2=0x7f5ad8143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5add262700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad80ab120 0x7f5ad8143800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5add262700 1 -- 172.21.15.57:0/3031814164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80aad40 msgr2=0x7f5ad80613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5add262700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80aad40 0x7f5ad80613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5add262700 1 -- 172.21.15.57:0/3031814164 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac800b1e0 con 0x7f5ad80b4d10 2021-06-25T04:47:45.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5add262700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ad80b4d10 0x7f5ad80b1300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5ad00032b0 tx=0x7f5ad0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5ad5ffb700 1 -- 172.21.15.57:0/3031814164 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ad000be20 con 0x7f5ad80b4d10 2021-06-25T04:47:45.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5ad5ffb700 1 -- 172.21.15.57:0/3031814164 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000e470 con 0x7f5ad80b4d10 2021-06-25T04:47:45.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adda63700 1 -- 172.21.15.57:0/3031814164 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad80b7df0 con 0x7f5ad80b4d10 2021-06-25T04:47:45.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5ad5ffb700 1 -- 172.21.15.57:0/3031814164 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ad000e7d0 con 0x7f5ad80b4d10 2021-06-25T04:47:45.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adda63700 1 -- 172.21.15.57:0/3031814164 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad8062270 con 0x7f5ad80b4d10 2021-06-25T04:47:45.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.307+0000 7f5adda63700 1 -- 172.21.15.57:0/3031814164 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ad80b79d0 con 0x7f5ad80b4d10 2021-06-25T04:47:45.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.311+0000 7f5ad5ffb700 1 -- 172.21.15.57:0/3031814164 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5ad0022070 con 0x7f5ad80b4d10 2021-06-25T04:47:45.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.311+0000 7f5ad5ffb700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ab8055490 0x7f5ab8057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.311+0000 7f5ad5ffb700 1 -- 172.21.15.57:0/3031814164 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5ad006e090 con 0x7f5ad80b4d10 2021-06-25T04:47:45.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.311+0000 7f5adca61700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ab8055490 0x7f5ab8057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.311+0000 7f5ad5ffb700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] conn(0x7f5ab805cf10 0x7f5ab805f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.311+0000 7f5ad5ffb700 1 -- 172.21.15.57:0/3031814164 --> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ab805f8f0 con 0x7f5ab805cf10 2021-06-25T04:47:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.311+0000 7f5ad5ffb700 1 -- 172.21.15.57:0/3031814164 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ad006e470 con 0x7f5ad80b4d10 2021-06-25T04:47:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.311+0000 7f5ad7fff700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] conn(0x7f5ab805cf10 0x7f5ab805f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.311+0000 7f5adca61700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ab8055490 0x7f5ab8057950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f5acc00d000 tx=0x7f5acc007be0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.311+0000 7f5ad7fff700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] conn(0x7f5ab805cf10 0x7f5ab805f330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.315+0000 7f5ad5ffb700 1 -- 172.21.15.57:0/3031814164 <== osd.4 v2:172.21.15.87:6808/15528 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f5ab805f8f0 con 0x7f5ab805cf10 2021-06-25T04:47:45.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.331+0000 7f5adda63700 1 -- 172.21.15.57:0/3031814164 --> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ad80b1ae0 con 0x7f5ab805cf10 2021-06-25T04:47:45.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.331+0000 7f5ad5ffb700 1 -- 172.21.15.57:0/3031814164 <== osd.4 v2:172.21.15.87:6808/15528 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ad80b1ae0 con 0x7f5ab805cf10 2021-06-25T04:47:45.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.335+0000 7f5adda63700 1 -- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] conn(0x7f5ab805cf10 msgr2=0x7f5ab805f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.335+0000 7f5adda63700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] conn(0x7f5ab805cf10 0x7f5ab805f330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.335+0000 7f5adda63700 1 -- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ab8055490 msgr2=0x7f5ab8057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.335+0000 7f5adda63700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ab8055490 0x7f5ab8057950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f5acc00d000 tx=0x7f5acc007be0).stop 2021-06-25T04:47:45.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.335+0000 7f5adda63700 1 -- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ad80b4d10 msgr2=0x7f5ad80b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.335+0000 7f5adda63700 1 --2- 172.21.15.57:0/3031814164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ad80b4d10 0x7f5ad80b1300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5ad00032b0 tx=0x7f5ad0009060).stop 2021-06-25T04:47:45.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.335+0000 7f5add262700 1 -- 172.21.15.57:0/3031814164 reap_dead start 2021-06-25T04:47:45.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.335+0000 7f5adda63700 1 -- 172.21.15.57:0/3031814164 shutdown_connections 2021-06-25T04:47:45.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.335+0000 7f5adda63700 1 -- 172.21.15.57:0/3031814164 >> 172.21.15.57:0/3031814164 conn(0x7f5ad8062ba0 msgr2=0x7f5ad81413e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.335+0000 7f5adda63700 1 -- 172.21.15.57:0/3031814164 shutdown_connections 2021-06-25T04:47:45.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.335+0000 7f5adda63700 1 -- 172.21.15.57:0/3031814164 wait complete. 2021-06-25T04:47:45.360 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2021-06-25T04:47:45.360 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-06-25T04:47:45.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81f06de700 1 Processor -- start 2021-06-25T04:47:45.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81f06de700 1 -- start start 2021-06-25T04:47:45.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81f06de700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f81e8066a80 0x7f81e80b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81f06de700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f81e80b2710 0x7f81e805fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81f06de700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e80b2e80 con 0x7f81e805f670 2021-06-25T04:47:45.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81f06de700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e80b0770 con 0x7f81e8066a80 2021-06-25T04:47:45.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81f06de700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e8061380 con 0x7f81e80b2710 2021-06-25T04:47:45.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81ee47a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f81e8066a80 0x7f81e80b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81ee47a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f81e8066a80 0x7f81e80b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35358/0 (socket says 172.21.15.57:35358) 2021-06-25T04:47:45.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81ee47a700 1 -- 172.21.15.57:0/1721680647 learned_addr learned my addr 172.21.15.57:0/1721680647 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:45.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81edc79700 1 --2- 172.21.15.57:0/1721680647 >> v2:172.21.15.87:3300/0 conn(0x7f81e80b2710 0x7f81e805fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81ee47a700 1 -- 172.21.15.57:0/1721680647 >> v2:172.21.15.87:3300/0 conn(0x7f81e80b2710 msgr2=0x7f81e805fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:45.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81ed478700 1 -- 172.21.15.57:0/1721680647 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396936093 0 0) 0x7f81e80b2e80 con 0x7f81e805f670 2021-06-25T04:47:45.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81ee47a700 1 --2- 172.21.15.57:0/1721680647 >> v2:172.21.15.87:3300/0 conn(0x7f81e80b2710 0x7f81e805fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81ee47a700 1 -- 172.21.15.57:0/1721680647 >> v1:172.21.15.57:6789/0 conn(0x7f81e805f670 legacy=0x7f81e8060230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81ee47a700 1 -- 172.21.15.57:0/1721680647 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e8066e60 con 0x7f81e8066a80 2021-06-25T04:47:45.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81ee47a700 1 --2- 172.21.15.57:0/1721680647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e8066a80 0x7f81e80b3550 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f81e4002f70 tx=0x7f81e4006eb0).ready entity=mon.0 client_cookie=fe3335592f1e0f41 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.463+0000 7f81ed478700 1 -- 172.21.15.57:0/1721680647 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e400d5c0 con 0x7f81e8066a80 2021-06-25T04:47:45.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81ed478700 1 -- 172.21.15.57:0/1721680647 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4000e90 con 0x7f81e8066a80 2021-06-25T04:47:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81ed478700 1 -- 172.21.15.57:0/1721680647 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e400d910 con 0x7f81e8066a80 2021-06-25T04:47:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81f06de700 1 -- 172.21.15.57:0/1721680647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e8066a80 msgr2=0x7f81e80b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81f06de700 1 --2- 172.21.15.57:0/1721680647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e8066a80 0x7f81e80b3550 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f81e4002f70 tx=0x7f81e4006eb0).stop 2021-06-25T04:47:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81f06de700 1 -- 172.21.15.57:0/1721680647 shutdown_connections 2021-06-25T04:47:45.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81f06de700 1 --2- 172.21.15.57:0/1721680647 >> v2:172.21.15.87:3300/0 conn(0x7f81e80b2710 0x7f81e805fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81f06de700 1 --2- 172.21.15.57:0/1721680647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e8066a80 0x7f81e80b3550 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81f06de700 1 -- 172.21.15.57:0/1721680647 >> 172.21.15.57:0/1721680647 conn(0x7f81e805c450 msgr2=0x7f81e805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81f06de700 1 -- 172.21.15.57:0/1721680647 shutdown_connections 2021-06-25T04:47:45.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81f06de700 1 -- 172.21.15.57:0/1721680647 wait complete. 2021-06-25T04:47:45.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81f06de700 1 Processor -- start 2021-06-25T04:47:45.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.467+0000 7f81f06de700 1 -- start start 2021-06-25T04:47:45.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81f06de700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81e805f670 0x7f81e80ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81f06de700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e8066a80 0x7f81e8140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81f06de700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81e80b2710 0x7f81e8141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81f06de700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e8065de0 con 0x7f81e8066a80 2021-06-25T04:47:45.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81f06de700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80a0260 con 0x7f81e80b2710 2021-06-25T04:47:45.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81f06de700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e809ffc0 con 0x7f81e805f670 2021-06-25T04:47:45.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81edc79700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e8066a80 0x7f81e8140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81edc79700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e8066a80 0x7f81e8140c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35366/0 (socket says 172.21.15.57:35366) 2021-06-25T04:47:45.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81edc79700 1 -- 172.21.15.57:0/3038504159 learned_addr learned my addr 172.21.15.57:0/3038504159 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:45.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81ee47a700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81e805f670 0x7f81e80ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81eec7b700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81e80b2710 0x7f81e8141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81edc79700 1 -- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81e805f670 msgr2=0x7f81e80ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81edc79700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81e805f670 0x7f81e80ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81edc79700 1 -- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81e80b2710 msgr2=0x7f81e8141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81edc79700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81e80b2710 0x7f81e8141110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81edc79700 1 -- 172.21.15.57:0/3038504159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e400b1e0 con 0x7f81e8066a80 2021-06-25T04:47:45.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81eec7b700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81e80b2710 0x7f81e8141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:45.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81edc79700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e8066a80 0x7f81e8140c20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f81d800c000 tx=0x7f81d8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81d77fe700 1 -- 172.21.15.57:0/3038504159 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d8010780 con 0x7f81e8066a80 2021-06-25T04:47:45.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81d77fe700 1 -- 172.21.15.57:0/3038504159 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d80108e0 con 0x7f81e8066a80 2021-06-25T04:47:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81f06de700 1 -- 172.21.15.57:0/3038504159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e8066040 con 0x7f81e8066a80 2021-06-25T04:47:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81d77fe700 1 -- 172.21.15.57:0/3038504159 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d8010c40 con 0x7f81e8066a80 2021-06-25T04:47:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81f06de700 1 -- 172.21.15.57:0/3038504159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e8141600 con 0x7f81e8066a80 2021-06-25T04:47:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81f06de700 1 -- 172.21.15.57:0/3038504159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81e80661d0 con 0x7f81e8066a80 2021-06-25T04:47:45.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.471+0000 7f81d77fe700 1 -- 172.21.15.57:0/3038504159 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f81d801c460 con 0x7f81e8066a80 2021-06-25T04:47:45.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.475+0000 7f81d77fe700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81c8055450 0x7f81c8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.475+0000 7f81d77fe700 1 -- 172.21.15.57:0/3038504159 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f81d806e2c0 con 0x7f81e8066a80 2021-06-25T04:47:45.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.475+0000 7f81d77fe700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] conn(0x7f81c805ced0 0x7f81c805f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.475+0000 7f81d77fe700 1 -- 172.21.15.57:0/3038504159 --> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81c805f8b0 con 0x7f81c805ced0 2021-06-25T04:47:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.475+0000 7f81d77fe700 1 -- 172.21.15.57:0/3038504159 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81d8070950 con 0x7f81e8066a80 2021-06-25T04:47:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.475+0000 7f81ee47a700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81c8055450 0x7f81c8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.475+0000 7f81eec7b700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] conn(0x7f81c805ced0 0x7f81c805f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.475+0000 7f81ee47a700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81c8055450 0x7f81c8057910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f81e401b000 tx=0x7f81e4015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.475+0000 7f81eec7b700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] conn(0x7f81c805ced0 0x7f81c805f2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.475+0000 7f81d77fe700 1 -- 172.21.15.57:0/3038504159 <== osd.5 v2:172.21.15.87:6824/15545 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f81c805f8b0 con 0x7f81c805ced0 2021-06-25T04:47:45.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.495+0000 7f81f06de700 1 -- 172.21.15.57:0/3038504159 --> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f81e8057310 con 0x7f81c805ced0 2021-06-25T04:47:45.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81d77fe700 1 -- 172.21.15.57:0/3038504159 <== osd.5 v2:172.21.15.87:6824/15545 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f81e8057310 con 0x7f81c805ced0 2021-06-25T04:47:45.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81f06de700 1 -- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] conn(0x7f81c805ced0 msgr2=0x7f81c805f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81f06de700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] conn(0x7f81c805ced0 0x7f81c805f2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81f06de700 1 -- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81c8055450 msgr2=0x7f81c8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81f06de700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81c8055450 0x7f81c8057910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f81e401b000 tx=0x7f81e4015000).stop 2021-06-25T04:47:45.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81f06de700 1 -- 172.21.15.57:0/3038504159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e8066a80 msgr2=0x7f81e8140c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81f06de700 1 --2- 172.21.15.57:0/3038504159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e8066a80 0x7f81e8140c20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f81d800c000 tx=0x7f81d8006df0).stop 2021-06-25T04:47:45.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81eec7b700 1 -- 172.21.15.57:0/3038504159 reap_dead start 2021-06-25T04:47:45.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81f06de700 1 -- 172.21.15.57:0/3038504159 shutdown_connections 2021-06-25T04:47:45.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81f06de700 1 -- 172.21.15.57:0/3038504159 >> 172.21.15.57:0/3038504159 conn(0x7f81e805c450 msgr2=0x7f81e80aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81f06de700 1 -- 172.21.15.57:0/3038504159 shutdown_connections 2021-06-25T04:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.499+0000 7f81f06de700 1 -- 172.21.15.57:0/3038504159 wait complete. 2021-06-25T04:47:45.523 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2021-06-25T04:47:45.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-06-25T04:47:45.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353b59e700 1 Processor -- start 2021-06-25T04:47:45.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353b59e700 1 -- start start 2021-06-25T04:47:45.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f353c061640 0x7f353c0b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353c0b46d0 0x7f353c0ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f353c143960 0x7f353c13fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353b59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353c0b9640 con 0x7f353c143960 2021-06-25T04:47:45.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353c0b68d0 con 0x7f353c061640 2021-06-25T04:47:45.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c0b6b70 con 0x7f353c0b46d0 2021-06-25T04:47:45.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f353c143960 0x7f353c13fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353a59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f353c061640 0x7f353c0b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f3539d9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353c0b46d0 0x7f353c0ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353a59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f353c061640 0x7f353c0b9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:43868/0 (socket says 172.21.15.57:43868) 2021-06-25T04:47:45.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353a59c700 1 -- 172.21.15.57:0/470980040 learned_addr learned my addr 172.21.15.57:0/470980040 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:45.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353ad9d700 1 -- 172.21.15.57:0/470980040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353c0b46d0 msgr2=0x7f353c0ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:45.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353ad9d700 1 --2- 172.21.15.57:0/470980040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353c0b46d0 0x7f353c0ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353ad9d700 1 -- 172.21.15.57:0/470980040 >> v2:172.21.15.87:3300/0 conn(0x7f353c061640 msgr2=0x7f353c0b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:45.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353ad9d700 1 --2- 172.21.15.57:0/470980040 >> v2:172.21.15.87:3300/0 conn(0x7f353c061640 0x7f353c0b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353ad9d700 1 -- 172.21.15.57:0/470980040 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c0b6e10 con 0x7f353c143960 2021-06-25T04:47:45.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353ad9d700 1 --2- 172.21.15.57:0/470980040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353c143960 0x7f353c13fd60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f3534002f70 tx=0x7f3534006df0).ready entity=mon.0 client_cookie=3b6df23870bbae17 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353959a700 1 -- 172.21.15.57:0/470980040 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f353400d4a0 con 0x7f353c143960 2021-06-25T04:47:45.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353959a700 1 -- 172.21.15.57:0/470980040 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3534000e90 con 0x7f353c143960 2021-06-25T04:47:45.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353959a700 1 -- 172.21.15.57:0/470980040 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f353400d7f0 con 0x7f353c143960 2021-06-25T04:47:45.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353b59e700 1 -- 172.21.15.57:0/470980040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353c143960 msgr2=0x7f353c13fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.631+0000 7f353b59e700 1 --2- 172.21.15.57:0/470980040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353c143960 0x7f353c13fd60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f3534002f70 tx=0x7f3534006df0).stop 2021-06-25T04:47:45.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 -- 172.21.15.57:0/470980040 shutdown_connections 2021-06-25T04:47:45.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 --2- 172.21.15.57:0/470980040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353c143960 0x7f353c13fd60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 --2- 172.21.15.57:0/470980040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353c0b46d0 0x7f353c0ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 --2- 172.21.15.57:0/470980040 >> v2:172.21.15.87:3300/0 conn(0x7f353c061640 0x7f353c0b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 -- 172.21.15.57:0/470980040 >> 172.21.15.57:0/470980040 conn(0x7f353c06adb0 msgr2=0x7f353c05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 -- 172.21.15.57:0/470980040 shutdown_connections 2021-06-25T04:47:45.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 -- 172.21.15.57:0/470980040 wait complete. 2021-06-25T04:47:45.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 Processor -- start 2021-06-25T04:47:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 -- start start 2021-06-25T04:47:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f353c061640 0x7f353c13fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353c143960 0x7f353c151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353c144190 0x7f353c1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c146470 con 0x7f353c144190 2021-06-25T04:47:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c0adaf0 con 0x7f353c061640 2021-06-25T04:47:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c148340 con 0x7f353c143960 2021-06-25T04:47:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353c144190 0x7f353c1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353c144190 0x7f353c1524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35384/0 (socket says 172.21.15.57:35384) 2021-06-25T04:47:45.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353ad9d700 1 -- 172.21.15.57:0/2777029498 learned_addr learned my addr 172.21.15.57:0/2777029498 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:45.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353a59c700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f353c061640 0x7f353c13fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f3539d9b700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353c143960 0x7f353c151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353ad9d700 1 -- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353c143960 msgr2=0x7f353c151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353ad9d700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353c143960 0x7f353c151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353ad9d700 1 -- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f353c061640 msgr2=0x7f353c13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353ad9d700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f353c061640 0x7f353c13fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353ad9d700 1 -- 172.21.15.57:0/2777029498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353400b180 con 0x7f353c144190 2021-06-25T04:47:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353ad9d700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353c144190 0x7f353c1524d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f353c1484d0 tx=0x7f3534014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f35337fe700 1 -- 172.21.15.57:0/2777029498 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3534012e40 con 0x7f353c144190 2021-06-25T04:47:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f35337fe700 1 -- 172.21.15.57:0/2777029498 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353400de50 con 0x7f353c144190 2021-06-25T04:47:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 -- 172.21.15.57:0/2777029498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353c0add50 con 0x7f353c144190 2021-06-25T04:47:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f35337fe700 1 -- 172.21.15.57:0/2777029498 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f353401f630 con 0x7f353c144190 2021-06-25T04:47:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.635+0000 7f353b59e700 1 -- 172.21.15.57:0/2777029498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353c0ae490 con 0x7f353c144190 2021-06-25T04:47:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.639+0000 7f353b59e700 1 -- 172.21.15.57:0/2777029498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f353c0ae1f0 con 0x7f353c144190 2021-06-25T04:47:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.639+0000 7f35337fe700 1 -- 172.21.15.57:0/2777029498 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3534025020 con 0x7f353c144190 2021-06-25T04:47:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.639+0000 7f35337fe700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35140554e0 0x7f35140579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.639+0000 7f35337fe700 1 -- 172.21.15.57:0/2777029498 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f353406ef20 con 0x7f353c144190 2021-06-25T04:47:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.639+0000 7f35337fe700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] conn(0x7f351405cee0 0x7f351405f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.639+0000 7f353a59c700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35140554e0 0x7f35140579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.639+0000 7f35337fe700 1 -- 172.21.15.57:0/2777029498 --> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f351405f8c0 con 0x7f351405cee0 2021-06-25T04:47:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.639+0000 7f35337fe700 1 -- 172.21.15.57:0/2777029498 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3534071590 con 0x7f353c144190 2021-06-25T04:47:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.643+0000 7f3539d9b700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] conn(0x7f351405cee0 0x7f351405f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.643+0000 7f353a59c700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35140554e0 0x7f35140579a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f352c00b000 tx=0x7f352c009290).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.643+0000 7f3539d9b700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] conn(0x7f351405cee0 0x7f351405f300 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.643+0000 7f35337fe700 1 -- 172.21.15.57:0/2777029498 <== osd.6 v2:172.21.15.87:6816/15529 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f351405f8c0 con 0x7f351405cee0 2021-06-25T04:47:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.663+0000 7f353b59e700 1 -- 172.21.15.57:0/2777029498 --> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f353c057310 con 0x7f351405cee0 2021-06-25T04:47:45.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.663+0000 7f35337fe700 1 -- 172.21.15.57:0/2777029498 <== osd.6 v2:172.21.15.87:6816/15529 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3524000e90 con 0x7f351405cee0 2021-06-25T04:47:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.663+0000 7f353b59e700 1 -- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] conn(0x7f351405cee0 msgr2=0x7f351405f300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.663+0000 7f353b59e700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] conn(0x7f351405cee0 0x7f351405f300 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.667+0000 7f353b59e700 1 -- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35140554e0 msgr2=0x7f35140579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.667+0000 7f353b59e700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35140554e0 0x7f35140579a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f352c00b000 tx=0x7f352c009290).stop 2021-06-25T04:47:45.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.667+0000 7f353b59e700 1 -- 172.21.15.57:0/2777029498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353c144190 msgr2=0x7f353c1524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.667+0000 7f353b59e700 1 --2- 172.21.15.57:0/2777029498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353c144190 0x7f353c1524d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f353c1484d0 tx=0x7f3534014000).stop 2021-06-25T04:47:45.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.667+0000 7f353ad9d700 1 -- 172.21.15.57:0/2777029498 reap_dead start 2021-06-25T04:47:45.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.667+0000 7f353b59e700 1 -- 172.21.15.57:0/2777029498 shutdown_connections 2021-06-25T04:47:45.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.667+0000 7f353b59e700 1 -- 172.21.15.57:0/2777029498 >> 172.21.15.57:0/2777029498 conn(0x7f353c06adb0 msgr2=0x7f353c0b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.667+0000 7f353b59e700 1 -- 172.21.15.57:0/2777029498 shutdown_connections 2021-06-25T04:47:45.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.667+0000 7f353b59e700 1 -- 172.21.15.57:0/2777029498 wait complete. 2021-06-25T04:47:45.686 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2021-06-25T04:47:45.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-06-25T04:47:45.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69457e700 1 Processor -- start 2021-06-25T04:47:45.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69457e700 1 -- start start 2021-06-25T04:47:45.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69457e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa68c0b77d0 0x7fa68c144560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69457e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0b3190 con 0x7fa68c0b1130 2021-06-25T04:47:45.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69457e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0b7bb0 con 0x7fa68c144a50 2021-06-25T04:47:45.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69457e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c144ee0 con 0x7fa68c0b77d0 2021-06-25T04:47:45.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa691b19700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa68c0b1130 0x7fa68c064830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52610/0 (socket says 172.21.15.57:52610) 2021-06-25T04:47:45.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa691b19700 1 -- 172.21.15.57:0/145657379 learned_addr learned my addr 172.21.15.57:0/145657379 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:45.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69231a700 1 --2- 172.21.15.57:0/145657379 >> v2:172.21.15.87:3300/0 conn(0x7fa68c0b77d0 0x7fa68c144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa691318700 1 -- 172.21.15.57:0/145657379 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740069735 0 0) 0x7fa68c0b3190 con 0x7fa68c0b1130 2021-06-25T04:47:45.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa691318700 1 -- 172.21.15.57:0/145657379 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa678003260 con 0x7fa68c0b1130 2021-06-25T04:47:45.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa691318700 1 -- 172.21.15.57:0/145657379 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873108349 0 0) 0x7fa68c0b7bb0 con 0x7fa68c144a50 2021-06-25T04:47:45.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa691318700 1 -- 172.21.15.57:0/145657379 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa68c0b3190 con 0x7fa68c144a50 2021-06-25T04:47:45.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69231a700 1 -- 172.21.15.57:0/145657379 >> v1:172.21.15.87:6789/0 conn(0x7fa68c144a50 legacy=0x7fa68c064f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69231a700 1 -- 172.21.15.57:0/145657379 >> v1:172.21.15.57:6789/0 conn(0x7fa68c0b1130 legacy=0x7fa68c064830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa691318700 1 -- 172.21.15.57:0/145657379 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4085335110 0 0) 0x7fa678003260 con 0x7fa68c0b1130 2021-06-25T04:47:45.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69231a700 1 -- 172.21.15.57:0/145657379 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c067580 con 0x7fa68c0b77d0 2021-06-25T04:47:45.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69231a700 1 --2- 172.21.15.57:0/145657379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa68c0b77d0 0x7fa68c144560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa684001490 tx=0x7fa688006df0).ready entity=mon.1 client_cookie=4660329291b0e4a2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa691318700 1 -- 172.21.15.57:0/145657379 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6840019e0 con 0x7fa68c0b77d0 2021-06-25T04:47:45.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa691318700 1 -- 172.21.15.57:0/145657379 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa688000e90 con 0x7fa68c0b77d0 2021-06-25T04:47:45.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa691318700 1 -- 172.21.15.57:0/145657379 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa688012460 con 0x7fa68c0b77d0 2021-06-25T04:47:45.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69457e700 1 -- 172.21.15.57:0/145657379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa68c0b77d0 msgr2=0x7fa68c144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.791+0000 7fa69457e700 1 --2- 172.21.15.57:0/145657379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa68c0b77d0 0x7fa68c144560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa684001490 tx=0x7fa688006df0).stop 2021-06-25T04:47:45.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.795+0000 7fa69457e700 1 -- 172.21.15.57:0/145657379 shutdown_connections 2021-06-25T04:47:45.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.795+0000 7fa69457e700 1 --2- 172.21.15.57:0/145657379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa68c0b77d0 0x7fa68c144560 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.795+0000 7fa69457e700 1 -- 172.21.15.57:0/145657379 >> 172.21.15.57:0/145657379 conn(0x7fa68c05f670 msgr2=0x7fa68c05fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.795+0000 7fa69457e700 1 -- 172.21.15.57:0/145657379 shutdown_connections 2021-06-25T04:47:45.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.795+0000 7fa69457e700 1 -- 172.21.15.57:0/145657379 wait complete. 2021-06-25T04:47:45.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.795+0000 7fa69457e700 1 Processor -- start 2021-06-25T04:47:45.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.795+0000 7fa69457e700 1 -- start start 2021-06-25T04:47:45.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.795+0000 7fa69457e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa68c0b1130 0x7fa68c0aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.795+0000 7fa69457e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa68c0b77d0 0x7fa68c1415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.795+0000 7fa69457e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa68c144a50 0x7fa68c14ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69457e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c153e00 con 0x7fa68c0b1130 2021-06-25T04:47:45.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69457e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c154070 con 0x7fa68c144a50 2021-06-25T04:47:45.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69457e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0ae7e0 con 0x7fa68c0b77d0 2021-06-25T04:47:45.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69231a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa68c0b1130 0x7fa68c0aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69231a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa68c0b1130 0x7fa68c0aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35396/0 (socket says 172.21.15.57:35396) 2021-06-25T04:47:45.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69231a700 1 -- 172.21.15.57:0/2744845800 learned_addr learned my addr 172.21.15.57:0/2744845800 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:45.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa691b19700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa68c0b77d0 0x7fa68c1415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa692b1b700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa68c144a50 0x7fa68c14ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69231a700 1 -- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa68c0b77d0 msgr2=0x7fa68c1415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69231a700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa68c0b77d0 0x7fa68c1415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69231a700 1 -- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa68c144a50 msgr2=0x7fa68c14ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69231a700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa68c144a50 0x7fa68c14ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69231a700 1 -- 172.21.15.57:0/2744845800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68800b180 con 0x7fa68c0b1130 2021-06-25T04:47:45.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69231a700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa68c0b1130 0x7fa68c0aef20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa684001490 tx=0x7fa688014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa6837fe700 1 -- 172.21.15.57:0/2744845800 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa688012460 con 0x7fa68c0b1130 2021-06-25T04:47:45.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa6837fe700 1 -- 172.21.15.57:0/2744845800 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68800dd20 con 0x7fa68c0b1130 2021-06-25T04:47:45.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69457e700 1 -- 172.21.15.57:0/2744845800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c0aea80 con 0x7fa68c0b1130 2021-06-25T04:47:45.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa6837fe700 1 -- 172.21.15.57:0/2744845800 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa68801e620 con 0x7fa68c0b1130 2021-06-25T04:47:45.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69457e700 1 -- 172.21.15.57:0/2744845800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c154310 con 0x7fa68c0b1130 2021-06-25T04:47:45.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.799+0000 7fa69457e700 1 -- 172.21.15.57:0/2744845800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa68c057310 con 0x7fa68c0b1130 2021-06-25T04:47:45.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.803+0000 7fa6837fe700 1 -- 172.21.15.57:0/2744845800 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa68800f030 con 0x7fa68c0b1130 2021-06-25T04:47:45.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.803+0000 7fa6837fe700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa66c055450 0x7fa66c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.803+0000 7fa6837fe700 1 -- 172.21.15.57:0/2744845800 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa68806ebe0 con 0x7fa68c0b1130 2021-06-25T04:47:45.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.803+0000 7fa6837fe700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] conn(0x7fa66c05ced0 0x7fa66c05f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.803+0000 7fa6837fe700 1 -- 172.21.15.57:0/2744845800 --> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa66c05f8b0 con 0x7fa66c05ced0 2021-06-25T04:47:45.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.803+0000 7fa6837fe700 1 -- 172.21.15.57:0/2744845800 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa688071270 con 0x7fa68c0b1130 2021-06-25T04:47:45.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.803+0000 7fa691b19700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa66c055450 0x7fa66c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.803+0000 7fa692b1b700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] conn(0x7fa66c05ced0 0x7fa66c05f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.803+0000 7fa691b19700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa66c055450 0x7fa66c057910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fa68400d000 tx=0x7fa684000f40).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.803+0000 7fa692b1b700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] conn(0x7fa66c05ced0 0x7fa66c05f2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.803+0000 7fa6837fe700 1 -- 172.21.15.57:0/2744845800 <== osd.7 v2:172.21.15.87:6800/15530 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fa66c05f8b0 con 0x7fa66c05ced0 2021-06-25T04:47:45.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa69457e700 1 -- 172.21.15.57:0/2744845800 --> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa68c1506d0 con 0x7fa66c05ced0 2021-06-25T04:47:45.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa6837fe700 1 -- 172.21.15.57:0/2744845800 <== osd.7 v2:172.21.15.87:6800/15530 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa68c1506d0 con 0x7fa66c05ced0 2021-06-25T04:47:45.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa69457e700 1 -- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] conn(0x7fa66c05ced0 msgr2=0x7fa66c05f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa69457e700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] conn(0x7fa66c05ced0 0x7fa66c05f2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa69457e700 1 -- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa66c055450 msgr2=0x7fa66c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa69457e700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa66c055450 0x7fa66c057910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fa68400d000 tx=0x7fa684000f40).stop 2021-06-25T04:47:45.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa69457e700 1 -- 172.21.15.57:0/2744845800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa68c0b1130 msgr2=0x7fa68c0aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa69457e700 1 --2- 172.21.15.57:0/2744845800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa68c0b1130 0x7fa68c0aef20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa684001490 tx=0x7fa688014000).stop 2021-06-25T04:47:45.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa692b1b700 1 -- 172.21.15.57:0/2744845800 reap_dead start 2021-06-25T04:47:45.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa69457e700 1 -- 172.21.15.57:0/2744845800 shutdown_connections 2021-06-25T04:47:45.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa69457e700 1 -- 172.21.15.57:0/2744845800 >> 172.21.15.57:0/2744845800 conn(0x7fa68c05f670 msgr2=0x7fa68c0b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa69457e700 1 -- 172.21.15.57:0/2744845800 shutdown_connections 2021-06-25T04:47:45.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.823+0000 7fa69457e700 1 -- 172.21.15.57:0/2744845800 wait complete. 2021-06-25T04:47:45.845 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2021-06-25T04:47:45.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-06-25T04:47:45.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.947+0000 7f5483b20700 1 Processor -- start 2021-06-25T04:47:45.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.947+0000 7f5483b20700 1 -- start start 2021-06-25T04:47:45.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f5483b20700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f547c13e910 0x7f547c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f5483b20700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c144d10 con 0x7f547c0ab810 2021-06-25T04:47:45.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f5483b20700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c144fb0 con 0x7f547c144590 2021-06-25T04:47:45.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f5483b20700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c1454f0 con 0x7f547c13e910 2021-06-25T04:47:45.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f54810bb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f547c13e910 0x7f547c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f54818bc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f547c0ab810 0x7f547c13e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52624/0 (socket says 172.21.15.57:52624) 2021-06-25T04:47:45.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f54818bc700 1 -- 172.21.15.57:0/2572581287 learned_addr learned my addr 172.21.15.57:0/2572581287 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:45.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f54810bb700 1 -- 172.21.15.57:0/2572581287 >> v1:172.21.15.87:6789/0 conn(0x7f547c144590 legacy=0x7f547c1413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f54810bb700 1 -- 172.21.15.57:0/2572581287 >> v1:172.21.15.57:6789/0 conn(0x7f547c0ab810 legacy=0x7f547c13e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f54810bb700 1 -- 172.21.15.57:0/2572581287 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c145250 con 0x7f547c13e910 2021-06-25T04:47:45.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f54810bb700 1 --2- 172.21.15.57:0/2572581287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f547c13e910 0x7f547c0b15c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f5470002f70 tx=0x7f5470006df0).ready entity=mon.0 client_cookie=8a440b40c971a8c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f54808ba700 1 -- 172.21.15.57:0/2572581287 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f547000d610 con 0x7f547c13e910 2021-06-25T04:47:45.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f54808ba700 1 -- 172.21.15.57:0/2572581287 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470000e90 con 0x7f547c13e910 2021-06-25T04:47:45.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f54808ba700 1 -- 172.21.15.57:0/2572581287 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f547000d960 con 0x7f547c13e910 2021-06-25T04:47:45.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f5483b20700 1 -- 172.21.15.57:0/2572581287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f547c13e910 msgr2=0x7f547c0b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f5483b20700 1 --2- 172.21.15.57:0/2572581287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f547c13e910 0x7f547c0b15c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f5470002f70 tx=0x7f5470006df0).stop 2021-06-25T04:47:45.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f5483b20700 1 -- 172.21.15.57:0/2572581287 shutdown_connections 2021-06-25T04:47:45.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f5483b20700 1 --2- 172.21.15.57:0/2572581287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f547c13e910 0x7f547c0b15c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f5483b20700 1 -- 172.21.15.57:0/2572581287 >> 172.21.15.57:0/2572581287 conn(0x7f547c0b53a0 msgr2=0x7f547c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:45.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f5483b20700 1 -- 172.21.15.57:0/2572581287 shutdown_connections 2021-06-25T04:47:45.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.951+0000 7f5483b20700 1 -- 172.21.15.57:0/2572581287 wait complete. 2021-06-25T04:47:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f5483b20700 1 Processor -- start 2021-06-25T04:47:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f5483b20700 1 -- start start 2021-06-25T04:47:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f5483b20700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f547c0ab810 0x7f547c13d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f5483b20700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f547c13e910 0x7f547c150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f5483b20700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f547c144590 0x7f547c150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f5483b20700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c150b70 con 0x7f547c0ab810 2021-06-25T04:47:45.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f5483b20700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0ae7f0 con 0x7f547c144590 2021-06-25T04:47:45.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f5483b20700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0aea90 con 0x7f547c13e910 2021-06-25T04:47:45.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54818bc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f547c0ab810 0x7f547c13d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54818bc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f547c0ab810 0x7f547c13d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35412/0 (socket says 172.21.15.57:35412) 2021-06-25T04:47:45.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54818bc700 1 -- 172.21.15.57:0/1938036171 learned_addr learned my addr 172.21.15.57:0/1938036171 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:45.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54810bb700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f547c13e910 0x7f547c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54820bd700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f547c144590 0x7f547c150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54818bc700 1 -- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f547c13e910 msgr2=0x7f547c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54818bc700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f547c13e910 0x7f547c150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54818bc700 1 -- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f547c144590 msgr2=0x7f547c150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54818bc700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f547c144590 0x7f547c150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54818bc700 1 -- 172.21.15.57:0/1938036171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547000b180 con 0x7f547c0ab810 2021-06-25T04:47:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54820bd700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f547c144590 0x7f547c150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:47:45.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f54818bc700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f547c0ab810 0x7f547c13d970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f547c06a0a0 tx=0x7f547400c890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f547affd700 1 -- 172.21.15.57:0/1938036171 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5474005ba0 con 0x7f547c0ab810 2021-06-25T04:47:45.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f547affd700 1 -- 172.21.15.57:0/1938036171 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474005d00 con 0x7f547c0ab810 2021-06-25T04:47:45.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f547affd700 1 -- 172.21.15.57:0/1938036171 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54740072c0 con 0x7f547c0ab810 2021-06-25T04:47:45.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f5483b20700 1 -- 172.21.15.57:0/1938036171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c0aed30 con 0x7f547c0ab810 2021-06-25T04:47:45.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.955+0000 7f5483b20700 1 -- 172.21.15.57:0/1938036171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c13e110 con 0x7f547c0ab810 2021-06-25T04:47:45.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.959+0000 7f5483b20700 1 -- 172.21.15.57:0/1938036171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c057310 con 0x7f547c0ab810 2021-06-25T04:47:45.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.959+0000 7f547affd700 1 -- 172.21.15.57:0/1938036171 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5474010070 con 0x7f547c0ab810 2021-06-25T04:47:45.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.959+0000 7f547affd700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f545c0553d0 0x7f545c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:45.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.959+0000 7f547affd700 1 -- 172.21.15.57:0/1938036171 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f547406d9b0 con 0x7f547c0ab810 2021-06-25T04:47:45.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.959+0000 7f54810bb700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f545c0553d0 0x7f545c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:45.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.959+0000 7f54810bb700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f545c0553d0 0x7f545c057890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f547001b000 tx=0x7f5470015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:45.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:45.967+0000 7f547affd700 1 -- 172.21.15.57:0/1938036171 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5474043b00 con 0x7f547c0ab810 2021-06-25T04:47:46.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.095+0000 7f5483b20700 1 -- 172.21.15.57:0/1938036171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f547c0698a0 con 0x7f547c0ab810 2021-06-25T04:47:46.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f547affd700 1 -- 172.21.15.57:0/1938036171 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5474047120 con 0x7f547c0ab810 2021-06-25T04:47:46.106 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2021-06-25T04:47:46.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 -- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f545c0553d0 msgr2=0x7f545c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:46.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f545c0553d0 0x7f545c057890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f547001b000 tx=0x7f5470015000).stop 2021-06-25T04:47:46.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 -- 172.21.15.57:0/1938036171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f547c0ab810 msgr2=0x7f547c13d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:46.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f547c0ab810 0x7f547c13d970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f547c06a0a0 tx=0x7f547400c890).stop 2021-06-25T04:47:46.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 -- 172.21.15.57:0/1938036171 shutdown_connections 2021-06-25T04:47:46.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f545c0553d0 0x7f545c057890 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:46.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f547c144590 0x7f547c150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:46.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f547c13e910 0x7f547c150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:46.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 --2- 172.21.15.57:0/1938036171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f547c0ab810 0x7f547c13d970 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:46.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 -- 172.21.15.57:0/1938036171 >> 172.21.15.57:0/1938036171 conn(0x7f547c0b53a0 msgr2=0x7f547c0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:46.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 -- 172.21.15.57:0/1938036171 shutdown_connections 2021-06-25T04:47:46.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:46.099+0000 7f5483b20700 1 -- 172.21.15.57:0/1938036171 wait complete. 2021-06-25T04:47:46.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2021-06-25T04:47:47.119 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-06-25T04:47:47.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.223+0000 7f7411211700 1 Processor -- start 2021-06-25T04:47:47.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.223+0000 7f7411211700 1 -- start start 2021-06-25T04:47:47.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f740c061640 0x7f740c0b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f740c143960 0x7f740c140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740c0b68d0 con 0x7f740c0b46d0 2021-06-25T04:47:47.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740c0b9640 con 0x7f740c061640 2021-06-25T04:47:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740c0b6b70 con 0x7f740c143960 2021-06-25T04:47:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f740bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f740c061640 0x7f740c0b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7403fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f740c0b46d0 0x7f740c13fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52640/0 (socket says 172.21.15.57:52640) 2021-06-25T04:47:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7403fff700 1 -- 172.21.15.57:0/942910296 learned_addr learned my addr 172.21.15.57:0/942910296 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:47.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7410a10700 1 --2- 172.21.15.57:0/942910296 >> v2:172.21.15.87:3300/0 conn(0x7f740c143960 0x7f740c140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f740b7fe700 1 -- 172.21.15.57:0/942910296 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322574868 0 0) 0x7f740c0b68d0 con 0x7f740c0b46d0 2021-06-25T04:47:47.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f740b7fe700 1 -- 172.21.15.57:0/942910296 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73ec003260 con 0x7f740c0b46d0 2021-06-25T04:47:47.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f740bfff700 1 -- 172.21.15.57:0/942910296 >> v2:172.21.15.87:3300/0 conn(0x7f740c143960 msgr2=0x7f740c140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:47.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f740bfff700 1 --2- 172.21.15.57:0/942910296 >> v2:172.21.15.87:3300/0 conn(0x7f740c143960 0x7f740c140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f740bfff700 1 -- 172.21.15.57:0/942910296 >> v1:172.21.15.57:6789/0 conn(0x7f740c0b46d0 legacy=0x7f740c13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f740bfff700 1 -- 172.21.15.57:0/942910296 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c0b6e10 con 0x7f740c061640 2021-06-25T04:47:47.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f740bfff700 1 --2- 172.21.15.57:0/942910296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c061640 0x7f740c0b9cd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f73fc002f70 tx=0x7f73fc006df0).ready entity=mon.0 client_cookie=e218cda48c6a591b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:47.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f740b7fe700 1 -- 172.21.15.57:0/942910296 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73fc00d4f0 con 0x7f740c061640 2021-06-25T04:47:47.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f740b7fe700 1 -- 172.21.15.57:0/942910296 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc000e90 con 0x7f740c061640 2021-06-25T04:47:47.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f740b7fe700 1 -- 172.21.15.57:0/942910296 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73fc00d840 con 0x7f740c061640 2021-06-25T04:47:47.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 -- 172.21.15.57:0/942910296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c061640 msgr2=0x7f740c0b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 --2- 172.21.15.57:0/942910296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c061640 0x7f740c0b9cd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f73fc002f70 tx=0x7f73fc006df0).stop 2021-06-25T04:47:47.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 -- 172.21.15.57:0/942910296 shutdown_connections 2021-06-25T04:47:47.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 --2- 172.21.15.57:0/942910296 >> v2:172.21.15.87:3300/0 conn(0x7f740c143960 0x7f740c140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 --2- 172.21.15.57:0/942910296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c061640 0x7f740c0b9cd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 -- 172.21.15.57:0/942910296 >> 172.21.15.57:0/942910296 conn(0x7f740c06adb0 msgr2=0x7f740c05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:47.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 -- 172.21.15.57:0/942910296 shutdown_connections 2021-06-25T04:47:47.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.227+0000 7f7411211700 1 -- 172.21.15.57:0/942910296 wait complete. 2021-06-25T04:47:47.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f7411211700 1 Processor -- start 2021-06-25T04:47:47.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f7411211700 1 -- start start 2021-06-25T04:47:47.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f7411211700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c061640 0x7f740c1444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f7411211700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f740c143960 0x7f740c138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f7411211700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f740c139380 0x7f740c0b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f7411211700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c152110 con 0x7f740c061640 2021-06-25T04:47:47.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f7411211700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c1490c0 con 0x7f740c139380 2021-06-25T04:47:47.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f7411211700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c147ff0 con 0x7f740c143960 2021-06-25T04:47:47.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f740bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c061640 0x7f740c1444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f740bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c061640 0x7f740c1444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35424/0 (socket says 172.21.15.57:35424) 2021-06-25T04:47:47.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f740bfff700 1 -- 172.21.15.57:0/1238251894 learned_addr learned my addr 172.21.15.57:0/1238251894 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:47.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f7410a10700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f740c139380 0x7f740c0b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f7403fff700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f740c143960 0x7f740c138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f740bfff700 1 -- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f740c143960 msgr2=0x7f740c138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f740bfff700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f740c143960 0x7f740c138e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f740bfff700 1 -- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f740c139380 msgr2=0x7f740c0b7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f740bfff700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f740c139380 0x7f740c0b7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.231+0000 7f740bfff700 1 -- 172.21.15.57:0/1238251894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc00b180 con 0x7f740c061640 2021-06-25T04:47:47.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.235+0000 7f740bfff700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c061640 0x7f740c1444d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f73fc002f70 tx=0x7f73fc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:47.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.235+0000 7f7409ffb700 1 -- 172.21.15.57:0/1238251894 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73fc012dd0 con 0x7f740c061640 2021-06-25T04:47:47.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.235+0000 7f7409ffb700 1 -- 172.21.15.57:0/1238251894 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc000e90 con 0x7f740c061640 2021-06-25T04:47:47.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.235+0000 7f7411211700 1 -- 172.21.15.57:0/1238251894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c13b940 con 0x7f740c061640 2021-06-25T04:47:47.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.235+0000 7f7409ffb700 1 -- 172.21.15.57:0/1238251894 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73fc01e5e0 con 0x7f740c061640 2021-06-25T04:47:47.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.235+0000 7f7411211700 1 -- 172.21.15.57:0/1238251894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c147d50 con 0x7f740c061640 2021-06-25T04:47:47.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.235+0000 7f7411211700 1 -- 172.21.15.57:0/1238251894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c057310 con 0x7f740c061640 2021-06-25T04:47:47.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.235+0000 7f7409ffb700 1 -- 172.21.15.57:0/1238251894 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f73fc024020 con 0x7f740c061640 2021-06-25T04:47:47.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.235+0000 7f7409ffb700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73f00554e0 0x7f73f00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.235+0000 7f7409ffb700 1 -- 172.21.15.57:0/1238251894 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f73fc06ea30 con 0x7f740c061640 2021-06-25T04:47:47.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.235+0000 7f7403fff700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73f00554e0 0x7f73f00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.239+0000 7f7403fff700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73f00554e0 0x7f73f00579a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f73f400d000 tx=0x7f73f4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:47.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.243+0000 7f7409ffb700 1 -- 172.21.15.57:0/1238251894 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f73fc044b40 con 0x7f740c061640 2021-06-25T04:47:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.371+0000 7f7411211700 1 -- 172.21.15.57:0/1238251894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f740c05d990 con 0x7f740c061640 2021-06-25T04:47:47.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7409ffb700 1 -- 172.21.15.57:0/1238251894 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f73fc048160 con 0x7f740c061640 2021-06-25T04:47:47.382 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2021-06-25T04:47:47.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 -- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73f00554e0 msgr2=0x7f73f00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73f00554e0 0x7f73f00579a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f73f400d000 tx=0x7f73f4009040).stop 2021-06-25T04:47:47.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 -- 172.21.15.57:0/1238251894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c061640 msgr2=0x7f740c1444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c061640 0x7f740c1444d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f73fc002f70 tx=0x7f73fc014000).stop 2021-06-25T04:47:47.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 -- 172.21.15.57:0/1238251894 shutdown_connections 2021-06-25T04:47:47.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73f00554e0 0x7f73f00579a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f740c139380 0x7f740c0b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f740c143960 0x7f740c138e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 --2- 172.21.15.57:0/1238251894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c061640 0x7f740c1444d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 -- 172.21.15.57:0/1238251894 >> 172.21.15.57:0/1238251894 conn(0x7f740c06adb0 msgr2=0x7f740c142160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:47.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 -- 172.21.15.57:0/1238251894 shutdown_connections 2021-06-25T04:47:47.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.375+0000 7f7411211700 1 -- 172.21.15.57:0/1238251894 wait complete. 2021-06-25T04:47:47.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2021-06-25T04:47:47.395 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-06-25T04:47:47.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf2bfff700 1 Processor -- start 2021-06-25T04:47:47.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf2bfff700 1 -- start start 2021-06-25T04:47:47.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf2bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf2c0b5460 0x7fcf2c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf2bfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c1479b0 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf2bfff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c0b5840 con 0x7fcf2c147560 2021-06-25T04:47:47.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf2bfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c1452a0 con 0x7fcf2c0b5460 2021-06-25T04:47:47.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf2a7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcf2c0b05d0 0x7fcf2c067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52650/0 (socket says 172.21.15.57:52650) 2021-06-25T04:47:47.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf2a7fc700 1 -- 172.21.15.57:0/2732522480 learned_addr learned my addr 172.21.15.57:0/2732522480 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:47.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf2affd700 1 --2- 172.21.15.57:0/2732522480 >> v2:172.21.15.57:3300/0 conn(0x7fcf2c0b5460 0x7fcf2c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf29ffb700 1 -- 172.21.15.57:0/2732522480 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072559222 0 0) 0x7fcf2c1479b0 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf29ffb700 1 -- 172.21.15.57:0/2732522480 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf10003260 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf29ffb700 1 -- 172.21.15.57:0/2732522480 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993894884 0 0) 0x7fcf2c0b5840 con 0x7fcf2c147560 2021-06-25T04:47:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf29ffb700 1 -- 172.21.15.57:0/2732522480 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf2c1479b0 con 0x7fcf2c147560 2021-06-25T04:47:47.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.491+0000 7fcf2affd700 1 -- 172.21.15.57:0/2732522480 >> v1:172.21.15.87:6789/0 conn(0x7fcf2c147560 legacy=0x7fcf2c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2affd700 1 -- 172.21.15.57:0/2732522480 >> v1:172.21.15.57:6789/0 conn(0x7fcf2c0b05d0 legacy=0x7fcf2c067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2affd700 1 -- 172.21.15.57:0/2732522480 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0ac7c0 con 0x7fcf2c0b5460 2021-06-25T04:47:47.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2affd700 1 --2- 172.21.15.57:0/2732522480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf2c0b5460 0x7fcf2c0af510 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcf20002f70 tx=0x7fcf20006df0).ready entity=mon.0 client_cookie=43d59998e958bbc2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:47.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf29ffb700 1 -- 172.21.15.57:0/2732522480 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf2000d540 con 0x7fcf2c0b5460 2021-06-25T04:47:47.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf29ffb700 1 -- 172.21.15.57:0/2732522480 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20000e90 con 0x7fcf2c0b5460 2021-06-25T04:47:47.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf29ffb700 1 -- 172.21.15.57:0/2732522480 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf2000d890 con 0x7fcf2c0b5460 2021-06-25T04:47:47.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2732522480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf2c0b5460 msgr2=0x7fcf2c0af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2bfff700 1 --2- 172.21.15.57:0/2732522480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf2c0b5460 0x7fcf2c0af510 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcf20002f70 tx=0x7fcf20006df0).stop 2021-06-25T04:47:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2732522480 shutdown_connections 2021-06-25T04:47:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2bfff700 1 --2- 172.21.15.57:0/2732522480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf2c0b5460 0x7fcf2c0af510 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2732522480 >> 172.21.15.57:0/2732522480 conn(0x7fcf2c062520 msgr2=0x7fcf2c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:47.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2732522480 shutdown_connections 2021-06-25T04:47:47.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2732522480 wait complete. 2021-06-25T04:47:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2bfff700 1 Processor -- start 2021-06-25T04:47:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.495+0000 7fcf2bfff700 1 -- start start 2021-06-25T04:47:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf2c0b05d0 0x7fcf2c063510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf2c0b5460 0x7fcf2c149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf2c147560 0x7fcf2c156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0adfb0 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0671a0 con 0x7fcf2c0b5460 2021-06-25T04:47:47.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c066c60 con 0x7fcf2c147560 2021-06-25T04:47:47.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf2c0b05d0 0x7fcf2c063510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf2c0b05d0 0x7fcf2c063510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35438/0 (socket says 172.21.15.57:35438) 2021-06-25T04:47:47.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2affd700 1 -- 172.21.15.57:0/2994366586 learned_addr learned my addr 172.21.15.57:0/2994366586 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:47.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2a7fc700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf2c0b5460 0x7fcf2c149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2b7fe700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf2c147560 0x7fcf2c156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2affd700 1 -- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf2c147560 msgr2=0x7fcf2c156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2affd700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf2c147560 0x7fcf2c156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2affd700 1 -- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf2c0b5460 msgr2=0x7fcf2c149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2affd700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf2c0b5460 0x7fcf2c149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2affd700 1 -- 172.21.15.57:0/2994366586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2000b180 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2affd700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf2c0b05d0 0x7fcf2c063510 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fcf2c066720 tx=0x7fcf20014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:47.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf1bfff700 1 -- 172.21.15.57:0/2994366586 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf20006b20 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf1bfff700 1 -- 172.21.15.57:0/2994366586 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20000e90 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2994366586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c066f00 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf1bfff700 1 -- 172.21.15.57:0/2994366586 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf2000d1c0 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2994366586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c156cf0 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.499+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2994366586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c063200 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.503+0000 7fcf1bfff700 1 -- 172.21.15.57:0/2994366586 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcf20024020 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.503+0000 7fcf1bfff700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf080553f0 0x7fcf080578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.503+0000 7fcf1bfff700 1 -- 172.21.15.57:0/2994366586 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcf2006e980 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.503+0000 7fcf2a7fc700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf080553f0 0x7fcf080578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.503+0000 7fcf2a7fc700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf080553f0 0x7fcf080578b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fcf1c00d000 tx=0x7fcf1c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:47.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.507+0000 7fcf1bfff700 1 -- 172.21.15.57:0/2994366586 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcf20044b30 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.639+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2994366586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcf2c057310 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.639+0000 7fcf1bfff700 1 -- 172.21.15.57:0/2994366586 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf20006980 con 0x7fcf2c0b05d0 2021-06-25T04:47:47.647 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2021-06-25T04:47:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf080553f0 msgr2=0x7fcf080578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf080553f0 0x7fcf080578b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fcf1c00d000 tx=0x7fcf1c009040).stop 2021-06-25T04:47:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2994366586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf2c0b05d0 msgr2=0x7fcf2c063510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf2c0b05d0 0x7fcf2c063510 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fcf2c066720 tx=0x7fcf20014000).stop 2021-06-25T04:47:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2994366586 shutdown_connections 2021-06-25T04:47:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf080553f0 0x7fcf080578b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf2c147560 0x7fcf2c156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf2c0b5460 0x7fcf2c149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 --2- 172.21.15.57:0/2994366586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf2c0b05d0 0x7fcf2c063510 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2994366586 >> 172.21.15.57:0/2994366586 conn(0x7fcf2c062520 msgr2=0x7fcf2c05ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2994366586 shutdown_connections 2021-06-25T04:47:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.643+0000 7fcf2bfff700 1 -- 172.21.15.57:0/2994366586 wait complete. 2021-06-25T04:47:47.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2021-06-25T04:47:47.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-06-25T04:47:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35b1051700 1 Processor -- start 2021-06-25T04:47:47.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35b1051700 1 -- start start 2021-06-25T04:47:47.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35b1051700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0a7670 0x7f35ac066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35b1051700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f35ac0b0020 0x7f35ac05fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35b1051700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ac0a7a50 con 0x7f35ac0b1930 2021-06-25T04:47:47.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35b1051700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac1475e0 con 0x7f35ac0b0020 2021-06-25T04:47:47.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35b1051700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac147880 con 0x7f35ac0a7670 2021-06-25T04:47:47.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35ab59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f35ac0b0020 0x7f35ac05fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35ab59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f35ac0b0020 0x7f35ac05fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35448/0 (socket says 172.21.15.57:35448) 2021-06-25T04:47:47.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35ab59e700 1 -- 172.21.15.57:0/3451705150 learned_addr learned my addr 172.21.15.57:0/3451705150 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:47.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35aad9d700 1 --2- 172.21.15.57:0/3451705150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0a7670 0x7f35ac066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35ab59e700 1 -- 172.21.15.57:0/3451705150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0a7670 msgr2=0x7f35ac066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:47.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35ab59e700 1 --2- 172.21.15.57:0/3451705150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0a7670 0x7f35ac066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35ab59e700 1 -- 172.21.15.57:0/3451705150 >> v1:172.21.15.57:6789/0 conn(0x7f35ac0b1930 legacy=0x7f35ac05f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35ab59e700 1 -- 172.21.15.57:0/3451705150 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac147b20 con 0x7f35ac0b0020 2021-06-25T04:47:47.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35ab59e700 1 --2- 172.21.15.57:0/3451705150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ac0b0020 0x7f35ac05fd80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f35a40032f0 tx=0x7f35a4009290).ready entity=mon.0 client_cookie=3279544e2d36ff9e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35a9d9b700 1 -- 172.21.15.57:0/3451705150 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35a400b8a0 con 0x7f35ac0b0020 2021-06-25T04:47:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35a9d9b700 1 -- 172.21.15.57:0/3451705150 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a400ba00 con 0x7f35ac0b0020 2021-06-25T04:47:47.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35a9d9b700 1 -- 172.21.15.57:0/3451705150 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35a400bb70 con 0x7f35ac0b0020 2021-06-25T04:47:47.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35b1051700 1 -- 172.21.15.57:0/3451705150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ac0b0020 msgr2=0x7f35ac05fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.771+0000 7f35b1051700 1 --2- 172.21.15.57:0/3451705150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ac0b0020 0x7f35ac05fd80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f35a40032f0 tx=0x7f35a4009290).stop 2021-06-25T04:47:47.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.775+0000 7f35b1051700 1 -- 172.21.15.57:0/3451705150 shutdown_connections 2021-06-25T04:47:47.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.775+0000 7f35b1051700 1 --2- 172.21.15.57:0/3451705150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ac0b0020 0x7f35ac05fd80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.775+0000 7f35b1051700 1 --2- 172.21.15.57:0/3451705150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0a7670 0x7f35ac066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.775+0000 7f35b1051700 1 -- 172.21.15.57:0/3451705150 >> 172.21.15.57:0/3451705150 conn(0x7f35ac0b53a0 msgr2=0x7f35ac0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:47.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.775+0000 7f35b1051700 1 -- 172.21.15.57:0/3451705150 shutdown_connections 2021-06-25T04:47:47.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.775+0000 7f35b1051700 1 -- 172.21.15.57:0/3451705150 wait complete. 2021-06-25T04:47:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.775+0000 7f35b1051700 1 Processor -- start 2021-06-25T04:47:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.775+0000 7f35b1051700 1 -- start start 2021-06-25T04:47:47.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35b1051700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ac0a7670 0x7f35ac14b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35b1051700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0b0020 0x7f35ac0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35b1051700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35ac0b1930 0x7f35ac0af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35b1051700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0ac290 con 0x7f35ac0a7670 2021-06-25T04:47:47.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35b1051700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0af560 con 0x7f35ac0b1930 2021-06-25T04:47:47.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35b1051700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0ab170 con 0x7f35ac0b0020 2021-06-25T04:47:47.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35aad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ac0a7670 0x7f35ac14b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35aad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ac0a7670 0x7f35ac14b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35450/0 (socket says 172.21.15.57:35450) 2021-06-25T04:47:47.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35aad9d700 1 -- 172.21.15.57:0/3551778324 learned_addr learned my addr 172.21.15.57:0/3551778324 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:47.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35aa59c700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0b0020 0x7f35ac0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35ab59e700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35ac0b1930 0x7f35ac0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35aad9d700 1 -- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0b0020 msgr2=0x7f35ac0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35aad9d700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0b0020 0x7f35ac0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35aad9d700 1 -- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35ac0b1930 msgr2=0x7f35ac0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35aad9d700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35ac0b1930 0x7f35ac0af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35aad9d700 1 -- 172.21.15.57:0/3551778324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a4009530 con 0x7f35ac0a7670 2021-06-25T04:47:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35aad9d700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ac0a7670 0x7f35ac14b000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f35ac0af6a0 tx=0x7f35a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f359bfff700 1 -- 172.21.15.57:0/3551778324 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35a0011780 con 0x7f35ac0a7670 2021-06-25T04:47:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f359bfff700 1 -- 172.21.15.57:0/3551778324 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a00118e0 con 0x7f35ac0a7670 2021-06-25T04:47:47.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35b1051700 1 -- 172.21.15.57:0/3551778324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac0ac4e0 con 0x7f35ac0a7670 2021-06-25T04:47:47.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f359bfff700 1 -- 172.21.15.57:0/3551778324 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35a0011c40 con 0x7f35ac0a7670 2021-06-25T04:47:47.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35b1051700 1 -- 172.21.15.57:0/3551778324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac0ac800 con 0x7f35ac0a7670 2021-06-25T04:47:47.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.779+0000 7f35b1051700 1 -- 172.21.15.57:0/3551778324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac057310 con 0x7f35ac0a7670 2021-06-25T04:47:47.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.783+0000 7f359bfff700 1 -- 172.21.15.57:0/3551778324 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f35a001c460 con 0x7f35ac0a7670 2021-06-25T04:47:47.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.783+0000 7f359bfff700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3588055340 0x7f3588057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:47.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.783+0000 7f359bfff700 1 -- 172.21.15.57:0/3551778324 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f35a006dfc0 con 0x7f35ac0a7670 2021-06-25T04:47:47.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.783+0000 7f35aa59c700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3588055340 0x7f3588057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:47.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.783+0000 7f35aa59c700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3588055340 0x7f3588057800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f359c00d000 tx=0x7f359c007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:47.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.791+0000 7f359bfff700 1 -- 172.21.15.57:0/3551778324 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f35a0044110 con 0x7f35ac0a7670 2021-06-25T04:47:47.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.919+0000 7f35b1051700 1 -- 172.21.15.57:0/3551778324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f35ac0698a0 con 0x7f35ac0a7670 2021-06-25T04:47:47.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.919+0000 7f359bfff700 1 -- 172.21.15.57:0/3551778324 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35a0047730 con 0x7f35ac0a7670 2021-06-25T04:47:47.926 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2021-06-25T04:47:47.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.919+0000 7f35b1051700 1 -- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3588055340 msgr2=0x7f3588057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.919+0000 7f35b1051700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3588055340 0x7f3588057800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f359c00d000 tx=0x7f359c007b90).stop 2021-06-25T04:47:47.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.919+0000 7f35b1051700 1 -- 172.21.15.57:0/3551778324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ac0a7670 msgr2=0x7f35ac14b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:47.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.919+0000 7f35b1051700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ac0a7670 0x7f35ac14b000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f35ac0af6a0 tx=0x7f35a0008040).stop 2021-06-25T04:47:47.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.923+0000 7f35b1051700 1 -- 172.21.15.57:0/3551778324 shutdown_connections 2021-06-25T04:47:47.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.923+0000 7f35b1051700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3588055340 0x7f3588057800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.923+0000 7f35b1051700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35ac0b1930 0x7f35ac0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.923+0000 7f35b1051700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0b0020 0x7f35ac0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.923+0000 7f35b1051700 1 --2- 172.21.15.57:0/3551778324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35ac0a7670 0x7f35ac14b000 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:47.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.923+0000 7f35b1051700 1 -- 172.21.15.57:0/3551778324 >> 172.21.15.57:0/3551778324 conn(0x7f35ac0b53a0 msgr2=0x7f35ac146350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:47.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.923+0000 7f35b1051700 1 -- 172.21.15.57:0/3551778324 shutdown_connections 2021-06-25T04:47:47.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:47.923+0000 7f35b1051700 1 -- 172.21.15.57:0/3551778324 wait complete. 2021-06-25T04:47:47.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2021-06-25T04:47:47.944 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-06-25T04:47:48.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.043+0000 7f19a3059700 1 Processor -- start 2021-06-25T04:47:48.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.043+0000 7f19a3059700 1 -- start start 2021-06-25T04:47:48.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.043+0000 7f19a3059700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f199c061640 0x7f199c0b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.043+0000 7f19a3059700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0b68d0 con 0x7f199c0b46d0 2021-06-25T04:47:48.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.043+0000 7f19a3059700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0b6b70 con 0x7f199c143960 2021-06-25T04:47:48.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.043+0000 7f19a3059700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0b9640 con 0x7f199c061640 2021-06-25T04:47:48.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.043+0000 7f19a2057700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f199c061640 0x7f199c0b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.043+0000 7f19a1856700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f199c0b46d0 0x7f199c13fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52678/0 (socket says 172.21.15.57:52678) 2021-06-25T04:47:48.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.043+0000 7f19a1856700 1 -- 172.21.15.57:0/3870091538 learned_addr learned my addr 172.21.15.57:0/3870091538 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:48.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a1055700 1 -- 172.21.15.57:0/3870091538 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650296311 0 0) 0x7f199c0b68d0 con 0x7f199c0b46d0 2021-06-25T04:47:48.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a1055700 1 -- 172.21.15.57:0/3870091538 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1984003260 con 0x7f199c0b46d0 2021-06-25T04:47:48.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a2057700 1 -- 172.21.15.57:0/3870091538 >> v1:172.21.15.87:6789/0 conn(0x7f199c143960 legacy=0x7f199c14d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a1055700 1 -- 172.21.15.57:0/3870091538 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849760171 0 0) 0x7f199c0b6b70 con 0x7f199c143960 2021-06-25T04:47:48.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a2057700 1 -- 172.21.15.57:0/3870091538 >> v1:172.21.15.57:6789/0 conn(0x7f199c0b46d0 legacy=0x7f199c13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a2057700 1 -- 172.21.15.57:0/3870091538 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c0b6e10 con 0x7f199c061640 2021-06-25T04:47:48.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a2057700 1 --2- 172.21.15.57:0/3870091538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f199c061640 0x7f199c0b9cd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f1998002f70 tx=0x7f1998006df0).ready entity=mon.0 client_cookie=7de213ab136c3b72 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a1055700 1 -- 172.21.15.57:0/3870091538 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f199800d610 con 0x7f199c061640 2021-06-25T04:47:48.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a1055700 1 -- 172.21.15.57:0/3870091538 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1998000e90 con 0x7f199c061640 2021-06-25T04:47:48.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a1055700 1 -- 172.21.15.57:0/3870091538 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f199800d960 con 0x7f199c061640 2021-06-25T04:47:48.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a3059700 1 -- 172.21.15.57:0/3870091538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f199c061640 msgr2=0x7f199c0b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a3059700 1 --2- 172.21.15.57:0/3870091538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f199c061640 0x7f199c0b9cd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f1998002f70 tx=0x7f1998006df0).stop 2021-06-25T04:47:48.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a3059700 1 -- 172.21.15.57:0/3870091538 shutdown_connections 2021-06-25T04:47:48.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a3059700 1 --2- 172.21.15.57:0/3870091538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f199c061640 0x7f199c0b9cd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a3059700 1 -- 172.21.15.57:0/3870091538 >> 172.21.15.57:0/3870091538 conn(0x7f199c06adb0 msgr2=0x7f199c05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:48.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a3059700 1 -- 172.21.15.57:0/3870091538 shutdown_connections 2021-06-25T04:47:48.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.047+0000 7f19a3059700 1 -- 172.21.15.57:0/3870091538 wait complete. 2021-06-25T04:47:48.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a3059700 1 Processor -- start 2021-06-25T04:47:48.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a3059700 1 -- start start 2021-06-25T04:47:48.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a3059700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f199c061640 0x7f199c13e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a3059700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f199c143960 0x7f199c152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a3059700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f199c13b100 0x7f199c13b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a3059700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c153030 con 0x7f199c13b100 2021-06-25T04:47:48.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a3059700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0b8ac0 con 0x7f199c143960 2021-06-25T04:47:48.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a3059700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0b8d60 con 0x7f199c061640 2021-06-25T04:47:48.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a2858700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f199c13b100 0x7f199c13b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a2858700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f199c13b100 0x7f199c13b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35468/0 (socket says 172.21.15.57:35468) 2021-06-25T04:47:48.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a2858700 1 -- 172.21.15.57:0/1014343264 learned_addr learned my addr 172.21.15.57:0/1014343264 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:48.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a1856700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f199c143960 0x7f199c152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a2057700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f199c061640 0x7f199c13e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a2858700 1 -- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f199c061640 msgr2=0x7f199c13e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a2858700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f199c061640 0x7f199c13e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a2858700 1 -- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f199c143960 msgr2=0x7f199c152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a2858700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f199c143960 0x7f199c152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a2858700 1 -- 172.21.15.57:0/1014343264 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199800b180 con 0x7f199c13b100 2021-06-25T04:47:48.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a2858700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f199c13b100 0x7f199c13b590 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1994001250 tx=0x7f199400c7d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f198b7fe700 1 -- 172.21.15.57:0/1014343264 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1994006aa0 con 0x7f199c13b100 2021-06-25T04:47:48.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f198b7fe700 1 -- 172.21.15.57:0/1014343264 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1994006c00 con 0x7f199c13b100 2021-06-25T04:47:48.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a3059700 1 -- 172.21.15.57:0/1014343264 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c0b9000 con 0x7f199c13b100 2021-06-25T04:47:48.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f198b7fe700 1 -- 172.21.15.57:0/1014343264 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1994007030 con 0x7f199c13b100 2021-06-25T04:47:48.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.051+0000 7f19a3059700 1 -- 172.21.15.57:0/1014343264 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c0b93a0 con 0x7f199c13b100 2021-06-25T04:47:48.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.055+0000 7f198b7fe700 1 -- 172.21.15.57:0/1014343264 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1994010030 con 0x7f199c13b100 2021-06-25T04:47:48.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.055+0000 7f19a3059700 1 -- 172.21.15.57:0/1014343264 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c057310 con 0x7f199c13b100 2021-06-25T04:47:48.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.055+0000 7f198b7fe700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f197c055510 0x7f197c0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.055+0000 7f198b7fe700 1 -- 172.21.15.57:0/1014343264 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f199406dc70 con 0x7f199c13b100 2021-06-25T04:47:48.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.055+0000 7f19a2057700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f197c055510 0x7f197c0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.055+0000 7f19a2057700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f197c055510 0x7f197c0579d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f1998019000 tx=0x7f1998014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.059+0000 7f198b7fe700 1 -- 172.21.15.57:0/1014343264 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1994043e20 con 0x7f199c13b100 2021-06-25T04:47:48.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.187+0000 7f19a3059700 1 -- 172.21.15.57:0/1014343264 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f199c13e930 con 0x7f199c13b100 2021-06-25T04:47:48.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.187+0000 7f198b7fe700 1 -- 172.21.15.57:0/1014343264 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f199c13e930 con 0x7f199c13b100 2021-06-25T04:47:48.196 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2021-06-25T04:47:48.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.187+0000 7f19a3059700 1 -- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f197c055510 msgr2=0x7f197c0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.187+0000 7f19a3059700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f197c055510 0x7f197c0579d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f1998019000 tx=0x7f1998014000).stop 2021-06-25T04:47:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.187+0000 7f19a3059700 1 -- 172.21.15.57:0/1014343264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f199c13b100 msgr2=0x7f199c13b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.187+0000 7f19a3059700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f199c13b100 0x7f199c13b590 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1994001250 tx=0x7f199400c7d0).stop 2021-06-25T04:47:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.191+0000 7f19a3059700 1 -- 172.21.15.57:0/1014343264 shutdown_connections 2021-06-25T04:47:48.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.191+0000 7f19a3059700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f197c055510 0x7f197c0579d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.191+0000 7f19a3059700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f199c13b100 0x7f199c13b590 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.191+0000 7f19a3059700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f199c143960 0x7f199c152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.191+0000 7f19a3059700 1 --2- 172.21.15.57:0/1014343264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f199c061640 0x7f199c13e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.191+0000 7f19a3059700 1 -- 172.21.15.57:0/1014343264 >> 172.21.15.57:0/1014343264 conn(0x7f199c06adb0 msgr2=0x7f199c05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:48.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.191+0000 7f19a3059700 1 -- 172.21.15.57:0/1014343264 shutdown_connections 2021-06-25T04:47:48.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.191+0000 7f19a3059700 1 -- 172.21.15.57:0/1014343264 wait complete. 2021-06-25T04:47:48.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2021-06-25T04:47:48.210 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-06-25T04:47:48.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.303+0000 7f8acb59e700 1 Processor -- start 2021-06-25T04:47:48.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.303+0000 7f8acb59e700 1 -- start start 2021-06-25T04:47:48.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8acc061640 0x7f8acc0b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8acc0b46d0 0x7f8acc0ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc0b68d0 con 0x7f8acc143960 2021-06-25T04:47:48.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8acc0b9640 con 0x7f8acc0b46d0 2021-06-25T04:47:48.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0b6b70 con 0x7f8acc061640 2021-06-25T04:47:48.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8ac9d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8acc0b46d0 0x7f8acc0ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acad9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8acc143960 0x7f8acc13fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52694/0 (socket says 172.21.15.57:52694) 2021-06-25T04:47:48.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acad9d700 1 -- 172.21.15.57:0/3838918601 learned_addr learned my addr 172.21.15.57:0/3838918601 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:48.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8aca59c700 1 --2- 172.21.15.57:0/3838918601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8acc061640 0x7f8acc0b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8ac9d9b700 1 -- 172.21.15.57:0/3838918601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8acc061640 msgr2=0x7f8acc0b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:48.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8ac9d9b700 1 --2- 172.21.15.57:0/3838918601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8acc061640 0x7f8acc0b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8ac9d9b700 1 -- 172.21.15.57:0/3838918601 >> v1:172.21.15.57:6789/0 conn(0x7f8acc143960 legacy=0x7f8acc13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8ac9d9b700 1 -- 172.21.15.57:0/3838918601 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc0b6e10 con 0x7f8acc0b46d0 2021-06-25T04:47:48.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8aca59c700 1 --2- 172.21.15.57:0/3838918601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8acc061640 0x7f8acc0b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:47:48.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8ac9d9b700 1 --2- 172.21.15.57:0/3838918601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8acc0b46d0 0x7f8acc0ba1c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8ab4002f70 tx=0x7f8ab4006df0).ready entity=mon.0 client_cookie=9afd21b5556e097d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8ac959a700 1 -- 172.21.15.57:0/3838918601 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ab400d570 con 0x7f8acc0b46d0 2021-06-25T04:47:48.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8ac959a700 1 -- 172.21.15.57:0/3838918601 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4000e90 con 0x7f8acc0b46d0 2021-06-25T04:47:48.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8ac959a700 1 -- 172.21.15.57:0/3838918601 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ab400d8c0 con 0x7f8acc0b46d0 2021-06-25T04:47:48.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 -- 172.21.15.57:0/3838918601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8acc0b46d0 msgr2=0x7f8acc0ba1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 --2- 172.21.15.57:0/3838918601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8acc0b46d0 0x7f8acc0ba1c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8ab4002f70 tx=0x7f8ab4006df0).stop 2021-06-25T04:47:48.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 -- 172.21.15.57:0/3838918601 shutdown_connections 2021-06-25T04:47:48.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 --2- 172.21.15.57:0/3838918601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8acc0b46d0 0x7f8acc0ba1c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 --2- 172.21.15.57:0/3838918601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8acc061640 0x7f8acc0b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 -- 172.21.15.57:0/3838918601 >> 172.21.15.57:0/3838918601 conn(0x7f8acc06adb0 msgr2=0x7f8acc05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:48.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 -- 172.21.15.57:0/3838918601 shutdown_connections 2021-06-25T04:47:48.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.307+0000 7f8acb59e700 1 -- 172.21.15.57:0/3838918601 wait complete. 2021-06-25T04:47:48.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8acb59e700 1 Processor -- start 2021-06-25T04:47:48.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8acb59e700 1 -- start start 2021-06-25T04:47:48.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8acb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8acc061640 0x7f8acc138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8acb59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8acc143960 0x7f8acc13c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8acb59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8acc13cc60 0x7f8acc155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8acb59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc13db30 con 0x7f8acc061640 2021-06-25T04:47:48.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8acb59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc13a380 con 0x7f8acc13cc60 2021-06-25T04:47:48.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8acb59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc13a0e0 con 0x7f8acc143960 2021-06-25T04:47:48.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8aca59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8acc061640 0x7f8acc138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8aca59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8acc061640 0x7f8acc138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35478/0 (socket says 172.21.15.57:35478) 2021-06-25T04:47:48.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8aca59c700 1 -- 172.21.15.57:0/2838645555 learned_addr learned my addr 172.21.15.57:0/2838645555 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:48.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8acad9d700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8acc13cc60 0x7f8acc155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8ac9d9b700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8acc143960 0x7f8acc13c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8aca59c700 1 -- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8acc143960 msgr2=0x7f8acc13c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8aca59c700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8acc143960 0x7f8acc13c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8aca59c700 1 -- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8acc13cc60 msgr2=0x7f8acc155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8aca59c700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8acc13cc60 0x7f8acc155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8aca59c700 1 -- 172.21.15.57:0/2838645555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab400b180 con 0x7f8acc061640 2021-06-25T04:47:48.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8aca59c700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8acc061640 0x7f8acc138ed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f8abc007000 tx=0x7f8abc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8ac37fe700 1 -- 172.21.15.57:0/2838645555 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8abc010580 con 0x7f8acc061640 2021-06-25T04:47:48.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8ac37fe700 1 -- 172.21.15.57:0/2838645555 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8abc0106e0 con 0x7f8acc061640 2021-06-25T04:47:48.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8acb59e700 1 -- 172.21.15.57:0/2838645555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc13c2d0 con 0x7f8acc061640 2021-06-25T04:47:48.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8ac37fe700 1 -- 172.21.15.57:0/2838645555 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8abc010a40 con 0x7f8acc061640 2021-06-25T04:47:48.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.311+0000 7f8acb59e700 1 -- 172.21.15.57:0/2838645555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc13e070 con 0x7f8acc061640 2021-06-25T04:47:48.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.315+0000 7f8ac37fe700 1 -- 172.21.15.57:0/2838645555 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8abc010ba0 con 0x7f8acc061640 2021-06-25T04:47:48.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.315+0000 7f8acb59e700 1 -- 172.21.15.57:0/2838645555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc057310 con 0x7f8acc061640 2021-06-25T04:47:48.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.315+0000 7f8ac37fe700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ab00554e0 0x7f8ab00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.315+0000 7f8ac37fe700 1 -- 172.21.15.57:0/2838645555 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8abc06dfc0 con 0x7f8acc061640 2021-06-25T04:47:48.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.315+0000 7f8ac9d9b700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ab00554e0 0x7f8ab00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.315+0000 7f8ac9d9b700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ab00554e0 0x7f8ab00579a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f8ab401b000 tx=0x7f8ab4015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.319+0000 7f8ac37fe700 1 -- 172.21.15.57:0/2838645555 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8abc044110 con 0x7f8acc061640 2021-06-25T04:47:48.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 -- 172.21.15.57:0/2838645555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8acc13c460 con 0x7f8acc061640 2021-06-25T04:47:48.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8ac37fe700 1 -- 172.21.15.57:0/2838645555 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8abc047730 con 0x7f8acc061640 2021-06-25T04:47:48.455 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2021-06-25T04:47:48.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 -- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ab00554e0 msgr2=0x7f8ab00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ab00554e0 0x7f8ab00579a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f8ab401b000 tx=0x7f8ab4015000).stop 2021-06-25T04:47:48.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 -- 172.21.15.57:0/2838645555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8acc061640 msgr2=0x7f8acc138ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8acc061640 0x7f8acc138ed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f8abc007000 tx=0x7f8abc008040).stop 2021-06-25T04:47:48.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 -- 172.21.15.57:0/2838645555 shutdown_connections 2021-06-25T04:47:48.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ab00554e0 0x7f8ab00579a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8acc13cc60 0x7f8acc155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8acc143960 0x7f8acc13c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 --2- 172.21.15.57:0/2838645555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8acc061640 0x7f8acc138ed0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 -- 172.21.15.57:0/2838645555 >> 172.21.15.57:0/2838645555 conn(0x7f8acc06adb0 msgr2=0x7f8acc05c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:48.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 -- 172.21.15.57:0/2838645555 shutdown_connections 2021-06-25T04:47:48.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.447+0000 7f8acb59e700 1 -- 172.21.15.57:0/2838645555 wait complete. 2021-06-25T04:47:48.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2021-06-25T04:47:48.468 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-06-25T04:47:48.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4d1630700 1 Processor -- start 2021-06-25T04:47:48.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4d1630700 1 -- start start 2021-06-25T04:47:48.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4d1630700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc4cc0b5460 0x7fc4cc0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4d1630700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4cc0b05d0 0x7fc4cc147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4d1630700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4cc0b5840 con 0x7fc4cc067560 2021-06-25T04:47:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4d1630700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4cc1452a0 con 0x7fc4cc0b5460 2021-06-25T04:47:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4d1630700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc0adfb0 con 0x7fc4cc0b05d0 2021-06-25T04:47:48.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4d0e2f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc4cc067560 0x7fc4cc0acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52704/0 (socket says 172.21.15.57:52704) 2021-06-25T04:47:48.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4d0e2f700 1 -- 172.21.15.57:0/4075179434 learned_addr learned my addr 172.21.15.57:0/4075179434 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:48.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4cb7fe700 1 --2- 172.21.15.57:0/4075179434 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4cc0b05d0 0x7fc4cc147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4cbfff700 1 --2- 172.21.15.57:0/4075179434 >> v2:172.21.15.87:3300/0 conn(0x7fc4cc0b5460 0x7fc4cc0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4caffd700 1 -- 172.21.15.57:0/4075179434 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266141270 0 0) 0x7fc4cc0b5840 con 0x7fc4cc067560 2021-06-25T04:47:48.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4caffd700 1 -- 172.21.15.57:0/4075179434 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4b8003260 con 0x7fc4cc067560 2021-06-25T04:47:48.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4cb7fe700 1 -- 172.21.15.57:0/4075179434 >> v2:172.21.15.87:3300/0 conn(0x7fc4cc0b5460 msgr2=0x7fc4cc0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:48.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4cb7fe700 1 --2- 172.21.15.57:0/4075179434 >> v2:172.21.15.87:3300/0 conn(0x7fc4cc0b5460 0x7fc4cc0af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4cb7fe700 1 -- 172.21.15.57:0/4075179434 >> v1:172.21.15.57:6789/0 conn(0x7fc4cc067560 legacy=0x7fc4cc0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4cb7fe700 1 -- 172.21.15.57:0/4075179434 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc0ac7c0 con 0x7fc4cc0b05d0 2021-06-25T04:47:48.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.563+0000 7fc4cb7fe700 1 --2- 172.21.15.57:0/4075179434 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4cc0b05d0 0x7fc4cc147560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc4bc0032f0 tx=0x7fc4bc0091d0).ready entity=mon.2 client_cookie=ecd2e385df671bcb server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4caffd700 1 -- 172.21.15.57:0/4075179434 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4bc00b600 con 0x7fc4cc0b05d0 2021-06-25T04:47:48.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4caffd700 1 -- 172.21.15.57:0/4075179434 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc00b760 con 0x7fc4cc0b05d0 2021-06-25T04:47:48.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4caffd700 1 -- 172.21.15.57:0/4075179434 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4bc00b8d0 con 0x7fc4cc0b05d0 2021-06-25T04:47:48.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4d1630700 1 -- 172.21.15.57:0/4075179434 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4cc0b05d0 msgr2=0x7fc4cc147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4d1630700 1 --2- 172.21.15.57:0/4075179434 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4cc0b05d0 0x7fc4cc147560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc4bc0032f0 tx=0x7fc4bc0091d0).stop 2021-06-25T04:47:48.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4d1630700 1 -- 172.21.15.57:0/4075179434 shutdown_connections 2021-06-25T04:47:48.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4d1630700 1 --2- 172.21.15.57:0/4075179434 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4cc0b05d0 0x7fc4cc147560 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4d1630700 1 --2- 172.21.15.57:0/4075179434 >> v2:172.21.15.87:3300/0 conn(0x7fc4cc0b5460 0x7fc4cc0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4d1630700 1 -- 172.21.15.57:0/4075179434 >> 172.21.15.57:0/4075179434 conn(0x7fc4cc062520 msgr2=0x7fc4cc062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:48.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4d1630700 1 -- 172.21.15.57:0/4075179434 shutdown_connections 2021-06-25T04:47:48.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4d1630700 1 -- 172.21.15.57:0/4075179434 wait complete. 2021-06-25T04:47:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4d1630700 1 Processor -- start 2021-06-25T04:47:48.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.567+0000 7fc4d1630700 1 -- start start 2021-06-25T04:47:48.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4d1630700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4cc067560 0x7fc4cc14c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4d1630700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4cc0b05d0 0x7fc4cc063ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4d1630700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4cc0b5460 0x7fc4cc0ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4d1630700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc0a7080 con 0x7fc4cc067560 2021-06-25T04:47:48.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4d1630700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc15ac70 con 0x7fc4cc0b5460 2021-06-25T04:47:48.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4d1630700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc0632a0 con 0x7fc4cc0b05d0 2021-06-25T04:47:48.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4cbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4cc067560 0x7fc4cc14c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4cbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4cc067560 0x7fc4cc14c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35490/0 (socket says 172.21.15.57:35490) 2021-06-25T04:47:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4cbfff700 1 -- 172.21.15.57:0/446079293 learned_addr learned my addr 172.21.15.57:0/446079293 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4cb7fe700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4cc0b05d0 0x7fc4cc063ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4d0e2f700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4cc0b5460 0x7fc4cc0ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4cbfff700 1 -- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4cc0b05d0 msgr2=0x7fc4cc063ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4cbfff700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4cc0b05d0 0x7fc4cc063ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4cbfff700 1 -- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4cc0b5460 msgr2=0x7fc4cc0ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4cbfff700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4cc0b5460 0x7fc4cc0ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4cbfff700 1 -- 172.21.15.57:0/446079293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc009470 con 0x7fc4cc067560 2021-06-25T04:47:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4cbfff700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4cc067560 0x7fc4cc14c580 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc4c000c000 tx=0x7fc4c0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4c97fa700 1 -- 172.21.15.57:0/446079293 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4c0010780 con 0x7fc4cc067560 2021-06-25T04:47:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4c97fa700 1 -- 172.21.15.57:0/446079293 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c00108e0 con 0x7fc4cc067560 2021-06-25T04:47:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4d1630700 1 -- 172.21.15.57:0/446079293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4cc063540 con 0x7fc4cc067560 2021-06-25T04:47:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4c97fa700 1 -- 172.21.15.57:0/446079293 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4c0010c40 con 0x7fc4cc067560 2021-06-25T04:47:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.571+0000 7fc4d1630700 1 -- 172.21.15.57:0/446079293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc0a74b0 con 0x7fc4cc067560 2021-06-25T04:47:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.575+0000 7fc4d1630700 1 -- 172.21.15.57:0/446079293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4cc064140 con 0x7fc4cc067560 2021-06-25T04:47:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.575+0000 7fc4c97fa700 1 -- 172.21.15.57:0/446079293 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc4c001c460 con 0x7fc4cc067560 2021-06-25T04:47:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.575+0000 7fc4c97fa700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4ac0553f0 0x7fc4ac0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.575+0000 7fc4c97fa700 1 -- 172.21.15.57:0/446079293 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc4c006e3d0 con 0x7fc4cc067560 2021-06-25T04:47:48.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.575+0000 7fc4cb7fe700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4ac0553f0 0x7fc4ac0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.575+0000 7fc4cb7fe700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4ac0553f0 0x7fc4ac0578b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fc4bc01b000 tx=0x7fc4bc016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.579+0000 7fc4c97fa700 1 -- 172.21.15.57:0/446079293 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc4c0044390 con 0x7fc4cc067560 2021-06-25T04:47:48.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.707+0000 7fc4d1630700 1 -- 172.21.15.57:0/446079293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc4cc0a71c0 con 0x7fc4cc067560 2021-06-25T04:47:48.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.711+0000 7fc4c97fa700 1 -- 172.21.15.57:0/446079293 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4c00479b0 con 0x7fc4cc067560 2021-06-25T04:47:48.718 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2021-06-25T04:47:48.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 -- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4ac0553f0 msgr2=0x7fc4ac0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4ac0553f0 0x7fc4ac0578b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fc4bc01b000 tx=0x7fc4bc016000).stop 2021-06-25T04:47:48.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 -- 172.21.15.57:0/446079293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4cc067560 msgr2=0x7fc4cc14c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4cc067560 0x7fc4cc14c580 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc4c000c000 tx=0x7fc4c0006df0).stop 2021-06-25T04:47:48.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 -- 172.21.15.57:0/446079293 shutdown_connections 2021-06-25T04:47:48.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4ac0553f0 0x7fc4ac0578b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4cc0b5460 0x7fc4cc0ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4cc0b05d0 0x7fc4cc063ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 --2- 172.21.15.57:0/446079293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4cc067560 0x7fc4cc14c580 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 -- 172.21.15.57:0/446079293 >> 172.21.15.57:0/446079293 conn(0x7fc4cc062520 msgr2=0x7fc4cc0af280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:48.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 -- 172.21.15.57:0/446079293 shutdown_connections 2021-06-25T04:47:48.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.715+0000 7fc4d1630700 1 -- 172.21.15.57:0/446079293 wait complete. 2021-06-25T04:47:48.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2021-06-25T04:47:48.736 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-06-25T04:47:48.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f16a208d700 1 Processor -- start 2021-06-25T04:47:48.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f16a208d700 1 -- start start 2021-06-25T04:47:48.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f16a208d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c0b04b0 0x7f169c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f16a208d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f169c0afd00 0x7f169c13fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f16a208d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c0ad560 con 0x7f169c0af920 2021-06-25T04:47:48.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f16a208d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c0af420 con 0x7f169c0afd00 2021-06-25T04:47:48.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f16a208d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0ad020 con 0x7f169c0b04b0 2021-06-25T04:47:48.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f169bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f169c0afd00 0x7f169c13fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f169b7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f169c0af920 0x7f169c0b1b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:53464/0 (socket says 172.21.15.57:53464) 2021-06-25T04:47:48.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f169affd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c0b04b0 0x7f169c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f169b7fe700 1 -- 172.21.15.57:0/1448505069 learned_addr learned my addr 172.21.15.57:0/1448505069 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:48.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f169a7fc700 1 -- 172.21.15.57:0/1448505069 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873332098 0 0) 0x7f169c0ad560 con 0x7f169c0af920 2021-06-25T04:47:48.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f169bfff700 1 -- 172.21.15.57:0/1448505069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c0b04b0 msgr2=0x7f169c0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:48.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f169bfff700 1 --2- 172.21.15.57:0/1448505069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c0b04b0 0x7f169c0b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f169bfff700 1 -- 172.21.15.57:0/1448505069 >> v1:172.21.15.87:6789/0 conn(0x7f169c0af920 legacy=0x7f169c0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.831+0000 7f169bfff700 1 -- 172.21.15.57:0/1448505069 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c0ad2c0 con 0x7f169c0afd00 2021-06-25T04:47:48.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f169bfff700 1 --2- 172.21.15.57:0/1448505069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c0afd00 0x7f169c13fa50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f1694002f70 tx=0x7f1694006df0).ready entity=mon.0 client_cookie=db73ffc24b6be751 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f169a7fc700 1 -- 172.21.15.57:0/1448505069 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169400d570 con 0x7f169c0afd00 2021-06-25T04:47:48.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f169a7fc700 1 -- 172.21.15.57:0/1448505069 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694000e90 con 0x7f169c0afd00 2021-06-25T04:47:48.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f169a7fc700 1 -- 172.21.15.57:0/1448505069 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169400d8c0 con 0x7f169c0afd00 2021-06-25T04:47:48.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f16a208d700 1 -- 172.21.15.57:0/1448505069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c0afd00 msgr2=0x7f169c13fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f16a208d700 1 --2- 172.21.15.57:0/1448505069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c0afd00 0x7f169c13fa50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f1694002f70 tx=0x7f1694006df0).stop 2021-06-25T04:47:48.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f16a208d700 1 -- 172.21.15.57:0/1448505069 shutdown_connections 2021-06-25T04:47:48.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f16a208d700 1 --2- 172.21.15.57:0/1448505069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c0afd00 0x7f169c13fa50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f16a208d700 1 --2- 172.21.15.57:0/1448505069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c0b04b0 0x7f169c0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f16a208d700 1 -- 172.21.15.57:0/1448505069 >> 172.21.15.57:0/1448505069 conn(0x7f169c05cce0 msgr2=0x7f169c062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:48.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f16a208d700 1 -- 172.21.15.57:0/1448505069 shutdown_connections 2021-06-25T04:47:48.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f16a208d700 1 -- 172.21.15.57:0/1448505069 wait complete. 2021-06-25T04:47:48.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f16a208d700 1 Processor -- start 2021-06-25T04:47:48.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.835+0000 7f16a208d700 1 -- start start 2021-06-25T04:47:48.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f16a208d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c0af920 0x7f169c137020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f16a208d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c0afd00 0x7f169c066560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f16a208d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c0b04b0 0x7f169c066a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f16a208d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0a6920 con 0x7f169c0af920 2021-06-25T04:47:48.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f16a208d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c066f40 con 0x7f169c0afd00 2021-06-25T04:47:48.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f16a208d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c065a60 con 0x7f169c0b04b0 2021-06-25T04:47:48.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f169b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c0af920 0x7f169c137020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f169b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c0af920 0x7f169c137020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35504/0 (socket says 172.21.15.57:35504) 2021-06-25T04:47:48.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f169b7fe700 1 -- 172.21.15.57:0/158154834 learned_addr learned my addr 172.21.15.57:0/158154834 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:48.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f169affd700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c0afd00 0x7f169c066560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f169bfff700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c0b04b0 0x7f169c066a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f169b7fe700 1 -- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c0b04b0 msgr2=0x7f169c066a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f169b7fe700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c0b04b0 0x7f169c066a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f169b7fe700 1 -- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c0afd00 msgr2=0x7f169c066560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f169b7fe700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c0afd00 0x7f169c066560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f169b7fe700 1 -- 172.21.15.57:0/158154834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169400b180 con 0x7f169c0af920 2021-06-25T04:47:48.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f169b7fe700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c0af920 0x7f169c137020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f169c0acc80 tx=0x7f168c007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f1698ff9700 1 -- 172.21.15.57:0/158154834 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f168c005ba0 con 0x7f169c0af920 2021-06-25T04:47:48.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f1698ff9700 1 -- 172.21.15.57:0/158154834 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c005d00 con 0x7f169c0af920 2021-06-25T04:47:48.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f1698ff9700 1 -- 172.21.15.57:0/158154834 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f168c0072c0 con 0x7f169c0af920 2021-06-25T04:47:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f16a208d700 1 -- 172.21.15.57:0/158154834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c064fe0 con 0x7f169c0af920 2021-06-25T04:47:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f16a208d700 1 -- 172.21.15.57:0/158154834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c137dc0 con 0x7f169c0af920 2021-06-25T04:47:48.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.839+0000 7f16a208d700 1 -- 172.21.15.57:0/158154834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c057310 con 0x7f169c0af920 2021-06-25T04:47:48.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.843+0000 7f1698ff9700 1 -- 172.21.15.57:0/158154834 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f168c010070 con 0x7f169c0af920 2021-06-25T04:47:48.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.843+0000 7f1698ff9700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f167c055450 0x7f167c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:48.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.843+0000 7f1698ff9700 1 -- 172.21.15.57:0/158154834 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f168c06d8f0 con 0x7f169c0af920 2021-06-25T04:47:48.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.843+0000 7f169affd700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f167c055450 0x7f167c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:48.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.843+0000 7f169affd700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f167c055450 0x7f167c057910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f169000b000 tx=0x7f1690006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.847+0000 7f1698ff9700 1 -- 172.21.15.57:0/158154834 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f168c043b50 con 0x7f169c0af920 2021-06-25T04:47:48.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.975+0000 7f16a208d700 1 -- 172.21.15.57:0/158154834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f169c065fe0 con 0x7f169c0af920 2021-06-25T04:47:48.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.975+0000 7f1698ff9700 1 -- 172.21.15.57:0/158154834 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f168c047170 con 0x7f169c0af920 2021-06-25T04:47:48.984 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2021-06-25T04:47:48.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.975+0000 7f16a208d700 1 -- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f167c055450 msgr2=0x7f167c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.975+0000 7f16a208d700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f167c055450 0x7f167c057910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f169000b000 tx=0x7f1690006df0).stop 2021-06-25T04:47:48.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.979+0000 7f16a208d700 1 -- 172.21.15.57:0/158154834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c0af920 msgr2=0x7f169c137020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:48.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.979+0000 7f16a208d700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c0af920 0x7f169c137020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f169c0acc80 tx=0x7f168c007e40).stop 2021-06-25T04:47:48.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.979+0000 7f16a208d700 1 -- 172.21.15.57:0/158154834 shutdown_connections 2021-06-25T04:47:48.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.979+0000 7f16a208d700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f167c055450 0x7f167c057910 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.979+0000 7f16a208d700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c0b04b0 0x7f169c066a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.979+0000 7f16a208d700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c0afd00 0x7f169c066560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.979+0000 7f16a208d700 1 --2- 172.21.15.57:0/158154834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c0af920 0x7f169c137020 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:48.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.979+0000 7f16a208d700 1 -- 172.21.15.57:0/158154834 >> 172.21.15.57:0/158154834 conn(0x7f169c05cce0 msgr2=0x7f169c13d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:48.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.979+0000 7f16a208d700 1 -- 172.21.15.57:0/158154834 shutdown_connections 2021-06-25T04:47:48.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:48.979+0000 7f16a208d700 1 -- 172.21.15.57:0/158154834 wait complete. 2021-06-25T04:47:48.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2021-06-25T04:47:48.997 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-06-25T04:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227f696700 1 Processor -- start 2021-06-25T04:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227f696700 1 -- start start 2021-06-25T04:47:49.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227f696700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f227805c450 0x7f22780b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227f696700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22780a58e0 0x7f22780a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227f696700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22780b20f0 con 0x7f22780b1d10 2021-06-25T04:47:49.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227f696700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22780ade70 con 0x7f22780a58e0 2021-06-25T04:47:49.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227f696700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780b2a40 con 0x7f227805c450 2021-06-25T04:47:49.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227dc33700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22780a58e0 0x7f22780a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227dc33700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22780a58e0 0x7f22780a5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35516/0 (socket says 172.21.15.57:35516) 2021-06-25T04:47:49.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227dc33700 1 -- 172.21.15.57:0/2343180376 learned_addr learned my addr 172.21.15.57:0/2343180376 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:49.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227cc31700 1 --2- 172.21.15.57:0/2343180376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f227805c450 0x7f22780b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227dc33700 1 -- 172.21.15.57:0/2343180376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f227805c450 msgr2=0x7f22780b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:49.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227dc33700 1 --2- 172.21.15.57:0/2343180376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f227805c450 0x7f22780b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227dc33700 1 -- 172.21.15.57:0/2343180376 >> v1:172.21.15.87:6789/0 conn(0x7f22780b1d10 legacy=0x7f22780ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227dc33700 1 -- 172.21.15.57:0/2343180376 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780b2ce0 con 0x7f22780a58e0 2021-06-25T04:47:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f2267fff700 1 -- 172.21.15.57:0/2343180376 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279211966 0 0) 0x7f22780b20f0 con 0x7f22780b1d10 2021-06-25T04:47:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f227dc33700 1 --2- 172.21.15.57:0/2343180376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22780a58e0 0x7f22780a5d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f22700032f0 tx=0x7f227000b530).ready entity=mon.0 client_cookie=1beb1523ddc5e6b2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.095+0000 7f2267fff700 1 -- 172.21.15.57:0/2343180376 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f227000de20 con 0x7f22780a58e0 2021-06-25T04:47:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f2267fff700 1 -- 172.21.15.57:0/2343180376 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2270010470 con 0x7f22780a58e0 2021-06-25T04:47:49.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f2267fff700 1 -- 172.21.15.57:0/2343180376 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22700107d0 con 0x7f22780a58e0 2021-06-25T04:47:49.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 -- 172.21.15.57:0/2343180376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22780a58e0 msgr2=0x7f22780a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 --2- 172.21.15.57:0/2343180376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22780a58e0 0x7f22780a5d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f22700032f0 tx=0x7f227000b530).stop 2021-06-25T04:47:49.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 -- 172.21.15.57:0/2343180376 shutdown_connections 2021-06-25T04:47:49.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 --2- 172.21.15.57:0/2343180376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22780a58e0 0x7f22780a5d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 --2- 172.21.15.57:0/2343180376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f227805c450 0x7f22780b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 -- 172.21.15.57:0/2343180376 >> 172.21.15.57:0/2343180376 conn(0x7f227805cce0 msgr2=0x7f2278062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 -- 172.21.15.57:0/2343180376 shutdown_connections 2021-06-25T04:47:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 -- 172.21.15.57:0/2343180376 wait complete. 2021-06-25T04:47:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 Processor -- start 2021-06-25T04:47:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 -- start start 2021-06-25T04:47:49.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f227805c450 0x7f2278145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22780a58e0 0x7f22780a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22780b1d10 0x7f22780a8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780ac480 con 0x7f22780a58e0 2021-06-25T04:47:49.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2278064170 con 0x7f22780b1d10 2021-06-25T04:47:49.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227f696700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2278064410 con 0x7f227805c450 2021-06-25T04:47:49.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227cc31700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22780a58e0 0x7f22780a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227cc31700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22780a58e0 0x7f22780a7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35518/0 (socket says 172.21.15.57:35518) 2021-06-25T04:47:49.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227cc31700 1 -- 172.21.15.57:0/3558166870 learned_addr learned my addr 172.21.15.57:0/3558166870 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:49.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227dc33700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22780b1d10 0x7f22780a8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.099+0000 7f227d432700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f227805c450 0x7f2278145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f227cc31700 1 -- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f227805c450 msgr2=0x7f2278145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f227cc31700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f227805c450 0x7f2278145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f227cc31700 1 -- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22780b1d10 msgr2=0x7f22780a8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f227cc31700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22780b1d10 0x7f22780a8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f227cc31700 1 -- 172.21.15.57:0/3558166870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227000b7d0 con 0x7f22780a58e0 2021-06-25T04:47:49.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f227cc31700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22780a58e0 0x7f22780a7b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f226800c000 tx=0x7f2268006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f22667fc700 1 -- 172.21.15.57:0/3558166870 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2268010780 con 0x7f22780a58e0 2021-06-25T04:47:49.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f22667fc700 1 -- 172.21.15.57:0/3558166870 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22680108e0 con 0x7f22780a58e0 2021-06-25T04:47:49.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f227f696700 1 -- 172.21.15.57:0/3558166870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22780646b0 con 0x7f22780a58e0 2021-06-25T04:47:49.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f22667fc700 1 -- 172.21.15.57:0/3558166870 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2268010c40 con 0x7f22780a58e0 2021-06-25T04:47:49.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f227f696700 1 -- 172.21.15.57:0/3558166870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22781401d0 con 0x7f22780a58e0 2021-06-25T04:47:49.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f227f696700 1 -- 172.21.15.57:0/3558166870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2278057310 con 0x7f22780a58e0 2021-06-25T04:47:49.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f22667fc700 1 -- 172.21.15.57:0/3558166870 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f226801c460 con 0x7f22780a58e0 2021-06-25T04:47:49.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f22667fc700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2258055450 0x7f2258057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.103+0000 7f22667fc700 1 -- 172.21.15.57:0/3558166870 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f226806e270 con 0x7f22780a58e0 2021-06-25T04:47:49.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.107+0000 7f227d432700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2258055450 0x7f2258057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.107+0000 7f227d432700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2258055450 0x7f2258057910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f227400d000 tx=0x7f2274007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.111+0000 7f22667fc700 1 -- 172.21.15.57:0/3558166870 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f22680443c0 con 0x7f22780a58e0 2021-06-25T04:47:49.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.239+0000 7f227f696700 1 -- 172.21.15.57:0/3558166870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f227813dbf0 con 0x7f22780a58e0 2021-06-25T04:47:49.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f22667fc700 1 -- 172.21.15.57:0/3558166870 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22680479e0 con 0x7f22780a58e0 2021-06-25T04:47:49.250 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2021-06-25T04:47:49.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 -- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2258055450 msgr2=0x7f2258057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2258055450 0x7f2258057910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f227400d000 tx=0x7f2274007b90).stop 2021-06-25T04:47:49.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 -- 172.21.15.57:0/3558166870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22780a58e0 msgr2=0x7f22780a7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22780a58e0 0x7f22780a7b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f226800c000 tx=0x7f2268006df0).stop 2021-06-25T04:47:49.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 -- 172.21.15.57:0/3558166870 shutdown_connections 2021-06-25T04:47:49.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2258055450 0x7f2258057910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22780b1d10 0x7f22780a8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22780a58e0 0x7f22780a7b60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 --2- 172.21.15.57:0/3558166870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f227805c450 0x7f2278145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 -- 172.21.15.57:0/3558166870 >> 172.21.15.57:0/3558166870 conn(0x7f227805cce0 msgr2=0x7f22780b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:49.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 -- 172.21.15.57:0/3558166870 shutdown_connections 2021-06-25T04:47:49.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.243+0000 7f227f696700 1 -- 172.21.15.57:0/3558166870 wait complete. 2021-06-25T04:47:49.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2021-06-25T04:47:49.268 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-06-25T04:47:49.269 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-06-25T04:47:49.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fd5615700 1 Processor -- start 2021-06-25T04:47:49.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fd5615700 1 -- start start 2021-06-25T04:47:49.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fd5615700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8fd00670e0 0x7f8fd00b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fd5615700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd00b9b90 con 0x7f8fd013ffb0 2021-06-25T04:47:49.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fd5615700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd00674c0 con 0x7f8fd0143970 2021-06-25T04:47:49.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fd5615700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd0143040 con 0x7f8fd00670e0 2021-06-25T04:47:49.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fcf7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8fd013ffb0 0x7f8fd0140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52748/0 (socket says 172.21.15.57:52748) 2021-06-25T04:47:49.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fcf7fe700 1 -- 172.21.15.57:0/2795513389 learned_addr learned my addr 172.21.15.57:0/2795513389 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:49.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fceffd700 1 --2- 172.21.15.57:0/2795513389 >> v2:172.21.15.87:3300/0 conn(0x7f8fd00670e0 0x7f8fd00b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fcdffb700 1 -- 172.21.15.57:0/2795513389 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130792338 0 0) 0x7f8fc8001490 con 0x7f8fd013ffb0 2021-06-25T04:47:49.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fcdffb700 1 -- 172.21.15.57:0/2795513389 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb0003260 con 0x7f8fd013ffb0 2021-06-25T04:47:49.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fcdffb700 1 -- 172.21.15.57:0/2795513389 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424640619 0 0) 0x7f8fd00674c0 con 0x7f8fd0143970 2021-06-25T04:47:49.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fcdffb700 1 -- 172.21.15.57:0/2795513389 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc8001490 con 0x7f8fd0143970 2021-06-25T04:47:49.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fceffd700 1 -- 172.21.15.57:0/2795513389 >> v1:172.21.15.87:6789/0 conn(0x7f8fd0143970 legacy=0x7f8fd00aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fcdffb700 1 -- 172.21.15.57:0/2795513389 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1892778634 0 0) 0x7f8fb0003260 con 0x7f8fd013ffb0 2021-06-25T04:47:49.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fceffd700 1 -- 172.21.15.57:0/2795513389 >> v1:172.21.15.57:6789/0 conn(0x7f8fd013ffb0 legacy=0x7f8fd0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.367+0000 7f8fceffd700 1 -- 172.21.15.57:0/2795513389 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00af490 con 0x7f8fd00670e0 2021-06-25T04:47:49.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.371+0000 7f8fceffd700 1 --2- 172.21.15.57:0/2795513389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fd00670e0 0x7f8fd00b96a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f8fc8001620 tx=0x7f8fb8006df0).ready entity=mon.1 client_cookie=454e6733a77a7d13 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.371+0000 7f8fcdffb700 1 -- 172.21.15.57:0/2795513389 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fc8001b70 con 0x7f8fd00670e0 2021-06-25T04:47:49.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.371+0000 7f8fcdffb700 1 -- 172.21.15.57:0/2795513389 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb8000e90 con 0x7f8fd00670e0 2021-06-25T04:47:49.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.371+0000 7f8fcdffb700 1 -- 172.21.15.57:0/2795513389 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fb8012460 con 0x7f8fd00670e0 2021-06-25T04:47:49.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.371+0000 7f8fd5615700 1 -- 172.21.15.57:0/2795513389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fd00670e0 msgr2=0x7f8fd00b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.371+0000 7f8fd5615700 1 --2- 172.21.15.57:0/2795513389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fd00670e0 0x7f8fd00b96a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f8fc8001620 tx=0x7f8fb8006df0).stop 2021-06-25T04:47:49.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.371+0000 7f8fd5615700 1 -- 172.21.15.57:0/2795513389 shutdown_connections 2021-06-25T04:47:49.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.371+0000 7f8fd5615700 1 --2- 172.21.15.57:0/2795513389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fd00670e0 0x7f8fd00b96a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.371+0000 7f8fd5615700 1 -- 172.21.15.57:0/2795513389 >> 172.21.15.57:0/2795513389 conn(0x7f8fd005f9b0 msgr2=0x7f8fd0061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:49.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.371+0000 7f8fd5615700 1 -- 172.21.15.57:0/2795513389 shutdown_connections 2021-06-25T04:47:49.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.371+0000 7f8fd5615700 1 -- 172.21.15.57:0/2795513389 wait complete. 2021-06-25T04:47:49.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fd5615700 1 Processor -- start 2021-06-25T04:47:49.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fd5615700 1 -- start start 2021-06-25T04:47:49.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fd5615700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd00670e0 0x7f8fd01476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fd5615700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fd013ffb0 0x7f8fd01527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fd5615700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fd0143970 0x7f8fd0137bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fd5615700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd0156470 con 0x7f8fd013ffb0 2021-06-25T04:47:49.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fd5615700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd01520f0 con 0x7f8fd0143970 2021-06-25T04:47:49.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fd5615700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd0155530 con 0x7f8fd00670e0 2021-06-25T04:47:49.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fce7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fd013ffb0 0x7f8fd01527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fce7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fd013ffb0 0x7f8fd01527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35534/0 (socket says 172.21.15.57:35534) 2021-06-25T04:47:49.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fce7fc700 1 -- 172.21.15.57:0/3188290838 learned_addr learned my addr 172.21.15.57:0/3188290838 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:49.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fceffd700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd00670e0 0x7f8fd01476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fcf7fe700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fd0143970 0x7f8fd0137bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fce7fc700 1 -- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd00670e0 msgr2=0x7f8fd01476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fce7fc700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd00670e0 0x7f8fd01476d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fce7fc700 1 -- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fd0143970 msgr2=0x7f8fd0137bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fce7fc700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fd0143970 0x7f8fd0137bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fce7fc700 1 -- 172.21.15.57:0/3188290838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb800b180 con 0x7f8fd013ffb0 2021-06-25T04:47:49.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fcf7fe700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fd0143970 0x7f8fd0137bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:49.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fce7fc700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fd013ffb0 0x7f8fd01527c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f8fd013a7b0 tx=0x7f8fc0007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fc7fff700 1 -- 172.21.15.57:0/3188290838 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fc0012400 con 0x7f8fd013ffb0 2021-06-25T04:47:49.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fc7fff700 1 -- 172.21.15.57:0/3188290838 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc0012560 con 0x7f8fd013ffb0 2021-06-25T04:47:49.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fc7fff700 1 -- 172.21.15.57:0/3188290838 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fc00128c0 con 0x7f8fd013ffb0 2021-06-25T04:47:49.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fd5615700 1 -- 172.21.15.57:0/3188290838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd0152320 con 0x7f8fd013ffb0 2021-06-25T04:47:49.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.375+0000 7f8fd5615700 1 -- 172.21.15.57:0/3188290838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd01557d0 con 0x7f8fd013ffb0 2021-06-25T04:47:49.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.379+0000 7f8fd5615700 1 -- 172.21.15.57:0/3188290838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd0057310 con 0x7f8fd013ffb0 2021-06-25T04:47:49.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.379+0000 7f8fc7fff700 1 -- 172.21.15.57:0/3188290838 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8fc0019030 con 0x7f8fd013ffb0 2021-06-25T04:47:49.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.379+0000 7f8fc7fff700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fb4055340 0x7f8fb4057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.379+0000 7f8fc7fff700 1 -- 172.21.15.57:0/3188290838 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8fc006d380 con 0x7f8fd013ffb0 2021-06-25T04:47:49.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.379+0000 7f8fceffd700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fb4055340 0x7f8fb4057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.379+0000 7f8fceffd700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fb4055340 0x7f8fb4057800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f8fb8019000 tx=0x7f8fb8014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.387+0000 7f8fc7fff700 1 -- 172.21.15.57:0/3188290838 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8fc00433e0 con 0x7f8fd013ffb0 2021-06-25T04:47:49.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.507+0000 7f8fd5615700 1 -- 172.21.15.57:0/3188290838 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fd00698a0 con 0x7f8fb4055340 2021-06-25T04:47:49.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fc7fff700 1 -- 172.21.15.57:0/3188290838 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82469 (secure 0 0 0) 0x7f8fd00698a0 con 0x7f8fb4055340 2021-06-25T04:47:49.527 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:49.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 -- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fb4055340 msgr2=0x7f8fb4057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fb4055340 0x7f8fb4057800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f8fb8019000 tx=0x7f8fb8014000).stop 2021-06-25T04:47:49.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 -- 172.21.15.57:0/3188290838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fd013ffb0 msgr2=0x7f8fd01527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fd013ffb0 0x7f8fd01527c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f8fd013a7b0 tx=0x7f8fc0007ae0).stop 2021-06-25T04:47:49.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 -- 172.21.15.57:0/3188290838 shutdown_connections 2021-06-25T04:47:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fb4055340 0x7f8fb4057800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fd0143970 0x7f8fd0137bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fd013ffb0 0x7f8fd01527c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 --2- 172.21.15.57:0/3188290838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd00670e0 0x7f8fd01476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 -- 172.21.15.57:0/3188290838 >> 172.21.15.57:0/3188290838 conn(0x7f8fd005f9b0 msgr2=0x7f8fd013d440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:49.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 -- 172.21.15.57:0/3188290838 shutdown_connections 2021-06-25T04:47:49.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.519+0000 7f8fd5615700 1 -- 172.21.15.57:0/3188290838 wait complete. 2021-06-25T04:47:49.534 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2021-06-25T04:47:49.541 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2021-06-25T04:47:48.453925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390816,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583904,"statfs":{"total":773094113280,"available":764501917696,"internally_reserved":8589934592,"allocated":2195456,"data_stored":866672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.422929"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.063061+0000","last_change":"2021-06-25T04:47:40.058602+0000","last_active":"2021-06-25T04:47:40.063061+0000","last_peered":"2021-06-25T04:47:40.063061+0000","last_clean":"2021-06-25T04:47:40.063061+0000","last_became_active":"2021-06-25T04:47:40.057840+0000","last_became_peered":"2021-06-25T04:47:40.057840+0000","last_unstale":"2021-06-25T04:47:40.063061+0000","last_undegraded":"2021-06-25T04:47:40.063061+0000","last_fullsized":"2021-06-25T04:47:40.063061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.050778+0000","last_change":"2021-06-25T04:47:29.030351+0000","last_active":"2021-06-25T04:47:40.050778+0000","last_peered":"2021-06-25T04:47:40.050778+0000","last_clean":"2021-06-25T04:47:40.050778+0000","last_became_active":"2021-06-25T04:47:29.028725+0000","last_became_peered":"2021-06-25T04:47:29.028725+0000","last_unstale":"2021-06-25T04:47:40.050778+0000","last_undegraded":"2021-06-25T04:47:40.050778+0000","last_fullsized":"2021-06-25T04:47:40.050778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:25.443883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:25.443883+0000","last_clean_scrub_stamp":"2021-06-25T04:47:25.443883+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.043159+0000","last_change":"2021-06-25T04:47:33.562610+0000","last_active":"2021-06-25T04:47:40.043159+0000","last_peered":"2021-06-25T04:47:40.043159+0000","last_clean":"2021-06-25T04:47:40.043159+0000","last_became_active":"2021-06-25T04:47:33.562250+0000","last_became_peered":"2021-06-25T04:47:33.562250+0000","last_unstale":"2021-06-25T04:47:40.043159+0000","last_undegraded":"2021-06-25T04:47:40.043159+0000","last_fullsized":"2021-06-25T04:47:40.043159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.043506+0000","last_change":"2021-06-25T04:47:36.700201+0000","last_active":"2021-06-25T04:47:40.043506+0000","last_peered":"2021-06-25T04:47:40.043506+0000","last_clean":"2021-06-25T04:47:40.043506+0000","last_became_active":"2021-06-25T04:47:36.699773+0000","last_became_peered":"2021-06-25T04:47:36.699773+0000","last_unstale":"2021-06-25T04:47:40.043506+0000","last_undegraded":"2021-06-25T04:47:40.043506+0000","last_fullsized":"2021-06-25T04:47:40.043506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.054637+0000","last_change":"2021-06-25T04:47:40.053144+0000","last_active":"2021-06-25T04:47:40.054637+0000","last_peered":"2021-06-25T04:47:40.054637+0000","last_clean":"2021-06-25T04:47:40.054637+0000","last_became_active":"2021-06-25T04:47:40.052742+0000","last_became_peered":"2021-06-25T04:47:40.052742+0000","last_unstale":"2021-06-25T04:47:40.054637+0000","last_undegraded":"2021-06-25T04:47:40.054637+0000","last_fullsized":"2021-06-25T04:47:40.054637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.050694+0000","last_change":"2021-06-25T04:47:33.560332+0000","last_active":"2021-06-25T04:47:40.050694+0000","last_peered":"2021-06-25T04:47:40.050694+0000","last_clean":"2021-06-25T04:47:40.050694+0000","last_became_active":"2021-06-25T04:47:33.559708+0000","last_became_peered":"2021-06-25T04:47:33.559708+0000","last_unstale":"2021-06-25T04:47:40.050694+0000","last_undegraded":"2021-06-25T04:47:40.050694+0000","last_fullsized":"2021-06-25T04:47:40.050694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.026578+0000","last_change":"2021-06-25T04:47:36.700748+0000","last_active":"2021-06-25T04:47:40.026578+0000","last_peered":"2021-06-25T04:47:40.026578+0000","last_clean":"2021-06-25T04:47:40.026578+0000","last_became_active":"2021-06-25T04:47:36.700387+0000","last_became_peered":"2021-06-25T04:47:36.700387+0000","last_unstale":"2021-06-25T04:47:40.026578+0000","last_undegraded":"2021-06-25T04:47:40.026578+0000","last_fullsized":"2021-06-25T04:47:40.026578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.048385+0000","last_change":"2021-06-25T04:47:40.046233+0000","last_active":"2021-06-25T04:47:40.048385+0000","last_peered":"2021-06-25T04:47:40.048385+0000","last_clean":"2021-06-25T04:47:40.048385+0000","last_became_active":"2021-06-25T04:47:40.044470+0000","last_became_peered":"2021-06-25T04:47:40.044470+0000","last_unstale":"2021-06-25T04:47:40.048385+0000","last_undegraded":"2021-06-25T04:47:40.048385+0000","last_fullsized":"2021-06-25T04:47:40.048385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.027096+0000","last_change":"2021-06-25T04:47:33.608982+0000","last_active":"2021-06-25T04:47:40.027096+0000","last_peered":"2021-06-25T04:47:40.027096+0000","last_clean":"2021-06-25T04:47:40.027096+0000","last_became_active":"2021-06-25T04:47:33.608340+0000","last_became_peered":"2021-06-25T04:47:33.608340+0000","last_unstale":"2021-06-25T04:47:40.027096+0000","last_undegraded":"2021-06-25T04:47:40.027096+0000","last_fullsized":"2021-06-25T04:47:40.027096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.048387+0000","last_change":"2021-06-25T04:47:36.697844+0000","last_active":"2021-06-25T04:47:40.048387+0000","last_peered":"2021-06-25T04:47:40.048387+0000","last_clean":"2021-06-25T04:47:40.048387+0000","last_became_active":"2021-06-25T04:47:36.697236+0000","last_became_peered":"2021-06-25T04:47:36.697236+0000","last_unstale":"2021-06-25T04:47:40.048387+0000","last_undegraded":"2021-06-25T04:47:40.048387+0000","last_fullsized":"2021-06-25T04:47:40.048387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.036376+0000","last_change":"2021-06-25T04:47:39.716470+0000","last_active":"2021-06-25T04:47:40.036376+0000","last_peered":"2021-06-25T04:47:40.036376+0000","last_clean":"2021-06-25T04:47:40.036376+0000","last_became_active":"2021-06-25T04:47:39.715372+0000","last_became_peered":"2021-06-25T04:47:39.715372+0000","last_unstale":"2021-06-25T04:47:40.036376+0000","last_undegraded":"2021-06-25T04:47:40.036376+0000","last_fullsized":"2021-06-25T04:47:40.036376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.043547+0000","last_change":"2021-06-25T04:47:33.562562+0000","last_active":"2021-06-25T04:47:40.043547+0000","last_peered":"2021-06-25T04:47:40.043547+0000","last_clean":"2021-06-25T04:47:40.043547+0000","last_became_active":"2021-06-25T04:47:33.561980+0000","last_became_peered":"2021-06-25T04:47:33.561980+0000","last_unstale":"2021-06-25T04:47:40.043547+0000","last_undegraded":"2021-06-25T04:47:40.043547+0000","last_fullsized":"2021-06-25T04:47:40.043547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.051629+0000","last_change":"2021-06-25T04:47:36.713998+0000","last_active":"2021-06-25T04:47:40.051629+0000","last_peered":"2021-06-25T04:47:40.051629+0000","last_clean":"2021-06-25T04:47:40.051629+0000","last_became_active":"2021-06-25T04:47:36.713525+0000","last_became_peered":"2021-06-25T04:47:36.713525+0000","last_unstale":"2021-06-25T04:47:40.051629+0000","last_undegraded":"2021-06-25T04:47:40.051629+0000","last_fullsized":"2021-06-25T04:47:40.051629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.048334+0000","last_change":"2021-06-25T04:47:40.045293+0000","last_active":"2021-06-25T04:47:40.048334+0000","last_peered":"2021-06-25T04:47:40.048334+0000","last_clean":"2021-06-25T04:47:40.048334+0000","last_became_active":"2021-06-25T04:47:40.043910+0000","last_became_peered":"2021-06-25T04:47:40.043910+0000","last_unstale":"2021-06-25T04:47:40.048334+0000","last_undegraded":"2021-06-25T04:47:40.048334+0000","last_fullsized":"2021-06-25T04:47:40.048334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.052386+0000","last_change":"2021-06-25T04:47:36.706617+0000","last_active":"2021-06-25T04:47:40.052386+0000","last_peered":"2021-06-25T04:47:40.052386+0000","last_clean":"2021-06-25T04:47:40.052386+0000","last_became_active":"2021-06-25T04:47:36.706082+0000","last_became_peered":"2021-06-25T04:47:36.706082+0000","last_unstale":"2021-06-25T04:47:40.052386+0000","last_undegraded":"2021-06-25T04:47:40.052386+0000","last_fullsized":"2021-06-25T04:47:40.052386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.036633+0000","last_change":"2021-06-25T04:47:33.607795+0000","last_active":"2021-06-25T04:47:40.036633+0000","last_peered":"2021-06-25T04:47:40.036633+0000","last_clean":"2021-06-25T04:47:40.036633+0000","last_became_active":"2021-06-25T04:47:33.607259+0000","last_became_peered":"2021-06-25T04:47:33.607259+0000","last_unstale":"2021-06-25T04:47:40.036633+0000","last_undegraded":"2021-06-25T04:47:40.036633+0000","last_fullsized":"2021-06-25T04:47:40.036633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.053870+0000","last_change":"2021-06-25T04:47:40.052502+0000","last_active":"2021-06-25T04:47:40.053870+0000","last_peered":"2021-06-25T04:47:40.053870+0000","last_clean":"2021-06-25T04:47:40.053870+0000","last_became_active":"2021-06-25T04:47:40.051991+0000","last_became_peered":"2021-06-25T04:47:40.051991+0000","last_unstale":"2021-06-25T04:47:40.053870+0000","last_undegraded":"2021-06-25T04:47:40.053870+0000","last_fullsized":"2021-06-25T04:47:40.053870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.049662+0000","last_change":"2021-06-25T04:47:36.696085+0000","last_active":"2021-06-25T04:47:40.049662+0000","last_peered":"2021-06-25T04:47:40.049662+0000","last_clean":"2021-06-25T04:47:40.049662+0000","last_became_active":"2021-06-25T04:47:36.695472+0000","last_became_peered":"2021-06-25T04:47:36.695472+0000","last_unstale":"2021-06-25T04:47:40.049662+0000","last_undegraded":"2021-06-25T04:47:40.049662+0000","last_fullsized":"2021-06-25T04:47:40.049662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.050836+0000","last_change":"2021-06-25T04:47:33.614414+0000","last_active":"2021-06-25T04:47:40.050836+0000","last_peered":"2021-06-25T04:47:40.050836+0000","last_clean":"2021-06-25T04:47:40.050836+0000","last_became_active":"2021-06-25T04:47:33.613559+0000","last_became_peered":"2021-06-25T04:47:33.613559+0000","last_unstale":"2021-06-25T04:47:40.050836+0000","last_undegraded":"2021-06-25T04:47:40.050836+0000","last_fullsized":"2021-06-25T04:47:40.050836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.054897+0000","last_change":"2021-06-25T04:47:40.052962+0000","last_active":"2021-06-25T04:47:40.054897+0000","last_peered":"2021-06-25T04:47:40.054897+0000","last_clean":"2021-06-25T04:47:40.054897+0000","last_became_active":"2021-06-25T04:47:40.052100+0000","last_became_peered":"2021-06-25T04:47:40.052100+0000","last_unstale":"2021-06-25T04:47:40.054897+0000","last_undegraded":"2021-06-25T04:47:40.054897+0000","last_fullsized":"2021-06-25T04:47:40.054897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.046665+0000","last_change":"2021-06-25T04:47:36.848294+0000","last_active":"2021-06-25T04:47:40.046665+0000","last_peered":"2021-06-25T04:47:40.046665+0000","last_clean":"2021-06-25T04:47:40.046665+0000","last_became_active":"2021-06-25T04:47:36.847693+0000","last_became_peered":"2021-06-25T04:47:36.847693+0000","last_unstale":"2021-06-25T04:47:40.046665+0000","last_undegraded":"2021-06-25T04:47:40.046665+0000","last_fullsized":"2021-06-25T04:47:40.046665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.036474+0000","last_change":"2021-06-25T04:47:33.555017+0000","last_active":"2021-06-25T04:47:40.036474+0000","last_peered":"2021-06-25T04:47:40.036474+0000","last_clean":"2021-06-25T04:47:40.036474+0000","last_became_active":"2021-06-25T04:47:33.554237+0000","last_became_peered":"2021-06-25T04:47:33.554237+0000","last_unstale":"2021-06-25T04:47:40.036474+0000","last_undegraded":"2021-06-25T04:47:40.036474+0000","last_fullsized":"2021-06-25T04:47:40.036474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.063256+0000","last_change":"2021-06-25T04:47:40.059730+0000","last_active":"2021-06-25T04:47:40.063256+0000","last_peered":"2021-06-25T04:47:40.063256+0000","last_clean":"2021-06-25T04:47:40.063256+0000","last_became_active":"2021-06-25T04:47:40.058474+0000","last_became_peered":"2021-06-25T04:47:40.058474+0000","last_unstale":"2021-06-25T04:47:40.063256+0000","last_undegraded":"2021-06-25T04:47:40.063256+0000","last_fullsized":"2021-06-25T04:47:40.063256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"25'4","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-06-25T04:47:41.686369+0000","last_change":"2021-06-25T04:47:36.708572+0000","last_active":"2021-06-25T04:47:41.686369+0000","last_peered":"2021-06-25T04:47:41.686369+0000","last_clean":"2021-06-25T04:47:41.686369+0000","last_became_active":"2021-06-25T04:47:36.707982+0000","last_became_peered":"2021-06-25T04:47:36.707982+0000","last_unstale":"2021-06-25T04:47:41.686369+0000","last_undegraded":"2021-06-25T04:47:41.686369+0000","last_fullsized":"2021-06-25T04:47:41.686369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.033783+0000","last_change":"2021-06-25T04:47:33.560136+0000","last_active":"2021-06-25T04:47:40.033783+0000","last_peered":"2021-06-25T04:47:40.033783+0000","last_clean":"2021-06-25T04:47:40.033783+0000","last_became_active":"2021-06-25T04:47:33.559590+0000","last_became_peered":"2021-06-25T04:47:33.559590+0000","last_unstale":"2021-06-25T04:47:40.033783+0000","last_undegraded":"2021-06-25T04:47:40.033783+0000","last_fullsized":"2021-06-25T04:47:40.033783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":108333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":107758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":107918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":107792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":108493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":109293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":109293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":107792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]}]}} 2021-06-25T04:47:49.544 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-06-25T04:47:49.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.639+0000 7f35ea5ee700 1 Processor -- start 2021-06-25T04:47:49.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.639+0000 7f35ea5ee700 1 -- start start 2021-06-25T04:47:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.639+0000 7f35ea5ee700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35e4061640 0x7f35e40b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.639+0000 7f35ea5ee700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f35e4143960 0x7f35e4140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.639+0000 7f35ea5ee700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e40b68d0 con 0x7f35e40b46d0 2021-06-25T04:47:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.639+0000 7f35ea5ee700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e40b9640 con 0x7f35e4143960 2021-06-25T04:47:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.639+0000 7f35ea5ee700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40b6b70 con 0x7f35e4061640 2021-06-25T04:47:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.639+0000 7f35e9ded700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f35e4143960 0x7f35e4140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.639+0000 7f35e8deb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f35e40b46d0 0x7f35e413fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52758/0 (socket says 172.21.15.57:52758) 2021-06-25T04:47:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.639+0000 7f35e8deb700 1 -- 172.21.15.57:0/1642458600 learned_addr learned my addr 172.21.15.57:0/1642458600 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.639+0000 7f35e95ec700 1 --2- 172.21.15.57:0/1642458600 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35e4061640 0x7f35e40b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35dbfff700 1 -- 172.21.15.57:0/1642458600 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691916568 0 0) 0x7f35e40b68d0 con 0x7f35e40b46d0 2021-06-25T04:47:49.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35dbfff700 1 -- 172.21.15.57:0/1642458600 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c8003260 con 0x7f35e40b46d0 2021-06-25T04:47:49.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35e95ec700 1 -- 172.21.15.57:0/1642458600 >> v2:172.21.15.57:3300/0 conn(0x7f35e4143960 msgr2=0x7f35e4140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:49.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35e95ec700 1 --2- 172.21.15.57:0/1642458600 >> v2:172.21.15.57:3300/0 conn(0x7f35e4143960 0x7f35e4140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35e95ec700 1 -- 172.21.15.57:0/1642458600 >> v1:172.21.15.57:6789/0 conn(0x7f35e40b46d0 legacy=0x7f35e413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35e95ec700 1 -- 172.21.15.57:0/1642458600 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e40b6e10 con 0x7f35e4061640 2021-06-25T04:47:49.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35e9ded700 1 --2- 172.21.15.57:0/1642458600 >> v2:172.21.15.57:3300/0 conn(0x7f35e4143960 0x7f35e4140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:49.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35e95ec700 1 --2- 172.21.15.57:0/1642458600 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35e4061640 0x7f35e40b9cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f35e0002f70 tx=0x7f35e0006df0).ready entity=mon.2 client_cookie=76a4db06a7bda6f8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35dbfff700 1 -- 172.21.15.57:0/1642458600 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35e000d4a0 con 0x7f35e4061640 2021-06-25T04:47:49.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35dbfff700 1 -- 172.21.15.57:0/1642458600 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e0000e90 con 0x7f35e4061640 2021-06-25T04:47:49.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35dbfff700 1 -- 172.21.15.57:0/1642458600 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35e000d7f0 con 0x7f35e4061640 2021-06-25T04:47:49.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1642458600 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35e4061640 msgr2=0x7f35e40b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35ea5ee700 1 --2- 172.21.15.57:0/1642458600 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35e4061640 0x7f35e40b9cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f35e0002f70 tx=0x7f35e0006df0).stop 2021-06-25T04:47:49.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1642458600 shutdown_connections 2021-06-25T04:47:49.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35ea5ee700 1 --2- 172.21.15.57:0/1642458600 >> v2:172.21.15.57:3300/0 conn(0x7f35e4143960 0x7f35e4140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35ea5ee700 1 --2- 172.21.15.57:0/1642458600 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35e4061640 0x7f35e40b9cd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1642458600 >> 172.21.15.57:0/1642458600 conn(0x7f35e406adb0 msgr2=0x7f35e405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:49.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1642458600 shutdown_connections 2021-06-25T04:47:49.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.643+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1642458600 wait complete. 2021-06-25T04:47:49.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35ea5ee700 1 Processor -- start 2021-06-25T04:47:49.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35ea5ee700 1 -- start start 2021-06-25T04:47:49.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35ea5ee700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35e4061640 0x7f35e413ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35ea5ee700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35e4143960 0x7f35e413b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35ea5ee700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35e41485a0 0x7f35e40b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35ea5ee700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e413a200 con 0x7f35e4143960 2021-06-25T04:47:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35ea5ee700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40b8720 con 0x7f35e41485a0 2021-06-25T04:47:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35ea5ee700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e4140960 con 0x7f35e4061640 2021-06-25T04:47:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35e8deb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35e4143960 0x7f35e413b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35e8deb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35e4143960 0x7f35e413b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35546/0 (socket says 172.21.15.57:35546) 2021-06-25T04:47:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35e8deb700 1 -- 172.21.15.57:0/1813668706 learned_addr learned my addr 172.21.15.57:0/1813668706 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35e95ec700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35e4061640 0x7f35e413ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.647+0000 7f35e9ded700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35e41485a0 0x7f35e40b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35e8deb700 1 -- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35e4061640 msgr2=0x7f35e413ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35e8deb700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35e4061640 0x7f35e413ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35e8deb700 1 -- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35e41485a0 msgr2=0x7f35e40b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35e8deb700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35e41485a0 0x7f35e40b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35e8deb700 1 -- 172.21.15.57:0/1813668706 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc009470 con 0x7f35e4143960 2021-06-25T04:47:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35e8deb700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35e4143960 0x7f35e413b4b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f35d4001110 tx=0x7f35d4007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35da7fc700 1 -- 172.21.15.57:0/1813668706 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35d40070d0 con 0x7f35e4143960 2021-06-25T04:47:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35da7fc700 1 -- 172.21.15.57:0/1813668706 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d4007230 con 0x7f35e4143960 2021-06-25T04:47:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1813668706 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e000b180 con 0x7f35e4143960 2021-06-25T04:47:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35da7fc700 1 -- 172.21.15.57:0/1813668706 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35d4005610 con 0x7f35e4143960 2021-06-25T04:47:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1813668706 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e413a3f0 con 0x7f35e4143960 2021-06-25T04:47:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1813668706 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e413a830 con 0x7f35e4143960 2021-06-25T04:47:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35da7fc700 1 -- 172.21.15.57:0/1813668706 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f35d4010070 con 0x7f35e4143960 2021-06-25T04:47:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35da7fc700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35cc055450 0x7f35cc057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35da7fc700 1 -- 172.21.15.57:0/1813668706 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f35d406d590 con 0x7f35e4143960 2021-06-25T04:47:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.651+0000 7f35e95ec700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35cc055450 0x7f35cc057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.655+0000 7f35e95ec700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35cc055450 0x7f35cc057910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f35e0019000 tx=0x7f35e0014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.659+0000 7f35da7fc700 1 -- 172.21.15.57:0/1813668706 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f35d40436a0 con 0x7f35e4143960 2021-06-25T04:47:49.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.787+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1813668706 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35e4057310 con 0x7f35cc055450 2021-06-25T04:47:49.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.791+0000 7f35da7fc700 1 -- 172.21.15.57:0/1813668706 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82469 (secure 0 0 0) 0x7f35e4057310 con 0x7f35cc055450 2021-06-25T04:47:49.801 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:49.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35cc055450 msgr2=0x7f35cc057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35cc055450 0x7f35cc057910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f35e0019000 tx=0x7f35e0014000).stop 2021-06-25T04:47:49.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1813668706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35e4143960 msgr2=0x7f35e413b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35e4143960 0x7f35e413b4b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f35d4001110 tx=0x7f35d4007aa0).stop 2021-06-25T04:47:49.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1813668706 shutdown_connections 2021-06-25T04:47:49.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f35cc055450 0x7f35cc057910 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35e41485a0 0x7f35e40b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35e4143960 0x7f35e413b4b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 --2- 172.21.15.57:0/1813668706 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35e4061640 0x7f35e413ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1813668706 >> 172.21.15.57:0/1813668706 conn(0x7f35e406adb0 msgr2=0x7f35e4142e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:49.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1813668706 shutdown_connections 2021-06-25T04:47:49.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.795+0000 7f35ea5ee700 1 -- 172.21.15.57:0/1813668706 wait complete. 2021-06-25T04:47:49.806 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2021-06-25T04:47:49.815 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2021-06-25T04:47:48.453925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390816,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583904,"statfs":{"total":773094113280,"available":764501917696,"internally_reserved":8589934592,"allocated":2195456,"data_stored":866672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.422929"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.063061+0000","last_change":"2021-06-25T04:47:40.058602+0000","last_active":"2021-06-25T04:47:40.063061+0000","last_peered":"2021-06-25T04:47:40.063061+0000","last_clean":"2021-06-25T04:47:40.063061+0000","last_became_active":"2021-06-25T04:47:40.057840+0000","last_became_peered":"2021-06-25T04:47:40.057840+0000","last_unstale":"2021-06-25T04:47:40.063061+0000","last_undegraded":"2021-06-25T04:47:40.063061+0000","last_fullsized":"2021-06-25T04:47:40.063061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.050778+0000","last_change":"2021-06-25T04:47:29.030351+0000","last_active":"2021-06-25T04:47:40.050778+0000","last_peered":"2021-06-25T04:47:40.050778+0000","last_clean":"2021-06-25T04:47:40.050778+0000","last_became_active":"2021-06-25T04:47:29.028725+0000","last_became_peered":"2021-06-25T04:47:29.028725+0000","last_unstale":"2021-06-25T04:47:40.050778+0000","last_undegraded":"2021-06-25T04:47:40.050778+0000","last_fullsized":"2021-06-25T04:47:40.050778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:25.443883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:25.443883+0000","last_clean_scrub_stamp":"2021-06-25T04:47:25.443883+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.043159+0000","last_change":"2021-06-25T04:47:33.562610+0000","last_active":"2021-06-25T04:47:40.043159+0000","last_peered":"2021-06-25T04:47:40.043159+0000","last_clean":"2021-06-25T04:47:40.043159+0000","last_became_active":"2021-06-25T04:47:33.562250+0000","last_became_peered":"2021-06-25T04:47:33.562250+0000","last_unstale":"2021-06-25T04:47:40.043159+0000","last_undegraded":"2021-06-25T04:47:40.043159+0000","last_fullsized":"2021-06-25T04:47:40.043159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.043506+0000","last_change":"2021-06-25T04:47:36.700201+0000","last_active":"2021-06-25T04:47:40.043506+0000","last_peered":"2021-06-25T04:47:40.043506+0000","last_clean":"2021-06-25T04:47:40.043506+0000","last_became_active":"2021-06-25T04:47:36.699773+0000","last_became_peered":"2021-06-25T04:47:36.699773+0000","last_unstale":"2021-06-25T04:47:40.043506+0000","last_undegraded":"2021-06-25T04:47:40.043506+0000","last_fullsized":"2021-06-25T04:47:40.043506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.054637+0000","last_change":"2021-06-25T04:47:40.053144+0000","last_active":"2021-06-25T04:47:40.054637+0000","last_peered":"2021-06-25T04:47:40.054637+0000","last_clean":"2021-06-25T04:47:40.054637+0000","last_became_active":"2021-06-25T04:47:40.052742+0000","last_became_peered":"2021-06-25T04:47:40.052742+0000","last_unstale":"2021-06-25T04:47:40.054637+0000","last_undegraded":"2021-06-25T04:47:40.054637+0000","last_fullsized":"2021-06-25T04:47:40.054637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.050694+0000","last_change":"2021-06-25T04:47:33.560332+0000","last_active":"2021-06-25T04:47:40.050694+0000","last_peered":"2021-06-25T04:47:40.050694+0000","last_clean":"2021-06-25T04:47:40.050694+0000","last_became_active":"2021-06-25T04:47:33.559708+0000","last_became_peered":"2021-06-25T04:47:33.559708+0000","last_unstale":"2021-06-25T04:47:40.050694+0000","last_undegraded":"2021-06-25T04:47:40.050694+0000","last_fullsized":"2021-06-25T04:47:40.050694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.026578+0000","last_change":"2021-06-25T04:47:36.700748+0000","last_active":"2021-06-25T04:47:40.026578+0000","last_peered":"2021-06-25T04:47:40.026578+0000","last_clean":"2021-06-25T04:47:40.026578+0000","last_became_active":"2021-06-25T04:47:36.700387+0000","last_became_peered":"2021-06-25T04:47:36.700387+0000","last_unstale":"2021-06-25T04:47:40.026578+0000","last_undegraded":"2021-06-25T04:47:40.026578+0000","last_fullsized":"2021-06-25T04:47:40.026578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.048385+0000","last_change":"2021-06-25T04:47:40.046233+0000","last_active":"2021-06-25T04:47:40.048385+0000","last_peered":"2021-06-25T04:47:40.048385+0000","last_clean":"2021-06-25T04:47:40.048385+0000","last_became_active":"2021-06-25T04:47:40.044470+0000","last_became_peered":"2021-06-25T04:47:40.044470+0000","last_unstale":"2021-06-25T04:47:40.048385+0000","last_undegraded":"2021-06-25T04:47:40.048385+0000","last_fullsized":"2021-06-25T04:47:40.048385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.027096+0000","last_change":"2021-06-25T04:47:33.608982+0000","last_active":"2021-06-25T04:47:40.027096+0000","last_peered":"2021-06-25T04:47:40.027096+0000","last_clean":"2021-06-25T04:47:40.027096+0000","last_became_active":"2021-06-25T04:47:33.608340+0000","last_became_peered":"2021-06-25T04:47:33.608340+0000","last_unstale":"2021-06-25T04:47:40.027096+0000","last_undegraded":"2021-06-25T04:47:40.027096+0000","last_fullsized":"2021-06-25T04:47:40.027096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.048387+0000","last_change":"2021-06-25T04:47:36.697844+0000","last_active":"2021-06-25T04:47:40.048387+0000","last_peered":"2021-06-25T04:47:40.048387+0000","last_clean":"2021-06-25T04:47:40.048387+0000","last_became_active":"2021-06-25T04:47:36.697236+0000","last_became_peered":"2021-06-25T04:47:36.697236+0000","last_unstale":"2021-06-25T04:47:40.048387+0000","last_undegraded":"2021-06-25T04:47:40.048387+0000","last_fullsized":"2021-06-25T04:47:40.048387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.036376+0000","last_change":"2021-06-25T04:47:39.716470+0000","last_active":"2021-06-25T04:47:40.036376+0000","last_peered":"2021-06-25T04:47:40.036376+0000","last_clean":"2021-06-25T04:47:40.036376+0000","last_became_active":"2021-06-25T04:47:39.715372+0000","last_became_peered":"2021-06-25T04:47:39.715372+0000","last_unstale":"2021-06-25T04:47:40.036376+0000","last_undegraded":"2021-06-25T04:47:40.036376+0000","last_fullsized":"2021-06-25T04:47:40.036376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.043547+0000","last_change":"2021-06-25T04:47:33.562562+0000","last_active":"2021-06-25T04:47:40.043547+0000","last_peered":"2021-06-25T04:47:40.043547+0000","last_clean":"2021-06-25T04:47:40.043547+0000","last_became_active":"2021-06-25T04:47:33.561980+0000","last_became_peered":"2021-06-25T04:47:33.561980+0000","last_unstale":"2021-06-25T04:47:40.043547+0000","last_undegraded":"2021-06-25T04:47:40.043547+0000","last_fullsized":"2021-06-25T04:47:40.043547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.051629+0000","last_change":"2021-06-25T04:47:36.713998+0000","last_active":"2021-06-25T04:47:40.051629+0000","last_peered":"2021-06-25T04:47:40.051629+0000","last_clean":"2021-06-25T04:47:40.051629+0000","last_became_active":"2021-06-25T04:47:36.713525+0000","last_became_peered":"2021-06-25T04:47:36.713525+0000","last_unstale":"2021-06-25T04:47:40.051629+0000","last_undegraded":"2021-06-25T04:47:40.051629+0000","last_fullsized":"2021-06-25T04:47:40.051629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.048334+0000","last_change":"2021-06-25T04:47:40.045293+0000","last_active":"2021-06-25T04:47:40.048334+0000","last_peered":"2021-06-25T04:47:40.048334+0000","last_clean":"2021-06-25T04:47:40.048334+0000","last_became_active":"2021-06-25T04:47:40.043910+0000","last_became_peered":"2021-06-25T04:47:40.043910+0000","last_unstale":"2021-06-25T04:47:40.048334+0000","last_undegraded":"2021-06-25T04:47:40.048334+0000","last_fullsized":"2021-06-25T04:47:40.048334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.052386+0000","last_change":"2021-06-25T04:47:36.706617+0000","last_active":"2021-06-25T04:47:40.052386+0000","last_peered":"2021-06-25T04:47:40.052386+0000","last_clean":"2021-06-25T04:47:40.052386+0000","last_became_active":"2021-06-25T04:47:36.706082+0000","last_became_peered":"2021-06-25T04:47:36.706082+0000","last_unstale":"2021-06-25T04:47:40.052386+0000","last_undegraded":"2021-06-25T04:47:40.052386+0000","last_fullsized":"2021-06-25T04:47:40.052386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.036633+0000","last_change":"2021-06-25T04:47:33.607795+0000","last_active":"2021-06-25T04:47:40.036633+0000","last_peered":"2021-06-25T04:47:40.036633+0000","last_clean":"2021-06-25T04:47:40.036633+0000","last_became_active":"2021-06-25T04:47:33.607259+0000","last_became_peered":"2021-06-25T04:47:33.607259+0000","last_unstale":"2021-06-25T04:47:40.036633+0000","last_undegraded":"2021-06-25T04:47:40.036633+0000","last_fullsized":"2021-06-25T04:47:40.036633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.053870+0000","last_change":"2021-06-25T04:47:40.052502+0000","last_active":"2021-06-25T04:47:40.053870+0000","last_peered":"2021-06-25T04:47:40.053870+0000","last_clean":"2021-06-25T04:47:40.053870+0000","last_became_active":"2021-06-25T04:47:40.051991+0000","last_became_peered":"2021-06-25T04:47:40.051991+0000","last_unstale":"2021-06-25T04:47:40.053870+0000","last_undegraded":"2021-06-25T04:47:40.053870+0000","last_fullsized":"2021-06-25T04:47:40.053870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.049662+0000","last_change":"2021-06-25T04:47:36.696085+0000","last_active":"2021-06-25T04:47:40.049662+0000","last_peered":"2021-06-25T04:47:40.049662+0000","last_clean":"2021-06-25T04:47:40.049662+0000","last_became_active":"2021-06-25T04:47:36.695472+0000","last_became_peered":"2021-06-25T04:47:36.695472+0000","last_unstale":"2021-06-25T04:47:40.049662+0000","last_undegraded":"2021-06-25T04:47:40.049662+0000","last_fullsized":"2021-06-25T04:47:40.049662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.050836+0000","last_change":"2021-06-25T04:47:33.614414+0000","last_active":"2021-06-25T04:47:40.050836+0000","last_peered":"2021-06-25T04:47:40.050836+0000","last_clean":"2021-06-25T04:47:40.050836+0000","last_became_active":"2021-06-25T04:47:33.613559+0000","last_became_peered":"2021-06-25T04:47:33.613559+0000","last_unstale":"2021-06-25T04:47:40.050836+0000","last_undegraded":"2021-06-25T04:47:40.050836+0000","last_fullsized":"2021-06-25T04:47:40.050836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.054897+0000","last_change":"2021-06-25T04:47:40.052962+0000","last_active":"2021-06-25T04:47:40.054897+0000","last_peered":"2021-06-25T04:47:40.054897+0000","last_clean":"2021-06-25T04:47:40.054897+0000","last_became_active":"2021-06-25T04:47:40.052100+0000","last_became_peered":"2021-06-25T04:47:40.052100+0000","last_unstale":"2021-06-25T04:47:40.054897+0000","last_undegraded":"2021-06-25T04:47:40.054897+0000","last_fullsized":"2021-06-25T04:47:40.054897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.046665+0000","last_change":"2021-06-25T04:47:36.848294+0000","last_active":"2021-06-25T04:47:40.046665+0000","last_peered":"2021-06-25T04:47:40.046665+0000","last_clean":"2021-06-25T04:47:40.046665+0000","last_became_active":"2021-06-25T04:47:36.847693+0000","last_became_peered":"2021-06-25T04:47:36.847693+0000","last_unstale":"2021-06-25T04:47:40.046665+0000","last_undegraded":"2021-06-25T04:47:40.046665+0000","last_fullsized":"2021-06-25T04:47:40.046665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.036474+0000","last_change":"2021-06-25T04:47:33.555017+0000","last_active":"2021-06-25T04:47:40.036474+0000","last_peered":"2021-06-25T04:47:40.036474+0000","last_clean":"2021-06-25T04:47:40.036474+0000","last_became_active":"2021-06-25T04:47:33.554237+0000","last_became_peered":"2021-06-25T04:47:33.554237+0000","last_unstale":"2021-06-25T04:47:40.036474+0000","last_undegraded":"2021-06-25T04:47:40.036474+0000","last_fullsized":"2021-06-25T04:47:40.036474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.063256+0000","last_change":"2021-06-25T04:47:40.059730+0000","last_active":"2021-06-25T04:47:40.063256+0000","last_peered":"2021-06-25T04:47:40.063256+0000","last_clean":"2021-06-25T04:47:40.063256+0000","last_became_active":"2021-06-25T04:47:40.058474+0000","last_became_peered":"2021-06-25T04:47:40.058474+0000","last_unstale":"2021-06-25T04:47:40.063256+0000","last_undegraded":"2021-06-25T04:47:40.063256+0000","last_fullsized":"2021-06-25T04:47:40.063256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:38.687142+0000","last_clean_scrub_stamp":"2021-06-25T04:47:38.687142+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"25'4","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-06-25T04:47:41.686369+0000","last_change":"2021-06-25T04:47:36.708572+0000","last_active":"2021-06-25T04:47:41.686369+0000","last_peered":"2021-06-25T04:47:41.686369+0000","last_clean":"2021-06-25T04:47:41.686369+0000","last_became_active":"2021-06-25T04:47:36.707982+0000","last_became_peered":"2021-06-25T04:47:36.707982+0000","last_unstale":"2021-06-25T04:47:41.686369+0000","last_undegraded":"2021-06-25T04:47:41.686369+0000","last_fullsized":"2021-06-25T04:47:41.686369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:35.666800+0000","last_clean_scrub_stamp":"2021-06-25T04:47:35.666800+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2021-06-25T04:47:40.033783+0000","last_change":"2021-06-25T04:47:33.560136+0000","last_active":"2021-06-25T04:47:40.033783+0000","last_peered":"2021-06-25T04:47:40.033783+0000","last_clean":"2021-06-25T04:47:40.033783+0000","last_became_active":"2021-06-25T04:47:33.559590+0000","last_became_peered":"2021-06-25T04:47:33.559590+0000","last_unstale":"2021-06-25T04:47:40.033783+0000","last_undegraded":"2021-06-25T04:47:40.033783+0000","last_fullsized":"2021-06-25T04:47:40.033783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":108333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":107758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":107918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":107792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":108493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":109293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":109293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":107792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]}]}} 2021-06-25T04:47:49.818 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-06-25T04:47:49.818 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-06-25T04:47:49.819 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-06-25T04:47:49.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-06-25T04:47:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.919+0000 7faab1a40700 1 Processor -- start 2021-06-25T04:47:49.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.919+0000 7faab1a40700 1 -- start start 2021-06-25T04:47:49.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.919+0000 7faab1a40700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faaac0a9380 0x7faaac0af660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.919+0000 7faab1a40700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac0afd60 con 0x7faaac0af280 2021-06-25T04:47:49.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.919+0000 7faab1a40700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac05c5d0 con 0x7faaac0ad2e0 2021-06-25T04:47:49.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.919+0000 7faab1a40700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac1407c0 con 0x7faaac0a9380 2021-06-25T04:47:49.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.919+0000 7faab0a3e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faaac0af280 0x7faaac143110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52770/0 (socket says 172.21.15.57:52770) 2021-06-25T04:47:49.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.919+0000 7faab0a3e700 1 -- 172.21.15.57:0/612876978 learned_addr learned my addr 172.21.15.57:0/612876978 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:49.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.919+0000 7faab123f700 1 --2- 172.21.15.57:0/612876978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faaac0a9380 0x7faaac0af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faaab7fe700 1 -- 172.21.15.57:0/612876978 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099246579 0 0) 0x7faaac0afd60 con 0x7faaac0af280 2021-06-25T04:47:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab123f700 1 -- 172.21.15.57:0/612876978 >> v1:172.21.15.87:6789/0 conn(0x7faaac0ad2e0 legacy=0x7faaac0a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab123f700 1 -- 172.21.15.57:0/612876978 >> v1:172.21.15.57:6789/0 conn(0x7faaac0af280 legacy=0x7faaac143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab123f700 1 -- 172.21.15.57:0/612876978 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac143820 con 0x7faaac0a9380 2021-06-25T04:47:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab123f700 1 --2- 172.21.15.57:0/612876978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faaac0a9380 0x7faaac0af660 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7faaac0ad730 tx=0x7faaa40091d0).ready entity=mon.2 client_cookie=be499e16ad6416 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faaab7fe700 1 -- 172.21.15.57:0/612876978 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaa400b860 con 0x7faaac0a9380 2021-06-25T04:47:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faaab7fe700 1 -- 172.21.15.57:0/612876978 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa400b9c0 con 0x7faaac0a9380 2021-06-25T04:47:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faaab7fe700 1 -- 172.21.15.57:0/612876978 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaa400bb30 con 0x7faaac0a9380 2021-06-25T04:47:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab1a40700 1 -- 172.21.15.57:0/612876978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faaac0a9380 msgr2=0x7faaac0af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab1a40700 1 --2- 172.21.15.57:0/612876978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faaac0a9380 0x7faaac0af660 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7faaac0ad730 tx=0x7faaa40091d0).stop 2021-06-25T04:47:49.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab1a40700 1 -- 172.21.15.57:0/612876978 shutdown_connections 2021-06-25T04:47:49.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab1a40700 1 --2- 172.21.15.57:0/612876978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faaac0a9380 0x7faaac0af660 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab1a40700 1 -- 172.21.15.57:0/612876978 >> 172.21.15.57:0/612876978 conn(0x7faaac061100 msgr2=0x7faaac062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab1a40700 1 -- 172.21.15.57:0/612876978 shutdown_connections 2021-06-25T04:47:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab1a40700 1 -- 172.21.15.57:0/612876978 wait complete. 2021-06-25T04:47:49.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab1a40700 1 Processor -- start 2021-06-25T04:47:49.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.923+0000 7faab1a40700 1 -- start start 2021-06-25T04:47:49.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab1a40700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaac0a9380 0x7faaac140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab1a40700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faaac0ad2e0 0x7faaac063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab1a40700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0af280 0x7faaac063b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab1a40700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac064d70 con 0x7faaac0af280 2021-06-25T04:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab1a40700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac150bb0 con 0x7faaac0a9380 2021-06-25T04:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab1a40700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac09f240 con 0x7faaac0ad2e0 2021-06-25T04:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab123f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0af280 0x7faaac063b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab123f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0af280 0x7faaac063b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35562/0 (socket says 172.21.15.57:35562) 2021-06-25T04:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab123f700 1 -- 172.21.15.57:0/3116149637 learned_addr learned my addr 172.21.15.57:0/3116149637 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faaabfff700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faaac0ad2e0 0x7faaac063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab0a3e700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaac0a9380 0x7faaac140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab123f700 1 -- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faaac0ad2e0 msgr2=0x7faaac063690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab123f700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faaac0ad2e0 0x7faaac063690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab123f700 1 -- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaac0a9380 msgr2=0x7faaac140f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab123f700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaac0a9380 0x7faaac140f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab123f700 1 -- 172.21.15.57:0/3116149637 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa4009470 con 0x7faaac0af280 2021-06-25T04:47:49.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab0a3e700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaac0a9380 0x7faaac140f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:49.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab123f700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0af280 0x7faaac063b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7faaac0ad730 tx=0x7faaa4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faaa9ffb700 1 -- 172.21.15.57:0/3116149637 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaa4011de0 con 0x7faaac0af280 2021-06-25T04:47:49.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faaa9ffb700 1 -- 172.21.15.57:0/3116149637 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa4021440 con 0x7faaac0af280 2021-06-25T04:47:49.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab1a40700 1 -- 172.21.15.57:0/3116149637 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac1508a0 con 0x7faaac0af280 2021-06-25T04:47:49.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faaa9ffb700 1 -- 172.21.15.57:0/3116149637 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaa40217a0 con 0x7faaac0af280 2021-06-25T04:47:49.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab1a40700 1 -- 172.21.15.57:0/3116149637 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac0b29f0 con 0x7faaac0af280 2021-06-25T04:47:49.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.927+0000 7faab1a40700 1 -- 172.21.15.57:0/3116149637 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac150d70 con 0x7faaac0af280 2021-06-25T04:47:49.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.931+0000 7faaa9ffb700 1 -- 172.21.15.57:0/3116149637 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7faaa4029070 con 0x7faaac0af280 2021-06-25T04:47:49.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.931+0000 7faaa9ffb700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa8c0553f0 0x7faa8c0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:49.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.931+0000 7faaa9ffb700 1 -- 172.21.15.57:0/3116149637 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7faaa406eda0 con 0x7faaac0af280 2021-06-25T04:47:49.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.931+0000 7faab0a3e700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa8c0553f0 0x7faa8c0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:49.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.931+0000 7faab0a3e700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa8c0553f0 0x7faa8c0578b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7faa9c00b000 tx=0x7faa9c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:49.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:49.939+0000 7faaa9ffb700 1 -- 172.21.15.57:0/3116149637 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7faaa4044f90 con 0x7faaac0af280 2021-06-25T04:47:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.107+0000 7faab1a40700 1 -- 172.21.15.57:0/3116149637 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faaac057310 con 0x7faaac0af280 2021-06-25T04:47:50.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.107+0000 7faaa9ffb700 1 -- 172.21.15.57:0/3116149637 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7faaa4048570 con 0x7faaac0af280 2021-06-25T04:47:50.118 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:50.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 -- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa8c0553f0 msgr2=0x7faa8c0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa8c0553f0 0x7faa8c0578b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7faa9c00b000 tx=0x7faa9c009040).stop 2021-06-25T04:47:50.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 -- 172.21.15.57:0/3116149637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0af280 msgr2=0x7faaac063b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0af280 0x7faaac063b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7faaac0ad730 tx=0x7faaa4016000).stop 2021-06-25T04:47:50.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 -- 172.21.15.57:0/3116149637 shutdown_connections 2021-06-25T04:47:50.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa8c0553f0 0x7faa8c0578b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaac0af280 0x7faaac063b80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faaac0ad2e0 0x7faaac063690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 --2- 172.21.15.57:0/3116149637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaac0a9380 0x7faaac140f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 -- 172.21.15.57:0/3116149637 >> 172.21.15.57:0/3116149637 conn(0x7faaac061100 msgr2=0x7faaac0a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:50.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 -- 172.21.15.57:0/3116149637 shutdown_connections 2021-06-25T04:47:50.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.111+0000 7faab1a40700 1 -- 172.21.15.57:0/3116149637 wait complete. 2021-06-25T04:47:50.129 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-06-25T04:47:50.130 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-06-25T04:47:50.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:50.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0f59e700 1 Processor -- start 2021-06-25T04:47:50.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0f59e700 1 -- start start 2021-06-25T04:47:50.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100b2810 0x7f1f100b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0f59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1f1013c6a0 0x7f1f1013cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0f59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f100b2bf0 con 0x7f1f1005c450 2021-06-25T04:47:50.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0f59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f100b1620 con 0x7f1f1013c6a0 2021-06-25T04:47:50.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100b18c0 con 0x7f1f100b2810 2021-06-25T04:47:50.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0ed9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1f1005c450 0x7f1f100acee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52786/0 (socket says 172.21.15.57:52786) 2021-06-25T04:47:50.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0ed9d700 1 -- 172.21.15.57:0/1605984041 learned_addr learned my addr 172.21.15.57:0/1605984041 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:50.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0dd9b700 1 --2- 172.21.15.57:0/1605984041 >> v2:172.21.15.87:3300/0 conn(0x7f1f1013c6a0 0x7f1f1013cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0e59c700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100b2810 0x7f1f100b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912697475 0 0) 0x7f1f100b2bf0 con 0x7f1f1005c450 2021-06-25T04:47:50.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef0003260 con 0x7f1f1005c450 2021-06-25T04:47:50.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3997345709 0 0) 0x7f1ef0003260 con 0x7f1f1005c450 2021-06-25T04:47:50.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100b2810 msgr2=0x7f1f100b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:50.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100b2810 0x7f1f100b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 >> v2:172.21.15.87:3300/0 conn(0x7f1f1013c6a0 msgr2=0x7f1f1013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:50.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 --2- 172.21.15.57:0/1605984041 >> v2:172.21.15.87:3300/0 conn(0x7f1f1013c6a0 0x7f1f1013cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f100b1b60 con 0x7f1f1005c450 2021-06-25T04:47:50.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f1f080019e0 con 0x7f1f1005c450 2021-06-25T04:47:50.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 >> v1:172.21.15.57:6789/0 conn(0x7f1f1005c450 legacy=0x7f1f100acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ef0003750 0x7f1ef0003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100b2810 0x7f1ef0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef00049f0 0x7f1ef0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100b1620 con 0x7f1ef0003750 2021-06-25T04:47:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100b18c0 con 0x7f1ef00049f0 2021-06-25T04:47:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef000b750 con 0x7f1f100b2810 2021-06-25T04:47:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0e59c700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ef0003750 0x7f1ef0003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0dd9b700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100b2810 0x7f1ef0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.227+0000 7f1f0ed9d700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef00049f0 0x7f1ef0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0e59c700 1 -- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100b2810 msgr2=0x7f1ef0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:50.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0e59c700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100b2810 0x7f1ef0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0e59c700 1 -- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef00049f0 msgr2=0x7f1ef0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:50.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0e59c700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef00049f0 0x7f1ef0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0e59c700 1 -- 172.21.15.57:0/1605984041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef0003260 con 0x7f1ef0003750 2021-06-25T04:47:50.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0ed9d700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef00049f0 0x7f1ef0004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:47:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0e59c700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ef0003750 0x7f1ef0003b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f1f0000c000 tx=0x7f1f00006df0).ready entity=mon.0 client_cookie=e042909c63415943 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f0000e830 con 0x7f1ef0003750 2021-06-25T04:47:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0000e990 con 0x7f1ef0003750 2021-06-25T04:47:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0d59a700 1 -- 172.21.15.57:0/1605984041 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f0000ecf0 con 0x7f1ef0003750 2021-06-25T04:47:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0f59e700 1 -- 172.21.15.57:0/1605984041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ef0003750 msgr2=0x7f1ef0003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0f59e700 1 --2- 172.21.15.57:0/1605984041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ef0003750 0x7f1ef0003b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f1f0000c000 tx=0x7f1f00006df0).stop 2021-06-25T04:47:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0ed9d700 1 -- 172.21.15.57:0/1605984041 reap_dead start 2021-06-25T04:47:50.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0f59e700 1 -- 172.21.15.57:0/1605984041 shutdown_connections 2021-06-25T04:47:50.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0f59e700 1 -- 172.21.15.57:0/1605984041 >> 172.21.15.57:0/1605984041 conn(0x7f1f100611f0 msgr2=0x7f1f10062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:50.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0f59e700 1 -- 172.21.15.57:0/1605984041 shutdown_connections 2021-06-25T04:47:50.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0f59e700 1 -- 172.21.15.57:0/1605984041 wait complete. 2021-06-25T04:47:50.264 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0f59e700 1 Processor -- start 2021-06-25T04:47:50.264 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.231+0000 7f1f0f59e700 1 -- start start 2021-06-25T04:47:50.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f10065620 0x7f1f100b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100677a0 0x7f1f10063aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f10135c60 0x7f1f10136110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0f59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10065a00 con 0x7f1f10065620 2021-06-25T04:47:50.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10065ca0 con 0x7f1f10135c60 2021-06-25T04:47:50.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100644c0 con 0x7f1f100677a0 2021-06-25T04:47:50.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f10065620 0x7f1f100b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f10065620 0x7f1f100b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35578/0 (socket says 172.21.15.57:35578) 2021-06-25T04:47:50.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0e59c700 1 -- 172.21.15.57:0/2590411868 learned_addr learned my addr 172.21.15.57:0/2590411868 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:50.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0dd9b700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100677a0 0x7f1f10063aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0ed9d700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f10135c60 0x7f1f10136110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0e59c700 1 -- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100677a0 msgr2=0x7f1f10063aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0e59c700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100677a0 0x7f1f10063aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0e59c700 1 -- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f10135c60 msgr2=0x7f1f10136110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0e59c700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f10135c60 0x7f1f10136110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0e59c700 1 -- 172.21.15.57:0/2590411868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1014fbf0 con 0x7f1f10065620 2021-06-25T04:47:50.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0ed9d700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f10135c60 0x7f1f10136110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:50.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0e59c700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f10065620 0x7f1f100b3620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f1f10063860 tx=0x7f1f00019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:50.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f077fe700 1 -- 172.21.15.57:0/2590411868 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f0000eee0 con 0x7f1f10065620 2021-06-25T04:47:50.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f077fe700 1 -- 172.21.15.57:0/2590411868 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f00000e90 con 0x7f1f10065620 2021-06-25T04:47:50.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0f59e700 1 -- 172.21.15.57:0/2590411868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f10136600 con 0x7f1f10065620 2021-06-25T04:47:50.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f077fe700 1 -- 172.21.15.57:0/2590411868 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f0000be60 con 0x7f1f10065620 2021-06-25T04:47:50.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0f59e700 1 -- 172.21.15.57:0/2590411868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f100660a0 con 0x7f1f10065620 2021-06-25T04:47:50.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f0f59e700 1 -- 172.21.15.57:0/2590411868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f100646c0 con 0x7f1f10065620 2021-06-25T04:47:50.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f077fe700 1 -- 172.21.15.57:0/2590411868 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1f000243f0 con 0x7f1f10065620 2021-06-25T04:47:50.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.235+0000 7f1f077fe700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ef4055510 0x7f1ef40579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.239+0000 7f1f077fe700 1 -- 172.21.15.57:0/2590411868 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1f0006f390 con 0x7f1f10065620 2021-06-25T04:47:50.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.239+0000 7f1f0dd9b700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ef4055510 0x7f1ef40579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.239+0000 7f1f0dd9b700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ef4055510 0x7f1ef40579d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1ef800b000 tx=0x7f1ef8008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:50.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.243+0000 7f1f077fe700 1 -- 172.21.15.57:0/2590411868 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1f00048f10 con 0x7f1f10065620 2021-06-25T04:47:50.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.371+0000 7f1f0f59e700 1 -- 172.21.15.57:0/2590411868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f1014fa30 con 0x7f1f10065620 2021-06-25T04:47:50.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.371+0000 7f1f077fe700 1 -- 172.21.15.57:0/2590411868 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f1f0000b3c0 con 0x7f1f10065620 2021-06-25T04:47:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:50.383 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:41.021834+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:50.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 -- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ef4055510 msgr2=0x7f1ef40579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ef4055510 0x7f1ef40579d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1ef800b000 tx=0x7f1ef8008040).stop 2021-06-25T04:47:50.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 -- 172.21.15.57:0/2590411868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f10065620 msgr2=0x7f1f100b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f10065620 0x7f1f100b3620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f1f10063860 tx=0x7f1f00019000).stop 2021-06-25T04:47:50.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 -- 172.21.15.57:0/2590411868 shutdown_connections 2021-06-25T04:47:50.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ef4055510 0x7f1ef40579d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f10135c60 0x7f1f10136110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f100677a0 0x7f1f10063aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 --2- 172.21.15.57:0/2590411868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f10065620 0x7f1f100b3620 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 -- 172.21.15.57:0/2590411868 >> 172.21.15.57:0/2590411868 conn(0x7f1f100611f0 msgr2=0x7f1f100adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:50.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 -- 172.21.15.57:0/2590411868 shutdown_connections 2021-06-25T04:47:50.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.375+0000 7f1f0f59e700 1 -- 172.21.15.57:0/2590411868 wait complete. 2021-06-25T04:47:50.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:47:34.957337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:47:37.729999+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:47:50.397 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:47:50.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.499+0000 7fafc8b98700 1 Processor -- start 2021-06-25T04:47:50.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.499+0000 7fafc8b98700 1 -- start start 2021-06-25T04:47:50.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.499+0000 7fafc8b98700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fafc40b06d0 0x7fafc4142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.499+0000 7fafc8b98700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc41438e0 con 0x7fafc40b3090 2021-06-25T04:47:50.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.499+0000 7fafc8b98700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc40b0ab0 con 0x7fafc40ace30 2021-06-25T04:47:50.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.499+0000 7fafc8b98700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc40ae640 con 0x7fafc40b06d0 2021-06-25T04:47:50.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.499+0000 7fafc2ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fafc40b3090 0x7fafc41431d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52806/0 (socket says 172.21.15.57:52806) 2021-06-25T04:47:50.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.499+0000 7fafc2ffd700 1 -- 172.21.15.57:0/2210947178 learned_addr learned my addr 172.21.15.57:0/2210947178 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:50.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc37fe700 1 --2- 172.21.15.57:0/2210947178 >> v2:172.21.15.87:3300/0 conn(0x7fafc40b06d0 0x7fafc4142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562904324 0 0) 0x7fafc41438e0 con 0x7fafc40b3090 2021-06-25T04:47:50.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa4004370 con 0x7fafc40b3090 2021-06-25T04:47:50.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153051060 0 0) 0x7fafc40b0ab0 con 0x7fafc40ace30 2021-06-25T04:47:50.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc41438e0 con 0x7fafc40ace30 2021-06-25T04:47:50.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 922388880 0 0) 0x7fafa4004370 con 0x7fafc40b3090 2021-06-25T04:47:50.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 >> v2:172.21.15.87:3300/0 conn(0x7fafc40b06d0 msgr2=0x7fafc4142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:50.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 --2- 172.21.15.57:0/2210947178 >> v2:172.21.15.87:3300/0 conn(0x7fafc40b06d0 0x7fafc4142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 >> v1:172.21.15.87:6789/0 conn(0x7fafc40ace30 legacy=0x7fafc413f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40ae8e0 con 0x7fafc40b3090 2021-06-25T04:47:50.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fafac001660 con 0x7fafc40b3090 2021-06-25T04:47:50.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 >> v1:172.21.15.57:6789/0 conn(0x7fafc40b3090 legacy=0x7fafc41431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 --2- 172.21.15.57:0/2210947178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafa4004a40 0x7fafa4004e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 --2- 172.21.15.57:0/2210947178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa4005610 0x7fafa4005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 --2- 172.21.15.57:0/2210947178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 0x7fafa400c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40ae640 con 0x7fafa4005f80 2021-06-25T04:47:50.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa400ceb0 con 0x7fafa4004a40 2021-06-25T04:47:50.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa400d070 con 0x7fafa4005610 2021-06-25T04:47:50.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc3fff700 1 --2- 172.21.15.57:0/2210947178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 0x7fafa400c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc37fe700 1 --2- 172.21.15.57:0/2210947178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafa4004a40 0x7fafa4004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc2ffd700 1 --2- 172.21.15.57:0/2210947178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa4005610 0x7fafa4005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc3fff700 1 -- 172.21.15.57:0/2210947178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa4005610 msgr2=0x7fafa4005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:50.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc3fff700 1 --2- 172.21.15.57:0/2210947178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa4005610 0x7fafa4005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc3fff700 1 -- 172.21.15.57:0/2210947178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafa4004a40 msgr2=0x7fafa4004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:50.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc3fff700 1 --2- 172.21.15.57:0/2210947178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafa4004a40 0x7fafa4004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc3fff700 1 -- 172.21.15.57:0/2210947178 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4004370 con 0x7fafa4005f80 2021-06-25T04:47:50.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc3fff700 1 -- 172.21.15.57:0/2210947178 reap_dead start 2021-06-25T04:47:50.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc3fff700 1 --2- 172.21.15.57:0/2210947178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 0x7fafa400c860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fafbc001490 tx=0x7fafbc007d80).ready entity=mon.0 client_cookie=6dfbaee59541b7e6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:50.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafbc001780 con 0x7fafa4005f80 2021-06-25T04:47:50.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc006890 con 0x7fafa4005f80 2021-06-25T04:47:50.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc27fc700 1 -- 172.21.15.57:0/2210947178 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafbc006bf0 con 0x7fafa4005f80 2021-06-25T04:47:50.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc8b98700 1 -- 172.21.15.57:0/2210947178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 msgr2=0x7fafa400c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc8b98700 1 --2- 172.21.15.57:0/2210947178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 0x7fafa400c860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fafbc001490 tx=0x7fafbc007d80).stop 2021-06-25T04:47:50.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc8b98700 1 -- 172.21.15.57:0/2210947178 shutdown_connections 2021-06-25T04:47:50.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc8b98700 1 --2- 172.21.15.57:0/2210947178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 0x7fafa400c860 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc8b98700 1 -- 172.21.15.57:0/2210947178 >> 172.21.15.57:0/2210947178 conn(0x7fafc4061100 msgr2=0x7fafc4062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:50.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc8b98700 1 -- 172.21.15.57:0/2210947178 shutdown_connections 2021-06-25T04:47:50.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.503+0000 7fafc8b98700 1 -- 172.21.15.57:0/2210947178 wait complete. 2021-06-25T04:47:50.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc8b98700 1 Processor -- start 2021-06-25T04:47:50.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc8b98700 1 -- start start 2021-06-25T04:47:50.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc8b98700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 0x7fafc40abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc8b98700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafc4065930 0x7fafc4152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc8b98700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafc4156340 0x7fafc40a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc8b98700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4155c70 con 0x7fafa4005f80 2021-06-25T04:47:50.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc8b98700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40650f0 con 0x7fafc4156340 2021-06-25T04:47:50.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc8b98700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4155ea0 con 0x7fafc4065930 2021-06-25T04:47:50.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 0x7fafc40abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 0x7fafc40abc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35598/0 (socket says 172.21.15.57:35598) 2021-06-25T04:47:50.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc37fe700 1 -- 172.21.15.57:0/3172329286 learned_addr learned my addr 172.21.15.57:0/3172329286 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:50.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc2ffd700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafc4065930 0x7fafc4152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc3fff700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafc4156340 0x7fafc40a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc37fe700 1 -- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafc4065930 msgr2=0x7fafc4152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc37fe700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafc4065930 0x7fafc4152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc37fe700 1 -- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafc4156340 msgr2=0x7fafc40a86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc37fe700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafc4156340 0x7fafc40a86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc37fe700 1 -- 172.21.15.57:0/3172329286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4065390 con 0x7fafa4005f80 2021-06-25T04:47:50.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc37fe700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 0x7fafc40abc50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fafb400b000 tx=0x7fafb4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:50.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc0ff9700 1 -- 172.21.15.57:0/3172329286 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafb40145f0 con 0x7fafa4005f80 2021-06-25T04:47:50.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc0ff9700 1 -- 172.21.15.57:0/3172329286 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb4014750 con 0x7fafa4005f80 2021-06-25T04:47:50.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc8b98700 1 -- 172.21.15.57:0/3172329286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc4064d70 con 0x7fafa4005f80 2021-06-25T04:47:50.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc0ff9700 1 -- 172.21.15.57:0/3172329286 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafb4014ab0 con 0x7fafa4005f80 2021-06-25T04:47:50.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc8b98700 1 -- 172.21.15.57:0/3172329286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc40b1510 con 0x7fafa4005f80 2021-06-25T04:47:50.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.507+0000 7fafc8b98700 1 -- 172.21.15.57:0/3172329286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc4057310 con 0x7fafa4005f80 2021-06-25T04:47:50.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.511+0000 7fafc0ff9700 1 -- 172.21.15.57:0/3172329286 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fafb4012040 con 0x7fafa4005f80 2021-06-25T04:47:50.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.511+0000 7fafc0ff9700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafa80553f0 0x7fafa80578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.511+0000 7fafc0ff9700 1 -- 172.21.15.57:0/3172329286 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fafb406e6b0 con 0x7fafa4005f80 2021-06-25T04:47:50.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.511+0000 7fafc2ffd700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafa80553f0 0x7fafa80578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.511+0000 7fafc2ffd700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafa80553f0 0x7fafa80578b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fafac00d000 tx=0x7fafac009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:50.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.519+0000 7fafc0ff9700 1 -- 172.21.15.57:0/3172329286 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fafb4044860 con 0x7fafa4005f80 2021-06-25T04:47:50.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.647+0000 7fafc8b98700 1 -- 172.21.15.57:0/3172329286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fafc4061910 con 0x7fafa4005f80 2021-06-25T04:47:50.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.647+0000 7fafc0ff9700 1 -- 172.21.15.57:0/3172329286 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fafb4047e80 con 0x7fafa4005f80 2021-06-25T04:47:50.656 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:47:50.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 -- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafa80553f0 msgr2=0x7fafa80578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafa80553f0 0x7fafa80578b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fafac00d000 tx=0x7fafac009040).stop 2021-06-25T04:47:50.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 -- 172.21.15.57:0/3172329286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 msgr2=0x7fafc40abc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 0x7fafc40abc50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fafb400b000 tx=0x7fafb4006df0).stop 2021-06-25T04:47:50.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 -- 172.21.15.57:0/3172329286 shutdown_connections 2021-06-25T04:47:50.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafa80553f0 0x7fafa80578b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafc4156340 0x7fafc40a86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafc4065930 0x7fafc4152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 --2- 172.21.15.57:0/3172329286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa4005f80 0x7fafc40abc50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 -- 172.21.15.57:0/3172329286 >> 172.21.15.57:0/3172329286 conn(0x7fafc4061100 msgr2=0x7fafc413fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:50.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 -- 172.21.15.57:0/3172329286 shutdown_connections 2021-06-25T04:47:50.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.651+0000 7fafc8b98700 1 -- 172.21.15.57:0/3172329286 wait complete. 2021-06-25T04:47:50.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:47:50.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 Processor -- start 2021-06-25T04:47:50.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 -- start start 2021-06-25T04:47:50.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac40b4140 0x7fcac4140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcac40b4650 0x7fcac40b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac4143b20 con 0x7fcac4146910 2021-06-25T04:47:50.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac41474d0 con 0x7fcac40b4650 2021-06-25T04:47:50.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4143dc0 con 0x7fcac40b4140 2021-06-25T04:47:50.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac2d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcac40b4650 0x7fcac40b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac2d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcac40b4650 0x7fcac40b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35608/0 (socket says 172.21.15.57:35608) 2021-06-25T04:47:50.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac2d9d700 1 -- 172.21.15.57:0/1618213239 learned_addr learned my addr 172.21.15.57:0/1618213239 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:50.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac1d9b700 1 --2- 172.21.15.57:0/1618213239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac40b4140 0x7fcac4140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac2d9d700 1 -- 172.21.15.57:0/1618213239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac40b4140 msgr2=0x7fcac4140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:50.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac2d9d700 1 --2- 172.21.15.57:0/1618213239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac40b4140 0x7fcac4140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac2d9d700 1 -- 172.21.15.57:0/1618213239 >> v1:172.21.15.87:6789/0 conn(0x7fcac4146910 legacy=0x7fcac41401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac2d9d700 1 -- 172.21.15.57:0/1618213239 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40b0c50 con 0x7fcac40b4650 2021-06-25T04:47:50.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac2d9d700 1 --2- 172.21.15.57:0/1618213239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac40b4650 0x7fcac40b4e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fcabc0032f0 tx=0x7fcabc009290).ready entity=mon.0 client_cookie=c23b81af9893a2f4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:50.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac159a700 1 -- 172.21.15.57:0/1618213239 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc00b8a0 con 0x7fcac40b4650 2021-06-25T04:47:50.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac159a700 1 -- 172.21.15.57:0/1618213239 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00ba00 con 0x7fcac40b4650 2021-06-25T04:47:50.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac159a700 1 -- 172.21.15.57:0/1618213239 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc00bb70 con 0x7fcac40b4650 2021-06-25T04:47:50.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 -- 172.21.15.57:0/1618213239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac40b4650 msgr2=0x7fcac40b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 --2- 172.21.15.57:0/1618213239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac40b4650 0x7fcac40b4e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fcabc0032f0 tx=0x7fcabc009290).stop 2021-06-25T04:47:50.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 -- 172.21.15.57:0/1618213239 shutdown_connections 2021-06-25T04:47:50.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 --2- 172.21.15.57:0/1618213239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac40b4650 0x7fcac40b4e90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 --2- 172.21.15.57:0/1618213239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac40b4140 0x7fcac4140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 -- 172.21.15.57:0/1618213239 >> 172.21.15.57:0/1618213239 conn(0x7fcac405c450 msgr2=0x7fcac405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:50.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 -- 172.21.15.57:0/1618213239 shutdown_connections 2021-06-25T04:47:50.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.779+0000 7fcac8977700 1 -- 172.21.15.57:0/1618213239 wait complete. 2021-06-25T04:47:50.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac8977700 1 Processor -- start 2021-06-25T04:47:50.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac8977700 1 -- start start 2021-06-25T04:47:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac8977700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac40b4140 0x7fcac4141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac8977700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac40b4650 0x7fcac4155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac8977700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac4146910 0x7fcac4155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac8977700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4152100 con 0x7fcac40b4650 2021-06-25T04:47:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac8977700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac41523a0 con 0x7fcac40b4140 2021-06-25T04:47:50.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac8977700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4152640 con 0x7fcac4146910 2021-06-25T04:47:50.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac1d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac40b4650 0x7fcac4155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac1d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac40b4650 0x7fcac4155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35614/0 (socket says 172.21.15.57:35614) 2021-06-25T04:47:50.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac1d9b700 1 -- 172.21.15.57:0/2842522464 learned_addr learned my addr 172.21.15.57:0/2842522464 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:50.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac259c700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac40b4140 0x7fcac4141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac2d9d700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac4146910 0x7fcac4155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac1d9b700 1 -- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac4146910 msgr2=0x7fcac4155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac1d9b700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac4146910 0x7fcac4155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac1d9b700 1 -- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac40b4140 msgr2=0x7fcac4141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac1d9b700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac40b4140 0x7fcac4141f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac1d9b700 1 -- 172.21.15.57:0/2842522464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc009530 con 0x7fcac40b4650 2021-06-25T04:47:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac259c700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac40b4140 0x7fcac4141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac1d9b700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac40b4650 0x7fcac4155650 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fcab400a000 tx=0x7fcab4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcab37fe700 1 -- 172.21.15.57:0/2842522464 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab4011780 con 0x7fcac40b4650 2021-06-25T04:47:50.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcab37fe700 1 -- 172.21.15.57:0/2842522464 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab40118e0 con 0x7fcac40b4650 2021-06-25T04:47:50.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac8977700 1 -- 172.21.15.57:0/2842522464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac41528e0 con 0x7fcac40b4650 2021-06-25T04:47:50.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcab37fe700 1 -- 172.21.15.57:0/2842522464 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab4011c40 con 0x7fcac40b4650 2021-06-25T04:47:50.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.783+0000 7fcac8977700 1 -- 172.21.15.57:0/2842522464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac40b04e0 con 0x7fcac40b4650 2021-06-25T04:47:50.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.787+0000 7fcac8977700 1 -- 172.21.15.57:0/2842522464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac4152a70 con 0x7fcac40b4650 2021-06-25T04:47:50.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.787+0000 7fcab37fe700 1 -- 172.21.15.57:0/2842522464 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcab4012420 con 0x7fcac40b4650 2021-06-25T04:47:50.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.787+0000 7fcab37fe700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 0x7fcaa0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:50.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.787+0000 7fcab37fe700 1 -- 172.21.15.57:0/2842522464 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcab406ddf0 con 0x7fcac40b4650 2021-06-25T04:47:50.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.787+0000 7fcac259c700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 0x7fcaa0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:50.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.787+0000 7fcac259c700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 0x7fcaa0057910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcab800b000 tx=0x7fcab8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:50.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.795+0000 7fcab37fe700 1 -- 172.21.15.57:0/2842522464 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcab4043db0 con 0x7fcac40b4650 2021-06-25T04:47:50.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 -- 172.21.15.57:0/2842522464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcac4057310 con 0x7fcac40b4650 2021-06-25T04:47:50.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcab37fe700 1 -- 172.21.15.57:0/2842522464 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcab40473d0 con 0x7fcac40b4650 2021-06-25T04:47:50.931 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:50.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 -- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 msgr2=0x7fcaa0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 0x7fcaa0057910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcab800b000 tx=0x7fcab8009040).stop 2021-06-25T04:47:50.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 -- 172.21.15.57:0/2842522464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac40b4650 msgr2=0x7fcac4155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:50.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac40b4650 0x7fcac4155650 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fcab400a000 tx=0x7fcab4008040).stop 2021-06-25T04:47:50.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 -- 172.21.15.57:0/2842522464 shutdown_connections 2021-06-25T04:47:50.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 0x7fcaa0057910 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac4146910 0x7fcac4155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac40b4650 0x7fcac4155650 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 --2- 172.21.15.57:0/2842522464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac40b4140 0x7fcac4141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:50.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 -- 172.21.15.57:0/2842522464 >> 172.21.15.57:0/2842522464 conn(0x7fcac405c450 msgr2=0x7fcac40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:50.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 -- 172.21.15.57:0/2842522464 shutdown_connections 2021-06-25T04:47:50.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:50.923+0000 7fcac8977700 1 -- 172.21.15.57:0/2842522464 wait complete. 2021-06-25T04:47:50.945 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:47:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.043+0000 7fb56dd10700 1 Processor -- start 2021-06-25T04:47:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.043+0000 7fb56dd10700 1 -- start start 2021-06-25T04:47:51.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb5680b2fc0 0x7fb568060ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb5680b2560 0x7fb568060fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5680664e0 0x7fb568066920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb568061fc0 con 0x7fb5680b2fc0 2021-06-25T04:47:51.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5680652f0 con 0x7fb5680b2560 2021-06-25T04:47:51.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680b33a0 con 0x7fb5680664e0 2021-06-25T04:47:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56cd0e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb5680b2fc0 0x7fb568060ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56cd0e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb5680b2fc0 0x7fb568060ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35620/0 (socket says 172.21.15.57:35620) 2021-06-25T04:47:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56cd0e700 1 -- 172.21.15.57:0/4207161658 learned_addr learned my addr 172.21.15.57:0/4207161658 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:51.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb567fff700 1 --2- 172.21.15.57:0/4207161658 >> v2:172.21.15.87:3300/0 conn(0x7fb5680b2560 0x7fb568060fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56d50f700 1 --2- 172.21.15.57:0/4207161658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5680664e0 0x7fb568066920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56cd0e700 1 -- 172.21.15.57:0/4207161658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5680664e0 msgr2=0x7fb568066920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:51.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56cd0e700 1 --2- 172.21.15.57:0/4207161658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5680664e0 0x7fb568066920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56cd0e700 1 -- 172.21.15.57:0/4207161658 >> v2:172.21.15.87:3300/0 conn(0x7fb5680b2560 msgr2=0x7fb568060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:51.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56cd0e700 1 --2- 172.21.15.57:0/4207161658 >> v2:172.21.15.87:3300/0 conn(0x7fb5680b2560 0x7fb568060fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56cd0e700 1 -- 172.21.15.57:0/4207161658 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56805fa20 con 0x7fb5680b2fc0 2021-06-25T04:47:51.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56d50f700 1 --2- 172.21.15.57:0/4207161658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5680664e0 0x7fb568066920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:51.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56cd0e700 1 --2- 172.21.15.57:0/4207161658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5680b2fc0 0x7fb568060ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fb568064720 tx=0x7fb554006eb0).ready entity=mon.0 client_cookie=ff912520a5f876d3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:51.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb5677fe700 1 -- 172.21.15.57:0/4207161658 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb55400d570 con 0x7fb5680b2fc0 2021-06-25T04:47:51.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb5677fe700 1 -- 172.21.15.57:0/4207161658 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554000e90 con 0x7fb5680b2fc0 2021-06-25T04:47:51.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb5677fe700 1 -- 172.21.15.57:0/4207161658 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb55400d900 con 0x7fb5680b2fc0 2021-06-25T04:47:51.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 -- 172.21.15.57:0/4207161658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5680b2fc0 msgr2=0x7fb568060ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 --2- 172.21.15.57:0/4207161658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5680b2fc0 0x7fb568060ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fb568064720 tx=0x7fb554006eb0).stop 2021-06-25T04:47:51.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 -- 172.21.15.57:0/4207161658 shutdown_connections 2021-06-25T04:47:51.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 --2- 172.21.15.57:0/4207161658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5680664e0 0x7fb568066920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 --2- 172.21.15.57:0/4207161658 >> v2:172.21.15.87:3300/0 conn(0x7fb5680b2560 0x7fb568060fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 --2- 172.21.15.57:0/4207161658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5680b2fc0 0x7fb568060ad0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 -- 172.21.15.57:0/4207161658 >> 172.21.15.57:0/4207161658 conn(0x7fb5680636a0 msgr2=0x7fb568063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:51.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 -- 172.21.15.57:0/4207161658 shutdown_connections 2021-06-25T04:47:51.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.047+0000 7fb56dd10700 1 -- 172.21.15.57:0/4207161658 wait complete. 2021-06-25T04:47:51.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56dd10700 1 Processor -- start 2021-06-25T04:47:51.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56dd10700 1 -- start start 2021-06-25T04:47:51.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56dd10700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5680664e0 0x7fb568060f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56dd10700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5680b2560 0x7fb5680aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56dd10700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5680b2fc0 0x7fb5680aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56dd10700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56814a1a0 con 0x7fb5680b2fc0 2021-06-25T04:47:51.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56dd10700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680b6150 con 0x7fb5680664e0 2021-06-25T04:47:51.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56dd10700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680b63d0 con 0x7fb5680b2560 2021-06-25T04:47:51.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56d50f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5680b2fc0 0x7fb5680aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56d50f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5680b2fc0 0x7fb5680aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35630/0 (socket says 172.21.15.57:35630) 2021-06-25T04:47:51.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56d50f700 1 -- 172.21.15.57:0/112563202 learned_addr learned my addr 172.21.15.57:0/112563202 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:51.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56cd0e700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5680664e0 0x7fb568060f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb567fff700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5680b2560 0x7fb5680aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56d50f700 1 -- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5680b2560 msgr2=0x7fb5680aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56d50f700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5680b2560 0x7fb5680aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56d50f700 1 -- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5680664e0 msgr2=0x7fb568060f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56d50f700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5680664e0 0x7fb568060f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56d50f700 1 -- 172.21.15.57:0/112563202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55400b1e0 con 0x7fb5680b2fc0 2021-06-25T04:47:51.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56cd0e700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5680664e0 0x7fb568060f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:47:51.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56d50f700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5680b2fc0 0x7fb5680aae90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb560006cc0 tx=0x7fb560008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:51.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb565ffb700 1 -- 172.21.15.57:0/112563202 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb56000c770 con 0x7fb5680b2fc0 2021-06-25T04:47:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb565ffb700 1 -- 172.21.15.57:0/112563202 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56000c8d0 con 0x7fb5680b2fc0 2021-06-25T04:47:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56dd10700 1 -- 172.21.15.57:0/112563202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56814a3d0 con 0x7fb5680b2fc0 2021-06-25T04:47:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb565ffb700 1 -- 172.21.15.57:0/112563202 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb56000cc30 con 0x7fb5680b2fc0 2021-06-25T04:47:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.051+0000 7fb56dd10700 1 -- 172.21.15.57:0/112563202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5680b4980 con 0x7fb5680b2fc0 2021-06-25T04:47:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.055+0000 7fb565ffb700 1 -- 172.21.15.57:0/112563202 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb560013430 con 0x7fb5680b2fc0 2021-06-25T04:47:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.055+0000 7fb56dd10700 1 -- 172.21.15.57:0/112563202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb568057310 con 0x7fb5680b2fc0 2021-06-25T04:47:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.055+0000 7fb565ffb700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5500554e0 0x7fb5500579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.055+0000 7fb565ffb700 1 -- 172.21.15.57:0/112563202 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb56006df50 con 0x7fb5680b2fc0 2021-06-25T04:47:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.055+0000 7fb56cd0e700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5500554e0 0x7fb5500579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.055+0000 7fb56cd0e700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5500554e0 0x7fb5500579a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb554016000 tx=0x7fb554015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.059+0000 7fb565ffb700 1 -- 172.21.15.57:0/112563202 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb560043f90 con 0x7fb5680b2fc0 2021-06-25T04:47:51.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.183+0000 7fb56dd10700 1 -- 172.21.15.57:0/112563202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5681455e0 con 0x7fb5680b2fc0 2021-06-25T04:47:51.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb565ffb700 1 -- 172.21.15.57:0/112563202 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb56000ee60 con 0x7fb5680b2fc0 2021-06-25T04:47:51.195 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:51.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 -- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5500554e0 msgr2=0x7fb5500579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5500554e0 0x7fb5500579a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb554016000 tx=0x7fb554015000).stop 2021-06-25T04:47:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 -- 172.21.15.57:0/112563202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5680b2fc0 msgr2=0x7fb5680aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5680b2fc0 0x7fb5680aae90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb560006cc0 tx=0x7fb560008040).stop 2021-06-25T04:47:51.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 -- 172.21.15.57:0/112563202 shutdown_connections 2021-06-25T04:47:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5500554e0 0x7fb5500579a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5680b2fc0 0x7fb5680aae90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5680b2560 0x7fb5680aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 --2- 172.21.15.57:0/112563202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5680664e0 0x7fb568060f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 -- 172.21.15.57:0/112563202 >> 172.21.15.57:0/112563202 conn(0x7fb5680636a0 msgr2=0x7fb5680b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:51.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 -- 172.21.15.57:0/112563202 shutdown_connections 2021-06-25T04:47:51.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.187+0000 7fb56dd10700 1 -- 172.21.15.57:0/112563202 wait complete. 2021-06-25T04:47:51.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:47:51.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.311+0000 7f9458e7b700 1 Processor -- start 2021-06-25T04:47:51.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.311+0000 7f9458e7b700 1 -- start start 2021-06-25T04:47:51.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.311+0000 7f9458e7b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9454066bf0 0x7f945414e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.311+0000 7f9458e7b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94540652f0 con 0x7f94540b2560 2021-06-25T04:47:51.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.311+0000 7f9458e7b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94540b33a0 con 0x7f94540b2fc0 2021-06-25T04:47:51.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.311+0000 7f9458e7b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9454061fc0 con 0x7f9454066bf0 2021-06-25T04:47:51.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.311+0000 7f9452ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f94540b2560 0x7f94540664e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52854/0 (socket says 172.21.15.57:52854) 2021-06-25T04:47:51.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.311+0000 7f9452ffd700 1 -- 172.21.15.57:0/1970872738 learned_addr learned my addr 172.21.15.57:0/1970872738 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:51.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.311+0000 7f9453fff700 1 --2- 172.21.15.57:0/1970872738 >> v2:172.21.15.87:3300/0 conn(0x7f9454066bf0 0x7f945414e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f94527fc700 1 -- 172.21.15.57:0/1970872738 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900964137 0 0) 0x7f94540652f0 con 0x7f94540b2560 2021-06-25T04:47:51.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f94527fc700 1 -- 172.21.15.57:0/1970872738 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9434003260 con 0x7f94540b2560 2021-06-25T04:47:51.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f9453fff700 1 -- 172.21.15.57:0/1970872738 >> v1:172.21.15.87:6789/0 conn(0x7f94540b2fc0 legacy=0x7f9454060ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f94527fc700 1 -- 172.21.15.57:0/1970872738 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3860430670 0 0) 0x7f9434003260 con 0x7f94540b2560 2021-06-25T04:47:51.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f9453fff700 1 -- 172.21.15.57:0/1970872738 >> v1:172.21.15.57:6789/0 conn(0x7f94540b2560 legacy=0x7f94540664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f9453fff700 1 -- 172.21.15.57:0/1970872738 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945405fa20 con 0x7f9454066bf0 2021-06-25T04:47:51.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f9453fff700 1 --2- 172.21.15.57:0/1970872738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9454066bf0 0x7f945414e8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f943c001800 tx=0x7f944c006df0).ready entity=mon.1 client_cookie=54cdbf034c395f19 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:51.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f94527fc700 1 -- 172.21.15.57:0/1970872738 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943c001660 con 0x7f9454066bf0 2021-06-25T04:47:51.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f94527fc700 1 -- 172.21.15.57:0/1970872738 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c000e90 con 0x7f9454066bf0 2021-06-25T04:47:51.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f94527fc700 1 -- 172.21.15.57:0/1970872738 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f944c00d4f0 con 0x7f9454066bf0 2021-06-25T04:47:51.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f9458e7b700 1 -- 172.21.15.57:0/1970872738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9454066bf0 msgr2=0x7f945414e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f9458e7b700 1 --2- 172.21.15.57:0/1970872738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9454066bf0 0x7f945414e8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f943c001800 tx=0x7f944c006df0).stop 2021-06-25T04:47:51.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f9458e7b700 1 -- 172.21.15.57:0/1970872738 shutdown_connections 2021-06-25T04:47:51.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f9458e7b700 1 --2- 172.21.15.57:0/1970872738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9454066bf0 0x7f945414e8f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f9458e7b700 1 -- 172.21.15.57:0/1970872738 >> 172.21.15.57:0/1970872738 conn(0x7f94540636a0 msgr2=0x7f9454063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:51.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f9458e7b700 1 -- 172.21.15.57:0/1970872738 shutdown_connections 2021-06-25T04:47:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.315+0000 7f9458e7b700 1 -- 172.21.15.57:0/1970872738 wait complete. 2021-06-25T04:47:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9458e7b700 1 Processor -- start 2021-06-25T04:47:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9458e7b700 1 -- start start 2021-06-25T04:47:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9458e7b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9454066bf0 0x7f94540b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9458e7b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94540b2560 0x7f9454151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9458e7b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94540b2fc0 0x7f9454155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9458e7b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9454155400 con 0x7f94540b2560 2021-06-25T04:47:51.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9458e7b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94541483e0 con 0x7f9454066bf0 2021-06-25T04:47:51.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9458e7b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9454155660 con 0x7f94540b2fc0 2021-06-25T04:47:51.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9452ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94540b2560 0x7f9454151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9452ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94540b2560 0x7f9454151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35642/0 (socket says 172.21.15.57:35642) 2021-06-25T04:47:51.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9452ffd700 1 -- 172.21.15.57:0/3486273913 learned_addr learned my addr 172.21.15.57:0/3486273913 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:51.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f94537fe700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9454066bf0 0x7f94540b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9453fff700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94540b2fc0 0x7f9454155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9452ffd700 1 -- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94540b2fc0 msgr2=0x7f9454155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9452ffd700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94540b2fc0 0x7f9454155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9452ffd700 1 -- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9454066bf0 msgr2=0x7f94540b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9452ffd700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9454066bf0 0x7f94540b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9452ffd700 1 -- 172.21.15.57:0/3486273913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c00b180 con 0x7f94540b2560 2021-06-25T04:47:51.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9452ffd700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94540b2560 0x7f9454151e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f943c0018c0 tx=0x7f943c001d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:51.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9450ff9700 1 -- 172.21.15.57:0/3486273913 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943c0070d0 con 0x7f94540b2560 2021-06-25T04:47:51.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9450ff9700 1 -- 172.21.15.57:0/3486273913 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c007230 con 0x7f94540b2560 2021-06-25T04:47:51.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9450ff9700 1 -- 172.21.15.57:0/3486273913 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943c005610 con 0x7f94540b2560 2021-06-25T04:47:51.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9458e7b700 1 -- 172.21.15.57:0/3486273913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9454148680 con 0x7f94540b2560 2021-06-25T04:47:51.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.319+0000 7f9458e7b700 1 -- 172.21.15.57:0/3486273913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94540a4c30 con 0x7f94540b2560 2021-06-25T04:47:51.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.323+0000 7f9458e7b700 1 -- 172.21.15.57:0/3486273913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9454155820 con 0x7f94540b2560 2021-06-25T04:47:51.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.323+0000 7f9450ff9700 1 -- 172.21.15.57:0/3486273913 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f943c010070 con 0x7f94540b2560 2021-06-25T04:47:51.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.323+0000 7f9450ff9700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94380553f0 0x7f94380578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.323+0000 7f9450ff9700 1 -- 172.21.15.57:0/3486273913 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f943c06d550 con 0x7f94540b2560 2021-06-25T04:47:51.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.323+0000 7f94537fe700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94380553f0 0x7f94380578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.323+0000 7f94537fe700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94380553f0 0x7f94380578b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f944400d000 tx=0x7f9444007f10).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:51.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.331+0000 7f9450ff9700 1 -- 172.21.15.57:0/3486273913 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f943c043700 con 0x7f94540b2560 2021-06-25T04:47:51.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.455+0000 7f9458e7b700 1 -- 172.21.15.57:0/3486273913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9454148150 con 0x7f94540b2560 2021-06-25T04:47:51.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.455+0000 7f9450ff9700 1 -- 172.21.15.57:0/3486273913 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f943c018070 con 0x7f94540b2560 2021-06-25T04:47:51.466 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:51.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 -- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94380553f0 msgr2=0x7f94380578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94380553f0 0x7f94380578b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f944400d000 tx=0x7f9444007f10).stop 2021-06-25T04:47:51.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 -- 172.21.15.57:0/3486273913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94540b2560 msgr2=0x7f9454151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94540b2560 0x7f9454151e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f943c0018c0 tx=0x7f943c001d80).stop 2021-06-25T04:47:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 -- 172.21.15.57:0/3486273913 shutdown_connections 2021-06-25T04:47:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94380553f0 0x7f94380578b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94540b2fc0 0x7f9454155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94540b2560 0x7f9454151e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 --2- 172.21.15.57:0/3486273913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9454066bf0 0x7f94540b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 -- 172.21.15.57:0/3486273913 >> 172.21.15.57:0/3486273913 conn(0x7f94540636a0 msgr2=0x7f94540b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:51.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 -- 172.21.15.57:0/3486273913 shutdown_connections 2021-06-25T04:47:51.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.459+0000 7f9458e7b700 1 -- 172.21.15.57:0/3486273913 wait complete. 2021-06-25T04:47:51.478 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:47:51.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 Processor -- start 2021-06-25T04:47:51.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 -- start start 2021-06-25T04:47:51.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0cfc0b2810 0x7f0cfc0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cfc0acee0 0x7f0cfc0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc0b2bf0 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc13d1f0 con 0x7f0cfc0b2810 2021-06-25T04:47:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0b1620 con 0x7f0cfc0acee0 2021-06-25T04:47:51.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfa59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0cfc0b2810 0x7f0cfc0b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cf9d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0cfc13c6a0 0x7f0cfc13cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52870/0 (socket says 172.21.15.57:52870) 2021-06-25T04:47:51.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cf9d9b700 1 -- 172.21.15.57:0/3462556366 learned_addr learned my addr 172.21.15.57:0/3462556366 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:51.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfad9d700 1 --2- 172.21.15.57:0/3462556366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cfc0acee0 0x7f0cfc0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfa59c700 1 -- 172.21.15.57:0/3462556366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cfc0acee0 msgr2=0x7f0cfc0ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:51.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfa59c700 1 --2- 172.21.15.57:0/3462556366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cfc0acee0 0x7f0cfc0ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfa59c700 1 -- 172.21.15.57:0/3462556366 >> v1:172.21.15.57:6789/0 conn(0x7f0cfc13c6a0 legacy=0x7f0cfc13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cf959a700 1 -- 172.21.15.57:0/3462556366 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676677393 0 0) 0x7f0cfc0b2bf0 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfa59c700 1 -- 172.21.15.57:0/3462556366 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0b18c0 con 0x7f0cfc0b2810 2021-06-25T04:47:51.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfa59c700 1 --2- 172.21.15.57:0/3462556366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cfc0b2810 0x7f0cfc0b0a60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f0cec002f70 tx=0x7f0cec006e80).ready entity=mon.0 client_cookie=c06cdb2cd3a2763b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:51.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cf959a700 1 -- 172.21.15.57:0/3462556366 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cec00b7d0 con 0x7f0cfc0b2810 2021-06-25T04:47:51.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cf959a700 1 -- 172.21.15.57:0/3462556366 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00b930 con 0x7f0cfc0b2810 2021-06-25T04:47:51.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cf959a700 1 -- 172.21.15.57:0/3462556366 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cec00bc90 con 0x7f0cfc0b2810 2021-06-25T04:47:51.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 -- 172.21.15.57:0/3462556366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cfc0b2810 msgr2=0x7f0cfc0b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 --2- 172.21.15.57:0/3462556366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cfc0b2810 0x7f0cfc0b0a60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f0cec002f70 tx=0x7f0cec006e80).stop 2021-06-25T04:47:51.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 -- 172.21.15.57:0/3462556366 shutdown_connections 2021-06-25T04:47:51.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 --2- 172.21.15.57:0/3462556366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cfc0acee0 0x7f0cfc0ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 --2- 172.21.15.57:0/3462556366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cfc0b2810 0x7f0cfc0b0a60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 -- 172.21.15.57:0/3462556366 >> 172.21.15.57:0/3462556366 conn(0x7f0cfc0611f0 msgr2=0x7f0cfc062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:51.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.575+0000 7f0cfb59e700 1 -- 172.21.15.57:0/3462556366 shutdown_connections 2021-06-25T04:47:51.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfb59e700 1 -- 172.21.15.57:0/3462556366 wait complete. 2021-06-25T04:47:51.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfb59e700 1 Processor -- start 2021-06-25T04:47:51.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfb59e700 1 -- start start 2021-06-25T04:47:51.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfb59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cfc0acee0 0x7f0cfc139730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfb59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cfc0b2810 0x7f0cfc142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cfc13c6a0 0x7f0cfc135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfb59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc140f50 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfb59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc140630 con 0x7f0cfc0b2810 2021-06-25T04:47:51.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfb59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc140b00 con 0x7f0cfc0acee0 2021-06-25T04:47:51.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cfc13c6a0 0x7f0cfc135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cfc13c6a0 0x7f0cfc135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35658/0 (socket says 172.21.15.57:35658) 2021-06-25T04:47:51.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfad9d700 1 -- 172.21.15.57:0/83070587 learned_addr learned my addr 172.21.15.57:0/83070587 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:51.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cf9d9b700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cfc0b2810 0x7f0cfc142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfa59c700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cfc0acee0 0x7f0cfc139730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfad9d700 1 -- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cfc0acee0 msgr2=0x7f0cfc139730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfad9d700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cfc0acee0 0x7f0cfc139730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfad9d700 1 -- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cfc0b2810 msgr2=0x7f0cfc142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfad9d700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cfc0b2810 0x7f0cfc142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfad9d700 1 -- 172.21.15.57:0/83070587 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec00d410 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cf9d9b700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cfc0b2810 0x7f0cfc142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:51.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfad9d700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cfc13c6a0 0x7f0cfc135cd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f0cfc063e10 tx=0x7f0cf40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:51.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0ceb7fe700 1 -- 172.21.15.57:0/83070587 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf400eee0 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0ceb7fe700 1 -- 172.21.15.57:0/83070587 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf400c850 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfb59e700 1 -- 172.21.15.57:0/83070587 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc141180 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0ceb7fe700 1 -- 172.21.15.57:0/83070587 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf400cbb0 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.579+0000 7f0cfb59e700 1 -- 172.21.15.57:0/83070587 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc0648d0 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.583+0000 7f0cfb59e700 1 -- 172.21.15.57:0/83070587 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc141d00 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.583+0000 7f0ceb7fe700 1 -- 172.21.15.57:0/83070587 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0cf400cd10 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.583+0000 7f0ceb7fe700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0cd8055340 0x7f0cd8057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:51.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.583+0000 7f0ceb7fe700 1 -- 172.21.15.57:0/83070587 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0cf406e280 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.583+0000 7f0cfa59c700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0cd8055340 0x7f0cd8057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:51.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.583+0000 7f0cfa59c700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0cd8055340 0x7f0cd8057800 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f0cec01e000 tx=0x7f0cec006e80).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:51.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.587+0000 7f0ceb7fe700 1 -- 172.21.15.57:0/83070587 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0cf40443d0 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.759+0000 7f0cfb59e700 1 -- 172.21.15.57:0/83070587 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cfc057310 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.759+0000 7f0ceb7fe700 1 -- 172.21.15.57:0/83070587 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f0cf40479f0 con 0x7f0cfc13c6a0 2021-06-25T04:47:51.768 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:51.768 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/1675349577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1675349577},{"type":"v1","addr":"172.21.15.87:6835","nonce":1675349577}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/4129321821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4129321821},{"type":"v1","addr":"172.21.15.57:6833","nonce":4129321821}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:47:40.019558+0000","modified":"2021-06-25T04:47:41.749060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1050167707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1050167707},{"type":"v1","addr":"172.21.15.57:6835","nonce":1050167707}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-06-25T04:47:51.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 -- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0cd8055340 msgr2=0x7f0cd8057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0cd8055340 0x7f0cd8057800 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f0cec01e000 tx=0x7f0cec006e80).stop 2021-06-25T04:47:51.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 -- 172.21.15.57:0/83070587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cfc13c6a0 msgr2=0x7f0cfc135cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:51.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cfc13c6a0 0x7f0cfc135cd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f0cfc063e10 tx=0x7f0cf40091d0).stop 2021-06-25T04:47:51.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 -- 172.21.15.57:0/83070587 shutdown_connections 2021-06-25T04:47:51.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0cd8055340 0x7f0cd8057800 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cfc13c6a0 0x7f0cfc135cd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cfc0b2810 0x7f0cfc142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 --2- 172.21.15.57:0/83070587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cfc0acee0 0x7f0cfc139730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:51.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 -- 172.21.15.57:0/83070587 >> 172.21.15.57:0/83070587 conn(0x7f0cfc0611f0 msgr2=0x7f0cfc0b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:51.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 -- 172.21.15.57:0/83070587 shutdown_connections 2021-06-25T04:47:51.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:51.763+0000 7f0cfb59e700 1 -- 172.21.15.57:0/83070587 wait complete. 2021-06-25T04:47:51.776 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2021-06-25T04:47:52.084 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:47:40.019558+0000', 'modified': '2021-06-25T04:47:41.749060+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/1050167707', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 1050167707}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 1050167707}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:47:52.084 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:47:52.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:47:52.204 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":4281,"want_state":"up:active","state":"up:active","rank_uptime":12.168483489,"mdsmap_epoch":7,"osdmap_epoch":25,"osdmap_epoch_barrier":25,"uptime":18.53232946} 2021-06-25T04:47:52.204 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 4281, "mdsmap_epoch": 7, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "rank_uptime": 12.168483489, "state": "up:active", "uptime": 18.53232946, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:47:52.205 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-06-25T04:47:52.229 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-06-25T04:47:52.229 INFO:tasks.ceph_fuse:config is None 2021-06-25T04:47:52.230 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None} 2021-06-25T04:47:52.230 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-06-25T04:47:52.231 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:52.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd129aa1700 1 Processor -- start 2021-06-25T04:47:52.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd129aa1700 1 -- start start 2021-06-25T04:47:52.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd129aa1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1240af920 0x7fd1240b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd129aa1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1240b04b0 0x7fd12405c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd129aa1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1240ad560 con 0x7fd1240afd00 2021-06-25T04:47:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd129aa1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1240af420 con 0x7fd1240b04b0 2021-06-25T04:47:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd129aa1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240ad020 con 0x7fd1240af920 2021-06-25T04:47:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd122ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1240b04b0 0x7fd12405c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd122ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1240b04b0 0x7fd12405c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35662/0 (socket says 172.21.15.57:35662) 2021-06-25T04:47:52.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd122ffd700 1 -- 172.21.15.57:0/1576854966 learned_addr learned my addr 172.21.15.57:0/1576854966 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:52.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd1237fe700 1 --2- 172.21.15.57:0/1576854966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1240af920 0x7fd1240b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd122ffd700 1 -- 172.21.15.57:0/1576854966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1240af920 msgr2=0x7fd1240b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:52.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd122ffd700 1 --2- 172.21.15.57:0/1576854966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1240af920 0x7fd1240b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd122ffd700 1 -- 172.21.15.57:0/1576854966 >> v1:172.21.15.87:6789/0 conn(0x7fd1240afd00 legacy=0x7fd1240b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd122ffd700 1 -- 172.21.15.57:0/1576854966 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240ad2c0 con 0x7fd1240b04b0 2021-06-25T04:47:52.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd1237fe700 1 --2- 172.21.15.57:0/1576854966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1240af920 0x7fd1240b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:52.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd122ffd700 1 --2- 172.21.15.57:0/1576854966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1240b04b0 0x7fd12405c450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd10c002f70 tx=0x7fd10c006eb0).ready entity=mon.0 client_cookie=ba82b358cb912f3b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:52.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd1227fc700 1 -- 172.21.15.57:0/1576854966 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd10c00d5c0 con 0x7fd1240b04b0 2021-06-25T04:47:52.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd1227fc700 1 -- 172.21.15.57:0/1576854966 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10c000e90 con 0x7fd1240b04b0 2021-06-25T04:47:52.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd1227fc700 1 -- 172.21.15.57:0/1576854966 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd10c00d950 con 0x7fd1240b04b0 2021-06-25T04:47:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd129aa1700 1 -- 172.21.15.57:0/1576854966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1240b04b0 msgr2=0x7fd12405c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.331+0000 7fd129aa1700 1 --2- 172.21.15.57:0/1576854966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1240b04b0 0x7fd12405c450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd10c002f70 tx=0x7fd10c006eb0).stop 2021-06-25T04:47:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 -- 172.21.15.57:0/1576854966 shutdown_connections 2021-06-25T04:47:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 --2- 172.21.15.57:0/1576854966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1240b04b0 0x7fd12405c450 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 --2- 172.21.15.57:0/1576854966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1240af920 0x7fd1240b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 -- 172.21.15.57:0/1576854966 >> 172.21.15.57:0/1576854966 conn(0x7fd12405cce0 msgr2=0x7fd124062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 -- 172.21.15.57:0/1576854966 shutdown_connections 2021-06-25T04:47:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 -- 172.21.15.57:0/1576854966 wait complete. 2021-06-25T04:47:52.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 Processor -- start 2021-06-25T04:47:52.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 -- start start 2021-06-25T04:47:52.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1240af920 0x7fd124067190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1240afd00 0x7fd1241518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1240b04b0 0x7fd124151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240a7890 con 0x7fd1240b04b0 2021-06-25T04:47:52.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240a7ac0 con 0x7fd1240afd00 2021-06-25T04:47:52.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd129aa1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240a7d60 con 0x7fd1240af920 2021-06-25T04:47:52.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.335+0000 7fd123fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1240b04b0 0x7fd124151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd1237fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1240af920 0x7fd124067190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd123fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1240b04b0 0x7fd124151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35672/0 (socket says 172.21.15.57:35672) 2021-06-25T04:47:52.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd123fff700 1 -- 172.21.15.57:0/2422485080 learned_addr learned my addr 172.21.15.57:0/2422485080 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:52.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd122ffd700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1240afd00 0x7fd1241518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd123fff700 1 -- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1240af920 msgr2=0x7fd124067190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd123fff700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1240af920 0x7fd124067190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd123fff700 1 -- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1240afd00 msgr2=0x7fd1241518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd123fff700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1240afd00 0x7fd1241518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd123fff700 1 -- 172.21.15.57:0/2422485080 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c00b1e0 con 0x7fd1240b04b0 2021-06-25T04:47:52.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd123fff700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1240b04b0 0x7fd124151dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd1240b0470 tx=0x7fd11c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:52.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd120ff9700 1 -- 172.21.15.57:0/2422485080 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd11c00f470 con 0x7fd1240b04b0 2021-06-25T04:47:52.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd120ff9700 1 -- 172.21.15.57:0/2422485080 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c00f5d0 con 0x7fd1240b04b0 2021-06-25T04:47:52.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd129aa1700 1 -- 172.21.15.57:0/2422485080 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd124151440 con 0x7fd1240b04b0 2021-06-25T04:47:52.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd120ff9700 1 -- 172.21.15.57:0/2422485080 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd11c00f930 con 0x7fd1240b04b0 2021-06-25T04:47:52.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd129aa1700 1 -- 172.21.15.57:0/2422485080 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1240a83b0 con 0x7fd1240b04b0 2021-06-25T04:47:52.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd129aa1700 1 -- 172.21.15.57:0/2422485080 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1241515d0 con 0x7fd1240b04b0 2021-06-25T04:47:52.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.339+0000 7fd120ff9700 1 -- 172.21.15.57:0/2422485080 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd11c019030 con 0x7fd1240b04b0 2021-06-25T04:47:52.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.343+0000 7fd120ff9700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1080554e0 0x7fd1080579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.343+0000 7fd120ff9700 1 -- 172.21.15.57:0/2422485080 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd11c06d640 con 0x7fd1240b04b0 2021-06-25T04:47:52.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.343+0000 7fd1237fe700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1080554e0 0x7fd1080579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.343+0000 7fd1237fe700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1080554e0 0x7fd1080579a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd11400c000 tx=0x7fd114008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:52.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.347+0000 7fd120ff9700 1 -- 172.21.15.57:0/2422485080 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd11c0437f0 con 0x7fd1240b04b0 2021-06-25T04:47:52.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.471+0000 7fd129aa1700 1 -- 172.21.15.57:0/2422485080 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1240a7f20 con 0x7fd1240b04b0 2021-06-25T04:47:52.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.471+0000 7fd120ff9700 1 -- 172.21.15.57:0/2422485080 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fd11c046e10 con 0x7fd1240b04b0 2021-06-25T04:47:52.481 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:52.481 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:41.021834+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:52.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 -- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1080554e0 msgr2=0x7fd1080579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1080554e0 0x7fd1080579a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd11400c000 tx=0x7fd114008040).stop 2021-06-25T04:47:52.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 -- 172.21.15.57:0/2422485080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1240b04b0 msgr2=0x7fd124151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1240b04b0 0x7fd124151dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd1240b0470 tx=0x7fd11c007f10).stop 2021-06-25T04:47:52.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 -- 172.21.15.57:0/2422485080 shutdown_connections 2021-06-25T04:47:52.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1080554e0 0x7fd1080579a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1240b04b0 0x7fd124151dd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1240afd00 0x7fd1241518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 --2- 172.21.15.57:0/2422485080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1240af920 0x7fd124067190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 -- 172.21.15.57:0/2422485080 >> 172.21.15.57:0/2422485080 conn(0x7fd12405cce0 msgr2=0x7fd12405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:52.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 -- 172.21.15.57:0/2422485080 shutdown_connections 2021-06-25T04:47:52.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.475+0000 7fd129aa1700 1 -- 172.21.15.57:0/2422485080 wait complete. 2021-06-25T04:47:52.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:47:34.957337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:47:37.729999+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:47:52.499 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:47:52.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac89c4700 1 Processor -- start 2021-06-25T04:47:52.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac89c4700 1 -- start start 2021-06-25T04:47:52.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac89c4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbac40b6250 0x7fbac4061430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac89c4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac40b4020 0x7fbac4061920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac89c4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbac4061e10 0x7fbac41463f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac89c4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac40b5f10 con 0x7fbac40b6250 2021-06-25T04:47:52.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac89c4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac40b1f30 con 0x7fbac4061e10 2021-06-25T04:47:52.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac89c4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40b21d0 con 0x7fbac40b4020 2021-06-25T04:47:52.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac2d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbac40b6250 0x7fbac4061430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac2d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbac40b6250 0x7fbac4061430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35676/0 (socket says 172.21.15.57:35676) 2021-06-25T04:47:52.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac2d9d700 1 -- 172.21.15.57:0/3875185092 learned_addr learned my addr 172.21.15.57:0/3875185092 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:52.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac359e700 1 --2- 172.21.15.57:0/3875185092 >> v2:172.21.15.87:3300/0 conn(0x7fbac4061e10 0x7fbac41463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.603+0000 7fbac259c700 1 --2- 172.21.15.57:0/3875185092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac40b4020 0x7fbac4061920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac359e700 1 -- 172.21.15.57:0/3875185092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac40b4020 msgr2=0x7fbac4061920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:52.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac359e700 1 --2- 172.21.15.57:0/3875185092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac40b4020 0x7fbac4061920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac359e700 1 -- 172.21.15.57:0/3875185092 >> v2:172.21.15.57:3300/0 conn(0x7fbac40b6250 msgr2=0x7fbac4061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:52.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac359e700 1 --2- 172.21.15.57:0/3875185092 >> v2:172.21.15.57:3300/0 conn(0x7fbac40b6250 0x7fbac4061430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac359e700 1 -- 172.21.15.57:0/3875185092 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac40b2470 con 0x7fbac4061e10 2021-06-25T04:47:52.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac259c700 1 --2- 172.21.15.57:0/3875185092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac40b4020 0x7fbac4061920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:52.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac2d9d700 1 --2- 172.21.15.57:0/3875185092 >> v2:172.21.15.57:3300/0 conn(0x7fbac40b6250 0x7fbac4061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:52.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac359e700 1 --2- 172.21.15.57:0/3875185092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac4061e10 0x7fbac41463f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbabc0032f0 tx=0x7fbabc0091d0).ready entity=mon.1 client_cookie=1ea49d5418181903 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:52.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac1d9b700 1 -- 172.21.15.57:0/3875185092 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbabc00b600 con 0x7fbac4061e10 2021-06-25T04:47:52.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac1d9b700 1 -- 172.21.15.57:0/3875185092 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc00b760 con 0x7fbac4061e10 2021-06-25T04:47:52.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac1d9b700 1 -- 172.21.15.57:0/3875185092 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbabc00b8d0 con 0x7fbac4061e10 2021-06-25T04:47:52.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac89c4700 1 -- 172.21.15.57:0/3875185092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac4061e10 msgr2=0x7fbac41463f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac89c4700 1 --2- 172.21.15.57:0/3875185092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac4061e10 0x7fbac41463f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbabc0032f0 tx=0x7fbabc0091d0).stop 2021-06-25T04:47:52.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac89c4700 1 -- 172.21.15.57:0/3875185092 shutdown_connections 2021-06-25T04:47:52.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac89c4700 1 --2- 172.21.15.57:0/3875185092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac4061e10 0x7fbac41463f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac89c4700 1 --2- 172.21.15.57:0/3875185092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac40b4020 0x7fbac4061920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac89c4700 1 --2- 172.21.15.57:0/3875185092 >> v2:172.21.15.57:3300/0 conn(0x7fbac40b6250 0x7fbac4061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac89c4700 1 -- 172.21.15.57:0/3875185092 >> 172.21.15.57:0/3875185092 conn(0x7fbac405c450 msgr2=0x7fbac405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac89c4700 1 -- 172.21.15.57:0/3875185092 shutdown_connections 2021-06-25T04:47:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac89c4700 1 -- 172.21.15.57:0/3875185092 wait complete. 2021-06-25T04:47:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac89c4700 1 Processor -- start 2021-06-25T04:47:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.607+0000 7fbac89c4700 1 -- start start 2021-06-25T04:47:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac89c4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac4061e10 0x7fbac40ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac89c4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbac40b4020 0x7fbac4156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac89c4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40b6250 0x7fbac40aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac89c4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac413d740 con 0x7fbac40b4020 2021-06-25T04:47:52.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac89c4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac413d930 con 0x7fbac40b6250 2021-06-25T04:47:52.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac89c4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac413dbd0 con 0x7fbac4061e10 2021-06-25T04:47:52.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbac40b4020 0x7fbac4156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbac40b4020 0x7fbac4156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35682/0 (socket says 172.21.15.57:35682) 2021-06-25T04:47:52.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac259c700 1 -- 172.21.15.57:0/2287549441 learned_addr learned my addr 172.21.15.57:0/2287549441 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:52.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac2d9d700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac4061e10 0x7fbac40ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac359e700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40b6250 0x7fbac40aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac359e700 1 -- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac4061e10 msgr2=0x7fbac40ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac359e700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac4061e10 0x7fbac40ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac359e700 1 -- 172.21.15.57:0/2287549441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbac40b4020 msgr2=0x7fbac4156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac359e700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbac40b4020 0x7fbac4156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac359e700 1 -- 172.21.15.57:0/2287549441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac00b180 con 0x7fbac40b6250 2021-06-25T04:47:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac259c700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbac40b4020 0x7fbac4156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac359e700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40b6250 0x7fbac40aefb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fbabc0032f0 tx=0x7fbabc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbabbfff700 1 -- 172.21.15.57:0/2287549441 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbabc011d70 con 0x7fbac40b6250 2021-06-25T04:47:52.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac89c4700 1 -- 172.21.15.57:0/2287549441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab400b1e0 con 0x7fbac40b6250 2021-06-25T04:47:52.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbabbfff700 1 -- 172.21.15.57:0/2287549441 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc021480 con 0x7fbac40b6250 2021-06-25T04:47:52.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbabbfff700 1 -- 172.21.15.57:0/2287549441 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbabc0217e0 con 0x7fbac40b6250 2021-06-25T04:47:52.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.611+0000 7fbac89c4700 1 -- 172.21.15.57:0/2287549441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc009470 con 0x7fbac40b6250 2021-06-25T04:47:52.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.615+0000 7fbac89c4700 1 -- 172.21.15.57:0/2287549441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac40b3db0 con 0x7fbac40b6250 2021-06-25T04:47:52.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.615+0000 7fbabbfff700 1 -- 172.21.15.57:0/2287549441 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbabc028070 con 0x7fbac40b6250 2021-06-25T04:47:52.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.615+0000 7fbabbfff700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbaa80554e0 0x7fbaa80579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.615+0000 7fbabbfff700 1 -- 172.21.15.57:0/2287549441 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbabc06ed40 con 0x7fbac40b6250 2021-06-25T04:47:52.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.615+0000 7fbac2d9d700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbaa80554e0 0x7fbaa80579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.615+0000 7fbac2d9d700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbaa80554e0 0x7fbaa80579a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbab400b000 tx=0x7fbab4006eb0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:52.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.623+0000 7fbabbfff700 1 -- 172.21.15.57:0/2287549441 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbac40b3db0 con 0x7fbac40b6250 2021-06-25T04:47:52.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 -- 172.21.15.57:0/2287549441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbac40b3db0 con 0x7fbac40b6250 2021-06-25T04:47:52.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbabbfff700 1 -- 172.21.15.57:0/2287549441 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbac40b3db0 con 0x7fbac40b6250 2021-06-25T04:47:52.762 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:47:52.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 -- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbaa80554e0 msgr2=0x7fbaa80579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbaa80554e0 0x7fbaa80579a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbab400b000 tx=0x7fbab4006eb0).stop 2021-06-25T04:47:52.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 -- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40b6250 msgr2=0x7fbac40aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40b6250 0x7fbac40aefb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fbabc0032f0 tx=0x7fbabc016000).stop 2021-06-25T04:47:52.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 -- 172.21.15.57:0/2287549441 shutdown_connections 2021-06-25T04:47:52.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbaa80554e0 0x7fbaa80579a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40b6250 0x7fbac40aefb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbac40b4020 0x7fbac4156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 --2- 172.21.15.57:0/2287549441 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac4061e10 0x7fbac40ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 -- 172.21.15.57:0/2287549441 >> 172.21.15.57:0/2287549441 conn(0x7fbac405c450 msgr2=0x7fbac40b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:52.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 -- 172.21.15.57:0/2287549441 shutdown_connections 2021-06-25T04:47:52.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.755+0000 7fbac89c4700 1 -- 172.21.15.57:0/2287549441 wait complete. 2021-06-25T04:47:52.777 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:47:52.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.875+0000 7f7a4cd39700 1 Processor -- start 2021-06-25T04:47:52.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.875+0000 7f7a4cd39700 1 -- start start 2021-06-25T04:47:52.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7a480b4140 0x7f7a48140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7a480b4650 0x7f7a480b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a48143b20 con 0x7f7a48146910 2021-06-25T04:47:52.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a481474d0 con 0x7f7a480b4650 2021-06-25T04:47:52.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a48143dc0 con 0x7f7a480b4140 2021-06-25T04:47:52.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a46d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7a480b4650 0x7f7a480b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a46d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7a480b4650 0x7f7a480b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35692/0 (socket says 172.21.15.57:35692) 2021-06-25T04:47:52.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a46d9d700 1 -- 172.21.15.57:0/3378436876 learned_addr learned my addr 172.21.15.57:0/3378436876 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:52.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a3dd9b700 1 --2- 172.21.15.57:0/3378436876 >> v2:172.21.15.87:3300/0 conn(0x7f7a480b4140 0x7f7a48140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a46d9d700 1 -- 172.21.15.57:0/3378436876 >> v2:172.21.15.87:3300/0 conn(0x7f7a480b4140 msgr2=0x7f7a48140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:52.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a46d9d700 1 --2- 172.21.15.57:0/3378436876 >> v2:172.21.15.87:3300/0 conn(0x7f7a480b4140 0x7f7a48140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a46d9d700 1 -- 172.21.15.57:0/3378436876 >> v1:172.21.15.57:6789/0 conn(0x7f7a48146910 legacy=0x7f7a481401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a46d9d700 1 -- 172.21.15.57:0/3378436876 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480b0c50 con 0x7f7a480b4650 2021-06-25T04:47:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a46d9d700 1 --2- 172.21.15.57:0/3378436876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a480b4650 0x7f7a480b4e90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f7a400032f0 tx=0x7f7a40009290).ready entity=mon.0 client_cookie=4cd3cd2417340dcf server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a45d9b700 1 -- 172.21.15.57:0/3378436876 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a4000b870 con 0x7f7a480b4650 2021-06-25T04:47:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a45d9b700 1 -- 172.21.15.57:0/3378436876 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4000b9d0 con 0x7f7a480b4650 2021-06-25T04:47:52.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 -- 172.21.15.57:0/3378436876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a480b4650 msgr2=0x7f7a480b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a45d9b700 1 -- 172.21.15.57:0/3378436876 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a4000bb40 con 0x7f7a480b4650 2021-06-25T04:47:52.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 --2- 172.21.15.57:0/3378436876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a480b4650 0x7f7a480b4e90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f7a400032f0 tx=0x7f7a40009290).stop 2021-06-25T04:47:52.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 -- 172.21.15.57:0/3378436876 shutdown_connections 2021-06-25T04:47:52.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 --2- 172.21.15.57:0/3378436876 >> v2:172.21.15.87:3300/0 conn(0x7f7a480b4140 0x7f7a48140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 --2- 172.21.15.57:0/3378436876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a480b4650 0x7f7a480b4e90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 -- 172.21.15.57:0/3378436876 >> 172.21.15.57:0/3378436876 conn(0x7f7a4805c450 msgr2=0x7f7a4805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:52.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 -- 172.21.15.57:0/3378436876 shutdown_connections 2021-06-25T04:47:52.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.879+0000 7f7a4cd39700 1 -- 172.21.15.57:0/3378436876 wait complete. 2021-06-25T04:47:52.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a4cd39700 1 Processor -- start 2021-06-25T04:47:52.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a4cd39700 1 -- start start 2021-06-25T04:47:52.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a4cd39700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a480b4140 0x7f7a480b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a4cd39700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a480b4650 0x7f7a48142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a4cd39700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a48146910 0x7f7a48155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a4cd39700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a481521c0 con 0x7f7a480b4650 2021-06-25T04:47:52.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a4cd39700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48142510 con 0x7f7a480b4140 2021-06-25T04:47:52.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a4cd39700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48141dd0 con 0x7f7a48146910 2021-06-25T04:47:52.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a3dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a480b4650 0x7f7a48142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a3dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a480b4650 0x7f7a48142020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35698/0 (socket says 172.21.15.57:35698) 2021-06-25T04:47:52.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a3dd9b700 1 -- 172.21.15.57:0/1919642023 learned_addr learned my addr 172.21.15.57:0/1919642023 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:52.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a4659c700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a480b4140 0x7f7a480b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a46d9d700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a48146910 0x7f7a48155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a3dd9b700 1 -- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a48146910 msgr2=0x7f7a48155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a3dd9b700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a48146910 0x7f7a48155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a3dd9b700 1 -- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a480b4140 msgr2=0x7f7a480b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:52.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a3dd9b700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a480b4140 0x7f7a480b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:52.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a3dd9b700 1 -- 172.21.15.57:0/1919642023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40009530 con 0x7f7a480b4650 2021-06-25T04:47:52.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a46d9d700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a48146910 0x7f7a48155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:52.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a3dd9b700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a480b4650 0x7f7a48142020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f7a48142650 tx=0x7f7a30008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:52.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a3ffff700 1 -- 172.21.15.57:0/1919642023 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a30011780 con 0x7f7a480b4650 2021-06-25T04:47:52.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.883+0000 7f7a3ffff700 1 -- 172.21.15.57:0/1919642023 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a300118e0 con 0x7f7a480b4650 2021-06-25T04:47:52.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.887+0000 7f7a3ffff700 1 -- 172.21.15.57:0/1919642023 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a30011c40 con 0x7f7a480b4650 2021-06-25T04:47:52.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.887+0000 7f7a4cd39700 1 -- 172.21.15.57:0/1919642023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a48141890 con 0x7f7a480b4650 2021-06-25T04:47:52.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.887+0000 7f7a4cd39700 1 -- 172.21.15.57:0/1919642023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a480b6b30 con 0x7f7a480b4650 2021-06-25T04:47:52.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.887+0000 7f7a4cd39700 1 -- 172.21.15.57:0/1919642023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a480b0550 con 0x7f7a480b4650 2021-06-25T04:47:52.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.887+0000 7f7a3ffff700 1 -- 172.21.15.57:0/1919642023 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7a30006030 con 0x7f7a480b4650 2021-06-25T04:47:52.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.887+0000 7f7a3ffff700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a2c055450 0x7f7a2c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:52.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.887+0000 7f7a3ffff700 1 -- 172.21.15.57:0/1919642023 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7a3006df00 con 0x7f7a480b4650 2021-06-25T04:47:52.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.887+0000 7f7a4659c700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a2c055450 0x7f7a2c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:52.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.887+0000 7f7a4659c700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a2c055450 0x7f7a2c057910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7a3800d000 tx=0x7f7a38007b70).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:52.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:52.895+0000 7f7a3ffff700 1 -- 172.21.15.57:0/1919642023 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7a30044010 con 0x7f7a480b4650 2021-06-25T04:47:53.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.019+0000 7f7a4cd39700 1 -- 172.21.15.57:0/1919642023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7a481557a0 con 0x7f7a480b4650 2021-06-25T04:47:53.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.019+0000 7f7a3ffff700 1 -- 172.21.15.57:0/1919642023 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7a30047630 con 0x7f7a480b4650 2021-06-25T04:47:53.028 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:53.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 -- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a2c055450 msgr2=0x7f7a2c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a2c055450 0x7f7a2c057910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7a3800d000 tx=0x7f7a38007b70).stop 2021-06-25T04:47:53.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 -- 172.21.15.57:0/1919642023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a480b4650 msgr2=0x7f7a48142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a480b4650 0x7f7a48142020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f7a48142650 tx=0x7f7a30008040).stop 2021-06-25T04:47:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 -- 172.21.15.57:0/1919642023 shutdown_connections 2021-06-25T04:47:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a2c055450 0x7f7a2c057910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a48146910 0x7f7a48155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a480b4650 0x7f7a48142020 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 --2- 172.21.15.57:0/1919642023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a480b4140 0x7f7a480b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 -- 172.21.15.57:0/1919642023 >> 172.21.15.57:0/1919642023 conn(0x7f7a4805c450 msgr2=0x7f7a480b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:53.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 -- 172.21.15.57:0/1919642023 shutdown_connections 2021-06-25T04:47:53.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.023+0000 7f7a4cd39700 1 -- 172.21.15.57:0/1919642023 wait complete. 2021-06-25T04:47:53.045 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:47:53.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.143+0000 7f7fcbd6c700 1 Processor -- start 2021-06-25T04:47:53.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.143+0000 7f7fcbd6c700 1 -- start start 2021-06-25T04:47:53.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc405fa60 0x7f7fc4143890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7fc40ac4c0 0x7f7fc4143d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc405fe40 con 0x7f7fc4060790 2021-06-25T04:47:53.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc4143200 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40acc20 con 0x7f7fc405fa60 2021-06-25T04:47:53.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fca309700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7fc40ac4c0 0x7f7fc4143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fca309700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7fc40ac4c0 0x7f7fc4143d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35708/0 (socket says 172.21.15.57:35708) 2021-06-25T04:47:53.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fc9307700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7fc4060790 0x7f7fc41467d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:53672/0 (socket says 172.21.15.57:53672) 2021-06-25T04:47:53.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fca309700 1 -- 172.21.15.57:0/3732913485 learned_addr learned my addr 172.21.15.57:0/3732913485 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:53.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fc9b08700 1 --2- 172.21.15.57:0/3732913485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc405fa60 0x7f7fc4143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fc8b06700 1 -- 172.21.15.57:0/3732913485 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636413345 0 0) 0x7f7fc405fe40 con 0x7f7fc4060790 2021-06-25T04:47:53.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fc8b06700 1 -- 172.21.15.57:0/3732913485 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fac003260 con 0x7f7fc4060790 2021-06-25T04:47:53.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fca309700 1 -- 172.21.15.57:0/3732913485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc405fa60 msgr2=0x7f7fc4143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:53.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fca309700 1 --2- 172.21.15.57:0/3732913485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc405fa60 0x7f7fc4143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fca309700 1 -- 172.21.15.57:0/3732913485 >> v1:172.21.15.87:6789/0 conn(0x7f7fc4060790 legacy=0x7f7fc41467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fca309700 1 -- 172.21.15.57:0/3732913485 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40acec0 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fca309700 1 --2- 172.21.15.57:0/3732913485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc40ac4c0 0x7f7fc4143d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f7fbc0032f0 tx=0x7f7fbc009290).ready entity=mon.0 client_cookie=83063f4a9233bcfa server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:53.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fc8b06700 1 -- 172.21.15.57:0/3732913485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fbc00b6c0 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fc8b06700 1 -- 172.21.15.57:0/3732913485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc00b820 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fc8b06700 1 -- 172.21.15.57:0/3732913485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fbc00b990 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/3732913485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc40ac4c0 msgr2=0x7f7fc4143d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 --2- 172.21.15.57:0/3732913485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc40ac4c0 0x7f7fc4143d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f7fbc0032f0 tx=0x7f7fbc009290).stop 2021-06-25T04:47:53.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/3732913485 shutdown_connections 2021-06-25T04:47:53.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 --2- 172.21.15.57:0/3732913485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc40ac4c0 0x7f7fc4143d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 --2- 172.21.15.57:0/3732913485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc405fa60 0x7f7fc4143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/3732913485 >> 172.21.15.57:0/3732913485 conn(0x7f7fc40b2930 msgr2=0x7f7fc40b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:53.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.147+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/3732913485 shutdown_connections 2021-06-25T04:47:53.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/3732913485 wait complete. 2021-06-25T04:47:53.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fcbd6c700 1 Processor -- start 2021-06-25T04:47:53.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fcbd6c700 1 -- start start 2021-06-25T04:47:53.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fcbd6c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc405fa60 0x7f7fc413d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fcbd6c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc4060790 0x7f7fc40b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fcbd6c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc40ac4c0 0x7f7fc4065e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fcbd6c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc4065a20 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fcbd6c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc4066ed0 con 0x7f7fc405fa60 2021-06-25T04:47:53.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fcbd6c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc4066990 con 0x7f7fc4060790 2021-06-25T04:47:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fca309700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc40ac4c0 0x7f7fc4065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fca309700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc40ac4c0 0x7f7fc4065e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35714/0 (socket says 172.21.15.57:35714) 2021-06-25T04:47:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fca309700 1 -- 172.21.15.57:0/2236912124 learned_addr learned my addr 172.21.15.57:0/2236912124 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fc9b08700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc405fa60 0x7f7fc413d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fc9307700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc4060790 0x7f7fc40b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fca309700 1 -- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc4060790 msgr2=0x7f7fc40b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fca309700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc4060790 0x7f7fc40b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fca309700 1 -- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc405fa60 msgr2=0x7f7fc413d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fca309700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc405fa60 0x7f7fc413d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fca309700 1 -- 172.21.15.57:0/2236912124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc009530 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fc9b08700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc405fa60 0x7f7fc413d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.151+0000 7f7fc9307700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc4060790 0x7f7fc40b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.155+0000 7f7fca309700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc40ac4c0 0x7f7fc4065e80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7fbc0032f0 tx=0x7f7fbc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.155+0000 7f7fb2ffd700 1 -- 172.21.15.57:0/2236912124 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fbc011c10 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.155+0000 7f7fb2ffd700 1 -- 172.21.15.57:0/2236912124 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc011d70 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.155+0000 7f7fb2ffd700 1 -- 172.21.15.57:0/2236912124 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fbc020620 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.155+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/2236912124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc4066c30 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.155+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/2236912124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc40b4cc0 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.155+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/2236912124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc4057310 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.155+0000 7f7fb2ffd700 1 -- 172.21.15.57:0/2236912124 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7fbc027070 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.155+0000 7f7fb2ffd700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fa4055450 0x7f7fa4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.155+0000 7f7fb2ffd700 1 -- 172.21.15.57:0/2236912124 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7fbc06e730 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.155+0000 7f7fc9b08700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fa4055450 0x7f7fa4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.159+0000 7f7fc9b08700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fa4055450 0x7f7fa4057910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f7fb400b000 tx=0x7f7fb4006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.163+0000 7f7fb2ffd700 1 -- 172.21.15.57:0/2236912124 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7fbc0447d0 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/2236912124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7fc40633d0 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fb2ffd700 1 -- 172.21.15.57:0/2236912124 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7fbc015020 con 0x7f7fc40ac4c0 2021-06-25T04:47:53.294 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:53.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fa4055450 msgr2=0x7f7fa4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fa4055450 0x7f7fa4057910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f7fb400b000 tx=0x7f7fb4006df0).stop 2021-06-25T04:47:53.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/2236912124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc40ac4c0 msgr2=0x7f7fc4065e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc40ac4c0 0x7f7fc4065e80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7fbc0032f0 tx=0x7f7fbc016000).stop 2021-06-25T04:47:53.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/2236912124 shutdown_connections 2021-06-25T04:47:53.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fa4055450 0x7f7fa4057910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc40ac4c0 0x7f7fc4065e80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc4060790 0x7f7fc40b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 --2- 172.21.15.57:0/2236912124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc405fa60 0x7f7fc413d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/2236912124 >> 172.21.15.57:0/2236912124 conn(0x7f7fc40b2930 msgr2=0x7f7fc4142510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:53.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/2236912124 shutdown_connections 2021-06-25T04:47:53.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.287+0000 7f7fcbd6c700 1 -- 172.21.15.57:0/2236912124 wait complete. 2021-06-25T04:47:53.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:47:53.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.415+0000 7f3d87fff700 1 Processor -- start 2021-06-25T04:47:53.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.415+0000 7f3d87fff700 1 -- start start 2021-06-25T04:47:53.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.415+0000 7f3d87fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880665b0 0x7f3d88066990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.415+0000 7f3d87fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3d88140c70 0x7f3d8813e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.415+0000 7f3d87fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8805f710 con 0x7f3d880b19f0 2021-06-25T04:47:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.415+0000 7f3d87fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d880b1460 con 0x7f3d88140c70 2021-06-25T04:47:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.415+0000 7f3d87fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8805f940 con 0x7f3d880665b0 2021-06-25T04:47:53.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.415+0000 7f3d877fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3d88140c70 0x7f3d8813e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.415+0000 7f3d867fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3d880b19f0 0x7f3d8805fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52938/0 (socket says 172.21.15.57:52938) 2021-06-25T04:47:53.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.415+0000 7f3d867fc700 1 -- 172.21.15.57:0/2807552187 learned_addr learned my addr 172.21.15.57:0/2807552187 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:53.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.415+0000 7f3d86ffd700 1 --2- 172.21.15.57:0/2807552187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880665b0 0x7f3d88066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d877fe700 1 -- 172.21.15.57:0/2807552187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880665b0 msgr2=0x7f3d88066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:53.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d877fe700 1 --2- 172.21.15.57:0/2807552187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880665b0 0x7f3d88066990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d877fe700 1 -- 172.21.15.57:0/2807552187 >> v1:172.21.15.57:6789/0 conn(0x7f3d880b19f0 legacy=0x7f3d8805fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d877fe700 1 -- 172.21.15.57:0/2807552187 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880b1700 con 0x7f3d88140c70 2021-06-25T04:47:53.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d877fe700 1 --2- 172.21.15.57:0/2807552187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d88140c70 0x7f3d8813e0e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f3d800032f0 tx=0x7f3d800091d0).ready entity=mon.0 client_cookie=a2b4897dea8daadc server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:53.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d85ffb700 1 -- 172.21.15.57:0/2807552187 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d8000b6c0 con 0x7f3d88140c70 2021-06-25T04:47:53.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d85ffb700 1 -- 172.21.15.57:0/2807552187 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8000b820 con 0x7f3d88140c70 2021-06-25T04:47:53.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d85ffb700 1 -- 172.21.15.57:0/2807552187 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d8000b990 con 0x7f3d88140c70 2021-06-25T04:47:53.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d87fff700 1 -- 172.21.15.57:0/2807552187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d88140c70 msgr2=0x7f3d8813e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d87fff700 1 --2- 172.21.15.57:0/2807552187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d88140c70 0x7f3d8813e0e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f3d800032f0 tx=0x7f3d800091d0).stop 2021-06-25T04:47:53.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d87fff700 1 -- 172.21.15.57:0/2807552187 shutdown_connections 2021-06-25T04:47:53.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d87fff700 1 --2- 172.21.15.57:0/2807552187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d88140c70 0x7f3d8813e0e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d87fff700 1 --2- 172.21.15.57:0/2807552187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880665b0 0x7f3d88066990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d87fff700 1 -- 172.21.15.57:0/2807552187 >> 172.21.15.57:0/2807552187 conn(0x7f3d880636a0 msgr2=0x7f3d88063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:53.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d87fff700 1 -- 172.21.15.57:0/2807552187 shutdown_connections 2021-06-25T04:47:53.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.419+0000 7f3d87fff700 1 -- 172.21.15.57:0/2807552187 wait complete. 2021-06-25T04:47:53.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d87fff700 1 Processor -- start 2021-06-25T04:47:53.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d87fff700 1 -- start start 2021-06-25T04:47:53.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d87fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880665b0 0x7f3d88138c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d87fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d880b19f0 0x7f3d8813a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d87fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d88140c70 0x7f3d8813ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d87fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88139130 con 0x7f3d880665b0 2021-06-25T04:47:53.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d87fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88145930 con 0x7f3d880b19f0 2021-06-25T04:47:53.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d87fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8813b800 con 0x7f3d88140c70 2021-06-25T04:47:53.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d86ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880665b0 0x7f3d88138c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d86ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880665b0 0x7f3d88138c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35724/0 (socket says 172.21.15.57:35724) 2021-06-25T04:47:53.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d86ffd700 1 -- 172.21.15.57:0/2924616099 learned_addr learned my addr 172.21.15.57:0/2924616099 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:53.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d877fe700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d88140c70 0x7f3d8813ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d867fc700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d880b19f0 0x7f3d8813a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d86ffd700 1 -- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d88140c70 msgr2=0x7f3d8813ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d86ffd700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d88140c70 0x7f3d8813ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d86ffd700 1 -- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d880b19f0 msgr2=0x7f3d8813a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d86ffd700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d880b19f0 0x7f3d8813a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d86ffd700 1 -- 172.21.15.57:0/2924616099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80009470 con 0x7f3d880665b0 2021-06-25T04:47:53.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d86ffd700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880665b0 0x7f3d88138c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f3d881454b0 tx=0x7f3d78006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:53.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d7ffff700 1 -- 172.21.15.57:0/2924616099 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d7800c830 con 0x7f3d880665b0 2021-06-25T04:47:53.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d7ffff700 1 -- 172.21.15.57:0/2924616099 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7800c990 con 0x7f3d880665b0 2021-06-25T04:47:53.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d87fff700 1 -- 172.21.15.57:0/2924616099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d881500a0 con 0x7f3d880665b0 2021-06-25T04:47:53.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d7ffff700 1 -- 172.21.15.57:0/2924616099 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d7800ccf0 con 0x7f3d880665b0 2021-06-25T04:47:53.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.423+0000 7f3d87fff700 1 -- 172.21.15.57:0/2924616099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8813ba30 con 0x7f3d880665b0 2021-06-25T04:47:53.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.427+0000 7f3d87fff700 1 -- 172.21.15.57:0/2924616099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d88057310 con 0x7f3d880665b0 2021-06-25T04:47:53.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.427+0000 7f3d7ffff700 1 -- 172.21.15.57:0/2924616099 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3d7801c460 con 0x7f3d880665b0 2021-06-25T04:47:53.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.427+0000 7f3d7ffff700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d6c055450 0x7f3d6c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.427+0000 7f3d7ffff700 1 -- 172.21.15.57:0/2924616099 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3d7806e530 con 0x7f3d880665b0 2021-06-25T04:47:53.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.427+0000 7f3d867fc700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d6c055450 0x7f3d6c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.427+0000 7f3d867fc700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d6c055450 0x7f3d6c057910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3d7000b000 tx=0x7f3d70009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:53.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.431+0000 7f3d7ffff700 1 -- 172.21.15.57:0/2924616099 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3d78044570 con 0x7f3d880665b0 2021-06-25T04:47:53.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.563+0000 7f3d87fff700 1 -- 172.21.15.57:0/2924616099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d88145060 con 0x7f3d880665b0 2021-06-25T04:47:53.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.563+0000 7f3d7ffff700 1 -- 172.21.15.57:0/2924616099 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3d78047b90 con 0x7f3d880665b0 2021-06-25T04:47:53.572 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:53.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 -- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d6c055450 msgr2=0x7f3d6c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d6c055450 0x7f3d6c057910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3d7000b000 tx=0x7f3d70009040).stop 2021-06-25T04:47:53.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 -- 172.21.15.57:0/2924616099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880665b0 msgr2=0x7f3d88138c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880665b0 0x7f3d88138c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f3d881454b0 tx=0x7f3d78006df0).stop 2021-06-25T04:47:53.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 -- 172.21.15.57:0/2924616099 shutdown_connections 2021-06-25T04:47:53.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d6c055450 0x7f3d6c057910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d88140c70 0x7f3d8813ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d880b19f0 0x7f3d8813a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 --2- 172.21.15.57:0/2924616099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880665b0 0x7f3d88138c40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 -- 172.21.15.57:0/2924616099 >> 172.21.15.57:0/2924616099 conn(0x7f3d880636a0 msgr2=0x7f3d880b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:53.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 -- 172.21.15.57:0/2924616099 shutdown_connections 2021-06-25T04:47:53.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.567+0000 7f3d87fff700 1 -- 172.21.15.57:0/2924616099 wait complete. 2021-06-25T04:47:53.585 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:47:53.585 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:47:53.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.675+0000 7f92e6b93700 1 Processor -- start 2021-06-25T04:47:53.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.675+0000 7f92e6b93700 1 -- start start 2021-06-25T04:47:53.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.675+0000 7f92e6b93700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f92e0061640 0x7f92e00b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.675+0000 7f92e6b93700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e00b68d0 con 0x7f92e00b46d0 2021-06-25T04:47:53.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.675+0000 7f92e6b93700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e00b6b70 con 0x7f92e0143960 2021-06-25T04:47:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.675+0000 7f92e6b93700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e00b9640 con 0x7f92e0061640 2021-06-25T04:47:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.675+0000 7f92e5390700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f92e00b46d0 0x7f92e013fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52950/0 (socket says 172.21.15.57:52950) 2021-06-25T04:47:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.675+0000 7f92e5390700 1 -- 172.21.15.57:0/3957564015 learned_addr learned my addr 172.21.15.57:0/3957564015 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.675+0000 7f92e5b91700 1 --2- 172.21.15.57:0/3957564015 >> v2:172.21.15.87:3300/0 conn(0x7f92e0061640 0x7f92e00b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e4b8f700 1 -- 172.21.15.57:0/3957564015 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407287580 0 0) 0x7f92e00b68d0 con 0x7f92e00b46d0 2021-06-25T04:47:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e4b8f700 1 -- 172.21.15.57:0/3957564015 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c8003260 con 0x7f92e00b46d0 2021-06-25T04:47:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e5b91700 1 -- 172.21.15.57:0/3957564015 >> v1:172.21.15.87:6789/0 conn(0x7f92e0143960 legacy=0x7f92e014d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e4b8f700 1 -- 172.21.15.57:0/3957564015 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1972691447 0 0) 0x7f92c8003260 con 0x7f92e00b46d0 2021-06-25T04:47:53.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e5b91700 1 -- 172.21.15.57:0/3957564015 >> v1:172.21.15.57:6789/0 conn(0x7f92e00b46d0 legacy=0x7f92e013fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e5b91700 1 -- 172.21.15.57:0/3957564015 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e00b6e10 con 0x7f92e0061640 2021-06-25T04:47:53.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e5b91700 1 --2- 172.21.15.57:0/3957564015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92e0061640 0x7f92e00b9cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f92dc001800 tx=0x7f92d4006df0).ready entity=mon.1 client_cookie=4624c36916a085e6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:53.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e4b8f700 1 -- 172.21.15.57:0/3957564015 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92dc001660 con 0x7f92e0061640 2021-06-25T04:47:53.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e4b8f700 1 -- 172.21.15.57:0/3957564015 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d4000e90 con 0x7f92e0061640 2021-06-25T04:47:53.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e4b8f700 1 -- 172.21.15.57:0/3957564015 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92d4011400 con 0x7f92e0061640 2021-06-25T04:47:53.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e6b93700 1 -- 172.21.15.57:0/3957564015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92e0061640 msgr2=0x7f92e00b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e6b93700 1 --2- 172.21.15.57:0/3957564015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92e0061640 0x7f92e00b9cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f92dc001800 tx=0x7f92d4006df0).stop 2021-06-25T04:47:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e6b93700 1 -- 172.21.15.57:0/3957564015 shutdown_connections 2021-06-25T04:47:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e6b93700 1 --2- 172.21.15.57:0/3957564015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92e0061640 0x7f92e00b9cd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e6b93700 1 -- 172.21.15.57:0/3957564015 >> 172.21.15.57:0/3957564015 conn(0x7f92e006adb0 msgr2=0x7f92e005f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e6b93700 1 -- 172.21.15.57:0/3957564015 shutdown_connections 2021-06-25T04:47:53.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e6b93700 1 -- 172.21.15.57:0/3957564015 wait complete. 2021-06-25T04:47:53.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e6b93700 1 Processor -- start 2021-06-25T04:47:53.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.679+0000 7f92e6b93700 1 -- start start 2021-06-25T04:47:53.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e6b93700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92e0061640 0x7f92e013a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e6b93700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e0143960 0x7f92e00b81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e6b93700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92e013dac0 0x7f92e0135cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e6b93700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e01492b0 con 0x7f92e0143960 2021-06-25T04:47:53.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e6b93700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00b0b20 con 0x7f92e0061640 2021-06-25T04:47:53.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e6b93700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e013d300 con 0x7f92e013dac0 2021-06-25T04:47:53.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e5390700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e0143960 0x7f92e00b81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e5390700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e0143960 0x7f92e00b81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35740/0 (socket says 172.21.15.57:35740) 2021-06-25T04:47:53.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e5390700 1 -- 172.21.15.57:0/1324356903 learned_addr learned my addr 172.21.15.57:0/1324356903 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:53.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e5b91700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92e0061640 0x7f92e013a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e6392700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92e013dac0 0x7f92e0135cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e5390700 1 -- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92e013dac0 msgr2=0x7f92e0135cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e5390700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92e013dac0 0x7f92e0135cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e5390700 1 -- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92e0061640 msgr2=0x7f92e013a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e5390700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92e0061640 0x7f92e013a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e5390700 1 -- 172.21.15.57:0/1324356903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d400b180 con 0x7f92e0143960 2021-06-25T04:47:53.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e5390700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e0143960 0x7f92e00b81a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f92dc0018c0 tx=0x7f92dc001230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:53.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92d2ffd700 1 -- 172.21.15.57:0/1324356903 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92dc007170 con 0x7f92e0143960 2021-06-25T04:47:53.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92d2ffd700 1 -- 172.21.15.57:0/1324356903 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc0072d0 con 0x7f92e0143960 2021-06-25T04:47:53.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e6b93700 1 -- 172.21.15.57:0/1324356903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e013d5a0 con 0x7f92e0143960 2021-06-25T04:47:53.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92d2ffd700 1 -- 172.21.15.57:0/1324356903 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92dc004710 con 0x7f92e0143960 2021-06-25T04:47:53.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.683+0000 7f92e6b93700 1 -- 172.21.15.57:0/1324356903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e00b7d00 con 0x7f92e0143960 2021-06-25T04:47:53.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.687+0000 7f92e6b93700 1 -- 172.21.15.57:0/1324356903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e00b7ec0 con 0x7f92e0143960 2021-06-25T04:47:53.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.687+0000 7f92d2ffd700 1 -- 172.21.15.57:0/1324356903 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f92dc01b070 con 0x7f92e0143960 2021-06-25T04:47:53.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.687+0000 7f92d2ffd700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f92c00554e0 0x7f92c00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:53.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.687+0000 7f92d2ffd700 1 -- 172.21.15.57:0/1324356903 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f92dc06d460 con 0x7f92e0143960 2021-06-25T04:47:53.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.687+0000 7f92e5b91700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f92c00554e0 0x7f92c00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:53.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.687+0000 7f92e5b91700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f92c00554e0 0x7f92c00579a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f92d4018000 tx=0x7f92e00b6a60).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:53.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.695+0000 7f92d2ffd700 1 -- 172.21.15.57:0/1324356903 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f92dc043610 con 0x7f92e0143960 2021-06-25T04:47:53.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.855+0000 7f92e6b93700 1 -- 172.21.15.57:0/1324356903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92e0057310 con 0x7f92e0143960 2021-06-25T04:47:53.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.855+0000 7f92d2ffd700 1 -- 172.21.15.57:0/1324356903 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f92dc046c30 con 0x7f92e0143960 2021-06-25T04:47:53.865 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/1675349577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1675349577},{"type":"v1","addr":"172.21.15.87:6835","nonce":1675349577}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/4129321821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4129321821},{"type":"v1","addr":"172.21.15.57:6833","nonce":4129321821}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:47:40.019558+0000","modified":"2021-06-25T04:47:41.749060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1050167707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1050167707},{"type":"v1","addr":"172.21.15.57:6835","nonce":1050167707}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-06-25T04:47:53.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 -- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f92c00554e0 msgr2=0x7f92c00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f92c00554e0 0x7f92c00579a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f92d4018000 tx=0x7f92e00b6a60).stop 2021-06-25T04:47:53.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 -- 172.21.15.57:0/1324356903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e0143960 msgr2=0x7f92e00b81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:53.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e0143960 0x7f92e00b81a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f92dc0018c0 tx=0x7f92dc001230).stop 2021-06-25T04:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 -- 172.21.15.57:0/1324356903 shutdown_connections 2021-06-25T04:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f92c00554e0 0x7f92c00579a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92e013dac0 0x7f92e0135cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92e0143960 0x7f92e00b81a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 --2- 172.21.15.57:0/1324356903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92e0061640 0x7f92e013a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 -- 172.21.15.57:0/1324356903 >> 172.21.15.57:0/1324356903 conn(0x7f92e006adb0 msgr2=0x7f92e01412e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:53.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 -- 172.21.15.57:0/1324356903 shutdown_connections 2021-06-25T04:47:53.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:53.859+0000 7f92e6b93700 1 -- 172.21.15.57:0/1324356903 wait complete. 2021-06-25T04:47:53.871 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2021-06-25T04:47:54.181 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:47:40.019558+0000', 'modified': '2021-06-25T04:47:41.749060+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/1050167707', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 1050167707}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 1050167707}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:47:54.181 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:47:54.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:47:54.300 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":4281,"want_state":"up:active","state":"up:active","rank_uptime":14.264386152,"mdsmap_epoch":7,"osdmap_epoch":25,"osdmap_epoch_barrier":25,"uptime":20.628223746} 2021-06-25T04:47:54.301 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 4281, "mdsmap_epoch": 7, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "rank_uptime": 14.264386152, "state": "up:active", "uptime": 20.628223746, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:47:54.301 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:47:54.301 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:47:54.302 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:47:54.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:54.302 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:47:54.311 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:47:54.326 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:47:54.327 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:47:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:47:54.339 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:47:54.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:54.341 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:47:54.388 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:47:54.389 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:47:54.391 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:47:54.407 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:47:54.408 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:47:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:47:54.419 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:47:54.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:54.421 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:47:54.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:47:54.522+0000 7fefebc16080 -1 init, newargv = 0x55938a8329f0 newargc=9ceph-fuse[14365]: starting ceph client 2021-06-25T04:47:54.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr: 2021-06-25T04:47:54.528 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14365]: starting fuse 2021-06-25T04:47:55.574 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:47:55.592 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:47:55.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:47:55.649 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:47:55.650 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:47:55.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:55.651 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:47:55.659 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:47:55.660 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:47:55.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:55.661 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:47:55.661 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:47:55.661 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:47:55.662 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:47:55.662 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:47:55.662 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:47:55.663 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:47:55.663 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:47:55.664 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:47:55.664 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:47:55.665 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:47:55.666 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:47:55.666 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:47:55.667 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:47:55.667 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:47:55.668 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:47:55.669 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:47:55.669 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:47:55.670 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:47:55.670 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:47:55.671 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:47:55.672 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:47:55.672 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:47:55.717 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.14365.asok 2021-06-25T04:47:55.722 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14365.asok 2021-06-25T04:47:55.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:55.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14365.asok status 2021-06-25T04:47:55.836 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:47:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:47:55.837 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:47:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:47:55.838 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:47:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:47:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:47:55.839 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "14365", 2021-06-25T04:47:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:47:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:47:55.840 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:47:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:47:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4662, 2021-06-25T04:47:55.841 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:47:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:47:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:47:55.842 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 4662 2021-06-25T04:47:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:47:55.843 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:47:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:47:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:47:55.844 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3585981891 2021-06-25T04:47:55.845 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:47:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:47:55.846 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:47:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:47:55.847 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:47:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3585981891 2021-06-25T04:47:55.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:47:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.4662 172.21.15.102:0/3585981891", 2021-06-25T04:47:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/3585981891", 2021-06-25T04:47:55.849 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:47:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 7, 2021-06-25T04:47:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 25, 2021-06-25T04:47:55.850 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:47:55.851 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:47:55.851 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:47:55.851 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:47:55.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:55.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d787f3700 1 Processor -- start 2021-06-25T04:47:55.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d787f3700 1 -- start start 2021-06-25T04:47:55.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d787f3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d700b3200 0x7f2d70066640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:55.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d787f3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d700b0e30 0x7f2d70066b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:55.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d787f3700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d700b35e0 con 0x7f2d700b1800 2021-06-25T04:47:55.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d787f3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d701436b0 con 0x7f2d700b3200 2021-06-25T04:47:55.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d787f3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d70065c60 con 0x7f2d700b0e30 2021-06-25T04:47:55.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d7658f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d700b3200 0x7f2d70066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:55.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d76d90700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d700b0e30 0x7f2d70066b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:55.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d7658f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d700b3200 0x7f2d70066640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:44240/0 (socket says 172.21.15.57:44240) 2021-06-25T04:47:55.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d75d8e700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2d700b1800 0x7f2d70142850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:53714/0 (socket says 172.21.15.57:53714) 2021-06-25T04:47:55.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d7658f700 1 -- 172.21.15.57:0/3849982623 learned_addr learned my addr 172.21.15.57:0/3849982623 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:55.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d76d90700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d700b0e30 0x7f2d70066b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:46914/0 (socket says 172.21.15.57:46914) 2021-06-25T04:47:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d7658f700 1 -- 172.21.15.57:0/3849982623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d700b0e30 msgr2=0x7f2d70066b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d7658f700 1 --2- 172.21.15.57:0/3849982623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d700b0e30 0x7f2d70066b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d7658f700 1 -- 172.21.15.57:0/3849982623 >> v1:172.21.15.87:6789/0 conn(0x7f2d700b1800 legacy=0x7f2d70142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d7658f700 1 -- 172.21.15.57:0/3849982623 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d70065f00 con 0x7f2d700b3200 2021-06-25T04:47:55.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d7658f700 1 --2- 172.21.15.57:0/3849982623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d700b3200 0x7f2d70066640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f2d64002f70 tx=0x7f2d64006eb0).ready entity=mon.1 client_cookie=73a98b21b1361b11 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:55.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d7558d700 1 -- 172.21.15.57:0/3849982623 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d6400d570 con 0x7f2d700b3200 2021-06-25T04:47:55.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d7558d700 1 -- 172.21.15.57:0/3849982623 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d64000e90 con 0x7f2d700b3200 2021-06-25T04:47:55.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d7558d700 1 -- 172.21.15.57:0/3849982623 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d6400d900 con 0x7f2d700b3200 2021-06-25T04:47:55.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d787f3700 1 -- 172.21.15.57:0/3849982623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d700b3200 msgr2=0x7f2d70066640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:55.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.955+0000 7f2d787f3700 1 --2- 172.21.15.57:0/3849982623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d700b3200 0x7f2d70066640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f2d64002f70 tx=0x7f2d64006eb0).stop 2021-06-25T04:47:55.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 -- 172.21.15.57:0/3849982623 shutdown_connections 2021-06-25T04:47:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 --2- 172.21.15.57:0/3849982623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d700b0e30 0x7f2d70066b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 --2- 172.21.15.57:0/3849982623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d700b3200 0x7f2d70066640 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 -- 172.21.15.57:0/3849982623 >> 172.21.15.57:0/3849982623 conn(0x7f2d7005c450 msgr2=0x7f2d7005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 -- 172.21.15.57:0/3849982623 shutdown_connections 2021-06-25T04:47:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 -- 172.21.15.57:0/3849982623 wait complete. 2021-06-25T04:47:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 Processor -- start 2021-06-25T04:47:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 -- start start 2021-06-25T04:47:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d700b0e30 0x7f2d7013cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d700b1800 0x7f2d7013a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d700b3200 0x7f2d7013ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700abb90 con 0x7f2d700b1800 2021-06-25T04:47:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700abe30 con 0x7f2d700b0e30 2021-06-25T04:47:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d787f3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700ac0d0 con 0x7f2d700b3200 2021-06-25T04:47:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d75d8e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d700b1800 0x7f2d7013a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d75d8e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d700b1800 0x7f2d7013a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35752/0 (socket says 172.21.15.57:35752) 2021-06-25T04:47:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.959+0000 7f2d75d8e700 1 -- 172.21.15.57:0/493771512 learned_addr learned my addr 172.21.15.57:0/493771512 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d7658f700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d700b0e30 0x7f2d7013cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d76d90700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d700b3200 0x7f2d7013ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:55.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d75d8e700 1 -- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d700b3200 msgr2=0x7f2d7013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:55.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d75d8e700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d700b3200 0x7f2d7013ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:55.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d75d8e700 1 -- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d700b0e30 msgr2=0x7f2d7013cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:55.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d75d8e700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d700b0e30 0x7f2d7013cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d75d8e700 1 -- 172.21.15.57:0/493771512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6400b1e0 con 0x7f2d700b1800 2021-06-25T04:47:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d75d8e700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d700b1800 0x7f2d7013a830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f2d70061d50 tx=0x7f2d6c007b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d637fe700 1 -- 172.21.15.57:0/493771512 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d6c007170 con 0x7f2d700b1800 2021-06-25T04:47:55.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d637fe700 1 -- 172.21.15.57:0/493771512 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c0072d0 con 0x7f2d700b1800 2021-06-25T04:47:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d787f3700 1 -- 172.21.15.57:0/493771512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d700ac370 con 0x7f2d700b1800 2021-06-25T04:47:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d637fe700 1 -- 172.21.15.57:0/493771512 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d6c004710 con 0x7f2d700b1800 2021-06-25T04:47:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d787f3700 1 -- 172.21.15.57:0/493771512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d700b0a40 con 0x7f2d700b1800 2021-06-25T04:47:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d787f3700 1 -- 172.21.15.57:0/493771512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d70057310 con 0x7f2d700b1800 2021-06-25T04:47:55.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d637fe700 1 -- 172.21.15.57:0/493771512 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2d6c004870 con 0x7f2d700b1800 2021-06-25T04:47:55.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d637fe700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d50055450 0x7f2d50057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:55.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d637fe700 1 -- 172.21.15.57:0/493771512 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2d6c06d7b0 con 0x7f2d700b1800 2021-06-25T04:47:55.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.963+0000 7f2d7658f700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d50055450 0x7f2d50057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:55.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.967+0000 7f2d7658f700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d50055450 0x7f2d50057910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2d6401b000 tx=0x7f2d64015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:55.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:55.975+0000 7f2d637fe700 1 -- 172.21.15.57:0/493771512 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2d6c043850 con 0x7f2d700b1800 2021-06-25T04:47:56.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.103+0000 7f2d787f3700 1 -- 172.21.15.57:0/493771512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d700ad5b0 con 0x7f2d700b1800 2021-06-25T04:47:56.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d637fe700 1 -- 172.21.15.57:0/493771512 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f2d6c046e70 con 0x7f2d700b1800 2021-06-25T04:47:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:56.114 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:41.021834+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:56.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 -- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d50055450 msgr2=0x7f2d50057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d50055450 0x7f2d50057910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2d6401b000 tx=0x7f2d64015000).stop 2021-06-25T04:47:56.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 -- 172.21.15.57:0/493771512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d700b1800 msgr2=0x7f2d7013a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d700b1800 0x7f2d7013a830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f2d70061d50 tx=0x7f2d6c007b70).stop 2021-06-25T04:47:56.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 -- 172.21.15.57:0/493771512 shutdown_connections 2021-06-25T04:47:56.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d50055450 0x7f2d50057910 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d700b3200 0x7f2d7013ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d700b1800 0x7f2d7013a830 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 --2- 172.21.15.57:0/493771512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d700b0e30 0x7f2d7013cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 -- 172.21.15.57:0/493771512 >> 172.21.15.57:0/493771512 conn(0x7f2d7005c450 msgr2=0x7f2d7013f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:56.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 -- 172.21.15.57:0/493771512 shutdown_connections 2021-06-25T04:47:56.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.107+0000 7f2d787f3700 1 -- 172.21.15.57:0/493771512 wait complete. 2021-06-25T04:47:56.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:47:34.957337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:47:37.729999+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:47:56.128 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:47:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.231+0000 7ff3b093a700 1 Processor -- start 2021-06-25T04:47:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.231+0000 7ff3b093a700 1 -- start start 2021-06-25T04:47:56.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3b093a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3ac066880 0x7ff3ac0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3b093a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff3ac05fc50 0x7ff3ac0b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3b093a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ac0b1530 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3b093a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ac066c60 con 0x7ff3ac05fc50 2021-06-25T04:47:56.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3b093a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0b1330 con 0x7ff3ac066880 2021-06-25T04:47:56.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3abfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff3ac05fc50 0x7ff3ac0b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3aaffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff3ac0b0c90 0x7ff3ac0b61a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52980/0 (socket says 172.21.15.57:52980) 2021-06-25T04:47:56.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3aaffd700 1 -- 172.21.15.57:0/3193378197 learned_addr learned my addr 172.21.15.57:0/3193378197 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3ab7fe700 1 --2- 172.21.15.57:0/3193378197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3ac066880 0x7ff3ac0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3abfff700 1 -- 172.21.15.57:0/3193378197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3ac066880 msgr2=0x7ff3ac0b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3abfff700 1 --2- 172.21.15.57:0/3193378197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3ac066880 0x7ff3ac0b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3abfff700 1 -- 172.21.15.57:0/3193378197 >> v1:172.21.15.57:6789/0 conn(0x7ff3ac0b0c90 legacy=0x7ff3ac0b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3aa7fc700 1 -- 172.21.15.57:0/3193378197 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231796713 0 0) 0x7ff3ac0b1530 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3abfff700 1 -- 172.21.15.57:0/3193378197 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac05f7f0 con 0x7ff3ac05fc50 2021-06-25T04:47:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3abfff700 1 --2- 172.21.15.57:0/3193378197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac05fc50 0x7ff3ac0b2650 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ff3a40032f0 tx=0x7ff3a40091d0).ready entity=mon.0 client_cookie=117a507724887afa server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:56.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3aa7fc700 1 -- 172.21.15.57:0/3193378197 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a400b6c0 con 0x7ff3ac05fc50 2021-06-25T04:47:56.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3aa7fc700 1 -- 172.21.15.57:0/3193378197 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a400b820 con 0x7ff3ac05fc50 2021-06-25T04:47:56.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3aa7fc700 1 -- 172.21.15.57:0/3193378197 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a400b990 con 0x7ff3ac05fc50 2021-06-25T04:47:56.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3b093a700 1 -- 172.21.15.57:0/3193378197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac05fc50 msgr2=0x7ff3ac0b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3b093a700 1 --2- 172.21.15.57:0/3193378197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac05fc50 0x7ff3ac0b2650 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ff3a40032f0 tx=0x7ff3a40091d0).stop 2021-06-25T04:47:56.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3b093a700 1 -- 172.21.15.57:0/3193378197 shutdown_connections 2021-06-25T04:47:56.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3b093a700 1 --2- 172.21.15.57:0/3193378197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac05fc50 0x7ff3ac0b2650 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3b093a700 1 --2- 172.21.15.57:0/3193378197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3ac066880 0x7ff3ac0b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.235+0000 7ff3b093a700 1 -- 172.21.15.57:0/3193378197 >> 172.21.15.57:0/3193378197 conn(0x7ff3ac063630 msgr2=0x7ff3ac063a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:56.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 -- 172.21.15.57:0/3193378197 shutdown_connections 2021-06-25T04:47:56.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 -- 172.21.15.57:0/3193378197 wait complete. 2021-06-25T04:47:56.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 Processor -- start 2021-06-25T04:47:56.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 -- start start 2021-06-25T04:47:56.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3ac05fc50 0x7ff3ac142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3ac066880 0x7ff3ac143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0b0c90 0x7ff3ac0b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac1421c0 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0b53c0 con 0x7ff3ac05fc50 2021-06-25T04:47:56.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac064330 con 0x7ff3ac066880 2021-06-25T04:47:56.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0b0c90 0x7ff3ac0b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0b0c90 0x7ff3ac0b6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35768/0 (socket says 172.21.15.57:35768) 2021-06-25T04:47:56.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3abfff700 1 -- 172.21.15.57:0/4073507934 learned_addr learned my addr 172.21.15.57:0/4073507934 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:56.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3ab7fe700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3ac05fc50 0x7ff3ac142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3aaffd700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3ac066880 0x7ff3ac143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3abfff700 1 -- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3ac066880 msgr2=0x7ff3ac143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3abfff700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3ac066880 0x7ff3ac143330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3abfff700 1 -- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3ac05fc50 msgr2=0x7ff3ac142e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3abfff700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3ac05fc50 0x7ff3ac142e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3abfff700 1 -- 172.21.15.57:0/4073507934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a4009470 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3abfff700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0b0c90 0x7ff3ac0b6330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7ff3a40032f0 tx=0x7ff3a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:56.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3a8ff9700 1 -- 172.21.15.57:0/4073507934 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a4011e90 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3a8ff9700 1 -- 172.21.15.57:0/4073507934 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a4021440 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 -- 172.21.15.57:0/4073507934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ac144be0 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3a8ff9700 1 -- 172.21.15.57:0/4073507934 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a40217a0 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.239+0000 7ff3b093a700 1 -- 172.21.15.57:0/4073507934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac0b6f60 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.243+0000 7ff3b093a700 1 -- 172.21.15.57:0/4073507934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ac0b50d0 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.243+0000 7ff3a8ff9700 1 -- 172.21.15.57:0/4073507934 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff3a400f070 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.243+0000 7ff3a8ff9700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff38c0553d0 0x7ff38c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.243+0000 7ff3a8ff9700 1 -- 172.21.15.57:0/4073507934 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff3a406f5b0 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.243+0000 7ff3ab7fe700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff38c0553d0 0x7ff38c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.243+0000 7ff3ab7fe700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff38c0553d0 0x7ff38c057890 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7ff39c00b000 tx=0x7ff39c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:56.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.251+0000 7ff3a8ff9700 1 -- 172.21.15.57:0/4073507934 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff3a4045760 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.379+0000 7ff3b093a700 1 -- 172.21.15.57:0/4073507934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff3ac057310 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3a8ff9700 1 -- 172.21.15.57:0/4073507934 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff3a4048d80 con 0x7ff3ac0b0c90 2021-06-25T04:47:56.389 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:47:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 -- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff38c0553d0 msgr2=0x7ff38c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff38c0553d0 0x7ff38c057890 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7ff39c00b000 tx=0x7ff39c006df0).stop 2021-06-25T04:47:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 -- 172.21.15.57:0/4073507934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0b0c90 msgr2=0x7ff3ac0b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0b0c90 0x7ff3ac0b6330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7ff3a40032f0 tx=0x7ff3a4016000).stop 2021-06-25T04:47:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 -- 172.21.15.57:0/4073507934 shutdown_connections 2021-06-25T04:47:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff38c0553d0 0x7ff38c057890 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0b0c90 0x7ff3ac0b6330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3ac066880 0x7ff3ac143330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 --2- 172.21.15.57:0/4073507934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3ac05fc50 0x7ff3ac142e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 -- 172.21.15.57:0/4073507934 >> 172.21.15.57:0/4073507934 conn(0x7ff3ac063630 msgr2=0x7ff3ac0b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:56.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 -- 172.21.15.57:0/4073507934 shutdown_connections 2021-06-25T04:47:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.383+0000 7ff3b093a700 1 -- 172.21.15.57:0/4073507934 wait complete. 2021-06-25T04:47:56.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:47:56.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.507+0000 7ff28a7d7700 1 Processor -- start 2021-06-25T04:47:56.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.507+0000 7ff28a7d7700 1 -- start start 2021-06-25T04:47:56.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.507+0000 7ff28a7d7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff2840b2760 0x7ff284061120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.507+0000 7ff28a7d7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff284067010 con 0x7ff284143230 2021-06-25T04:47:56.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.507+0000 7ff28a7d7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff284061610 con 0x7ff2840b7670 2021-06-25T04:47:56.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.507+0000 7ff28a7d7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff284065370 con 0x7ff2840b2760 2021-06-25T04:47:56.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff289fd6700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff284143230 0x7ff2841436c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52996/0 (socket says 172.21.15.57:52996) 2021-06-25T04:47:56.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff289fd6700 1 -- 172.21.15.57:0/1644311153 learned_addr learned my addr 172.21.15.57:0/1644311153 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:56.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff288fd4700 1 --2- 172.21.15.57:0/1644311153 >> v2:172.21.15.87:3300/0 conn(0x7ff2840b2760 0x7ff284061120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff27bfff700 1 -- 172.21.15.57:0/1644311153 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421358124 0 0) 0x7ff284067010 con 0x7ff284143230 2021-06-25T04:47:56.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff27bfff700 1 -- 172.21.15.57:0/1644311153 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff268003260 con 0x7ff284143230 2021-06-25T04:47:56.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff288fd4700 1 -- 172.21.15.57:0/1644311153 >> v1:172.21.15.87:6789/0 conn(0x7ff2840b7670 legacy=0x7ff284060a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff288fd4700 1 -- 172.21.15.57:0/1644311153 >> v1:172.21.15.57:6789/0 conn(0x7ff284143230 legacy=0x7ff2841436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff288fd4700 1 -- 172.21.15.57:0/1644311153 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2840b7a50 con 0x7ff2840b2760 2021-06-25T04:47:56.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff288fd4700 1 --2- 172.21.15.57:0/1644311153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2840b2760 0x7ff284061120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff274002f70 tx=0x7ff274006df0).ready entity=mon.1 client_cookie=6bf3d0a0783e26df server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:56.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff27bfff700 1 -- 172.21.15.57:0/1644311153 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff27400d610 con 0x7ff2840b2760 2021-06-25T04:47:56.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff27bfff700 1 -- 172.21.15.57:0/1644311153 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff274000e90 con 0x7ff2840b2760 2021-06-25T04:47:56.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff27bfff700 1 -- 172.21.15.57:0/1644311153 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff27400d960 con 0x7ff2840b2760 2021-06-25T04:47:56.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff28a7d7700 1 -- 172.21.15.57:0/1644311153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2840b2760 msgr2=0x7ff284061120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff28a7d7700 1 --2- 172.21.15.57:0/1644311153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2840b2760 0x7ff284061120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff274002f70 tx=0x7ff274006df0).stop 2021-06-25T04:47:56.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff28a7d7700 1 -- 172.21.15.57:0/1644311153 shutdown_connections 2021-06-25T04:47:56.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff28a7d7700 1 --2- 172.21.15.57:0/1644311153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2840b2760 0x7ff284061120 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff28a7d7700 1 -- 172.21.15.57:0/1644311153 >> 172.21.15.57:0/1644311153 conn(0x7ff28405f670 msgr2=0x7ff28405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:56.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff28a7d7700 1 -- 172.21.15.57:0/1644311153 shutdown_connections 2021-06-25T04:47:56.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.511+0000 7ff28a7d7700 1 -- 172.21.15.57:0/1644311153 wait complete. 2021-06-25T04:47:56.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff28a7d7700 1 Processor -- start 2021-06-25T04:47:56.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff28a7d7700 1 -- start start 2021-06-25T04:47:56.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff28a7d7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2840b2760 0x7ff28405bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff28a7d7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2840b7670 0x7ff2840b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff28a7d7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff284143230 0x7ff2840ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff28a7d7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff284152270 con 0x7ff2840b7670 2021-06-25T04:47:56.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff28a7d7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff284152510 con 0x7ff2840b2760 2021-06-25T04:47:56.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff28a7d7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2841527b0 con 0x7ff284143230 2021-06-25T04:47:56.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff288fd4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2840b7670 0x7ff2840b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff288fd4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2840b7670 0x7ff2840b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35782/0 (socket says 172.21.15.57:35782) 2021-06-25T04:47:56.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff288fd4700 1 -- 172.21.15.57:0/2710584624 learned_addr learned my addr 172.21.15.57:0/2710584624 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:56.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff2897d5700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2840b2760 0x7ff28405bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff289fd6700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff284143230 0x7ff2840ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff288fd4700 1 -- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff284143230 msgr2=0x7ff2840ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff288fd4700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff284143230 0x7ff2840ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff288fd4700 1 -- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2840b2760 msgr2=0x7ff28405bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff288fd4700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2840b2760 0x7ff28405bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff288fd4700 1 -- 172.21.15.57:0/2710584624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27400b180 con 0x7ff2840b7670 2021-06-25T04:47:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff288fd4700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2840b7670 0x7ff2840b0c00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ff274002f70 tx=0x7ff274014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff27a7fc700 1 -- 172.21.15.57:0/2710584624 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff274006b20 con 0x7ff2840b7670 2021-06-25T04:47:56.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff27a7fc700 1 -- 172.21.15.57:0/2710584624 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27400d290 con 0x7ff2840b7670 2021-06-25T04:47:56.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff28a7d7700 1 -- 172.21.15.57:0/2710584624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff284152a50 con 0x7ff2840b7670 2021-06-25T04:47:56.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff27a7fc700 1 -- 172.21.15.57:0/2710584624 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff27401f440 con 0x7ff2840b7670 2021-06-25T04:47:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.515+0000 7ff28a7d7700 1 -- 172.21.15.57:0/2710584624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff284152ef0 con 0x7ff2840b7670 2021-06-25T04:47:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.519+0000 7ff28a7d7700 1 -- 172.21.15.57:0/2710584624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff284152be0 con 0x7ff2840b7670 2021-06-25T04:47:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.519+0000 7ff27a7fc700 1 -- 172.21.15.57:0/2710584624 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff274025020 con 0x7ff2840b7670 2021-06-25T04:47:56.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.519+0000 7ff27a7fc700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff26c055510 0x7ff26c0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.519+0000 7ff27a7fc700 1 -- 172.21.15.57:0/2710584624 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff27406eee0 con 0x7ff2840b7670 2021-06-25T04:47:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.519+0000 7ff2897d5700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff26c055510 0x7ff26c0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.519+0000 7ff2897d5700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff26c055510 0x7ff26c0579d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7ff28000d000 tx=0x7ff280007b80).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.527+0000 7ff27a7fc700 1 -- 172.21.15.57:0/2710584624 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff274045090 con 0x7ff2840b7670 2021-06-25T04:47:56.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.655+0000 7ff28a7d7700 1 -- 172.21.15.57:0/2710584624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff284057310 con 0x7ff2840b7670 2021-06-25T04:47:56.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.655+0000 7ff27a7fc700 1 -- 172.21.15.57:0/2710584624 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff2740486b0 con 0x7ff2840b7670 2021-06-25T04:47:56.664 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:56.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 -- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff26c055510 msgr2=0x7ff26c0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff26c055510 0x7ff26c0579d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7ff28000d000 tx=0x7ff280007b80).stop 2021-06-25T04:47:56.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 -- 172.21.15.57:0/2710584624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2840b7670 msgr2=0x7ff2840b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2840b7670 0x7ff2840b0c00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ff274002f70 tx=0x7ff274014000).stop 2021-06-25T04:47:56.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 -- 172.21.15.57:0/2710584624 shutdown_connections 2021-06-25T04:47:56.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff26c055510 0x7ff26c0579d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff284143230 0x7ff2840ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2840b7670 0x7ff2840b0c00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 --2- 172.21.15.57:0/2710584624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2840b2760 0x7ff28405bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 -- 172.21.15.57:0/2710584624 >> 172.21.15.57:0/2710584624 conn(0x7ff28405f670 msgr2=0x7ff2840b6990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 -- 172.21.15.57:0/2710584624 shutdown_connections 2021-06-25T04:47:56.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.659+0000 7ff28a7d7700 1 -- 172.21.15.57:0/2710584624 wait complete. 2021-06-25T04:47:56.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:47:56.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f9723f2b700 1 Processor -- start 2021-06-25T04:47:56.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f9723f2b700 1 -- start start 2021-06-25T04:47:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f9723f2b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f971c061690 0x7f971c0b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f9723f2b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f971c060b30 0x7f971c05f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f9723f2b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c140050 con 0x7f971c0b1940 2021-06-25T04:47:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f9723f2b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c060f80 con 0x7f971c060b30 2021-06-25T04:47:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f9723f2b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c1402f0 con 0x7f971c061690 2021-06-25T04:47:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f9721cc7700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f971c0b1940 0x7f971c139c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53006/0 (socket says 172.21.15.57:53006) 2021-06-25T04:47:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f9721cc7700 1 -- 172.21.15.57:0/1107131031 learned_addr learned my addr 172.21.15.57:0/1107131031 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f97214c6700 1 --2- 172.21.15.57:0/1107131031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f971c061690 0x7f971c0b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f97224c8700 1 --2- 172.21.15.57:0/1107131031 >> v2:172.21.15.87:3300/0 conn(0x7f971c060b30 0x7f971c05f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f9720cc5700 1 -- 172.21.15.57:0/1107131031 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348437641 0 0) 0x7f971c140050 con 0x7f971c0b1940 2021-06-25T04:47:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f9720cc5700 1 -- 172.21.15.57:0/1107131031 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9704003260 con 0x7f971c0b1940 2021-06-25T04:47:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f97224c8700 1 -- 172.21.15.57:0/1107131031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f971c061690 msgr2=0x7f971c0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f97224c8700 1 --2- 172.21.15.57:0/1107131031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f971c061690 0x7f971c0b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f97224c8700 1 -- 172.21.15.57:0/1107131031 >> v1:172.21.15.57:6789/0 conn(0x7f971c0b1940 legacy=0x7f971c139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.771+0000 7f97224c8700 1 -- 172.21.15.57:0/1107131031 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c140590 con 0x7f971c060b30 2021-06-25T04:47:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f97224c8700 1 --2- 172.21.15.57:0/1107131031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c060b30 0x7f971c05f670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f97140032f0 tx=0x7f97140091d0).ready entity=mon.1 client_cookie=3a9635a34cdeeb28 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9720cc5700 1 -- 172.21.15.57:0/1107131031 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f971400b600 con 0x7f971c060b30 2021-06-25T04:47:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9720cc5700 1 -- 172.21.15.57:0/1107131031 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971400b760 con 0x7f971c060b30 2021-06-25T04:47:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9720cc5700 1 -- 172.21.15.57:0/1107131031 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f971400b8d0 con 0x7f971c060b30 2021-06-25T04:47:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9723f2b700 1 -- 172.21.15.57:0/1107131031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c060b30 msgr2=0x7f971c05f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9723f2b700 1 --2- 172.21.15.57:0/1107131031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c060b30 0x7f971c05f670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f97140032f0 tx=0x7f97140091d0).stop 2021-06-25T04:47:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9723f2b700 1 -- 172.21.15.57:0/1107131031 shutdown_connections 2021-06-25T04:47:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9723f2b700 1 --2- 172.21.15.57:0/1107131031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c060b30 0x7f971c05f670 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9723f2b700 1 --2- 172.21.15.57:0/1107131031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f971c061690 0x7f971c0b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9723f2b700 1 -- 172.21.15.57:0/1107131031 >> 172.21.15.57:0/1107131031 conn(0x7f971c0b2930 msgr2=0x7f971c0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9723f2b700 1 -- 172.21.15.57:0/1107131031 shutdown_connections 2021-06-25T04:47:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9723f2b700 1 -- 172.21.15.57:0/1107131031 wait complete. 2021-06-25T04:47:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9723f2b700 1 Processor -- start 2021-06-25T04:47:56.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.775+0000 7f9723f2b700 1 -- start start 2021-06-25T04:47:56.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9723f2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c060b30 0x7f971c0ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9723f2b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f971c061690 0x7f971c14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9723f2b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c0b1940 0x7f971c0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9723f2b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c144430 con 0x7f971c060b30 2021-06-25T04:47:56.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9723f2b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c141880 con 0x7f971c0b1940 2021-06-25T04:47:56.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9723f2b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c14fdc0 con 0x7f971c061690 2021-06-25T04:47:56.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9721cc7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c060b30 0x7f971c0ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9721cc7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c060b30 0x7f971c0ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35794/0 (socket says 172.21.15.57:35794) 2021-06-25T04:47:56.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9721cc7700 1 -- 172.21.15.57:0/2964419416 learned_addr learned my addr 172.21.15.57:0/2964419416 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:56.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f97224c8700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c0b1940 0x7f971c0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f97214c6700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f971c061690 0x7f971c14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9721cc7700 1 -- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f971c061690 msgr2=0x7f971c14f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9721cc7700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f971c061690 0x7f971c14f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9721cc7700 1 -- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c0b1940 msgr2=0x7f971c0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9721cc7700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c0b1940 0x7f971c0afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9721cc7700 1 -- 172.21.15.57:0/2964419416 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9714009470 con 0x7f971c060b30 2021-06-25T04:47:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9721cc7700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c060b30 0x7f971c0ad280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f971c1441c0 tx=0x7f9718007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:56.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f970affd700 1 -- 172.21.15.57:0/2964419416 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f971800ce70 con 0x7f971c060b30 2021-06-25T04:47:56.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f970affd700 1 -- 172.21.15.57:0/2964419416 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97180070d0 con 0x7f971c060b30 2021-06-25T04:47:56.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9723f2b700 1 -- 172.21.15.57:0/2964419416 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c13d250 con 0x7f971c060b30 2021-06-25T04:47:56.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f970affd700 1 -- 172.21.15.57:0/2964419416 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9718007430 con 0x7f971c060b30 2021-06-25T04:47:56.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.779+0000 7f9723f2b700 1 -- 172.21.15.57:0/2964419416 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c141ab0 con 0x7f971c060b30 2021-06-25T04:47:56.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.783+0000 7f970affd700 1 -- 172.21.15.57:0/2964419416 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9718010070 con 0x7f971c060b30 2021-06-25T04:47:56.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.783+0000 7f9723f2b700 1 -- 172.21.15.57:0/2964419416 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c141c70 con 0x7f971c060b30 2021-06-25T04:47:56.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.783+0000 7f970affd700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f96fc0553f0 0x7f96fc0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:56.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.783+0000 7f970affd700 1 -- 172.21.15.57:0/2964419416 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f971806d580 con 0x7f971c060b30 2021-06-25T04:47:56.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.783+0000 7f97214c6700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f96fc0553f0 0x7f96fc0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:56.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.783+0000 7f97214c6700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f96fc0553f0 0x7f96fc0578b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f970c00b000 tx=0x7f970c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:56.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.787+0000 7f970affd700 1 -- 172.21.15.57:0/2964419416 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f97180435c0 con 0x7f971c060b30 2021-06-25T04:47:56.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 -- 172.21.15.57:0/2964419416 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f971c057310 con 0x7f971c060b30 2021-06-25T04:47:56.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f970affd700 1 -- 172.21.15.57:0/2964419416 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9718046be0 con 0x7f971c060b30 2021-06-25T04:47:56.919 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:56.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 -- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f96fc0553f0 msgr2=0x7f96fc0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f96fc0553f0 0x7f96fc0578b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f970c00b000 tx=0x7f970c006df0).stop 2021-06-25T04:47:56.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 -- 172.21.15.57:0/2964419416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c060b30 msgr2=0x7f971c0ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:56.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c060b30 0x7f971c0ad280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f971c1441c0 tx=0x7f9718007aa0).stop 2021-06-25T04:47:56.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 -- 172.21.15.57:0/2964419416 shutdown_connections 2021-06-25T04:47:56.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f96fc0553f0 0x7f96fc0578b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f971c0b1940 0x7f971c0afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f971c061690 0x7f971c14f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 --2- 172.21.15.57:0/2964419416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c060b30 0x7f971c0ad280 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:56.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 -- 172.21.15.57:0/2964419416 >> 172.21.15.57:0/2964419416 conn(0x7f971c0b2930 msgr2=0x7f971c0aa230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:56.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 -- 172.21.15.57:0/2964419416 shutdown_connections 2021-06-25T04:47:56.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:56.911+0000 7f9723f2b700 1 -- 172.21.15.57:0/2964419416 wait complete. 2021-06-25T04:47:56.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:47:57.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.035+0000 7f143e54e700 1 Processor -- start 2021-06-25T04:47:57.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.035+0000 7f143e54e700 1 -- start start 2021-06-25T04:47:57.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143e54e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f143805c790 0x7f14380b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143e54e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f143813f350 0x7f14380aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143e54e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143805cb70 con 0x7f143805d070 2021-06-25T04:47:57.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143e54e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14380ad500 con 0x7f143813f350 2021-06-25T04:47:57.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143e54e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1438067d30 con 0x7f143805c790 2021-06-25T04:47:57.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143dd4d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f143813f350 0x7f14380aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143cd4b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f143805d070 0x7f14380acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53022/0 (socket says 172.21.15.57:53022) 2021-06-25T04:47:57.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143cd4b700 1 -- 172.21.15.57:0/1774722748 learned_addr learned my addr 172.21.15.57:0/1774722748 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:57.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143d54c700 1 --2- 172.21.15.57:0/1774722748 >> v2:172.21.15.87:3300/0 conn(0x7f143805c790 0x7f14380b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f1427fff700 1 -- 172.21.15.57:0/1774722748 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314534754 0 0) 0x7f143805cb70 con 0x7f143805d070 2021-06-25T04:47:57.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143dd4d700 1 -- 172.21.15.57:0/1774722748 >> v2:172.21.15.87:3300/0 conn(0x7f143805c790 msgr2=0x7f14380b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:57.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143dd4d700 1 --2- 172.21.15.57:0/1774722748 >> v2:172.21.15.87:3300/0 conn(0x7f143805c790 0x7f14380b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143dd4d700 1 -- 172.21.15.57:0/1774722748 >> v1:172.21.15.57:6789/0 conn(0x7f143805d070 legacy=0x7f14380acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:57.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143dd4d700 1 -- 172.21.15.57:0/1774722748 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14380b1750 con 0x7f143813f350 2021-06-25T04:47:57.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143dd4d700 1 --2- 172.21.15.57:0/1774722748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143813f350 0x7f14380aeca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f14300032f0 tx=0x7f14300091d0).ready entity=mon.0 client_cookie=c6130790fe62be94 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:57.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f1427fff700 1 -- 172.21.15.57:0/1774722748 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f143000b680 con 0x7f143813f350 2021-06-25T04:47:57.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f1427fff700 1 -- 172.21.15.57:0/1774722748 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000b7e0 con 0x7f143813f350 2021-06-25T04:47:57.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f1427fff700 1 -- 172.21.15.57:0/1774722748 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f143000b950 con 0x7f143813f350 2021-06-25T04:47:57.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143e54e700 1 -- 172.21.15.57:0/1774722748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143813f350 msgr2=0x7f14380aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:57.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143e54e700 1 --2- 172.21.15.57:0/1774722748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143813f350 0x7f14380aeca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f14300032f0 tx=0x7f14300091d0).stop 2021-06-25T04:47:57.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143e54e700 1 -- 172.21.15.57:0/1774722748 shutdown_connections 2021-06-25T04:47:57.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143e54e700 1 --2- 172.21.15.57:0/1774722748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143813f350 0x7f14380aeca0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.039+0000 7f143e54e700 1 --2- 172.21.15.57:0/1774722748 >> v2:172.21.15.87:3300/0 conn(0x7f143805c790 0x7f14380b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.043+0000 7f143e54e700 1 -- 172.21.15.57:0/1774722748 >> 172.21.15.57:0/1774722748 conn(0x7f1438060140 msgr2=0x7f14380b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:57.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.043+0000 7f143e54e700 1 -- 172.21.15.57:0/1774722748 shutdown_connections 2021-06-25T04:47:57.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.043+0000 7f143e54e700 1 -- 172.21.15.57:0/1774722748 wait complete. 2021-06-25T04:47:57.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.043+0000 7f143e54e700 1 Processor -- start 2021-06-25T04:47:57.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.043+0000 7f143e54e700 1 -- start start 2021-06-25T04:47:57.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143e54e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143805c790 0x7f143813baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143e54e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f143805d070 0x7f14381428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143e54e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f143813f350 0x7f1438151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143e54e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380abc90 con 0x7f143805c790 2021-06-25T04:47:57.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143e54e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1438142030 con 0x7f143813f350 2021-06-25T04:47:57.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143e54e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1438141dd0 con 0x7f143805d070 2021-06-25T04:47:57.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143d54c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143805c790 0x7f143813baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143d54c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143805c790 0x7f143813baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35808/0 (socket says 172.21.15.57:35808) 2021-06-25T04:47:57.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143d54c700 1 -- 172.21.15.57:0/918886669 learned_addr learned my addr 172.21.15.57:0/918886669 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:57.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143cd4b700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f143805d070 0x7f14381428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143dd4d700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f143813f350 0x7f1438151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143d54c700 1 -- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f143805d070 msgr2=0x7f14381428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:57.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143d54c700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f143805d070 0x7f14381428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143d54c700 1 -- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f143813f350 msgr2=0x7f1438151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:57.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143d54c700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f143813f350 0x7f1438151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143d54c700 1 -- 172.21.15.57:0/918886669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430009470 con 0x7f143805c790 2021-06-25T04:47:57.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143d54c700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143805c790 0x7f143813baf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f1438063ca0 tx=0x7f1434006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:57.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f14267fc700 1 -- 172.21.15.57:0/918886669 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14340127a0 con 0x7f143805c790 2021-06-25T04:47:57.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f14267fc700 1 -- 172.21.15.57:0/918886669 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1434012900 con 0x7f143805c790 2021-06-25T04:47:57.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143e54e700 1 -- 172.21.15.57:0/918886669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14380ab9f0 con 0x7f143805c790 2021-06-25T04:47:57.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f14267fc700 1 -- 172.21.15.57:0/918886669 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1434012c60 con 0x7f143805c790 2021-06-25T04:47:57.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143e54e700 1 -- 172.21.15.57:0/918886669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1438151570 con 0x7f143805c790 2021-06-25T04:47:57.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.047+0000 7f143e54e700 1 -- 172.21.15.57:0/918886669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14381423e0 con 0x7f143805c790 2021-06-25T04:47:57.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.051+0000 7f14267fc700 1 -- 172.21.15.57:0/918886669 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1434012040 con 0x7f143805c790 2021-06-25T04:47:57.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.051+0000 7f14267fc700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1418055340 0x7f1418057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.051+0000 7f14267fc700 1 -- 172.21.15.57:0/918886669 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f14340704f0 con 0x7f143805c790 2021-06-25T04:47:57.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.051+0000 7f143cd4b700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1418055340 0x7f1418057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.051+0000 7f143cd4b700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1418055340 0x7f1418057800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f142800d000 tx=0x7f1428007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:57.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.055+0000 7f14267fc700 1 -- 172.21.15.57:0/918886669 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1434046600 con 0x7f143805c790 2021-06-25T04:47:57.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 -- 172.21.15.57:0/918886669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1438057310 con 0x7f143805c790 2021-06-25T04:47:57.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f14267fc700 1 -- 172.21.15.57:0/918886669 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1434049c20 con 0x7f143805c790 2021-06-25T04:47:57.190 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:47:57.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 -- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1418055340 msgr2=0x7f1418057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:57.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1418055340 0x7f1418057800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f142800d000 tx=0x7f1428007a20).stop 2021-06-25T04:47:57.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 -- 172.21.15.57:0/918886669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143805c790 msgr2=0x7f143813baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:57.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143805c790 0x7f143813baf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f1438063ca0 tx=0x7f1434006df0).stop 2021-06-25T04:47:57.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 -- 172.21.15.57:0/918886669 shutdown_connections 2021-06-25T04:47:57.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1418055340 0x7f1418057800 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f143813f350 0x7f1438151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f143805d070 0x7f14381428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 --2- 172.21.15.57:0/918886669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143805c790 0x7f143813baf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 -- 172.21.15.57:0/918886669 >> 172.21.15.57:0/918886669 conn(0x7f1438060140 msgr2=0x7f143813f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:57.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 -- 172.21.15.57:0/918886669 shutdown_connections 2021-06-25T04:47:57.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.183+0000 7f143e54e700 1 -- 172.21.15.57:0/918886669 wait complete. 2021-06-25T04:47:57.203 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:47:57.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:47:57.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.299+0000 7febb1bf3700 1 Processor -- start 2021-06-25T04:47:57.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.299+0000 7febb1bf3700 1 -- start start 2021-06-25T04:47:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7febac0a7670 0x7febac066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7febac0b1930 0x7febac066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febac0b0020 0x7febac05f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac067410 con 0x7febac0b1930 2021-06-25T04:47:57.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac0a7a50 con 0x7febac0a7670 2021-06-25T04:47:57.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac1475e0 con 0x7febac0b0020 2021-06-25T04:47:57.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaaffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7febac0b1930 0x7febac066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaaffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7febac0b1930 0x7febac066f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35816/0 (socket says 172.21.15.57:35816) 2021-06-25T04:47:57.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaaffd700 1 -- 172.21.15.57:0/3714952927 learned_addr learned my addr 172.21.15.57:0/3714952927 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:57.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febabfff700 1 --2- 172.21.15.57:0/3714952927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febac0b0020 0x7febac05f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febab7fe700 1 --2- 172.21.15.57:0/3714952927 >> v2:172.21.15.87:3300/0 conn(0x7febac0a7670 0x7febac066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaaffd700 1 -- 172.21.15.57:0/3714952927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febac0b0020 msgr2=0x7febac05f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaaffd700 1 --2- 172.21.15.57:0/3714952927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febac0b0020 0x7febac05f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaaffd700 1 -- 172.21.15.57:0/3714952927 >> v2:172.21.15.87:3300/0 conn(0x7febac0a7670 msgr2=0x7febac066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:47:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaaffd700 1 --2- 172.21.15.57:0/3714952927 >> v2:172.21.15.87:3300/0 conn(0x7febac0a7670 0x7febac066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaaffd700 1 -- 172.21.15.57:0/3714952927 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac147880 con 0x7febac0b1930 2021-06-25T04:47:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaaffd700 1 --2- 172.21.15.57:0/3714952927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febac0b1930 0x7febac066f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7feb9c002f70 tx=0x7feb9c006eb0).ready entity=mon.0 client_cookie=6d7ebf2082729974 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaa7fc700 1 -- 172.21.15.57:0/3714952927 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb9c00d570 con 0x7febac0b1930 2021-06-25T04:47:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaa7fc700 1 -- 172.21.15.57:0/3714952927 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c000e90 con 0x7febac0b1930 2021-06-25T04:47:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febaa7fc700 1 -- 172.21.15.57:0/3714952927 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb9c00d900 con 0x7febac0b1930 2021-06-25T04:47:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 -- 172.21.15.57:0/3714952927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febac0b1930 msgr2=0x7febac066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 --2- 172.21.15.57:0/3714952927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febac0b1930 0x7febac066f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7feb9c002f70 tx=0x7feb9c006eb0).stop 2021-06-25T04:47:57.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 -- 172.21.15.57:0/3714952927 shutdown_connections 2021-06-25T04:47:57.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 --2- 172.21.15.57:0/3714952927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febac0b0020 0x7febac05f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 --2- 172.21.15.57:0/3714952927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febac0b1930 0x7febac066f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 --2- 172.21.15.57:0/3714952927 >> v2:172.21.15.87:3300/0 conn(0x7febac0a7670 0x7febac066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 -- 172.21.15.57:0/3714952927 >> 172.21.15.57:0/3714952927 conn(0x7febac0b53a0 msgr2=0x7febac0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:57.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 -- 172.21.15.57:0/3714952927 shutdown_connections 2021-06-25T04:47:57.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.303+0000 7febb1bf3700 1 -- 172.21.15.57:0/3714952927 wait complete. 2021-06-25T04:47:57.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febb1bf3700 1 Processor -- start 2021-06-25T04:47:57.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febb1bf3700 1 -- start start 2021-06-25T04:47:57.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febb1bf3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febac0a7670 0x7febac14caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febb1bf3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febac0b0020 0x7febac0aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febb1bf3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febac0b1930 0x7febac0ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febb1bf3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac14c3f0 con 0x7febac0b1930 2021-06-25T04:47:57.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febb1bf3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac14c690 con 0x7febac0b0020 2021-06-25T04:47:57.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febb1bf3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0aa840 con 0x7febac0a7670 2021-06-25T04:47:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febabfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febac0b1930 0x7febac0ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febabfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febac0b1930 0x7febac0ab230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35826/0 (socket says 172.21.15.57:35826) 2021-06-25T04:47:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febabfff700 1 -- 172.21.15.57:0/2792532282 learned_addr learned my addr 172.21.15.57:0/2792532282 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febab7fe700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febac0a7670 0x7febac14caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febaaffd700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febac0b0020 0x7febac0aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febabfff700 1 -- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febac0a7670 msgr2=0x7febac14caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:57.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febabfff700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febac0a7670 0x7febac14caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febabfff700 1 -- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febac0b0020 msgr2=0x7febac0aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:57.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febabfff700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febac0b0020 0x7febac0aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febabfff700 1 -- 172.21.15.57:0/2792532282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c00b1e0 con 0x7febac0b1930 2021-06-25T04:47:57.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febab7fe700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febac0a7670 0x7febac14caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:47:57.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febabfff700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febac0b1930 0x7febac0ab230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7feba4006e00 tx=0x7feba40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:57.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7feba8ff9700 1 -- 172.21.15.57:0/2792532282 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba400c850 con 0x7febac0b1930 2021-06-25T04:47:57.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7feba8ff9700 1 -- 172.21.15.57:0/2792532282 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba400c9b0 con 0x7febac0b1930 2021-06-25T04:47:57.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7feba8ff9700 1 -- 172.21.15.57:0/2792532282 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba400cd10 con 0x7febac0b1930 2021-06-25T04:47:57.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febb1bf3700 1 -- 172.21.15.57:0/2792532282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac0ab720 con 0x7febac0b1930 2021-06-25T04:47:57.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.307+0000 7febb1bf3700 1 -- 172.21.15.57:0/2792532282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac0abbf0 con 0x7febac0b1930 2021-06-25T04:47:57.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.311+0000 7febb1bf3700 1 -- 172.21.15.57:0/2792532282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac14c850 con 0x7febac0b1930 2021-06-25T04:47:57.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.311+0000 7feba8ff9700 1 -- 172.21.15.57:0/2792532282 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7feba4022070 con 0x7febac0b1930 2021-06-25T04:47:57.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.311+0000 7feba8ff9700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb8c055340 0x7feb8c057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:57.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.311+0000 7feba8ff9700 1 -- 172.21.15.57:0/2792532282 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7feba406e670 con 0x7febac0b1930 2021-06-25T04:47:57.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.311+0000 7febab7fe700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb8c055340 0x7feb8c057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:57.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.311+0000 7febab7fe700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb8c055340 0x7feb8c057800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7feba000c000 tx=0x7feba0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:57.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.315+0000 7feba8ff9700 1 -- 172.21.15.57:0/2792532282 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7feba4044820 con 0x7febac0b1930 2021-06-25T04:47:57.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7febb1bf3700 1 -- 172.21.15.57:0/2792532282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febac057310 con 0x7febac0b1930 2021-06-25T04:47:57.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7feba8ff9700 1 -- 172.21.15.57:0/2792532282 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7feba4016020 con 0x7febac0b1930 2021-06-25T04:47:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:57.487 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/1675349577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1675349577},{"type":"v1","addr":"172.21.15.87:6835","nonce":1675349577}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/4129321821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4129321821},{"type":"v1","addr":"172.21.15.57:6833","nonce":4129321821}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:47:40.019558+0000","modified":"2021-06-25T04:47:41.749060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1050167707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1050167707},{"type":"v1","addr":"172.21.15.57:6835","nonce":1050167707}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-06-25T04:47:57.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7febb1bf3700 1 -- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb8c055340 msgr2=0x7feb8c057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:57.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7febb1bf3700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb8c055340 0x7feb8c057800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7feba000c000 tx=0x7feba0008040).stop 2021-06-25T04:47:57.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7febb1bf3700 1 -- 172.21.15.57:0/2792532282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febac0b1930 msgr2=0x7febac0ab230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:57.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7febb1bf3700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febac0b1930 0x7febac0ab230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7feba4006e00 tx=0x7feba40091d0).stop 2021-06-25T04:47:57.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7febb1bf3700 1 -- 172.21.15.57:0/2792532282 shutdown_connections 2021-06-25T04:47:57.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7febb1bf3700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb8c055340 0x7feb8c057800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7febb1bf3700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febac0b1930 0x7febac0ab230 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7febb1bf3700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febac0b0020 0x7febac0aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7febb1bf3700 1 --2- 172.21.15.57:0/2792532282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febac0a7670 0x7febac14caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:57.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.479+0000 7febb1bf3700 1 -- 172.21.15.57:0/2792532282 >> 172.21.15.57:0/2792532282 conn(0x7febac0b53a0 msgr2=0x7febac0b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:57.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.483+0000 7febb1bf3700 1 -- 172.21.15.57:0/2792532282 shutdown_connections 2021-06-25T04:47:57.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:57.483+0000 7febb1bf3700 1 -- 172.21.15.57:0/2792532282 wait complete. 2021-06-25T04:47:57.492 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2021-06-25T04:47:57.803 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:47:40.019558+0000', 'modified': '2021-06-25T04:47:41.749060+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/1050167707', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 1050167707}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 1050167707}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:47:57.804 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:47:57.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:47:57.924 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":4281,"want_state":"up:active","state":"up:active","rank_uptime":17.888174795000001,"mdsmap_epoch":7,"osdmap_epoch":25,"osdmap_epoch_barrier":25,"uptime":24.252037509000001} 2021-06-25T04:47:57.925 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 4281, "mdsmap_epoch": 7, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "rank_uptime": 17.888174795, "state": "up:active", "uptime": 24.252037509, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:47:57.925 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:47:57.926 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-06-25T04:47:57.926 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi161.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-06-25T04:47:57.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:57.928 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:47:57.938 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:47:57.955 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:47:57.955 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:47:57.971 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:47:57.972 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:47:57.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:57.973 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:47:57.979 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:47:57.979 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:47:58.022 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:47:58.039 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:47:58.039 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:47:58.048 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:47:58.049 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:47:58.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:58.050 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:47:58.114 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14354]: starting ceph client2021-06-25T04:47:58.111+0000 7f166619e080 -1 init, newargv = 0x55d397112a90 newargc=9 2021-06-25T04:47:58.114 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr: 2021-06-25T04:47:58.124 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14354]: starting fuse 2021-06-25T04:47:59.206 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:47:59.225 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:47:59.225 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:47:59.280 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:47:59.282 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:47:59.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:59.283 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:47:59.289 INFO:teuthology.orchestra.run.smithi161.stdout:52 2021-06-25T04:47:59.290 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:47:59.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:59.291 DEBUG:teuthology.orchestra.run.smithi161:> sudo python3 -c ' 2021-06-25T04:47:59.291 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2021-06-25T04:47:59.293 DEBUG:teuthology.orchestra.run.smithi161:> import re 2021-06-25T04:47:59.293 DEBUG:teuthology.orchestra.run.smithi161:> import os 2021-06-25T04:47:59.293 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2021-06-25T04:47:59.294 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:47:59.294 DEBUG:teuthology.orchestra.run.smithi161:> def find_socket(client_name): 2021-06-25T04:47:59.294 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-06-25T04:47:59.295 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2021-06-25T04:47:59.295 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:47:59.296 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2021-06-25T04:47:59.297 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2021-06-25T04:47:59.297 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2021-06-25T04:47:59.298 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2021-06-25T04:47:59.298 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:47:59.298 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2021-06-25T04:47:59.299 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:47:59.299 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:47:59.299 DEBUG:teuthology.orchestra.run.smithi161:> return f 2021-06-25T04:47:59.300 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:47:59.300 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:47:59.301 DEBUG:teuthology.orchestra.run.smithi161:> print(find_socket("client.1")) 2021-06-25T04:47:59.301 DEBUG:teuthology.orchestra.run.smithi161:> ' 2021-06-25T04:47:59.344 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.14354.asok 2021-06-25T04:47:59.349 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14354.asok 2021-06-25T04:47:59.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:59.350 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14354.asok status 2021-06-25T04:47:59.506 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2021-06-25T04:47:59.506 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2021-06-25T04:47:59.507 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:47:59.507 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:47:59.507 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2021-06-25T04:47:59.507 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2021-06-25T04:47:59.508 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-06-25T04:47:59.508 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "14354", 2021-06-25T04:47:59.508 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2021-06-25T04:47:59.508 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:47:59.508 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2021-06-25T04:47:59.509 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2021-06-25T04:47:59.509 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4523, 2021-06-25T04:47:59.509 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2021-06-25T04:47:59.509 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2021-06-25T04:47:59.510 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2021-06-25T04:47:59.510 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 4523 2021-06-25T04:47:59.510 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:47:59.510 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:47:59.511 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:47:59.511 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:47:59.511 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 2169607864 2021-06-25T04:47:59.511 INFO:teuthology.orchestra.run.smithi161.stdout: } 2021-06-25T04:47:59.511 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:47:59.512 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:47:59.512 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:47:59.512 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:47:59.512 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 2169607864 2021-06-25T04:47:59.513 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:47:59.513 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.4523 172.21.15.161:0/2169607864", 2021-06-25T04:47:59.513 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "172.21.15.161:0/2169607864", 2021-06-25T04:47:59.515 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2021-06-25T04:47:59.515 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 7, 2021-06-25T04:47:59.515 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 25, 2021-06-25T04:47:59.515 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:47:59.516 INFO:teuthology.orchestra.run.smithi161.stdout: "blacklisted": false, 2021-06-25T04:47:59.516 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2021-06-25T04:47:59.516 INFO:teuthology.orchestra.run.smithi161.stdout:} 2021-06-25T04:47:59.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:59.518 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:47:59.518 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:47:59.527 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:47:59.528 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:47:59.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:59.529 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:47:59.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:59.548 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:47:59.548 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:47:59.557 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:47:59.558 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:47:59.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:47:59.559 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:47:59.584 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2021-06-25T04:47:59.602 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:47:59.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.703+0000 7f61817cd700 1 Processor -- start 2021-06-25T04:47:59.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.703+0000 7f61817cd700 1 -- start start 2021-06-25T04:47:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f61817cd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f617c0b52c0 0x7f617c13e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f61817cd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c0aeee0 con 0x7f617c0b1420 2021-06-25T04:47:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f61817cd700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c0ac2c0 con 0x7f617c13e560 2021-06-25T04:47:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f61817cd700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c0af110 con 0x7f617c0b52c0 2021-06-25T04:47:59.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f617c0b1420 0x7f617c141000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53048/0 (socket says 172.21.15.57:53048) 2021-06-25T04:47:59.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617b7fe700 1 -- 172.21.15.57:0/3714774815 learned_addr learned my addr 172.21.15.57:0/3714774815 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:59.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617bfff700 1 --2- 172.21.15.57:0/3714774815 >> v2:172.21.15.87:3300/0 conn(0x7f617c0b52c0 0x7f617c13e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:59.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617affd700 1 -- 172.21.15.57:0/3714774815 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695222435 0 0) 0x7f617c0aeee0 con 0x7f617c0b1420 2021-06-25T04:47:59.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617affd700 1 -- 172.21.15.57:0/3714774815 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6168003260 con 0x7f617c0b1420 2021-06-25T04:47:59.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617bfff700 1 -- 172.21.15.57:0/3714774815 >> v1:172.21.15.87:6789/0 conn(0x7f617c13e560 legacy=0x7f617c141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:59.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617bfff700 1 -- 172.21.15.57:0/3714774815 >> v1:172.21.15.57:6789/0 conn(0x7f617c0b1420 legacy=0x7f617c141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:59.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617bfff700 1 -- 172.21.15.57:0/3714774815 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c0af3b0 con 0x7f617c0b52c0 2021-06-25T04:47:59.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617bfff700 1 --2- 172.21.15.57:0/3714774815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f617c0b52c0 0x7f617c13e070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f6170002f70 tx=0x7f6170006df0).ready entity=mon.1 client_cookie=30a8aba9e09a525a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:59.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617affd700 1 -- 172.21.15.57:0/3714774815 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f617000d610 con 0x7f617c0b52c0 2021-06-25T04:47:59.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617affd700 1 -- 172.21.15.57:0/3714774815 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6170000e90 con 0x7f617c0b52c0 2021-06-25T04:47:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f617affd700 1 -- 172.21.15.57:0/3714774815 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f617000d960 con 0x7f617c0b52c0 2021-06-25T04:47:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f61817cd700 1 -- 172.21.15.57:0/3714774815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f617c0b52c0 msgr2=0x7f617c13e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f61817cd700 1 --2- 172.21.15.57:0/3714774815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f617c0b52c0 0x7f617c13e070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f6170002f70 tx=0x7f6170006df0).stop 2021-06-25T04:47:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f61817cd700 1 -- 172.21.15.57:0/3714774815 shutdown_connections 2021-06-25T04:47:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f61817cd700 1 --2- 172.21.15.57:0/3714774815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f617c0b52c0 0x7f617c13e070 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f61817cd700 1 -- 172.21.15.57:0/3714774815 >> 172.21.15.57:0/3714774815 conn(0x7f617c062520 msgr2=0x7f617c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f61817cd700 1 -- 172.21.15.57:0/3714774815 shutdown_connections 2021-06-25T04:47:59.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.707+0000 7f61817cd700 1 -- 172.21.15.57:0/3714774815 wait complete. 2021-06-25T04:47:59.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f61817cd700 1 Processor -- start 2021-06-25T04:47:59.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f61817cd700 1 -- start start 2021-06-25T04:47:59.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f61817cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f617c0b1420 0x7f617c066cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:59.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f61817cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617c0b52c0 0x7f617c144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:59.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f61817cd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f617c13e560 0x7f617c0aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:59.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f61817cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c1437d0 con 0x7f617c0b52c0 2021-06-25T04:47:59.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f61817cd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c066370 con 0x7f617c0b1420 2021-06-25T04:47:59.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f61817cd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c13ff60 con 0x7f617c13e560 2021-06-25T04:47:59.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f617b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617c0b52c0 0x7f617c144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:59.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f617b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617c0b52c0 0x7f617c144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35838/0 (socket says 172.21.15.57:35838) 2021-06-25T04:47:59.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f617b7fe700 1 -- 172.21.15.57:0/2035060011 learned_addr learned my addr 172.21.15.57:0/2035060011 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:47:59.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f617bfff700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f617c0b1420 0x7f617c066cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:59.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.711+0000 7f6180fcc700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f617c13e560 0x7f617c0aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:59.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f617b7fe700 1 -- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f617c13e560 msgr2=0x7f617c0aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:59.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f617b7fe700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f617c13e560 0x7f617c0aaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:59.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f617b7fe700 1 -- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f617c0b1420 msgr2=0x7f617c066cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:59.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f617b7fe700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f617c0b1420 0x7f617c066cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:59.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f617b7fe700 1 -- 172.21.15.57:0/2035060011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617000b180 con 0x7f617c0b52c0 2021-06-25T04:47:59.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f617bfff700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f617c0b1420 0x7f617c066cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:47:59.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f617b7fe700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617c0b52c0 0x7f617c144b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f616c001110 tx=0x7f616c007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:59.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f61797fa700 1 -- 172.21.15.57:0/2035060011 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f616c0070d0 con 0x7f617c0b52c0 2021-06-25T04:47:59.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f61797fa700 1 -- 172.21.15.57:0/2035060011 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c007230 con 0x7f617c0b52c0 2021-06-25T04:47:59.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f61817cd700 1 -- 172.21.15.57:0/2035060011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c1501e0 con 0x7f617c0b52c0 2021-06-25T04:47:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f61797fa700 1 -- 172.21.15.57:0/2035060011 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f616c005610 con 0x7f617c0b52c0 2021-06-25T04:47:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f61817cd700 1 -- 172.21.15.57:0/2035060011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c09e870 con 0x7f617c0b52c0 2021-06-25T04:47:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f61817cd700 1 -- 172.21.15.57:0/2035060011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c13fdc0 con 0x7f617c0b52c0 2021-06-25T04:47:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f61797fa700 1 -- 172.21.15.57:0/2035060011 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f616c010070 con 0x7f617c0b52c0 2021-06-25T04:47:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f61797fa700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f615c055510 0x7f615c0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.715+0000 7f61797fa700 1 -- 172.21.15.57:0/2035060011 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f616c06d4d0 con 0x7f617c0b52c0 2021-06-25T04:47:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.719+0000 7f617bfff700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f615c055510 0x7f615c0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.719+0000 7f617bfff700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f615c055510 0x7f615c0579d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6170019000 tx=0x7f6170014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.723+0000 7f61797fa700 1 -- 172.21.15.57:0/2035060011 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f617c13fdc0 con 0x7f617c0b52c0 2021-06-25T04:47:59.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.851+0000 7f61817cd700 1 -- 172.21.15.57:0/2035060011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f617c13fdc0 con 0x7f617c0b52c0 2021-06-25T04:47:59.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61797fa700 1 -- 172.21.15.57:0/2035060011 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f617c13fdc0 con 0x7f617c0b52c0 2021-06-25T04:47:59.863 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:47:59.863 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:41.021834+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:47:59.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 -- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f615c055510 msgr2=0x7f615c0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:59.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f615c055510 0x7f615c0579d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6170019000 tx=0x7f6170014000).stop 2021-06-25T04:47:59.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 -- 172.21.15.57:0/2035060011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617c0b52c0 msgr2=0x7f617c144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:59.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617c0b52c0 0x7f617c144b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f616c001110 tx=0x7f616c007ad0).stop 2021-06-25T04:47:59.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 -- 172.21.15.57:0/2035060011 shutdown_connections 2021-06-25T04:47:59.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f615c055510 0x7f615c0579d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:59.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f617c13e560 0x7f617c0aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:59.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617c0b52c0 0x7f617c144b80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:59.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 --2- 172.21.15.57:0/2035060011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f617c0b1420 0x7f617c066cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:59.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 -- 172.21.15.57:0/2035060011 >> 172.21.15.57:0/2035060011 conn(0x7f617c062520 msgr2=0x7f617c0b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:59.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 -- 172.21.15.57:0/2035060011 shutdown_connections 2021-06-25T04:47:59.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.855+0000 7f61817cd700 1 -- 172.21.15.57:0/2035060011 wait complete. 2021-06-25T04:47:59.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:47:34.957337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:47:37.729999+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:47:59.878 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:47:59.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.979+0000 7fc2234c2700 1 Processor -- start 2021-06-25T04:47:59.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.979+0000 7fc2234c2700 1 -- start start 2021-06-25T04:47:59.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc21c14b780 0x7fc21c14db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:47:59.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c0b5f10 con 0x7fc21c0b4020 2021-06-25T04:47:59.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c0b1f30 con 0x7fc21c0b6250 2021-06-25T04:47:59.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c0b21d0 con 0x7fc21c14b780 2021-06-25T04:47:59.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc222cc1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc21c14b780 0x7fc21c14db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:47:59.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc221cbf700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc21c0b4020 0x7fc21c061b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53064/0 (socket says 172.21.15.57:53064) 2021-06-25T04:47:59.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc222cc1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc21c14b780 0x7fc21c14db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35848/0 (socket says 172.21.15.57:35848) 2021-06-25T04:47:59.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc221cbf700 1 -- 172.21.15.57:0/2432626818 learned_addr learned my addr 172.21.15.57:0/2432626818 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:47:59.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc222cc1700 1 -- 172.21.15.57:0/2432626818 >> v1:172.21.15.87:6789/0 conn(0x7fc21c0b6250 legacy=0x7fc21c061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:59.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc222cc1700 1 -- 172.21.15.57:0/2432626818 >> v1:172.21.15.57:6789/0 conn(0x7fc21c0b4020 legacy=0x7fc21c061b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:59.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc222cc1700 1 -- 172.21.15.57:0/2432626818 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0b2470 con 0x7fc21c14b780 2021-06-25T04:47:59.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc222cc1700 1 --2- 172.21.15.57:0/2432626818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc21c14b780 0x7fc21c14db70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc20c0032f0 tx=0x7fc20c0091d0).ready entity=mon.0 client_cookie=baec0f8ed4357943 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:47:59.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2214be700 1 -- 172.21.15.57:0/2432626818 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20c009ea0 con 0x7fc21c14b780 2021-06-25T04:47:59.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2214be700 1 -- 172.21.15.57:0/2432626818 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00b8a0 con 0x7fc21c14b780 2021-06-25T04:47:59.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2214be700 1 -- 172.21.15.57:0/2432626818 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20c00ba10 con 0x7fc21c14b780 2021-06-25T04:47:59.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 -- 172.21.15.57:0/2432626818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc21c14b780 msgr2=0x7fc21c14db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:47:59.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 --2- 172.21.15.57:0/2432626818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc21c14b780 0x7fc21c14db70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc20c0032f0 tx=0x7fc20c0091d0).stop 2021-06-25T04:47:59.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 -- 172.21.15.57:0/2432626818 shutdown_connections 2021-06-25T04:47:59.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 --2- 172.21.15.57:0/2432626818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc21c14b780 0x7fc21c14db70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:47:59.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 -- 172.21.15.57:0/2432626818 >> 172.21.15.57:0/2432626818 conn(0x7fc21c05c450 msgr2=0x7fc21c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:47:59.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 -- 172.21.15.57:0/2432626818 shutdown_connections 2021-06-25T04:47:59.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 -- 172.21.15.57:0/2432626818 wait complete. 2021-06-25T04:48:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.983+0000 7fc2234c2700 1 Processor -- start 2021-06-25T04:48:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2234c2700 1 -- start start 2021-06-25T04:48:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2234c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc21c0b4020 0x7fc21c142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2234c2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc21c0b6250 0x7fc21c1400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2234c2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc21c14b780 0x7fc21c140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2234c2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c14adb0 con 0x7fc21c0b4020 2021-06-25T04:48:00.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2234c2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c140a80 con 0x7fc21c0b6250 2021-06-25T04:48:00.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2234c2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c13d6b0 con 0x7fc21c14b780 2021-06-25T04:48:00.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2224c0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc21c0b4020 0x7fc21c142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc221cbf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc21c0b6250 0x7fc21c1400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc222cc1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc21c14b780 0x7fc21c140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc221cbf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc21c0b6250 0x7fc21c1400a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:44344/0 (socket says 172.21.15.57:44344) 2021-06-25T04:48:00.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc221cbf700 1 -- 172.21.15.57:0/1894755007 learned_addr learned my addr 172.21.15.57:0/1894755007 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:00.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2224c0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc21c0b4020 0x7fc21c142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35852/0 (socket says 172.21.15.57:35852) 2021-06-25T04:48:00.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2224c0700 1 -- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc21c14b780 msgr2=0x7fc21c140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2224c0700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc21c14b780 0x7fc21c140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2224c0700 1 -- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc21c0b6250 msgr2=0x7fc21c1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2224c0700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc21c0b6250 0x7fc21c1400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2224c0700 1 -- 172.21.15.57:0/1894755007 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c009470 con 0x7fc21c0b4020 2021-06-25T04:48:00.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc221cbf700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc21c0b6250 0x7fc21c1400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:00.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2224c0700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc21c0b4020 0x7fc21c142660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc21c060150 tx=0x7fc214007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:00.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc21b7fe700 1 -- 172.21.15.57:0/1894755007 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc214012400 con 0x7fc21c0b4020 2021-06-25T04:48:00.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc21b7fe700 1 -- 172.21.15.57:0/1894755007 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc214012560 con 0x7fc21c0b4020 2021-06-25T04:48:00.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc21b7fe700 1 -- 172.21.15.57:0/1894755007 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2140128c0 con 0x7fc21c0b4020 2021-06-25T04:48:00.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2234c2700 1 -- 172.21.15.57:0/1894755007 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c13fc00 con 0x7fc21c0b4020 2021-06-25T04:48:00.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.987+0000 7fc2234c2700 1 -- 172.21.15.57:0/1894755007 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c14aa30 con 0x7fc21c0b4020 2021-06-25T04:48:00.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.991+0000 7fc2234c2700 1 -- 172.21.15.57:0/1894755007 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c0aef00 con 0x7fc21c0b4020 2021-06-25T04:48:00.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.991+0000 7fc21b7fe700 1 -- 172.21.15.57:0/1894755007 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc214019030 con 0x7fc21c0b4020 2021-06-25T04:48:00.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.991+0000 7fc21b7fe700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc1fc055450 0x7fc1fc057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.991+0000 7fc21b7fe700 1 -- 172.21.15.57:0/1894755007 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc21406d290 con 0x7fc21c0b4020 2021-06-25T04:48:00.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.991+0000 7fc221cbf700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc1fc055450 0x7fc1fc057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.991+0000 7fc221cbf700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc1fc055450 0x7fc1fc057910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc21000d000 tx=0x7fc210009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:00.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:47:59.999+0000 7fc21b7fe700 1 -- 172.21.15.57:0/1894755007 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc214043330 con 0x7fc21c0b4020 2021-06-25T04:48:00.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.127+0000 7fc2234c2700 1 -- 172.21.15.57:0/1894755007 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc21c057310 con 0x7fc21c0b4020 2021-06-25T04:48:00.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.127+0000 7fc21b7fe700 1 -- 172.21.15.57:0/1894755007 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc214046950 con 0x7fc21c0b4020 2021-06-25T04:48:00.137 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:48:00.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 -- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc1fc055450 msgr2=0x7fc1fc057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc1fc055450 0x7fc1fc057910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc21000d000 tx=0x7fc210009040).stop 2021-06-25T04:48:00.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 -- 172.21.15.57:0/1894755007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc21c0b4020 msgr2=0x7fc21c142660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc21c0b4020 0x7fc21c142660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc21c060150 tx=0x7fc214007b90).stop 2021-06-25T04:48:00.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 -- 172.21.15.57:0/1894755007 shutdown_connections 2021-06-25T04:48:00.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc1fc055450 0x7fc1fc057910 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc21c14b780 0x7fc21c140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc21c0b6250 0x7fc21c1400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 --2- 172.21.15.57:0/1894755007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc21c0b4020 0x7fc21c142660 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 -- 172.21.15.57:0/1894755007 >> 172.21.15.57:0/1894755007 conn(0x7fc21c05c450 msgr2=0x7fc21c0b7560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:00.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 -- 172.21.15.57:0/1894755007 shutdown_connections 2021-06-25T04:48:00.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.131+0000 7fc2234c2700 1 -- 172.21.15.57:0/1894755007 wait complete. 2021-06-25T04:48:00.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:48:00.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.247+0000 7f8d11cc2700 1 Processor -- start 2021-06-25T04:48:00.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.247+0000 7f8d11cc2700 1 -- start start 2021-06-25T04:48:00.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.247+0000 7f8d11cc2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d0c0a8a80 0x7f8d0c152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.247+0000 7f8d11cc2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0c0a7080 con 0x7f8d0c0affd0 2021-06-25T04:48:00.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.247+0000 7f8d11cc2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0c0a72b0 con 0x7f8d0c0b2540 2021-06-25T04:48:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.247+0000 7f8d11cc2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c0a7550 con 0x7f8d0c0a8a80 2021-06-25T04:48:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.247+0000 7f8d0bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8d0c0affd0 0x7f8d0c0a8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53080/0 (socket says 172.21.15.57:53080) 2021-06-25T04:48:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.247+0000 7f8d0bfff700 1 -- 172.21.15.57:0/3539282496 learned_addr learned my addr 172.21.15.57:0/3539282496 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.247+0000 7f8d114c1700 1 --2- 172.21.15.57:0/3539282496 >> v2:172.21.15.87:3300/0 conn(0x7f8d0c0a8a80 0x7f8d0c152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d0b7fe700 1 -- 172.21.15.57:0/3539282496 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851335022 0 0) 0x7f8d0c0a7080 con 0x7f8d0c0affd0 2021-06-25T04:48:00.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d0b7fe700 1 -- 172.21.15.57:0/3539282496 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cec003260 con 0x7f8d0c0affd0 2021-06-25T04:48:00.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d0b7fe700 1 -- 172.21.15.57:0/3539282496 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812142365 0 0) 0x7f8d0c0a72b0 con 0x7f8d0c0b2540 2021-06-25T04:48:00.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d0b7fe700 1 -- 172.21.15.57:0/3539282496 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d0c0a7080 con 0x7f8d0c0b2540 2021-06-25T04:48:00.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d114c1700 1 -- 172.21.15.57:0/3539282496 >> v1:172.21.15.87:6789/0 conn(0x7f8d0c0b2540 legacy=0x7f8d0c14ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d114c1700 1 -- 172.21.15.57:0/3539282496 >> v1:172.21.15.57:6789/0 conn(0x7f8d0c0affd0 legacy=0x7f8d0c0a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d114c1700 1 -- 172.21.15.57:0/3539282496 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0a77f0 con 0x7f8d0c0a8a80 2021-06-25T04:48:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d114c1700 1 --2- 172.21.15.57:0/3539282496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d0c0a8a80 0x7f8d0c152ba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8d040032f0 tx=0x7f8d040091d0).ready entity=mon.1 client_cookie=3ae148f6cd763c18 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d0b7fe700 1 -- 172.21.15.57:0/3539282496 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d0400b600 con 0x7f8d0c0a8a80 2021-06-25T04:48:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d0b7fe700 1 -- 172.21.15.57:0/3539282496 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0400b760 con 0x7f8d0c0a8a80 2021-06-25T04:48:00.264 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d0b7fe700 1 -- 172.21.15.57:0/3539282496 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d0400b8d0 con 0x7f8d0c0a8a80 2021-06-25T04:48:00.264 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d11cc2700 1 -- 172.21.15.57:0/3539282496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d0c0a8a80 msgr2=0x7f8d0c152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d11cc2700 1 --2- 172.21.15.57:0/3539282496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d0c0a8a80 0x7f8d0c152ba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8d040032f0 tx=0x7f8d040091d0).stop 2021-06-25T04:48:00.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d11cc2700 1 -- 172.21.15.57:0/3539282496 shutdown_connections 2021-06-25T04:48:00.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d11cc2700 1 --2- 172.21.15.57:0/3539282496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d0c0a8a80 0x7f8d0c152ba0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d11cc2700 1 -- 172.21.15.57:0/3539282496 >> 172.21.15.57:0/3539282496 conn(0x7f8d0c060140 msgr2=0x7f8d0c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:00.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d11cc2700 1 -- 172.21.15.57:0/3539282496 shutdown_connections 2021-06-25T04:48:00.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d11cc2700 1 -- 172.21.15.57:0/3539282496 wait complete. 2021-06-25T04:48:00.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d11cc2700 1 Processor -- start 2021-06-25T04:48:00.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.251+0000 7f8d11cc2700 1 -- start start 2021-06-25T04:48:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d11cc2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d0c0a8a80 0x7f8d0c0ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d11cc2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d0c0affd0 0x7f8d0c0a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d11cc2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d0c0b2540 0x7f8d0c0a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d11cc2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c156d50 con 0x7f8d0c0affd0 2021-06-25T04:48:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d11cc2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0b5350 con 0x7f8d0c0a8a80 2021-06-25T04:48:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d11cc2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0630d0 con 0x7f8d0c0b2540 2021-06-25T04:48:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d0bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d0c0affd0 0x7f8d0c0a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d114c1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d0c0b2540 0x7f8d0c0a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d10cc0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d0c0a8a80 0x7f8d0c0ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d0bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d0c0affd0 0x7f8d0c0a92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35868/0 (socket says 172.21.15.57:35868) 2021-06-25T04:48:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d114c1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d0c0b2540 0x7f8d0c0a9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:47030/0 (socket says 172.21.15.57:47030) 2021-06-25T04:48:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d10cc0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d0c0a8a80 0x7f8d0c0ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:44358/0 (socket says 172.21.15.57:44358) 2021-06-25T04:48:00.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d0bfff700 1 -- 172.21.15.57:0/2471424876 learned_addr learned my addr 172.21.15.57:0/2471424876 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:00.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d0bfff700 1 -- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d0c0b2540 msgr2=0x7f8d0c0a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d0bfff700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d0c0b2540 0x7f8d0c0a9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d0bfff700 1 -- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d0c0a8a80 msgr2=0x7f8d0c0ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d0bfff700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d0c0a8a80 0x7f8d0c0ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d0bfff700 1 -- 172.21.15.57:0/2471424876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d04009470 con 0x7f8d0c0affd0 2021-06-25T04:48:00.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d0bfff700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d0c0affd0 0x7f8d0c0a92a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8cf4001110 tx=0x7f8cf4007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:00.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d09ffb700 1 -- 172.21.15.57:0/2471424876 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf400ce80 con 0x7f8d0c0affd0 2021-06-25T04:48:00.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d11cc2700 1 -- 172.21.15.57:0/2471424876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0c156f80 con 0x7f8d0c0affd0 2021-06-25T04:48:00.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d09ffb700 1 -- 172.21.15.57:0/2471424876 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf40070d0 con 0x7f8d0c0affd0 2021-06-25T04:48:00.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d09ffb700 1 -- 172.21.15.57:0/2471424876 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf4007430 con 0x7f8d0c0affd0 2021-06-25T04:48:00.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d11cc2700 1 -- 172.21.15.57:0/2471424876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0c063370 con 0x7f8d0c0affd0 2021-06-25T04:48:00.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.255+0000 7f8d11cc2700 1 -- 172.21.15.57:0/2471424876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0c157110 con 0x7f8d0c0affd0 2021-06-25T04:48:00.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.259+0000 7f8d09ffb700 1 -- 172.21.15.57:0/2471424876 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8cf4010070 con 0x7f8d0c0affd0 2021-06-25T04:48:00.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.259+0000 7f8d09ffb700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cf00554e0 0x7f8cf00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.259+0000 7f8d09ffb700 1 -- 172.21.15.57:0/2471424876 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8cf406d4a0 con 0x7f8d0c0affd0 2021-06-25T04:48:00.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.259+0000 7f8d10cc0700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cf00554e0 0x7f8cf00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.259+0000 7f8d10cc0700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cf00554e0 0x7f8cf00579a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8cfc00d000 tx=0x7f8cfc007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:00.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.263+0000 7f8d09ffb700 1 -- 172.21.15.57:0/2471424876 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8cf40435b0 con 0x7f8d0c0affd0 2021-06-25T04:48:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.391+0000 7f8d11cc2700 1 -- 172.21.15.57:0/2471424876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8d0c057310 con 0x7f8d0c0affd0 2021-06-25T04:48:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.391+0000 7f8d09ffb700 1 -- 172.21.15.57:0/2471424876 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8cf4018070 con 0x7f8d0c0affd0 2021-06-25T04:48:00.400 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:00.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 -- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cf00554e0 msgr2=0x7f8cf00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cf00554e0 0x7f8cf00579a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8cfc00d000 tx=0x7f8cfc007a20).stop 2021-06-25T04:48:00.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 -- 172.21.15.57:0/2471424876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d0c0affd0 msgr2=0x7f8d0c0a92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d0c0affd0 0x7f8d0c0a92a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8cf4001110 tx=0x7f8cf4007a80).stop 2021-06-25T04:48:00.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 -- 172.21.15.57:0/2471424876 shutdown_connections 2021-06-25T04:48:00.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cf00554e0 0x7f8cf00579a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d0c0b2540 0x7f8d0c0a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d0c0affd0 0x7f8d0c0a92a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 --2- 172.21.15.57:0/2471424876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d0c0a8a80 0x7f8d0c0ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 -- 172.21.15.57:0/2471424876 >> 172.21.15.57:0/2471424876 conn(0x7f8d0c060140 msgr2=0x7f8d0c05bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 -- 172.21.15.57:0/2471424876 shutdown_connections 2021-06-25T04:48:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.395+0000 7f8d11cc2700 1 -- 172.21.15.57:0/2471424876 wait complete. 2021-06-25T04:48:00.413 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:48:00.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.511+0000 7fa90502c700 1 Processor -- start 2021-06-25T04:48:00.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.511+0000 7fa90502c700 1 -- start start 2021-06-25T04:48:00.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.511+0000 7fa90502c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa9000b1e80 0x7fa9000b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.511+0000 7fa90502c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9000b03e0 con 0x7fa9000aff70 2021-06-25T04:48:00.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.511+0000 7fa90502c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9000a7790 con 0x7fa9000b2260 2021-06-25T04:48:00.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.511+0000 7fa90502c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9000b0610 con 0x7fa9000b1e80 2021-06-25T04:48:00.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.511+0000 7fa8fe59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa9000aff70 0x7fa9000a7080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53090/0 (socket says 172.21.15.57:53090) 2021-06-25T04:48:00.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.511+0000 7fa8fe59c700 1 -- 172.21.15.57:0/3016009657 learned_addr learned my addr 172.21.15.57:0/3016009657 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:00.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.511+0000 7fa8fed9d700 1 --2- 172.21.15.57:0/3016009657 >> v2:172.21.15.57:3300/0 conn(0x7fa9000b1e80 0x7fa9000b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa8fdd9b700 1 -- 172.21.15.57:0/3016009657 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376051909 0 0) 0x7fa9000b03e0 con 0x7fa9000aff70 2021-06-25T04:48:00.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa8fdd9b700 1 -- 172.21.15.57:0/3016009657 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e4003260 con 0x7fa9000aff70 2021-06-25T04:48:00.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa8fdd9b700 1 -- 172.21.15.57:0/3016009657 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021455008 0 0) 0x7fa9000a7790 con 0x7fa9000b2260 2021-06-25T04:48:00.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa8fed9d700 1 -- 172.21.15.57:0/3016009657 >> v1:172.21.15.87:6789/0 conn(0x7fa9000b2260 legacy=0x7fa900141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa8fed9d700 1 -- 172.21.15.57:0/3016009657 >> v1:172.21.15.57:6789/0 conn(0x7fa9000aff70 legacy=0x7fa9000a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa8fed9d700 1 -- 172.21.15.57:0/3016009657 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9000b08b0 con 0x7fa9000b1e80 2021-06-25T04:48:00.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa8fed9d700 1 --2- 172.21.15.57:0/3016009657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9000b1e80 0x7fa9000b1290 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fa8f0001b80 tx=0x7fa8f4006df0).ready entity=mon.0 client_cookie=6fa273d5663d76f8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:00.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa8fdd9b700 1 -- 172.21.15.57:0/3016009657 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f00019e0 con 0x7fa9000b1e80 2021-06-25T04:48:00.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa8fdd9b700 1 -- 172.21.15.57:0/3016009657 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4000e90 con 0x7fa9000b1e80 2021-06-25T04:48:00.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa8fdd9b700 1 -- 172.21.15.57:0/3016009657 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f4011400 con 0x7fa9000b1e80 2021-06-25T04:48:00.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa90502c700 1 -- 172.21.15.57:0/3016009657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9000b1e80 msgr2=0x7fa9000b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa90502c700 1 --2- 172.21.15.57:0/3016009657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9000b1e80 0x7fa9000b1290 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fa8f0001b80 tx=0x7fa8f4006df0).stop 2021-06-25T04:48:00.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa90502c700 1 -- 172.21.15.57:0/3016009657 shutdown_connections 2021-06-25T04:48:00.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa90502c700 1 --2- 172.21.15.57:0/3016009657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9000b1e80 0x7fa9000b1290 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa90502c700 1 -- 172.21.15.57:0/3016009657 >> 172.21.15.57:0/3016009657 conn(0x7fa90005f670 msgr2=0x7fa90005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:00.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa90502c700 1 -- 172.21.15.57:0/3016009657 shutdown_connections 2021-06-25T04:48:00.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa90502c700 1 -- 172.21.15.57:0/3016009657 wait complete. 2021-06-25T04:48:00.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa90502c700 1 Processor -- start 2021-06-25T04:48:00.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.515+0000 7fa90502c700 1 -- start start 2021-06-25T04:48:00.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa90502c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9000aff70 0x7fa9000b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa90502c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9000b1e80 0x7fa9000aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa90502c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9000b2260 0x7fa90015a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa90502c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000abae0 con 0x7fa9000b1e80 2021-06-25T04:48:00.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa90502c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90014b700 con 0x7fa9000b2260 2021-06-25T04:48:00.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa90502c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000abd10 con 0x7fa9000aff70 2021-06-25T04:48:00.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8fe59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9000b1e80 0x7fa9000aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8fe59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9000b1e80 0x7fa9000aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35878/0 (socket says 172.21.15.57:35878) 2021-06-25T04:48:00.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8fe59c700 1 -- 172.21.15.57:0/712061331 learned_addr learned my addr 172.21.15.57:0/712061331 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:00.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8ff59e700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9000b2260 0x7fa90015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8fed9d700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9000aff70 0x7fa9000b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8fe59c700 1 -- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9000aff70 msgr2=0x7fa9000b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8fe59c700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9000aff70 0x7fa9000b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8fe59c700 1 -- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9000b2260 msgr2=0x7fa90015a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8fe59c700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9000b2260 0x7fa90015a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8fe59c700 1 -- 172.21.15.57:0/712061331 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f400b180 con 0x7fa9000b1e80 2021-06-25T04:48:00.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8fe59c700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9000b1e80 0x7fa9000aa370 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fa8f0001550 tx=0x7fa8f0001e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:00.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8effff700 1 -- 172.21.15.57:0/712061331 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f00020d0 con 0x7fa9000b1e80 2021-06-25T04:48:00.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8effff700 1 -- 172.21.15.57:0/712061331 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f0004ab0 con 0x7fa9000b1e80 2021-06-25T04:48:00.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa8effff700 1 -- 172.21.15.57:0/712061331 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f0004e10 con 0x7fa9000b1e80 2021-06-25T04:48:00.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa90502c700 1 -- 172.21.15.57:0/712061331 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9000abfb0 con 0x7fa9000b1e80 2021-06-25T04:48:00.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa90502c700 1 -- 172.21.15.57:0/712061331 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90014b9a0 con 0x7fa9000b1e80 2021-06-25T04:48:00.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.519+0000 7fa90502c700 1 -- 172.21.15.57:0/712061331 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9000aa860 con 0x7fa9000b1e80 2021-06-25T04:48:00.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.523+0000 7fa8effff700 1 -- 172.21.15.57:0/712061331 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa8f0010070 con 0x7fa9000b1e80 2021-06-25T04:48:00.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.523+0000 7fa8effff700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa8dc055490 0x7fa8dc057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.523+0000 7fa8effff700 1 -- 172.21.15.57:0/712061331 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa8f006dbc0 con 0x7fa9000b1e80 2021-06-25T04:48:00.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.523+0000 7fa8fed9d700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa8dc055490 0x7fa8dc057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.523+0000 7fa8fed9d700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa8dc055490 0x7fa8dc057950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa8f4018000 tx=0x7fa9000b0a40).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:00.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.527+0000 7fa8effff700 1 -- 172.21.15.57:0/712061331 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa8f0043c60 con 0x7fa9000b1e80 2021-06-25T04:48:00.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.651+0000 7fa90502c700 1 -- 172.21.15.57:0/712061331 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa9000ab6e0 con 0x7fa9000b1e80 2021-06-25T04:48:00.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa8effff700 1 -- 172.21.15.57:0/712061331 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa8f0019070 con 0x7fa9000b1e80 2021-06-25T04:48:00.662 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:00.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 -- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa8dc055490 msgr2=0x7fa8dc057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa8dc055490 0x7fa8dc057950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa8f4018000 tx=0x7fa9000b0a40).stop 2021-06-25T04:48:00.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 -- 172.21.15.57:0/712061331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9000b1e80 msgr2=0x7fa9000aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9000b1e80 0x7fa9000aa370 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fa8f0001550 tx=0x7fa8f0001e60).stop 2021-06-25T04:48:00.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 -- 172.21.15.57:0/712061331 shutdown_connections 2021-06-25T04:48:00.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa8dc055490 0x7fa8dc057950 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9000b2260 0x7fa90015a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9000b1e80 0x7fa9000aa370 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 --2- 172.21.15.57:0/712061331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9000aff70 0x7fa9000b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 -- 172.21.15.57:0/712061331 >> 172.21.15.57:0/712061331 conn(0x7fa90005f670 msgr2=0x7fa900147f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:00.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 -- 172.21.15.57:0/712061331 shutdown_connections 2021-06-25T04:48:00.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.655+0000 7fa90502c700 1 -- 172.21.15.57:0/712061331 wait complete. 2021-06-25T04:48:00.678 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:48:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f231b59e700 1 Processor -- start 2021-06-25T04:48:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f231b59e700 1 -- start start 2021-06-25T04:48:00.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f231b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f231c0ad580 0x7f231c0616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f231b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c0aecb0 con 0x7f231c0612e0 2021-06-25T04:48:00.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f231b59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c0b6ee0 con 0x7f231c140400 2021-06-25T04:48:00.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f231b59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c0aeee0 con 0x7f231c0ad580 2021-06-25T04:48:00.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f2319d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f231c0ad580 0x7f231c0616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f2319d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f231c0ad580 0x7f231c0616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35888/0 (socket says 172.21.15.57:35888) 2021-06-25T04:48:00.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f2319d9b700 1 -- 172.21.15.57:0/3169852071 learned_addr learned my addr 172.21.15.57:0/3169852071 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:00.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f231a59c700 1 --1- 172.21.15.57:0/3169852071 >> v1:172.21.15.57:6789/0 conn(0x7f231c0612e0 0x7f231c0b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53104/0 (socket says 172.21.15.57:53104) 2021-06-25T04:48:00.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f2319d9b700 1 -- 172.21.15.57:0/3169852071 >> v1:172.21.15.87:6789/0 conn(0x7f231c140400 legacy=0x7f231c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:00.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f2319d9b700 1 -- 172.21.15.57:0/3169852071 >> v1:172.21.15.57:6789/0 conn(0x7f231c0612e0 legacy=0x7f231c0b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f2319d9b700 1 -- 172.21.15.57:0/3169852071 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0af180 con 0x7f231c0ad580 2021-06-25T04:48:00.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.779+0000 7f2319d9b700 1 --2- 172.21.15.57:0/3169852071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f231c0ad580 0x7f231c0616c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f231c0af7a0 tx=0x7f2308006eb0).ready entity=mon.0 client_cookie=92ed6be1f6d97fe server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:00.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231959a700 1 -- 172.21.15.57:0/3169852071 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230800d610 con 0x7f231c0ad580 2021-06-25T04:48:00.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231959a700 1 -- 172.21.15.57:0/3169852071 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308000e90 con 0x7f231c0ad580 2021-06-25T04:48:00.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231959a700 1 -- 172.21.15.57:0/3169852071 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230800d960 con 0x7f231c0ad580 2021-06-25T04:48:00.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231b59e700 1 -- 172.21.15.57:0/3169852071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f231c0ad580 msgr2=0x7f231c0616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231b59e700 1 --2- 172.21.15.57:0/3169852071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f231c0ad580 0x7f231c0616c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f231c0af7a0 tx=0x7f2308006eb0).stop 2021-06-25T04:48:00.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231b59e700 1 -- 172.21.15.57:0/3169852071 shutdown_connections 2021-06-25T04:48:00.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231b59e700 1 --2- 172.21.15.57:0/3169852071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f231c0ad580 0x7f231c0616c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231b59e700 1 -- 172.21.15.57:0/3169852071 >> 172.21.15.57:0/3169852071 conn(0x7f231c066da0 msgr2=0x7f231c067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231b59e700 1 -- 172.21.15.57:0/3169852071 shutdown_connections 2021-06-25T04:48:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231b59e700 1 -- 172.21.15.57:0/3169852071 wait complete. 2021-06-25T04:48:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231b59e700 1 Processor -- start 2021-06-25T04:48:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.783+0000 7f231b59e700 1 -- start start 2021-06-25T04:48:00.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c0612e0 0x7f231c153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c0ad580 0x7f231c145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f231c140400 0x7f231c1529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c0b0260 con 0x7f231c140400 2021-06-25T04:48:00.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c153550 con 0x7f231c0ad580 2021-06-25T04:48:00.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c144dc0 con 0x7f231c0612e0 2021-06-25T04:48:00.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f231c140400 0x7f231c1529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f231c140400 0x7f231c1529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35894/0 (socket says 172.21.15.57:35894) 2021-06-25T04:48:00.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231a59c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c0612e0 0x7f231c153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231ad9d700 1 -- 172.21.15.57:0/1309482679 learned_addr learned my addr 172.21.15.57:0/1309482679 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:00.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f2319d9b700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c0ad580 0x7f231c145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231ad9d700 1 -- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c0612e0 msgr2=0x7f231c153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231ad9d700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c0612e0 0x7f231c153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231ad9d700 1 -- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c0ad580 msgr2=0x7f231c145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231ad9d700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c0ad580 0x7f231c145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231ad9d700 1 -- 172.21.15.57:0/1309482679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230800b1e0 con 0x7f231c140400 2021-06-25T04:48:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231ad9d700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f231c140400 0x7f231c1529c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f231c0b0a30 tx=0x7f23140090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f23137fe700 1 -- 172.21.15.57:0/1309482679 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f231400e470 con 0x7f231c140400 2021-06-25T04:48:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f23137fe700 1 -- 172.21.15.57:0/1309482679 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231400e5d0 con 0x7f231c140400 2021-06-25T04:48:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231b59e700 1 -- 172.21.15.57:0/1309482679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c0aa8e0 con 0x7f231c140400 2021-06-25T04:48:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f23137fe700 1 -- 172.21.15.57:0/1309482679 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f231400e930 con 0x7f231c140400 2021-06-25T04:48:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.787+0000 7f231b59e700 1 -- 172.21.15.57:0/1309482679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c0aab80 con 0x7f231c140400 2021-06-25T04:48:00.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.791+0000 7f231b59e700 1 -- 172.21.15.57:0/1309482679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231c144f30 con 0x7f231c140400 2021-06-25T04:48:00.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.791+0000 7f23137fe700 1 -- 172.21.15.57:0/1309482679 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2314018030 con 0x7f231c140400 2021-06-25T04:48:00.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.791+0000 7f23137fe700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22f8055510 0x7f22f80579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:00.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.791+0000 7f23137fe700 1 -- 172.21.15.57:0/1309482679 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f231406d660 con 0x7f231c140400 2021-06-25T04:48:00.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.791+0000 7f231a59c700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22f8055510 0x7f22f80579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:00.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.791+0000 7f231a59c700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22f8055510 0x7f22f80579d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f230c00d000 tx=0x7f230c007b80).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:00.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.799+0000 7f23137fe700 1 -- 172.21.15.57:0/1309482679 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2314041c50 con 0x7f231c140400 2021-06-25T04:48:00.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.927+0000 7f231b59e700 1 -- 172.21.15.57:0/1309482679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f231c057310 con 0x7f231c140400 2021-06-25T04:48:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.927+0000 7f23137fe700 1 -- 172.21.15.57:0/1309482679 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f23140437b0 con 0x7f231c140400 2021-06-25T04:48:00.936 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:00.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 -- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22f8055510 msgr2=0x7f22f80579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22f8055510 0x7f22f80579d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f230c00d000 tx=0x7f230c007b80).stop 2021-06-25T04:48:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 -- 172.21.15.57:0/1309482679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f231c140400 msgr2=0x7f231c1529c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f231c140400 0x7f231c1529c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f231c0b0a30 tx=0x7f23140090f0).stop 2021-06-25T04:48:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 -- 172.21.15.57:0/1309482679 shutdown_connections 2021-06-25T04:48:00.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22f8055510 0x7f22f80579d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f231c140400 0x7f231c1529c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c0ad580 0x7f231c145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 --2- 172.21.15.57:0/1309482679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c0612e0 0x7f231c153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:00.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 -- 172.21.15.57:0/1309482679 >> 172.21.15.57:0/1309482679 conn(0x7f231c066da0 msgr2=0x7f231c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:00.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 -- 172.21.15.57:0/1309482679 shutdown_connections 2021-06-25T04:48:00.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:00.931+0000 7f231b59e700 1 -- 172.21.15.57:0/1309482679 wait complete. 2021-06-25T04:48:00.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:48:01.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.039+0000 7f4f20aab700 1 Processor -- start 2021-06-25T04:48:01.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.039+0000 7f4f20aab700 1 -- start start 2021-06-25T04:48:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4f1c0b96a0 0x7f4f1c0aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4f1c13ffb0 0x7f4f1c140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1c0674c0 con 0x7f4f1c0670e0 2021-06-25T04:48:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1c143040 con 0x7f4f1c13ffb0 2021-06-25T04:48:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1c0af490 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f1ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4f1c13ffb0 0x7f4f1c140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f1ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4f1c13ffb0 0x7f4f1c140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35902/0 (socket says 172.21.15.57:35902) 2021-06-25T04:48:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f1ad9d700 1 -- 172.21.15.57:0/1436568325 learned_addr learned my addr 172.21.15.57:0/1436568325 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f19d9b700 1 --2- 172.21.15.57:0/1436568325 >> v2:172.21.15.87:3300/0 conn(0x7f4f1c0b96a0 0x7f4f1c0aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f1ad9d700 1 -- 172.21.15.57:0/1436568325 >> v2:172.21.15.87:3300/0 conn(0x7f4f1c0b96a0 msgr2=0x7f4f1c0aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:01.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f1ad9d700 1 --2- 172.21.15.57:0/1436568325 >> v2:172.21.15.87:3300/0 conn(0x7f4f1c0b96a0 0x7f4f1c0aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f1ad9d700 1 -- 172.21.15.57:0/1436568325 >> v1:172.21.15.87:6789/0 conn(0x7f4f1c0670e0 legacy=0x7f4f1c143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f1ad9d700 1 -- 172.21.15.57:0/1436568325 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c143230 con 0x7f4f1c13ffb0 2021-06-25T04:48:01.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f1ad9d700 1 --2- 172.21.15.57:0/1436568325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1c13ffb0 0x7f4f1c140440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f4f140032f0 tx=0x7f4f14009290).ready entity=mon.0 client_cookie=f2c5e1d36fc64ccc server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f1959a700 1 -- 172.21.15.57:0/1436568325 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f1400b870 con 0x7f4f1c13ffb0 2021-06-25T04:48:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f1959a700 1 -- 172.21.15.57:0/1436568325 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1400b9d0 con 0x7f4f1c13ffb0 2021-06-25T04:48:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f1959a700 1 -- 172.21.15.57:0/1436568325 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f1400bb40 con 0x7f4f1c13ffb0 2021-06-25T04:48:01.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 -- 172.21.15.57:0/1436568325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1c13ffb0 msgr2=0x7f4f1c140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 --2- 172.21.15.57:0/1436568325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1c13ffb0 0x7f4f1c140440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f4f140032f0 tx=0x7f4f14009290).stop 2021-06-25T04:48:01.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 -- 172.21.15.57:0/1436568325 shutdown_connections 2021-06-25T04:48:01.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 --2- 172.21.15.57:0/1436568325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1c13ffb0 0x7f4f1c140440 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 --2- 172.21.15.57:0/1436568325 >> v2:172.21.15.87:3300/0 conn(0x7f4f1c0b96a0 0x7f4f1c0aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 -- 172.21.15.57:0/1436568325 >> 172.21.15.57:0/1436568325 conn(0x7f4f1c05f9b0 msgr2=0x7f4f1c061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:01.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 -- 172.21.15.57:0/1436568325 shutdown_connections 2021-06-25T04:48:01.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.043+0000 7f4f20aab700 1 -- 172.21.15.57:0/1436568325 wait complete. 2021-06-25T04:48:01.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.047+0000 7f4f20aab700 1 Processor -- start 2021-06-25T04:48:01.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.047+0000 7f4f20aab700 1 -- start start 2021-06-25T04:48:01.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.047+0000 7f4f20aab700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f1c0670e0 0x7f4f1c05cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.047+0000 7f4f20aab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1c0b96a0 0x7f4f1c0b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.047+0000 7f4f20aab700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f1c13ffb0 0x7f4f1c0b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.047+0000 7f4f20aab700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c155500 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.047+0000 7f4f20aab700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0b1780 con 0x7f4f1c0670e0 2021-06-25T04:48:01.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.047+0000 7f4f20aab700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0b14e0 con 0x7f4f1c13ffb0 2021-06-25T04:48:01.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f19d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1c0b96a0 0x7f4f1c0b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f19d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1c0b96a0 0x7f4f1c0b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35906/0 (socket says 172.21.15.57:35906) 2021-06-25T04:48:01.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f19d9b700 1 -- 172.21.15.57:0/1048680050 learned_addr learned my addr 172.21.15.57:0/1048680050 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:01.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f1ad9d700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f1c13ffb0 0x7f4f1c0b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f1a59c700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f1c0670e0 0x7f4f1c05cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f19d9b700 1 -- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f1c13ffb0 msgr2=0x7f4f1c0b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f19d9b700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f1c13ffb0 0x7f4f1c0b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f19d9b700 1 -- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f1c0670e0 msgr2=0x7f4f1c05cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f19d9b700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f1c0670e0 0x7f4f1c05cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f19d9b700 1 -- 172.21.15.57:0/1048680050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f14009530 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f19d9b700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1c0b96a0 0x7f4f1c0b03a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f4f0c00c000 tx=0x7f4f0c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f137fe700 1 -- 172.21.15.57:0/1048680050 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f0c010780 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f137fe700 1 -- 172.21.15.57:0/1048680050 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0108e0 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f137fe700 1 -- 172.21.15.57:0/1048680050 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f0c010c40 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f20aab700 1 -- 172.21.15.57:0/1048680050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1c0af9d0 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f20aab700 1 -- 172.21.15.57:0/1048680050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c0b0890 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f20aab700 1 -- 172.21.15.57:0/1048680050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c057310 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.051+0000 7f4f137fe700 1 -- 172.21.15.57:0/1048680050 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4f0c01c460 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.055+0000 7f4f137fe700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4f000553d0 0x7f4f00057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.055+0000 7f4f137fe700 1 -- 172.21.15.57:0/1048680050 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4f0c06e4d0 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.055+0000 7f4f1a59c700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4f000553d0 0x7f4f00057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.055+0000 7f4f1a59c700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4f000553d0 0x7f4f00057890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4f0400b000 tx=0x7f4f04009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.059+0000 7f4f137fe700 1 -- 172.21.15.57:0/1048680050 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4f0c044580 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.187+0000 7f4f20aab700 1 -- 172.21.15.57:0/1048680050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f1c0698a0 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.187+0000 7f4f137fe700 1 -- 172.21.15.57:0/1048680050 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f4f0c047ba0 con 0x7f4f1c0b96a0 2021-06-25T04:48:01.195 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:01.195 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:41.021834+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:48:01.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.187+0000 7f4f20aab700 1 -- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4f000553d0 msgr2=0x7f4f00057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.187+0000 7f4f20aab700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4f000553d0 0x7f4f00057890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4f0400b000 tx=0x7f4f04009040).stop 2021-06-25T04:48:01.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.187+0000 7f4f20aab700 1 -- 172.21.15.57:0/1048680050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1c0b96a0 msgr2=0x7f4f1c0b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.187+0000 7f4f20aab700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1c0b96a0 0x7f4f1c0b03a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f4f0c00c000 tx=0x7f4f0c006df0).stop 2021-06-25T04:48:01.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.191+0000 7f4f20aab700 1 -- 172.21.15.57:0/1048680050 shutdown_connections 2021-06-25T04:48:01.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.191+0000 7f4f20aab700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4f000553d0 0x7f4f00057890 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.191+0000 7f4f20aab700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4f1c13ffb0 0x7f4f1c0b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.191+0000 7f4f20aab700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1c0b96a0 0x7f4f1c0b03a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.191+0000 7f4f20aab700 1 --2- 172.21.15.57:0/1048680050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f1c0670e0 0x7f4f1c05cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.191+0000 7f4f20aab700 1 -- 172.21.15.57:0/1048680050 >> 172.21.15.57:0/1048680050 conn(0x7f4f1c05f9b0 msgr2=0x7f4f1c05bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:01.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.191+0000 7f4f20aab700 1 -- 172.21.15.57:0/1048680050 shutdown_connections 2021-06-25T04:48:01.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.191+0000 7f4f20aab700 1 -- 172.21.15.57:0/1048680050 wait complete. 2021-06-25T04:48:01.208 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:47:34.957337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:47:37.729999+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:48:01.209 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:48:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e8583b700 1 Processor -- start 2021-06-25T04:48:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e8583b700 1 -- start start 2021-06-25T04:48:01.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e8583b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e800affd0 0x7f4e800a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e8583b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e800a7080 con 0x7f4e800b2540 2021-06-25T04:48:01.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e8583b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e800a72b0 con 0x7f4e800afb90 2021-06-25T04:48:01.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e8583b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e800a7550 con 0x7f4e800affd0 2021-06-25T04:48:01.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e7ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e800affd0 0x7f4e800a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e84839700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4e800b2540 0x7f4e8014ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53130/0 (socket says 172.21.15.57:53130) 2021-06-25T04:48:01.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e84839700 1 -- 172.21.15.57:0/3332033662 learned_addr learned my addr 172.21.15.57:0/3332033662 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:01.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e7ffff700 1 -- 172.21.15.57:0/3332033662 >> v1:172.21.15.87:6789/0 conn(0x7f4e800afb90 legacy=0x7f4e80151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e7ffff700 1 -- 172.21.15.57:0/3332033662 >> v1:172.21.15.57:6789/0 conn(0x7f4e800b2540 legacy=0x7f4e8014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e7f7fe700 1 -- 172.21.15.57:0/3332033662 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442381654 0 0) 0x7f4e800a7080 con 0x7f4e800b2540 2021-06-25T04:48:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.311+0000 7f4e7ffff700 1 -- 172.21.15.57:0/3332033662 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e800a77f0 con 0x7f4e800affd0 2021-06-25T04:48:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e7ffff700 1 --2- 172.21.15.57:0/3332033662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e800affd0 0x7f4e800a8370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f4e70002f70 tx=0x7f4e70006df0).ready entity=mon.0 client_cookie=d9e58a8cf243a3c1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e7f7fe700 1 -- 172.21.15.57:0/3332033662 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7000d610 con 0x7f4e800affd0 2021-06-25T04:48:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e7f7fe700 1 -- 172.21.15.57:0/3332033662 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e70000e90 con 0x7f4e800affd0 2021-06-25T04:48:01.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e7f7fe700 1 -- 172.21.15.57:0/3332033662 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7000d960 con 0x7f4e800affd0 2021-06-25T04:48:01.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 -- 172.21.15.57:0/3332033662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e800affd0 msgr2=0x7f4e800a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 --2- 172.21.15.57:0/3332033662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e800affd0 0x7f4e800a8370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f4e70002f70 tx=0x7f4e70006df0).stop 2021-06-25T04:48:01.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 -- 172.21.15.57:0/3332033662 shutdown_connections 2021-06-25T04:48:01.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 --2- 172.21.15.57:0/3332033662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e800affd0 0x7f4e800a8370 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 -- 172.21.15.57:0/3332033662 >> 172.21.15.57:0/3332033662 conn(0x7f4e80060140 msgr2=0x7f4e800b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:01.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 -- 172.21.15.57:0/3332033662 shutdown_connections 2021-06-25T04:48:01.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 -- 172.21.15.57:0/3332033662 wait complete. 2021-06-25T04:48:01.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 Processor -- start 2021-06-25T04:48:01.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 -- start start 2021-06-25T04:48:01.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e800afb90 0x7f4e800abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e800affd0 0x7f4e80156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e800b2540 0x7f4e801566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80156be0 con 0x7f4e800b2540 2021-06-25T04:48:01.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.315+0000 7f4e8583b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8015a480 con 0x7f4e800afb90 2021-06-25T04:48:01.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8583b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80063140 con 0x7f4e800affd0 2021-06-25T04:48:01.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8503a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e800b2540 0x7f4e801566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8503a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e800b2540 0x7f4e801566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35922/0 (socket says 172.21.15.57:35922) 2021-06-25T04:48:01.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e84839700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e800afb90 0x7f4e800abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8503a700 1 -- 172.21.15.57:0/727402002 learned_addr learned my addr 172.21.15.57:0/727402002 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:01.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e7ffff700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e800affd0 0x7f4e80156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8503a700 1 -- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e800affd0 msgr2=0x7f4e80156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8503a700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e800affd0 0x7f4e80156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8503a700 1 -- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e800afb90 msgr2=0x7f4e800abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8503a700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e800afb90 0x7f4e800abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8503a700 1 -- 172.21.15.57:0/727402002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7000b180 con 0x7f4e800b2540 2021-06-25T04:48:01.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8503a700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e800b2540 0x7f4e801566f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f4e80061a40 tx=0x7f4e78007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e7dffb700 1 -- 172.21.15.57:0/727402002 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7800f470 con 0x7f4e800b2540 2021-06-25T04:48:01.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e7dffb700 1 -- 172.21.15.57:0/727402002 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7800f5d0 con 0x7f4e800b2540 2021-06-25T04:48:01.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8583b700 1 -- 172.21.15.57:0/727402002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e800633e0 con 0x7f4e800b2540 2021-06-25T04:48:01.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e7dffb700 1 -- 172.21.15.57:0/727402002 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7800f930 con 0x7f4e800b2540 2021-06-25T04:48:01.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8583b700 1 -- 172.21.15.57:0/727402002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e800aabe0 con 0x7f4e800b2540 2021-06-25T04:48:01.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.319+0000 7f4e8583b700 1 -- 172.21.15.57:0/727402002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8015a680 con 0x7f4e800b2540 2021-06-25T04:48:01.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.323+0000 7f4e7dffb700 1 -- 172.21.15.57:0/727402002 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4e78019030 con 0x7f4e800b2540 2021-06-25T04:48:01.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.323+0000 7f4e7dffb700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e600554e0 0x7f4e600579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.323+0000 7f4e7dffb700 1 -- 172.21.15.57:0/727402002 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4e7806d6d0 con 0x7f4e800b2540 2021-06-25T04:48:01.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.323+0000 7f4e84839700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e600554e0 0x7f4e600579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.323+0000 7f4e84839700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e600554e0 0x7f4e600579a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4e7400d000 tx=0x7f4e74007c00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.327+0000 7f4e7dffb700 1 -- 172.21.15.57:0/727402002 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4e780437e0 con 0x7f4e800b2540 2021-06-25T04:48:01.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 -- 172.21.15.57:0/727402002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4e80057310 con 0x7f4e800b2540 2021-06-25T04:48:01.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e7dffb700 1 -- 172.21.15.57:0/727402002 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4e78046e00 con 0x7f4e800b2540 2021-06-25T04:48:01.462 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:48:01.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 -- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e600554e0 msgr2=0x7f4e600579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e600554e0 0x7f4e600579a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4e7400d000 tx=0x7f4e74007c00).stop 2021-06-25T04:48:01.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 -- 172.21.15.57:0/727402002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e800b2540 msgr2=0x7f4e801566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e800b2540 0x7f4e801566f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f4e80061a40 tx=0x7f4e78007f10).stop 2021-06-25T04:48:01.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 -- 172.21.15.57:0/727402002 shutdown_connections 2021-06-25T04:48:01.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e600554e0 0x7f4e600579a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e800b2540 0x7f4e801566f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e800affd0 0x7f4e80156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 --2- 172.21.15.57:0/727402002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e800afb90 0x7f4e800abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 -- 172.21.15.57:0/727402002 >> 172.21.15.57:0/727402002 conn(0x7f4e80060140 msgr2=0x7f4e80148680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:01.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 -- 172.21.15.57:0/727402002 shutdown_connections 2021-06-25T04:48:01.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.455+0000 7f4e8583b700 1 -- 172.21.15.57:0/727402002 wait complete. 2021-06-25T04:48:01.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:48:01.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f18a12c6700 1 Processor -- start 2021-06-25T04:48:01.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f18a12c6700 1 -- start start 2021-06-25T04:48:01.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f18a12c6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f189c0b6250 0x7f189c061430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f18a12c6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f189c0b4020 0x7f189c061920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f18a12c6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189c0b5f10 con 0x7f189c061e10 2021-06-25T04:48:01.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f18a12c6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f189c0b1f30 con 0x7f189c0b6250 2021-06-25T04:48:01.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f18a12c6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189c0b21d0 con 0x7f189c0b4020 2021-06-25T04:48:01.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f18a0ac5700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f189c061e10 0x7f189c1463f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53148/0 (socket says 172.21.15.57:53148) 2021-06-25T04:48:01.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f18a0ac5700 1 -- 172.21.15.57:0/704214621 learned_addr learned my addr 172.21.15.57:0/704214621 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:01.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f189b7fe700 1 --2- 172.21.15.57:0/704214621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f189c0b4020 0x7f189c061920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f189bfff700 1 --2- 172.21.15.57:0/704214621 >> v2:172.21.15.87:3300/0 conn(0x7f189c0b6250 0x7f189c061430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f189affd700 1 -- 172.21.15.57:0/704214621 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326034047 0 0) 0x7f1894001490 con 0x7f189c061e10 2021-06-25T04:48:01.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.579+0000 7f189affd700 1 -- 172.21.15.57:0/704214621 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f187c003260 con 0x7f189c061e10 2021-06-25T04:48:01.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f189b7fe700 1 -- 172.21.15.57:0/704214621 >> v2:172.21.15.87:3300/0 conn(0x7f189c0b6250 msgr2=0x7f189c061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:01.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f189b7fe700 1 --2- 172.21.15.57:0/704214621 >> v2:172.21.15.87:3300/0 conn(0x7f189c0b6250 0x7f189c061430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f189b7fe700 1 -- 172.21.15.57:0/704214621 >> v1:172.21.15.57:6789/0 conn(0x7f189c061e10 legacy=0x7f189c1463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f189b7fe700 1 -- 172.21.15.57:0/704214621 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c0b2470 con 0x7f189c0b4020 2021-06-25T04:48:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f189b7fe700 1 --2- 172.21.15.57:0/704214621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f189c0b4020 0x7f189c061920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f188c002f70 tx=0x7f188c006df0).ready entity=mon.2 client_cookie=c454688ef1eac036 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f189affd700 1 -- 172.21.15.57:0/704214621 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188c00d4a0 con 0x7f189c0b4020 2021-06-25T04:48:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f189affd700 1 -- 172.21.15.57:0/704214621 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c000e90 con 0x7f189c0b4020 2021-06-25T04:48:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f189affd700 1 -- 172.21.15.57:0/704214621 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188c00d7f0 con 0x7f189c0b4020 2021-06-25T04:48:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f18a12c6700 1 -- 172.21.15.57:0/704214621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f189c0b4020 msgr2=0x7f189c061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f18a12c6700 1 --2- 172.21.15.57:0/704214621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f189c0b4020 0x7f189c061920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f188c002f70 tx=0x7f188c006df0).stop 2021-06-25T04:48:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f18a12c6700 1 -- 172.21.15.57:0/704214621 shutdown_connections 2021-06-25T04:48:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f18a12c6700 1 --2- 172.21.15.57:0/704214621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f189c0b4020 0x7f189c061920 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f18a12c6700 1 --2- 172.21.15.57:0/704214621 >> v2:172.21.15.87:3300/0 conn(0x7f189c0b6250 0x7f189c061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f18a12c6700 1 -- 172.21.15.57:0/704214621 >> 172.21.15.57:0/704214621 conn(0x7f189c05c450 msgr2=0x7f189c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:01.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f18a12c6700 1 -- 172.21.15.57:0/704214621 shutdown_connections 2021-06-25T04:48:01.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.583+0000 7f18a12c6700 1 -- 172.21.15.57:0/704214621 wait complete. 2021-06-25T04:48:01.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18a12c6700 1 Processor -- start 2021-06-25T04:48:01.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18a12c6700 1 -- start start 2021-06-25T04:48:01.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18a12c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189c061e10 0x7f189c149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18a12c6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f189c0b4020 0x7f189c12bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18a12c6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f189c0b6250 0x7f189c12c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18a12c6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c0ae0f0 con 0x7f189c0b4020 2021-06-25T04:48:01.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18a12c6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c1438c0 con 0x7f189c061e10 2021-06-25T04:48:01.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18a12c6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189c143af0 con 0x7f189c0b6250 2021-06-25T04:48:01.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f189b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f189c0b4020 0x7f189c12bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f189b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f189c0b4020 0x7f189c12bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35934/0 (socket says 172.21.15.57:35934) 2021-06-25T04:48:01.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f189b7fe700 1 -- 172.21.15.57:0/2804443913 learned_addr learned my addr 172.21.15.57:0/2804443913 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:01.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f189bfff700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189c061e10 0x7f189c149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18a0ac5700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f189c0b6250 0x7f189c12c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f189b7fe700 1 -- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f189c0b6250 msgr2=0x7f189c12c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f189b7fe700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f189c0b6250 0x7f189c12c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f189b7fe700 1 -- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189c061e10 msgr2=0x7f189c149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f189b7fe700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189c061e10 0x7f189c149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f189b7fe700 1 -- 172.21.15.57:0/2804443913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c00b180 con 0x7f189c0b4020 2021-06-25T04:48:01.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f189b7fe700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f189c0b4020 0x7f189c12bc80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f188c002f70 tx=0x7f188c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18997fa700 1 -- 172.21.15.57:0/2804443913 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188c012de0 con 0x7f189c0b4020 2021-06-25T04:48:01.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18997fa700 1 -- 172.21.15.57:0/2804443913 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c01f440 con 0x7f189c0b4020 2021-06-25T04:48:01.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18a12c6700 1 -- 172.21.15.57:0/2804443913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189c143d90 con 0x7f189c0b4020 2021-06-25T04:48:01.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18997fa700 1 -- 172.21.15.57:0/2804443913 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188c01f7a0 con 0x7f189c0b4020 2021-06-25T04:48:01.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.587+0000 7f18a12c6700 1 -- 172.21.15.57:0/2804443913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189c13f180 con 0x7f189c0b4020 2021-06-25T04:48:01.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.591+0000 7f18a12c6700 1 -- 172.21.15.57:0/2804443913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189c057310 con 0x7f189c0b4020 2021-06-25T04:48:01.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.591+0000 7f18997fa700 1 -- 172.21.15.57:0/2804443913 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f188c025020 con 0x7f189c0b4020 2021-06-25T04:48:01.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.591+0000 7f18997fa700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18800554e0 0x7f18800579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.591+0000 7f18997fa700 1 -- 172.21.15.57:0/2804443913 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f188c06f180 con 0x7f189c0b4020 2021-06-25T04:48:01.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.591+0000 7f189bfff700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18800554e0 0x7f18800579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.591+0000 7f189bfff700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18800554e0 0x7f18800579a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f188400b000 tx=0x7f1884006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.599+0000 7f18997fa700 1 -- 172.21.15.57:0/2804443913 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f188c045220 con 0x7f189c0b4020 2021-06-25T04:48:01.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.723+0000 7f18a12c6700 1 -- 172.21.15.57:0/2804443913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f189c06afd0 con 0x7f189c0b4020 2021-06-25T04:48:01.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.723+0000 7f18997fa700 1 -- 172.21.15.57:0/2804443913 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f188c048840 con 0x7f189c0b4020 2021-06-25T04:48:01.732 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:01.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 -- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18800554e0 msgr2=0x7f18800579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18800554e0 0x7f18800579a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f188400b000 tx=0x7f1884006df0).stop 2021-06-25T04:48:01.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 -- 172.21.15.57:0/2804443913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f189c0b4020 msgr2=0x7f189c12bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f189c0b4020 0x7f189c12bc80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f188c002f70 tx=0x7f188c014000).stop 2021-06-25T04:48:01.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 -- 172.21.15.57:0/2804443913 shutdown_connections 2021-06-25T04:48:01.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18800554e0 0x7f18800579a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f189c0b6250 0x7f189c12c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f189c0b4020 0x7f189c12bc80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 --2- 172.21.15.57:0/2804443913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189c061e10 0x7f189c149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 -- 172.21.15.57:0/2804443913 >> 172.21.15.57:0/2804443913 conn(0x7f189c05c450 msgr2=0x7f189c0b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:01.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 -- 172.21.15.57:0/2804443913 shutdown_connections 2021-06-25T04:48:01.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.727+0000 7f18a12c6700 1 -- 172.21.15.57:0/2804443913 wait complete. 2021-06-25T04:48:01.744 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:48:01.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.847+0000 7f3a90c3a700 1 Processor -- start 2021-06-25T04:48:01.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.847+0000 7f3a90c3a700 1 -- start start 2021-06-25T04:48:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.847+0000 7f3a90c3a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a8c0b6250 0x7f3a8c061430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.847+0000 7f3a90c3a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a8c0b4020 0x7f3a8c061920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a90c3a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8c0b5f10 con 0x7f3a8c061e10 2021-06-25T04:48:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a90c3a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c0b1f30 con 0x7f3a8c0b4020 2021-06-25T04:48:01.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a90c3a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c0b21d0 con 0x7f3a8c0b6250 2021-06-25T04:48:01.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a8c0b4020 0x7f3a8c061920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3a8c061e10 0x7f3a8c1463f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53162/0 (socket says 172.21.15.57:53162) 2021-06-25T04:48:01.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8bfff700 1 -- 172.21.15.57:0/3587525905 learned_addr learned my addr 172.21.15.57:0/3587525905 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:01.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8b7fe700 1 --2- 172.21.15.57:0/3587525905 >> v2:172.21.15.87:3300/0 conn(0x7f3a8c0b6250 0x7f3a8c061430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8affd700 1 -- 172.21.15.57:0/3587525905 >> v2:172.21.15.87:3300/0 conn(0x7f3a8c0b6250 msgr2=0x7f3a8c061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:01.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8affd700 1 --2- 172.21.15.57:0/3587525905 >> v2:172.21.15.87:3300/0 conn(0x7f3a8c0b6250 0x7f3a8c061430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8affd700 1 -- 172.21.15.57:0/3587525905 >> v1:172.21.15.57:6789/0 conn(0x7f3a8c061e10 legacy=0x7f3a8c1463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8affd700 1 -- 172.21.15.57:0/3587525905 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c0b2470 con 0x7f3a8c0b4020 2021-06-25T04:48:01.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8b7fe700 1 --2- 172.21.15.57:0/3587525905 >> v2:172.21.15.87:3300/0 conn(0x7f3a8c0b6250 0x7f3a8c061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:01.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8affd700 1 --2- 172.21.15.57:0/3587525905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c0b4020 0x7f3a8c061920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f3a80002f70 tx=0x7f3a80006df0).ready entity=mon.0 client_cookie=3c7b585f99e16d17 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8a7fc700 1 -- 172.21.15.57:0/3587525905 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a8000d5c0 con 0x7f3a8c0b4020 2021-06-25T04:48:01.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8a7fc700 1 -- 172.21.15.57:0/3587525905 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a80000e90 con 0x7f3a8c0b4020 2021-06-25T04:48:01.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a8a7fc700 1 -- 172.21.15.57:0/3587525905 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a8000d910 con 0x7f3a8c0b4020 2021-06-25T04:48:01.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a90c3a700 1 -- 172.21.15.57:0/3587525905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c0b4020 msgr2=0x7f3a8c061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a90c3a700 1 --2- 172.21.15.57:0/3587525905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c0b4020 0x7f3a8c061920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f3a80002f70 tx=0x7f3a80006df0).stop 2021-06-25T04:48:01.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a90c3a700 1 -- 172.21.15.57:0/3587525905 shutdown_connections 2021-06-25T04:48:01.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a90c3a700 1 --2- 172.21.15.57:0/3587525905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c0b4020 0x7f3a8c061920 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a90c3a700 1 --2- 172.21.15.57:0/3587525905 >> v2:172.21.15.87:3300/0 conn(0x7f3a8c0b6250 0x7f3a8c061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a90c3a700 1 -- 172.21.15.57:0/3587525905 >> 172.21.15.57:0/3587525905 conn(0x7f3a8c05c450 msgr2=0x7f3a8c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:01.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a90c3a700 1 -- 172.21.15.57:0/3587525905 shutdown_connections 2021-06-25T04:48:01.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.851+0000 7f3a90c3a700 1 -- 172.21.15.57:0/3587525905 wait complete. 2021-06-25T04:48:01.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a90c3a700 1 Processor -- start 2021-06-25T04:48:01.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a90c3a700 1 -- start start 2021-06-25T04:48:01.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a90c3a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a8c061e10 0x7f3a8c13ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a90c3a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a8c0b4020 0x7f3a8c13f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a90c3a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c0b6250 0x7f3a8c0aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a90c3a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c13e820 con 0x7f3a8c0b6250 2021-06-25T04:48:01.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a90c3a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c13e4c0 con 0x7f3a8c061e10 2021-06-25T04:48:01.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a90c3a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c13df80 con 0x7f3a8c0b4020 2021-06-25T04:48:01.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a8bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c0b6250 0x7f3a8c0aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a8bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c0b6250 0x7f3a8c0aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35950/0 (socket says 172.21.15.57:35950) 2021-06-25T04:48:01.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a8affd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a8c0b4020 0x7f3a8c13f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a8b7fe700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a8c061e10 0x7f3a8c13ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a8bfff700 1 -- 172.21.15.57:0/1809815981 learned_addr learned my addr 172.21.15.57:0/1809815981 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:01.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a8bfff700 1 -- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a8c0b4020 msgr2=0x7f3a8c13f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a8bfff700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a8c0b4020 0x7f3a8c13f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a8bfff700 1 -- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a8c061e10 msgr2=0x7f3a8c13ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:01.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a8bfff700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a8c061e10 0x7f3a8c13ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:01.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a8bfff700 1 -- 172.21.15.57:0/1809815981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8000b180 con 0x7f3a8c0b6250 2021-06-25T04:48:01.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a8bfff700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c0b6250 0x7f3a8c0aea90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f3a8c0b2a90 tx=0x7f3a84007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a88ff9700 1 -- 172.21.15.57:0/1809815981 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a84005b80 con 0x7f3a8c0b6250 2021-06-25T04:48:01.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a88ff9700 1 -- 172.21.15.57:0/1809815981 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a84005ce0 con 0x7f3a8c0b6250 2021-06-25T04:48:01.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a90c3a700 1 -- 172.21.15.57:0/1809815981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8c13e220 con 0x7f3a8c0b6250 2021-06-25T04:48:01.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a88ff9700 1 -- 172.21.15.57:0/1809815981 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a840072c0 con 0x7f3a8c0b6250 2021-06-25T04:48:01.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.855+0000 7f3a90c3a700 1 -- 172.21.15.57:0/1809815981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8c1521c0 con 0x7f3a8c0b6250 2021-06-25T04:48:01.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.859+0000 7f3a90c3a700 1 -- 172.21.15.57:0/1809815981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8c057310 con 0x7f3a8c0b6250 2021-06-25T04:48:01.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.859+0000 7f3a88ff9700 1 -- 172.21.15.57:0/1809815981 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3a8401a060 con 0x7f3a8c0b6250 2021-06-25T04:48:01.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.859+0000 7f3a88ff9700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a6c0553d0 0x7f3a6c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:01.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.859+0000 7f3a88ff9700 1 -- 172.21.15.57:0/1809815981 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3a8406d7d0 con 0x7f3a8c0b6250 2021-06-25T04:48:01.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.859+0000 7f3a8b7fe700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a6c0553d0 0x7f3a6c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:01.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.859+0000 7f3a8b7fe700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a6c0553d0 0x7f3a6c057890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f3a7c00c000 tx=0x7f3a7c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:01.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.863+0000 7f3a88ff9700 1 -- 172.21.15.57:0/1809815981 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3a84043870 con 0x7f3a8c0b6250 2021-06-25T04:48:02.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.995+0000 7f3a90c3a700 1 -- 172.21.15.57:0/1809815981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a8c0b5f10 con 0x7f3a8c0b6250 2021-06-25T04:48:02.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.995+0000 7f3a88ff9700 1 -- 172.21.15.57:0/1809815981 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3a8c0b5f10 con 0x7f3a8c0b6250 2021-06-25T04:48:02.002 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:02.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.995+0000 7f3a90c3a700 1 -- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a6c0553d0 msgr2=0x7f3a6c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.995+0000 7f3a90c3a700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a6c0553d0 0x7f3a6c057890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f3a7c00c000 tx=0x7f3a7c008040).stop 2021-06-25T04:48:02.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.995+0000 7f3a90c3a700 1 -- 172.21.15.57:0/1809815981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c0b6250 msgr2=0x7f3a8c0aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.995+0000 7f3a90c3a700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c0b6250 0x7f3a8c0aea90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f3a8c0b2a90 tx=0x7f3a84007f30).stop 2021-06-25T04:48:02.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.999+0000 7f3a90c3a700 1 -- 172.21.15.57:0/1809815981 shutdown_connections 2021-06-25T04:48:02.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.999+0000 7f3a90c3a700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a6c0553d0 0x7f3a6c057890 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.999+0000 7f3a90c3a700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c0b6250 0x7f3a8c0aea90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.999+0000 7f3a90c3a700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a8c0b4020 0x7f3a8c13f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.999+0000 7f3a90c3a700 1 --2- 172.21.15.57:0/1809815981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a8c061e10 0x7f3a8c13ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.999+0000 7f3a90c3a700 1 -- 172.21.15.57:0/1809815981 >> 172.21.15.57:0/1809815981 conn(0x7f3a8c05c450 msgr2=0x7f3a8c148c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:02.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.999+0000 7f3a90c3a700 1 -- 172.21.15.57:0/1809815981 shutdown_connections 2021-06-25T04:48:02.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:01.999+0000 7f3a90c3a700 1 -- 172.21.15.57:0/1809815981 wait complete. 2021-06-25T04:48:02.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:48:02.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.123+0000 7ff747cfe700 1 Processor -- start 2021-06-25T04:48:02.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.123+0000 7ff747cfe700 1 -- start start 2021-06-25T04:48:02.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.123+0000 7ff747cfe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff740146910 0x7ff7401401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.123+0000 7ff747cfe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff7400b4140 0x7ff7401406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.123+0000 7ff747cfe700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff740143b20 con 0x7ff7400b4650 2021-06-25T04:48:02.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.123+0000 7ff747cfe700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7401474d0 con 0x7ff740146910 2021-06-25T04:48:02.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.123+0000 7ff747cfe700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff740143dc0 con 0x7ff7400b4140 2021-06-25T04:48:02.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.123+0000 7ff745a9a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff740146910 0x7ff7401401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff745a9a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff740146910 0x7ff7401401f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35954/0 (socket says 172.21.15.57:35954) 2021-06-25T04:48:02.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff745a9a700 1 -- 172.21.15.57:0/801221596 learned_addr learned my addr 172.21.15.57:0/801221596 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:02.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff74629b700 1 --1- 172.21.15.57:0/801221596 >> v1:172.21.15.57:6789/0 conn(0x7ff7400b4650 0x7ff7400b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53174/0 (socket says 172.21.15.57:53174) 2021-06-25T04:48:02.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff745299700 1 --2- 172.21.15.57:0/801221596 >> v2:172.21.15.87:3300/0 conn(0x7ff7400b4140 0x7ff7401406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff745a9a700 1 -- 172.21.15.57:0/801221596 >> v2:172.21.15.87:3300/0 conn(0x7ff7400b4140 msgr2=0x7ff7401406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:02.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff745a9a700 1 --2- 172.21.15.57:0/801221596 >> v2:172.21.15.87:3300/0 conn(0x7ff7400b4140 0x7ff7401406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff745a9a700 1 -- 172.21.15.57:0/801221596 >> v1:172.21.15.57:6789/0 conn(0x7ff7400b4650 legacy=0x7ff7400b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff745a9a700 1 -- 172.21.15.57:0/801221596 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7400b0c50 con 0x7ff740146910 2021-06-25T04:48:02.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff744a98700 1 -- 172.21.15.57:0/801221596 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230139827 0 0) 0x7ff740143b20 con 0x7ff7400b4650 2021-06-25T04:48:02.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff745a9a700 1 --2- 172.21.15.57:0/801221596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff740146910 0x7ff7401401f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7ff7300032f0 tx=0x7ff730009290).ready entity=mon.0 client_cookie=2a37f5e8d703bd4f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff744a98700 1 -- 172.21.15.57:0/801221596 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff73000b870 con 0x7ff740146910 2021-06-25T04:48:02.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff744a98700 1 -- 172.21.15.57:0/801221596 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73000b9d0 con 0x7ff740146910 2021-06-25T04:48:02.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff744a98700 1 -- 172.21.15.57:0/801221596 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff73000bb40 con 0x7ff740146910 2021-06-25T04:48:02.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff747cfe700 1 -- 172.21.15.57:0/801221596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff740146910 msgr2=0x7ff7401401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff747cfe700 1 --2- 172.21.15.57:0/801221596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff740146910 0x7ff7401401f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7ff7300032f0 tx=0x7ff730009290).stop 2021-06-25T04:48:02.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff747cfe700 1 -- 172.21.15.57:0/801221596 shutdown_connections 2021-06-25T04:48:02.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff747cfe700 1 --2- 172.21.15.57:0/801221596 >> v2:172.21.15.87:3300/0 conn(0x7ff7400b4140 0x7ff7401406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff747cfe700 1 --2- 172.21.15.57:0/801221596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff740146910 0x7ff7401401f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff747cfe700 1 -- 172.21.15.57:0/801221596 >> 172.21.15.57:0/801221596 conn(0x7ff74005c450 msgr2=0x7ff74005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:02.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff747cfe700 1 -- 172.21.15.57:0/801221596 shutdown_connections 2021-06-25T04:48:02.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff747cfe700 1 -- 172.21.15.57:0/801221596 wait complete. 2021-06-25T04:48:02.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff747cfe700 1 Processor -- start 2021-06-25T04:48:02.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.127+0000 7ff747cfe700 1 -- start start 2021-06-25T04:48:02.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff747cfe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7400b4140 0x7ff7401383d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff747cfe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7400b4650 0x7ff7401350c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff747cfe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff740146910 0x7ff7401355b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff747cfe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74013d5c0 con 0x7ff7400b4140 2021-06-25T04:48:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff747cfe700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400b5870 con 0x7ff740146910 2021-06-25T04:48:02.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff747cfe700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff740147a50 con 0x7ff7400b4650 2021-06-25T04:48:02.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff745a9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7400b4140 0x7ff7401383d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff745a9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7400b4140 0x7ff7401383d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35960/0 (socket says 172.21.15.57:35960) 2021-06-25T04:48:02.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff745a9a700 1 -- 172.21.15.57:0/3471888870 learned_addr learned my addr 172.21.15.57:0/3471888870 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:02.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff745299700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7400b4650 0x7ff7401350c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff74629b700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff740146910 0x7ff7401355b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff745a9a700 1 -- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7400b4650 msgr2=0x7ff7401350c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff745a9a700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7400b4650 0x7ff7401350c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff745a9a700 1 -- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff740146910 msgr2=0x7ff7401355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff745a9a700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff740146910 0x7ff7401355b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff745a9a700 1 -- 172.21.15.57:0/3471888870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009530 con 0x7ff7400b4140 2021-06-25T04:48:02.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff745299700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7400b4650 0x7ff7401350c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:48:02.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff74629b700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff740146910 0x7ff7401355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:48:02.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff745a9a700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7400b4140 0x7ff7401383d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7ff7300032f0 tx=0x7ff730016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff73effd700 1 -- 172.21.15.57:0/3471888870 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff730011ca0 con 0x7ff7400b4140 2021-06-25T04:48:02.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff73effd700 1 -- 172.21.15.57:0/3471888870 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff730011e00 con 0x7ff7400b4140 2021-06-25T04:48:02.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff747cfe700 1 -- 172.21.15.57:0/3471888870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff740147cf0 con 0x7ff7400b4140 2021-06-25T04:48:02.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff73effd700 1 -- 172.21.15.57:0/3471888870 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff73001f600 con 0x7ff7400b4140 2021-06-25T04:48:02.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff747cfe700 1 -- 172.21.15.57:0/3471888870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7400b5130 con 0x7ff7400b4140 2021-06-25T04:48:02.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff73effd700 1 -- 172.21.15.57:0/3471888870 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff73000f070 con 0x7ff7400b4140 2021-06-25T04:48:02.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.131+0000 7ff747cfe700 1 -- 172.21.15.57:0/3471888870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7400b6d80 con 0x7ff7400b4140 2021-06-25T04:48:02.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.135+0000 7ff73effd700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff724055490 0x7ff724057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.135+0000 7ff73effd700 1 -- 172.21.15.57:0/3471888870 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff73006e900 con 0x7ff7400b4140 2021-06-25T04:48:02.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.135+0000 7ff745299700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff724055490 0x7ff724057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.135+0000 7ff745299700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff724055490 0x7ff724057950 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff728008000 tx=0x7ff728008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.139+0000 7ff73effd700 1 -- 172.21.15.57:0/3471888870 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff730044a30 con 0x7ff7400b4140 2021-06-25T04:48:02.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.263+0000 7ff747cfe700 1 -- 172.21.15.57:0/3471888870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff7400b5570 con 0x7ff7400b4140 2021-06-25T04:48:02.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff73effd700 1 -- 172.21.15.57:0/3471888870 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff730015070 con 0x7ff7400b4140 2021-06-25T04:48:02.274 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:02.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 -- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff724055490 msgr2=0x7ff724057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff724055490 0x7ff724057950 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff728008000 tx=0x7ff728008040).stop 2021-06-25T04:48:02.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 -- 172.21.15.57:0/3471888870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7400b4140 msgr2=0x7ff7401383d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7400b4140 0x7ff7401383d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7ff7300032f0 tx=0x7ff730016000).stop 2021-06-25T04:48:02.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 -- 172.21.15.57:0/3471888870 shutdown_connections 2021-06-25T04:48:02.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff724055490 0x7ff724057950 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff740146910 0x7ff7401355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7400b4650 0x7ff7401350c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 --2- 172.21.15.57:0/3471888870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7400b4140 0x7ff7401383d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 -- 172.21.15.57:0/3471888870 >> 172.21.15.57:0/3471888870 conn(0x7ff74005c450 msgr2=0x7ff740142810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:02.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 -- 172.21.15.57:0/3471888870 shutdown_connections 2021-06-25T04:48:02.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.267+0000 7ff747cfe700 1 -- 172.21.15.57:0/3471888870 wait complete. 2021-06-25T04:48:02.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:48:02.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.383+0000 7f2b56adf700 1 Processor -- start 2021-06-25T04:48:02.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.383+0000 7f2b56adf700 1 -- start start 2021-06-25T04:48:02.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.383+0000 7f2b56adf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b500b5460 0x7f2b500af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.383+0000 7f2b56adf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b500b05d0 0x7f2b50147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.383+0000 7f2b56adf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b500b5840 con 0x7f2b50067560 2021-06-25T04:48:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.383+0000 7f2b56adf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b501452a0 con 0x7f2b500b5460 2021-06-25T04:48:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.383+0000 7f2b56adf700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b500adfb0 con 0x7f2b500b05d0 2021-06-25T04:48:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.383+0000 7f2b55add700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b500b5460 0x7f2b500af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.383+0000 7f2b562de700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2b50067560 0x7f2b500acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53190/0 (socket says 172.21.15.57:53190) 2021-06-25T04:48:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b562de700 1 -- 172.21.15.57:0/4043641728 learned_addr learned my addr 172.21.15.57:0/4043641728 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b552dc700 1 --2- 172.21.15.57:0/4043641728 >> v2:172.21.15.87:3300/0 conn(0x7f2b500b05d0 0x7f2b50147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b54adb700 1 -- 172.21.15.57:0/4043641728 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016464204 0 0) 0x7f2b500b5840 con 0x7f2b50067560 2021-06-25T04:48:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b552dc700 1 -- 172.21.15.57:0/4043641728 >> v2:172.21.15.57:3300/0 conn(0x7f2b500b5460 msgr2=0x7f2b500af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b552dc700 1 --2- 172.21.15.57:0/4043641728 >> v2:172.21.15.57:3300/0 conn(0x7f2b500b5460 0x7f2b500af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b552dc700 1 -- 172.21.15.57:0/4043641728 >> v1:172.21.15.57:6789/0 conn(0x7f2b50067560 legacy=0x7f2b500acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b552dc700 1 -- 172.21.15.57:0/4043641728 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b500ac7c0 con 0x7f2b500b05d0 2021-06-25T04:48:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b552dc700 1 --2- 172.21.15.57:0/4043641728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b500b05d0 0x7f2b50147560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2b4c0032f0 tx=0x7f2b4c0091d0).ready entity=mon.1 client_cookie=d04cb20ef54c8b7d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b54adb700 1 -- 172.21.15.57:0/4043641728 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b4c00b680 con 0x7f2b500b05d0 2021-06-25T04:48:02.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b54adb700 1 -- 172.21.15.57:0/4043641728 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c00b7e0 con 0x7f2b500b05d0 2021-06-25T04:48:02.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b56adf700 1 -- 172.21.15.57:0/4043641728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b500b05d0 msgr2=0x7f2b50147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b54adb700 1 -- 172.21.15.57:0/4043641728 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b4c00b950 con 0x7f2b500b05d0 2021-06-25T04:48:02.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b56adf700 1 --2- 172.21.15.57:0/4043641728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b500b05d0 0x7f2b50147560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f2b4c0032f0 tx=0x7f2b4c0091d0).stop 2021-06-25T04:48:02.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b56adf700 1 -- 172.21.15.57:0/4043641728 shutdown_connections 2021-06-25T04:48:02.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b56adf700 1 --2- 172.21.15.57:0/4043641728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b500b05d0 0x7f2b50147560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b56adf700 1 --2- 172.21.15.57:0/4043641728 >> v2:172.21.15.57:3300/0 conn(0x7f2b500b5460 0x7f2b500af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b56adf700 1 -- 172.21.15.57:0/4043641728 >> 172.21.15.57:0/4043641728 conn(0x7f2b50062520 msgr2=0x7f2b50062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:02.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b56adf700 1 -- 172.21.15.57:0/4043641728 shutdown_connections 2021-06-25T04:48:02.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.387+0000 7f2b56adf700 1 -- 172.21.15.57:0/4043641728 wait complete. 2021-06-25T04:48:02.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b56adf700 1 Processor -- start 2021-06-25T04:48:02.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b56adf700 1 -- start start 2021-06-25T04:48:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b56adf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b50067560 0x7f2b5014afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b56adf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b500b05d0 0x7f2b50064ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b56adf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b500b5460 0x7f2b50064fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b56adf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b50063cd0 con 0x7f2b500b5460 2021-06-25T04:48:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b56adf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5015aeb0 con 0x7f2b500b05d0 2021-06-25T04:48:02.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b56adf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5014e5d0 con 0x7f2b50067560 2021-06-25T04:48:02.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b562de700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b500b5460 0x7f2b50064fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b55add700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b50067560 0x7f2b5014afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b562de700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b500b5460 0x7f2b50064fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35978/0 (socket says 172.21.15.57:35978) 2021-06-25T04:48:02.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b552dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b500b05d0 0x7f2b50064ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b55add700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b50067560 0x7f2b5014afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:47138/0 (socket says 172.21.15.57:47138) 2021-06-25T04:48:02.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b562de700 1 -- 172.21.15.57:0/2400722119 learned_addr learned my addr 172.21.15.57:0/2400722119 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:02.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b562de700 1 -- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b50067560 msgr2=0x7f2b5014afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b562de700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b50067560 0x7f2b5014afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b562de700 1 -- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b500b05d0 msgr2=0x7f2b50064ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b562de700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b500b05d0 0x7f2b50064ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.391+0000 7f2b562de700 1 -- 172.21.15.57:0/2400722119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c009470 con 0x7f2b500b5460 2021-06-25T04:48:02.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.395+0000 7f2b562de700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b500b5460 0x7f2b50064fb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f2b48000bc0 tx=0x7f2b48007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.395+0000 7f2b3effd700 1 -- 172.21.15.57:0/2400722119 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b480070d0 con 0x7f2b500b5460 2021-06-25T04:48:02.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.395+0000 7f2b3effd700 1 -- 172.21.15.57:0/2400722119 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b48007230 con 0x7f2b500b5460 2021-06-25T04:48:02.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.395+0000 7f2b56adf700 1 -- 172.21.15.57:0/2400722119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5015b110 con 0x7f2b500b5460 2021-06-25T04:48:02.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.395+0000 7f2b3effd700 1 -- 172.21.15.57:0/2400722119 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b48005610 con 0x7f2b500b5460 2021-06-25T04:48:02.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.395+0000 7f2b56adf700 1 -- 172.21.15.57:0/2400722119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b50067180 con 0x7f2b500b5460 2021-06-25T04:48:02.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.395+0000 7f2b56adf700 1 -- 172.21.15.57:0/2400722119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b50057310 con 0x7f2b500b5460 2021-06-25T04:48:02.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.395+0000 7f2b3effd700 1 -- 172.21.15.57:0/2400722119 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2b48010070 con 0x7f2b500b5460 2021-06-25T04:48:02.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.395+0000 7f2b3effd700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b30055450 0x7f2b30057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.395+0000 7f2b3effd700 1 -- 172.21.15.57:0/2400722119 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2b4806d3f0 con 0x7f2b500b5460 2021-06-25T04:48:02.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.399+0000 7f2b55add700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b30055450 0x7f2b30057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.399+0000 7f2b55add700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b30055450 0x7f2b30057910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f2b4000b000 tx=0x7f2b40006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.399+0000 7f2b3effd700 1 -- 172.21.15.57:0/2400722119 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2b480435a0 con 0x7f2b500b5460 2021-06-25T04:48:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.527+0000 7f2b56adf700 1 -- 172.21.15.57:0/2400722119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b50067be0 con 0x7f2b500b5460 2021-06-25T04:48:02.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.527+0000 7f2b3effd700 1 -- 172.21.15.57:0/2400722119 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f2b48046bc0 con 0x7f2b500b5460 2021-06-25T04:48:02.537 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:02.537 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:41.021834+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:48:02.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 -- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b30055450 msgr2=0x7f2b30057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b30055450 0x7f2b30057910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f2b4000b000 tx=0x7f2b40006df0).stop 2021-06-25T04:48:02.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 -- 172.21.15.57:0/2400722119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b500b5460 msgr2=0x7f2b50064fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b500b5460 0x7f2b50064fb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f2b48000bc0 tx=0x7f2b48007a00).stop 2021-06-25T04:48:02.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 -- 172.21.15.57:0/2400722119 shutdown_connections 2021-06-25T04:48:02.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b30055450 0x7f2b30057910 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b500b5460 0x7f2b50064fb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b500b05d0 0x7f2b50064ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 --2- 172.21.15.57:0/2400722119 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b50067560 0x7f2b5014afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 -- 172.21.15.57:0/2400722119 >> 172.21.15.57:0/2400722119 conn(0x7f2b50062520 msgr2=0x7f2b50062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 -- 172.21.15.57:0/2400722119 shutdown_connections 2021-06-25T04:48:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.531+0000 7f2b56adf700 1 -- 172.21.15.57:0/2400722119 wait complete. 2021-06-25T04:48:02.550 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:47:34.957337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:47:37.729999+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:48:02.551 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:48:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.647+0000 7f75ca731700 1 Processor -- start 2021-06-25T04:48:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.647+0000 7f75ca731700 1 -- start start 2021-06-25T04:48:02.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75c40b26e0 0x7f75c413dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f75c4141750 0x7f75c413e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c40aaa50 con 0x7f75c40b0fb0 2021-06-25T04:48:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c4141be0 con 0x7f75c4141750 2021-06-25T04:48:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c4140c50 con 0x7f75c40b26e0 2021-06-25T04:48:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75c9f30700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f75c4141750 0x7f75c413e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75c8f2e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f75c40b0fb0 0x7f75c4141040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53200/0 (socket says 172.21.15.57:53200) 2021-06-25T04:48:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75c8f2e700 1 -- 172.21.15.57:0/948036918 learned_addr learned my addr 172.21.15.57:0/948036918 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75c972f700 1 --2- 172.21.15.57:0/948036918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75c40b26e0 0x7f75c413dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75c9f30700 1 -- 172.21.15.57:0/948036918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75c40b26e0 msgr2=0x7f75c413dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75c9f30700 1 --2- 172.21.15.57:0/948036918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75c40b26e0 0x7f75c413dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75c9f30700 1 -- 172.21.15.57:0/948036918 >> v1:172.21.15.57:6789/0 conn(0x7f75c40b0fb0 legacy=0x7f75c4141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75bbfff700 1 -- 172.21.15.57:0/948036918 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669122280 0 0) 0x7f75c0001490 con 0x7f75c40b0fb0 2021-06-25T04:48:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75c9f30700 1 -- 172.21.15.57:0/948036918 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c40b2ac0 con 0x7f75c4141750 2021-06-25T04:48:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75c9f30700 1 --2- 172.21.15.57:0/948036918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75c4141750 0x7f75c413e4e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f75bc002f70 tx=0x7f75bc006df0).ready entity=mon.0 client_cookie=66407b1b8da45994 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75bbfff700 1 -- 172.21.15.57:0/948036918 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75bc00d570 con 0x7f75c4141750 2021-06-25T04:48:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75bbfff700 1 -- 172.21.15.57:0/948036918 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc000e90 con 0x7f75c4141750 2021-06-25T04:48:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75bbfff700 1 -- 172.21.15.57:0/948036918 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75bc00d8c0 con 0x7f75c4141750 2021-06-25T04:48:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 -- 172.21.15.57:0/948036918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75c4141750 msgr2=0x7f75c413e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 --2- 172.21.15.57:0/948036918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75c4141750 0x7f75c413e4e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f75bc002f70 tx=0x7f75bc006df0).stop 2021-06-25T04:48:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 -- 172.21.15.57:0/948036918 shutdown_connections 2021-06-25T04:48:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 --2- 172.21.15.57:0/948036918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75c4141750 0x7f75c413e4e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 --2- 172.21.15.57:0/948036918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75c40b26e0 0x7f75c413dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 -- 172.21.15.57:0/948036918 >> 172.21.15.57:0/948036918 conn(0x7f75c4060140 msgr2=0x7f75c40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 -- 172.21.15.57:0/948036918 shutdown_connections 2021-06-25T04:48:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 -- 172.21.15.57:0/948036918 wait complete. 2021-06-25T04:48:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 Processor -- start 2021-06-25T04:48:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.651+0000 7f75ca731700 1 -- start start 2021-06-25T04:48:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75ca731700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75c40b0fb0 0x7f75c40afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75ca731700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75c40b26e0 0x7f75c41465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75ca731700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75c4141750 0x7f75c4150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75ca731700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c414fec0 con 0x7f75c40b0fb0 2021-06-25T04:48:02.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75ca731700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c4147210 con 0x7f75c40b26e0 2021-06-25T04:48:02.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75ca731700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c4134340 con 0x7f75c4141750 2021-06-25T04:48:02.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c972f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75c40b0fb0 0x7f75c40afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c972f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75c40b0fb0 0x7f75c40afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35988/0 (socket says 172.21.15.57:35988) 2021-06-25T04:48:02.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c972f700 1 -- 172.21.15.57:0/2266254766 learned_addr learned my addr 172.21.15.57:0/2266254766 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:02.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c8f2e700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75c40b26e0 0x7f75c41465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c9f30700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75c4141750 0x7f75c4150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c972f700 1 -- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75c4141750 msgr2=0x7f75c4150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c972f700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75c4141750 0x7f75c4150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c972f700 1 -- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75c40b26e0 msgr2=0x7f75c41465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c972f700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75c40b26e0 0x7f75c41465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c972f700 1 -- 172.21.15.57:0/2266254766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc00b180 con 0x7f75c40b0fb0 2021-06-25T04:48:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c8f2e700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75c40b26e0 0x7f75c41465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75c972f700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75c40b0fb0 0x7f75c40afba0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f75b400a000 tx=0x7f75b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75ba7fc700 1 -- 172.21.15.57:0/2266254766 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b4011780 con 0x7f75c40b0fb0 2021-06-25T04:48:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75ba7fc700 1 -- 172.21.15.57:0/2266254766 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b40118e0 con 0x7f75c40b0fb0 2021-06-25T04:48:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75ca731700 1 -- 172.21.15.57:0/2266254766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c4146cd0 con 0x7f75c40b0fb0 2021-06-25T04:48:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75ba7fc700 1 -- 172.21.15.57:0/2266254766 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b4011c40 con 0x7f75c40b0fb0 2021-06-25T04:48:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.655+0000 7f75ca731700 1 -- 172.21.15.57:0/2266254766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c41500b0 con 0x7f75c40b0fb0 2021-06-25T04:48:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.659+0000 7f75ba7fc700 1 -- 172.21.15.57:0/2266254766 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f75b401c460 con 0x7f75c40b0fb0 2021-06-25T04:48:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.659+0000 7f75ca731700 1 -- 172.21.15.57:0/2266254766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c4150270 con 0x7f75c40b0fb0 2021-06-25T04:48:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.659+0000 7f75ba7fc700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ac055490 0x7f75ac057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.659+0000 7f75ba7fc700 1 -- 172.21.15.57:0/2266254766 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f75b406e370 con 0x7f75c40b0fb0 2021-06-25T04:48:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.659+0000 7f75c8f2e700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ac055490 0x7f75ac057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.659+0000 7f75c8f2e700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ac055490 0x7f75ac057950 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f75c000b000 tx=0x7f75c0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.663+0000 7f75ba7fc700 1 -- 172.21.15.57:0/2266254766 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f75b40444c0 con 0x7f75c40b0fb0 2021-06-25T04:48:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.787+0000 7f75ca731700 1 -- 172.21.15.57:0/2266254766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f75c4057310 con 0x7f75c40b0fb0 2021-06-25T04:48:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.787+0000 7f75ba7fc700 1 -- 172.21.15.57:0/2266254766 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f75b4047ae0 con 0x7f75c40b0fb0 2021-06-25T04:48:02.797 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:48:02.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 -- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ac055490 msgr2=0x7f75ac057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ac055490 0x7f75ac057950 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f75c000b000 tx=0x7f75c0009040).stop 2021-06-25T04:48:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 -- 172.21.15.57:0/2266254766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75c40b0fb0 msgr2=0x7f75c40afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75c40b0fb0 0x7f75c40afba0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f75b400a000 tx=0x7f75b4008040).stop 2021-06-25T04:48:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 -- 172.21.15.57:0/2266254766 shutdown_connections 2021-06-25T04:48:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ac055490 0x7f75ac057950 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75c4141750 0x7f75c4150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75c40b26e0 0x7f75c41465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 --2- 172.21.15.57:0/2266254766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75c40b0fb0 0x7f75c40afba0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 -- 172.21.15.57:0/2266254766 >> 172.21.15.57:0/2266254766 conn(0x7f75c4060140 msgr2=0x7f75c413cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:02.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 -- 172.21.15.57:0/2266254766 shutdown_connections 2021-06-25T04:48:02.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.791+0000 7f75ca731700 1 -- 172.21.15.57:0/2266254766 wait complete. 2021-06-25T04:48:02.809 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:48:02.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7fb005001700 1 Processor -- start 2021-06-25T04:48:02.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7fb005001700 1 -- start start 2021-06-25T04:48:02.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7fb005001700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0000b4650 0x7fb000140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7fb005001700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb000143b20 con 0x7fb000146910 2021-06-25T04:48:02.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7fb005001700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb000143dc0 con 0x7fb0000b4140 2021-06-25T04:48:02.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7fb005001700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0001474d0 con 0x7fb0000b4650 2021-06-25T04:48:02.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffed9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb000146910 0x7fb0001401f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53214/0 (socket says 172.21.15.57:53214) 2021-06-25T04:48:02.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffed9d700 1 -- 172.21.15.57:0/2621119991 learned_addr learned my addr 172.21.15.57:0/2621119991 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:02.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7fafff59e700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0000b4650 0x7fb000140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549175724 0 0) 0x7fb000143b20 con 0x7fb000146910 2021-06-25T04:48:02.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe0003260 con 0x7fb000146910 2021-06-25T04:48:02.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190131875 0 0) 0x7fb000143dc0 con 0x7fb0000b4140 2021-06-25T04:48:02.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb000143b20 con 0x7fb0000b4140 2021-06-25T04:48:02.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2563218742 0 0) 0x7fafe0003260 con 0x7fb000146910 2021-06-25T04:48:02.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0000b4650 msgr2=0x7fb000140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:02.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0000b4650 0x7fb000140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 >> v1:172.21.15.87:6789/0 conn(0x7fb0000b4140 legacy=0x7fb0000b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0000b0c50 con 0x7fb000146910 2021-06-25T04:48:02.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7faff0001660 con 0x7fb000146910 2021-06-25T04:48:02.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 >> v1:172.21.15.57:6789/0 conn(0x7fb000146910 legacy=0x7fb0001401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe0003910 0x7fafe0003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0000b4650 0x7fafe0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe00049f0 0x7fafe0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0001474d0 con 0x7fafe0003910 2021-06-25T04:48:02.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe000b7b0 con 0x7fafe00049f0 2021-06-25T04:48:02.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe000b970 con 0x7fb0000b4650 2021-06-25T04:48:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faffed9d700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe0003910 0x7fafe0003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.915+0000 7faff7fff700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0000b4650 0x7fafe0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7fafff59e700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe00049f0 0x7fafe0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7faffed9d700 1 -- 172.21.15.57:0/2621119991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0000b4650 msgr2=0x7fafe0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7faffed9d700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0000b4650 0x7fafe0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7faffed9d700 1 -- 172.21.15.57:0/2621119991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe00049f0 msgr2=0x7fafe0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7faffed9d700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe00049f0 0x7fafe0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7faffed9d700 1 -- 172.21.15.57:0/2621119991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0003260 con 0x7fafe0003910 2021-06-25T04:48:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7faffed9d700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe0003910 0x7fafe0003d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7faff0001430 tx=0x7fb000060c90).ready entity=mon.0 client_cookie=f25b4a5d45752243 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faff00077e0 con 0x7fafe0003910 2021-06-25T04:48:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff00070d0 con 0x7fafe0003910 2021-06-25T04:48:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7faffe59c700 1 -- 172.21.15.57:0/2621119991 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faff0007430 con 0x7fafe0003910 2021-06-25T04:48:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7fb005001700 1 -- 172.21.15.57:0/2621119991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe0003910 msgr2=0x7fafe0003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7fb005001700 1 --2- 172.21.15.57:0/2621119991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe0003910 0x7fafe0003d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7faff0001430 tx=0x7fb000060c90).stop 2021-06-25T04:48:02.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7fafff59e700 1 -- 172.21.15.57:0/2621119991 reap_dead start 2021-06-25T04:48:02.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7fb005001700 1 -- 172.21.15.57:0/2621119991 shutdown_connections 2021-06-25T04:48:02.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7fb005001700 1 -- 172.21.15.57:0/2621119991 >> 172.21.15.57:0/2621119991 conn(0x7fb00005c450 msgr2=0x7fb00005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:02.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7fb005001700 1 -- 172.21.15.57:0/2621119991 shutdown_connections 2021-06-25T04:48:02.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7fb005001700 1 -- 172.21.15.57:0/2621119991 wait complete. 2021-06-25T04:48:02.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7fb005001700 1 Processor -- start 2021-06-25T04:48:02.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.919+0000 7fb005001700 1 -- start start 2021-06-25T04:48:02.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7fb005001700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0000b5090 0x7fb00013b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7fb005001700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00013d400 0x7fb00013bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7fb005001700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb00013ac10 0x7fb00013b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7fb005001700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00013c2e0 con 0x7fb00013d400 2021-06-25T04:48:02.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7fb005001700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000b06f0 con 0x7fb0000b5090 2021-06-25T04:48:02.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7fb005001700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb000155840 con 0x7fb00013ac10 2021-06-25T04:48:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faff7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00013d400 0x7fb00013bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faff7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00013d400 0x7fb00013bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36010/0 (socket says 172.21.15.57:36010) 2021-06-25T04:48:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faff7fff700 1 -- 172.21.15.57:0/1602977649 learned_addr learned my addr 172.21.15.57:0/1602977649 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faffed9d700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0000b5090 0x7fb00013b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7fafff59e700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb00013ac10 0x7fb00013b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faff7fff700 1 -- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb00013ac10 msgr2=0x7fb00013b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faff7fff700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb00013ac10 0x7fb00013b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faff7fff700 1 -- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0000b5090 msgr2=0x7fb00013b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faff7fff700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0000b5090 0x7fb00013b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:02.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faff7fff700 1 -- 172.21.15.57:0/1602977649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000155ae0 con 0x7fb00013d400 2021-06-25T04:48:02.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7fafff59e700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb00013ac10 0x7fb00013b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:48:02.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faff7fff700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00013d400 0x7fb00013bdf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fafe800d000 tx=0x7fafe8007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faffcd99700 1 -- 172.21.15.57:0/1602977649 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafe800f800 con 0x7fb00013d400 2021-06-25T04:48:02.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faffcd99700 1 -- 172.21.15.57:0/1602977649 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe800f960 con 0x7fb00013d400 2021-06-25T04:48:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faffcd99700 1 -- 172.21.15.57:0/1602977649 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafe800fcc0 con 0x7fb00013d400 2021-06-25T04:48:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7fb005001700 1 -- 172.21.15.57:0/1602977649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb000155d80 con 0x7fb00013d400 2021-06-25T04:48:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7fb005001700 1 -- 172.21.15.57:0/1602977649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00013b580 con 0x7fb00013d400 2021-06-25T04:48:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7fb005001700 1 -- 172.21.15.57:0/1602977649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb000057310 con 0x7fb00013d400 2021-06-25T04:48:02.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faffcd99700 1 -- 172.21.15.57:0/1602977649 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fafe801b030 con 0x7fb00013d400 2021-06-25T04:48:02.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.923+0000 7faffcd99700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafe4055490 0x7fafe4057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:02.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.927+0000 7faffcd99700 1 -- 172.21.15.57:0/1602977649 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fafe806e160 con 0x7fb00013d400 2021-06-25T04:48:02.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.927+0000 7faffed9d700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafe4055490 0x7fafe4057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:02.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.927+0000 7faffed9d700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafe4055490 0x7fafe4057950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7faff0017000 tx=0x7faff0015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:02.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:02.935+0000 7faffcd99700 1 -- 172.21.15.57:0/1602977649 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fafe8044270 con 0x7fb00013d400 2021-06-25T04:48:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.059+0000 7fb005001700 1 -- 172.21.15.57:0/1602977649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb0000698a0 con 0x7fb00013d400 2021-06-25T04:48:03.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.059+0000 7faffcd99700 1 -- 172.21.15.57:0/1602977649 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fafe8047890 con 0x7fb00013d400 2021-06-25T04:48:03.068 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:03.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 -- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafe4055490 msgr2=0x7fafe4057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafe4055490 0x7fafe4057950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7faff0017000 tx=0x7faff0015000).stop 2021-06-25T04:48:03.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 -- 172.21.15.57:0/1602977649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00013d400 msgr2=0x7fb00013bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00013d400 0x7fb00013bdf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fafe800d000 tx=0x7fafe8007a00).stop 2021-06-25T04:48:03.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 -- 172.21.15.57:0/1602977649 shutdown_connections 2021-06-25T04:48:03.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafe4055490 0x7fafe4057950 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb00013ac10 0x7fb00013b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00013d400 0x7fb00013bdf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 --2- 172.21.15.57:0/1602977649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0000b5090 0x7fb00013b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 -- 172.21.15.57:0/1602977649 >> 172.21.15.57:0/1602977649 conn(0x7fb00005c450 msgr2=0x7fb000140ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:03.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 -- 172.21.15.57:0/1602977649 shutdown_connections 2021-06-25T04:48:03.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.063+0000 7fb005001700 1 -- 172.21.15.57:0/1602977649 wait complete. 2021-06-25T04:48:03.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:48:03.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 Processor -- start 2021-06-25T04:48:03.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 -- start start 2021-06-25T04:48:03.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f51800b1e80 0x7f51800b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51800aff70 0x7f51800b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f51800a7080 0x7f5180141210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800b03e0 con 0x7f51800a7080 2021-06-25T04:48:03.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800b2750 con 0x7f51800b1e80 2021-06-25T04:48:03.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51800b0610 con 0x7f51800aff70 2021-06-25T04:48:03.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517ed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f51800a7080 0x7f5180141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517ed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f51800a7080 0x7f5180141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36020/0 (socket says 172.21.15.57:36020) 2021-06-25T04:48:03.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517ed9d700 1 -- 172.21.15.57:0/2344457763 learned_addr learned my addr 172.21.15.57:0/2344457763 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:03.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517dd9b700 1 --2- 172.21.15.57:0/2344457763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51800aff70 0x7f51800b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517e59c700 1 --2- 172.21.15.57:0/2344457763 >> v2:172.21.15.87:3300/0 conn(0x7f51800b1e80 0x7f51800b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517ed9d700 1 -- 172.21.15.57:0/2344457763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51800aff70 msgr2=0x7f51800b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:03.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517ed9d700 1 --2- 172.21.15.57:0/2344457763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51800aff70 0x7f51800b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517ed9d700 1 -- 172.21.15.57:0/2344457763 >> v2:172.21.15.87:3300/0 conn(0x7f51800b1e80 msgr2=0x7f51800b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:03.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517ed9d700 1 --2- 172.21.15.57:0/2344457763 >> v2:172.21.15.87:3300/0 conn(0x7f51800b1e80 0x7f51800b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517ed9d700 1 -- 172.21.15.57:0/2344457763 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51800b08b0 con 0x7f51800a7080 2021-06-25T04:48:03.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517ed9d700 1 --2- 172.21.15.57:0/2344457763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51800a7080 0x7f5180141210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f51780032f0 tx=0x7f5178009290).ready entity=mon.0 client_cookie=a40a7d044903e49c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:03.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517d59a700 1 -- 172.21.15.57:0/2344457763 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517800b680 con 0x7f51800a7080 2021-06-25T04:48:03.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517d59a700 1 -- 172.21.15.57:0/2344457763 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517800b7e0 con 0x7f51800a7080 2021-06-25T04:48:03.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f517d59a700 1 -- 172.21.15.57:0/2344457763 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517800b950 con 0x7f51800a7080 2021-06-25T04:48:03.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 -- 172.21.15.57:0/2344457763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51800a7080 msgr2=0x7f5180141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 --2- 172.21.15.57:0/2344457763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51800a7080 0x7f5180141210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f51780032f0 tx=0x7f5178009290).stop 2021-06-25T04:48:03.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 -- 172.21.15.57:0/2344457763 shutdown_connections 2021-06-25T04:48:03.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 --2- 172.21.15.57:0/2344457763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51800a7080 0x7f5180141210 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 --2- 172.21.15.57:0/2344457763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51800aff70 0x7f51800b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 --2- 172.21.15.57:0/2344457763 >> v2:172.21.15.87:3300/0 conn(0x7f51800b1e80 0x7f51800b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.187+0000 7f5184c83700 1 -- 172.21.15.57:0/2344457763 >> 172.21.15.57:0/2344457763 conn(0x7f518005f670 msgr2=0x7f518005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:03.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f5184c83700 1 -- 172.21.15.57:0/2344457763 shutdown_connections 2021-06-25T04:48:03.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f5184c83700 1 -- 172.21.15.57:0/2344457763 wait complete. 2021-06-25T04:48:03.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f5184c83700 1 Processor -- start 2021-06-25T04:48:03.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f5184c83700 1 -- start start 2021-06-25T04:48:03.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f5184c83700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51800a7080 0x7f518013dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f5184c83700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51800aff70 0x7f5180148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f5184c83700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51800b1e80 0x7f5180148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f5184c83700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518014a640 con 0x7f51800aff70 2021-06-25T04:48:03.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f5184c83700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51800b55b0 con 0x7f51800b1e80 2021-06-25T04:48:03.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f5184c83700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51800ac0e0 con 0x7f51800a7080 2021-06-25T04:48:03.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f517dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51800aff70 0x7f5180148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f517dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51800aff70 0x7f5180148af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36024/0 (socket says 172.21.15.57:36024) 2021-06-25T04:48:03.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f517dd9b700 1 -- 172.21.15.57:0/2351547412 learned_addr learned my addr 172.21.15.57:0/2351547412 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:03.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f517e59c700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51800a7080 0x7f518013dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f517ed9d700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51800b1e80 0x7f5180148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f517dd9b700 1 -- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51800a7080 msgr2=0x7f518013dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f517dd9b700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51800a7080 0x7f518013dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f517dd9b700 1 -- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51800b1e80 msgr2=0x7f5180148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f517dd9b700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51800b1e80 0x7f5180148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.191+0000 7f517dd9b700 1 -- 172.21.15.57:0/2351547412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5178009530 con 0x7f51800aff70 2021-06-25T04:48:03.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f517dd9b700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51800aff70 0x7f5180148af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f5180145970 tx=0x7f5168006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:03.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f51777fe700 1 -- 172.21.15.57:0/2351547412 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5168010780 con 0x7f51800aff70 2021-06-25T04:48:03.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f51777fe700 1 -- 172.21.15.57:0/2351547412 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51680108e0 con 0x7f51800aff70 2021-06-25T04:48:03.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f5184c83700 1 -- 172.21.15.57:0/2351547412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51800b3350 con 0x7f51800aff70 2021-06-25T04:48:03.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f51777fe700 1 -- 172.21.15.57:0/2351547412 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5168010c40 con 0x7f51800aff70 2021-06-25T04:48:03.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f5184c83700 1 -- 172.21.15.57:0/2351547412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518014a010 con 0x7f51800aff70 2021-06-25T04:48:03.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f5184c83700 1 -- 172.21.15.57:0/2351547412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51800b34e0 con 0x7f51800aff70 2021-06-25T04:48:03.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f51777fe700 1 -- 172.21.15.57:0/2351547412 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f516801c460 con 0x7f51800aff70 2021-06-25T04:48:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f51777fe700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5164055450 0x7f5164057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f51777fe700 1 -- 172.21.15.57:0/2351547412 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f516806e330 con 0x7f51800aff70 2021-06-25T04:48:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f517e59c700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5164055450 0x7f5164057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.195+0000 7f517e59c700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5164055450 0x7f5164057910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f517000b000 tx=0x7f5170006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.203+0000 7f51777fe700 1 -- 172.21.15.57:0/2351547412 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5168044480 con 0x7f51800aff70 2021-06-25T04:48:03.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.331+0000 7f5184c83700 1 -- 172.21.15.57:0/2351547412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51800ac2a0 con 0x7f51800aff70 2021-06-25T04:48:03.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f51777fe700 1 -- 172.21.15.57:0/2351547412 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5168047aa0 con 0x7f51800aff70 2021-06-25T04:48:03.341 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:03.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 -- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5164055450 msgr2=0x7f5164057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5164055450 0x7f5164057910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f517000b000 tx=0x7f5170006df0).stop 2021-06-25T04:48:03.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 -- 172.21.15.57:0/2351547412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51800aff70 msgr2=0x7f5180148af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51800aff70 0x7f5180148af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f5180145970 tx=0x7f5168006df0).stop 2021-06-25T04:48:03.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 -- 172.21.15.57:0/2351547412 shutdown_connections 2021-06-25T04:48:03.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5164055450 0x7f5164057910 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51800b1e80 0x7f5180148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51800aff70 0x7f5180148af0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 --2- 172.21.15.57:0/2351547412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51800a7080 0x7f518013dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 -- 172.21.15.57:0/2351547412 >> 172.21.15.57:0/2351547412 conn(0x7f518005f670 msgr2=0x7f51800a7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:03.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 -- 172.21.15.57:0/2351547412 shutdown_connections 2021-06-25T04:48:03.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.335+0000 7f5184c83700 1 -- 172.21.15.57:0/2351547412 wait complete. 2021-06-25T04:48:03.354 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:48:03.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2b59e700 1 Processor -- start 2021-06-25T04:48:03.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2b59e700 1 -- start start 2021-06-25T04:48:03.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d2c0affd0 0x7f1d2c0a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c0a7080 con 0x7f1d2c0b2540 2021-06-25T04:48:03.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2b59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c0a72b0 con 0x7f1d2c0afb90 2021-06-25T04:48:03.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0a7550 con 0x7f1d2c0affd0 2021-06-25T04:48:03.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2a59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1d2c0b2540 0x7f1d2c14ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53248/0 (socket says 172.21.15.57:53248) 2021-06-25T04:48:03.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2a59c700 1 -- 172.21.15.57:0/170312148 learned_addr learned my addr 172.21.15.57:0/170312148 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:03.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d29d9b700 1 --2- 172.21.15.57:0/170312148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d2c0affd0 0x7f1d2c0a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2959a700 1 -- 172.21.15.57:0/170312148 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283537869 0 0) 0x7f1d2c0a7080 con 0x7f1d2c0b2540 2021-06-25T04:48:03.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2959a700 1 -- 172.21.15.57:0/170312148 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d0c003260 con 0x7f1d2c0b2540 2021-06-25T04:48:03.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2959a700 1 -- 172.21.15.57:0/170312148 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599102763 0 0) 0x7f1d2c0a72b0 con 0x7f1d2c0afb90 2021-06-25T04:48:03.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2959a700 1 -- 172.21.15.57:0/170312148 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d2c0a7080 con 0x7f1d2c0afb90 2021-06-25T04:48:03.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d29d9b700 1 -- 172.21.15.57:0/170312148 >> v1:172.21.15.87:6789/0 conn(0x7f1d2c0afb90 legacy=0x7f1d2c151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d29d9b700 1 -- 172.21.15.57:0/170312148 >> v1:172.21.15.57:6789/0 conn(0x7f1d2c0b2540 legacy=0x7f1d2c14ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d29d9b700 1 -- 172.21.15.57:0/170312148 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c0a77f0 con 0x7f1d2c0affd0 2021-06-25T04:48:03.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d29d9b700 1 --2- 172.21.15.57:0/170312148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d2c0affd0 0x7f1d2c0a8370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1d14002f70 tx=0x7f1d14006df0).ready entity=mon.2 client_cookie=92908d7dd632c24e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:03.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2959a700 1 -- 172.21.15.57:0/170312148 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d1400d5c0 con 0x7f1d2c0affd0 2021-06-25T04:48:03.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2959a700 1 -- 172.21.15.57:0/170312148 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d14000e90 con 0x7f1d2c0affd0 2021-06-25T04:48:03.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2b59e700 1 -- 172.21.15.57:0/170312148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d2c0affd0 msgr2=0x7f1d2c0a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.455+0000 7f1d2959a700 1 -- 172.21.15.57:0/170312148 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d1400d910 con 0x7f1d2c0affd0 2021-06-25T04:48:03.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.459+0000 7f1d2b59e700 1 --2- 172.21.15.57:0/170312148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d2c0affd0 0x7f1d2c0a8370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1d14002f70 tx=0x7f1d14006df0).stop 2021-06-25T04:48:03.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.459+0000 7f1d2b59e700 1 -- 172.21.15.57:0/170312148 shutdown_connections 2021-06-25T04:48:03.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.459+0000 7f1d2b59e700 1 --2- 172.21.15.57:0/170312148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d2c0affd0 0x7f1d2c0a8370 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.459+0000 7f1d2b59e700 1 -- 172.21.15.57:0/170312148 >> 172.21.15.57:0/170312148 conn(0x7f1d2c060140 msgr2=0x7f1d2c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:03.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.459+0000 7f1d2b59e700 1 -- 172.21.15.57:0/170312148 shutdown_connections 2021-06-25T04:48:03.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.459+0000 7f1d2b59e700 1 -- 172.21.15.57:0/170312148 wait complete. 2021-06-25T04:48:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.459+0000 7f1d2b59e700 1 Processor -- start 2021-06-25T04:48:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.459+0000 7f1d2b59e700 1 -- start start 2021-06-25T04:48:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c0afb90 0x7f1d2c14d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d2c0affd0 0x7f1d2c14dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d2c0b2540 0x7f1d2c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c143940 con 0x7f1d2c0afb90 2021-06-25T04:48:03.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c143be0 con 0x7f1d2c0affd0 2021-06-25T04:48:03.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c156210 con 0x7f1d2c0b2540 2021-06-25T04:48:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c0afb90 0x7f1d2c14d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c0afb90 0x7f1d2c14d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36036/0 (socket says 172.21.15.57:36036) 2021-06-25T04:48:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2a59c700 1 -- 172.21.15.57:0/1519694425 learned_addr learned my addr 172.21.15.57:0/1519694425 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d29d9b700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d2c0affd0 0x7f1d2c14dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2ad9d700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d2c0b2540 0x7f1d2c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2a59c700 1 -- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d2c0b2540 msgr2=0x7f1d2c156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2a59c700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d2c0b2540 0x7f1d2c156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2a59c700 1 -- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d2c0affd0 msgr2=0x7f1d2c14dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2a59c700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d2c0affd0 0x7f1d2c14dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2a59c700 1 -- 172.21.15.57:0/1519694425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1400b180 con 0x7f1d2c0afb90 2021-06-25T04:48:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2a59c700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c0afb90 0x7f1d2c14d490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f1d1c0010d0 tx=0x7f1d1c007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d237fe700 1 -- 172.21.15.57:0/1519694425 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d1c00ce50 con 0x7f1d2c0afb90 2021-06-25T04:48:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d237fe700 1 -- 172.21.15.57:0/1519694425 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c0070d0 con 0x7f1d2c0afb90 2021-06-25T04:48:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2b59e700 1 -- 172.21.15.57:0/1519694425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c1564b0 con 0x7f1d2c0afb90 2021-06-25T04:48:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d237fe700 1 -- 172.21.15.57:0/1519694425 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d1c007430 con 0x7f1d2c0afb90 2021-06-25T04:48:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2b59e700 1 -- 172.21.15.57:0/1519694425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c14e160 con 0x7f1d2c0afb90 2021-06-25T04:48:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d237fe700 1 -- 172.21.15.57:0/1519694425 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1d1c010070 con 0x7f1d2c0afb90 2021-06-25T04:48:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.463+0000 7f1d2b59e700 1 -- 172.21.15.57:0/1519694425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2c156640 con 0x7f1d2c0afb90 2021-06-25T04:48:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.467+0000 7f1d237fe700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1d10055450 0x7f1d10057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.467+0000 7f1d237fe700 1 -- 172.21.15.57:0/1519694425 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1d1c06d550 con 0x7f1d2c0afb90 2021-06-25T04:48:03.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.467+0000 7f1d29d9b700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1d10055450 0x7f1d10057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.467+0000 7f1d29d9b700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1d10055450 0x7f1d10057910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1d14019000 tx=0x7f1d14014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:03.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.471+0000 7f1d237fe700 1 -- 172.21.15.57:0/1519694425 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1d1c0435f0 con 0x7f1d2c0afb90 2021-06-25T04:48:03.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 -- 172.21.15.57:0/1519694425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d2c057310 con 0x7f1d2c0afb90 2021-06-25T04:48:03.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d237fe700 1 -- 172.21.15.57:0/1519694425 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1d1c046c10 con 0x7f1d2c0afb90 2021-06-25T04:48:03.606 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:03.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 -- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1d10055450 msgr2=0x7f1d10057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1d10055450 0x7f1d10057910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1d14019000 tx=0x7f1d14014000).stop 2021-06-25T04:48:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 -- 172.21.15.57:0/1519694425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c0afb90 msgr2=0x7f1d2c14d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c0afb90 0x7f1d2c14d490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f1d1c0010d0 tx=0x7f1d1c007b00).stop 2021-06-25T04:48:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 -- 172.21.15.57:0/1519694425 shutdown_connections 2021-06-25T04:48:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1d10055450 0x7f1d10057910 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d2c0b2540 0x7f1d2c156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d2c0affd0 0x7f1d2c14dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 --2- 172.21.15.57:0/1519694425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c0afb90 0x7f1d2c14d490 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 -- 172.21.15.57:0/1519694425 >> 172.21.15.57:0/1519694425 conn(0x7f1d2c060140 msgr2=0x7f1d2c146380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 -- 172.21.15.57:0/1519694425 shutdown_connections 2021-06-25T04:48:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.599+0000 7f1d2b59e700 1 -- 172.21.15.57:0/1519694425 wait complete. 2021-06-25T04:48:03.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:48:03.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.715+0000 7fb0e2d7b700 1 Processor -- start 2021-06-25T04:48:03.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e2d7b700 1 -- start start 2021-06-25T04:48:03.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e2d7b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0dc0af0f0 0x7fb0dc067820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e2d7b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0dc144410 con 0x7fb0dc0afd20 2021-06-25T04:48:03.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e2d7b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0dc0b2bf0 con 0x7fb0dc0b2810 2021-06-25T04:48:03.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e2d7b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc1452c0 con 0x7fb0dc0af0f0 2021-06-25T04:48:03.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e257a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb0dc0afd20 0x7fb0dc140e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53266/0 (socket says 172.21.15.57:53266) 2021-06-25T04:48:03.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e257a700 1 -- 172.21.15.57:0/2540247132 learned_addr learned my addr 172.21.15.57:0/2540247132 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:03.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e1578700 1 --2- 172.21.15.57:0/2540247132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0dc0af0f0 0x7fb0dc067820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e0d77700 1 -- 172.21.15.57:0/2540247132 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753276808 0 0) 0x7fb0dc144410 con 0x7fb0dc0afd20 2021-06-25T04:48:03.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e0d77700 1 -- 172.21.15.57:0/2540247132 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0c4003260 con 0x7fb0dc0afd20 2021-06-25T04:48:03.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e1578700 1 -- 172.21.15.57:0/2540247132 >> v1:172.21.15.87:6789/0 conn(0x7fb0dc0b2810 legacy=0x7fb0dc067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e1578700 1 -- 172.21.15.57:0/2540247132 >> v1:172.21.15.57:6789/0 conn(0x7fb0dc0afd20 legacy=0x7fb0dc140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e1578700 1 -- 172.21.15.57:0/2540247132 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc144640 con 0x7fb0dc0af0f0 2021-06-25T04:48:03.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e1578700 1 --2- 172.21.15.57:0/2540247132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0dc0af0f0 0x7fb0dc067820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb0cc002f70 tx=0x7fb0cc006df0).ready entity=mon.2 client_cookie=2d5ed4bb2445e0e4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:03.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e0d77700 1 -- 172.21.15.57:0/2540247132 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0cc00d570 con 0x7fb0dc0af0f0 2021-06-25T04:48:03.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e0d77700 1 -- 172.21.15.57:0/2540247132 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc000e90 con 0x7fb0dc0af0f0 2021-06-25T04:48:03.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e0d77700 1 -- 172.21.15.57:0/2540247132 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0cc00d8c0 con 0x7fb0dc0af0f0 2021-06-25T04:48:03.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2540247132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0dc0af0f0 msgr2=0x7fb0dc067820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.719+0000 7fb0e2d7b700 1 --2- 172.21.15.57:0/2540247132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0dc0af0f0 0x7fb0dc067820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb0cc002f70 tx=0x7fb0cc006df0).stop 2021-06-25T04:48:03.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.723+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2540247132 shutdown_connections 2021-06-25T04:48:03.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.723+0000 7fb0e2d7b700 1 --2- 172.21.15.57:0/2540247132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0dc0af0f0 0x7fb0dc067820 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.723+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2540247132 >> 172.21.15.57:0/2540247132 conn(0x7fb0dc0611f0 msgr2=0x7fb0dc062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:03.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.723+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2540247132 shutdown_connections 2021-06-25T04:48:03.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.723+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2540247132 wait complete. 2021-06-25T04:48:03.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.723+0000 7fb0e2d7b700 1 Processor -- start 2021-06-25T04:48:03.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.723+0000 7fb0e2d7b700 1 -- start start 2021-06-25T04:48:03.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e2d7b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0dc0af0f0 0x7fb0dc05f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e2d7b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0dc0afd20 0x7fb0dc150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e2d7b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0b2810 0x7fb0dc153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e2d7b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc153570 con 0x7fb0dc0afd20 2021-06-25T04:48:03.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e2d7b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc065200 con 0x7fb0dc0b2810 2021-06-25T04:48:03.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e2d7b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0654a0 con 0x7fb0dc0af0f0 2021-06-25T04:48:03.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e1578700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0dc0afd20 0x7fb0dc150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e1578700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0dc0afd20 0x7fb0dc150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36052/0 (socket says 172.21.15.57:36052) 2021-06-25T04:48:03.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e1578700 1 -- 172.21.15.57:0/2402300747 learned_addr learned my addr 172.21.15.57:0/2402300747 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:03.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e257a700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0b2810 0x7fb0dc153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e1d79700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0dc0af0f0 0x7fb0dc05f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e1578700 1 -- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0dc0af0f0 msgr2=0x7fb0dc05f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e1578700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0dc0af0f0 0x7fb0dc05f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e1578700 1 -- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0b2810 msgr2=0x7fb0dc153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e1578700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0b2810 0x7fb0dc153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e1578700 1 -- 172.21.15.57:0/2402300747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc00b180 con 0x7fb0dc0afd20 2021-06-25T04:48:03.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e257a700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0b2810 0x7fb0dc153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:03.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e1578700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0dc0afd20 0x7fb0dc150020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb0cc002f70 tx=0x7fb0cc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:03.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0caffd700 1 -- 172.21.15.57:0/2402300747 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0cc006b20 con 0x7fb0dc0afd20 2021-06-25T04:48:03.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0caffd700 1 -- 172.21.15.57:0/2402300747 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc012e80 con 0x7fb0dc0afd20 2021-06-25T04:48:03.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2402300747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0dc1537a0 con 0x7fb0dc0afd20 2021-06-25T04:48:03.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0caffd700 1 -- 172.21.15.57:0/2402300747 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0cc01e620 con 0x7fb0dc0afd20 2021-06-25T04:48:03.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2402300747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0dc060200 con 0x7fb0dc0afd20 2021-06-25T04:48:03.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2402300747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc153930 con 0x7fb0dc0afd20 2021-06-25T04:48:03.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0caffd700 1 -- 172.21.15.57:0/2402300747 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb0cc00f030 con 0x7fb0dc0afd20 2021-06-25T04:48:03.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0caffd700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0bc055510 0x7fb0bc0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.727+0000 7fb0caffd700 1 -- 172.21.15.57:0/2402300747 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb0cc06ef30 con 0x7fb0dc0afd20 2021-06-25T04:48:03.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.731+0000 7fb0e1d79700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0bc055510 0x7fb0bc0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.731+0000 7fb0e1d79700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0bc055510 0x7fb0bc0579d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb0d800d000 tx=0x7fb0d8007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:03.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.735+0000 7fb0caffd700 1 -- 172.21.15.57:0/2402300747 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb0cc045040 con 0x7fb0dc0afd20 2021-06-25T04:48:03.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.859+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2402300747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0dc13eac0 con 0x7fb0dc0afd20 2021-06-25T04:48:03.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.859+0000 7fb0caffd700 1 -- 172.21.15.57:0/2402300747 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fb0cc048660 con 0x7fb0dc0afd20 2021-06-25T04:48:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:03.869 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:47:41.021834+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:47:34.957337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-06-25T04:47:37.729999+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:48:03.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0bc055510 msgr2=0x7fb0bc0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0bc055510 0x7fb0bc0579d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb0d800d000 tx=0x7fb0d8007b90).stop 2021-06-25T04:48:03.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2402300747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0dc0afd20 msgr2=0x7fb0dc150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0dc0afd20 0x7fb0dc150020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb0cc002f70 tx=0x7fb0cc014000).stop 2021-06-25T04:48:03.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2402300747 shutdown_connections 2021-06-25T04:48:03.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0bc055510 0x7fb0bc0579d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0b2810 0x7fb0dc153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0dc0afd20 0x7fb0dc150020 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 --2- 172.21.15.57:0/2402300747 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0dc0af0f0 0x7fb0dc05f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2402300747 >> 172.21.15.57:0/2402300747 conn(0x7fb0dc0611f0 msgr2=0x7fb0dc13d640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:03.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2402300747 shutdown_connections 2021-06-25T04:48:03.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.863+0000 7fb0e2d7b700 1 -- 172.21.15.57:0/2402300747 wait complete. 2021-06-25T04:48:03.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:47:34.957337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:47:37.729999+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:48:03.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:48:03.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa496ff7700 1 Processor -- start 2021-06-25T04:48:03.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa496ff7700 1 -- start start 2021-06-25T04:48:03.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa496ff7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4900b2540 0x7fa49014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa496ff7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4900a8a80 0x7fa49014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:03.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa496ff7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4900a7080 con 0x7fa4900affd0 2021-06-25T04:48:03.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa496ff7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4900a72b0 con 0x7fa4900b2540 2021-06-25T04:48:03.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa496ff7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900a7550 con 0x7fa4900a8a80 2021-06-25T04:48:03.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa495ff5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4900b2540 0x7fa49014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa495ff5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4900b2540 0x7fa49014ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36058/0 (socket says 172.21.15.57:36058) 2021-06-25T04:48:03.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa495ff5700 1 -- 172.21.15.57:0/315063848 learned_addr learned my addr 172.21.15.57:0/315063848 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:03.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa4967f6700 1 --2- 172.21.15.57:0/315063848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4900a8a80 0x7fa49014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:03.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa495ff5700 1 -- 172.21.15.57:0/315063848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4900a8a80 msgr2=0x7fa49014b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:03.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa495ff5700 1 --2- 172.21.15.57:0/315063848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4900a8a80 0x7fa49014b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:03.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa495ff5700 1 -- 172.21.15.57:0/315063848 >> v1:172.21.15.87:6789/0 conn(0x7fa4900affd0 legacy=0x7fa4900a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:03.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa495ff5700 1 -- 172.21.15.57:0/315063848 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900a77f0 con 0x7fa4900b2540 2021-06-25T04:48:03.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa494ff3700 1 -- 172.21.15.57:0/315063848 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850398756 0 0) 0x7fa4900a7080 con 0x7fa4900affd0 2021-06-25T04:48:03.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa495ff5700 1 --2- 172.21.15.57:0/315063848 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4900b2540 0x7fa49014ae00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fa48c002f70 tx=0x7fa48c006eb0).ready entity=mon.0 client_cookie=a356721c73644679 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa494ff3700 1 -- 172.21.15.57:0/315063848 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48c00d570 con 0x7fa4900b2540 2021-06-25T04:48:04.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa494ff3700 1 -- 172.21.15.57:0/315063848 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c000e90 con 0x7fa4900b2540 2021-06-25T04:48:04.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa494ff3700 1 -- 172.21.15.57:0/315063848 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48c00d8c0 con 0x7fa4900b2540 2021-06-25T04:48:04.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa496ff7700 1 -- 172.21.15.57:0/315063848 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4900b2540 msgr2=0x7fa49014ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.987+0000 7fa496ff7700 1 --2- 172.21.15.57:0/315063848 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4900b2540 0x7fa49014ae00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fa48c002f70 tx=0x7fa48c006eb0).stop 2021-06-25T04:48:04.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 -- 172.21.15.57:0/315063848 shutdown_connections 2021-06-25T04:48:04.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 --2- 172.21.15.57:0/315063848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4900a8a80 0x7fa49014b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 --2- 172.21.15.57:0/315063848 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4900b2540 0x7fa49014ae00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 -- 172.21.15.57:0/315063848 >> 172.21.15.57:0/315063848 conn(0x7fa490060140 msgr2=0x7fa4900b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:04.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 -- 172.21.15.57:0/315063848 shutdown_connections 2021-06-25T04:48:04.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 -- 172.21.15.57:0/315063848 wait complete. 2021-06-25T04:48:04.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 Processor -- start 2021-06-25T04:48:04.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 -- start start 2021-06-25T04:48:04.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4900a8a80 0x7fa4900aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4900affd0 0x7fa490141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4900b2540 0x7fa490141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49014b330 con 0x7fa4900a8a80 2021-06-25T04:48:04.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa490149c50 con 0x7fa4900affd0 2021-06-25T04:48:04.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa490149ef0 con 0x7fa4900b2540 2021-06-25T04:48:04.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa495ff5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4900a8a80 0x7fa4900aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa495ff5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4900a8a80 0x7fa4900aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36064/0 (socket says 172.21.15.57:36064) 2021-06-25T04:48:04.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa495ff5700 1 -- 172.21.15.57:0/3673923987 learned_addr learned my addr 172.21.15.57:0/3673923987 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:04.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa4957f4700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4900affd0 0x7fa490141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa495ff5700 1 -- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4900b2540 msgr2=0x7fa490141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa495ff5700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4900b2540 0x7fa490141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-06-25T04:48:04.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa495ff5700 1 -- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4900affd0 msgr2=0x7fa490141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa495ff5700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4900affd0 0x7fa490141460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa495ff5700 1 -- 172.21.15.57:0/3673923987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c00b1e0 con 0x7fa4900a8a80 2021-06-25T04:48:04.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa4957f4700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4900affd0 0x7fa490141460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:48:04.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa495ff5700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4900a8a80 0x7fa4900aebc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa48c002f70 tx=0x7fa48c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa486ffd700 1 -- 172.21.15.57:0/3673923987 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48c021070 con 0x7fa4900a8a80 2021-06-25T04:48:04.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa486ffd700 1 -- 172.21.15.57:0/3673923987 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c000e90 con 0x7fa4900a8a80 2021-06-25T04:48:04.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 -- 172.21.15.57:0/3673923987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49014a190 con 0x7fa4900a8a80 2021-06-25T04:48:04.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa486ffd700 1 -- 172.21.15.57:0/3673923987 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa48c011a50 con 0x7fa4900a8a80 2021-06-25T04:48:04.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.991+0000 7fa496ff7700 1 -- 172.21.15.57:0/3673923987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49014b020 con 0x7fa4900a8a80 2021-06-25T04:48:04.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.995+0000 7fa496ff7700 1 -- 172.21.15.57:0/3673923987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa490057310 con 0x7fa4900a8a80 2021-06-25T04:48:04.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.995+0000 7fa486ffd700 1 -- 172.21.15.57:0/3673923987 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa48c00f070 con 0x7fa4900a8a80 2021-06-25T04:48:04.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.995+0000 7fa486ffd700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4700554e0 0x7fa4700579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.995+0000 7fa486ffd700 1 -- 172.21.15.57:0/3673923987 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa48c06f2e0 con 0x7fa4900a8a80 2021-06-25T04:48:04.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.995+0000 7fa4957f4700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4700554e0 0x7fa4700579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:03.995+0000 7fa4957f4700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4700554e0 0x7fa4700579a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fa488008000 tx=0x7fa488009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.003+0000 7fa486ffd700 1 -- 172.21.15.57:0/3673923987 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa48c045490 con 0x7fa4900a8a80 2021-06-25T04:48:04.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa496ff7700 1 -- 172.21.15.57:0/3673923987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa4900698a0 con 0x7fa4900a8a80 2021-06-25T04:48:04.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa486ffd700 1 -- 172.21.15.57:0/3673923987 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa48c048ab0 con 0x7fa4900a8a80 2021-06-25T04:48:04.136 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:48:04.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa496ff7700 1 -- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4700554e0 msgr2=0x7fa4700579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa496ff7700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4700554e0 0x7fa4700579a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fa488008000 tx=0x7fa488009040).stop 2021-06-25T04:48:04.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa496ff7700 1 -- 172.21.15.57:0/3673923987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4900a8a80 msgr2=0x7fa4900aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa496ff7700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4900a8a80 0x7fa4900aebc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa48c002f70 tx=0x7fa48c015000).stop 2021-06-25T04:48:04.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa496ff7700 1 -- 172.21.15.57:0/3673923987 shutdown_connections 2021-06-25T04:48:04.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa496ff7700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4700554e0 0x7fa4700579a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa496ff7700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4900b2540 0x7fa490141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-06-25T04:48:04.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa496ff7700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4900affd0 0x7fa490141460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa496ff7700 1 --2- 172.21.15.57:0/3673923987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4900a8a80 0x7fa4900aebc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.127+0000 7fa496ff7700 1 -- 172.21.15.57:0/3673923987 >> 172.21.15.57:0/3673923987 conn(0x7fa490060140 msgr2=0x7fa49005c450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:04.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.131+0000 7fa496ff7700 1 -- 172.21.15.57:0/3673923987 shutdown_connections 2021-06-25T04:48:04.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.131+0000 7fa496ff7700 1 -- 172.21.15.57:0/3673923987 wait complete. 2021-06-25T04:48:04.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:48:04.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.255+0000 7fc4b67b1700 1 Processor -- start 2021-06-25T04:48:04.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.255+0000 7fc4b67b1700 1 -- start start 2021-06-25T04:48:04.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4b00af280 0x7fc4b00af660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc4b00ad810 0x7fc4b00a8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b00afd60 con 0x7fc4b00ad2e0 2021-06-25T04:48:04.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b005c5d0 con 0x7fc4b00af280 2021-06-25T04:48:04.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b01407c0 con 0x7fc4b00ad810 2021-06-25T04:48:04.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b57af700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4b00af280 0x7fc4b00af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b57af700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4b00af280 0x7fc4b00af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36072/0 (socket says 172.21.15.57:36072) 2021-06-25T04:48:04.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b57af700 1 -- 172.21.15.57:0/2862675062 learned_addr learned my addr 172.21.15.57:0/2862675062 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:04.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b5fb0700 1 --2- 172.21.15.57:0/2862675062 >> v2:172.21.15.87:3300/0 conn(0x7fc4b00ad810 0x7fc4b00a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b57af700 1 -- 172.21.15.57:0/2862675062 >> v2:172.21.15.87:3300/0 conn(0x7fc4b00ad810 msgr2=0x7fc4b00a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:04.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b57af700 1 --2- 172.21.15.57:0/2862675062 >> v2:172.21.15.87:3300/0 conn(0x7fc4b00ad810 0x7fc4b00a8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b57af700 1 -- 172.21.15.57:0/2862675062 >> v1:172.21.15.87:6789/0 conn(0x7fc4b00ad2e0 legacy=0x7fc4b0143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b57af700 1 -- 172.21.15.57:0/2862675062 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0143820 con 0x7fc4b00af280 2021-06-25T04:48:04.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b57af700 1 --2- 172.21.15.57:0/2862675062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b00af280 0x7fc4b00af660 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc4b00ad730 tx=0x7fc4ac006eb0).ready entity=mon.0 client_cookie=b83d45501c30c34c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc49ffff700 1 -- 172.21.15.57:0/2862675062 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4ac00d610 con 0x7fc4b00af280 2021-06-25T04:48:04.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc49ffff700 1 -- 172.21.15.57:0/2862675062 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac000e90 con 0x7fc4b00af280 2021-06-25T04:48:04.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc49ffff700 1 -- 172.21.15.57:0/2862675062 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4ac00d960 con 0x7fc4b00af280 2021-06-25T04:48:04.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 -- 172.21.15.57:0/2862675062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b00af280 msgr2=0x7fc4b00af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 --2- 172.21.15.57:0/2862675062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b00af280 0x7fc4b00af660 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc4b00ad730 tx=0x7fc4ac006eb0).stop 2021-06-25T04:48:04.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 -- 172.21.15.57:0/2862675062 shutdown_connections 2021-06-25T04:48:04.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 --2- 172.21.15.57:0/2862675062 >> v2:172.21.15.87:3300/0 conn(0x7fc4b00ad810 0x7fc4b00a8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 --2- 172.21.15.57:0/2862675062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b00af280 0x7fc4b00af660 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 -- 172.21.15.57:0/2862675062 >> 172.21.15.57:0/2862675062 conn(0x7fc4b0061100 msgr2=0x7fc4b0062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 -- 172.21.15.57:0/2862675062 shutdown_connections 2021-06-25T04:48:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.259+0000 7fc4b67b1700 1 -- 172.21.15.57:0/2862675062 wait complete. 2021-06-25T04:48:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b67b1700 1 Processor -- start 2021-06-25T04:48:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b67b1700 1 -- start start 2021-06-25T04:48:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b67b1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b00ad2e0 0x7fc4b00b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b67b1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4b00ad810 0x7fc4b00ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b67b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b00af280 0x7fc4b00abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b67b1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00ac260 con 0x7fc4b00af280 2021-06-25T04:48:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b67b1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0065720 con 0x7fc4b00ad2e0 2021-06-25T04:48:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b67b1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00ab190 con 0x7fc4b00ad810 2021-06-25T04:48:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b5fb0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b00af280 0x7fc4b00abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b5fb0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b00af280 0x7fc4b00abd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36082/0 (socket says 172.21.15.57:36082) 2021-06-25T04:48:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b5fb0700 1 -- 172.21.15.57:0/4148313326 learned_addr learned my addr 172.21.15.57:0/4148313326 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b57af700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b00ad2e0 0x7fc4b00b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b4fae700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4b00ad810 0x7fc4b00ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b5fb0700 1 -- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4b00ad810 msgr2=0x7fc4b00ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b5fb0700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4b00ad810 0x7fc4b00ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b5fb0700 1 -- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b00ad2e0 msgr2=0x7fc4b00b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b5fb0700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b00ad2e0 0x7fc4b00b5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b5fb0700 1 -- 172.21.15.57:0/4148313326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac00b1e0 con 0x7fc4b00af280 2021-06-25T04:48:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b5fb0700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b00af280 0x7fc4b00abd70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fc4b00ac3a0 tx=0x7fc4a8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc49e7fc700 1 -- 172.21.15.57:0/4148313326 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a8013620 con 0x7fc4b00af280 2021-06-25T04:48:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc49e7fc700 1 -- 172.21.15.57:0/4148313326 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a8013780 con 0x7fc4b00af280 2021-06-25T04:48:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc49e7fc700 1 -- 172.21.15.57:0/4148313326 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a8013ae0 con 0x7fc4b00af280 2021-06-25T04:48:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b67b1700 1 -- 172.21.15.57:0/4148313326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b00ab430 con 0x7fc4b00af280 2021-06-25T04:48:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.263+0000 7fc4b67b1700 1 -- 172.21.15.57:0/4148313326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b0063690 con 0x7fc4b00af280 2021-06-25T04:48:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.267+0000 7fc4b67b1700 1 -- 172.21.15.57:0/4148313326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b0057310 con 0x7fc4b00af280 2021-06-25T04:48:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.267+0000 7fc49e7fc700 1 -- 172.21.15.57:0/4148313326 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc4a8013c40 con 0x7fc4b00af280 2021-06-25T04:48:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.267+0000 7fc49e7fc700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4900553d0 0x7fc490057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.267+0000 7fc49e7fc700 1 -- 172.21.15.57:0/4148313326 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc4a806e1c0 con 0x7fc4b00af280 2021-06-25T04:48:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.267+0000 7fc4b57af700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4900553d0 0x7fc490057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.267+0000 7fc4b57af700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4900553d0 0x7fc490057890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fc4ac01b000 tx=0x7fc4ac015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.275+0000 7fc49e7fc700 1 -- 172.21.15.57:0/4148313326 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc4a8044310 con 0x7fc4b00af280 2021-06-25T04:48:04.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc4b67b1700 1 -- 172.21.15.57:0/4148313326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc4b00ac870 con 0x7fc4b00af280 2021-06-25T04:48:04.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc49e7fc700 1 -- 172.21.15.57:0/4148313326 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc4a8047930 con 0x7fc4b00af280 2021-06-25T04:48:04.415 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:04.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc4b67b1700 1 -- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4900553d0 msgr2=0x7fc490057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc4b67b1700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4900553d0 0x7fc490057890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fc4ac01b000 tx=0x7fc4ac015000).stop 2021-06-25T04:48:04.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc4b67b1700 1 -- 172.21.15.57:0/4148313326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b00af280 msgr2=0x7fc4b00abd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc4b67b1700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b00af280 0x7fc4b00abd70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fc4b00ac3a0 tx=0x7fc4a8008040).stop 2021-06-25T04:48:04.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc4b67b1700 1 -- 172.21.15.57:0/4148313326 shutdown_connections 2021-06-25T04:48:04.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc4b67b1700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc4900553d0 0x7fc490057890 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc4b67b1700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b00af280 0x7fc4b00abd70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc4b67b1700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4b00ad810 0x7fc4b00ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc4b67b1700 1 --2- 172.21.15.57:0/4148313326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b00ad2e0 0x7fc4b00b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.407+0000 7fc4b67b1700 1 -- 172.21.15.57:0/4148313326 >> 172.21.15.57:0/4148313326 conn(0x7fc4b0061100 msgr2=0x7fc4b013cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:04.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.411+0000 7fc4b67b1700 1 -- 172.21.15.57:0/4148313326 shutdown_connections 2021-06-25T04:48:04.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.411+0000 7fc4b67b1700 1 -- 172.21.15.57:0/4148313326 wait complete. 2021-06-25T04:48:04.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:48:04.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.531+0000 7f68eac6a700 1 Processor -- start 2021-06-25T04:48:04.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.531+0000 7f68eac6a700 1 -- start start 2021-06-25T04:48:04.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.531+0000 7f68eac6a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f68e40b6250 0x7f68e4061430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.531+0000 7f68eac6a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4142e20 0x7f68e41432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.531+0000 7f68eac6a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e40b5f10 con 0x7f68e40b4020 2021-06-25T04:48:04.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.531+0000 7f68eac6a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e40b1f30 con 0x7f68e40b6250 2021-06-25T04:48:04.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.531+0000 7f68eac6a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40b21d0 con 0x7f68e4142e20 2021-06-25T04:48:04.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68ea469700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4142e20 0x7f68e41432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68e9c68700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f68e40b6250 0x7f68e4061430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68ea469700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4142e20 0x7f68e41432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:47254/0 (socket says 172.21.15.57:47254) 2021-06-25T04:48:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68ea469700 1 -- 172.21.15.57:0/3498949350 learned_addr learned my addr 172.21.15.57:0/3498949350 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68e9c68700 1 --2- 172.21.15.57:0/3498949350 >> v2:172.21.15.87:3300/0 conn(0x7f68e40b6250 0x7f68e4061430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:44580/0 (socket says 172.21.15.57:44580) 2021-06-25T04:48:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68e9467700 1 --1- 172.21.15.57:0/3498949350 >> v1:172.21.15.87:6789/0 conn(0x7f68e40b4020 0x7f68e4061920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:54052/0 (socket says 172.21.15.57:54052) 2021-06-25T04:48:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68ea469700 1 -- 172.21.15.57:0/3498949350 >> v2:172.21.15.87:3300/0 conn(0x7f68e40b6250 msgr2=0x7f68e4061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68ea469700 1 --2- 172.21.15.57:0/3498949350 >> v2:172.21.15.87:3300/0 conn(0x7f68e40b6250 0x7f68e4061430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68ea469700 1 -- 172.21.15.57:0/3498949350 >> v1:172.21.15.87:6789/0 conn(0x7f68e40b4020 legacy=0x7f68e4061920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68ea469700 1 -- 172.21.15.57:0/3498949350 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e40b2470 con 0x7f68e4142e20 2021-06-25T04:48:04.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68e9c68700 1 --2- 172.21.15.57:0/3498949350 >> v2:172.21.15.87:3300/0 conn(0x7f68e40b6250 0x7f68e4061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:04.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68ea469700 1 --2- 172.21.15.57:0/3498949350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4142e20 0x7f68e41432d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f68dc0032f0 tx=0x7f68dc009290).ready entity=mon.2 client_cookie=ae7247fbe7e182f9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68e8c66700 1 -- 172.21.15.57:0/3498949350 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68dc00b8a0 con 0x7f68e4142e20 2021-06-25T04:48:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68e8c66700 1 -- 172.21.15.57:0/3498949350 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc00ba00 con 0x7f68e4142e20 2021-06-25T04:48:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68e8c66700 1 -- 172.21.15.57:0/3498949350 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68dc00bb70 con 0x7f68e4142e20 2021-06-25T04:48:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68eac6a700 1 -- 172.21.15.57:0/3498949350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4142e20 msgr2=0x7f68e41432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68eac6a700 1 --2- 172.21.15.57:0/3498949350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4142e20 0x7f68e41432d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f68dc0032f0 tx=0x7f68dc009290).stop 2021-06-25T04:48:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68eac6a700 1 -- 172.21.15.57:0/3498949350 shutdown_connections 2021-06-25T04:48:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68eac6a700 1 --2- 172.21.15.57:0/3498949350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4142e20 0x7f68e41432d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68eac6a700 1 --2- 172.21.15.57:0/3498949350 >> v2:172.21.15.87:3300/0 conn(0x7f68e40b6250 0x7f68e4061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68eac6a700 1 -- 172.21.15.57:0/3498949350 >> 172.21.15.57:0/3498949350 conn(0x7f68e405c450 msgr2=0x7f68e405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68eac6a700 1 -- 172.21.15.57:0/3498949350 shutdown_connections 2021-06-25T04:48:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.535+0000 7f68eac6a700 1 -- 172.21.15.57:0/3498949350 wait complete. 2021-06-25T04:48:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68eac6a700 1 Processor -- start 2021-06-25T04:48:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68eac6a700 1 -- start start 2021-06-25T04:48:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68eac6a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68e40b4020 0x7f68e40b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68eac6a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e40b6250 0x7f68e4129d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68eac6a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68e4142e20 0x7f68e412a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68eac6a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40b0300 con 0x7f68e4142e20 2021-06-25T04:48:04.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68eac6a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40af2d0 con 0x7f68e40b4020 2021-06-25T04:48:04.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68eac6a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40af6c0 con 0x7f68e40b6250 2021-06-25T04:48:04.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68ea469700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68e4142e20 0x7f68e412a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68ea469700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68e4142e20 0x7f68e412a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36096/0 (socket says 172.21.15.57:36096) 2021-06-25T04:48:04.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68ea469700 1 -- 172.21.15.57:0/4141273604 learned_addr learned my addr 172.21.15.57:0/4141273604 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:04.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68e9467700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e40b6250 0x7f68e4129d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68e9c68700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68e40b4020 0x7f68e40b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68ea469700 1 -- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e40b6250 msgr2=0x7f68e4129d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68ea469700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e40b6250 0x7f68e4129d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68ea469700 1 -- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68e40b4020 msgr2=0x7f68e40b86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68ea469700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68e40b4020 0x7f68e40b86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68ea469700 1 -- 172.21.15.57:0/4141273604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e000b180 con 0x7f68e4142e20 2021-06-25T04:48:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68e9467700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e40b6250 0x7f68e4129d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:04.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68e9c68700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68e40b4020 0x7f68e40b86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:04.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68ea469700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68e4142e20 0x7f68e412a250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f68dc0032f0 tx=0x7f68dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68d2ffd700 1 -- 172.21.15.57:0/4141273604 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68dc011b40 con 0x7f68e4142e20 2021-06-25T04:48:04.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68d2ffd700 1 -- 172.21.15.57:0/4141273604 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc011ca0 con 0x7f68e4142e20 2021-06-25T04:48:04.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68d2ffd700 1 -- 172.21.15.57:0/4141273604 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68dc020430 con 0x7f68e4142e20 2021-06-25T04:48:04.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.539+0000 7f68eac6a700 1 -- 172.21.15.57:0/4141273604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68dc009530 con 0x7f68e4142e20 2021-06-25T04:48:04.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.543+0000 7f68eac6a700 1 -- 172.21.15.57:0/4141273604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e40af030 con 0x7f68e4142e20 2021-06-25T04:48:04.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.543+0000 7f68eac6a700 1 -- 172.21.15.57:0/4141273604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e4057310 con 0x7f68e4142e20 2021-06-25T04:48:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.543+0000 7f68d2ffd700 1 -- 172.21.15.57:0/4141273604 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f68dc027070 con 0x7f68e4142e20 2021-06-25T04:48:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.543+0000 7f68d2ffd700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68c4055450 0x7f68c4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.543+0000 7f68d2ffd700 1 -- 172.21.15.57:0/4141273604 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f68dc06e6d0 con 0x7f68e4142e20 2021-06-25T04:48:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.543+0000 7f68e9c68700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68c4055450 0x7f68c4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.547+0000 7f68e9c68700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68c4055450 0x7f68c4057910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f68e000b000 tx=0x7f68e0006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.551+0000 7f68d2ffd700 1 -- 172.21.15.57:0/4141273604 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f68dc044770 con 0x7f68e4142e20 2021-06-25T04:48:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.679+0000 7f68eac6a700 1 -- 172.21.15.57:0/4141273604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68e40b57d0 con 0x7f68e4142e20 2021-06-25T04:48:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68d2ffd700 1 -- 172.21.15.57:0/4141273604 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f68dc0150a0 con 0x7f68e4142e20 2021-06-25T04:48:04.690 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:04.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 -- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68c4055450 msgr2=0x7f68c4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68c4055450 0x7f68c4057910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f68e000b000 tx=0x7f68e0006df0).stop 2021-06-25T04:48:04.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 -- 172.21.15.57:0/4141273604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68e4142e20 msgr2=0x7f68e412a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68e4142e20 0x7f68e412a250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f68dc0032f0 tx=0x7f68dc016000).stop 2021-06-25T04:48:04.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 -- 172.21.15.57:0/4141273604 shutdown_connections 2021-06-25T04:48:04.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68c4055450 0x7f68c4057910 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68e4142e20 0x7f68e412a250 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e40b6250 0x7f68e4129d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 --2- 172.21.15.57:0/4141273604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68e40b4020 0x7f68e40b86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 -- 172.21.15.57:0/4141273604 >> 172.21.15.57:0/4141273604 conn(0x7f68e405c450 msgr2=0x7f68e412be90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:04.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 -- 172.21.15.57:0/4141273604 shutdown_connections 2021-06-25T04:48:04.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.683+0000 7f68eac6a700 1 -- 172.21.15.57:0/4141273604 wait complete. 2021-06-25T04:48:04.706 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:48:04.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.799+0000 7f70ba5a9700 1 Processor -- start 2021-06-25T04:48:04.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.799+0000 7f70ba5a9700 1 -- start start 2021-06-25T04:48:04.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f70b40ad580 0x7f70b40616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70b4140400 0x7f70b41408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b40aecb0 con 0x7f70b40612e0 2021-06-25T04:48:04.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b40b6ee0 con 0x7f70b40ad580 2021-06-25T04:48:04.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40aeee0 con 0x7f70b4140400 2021-06-25T04:48:04.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70b9da8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70b4140400 0x7f70b41408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70b8da6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f70b40ad580 0x7f70b40616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70b9da8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70b4140400 0x7f70b41408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:47268/0 (socket says 172.21.15.57:47268) 2021-06-25T04:48:04.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70b9da8700 1 -- 172.21.15.57:0/2384587009 learned_addr learned my addr 172.21.15.57:0/2384587009 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:04.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70b8da6700 1 -- 172.21.15.57:0/2384587009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70b4140400 msgr2=0x7f70b41408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:04.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70b8da6700 1 --2- 172.21.15.57:0/2384587009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70b4140400 0x7f70b41408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70b8da6700 1 -- 172.21.15.57:0/2384587009 >> v1:172.21.15.87:6789/0 conn(0x7f70b40612e0 legacy=0x7f70b40b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70b8da6700 1 -- 172.21.15.57:0/2384587009 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b40af180 con 0x7f70b40ad580 2021-06-25T04:48:04.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70b8da6700 1 --2- 172.21.15.57:0/2384587009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70b40ad580 0x7f70b40616c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f70a8002f70 tx=0x7f70a8006df0).ready entity=mon.1 client_cookie=76f273caf3581bef server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70a7fff700 1 -- 172.21.15.57:0/2384587009 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a800d570 con 0x7f70b40ad580 2021-06-25T04:48:04.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70a7fff700 1 -- 172.21.15.57:0/2384587009 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8000e90 con 0x7f70b40ad580 2021-06-25T04:48:04.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70a7fff700 1 -- 172.21.15.57:0/2384587009 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a800d8c0 con 0x7f70b40ad580 2021-06-25T04:48:04.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 -- 172.21.15.57:0/2384587009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70b40ad580 msgr2=0x7f70b40616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 --2- 172.21.15.57:0/2384587009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70b40ad580 0x7f70b40616c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f70a8002f70 tx=0x7f70a8006df0).stop 2021-06-25T04:48:04.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 -- 172.21.15.57:0/2384587009 shutdown_connections 2021-06-25T04:48:04.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 --2- 172.21.15.57:0/2384587009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70b4140400 0x7f70b41408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 --2- 172.21.15.57:0/2384587009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70b40ad580 0x7f70b40616c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 -- 172.21.15.57:0/2384587009 >> 172.21.15.57:0/2384587009 conn(0x7f70b4066da0 msgr2=0x7f70b4067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:04.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 -- 172.21.15.57:0/2384587009 shutdown_connections 2021-06-25T04:48:04.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.803+0000 7f70ba5a9700 1 -- 172.21.15.57:0/2384587009 wait complete. 2021-06-25T04:48:04.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70ba5a9700 1 Processor -- start 2021-06-25T04:48:04.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70ba5a9700 1 -- start start 2021-06-25T04:48:04.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70ba5a9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70b40612e0 0x7f70b40b8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70ba5a9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70b40ad580 0x7f70b4155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70ba5a9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70b4140400 0x7f70b41560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70ba5a9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b4145a50 con 0x7f70b40ad580 2021-06-25T04:48:04.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70ba5a9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b4145cf0 con 0x7f70b40612e0 2021-06-25T04:48:04.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70ba5a9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b4155750 con 0x7f70b4140400 2021-06-25T04:48:04.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70b8da6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70b40ad580 0x7f70b4155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70b8da6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70b40ad580 0x7f70b4155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36108/0 (socket says 172.21.15.57:36108) 2021-06-25T04:48:04.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70b8da6700 1 -- 172.21.15.57:0/1940156492 learned_addr learned my addr 172.21.15.57:0/1940156492 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:04.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70b95a7700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70b40612e0 0x7f70b40b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.807+0000 7f70b9da8700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70b4140400 0x7f70b41560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70b8da6700 1 -- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70b4140400 msgr2=0x7f70b41560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70b8da6700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70b4140400 0x7f70b41560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70b8da6700 1 -- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70b40612e0 msgr2=0x7f70b40b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70b8da6700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70b40612e0 0x7f70b40b8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70b8da6700 1 -- 172.21.15.57:0/1940156492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a800b180 con 0x7f70b40ad580 2021-06-25T04:48:04.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70b95a7700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70b40612e0 0x7f70b40b8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:04.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70b8da6700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70b40ad580 0x7f70b4155bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f70a8002f70 tx=0x7f70a8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70a67fc700 1 -- 172.21.15.57:0/1940156492 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a8006b20 con 0x7f70b40ad580 2021-06-25T04:48:04.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70a67fc700 1 -- 172.21.15.57:0/1940156492 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8012dd0 con 0x7f70b40ad580 2021-06-25T04:48:04.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70ba5a9700 1 -- 172.21.15.57:0/1940156492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b40a9c50 con 0x7f70b40ad580 2021-06-25T04:48:04.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70a67fc700 1 -- 172.21.15.57:0/1940156492 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a801f630 con 0x7f70b40ad580 2021-06-25T04:48:04.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70ba5a9700 1 -- 172.21.15.57:0/1940156492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b40b1290 con 0x7f70b40ad580 2021-06-25T04:48:04.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70ba5a9700 1 -- 172.21.15.57:0/1940156492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b4155910 con 0x7f70b40ad580 2021-06-25T04:48:04.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.811+0000 7f70a67fc700 1 -- 172.21.15.57:0/1940156492 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f70a8025020 con 0x7f70b40ad580 2021-06-25T04:48:04.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.815+0000 7f70a67fc700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f709c055450 0x7f709c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:04.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.815+0000 7f70a67fc700 1 -- 172.21.15.57:0/1940156492 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f70a806efe0 con 0x7f70b40ad580 2021-06-25T04:48:04.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.815+0000 7f70b95a7700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f709c055450 0x7f709c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:04.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.815+0000 7f70b95a7700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f709c055450 0x7f709c057910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f70b000d000 tx=0x7f70b0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:04.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.819+0000 7f70a67fc700 1 -- 172.21.15.57:0/1940156492 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f70a8045190 con 0x7f70b40ad580 2021-06-25T04:48:04.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.947+0000 7f70ba5a9700 1 -- 172.21.15.57:0/1940156492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70b4145e60 con 0x7f70b40ad580 2021-06-25T04:48:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.947+0000 7f70a67fc700 1 -- 172.21.15.57:0/1940156492 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f70a80487b0 con 0x7f70b40ad580 2021-06-25T04:48:04.957 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:04.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 -- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f709c055450 msgr2=0x7f709c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f709c055450 0x7f709c057910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f70b000d000 tx=0x7f70b0009040).stop 2021-06-25T04:48:04.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 -- 172.21.15.57:0/1940156492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70b40ad580 msgr2=0x7f70b4155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:04.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70b40ad580 0x7f70b4155bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f70a8002f70 tx=0x7f70a8014000).stop 2021-06-25T04:48:04.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 -- 172.21.15.57:0/1940156492 shutdown_connections 2021-06-25T04:48:04.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f709c055450 0x7f709c057910 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70b4140400 0x7f70b41560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70b40ad580 0x7f70b4155bf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 --2- 172.21.15.57:0/1940156492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70b40612e0 0x7f70b40b8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 -- 172.21.15.57:0/1940156492 >> 172.21.15.57:0/1940156492 conn(0x7f70b4066da0 msgr2=0x7f70b4140e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 -- 172.21.15.57:0/1940156492 shutdown_connections 2021-06-25T04:48:04.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:04.951+0000 7f70ba5a9700 1 -- 172.21.15.57:0/1940156492 wait complete. 2021-06-25T04:48:04.976 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2021-06-25T04:48:04.977 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-06-25T04:48:05.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 Processor -- start 2021-06-25T04:48:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 -- start start 2021-06-25T04:48:05.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e180b1d70 0x7f1e180b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:05.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1e18148360 0x7f1e180b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:05.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e180b0310 con 0x7f1e180a7080 2021-06-25T04:48:05.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e180a9080 con 0x7f1e18148360 2021-06-25T04:48:05.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180b05b0 con 0x7f1e180b1d70 2021-06-25T04:48:05.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e16ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1e18148360 0x7f1e180b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:05.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e16ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1e18148360 0x7f1e180b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36114/0 (socket says 172.21.15.57:36114) 2021-06-25T04:48:05.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e16ffd700 1 -- 172.21.15.57:0/646510819 learned_addr learned my addr 172.21.15.57:0/646510819 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:05.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e177fe700 1 --2- 172.21.15.57:0/646510819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e180b1d70 0x7f1e180b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:05.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e16ffd700 1 -- 172.21.15.57:0/646510819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e180b1d70 msgr2=0x7f1e180b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:05.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e16ffd700 1 --2- 172.21.15.57:0/646510819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e180b1d70 0x7f1e180b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e16ffd700 1 -- 172.21.15.57:0/646510819 >> v1:172.21.15.57:6789/0 conn(0x7f1e180a7080 legacy=0x7f1e181446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e16ffd700 1 -- 172.21.15.57:0/646510819 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180b0850 con 0x7f1e18148360 2021-06-25T04:48:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e16ffd700 1 --2- 172.21.15.57:0/646510819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e18148360 0x7f1e180b2150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f1e100032f0 tx=0x7f1e10009290).ready entity=mon.0 client_cookie=506a572329557233 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e167fc700 1 -- 172.21.15.57:0/646510819 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e1000b8a0 con 0x7f1e18148360 2021-06-25T04:48:05.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e167fc700 1 -- 172.21.15.57:0/646510819 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1000ba00 con 0x7f1e18148360 2021-06-25T04:48:05.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 -- 172.21.15.57:0/646510819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e18148360 msgr2=0x7f1e180b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:05.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e167fc700 1 -- 172.21.15.57:0/646510819 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e1000bb70 con 0x7f1e18148360 2021-06-25T04:48:05.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 --2- 172.21.15.57:0/646510819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e18148360 0x7f1e180b2150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f1e100032f0 tx=0x7f1e10009290).stop 2021-06-25T04:48:05.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 -- 172.21.15.57:0/646510819 shutdown_connections 2021-06-25T04:48:05.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 --2- 172.21.15.57:0/646510819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e18148360 0x7f1e180b2150 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:05.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 --2- 172.21.15.57:0/646510819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e180b1d70 0x7f1e180b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:05.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 -- 172.21.15.57:0/646510819 >> 172.21.15.57:0/646510819 conn(0x7f1e1805f670 msgr2=0x7f1e1805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:05.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 -- 172.21.15.57:0/646510819 shutdown_connections 2021-06-25T04:48:05.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.075+0000 7f1e1de69700 1 -- 172.21.15.57:0/646510819 wait complete. 2021-06-25T04:48:05.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e1de69700 1 Processor -- start 2021-06-25T04:48:05.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e1de69700 1 -- start start 2021-06-25T04:48:05.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e1de69700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e180a7080 0x7f1e18146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:05.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e1de69700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e180b1d70 0x7f1e18146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:05.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e1de69700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e18148360 0x7f1e18156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:05.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e1de69700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180acf00 con 0x7f1e180b1d70 2021-06-25T04:48:05.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e1de69700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18145ca0 con 0x7f1e18148360 2021-06-25T04:48:05.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e1de69700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180ad130 con 0x7f1e180a7080 2021-06-25T04:48:05.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e16ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e180b1d70 0x7f1e18146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:05.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e16ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e180b1d70 0x7f1e18146e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36124/0 (socket says 172.21.15.57:36124) 2021-06-25T04:48:05.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e16ffd700 1 -- 172.21.15.57:0/4064374613 learned_addr learned my addr 172.21.15.57:0/4064374613 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:05.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e17fff700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e18148360 0x7f1e18156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:05.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e177fe700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e180a7080 0x7f1e18146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:05.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e16ffd700 1 -- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e180a7080 msgr2=0x7f1e18146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:05.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e16ffd700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e180a7080 0x7f1e18146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:05.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e16ffd700 1 -- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e18148360 msgr2=0x7f1e18156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:05.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e16ffd700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e18148360 0x7f1e18156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:05.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e16ffd700 1 -- 172.21.15.57:0/4064374613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e10009530 con 0x7f1e180b1d70 2021-06-25T04:48:05.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e17fff700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e18148360 0x7f1e18156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:05.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e16ffd700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e180b1d70 0x7f1e18146e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f1e100032f0 tx=0x7f1e10016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:05.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e14ff9700 1 -- 172.21.15.57:0/4064374613 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e10011bd0 con 0x7f1e180b1d70 2021-06-25T04:48:05.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e14ff9700 1 -- 172.21.15.57:0/4064374613 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e10011d30 con 0x7f1e180b1d70 2021-06-25T04:48:05.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e1de69700 1 -- 172.21.15.57:0/4064374613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e180ad3d0 con 0x7f1e180b1d70 2021-06-25T04:48:05.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.079+0000 7f1e14ff9700 1 -- 172.21.15.57:0/4064374613 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e10011ea0 con 0x7f1e180b1d70 2021-06-25T04:48:05.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.083+0000 7f1e1de69700 1 -- 172.21.15.57:0/4064374613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e180afb50 con 0x7f1e180b1d70 2021-06-25T04:48:05.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.083+0000 7f1e1de69700 1 -- 172.21.15.57:0/4064374613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e180ad560 con 0x7f1e180b1d70 2021-06-25T04:48:05.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.083+0000 7f1e14ff9700 1 -- 172.21.15.57:0/4064374613 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1e10026030 con 0x7f1e180b1d70 2021-06-25T04:48:05.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.083+0000 7f1e14ff9700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dfc055490 0x7f1dfc057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:05.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.083+0000 7f1e14ff9700 1 -- 172.21.15.57:0/4064374613 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1e1006e860 con 0x7f1e180b1d70 2021-06-25T04:48:05.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.083+0000 7f1e177fe700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dfc055490 0x7f1dfc057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:05.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.083+0000 7f1e177fe700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dfc055490 0x7f1dfc057950 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1e0000b000 tx=0x7f1e00006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:05.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.087+0000 7f1e14ff9700 1 -- 172.21.15.57:0/4064374613 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1e10044a10 con 0x7f1e180b1d70 2021-06-25T04:48:05.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:05.259+0000 7f1e1de69700 1 -- 172.21.15.57:0/4064374613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f1e18057310 con 0x7f1e180b1d70 2021-06-25T04:48:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.279+0000 7f1e14ff9700 1 -- 172.21.15.57:0/4064374613 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v47) v1 ==== 142+0+0 (secure 0 0 0) 0x7f1e100150d0 con 0x7f1e180b1d70 2021-06-25T04:48:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 -- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dfc055490 msgr2=0x7f1dfc057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dfc055490 0x7f1dfc057950 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1e0000b000 tx=0x7f1e00006df0).stop 2021-06-25T04:48:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 -- 172.21.15.57:0/4064374613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e180b1d70 msgr2=0x7f1e18146e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e180b1d70 0x7f1e18146e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f1e100032f0 tx=0x7f1e10016000).stop 2021-06-25T04:48:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 -- 172.21.15.57:0/4064374613 shutdown_connections 2021-06-25T04:48:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dfc055490 0x7f1dfc057950 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e18148360 0x7f1e18156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e180b1d70 0x7f1e18146e10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 --2- 172.21.15.57:0/4064374613 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e180a7080 0x7f1e18146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 -- 172.21.15.57:0/4064374613 >> 172.21.15.57:0/4064374613 conn(0x7f1e1805f670 msgr2=0x7f1e180b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:06.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 -- 172.21.15.57:0/4064374613 shutdown_connections 2021-06-25T04:48:06.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.283+0000 7f1e1de69700 1 -- 172.21.15.57:0/4064374613 wait complete. 2021-06-25T04:48:06.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:48:06.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d359e700 1 Processor -- start 2021-06-25T04:48:06.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d359e700 1 -- start start 2021-06-25T04:48:06.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f71d40b5460 0x7f71d40af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:06.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 0x7f71d40acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:06.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d40b5840 con 0x7f71d40b05d0 2021-06-25T04:48:06.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d41452a0 con 0x7f71d40b5460 2021-06-25T04:48:06.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d40adfb0 con 0x7f71d4147560 2021-06-25T04:48:06.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d2d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 0x7f71d40acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:06.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d259c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f71d40b5460 0x7f71d40af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:06.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d2d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 0x7f71d40acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:47296/0 (socket says 172.21.15.57:47296) 2021-06-25T04:48:06.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d2d9d700 1 -- 172.21.15.57:0/2614643415 learned_addr learned my addr 172.21.15.57:0/2614643415 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:06.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.411+0000 7f71d1d9b700 1 --1- 172.21.15.57:0/2614643415 >> v1:172.21.15.87:6789/0 conn(0x7f71d40b05d0 0x7f71d4067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:54094/0 (socket says 172.21.15.57:54094) 2021-06-25T04:48:06.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d159a700 1 -- 172.21.15.57:0/2614643415 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468872557 0 0) 0x7f71d40b5840 con 0x7f71d40b05d0 2021-06-25T04:48:06.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d159a700 1 -- 172.21.15.57:0/2614643415 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b8003260 con 0x7f71d40b05d0 2021-06-25T04:48:06.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d2d9d700 1 -- 172.21.15.57:0/2614643415 >> v2:172.21.15.87:3300/0 conn(0x7f71d40b5460 msgr2=0x7f71d40af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:06.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d2d9d700 1 --2- 172.21.15.57:0/2614643415 >> v2:172.21.15.87:3300/0 conn(0x7f71d40b5460 0x7f71d40af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d2d9d700 1 -- 172.21.15.57:0/2614643415 >> v1:172.21.15.87:6789/0 conn(0x7f71d40b05d0 legacy=0x7f71d4067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:06.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d2d9d700 1 -- 172.21.15.57:0/2614643415 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40ac7c0 con 0x7f71d4147560 2021-06-25T04:48:06.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d2d9d700 1 --2- 172.21.15.57:0/2614643415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 0x7f71d40acc20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f71cc0032f0 tx=0x7f71cc009290).ready entity=mon.2 client_cookie=e6b4b1a727278e0e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:06.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d159a700 1 -- 172.21.15.57:0/2614643415 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71cc00b680 con 0x7f71d4147560 2021-06-25T04:48:06.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d159a700 1 -- 172.21.15.57:0/2614643415 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc00b7e0 con 0x7f71d4147560 2021-06-25T04:48:06.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d159a700 1 -- 172.21.15.57:0/2614643415 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71cc00b990 con 0x7f71d4147560 2021-06-25T04:48:06.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d359e700 1 -- 172.21.15.57:0/2614643415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 msgr2=0x7f71d40acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:06.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d359e700 1 --2- 172.21.15.57:0/2614643415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 0x7f71d40acc20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f71cc0032f0 tx=0x7f71cc009290).stop 2021-06-25T04:48:06.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d359e700 1 -- 172.21.15.57:0/2614643415 shutdown_connections 2021-06-25T04:48:06.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d359e700 1 --2- 172.21.15.57:0/2614643415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 0x7f71d40acc20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d359e700 1 --2- 172.21.15.57:0/2614643415 >> v2:172.21.15.87:3300/0 conn(0x7f71d40b5460 0x7f71d40af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d359e700 1 -- 172.21.15.57:0/2614643415 >> 172.21.15.57:0/2614643415 conn(0x7f71d4062520 msgr2=0x7f71d4062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:06.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d359e700 1 -- 172.21.15.57:0/2614643415 shutdown_connections 2021-06-25T04:48:06.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d359e700 1 -- 172.21.15.57:0/2614643415 wait complete. 2021-06-25T04:48:06.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d359e700 1 Processor -- start 2021-06-25T04:48:06.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.415+0000 7f71d359e700 1 -- start start 2021-06-25T04:48:06.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71d40b05d0 0x7f71d414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:06.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71d40b5460 0x7f71d415a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:06.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 0x7f71d4156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:06.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d4159c70 con 0x7f71d40b5460 2021-06-25T04:48:06.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d414b380 con 0x7f71d40b05d0 2021-06-25T04:48:06.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d4159e60 con 0x7f71d4147560 2021-06-25T04:48:06.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d1d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71d40b5460 0x7f71d415a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:06.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71d40b05d0 0x7f71d414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:06.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d1d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71d40b5460 0x7f71d415a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36136/0 (socket says 172.21.15.57:36136) 2021-06-25T04:48:06.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d1d9b700 1 -- 172.21.15.57:0/3708617757 learned_addr learned my addr 172.21.15.57:0/3708617757 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:06.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d2d9d700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 0x7f71d4156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:06.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d1d9b700 1 -- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 msgr2=0x7f71d4156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:06.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d1d9b700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 0x7f71d4156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d1d9b700 1 -- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71d40b05d0 msgr2=0x7f71d414e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:06.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d1d9b700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71d40b05d0 0x7f71d414e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d1d9b700 1 -- 172.21.15.57:0/3708617757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc009530 con 0x7f71d40b5460 2021-06-25T04:48:06.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d259c700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71d40b05d0 0x7f71d414e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:06.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d1d9b700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71d40b5460 0x7f71d415a5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f71c4001110 tx=0x7f71c4007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:06.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71c37fe700 1 -- 172.21.15.57:0/3708617757 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c400ce20 con 0x7f71d40b5460 2021-06-25T04:48:06.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d359e700 1 -- 172.21.15.57:0/3708617757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d415a100 con 0x7f71d40b5460 2021-06-25T04:48:06.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71c37fe700 1 -- 172.21.15.57:0/3708617757 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c40072e0 con 0x7f71d40b5460 2021-06-25T04:48:06.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71c37fe700 1 -- 172.21.15.57:0/3708617757 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c4005740 con 0x7f71d40b5460 2021-06-25T04:48:06.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.419+0000 7f71d359e700 1 -- 172.21.15.57:0/3708617757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d4156c10 con 0x7f71d40b5460 2021-06-25T04:48:06.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.423+0000 7f71c37fe700 1 -- 172.21.15.57:0/3708617757 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f71c4010070 con 0x7f71d40b5460 2021-06-25T04:48:06.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.423+0000 7f71d359e700 1 -- 172.21.15.57:0/3708617757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d4057310 con 0x7f71d40b5460 2021-06-25T04:48:06.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.423+0000 7f71c37fe700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71b0055490 0x7f71b0057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:06.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.423+0000 7f71c37fe700 1 -- 172.21.15.57:0/3708617757 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f71c406d5f0 con 0x7f71d40b5460 2021-06-25T04:48:06.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.423+0000 7f71d259c700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71b0055490 0x7f71b0057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:06.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.423+0000 7f71d259c700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71b0055490 0x7f71b0057950 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f71c800b000 tx=0x7f71c8006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:06.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.431+0000 7f71c37fe700 1 -- 172.21.15.57:0/3708617757 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f71c4043700 con 0x7f71d40b5460 2021-06-25T04:48:06.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.567+0000 7f71d359e700 1 -- 172.21.15.57:0/3708617757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f71d405f200 con 0x7f71d40b5460 2021-06-25T04:48:06.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.575+0000 7f71c37fe700 1 -- 172.21.15.57:0/3708617757 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f71c4046d20 con 0x7f71d40b5460 2021-06-25T04:48:06.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.575+0000 7f71d359e700 1 -- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71b0055490 msgr2=0x7f71b0057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:06.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.575+0000 7f71d359e700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71b0055490 0x7f71b0057950 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f71c800b000 tx=0x7f71c8006df0).stop 2021-06-25T04:48:06.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.575+0000 7f71d359e700 1 -- 172.21.15.57:0/3708617757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71d40b5460 msgr2=0x7f71d415a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:06.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.575+0000 7f71d359e700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71d40b5460 0x7f71d415a5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f71c4001110 tx=0x7f71c4007ad0).stop 2021-06-25T04:48:06.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.575+0000 7f71d359e700 1 -- 172.21.15.57:0/3708617757 shutdown_connections 2021-06-25T04:48:06.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.575+0000 7f71d359e700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71b0055490 0x7f71b0057950 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.575+0000 7f71d359e700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71d4147560 0x7f71d4156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.575+0000 7f71d359e700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71d40b5460 0x7f71d415a5a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.575+0000 7f71d359e700 1 --2- 172.21.15.57:0/3708617757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71d40b05d0 0x7f71d414e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:06.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.575+0000 7f71d359e700 1 -- 172.21.15.57:0/3708617757 >> 172.21.15.57:0/3708617757 conn(0x7f71d4062520 msgr2=0x7f71d40acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:06.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.579+0000 7f71d359e700 1 -- 172.21.15.57:0/3708617757 shutdown_connections 2021-06-25T04:48:06.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:06.579+0000 7f71d359e700 1 -- 172.21.15.57:0/3708617757 wait complete. 2021-06-25T04:48:06.597 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:48:06.597 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:48:06.613 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:48:06.633 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:48:06.659 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:48:06.897 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:48:06.908 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:48:06.918 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:48:06.920 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:48:06.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:06.921 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:48:06.921 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:48:06.926 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:48:06.935 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:48:06.937 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:48:06.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:06.938 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:48:06.939 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:48:07.016 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:48:07.017 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:48:07.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:07.019 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:48:07.020 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:48:07.032 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-06-25T04:48:07.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:48:07.035 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-06-25T04:48:07.036 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:48:07.036 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:48:07.037 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:48:07.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:07.127 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:48:07.128 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:48:07.143 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:48:07.145 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:48:07.146 INFO:teuthology.orchestra.run:waiting for 900 2021-06-25T04:48:07.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:48:07.148 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:48:07.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:07.221 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:48:07.221 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:48:07.230 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:48:07.231 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:48:07.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:07.232 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:48:07.233 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:48:07.241 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:48:07.247 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:48:07.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:07.248 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:48:07.249 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:48:07.299 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2021-06-25T04:48:07.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:48:07.301 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2021-06-25T04:48:07.301 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2021-06-25T04:48:07.302 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:48:07.302 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:48:07.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:07.331 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:48:07.332 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:48:07.338 INFO:teuthology.orchestra.run.smithi161.stdout:ext2/ext3 2021-06-25T04:48:07.339 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:48:07.340 INFO:teuthology.orchestra.run:waiting for 900 2021-06-25T04:48:07.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:48:07.341 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:48:07.397 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:48:07.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 Processor -- start 2021-06-25T04:48:07.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 -- start start 2021-06-25T04:48:07.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0140067140 0x7f014005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:07.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01400a7a50 con 0x7f01400a7670 2021-06-25T04:48:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01401475e0 con 0x7f01400b1930 2021-06-25T04:48:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0140147880 con 0x7f0140067140 2021-06-25T04:48:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0146125700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f01400a7670 0x7f0140066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53362/0 (socket says 172.21.15.57:53362) 2021-06-25T04:48:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0146125700 1 -- 172.21.15.57:0/3738064692 learned_addr learned my addr 172.21.15.57:0/3738064692 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0145924700 1 --2- 172.21.15.57:0/3738064692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0140067140 0x7f014005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0145123700 1 -- 172.21.15.57:0/3738064692 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245242692 0 0) 0x7f01400a7a50 con 0x7f01400a7670 2021-06-25T04:48:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0145123700 1 -- 172.21.15.57:0/3738064692 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0128003260 con 0x7f01400a7670 2021-06-25T04:48:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0145123700 1 -- 172.21.15.57:0/3738064692 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445015019 0 0) 0x7f01401475e0 con 0x7f01400b1930 2021-06-25T04:48:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0145924700 1 -- 172.21.15.57:0/3738064692 >> v1:172.21.15.87:6789/0 conn(0x7f01400b1930 legacy=0x7f014005fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0145924700 1 -- 172.21.15.57:0/3738064692 >> v1:172.21.15.57:6789/0 conn(0x7f01400a7670 legacy=0x7f0140066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0145924700 1 -- 172.21.15.57:0/3738064692 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140147b20 con 0x7f0140067140 2021-06-25T04:48:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0145924700 1 --2- 172.21.15.57:0/3738064692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0140067140 0x7f014005f670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f013c0032f0 tx=0x7f013c0091d0).ready entity=mon.2 client_cookie=7298ddb559a5b4c2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0145123700 1 -- 172.21.15.57:0/3738064692 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f013c00b6c0 con 0x7f0140067140 2021-06-25T04:48:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0145123700 1 -- 172.21.15.57:0/3738064692 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c00b820 con 0x7f0140067140 2021-06-25T04:48:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 -- 172.21.15.57:0/3738064692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0140067140 msgr2=0x7f014005f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0145123700 1 -- 172.21.15.57:0/3738064692 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f013c00b990 con 0x7f0140067140 2021-06-25T04:48:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 --2- 172.21.15.57:0/3738064692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0140067140 0x7f014005f670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f013c0032f0 tx=0x7f013c0091d0).stop 2021-06-25T04:48:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 -- 172.21.15.57:0/3738064692 shutdown_connections 2021-06-25T04:48:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 --2- 172.21.15.57:0/3738064692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0140067140 0x7f014005f670 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 -- 172.21.15.57:0/3738064692 >> 172.21.15.57:0/3738064692 conn(0x7f01400b53a0 msgr2=0x7f01400b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 -- 172.21.15.57:0/3738064692 shutdown_connections 2021-06-25T04:48:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.503+0000 7f0148389700 1 -- 172.21.15.57:0/3738064692 wait complete. 2021-06-25T04:48:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0148389700 1 Processor -- start 2021-06-25T04:48:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0148389700 1 -- start start 2021-06-25T04:48:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0148389700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0140067140 0x7f01400a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:07.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0148389700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01400a7670 0x7f01400ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:07.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0148389700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01400b1930 0x7f01400aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:07.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0148389700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01400aa180 con 0x7f01400b1930 2021-06-25T04:48:07.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0148389700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014014d3c0 con 0x7f01400a7670 2021-06-25T04:48:07.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0148389700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014014d660 con 0x7f0140067140 2021-06-25T04:48:07.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0146926700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01400b1930 0x7f01400aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:07.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0146125700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0140067140 0x7f01400a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:07.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0146926700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01400b1930 0x7f01400aaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36152/0 (socket says 172.21.15.57:36152) 2021-06-25T04:48:07.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0146926700 1 -- 172.21.15.57:0/1444996865 learned_addr learned my addr 172.21.15.57:0/1444996865 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:07.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0145924700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01400a7670 0x7f01400ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:07.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0146926700 1 -- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0140067140 msgr2=0x7f01400a9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:07.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0146926700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0140067140 0x7f01400a9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:07.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0146926700 1 -- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01400a7670 msgr2=0x7f01400ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:07.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0146926700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01400a7670 0x7f01400ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:07.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0146926700 1 -- 172.21.15.57:0/1444996865 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c009470 con 0x7f01400b1930 2021-06-25T04:48:07.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0146926700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01400b1930 0x7f01400aaca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0138000bc0 tx=0x7f0138007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:07.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f012f7fe700 1 -- 172.21.15.57:0/1444996865 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0138001d10 con 0x7f01400b1930 2021-06-25T04:48:07.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f012f7fe700 1 -- 172.21.15.57:0/1444996865 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0138007030 con 0x7f01400b1930 2021-06-25T04:48:07.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0148389700 1 -- 172.21.15.57:0/1444996865 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014014d900 con 0x7f01400b1930 2021-06-25T04:48:07.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f012f7fe700 1 -- 172.21.15.57:0/1444996865 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0138007390 con 0x7f01400b1930 2021-06-25T04:48:07.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.507+0000 7f0148389700 1 -- 172.21.15.57:0/1444996865 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01400aece0 con 0x7f01400b1930 2021-06-25T04:48:07.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.511+0000 7f0148389700 1 -- 172.21.15.57:0/1444996865 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0140057310 con 0x7f01400b1930 2021-06-25T04:48:07.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.511+0000 7f012f7fe700 1 -- 172.21.15.57:0/1444996865 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0138010030 con 0x7f01400b1930 2021-06-25T04:48:07.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.511+0000 7f012f7fe700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0120055450 0x7f0120057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:07.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.511+0000 7f012f7fe700 1 -- 172.21.15.57:0/1444996865 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f013806d990 con 0x7f01400b1930 2021-06-25T04:48:07.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.511+0000 7f0146125700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0120055450 0x7f0120057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:07.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.511+0000 7f0146125700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0120055450 0x7f0120057910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f013000d000 tx=0x7f0130009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:07.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.519+0000 7f012f7fe700 1 -- 172.21.15.57:0/1444996865 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0138043b40 con 0x7f01400b1930 2021-06-25T04:48:07.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.647+0000 7f0148389700 1 -- 172.21.15.57:0/1444996865 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0140060a00 con 0x7f01400b1930 2021-06-25T04:48:07.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f012f7fe700 1 -- 172.21.15.57:0/1444996865 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+34065 (secure 0 0 0) 0x7f0138047160 con 0x7f01400b1930 2021-06-25T04:48:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:07.659 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:48:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 25, 2021-06-25T04:48:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:48:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:48:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:47:41.021834+0000", 2021-06-25T04:48:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:48:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:48:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:48:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:48:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:48:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:48:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:48:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:48:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:48:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:48:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:48:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:48:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:48:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:48:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:48:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 4, 2021-06-25T04:48:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:48:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:48:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:48:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:48:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:48:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:48:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:48:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:48:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:48:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:48:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:48:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:48:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:48:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:48:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:48:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:48:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:48:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:48:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:48:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:48:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:48:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:48:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:48:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:48:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:48:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:48:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:48:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:48:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:48:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:48:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:48:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:48:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:48:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:48:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:48:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:48:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:48:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:48:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:48:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:48:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:48:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:48:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:48:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:48:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:48:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:48:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:48:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:48:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:48:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:48:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:48:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:48:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:48:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:48:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:48:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:48:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:48:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:48:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:48:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:48:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:48:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:48:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:48:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:48:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:48:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:48:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:48:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:48:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:48:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:48:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:48:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:48:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:48:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:48:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:48:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:48:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:48:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:48:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:48:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:48:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:48:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:48:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:48:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:48:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:48:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:48:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:48:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:48:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:48:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:48:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:48:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:48:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:48:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:48:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:48:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:48:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:48:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:48:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:48:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:48:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:48:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:48:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:48:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:48:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:48:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:48:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:48:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:48:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:48:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:48:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:48:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:48:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:48:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:48:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:48:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:48:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:48:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:48:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:48:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:48:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:48:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:48:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:48:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:48:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:48:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:48:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:48:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:48:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:48:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:48:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:48:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:48:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:48:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:48:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 3, 2021-06-25T04:48:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:48:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:34.957337+0000", 2021-06-25T04:48:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:48:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:48:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:48:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:48:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:48:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:48:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:48:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:48:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:48:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:48:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:48:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:48:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:48:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:48:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:48:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:48:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:48:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:48:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:48:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:48:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "24", 2021-06-25T04:48:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:48:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:48:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:48:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:48:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:48:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:48:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:48:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:48:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:48:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:48:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:48:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:48:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:48:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:48:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:48:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:48:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:48:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:48:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:48:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:48:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:48:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:48:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:48:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:48:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:48:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:48:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:48:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:48:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:48:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:48:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:48:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:48:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:48:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:48:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:48:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:48:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:48:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:48:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:48:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:48:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:48:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:48:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:48:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:48:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 4, 2021-06-25T04:48:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:48:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:37.729999+0000", 2021-06-25T04:48:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 5, 2021-06-25T04:48:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool,ec_overwrites", 2021-06-25T04:48:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 3, 2021-06-25T04:48:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 4, 2021-06-25T04:48:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 3, 2021-06-25T04:48:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 1, 2021-06-25T04:48:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:48:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:48:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:48:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:48:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:48:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:48:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:48:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:48:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:48:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:48:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:48:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:48:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:48:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:48:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "25", 2021-06-25T04:48:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:48:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:48:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:48:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:48:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:48:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:48:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:48:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:48:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:48:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:48:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:48:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:48:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:48:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:48:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:48:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:48:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:48:07.725 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:48:07.725 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:48:07.725 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:48:07.725 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:48:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:48:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:48:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "cephfs_data", 2021-06-25T04:48:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:48:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:48:07.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.727 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:48:07.727 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:48:07.727 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:48:07.728 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:48:07.728 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:48:07.728 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:48:07.728 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:48:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:48:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 8192, 2021-06-25T04:48:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:48:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:48:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:48:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:48:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:48:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:48:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:48:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:48:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:48:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:48:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:48:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:48:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:48:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:48:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:48:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:48:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:48:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 22, 2021-06-25T04:48:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:48:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:48:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:48:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:48:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:48:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:48:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:48:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:48:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:48:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:48:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:48:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:48:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:48:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.742 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:48:07.742 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:48:07.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:48:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:48:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.744 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:48:07.744 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.745 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.745 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:48:07.745 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:48:07.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.746 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.746 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:48:07.746 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:48:07.746 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.747 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.747 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:48:07.747 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:48:07.748 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:48:07.748 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:48:07.748 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:48:07.748 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:48:07.748 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:48:07.749 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.749 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:48:07.750 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:48:07.750 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:48:07.750 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:48:07.750 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:48:07.750 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:48:07.751 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:48:07.751 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:48:07.751 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:48:07.751 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 22, 2021-06-25T04:48:07.752 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:48:07.752 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:48:07.752 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:48:07.752 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.753 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.753 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:48:07.753 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:48:07.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:48:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:48:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:48:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:48:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:48:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:48:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:48:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:48:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:48:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:48:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:48:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:48:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.762 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:48:07.762 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.762 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.762 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:48:07.763 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:48:07.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.763 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.764 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:48:07.764 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:48:07.764 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.764 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.765 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:48:07.765 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:48:07.765 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:48:07.765 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:48:07.766 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:48:07.766 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:48:07.766 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:48:07.766 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.767 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:48:07.767 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:48:07.767 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:48:07.768 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:48:07.768 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:48:07.768 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:48:07.768 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:48:07.769 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:48:07.769 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:48:07.769 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 16, 2021-06-25T04:48:07.769 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:48:07.769 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:48:07.770 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:48:07.770 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.770 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.771 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:48:07.771 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:48:07.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.771 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.772 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:48:07.772 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:48:07.772 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.772 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.773 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:48:07.773 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.774 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.774 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:48:07.774 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:48:07.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.775 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.775 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:48:07.775 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:48:07.775 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.776 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.776 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:48:07.776 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.777 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.777 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:48:07.777 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:48:07.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.778 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.778 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:48:07.778 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:48:07.779 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.779 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.779 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:48:07.779 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.780 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.780 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:48:07.780 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:48:07.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.781 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.781 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:48:07.782 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:48:07.782 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.782 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.782 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:48:07.783 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:48:07.783 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:48:07.783 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:48:07.783 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:48:07.784 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:48:07.784 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:48:07.784 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.785 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:48:07.785 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:48:07.785 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:48:07.785 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:48:07.786 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:48:07.786 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:48:07.786 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:48:07.786 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:48:07.787 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:48:07.787 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 22, 2021-06-25T04:48:07.787 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:48:07.787 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:48:07.788 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:48:07.788 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.788 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.789 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:48:07.789 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:48:07.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.789 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.790 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:48:07.790 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:48:07.790 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.790 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.791 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:48:07.791 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.792 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.792 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:48:07.792 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:48:07.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.793 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.793 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:48:07.793 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:48:07.793 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.794 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.794 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:48:07.794 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.795 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.795 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:48:07.795 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:48:07.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.796 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.796 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:48:07.796 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:48:07.797 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.797 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.797 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:48:07.797 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.798 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.798 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:48:07.798 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:48:07.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.799 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.799 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:48:07.800 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:48:07.800 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.800 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.800 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:48:07.801 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:48:07.801 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:48:07.801 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:48:07.801 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:48:07.802 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:48:07.802 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:48:07.802 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.803 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:48:07.803 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:48:07.803 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:48:07.803 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:48:07.804 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:48:07.804 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:48:07.804 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:48:07.804 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:48:07.804 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:48:07.805 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 22, 2021-06-25T04:48:07.805 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:48:07.805 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:48:07.805 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:48:07.806 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.806 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.806 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:48:07.807 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:48:07.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.807 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.807 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:48:07.808 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:48:07.808 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.808 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.809 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:48:07.809 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.809 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.809 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:48:07.810 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:48:07.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.810 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.811 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:48:07.811 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:48:07.811 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.811 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.812 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:48:07.812 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.812 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.813 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:48:07.813 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:48:07.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.813 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.814 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:48:07.814 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:48:07.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.814 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.815 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:48:07.815 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.815 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.816 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:48:07.816 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:48:07.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.817 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.817 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:48:07.817 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:48:07.817 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.817 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.818 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:48:07.818 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:48:07.818 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:48:07.819 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:48:07.819 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:48:07.819 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:48:07.819 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:48:07.820 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.820 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:48:07.820 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:48:07.821 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:48:07.821 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:48:07.821 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:48:07.821 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:48:07.822 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:48:07.822 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:48:07.822 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:48:07.822 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 19, 2021-06-25T04:48:07.822 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:48:07.823 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:48:07.823 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:48:07.823 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.824 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.824 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:48:07.824 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:48:07.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.825 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.825 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:48:07.825 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:48:07.825 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.826 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.826 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:48:07.826 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.827 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.827 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:48:07.827 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:48:07.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.828 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.828 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:48:07.828 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:48:07.828 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.829 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.829 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:48:07.829 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.830 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.830 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:48:07.830 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:48:07.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.831 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.831 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:48:07.832 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:48:07.832 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.832 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.832 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:48:07.833 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.833 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.833 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:48:07.834 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:48:07.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.834 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.834 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:48:07.835 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:48:07.835 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.835 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.836 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:48:07.836 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:48:07.836 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:48:07.836 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:48:07.836 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:48:07.837 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:48:07.837 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:48:07.837 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.838 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:48:07.838 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:48:07.838 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:48:07.839 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:48:07.839 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:48:07.839 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:48:07.839 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:48:07.839 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:48:07.840 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:48:07.840 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 22, 2021-06-25T04:48:07.840 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:48:07.840 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:48:07.841 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:48:07.841 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.841 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.842 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:48:07.842 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:48:07.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.842 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.843 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:48:07.843 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:48:07.843 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.843 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.844 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:48:07.844 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.845 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.845 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:48:07.845 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:48:07.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.846 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.846 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:48:07.846 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:48:07.846 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.847 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.847 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:48:07.847 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.848 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.848 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:48:07.848 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:48:07.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.849 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.849 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:48:07.849 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:48:07.850 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.850 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.850 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:48:07.850 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.851 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.851 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:48:07.851 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:48:07.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.852 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.852 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:48:07.852 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:48:07.853 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.853 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.853 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:48:07.854 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:48:07.854 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:48:07.854 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:48:07.854 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:48:07.854 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:48:07.855 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:48:07.855 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.856 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:48:07.856 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:48:07.856 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:48:07.856 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:48:07.856 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:48:07.857 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:48:07.857 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:48:07.857 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:48:07.857 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:48:07.858 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 16, 2021-06-25T04:48:07.858 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:48:07.858 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:48:07.858 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:48:07.859 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.859 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.859 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:48:07.859 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:48:07.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.860 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.860 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:48:07.861 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:48:07.861 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.861 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.861 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:48:07.862 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.862 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.862 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:48:07.863 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:48:07.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.863 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.864 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:48:07.864 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:48:07.864 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.864 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.865 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:48:07.865 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.865 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.866 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:48:07.866 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:48:07.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.866 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.867 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:48:07.867 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:48:07.867 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.867 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.868 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:48:07.868 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:48:07.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.868 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:48:07.869 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:48:07.869 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:48:07.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.870 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:48:07.870 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:48:07.870 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:48:07.870 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.870 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.871 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:48:07.871 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:48:07.871 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:48:07.872 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:48:07.872 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:48:07.872 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:48:07.872 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:48:07.872 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:07.873 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.873 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:48:07.873 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:48:07.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.874 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:48:07.874 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:48:07.874 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:48:07.874 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:48:07.875 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:48:07.875 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:48:07.875 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:48:07.875 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:48:07.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.876 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:48:07.876 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:48:07.876 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:48:07.877 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:48:07.877 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:48:07.877 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:48:07.877 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:48:07.878 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:48:07.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.878 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:48:07.878 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:48:07.879 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:48:07.879 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:48:07.879 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:48:07.879 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:48:07.880 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:48:07.880 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:48:07.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.881 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:48:07.881 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:48:07.881 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:48:07.881 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:48:07.881 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:48:07.882 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:48:07.882 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:48:07.882 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:48:07.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.883 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:48:07.883 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:48:07.883 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:48:07.884 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:48:07.884 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:48:07.884 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:48:07.884 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:48:07.884 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:48:07.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.885 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:48:07.885 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:48:07.886 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:48:07.886 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:48:07.886 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:48:07.886 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:48:07.886 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:48:07.887 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:48:07.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.887 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:48:07.888 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:48:07.888 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:48:07.888 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:48:07.888 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:48:07.888 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:48:07.889 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:48:07.889 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:48:07.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:07.890 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:48:07.890 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:48:07.890 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:48:07.890 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:48:07.891 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:48:07.891 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:48:07.891 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:48:07.891 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:48:07.891 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.892 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:48:07.892 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:48:07.892 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:48:07.892 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:48:07.893 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:48:07.893 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": {}, 2021-06-25T04:48:07.893 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:48:07.893 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:48:07.893 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:48:07.894 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:48:07.894 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:48:07.894 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:48:07.894 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:48:07.895 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:48:07.895 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:48:07.895 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:48:07.895 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:48:07.895 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:48:07.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.896 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:48:07.896 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:48:07.896 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:48:07.897 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:48:07.897 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:48:07.897 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:48:07.897 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:48:07.898 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:07.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:07.898 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:48:07.898 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:48:07.898 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:48:07.899 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:48:07.899 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:48:07.899 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:48:07.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 -- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0120055450 msgr2=0x7f0120057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:07.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0120055450 0x7f0120057910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f013000d000 tx=0x7f0130009040).stop 2021-06-25T04:48:07.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 -- 172.21.15.57:0/1444996865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01400b1930 msgr2=0x7f01400aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:07.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01400b1930 0x7f01400aaca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0138000bc0 tx=0x7f0138007be0).stop 2021-06-25T04:48:07.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 -- 172.21.15.57:0/1444996865 shutdown_connections 2021-06-25T04:48:07.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0120055450 0x7f0120057910 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:07.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01400b1930 0x7f01400aaca0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:07.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01400a7670 0x7f01400ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:07.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 --2- 172.21.15.57:0/1444996865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0140067140 0x7f01400a9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:07.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 -- 172.21.15.57:0/1444996865 >> 172.21.15.57:0/1444996865 conn(0x7f01400b53a0 msgr2=0x7f0140148df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:07.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 -- 172.21.15.57:0/1444996865 shutdown_connections 2021-06-25T04:48:07.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:07.651+0000 7f0148389700 1 -- 172.21.15.57:0/1444996865 wait complete. 2021-06-25T04:48:07.904 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:48:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19359e700 1 Processor -- start 2021-06-25T04:48:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19359e700 1 -- start start 2021-06-25T04:48:08.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1940b05d0 0x7fe1940af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe194147560 0x7fe1940acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1940b5840 con 0x7fe1940b5460 2021-06-25T04:48:08.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1941452a0 con 0x7fe1940b05d0 2021-06-25T04:48:08.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1940adfb0 con 0x7fe194147560 2021-06-25T04:48:08.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe191d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1940b05d0 0x7fe1940af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe191d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1940b05d0 0x7fe1940af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36156/0 (socket says 172.21.15.57:36156) 2021-06-25T04:48:08.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe191d9b700 1 -- 172.21.15.57:0/2805719057 learned_addr learned my addr 172.21.15.57:0/2805719057 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:08.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe192d9d700 1 --2- 172.21.15.57:0/2805719057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe194147560 0x7fe1940acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe191d9b700 1 -- 172.21.15.57:0/2805719057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe194147560 msgr2=0x7fe1940acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:08.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe191d9b700 1 --2- 172.21.15.57:0/2805719057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe194147560 0x7fe1940acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe191d9b700 1 -- 172.21.15.57:0/2805719057 >> v1:172.21.15.87:6789/0 conn(0x7fe1940b5460 legacy=0x7fe194067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:08.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe191d9b700 1 -- 172.21.15.57:0/2805719057 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1940ac7c0 con 0x7fe1940b05d0 2021-06-25T04:48:08.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe191d9b700 1 --2- 172.21.15.57:0/2805719057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1940b05d0 0x7fe1940af510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fe1840032f0 tx=0x7fe184009290).ready entity=mon.0 client_cookie=4794aef4c6830032 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:08.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19159a700 1 -- 172.21.15.57:0/2805719057 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18400b870 con 0x7fe1940b05d0 2021-06-25T04:48:08.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19159a700 1 -- 172.21.15.57:0/2805719057 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18400b9d0 con 0x7fe1940b05d0 2021-06-25T04:48:08.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19159a700 1 -- 172.21.15.57:0/2805719057 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18400bb80 con 0x7fe1940b05d0 2021-06-25T04:48:08.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19359e700 1 -- 172.21.15.57:0/2805719057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1940b05d0 msgr2=0x7fe1940af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:08.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.007+0000 7fe19359e700 1 --2- 172.21.15.57:0/2805719057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1940b05d0 0x7fe1940af510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fe1840032f0 tx=0x7fe184009290).stop 2021-06-25T04:48:08.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.011+0000 7fe19359e700 1 -- 172.21.15.57:0/2805719057 shutdown_connections 2021-06-25T04:48:08.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.011+0000 7fe19359e700 1 --2- 172.21.15.57:0/2805719057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe194147560 0x7fe1940acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.011+0000 7fe19359e700 1 --2- 172.21.15.57:0/2805719057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1940b05d0 0x7fe1940af510 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.011+0000 7fe19359e700 1 -- 172.21.15.57:0/2805719057 >> 172.21.15.57:0/2805719057 conn(0x7fe194062520 msgr2=0x7fe194062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:08.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.011+0000 7fe19359e700 1 -- 172.21.15.57:0/2805719057 shutdown_connections 2021-06-25T04:48:08.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.011+0000 7fe19359e700 1 -- 172.21.15.57:0/2805719057 wait complete. 2021-06-25T04:48:08.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.011+0000 7fe19359e700 1 Processor -- start 2021-06-25T04:48:08.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.011+0000 7fe19359e700 1 -- start start 2021-06-25T04:48:08.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe19359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940b05d0 0x7fe194146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe19359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1940b5460 0x7fe1941410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe19359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194147560 0x7fe1940b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe19359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe194156c20 con 0x7fe1940b5460 2021-06-25T04:48:08.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe19359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe194156ec0 con 0x7fe194147560 2021-06-25T04:48:08.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe19359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe194157160 con 0x7fe1940b05d0 2021-06-25T04:48:08.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe191d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1940b5460 0x7fe1941410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe191d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1940b5460 0x7fe1941410a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36166/0 (socket says 172.21.15.57:36166) 2021-06-25T04:48:08.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe191d9b700 1 -- 172.21.15.57:0/1640661497 learned_addr learned my addr 172.21.15.57:0/1640661497 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:08.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe192d9d700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194147560 0x7fe1940b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe19259c700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940b05d0 0x7fe194146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe191d9b700 1 -- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940b05d0 msgr2=0x7fe194146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:08.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe191d9b700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940b05d0 0x7fe194146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe191d9b700 1 -- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194147560 msgr2=0x7fe1940b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe191d9b700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194147560 0x7fe1940b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe191d9b700 1 -- 172.21.15.57:0/1640661497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe184009530 con 0x7fe1940b5460 2021-06-25T04:48:08.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe191d9b700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1940b5460 0x7fe1941410a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fe1840032f0 tx=0x7fe184016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe18b7fe700 1 -- 172.21.15.57:0/1640661497 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe184020430 con 0x7fe1940b5460 2021-06-25T04:48:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe18b7fe700 1 -- 172.21.15.57:0/1640661497 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe184020590 con 0x7fe1940b5460 2021-06-25T04:48:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe18b7fe700 1 -- 172.21.15.57:0/1640661497 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1840208f0 con 0x7fe1940b5460 2021-06-25T04:48:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe19359e700 1 -- 172.21.15.57:0/1640661497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe194157400 con 0x7fe1940b5460 2021-06-25T04:48:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe19359e700 1 -- 172.21.15.57:0/1640661497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe194146860 con 0x7fe1940b5460 2021-06-25T04:48:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe19359e700 1 -- 172.21.15.57:0/1640661497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe194157590 con 0x7fe1940b5460 2021-06-25T04:48:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe18b7fe700 1 -- 172.21.15.57:0/1640661497 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe184028070 con 0x7fe1940b5460 2021-06-25T04:48:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe18b7fe700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1780553d0 0x7fe178057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.015+0000 7fe18b7fe700 1 -- 172.21.15.57:0/1640661497 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe18406eab0 con 0x7fe1940b5460 2021-06-25T04:48:08.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.019+0000 7fe19259c700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1780553d0 0x7fe178057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.019+0000 7fe19259c700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1780553d0 0x7fe178057890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe17c00b000 tx=0x7fe17c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:08.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.027+0000 7fe18b7fe700 1 -- 172.21.15.57:0/1640661497 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe184044bc0 con 0x7fe1940b5460 2021-06-25T04:48:08.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.187+0000 7fe19359e700 1 -- 172.21.15.57:0/1640661497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe194057310 con 0x7fe1940b5460 2021-06-25T04:48:08.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe18b7fe700 1 -- 172.21.15.57:0/1640661497 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7fe184015070 con 0x7fe1940b5460 2021-06-25T04:48:08.198 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:08.198 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/1675349577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1675349577},{"type":"v1","addr":"172.21.15.87:6835","nonce":1675349577}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/4129321821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4129321821},{"type":"v1","addr":"172.21.15.57:6833","nonce":4129321821}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:47:40.019558+0000","modified":"2021-06-25T04:47:41.749060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1050167707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1050167707},{"type":"v1","addr":"172.21.15.57:6835","nonce":1050167707}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-06-25T04:48:08.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 -- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1780553d0 msgr2=0x7fe178057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:08.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1780553d0 0x7fe178057890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe17c00b000 tx=0x7fe17c009040).stop 2021-06-25T04:48:08.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 -- 172.21.15.57:0/1640661497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1940b5460 msgr2=0x7fe1941410a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:08.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1940b5460 0x7fe1941410a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fe1840032f0 tx=0x7fe184016000).stop 2021-06-25T04:48:08.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 -- 172.21.15.57:0/1640661497 shutdown_connections 2021-06-25T04:48:08.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1780553d0 0x7fe178057890 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194147560 0x7fe1940b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1940b5460 0x7fe1941410a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 --2- 172.21.15.57:0/1640661497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940b05d0 0x7fe194146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 -- 172.21.15.57:0/1640661497 >> 172.21.15.57:0/1640661497 conn(0x7fe194062520 msgr2=0x7fe1940af380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:08.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 -- 172.21.15.57:0/1640661497 shutdown_connections 2021-06-25T04:48:08.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.191+0000 7fe19359e700 1 -- 172.21.15.57:0/1640661497 wait complete. 2021-06-25T04:48:08.202 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2021-06-25T04:48:08.210 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:48:08.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953d508700 1 Processor -- start 2021-06-25T04:48:08.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953d508700 1 -- start start 2021-06-25T04:48:08.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953d508700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380612e0 0x7f95380616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953d508700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95380ad580 0x7f95380b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953d508700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9538140400 0x7f95381408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953d508700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95380aecb0 con 0x7f9538140400 2021-06-25T04:48:08.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953d508700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95380b6ee0 con 0x7f95380ad580 2021-06-25T04:48:08.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953d508700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95380aeee0 con 0x7f95380612e0 2021-06-25T04:48:08.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953cd07700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9538140400 0x7f95381408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f95377fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95380ad580 0x7f95380b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953cd07700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9538140400 0x7f95381408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36174/0 (socket says 172.21.15.57:36174) 2021-06-25T04:48:08.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f95377fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95380ad580 0x7f95380b9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:44666/0 (socket says 172.21.15.57:44666) 2021-06-25T04:48:08.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953cd07700 1 -- 172.21.15.57:0/3428223981 learned_addr learned my addr 172.21.15.57:0/3428223981 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:08.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f9537fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380612e0 0x7f95380616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953cd07700 1 -- 172.21.15.57:0/3428223981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380612e0 msgr2=0x7f95380616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:08.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953cd07700 1 --2- 172.21.15.57:0/3428223981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380612e0 0x7f95380616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953cd07700 1 -- 172.21.15.57:0/3428223981 >> v2:172.21.15.87:3300/0 conn(0x7f95380ad580 msgr2=0x7f95380b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:08.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953cd07700 1 --2- 172.21.15.57:0/3428223981 >> v2:172.21.15.87:3300/0 conn(0x7f95380ad580 0x7f95380b9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953cd07700 1 -- 172.21.15.57:0/3428223981 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95380af180 con 0x7f9538140400 2021-06-25T04:48:08.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953cd07700 1 --2- 172.21.15.57:0/3428223981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9538140400 0x7f95381408b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f9530002f70 tx=0x7f9530006eb0).ready entity=mon.0 client_cookie=bf25207bc05da91a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:08.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f9536ffd700 1 -- 172.21.15.57:0/3428223981 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953000d570 con 0x7f9538140400 2021-06-25T04:48:08.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f9536ffd700 1 -- 172.21.15.57:0/3428223981 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9530000e90 con 0x7f9538140400 2021-06-25T04:48:08.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953d508700 1 -- 172.21.15.57:0/3428223981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9538140400 msgr2=0x7f95381408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f9536ffd700 1 -- 172.21.15.57:0/3428223981 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f953000d900 con 0x7f9538140400 2021-06-25T04:48:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.307+0000 7f953d508700 1 --2- 172.21.15.57:0/3428223981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9538140400 0x7f95381408b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f9530002f70 tx=0x7f9530006eb0).stop 2021-06-25T04:48:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 -- 172.21.15.57:0/3428223981 shutdown_connections 2021-06-25T04:48:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 --2- 172.21.15.57:0/3428223981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9538140400 0x7f95381408b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 --2- 172.21.15.57:0/3428223981 >> v2:172.21.15.87:3300/0 conn(0x7f95380ad580 0x7f95380b9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 --2- 172.21.15.57:0/3428223981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380612e0 0x7f95380616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 -- 172.21.15.57:0/3428223981 >> 172.21.15.57:0/3428223981 conn(0x7f9538066da0 msgr2=0x7f9538067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 -- 172.21.15.57:0/3428223981 shutdown_connections 2021-06-25T04:48:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 -- 172.21.15.57:0/3428223981 wait complete. 2021-06-25T04:48:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 Processor -- start 2021-06-25T04:48:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 -- start start 2021-06-25T04:48:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95380612e0 0x7f95380aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ad580 0x7f95380b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9538140400 0x7f95380b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9538152360 con 0x7f95380612e0 2021-06-25T04:48:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9538152600 con 0x7f9538140400 2021-06-25T04:48:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953d508700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95381528a0 con 0x7f95380ad580 2021-06-25T04:48:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f9537fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95380612e0 0x7f95380aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f9537fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95380612e0 0x7f95380aa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36176/0 (socket says 172.21.15.57:36176) 2021-06-25T04:48:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f9537fff700 1 -- 172.21.15.57:0/3990342970 learned_addr learned my addr 172.21.15.57:0/3990342970 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f95377fe700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ad580 0x7f95380b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f953cd07700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9538140400 0x7f95380b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f9537fff700 1 -- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ad580 msgr2=0x7f95380b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f9537fff700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ad580 0x7f95380b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f9537fff700 1 -- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9538140400 msgr2=0x7f95380b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f9537fff700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9538140400 0x7f95380b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:08.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f9537fff700 1 -- 172.21.15.57:0/3990342970 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953000b1e0 con 0x7f95380612e0 2021-06-25T04:48:08.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.311+0000 7f95377fe700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ad580 0x7f95380b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:08.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.315+0000 7f9537fff700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95380612e0 0x7f95380aa7d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f952800c000 tx=0x7f9528006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:08.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.315+0000 7f95357fa700 1 -- 172.21.15.57:0/3990342970 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f952800c830 con 0x7f95380612e0 2021-06-25T04:48:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.315+0000 7f95357fa700 1 -- 172.21.15.57:0/3990342970 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952800c990 con 0x7f95380612e0 2021-06-25T04:48:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.315+0000 7f953d508700 1 -- 172.21.15.57:0/3990342970 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9538152b40 con 0x7f95380612e0 2021-06-25T04:48:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.315+0000 7f95357fa700 1 -- 172.21.15.57:0/3990342970 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f952800ccf0 con 0x7f95380612e0 2021-06-25T04:48:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.315+0000 7f953d508700 1 -- 172.21.15.57:0/3990342970 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95380aacc0 con 0x7f95380612e0 2021-06-25T04:48:08.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.315+0000 7f953d508700 1 -- 172.21.15.57:0/3990342970 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9538057310 con 0x7f95380612e0 2021-06-25T04:48:08.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.315+0000 7f95357fa700 1 -- 172.21.15.57:0/3990342970 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f952801c460 con 0x7f95380612e0 2021-06-25T04:48:08.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.315+0000 7f95357fa700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95100553d0 0x7f9510057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:08.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.315+0000 7f95357fa700 1 -- 172.21.15.57:0/3990342970 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f952806e350 con 0x7f95380612e0 2021-06-25T04:48:08.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.315+0000 7f95377fe700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95100553d0 0x7f9510057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.319+0000 7f95377fe700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95100553d0 0x7f9510057890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f952000b000 tx=0x7f9520008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.323+0000 7f95357fa700 1 -- 172.21.15.57:0/3990342970 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9528044550 con 0x7f95380612e0 2021-06-25T04:48:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:08.483+0000 7f953d508700 1 -- 172.21.15.57:0/3990342970 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f95380620c0 con 0x7f95380612e0 2021-06-25T04:48:09.296 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:48:09.287+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:48:09.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.299+0000 7f95357fa700 1 -- 172.21.15.57:0/3990342970 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9528047b70 con 0x7f95380612e0 2021-06-25T04:48:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 -- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95100553d0 msgr2=0x7f9510057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95100553d0 0x7f9510057890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f952000b000 tx=0x7f9520008040).stop 2021-06-25T04:48:09.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 -- 172.21.15.57:0/3990342970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95380612e0 msgr2=0x7f95380aa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95380612e0 0x7f95380aa7d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f952800c000 tx=0x7f9528006df0).stop 2021-06-25T04:48:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 -- 172.21.15.57:0/3990342970 shutdown_connections 2021-06-25T04:48:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95100553d0 0x7f9510057890 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9538140400 0x7f95380b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ad580 0x7f95380b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 --2- 172.21.15.57:0/3990342970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95380612e0 0x7f95380aa7d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 -- 172.21.15.57:0/3990342970 >> 172.21.15.57:0/3990342970 conn(0x7f9538066da0 msgr2=0x7f95380b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:09.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 -- 172.21.15.57:0/3990342970 shutdown_connections 2021-06-25T04:48:09.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.303+0000 7f953d508700 1 -- 172.21.15.57:0/3990342970 wait complete. 2021-06-25T04:48:09.317 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:48:09.330 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:48:09.338 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:48:09.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.431+0000 7f55f359e700 1 Processor -- start 2021-06-25T04:48:09.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.431+0000 7f55f359e700 1 -- start start 2021-06-25T04:48:09.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f55f4063890 0x7f55f4143d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:09.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f4063c70 con 0x7f55f40618e0 2021-06-25T04:48:09.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f4061fb0 con 0x7f55f4140940 2021-06-25T04:48:09.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f413fd70 con 0x7f55f4063890 2021-06-25T04:48:09.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f55f4063890 0x7f55f4143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:09.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55ebfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f55f40618e0 0x7f55f40b1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53416/0 (socket says 172.21.15.57:53416) 2021-06-25T04:48:09.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55ebfff700 1 -- 172.21.15.57:0/897984497 learned_addr learned my addr 172.21.15.57:0/897984497 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:09.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f259c700 1 -- 172.21.15.57:0/897984497 >> v1:172.21.15.87:6789/0 conn(0x7f55f4140940 legacy=0x7f55f4128c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f259c700 1 -- 172.21.15.57:0/897984497 >> v1:172.21.15.57:6789/0 conn(0x7f55f40618e0 legacy=0x7f55f40b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f259c700 1 -- 172.21.15.57:0/897984497 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f413ff60 con 0x7f55f4063890 2021-06-25T04:48:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f259c700 1 --2- 172.21.15.57:0/897984497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55f4063890 0x7f55f4143d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f55e4002f70 tx=0x7f55e4006df0).ready entity=mon.0 client_cookie=f22b23639397efcd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f1d9b700 1 -- 172.21.15.57:0/897984497 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e400d610 con 0x7f55f4063890 2021-06-25T04:48:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f1d9b700 1 -- 172.21.15.57:0/897984497 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e4000e90 con 0x7f55f4063890 2021-06-25T04:48:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f1d9b700 1 -- 172.21.15.57:0/897984497 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e400d960 con 0x7f55f4063890 2021-06-25T04:48:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 -- 172.21.15.57:0/897984497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55f4063890 msgr2=0x7f55f4143d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 --2- 172.21.15.57:0/897984497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55f4063890 0x7f55f4143d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f55e4002f70 tx=0x7f55e4006df0).stop 2021-06-25T04:48:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 -- 172.21.15.57:0/897984497 shutdown_connections 2021-06-25T04:48:09.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 --2- 172.21.15.57:0/897984497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55f4063890 0x7f55f4143d10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 -- 172.21.15.57:0/897984497 >> 172.21.15.57:0/897984497 conn(0x7f55f405c450 msgr2=0x7f55f405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:09.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 -- 172.21.15.57:0/897984497 shutdown_connections 2021-06-25T04:48:09.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 -- 172.21.15.57:0/897984497 wait complete. 2021-06-25T04:48:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 Processor -- start 2021-06-25T04:48:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.435+0000 7f55f359e700 1 -- start start 2021-06-25T04:48:09.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55f40618e0 0x7f55f4127160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:09.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f4063890 0x7f55f41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:09.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f4140940 0x7f55f4155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:09.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40b0990 con 0x7f55f40618e0 2021-06-25T04:48:09.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f4145120 con 0x7f55f4063890 2021-06-25T04:48:09.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40b44d0 con 0x7f55f4140940 2021-06-25T04:48:09.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55f40618e0 0x7f55f4127160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:09.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55f40618e0 0x7f55f4127160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36202/0 (socket says 172.21.15.57:36202) 2021-06-25T04:48:09.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f259c700 1 -- 172.21.15.57:0/3491328730 learned_addr learned my addr 172.21.15.57:0/3491328730 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:09.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f2d9d700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f4140940 0x7f55f4155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:09.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55ebfff700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f4063890 0x7f55f41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:09.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f259c700 1 -- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f4140940 msgr2=0x7f55f4155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f259c700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f4140940 0x7f55f4155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f259c700 1 -- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f4063890 msgr2=0x7f55f41464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f259c700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f4063890 0x7f55f41464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f259c700 1 -- 172.21.15.57:0/3491328730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e400b180 con 0x7f55f40618e0 2021-06-25T04:48:09.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55ebfff700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f4063890 0x7f55f41464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:09.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f259c700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55f40618e0 0x7f55f4127160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f55f413c710 tx=0x7f55e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:09.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55eb7fe700 1 -- 172.21.15.57:0/3491328730 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e4021070 con 0x7f55f40618e0 2021-06-25T04:48:09.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55eb7fe700 1 -- 172.21.15.57:0/3491328730 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e4000e90 con 0x7f55f40618e0 2021-06-25T04:48:09.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f359e700 1 -- 172.21.15.57:0/3491328730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f40b3f90 con 0x7f55f40618e0 2021-06-25T04:48:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55eb7fe700 1 -- 172.21.15.57:0/3491328730 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e4011de0 con 0x7f55f40618e0 2021-06-25T04:48:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55f359e700 1 -- 172.21.15.57:0/3491328730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f41469d0 con 0x7f55f40618e0 2021-06-25T04:48:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.439+0000 7f55eb7fe700 1 -- 172.21.15.57:0/3491328730 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f55e400f070 con 0x7f55f40618e0 2021-06-25T04:48:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.443+0000 7f55f359e700 1 -- 172.21.15.57:0/3491328730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f4057310 con 0x7f55f40618e0 2021-06-25T04:48:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.443+0000 7f55eb7fe700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f55d8055450 0x7f55d8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:09.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.443+0000 7f55eb7fe700 1 -- 172.21.15.57:0/3491328730 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f55e406f450 con 0x7f55f40618e0 2021-06-25T04:48:09.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.443+0000 7f55ebfff700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f55d8055450 0x7f55d8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:09.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.443+0000 7f55ebfff700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f55d8055450 0x7f55d8057910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f55dc00b000 tx=0x7f55dc009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:09.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.447+0000 7f55eb7fe700 1 -- 172.21.15.57:0/3491328730 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f55e4045540 con 0x7f55f40618e0 2021-06-25T04:48:09.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 -- 172.21.15.57:0/3491328730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55f4128750 con 0x7f55f40618e0 2021-06-25T04:48:09.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55eb7fe700 1 -- 172.21.15.57:0/3491328730 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2126 (secure 0 0 0) 0x7f55e4048b60 con 0x7f55f40618e0 2021-06-25T04:48:09.618 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:09.618 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/1675349577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1675349577},{"type":"v1","addr":"172.21.15.87:6835","nonce":1675349577}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/4129321821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4129321821},{"type":"v1","addr":"172.21.15.57:6833","nonce":4129321821}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:47:40.019558+0000","modified":"2021-06-25T04:48:09.292736+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-06-25T04:48:09.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 -- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f55d8055450 msgr2=0x7f55d8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f55d8055450 0x7f55d8057910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f55dc00b000 tx=0x7f55dc009040).stop 2021-06-25T04:48:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 -- 172.21.15.57:0/3491328730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55f40618e0 msgr2=0x7f55f4127160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55f40618e0 0x7f55f4127160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f55f413c710 tx=0x7f55e4015000).stop 2021-06-25T04:48:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 -- 172.21.15.57:0/3491328730 shutdown_connections 2021-06-25T04:48:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f55d8055450 0x7f55d8057910 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f4140940 0x7f55f4155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f4063890 0x7f55f41464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 --2- 172.21.15.57:0/3491328730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55f40618e0 0x7f55f4127160 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 -- 172.21.15.57:0/3491328730 >> 172.21.15.57:0/3491328730 conn(0x7f55f405c450 msgr2=0x7f55f4127c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:09.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 -- 172.21.15.57:0/3491328730 shutdown_connections 2021-06-25T04:48:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.611+0000 7f55f359e700 1 -- 172.21.15.57:0/3491328730 wait complete. 2021-06-25T04:48:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2021-06-25T04:48:09.631 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:48:09.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf34e21700 1 Processor -- start 2021-06-25T04:48:09.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf34e21700 1 -- start start 2021-06-25T04:48:09.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf34e21700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbf30061ce0 0x7fbf30144560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:09.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf34e21700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf300b3a80 0x7fbf300b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:09.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf34e21700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf300620c0 con 0x7fbf3005ff30 2021-06-25T04:48:09.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf34e21700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf300b11a0 con 0x7fbf30061ce0 2021-06-25T04:48:09.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf34e21700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30144a50 con 0x7fbf300b3a80 2021-06-25T04:48:09.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf2ed9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbf3005ff30 0x7fbf300afc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53432/0 (socket says 172.21.15.57:53432) 2021-06-25T04:48:09.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf2ed9d700 1 -- 172.21.15.57:0/485397787 learned_addr learned my addr 172.21.15.57:0/485397787 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:09.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf2dd9b700 1 --2- 172.21.15.57:0/485397787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf300b3a80 0x7fbf300b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:09.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf2e59c700 1 --2- 172.21.15.57:0/485397787 >> v2:172.21.15.87:3300/0 conn(0x7fbf30061ce0 0x7fbf30144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:09.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf2d59a700 1 -- 172.21.15.57:0/485397787 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326198821 0 0) 0x7fbf300620c0 con 0x7fbf3005ff30 2021-06-25T04:48:09.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf2d59a700 1 -- 172.21.15.57:0/485397787 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf14003260 con 0x7fbf3005ff30 2021-06-25T04:48:09.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf2dd9b700 1 -- 172.21.15.57:0/485397787 >> v2:172.21.15.87:3300/0 conn(0x7fbf30061ce0 msgr2=0x7fbf30144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:09.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf2dd9b700 1 --2- 172.21.15.57:0/485397787 >> v2:172.21.15.87:3300/0 conn(0x7fbf30061ce0 0x7fbf30144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf2dd9b700 1 -- 172.21.15.57:0/485397787 >> v1:172.21.15.57:6789/0 conn(0x7fbf3005ff30 legacy=0x7fbf300afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf2dd9b700 1 -- 172.21.15.57:0/485397787 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf300b29d0 con 0x7fbf300b3a80 2021-06-25T04:48:09.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.735+0000 7fbf2dd9b700 1 --2- 172.21.15.57:0/485397787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf300b3a80 0x7fbf300b24e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbf24002f70 tx=0x7fbf24006df0).ready entity=mon.2 client_cookie=a1c69cca65a76385 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:09.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf2d59a700 1 -- 172.21.15.57:0/485397787 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf2400d4a0 con 0x7fbf300b3a80 2021-06-25T04:48:09.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf2d59a700 1 -- 172.21.15.57:0/485397787 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf24000e90 con 0x7fbf300b3a80 2021-06-25T04:48:09.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf2d59a700 1 -- 172.21.15.57:0/485397787 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf2400d7f0 con 0x7fbf300b3a80 2021-06-25T04:48:09.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf34e21700 1 -- 172.21.15.57:0/485397787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf300b3a80 msgr2=0x7fbf300b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf34e21700 1 --2- 172.21.15.57:0/485397787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf300b3a80 0x7fbf300b24e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbf24002f70 tx=0x7fbf24006df0).stop 2021-06-25T04:48:09.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf34e21700 1 -- 172.21.15.57:0/485397787 shutdown_connections 2021-06-25T04:48:09.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf34e21700 1 --2- 172.21.15.57:0/485397787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf300b3a80 0x7fbf300b24e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf34e21700 1 --2- 172.21.15.57:0/485397787 >> v2:172.21.15.87:3300/0 conn(0x7fbf30061ce0 0x7fbf30144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf34e21700 1 -- 172.21.15.57:0/485397787 >> 172.21.15.57:0/485397787 conn(0x7fbf30063970 msgr2=0x7fbf30063d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:09.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf34e21700 1 -- 172.21.15.57:0/485397787 shutdown_connections 2021-06-25T04:48:09.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf34e21700 1 -- 172.21.15.57:0/485397787 wait complete. 2021-06-25T04:48:09.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf34e21700 1 Processor -- start 2021-06-25T04:48:09.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.739+0000 7fbf34e21700 1 -- start start 2021-06-25T04:48:09.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf34e21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf3005ff30 0x7fbf30138790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:09.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf34e21700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf30061ce0 0x7fbf30137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:09.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf34e21700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf300b3a80 0x7fbf30137fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:09.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf34e21700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30151060 con 0x7fbf3005ff30 2021-06-25T04:48:09.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf34e21700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf301428d0 con 0x7fbf300b3a80 2021-06-25T04:48:09.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf34e21700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30142b70 con 0x7fbf30061ce0 2021-06-25T04:48:09.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf2e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf3005ff30 0x7fbf30138790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:09.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf2e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf3005ff30 0x7fbf30138790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36216/0 (socket says 172.21.15.57:36216) 2021-06-25T04:48:09.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf2e59c700 1 -- 172.21.15.57:0/4234999127 learned_addr learned my addr 172.21.15.57:0/4234999127 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:09.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf2dd9b700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf30061ce0 0x7fbf30137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:09.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf2ed9d700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf300b3a80 0x7fbf30137fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:09.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf2e59c700 1 -- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf30061ce0 msgr2=0x7fbf30137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf2e59c700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf30061ce0 0x7fbf30137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf2e59c700 1 -- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf300b3a80 msgr2=0x7fbf30137fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:09.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf2e59c700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf300b3a80 0x7fbf30137fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:09.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf2e59c700 1 -- 172.21.15.57:0/4234999127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2400b180 con 0x7fbf3005ff30 2021-06-25T04:48:09.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf2e59c700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf3005ff30 0x7fbf30138790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbf2000c000 tx=0x7fbf20006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:09.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf1f7fe700 1 -- 172.21.15.57:0/4234999127 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf20010780 con 0x7fbf3005ff30 2021-06-25T04:48:09.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf1f7fe700 1 -- 172.21.15.57:0/4234999127 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf200108e0 con 0x7fbf3005ff30 2021-06-25T04:48:09.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf1f7fe700 1 -- 172.21.15.57:0/4234999127 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf20010c40 con 0x7fbf3005ff30 2021-06-25T04:48:09.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf34e21700 1 -- 172.21.15.57:0/4234999127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf30142e10 con 0x7fbf3005ff30 2021-06-25T04:48:09.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.743+0000 7fbf34e21700 1 -- 172.21.15.57:0/4234999127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf300b4240 con 0x7fbf3005ff30 2021-06-25T04:48:09.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.747+0000 7fbf34e21700 1 -- 172.21.15.57:0/4234999127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf30150de0 con 0x7fbf3005ff30 2021-06-25T04:48:09.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.747+0000 7fbf1f7fe700 1 -- 172.21.15.57:0/4234999127 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbf2001c460 con 0x7fbf3005ff30 2021-06-25T04:48:09.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.747+0000 7fbf1f7fe700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf0c0554e0 0x7fbf0c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:09.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.747+0000 7fbf1f7fe700 1 -- 172.21.15.57:0/4234999127 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fbf2006e430 con 0x7fbf3005ff30 2021-06-25T04:48:09.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.747+0000 7fbf2dd9b700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf0c0554e0 0x7fbf0c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:09.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.747+0000 7fbf2dd9b700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf0c0554e0 0x7fbf0c0579a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fbf24019000 tx=0x7fbf24014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:09.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.755+0000 7fbf1f7fe700 1 -- 172.21.15.57:0/4234999127 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbf20044390 con 0x7fbf3005ff30 2021-06-25T04:48:09.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:09.923+0000 7fbf34e21700 1 -- 172.21.15.57:0/4234999127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbf30142fa0 con 0x7fbf3005ff30 2021-06-25T04:48:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf1f7fe700 1 -- 172.21.15.57:0/4234999127 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbf200479b0 con 0x7fbf3005ff30 2021-06-25T04:48:10.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 -- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf0c0554e0 msgr2=0x7fbf0c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:10.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf0c0554e0 0x7fbf0c0579a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fbf24019000 tx=0x7fbf24014000).stop 2021-06-25T04:48:10.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 -- 172.21.15.57:0/4234999127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf3005ff30 msgr2=0x7fbf30138790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:10.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf3005ff30 0x7fbf30138790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbf2000c000 tx=0x7fbf20006df0).stop 2021-06-25T04:48:10.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 -- 172.21.15.57:0/4234999127 shutdown_connections 2021-06-25T04:48:10.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf0c0554e0 0x7fbf0c0579a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:10.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf300b3a80 0x7fbf30137fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:10.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf30061ce0 0x7fbf30137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 --2- 172.21.15.57:0/4234999127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf3005ff30 0x7fbf30138790 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 -- 172.21.15.57:0/4234999127 >> 172.21.15.57:0/4234999127 conn(0x7fbf30063970 msgr2=0x7fbf301419d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:10.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 -- 172.21.15.57:0/4234999127 shutdown_connections 2021-06-25T04:48:10.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.307+0000 7fbf34e21700 1 -- 172.21.15.57:0/4234999127 wait complete. 2021-06-25T04:48:10.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:48:10.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f845938b700 1 Processor -- start 2021-06-25T04:48:10.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f845938b700 1 -- start start 2021-06-25T04:48:10.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f845938b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f84540b0460 0x7f84540adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:10.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f845938b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f84540b0840 0x7f8454140560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:10.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f845938b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84540b2ab0 con 0x7f84540aa0e0 2021-06-25T04:48:10.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f845938b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540b2730 con 0x7f84540b0460 2021-06-25T04:48:10.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f845938b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540b2ce0 con 0x7f84540b0840 2021-06-25T04:48:10.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f8452ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f84540b0460 0x7f84540adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:10.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f8452ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f84540b0460 0x7f84540adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36224/0 (socket says 172.21.15.57:36224) 2021-06-25T04:48:10.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f8452ffd700 1 -- 172.21.15.57:0/1092261143 learned_addr learned my addr 172.21.15.57:0/1092261143 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:10.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f84537fe700 1 --2- 172.21.15.57:0/1092261143 >> v2:172.21.15.87:3300/0 conn(0x7f84540b0840 0x7f8454140560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:10.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f8452ffd700 1 -- 172.21.15.57:0/1092261143 >> v2:172.21.15.87:3300/0 conn(0x7f84540b0840 msgr2=0x7f8454140560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:10.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f8452ffd700 1 --2- 172.21.15.57:0/1092261143 >> v2:172.21.15.87:3300/0 conn(0x7f84540b0840 0x7f8454140560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:10.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f8452ffd700 1 -- 172.21.15.57:0/1092261143 >> v1:172.21.15.87:6789/0 conn(0x7f84540aa0e0 legacy=0x7f84540ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:10.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f8452ffd700 1 -- 172.21.15.57:0/1092261143 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540a9b30 con 0x7f84540b0460 2021-06-25T04:48:10.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f84537fe700 1 --2- 172.21.15.57:0/1092261143 >> v2:172.21.15.87:3300/0 conn(0x7f84540b0840 0x7f8454140560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:48:10.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f8452ffd700 1 --2- 172.21.15.57:0/1092261143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84540b0460 0x7f84540adcf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f84540b0070 tx=0x7f8444006eb0).ready entity=mon.0 client_cookie=19d9d88ef2ca2281 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:10.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f84527fc700 1 -- 172.21.15.57:0/1092261143 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f844400d5c0 con 0x7f84540b0460 2021-06-25T04:48:10.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f84527fc700 1 -- 172.21.15.57:0/1092261143 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8444000e90 con 0x7f84540b0460 2021-06-25T04:48:10.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f84527fc700 1 -- 172.21.15.57:0/1092261143 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f844400d910 con 0x7f84540b0460 2021-06-25T04:48:10.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f845938b700 1 -- 172.21.15.57:0/1092261143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84540b0460 msgr2=0x7f84540adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:10.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.443+0000 7f845938b700 1 --2- 172.21.15.57:0/1092261143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84540b0460 0x7f84540adcf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f84540b0070 tx=0x7f8444006eb0).stop 2021-06-25T04:48:10.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 -- 172.21.15.57:0/1092261143 shutdown_connections 2021-06-25T04:48:10.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 --2- 172.21.15.57:0/1092261143 >> v2:172.21.15.87:3300/0 conn(0x7f84540b0840 0x7f8454140560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:10.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 --2- 172.21.15.57:0/1092261143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84540b0460 0x7f84540adcf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:10.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 -- 172.21.15.57:0/1092261143 >> 172.21.15.57:0/1092261143 conn(0x7f8454060780 msgr2=0x7f8454060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:10.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 -- 172.21.15.57:0/1092261143 shutdown_connections 2021-06-25T04:48:10.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 -- 172.21.15.57:0/1092261143 wait complete. 2021-06-25T04:48:10.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 Processor -- start 2021-06-25T04:48:10.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 -- start start 2021-06-25T04:48:10.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84540aa0e0 0x7f845413f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:10.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84540b0460 0x7f8454067030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:10.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84540b0840 0x7f8454067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:10.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84541525b0 con 0x7f84540b0460 2021-06-25T04:48:10.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84541527a0 con 0x7f84540aa0e0 2021-06-25T04:48:10.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f845938b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8454152a40 con 0x7f84540b0840 2021-06-25T04:48:10.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f844bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84540b0460 0x7f8454067030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:10.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f844bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84540b0460 0x7f8454067030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36232/0 (socket says 172.21.15.57:36232) 2021-06-25T04:48:10.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f844bfff700 1 -- 172.21.15.57:0/2789915732 learned_addr learned my addr 172.21.15.57:0/2789915732 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:10.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f8452ffd700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84540aa0e0 0x7f845413f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:10.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f84537fe700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84540b0840 0x7f8454067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:10.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f844bfff700 1 -- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84540b0840 msgr2=0x7f8454067520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:10.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f844bfff700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84540b0840 0x7f8454067520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:10.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f844bfff700 1 -- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84540aa0e0 msgr2=0x7f845413f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:10.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f844bfff700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84540aa0e0 0x7f845413f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:10.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f844bfff700 1 -- 172.21.15.57:0/2789915732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844400b1e0 con 0x7f84540b0460 2021-06-25T04:48:10.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.447+0000 7f84537fe700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84540b0840 0x7f8454067520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:10.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.451+0000 7f844bfff700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84540b0460 0x7f8454067030 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f843c001fa0 tx=0x7f843c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:10.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.451+0000 7f8450ff9700 1 -- 172.21.15.57:0/2789915732 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f843c007030 con 0x7f84540b0460 2021-06-25T04:48:10.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.451+0000 7f8450ff9700 1 -- 172.21.15.57:0/2789915732 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c007190 con 0x7f84540b0460 2021-06-25T04:48:10.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.451+0000 7f845938b700 1 -- 172.21.15.57:0/2789915732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8454152ce0 con 0x7f84540b0460 2021-06-25T04:48:10.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.451+0000 7f8450ff9700 1 -- 172.21.15.57:0/2789915732 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f843c006510 con 0x7f84540b0460 2021-06-25T04:48:10.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.451+0000 7f845938b700 1 -- 172.21.15.57:0/2789915732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8454153420 con 0x7f84540b0460 2021-06-25T04:48:10.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.451+0000 7f845938b700 1 -- 172.21.15.57:0/2789915732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8454057310 con 0x7f84540b0460 2021-06-25T04:48:10.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.451+0000 7f8450ff9700 1 -- 172.21.15.57:0/2789915732 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f843c010030 con 0x7f84540b0460 2021-06-25T04:48:10.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.455+0000 7f8450ff9700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8438055510 0x7f84380579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:10.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.455+0000 7f8450ff9700 1 -- 172.21.15.57:0/2789915732 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f843c06dc70 con 0x7f84540b0460 2021-06-25T04:48:10.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.455+0000 7f8452ffd700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8438055510 0x7f84380579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:10.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.455+0000 7f8452ffd700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8438055510 0x7f84380579d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f844401b000 tx=0x7f8444015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:10.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.459+0000 7f8450ff9700 1 -- 172.21.15.57:0/2789915732 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f843c043cb0 con 0x7f84540b0460 2021-06-25T04:48:10.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:10.591+0000 7f845938b700 1 -- 172.21.15.57:0/2789915732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8454044610 con 0x7f84540b0460 2021-06-25T04:48:11.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.315+0000 7f8450ff9700 1 -- 172.21.15.57:0/2789915732 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 185+0+0 (secure 0 0 0) 0x7f843c0472d0 con 0x7f84540b0460 2021-06-25T04:48:11.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 -- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8438055510 msgr2=0x7f84380579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:11.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8438055510 0x7f84380579d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f844401b000 tx=0x7f8444015000).stop 2021-06-25T04:48:11.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 -- 172.21.15.57:0/2789915732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84540b0460 msgr2=0x7f8454067030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:11.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84540b0460 0x7f8454067030 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f843c001fa0 tx=0x7f843c007c00).stop 2021-06-25T04:48:11.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 -- 172.21.15.57:0/2789915732 shutdown_connections 2021-06-25T04:48:11.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8438055510 0x7f84380579d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:11.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84540b0840 0x7f8454067520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:11.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84540b0460 0x7f8454067030 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:11.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 --2- 172.21.15.57:0/2789915732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84540aa0e0 0x7f845413f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:11.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 -- 172.21.15.57:0/2789915732 >> 172.21.15.57:0/2789915732 conn(0x7f8454060780 msgr2=0x7f84540b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:11.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 -- 172.21.15.57:0/2789915732 shutdown_connections 2021-06-25T04:48:11.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.323+0000 7f845938b700 1 -- 172.21.15.57:0/2789915732 wait complete. 2021-06-25T04:48:11.333 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:48:11.343 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:48:11.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.447+0000 7f295701e700 1 Processor -- start 2021-06-25T04:48:11.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.447+0000 7f295701e700 1 -- start start 2021-06-25T04:48:11.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29500b46d0 0x7f295013fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:11.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2950143960 0x7f2950140250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:11.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29500b68d0 con 0x7f2950061640 2021-06-25T04:48:11.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29500b9640 con 0x7f29500b46d0 2021-06-25T04:48:11.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29500b6b70 con 0x7f2950143960 2021-06-25T04:48:11.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295581b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29500b46d0 0x7f295013fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:11.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295681d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2950143960 0x7f2950140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:11.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295581b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29500b46d0 0x7f295013fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:44734/0 (socket says 172.21.15.57:44734) 2021-06-25T04:48:11.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295581b700 1 -- 172.21.15.57:0/215792501 learned_addr learned my addr 172.21.15.57:0/215792501 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:11.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295681d700 1 -- 172.21.15.57:0/215792501 >> v2:172.21.15.87:3300/0 conn(0x7f29500b46d0 msgr2=0x7f295013fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:11.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295681d700 1 --2- 172.21.15.57:0/215792501 >> v2:172.21.15.87:3300/0 conn(0x7f29500b46d0 0x7f295013fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:11.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295681d700 1 -- 172.21.15.57:0/215792501 >> v1:172.21.15.87:6789/0 conn(0x7f2950061640 legacy=0x7f29500b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:11.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295681d700 1 -- 172.21.15.57:0/215792501 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500b6e10 con 0x7f2950143960 2021-06-25T04:48:11.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295581b700 1 --2- 172.21.15.57:0/215792501 >> v2:172.21.15.87:3300/0 conn(0x7f29500b46d0 0x7f295013fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:11.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295681d700 1 --2- 172.21.15.57:0/215792501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2950143960 0x7f2950140250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2948002f70 tx=0x7f2948006df0).ready entity=mon.2 client_cookie=5ec3cd4a96a8207c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:11.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295501a700 1 -- 172.21.15.57:0/215792501 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f294800d570 con 0x7f2950143960 2021-06-25T04:48:11.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295501a700 1 -- 172.21.15.57:0/215792501 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2948000e90 con 0x7f2950143960 2021-06-25T04:48:11.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295501a700 1 -- 172.21.15.57:0/215792501 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f294800d8c0 con 0x7f2950143960 2021-06-25T04:48:11.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 -- 172.21.15.57:0/215792501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2950143960 msgr2=0x7f2950140250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:11.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 --2- 172.21.15.57:0/215792501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2950143960 0x7f2950140250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2948002f70 tx=0x7f2948006df0).stop 2021-06-25T04:48:11.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 -- 172.21.15.57:0/215792501 shutdown_connections 2021-06-25T04:48:11.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 --2- 172.21.15.57:0/215792501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2950143960 0x7f2950140250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:11.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 --2- 172.21.15.57:0/215792501 >> v2:172.21.15.87:3300/0 conn(0x7f29500b46d0 0x7f295013fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:11.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 -- 172.21.15.57:0/215792501 >> 172.21.15.57:0/215792501 conn(0x7f295006adb0 msgr2=0x7f295005f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:11.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 -- 172.21.15.57:0/215792501 shutdown_connections 2021-06-25T04:48:11.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.451+0000 7f295701e700 1 -- 172.21.15.57:0/215792501 wait complete. 2021-06-25T04:48:11.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295701e700 1 Processor -- start 2021-06-25T04:48:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295701e700 1 -- start start 2021-06-25T04:48:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295701e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2950061640 0x7f29500b7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295701e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2950143960 0x7f29500b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295701e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2950138f80 0x7f2950139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295701e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295013c280 con 0x7f2950138f80 2021-06-25T04:48:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295701e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295013caa0 con 0x7f2950143960 2021-06-25T04:48:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295701e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2950139900 con 0x7f2950061640 2021-06-25T04:48:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295681d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2950138f80 0x7f2950139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295681d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2950138f80 0x7f2950139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36248/0 (socket says 172.21.15.57:36248) 2021-06-25T04:48:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295681d700 1 -- 172.21.15.57:0/3627795267 learned_addr learned my addr 172.21.15.57:0/3627795267 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:11.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295581b700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2950143960 0x7f29500b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:11.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295601c700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2950061640 0x7f29500b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295681d700 1 -- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2950061640 msgr2=0x7f29500b7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295681d700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2950061640 0x7f29500b7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295681d700 1 -- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2950143960 msgr2=0x7f29500b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295681d700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2950143960 0x7f29500b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295681d700 1 -- 172.21.15.57:0/3627795267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944009530 con 0x7f2950138f80 2021-06-25T04:48:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295681d700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2950138f80 0x7f2950139410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f295013bc80 tx=0x7f2948014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:11.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f294f7fe700 1 -- 172.21.15.57:0/3627795267 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2948006b20 con 0x7f2950138f80 2021-06-25T04:48:11.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f294f7fe700 1 -- 172.21.15.57:0/3627795267 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2948012d50 con 0x7f2950138f80 2021-06-25T04:48:11.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f294f7fe700 1 -- 172.21.15.57:0/3627795267 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f294800dea0 con 0x7f2950138f80 2021-06-25T04:48:11.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295701e700 1 -- 172.21.15.57:0/3627795267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294800b180 con 0x7f2950138f80 2021-06-25T04:48:11.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.455+0000 7f295701e700 1 -- 172.21.15.57:0/3627795267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295013ccd0 con 0x7f2950138f80 2021-06-25T04:48:11.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.459+0000 7f295701e700 1 -- 172.21.15.57:0/3627795267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2950152300 con 0x7f2950138f80 2021-06-25T04:48:11.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.459+0000 7f294f7fe700 1 -- 172.21.15.57:0/3627795267 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2948025020 con 0x7f2950138f80 2021-06-25T04:48:11.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.459+0000 7f294f7fe700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29300554e0 0x7f29300579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:11.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.459+0000 7f294f7fe700 1 -- 172.21.15.57:0/3627795267 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6079+0+0 (secure 0 0 0) 0x7f294806ed90 con 0x7f2950138f80 2021-06-25T04:48:11.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.459+0000 7f295601c700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29300554e0 0x7f29300579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:11.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.459+0000 7f295601c700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29300554e0 0x7f29300579a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f294000d000 tx=0x7f2940007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:11.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.467+0000 7f294f7fe700 1 -- 172.21.15.57:0/3627795267 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2948044f90 con 0x7f2950138f80 2021-06-25T04:48:11.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:11.591+0000 7f295701e700 1 -- 172.21.15.57:0/3627795267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2950057310 con 0x7f2950138f80 2021-06-25T04:48:12.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.319+0000 7f294f7fe700 1 -- 172.21.15.57:0/3627795267 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7f29480485b0 con 0x7f2950138f80 2021-06-25T04:48:12.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 -- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29300554e0 msgr2=0x7f29300579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:12.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29300554e0 0x7f29300579a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f294000d000 tx=0x7f2940007b90).stop 2021-06-25T04:48:12.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 -- 172.21.15.57:0/3627795267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2950138f80 msgr2=0x7f2950139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:12.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2950138f80 0x7f2950139410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f295013bc80 tx=0x7f2948014000).stop 2021-06-25T04:48:12.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 -- 172.21.15.57:0/3627795267 shutdown_connections 2021-06-25T04:48:12.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29300554e0 0x7f29300579a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:12.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2950138f80 0x7f2950139410 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:12.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2950143960 0x7f29500b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:12.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 --2- 172.21.15.57:0/3627795267 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2950061640 0x7f29500b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:12.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 -- 172.21.15.57:0/3627795267 >> 172.21.15.57:0/3627795267 conn(0x7f295006adb0 msgr2=0x7f2950141520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:12.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 -- 172.21.15.57:0/3627795267 shutdown_connections 2021-06-25T04:48:12.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.327+0000 7f295701e700 1 -- 172.21.15.57:0/3627795267 wait complete. 2021-06-25T04:48:12.338 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:48:12.347 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:48:12.349 INFO:tasks.ceph.mds.a:Stopping old one... 2021-06-25T04:48:12.349 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:48:12.350 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:48:12.350 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:48:12.350 INFO:tasks.ceph.mds.c:Stopping old one... 2021-06-25T04:48:12.351 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:48:12.351 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:48:12.351 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:48:12.351 INFO:tasks.ceph.mds.b:Stopping old one... 2021-06-25T04:48:12.352 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:48:12.352 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:48:12.360 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:48:12.360 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:48:12.363 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:48:12.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:48:12.365 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:48:12.365 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:48:12.368 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:48:12.368 DEBUG:teuthology.parallel:result is None 2021-06-25T04:48:12.406 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:48:12.406 DEBUG:teuthology.parallel:result is None 2021-06-25T04:48:12.407 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:48:12.408 DEBUG:teuthology.parallel:result is None 2021-06-25T04:48:12.409 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:48:12.444 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:48:12.487 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:48:12.498 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:48:12.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc035822700 1 Processor -- start 2021-06-25T04:48:12.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc035822700 1 -- start start 2021-06-25T04:48:12.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc035822700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc0300612e0 0x7fc0300616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:12.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc035822700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0300ad580 0x7fc0300b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:12.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc035822700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0300aecb0 con 0x7fc030140400 2021-06-25T04:48:12.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc035822700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0300b6ee0 con 0x7fc0300612e0 2021-06-25T04:48:12.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc035822700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300aeee0 con 0x7fc0300ad580 2021-06-25T04:48:12.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc034820700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc0300612e0 0x7fc0300616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:12.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc02ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0300ad580 0x7fc0300b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:12.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc034820700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc0300612e0 0x7fc0300616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36276/0 (socket says 172.21.15.57:36276) 2021-06-25T04:48:12.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc034820700 1 -- 172.21.15.57:0/657360574 learned_addr learned my addr 172.21.15.57:0/657360574 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:12.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc02ffff700 1 -- 172.21.15.57:0/657360574 >> v2:172.21.15.57:3300/0 conn(0x7fc0300612e0 msgr2=0x7fc0300616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:12.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc02ffff700 1 --2- 172.21.15.57:0/657360574 >> v2:172.21.15.57:3300/0 conn(0x7fc0300612e0 0x7fc0300616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:12.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc02ffff700 1 -- 172.21.15.57:0/657360574 >> v1:172.21.15.87:6789/0 conn(0x7fc030140400 legacy=0x7fc0301464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:12.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc02f7fe700 1 -- 172.21.15.57:0/657360574 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731815687 0 0) 0x7fc0300aecb0 con 0x7fc030140400 2021-06-25T04:48:12.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.519+0000 7fc02ffff700 1 -- 172.21.15.57:0/657360574 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0300af180 con 0x7fc0300ad580 2021-06-25T04:48:12.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc02ffff700 1 --2- 172.21.15.57:0/657360574 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0300ad580 0x7fc0300b9e20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc020002f70 tx=0x7fc020006df0).ready entity=mon.2 client_cookie=cdd7be6966d06aa1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:12.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc02f7fe700 1 -- 172.21.15.57:0/657360574 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc02000d570 con 0x7fc0300ad580 2021-06-25T04:48:12.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc02f7fe700 1 -- 172.21.15.57:0/657360574 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc020000e90 con 0x7fc0300ad580 2021-06-25T04:48:12.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc02f7fe700 1 -- 172.21.15.57:0/657360574 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc02000d8c0 con 0x7fc0300ad580 2021-06-25T04:48:12.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc035822700 1 -- 172.21.15.57:0/657360574 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0300ad580 msgr2=0x7fc0300b9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:12.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc035822700 1 --2- 172.21.15.57:0/657360574 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0300ad580 0x7fc0300b9e20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc020002f70 tx=0x7fc020006df0).stop 2021-06-25T04:48:12.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc035822700 1 -- 172.21.15.57:0/657360574 shutdown_connections 2021-06-25T04:48:12.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc035822700 1 --2- 172.21.15.57:0/657360574 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0300ad580 0x7fc0300b9e20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:12.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc035822700 1 --2- 172.21.15.57:0/657360574 >> v2:172.21.15.57:3300/0 conn(0x7fc0300612e0 0x7fc0300616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:12.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc035822700 1 -- 172.21.15.57:0/657360574 >> 172.21.15.57:0/657360574 conn(0x7fc030066da0 msgr2=0x7fc030067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:12.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc035822700 1 -- 172.21.15.57:0/657360574 shutdown_connections 2021-06-25T04:48:12.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc035822700 1 -- 172.21.15.57:0/657360574 wait complete. 2021-06-25T04:48:12.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.523+0000 7fc035822700 1 Processor -- start 2021-06-25T04:48:12.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035822700 1 -- start start 2021-06-25T04:48:12.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035822700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0300612e0 0x7fc0300b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:12.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035822700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300ad580 0x7fc030152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:12.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035822700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc030140400 0x7fc030152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:12.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035822700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300b1250 con 0x7fc0300ad580 2021-06-25T04:48:12.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035822700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc030156430 con 0x7fc0300612e0 2021-06-25T04:48:12.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035822700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc030146540 con 0x7fc030140400 2021-06-25T04:48:12.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc02ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300ad580 0x7fc030152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:12.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc034820700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0300612e0 0x7fc0300b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:12.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc02ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300ad580 0x7fc030152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36284/0 (socket says 172.21.15.57:36284) 2021-06-25T04:48:12.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc02ffff700 1 -- 172.21.15.57:0/3577676546 learned_addr learned my addr 172.21.15.57:0/3577676546 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:12.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035021700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc030140400 0x7fc030152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:12.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035021700 1 -- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0300612e0 msgr2=0x7fc0300b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:12.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035021700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0300612e0 0x7fc0300b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:12.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035021700 1 -- 172.21.15.57:0/3577676546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300ad580 msgr2=0x7fc030152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:12.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035021700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300ad580 0x7fc030152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:12.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035021700 1 -- 172.21.15.57:0/3577676546 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02000b180 con 0x7fc030140400 2021-06-25T04:48:12.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035021700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc030140400 0x7fc030152640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc028001250 tx=0x7fc028007e80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:12.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc02dffb700 1 -- 172.21.15.57:0/3577676546 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc02800f470 con 0x7fc030140400 2021-06-25T04:48:12.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc02dffb700 1 -- 172.21.15.57:0/3577676546 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02800f5d0 con 0x7fc030140400 2021-06-25T04:48:12.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035822700 1 -- 172.21.15.57:0/3577676546 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0301467e0 con 0x7fc030140400 2021-06-25T04:48:12.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc02dffb700 1 -- 172.21.15.57:0/3577676546 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc02800f930 con 0x7fc030140400 2021-06-25T04:48:12.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.527+0000 7fc035822700 1 -- 172.21.15.57:0/3577676546 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03009e870 con 0x7fc030140400 2021-06-25T04:48:12.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.531+0000 7fc035822700 1 -- 172.21.15.57:0/3577676546 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc030156200 con 0x7fc030140400 2021-06-25T04:48:12.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.531+0000 7fc02dffb700 1 -- 172.21.15.57:0/3577676546 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc028019030 con 0x7fc030140400 2021-06-25T04:48:12.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.531+0000 7fc02dffb700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc010055340 0x7fc010057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:12.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.531+0000 7fc02dffb700 1 -- 172.21.15.57:0/3577676546 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc02806d510 con 0x7fc030140400 2021-06-25T04:48:12.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.531+0000 7fc034820700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc010055340 0x7fc010057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:12.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.531+0000 7fc034820700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc010055340 0x7fc010057800 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc024008000 tx=0x7fc024008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:12.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.543+0000 7fc02dffb700 1 -- 172.21.15.57:0/3577676546 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc028043920 con 0x7fc030140400 2021-06-25T04:48:12.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:12.679+0000 7fc035822700 1 -- 172.21.15.57:0/3577676546 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fc0300620c0 con 0x7fc030140400 2021-06-25T04:48:13.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.507+0000 7fc02dffb700 1 -- 172.21.15.57:0/3577676546 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc028046f40 con 0x7fc030140400 2021-06-25T04:48:13.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 -- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc010055340 msgr2=0x7fc010057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:13.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc010055340 0x7fc010057800 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc024008000 tx=0x7fc024008040).stop 2021-06-25T04:48:13.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 -- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc030140400 msgr2=0x7fc030152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:13.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc030140400 0x7fc030152640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc028001250 tx=0x7fc028007e80).stop 2021-06-25T04:48:13.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 -- 172.21.15.57:0/3577676546 shutdown_connections 2021-06-25T04:48:13.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc010055340 0x7fc010057800 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc030140400 0x7fc030152640 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300ad580 0x7fc030152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 --2- 172.21.15.57:0/3577676546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0300612e0 0x7fc0300b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 -- 172.21.15.57:0/3577676546 >> 172.21.15.57:0/3577676546 conn(0x7fc030066da0 msgr2=0x7fc0300b8500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:13.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 -- 172.21.15.57:0/3577676546 shutdown_connections 2021-06-25T04:48:13.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.511+0000 7fc035822700 1 -- 172.21.15.57:0/3577676546 wait complete. 2021-06-25T04:48:13.524 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:48:13.536 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:48:13.537 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:48:13.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.635+0000 7f597e60b700 1 Processor -- start 2021-06-25T04:48:13.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.635+0000 7f597e60b700 1 -- start start 2021-06-25T04:48:13.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.635+0000 7f597e60b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59780b52c0 0x7f59780ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:13.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.635+0000 7f597e60b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5978063760 0x7f59780b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:13.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.635+0000 7f597e60b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f59781435e0 0x7f5978066fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:13.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.635+0000 7f597e60b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5978063b80 con 0x7f5978063760 2021-06-25T04:48:13.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.635+0000 7f597e60b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59780adf50 con 0x7f59781435e0 2021-06-25T04:48:13.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.635+0000 7f597e60b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59780ae1f0 con 0x7f59780b52c0 2021-06-25T04:48:13.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597ce08700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5978063760 0x7f59780b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:13.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597ce08700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5978063760 0x7f59780b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36292/0 (socket says 172.21.15.57:36292) 2021-06-25T04:48:13.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597ce08700 1 -- 172.21.15.57:0/3542383899 learned_addr learned my addr 172.21.15.57:0/3542383899 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:13.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597de0a700 1 --2- 172.21.15.57:0/3542383899 >> v2:172.21.15.87:3300/0 conn(0x7f59781435e0 0x7f5978066fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:13.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597d609700 1 --2- 172.21.15.57:0/3542383899 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59780b52c0 0x7f59780ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:13.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597ce08700 1 -- 172.21.15.57:0/3542383899 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59780b52c0 msgr2=0x7f59780ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:13.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597ce08700 1 --2- 172.21.15.57:0/3542383899 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59780b52c0 0x7f59780ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597ce08700 1 -- 172.21.15.57:0/3542383899 >> v2:172.21.15.87:3300/0 conn(0x7f59781435e0 msgr2=0x7f5978066fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:13.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597ce08700 1 --2- 172.21.15.57:0/3542383899 >> v2:172.21.15.87:3300/0 conn(0x7f59781435e0 0x7f5978066fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597ce08700 1 -- 172.21.15.57:0/3542383899 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59780ae490 con 0x7f5978063760 2021-06-25T04:48:13.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597ce08700 1 --2- 172.21.15.57:0/3542383899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5978063760 0x7f59780b1650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f5968002f70 tx=0x7f5968006eb0).ready entity=mon.0 client_cookie=23bf836155974501 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:13.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f5967fff700 1 -- 172.21.15.57:0/3542383899 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596800d570 con 0x7f5978063760 2021-06-25T04:48:13.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f5967fff700 1 -- 172.21.15.57:0/3542383899 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968000e90 con 0x7f5978063760 2021-06-25T04:48:13.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f5967fff700 1 -- 172.21.15.57:0/3542383899 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596800d900 con 0x7f5978063760 2021-06-25T04:48:13.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597e60b700 1 -- 172.21.15.57:0/3542383899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5978063760 msgr2=0x7f59780b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:13.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597e60b700 1 --2- 172.21.15.57:0/3542383899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5978063760 0x7f59780b1650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f5968002f70 tx=0x7f5968006eb0).stop 2021-06-25T04:48:13.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597e60b700 1 -- 172.21.15.57:0/3542383899 shutdown_connections 2021-06-25T04:48:13.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597e60b700 1 --2- 172.21.15.57:0/3542383899 >> v2:172.21.15.87:3300/0 conn(0x7f59781435e0 0x7f5978066fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597e60b700 1 --2- 172.21.15.57:0/3542383899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5978063760 0x7f59780b1650 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597e60b700 1 --2- 172.21.15.57:0/3542383899 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59780b52c0 0x7f59780ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597e60b700 1 -- 172.21.15.57:0/3542383899 >> 172.21.15.57:0/3542383899 conn(0x7f5978062520 msgr2=0x7f5978062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:13.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597e60b700 1 -- 172.21.15.57:0/3542383899 shutdown_connections 2021-06-25T04:48:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.639+0000 7f597e60b700 1 -- 172.21.15.57:0/3542383899 wait complete. 2021-06-25T04:48:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597e60b700 1 Processor -- start 2021-06-25T04:48:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597e60b700 1 -- start start 2021-06-25T04:48:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597e60b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5978063760 0x7f5978146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:13.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597e60b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59780b52c0 0x7f5978154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:13.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597e60b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59781435e0 0x7f5978150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:13.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597e60b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597813ab80 con 0x7f59781435e0 2021-06-25T04:48:13.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597e60b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597813b940 con 0x7f5978063760 2021-06-25T04:48:13.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597e60b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597813bbe0 con 0x7f59780b52c0 2021-06-25T04:48:13.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597de0a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59781435e0 0x7f5978150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:13.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597de0a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59781435e0 0x7f5978150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36302/0 (socket says 172.21.15.57:36302) 2021-06-25T04:48:13.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597de0a700 1 -- 172.21.15.57:0/638984767 learned_addr learned my addr 172.21.15.57:0/638984767 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:13.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597ce08700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59780b52c0 0x7f5978154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:13.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597d609700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5978063760 0x7f5978146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:13.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597de0a700 1 -- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59780b52c0 msgr2=0x7f5978154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:13.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597de0a700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59780b52c0 0x7f5978154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597de0a700 1 -- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5978063760 msgr2=0x7f5978146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:13.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.643+0000 7f597de0a700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5978063760 0x7f5978146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f597de0a700 1 -- 172.21.15.57:0/638984767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596800b1e0 con 0x7f59781435e0 2021-06-25T04:48:13.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f597de0a700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59781435e0 0x7f5978150910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f5970006e00 tx=0x7f59700091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f59667fc700 1 -- 172.21.15.57:0/638984767 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597000c670 con 0x7f59781435e0 2021-06-25T04:48:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f59667fc700 1 -- 172.21.15.57:0/638984767 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597000c7d0 con 0x7f59781435e0 2021-06-25T04:48:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f597e60b700 1 -- 172.21.15.57:0/638984767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597813be80 con 0x7f59781435e0 2021-06-25T04:48:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f59667fc700 1 -- 172.21.15.57:0/638984767 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597000cb30 con 0x7f59781435e0 2021-06-25T04:48:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f597e60b700 1 -- 172.21.15.57:0/638984767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5978154780 con 0x7f59781435e0 2021-06-25T04:48:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f597e60b700 1 -- 172.21.15.57:0/638984767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5978057310 con 0x7f59781435e0 2021-06-25T04:48:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f59667fc700 1 -- 172.21.15.57:0/638984767 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f597000cc90 con 0x7f59781435e0 2021-06-25T04:48:13.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f59667fc700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5958055450 0x7f5958057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:13.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f59667fc700 1 -- 172.21.15.57:0/638984767 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f597006dea0 con 0x7f59781435e0 2021-06-25T04:48:13.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.647+0000 7f597d609700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5958055450 0x7f5958057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:13.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.651+0000 7f597d609700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5958055450 0x7f5958057910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f597400b000 tx=0x7f5974006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:13.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.655+0000 7f59667fc700 1 -- 172.21.15.57:0/638984767 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f597006ac50 con 0x7f59781435e0 2021-06-25T04:48:13.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.847+0000 7f597e60b700 1 -- 172.21.15.57:0/638984767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f597805f200 con 0x7f59781435e0 2021-06-25T04:48:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.847+0000 7f59667fc700 1 -- 172.21.15.57:0/638984767 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5621 (secure 0 0 0) 0x7f5970016070 con 0x7f59781435e0 2021-06-25T04:48:13.857 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:13.857 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:48:13.857 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:48:13.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.858 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:48:13.858 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:48:13.858 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.858 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:48:13.859 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.859 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.859 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.860 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.861 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:48:13.861 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:48:13.861 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.861 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:48:13.861 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.862 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.862 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.863 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.863 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:48:13.864 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:48:13.864 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.864 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:48:13.864 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.865 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.865 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.865 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.866 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:48:13.866 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:48:13.866 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.866 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.867 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.867 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.867 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.868 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:48:13.868 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:48:13.868 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.868 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.869 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.869 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.869 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.870 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:48:13.871 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:48:13.871 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.871 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.871 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.872 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.873 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:48:13.873 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:48:13.873 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.874 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.874 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.874 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.874 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.875 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:48:13.875 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:48:13.875 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.876 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.876 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.876 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.876 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.877 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:48:13.877 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:48:13.877 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.878 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.878 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.878 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.878 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.879 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:48:13.879 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:48:13.879 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.880 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.880 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.880 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.881 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.881 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:48:13.882 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:48:13.882 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.882 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.882 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.882 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.883 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.884 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:48:13.884 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:48:13.884 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.884 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:48:13.885 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2021-06-25T04:48:13.885 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2021-06-25T04:48:13.885 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2021-06-25T04:48:13.885 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.887 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:48:13.887 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:48:13.888 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.888 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:48:13.889 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2021-06-25T04:48:13.889 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2021-06-25T04:48:13.889 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2021-06-25T04:48:13.890 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.891 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:48:13.892 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:48:13.892 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.892 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:48:13.892 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:48:13.892 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:48:13.893 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.893 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.894 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-mds", 2021-06-25T04:48:13.894 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDYX9VgstHTGBAAEChSupO3LV3W/D+WsPRAyQ==", 2021-06-25T04:48:13.894 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.894 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-mds" 2021-06-25T04:48:13.894 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.895 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-mgr", 2021-06-25T04:48:13.895 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDYX9Vg3u/TGBAAxsd8a6EYwW1PWINWtILDzg==", 2021-06-25T04:48:13.896 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.896 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-mgr" 2021-06-25T04:48:13.896 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.897 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-osd", 2021-06-25T04:48:13.897 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDYX9VgwgfUGBAA0zDcjUUjSe6zVvXpXiUVXA==", 2021-06-25T04:48:13.897 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.897 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-osd" 2021-06-25T04:48:13.898 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.898 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rbd", 2021-06-25T04:48:13.899 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDYX9VguCDUGBAAJLosjHA+/E1EDfhyXBVL1g==", 2021-06-25T04:48:13.899 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.899 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rbd" 2021-06-25T04:48:13.899 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.900 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rbd-mirror", 2021-06-25T04:48:13.900 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDYX9VgqznUGBAAgcnN7TOA68eSVwAEPhWZBw==", 2021-06-25T04:48:13.900 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.900 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2021-06-25T04:48:13.901 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.901 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rgw", 2021-06-25T04:48:13.902 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDYX9Vg0lHUGBAAhM6bJorsgAwd08NPds1kuw==", 2021-06-25T04:48:13.902 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.902 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rgw" 2021-06-25T04:48:13.902 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.903 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:48:13.903 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:48:13.904 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.904 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:48:13.904 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:48:13.904 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.905 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:13.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:13.905 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:48:13.905 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:48:13.906 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:48:13.906 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:48:13.906 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:48:13.906 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:48:13.907 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.907 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:13.907 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:48:13.907 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:48:13.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 -- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5958055450 msgr2=0x7f5958057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:13.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5958055450 0x7f5958057910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f597400b000 tx=0x7f5974006df0).stop 2021-06-25T04:48:13.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 -- 172.21.15.57:0/638984767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59781435e0 msgr2=0x7f5978150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:13.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59781435e0 0x7f5978150910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f5970006e00 tx=0x7f59700091d0).stop 2021-06-25T04:48:13.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 -- 172.21.15.57:0/638984767 shutdown_connections 2021-06-25T04:48:13.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5958055450 0x7f5958057910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59781435e0 0x7f5978150910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59780b52c0 0x7f5978154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 --2- 172.21.15.57:0/638984767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5978063760 0x7f5978146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:13.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 -- 172.21.15.57:0/638984767 >> 172.21.15.57:0/638984767 conn(0x7f5978062520 msgr2=0x7f59780b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:13.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 -- 172.21.15.57:0/638984767 shutdown_connections 2021-06-25T04:48:13.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:13.851+0000 7f597e60b700 1 -- 172.21.15.57:0/638984767 wait complete. 2021-06-25T04:48:13.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2021-06-25T04:48:14.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.015+0000 7fe9d262b700 1 Processor -- start 2021-06-25T04:48:14.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.015+0000 7fe9d262b700 1 -- start start 2021-06-25T04:48:14.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.015+0000 7fe9d262b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe9cc067140 0x7fe9cc05f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.015+0000 7fe9d262b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc0a7a50 con 0x7fe9cc0a7670 2021-06-25T04:48:14.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.015+0000 7fe9d262b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc1475e0 con 0x7fe9cc0b1930 2021-06-25T04:48:14.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.015+0000 7fe9d262b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9cc147880 con 0x7fe9cc067140 2021-06-25T04:48:14.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.015+0000 7fe9cbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe9cc0a7670 0x7fe9cc066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53524/0 (socket says 172.21.15.57:53524) 2021-06-25T04:48:14.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.015+0000 7fe9c3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe9cc067140 0x7fe9cc05f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.015+0000 7fe9cbfff700 1 -- 172.21.15.57:0/1531564021 learned_addr learned my addr 172.21.15.57:0/1531564021 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:14.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.015+0000 7fe9cb7fe700 1 -- 172.21.15.57:0/1531564021 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049737321 0 0) 0x7fe9cc0a7a50 con 0x7fe9cc0a7670 2021-06-25T04:48:14.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.015+0000 7fe9cb7fe700 1 -- 172.21.15.57:0/1531564021 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9ac003260 con 0x7fe9cc0a7670 2021-06-25T04:48:14.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9c3fff700 1 -- 172.21.15.57:0/1531564021 >> v1:172.21.15.87:6789/0 conn(0x7fe9cc0b1930 legacy=0x7fe9cc05fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9c3fff700 1 -- 172.21.15.57:0/1531564021 >> v1:172.21.15.57:6789/0 conn(0x7fe9cc0a7670 legacy=0x7fe9cc066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9cb7fe700 1 -- 172.21.15.57:0/1531564021 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715824997 0 0) 0x7fe9cc1475e0 con 0x7fe9cc0b1930 2021-06-25T04:48:14.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9c3fff700 1 -- 172.21.15.57:0/1531564021 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc147b20 con 0x7fe9cc067140 2021-06-25T04:48:14.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9c3fff700 1 --2- 172.21.15.57:0/1531564021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc067140 0x7fe9cc05f670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fe9bc001800 tx=0x7fe9b4006df0).ready entity=mon.0 client_cookie=9dde219ccd6b7bdc server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:14.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9cb7fe700 1 -- 172.21.15.57:0/1531564021 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9bc001660 con 0x7fe9cc067140 2021-06-25T04:48:14.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9cb7fe700 1 -- 172.21.15.57:0/1531564021 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b4000e90 con 0x7fe9cc067140 2021-06-25T04:48:14.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9cb7fe700 1 -- 172.21.15.57:0/1531564021 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9b4011400 con 0x7fe9cc067140 2021-06-25T04:48:14.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9d262b700 1 -- 172.21.15.57:0/1531564021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc067140 msgr2=0x7fe9cc05f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9d262b700 1 --2- 172.21.15.57:0/1531564021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc067140 0x7fe9cc05f670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fe9bc001800 tx=0x7fe9b4006df0).stop 2021-06-25T04:48:14.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9d262b700 1 -- 172.21.15.57:0/1531564021 shutdown_connections 2021-06-25T04:48:14.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9d262b700 1 --2- 172.21.15.57:0/1531564021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc067140 0x7fe9cc05f670 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9d262b700 1 -- 172.21.15.57:0/1531564021 >> 172.21.15.57:0/1531564021 conn(0x7fe9cc0b53a0 msgr2=0x7fe9cc0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:14.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9d262b700 1 -- 172.21.15.57:0/1531564021 shutdown_connections 2021-06-25T04:48:14.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.019+0000 7fe9d262b700 1 -- 172.21.15.57:0/1531564021 wait complete. 2021-06-25T04:48:14.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d262b700 1 Processor -- start 2021-06-25T04:48:14.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d262b700 1 -- start start 2021-06-25T04:48:14.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d262b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc067140 0x7fe9cc14d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d262b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0a7670 0x7fe9cc156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d262b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b1930 0x7fe9cc156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d262b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0a9e60 con 0x7fe9cc0b1930 2021-06-25T04:48:14.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d262b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc157350 con 0x7fe9cc0a7670 2021-06-25T04:48:14.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d262b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc14eb30 con 0x7fe9cc067140 2021-06-25T04:48:14.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d0bc8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b1930 0x7fe9cc156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d0bc8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b1930 0x7fe9cc156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36314/0 (socket says 172.21.15.57:36314) 2021-06-25T04:48:14.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d0bc8700 1 -- 172.21.15.57:0/3561972861 learned_addr learned my addr 172.21.15.57:0/3561972861 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:14.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9cbfff700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc067140 0x7fe9cc14d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9c3fff700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0a7670 0x7fe9cc156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d0bc8700 1 -- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc067140 msgr2=0x7fe9cc14d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d0bc8700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc067140 0x7fe9cc14d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d0bc8700 1 -- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0a7670 msgr2=0x7fe9cc156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d0bc8700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0a7670 0x7fe9cc156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d0bc8700 1 -- 172.21.15.57:0/3561972861 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b400b180 con 0x7fe9cc0b1930 2021-06-25T04:48:14.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d0bc8700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b1930 0x7fe9cc156e60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fe9c4001250 tx=0x7fe9c4007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:14.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9c9ffb700 1 -- 172.21.15.57:0/3561972861 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c4006aa0 con 0x7fe9cc0b1930 2021-06-25T04:48:14.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9c9ffb700 1 -- 172.21.15.57:0/3561972861 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c4006c00 con 0x7fe9cc0b1930 2021-06-25T04:48:14.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d262b700 1 -- 172.21.15.57:0/3561972861 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc0aa0c0 con 0x7fe9cc0b1930 2021-06-25T04:48:14.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9c9ffb700 1 -- 172.21.15.57:0/3561972861 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c4007030 con 0x7fe9cc0b1930 2021-06-25T04:48:14.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.023+0000 7fe9d262b700 1 -- 172.21.15.57:0/3561972861 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc0aa800 con 0x7fe9cc0b1930 2021-06-25T04:48:14.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.027+0000 7fe9d262b700 1 -- 172.21.15.57:0/3561972861 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc14e970 con 0x7fe9cc0b1930 2021-06-25T04:48:14.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.027+0000 7fe9c9ffb700 1 -- 172.21.15.57:0/3561972861 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe9c401b060 con 0x7fe9cc0b1930 2021-06-25T04:48:14.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.027+0000 7fe9c9ffb700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b00553d0 0x7fe9b0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.027+0000 7fe9c9ffb700 1 -- 172.21.15.57:0/3561972861 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fe9c406d950 con 0x7fe9cc0b1930 2021-06-25T04:48:14.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.027+0000 7fe9cbfff700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b00553d0 0x7fe9b0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.027+0000 7fe9cbfff700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b00553d0 0x7fe9b0057890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe9bc00b000 tx=0x7fe9bc000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:14.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.035+0000 7fe9c9ffb700 1 -- 172.21.15.57:0/3561972861 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe9c4043e40 con 0x7fe9cc0b1930 2021-06-25T04:48:14.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.199+0000 7fe9d262b700 1 -- 172.21.15.57:0/3561972861 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fe9cc156680 con 0x7fe9cc0b1930 2021-06-25T04:48:14.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.207+0000 7fe9c9ffb700 1 -- 172.21.15.57:0/3561972861 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe9c4019070 con 0x7fe9cc0b1930 2021-06-25T04:48:14.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 -- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b00553d0 msgr2=0x7fe9b0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b00553d0 0x7fe9b0057890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe9bc00b000 tx=0x7fe9bc000bc0).stop 2021-06-25T04:48:14.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 -- 172.21.15.57:0/3561972861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b1930 msgr2=0x7fe9cc156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b1930 0x7fe9cc156e60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fe9c4001250 tx=0x7fe9c4007f50).stop 2021-06-25T04:48:14.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 -- 172.21.15.57:0/3561972861 shutdown_connections 2021-06-25T04:48:14.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b00553d0 0x7fe9b0057890 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b1930 0x7fe9cc156e60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0a7670 0x7fe9cc156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 --2- 172.21.15.57:0/3561972861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc067140 0x7fe9cc14d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 -- 172.21.15.57:0/3561972861 >> 172.21.15.57:0/3561972861 conn(0x7fe9cc0b53a0 msgr2=0x7fe9cc149d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:14.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 -- 172.21.15.57:0/3561972861 shutdown_connections 2021-06-25T04:48:14.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.211+0000 7fe9d262b700 1 -- 172.21.15.57:0/3561972861 wait complete. 2021-06-25T04:48:14.223 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2021-06-25T04:48:14.231 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2021-06-25T04:48:14.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab1cbfb700 1 Processor -- start 2021-06-25T04:48:14.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab1cbfb700 1 -- start start 2021-06-25T04:48:14.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab1cbfb700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab180b20d0 0x7fab18139020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab1cbfb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180b18b0 0x7fab18139510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab1cbfb700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab18140370 con 0x7fab180af2b0 2021-06-25T04:48:14.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab1cbfb700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab180ae3c0 con 0x7fab180b20d0 2021-06-25T04:48:14.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab1cbfb700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab180afd30 con 0x7fab180b18b0 2021-06-25T04:48:14.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab16ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab180b20d0 0x7fab18139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab17fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180b18b0 0x7fab18139510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab16ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab180b20d0 0x7fab18139020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:44816/0 (socket says 172.21.15.57:44816) 2021-06-25T04:48:14.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab16ffd700 1 -- 172.21.15.57:0/1263484154 learned_addr learned my addr 172.21.15.57:0/1263484154 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:14.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab17fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180b18b0 0x7fab18139510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:47488/0 (socket says 172.21.15.57:47488) 2021-06-25T04:48:14.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.327+0000 7fab177fe700 1 --1- 172.21.15.57:0/1263484154 >> v1:172.21.15.87:6789/0 conn(0x7fab180af2b0 0x7fab180ab940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:54286/0 (socket says 172.21.15.57:54286) 2021-06-25T04:48:14.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab17fff700 1 -- 172.21.15.57:0/1263484154 >> v2:172.21.15.87:3300/0 conn(0x7fab180b20d0 msgr2=0x7fab18139020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:14.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab17fff700 1 --2- 172.21.15.57:0/1263484154 >> v2:172.21.15.87:3300/0 conn(0x7fab180b20d0 0x7fab18139020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab17fff700 1 -- 172.21.15.57:0/1263484154 >> v1:172.21.15.87:6789/0 conn(0x7fab180af2b0 legacy=0x7fab180ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab17fff700 1 -- 172.21.15.57:0/1263484154 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab180affd0 con 0x7fab180b18b0 2021-06-25T04:48:14.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab17fff700 1 --2- 172.21.15.57:0/1263484154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180b18b0 0x7fab18139510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fab100032f0 tx=0x7fab100091d0).ready entity=mon.2 client_cookie=15b6f172646fba86 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:14.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab167fc700 1 -- 172.21.15.57:0/1263484154 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab1000b6c0 con 0x7fab180b18b0 2021-06-25T04:48:14.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab167fc700 1 -- 172.21.15.57:0/1263484154 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1000b820 con 0x7fab180b18b0 2021-06-25T04:48:14.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab167fc700 1 -- 172.21.15.57:0/1263484154 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab1000b990 con 0x7fab180b18b0 2021-06-25T04:48:14.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab1cbfb700 1 -- 172.21.15.57:0/1263484154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180b18b0 msgr2=0x7fab18139510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab1cbfb700 1 --2- 172.21.15.57:0/1263484154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180b18b0 0x7fab18139510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fab100032f0 tx=0x7fab100091d0).stop 2021-06-25T04:48:14.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab1cbfb700 1 -- 172.21.15.57:0/1263484154 shutdown_connections 2021-06-25T04:48:14.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab1cbfb700 1 --2- 172.21.15.57:0/1263484154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180b18b0 0x7fab18139510 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab1cbfb700 1 --2- 172.21.15.57:0/1263484154 >> v2:172.21.15.87:3300/0 conn(0x7fab180b20d0 0x7fab18139020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab1cbfb700 1 -- 172.21.15.57:0/1263484154 >> 172.21.15.57:0/1263484154 conn(0x7fab18062520 msgr2=0x7fab18062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:14.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab1cbfb700 1 -- 172.21.15.57:0/1263484154 shutdown_connections 2021-06-25T04:48:14.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.331+0000 7fab1cbfb700 1 -- 172.21.15.57:0/1263484154 wait complete. 2021-06-25T04:48:14.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab1cbfb700 1 Processor -- start 2021-06-25T04:48:14.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab1cbfb700 1 -- start start 2021-06-25T04:48:14.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab1cbfb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180af2b0 0x7fab180634f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab1cbfb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab180b18b0 0x7fab18141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab1cbfb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab180b20d0 0x7fab18141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab1cbfb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab181434c0 con 0x7fab180b18b0 2021-06-25T04:48:14.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab1cbfb700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab18142ab0 con 0x7fab180b20d0 2021-06-25T04:48:14.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab1cbfb700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1813a450 con 0x7fab180af2b0 2021-06-25T04:48:14.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab16ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab180b18b0 0x7fab18141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab16ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab180b18b0 0x7fab18141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36328/0 (socket says 172.21.15.57:36328) 2021-06-25T04:48:14.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab16ffd700 1 -- 172.21.15.57:0/10035233 learned_addr learned my addr 172.21.15.57:0/10035233 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:14.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab177fe700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180af2b0 0x7fab180634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab17fff700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab180b20d0 0x7fab18141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab16ffd700 1 -- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180af2b0 msgr2=0x7fab180634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab16ffd700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180af2b0 0x7fab180634f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab16ffd700 1 -- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab180b20d0 msgr2=0x7fab18141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab16ffd700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab180b20d0 0x7fab18141b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab16ffd700 1 -- 172.21.15.57:0/10035233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab10009470 con 0x7fab180b18b0 2021-06-25T04:48:14.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab177fe700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180af2b0 0x7fab180634f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:14.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab16ffd700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab180b18b0 0x7fab18141620 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fab0c00c000 tx=0x7fab0c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:14.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab14ff9700 1 -- 172.21.15.57:0/10035233 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab0c013610 con 0x7fab180b18b0 2021-06-25T04:48:14.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab14ff9700 1 -- 172.21.15.57:0/10035233 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0c013770 con 0x7fab180b18b0 2021-06-25T04:48:14.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab1cbfb700 1 -- 172.21.15.57:0/10035233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab181436f0 con 0x7fab180b18b0 2021-06-25T04:48:14.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab14ff9700 1 -- 172.21.15.57:0/10035233 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab0c013ad0 con 0x7fab180b18b0 2021-06-25T04:48:14.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.335+0000 7fab1cbfb700 1 -- 172.21.15.57:0/10035233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab18063ba0 con 0x7fab180b18b0 2021-06-25T04:48:14.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.339+0000 7fab1cbfb700 1 -- 172.21.15.57:0/10035233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab18057310 con 0x7fab180b18b0 2021-06-25T04:48:14.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.339+0000 7fab14ff9700 1 -- 172.21.15.57:0/10035233 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fab0c023070 con 0x7fab180b18b0 2021-06-25T04:48:14.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.339+0000 7fab14ff9700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faaf8055450 0x7faaf8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.339+0000 7fab14ff9700 1 -- 172.21.15.57:0/10035233 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fab0c06de30 con 0x7fab180b18b0 2021-06-25T04:48:14.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.339+0000 7fab177fe700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faaf8055450 0x7faaf8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.339+0000 7fab177fe700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faaf8055450 0x7faaf8057910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fab0800b000 tx=0x7fab080070e0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:14.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.347+0000 7fab14ff9700 1 -- 172.21.15.57:0/10035233 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fab0c06ac50 con 0x7fab180b18b0 2021-06-25T04:48:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.519+0000 7fab1cbfb700 1 -- 172.21.15.57:0/10035233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fab180ac3c0 con 0x7fab180b18b0 2021-06-25T04:48:14.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.527+0000 7fab14ff9700 1 -- 172.21.15.57:0/10035233 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7fab0c044280 con 0x7fab180b18b0 2021-06-25T04:48:14.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 -- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faaf8055450 msgr2=0x7faaf8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faaf8055450 0x7faaf8057910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fab0800b000 tx=0x7fab080070e0).stop 2021-06-25T04:48:14.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 -- 172.21.15.57:0/10035233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab180b18b0 msgr2=0x7fab18141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab180b18b0 0x7fab18141620 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fab0c00c000 tx=0x7fab0c008040).stop 2021-06-25T04:48:14.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 -- 172.21.15.57:0/10035233 shutdown_connections 2021-06-25T04:48:14.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faaf8055450 0x7faaf8057910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab180b20d0 0x7fab18141b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab180b18b0 0x7fab18141620 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 --2- 172.21.15.57:0/10035233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab180af2b0 0x7fab180634f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 -- 172.21.15.57:0/10035233 >> 172.21.15.57:0/10035233 conn(0x7fab18062520 msgr2=0x7fab1813d990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:14.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 -- 172.21.15.57:0/10035233 shutdown_connections 2021-06-25T04:48:14.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.531+0000 7fab1cbfb700 1 -- 172.21.15.57:0/10035233 wait complete. 2021-06-25T04:48:14.541 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2021-06-25T04:48:14.550 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2021-06-25T04:48:14.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.651+0000 7ff0796ea700 1 Processor -- start 2021-06-25T04:48:14.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.651+0000 7ff0796ea700 1 -- start start 2021-06-25T04:48:14.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0796ea700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff0740acee0 0x7ff0740ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0796ea700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0740b2bf0 con 0x7ff07413c6a0 2021-06-25T04:48:14.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0796ea700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0740b1620 con 0x7ff0740b2810 2021-06-25T04:48:14.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0796ea700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0740b1170 con 0x7ff0740acee0 2021-06-25T04:48:14.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0737fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff07413c6a0 0x7ff07413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53554/0 (socket says 172.21.15.57:53554) 2021-06-25T04:48:14.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0737fe700 1 -- 172.21.15.57:0/2290840607 learned_addr learned my addr 172.21.15.57:0/2290840607 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:14.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff078ee9700 1 --2- 172.21.15.57:0/2290840607 >> v2:172.21.15.87:3300/0 conn(0x7ff0740acee0 0x7ff0740ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff072ffd700 1 -- 172.21.15.57:0/2290840607 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559872368 0 0) 0x7ff0740b2bf0 con 0x7ff07413c6a0 2021-06-25T04:48:14.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff072ffd700 1 -- 172.21.15.57:0/2290840607 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff058003260 con 0x7ff07413c6a0 2021-06-25T04:48:14.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff078ee9700 1 -- 172.21.15.57:0/2290840607 >> v1:172.21.15.87:6789/0 conn(0x7ff0740b2810 legacy=0x7ff0740b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff078ee9700 1 -- 172.21.15.57:0/2290840607 >> v1:172.21.15.57:6789/0 conn(0x7ff07413c6a0 legacy=0x7ff07413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff078ee9700 1 -- 172.21.15.57:0/2290840607 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0740b18c0 con 0x7ff0740acee0 2021-06-25T04:48:14.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff078ee9700 1 --2- 172.21.15.57:0/2290840607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0740acee0 0x7ff0740ad300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff06c0032f0 tx=0x7ff06c0091d0).ready entity=mon.1 client_cookie=1d5b62c13ff3f033 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:14.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff072ffd700 1 -- 172.21.15.57:0/2290840607 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff06c00b6c0 con 0x7ff0740acee0 2021-06-25T04:48:14.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff072ffd700 1 -- 172.21.15.57:0/2290840607 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c00b820 con 0x7ff0740acee0 2021-06-25T04:48:14.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff072ffd700 1 -- 172.21.15.57:0/2290840607 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff06c00b990 con 0x7ff0740acee0 2021-06-25T04:48:14.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0796ea700 1 -- 172.21.15.57:0/2290840607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0740acee0 msgr2=0x7ff0740ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0796ea700 1 --2- 172.21.15.57:0/2290840607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0740acee0 0x7ff0740ad300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff06c0032f0 tx=0x7ff06c0091d0).stop 2021-06-25T04:48:14.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0796ea700 1 -- 172.21.15.57:0/2290840607 shutdown_connections 2021-06-25T04:48:14.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0796ea700 1 --2- 172.21.15.57:0/2290840607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0740acee0 0x7ff0740ad300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0796ea700 1 -- 172.21.15.57:0/2290840607 >> 172.21.15.57:0/2290840607 conn(0x7ff0740611f0 msgr2=0x7ff074062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:14.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0796ea700 1 -- 172.21.15.57:0/2290840607 shutdown_connections 2021-06-25T04:48:14.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.655+0000 7ff0796ea700 1 -- 172.21.15.57:0/2290840607 wait complete. 2021-06-25T04:48:14.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0796ea700 1 Processor -- start 2021-06-25T04:48:14.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0796ea700 1 -- start start 2021-06-25T04:48:14.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0796ea700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0740acee0 0x7ff074139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0796ea700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0740b2810 0x7ff074066180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0796ea700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff07413c6a0 0x7ff07413b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0796ea700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740675f0 con 0x7ff07413c6a0 2021-06-25T04:48:14.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0796ea700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740b4d00 con 0x7ff0740acee0 2021-06-25T04:48:14.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0796ea700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740b4fa0 con 0x7ff0740b2810 2021-06-25T04:48:14.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff078ee9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff07413c6a0 0x7ff07413b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff078ee9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff07413c6a0 0x7ff07413b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36344/0 (socket says 172.21.15.57:36344) 2021-06-25T04:48:14.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff078ee9700 1 -- 172.21.15.57:0/3040984084 learned_addr learned my addr 172.21.15.57:0/3040984084 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:14.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0737fe700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0740b2810 0x7ff074066180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff073fff700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0740acee0 0x7ff074139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff073fff700 1 -- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0740b2810 msgr2=0x7ff074066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff073fff700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0740b2810 0x7ff074066180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff073fff700 1 -- 172.21.15.57:0/3040984084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff07413c6a0 msgr2=0x7ff07413b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff073fff700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff07413c6a0 0x7ff07413b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff073fff700 1 -- 172.21.15.57:0/3040984084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c009470 con 0x7ff0740acee0 2021-06-25T04:48:14.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff078ee9700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff07413c6a0 0x7ff07413b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:14.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff073fff700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0740acee0 0x7ff074139870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff074065a00 tx=0x7ff064007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:14.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0717fa700 1 -- 172.21.15.57:0/3040984084 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff064012400 con 0x7ff0740acee0 2021-06-25T04:48:14.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0717fa700 1 -- 172.21.15.57:0/3040984084 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff064012560 con 0x7ff0740acee0 2021-06-25T04:48:14.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0796ea700 1 -- 172.21.15.57:0/3040984084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0740b5600 con 0x7ff0740acee0 2021-06-25T04:48:14.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0717fa700 1 -- 172.21.15.57:0/3040984084 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0640128c0 con 0x7ff0740acee0 2021-06-25T04:48:14.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.659+0000 7ff0796ea700 1 -- 172.21.15.57:0/3040984084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0740b4270 con 0x7ff0740acee0 2021-06-25T04:48:14.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.663+0000 7ff0796ea700 1 -- 172.21.15.57:0/3040984084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff074057310 con 0x7ff0740acee0 2021-06-25T04:48:14.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.663+0000 7ff0717fa700 1 -- 172.21.15.57:0/3040984084 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff064019030 con 0x7ff0740acee0 2021-06-25T04:48:14.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.663+0000 7ff0717fa700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff04c055340 0x7ff04c057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.663+0000 7ff0717fa700 1 -- 172.21.15.57:0/3040984084 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ff06406cf20 con 0x7ff0740acee0 2021-06-25T04:48:14.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.663+0000 7ff0737fe700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff04c055340 0x7ff04c057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.663+0000 7ff0737fe700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff04c055340 0x7ff04c057800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff05c00d000 tx=0x7ff05c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:14.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.671+0000 7ff0717fa700 1 -- 172.21.15.57:0/3040984084 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff064043300 con 0x7ff0740acee0 2021-06-25T04:48:14.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.839+0000 7ff0796ea700 1 -- 172.21.15.57:0/3040984084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ff074065e70 con 0x7ff0740acee0 2021-06-25T04:48:14.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.851+0000 7ff0717fa700 1 -- 172.21.15.57:0/3040984084 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff064046920 con 0x7ff0740acee0 2021-06-25T04:48:14.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 -- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff04c055340 msgr2=0x7ff04c057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff04c055340 0x7ff04c057800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff05c00d000 tx=0x7ff05c009040).stop 2021-06-25T04:48:14.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 -- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0740acee0 msgr2=0x7ff074139870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0740acee0 0x7ff074139870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff074065a00 tx=0x7ff064007b90).stop 2021-06-25T04:48:14.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 -- 172.21.15.57:0/3040984084 shutdown_connections 2021-06-25T04:48:14.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff04c055340 0x7ff04c057800 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff07413c6a0 0x7ff07413b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0740b2810 0x7ff074066180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 --2- 172.21.15.57:0/3040984084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0740acee0 0x7ff074139870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 -- 172.21.15.57:0/3040984084 >> 172.21.15.57:0/3040984084 conn(0x7ff0740611f0 msgr2=0x7ff07413eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:14.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 -- 172.21.15.57:0/3040984084 shutdown_connections 2021-06-25T04:48:14.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.855+0000 7ff0796ea700 1 -- 172.21.15.57:0/3040984084 wait complete. 2021-06-25T04:48:14.864 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2021-06-25T04:48:14.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2021-06-25T04:48:14.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.975+0000 7fd78a3e2700 1 Processor -- start 2021-06-25T04:48:14.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.975+0000 7fd78a3e2700 1 -- start start 2021-06-25T04:48:14.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.975+0000 7fd78a3e2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd784143960 0x7fd784140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.975+0000 7fd78a3e2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7840b68d0 con 0x7fd7840b46d0 2021-06-25T04:48:14.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.975+0000 7fd78a3e2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7840b6b70 con 0x7fd784061640 2021-06-25T04:48:14.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.975+0000 7fd78a3e2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7840b9640 con 0x7fd784143960 2021-06-25T04:48:14.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.975+0000 7fd788bdf700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd7840b46d0 0x7fd78413fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53570/0 (socket says 172.21.15.57:53570) 2021-06-25T04:48:14.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.975+0000 7fd788bdf700 1 -- 172.21.15.57:0/1157014694 learned_addr learned my addr 172.21.15.57:0/1157014694 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:14.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.975+0000 7fd789be1700 1 --2- 172.21.15.57:0/1157014694 >> v2:172.21.15.87:3300/0 conn(0x7fd784143960 0x7fd784140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.975+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360059211 0 0) 0x7fd7840b68d0 con 0x7fd7840b46d0 2021-06-25T04:48:14.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.975+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd76c003260 con 0x7fd7840b46d0 2021-06-25T04:48:14.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4067046491 0 0) 0x7fd76c003260 con 0x7fd7840b46d0 2021-06-25T04:48:14.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 >> v2:172.21.15.87:3300/0 conn(0x7fd784143960 msgr2=0x7fd784140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:14.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 --2- 172.21.15.57:0/1157014694 >> v2:172.21.15.87:3300/0 conn(0x7fd784143960 0x7fd784140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 >> v1:172.21.15.87:6789/0 conn(0x7fd784061640 legacy=0x7fd7840b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7840b6e10 con 0x7fd7840b46d0 2021-06-25T04:48:14.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fd774001660 con 0x7fd7840b46d0 2021-06-25T04:48:14.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 >> v1:172.21.15.57:6789/0 conn(0x7fd7840b46d0 legacy=0x7fd78413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 --2- 172.21.15.57:0/1157014694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd76c003750 0x7fd76c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 --2- 172.21.15.57:0/1157014694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd76c004500 0x7fd76c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 --2- 172.21.15.57:0/1157014694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd76c004e70 0x7fd76c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:14.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c00bcf0 con 0x7fd76c004e70 2021-06-25T04:48:14.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c00be60 con 0x7fd76c004500 2021-06-25T04:48:14.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c00c020 con 0x7fd76c003750 2021-06-25T04:48:14.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd789be1700 1 --2- 172.21.15.57:0/1157014694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd76c004e70 0x7fd76c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd788bdf700 1 --2- 172.21.15.57:0/1157014694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd76c004500 0x7fd76c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd7893e0700 1 --2- 172.21.15.57:0/1157014694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd76c003750 0x7fd76c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:14.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd789be1700 1 -- 172.21.15.57:0/1157014694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd76c003750 msgr2=0x7fd76c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:14.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd789be1700 1 --2- 172.21.15.57:0/1157014694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd76c003750 0x7fd76c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd789be1700 1 -- 172.21.15.57:0/1157014694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd76c004500 msgr2=0x7fd76c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:14.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd789be1700 1 --2- 172.21.15.57:0/1157014694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd76c004500 0x7fd76c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:14.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd789be1700 1 -- 172.21.15.57:0/1157014694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c003260 con 0x7fd76c004e70 2021-06-25T04:48:14.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd789be1700 1 -- 172.21.15.57:0/1157014694 reap_dead start 2021-06-25T04:48:14.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd789be1700 1 --2- 172.21.15.57:0/1157014694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd76c004e70 0x7fd76c00b750 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd77c00c000 tx=0x7fd77c0091d0).ready entity=mon.0 client_cookie=77c85fa4a8ded7cf server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:14.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77c00e7e0 con 0x7fd76c004e70 2021-06-25T04:48:14.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c00e940 con 0x7fd76c004e70 2021-06-25T04:48:14.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd773fff700 1 -- 172.21.15.57:0/1157014694 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77c00eca0 con 0x7fd76c004e70 2021-06-25T04:48:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd78a3e2700 1 -- 172.21.15.57:0/1157014694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd76c004e70 msgr2=0x7fd76c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd78a3e2700 1 --2- 172.21.15.57:0/1157014694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd76c004e70 0x7fd76c00b750 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd77c00c000 tx=0x7fd77c0091d0).stop 2021-06-25T04:48:15.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd78a3e2700 1 -- 172.21.15.57:0/1157014694 shutdown_connections 2021-06-25T04:48:15.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd78a3e2700 1 --2- 172.21.15.57:0/1157014694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd76c004e70 0x7fd76c00b750 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd78a3e2700 1 -- 172.21.15.57:0/1157014694 >> 172.21.15.57:0/1157014694 conn(0x7fd78406adb0 msgr2=0x7fd78405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:15.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd78a3e2700 1 -- 172.21.15.57:0/1157014694 shutdown_connections 2021-06-25T04:48:15.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.979+0000 7fd78a3e2700 1 -- 172.21.15.57:0/1157014694 wait complete. 2021-06-25T04:48:15.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd78a3e2700 1 Processor -- start 2021-06-25T04:48:15.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd78a3e2700 1 -- start start 2021-06-25T04:48:15.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd78a3e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd76c004e70 0x7fd7841425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd78a3e2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7840b0490 0x7fd7840ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd78a3e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7840b8fd0 0x7fd7840adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd78a3e2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840b8060 con 0x7fd7840b8fd0 2021-06-25T04:48:15.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd78a3e2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840b7520 con 0x7fd76c004e70 2021-06-25T04:48:15.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd78a3e2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840b7dc0 con 0x7fd7840b0490 2021-06-25T04:48:15.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd789be1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7840b8fd0 0x7fd7840adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd789be1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7840b8fd0 0x7fd7840adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36364/0 (socket says 172.21.15.57:36364) 2021-06-25T04:48:15.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd789be1700 1 -- 172.21.15.57:0/285716553 learned_addr learned my addr 172.21.15.57:0/285716553 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:15.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd788bdf700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7840b0490 0x7fd7840ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd7893e0700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd76c004e70 0x7fd7841425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd789be1700 1 -- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7840b0490 msgr2=0x7fd7840ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd789be1700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7840b0490 0x7fd7840ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd789be1700 1 -- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd76c004e70 msgr2=0x7fd7841425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd789be1700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd76c004e70 0x7fd7841425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd789be1700 1 -- 172.21.15.57:0/285716553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7840ae040 con 0x7fd7840b8fd0 2021-06-25T04:48:15.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd789be1700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7840b8fd0 0x7fd7840adb50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fd77c00c000 tx=0x7fd77c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:15.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd7727fc700 1 -- 172.21.15.57:0/285716553 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77c009600 con 0x7fd7840b8fd0 2021-06-25T04:48:15.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd7727fc700 1 -- 172.21.15.57:0/285716553 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c01de10 con 0x7fd7840b8fd0 2021-06-25T04:48:15.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd78a3e2700 1 -- 172.21.15.57:0/285716553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7840aff30 con 0x7fd7840b8fd0 2021-06-25T04:48:15.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd7727fc700 1 -- 172.21.15.57:0/285716553 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77c01b640 con 0x7fd7840b8fd0 2021-06-25T04:48:15.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.983+0000 7fd78a3e2700 1 -- 172.21.15.57:0/285716553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7840b1ea0 con 0x7fd7840b8fd0 2021-06-25T04:48:15.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.987+0000 7fd78a3e2700 1 -- 172.21.15.57:0/285716553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd784057310 con 0x7fd7840b8fd0 2021-06-25T04:48:15.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.987+0000 7fd7727fc700 1 -- 172.21.15.57:0/285716553 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd77c02e070 con 0x7fd7840b8fd0 2021-06-25T04:48:15.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.987+0000 7fd7727fc700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640554e0 0x7fd7640579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.987+0000 7fd7727fc700 1 -- 172.21.15.57:0/285716553 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fd77c06f8b0 con 0x7fd7840b8fd0 2021-06-25T04:48:15.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.987+0000 7fd7893e0700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640554e0 0x7fd7640579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.987+0000 7fd7893e0700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640554e0 0x7fd7640579a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fd780003000 tx=0x7fd780007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:15.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:14.995+0000 7fd7727fc700 1 -- 172.21.15.57:0/285716553 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd77c045da0 con 0x7fd7840b8fd0 2021-06-25T04:48:15.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.163+0000 7fd78a3e2700 1 -- 172.21.15.57:0/285716553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd7840b7f80 con 0x7fd7840b8fd0 2021-06-25T04:48:15.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.167+0000 7fd7727fc700 1 -- 172.21.15.57:0/285716553 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd77c0493c0 con 0x7fd7840b8fd0 2021-06-25T04:48:15.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 -- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640554e0 msgr2=0x7fd7640579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640554e0 0x7fd7640579a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fd780003000 tx=0x7fd780007a00).stop 2021-06-25T04:48:15.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 -- 172.21.15.57:0/285716553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7840b8fd0 msgr2=0x7fd7840adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7840b8fd0 0x7fd7840adb50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fd77c00c000 tx=0x7fd77c019000).stop 2021-06-25T04:48:15.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 -- 172.21.15.57:0/285716553 shutdown_connections 2021-06-25T04:48:15.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd7640554e0 0x7fd7640579a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7840b8fd0 0x7fd7840adb50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7840b0490 0x7fd7840ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 --2- 172.21.15.57:0/285716553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd76c004e70 0x7fd7841425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 -- 172.21.15.57:0/285716553 >> 172.21.15.57:0/285716553 conn(0x7fd78406adb0 msgr2=0x7fd78405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:15.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 -- 172.21.15.57:0/285716553 shutdown_connections 2021-06-25T04:48:15.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.171+0000 7fd78a3e2700 1 -- 172.21.15.57:0/285716553 wait complete. 2021-06-25T04:48:15.182 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2021-06-25T04:48:15.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2021-06-25T04:48:15.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 Processor -- start 2021-06-25T04:48:15.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 -- start start 2021-06-25T04:48:15.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa63c0b5460 0x7fa63c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa63c0b05d0 0x7fa63c147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa63c067560 0x7fa63c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63c1452a0 con 0x7fa63c0b05d0 2021-06-25T04:48:15.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63c0adfb0 con 0x7fa63c067560 2021-06-25T04:48:15.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0b5840 con 0x7fa63c0b5460 2021-06-25T04:48:15.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6411a7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa63c0b05d0 0x7fa63c147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6411a7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa63c0b05d0 0x7fa63c147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36368/0 (socket says 172.21.15.57:36368) 2021-06-25T04:48:15.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6411a7700 1 -- 172.21.15.57:0/3498042466 learned_addr learned my addr 172.21.15.57:0/3498042466 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:15.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6419a8700 1 --2- 172.21.15.57:0/3498042466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa63c0b5460 0x7fa63c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6421a9700 1 --2- 172.21.15.57:0/3498042466 >> v2:172.21.15.87:3300/0 conn(0x7fa63c067560 0x7fa63c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6411a7700 1 -- 172.21.15.57:0/3498042466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa63c0b5460 msgr2=0x7fa63c0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:15.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6411a7700 1 --2- 172.21.15.57:0/3498042466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa63c0b5460 0x7fa63c0af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6411a7700 1 -- 172.21.15.57:0/3498042466 >> v2:172.21.15.87:3300/0 conn(0x7fa63c067560 msgr2=0x7fa63c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:15.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6411a7700 1 --2- 172.21.15.57:0/3498042466 >> v2:172.21.15.87:3300/0 conn(0x7fa63c067560 0x7fa63c0acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6411a7700 1 -- 172.21.15.57:0/3498042466 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0ac7c0 con 0x7fa63c0b05d0 2021-06-25T04:48:15.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6421a9700 1 --2- 172.21.15.57:0/3498042466 >> v2:172.21.15.87:3300/0 conn(0x7fa63c067560 0x7fa63c0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:48:15.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6411a7700 1 --2- 172.21.15.57:0/3498042466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa63c0b05d0 0x7fa63c147560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fa62c002f70 tx=0x7fa62c006eb0).ready entity=mon.0 client_cookie=3e028265b574a664 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:15.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6409a6700 1 -- 172.21.15.57:0/3498042466 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62c00d570 con 0x7fa63c0b05d0 2021-06-25T04:48:15.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6409a6700 1 -- 172.21.15.57:0/3498042466 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c000e90 con 0x7fa63c0b05d0 2021-06-25T04:48:15.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 -- 172.21.15.57:0/3498042466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa63c0b05d0 msgr2=0x7fa63c147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6409a6700 1 -- 172.21.15.57:0/3498042466 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62c00d900 con 0x7fa63c0b05d0 2021-06-25T04:48:15.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 --2- 172.21.15.57:0/3498042466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa63c0b05d0 0x7fa63c147560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fa62c002f70 tx=0x7fa62c006eb0).stop 2021-06-25T04:48:15.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 -- 172.21.15.57:0/3498042466 shutdown_connections 2021-06-25T04:48:15.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 --2- 172.21.15.57:0/3498042466 >> v2:172.21.15.87:3300/0 conn(0x7fa63c067560 0x7fa63c0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 --2- 172.21.15.57:0/3498042466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa63c0b05d0 0x7fa63c147560 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 --2- 172.21.15.57:0/3498042466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa63c0b5460 0x7fa63c0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 -- 172.21.15.57:0/3498042466 >> 172.21.15.57:0/3498042466 conn(0x7fa63c062520 msgr2=0x7fa63c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:15.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 -- 172.21.15.57:0/3498042466 shutdown_connections 2021-06-25T04:48:15.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.291+0000 7fa6429aa700 1 -- 172.21.15.57:0/3498042466 wait complete. 2021-06-25T04:48:15.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6429aa700 1 Processor -- start 2021-06-25T04:48:15.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6429aa700 1 -- start start 2021-06-25T04:48:15.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6429aa700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa63c067560 0x7fa63c1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6429aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa63c0b05d0 0x7fa63c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6429aa700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa63c0b5460 0x7fa63c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6429aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c14b550 con 0x7fa63c0b05d0 2021-06-25T04:48:15.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6429aa700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c14b7f0 con 0x7fa63c067560 2021-06-25T04:48:15.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6429aa700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c145480 con 0x7fa63c0b5460 2021-06-25T04:48:15.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6411a7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa63c0b05d0 0x7fa63c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6411a7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa63c0b05d0 0x7fa63c15a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36376/0 (socket says 172.21.15.57:36376) 2021-06-25T04:48:15.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6411a7700 1 -- 172.21.15.57:0/1039711531 learned_addr learned my addr 172.21.15.57:0/1039711531 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:15.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6419a8700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa63c067560 0x7fa63c1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6421a9700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa63c0b5460 0x7fa63c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6411a7700 1 -- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa63c0b5460 msgr2=0x7fa63c15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6411a7700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa63c0b5460 0x7fa63c15a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6411a7700 1 -- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa63c067560 msgr2=0x7fa63c1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6411a7700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa63c067560 0x7fa63c1408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6411a7700 1 -- 172.21.15.57:0/1039711531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c00b1e0 con 0x7fa63c0b05d0 2021-06-25T04:48:15.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6419a8700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa63c067560 0x7fa63c1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:15.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6411a7700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa63c0b05d0 0x7fa63c15a120 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fa62c002f70 tx=0x7fa62c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:15.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa62affd700 1 -- 172.21.15.57:0/1039711531 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62c021070 con 0x7fa63c0b05d0 2021-06-25T04:48:15.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa62affd700 1 -- 172.21.15.57:0/1039711531 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c000e90 con 0x7fa63c0b05d0 2021-06-25T04:48:15.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6429aa700 1 -- 172.21.15.57:0/1039711531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c145720 con 0x7fa63c0b05d0 2021-06-25T04:48:15.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa62affd700 1 -- 172.21.15.57:0/1039711531 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62c0119d0 con 0x7fa63c0b05d0 2021-06-25T04:48:15.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa6429aa700 1 -- 172.21.15.57:0/1039711531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c15ab00 con 0x7fa63c0b05d0 2021-06-25T04:48:15.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.295+0000 7fa62affd700 1 -- 172.21.15.57:0/1039711531 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa62c00f070 con 0x7fa63c0b05d0 2021-06-25T04:48:15.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.299+0000 7fa6429aa700 1 -- 172.21.15.57:0/1039711531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c1458e0 con 0x7fa63c0b05d0 2021-06-25T04:48:15.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.299+0000 7fa62affd700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa61c0553f0 0x7fa61c0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.299+0000 7fa62affd700 1 -- 172.21.15.57:0/1039711531 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa62c06ef30 con 0x7fa63c0b05d0 2021-06-25T04:48:15.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.299+0000 7fa6419a8700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa61c0553f0 0x7fa61c0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.299+0000 7fa6419a8700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa61c0553f0 0x7fa61c0578b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa63800c000 tx=0x7fa638008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:15.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.303+0000 7fa62affd700 1 -- 172.21.15.57:0/1039711531 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa62c045420 con 0x7fa63c0b05d0 2021-06-25T04:48:15.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.475+0000 7fa6429aa700 1 -- 172.21.15.57:0/1039711531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa63c060e50 con 0x7fa63c0b05d0 2021-06-25T04:48:15.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.483+0000 7fa62affd700 1 -- 172.21.15.57:0/1039711531 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa62c048a40 con 0x7fa63c0b05d0 2021-06-25T04:48:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 -- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa61c0553f0 msgr2=0x7fa61c0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa61c0553f0 0x7fa61c0578b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa63800c000 tx=0x7fa638008040).stop 2021-06-25T04:48:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 -- 172.21.15.57:0/1039711531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa63c0b05d0 msgr2=0x7fa63c15a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa63c0b05d0 0x7fa63c15a120 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fa62c002f70 tx=0x7fa62c015000).stop 2021-06-25T04:48:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 -- 172.21.15.57:0/1039711531 shutdown_connections 2021-06-25T04:48:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa61c0553f0 0x7fa61c0578b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa63c0b5460 0x7fa63c15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa63c0b05d0 0x7fa63c15a120 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 --2- 172.21.15.57:0/1039711531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa63c067560 0x7fa63c1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 -- 172.21.15.57:0/1039711531 >> 172.21.15.57:0/1039711531 conn(0x7fa63c062520 msgr2=0x7fa63c1489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 -- 172.21.15.57:0/1039711531 shutdown_connections 2021-06-25T04:48:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.487+0000 7fa6429aa700 1 -- 172.21.15.57:0/1039711531 wait complete. 2021-06-25T04:48:15.499 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2021-06-25T04:48:15.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2021-06-25T04:48:15.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.603+0000 7ffaf1532700 1 Processor -- start 2021-06-25T04:48:15.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.603+0000 7ffaf1532700 1 -- start start 2021-06-25T04:48:15.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.603+0000 7ffaf1532700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffaec067140 0x7ffaec05f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.603+0000 7ffaf1532700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffaec0b1930 0x7ffaec05fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.603+0000 7ffaf1532700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaec0a7a50 con 0x7ffaec0a7670 2021-06-25T04:48:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.603+0000 7ffaf1532700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec1475e0 con 0x7ffaec0b1930 2021-06-25T04:48:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.603+0000 7ffaf1532700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec147880 con 0x7ffaec067140 2021-06-25T04:48:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaeb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffaec0b1930 0x7ffaec05fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaeaffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffaec0a7670 0x7ffaec066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53600/0 (socket says 172.21.15.57:53600) 2021-06-25T04:48:15.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaeaffd700 1 -- 172.21.15.57:0/1509484465 learned_addr learned my addr 172.21.15.57:0/1509484465 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:15.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaea7fc700 1 --2- 172.21.15.57:0/1509484465 >> v2:172.21.15.87:3300/0 conn(0x7ffaec067140 0x7ffaec05f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaeb7fe700 1 -- 172.21.15.57:0/1509484465 >> v2:172.21.15.87:3300/0 conn(0x7ffaec067140 msgr2=0x7ffaec05f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:15.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaeb7fe700 1 --2- 172.21.15.57:0/1509484465 >> v2:172.21.15.87:3300/0 conn(0x7ffaec067140 0x7ffaec05f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaeb7fe700 1 -- 172.21.15.57:0/1509484465 >> v1:172.21.15.57:6789/0 conn(0x7ffaec0a7670 legacy=0x7ffaec066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffae9ffb700 1 -- 172.21.15.57:0/1509484465 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200071785 0 0) 0x7ffaec0a7a50 con 0x7ffaec0a7670 2021-06-25T04:48:15.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaeb7fe700 1 -- 172.21.15.57:0/1509484465 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec147b20 con 0x7ffaec0b1930 2021-06-25T04:48:15.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaeb7fe700 1 --2- 172.21.15.57:0/1509484465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffaec0b1930 0x7ffaec05fb60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ffae4002f70 tx=0x7ffae4006df0).ready entity=mon.0 client_cookie=ab6a90d814ef2375 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffae9ffb700 1 -- 172.21.15.57:0/1509484465 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae400d570 con 0x7ffaec0b1930 2021-06-25T04:48:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffae9ffb700 1 -- 172.21.15.57:0/1509484465 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4000e90 con 0x7ffaec0b1930 2021-06-25T04:48:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffae9ffb700 1 -- 172.21.15.57:0/1509484465 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae400d8c0 con 0x7ffaec0b1930 2021-06-25T04:48:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaf1532700 1 -- 172.21.15.57:0/1509484465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffaec0b1930 msgr2=0x7ffaec05fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaf1532700 1 --2- 172.21.15.57:0/1509484465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffaec0b1930 0x7ffaec05fb60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ffae4002f70 tx=0x7ffae4006df0).stop 2021-06-25T04:48:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaf1532700 1 -- 172.21.15.57:0/1509484465 shutdown_connections 2021-06-25T04:48:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaf1532700 1 --2- 172.21.15.57:0/1509484465 >> v2:172.21.15.87:3300/0 conn(0x7ffaec067140 0x7ffaec05f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaf1532700 1 --2- 172.21.15.57:0/1509484465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffaec0b1930 0x7ffaec05fb60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaf1532700 1 -- 172.21.15.57:0/1509484465 >> 172.21.15.57:0/1509484465 conn(0x7ffaec0b53a0 msgr2=0x7ffaec0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:15.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaf1532700 1 -- 172.21.15.57:0/1509484465 shutdown_connections 2021-06-25T04:48:15.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.607+0000 7ffaf1532700 1 -- 172.21.15.57:0/1509484465 wait complete. 2021-06-25T04:48:15.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaf1532700 1 Processor -- start 2021-06-25T04:48:15.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaf1532700 1 -- start start 2021-06-25T04:48:15.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaf1532700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffaec067140 0x7ffaec0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaf1532700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaec0a7670 0x7ffaec159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaf1532700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaec0b1930 0x7ffaec15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaf1532700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec1573f0 con 0x7ffaec067140 2021-06-25T04:48:15.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaf1532700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0ab7c0 con 0x7ffaec0a7670 2021-06-25T04:48:15.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaf1532700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0ad6b0 con 0x7ffaec0b1930 2021-06-25T04:48:15.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaeaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffaec067140 0x7ffaec0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaeaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffaec067140 0x7ffaec0b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36388/0 (socket says 172.21.15.57:36388) 2021-06-25T04:48:15.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaeaffd700 1 -- 172.21.15.57:0/2128350483 learned_addr learned my addr 172.21.15.57:0/2128350483 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:15.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaea7fc700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaec0a7670 0x7ffaec159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaeb7fe700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaec0b1930 0x7ffaec15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaea7fc700 1 -- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaec0b1930 msgr2=0x7ffaec15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaea7fc700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaec0b1930 0x7ffaec15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaea7fc700 1 -- 172.21.15.57:0/2128350483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffaec067140 msgr2=0x7ffaec0b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaea7fc700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffaec067140 0x7ffaec0b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaea7fc700 1 -- 172.21.15.57:0/2128350483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae400b180 con 0x7ffaec0a7670 2021-06-25T04:48:15.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaeaffd700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffaec067140 0x7ffaec0b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:15.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaea7fc700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaec0a7670 0x7ffaec159f00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ffadc00c000 tx=0x7ffadc0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:15.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffadbfff700 1 -- 172.21.15.57:0/2128350483 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffadc0126d0 con 0x7ffaec0a7670 2021-06-25T04:48:15.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffadbfff700 1 -- 172.21.15.57:0/2128350483 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc012830 con 0x7ffaec0a7670 2021-06-25T04:48:15.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaf1532700 1 -- 172.21.15.57:0/2128350483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec0ad950 con 0x7ffaec0a7670 2021-06-25T04:48:15.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffadbfff700 1 -- 172.21.15.57:0/2128350483 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffadc012b90 con 0x7ffaec0a7670 2021-06-25T04:48:15.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.611+0000 7ffaf1532700 1 -- 172.21.15.57:0/2128350483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec0af870 con 0x7ffaec0a7670 2021-06-25T04:48:15.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.615+0000 7ffaf1532700 1 -- 172.21.15.57:0/2128350483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec0ac2f0 con 0x7ffaec0a7670 2021-06-25T04:48:15.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.615+0000 7ffadbfff700 1 -- 172.21.15.57:0/2128350483 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ffadc022070 con 0x7ffaec0a7670 2021-06-25T04:48:15.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.615+0000 7ffadbfff700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffac8055450 0x7ffac8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.615+0000 7ffadbfff700 1 -- 172.21.15.57:0/2128350483 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ffadc06e160 con 0x7ffaec0a7670 2021-06-25T04:48:15.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.615+0000 7ffaeaffd700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffac8055450 0x7ffac8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.615+0000 7ffaeaffd700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffac8055450 0x7ffac8057910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7ffae000d000 tx=0x7ffae0007ac0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:15.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.623+0000 7ffadbfff700 1 -- 172.21.15.57:0/2128350483 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ffadc044580 con 0x7ffaec0a7670 2021-06-25T04:48:15.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.795+0000 7ffaf1532700 1 -- 172.21.15.57:0/2128350483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7ffaec057310 con 0x7ffaec0a7670 2021-06-25T04:48:15.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffadbfff700 1 -- 172.21.15.57:0/2128350483 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffadc047ba0 con 0x7ffaec0a7670 2021-06-25T04:48:15.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 -- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffac8055450 msgr2=0x7ffac8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffac8055450 0x7ffac8057910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7ffae000d000 tx=0x7ffae0007ac0).stop 2021-06-25T04:48:15.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 -- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaec0a7670 msgr2=0x7ffaec159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaec0a7670 0x7ffaec159f00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ffadc00c000 tx=0x7ffadc0091d0).stop 2021-06-25T04:48:15.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 -- 172.21.15.57:0/2128350483 shutdown_connections 2021-06-25T04:48:15.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffac8055450 0x7ffac8057910 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaec0b1930 0x7ffaec15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaec0a7670 0x7ffaec159f00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 --2- 172.21.15.57:0/2128350483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffaec067140 0x7ffaec0b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 -- 172.21.15.57:0/2128350483 >> 172.21.15.57:0/2128350483 conn(0x7ffaec0b53a0 msgr2=0x7ffaec05fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:15.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 -- 172.21.15.57:0/2128350483 shutdown_connections 2021-06-25T04:48:15.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.807+0000 7ffaf1532700 1 -- 172.21.15.57:0/2128350483 wait complete. 2021-06-25T04:48:15.818 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2021-06-25T04:48:15.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:48:15.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.923+0000 7fcac5b28700 1 Processor -- start 2021-06-25T04:48:15.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.923+0000 7fcac5b28700 1 -- start start 2021-06-25T04:48:15.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcac0061640 0x7fcac00b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcac00b46d0 0x7fcac00ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac0143960 0x7fcac013fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac00b9640 con 0x7fcac00b46d0 2021-06-25T04:48:15.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac00b68d0 con 0x7fcac0061640 2021-06-25T04:48:15.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00b6b70 con 0x7fcac0143960 2021-06-25T04:48:15.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcac00b46d0 0x7fcac00ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcac00b46d0 0x7fcac00ba1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36396/0 (socket says 172.21.15.57:36396) 2021-06-25T04:48:15.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabffff700 1 -- 172.21.15.57:0/1956125681 learned_addr learned my addr 172.21.15.57:0/1956125681 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:15.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5327700 1 --2- 172.21.15.57:0/1956125681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac0143960 0x7fcac013fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac4b26700 1 --2- 172.21.15.57:0/1956125681 >> v2:172.21.15.87:3300/0 conn(0x7fcac0061640 0x7fcac00b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabffff700 1 -- 172.21.15.57:0/1956125681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac0143960 msgr2=0x7fcac013fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:15.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabffff700 1 --2- 172.21.15.57:0/1956125681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac0143960 0x7fcac013fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabffff700 1 -- 172.21.15.57:0/1956125681 >> v2:172.21.15.87:3300/0 conn(0x7fcac0061640 msgr2=0x7fcac00b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:15.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabffff700 1 --2- 172.21.15.57:0/1956125681 >> v2:172.21.15.87:3300/0 conn(0x7fcac0061640 0x7fcac00b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabffff700 1 -- 172.21.15.57:0/1956125681 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00b6e10 con 0x7fcac00b46d0 2021-06-25T04:48:15.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabffff700 1 --2- 172.21.15.57:0/1956125681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac00b46d0 0x7fcac00ba1c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fcab4002f70 tx=0x7fcab4006eb0).ready entity=mon.0 client_cookie=e1e59dc24c1d99ed server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:15.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabf7fe700 1 -- 172.21.15.57:0/1956125681 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab400d570 con 0x7fcac00b46d0 2021-06-25T04:48:15.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabf7fe700 1 -- 172.21.15.57:0/1956125681 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab4000e90 con 0x7fcac00b46d0 2021-06-25T04:48:15.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcabf7fe700 1 -- 172.21.15.57:0/1956125681 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab400d900 con 0x7fcac00b46d0 2021-06-25T04:48:15.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 -- 172.21.15.57:0/1956125681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac00b46d0 msgr2=0x7fcac00ba1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 --2- 172.21.15.57:0/1956125681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac00b46d0 0x7fcac00ba1c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fcab4002f70 tx=0x7fcab4006eb0).stop 2021-06-25T04:48:15.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 -- 172.21.15.57:0/1956125681 shutdown_connections 2021-06-25T04:48:15.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 --2- 172.21.15.57:0/1956125681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac0143960 0x7fcac013fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 --2- 172.21.15.57:0/1956125681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac00b46d0 0x7fcac00ba1c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 --2- 172.21.15.57:0/1956125681 >> v2:172.21.15.87:3300/0 conn(0x7fcac0061640 0x7fcac00b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 -- 172.21.15.57:0/1956125681 >> 172.21.15.57:0/1956125681 conn(0x7fcac006adb0 msgr2=0x7fcac005f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:15.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 -- 172.21.15.57:0/1956125681 shutdown_connections 2021-06-25T04:48:15.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.927+0000 7fcac5b28700 1 -- 172.21.15.57:0/1956125681 wait complete. 2021-06-25T04:48:15.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac5b28700 1 Processor -- start 2021-06-25T04:48:15.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac5b28700 1 -- start start 2021-06-25T04:48:15.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac5b28700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac0061640 0x7fcac013f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac5b28700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac0143960 0x7fcac01557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac5b28700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac00adcf0 0x7fcac00b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac5b28700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac014ff00 con 0x7fcac0143960 2021-06-25T04:48:15.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac5b28700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00ad660 con 0x7fcac00adcf0 2021-06-25T04:48:15.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac5b28700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00b78f0 con 0x7fcac0061640 2021-06-25T04:48:15.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcabffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac0143960 0x7fcac01557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcabffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac0143960 0x7fcac01557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36404/0 (socket says 172.21.15.57:36404) 2021-06-25T04:48:15.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcabffff700 1 -- 172.21.15.57:0/240311917 learned_addr learned my addr 172.21.15.57:0/240311917 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:15.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac4b26700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac0061640 0x7fcac013f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac5327700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac00adcf0 0x7fcac00b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcabffff700 1 -- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac0061640 msgr2=0x7fcac013f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcabffff700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac0061640 0x7fcac013f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcabffff700 1 -- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac00adcf0 msgr2=0x7fcac00b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:15.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcabffff700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac00adcf0 0x7fcac00b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:15.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcabffff700 1 -- 172.21.15.57:0/240311917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab400b1e0 con 0x7fcac0143960 2021-06-25T04:48:15.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac4b26700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac0061640 0x7fcac013f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:15.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcabffff700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac0143960 0x7fcac01557b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fcab4002f70 tx=0x7fcab4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:15.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcabdffb700 1 -- 172.21.15.57:0/240311917 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab4021070 con 0x7fcac0143960 2021-06-25T04:48:15.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcabdffb700 1 -- 172.21.15.57:0/240311917 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab4000e90 con 0x7fcac0143960 2021-06-25T04:48:15.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.931+0000 7fcac5b28700 1 -- 172.21.15.57:0/240311917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac00b7b90 con 0x7fcac0143960 2021-06-25T04:48:15.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.935+0000 7fcabdffb700 1 -- 172.21.15.57:0/240311917 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab4011bc0 con 0x7fcac0143960 2021-06-25T04:48:15.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.935+0000 7fcac5b28700 1 -- 172.21.15.57:0/240311917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac00ad850 con 0x7fcac0143960 2021-06-25T04:48:15.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.935+0000 7fcac5b28700 1 -- 172.21.15.57:0/240311917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac0057310 con 0x7fcac0143960 2021-06-25T04:48:15.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.935+0000 7fcabdffb700 1 -- 172.21.15.57:0/240311917 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcab400f070 con 0x7fcac0143960 2021-06-25T04:48:15.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.935+0000 7fcabdffb700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 0x7fcaa0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:15.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.935+0000 7fcabdffb700 1 -- 172.21.15.57:0/240311917 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fcab406ee70 con 0x7fcac0143960 2021-06-25T04:48:15.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.935+0000 7fcac4b26700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 0x7fcaa0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:15.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.939+0000 7fcac4b26700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 0x7fcaa0057910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fcab000b000 tx=0x7fcab0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:15.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:15.943+0000 7fcabdffb700 1 -- 172.21.15.57:0/240311917 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcab4045360 con 0x7fcac0143960 2021-06-25T04:48:16.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.067+0000 7fcac5b28700 1 -- 172.21.15.57:0/240311917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcac005d990 con 0x7fcac0143960 2021-06-25T04:48:16.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcabdffb700 1 -- 172.21.15.57:0/240311917 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13414 (secure 0 0 0) 0x7fcab4048980 con 0x7fcac0143960 2021-06-25T04:48:16.077 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:16.078 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":30,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:48:13.502580+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:48:16.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 -- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 msgr2=0x7fcaa0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 0x7fcaa0057910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fcab000b000 tx=0x7fcab0008040).stop 2021-06-25T04:48:16.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 -- 172.21.15.57:0/240311917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac0143960 msgr2=0x7fcac01557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac0143960 0x7fcac01557b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fcab4002f70 tx=0x7fcab4015000).stop 2021-06-25T04:48:16.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 -- 172.21.15.57:0/240311917 shutdown_connections 2021-06-25T04:48:16.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcaa0055450 0x7fcaa0057910 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac00adcf0 0x7fcac00b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcac0143960 0x7fcac01557b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 --2- 172.21.15.57:0/240311917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcac0061640 0x7fcac013f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 -- 172.21.15.57:0/240311917 >> 172.21.15.57:0/240311917 conn(0x7fcac006adb0 msgr2=0x7fcac0142dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:16.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 -- 172.21.15.57:0/240311917 shutdown_connections 2021-06-25T04:48:16.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.071+0000 7fcac5b28700 1 -- 172.21.15.57:0/240311917 wait complete. 2021-06-25T04:48:16.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:48:16.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:48:16.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bf49b8700 1 Processor -- start 2021-06-25T04:48:16.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bf49b8700 1 -- start start 2021-06-25T04:48:16.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bf49b8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0bf00b1080 0x7f0bf00b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bf49b8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bf0140b60 0x7f0bf00b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bf49b8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf00ac780 con 0x7f0bf00acb30 2021-06-25T04:48:16.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bf49b8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf00abfe0 con 0x7f0bf00b1080 2021-06-25T04:48:16.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bf49b8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf0140fd0 con 0x7f0bf0140b60 2021-06-25T04:48:16.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bee59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0bf00b1080 0x7f0bf00b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bee59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0bf00b1080 0x7f0bf00b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36412/0 (socket says 172.21.15.57:36412) 2021-06-25T04:48:16.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bee59c700 1 -- 172.21.15.57:0/3418403115 learned_addr learned my addr 172.21.15.57:0/3418403115 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:16.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0beed9d700 1 --2- 172.21.15.57:0/3418403115 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bf0140b60 0x7f0bf00b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bee59c700 1 -- 172.21.15.57:0/3418403115 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bf0140b60 msgr2=0x7f0bf00b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:16.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.195+0000 7f0bee59c700 1 --2- 172.21.15.57:0/3418403115 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bf0140b60 0x7f0bf00b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bee59c700 1 -- 172.21.15.57:0/3418403115 >> v1:172.21.15.87:6789/0 conn(0x7f0bf00acb30 legacy=0x7f0bf013d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bee59c700 1 -- 172.21.15.57:0/3418403115 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf00ac240 con 0x7f0bf00b1080 2021-06-25T04:48:16.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bee59c700 1 --2- 172.21.15.57:0/3418403115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bf00b1080 0x7f0bf00b1460 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f0be4002f70 tx=0x7f0be4006eb0).ready entity=mon.0 client_cookie=f73c77a5e8b857b9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:16.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bed59a700 1 -- 172.21.15.57:0/3418403115 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0be400d570 con 0x7f0bf00b1080 2021-06-25T04:48:16.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bed59a700 1 -- 172.21.15.57:0/3418403115 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4000e90 con 0x7f0bf00b1080 2021-06-25T04:48:16.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bed59a700 1 -- 172.21.15.57:0/3418403115 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0be400d900 con 0x7f0bf00b1080 2021-06-25T04:48:16.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bf49b8700 1 -- 172.21.15.57:0/3418403115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bf00b1080 msgr2=0x7f0bf00b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bf49b8700 1 --2- 172.21.15.57:0/3418403115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bf00b1080 0x7f0bf00b1460 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f0be4002f70 tx=0x7f0be4006eb0).stop 2021-06-25T04:48:16.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bf49b8700 1 -- 172.21.15.57:0/3418403115 shutdown_connections 2021-06-25T04:48:16.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bf49b8700 1 --2- 172.21.15.57:0/3418403115 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bf0140b60 0x7f0bf00b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bf49b8700 1 --2- 172.21.15.57:0/3418403115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bf00b1080 0x7f0bf00b1460 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bf49b8700 1 -- 172.21.15.57:0/3418403115 >> 172.21.15.57:0/3418403115 conn(0x7f0bf005f670 msgr2=0x7f0bf005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:16.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bf49b8700 1 -- 172.21.15.57:0/3418403115 shutdown_connections 2021-06-25T04:48:16.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bf49b8700 1 -- 172.21.15.57:0/3418403115 wait complete. 2021-06-25T04:48:16.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bf49b8700 1 Processor -- start 2021-06-25T04:48:16.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.199+0000 7f0bf49b8700 1 -- start start 2021-06-25T04:48:16.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bf49b8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bf00acb30 0x7f0bf00b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bf49b8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bf00b1080 0x7f0bf0063190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bf49b8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bf0140b60 0x7f0bf013a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bf49b8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf0150160 con 0x7f0bf0140b60 2021-06-25T04:48:16.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bf49b8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf00b6430 con 0x7f0bf00b1080 2021-06-25T04:48:16.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bf49b8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf00b5ef0 con 0x7f0bf00acb30 2021-06-25T04:48:16.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0beed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bf0140b60 0x7f0bf013a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0beed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bf0140b60 0x7f0bf013a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36420/0 (socket says 172.21.15.57:36420) 2021-06-25T04:48:16.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0beed9d700 1 -- 172.21.15.57:0/2880639055 learned_addr learned my addr 172.21.15.57:0/2880639055 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:16.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bedd9b700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bf00b1080 0x7f0bf0063190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bee59c700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bf00acb30 0x7f0bf00b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0beed9d700 1 -- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bf00acb30 msgr2=0x7f0bf00b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0beed9d700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bf00acb30 0x7f0bf00b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0beed9d700 1 -- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bf00b1080 msgr2=0x7f0bf0063190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0beed9d700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bf00b1080 0x7f0bf0063190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0beed9d700 1 -- 172.21.15.57:0/2880639055 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be400b1e0 con 0x7f0bf0140b60 2021-06-25T04:48:16.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bedd9b700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bf00b1080 0x7f0bf0063190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:16.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0beed9d700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bf0140b60 0x7f0bf013a8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f0be8006e00 tx=0x7f0be80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:16.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bdf7fe700 1 -- 172.21.15.57:0/2880639055 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0be800c7f0 con 0x7f0bf0140b60 2021-06-25T04:48:16.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bdf7fe700 1 -- 172.21.15.57:0/2880639055 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be800c950 con 0x7f0bf0140b60 2021-06-25T04:48:16.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bf49b8700 1 -- 172.21.15.57:0/2880639055 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf00b6190 con 0x7f0bf0140b60 2021-06-25T04:48:16.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bdf7fe700 1 -- 172.21.15.57:0/2880639055 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0be800ccb0 con 0x7f0bf0140b60 2021-06-25T04:48:16.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bf49b8700 1 -- 172.21.15.57:0/2880639055 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf00b4db0 con 0x7f0bf0140b60 2021-06-25T04:48:16.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.203+0000 7f0bf49b8700 1 -- 172.21.15.57:0/2880639055 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf0057310 con 0x7f0bf0140b60 2021-06-25T04:48:16.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.207+0000 7f0bdf7fe700 1 -- 172.21.15.57:0/2880639055 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0be8022070 con 0x7f0bf0140b60 2021-06-25T04:48:16.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.207+0000 7f0bdf7fe700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0bcc0553d0 0x7f0bcc057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.207+0000 7f0bdf7fe700 1 -- 172.21.15.57:0/2880639055 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f0be806e2f0 con 0x7f0bf0140b60 2021-06-25T04:48:16.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.207+0000 7f0bee59c700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0bcc0553d0 0x7f0bcc057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.207+0000 7f0bee59c700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0bcc0553d0 0x7f0bcc057890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0be4019000 tx=0x7f0be4015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:16.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.211+0000 7f0bdf7fe700 1 -- 172.21.15.57:0/2880639055 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0be80446d0 con 0x7f0bf0140b60 2021-06-25T04:48:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.339+0000 7f0bf49b8700 1 -- 172.21.15.57:0/2880639055 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0bf0044610 con 0x7f0bf0140b60 2021-06-25T04:48:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.339+0000 7f0bdf7fe700 1 -- 172.21.15.57:0/2880639055 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0be80160b0 con 0x7f0bf0140b60 2021-06-25T04:48:16.348 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:48:16.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 -- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0bcc0553d0 msgr2=0x7f0bcc057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0bcc0553d0 0x7f0bcc057890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0be4019000 tx=0x7f0be4015000).stop 2021-06-25T04:48:16.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 -- 172.21.15.57:0/2880639055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bf0140b60 msgr2=0x7f0bf013a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bf0140b60 0x7f0bf013a8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f0be8006e00 tx=0x7f0be80091d0).stop 2021-06-25T04:48:16.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 -- 172.21.15.57:0/2880639055 shutdown_connections 2021-06-25T04:48:16.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0bcc0553d0 0x7f0bcc057890 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bf0140b60 0x7f0bf013a8b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bf00b1080 0x7f0bf0063190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 --2- 172.21.15.57:0/2880639055 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bf00acb30 0x7f0bf00b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 -- 172.21.15.57:0/2880639055 >> 172.21.15.57:0/2880639055 conn(0x7f0bf005f670 msgr2=0x7f0bf013d380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:16.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 -- 172.21.15.57:0/2880639055 shutdown_connections 2021-06-25T04:48:16.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.343+0000 7f0bf49b8700 1 -- 172.21.15.57:0/2880639055 wait complete. 2021-06-25T04:48:16.361 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:48:16.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f9163fff700 1 Processor -- start 2021-06-25T04:48:16.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f9163fff700 1 -- start start 2021-06-25T04:48:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f9163fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f916405d070 0x7f91640b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f9163fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916413f350 0x7f91640aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f9163fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916405cb70 con 0x7f916405c790 2021-06-25T04:48:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f9163fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91640ad500 con 0x7f916405d070 2021-06-25T04:48:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f9163fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9164067d30 con 0x7f916413f350 2021-06-25T04:48:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f91627fc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f916405d070 0x7f91640b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f91627fc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f916405d070 0x7f91640b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:44920/0 (socket says 172.21.15.57:44920) 2021-06-25T04:48:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f91637fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916413f350 0x7f91640aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f91627fc700 1 -- 172.21.15.57:0/4102242280 learned_addr learned my addr 172.21.15.57:0/4102242280 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:16.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f91627fc700 1 -- 172.21.15.57:0/4102242280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916413f350 msgr2=0x7f91640aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:16.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f91627fc700 1 --2- 172.21.15.57:0/4102242280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916413f350 0x7f91640aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f91627fc700 1 -- 172.21.15.57:0/4102242280 >> v1:172.21.15.87:6789/0 conn(0x7f916405c790 legacy=0x7f91640acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f91627fc700 1 -- 172.21.15.57:0/4102242280 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640b1750 con 0x7f916405d070 2021-06-25T04:48:16.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f91637fe700 1 --2- 172.21.15.57:0/4102242280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916413f350 0x7f91640aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:16.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f9161ffb700 1 -- 172.21.15.57:0/4102242280 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121604075 0 0) 0x7f916405cb70 con 0x7f916405c790 2021-06-25T04:48:16.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.459+0000 7f91627fc700 1 --2- 172.21.15.57:0/4102242280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916405d070 0x7f91640b10b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f914c0032f0 tx=0x7f914c009290).ready entity=mon.1 client_cookie=f684ceffb854a501 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:16.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9161ffb700 1 -- 172.21.15.57:0/4102242280 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f914c00b8a0 con 0x7f916405d070 2021-06-25T04:48:16.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9161ffb700 1 -- 172.21.15.57:0/4102242280 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c00ba00 con 0x7f916405d070 2021-06-25T04:48:16.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9161ffb700 1 -- 172.21.15.57:0/4102242280 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f914c00bb70 con 0x7f916405d070 2021-06-25T04:48:16.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 -- 172.21.15.57:0/4102242280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916405d070 msgr2=0x7f91640b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 --2- 172.21.15.57:0/4102242280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916405d070 0x7f91640b10b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f914c0032f0 tx=0x7f914c009290).stop 2021-06-25T04:48:16.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 -- 172.21.15.57:0/4102242280 shutdown_connections 2021-06-25T04:48:16.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 --2- 172.21.15.57:0/4102242280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916413f350 0x7f91640aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 --2- 172.21.15.57:0/4102242280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916405d070 0x7f91640b10b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 -- 172.21.15.57:0/4102242280 >> 172.21.15.57:0/4102242280 conn(0x7f9164060140 msgr2=0x7f91640b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:16.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 -- 172.21.15.57:0/4102242280 shutdown_connections 2021-06-25T04:48:16.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 -- 172.21.15.57:0/4102242280 wait complete. 2021-06-25T04:48:16.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 Processor -- start 2021-06-25T04:48:16.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 -- start start 2021-06-25T04:48:16.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f916405c790 0x7f9164066e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916405d070 0x7f91640a81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916413f350 0x7f91640a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640639c0 con 0x7f916405c790 2021-06-25T04:48:16.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9164153ce0 con 0x7f916413f350 2021-06-25T04:48:16.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9163fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9164063bf0 con 0x7f916405d070 2021-06-25T04:48:16.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.463+0000 7f9162ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f916405c790 0x7f9164066e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f9162ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f916405c790 0x7f9164066e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36430/0 (socket says 172.21.15.57:36430) 2021-06-25T04:48:16.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f9162ffd700 1 -- 172.21.15.57:0/3509468992 learned_addr learned my addr 172.21.15.57:0/3509468992 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:16.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f91637fe700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916413f350 0x7f91640a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f91627fc700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916405d070 0x7f91640a81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f9162ffd700 1 -- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916405d070 msgr2=0x7f91640a81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f9162ffd700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916405d070 0x7f91640a81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f9162ffd700 1 -- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916413f350 msgr2=0x7f91640a86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f9162ffd700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916413f350 0x7f91640a86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f9162ffd700 1 -- 172.21.15.57:0/3509468992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c00b180 con 0x7f916405c790 2021-06-25T04:48:16.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f91637fe700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916413f350 0x7f91640a86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:16.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f9162ffd700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f916405c790 0x7f9164066e70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f9154000ed0 tx=0x7f9154007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:16.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f915bfff700 1 -- 172.21.15.57:0/3509468992 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f915400ce00 con 0x7f916405c790 2021-06-25T04:48:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f915bfff700 1 -- 172.21.15.57:0/3509468992 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915400f470 con 0x7f916405c790 2021-06-25T04:48:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f9163fff700 1 -- 172.21.15.57:0/3509468992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c009530 con 0x7f916405c790 2021-06-25T04:48:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f915bfff700 1 -- 172.21.15.57:0/3509468992 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f915400f7d0 con 0x7f916405c790 2021-06-25T04:48:16.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f9163fff700 1 -- 172.21.15.57:0/3509468992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91640ab550 con 0x7f916405c790 2021-06-25T04:48:16.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f9163fff700 1 -- 172.21.15.57:0/3509468992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916409ea10 con 0x7f916405c790 2021-06-25T04:48:16.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.467+0000 7f915bfff700 1 -- 172.21.15.57:0/3509468992 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9154019030 con 0x7f916405c790 2021-06-25T04:48:16.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.471+0000 7f915bfff700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91480553d0 0x7f9148057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.471+0000 7f915bfff700 1 -- 172.21.15.57:0/3509468992 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f915406d0c0 con 0x7f916405c790 2021-06-25T04:48:16.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.471+0000 7f91627fc700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91480553d0 0x7f9148057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.471+0000 7f91627fc700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91480553d0 0x7f9148057890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f914c018000 tx=0x7f914c016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:16.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.479+0000 7f915bfff700 1 -- 172.21.15.57:0/3509468992 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f91540435c0 con 0x7f916405c790 2021-06-25T04:48:16.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.607+0000 7f9163fff700 1 -- 172.21.15.57:0/3509468992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9164063db0 con 0x7f916405c790 2021-06-25T04:48:16.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f915bfff700 1 -- 172.21.15.57:0/3509468992 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9154046be0 con 0x7f916405c790 2021-06-25T04:48:16.617 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:16.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 -- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91480553d0 msgr2=0x7f9148057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91480553d0 0x7f9148057890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f914c018000 tx=0x7f914c016000).stop 2021-06-25T04:48:16.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 -- 172.21.15.57:0/3509468992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f916405c790 msgr2=0x7f9164066e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f916405c790 0x7f9164066e70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f9154000ed0 tx=0x7f9154007ab0).stop 2021-06-25T04:48:16.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 -- 172.21.15.57:0/3509468992 shutdown_connections 2021-06-25T04:48:16.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f91480553d0 0x7f9148057890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916413f350 0x7f91640a86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916405d070 0x7f91640a81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 --2- 172.21.15.57:0/3509468992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f916405c790 0x7f9164066e70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 -- 172.21.15.57:0/3509468992 >> 172.21.15.57:0/3509468992 conn(0x7f9164060140 msgr2=0x7f916413f780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:16.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 -- 172.21.15.57:0/3509468992 shutdown_connections 2021-06-25T04:48:16.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.611+0000 7f9163fff700 1 -- 172.21.15.57:0/3509468992 wait complete. 2021-06-25T04:48:16.634 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:48:16.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 Processor -- start 2021-06-25T04:48:16.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 -- start start 2021-06-25T04:48:16.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5190067140 0x7f519005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f51900b1930 0x7f519005fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51900a7a50 con 0x7f51900a7670 2021-06-25T04:48:16.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51901475e0 con 0x7f51900b1930 2021-06-25T04:48:16.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5190147880 con 0x7f5190067140 2021-06-25T04:48:16.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f519673e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f51900b1930 0x7f519005fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f519673e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f51900b1930 0x7f519005fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36442/0 (socket says 172.21.15.57:36442) 2021-06-25T04:48:16.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f519673e700 1 -- 172.21.15.57:0/1290263513 learned_addr learned my addr 172.21.15.57:0/1290263513 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:16.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f519573c700 1 --2- 172.21.15.57:0/1290263513 >> v2:172.21.15.87:3300/0 conn(0x7f5190067140 0x7f519005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f519673e700 1 -- 172.21.15.57:0/1290263513 >> v2:172.21.15.87:3300/0 conn(0x7f5190067140 msgr2=0x7f519005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:16.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f519673e700 1 --2- 172.21.15.57:0/1290263513 >> v2:172.21.15.87:3300/0 conn(0x7f5190067140 0x7f519005f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f519673e700 1 -- 172.21.15.57:0/1290263513 >> v1:172.21.15.87:6789/0 conn(0x7f51900a7670 legacy=0x7f5190066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f519673e700 1 -- 172.21.15.57:0/1290263513 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5190147b20 con 0x7f51900b1930 2021-06-25T04:48:16.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f519673e700 1 --2- 172.21.15.57:0/1290263513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900b1930 0x7f519005fb60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f5188002f70 tx=0x7f5188006eb0).ready entity=mon.0 client_cookie=e90482d02a420147 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:16.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f5194f3b700 1 -- 172.21.15.57:0/1290263513 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f518800d5c0 con 0x7f51900b1930 2021-06-25T04:48:16.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f5194f3b700 1 -- 172.21.15.57:0/1290263513 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188000e90 con 0x7f51900b1930 2021-06-25T04:48:16.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f5194f3b700 1 -- 172.21.15.57:0/1290263513 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f518800d950 con 0x7f51900b1930 2021-06-25T04:48:16.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 -- 172.21.15.57:0/1290263513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900b1930 msgr2=0x7f519005fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 --2- 172.21.15.57:0/1290263513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900b1930 0x7f519005fb60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f5188002f70 tx=0x7f5188006eb0).stop 2021-06-25T04:48:16.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 -- 172.21.15.57:0/1290263513 shutdown_connections 2021-06-25T04:48:16.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 --2- 172.21.15.57:0/1290263513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900b1930 0x7f519005fb60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 --2- 172.21.15.57:0/1290263513 >> v2:172.21.15.87:3300/0 conn(0x7f5190067140 0x7f519005f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 -- 172.21.15.57:0/1290263513 >> 172.21.15.57:0/1290263513 conn(0x7f51900b53a0 msgr2=0x7f51900b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:16.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 -- 172.21.15.57:0/1290263513 shutdown_connections 2021-06-25T04:48:16.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.727+0000 7f51981a1700 1 -- 172.21.15.57:0/1290263513 wait complete. 2021-06-25T04:48:16.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f51981a1700 1 Processor -- start 2021-06-25T04:48:16.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f51981a1700 1 -- start start 2021-06-25T04:48:16.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f51981a1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5190067140 0x7f519014e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f51981a1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51900a7670 0x7f51901567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f51981a1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51900b1930 0x7f5190156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f51981a1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51900af180 con 0x7f5190067140 2021-06-25T04:48:16.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f51981a1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51900af420 con 0x7f51900b1930 2021-06-25T04:48:16.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f51981a1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51900ac5f0 con 0x7f51900a7670 2021-06-25T04:48:16.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5195f3d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5190067140 0x7f519014e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5195f3d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5190067140 0x7f519014e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36444/0 (socket says 172.21.15.57:36444) 2021-06-25T04:48:16.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5195f3d700 1 -- 172.21.15.57:0/621043711 learned_addr learned my addr 172.21.15.57:0/621043711 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:16.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f519573c700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51900a7670 0x7f51901567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f519673e700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51900b1930 0x7f5190156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5195f3d700 1 -- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51900a7670 msgr2=0x7f51901567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5195f3d700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51900a7670 0x7f51901567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5195f3d700 1 -- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51900b1930 msgr2=0x7f5190156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5195f3d700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51900b1930 0x7f5190156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5195f3d700 1 -- 172.21.15.57:0/621043711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518800b1e0 con 0x7f5190067140 2021-06-25T04:48:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5195f3d700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5190067140 0x7f519014e720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f519006a0a0 tx=0x7f5180007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:16.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5186ffd700 1 -- 172.21.15.57:0/621043711 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5180012400 con 0x7f5190067140 2021-06-25T04:48:16.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5186ffd700 1 -- 172.21.15.57:0/621043711 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5180012560 con 0x7f5190067140 2021-06-25T04:48:16.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f51981a1700 1 -- 172.21.15.57:0/621043711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51900a94d0 con 0x7f5190067140 2021-06-25T04:48:16.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f5186ffd700 1 -- 172.21.15.57:0/621043711 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51800128c0 con 0x7f5190067140 2021-06-25T04:48:16.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.731+0000 7f51981a1700 1 -- 172.21.15.57:0/621043711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51900aa230 con 0x7f5190067140 2021-06-25T04:48:16.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.735+0000 7f51981a1700 1 -- 172.21.15.57:0/621043711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51900ac7b0 con 0x7f5190067140 2021-06-25T04:48:16.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.735+0000 7f5186ffd700 1 -- 172.21.15.57:0/621043711 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5180019030 con 0x7f5190067140 2021-06-25T04:48:16.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.735+0000 7f5186ffd700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f51780554e0 0x7f51780579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:16.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.735+0000 7f5186ffd700 1 -- 172.21.15.57:0/621043711 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f518006ceb0 con 0x7f5190067140 2021-06-25T04:48:16.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.735+0000 7f519573c700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f51780554e0 0x7f51780579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:16.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.735+0000 7f519573c700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f51780554e0 0x7f51780579a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f518c00b000 tx=0x7f518c0091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:16.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.743+0000 7f5186ffd700 1 -- 172.21.15.57:0/621043711 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f51800433a0 con 0x7f5190067140 2021-06-25T04:48:16.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f51981a1700 1 -- 172.21.15.57:0/621043711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f51900af5e0 con 0x7f5190067140 2021-06-25T04:48:16.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f5186ffd700 1 -- 172.21.15.57:0/621043711 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+143 (secure 0 0 0) 0x7f51800469c0 con 0x7f5190067140 2021-06-25T04:48:16.879 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:16.880 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:48:16.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:16.881 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:48:16.881 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:48:16.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:48:16.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:48:16.882 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:48:16.882 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:48:16.882 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:48:16.883 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:48:16.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f51981a1700 1 -- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f51780554e0 msgr2=0x7f51780579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f51981a1700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f51780554e0 0x7f51780579a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f518c00b000 tx=0x7f518c0091d0).stop 2021-06-25T04:48:16.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f51981a1700 1 -- 172.21.15.57:0/621043711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5190067140 msgr2=0x7f519014e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:16.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f51981a1700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5190067140 0x7f519014e720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f519006a0a0 tx=0x7f5180007c50).stop 2021-06-25T04:48:16.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f51981a1700 1 -- 172.21.15.57:0/621043711 shutdown_connections 2021-06-25T04:48:16.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f51981a1700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f51780554e0 0x7f51780579a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f51981a1700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51900b1930 0x7f5190156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f51981a1700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51900a7670 0x7f51901567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f51981a1700 1 --2- 172.21.15.57:0/621043711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5190067140 0x7f519014e720 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:16.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.871+0000 7f51981a1700 1 -- 172.21.15.57:0/621043711 >> 172.21.15.57:0/621043711 conn(0x7f51900b53a0 msgr2=0x7f519005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:16.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.875+0000 7f51981a1700 1 -- 172.21.15.57:0/621043711 shutdown_connections 2021-06-25T04:48:16.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.875+0000 7f51981a1700 1 -- 172.21.15.57:0/621043711 wait complete. 2021-06-25T04:48:16.891 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:48:16.893 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:48:16.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.991+0000 7f23b1f79700 1 Processor -- start 2021-06-25T04:48:16.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.991+0000 7f23b1f79700 1 -- start start 2021-06-25T04:48:17.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.991+0000 7f23b1f79700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23ac0612e0 0x7f23ac0616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:17.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.991+0000 7f23b1f79700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23ac140400 0x7f23ac140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:17.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.991+0000 7f23b1f79700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0aecb0 con 0x7f23ac0ad580 2021-06-25T04:48:17.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.991+0000 7f23b1f79700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac0b6ee0 con 0x7f23ac140400 2021-06-25T04:48:17.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.991+0000 7f23b1f79700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0aeee0 con 0x7f23ac0612e0 2021-06-25T04:48:17.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1778700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23ac140400 0x7f23ac140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:17.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1778700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23ac140400 0x7f23ac140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:44950/0 (socket says 172.21.15.57:44950) 2021-06-25T04:48:17.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b0f77700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23ac0612e0 0x7f23ac0616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:17.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1778700 1 -- 172.21.15.57:0/1987622425 learned_addr learned my addr 172.21.15.57:0/1987622425 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:17.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23abfff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f23ac0ad580 0x7f23ac0b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:54418/0 (socket says 172.21.15.57:54418) 2021-06-25T04:48:17.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1778700 1 -- 172.21.15.57:0/1987622425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23ac0612e0 msgr2=0x7f23ac0616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:17.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1778700 1 --2- 172.21.15.57:0/1987622425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23ac0612e0 0x7f23ac0616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1778700 1 -- 172.21.15.57:0/1987622425 >> v1:172.21.15.87:6789/0 conn(0x7f23ac0ad580 legacy=0x7f23ac0b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:17.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1778700 1 -- 172.21.15.57:0/1987622425 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0af180 con 0x7f23ac140400 2021-06-25T04:48:17.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1778700 1 --2- 172.21.15.57:0/1987622425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23ac140400 0x7f23ac140890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f23a40032f0 tx=0x7f23a4009290).ready entity=mon.1 client_cookie=da796c3b497f2c4a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23ab7fe700 1 -- 172.21.15.57:0/1987622425 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a400b8a0 con 0x7f23ac140400 2021-06-25T04:48:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23ab7fe700 1 -- 172.21.15.57:0/1987622425 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a400ba00 con 0x7f23ac140400 2021-06-25T04:48:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23ab7fe700 1 -- 172.21.15.57:0/1987622425 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a400bb70 con 0x7f23ac140400 2021-06-25T04:48:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1f79700 1 -- 172.21.15.57:0/1987622425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23ac140400 msgr2=0x7f23ac140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1f79700 1 --2- 172.21.15.57:0/1987622425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23ac140400 0x7f23ac140890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f23a40032f0 tx=0x7f23a4009290).stop 2021-06-25T04:48:17.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1f79700 1 -- 172.21.15.57:0/1987622425 shutdown_connections 2021-06-25T04:48:17.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1f79700 1 --2- 172.21.15.57:0/1987622425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23ac140400 0x7f23ac140890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1f79700 1 --2- 172.21.15.57:0/1987622425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23ac0612e0 0x7f23ac0616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1f79700 1 -- 172.21.15.57:0/1987622425 >> 172.21.15.57:0/1987622425 conn(0x7f23ac066da0 msgr2=0x7f23ac067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:17.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1f79700 1 -- 172.21.15.57:0/1987622425 shutdown_connections 2021-06-25T04:48:17.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.995+0000 7f23b1f79700 1 -- 172.21.15.57:0/1987622425 wait complete. 2021-06-25T04:48:17.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b1f79700 1 Processor -- start 2021-06-25T04:48:17.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b1f79700 1 -- start start 2021-06-25T04:48:17.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b1f79700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23ac0612e0 0x7f23ac140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:17.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b1f79700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ac0ad580 0x7f23ac0b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:17.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b1f79700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23ac140400 0x7f23ac141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:17.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b1f79700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b20a0 con 0x7f23ac0ad580 2021-06-25T04:48:17.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b1f79700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b01a0 con 0x7f23ac0612e0 2021-06-25T04:48:17.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b1f79700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b0cc0 con 0x7f23ac140400 2021-06-25T04:48:17.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ac0ad580 0x7f23ac0b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:17.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ac0ad580 0x7f23ac0b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36460/0 (socket says 172.21.15.57:36460) 2021-06-25T04:48:17.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23abfff700 1 -- 172.21.15.57:0/406138737 learned_addr learned my addr 172.21.15.57:0/406138737 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:17.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b1778700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23ac140400 0x7f23ac141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:17.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b0f77700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23ac0612e0 0x7f23ac140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:17.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23abfff700 1 -- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23ac140400 msgr2=0x7f23ac141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:17.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23abfff700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23ac140400 0x7f23ac141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23abfff700 1 -- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23ac0612e0 msgr2=0x7f23ac140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:17.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23abfff700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23ac0612e0 0x7f23ac140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23abfff700 1 -- 172.21.15.57:0/406138737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4009530 con 0x7f23ac0ad580 2021-06-25T04:48:17.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b0f77700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23ac0612e0 0x7f23ac140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:17.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23abfff700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ac0ad580 0x7f23ac0b2250 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f23ac0b6aa0 tx=0x7f2394007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:17.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23a9ffb700 1 -- 172.21.15.57:0/406138737 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23940070d0 con 0x7f23ac0ad580 2021-06-25T04:48:17.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23a9ffb700 1 -- 172.21.15.57:0/406138737 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2394007230 con 0x7f23ac0ad580 2021-06-25T04:48:17.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b1f79700 1 -- 172.21.15.57:0/406138737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac0b0f60 con 0x7f23ac0ad580 2021-06-25T04:48:17.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23a9ffb700 1 -- 172.21.15.57:0/406138737 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2394005550 con 0x7f23ac0ad580 2021-06-25T04:48:17.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:16.999+0000 7f23b1f79700 1 -- 172.21.15.57:0/406138737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac0b0400 con 0x7f23ac0ad580 2021-06-25T04:48:17.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.003+0000 7f23a9ffb700 1 -- 172.21.15.57:0/406138737 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f239401a070 con 0x7f23ac0ad580 2021-06-25T04:48:17.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.003+0000 7f23b1f79700 1 -- 172.21.15.57:0/406138737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac0b05c0 con 0x7f23ac0ad580 2021-06-25T04:48:17.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.003+0000 7f23a9ffb700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2390055450 0x7f2390057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:17.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.003+0000 7f23a9ffb700 1 -- 172.21.15.57:0/406138737 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f239406cf10 con 0x7f23ac0ad580 2021-06-25T04:48:17.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.003+0000 7f23b0f77700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2390055450 0x7f2390057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:17.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.003+0000 7f23b0f77700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2390055450 0x7f2390057910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f239c00b000 tx=0x7f239c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:17.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.011+0000 7f23a9ffb700 1 -- 172.21.15.57:0/406138737 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2394043360 con 0x7f23ac0ad580 2021-06-25T04:48:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.135+0000 7f23b1f79700 1 -- 172.21.15.57:0/406138737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f23ac057310 con 0x7f23ac0ad580 2021-06-25T04:48:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.543+0000 7f23a9ffb700 1 -- 172.21.15.57:0/406138737 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v32) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2394046980 con 0x7f23ac0ad580 2021-06-25T04:48:17.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 -- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2390055450 msgr2=0x7f2390057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:17.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2390055450 0x7f2390057910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f239c00b000 tx=0x7f239c008040).stop 2021-06-25T04:48:17.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 -- 172.21.15.57:0/406138737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ac0ad580 msgr2=0x7f23ac0b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:17.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ac0ad580 0x7f23ac0b2250 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f23ac0b6aa0 tx=0x7f2394007c40).stop 2021-06-25T04:48:17.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 -- 172.21.15.57:0/406138737 shutdown_connections 2021-06-25T04:48:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2390055450 0x7f2390057910 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23ac140400 0x7f23ac141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ac0ad580 0x7f23ac0b2250 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 --2- 172.21.15.57:0/406138737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23ac0612e0 0x7f23ac140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 -- 172.21.15.57:0/406138737 >> 172.21.15.57:0/406138737 conn(0x7f23ac066da0 msgr2=0x7f23ac0b7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:17.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 -- 172.21.15.57:0/406138737 shutdown_connections 2021-06-25T04:48:17.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.551+0000 7f23b1f79700 1 -- 172.21.15.57:0/406138737 wait complete. 2021-06-25T04:48:17.563 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:48:17.572 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:48:17.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.679+0000 7f8a47fff700 1 Processor -- start 2021-06-25T04:48:17.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.679+0000 7f8a47fff700 1 -- start start 2021-06-25T04:48:17.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a47fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a480b0390 0x7f8a48146c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:17.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a47fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a480b1100 con 0x7f8a480b0b40 2021-06-25T04:48:17.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a47fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a480a9530 con 0x7f8a480a9150 2021-06-25T04:48:17.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a47fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480b1330 con 0x7f8a480b0390 2021-06-25T04:48:17.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a3ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8a480b0b40 0x7f8a48140180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53688/0 (socket says 172.21.15.57:53688) 2021-06-25T04:48:17.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a3ffff700 1 -- 172.21.15.57:0/2240956165 learned_addr learned my addr 172.21.15.57:0/2240956165 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:17.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a477fe700 1 --2- 172.21.15.57:0/2240956165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a480b0390 0x7f8a48146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:17.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a467fc700 1 -- 172.21.15.57:0/2240956165 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032778875 0 0) 0x7f8a480b1100 con 0x7f8a480b0b40 2021-06-25T04:48:17.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a467fc700 1 -- 172.21.15.57:0/2240956165 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a28003260 con 0x7f8a480b0b40 2021-06-25T04:48:17.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a467fc700 1 -- 172.21.15.57:0/2240956165 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052056754 0 0) 0x7f8a480a9530 con 0x7f8a480a9150 2021-06-25T04:48:17.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a467fc700 1 -- 172.21.15.57:0/2240956165 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a480b1100 con 0x7f8a480a9150 2021-06-25T04:48:17.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a477fe700 1 -- 172.21.15.57:0/2240956165 >> v1:172.21.15.87:6789/0 conn(0x7f8a480a9150 legacy=0x7f8a48146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:17.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a477fe700 1 -- 172.21.15.57:0/2240956165 >> v1:172.21.15.57:6789/0 conn(0x7f8a480b0b40 legacy=0x7f8a48140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:17.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a477fe700 1 -- 172.21.15.57:0/2240956165 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a480b15d0 con 0x7f8a480b0390 2021-06-25T04:48:17.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a477fe700 1 --2- 172.21.15.57:0/2240956165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a480b0390 0x7f8a48146c20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8a400032f0 tx=0x7f8a400091d0).ready entity=mon.2 client_cookie=66620f8a464dcd27 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:17.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a467fc700 1 -- 172.21.15.57:0/2240956165 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a4000b640 con 0x7f8a480b0390 2021-06-25T04:48:17.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a467fc700 1 -- 172.21.15.57:0/2240956165 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4000b7a0 con 0x7f8a480b0390 2021-06-25T04:48:17.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a467fc700 1 -- 172.21.15.57:0/2240956165 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a4000b910 con 0x7f8a480b0390 2021-06-25T04:48:17.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a47fff700 1 -- 172.21.15.57:0/2240956165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a480b0390 msgr2=0x7f8a48146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:17.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a47fff700 1 --2- 172.21.15.57:0/2240956165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a480b0390 0x7f8a48146c20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8a400032f0 tx=0x7f8a400091d0).stop 2021-06-25T04:48:17.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a47fff700 1 -- 172.21.15.57:0/2240956165 shutdown_connections 2021-06-25T04:48:17.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a47fff700 1 --2- 172.21.15.57:0/2240956165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a480b0390 0x7f8a48146c20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a47fff700 1 -- 172.21.15.57:0/2240956165 >> 172.21.15.57:0/2240956165 conn(0x7f8a48061100 msgr2=0x7f8a48062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:17.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a47fff700 1 -- 172.21.15.57:0/2240956165 shutdown_connections 2021-06-25T04:48:17.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.683+0000 7f8a47fff700 1 -- 172.21.15.57:0/2240956165 wait complete. 2021-06-25T04:48:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a47fff700 1 Processor -- start 2021-06-25T04:48:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a47fff700 1 -- start start 2021-06-25T04:48:17.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a47fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a480a9150 0x7f8a48145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:17.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a47fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a480b0390 0x7f8a480b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:17.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a47fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a480b0b40 0x7f8a480b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:17.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a47fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480b5260 con 0x7f8a480b0b40 2021-06-25T04:48:17.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a47fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480b5500 con 0x7f8a480a9150 2021-06-25T04:48:17.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a47fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480b57a0 con 0x7f8a480b0390 2021-06-25T04:48:17.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a477fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a480b0b40 0x7f8a480b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:17.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a477fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a480b0b40 0x7f8a480b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36478/0 (socket says 172.21.15.57:36478) 2021-06-25T04:48:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a477fe700 1 -- 172.21.15.57:0/3320308457 learned_addr learned my addr 172.21.15.57:0/3320308457 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a3ffff700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a480b0390 0x7f8a480b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a46ffd700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a480a9150 0x7f8a48145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a477fe700 1 -- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a480b0390 msgr2=0x7f8a480b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a477fe700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a480b0390 0x7f8a480b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a477fe700 1 -- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a480a9150 msgr2=0x7f8a48145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a477fe700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a480a9150 0x7f8a48145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.687+0000 7f8a477fe700 1 -- 172.21.15.57:0/3320308457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40009470 con 0x7f8a480b0b40 2021-06-25T04:48:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.691+0000 7f8a477fe700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a480b0b40 0x7f8a480b3ae0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f8a400032f0 tx=0x7f8a40016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:17.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.691+0000 7f8a44ff9700 1 -- 172.21.15.57:0/3320308457 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a40011e40 con 0x7f8a480b0b40 2021-06-25T04:48:17.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.691+0000 7f8a44ff9700 1 -- 172.21.15.57:0/3320308457 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a40021440 con 0x7f8a480b0b40 2021-06-25T04:48:17.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.691+0000 7f8a47fff700 1 -- 172.21.15.57:0/3320308457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a480b5a40 con 0x7f8a480b0b40 2021-06-25T04:48:17.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.691+0000 7f8a44ff9700 1 -- 172.21.15.57:0/3320308457 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a400217a0 con 0x7f8a480b0b40 2021-06-25T04:48:17.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.691+0000 7f8a47fff700 1 -- 172.21.15.57:0/3320308457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a480aba10 con 0x7f8a480b0b40 2021-06-25T04:48:17.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.691+0000 7f8a47fff700 1 -- 172.21.15.57:0/3320308457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a480b5bd0 con 0x7f8a480b0b40 2021-06-25T04:48:17.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.691+0000 7f8a44ff9700 1 -- 172.21.15.57:0/3320308457 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8a40027020 con 0x7f8a480b0b40 2021-06-25T04:48:17.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.691+0000 7f8a44ff9700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a2c055450 0x7f8a2c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:17.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.695+0000 7f8a44ff9700 1 -- 172.21.15.57:0/3320308457 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f8a4006f120 con 0x7f8a480b0b40 2021-06-25T04:48:17.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.695+0000 7f8a46ffd700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a2c055450 0x7f8a2c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:17.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.695+0000 7f8a46ffd700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a2c055450 0x7f8a2c057910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f8a3800d000 tx=0x7f8a38007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:17.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.703+0000 7f8a44ff9700 1 -- 172.21.15.57:0/3320308457 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8a40045310 con 0x7f8a480b0b40 2021-06-25T04:48:17.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:17.835+0000 7f8a47fff700 1 -- 172.21.15.57:0/3320308457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f8a48057310 con 0x7f8a480b0b40 2021-06-25T04:48:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.547+0000 7f8a44ff9700 1 -- 172.21.15.57:0/3320308457 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v33) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8a40048930 con 0x7f8a480b0b40 2021-06-25T04:48:18.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 -- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a2c055450 msgr2=0x7f8a2c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:18.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a2c055450 0x7f8a2c057910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f8a3800d000 tx=0x7f8a38007a00).stop 2021-06-25T04:48:18.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 -- 172.21.15.57:0/3320308457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a480b0b40 msgr2=0x7f8a480b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:18.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a480b0b40 0x7f8a480b3ae0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f8a400032f0 tx=0x7f8a40016000).stop 2021-06-25T04:48:18.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 -- 172.21.15.57:0/3320308457 shutdown_connections 2021-06-25T04:48:18.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a2c055450 0x7f8a2c057910 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a480b0b40 0x7f8a480b3ae0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a480b0390 0x7f8a480b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 --2- 172.21.15.57:0/3320308457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a480a9150 0x7f8a48145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 -- 172.21.15.57:0/3320308457 >> 172.21.15.57:0/3320308457 conn(0x7f8a48061100 msgr2=0x7f8a4805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:18.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 -- 172.21.15.57:0/3320308457 shutdown_connections 2021-06-25T04:48:18.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.555+0000 7f8a47fff700 1 -- 172.21.15.57:0/3320308457 wait complete. 2021-06-25T04:48:18.566 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:48:18.576 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:48:18.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba95f700 1 Processor -- start 2021-06-25T04:48:18.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba95f700 1 -- start start 2021-06-25T04:48:18.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba95f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7cb40b0440 0x7f7cb40aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:18.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba95f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cb4146e90 0x7f7cb413ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:18.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba95f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb40affc0 con 0x7f7cb40aea70 2021-06-25T04:48:18.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba95f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb40adf00 con 0x7f7cb40b0440 2021-06-25T04:48:18.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba95f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40ad060 con 0x7f7cb4146e90 2021-06-25T04:48:18.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cb995d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7cb40aea70 0x7f7cb4146780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53700/0 (socket says 172.21.15.57:53700) 2021-06-25T04:48:18.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cb995d700 1 -- 172.21.15.57:0/1525043802 learned_addr learned my addr 172.21.15.57:0/1525043802 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:18.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cb915c700 1 --2- 172.21.15.57:0/1525043802 >> v2:172.21.15.87:3300/0 conn(0x7f7cb40b0440 0x7f7cb40aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:18.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba15e700 1 --2- 172.21.15.57:0/1525043802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cb4146e90 0x7f7cb413ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:18.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cb895b700 1 -- 172.21.15.57:0/1525043802 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108847132 0 0) 0x7f7cb40affc0 con 0x7f7cb40aea70 2021-06-25T04:48:18.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cb895b700 1 -- 172.21.15.57:0/1525043802 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c9c003260 con 0x7f7cb40aea70 2021-06-25T04:48:18.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba15e700 1 -- 172.21.15.57:0/1525043802 >> v2:172.21.15.87:3300/0 conn(0x7f7cb40b0440 msgr2=0x7f7cb40aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:18.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba15e700 1 --2- 172.21.15.57:0/1525043802 >> v2:172.21.15.87:3300/0 conn(0x7f7cb40b0440 0x7f7cb40aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba15e700 1 -- 172.21.15.57:0/1525043802 >> v1:172.21.15.57:6789/0 conn(0x7f7cb40aea70 legacy=0x7f7cb4146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:18.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cba15e700 1 -- 172.21.15.57:0/1525043802 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4147310 con 0x7f7cb4146e90 2021-06-25T04:48:18.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.679+0000 7f7cb915c700 1 --2- 172.21.15.57:0/1525043802 >> v2:172.21.15.87:3300/0 conn(0x7f7cb40b0440 0x7f7cb40aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:18.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cba15e700 1 --2- 172.21.15.57:0/1525043802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cb4146e90 0x7f7cb413ff40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7cac0032f0 tx=0x7f7cac0091d0).ready entity=mon.2 client_cookie=4e72ca96eadb2bb7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:18.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cb895b700 1 -- 172.21.15.57:0/1525043802 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cac00b600 con 0x7f7cb4146e90 2021-06-25T04:48:18.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cb895b700 1 -- 172.21.15.57:0/1525043802 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac00b760 con 0x7f7cb4146e90 2021-06-25T04:48:18.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cb895b700 1 -- 172.21.15.57:0/1525043802 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cac00b8d0 con 0x7f7cb4146e90 2021-06-25T04:48:18.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cba95f700 1 -- 172.21.15.57:0/1525043802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cb4146e90 msgr2=0x7f7cb413ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:18.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cba95f700 1 --2- 172.21.15.57:0/1525043802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cb4146e90 0x7f7cb413ff40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7cac0032f0 tx=0x7f7cac0091d0).stop 2021-06-25T04:48:18.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cba95f700 1 -- 172.21.15.57:0/1525043802 shutdown_connections 2021-06-25T04:48:18.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cba95f700 1 --2- 172.21.15.57:0/1525043802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cb4146e90 0x7f7cb413ff40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cba95f700 1 --2- 172.21.15.57:0/1525043802 >> v2:172.21.15.87:3300/0 conn(0x7f7cb40b0440 0x7f7cb40aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cba95f700 1 -- 172.21.15.57:0/1525043802 >> 172.21.15.57:0/1525043802 conn(0x7f7cb40611f0 msgr2=0x7f7cb4062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:18.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cba95f700 1 -- 172.21.15.57:0/1525043802 shutdown_connections 2021-06-25T04:48:18.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cba95f700 1 -- 172.21.15.57:0/1525043802 wait complete. 2021-06-25T04:48:18.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cba95f700 1 Processor -- start 2021-06-25T04:48:18.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.683+0000 7f7cba95f700 1 -- start start 2021-06-25T04:48:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cba95f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cb40aea70 0x7f7cb413cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cba95f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb40b0440 0x7f7cb4136d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cba95f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cb4146e90 0x7f7cb4137230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cba95f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4137720 con 0x7f7cb40b0440 2021-06-25T04:48:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cba95f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb41480e0 con 0x7f7cb40aea70 2021-06-25T04:48:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cba95f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4148310 con 0x7f7cb4146e90 2021-06-25T04:48:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cb915c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb40b0440 0x7f7cb4136d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cb995d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cb40aea70 0x7f7cb413cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:18.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cb915c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb40b0440 0x7f7cb4136d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36490/0 (socket says 172.21.15.57:36490) 2021-06-25T04:48:18.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cb915c700 1 -- 172.21.15.57:0/3995474545 learned_addr learned my addr 172.21.15.57:0/3995474545 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:18.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cba15e700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cb4146e90 0x7f7cb4137230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cb915c700 1 -- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cb4146e90 msgr2=0x7f7cb4137230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cb915c700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cb4146e90 0x7f7cb4137230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cb915c700 1 -- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cb40aea70 msgr2=0x7f7cb413cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:18.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cb915c700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cb40aea70 0x7f7cb413cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cb915c700 1 -- 172.21.15.57:0/3995474545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca400b180 con 0x7f7cb40b0440 2021-06-25T04:48:18.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cb915c700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb40b0440 0x7f7cb4136d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f7ca400c000 tx=0x7f7ca4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:18.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7ca2ffd700 1 -- 172.21.15.57:0/3995474545 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca4010780 con 0x7f7cb40b0440 2021-06-25T04:48:18.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7ca2ffd700 1 -- 172.21.15.57:0/3995474545 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca40108e0 con 0x7f7cb40b0440 2021-06-25T04:48:18.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cba95f700 1 -- 172.21.15.57:0/3995474545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac009470 con 0x7f7cb40b0440 2021-06-25T04:48:18.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7ca2ffd700 1 -- 172.21.15.57:0/3995474545 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca4010c40 con 0x7f7cb40b0440 2021-06-25T04:48:18.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.687+0000 7f7cba95f700 1 -- 172.21.15.57:0/3995474545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb4148850 con 0x7f7cb40b0440 2021-06-25T04:48:18.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.691+0000 7f7cba95f700 1 -- 172.21.15.57:0/3995474545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb4148a10 con 0x7f7cb40b0440 2021-06-25T04:48:18.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.691+0000 7f7ca2ffd700 1 -- 172.21.15.57:0/3995474545 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7ca401c460 con 0x7f7cb40b0440 2021-06-25T04:48:18.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.691+0000 7f7ca2ffd700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c940553d0 0x7f7c94057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:18.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.691+0000 7f7ca2ffd700 1 -- 172.21.15.57:0/3995474545 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f7ca406e530 con 0x7f7cb40b0440 2021-06-25T04:48:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.691+0000 7f7cb995d700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c940553d0 0x7f7c94057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.691+0000 7f7cb995d700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c940553d0 0x7f7c94057890 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7cb000d000 tx=0x7f7cb0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.699+0000 7f7ca2ffd700 1 -- 172.21.15.57:0/3995474545 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7ca40445f0 con 0x7f7cb40b0440 2021-06-25T04:48:18.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.867+0000 7f7cba95f700 1 -- 172.21.15.57:0/3995474545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f7cb4057310 con 0x7f7cb40b0440 2021-06-25T04:48:18.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.879+0000 7f7ca2ffd700 1 -- 172.21.15.57:0/3995474545 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 187+0+0 (secure 0 0 0) 0x7f7ca4047c10 con 0x7f7cb40b0440 2021-06-25T04:48:18.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.883+0000 7f7cba95f700 1 -- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c940553d0 msgr2=0x7f7c94057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:18.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.883+0000 7f7cba95f700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c940553d0 0x7f7c94057890 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7cb000d000 tx=0x7f7cb0009040).stop 2021-06-25T04:48:18.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.883+0000 7f7cba95f700 1 -- 172.21.15.57:0/3995474545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb40b0440 msgr2=0x7f7cb4136d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:18.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.883+0000 7f7cba95f700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb40b0440 0x7f7cb4136d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f7ca400c000 tx=0x7f7ca4006df0).stop 2021-06-25T04:48:18.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.883+0000 7f7cba95f700 1 -- 172.21.15.57:0/3995474545 shutdown_connections 2021-06-25T04:48:18.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.883+0000 7f7cba95f700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c940553d0 0x7f7c94057890 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.883+0000 7f7cba95f700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cb4146e90 0x7f7cb4137230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.883+0000 7f7cba95f700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb40b0440 0x7f7cb4136d40 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0x7f7ca400c000 tx=0x7f7ca4006df0).stop 2021-06-25T04:48:18.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.883+0000 7f7cba95f700 1 --2- 172.21.15.57:0/3995474545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cb40aea70 0x7f7cb413cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:18.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.883+0000 7f7cba95f700 1 -- 172.21.15.57:0/3995474545 >> 172.21.15.57:0/3995474545 conn(0x7f7cb40611f0 msgr2=0x7f7cb40b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:18.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.883+0000 7f7cba95f700 1 -- 172.21.15.57:0/3995474545 shutdown_connections 2021-06-25T04:48:18.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.887+0000 7f7cba95f700 1 -- 172.21.15.57:0/3995474545 wait complete. 2021-06-25T04:48:18.900 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 5 and data pool 6 2021-06-25T04:48:18.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:48:19.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1a40c700 1 Processor -- start 2021-06-25T04:48:19.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1a40c700 1 -- start start 2021-06-25T04:48:19.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1a40c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc140b5460 0x7fdc140af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1a40c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdc14147560 0x7fdc140acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1a40c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc140b5840 con 0x7fdc140b05d0 2021-06-25T04:48:19.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1a40c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc141452a0 con 0x7fdc14147560 2021-06-25T04:48:19.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1a40c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140adfb0 con 0x7fdc140b5460 2021-06-25T04:48:19.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1940a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc140b5460 0x7fdc140af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc18c09700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdc140b05d0 0x7fdc14067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:54474/0 (socket says 172.21.15.57:54474) 2021-06-25T04:48:19.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc18c09700 1 -- 172.21.15.57:0/1419400111 learned_addr learned my addr 172.21.15.57:0/1419400111 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:19.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc19c0b700 1 --2- 172.21.15.57:0/1419400111 >> v2:172.21.15.87:3300/0 conn(0x7fdc14147560 0x7fdc140acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc0bfff700 1 -- 172.21.15.57:0/1419400111 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586068669 0 0) 0x7fdc140b5840 con 0x7fdc140b05d0 2021-06-25T04:48:19.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc0bfff700 1 -- 172.21.15.57:0/1419400111 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf8003260 con 0x7fdc140b05d0 2021-06-25T04:48:19.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1940a700 1 -- 172.21.15.57:0/1419400111 >> v2:172.21.15.87:3300/0 conn(0x7fdc14147560 msgr2=0x7fdc140acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:19.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1940a700 1 --2- 172.21.15.57:0/1419400111 >> v2:172.21.15.87:3300/0 conn(0x7fdc14147560 0x7fdc140acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1940a700 1 -- 172.21.15.57:0/1419400111 >> v1:172.21.15.87:6789/0 conn(0x7fdc140b05d0 legacy=0x7fdc14067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1940a700 1 -- 172.21.15.57:0/1419400111 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc140ac7c0 con 0x7fdc140b5460 2021-06-25T04:48:19.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1940a700 1 --2- 172.21.15.57:0/1419400111 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc140b5460 0x7fdc140af510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdc04002f70 tx=0x7fdc04006df0).ready entity=mon.2 client_cookie=5b56815f2b36a865 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:19.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc0bfff700 1 -- 172.21.15.57:0/1419400111 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc0400d4a0 con 0x7fdc140b5460 2021-06-25T04:48:19.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc0bfff700 1 -- 172.21.15.57:0/1419400111 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc04000e90 con 0x7fdc140b5460 2021-06-25T04:48:19.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1a40c700 1 -- 172.21.15.57:0/1419400111 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc140b5460 msgr2=0x7fdc140af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc0bfff700 1 -- 172.21.15.57:0/1419400111 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc0400d7f0 con 0x7fdc140b5460 2021-06-25T04:48:19.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:18.999+0000 7fdc1a40c700 1 --2- 172.21.15.57:0/1419400111 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc140b5460 0x7fdc140af510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdc04002f70 tx=0x7fdc04006df0).stop 2021-06-25T04:48:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 -- 172.21.15.57:0/1419400111 shutdown_connections 2021-06-25T04:48:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 --2- 172.21.15.57:0/1419400111 >> v2:172.21.15.87:3300/0 conn(0x7fdc14147560 0x7fdc140acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 --2- 172.21.15.57:0/1419400111 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc140b5460 0x7fdc140af510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 -- 172.21.15.57:0/1419400111 >> 172.21.15.57:0/1419400111 conn(0x7fdc14062520 msgr2=0x7fdc14062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 -- 172.21.15.57:0/1419400111 shutdown_connections 2021-06-25T04:48:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 -- 172.21.15.57:0/1419400111 wait complete. 2021-06-25T04:48:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 Processor -- start 2021-06-25T04:48:19.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 -- start start 2021-06-25T04:48:19.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc140b05d0 0x7fdc14143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc140b5460 0x7fdc1415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc14147560 0x7fdc1415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140b4cb0 con 0x7fdc140b05d0 2021-06-25T04:48:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14141610 con 0x7fdc140b5460 2021-06-25T04:48:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14159e00 con 0x7fdc14147560 2021-06-25T04:48:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1940a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc140b05d0 0x7fdc14143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc18c09700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc140b5460 0x7fdc1415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1940a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc140b05d0 0x7fdc14143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36516/0 (socket says 172.21.15.57:36516) 2021-06-25T04:48:19.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1940a700 1 -- 172.21.15.57:0/3473224987 learned_addr learned my addr 172.21.15.57:0/3473224987 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:19.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc19c0b700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc14147560 0x7fdc1415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1940a700 1 -- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc14147560 msgr2=0x7fdc1415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1940a700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc14147560 0x7fdc1415a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1940a700 1 -- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc140b5460 msgr2=0x7fdc1415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1940a700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc140b5460 0x7fdc1415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1940a700 1 -- 172.21.15.57:0/3473224987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0400b180 con 0x7fdc140b05d0 2021-06-25T04:48:19.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1940a700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc140b05d0 0x7fdc14143ff0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fdc140af510 tx=0x7fdc04014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:19.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc0a7fc700 1 -- 172.21.15.57:0/3473224987 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc040129b0 con 0x7fdc140b05d0 2021-06-25T04:48:19.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc0a7fc700 1 -- 172.21.15.57:0/3473224987 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc04012b10 con 0x7fdc140b05d0 2021-06-25T04:48:19.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 -- 172.21.15.57:0/3473224987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc14145680 con 0x7fdc140b05d0 2021-06-25T04:48:19.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc0a7fc700 1 -- 172.21.15.57:0/3473224987 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc04012e70 con 0x7fdc140b05d0 2021-06-25T04:48:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.003+0000 7fdc1a40c700 1 -- 172.21.15.57:0/3473224987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc14141370 con 0x7fdc140b05d0 2021-06-25T04:48:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.007+0000 7fdc1a40c700 1 -- 172.21.15.57:0/3473224987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc14057310 con 0x7fdc140b05d0 2021-06-25T04:48:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.007+0000 7fdc0a7fc700 1 -- 172.21.15.57:0/3473224987 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdc04025020 con 0x7fdc140b05d0 2021-06-25T04:48:19.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.007+0000 7fdc0a7fc700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdbfc055490 0x7fdbfc057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.007+0000 7fdc0a7fc700 1 -- 172.21.15.57:0/3473224987 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdc0406ed50 con 0x7fdc140b05d0 2021-06-25T04:48:19.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.007+0000 7fdc18c09700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdbfc055490 0x7fdbfc057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.007+0000 7fdc18c09700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdbfc055490 0x7fdbfc057950 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdc1000d000 tx=0x7fdc10009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:19.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.011+0000 7fdc0a7fc700 1 -- 172.21.15.57:0/3473224987 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdc04044fb0 con 0x7fdc140b05d0 2021-06-25T04:48:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.139+0000 7fdc1a40c700 1 -- 172.21.15.57:0/3473224987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc1405f200 con 0x7fdc140b05d0 2021-06-25T04:48:19.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc0a7fc700 1 -- 172.21.15.57:0/3473224987 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16284 (secure 0 0 0) 0x7fdc040485d0 con 0x7fdc140b05d0 2021-06-25T04:48:19.151 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:19.151 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":34,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:48:18.872575+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:48:17.192457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-06-25T04:48:17.888021+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:48:19.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 -- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdbfc055490 msgr2=0x7fdbfc057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdbfc055490 0x7fdbfc057950 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdc1000d000 tx=0x7fdc10009040).stop 2021-06-25T04:48:19.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 -- 172.21.15.57:0/3473224987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc140b05d0 msgr2=0x7fdc14143ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc140b05d0 0x7fdc14143ff0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fdc140af510 tx=0x7fdc04014000).stop 2021-06-25T04:48:19.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 -- 172.21.15.57:0/3473224987 shutdown_connections 2021-06-25T04:48:19.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdbfc055490 0x7fdbfc057950 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc14147560 0x7fdc1415a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc140b5460 0x7fdc1415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 --2- 172.21.15.57:0/3473224987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc140b05d0 0x7fdc14143ff0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 -- 172.21.15.57:0/3473224987 >> 172.21.15.57:0/3473224987 conn(0x7fdc14062520 msgr2=0x7fdc14148d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:19.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 -- 172.21.15.57:0/3473224987 shutdown_connections 2021-06-25T04:48:19.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.143+0000 7fdc1a40c700 1 -- 172.21.15.57:0/3473224987 wait complete. 2021-06-25T04:48:19.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:48:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd5a5c4700 1 Processor -- start 2021-06-25T04:48:19.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd5a5c4700 1 -- start start 2021-06-25T04:48:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd5a5c4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdd5413c6a0 0x7fdd5413cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd5a5c4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540acee0 0x7fdd540ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd5a5c4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd540b2bf0 con 0x7fdd540b2810 2021-06-25T04:48:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd5a5c4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd540b1170 con 0x7fdd5413c6a0 2021-06-25T04:48:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd5a5c4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540b1620 con 0x7fdd540acee0 2021-06-25T04:48:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd59dc3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540acee0 0x7fdd540ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd58dc1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdd5413c6a0 0x7fdd5413cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd58dc1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdd5413c6a0 0x7fdd5413cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:45016/0 (socket says 172.21.15.57:45016) 2021-06-25T04:48:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd59dc3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540acee0 0x7fdd540ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:47690/0 (socket says 172.21.15.57:47690) 2021-06-25T04:48:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd58dc1700 1 -- 172.21.15.57:0/993721260 learned_addr learned my addr 172.21.15.57:0/993721260 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd595c2700 1 --1- 172.21.15.57:0/993721260 >> v1:172.21.15.87:6789/0 conn(0x7fdd540b2810 0x7fdd540b0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:54488/0 (socket says 172.21.15.57:54488) 2021-06-25T04:48:19.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd59dc3700 1 -- 172.21.15.57:0/993721260 >> v2:172.21.15.87:3300/0 conn(0x7fdd5413c6a0 msgr2=0x7fdd5413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:19.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd59dc3700 1 --2- 172.21.15.57:0/993721260 >> v2:172.21.15.87:3300/0 conn(0x7fdd5413c6a0 0x7fdd5413cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd59dc3700 1 -- 172.21.15.57:0/993721260 >> v1:172.21.15.87:6789/0 conn(0x7fdd540b2810 legacy=0x7fdd540b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd59dc3700 1 -- 172.21.15.57:0/993721260 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540b18c0 con 0x7fdd540acee0 2021-06-25T04:48:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd59dc3700 1 --2- 172.21.15.57:0/993721260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540acee0 0x7fdd540ad350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdd4c002f70 tx=0x7fdd4c006df0).ready entity=mon.2 client_cookie=e1df32ef8199018e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.263+0000 7fdd47fff700 1 -- 172.21.15.57:0/993721260 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd4c00d570 con 0x7fdd540acee0 2021-06-25T04:48:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd47fff700 1 -- 172.21.15.57:0/993721260 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c000e90 con 0x7fdd540acee0 2021-06-25T04:48:19.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd47fff700 1 -- 172.21.15.57:0/993721260 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd4c00d8c0 con 0x7fdd540acee0 2021-06-25T04:48:19.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/993721260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540acee0 msgr2=0x7fdd540ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd5a5c4700 1 --2- 172.21.15.57:0/993721260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540acee0 0x7fdd540ad350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdd4c002f70 tx=0x7fdd4c006df0).stop 2021-06-25T04:48:19.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/993721260 shutdown_connections 2021-06-25T04:48:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd5a5c4700 1 --2- 172.21.15.57:0/993721260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540acee0 0x7fdd540ad350 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd5a5c4700 1 --2- 172.21.15.57:0/993721260 >> v2:172.21.15.87:3300/0 conn(0x7fdd5413c6a0 0x7fdd5413cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/993721260 >> 172.21.15.57:0/993721260 conn(0x7fdd540611f0 msgr2=0x7fdd54062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:19.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/993721260 shutdown_connections 2021-06-25T04:48:19.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/993721260 wait complete. 2021-06-25T04:48:19.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd5a5c4700 1 Processor -- start 2021-06-25T04:48:19.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.267+0000 7fdd5a5c4700 1 -- start start 2021-06-25T04:48:19.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd5a5c4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd540acee0 0x7fdd540656a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd5a5c4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd540b2810 0x7fdd54066140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd5a5c4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd5413c6a0 0x7fdd5409f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd5a5c4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54065070 con 0x7fdd540b2810 2021-06-25T04:48:19.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd5a5c4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54143730 con 0x7fdd540acee0 2021-06-25T04:48:19.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd5a5c4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54152e20 con 0x7fdd5413c6a0 2021-06-25T04:48:19.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd58dc1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd540b2810 0x7fdd54066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd58dc1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd540b2810 0x7fdd54066140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36530/0 (socket says 172.21.15.57:36530) 2021-06-25T04:48:19.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd58dc1700 1 -- 172.21.15.57:0/2841429555 learned_addr learned my addr 172.21.15.57:0/2841429555 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:19.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd595c2700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd540acee0 0x7fdd540656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd59dc3700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd5413c6a0 0x7fdd5409f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd58dc1700 1 -- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd5413c6a0 msgr2=0x7fdd5409f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd58dc1700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd5413c6a0 0x7fdd5409f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd58dc1700 1 -- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd540acee0 msgr2=0x7fdd540656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd58dc1700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd540acee0 0x7fdd540656a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd58dc1700 1 -- 172.21.15.57:0/2841429555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c00b180 con 0x7fdd540b2810 2021-06-25T04:48:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd58dc1700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd540b2810 0x7fdd54066140 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fdd48006ec0 tx=0x7fdd4800b530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd46ffd700 1 -- 172.21.15.57:0/2841429555 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd4800db20 con 0x7fdd540b2810 2021-06-25T04:48:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd46ffd700 1 -- 172.21.15.57:0/2841429555 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800dc80 con 0x7fdd540b2810 2021-06-25T04:48:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/2841429555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd54064dd0 con 0x7fdd540b2810 2021-06-25T04:48:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd46ffd700 1 -- 172.21.15.57:0/2841429555 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd48010440 con 0x7fdd540b2810 2021-06-25T04:48:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/2841429555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5414fdd0 con 0x7fdd540b2810 2021-06-25T04:48:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.271+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/2841429555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd540667d0 con 0x7fdd540b2810 2021-06-25T04:48:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.275+0000 7fdd46ffd700 1 -- 172.21.15.57:0/2841429555 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdd480105a0 con 0x7fdd540b2810 2021-06-25T04:48:19.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.275+0000 7fdd46ffd700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd30055450 0x7fdd30057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.275+0000 7fdd46ffd700 1 -- 172.21.15.57:0/2841429555 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdd4806eab0 con 0x7fdd540b2810 2021-06-25T04:48:19.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.275+0000 7fdd595c2700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd30055450 0x7fdd30057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.275+0000 7fdd595c2700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd30055450 0x7fdd30057910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdd5000d000 tx=0x7fdd50009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:19.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.279+0000 7fdd46ffd700 1 -- 172.21.15.57:0/2841429555 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdd48044c00 con 0x7fdd540b2810 2021-06-25T04:48:19.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.407+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/2841429555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd54057310 con 0x7fdd540b2810 2021-06-25T04:48:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd46ffd700 1 -- 172.21.15.57:0/2841429555 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16284 (secure 0 0 0) 0x7fdd48048220 con 0x7fdd540b2810 2021-06-25T04:48:19.417 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:19.417 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":34,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:48:18.872575+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:48:17.192457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-06-25T04:48:17.888021+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:48:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd30055450 msgr2=0x7fdd30057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd30055450 0x7fdd30057910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdd5000d000 tx=0x7fdd50009040).stop 2021-06-25T04:48:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/2841429555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd540b2810 msgr2=0x7fdd54066140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd540b2810 0x7fdd54066140 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fdd48006ec0 tx=0x7fdd4800b530).stop 2021-06-25T04:48:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/2841429555 shutdown_connections 2021-06-25T04:48:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd30055450 0x7fdd30057910 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd5413c6a0 0x7fdd5409f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd540b2810 0x7fdd54066140 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 --2- 172.21.15.57:0/2841429555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd540acee0 0x7fdd540656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/2841429555 >> 172.21.15.57:0/2841429555 conn(0x7fdd540611f0 msgr2=0x7fdd5413ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:19.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/2841429555 shutdown_connections 2021-06-25T04:48:19.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.411+0000 7fdd5a5c4700 1 -- 172.21.15.57:0/2841429555 wait complete. 2021-06-25T04:48:19.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:48:19.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f081359e700 1 Processor -- start 2021-06-25T04:48:19.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f081359e700 1 -- start start 2021-06-25T04:48:19.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f081359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140b2540 0x7f081414ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f081359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f08140affd0 0x7f081414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f081359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08140a7080 con 0x7f08140afb90 2021-06-25T04:48:19.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f081359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08140a72b0 con 0x7f08140affd0 2021-06-25T04:48:19.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f081359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08140a7550 con 0x7f08140b2540 2021-06-25T04:48:19.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f0811d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f08140affd0 0x7f081414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f0812d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f08140afb90 0x7f08140a8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53758/0 (socket says 172.21.15.57:53758) 2021-06-25T04:48:19.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f0811d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f08140affd0 0x7f081414b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36536/0 (socket says 172.21.15.57:36536) 2021-06-25T04:48:19.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f0812d9d700 1 -- 172.21.15.57:0/2842749127 learned_addr learned my addr 172.21.15.57:0/2842749127 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:19.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f081259c700 1 --2- 172.21.15.57:0/2842749127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140b2540 0x7f081414ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f0811d9b700 1 -- 172.21.15.57:0/2842749127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140b2540 msgr2=0x7f081414ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:19.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.531+0000 7f0811d9b700 1 --2- 172.21.15.57:0/2842749127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140b2540 0x7f081414ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f0811d9b700 1 -- 172.21.15.57:0/2842749127 >> v1:172.21.15.57:6789/0 conn(0x7f08140afb90 legacy=0x7f08140a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f0811d9b700 1 -- 172.21.15.57:0/2842749127 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08140a77f0 con 0x7f08140affd0 2021-06-25T04:48:19.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081259c700 1 --2- 172.21.15.57:0/2842749127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140b2540 0x7f081414ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:19.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f0811d9b700 1 --2- 172.21.15.57:0/2842749127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08140affd0 0x7f081414b2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f08040032f0 tx=0x7f08040091d0).ready entity=mon.0 client_cookie=97e395b05d64fddd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:19.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081159a700 1 -- 172.21.15.57:0/2842749127 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0804009ea0 con 0x7f08140affd0 2021-06-25T04:48:19.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081159a700 1 -- 172.21.15.57:0/2842749127 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080400b8a0 con 0x7f08140affd0 2021-06-25T04:48:19.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081159a700 1 -- 172.21.15.57:0/2842749127 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080400ba10 con 0x7f08140affd0 2021-06-25T04:48:19.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081359e700 1 -- 172.21.15.57:0/2842749127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08140affd0 msgr2=0x7f081414b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081359e700 1 --2- 172.21.15.57:0/2842749127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08140affd0 0x7f081414b2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f08040032f0 tx=0x7f08040091d0).stop 2021-06-25T04:48:19.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081359e700 1 -- 172.21.15.57:0/2842749127 shutdown_connections 2021-06-25T04:48:19.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081359e700 1 --2- 172.21.15.57:0/2842749127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08140affd0 0x7f081414b2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081359e700 1 --2- 172.21.15.57:0/2842749127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140b2540 0x7f081414ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081359e700 1 -- 172.21.15.57:0/2842749127 >> 172.21.15.57:0/2842749127 conn(0x7f0814060140 msgr2=0x7f08140b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:19.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081359e700 1 -- 172.21.15.57:0/2842749127 shutdown_connections 2021-06-25T04:48:19.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.535+0000 7f081359e700 1 -- 172.21.15.57:0/2842749127 wait complete. 2021-06-25T04:48:19.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081359e700 1 Processor -- start 2021-06-25T04:48:19.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081359e700 1 -- start start 2021-06-25T04:48:19.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140afb90 0x7f08140ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08140affd0 0x7f08140abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08140b2540 0x7f08140ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08140b4be0 con 0x7f08140b2540 2021-06-25T04:48:19.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08140b40c0 con 0x7f08140affd0 2021-06-25T04:48:19.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08140a9b40 con 0x7f08140afb90 2021-06-25T04:48:19.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f0812d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08140b2540 0x7f08140ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f0812d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08140b2540 0x7f08140ac1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36546/0 (socket says 172.21.15.57:36546) 2021-06-25T04:48:19.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f0812d9d700 1 -- 172.21.15.57:0/2268037440 learned_addr learned my addr 172.21.15.57:0/2268037440 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:19.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f0811d9b700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08140affd0 0x7f08140abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081259c700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140afb90 0x7f08140ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f0812d9d700 1 -- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140afb90 msgr2=0x7f08140ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f0812d9d700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140afb90 0x7f08140ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f0812d9d700 1 -- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08140affd0 msgr2=0x7f08140abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f0812d9d700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08140affd0 0x7f08140abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f0812d9d700 1 -- 172.21.15.57:0/2268037440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804009470 con 0x7f08140b2540 2021-06-25T04:48:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081259c700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140afb90 0x7f08140ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f0811d9b700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08140affd0 0x7f08140abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f0812d9d700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08140b2540 0x7f08140ac1b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f0814061a40 tx=0x7f080c007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f08037fe700 1 -- 172.21.15.57:0/2268037440 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c0070d0 con 0x7f08140b2540 2021-06-25T04:48:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f08037fe700 1 -- 172.21.15.57:0/2268037440 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c007230 con 0x7f08140b2540 2021-06-25T04:48:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081359e700 1 -- 172.21.15.57:0/2268037440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08140b4e10 con 0x7f08140b2540 2021-06-25T04:48:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f08037fe700 1 -- 172.21.15.57:0/2268037440 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c005610 con 0x7f08140b2540 2021-06-25T04:48:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.539+0000 7f081359e700 1 -- 172.21.15.57:0/2268037440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08140aefe0 con 0x7f08140b2540 2021-06-25T04:48:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.543+0000 7f081359e700 1 -- 172.21.15.57:0/2268037440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08140ab080 con 0x7f08140b2540 2021-06-25T04:48:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.543+0000 7f08037fe700 1 -- 172.21.15.57:0/2268037440 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f080c010070 con 0x7f08140b2540 2021-06-25T04:48:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.543+0000 7f08037fe700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f07f0055510 0x7f07f00579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:19.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.543+0000 7f08037fe700 1 -- 172.21.15.57:0/2268037440 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f080c06d4e0 con 0x7f08140b2540 2021-06-25T04:48:19.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.543+0000 7f081259c700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f07f0055510 0x7f07f00579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:19.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.547+0000 7f081259c700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f07f0055510 0x7f07f00579d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f080800c000 tx=0x7f0808008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:19.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.551+0000 7f08037fe700 1 -- 172.21.15.57:0/2268037440 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f080c043580 con 0x7f08140b2540 2021-06-25T04:48:19.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.711+0000 7f081359e700 1 -- 172.21.15.57:0/2268037440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0814057310 con 0x7f08140b2540 2021-06-25T04:48:19.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.879+0000 7f08037fe700 1 -- 172.21.15.57:0/2268037440 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f080c046ba0 con 0x7f08140b2540 2021-06-25T04:48:19.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 -- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f07f0055510 msgr2=0x7f07f00579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f07f0055510 0x7f07f00579d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f080800c000 tx=0x7f0808008040).stop 2021-06-25T04:48:19.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 -- 172.21.15.57:0/2268037440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08140b2540 msgr2=0x7f08140ac1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:19.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08140b2540 0x7f08140ac1b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f0814061a40 tx=0x7f080c007b80).stop 2021-06-25T04:48:19.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 -- 172.21.15.57:0/2268037440 shutdown_connections 2021-06-25T04:48:19.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f07f0055510 0x7f07f00579d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08140b2540 0x7f08140ac1b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08140affd0 0x7f08140abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 --2- 172.21.15.57:0/2268037440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08140afb90 0x7f08140ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:19.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 -- 172.21.15.57:0/2268037440 >> 172.21.15.57:0/2268037440 conn(0x7f0814060140 msgr2=0x7f0814148680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:19.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 -- 172.21.15.57:0/2268037440 shutdown_connections 2021-06-25T04:48:19.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:19.883+0000 7f081359e700 1 -- 172.21.15.57:0/2268037440 wait complete. 2021-06-25T04:48:19.908 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:48:20.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37fc8b8700 1 Processor -- start 2021-06-25T04:48:20.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37fc8b8700 1 -- start start 2021-06-25T04:48:20.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37fc8b8700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f37f80b2810 0x7f37f8067110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37fc8b8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80af0f0 0x7f37f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37fc8b8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f37f80afd20 0x7f37f8140e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37fc8b8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f8144410 con 0x7f37f80afd20 2021-06-25T04:48:20.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37fc8b8700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f80b2bf0 con 0x7f37f80b2810 2021-06-25T04:48:20.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37fc8b8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f81452c0 con 0x7f37f80af0f0 2021-06-25T04:48:20.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f6ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80af0f0 0x7f37f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f37f80afd20 0x7f37f8140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f77fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f37f80b2810 0x7f37f8067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f6ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80af0f0 0x7f37f8067600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:47716/0 (socket says 172.21.15.57:47716) 2021-06-25T04:48:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f6ffd700 1 -- 172.21.15.57:0/1241898884 learned_addr learned my addr 172.21.15.57:0/1241898884 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f6ffd700 1 -- 172.21.15.57:0/1241898884 >> v2:172.21.15.87:3300/0 conn(0x7f37f80b2810 msgr2=0x7f37f8067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f6ffd700 1 --2- 172.21.15.57:0/1241898884 >> v2:172.21.15.87:3300/0 conn(0x7f37f80b2810 0x7f37f8067110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f6ffd700 1 -- 172.21.15.57:0/1241898884 >> v2:172.21.15.57:3300/0 conn(0x7f37f80afd20 msgr2=0x7f37f8140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f6ffd700 1 --2- 172.21.15.57:0/1241898884 >> v2:172.21.15.57:3300/0 conn(0x7f37f80afd20 0x7f37f8140e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f6ffd700 1 -- 172.21.15.57:0/1241898884 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f8144640 con 0x7f37f80af0f0 2021-06-25T04:48:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f6ffd700 1 --2- 172.21.15.57:0/1241898884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80af0f0 0x7f37f8067600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f37f00032f0 tx=0x7f37f0009290).ready entity=mon.2 client_cookie=a0ad313f1248bbc server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f67fc700 1 -- 172.21.15.57:0/1241898884 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f000b680 con 0x7f37f80af0f0 2021-06-25T04:48:20.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f67fc700 1 -- 172.21.15.57:0/1241898884 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f000b7e0 con 0x7f37f80af0f0 2021-06-25T04:48:20.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1241898884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80af0f0 msgr2=0x7f37f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37fc8b8700 1 --2- 172.21.15.57:0/1241898884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80af0f0 0x7f37f8067600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f37f00032f0 tx=0x7f37f0009290).stop 2021-06-25T04:48:20.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.007+0000 7f37f67fc700 1 -- 172.21.15.57:0/1241898884 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f000b950 con 0x7f37f80af0f0 2021-06-25T04:48:20.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1241898884 shutdown_connections 2021-06-25T04:48:20.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 --2- 172.21.15.57:0/1241898884 >> v2:172.21.15.57:3300/0 conn(0x7f37f80afd20 0x7f37f8140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 --2- 172.21.15.57:0/1241898884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80af0f0 0x7f37f8067600 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 --2- 172.21.15.57:0/1241898884 >> v2:172.21.15.87:3300/0 conn(0x7f37f80b2810 0x7f37f8067110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1241898884 >> 172.21.15.57:0/1241898884 conn(0x7f37f80611f0 msgr2=0x7f37f8062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:20.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1241898884 shutdown_connections 2021-06-25T04:48:20.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1241898884 wait complete. 2021-06-25T04:48:20.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 Processor -- start 2021-06-25T04:48:20.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 -- start start 2021-06-25T04:48:20.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80af0f0 0x7f37f813d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37f80afd20 0x7f37f80ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80b2810 0x7f37f8159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f8138eb0 con 0x7f37f80af0f0 2021-06-25T04:48:20.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f815a940 con 0x7f37f80afd20 2021-06-25T04:48:20.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f8139430 con 0x7f37f80b2810 2021-06-25T04:48:20.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80af0f0 0x7f37f813d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80af0f0 0x7f37f813d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36558/0 (socket says 172.21.15.57:36558) 2021-06-25T04:48:20.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f77fe700 1 -- 172.21.15.57:0/1766131310 learned_addr learned my addr 172.21.15.57:0/1766131310 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:20.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f6ffd700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37f80afd20 0x7f37f80ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f7fff700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80b2810 0x7f37f8159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f77fe700 1 -- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80b2810 msgr2=0x7f37f8159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f77fe700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80b2810 0x7f37f8159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f77fe700 1 -- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37f80afd20 msgr2=0x7f37f80ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f77fe700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37f80afd20 0x7f37f80ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f77fe700 1 -- 172.21.15.57:0/1766131310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0009530 con 0x7f37f80af0f0 2021-06-25T04:48:20.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f6ffd700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37f80afd20 0x7f37f80ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:20.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f77fe700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80af0f0 0x7f37f813d900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f37f80ac210 tx=0x7f37e0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f4ff9700 1 -- 172.21.15.57:0/1766131310 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37e0010780 con 0x7f37f80af0f0 2021-06-25T04:48:20.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f4ff9700 1 -- 172.21.15.57:0/1766131310 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e00108e0 con 0x7f37f80af0f0 2021-06-25T04:48:20.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1766131310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f8139190 con 0x7f37f80af0f0 2021-06-25T04:48:20.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37f4ff9700 1 -- 172.21.15.57:0/1766131310 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37e0010c40 con 0x7f37f80af0f0 2021-06-25T04:48:20.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.011+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1766131310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f813c6c0 con 0x7f37f80af0f0 2021-06-25T04:48:20.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.015+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1766131310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f8057310 con 0x7f37f80af0f0 2021-06-25T04:48:20.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.015+0000 7f37f4ff9700 1 -- 172.21.15.57:0/1766131310 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f37e001c460 con 0x7f37f80af0f0 2021-06-25T04:48:20.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.015+0000 7f37f4ff9700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37dc0553f0 0x7f37dc0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.015+0000 7f37f4ff9700 1 -- 172.21.15.57:0/1766131310 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f37e006e300 con 0x7f37f80af0f0 2021-06-25T04:48:20.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.015+0000 7f37f6ffd700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37dc0553f0 0x7f37dc0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.015+0000 7f37f6ffd700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37dc0553f0 0x7f37dc0578b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f37f0019000 tx=0x7f37f0017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.019+0000 7f37f4ff9700 1 -- 172.21.15.57:0/1766131310 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f37e00443b0 con 0x7f37f80af0f0 2021-06-25T04:48:20.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.187+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1766131310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37f805f200 con 0x7f37f80af0f0 2021-06-25T04:48:20.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.187+0000 7f37f4ff9700 1 -- 172.21.15.57:0/1766131310 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f37e00479d0 con 0x7f37f80af0f0 2021-06-25T04:48:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:20.197 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3329294132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329294132},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329294132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/1504287390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1504287390},{"type":"v1","addr":"172.21.15.57:6833","nonce":1504287390}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:48:18.873057+0000","modified":"2021-06-25T04:48:19.875996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2421744077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2421744077},{"type":"v1","addr":"172.21.15.57:6835","nonce":2421744077}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-06-25T04:48:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37dc0553f0 msgr2=0x7f37dc0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37dc0553f0 0x7f37dc0578b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f37f0019000 tx=0x7f37f0017000).stop 2021-06-25T04:48:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1766131310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80af0f0 msgr2=0x7f37f813d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80af0f0 0x7f37f813d900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f37f80ac210 tx=0x7f37e0006df0).stop 2021-06-25T04:48:20.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1766131310 shutdown_connections 2021-06-25T04:48:20.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37dc0553f0 0x7f37dc0578b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37f80b2810 0x7f37f8159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37f80afd20 0x7f37f80ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 --2- 172.21.15.57:0/1766131310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f80af0f0 0x7f37f813d900 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1766131310 >> 172.21.15.57:0/1766131310 conn(0x7f37f80611f0 msgr2=0x7f37f8064580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:20.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1766131310 shutdown_connections 2021-06-25T04:48:20.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.191+0000 7f37fc8b8700 1 -- 172.21.15.57:0/1766131310 wait complete. 2021-06-25T04:48:20.203 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 13 2021-06-25T04:48:20.210 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:48:20.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893f1a4700 1 Processor -- start 2021-06-25T04:48:20.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893f1a4700 1 -- start start 2021-06-25T04:48:20.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893f1a4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89380b5460 0x7f89380af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893f1a4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f89380b05d0 0x7f8938147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893f1a4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8938067560 0x7f89380acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893f1a4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89381452a0 con 0x7f8938067560 2021-06-25T04:48:20.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893f1a4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89380adfb0 con 0x7f89380b05d0 2021-06-25T04:48:20.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893f1a4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89380b5840 con 0x7f89380b5460 2021-06-25T04:48:20.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893e9a3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8938067560 0x7f89380acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893e9a3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8938067560 0x7f89380acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36568/0 (socket says 172.21.15.57:36568) 2021-06-25T04:48:20.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893e9a3700 1 -- 172.21.15.57:0/3319365877 learned_addr learned my addr 172.21.15.57:0/3319365877 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:20.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893d9a1700 1 --2- 172.21.15.57:0/3319365877 >> v2:172.21.15.87:3300/0 conn(0x7f89380b05d0 0x7f8938147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.307+0000 7f893e1a2700 1 --2- 172.21.15.57:0/3319365877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89380b5460 0x7f89380af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893e9a3700 1 -- 172.21.15.57:0/3319365877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89380b5460 msgr2=0x7f89380af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:20.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893e9a3700 1 --2- 172.21.15.57:0/3319365877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89380b5460 0x7f89380af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893e9a3700 1 -- 172.21.15.57:0/3319365877 >> v2:172.21.15.87:3300/0 conn(0x7f89380b05d0 msgr2=0x7f8938147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:20.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893e9a3700 1 --2- 172.21.15.57:0/3319365877 >> v2:172.21.15.87:3300/0 conn(0x7f89380b05d0 0x7f8938147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893e9a3700 1 -- 172.21.15.57:0/3319365877 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89380ac7c0 con 0x7f8938067560 2021-06-25T04:48:20.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893e9a3700 1 --2- 172.21.15.57:0/3319365877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8938067560 0x7f89380acc20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f89300032f0 tx=0x7f8930009290).ready entity=mon.0 client_cookie=8fff9c556ce55077 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893d1a0700 1 -- 172.21.15.57:0/3319365877 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893000b680 con 0x7f8938067560 2021-06-25T04:48:20.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893d1a0700 1 -- 172.21.15.57:0/3319365877 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893000b7e0 con 0x7f8938067560 2021-06-25T04:48:20.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893d1a0700 1 -- 172.21.15.57:0/3319365877 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893000b950 con 0x7f8938067560 2021-06-25T04:48:20.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 -- 172.21.15.57:0/3319365877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8938067560 msgr2=0x7f89380acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 --2- 172.21.15.57:0/3319365877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8938067560 0x7f89380acc20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f89300032f0 tx=0x7f8930009290).stop 2021-06-25T04:48:20.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 -- 172.21.15.57:0/3319365877 shutdown_connections 2021-06-25T04:48:20.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 --2- 172.21.15.57:0/3319365877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8938067560 0x7f89380acc20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 --2- 172.21.15.57:0/3319365877 >> v2:172.21.15.87:3300/0 conn(0x7f89380b05d0 0x7f8938147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 --2- 172.21.15.57:0/3319365877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89380b5460 0x7f89380af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 -- 172.21.15.57:0/3319365877 >> 172.21.15.57:0/3319365877 conn(0x7f8938062520 msgr2=0x7f8938062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:20.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 -- 172.21.15.57:0/3319365877 shutdown_connections 2021-06-25T04:48:20.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 -- 172.21.15.57:0/3319365877 wait complete. 2021-06-25T04:48:20.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 Processor -- start 2021-06-25T04:48:20.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 -- start start 2021-06-25T04:48:20.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8938067560 0x7f8938148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89380b05d0 0x7f89380a8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89380b5460 0x7f8938156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893815ab60 con 0x7f89380b05d0 2021-06-25T04:48:20.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893815a650 con 0x7f89380b5460 2021-06-25T04:48:20.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893f1a4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893815a8c0 con 0x7f8938067560 2021-06-25T04:48:20.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.311+0000 7f893d9a1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89380b05d0 0x7f89380a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893e1a2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8938067560 0x7f8938148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893e1a2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8938067560 0x7f8938148c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:47734/0 (socket says 172.21.15.57:47734) 2021-06-25T04:48:20.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893e1a2700 1 -- 172.21.15.57:0/2996404396 learned_addr learned my addr 172.21.15.57:0/2996404396 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:20.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893d9a1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89380b05d0 0x7f89380a8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36572/0 (socket says 172.21.15.57:36572) 2021-06-25T04:48:20.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893e9a3700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89380b5460 0x7f8938156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893d9a1700 1 -- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8938067560 msgr2=0x7f8938148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893d9a1700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8938067560 0x7f8938148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893d9a1700 1 -- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89380b5460 msgr2=0x7f8938156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893d9a1700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89380b5460 0x7f8938156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893d9a1700 1 -- 172.21.15.57:0/2996404396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8930009530 con 0x7f89380b05d0 2021-06-25T04:48:20.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893e1a2700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8938067560 0x7f8938148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:20.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893d9a1700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89380b05d0 0x7f89380a8010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f893400c000 tx=0x7f8934006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f89277fe700 1 -- 172.21.15.57:0/2996404396 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8934011750 con 0x7f89380b05d0 2021-06-25T04:48:20.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f89277fe700 1 -- 172.21.15.57:0/2996404396 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89340118b0 con 0x7f89380b05d0 2021-06-25T04:48:20.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893f1a4700 1 -- 172.21.15.57:0/2996404396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89380a7b70 con 0x7f89380b05d0 2021-06-25T04:48:20.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f89277fe700 1 -- 172.21.15.57:0/2996404396 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8934011c10 con 0x7f89380b05d0 2021-06-25T04:48:20.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893f1a4700 1 -- 172.21.15.57:0/2996404396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8938156c00 con 0x7f89380b05d0 2021-06-25T04:48:20.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f893f1a4700 1 -- 172.21.15.57:0/2996404396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89380a7d00 con 0x7f89380b05d0 2021-06-25T04:48:20.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.315+0000 7f89277fe700 1 -- 172.21.15.57:0/2996404396 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8934011d70 con 0x7f89380b05d0 2021-06-25T04:48:20.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.319+0000 7f89277fe700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89180554e0 0x7f89180579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.319+0000 7f89277fe700 1 -- 172.21.15.57:0/2996404396 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f893406de20 con 0x7f89380b05d0 2021-06-25T04:48:20.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.319+0000 7f893e1a2700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89180554e0 0x7f89180579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.319+0000 7f893e1a2700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89180554e0 0x7f89180579a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f892800b000 tx=0x7f8928006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.323+0000 7f89277fe700 1 -- 172.21.15.57:0/2996404396 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8934047e60 con 0x7f89380b05d0 2021-06-25T04:48:20.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.447+0000 7f893f1a4700 1 -- 172.21.15.57:0/2996404396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f893805f200 con 0x7f89380b05d0 2021-06-25T04:48:20.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f89277fe700 1 -- 172.21.15.57:0/2996404396 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f8934043f70 con 0x7f89380b05d0 2021-06-25T04:48:20.458 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:20.458 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":35,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:48:19.876788+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:48:17.192457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-06-25T04:48:17.888021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:48:20.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 -- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89180554e0 msgr2=0x7f89180579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89180554e0 0x7f89180579a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f892800b000 tx=0x7f8928006df0).stop 2021-06-25T04:48:20.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 -- 172.21.15.57:0/2996404396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89380b05d0 msgr2=0x7f89380a8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89380b05d0 0x7f89380a8010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f893400c000 tx=0x7f8934006df0).stop 2021-06-25T04:48:20.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 -- 172.21.15.57:0/2996404396 shutdown_connections 2021-06-25T04:48:20.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89180554e0 0x7f89180579a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89380b5460 0x7f8938156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89380b05d0 0x7f89380a8010 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 --2- 172.21.15.57:0/2996404396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8938067560 0x7f8938148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 -- 172.21.15.57:0/2996404396 >> 172.21.15.57:0/2996404396 conn(0x7f8938062520 msgr2=0x7f89380af280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:20.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 -- 172.21.15.57:0/2996404396 shutdown_connections 2021-06-25T04:48:20.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.451+0000 7f893f1a4700 1 -- 172.21.15.57:0/2996404396 wait complete. 2021-06-25T04:48:20.471 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:48:20.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.575+0000 7ff56decc700 1 Processor -- start 2021-06-25T04:48:20.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.575+0000 7ff56decc700 1 -- start start 2021-06-25T04:48:20.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5680612e0 0x7ff5680616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff5680ad580 0x7ff5680b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5680aecb0 con 0x7ff568140400 2021-06-25T04:48:20.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5680b6ee0 con 0x7ff5680ad580 2021-06-25T04:48:20.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680aeee0 con 0x7ff5680612e0 2021-06-25T04:48:20.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56d6cb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff568140400 0x7ff5681464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53798/0 (socket says 172.21.15.57:53798) 2021-06-25T04:48:20.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56d6cb700 1 -- 172.21.15.57:0/4104156185 learned_addr learned my addr 172.21.15.57:0/4104156185 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:20.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff567fff700 1 --2- 172.21.15.57:0/4104156185 >> v2:172.21.15.87:3300/0 conn(0x7ff5680ad580 0x7ff5680b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56ceca700 1 --2- 172.21.15.57:0/4104156185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5680612e0 0x7ff5680616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff5677fe700 1 -- 172.21.15.57:0/4104156185 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319800242 0 0) 0x7ff5680aecb0 con 0x7ff568140400 2021-06-25T04:48:20.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff5677fe700 1 -- 172.21.15.57:0/4104156185 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff554003260 con 0x7ff568140400 2021-06-25T04:48:20.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff567fff700 1 -- 172.21.15.57:0/4104156185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5680612e0 msgr2=0x7ff5680616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:20.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff567fff700 1 --2- 172.21.15.57:0/4104156185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5680612e0 0x7ff5680616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff567fff700 1 -- 172.21.15.57:0/4104156185 >> v1:172.21.15.57:6789/0 conn(0x7ff568140400 legacy=0x7ff5681464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff5677fe700 1 -- 172.21.15.57:0/4104156185 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2258483566 0 0) 0x7ff554003260 con 0x7ff568140400 2021-06-25T04:48:20.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff567fff700 1 -- 172.21.15.57:0/4104156185 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680af180 con 0x7ff5680ad580 2021-06-25T04:48:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56ceca700 1 --2- 172.21.15.57:0/4104156185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5680612e0 0x7ff5680616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff567fff700 1 --2- 172.21.15.57:0/4104156185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5680ad580 0x7ff5680b9e20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7ff560001b80 tx=0x7ff55c006df0).ready entity=mon.1 client_cookie=1a78632a418bc697 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff5677fe700 1 -- 172.21.15.57:0/4104156185 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5600019e0 con 0x7ff5680ad580 2021-06-25T04:48:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff5677fe700 1 -- 172.21.15.57:0/4104156185 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c000e90 con 0x7ff5680ad580 2021-06-25T04:48:20.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 -- 172.21.15.57:0/4104156185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5680ad580 msgr2=0x7ff5680b9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff5677fe700 1 -- 172.21.15.57:0/4104156185 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff55c012460 con 0x7ff5680ad580 2021-06-25T04:48:20.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 --2- 172.21.15.57:0/4104156185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5680ad580 0x7ff5680b9e20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7ff560001b80 tx=0x7ff55c006df0).stop 2021-06-25T04:48:20.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 -- 172.21.15.57:0/4104156185 shutdown_connections 2021-06-25T04:48:20.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 --2- 172.21.15.57:0/4104156185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5680ad580 0x7ff5680b9e20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 --2- 172.21.15.57:0/4104156185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5680612e0 0x7ff5680616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 -- 172.21.15.57:0/4104156185 >> 172.21.15.57:0/4104156185 conn(0x7ff568066da0 msgr2=0x7ff568067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:20.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 -- 172.21.15.57:0/4104156185 shutdown_connections 2021-06-25T04:48:20.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.579+0000 7ff56decc700 1 -- 172.21.15.57:0/4104156185 wait complete. 2021-06-25T04:48:20.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56decc700 1 Processor -- start 2021-06-25T04:48:20.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56decc700 1 -- start start 2021-06-25T04:48:20.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56decc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5680612e0 0x7ff5680ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56decc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5680ad580 0x7ff5681452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56decc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff568140400 0x7ff568145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56decc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680b27d0 con 0x7ff568140400 2021-06-25T04:48:20.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56decc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff568140a70 con 0x7ff5680ad580 2021-06-25T04:48:20.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56decc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff568151ed0 con 0x7ff5680612e0 2021-06-25T04:48:20.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56d6cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff568140400 0x7ff568145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56d6cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff568140400 0x7ff568145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36588/0 (socket says 172.21.15.57:36588) 2021-06-25T04:48:20.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56d6cb700 1 -- 172.21.15.57:0/989605186 learned_addr learned my addr 172.21.15.57:0/989605186 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:20.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56ceca700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5680612e0 0x7ff5680ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff567fff700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5680ad580 0x7ff5681452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56d6cb700 1 -- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5680612e0 msgr2=0x7ff5680ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56d6cb700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5680612e0 0x7ff5680ac3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56d6cb700 1 -- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5680ad580 msgr2=0x7ff5681452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56d6cb700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5680ad580 0x7ff5681452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56d6cb700 1 -- 172.21.15.57:0/989605186 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55800b180 con 0x7ff568140400 2021-06-25T04:48:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.583+0000 7ff56d6cb700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff568140400 0x7ff568145790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7ff560001c40 tx=0x7ff560002160).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.587+0000 7ff565ffb700 1 -- 172.21.15.57:0/989605186 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff560004ab0 con 0x7ff568140400 2021-06-25T04:48:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.587+0000 7ff565ffb700 1 -- 172.21.15.57:0/989605186 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff560004c10 con 0x7ff568140400 2021-06-25T04:48:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.587+0000 7ff56decc700 1 -- 172.21.15.57:0/989605186 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c00b180 con 0x7ff568140400 2021-06-25T04:48:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.587+0000 7ff565ffb700 1 -- 172.21.15.57:0/989605186 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff560007170 con 0x7ff568140400 2021-06-25T04:48:20.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.587+0000 7ff56decc700 1 -- 172.21.15.57:0/989605186 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff568152360 con 0x7ff568140400 2021-06-25T04:48:20.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.587+0000 7ff565ffb700 1 -- 172.21.15.57:0/989605186 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff56001b070 con 0x7ff568140400 2021-06-25T04:48:20.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.587+0000 7ff565ffb700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff5480553d0 0x7ff548057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.587+0000 7ff565ffb700 1 -- 172.21.15.57:0/989605186 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff56006d780 con 0x7ff568140400 2021-06-25T04:48:20.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.587+0000 7ff56ceca700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff5480553d0 0x7ff548057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.587+0000 7ff56decc700 1 -- 172.21.15.57:0/989605186 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff568152a40 con 0x7ff568140400 2021-06-25T04:48:20.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.587+0000 7ff56ceca700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff5480553d0 0x7ff548057890 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff55800b000 tx=0x7ff558006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.595+0000 7ff565ffb700 1 -- 172.21.15.57:0/989605186 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff560043930 con 0x7ff568140400 2021-06-25T04:48:20.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.767+0000 7ff56decc700 1 -- 172.21.15.57:0/989605186 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff5680620c0 con 0x7ff568140400 2021-06-25T04:48:20.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff565ffb700 1 -- 172.21.15.57:0/989605186 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff5600015b0 con 0x7ff568140400 2021-06-25T04:48:20.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 -- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff5480553d0 msgr2=0x7ff548057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff5480553d0 0x7ff548057890 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff55800b000 tx=0x7ff558006df0).stop 2021-06-25T04:48:20.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 -- 172.21.15.57:0/989605186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff568140400 msgr2=0x7ff568145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff568140400 0x7ff568145790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7ff560001c40 tx=0x7ff560002160).stop 2021-06-25T04:48:20.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 -- 172.21.15.57:0/989605186 shutdown_connections 2021-06-25T04:48:20.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff5480553d0 0x7ff548057890 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff568140400 0x7ff568145790 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5680ad580 0x7ff5681452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 --2- 172.21.15.57:0/989605186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5680612e0 0x7ff5680ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 -- 172.21.15.57:0/989605186 >> 172.21.15.57:0/989605186 conn(0x7ff568066da0 msgr2=0x7ff5680b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:20.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 -- 172.21.15.57:0/989605186 shutdown_connections 2021-06-25T04:48:20.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.775+0000 7ff56decc700 1 -- 172.21.15.57:0/989605186 wait complete. 2021-06-25T04:48:20.787 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:48:20.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:48:20.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c79dc700 1 Processor -- start 2021-06-25T04:48:20.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c79dc700 1 -- start start 2021-06-25T04:48:20.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c79dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0c00aa0e0 0x7ff0c00ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c79dc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c00b2ab0 con 0x7ff0c00b0840 2021-06-25T04:48:20.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c79dc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c00b2730 con 0x7ff0c00b0460 2021-06-25T04:48:20.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c79dc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c00b2ce0 con 0x7ff0c00aa0e0 2021-06-25T04:48:20.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c4f77700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0c00aa0e0 0x7ff0c00ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c4f77700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0c00aa0e0 0x7ff0c00ae400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36594/0 (socket says 172.21.15.57:36594) 2021-06-25T04:48:20.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c4f77700 1 -- 172.21.15.57:0/154232571 learned_addr learned my addr 172.21.15.57:0/154232571 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:20.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c4f77700 1 -- 172.21.15.57:0/154232571 >> v1:172.21.15.87:6789/0 conn(0x7ff0c00b0460 legacy=0x7ff0c00adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c4f77700 1 -- 172.21.15.57:0/154232571 >> v1:172.21.15.57:6789/0 conn(0x7ff0c00b0840 legacy=0x7ff0c0140560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c4f77700 1 -- 172.21.15.57:0/154232571 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00a9b30 con 0x7ff0c00aa0e0 2021-06-25T04:48:20.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c4f77700 1 --2- 172.21.15.57:0/154232571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0c00aa0e0 0x7ff0c00ae400 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7ff0bc002f70 tx=0x7ff0bc006f40).ready entity=mon.0 client_cookie=2731622f19851a16 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0b3fff700 1 -- 172.21.15.57:0/154232571 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0bc00dc70 con 0x7ff0c00aa0e0 2021-06-25T04:48:20.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0b3fff700 1 -- 172.21.15.57:0/154232571 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc000e90 con 0x7ff0c00aa0e0 2021-06-25T04:48:20.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0b3fff700 1 -- 172.21.15.57:0/154232571 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0bc00be90 con 0x7ff0c00aa0e0 2021-06-25T04:48:20.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c79dc700 1 -- 172.21.15.57:0/154232571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0c00aa0e0 msgr2=0x7ff0c00ae400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.907+0000 7ff0c79dc700 1 --2- 172.21.15.57:0/154232571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0c00aa0e0 0x7ff0c00ae400 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7ff0bc002f70 tx=0x7ff0bc006f40).stop 2021-06-25T04:48:20.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 -- 172.21.15.57:0/154232571 shutdown_connections 2021-06-25T04:48:20.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 --2- 172.21.15.57:0/154232571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0c00aa0e0 0x7ff0c00ae400 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 -- 172.21.15.57:0/154232571 >> 172.21.15.57:0/154232571 conn(0x7ff0c0060780 msgr2=0x7ff0c0060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:20.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 -- 172.21.15.57:0/154232571 shutdown_connections 2021-06-25T04:48:20.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 -- 172.21.15.57:0/154232571 wait complete. 2021-06-25T04:48:20.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 Processor -- start 2021-06-25T04:48:20.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 -- start start 2021-06-25T04:48:20.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0c00aa0e0 0x7ff0c0140190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0c00b0460 0x7ff0c0152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0c00b0840 0x7ff0c0066f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0067440 con 0x7ff0c00b0460 2021-06-25T04:48:20.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00676d0 con 0x7ff0c00b0840 2021-06-25T04:48:20.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c79dc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0151760 con 0x7ff0c00aa0e0 2021-06-25T04:48:20.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c4f77700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0c00b0460 0x7ff0c0152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c4f77700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0c00b0460 0x7ff0c0152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36600/0 (socket says 172.21.15.57:36600) 2021-06-25T04:48:20.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c4f77700 1 -- 172.21.15.57:0/3753410610 learned_addr learned my addr 172.21.15.57:0/3753410610 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:20.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c5778700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0c00aa0e0 0x7ff0c0140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.911+0000 7ff0c5f79700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0c00b0840 0x7ff0c0066f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c4f77700 1 -- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0c00aa0e0 msgr2=0x7ff0c0140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c4f77700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0c00aa0e0 0x7ff0c0140190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c4f77700 1 -- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0c00b0840 msgr2=0x7ff0c0066f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:20.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c4f77700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0c00b0840 0x7ff0c0066f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:20.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c4f77700 1 -- 172.21.15.57:0/3753410610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc00b460 con 0x7ff0c00b0460 2021-06-25T04:48:20.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c5778700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0c00aa0e0 0x7ff0c0140190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:20.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c5f79700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0c00b0840 0x7ff0c0066f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:20.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c4f77700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0c00b0460 0x7ff0c0152140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7ff0bc002f70 tx=0x7ff0bc006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0b27fc700 1 -- 172.21.15.57:0/3753410610 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0bc023630 con 0x7ff0c00b0460 2021-06-25T04:48:20.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0b27fc700 1 -- 172.21.15.57:0/3753410610 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc01e040 con 0x7ff0c00b0460 2021-06-25T04:48:20.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c79dc700 1 -- 172.21.15.57:0/3753410610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c0151a00 con 0x7ff0c00b0460 2021-06-25T04:48:20.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0b27fc700 1 -- 172.21.15.57:0/3753410610 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0bc023980 con 0x7ff0c00b0460 2021-06-25T04:48:20.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c79dc700 1 -- 172.21.15.57:0/3753410610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c0064540 con 0x7ff0c00b0460 2021-06-25T04:48:20.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c79dc700 1 -- 172.21.15.57:0/3753410610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c0057310 con 0x7ff0c00b0460 2021-06-25T04:48:20.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0b27fc700 1 -- 172.21.15.57:0/3753410610 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff0bc029020 con 0x7ff0c00b0460 2021-06-25T04:48:20.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0b27fc700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0a8055450 0x7ff0a8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:20.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0b27fc700 1 -- 172.21.15.57:0/3753410610 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff0bc071910 con 0x7ff0c00b0460 2021-06-25T04:48:20.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.915+0000 7ff0c5778700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0a8055450 0x7ff0a8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:20.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.919+0000 7ff0c5778700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0a8055450 0x7ff0a8057910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff0b400b000 tx=0x7ff0b4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:20.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:20.923+0000 7ff0b27fc700 1 -- 172.21.15.57:0/3753410610 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff0bc047ac0 con 0x7ff0c00b0460 2021-06-25T04:48:21.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.091+0000 7ff0c79dc700 1 -- 172.21.15.57:0/3753410610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff0c0044610 con 0x7ff0c00b0460 2021-06-25T04:48:21.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.099+0000 7ff0b27fc700 1 -- 172.21.15.57:0/3753410610 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff0bc04b0e0 con 0x7ff0c00b0460 2021-06-25T04:48:21.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 -- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0a8055450 msgr2=0x7ff0a8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:21.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0a8055450 0x7ff0a8057910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff0b400b000 tx=0x7ff0b4009040).stop 2021-06-25T04:48:21.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 -- 172.21.15.57:0/3753410610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0c00b0460 msgr2=0x7ff0c0152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:21.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0c00b0460 0x7ff0c0152140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7ff0bc002f70 tx=0x7ff0bc006f40).stop 2021-06-25T04:48:21.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 -- 172.21.15.57:0/3753410610 shutdown_connections 2021-06-25T04:48:21.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0a8055450 0x7ff0a8057910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0c00b0840 0x7ff0c0066f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0c00b0460 0x7ff0c0152140 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 --2- 172.21.15.57:0/3753410610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0c00aa0e0 0x7ff0c0140190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 -- 172.21.15.57:0/3753410610 >> 172.21.15.57:0/3753410610 conn(0x7ff0c0060780 msgr2=0x7ff0c005ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:21.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 -- 172.21.15.57:0/3753410610 shutdown_connections 2021-06-25T04:48:21.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.103+0000 7ff0c79dc700 1 -- 172.21.15.57:0/3753410610 wait complete. 2021-06-25T04:48:21.117 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:48:21.123 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:48:21.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0359e700 1 Processor -- start 2021-06-25T04:48:21.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0359e700 1 -- start start 2021-06-25T04:48:21.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1b040b2810 0x7f1b040b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b040acee0 0x7f1b040ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b040b2bf0 con 0x7f1b0413c6a0 2021-06-25T04:48:21.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0413d1f0 con 0x7f1b040acee0 2021-06-25T04:48:21.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b040b1620 con 0x7f1b040b2810 2021-06-25T04:48:21.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b02d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b040acee0 0x7f1b040ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b01d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1b0413c6a0 0x7f1b0413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53826/0 (socket says 172.21.15.57:53826) 2021-06-25T04:48:21.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b01d9b700 1 -- 172.21.15.57:0/1851283694 learned_addr learned my addr 172.21.15.57:0/1851283694 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:21.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0259c700 1 --2- 172.21.15.57:0/1851283694 >> v2:172.21.15.87:3300/0 conn(0x7f1b040b2810 0x7f1b040b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0159a700 1 -- 172.21.15.57:0/1851283694 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965165179 0 0) 0x7f1b040b2bf0 con 0x7f1b0413c6a0 2021-06-25T04:48:21.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0159a700 1 -- 172.21.15.57:0/1851283694 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae8003260 con 0x7f1b0413c6a0 2021-06-25T04:48:21.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b02d9d700 1 -- 172.21.15.57:0/1851283694 >> v2:172.21.15.87:3300/0 conn(0x7f1b040b2810 msgr2=0x7f1b040b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:21.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b02d9d700 1 --2- 172.21.15.57:0/1851283694 >> v2:172.21.15.87:3300/0 conn(0x7f1b040b2810 0x7f1b040b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b02d9d700 1 -- 172.21.15.57:0/1851283694 >> v1:172.21.15.57:6789/0 conn(0x7f1b0413c6a0 legacy=0x7f1b0413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:21.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b02d9d700 1 -- 172.21.15.57:0/1851283694 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b040b18c0 con 0x7f1b040acee0 2021-06-25T04:48:21.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b02d9d700 1 --2- 172.21.15.57:0/1851283694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b040acee0 0x7f1b040ad300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f1afc0032f0 tx=0x7f1afc0091d0).ready entity=mon.0 client_cookie=4b80dfeac5d70d54 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:21.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0159a700 1 -- 172.21.15.57:0/1851283694 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1afc00b600 con 0x7f1b040acee0 2021-06-25T04:48:21.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0159a700 1 -- 172.21.15.57:0/1851283694 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc00b760 con 0x7f1b040acee0 2021-06-25T04:48:21.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0159a700 1 -- 172.21.15.57:0/1851283694 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1afc00b8d0 con 0x7f1b040acee0 2021-06-25T04:48:21.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.223+0000 7f1b0359e700 1 -- 172.21.15.57:0/1851283694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b040acee0 msgr2=0x7f1b040ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:21.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.227+0000 7f1b0359e700 1 --2- 172.21.15.57:0/1851283694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b040acee0 0x7f1b040ad300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f1afc0032f0 tx=0x7f1afc0091d0).stop 2021-06-25T04:48:21.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.227+0000 7f1b0359e700 1 -- 172.21.15.57:0/1851283694 shutdown_connections 2021-06-25T04:48:21.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.227+0000 7f1b0359e700 1 --2- 172.21.15.57:0/1851283694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b040acee0 0x7f1b040ad300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.227+0000 7f1b0359e700 1 --2- 172.21.15.57:0/1851283694 >> v2:172.21.15.87:3300/0 conn(0x7f1b040b2810 0x7f1b040b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.227+0000 7f1b0359e700 1 -- 172.21.15.57:0/1851283694 >> 172.21.15.57:0/1851283694 conn(0x7f1b040611f0 msgr2=0x7f1b04062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:21.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.227+0000 7f1b0359e700 1 -- 172.21.15.57:0/1851283694 shutdown_connections 2021-06-25T04:48:21.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.227+0000 7f1b0359e700 1 -- 172.21.15.57:0/1851283694 wait complete. 2021-06-25T04:48:21.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.227+0000 7f1b0359e700 1 Processor -- start 2021-06-25T04:48:21.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.227+0000 7f1b0359e700 1 -- start start 2021-06-25T04:48:21.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b0359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b040acee0 0x7f1b04140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b0359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b040b2810 0x7f1b04151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b0359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b0413c6a0 0x7f1b0413df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b0359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b04141ed0 con 0x7f1b040b2810 2021-06-25T04:48:21.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b0359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b040b51c0 con 0x7f1b0413c6a0 2021-06-25T04:48:21.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b0359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b04151fb0 con 0x7f1b040acee0 2021-06-25T04:48:21.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b01d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b040b2810 0x7f1b04151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b01d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b040b2810 0x7f1b04151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36614/0 (socket says 172.21.15.57:36614) 2021-06-25T04:48:21.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b01d9b700 1 -- 172.21.15.57:0/3844090327 learned_addr learned my addr 172.21.15.57:0/3844090327 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:21.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b02d9d700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b0413c6a0 0x7f1b0413df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b0259c700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b040acee0 0x7f1b04140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b02d9d700 1 -- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b040acee0 msgr2=0x7f1b04140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:21.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b02d9d700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b040acee0 0x7f1b04140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b02d9d700 1 -- 172.21.15.57:0/3844090327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b040b2810 msgr2=0x7f1b04151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:21.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b02d9d700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b040b2810 0x7f1b04151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b02d9d700 1 -- 172.21.15.57:0/3844090327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc009470 con 0x7f1b0413c6a0 2021-06-25T04:48:21.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b01d9b700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b040b2810 0x7f1b04151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:21.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b02d9d700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b0413c6a0 0x7f1b0413df90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1afc0032f0 tx=0x7f1afc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:21.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1af37fe700 1 -- 172.21.15.57:0/3844090327 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1afc011bf0 con 0x7f1b0413c6a0 2021-06-25T04:48:21.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1af37fe700 1 -- 172.21.15.57:0/3844090327 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc011d50 con 0x7f1b0413c6a0 2021-06-25T04:48:21.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b0359e700 1 -- 172.21.15.57:0/3844090327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b04152240 con 0x7f1b0413c6a0 2021-06-25T04:48:21.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1af37fe700 1 -- 172.21.15.57:0/3844090327 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1afc01e5f0 con 0x7f1b0413c6a0 2021-06-25T04:48:21.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.231+0000 7f1b0359e700 1 -- 172.21.15.57:0/3844090327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b04152780 con 0x7f1b0413c6a0 2021-06-25T04:48:21.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.235+0000 7f1b0359e700 1 -- 172.21.15.57:0/3844090327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b04142040 con 0x7f1b0413c6a0 2021-06-25T04:48:21.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.235+0000 7f1af37fe700 1 -- 172.21.15.57:0/3844090327 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1afc026030 con 0x7f1b0413c6a0 2021-06-25T04:48:21.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.235+0000 7f1af37fe700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ae00553d0 0x7f1ae0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.235+0000 7f1af37fe700 1 -- 172.21.15.57:0/3844090327 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1afc070700 con 0x7f1b0413c6a0 2021-06-25T04:48:21.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.235+0000 7f1b0259c700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ae00553d0 0x7f1ae0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.235+0000 7f1b0259c700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ae00553d0 0x7f1ae0057890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f1af400b000 tx=0x7f1af4006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:21.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.243+0000 7f1af37fe700 1 -- 172.21.15.57:0/3844090327 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1afc0467a0 con 0x7f1b0413c6a0 2021-06-25T04:48:21.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 -- 172.21.15.57:0/3844090327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b04057310 con 0x7f1b0413c6a0 2021-06-25T04:48:21.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1af37fe700 1 -- 172.21.15.57:0/3844090327 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f1afc024020 con 0x7f1b0413c6a0 2021-06-25T04:48:21.414 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:21.415 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3329294132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329294132},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329294132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/1504287390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1504287390},{"type":"v1","addr":"172.21.15.57:6833","nonce":1504287390}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:48:18.873057+0000","modified":"2021-06-25T04:48:19.875996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2421744077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2421744077},{"type":"v1","addr":"172.21.15.57:6835","nonce":2421744077}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-06-25T04:48:21.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 -- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ae00553d0 msgr2=0x7f1ae0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:21.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ae00553d0 0x7f1ae0057890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f1af400b000 tx=0x7f1af4006df0).stop 2021-06-25T04:48:21.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 -- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b0413c6a0 msgr2=0x7f1b0413df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:21.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b0413c6a0 0x7f1b0413df90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1afc0032f0 tx=0x7f1afc016000).stop 2021-06-25T04:48:21.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 -- 172.21.15.57:0/3844090327 shutdown_connections 2021-06-25T04:48:21.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ae00553d0 0x7f1ae0057890 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b0413c6a0 0x7f1b0413df90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b040b2810 0x7f1b04151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 --2- 172.21.15.57:0/3844090327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b040acee0 0x7f1b04140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 -- 172.21.15.57:0/3844090327 >> 172.21.15.57:0/3844090327 conn(0x7f1b040611f0 msgr2=0x7f1b04138bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:21.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 -- 172.21.15.57:0/3844090327 shutdown_connections 2021-06-25T04:48:21.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.407+0000 7f1b0359e700 1 -- 172.21.15.57:0/3844090327 wait complete. 2021-06-25T04:48:21.420 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 13 2021-06-25T04:48:21.730 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:48:18.873057+0000', 'modified': '2021-06-25T04:48:19.875996+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4926}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4926': {'gid': 4926, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2421744077', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2421744077}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2421744077}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:48:21.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:48:21.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:48:21.846 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":4926,"want_state":"up:active","state":"up:active","rank_uptime":2.957642533,"mdsmap_epoch":13,"osdmap_epoch":35,"osdmap_epoch_barrier":34,"uptime":9.3377723659999994} 2021-06-25T04:48:21.847 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 4926, "mdsmap_epoch": 13, "osdmap_epoch": 35, "osdmap_epoch_barrier": 34, "rank_uptime": 2.957642533, "state": "up:active", "uptime": 9.337772366, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:48:21.848 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:48:21.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40af903700 1 Processor -- start 2021-06-25T04:48:21.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40af903700 1 -- start start 2021-06-25T04:48:21.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40af903700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40a80a7670 0x7f40a8066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40af903700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40a80b1930 0x7f40a8066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40af903700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f40a80b0020 0x7f40a805f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40af903700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a8067410 con 0x7f40a80b1930 2021-06-25T04:48:21.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40af903700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a80a7a50 con 0x7f40a80b0020 2021-06-25T04:48:21.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40af903700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81475e0 con 0x7f40a80a7670 2021-06-25T04:48:21.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40ace9e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40a80b1930 0x7f40a8066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40ace9e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40a80b1930 0x7f40a8066f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36620/0 (socket says 172.21.15.57:36620) 2021-06-25T04:48:21.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40ace9e700 1 -- 172.21.15.57:0/3252193291 learned_addr learned my addr 172.21.15.57:0/3252193291 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:21.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40ad69f700 1 --2- 172.21.15.57:0/3252193291 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40a80a7670 0x7f40a8066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40adea0700 1 --2- 172.21.15.57:0/3252193291 >> v2:172.21.15.87:3300/0 conn(0x7f40a80b0020 0x7f40a805f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40ace9e700 1 -- 172.21.15.57:0/3252193291 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40a80a7670 msgr2=0x7f40a8066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:21.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40ace9e700 1 --2- 172.21.15.57:0/3252193291 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40a80a7670 0x7f40a8066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40ace9e700 1 -- 172.21.15.57:0/3252193291 >> v2:172.21.15.87:3300/0 conn(0x7f40a80b0020 msgr2=0x7f40a805f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40ace9e700 1 --2- 172.21.15.57:0/3252193291 >> v2:172.21.15.87:3300/0 conn(0x7f40a80b0020 0x7f40a805f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40ace9e700 1 -- 172.21.15.57:0/3252193291 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a8147880 con 0x7f40a80b1930 2021-06-25T04:48:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40ace9e700 1 --2- 172.21.15.57:0/3252193291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80b1930 0x7f40a8066f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f40a4002f70 tx=0x7f40a4006eb0).ready entity=mon.0 client_cookie=f664483e09f86acb server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:21.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f409ffff700 1 -- 172.21.15.57:0/3252193291 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40a400d570 con 0x7f40a80b1930 2021-06-25T04:48:21.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f409ffff700 1 -- 172.21.15.57:0/3252193291 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a4000e90 con 0x7f40a80b1930 2021-06-25T04:48:21.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f409ffff700 1 -- 172.21.15.57:0/3252193291 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40a400d900 con 0x7f40a80b1930 2021-06-25T04:48:21.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40af903700 1 -- 172.21.15.57:0/3252193291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80b1930 msgr2=0x7f40a8066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:21.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.943+0000 7f40af903700 1 --2- 172.21.15.57:0/3252193291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80b1930 0x7f40a8066f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f40a4002f70 tx=0x7f40a4006eb0).stop 2021-06-25T04:48:21.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.947+0000 7f40af903700 1 -- 172.21.15.57:0/3252193291 shutdown_connections 2021-06-25T04:48:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.947+0000 7f40af903700 1 --2- 172.21.15.57:0/3252193291 >> v2:172.21.15.87:3300/0 conn(0x7f40a80b0020 0x7f40a805f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.947+0000 7f40af903700 1 --2- 172.21.15.57:0/3252193291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80b1930 0x7f40a8066f20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.947+0000 7f40af903700 1 --2- 172.21.15.57:0/3252193291 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40a80a7670 0x7f40a8066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.947+0000 7f40af903700 1 -- 172.21.15.57:0/3252193291 >> 172.21.15.57:0/3252193291 conn(0x7f40a80b53a0 msgr2=0x7f40a80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:21.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.947+0000 7f40af903700 1 -- 172.21.15.57:0/3252193291 shutdown_connections 2021-06-25T04:48:21.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.947+0000 7f40af903700 1 -- 172.21.15.57:0/3252193291 wait complete. 2021-06-25T04:48:21.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.947+0000 7f40af903700 1 Processor -- start 2021-06-25T04:48:21.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.947+0000 7f40af903700 1 -- start start 2021-06-25T04:48:21.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40af903700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40a80a7670 0x7f40a80aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40af903700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80b0020 0x7f40a814d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40af903700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40a80b1930 0x7f40a80a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40af903700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80abb00 con 0x7f40a80b0020 2021-06-25T04:48:21.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40af903700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80abfe0 con 0x7f40a80b1930 2021-06-25T04:48:21.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40af903700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80add10 con 0x7f40a80a7670 2021-06-25T04:48:21.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40ace9e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80b0020 0x7f40a814d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40ace9e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80b0020 0x7f40a814d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36628/0 (socket says 172.21.15.57:36628) 2021-06-25T04:48:21.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40ace9e700 1 -- 172.21.15.57:0/4193925018 learned_addr learned my addr 172.21.15.57:0/4193925018 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:21.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40ad69f700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40a80a7670 0x7f40a80aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40adea0700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40a80b1930 0x7f40a80a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40ace9e700 1 -- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40a80a7670 msgr2=0x7f40a80aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:21.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40ace9e700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40a80a7670 0x7f40a80aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40ace9e700 1 -- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40a80b1930 msgr2=0x7f40a80a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:21.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40ace9e700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40a80b1930 0x7f40a80a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:21.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40ace9e700 1 -- 172.21.15.57:0/4193925018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a400b1e0 con 0x7f40a80b0020 2021-06-25T04:48:21.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40ace9e700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80b0020 0x7f40a814d210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f40a4002f70 tx=0x7f40a4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:21.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f409e7fc700 1 -- 172.21.15.57:0/4193925018 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40a4021070 con 0x7f40a80b0020 2021-06-25T04:48:21.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40af903700 1 -- 172.21.15.57:0/4193925018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a80adfb0 con 0x7f40a80b0020 2021-06-25T04:48:21.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f409e7fc700 1 -- 172.21.15.57:0/4193925018 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a4000e90 con 0x7f40a80b0020 2021-06-25T04:48:21.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40af903700 1 -- 172.21.15.57:0/4193925018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a80abd10 con 0x7f40a80b0020 2021-06-25T04:48:21.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f409e7fc700 1 -- 172.21.15.57:0/4193925018 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40a4006c50 con 0x7f40a80b0020 2021-06-25T04:48:21.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.951+0000 7f40af903700 1 -- 172.21.15.57:0/4193925018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a8057310 con 0x7f40a80b0020 2021-06-25T04:48:21.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.955+0000 7f409e7fc700 1 -- 172.21.15.57:0/4193925018 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f40a400f070 con 0x7f40a80b0020 2021-06-25T04:48:21.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.955+0000 7f409e7fc700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4090055490 0x7f4090057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:21.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.955+0000 7f409e7fc700 1 -- 172.21.15.57:0/4193925018 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f40a406f2c0 con 0x7f40a80b0020 2021-06-25T04:48:21.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.955+0000 7f40ad69f700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4090055490 0x7f4090057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:21.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.955+0000 7f40ad69f700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4090055490 0x7f4090057950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f409800c000 tx=0x7f4098008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:21.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:21.959+0000 7f409e7fc700 1 -- 172.21.15.57:0/4193925018 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f40a40453d0 con 0x7f40a80b0020 2021-06-25T04:48:22.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.083+0000 7f40af903700 1 -- 172.21.15.57:0/4193925018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40a80ac230 con 0x7f40a80b0020 2021-06-25T04:48:22.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f409e7fc700 1 -- 172.21.15.57:0/4193925018 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f40a40489f0 con 0x7f40a80b0020 2021-06-25T04:48:22.094 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:22.094 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":35,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:48:19.876788+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:48:17.192457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-06-25T04:48:17.888021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:48:22.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 -- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4090055490 msgr2=0x7f4090057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4090055490 0x7f4090057950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f409800c000 tx=0x7f4098008040).stop 2021-06-25T04:48:22.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 -- 172.21.15.57:0/4193925018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80b0020 msgr2=0x7f40a814d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80b0020 0x7f40a814d210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f40a4002f70 tx=0x7f40a4015000).stop 2021-06-25T04:48:22.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 -- 172.21.15.57:0/4193925018 shutdown_connections 2021-06-25T04:48:22.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4090055490 0x7f4090057950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40a80b1930 0x7f40a80a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80b0020 0x7f40a814d210 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 --2- 172.21.15.57:0/4193925018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40a80a7670 0x7f40a80aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 -- 172.21.15.57:0/4193925018 >> 172.21.15.57:0/4193925018 conn(0x7f40a80b53a0 msgr2=0x7f40a805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 -- 172.21.15.57:0/4193925018 shutdown_connections 2021-06-25T04:48:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.087+0000 7f40af903700 1 -- 172.21.15.57:0/4193925018 wait complete. 2021-06-25T04:48:22.108 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:48:17.192457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:48:17.888021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:48:22.108 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:48:22.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.211+0000 7f5daf188700 1 Processor -- start 2021-06-25T04:48:22.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.211+0000 7f5daf188700 1 -- start start 2021-06-25T04:48:22.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.211+0000 7f5daf188700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5da8064600 0x7f5da80b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.211+0000 7f5daf188700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5da80b4a60 0x7f5da80649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.211+0000 7f5daf188700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da80b8050 con 0x7f5da8143830 2021-06-25T04:48:22.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.211+0000 7f5daf188700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da80674d0 con 0x7f5da80b4a60 2021-06-25T04:48:22.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.211+0000 7f5daf188700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da8142f00 con 0x7f5da8064600 2021-06-25T04:48:22.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.211+0000 7f5dad985700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5da80b4a60 0x7f5da80649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.211+0000 7f5dad985700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5da80b4a60 0x7f5da80649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:45128/0 (socket says 172.21.15.57:45128) 2021-06-25T04:48:22.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.211+0000 7f5dae186700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5da8064600 0x7f5da80b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.211+0000 7f5dad985700 1 -- 172.21.15.57:0/975550451 learned_addr learned my addr 172.21.15.57:0/975550451 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:22.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5dae186700 1 -- 172.21.15.57:0/975550451 >> v2:172.21.15.87:3300/0 conn(0x7f5da80b4a60 msgr2=0x7f5da80649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:22.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5dae186700 1 --2- 172.21.15.57:0/975550451 >> v2:172.21.15.87:3300/0 conn(0x7f5da80b4a60 0x7f5da80649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5dae186700 1 -- 172.21.15.57:0/975550451 >> v1:172.21.15.87:6789/0 conn(0x7f5da8143830 legacy=0x7f5da81464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5dae186700 1 -- 172.21.15.57:0/975550451 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da81430f0 con 0x7f5da8064600 2021-06-25T04:48:22.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5dad985700 1 --2- 172.21.15.57:0/975550451 >> v2:172.21.15.87:3300/0 conn(0x7f5da80b4a60 0x7f5da80649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5dae186700 1 --2- 172.21.15.57:0/975550451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5da8064600 0x7f5da80b36d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5da4002f70 tx=0x7f5da4006df0).ready entity=mon.2 client_cookie=622c5a1c12f00d0a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5dad184700 1 -- 172.21.15.57:0/975550451 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5da400d570 con 0x7f5da8064600 2021-06-25T04:48:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5dad184700 1 -- 172.21.15.57:0/975550451 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da4000e90 con 0x7f5da8064600 2021-06-25T04:48:22.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5dad184700 1 -- 172.21.15.57:0/975550451 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5da400d8c0 con 0x7f5da8064600 2021-06-25T04:48:22.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5daf188700 1 -- 172.21.15.57:0/975550451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5da8064600 msgr2=0x7f5da80b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5daf188700 1 --2- 172.21.15.57:0/975550451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5da8064600 0x7f5da80b36d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5da4002f70 tx=0x7f5da4006df0).stop 2021-06-25T04:48:22.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5daf188700 1 -- 172.21.15.57:0/975550451 shutdown_connections 2021-06-25T04:48:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5daf188700 1 --2- 172.21.15.57:0/975550451 >> v2:172.21.15.87:3300/0 conn(0x7f5da80b4a60 0x7f5da80649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5daf188700 1 --2- 172.21.15.57:0/975550451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5da8064600 0x7f5da80b36d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5daf188700 1 -- 172.21.15.57:0/975550451 >> 172.21.15.57:0/975550451 conn(0x7f5da805f670 msgr2=0x7f5da805fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:22.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5daf188700 1 -- 172.21.15.57:0/975550451 shutdown_connections 2021-06-25T04:48:22.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.215+0000 7f5daf188700 1 -- 172.21.15.57:0/975550451 wait complete. 2021-06-25T04:48:22.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5daf188700 1 Processor -- start 2021-06-25T04:48:22.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5daf188700 1 -- start start 2021-06-25T04:48:22.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5daf188700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5da8064600 0x7f5da8061c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5daf188700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da80b4a60 0x7f5da8152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5daf188700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5da8143830 0x7f5da8155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5daf188700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da8062610 con 0x7f5da80b4a60 2021-06-25T04:48:22.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5daf188700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da80b0ce0 con 0x7f5da8143830 2021-06-25T04:48:22.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5daf188700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da80b0f80 con 0x7f5da8064600 2021-06-25T04:48:22.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5dad985700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da80b4a60 0x7f5da8152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5dad985700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da80b4a60 0x7f5da8152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36640/0 (socket says 172.21.15.57:36640) 2021-06-25T04:48:22.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5dad985700 1 -- 172.21.15.57:0/1146125839 learned_addr learned my addr 172.21.15.57:0/1146125839 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:22.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5dae987700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5da8143830 0x7f5da8155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5dae186700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5da8064600 0x7f5da8061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5dad985700 1 -- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5da8064600 msgr2=0x7f5da8061c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5dad985700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5da8064600 0x7f5da8061c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5dad985700 1 -- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5da8143830 msgr2=0x7f5da8155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5dad985700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5da8143830 0x7f5da8155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5dad985700 1 -- 172.21.15.57:0/1146125839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c00b1e0 con 0x7f5da80b4a60 2021-06-25T04:48:22.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5dad985700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da80b4a60 0x7f5da8152d50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f5d9c00c000 tx=0x7f5d9c006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:22.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.219+0000 7f5d9b7fe700 1 -- 172.21.15.57:0/1146125839 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d9c012600 con 0x7f5da80b4a60 2021-06-25T04:48:22.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.223+0000 7f5d9b7fe700 1 -- 172.21.15.57:0/1146125839 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c012760 con 0x7f5da80b4a60 2021-06-25T04:48:22.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.223+0000 7f5daf188700 1 -- 172.21.15.57:0/1146125839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da400b180 con 0x7f5da80b4a60 2021-06-25T04:48:22.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.223+0000 7f5d9b7fe700 1 -- 172.21.15.57:0/1146125839 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d9c012ac0 con 0x7f5da80b4a60 2021-06-25T04:48:22.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.223+0000 7f5daf188700 1 -- 172.21.15.57:0/1146125839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da81528b0 con 0x7f5da80b4a60 2021-06-25T04:48:22.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.223+0000 7f5daf188700 1 -- 172.21.15.57:0/1146125839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da8152a70 con 0x7f5da80b4a60 2021-06-25T04:48:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.223+0000 7f5d9b7fe700 1 -- 172.21.15.57:0/1146125839 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5d9c022070 con 0x7f5da80b4a60 2021-06-25T04:48:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.223+0000 7f5d9b7fe700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d880554e0 0x7f5d880579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.223+0000 7f5d9b7fe700 1 -- 172.21.15.57:0/1146125839 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5d9c06e460 con 0x7f5da80b4a60 2021-06-25T04:48:22.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.223+0000 7f5dae186700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d880554e0 0x7f5d880579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.223+0000 7f5dae186700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d880554e0 0x7f5d880579a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f5da4019000 tx=0x7f5da4014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:22.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.231+0000 7f5d9b7fe700 1 -- 172.21.15.57:0/1146125839 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5d9c044570 con 0x7f5da80b4a60 2021-06-25T04:48:22.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.359+0000 7f5daf188700 1 -- 172.21.15.57:0/1146125839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5da8057310 con 0x7f5da80b4a60 2021-06-25T04:48:22.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.359+0000 7f5d9b7fe700 1 -- 172.21.15.57:0/1146125839 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v35) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5d9c047b90 con 0x7f5da80b4a60 2021-06-25T04:48:22.370 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:48:22.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 -- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d880554e0 msgr2=0x7f5d880579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d880554e0 0x7f5d880579a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f5da4019000 tx=0x7f5da4014000).stop 2021-06-25T04:48:22.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 -- 172.21.15.57:0/1146125839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da80b4a60 msgr2=0x7f5da8152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da80b4a60 0x7f5da8152d50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f5d9c00c000 tx=0x7f5d9c006eb0).stop 2021-06-25T04:48:22.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 -- 172.21.15.57:0/1146125839 shutdown_connections 2021-06-25T04:48:22.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d880554e0 0x7f5d880579a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5da8143830 0x7f5da8155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da80b4a60 0x7f5da8152d50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 --2- 172.21.15.57:0/1146125839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5da8064600 0x7f5da8061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 -- 172.21.15.57:0/1146125839 >> 172.21.15.57:0/1146125839 conn(0x7f5da805f670 msgr2=0x7f5da80b5470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 -- 172.21.15.57:0/1146125839 shutdown_connections 2021-06-25T04:48:22.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.363+0000 7f5daf188700 1 -- 172.21.15.57:0/1146125839 wait complete. 2021-06-25T04:48:22.386 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:48:22.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.523+0000 7f3b5d88a700 1 Processor -- start 2021-06-25T04:48:22.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.523+0000 7f3b5d88a700 1 -- start start 2021-06-25T04:48:22.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3b580600c0 0x7f3b58064cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b580b3890 0x7f3b580651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b580604a0 con 0x7f3b58144400 2021-06-25T04:48:22.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580656b0 con 0x7f3b580600c0 2021-06-25T04:48:22.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b58065c40 con 0x7f3b580b3890 2021-06-25T04:48:22.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b56ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3b580600c0 0x7f3b58064cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b577fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b580b3890 0x7f3b580651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b56ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3b580600c0 0x7f3b58064cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36648/0 (socket says 172.21.15.57:36648) 2021-06-25T04:48:22.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b56ffd700 1 -- 172.21.15.57:0/1573635580 learned_addr learned my addr 172.21.15.57:0/1573635580 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:22.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b55ffb700 1 -- 172.21.15.57:0/1573635580 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246122669 0 0) 0x7f3b580604a0 con 0x7f3b58144400 2021-06-25T04:48:22.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b55ffb700 1 -- 172.21.15.57:0/1573635580 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b38003260 con 0x7f3b58144400 2021-06-25T04:48:22.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b577fe700 1 -- 172.21.15.57:0/1573635580 >> v2:172.21.15.57:3300/0 conn(0x7f3b580600c0 msgr2=0x7f3b58064cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:22.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b577fe700 1 --2- 172.21.15.57:0/1573635580 >> v2:172.21.15.57:3300/0 conn(0x7f3b580600c0 0x7f3b58064cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b577fe700 1 -- 172.21.15.57:0/1573635580 >> v1:172.21.15.87:6789/0 conn(0x7f3b58144400 legacy=0x7f3b58144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b577fe700 1 -- 172.21.15.57:0/1573635580 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580b2370 con 0x7f3b580b3890 2021-06-25T04:48:22.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b56ffd700 1 --2- 172.21.15.57:0/1573635580 >> v2:172.21.15.57:3300/0 conn(0x7f3b580600c0 0x7f3b58064cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:22.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b577fe700 1 --2- 172.21.15.57:0/1573635580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b580b3890 0x7f3b580651c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3b500032f0 tx=0x7f3b500091d0).ready entity=mon.1 client_cookie=4b81a23129794936 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:22.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b55ffb700 1 -- 172.21.15.57:0/1573635580 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b5000b600 con 0x7f3b580b3890 2021-06-25T04:48:22.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b55ffb700 1 -- 172.21.15.57:0/1573635580 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5000b760 con 0x7f3b580b3890 2021-06-25T04:48:22.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b55ffb700 1 -- 172.21.15.57:0/1573635580 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b5000b8d0 con 0x7f3b580b3890 2021-06-25T04:48:22.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 -- 172.21.15.57:0/1573635580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b580b3890 msgr2=0x7f3b580651c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 --2- 172.21.15.57:0/1573635580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b580b3890 0x7f3b580651c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3b500032f0 tx=0x7f3b500091d0).stop 2021-06-25T04:48:22.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 -- 172.21.15.57:0/1573635580 shutdown_connections 2021-06-25T04:48:22.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 --2- 172.21.15.57:0/1573635580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b580b3890 0x7f3b580651c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 --2- 172.21.15.57:0/1573635580 >> v2:172.21.15.57:3300/0 conn(0x7f3b580600c0 0x7f3b58064cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 -- 172.21.15.57:0/1573635580 >> 172.21.15.57:0/1573635580 conn(0x7f3b5805cf20 msgr2=0x7f3b5805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:22.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 -- 172.21.15.57:0/1573635580 shutdown_connections 2021-06-25T04:48:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.527+0000 7f3b5d88a700 1 -- 172.21.15.57:0/1573635580 wait complete. 2021-06-25T04:48:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.531+0000 7f3b5d88a700 1 Processor -- start 2021-06-25T04:48:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.531+0000 7f3b5d88a700 1 -- start start 2021-06-25T04:48:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b5d88a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b580600c0 0x7f3b58145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b5d88a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b580b3890 0x7f3b58153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b5d88a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b58143880 0x7f3b580b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b5d88a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580b6d40 con 0x7f3b580600c0 2021-06-25T04:48:22.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b56ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b580600c0 0x7f3b58145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b56ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b580600c0 0x7f3b58145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36652/0 (socket says 172.21.15.57:36652) 2021-06-25T04:48:22.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b56ffd700 1 -- 172.21.15.57:0/2002007402 learned_addr learned my addr 172.21.15.57:0/2002007402 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:22.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58153510 con 0x7f3b580b3890 2021-06-25T04:48:22.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58143d90 con 0x7f3b58143880 2021-06-25T04:48:22.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b567fc700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b580b3890 0x7f3b58153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b577fe700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b58143880 0x7f3b580b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b56ffd700 1 -- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b58143880 msgr2=0x7f3b580b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b56ffd700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b58143880 0x7f3b580b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b56ffd700 1 -- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b580b3890 msgr2=0x7f3b58153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b56ffd700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b580b3890 0x7f3b58153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b56ffd700 1 -- 172.21.15.57:0/2002007402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4000b1e0 con 0x7f3b580600c0 2021-06-25T04:48:22.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b567fc700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b580b3890 0x7f3b58153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:22.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b577fe700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b58143880 0x7f3b580b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:22.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b56ffd700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b580600c0 0x7f3b58145800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f3b58144300 tx=0x7f3b40006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:22.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b4ffff700 1 -- 172.21.15.57:0/2002007402 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b40012600 con 0x7f3b580600c0 2021-06-25T04:48:22.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b4ffff700 1 -- 172.21.15.57:0/2002007402 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b40012760 con 0x7f3b580600c0 2021-06-25T04:48:22.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b50009470 con 0x7f3b580600c0 2021-06-25T04:48:22.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b4ffff700 1 -- 172.21.15.57:0/2002007402 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b40012ac0 con 0x7f3b580600c0 2021-06-25T04:48:22.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b58146370 con 0x7f3b580600c0 2021-06-25T04:48:22.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b58057310 con 0x7f3b580600c0 2021-06-25T04:48:22.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.535+0000 7f3b4ffff700 1 -- 172.21.15.57:0/2002007402 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3b40022070 con 0x7f3b580600c0 2021-06-25T04:48:22.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.539+0000 7f3b4ffff700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3b3c055510 0x7f3b3c0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.539+0000 7f3b4ffff700 1 -- 172.21.15.57:0/2002007402 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3b4006e490 con 0x7f3b580600c0 2021-06-25T04:48:22.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.539+0000 7f3b567fc700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3b3c055510 0x7f3b3c0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.539+0000 7f3b567fc700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3b3c055510 0x7f3b3c0579d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3b4800d000 tx=0x7f3b48007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:22.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.547+0000 7f3b4ffff700 1 -- 172.21.15.57:0/2002007402 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3b400444b0 con 0x7f3b580600c0 2021-06-25T04:48:22.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.671+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b580698a0 con 0x7f3b580600c0 2021-06-25T04:48:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.671+0000 7f3b4ffff700 1 -- 172.21.15.57:0/2002007402 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3b40047ad0 con 0x7f3b580600c0 2021-06-25T04:48:22.682 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:22.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3b3c055510 msgr2=0x7f3b3c0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3b3c055510 0x7f3b3c0579d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3b4800d000 tx=0x7f3b48007a20).stop 2021-06-25T04:48:22.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b580600c0 msgr2=0x7f3b58145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b580600c0 0x7f3b58145800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f3b58144300 tx=0x7f3b40006eb0).stop 2021-06-25T04:48:22.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 shutdown_connections 2021-06-25T04:48:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3b3c055510 0x7f3b3c0579d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b58143880 0x7f3b580b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b580b3890 0x7f3b58153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 --2- 172.21.15.57:0/2002007402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b580600c0 0x7f3b58145800 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 >> 172.21.15.57:0/2002007402 conn(0x7f3b5805cf20 msgr2=0x7f3b5813ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:22.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 shutdown_connections 2021-06-25T04:48:22.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.675+0000 7f3b5d88a700 1 -- 172.21.15.57:0/2002007402 wait complete. 2021-06-25T04:48:22.692 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:48:22.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145d24700 1 Processor -- start 2021-06-25T04:48:22.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145d24700 1 -- start start 2021-06-25T04:48:22.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145d24700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41400ad580 0x7f41400616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145d24700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4140140400 0x7f41401408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145d24700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41400aecb0 con 0x7f41400612e0 2021-06-25T04:48:22.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145d24700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41400b6ee0 con 0x7f4140140400 2021-06-25T04:48:22.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145d24700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41400aeee0 con 0x7f41400ad580 2021-06-25T04:48:22.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145523700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4140140400 0x7f41401408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4144d22700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f41400612e0 0x7f41400b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53878/0 (socket says 172.21.15.57:53878) 2021-06-25T04:48:22.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145523700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4140140400 0x7f41401408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36664/0 (socket says 172.21.15.57:36664) 2021-06-25T04:48:22.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4144d22700 1 -- 172.21.15.57:0/3258851997 learned_addr learned my addr 172.21.15.57:0/3258851997 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:22.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f413ffff700 1 --2- 172.21.15.57:0/3258851997 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41400ad580 0x7f41400616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145523700 1 -- 172.21.15.57:0/3258851997 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41400ad580 msgr2=0x7f41400616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:22.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145523700 1 --2- 172.21.15.57:0/3258851997 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41400ad580 0x7f41400616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145523700 1 -- 172.21.15.57:0/3258851997 >> v1:172.21.15.57:6789/0 conn(0x7f41400612e0 legacy=0x7f41400b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f413f7fe700 1 -- 172.21.15.57:0/3258851997 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242624664 0 0) 0x7f41400aecb0 con 0x7f41400612e0 2021-06-25T04:48:22.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145523700 1 -- 172.21.15.57:0/3258851997 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41400af180 con 0x7f4140140400 2021-06-25T04:48:22.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f413ffff700 1 --2- 172.21.15.57:0/3258851997 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41400ad580 0x7f41400616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:22.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145523700 1 --2- 172.21.15.57:0/3258851997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140140400 0x7f41401408b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f41380032f0 tx=0x7f41380091d0).ready entity=mon.0 client_cookie=b225fc9fef43aa2d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:22.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f413f7fe700 1 -- 172.21.15.57:0/3258851997 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4138009ea0 con 0x7f4140140400 2021-06-25T04:48:22.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f413f7fe700 1 -- 172.21.15.57:0/3258851997 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413800b8a0 con 0x7f4140140400 2021-06-25T04:48:22.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f413f7fe700 1 -- 172.21.15.57:0/3258851997 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f413800ba10 con 0x7f4140140400 2021-06-25T04:48:22.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145d24700 1 -- 172.21.15.57:0/3258851997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140140400 msgr2=0x7f41401408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.815+0000 7f4145d24700 1 --2- 172.21.15.57:0/3258851997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140140400 0x7f41401408b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f41380032f0 tx=0x7f41380091d0).stop 2021-06-25T04:48:22.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 -- 172.21.15.57:0/3258851997 shutdown_connections 2021-06-25T04:48:22.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 --2- 172.21.15.57:0/3258851997 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41400ad580 0x7f41400616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 --2- 172.21.15.57:0/3258851997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140140400 0x7f41401408b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 -- 172.21.15.57:0/3258851997 >> 172.21.15.57:0/3258851997 conn(0x7f4140066da0 msgr2=0x7f4140067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 -- 172.21.15.57:0/3258851997 shutdown_connections 2021-06-25T04:48:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 -- 172.21.15.57:0/3258851997 wait complete. 2021-06-25T04:48:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 Processor -- start 2021-06-25T04:48:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 -- start start 2021-06-25T04:48:22.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41400612e0 0x7f41401428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41400ad580 0x7f41400b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140140400 0x7f41400ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4140149c70 con 0x7f4140140400 2021-06-25T04:48:22.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414014a280 con 0x7f41400ad580 2021-06-25T04:48:22.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145d24700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4140149ea0 con 0x7f41400612e0 2021-06-25T04:48:22.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145523700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140140400 0x7f41400ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145523700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140140400 0x7f41400ac0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36670/0 (socket says 172.21.15.57:36670) 2021-06-25T04:48:22.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145523700 1 -- 172.21.15.57:0/4010326745 learned_addr learned my addr 172.21.15.57:0/4010326745 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f413ffff700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41400ad580 0x7f41400b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4144d22700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41400612e0 0x7f41401428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145523700 1 -- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41400612e0 msgr2=0x7f41401428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145523700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41400612e0 0x7f41401428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145523700 1 -- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41400ad580 msgr2=0x7f41400b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145523700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41400ad580 0x7f41400b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.819+0000 7f4145523700 1 -- 172.21.15.57:0/4010326745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138009470 con 0x7f4140140400 2021-06-25T04:48:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f413ffff700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41400ad580 0x7f41400b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:48:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f4145523700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140140400 0x7f41400ac0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f41380032f0 tx=0x7f4138016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:22.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f413dffb700 1 -- 172.21.15.57:0/4010326745 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4138011d10 con 0x7f4140140400 2021-06-25T04:48:22.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f413dffb700 1 -- 172.21.15.57:0/4010326745 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4138011e70 con 0x7f4140140400 2021-06-25T04:48:22.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f413dffb700 1 -- 172.21.15.57:0/4010326745 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4138021630 con 0x7f4140140400 2021-06-25T04:48:22.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f4145d24700 1 -- 172.21.15.57:0/4010326745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41400b2000 con 0x7f4140140400 2021-06-25T04:48:22.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f4145d24700 1 -- 172.21.15.57:0/4010326745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4140148cb0 con 0x7f4140140400 2021-06-25T04:48:22.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f4145d24700 1 -- 172.21.15.57:0/4010326745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4140149a10 con 0x7f4140140400 2021-06-25T04:48:22.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f413dffb700 1 -- 172.21.15.57:0/4010326745 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4138027020 con 0x7f4140140400 2021-06-25T04:48:22.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f413dffb700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4120055340 0x7f4120057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:22.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f413dffb700 1 -- 172.21.15.57:0/4010326745 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f413806f190 con 0x7f4140140400 2021-06-25T04:48:22.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.823+0000 7f4144d22700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4120055340 0x7f4120057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:22.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.827+0000 7f4144d22700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4120055340 0x7f4120057800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f413400d000 tx=0x7f41340011a0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:22.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.831+0000 7f413dffb700 1 -- 172.21.15.57:0/4010326745 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4138045340 con 0x7f4140140400 2021-06-25T04:48:22.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.955+0000 7f4145d24700 1 -- 172.21.15.57:0/4010326745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4140149c70 con 0x7f4140140400 2021-06-25T04:48:22.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.955+0000 7f413dffb700 1 -- 172.21.15.57:0/4010326745 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4138048960 con 0x7f4140140400 2021-06-25T04:48:22.965 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:22.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 -- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4120055340 msgr2=0x7f4120057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4120055340 0x7f4120057800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f413400d000 tx=0x7f41340011a0).stop 2021-06-25T04:48:22.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 -- 172.21.15.57:0/4010326745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140140400 msgr2=0x7f41400ac0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:22.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140140400 0x7f41400ac0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f41380032f0 tx=0x7f4138016000).stop 2021-06-25T04:48:22.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 -- 172.21.15.57:0/4010326745 shutdown_connections 2021-06-25T04:48:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4120055340 0x7f4120057800 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140140400 0x7f41400ac0d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41400ad580 0x7f41400b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 --2- 172.21.15.57:0/4010326745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41400612e0 0x7f41401428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 -- 172.21.15.57:0/4010326745 >> 172.21.15.57:0/4010326745 conn(0x7f4140066da0 msgr2=0x7f41400b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 -- 172.21.15.57:0/4010326745 shutdown_connections 2021-06-25T04:48:22.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:22.959+0000 7f4145d24700 1 -- 172.21.15.57:0/4010326745 wait complete. 2021-06-25T04:48:22.979 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:48:23.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.087+0000 7f9343fff700 1 Processor -- start 2021-06-25T04:48:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.087+0000 7f9343fff700 1 -- start start 2021-06-25T04:48:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.087+0000 7f9343fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f93440b7330 0x7f93440b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.087+0000 7f9343fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93440b2340 con 0x7f93440aabe0 2021-06-25T04:48:23.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.087+0000 7f9343fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9344144210 con 0x7f93440b3020 2021-06-25T04:48:23.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.087+0000 7f9343fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93440b3530 con 0x7f93440b7330 2021-06-25T04:48:23.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.087+0000 7f93437fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f93440aabe0 0x7f9344064b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53896/0 (socket says 172.21.15.57:53896) 2021-06-25T04:48:23.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.087+0000 7f93437fe700 1 -- 172.21.15.57:0/2488670137 learned_addr learned my addr 172.21.15.57:0/2488670137 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.087+0000 7f9342ffd700 1 --2- 172.21.15.57:0/2488670137 >> v2:172.21.15.87:3300/0 conn(0x7f93440b7330 0x7f93440b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.087+0000 7f9341ffb700 1 -- 172.21.15.57:0/2488670137 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770370520 0 0) 0x7f93440b2340 con 0x7f93440aabe0 2021-06-25T04:48:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.087+0000 7f9341ffb700 1 -- 172.21.15.57:0/2488670137 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9328003260 con 0x7f93440aabe0 2021-06-25T04:48:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9341ffb700 1 -- 172.21.15.57:0/2488670137 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183007510 0 0) 0x7f9344144210 con 0x7f93440b3020 2021-06-25T04:48:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9341ffb700 1 -- 172.21.15.57:0/2488670137 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93440b2340 con 0x7f93440b3020 2021-06-25T04:48:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9342ffd700 1 -- 172.21.15.57:0/2488670137 >> v1:172.21.15.87:6789/0 conn(0x7f93440b3020 legacy=0x7f934413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9342ffd700 1 -- 172.21.15.57:0/2488670137 >> v1:172.21.15.57:6789/0 conn(0x7f93440aabe0 legacy=0x7f9344064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9342ffd700 1 -- 172.21.15.57:0/2488670137 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93440b2570 con 0x7f93440b7330 2021-06-25T04:48:23.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9342ffd700 1 --2- 172.21.15.57:0/2488670137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93440b7330 0x7f93440b7710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f9338002f70 tx=0x7f9338006d90).ready entity=mon.1 client_cookie=2bdf27de5fe9121e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9341ffb700 1 -- 172.21.15.57:0/2488670137 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933800e630 con 0x7f93440b7330 2021-06-25T04:48:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9341ffb700 1 -- 172.21.15.57:0/2488670137 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9338000e90 con 0x7f93440b7330 2021-06-25T04:48:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9343fff700 1 -- 172.21.15.57:0/2488670137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93440b7330 msgr2=0x7f93440b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9341ffb700 1 -- 172.21.15.57:0/2488670137 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933800e980 con 0x7f93440b7330 2021-06-25T04:48:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9343fff700 1 --2- 172.21.15.57:0/2488670137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93440b7330 0x7f93440b7710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f9338002f70 tx=0x7f9338006d90).stop 2021-06-25T04:48:23.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9343fff700 1 -- 172.21.15.57:0/2488670137 shutdown_connections 2021-06-25T04:48:23.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9343fff700 1 --2- 172.21.15.57:0/2488670137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93440b7330 0x7f93440b7710 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9343fff700 1 -- 172.21.15.57:0/2488670137 >> 172.21.15.57:0/2488670137 conn(0x7f934405f670 msgr2=0x7f934405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:23.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9343fff700 1 -- 172.21.15.57:0/2488670137 shutdown_connections 2021-06-25T04:48:23.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9343fff700 1 -- 172.21.15.57:0/2488670137 wait complete. 2021-06-25T04:48:23.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9343fff700 1 Processor -- start 2021-06-25T04:48:23.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.091+0000 7f9343fff700 1 -- start start 2021-06-25T04:48:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9343fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93440aabe0 0x7f9344061830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9343fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93440b3020 0x7f9344155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9343fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93440b7330 0x7f9344156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9343fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9344156510 con 0x7f93440b3020 2021-06-25T04:48:23.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9343fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9344148990 con 0x7f93440aabe0 2021-06-25T04:48:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9343fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93441440b0 con 0x7f93440b7330 2021-06-25T04:48:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f93427fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93440b3020 0x7f9344155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f93427fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93440b3020 0x7f9344155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36682/0 (socket says 172.21.15.57:36682) 2021-06-25T04:48:23.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f93427fc700 1 -- 172.21.15.57:0/4213635293 learned_addr learned my addr 172.21.15.57:0/4213635293 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9342ffd700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93440aabe0 0x7f9344061830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f93437fe700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93440b7330 0x7f9344156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f93427fc700 1 -- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93440b7330 msgr2=0x7f9344156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f93427fc700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93440b7330 0x7f9344156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f93427fc700 1 -- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93440aabe0 msgr2=0x7f9344061830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f93427fc700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93440aabe0 0x7f9344061830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f93427fc700 1 -- 172.21.15.57:0/4213635293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933800b120 con 0x7f93440b3020 2021-06-25T04:48:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f93427fc700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93440b3020 0x7f9344155b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f9334001110 tx=0x7f9334007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:23.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9333fff700 1 -- 172.21.15.57:0/4213635293 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9334012400 con 0x7f93440b3020 2021-06-25T04:48:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9343fff700 1 -- 172.21.15.57:0/4213635293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9344144350 con 0x7f93440b3020 2021-06-25T04:48:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9333fff700 1 -- 172.21.15.57:0/4213635293 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9334012560 con 0x7f93440b3020 2021-06-25T04:48:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9343fff700 1 -- 172.21.15.57:0/4213635293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9344061d20 con 0x7f93440b3020 2021-06-25T04:48:23.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.095+0000 7f9333fff700 1 -- 172.21.15.57:0/4213635293 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93340128c0 con 0x7f93440b3020 2021-06-25T04:48:23.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.099+0000 7f9343fff700 1 -- 172.21.15.57:0/4213635293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9344057310 con 0x7f93440b3020 2021-06-25T04:48:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.099+0000 7f9333fff700 1 -- 172.21.15.57:0/4213635293 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9334019030 con 0x7f93440b3020 2021-06-25T04:48:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.099+0000 7f9333fff700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93200553f0 0x7f93200578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.099+0000 7f9333fff700 1 -- 172.21.15.57:0/4213635293 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f933406d250 con 0x7f93440b3020 2021-06-25T04:48:23.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.099+0000 7f9342ffd700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93200553f0 0x7f93200578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.099+0000 7f9342ffd700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93200553f0 0x7f93200578b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f9338018000 tx=0x7f9338014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:23.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.107+0000 7f9333fff700 1 -- 172.21.15.57:0/4213635293 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9334042c50 con 0x7f93440b3020 2021-06-25T04:48:23.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.235+0000 7f9343fff700 1 -- 172.21.15.57:0/4213635293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9344060160 con 0x7f93440b3020 2021-06-25T04:48:23.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.235+0000 7f9333fff700 1 -- 172.21.15.57:0/4213635293 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9334043410 con 0x7f93440b3020 2021-06-25T04:48:23.245 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:48:23.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 -- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93200553f0 msgr2=0x7f93200578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93200553f0 0x7f93200578b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f9338018000 tx=0x7f9338014000).stop 2021-06-25T04:48:23.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 -- 172.21.15.57:0/4213635293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93440b3020 msgr2=0x7f9344155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93440b3020 0x7f9344155b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f9334001110 tx=0x7f9334007ae0).stop 2021-06-25T04:48:23.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 -- 172.21.15.57:0/4213635293 shutdown_connections 2021-06-25T04:48:23.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93200553f0 0x7f93200578b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93440b7330 0x7f9344156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93440b3020 0x7f9344155b30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 --2- 172.21.15.57:0/4213635293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93440aabe0 0x7f9344061830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 -- 172.21.15.57:0/4213635293 >> 172.21.15.57:0/4213635293 conn(0x7f934405f670 msgr2=0x7f93440b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:23.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 -- 172.21.15.57:0/4213635293 shutdown_connections 2021-06-25T04:48:23.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.239+0000 7f9343fff700 1 -- 172.21.15.57:0/4213635293 wait complete. 2021-06-25T04:48:23.257 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:48:23.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:48:23.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.347+0000 7ffba0b3c700 1 Processor -- start 2021-06-25T04:48:23.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.347+0000 7ffba0b3c700 1 -- start start 2021-06-25T04:48:23.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffba0b3c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb9c0afe20 0x7ffb9c0ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffba0b3c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9c0ad600 con 0x7ffb9c1480e0 2021-06-25T04:48:23.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffba0b3c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9c147480 con 0x7ffb9c0ad220 2021-06-25T04:48:23.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffba0b3c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9c0accc0 con 0x7ffb9c0afe20 2021-06-25T04:48:23.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9affd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffb9c1480e0 0x7ffb9c0ac0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53906/0 (socket says 172.21.15.57:53906) 2021-06-25T04:48:23.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9affd700 1 -- 172.21.15.57:0/3062586896 learned_addr learned my addr 172.21.15.57:0/3062586896 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9bfff700 1 --2- 172.21.15.57:0/3062586896 >> v2:172.21.15.87:3300/0 conn(0x7ffb9c0afe20 0x7ffb9c0ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952223685 0 0) 0x7ffb9c0ad600 con 0x7ffb9c1480e0 2021-06-25T04:48:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb88003260 con 0x7ffb9c1480e0 2021-06-25T04:48:23.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3938470525 0 0) 0x7ffb88003260 con 0x7ffb9c1480e0 2021-06-25T04:48:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 >> v2:172.21.15.87:3300/0 conn(0x7ffb9c0afe20 msgr2=0x7ffb9c0ac7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 --2- 172.21.15.57:0/3062586896 >> v2:172.21.15.87:3300/0 conn(0x7ffb9c0afe20 0x7ffb9c0ac7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 >> v1:172.21.15.87:6789/0 conn(0x7ffb9c0ad220 legacy=0x7ffb9c1479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c0b0440 con 0x7ffb9c1480e0 2021-06-25T04:48:23.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7ffb8c001680 con 0x7ffb9c1480e0 2021-06-25T04:48:23.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 >> v1:172.21.15.57:6789/0 conn(0x7ffb9c1480e0 legacy=0x7ffb9c0ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb88003750 0x7ffb88003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb88004500 0x7ffb88004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 0x7ffb8800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8800bcf0 con 0x7ffb88004e70 2021-06-25T04:48:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8800be60 con 0x7ffb88004500 2021-06-25T04:48:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8800c020 con 0x7ffb88003750 2021-06-25T04:48:23.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9bfff700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 0x7ffb8800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9affd700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb88004500 0x7ffb88004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9b7fe700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb88003750 0x7ffb88003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9bfff700 1 -- 172.21.15.57:0/3062586896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb88003750 msgr2=0x7ffb88003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:23.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9bfff700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb88003750 0x7ffb88003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9bfff700 1 -- 172.21.15.57:0/3062586896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb88004500 msgr2=0x7ffb88004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:23.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9bfff700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb88004500 0x7ffb88004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9bfff700 1 -- 172.21.15.57:0/3062586896 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb88003260 con 0x7ffb88004e70 2021-06-25T04:48:23.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9b7fe700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb88003750 0x7ffb88003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:23.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9bfff700 1 -- 172.21.15.57:0/3062586896 reap_dead start 2021-06-25T04:48:23.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9bfff700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 0x7ffb8800b750 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7ffb9400c000 tx=0x7ffb940091d0).ready entity=mon.0 client_cookie=8c509e81506c7168 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:23.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9400e7e0 con 0x7ffb88004e70 2021-06-25T04:48:23.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9400e940 con 0x7ffb88004e70 2021-06-25T04:48:23.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffb9a7fc700 1 -- 172.21.15.57:0/3062586896 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9400eca0 con 0x7ffb88004e70 2021-06-25T04:48:23.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffba0b3c700 1 -- 172.21.15.57:0/3062586896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 msgr2=0x7ffb8800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.351+0000 7ffba0b3c700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 0x7ffb8800b750 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7ffb9400c000 tx=0x7ffb940091d0).stop 2021-06-25T04:48:23.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 -- 172.21.15.57:0/3062586896 shutdown_connections 2021-06-25T04:48:23.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 --2- 172.21.15.57:0/3062586896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 0x7ffb8800b750 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 -- 172.21.15.57:0/3062586896 >> 172.21.15.57:0/3062586896 conn(0x7ffb9c0611f0 msgr2=0x7ffb9c062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:23.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 -- 172.21.15.57:0/3062586896 shutdown_connections 2021-06-25T04:48:23.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 -- 172.21.15.57:0/3062586896 wait complete. 2021-06-25T04:48:23.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 Processor -- start 2021-06-25T04:48:23.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 -- start start 2021-06-25T04:48:23.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 0x7ffb9c143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb9c14b070 0x7ffb9c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb9c14a980 0x7ffb9c156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c157260 con 0x7ffb88004e70 2021-06-25T04:48:23.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c14b810 con 0x7ffb9c14a980 2021-06-25T04:48:23.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c149f30 con 0x7ffb9c14b070 2021-06-25T04:48:23.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 0x7ffb9c143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 0x7ffb9c143300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36700/0 (socket says 172.21.15.57:36700) 2021-06-25T04:48:23.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9b7fe700 1 -- 172.21.15.57:0/456730187 learned_addr learned my addr 172.21.15.57:0/456730187 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:23.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9bfff700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb9c14a980 0x7ffb9c156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9affd700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb9c14b070 0x7ffb9c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9b7fe700 1 -- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb9c14b070 msgr2=0x7ffb9c156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9b7fe700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb9c14b070 0x7ffb9c156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9b7fe700 1 -- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb9c14a980 msgr2=0x7ffb9c156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9b7fe700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb9c14a980 0x7ffb9c156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9b7fe700 1 -- 172.21.15.57:0/456730187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c14a1d0 con 0x7ffb88004e70 2021-06-25T04:48:23.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9bfff700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb9c14a980 0x7ffb9c156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:48:23.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb9b7fe700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 0x7ffb9c143300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7ffb900076e0 tx=0x7ffb90009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:23.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb98ff9700 1 -- 172.21.15.57:0/456730187 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb90015630 con 0x7ffb88004e70 2021-06-25T04:48:23.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb98ff9700 1 -- 172.21.15.57:0/456730187 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb90010040 con 0x7ffb88004e70 2021-06-25T04:48:23.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 -- 172.21.15.57:0/456730187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9c14a470 con 0x7ffb88004e70 2021-06-25T04:48:23.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffb98ff9700 1 -- 172.21.15.57:0/456730187 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb90015980 con 0x7ffb88004e70 2021-06-25T04:48:23.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.355+0000 7ffba0b3c700 1 -- 172.21.15.57:0/456730187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9c1487e0 con 0x7ffb88004e70 2021-06-25T04:48:23.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.359+0000 7ffba0b3c700 1 -- 172.21.15.57:0/456730187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9c057310 con 0x7ffb88004e70 2021-06-25T04:48:23.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.359+0000 7ffb98ff9700 1 -- 172.21.15.57:0/456730187 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ffb9001c060 con 0x7ffb88004e70 2021-06-25T04:48:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.359+0000 7ffb98ff9700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb7c055450 0x7ffb7c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.359+0000 7ffb98ff9700 1 -- 172.21.15.57:0/456730187 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ffb9006d740 con 0x7ffb88004e70 2021-06-25T04:48:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.359+0000 7ffb9affd700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb7c055450 0x7ffb7c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.359+0000 7ffb9affd700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb7c055450 0x7ffb7c057910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7ffb8c005000 tx=0x7ffb9c0b3090).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:23.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.363+0000 7ffb98ff9700 1 -- 172.21.15.57:0/456730187 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ffb900438f0 con 0x7ffb88004e70 2021-06-25T04:48:23.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.531+0000 7ffba0b3c700 1 -- 172.21.15.57:0/456730187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb9c05f200 con 0x7ffb88004e70 2021-06-25T04:48:23.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.531+0000 7ffb98ff9700 1 -- 172.21.15.57:0/456730187 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7ffb9001a070 con 0x7ffb88004e70 2021-06-25T04:48:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:23.539 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3329294132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329294132},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329294132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/1504287390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1504287390},{"type":"v1","addr":"172.21.15.57:6833","nonce":1504287390}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:48:18.873057+0000","modified":"2021-06-25T04:48:19.875996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2421744077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2421744077},{"type":"v1","addr":"172.21.15.57:6835","nonce":2421744077}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-06-25T04:48:23.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 -- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb7c055450 msgr2=0x7ffb7c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb7c055450 0x7ffb7c057910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7ffb8c005000 tx=0x7ffb9c0b3090).stop 2021-06-25T04:48:23.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 -- 172.21.15.57:0/456730187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 msgr2=0x7ffb9c143300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:23.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 0x7ffb9c143300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7ffb900076e0 tx=0x7ffb90009040).stop 2021-06-25T04:48:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 -- 172.21.15.57:0/456730187 shutdown_connections 2021-06-25T04:48:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb7c055450 0x7ffb7c057910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb9c14a980 0x7ffb9c156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb9c14b070 0x7ffb9c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 --2- 172.21.15.57:0/456730187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb88004e70 0x7ffb9c143300 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:23.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 -- 172.21.15.57:0/456730187 >> 172.21.15.57:0/456730187 conn(0x7ffb9c0611f0 msgr2=0x7ffb9c0ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:23.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 -- 172.21.15.57:0/456730187 shutdown_connections 2021-06-25T04:48:23.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:23.535+0000 7ffba0b3c700 1 -- 172.21.15.57:0/456730187 wait complete. 2021-06-25T04:48:23.548 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 13 2021-06-25T04:48:23.859 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:48:18.873057+0000', 'modified': '2021-06-25T04:48:19.875996+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4926}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4926': {'gid': 4926, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2421744077', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2421744077}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2421744077}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:48:23.859 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:48:23.860 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:48:23.976 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":4926,"want_state":"up:active","state":"up:active","rank_uptime":5.0873792790000003,"mdsmap_epoch":13,"osdmap_epoch":35,"osdmap_epoch_barrier":34,"uptime":11.467508511} 2021-06-25T04:48:23.976 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 4926, "mdsmap_epoch": 13, "osdmap_epoch": 35, "osdmap_epoch_barrier": 34, "rank_uptime": 5.087379279, "state": "up:active", "uptime": 11.467508511, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:48:23.977 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:48:23.977 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:48:23.978 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:48:23.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:23.979 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:48:23.988 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:48:24.046 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:48:24.047 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:48:24.058 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:48:24.060 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:48:24.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:24.062 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:48:24.068 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:48:24.068 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:48:24.112 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:48:24.127 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:48:24.128 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:48:24.137 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:48:24.138 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:48:24.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:24.139 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:48:24.184 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:48:24.186+0000 7f6bbf184080 -1 init, newargv = 0x55eaf1e69ef0 newargc=9 2021-06-25T04:48:24.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14449]: starting ceph client 2021-06-25T04:48:24.195 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14449]: starting fuse 2021-06-25T04:48:25.288 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:48:25.306 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:48:25.307 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:48:25.317 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:48:25.318 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:48:25.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:25.319 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:48:25.367 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:48:25.367 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:48:25.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:25.368 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:48:25.369 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:48:25.369 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:48:25.369 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:48:25.370 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:48:25.370 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:48:25.371 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:48:25.371 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:48:25.372 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:48:25.372 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:48:25.372 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:48:25.373 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:48:25.373 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:48:25.374 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:48:25.374 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:48:25.374 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:48:25.375 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:48:25.375 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:48:25.376 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:48:25.376 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:48:25.376 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:48:25.377 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:48:25.377 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:48:25.420 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.14449.asok 2021-06-25T04:48:25.425 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14449.asok 2021-06-25T04:48:25.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:25.426 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14449.asok status 2021-06-25T04:48:25.560 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:48:25.561 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:48:25.561 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:48:25.561 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:48:25.562 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:48:25.562 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:48:25.562 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:48:25.562 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "14449", 2021-06-25T04:48:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:48:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:48:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:48:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:48:25.563 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 5106, 2021-06-25T04:48:25.564 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:48:25.564 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:48:25.564 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:48:25.564 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 5106 2021-06-25T04:48:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:48:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:48:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:48:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:48:25.565 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4037568786 2021-06-25T04:48:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:48:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:48:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:48:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:48:25.566 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:48:25.567 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4037568786 2021-06-25T04:48:25.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:48:25.567 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.5106 172.21.15.102:0/4037568786", 2021-06-25T04:48:25.568 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/4037568786", 2021-06-25T04:48:25.568 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:48:25.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 13, 2021-06-25T04:48:25.569 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 35, 2021-06-25T04:48:25.569 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:48:25.569 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:48:25.569 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:48:25.570 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:48:25.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:25.572 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:48:25.572 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:48:25.579 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:48:25.580 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:48:25.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:25.581 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:48:25.598 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2021-06-25T04:48:25.703 INFO:teuthology.orchestra.run.smithi057.stdout:{"mds_min_caps_per_client":"100"} 2021-06-25T04:48:25.703 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2021-06-25T04:48:25.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:48:25.705 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:48:25.706 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:48:25.714 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:48:25.715 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:48:25.717 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-06-25T04:48:25.718 DEBUG:teuthology.orchestra.run.smithi102:> import sys 2021-06-25T04:48:25.718 DEBUG:teuthology.orchestra.run.smithi102:> import time 2021-06-25T04:48:25.719 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:48:25.719 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:48:25.719 DEBUG:teuthology.orchestra.run.smithi102:> n = 1000 2021-06-25T04:48:25.720 DEBUG:teuthology.orchestra.run.smithi102:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-06-25T04:48:25.720 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:48:25.721 DEBUG:teuthology.orchestra.run.smithi102:> if not os.path.exists(os.path.dirname(abs_path)): 2021-06-25T04:48:25.721 DEBUG:teuthology.orchestra.run.smithi102:> os.makedirs(os.path.dirname(abs_path)) 2021-06-25T04:48:25.721 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:48:25.722 DEBUG:teuthology.orchestra.run.smithi102:> for i in range(0, n): 2021-06-25T04:48:25.722 DEBUG:teuthology.orchestra.run.smithi102:> fname = "{0}_{1}".format(abs_path, i) 2021-06-25T04:48:25.723 DEBUG:teuthology.orchestra.run.smithi102:> with open(fname, '"'"'w'"'"') as f: 2021-06-25T04:48:25.723 DEBUG:teuthology.orchestra.run.smithi102:> f.write('"'"'content'"'"') 2021-06-25T04:48:25.724 DEBUG:teuthology.orchestra.run.smithi102:> if True: 2021-06-25T04:48:25.724 DEBUG:teuthology.orchestra.run.smithi102:> f.flush() 2021-06-25T04:48:25.724 DEBUG:teuthology.orchestra.run.smithi102:> os.fsync(f.fileno()) 2021-06-25T04:48:25.725 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:48:37.008 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:48:37.011 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:48:37.013 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:48:37.016 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:48:37.205 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:48:37.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.299+0000 7fc9a981a700 1 Processor -- start 2021-06-25T04:48:37.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.299+0000 7fc9a981a700 1 -- start start 2021-06-25T04:48:37.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a981a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc9a40a7670 0x7fc9a4066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:37.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a981a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a40a7a50 con 0x7fc9a40b0020 2021-06-25T04:48:37.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a981a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a41475e0 con 0x7fc9a40b1930 2021-06-25T04:48:37.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a981a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a4147880 con 0x7fc9a40a7670 2021-06-25T04:48:37.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a37fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc9a40b0020 0x7fc9a4151f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53932/0 (socket says 172.21.15.57:53932) 2021-06-25T04:48:37.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a37fe700 1 -- 172.21.15.57:0/3767437461 learned_addr learned my addr 172.21.15.57:0/3767437461 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:37.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a2ffd700 1 --2- 172.21.15.57:0/3767437461 >> v2:172.21.15.87:3300/0 conn(0x7fc9a40a7670 0x7fc9a4066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:37.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a1ffb700 1 -- 172.21.15.57:0/3767437461 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689018652 0 0) 0x7fc9a40a7a50 con 0x7fc9a40b0020 2021-06-25T04:48:37.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a1ffb700 1 -- 172.21.15.57:0/3767437461 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc988003260 con 0x7fc9a40b0020 2021-06-25T04:48:37.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a2ffd700 1 -- 172.21.15.57:0/3767437461 >> v1:172.21.15.87:6789/0 conn(0x7fc9a40b1930 legacy=0x7fc9a405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a2ffd700 1 -- 172.21.15.57:0/3767437461 >> v1:172.21.15.57:6789/0 conn(0x7fc9a40b0020 legacy=0x7fc9a4151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a2ffd700 1 -- 172.21.15.57:0/3767437461 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4147b20 con 0x7fc9a40a7670 2021-06-25T04:48:37.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a2ffd700 1 --2- 172.21.15.57:0/3767437461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a40a7670 0x7fc9a4066a30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fc998002f70 tx=0x7fc998006df0).ready entity=mon.1 client_cookie=95b5c59dcaad5ec8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:37.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a1ffb700 1 -- 172.21.15.57:0/3767437461 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc99800d610 con 0x7fc9a40a7670 2021-06-25T04:48:37.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a1ffb700 1 -- 172.21.15.57:0/3767437461 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc998000e90 con 0x7fc9a40a7670 2021-06-25T04:48:37.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a1ffb700 1 -- 172.21.15.57:0/3767437461 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc99800d960 con 0x7fc9a40a7670 2021-06-25T04:48:37.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a981a700 1 -- 172.21.15.57:0/3767437461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a40a7670 msgr2=0x7fc9a4066a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a981a700 1 --2- 172.21.15.57:0/3767437461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a40a7670 0x7fc9a4066a30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fc998002f70 tx=0x7fc998006df0).stop 2021-06-25T04:48:37.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a981a700 1 -- 172.21.15.57:0/3767437461 shutdown_connections 2021-06-25T04:48:37.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a981a700 1 --2- 172.21.15.57:0/3767437461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a40a7670 0x7fc9a4066a30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a981a700 1 -- 172.21.15.57:0/3767437461 >> 172.21.15.57:0/3767437461 conn(0x7fc9a40b53a0 msgr2=0x7fc9a40b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:37.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a981a700 1 -- 172.21.15.57:0/3767437461 shutdown_connections 2021-06-25T04:48:37.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.303+0000 7fc9a981a700 1 -- 172.21.15.57:0/3767437461 wait complete. 2021-06-25T04:48:37.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a981a700 1 Processor -- start 2021-06-25T04:48:37.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a981a700 1 -- start start 2021-06-25T04:48:37.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a981a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a40a7670 0x7fc9a4149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:37.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a981a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40b0020 0x7fc9a4144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:37.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a981a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9a40b1930 0x7fc9a4144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:37.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a981a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40ac910 con 0x7fc9a40b0020 2021-06-25T04:48:37.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a981a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40aadd0 con 0x7fc9a40a7670 2021-06-25T04:48:37.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a981a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a4159af0 con 0x7fc9a40b1930 2021-06-25T04:48:37.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40b0020 0x7fc9a4144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:37.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40b0020 0x7fc9a4144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36718/0 (socket says 172.21.15.57:36718) 2021-06-25T04:48:37.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a27fc700 1 -- 172.21.15.57:0/551655028 learned_addr learned my addr 172.21.15.57:0/551655028 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:37.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a2ffd700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a40a7670 0x7fc9a4149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:37.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a37fe700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9a40b1930 0x7fc9a4144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:37.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a27fc700 1 -- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9a40b1930 msgr2=0x7fc9a4144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a27fc700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9a40b1930 0x7fc9a4144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a27fc700 1 -- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a40a7670 msgr2=0x7fc9a4149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a27fc700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a40a7670 0x7fc9a4149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a27fc700 1 -- 172.21.15.57:0/551655028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99800b180 con 0x7fc9a40b0020 2021-06-25T04:48:37.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a27fc700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40b0020 0x7fc9a4144650 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fc9a40aca50 tx=0x7fc994007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:37.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc993fff700 1 -- 172.21.15.57:0/551655028 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc99400ccc0 con 0x7fc9a40b0020 2021-06-25T04:48:37.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc993fff700 1 -- 172.21.15.57:0/551655028 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99400ce20 con 0x7fc9a40b0020 2021-06-25T04:48:37.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc993fff700 1 -- 172.21.15.57:0/551655028 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9940125f0 con 0x7fc9a40b0020 2021-06-25T04:48:37.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a981a700 1 -- 172.21.15.57:0/551655028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a40aa890 con 0x7fc9a40b0020 2021-06-25T04:48:37.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.307+0000 7fc9a981a700 1 -- 172.21.15.57:0/551655028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a4145030 con 0x7fc9a40b0020 2021-06-25T04:48:37.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.311+0000 7fc9a981a700 1 -- 172.21.15.57:0/551655028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a4057310 con 0x7fc9a40b0020 2021-06-25T04:48:37.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.311+0000 7fc993fff700 1 -- 172.21.15.57:0/551655028 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc994019030 con 0x7fc9a40b0020 2021-06-25T04:48:37.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.311+0000 7fc993fff700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc980055450 0x7fc980057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:37.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.311+0000 7fc993fff700 1 -- 172.21.15.57:0/551655028 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc99406d0e0 con 0x7fc9a40b0020 2021-06-25T04:48:37.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.311+0000 7fc9a2ffd700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc980055450 0x7fc980057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.311+0000 7fc9a2ffd700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc980055450 0x7fc980057910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc998019000 tx=0x7fc998014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:37.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.319+0000 7fc993fff700 1 -- 172.21.15.57:0/551655028 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc994043290 con 0x7fc9a40b0020 2021-06-25T04:48:37.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.483+0000 7fc9a981a700 1 -- 172.21.15.57:0/551655028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9a40ab4c0 con 0x7fc9a40b0020 2021-06-25T04:48:37.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.483+0000 7fc993fff700 1 -- 172.21.15.57:0/551655028 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7fc9940468b0 con 0x7fc9a40b0020 2021-06-25T04:48:37.492 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:37.492 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3329294132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329294132},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329294132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/1504287390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1504287390},{"type":"v1","addr":"172.21.15.57:6833","nonce":1504287390}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:48:18.873057+0000","modified":"2021-06-25T04:48:19.875996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2421744077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2421744077},{"type":"v1","addr":"172.21.15.57:6835","nonce":2421744077}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-06-25T04:48:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 -- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc980055450 msgr2=0x7fc980057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc980055450 0x7fc980057910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc998019000 tx=0x7fc998014000).stop 2021-06-25T04:48:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 -- 172.21.15.57:0/551655028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40b0020 msgr2=0x7fc9a4144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40b0020 0x7fc9a4144650 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fc9a40aca50 tx=0x7fc994007c20).stop 2021-06-25T04:48:37.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 -- 172.21.15.57:0/551655028 shutdown_connections 2021-06-25T04:48:37.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc980055450 0x7fc980057910 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9a40b1930 0x7fc9a4144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40b0020 0x7fc9a4144650 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 --2- 172.21.15.57:0/551655028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a40a7670 0x7fc9a4149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 -- 172.21.15.57:0/551655028 >> 172.21.15.57:0/551655028 conn(0x7fc9a40b53a0 msgr2=0x7fc9a414a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:37.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 -- 172.21.15.57:0/551655028 shutdown_connections 2021-06-25T04:48:37.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.487+0000 7fc9a981a700 1 -- 172.21.15.57:0/551655028 wait complete. 2021-06-25T04:48:37.498 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 13 2021-06-25T04:48:37.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-06-25T04:48:37.604 INFO:teuthology.orchestra.run.smithi057.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-06-25T04:48:37.604 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-06-25T04:48:37.605 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:48:37.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.695+0000 7f8751396700 1 Processor -- start 2021-06-25T04:48:37.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.695+0000 7f8751396700 1 -- start start 2021-06-25T04:48:37.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.695+0000 7f8751396700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f874c0aad40 0x7f874c0672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:37.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.695+0000 7f8751396700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0ab120 0x7f874c0647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:37.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.695+0000 7f8751396700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874c065920 con 0x7f874c064cb0 2021-06-25T04:48:37.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.695+0000 7f8751396700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874c0b3ca0 con 0x7f874c0aad40 2021-06-25T04:48:37.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.695+0000 7f8751396700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c066e20 con 0x7f874c0ab120 2021-06-25T04:48:37.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f874c0aad40 0x7f874c0672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:37.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874b7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0ab120 0x7f874c0647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:37.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874b7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0ab120 0x7f874c0647c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:47888/0 (socket says 172.21.15.57:47888) 2021-06-25T04:48:37.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874b7fe700 1 -- 172.21.15.57:0/1108648369 learned_addr learned my addr 172.21.15.57:0/1108648369 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:37.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874bfff700 1 --2- 172.21.15.57:0/1108648369 >> v2:172.21.15.87:3300/0 conn(0x7f874c0aad40 0x7f874c0672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:45220/0 (socket says 172.21.15.57:45220) 2021-06-25T04:48:37.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874b7fe700 1 -- 172.21.15.57:0/1108648369 >> v2:172.21.15.87:3300/0 conn(0x7f874c0aad40 msgr2=0x7f874c0672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:37.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874b7fe700 1 --2- 172.21.15.57:0/1108648369 >> v2:172.21.15.87:3300/0 conn(0x7f874c0aad40 0x7f874c0672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874b7fe700 1 -- 172.21.15.57:0/1108648369 >> v1:172.21.15.87:6789/0 conn(0x7f874c064cb0 legacy=0x7f874c0b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874b7fe700 1 -- 172.21.15.57:0/1108648369 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c0b7bf0 con 0x7f874c0ab120 2021-06-25T04:48:37.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874b7fe700 1 --2- 172.21.15.57:0/1108648369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0ab120 0x7f874c0647c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f873c0032f0 tx=0x7f873c009250).ready entity=mon.2 client_cookie=a4182637ca8c280d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:37.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874affd700 1 -- 172.21.15.57:0/1108648369 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f873c009ea0 con 0x7f874c0ab120 2021-06-25T04:48:37.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874affd700 1 -- 172.21.15.57:0/1108648369 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00b870 con 0x7f874c0ab120 2021-06-25T04:48:37.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f874affd700 1 -- 172.21.15.57:0/1108648369 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f873c00ba20 con 0x7f874c0ab120 2021-06-25T04:48:37.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f8751396700 1 -- 172.21.15.57:0/1108648369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0ab120 msgr2=0x7f874c0647c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f8751396700 1 --2- 172.21.15.57:0/1108648369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0ab120 0x7f874c0647c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f873c0032f0 tx=0x7f873c009250).stop 2021-06-25T04:48:37.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f8751396700 1 -- 172.21.15.57:0/1108648369 shutdown_connections 2021-06-25T04:48:37.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f8751396700 1 --2- 172.21.15.57:0/1108648369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0ab120 0x7f874c0647c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f8751396700 1 --2- 172.21.15.57:0/1108648369 >> v2:172.21.15.87:3300/0 conn(0x7f874c0aad40 0x7f874c0672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f8751396700 1 -- 172.21.15.57:0/1108648369 >> 172.21.15.57:0/1108648369 conn(0x7f874c062ba0 msgr2=0x7f874c05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:37.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f8751396700 1 -- 172.21.15.57:0/1108648369 shutdown_connections 2021-06-25T04:48:37.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.699+0000 7f8751396700 1 -- 172.21.15.57:0/1108648369 wait complete. 2021-06-25T04:48:37.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8751396700 1 Processor -- start 2021-06-25T04:48:37.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8751396700 1 -- start start 2021-06-25T04:48:37.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8751396700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0aad40 0x7f874c0adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:37.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8751396700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f874c0ab120 0x7f874c0ab970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:37.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8751396700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874c141a50 0x7f874c13fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:37.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8751396700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c062790 con 0x7f874c141a50 2021-06-25T04:48:37.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8751396700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0ae7d0 con 0x7f874c0ab120 2021-06-25T04:48:37.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8751396700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0ae530 con 0x7f874c0aad40 2021-06-25T04:48:37.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8750b95700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874c141a50 0x7f874c13fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:37.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8750b95700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874c141a50 0x7f874c13fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36730/0 (socket says 172.21.15.57:36730) 2021-06-25T04:48:37.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8750b95700 1 -- 172.21.15.57:0/3228075669 learned_addr learned my addr 172.21.15.57:0/3228075669 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:37.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f874bfff700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0aad40 0x7f874c0adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:37.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f874b7fe700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f874c0ab120 0x7f874c0ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:37.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8750b95700 1 -- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0aad40 msgr2=0x7f874c0adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8750b95700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0aad40 0x7f874c0adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8750b95700 1 -- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f874c0ab120 msgr2=0x7f874c0ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8750b95700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f874c0ab120 0x7f874c0ab970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8750b95700 1 -- 172.21.15.57:0/3228075669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c0094d0 con 0x7f874c141a50 2021-06-25T04:48:37.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8750b95700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874c141a50 0x7f874c13fc80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f874c0628d0 tx=0x7f8744007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:37.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f87497fa700 1 -- 172.21.15.57:0/3228075669 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8744012400 con 0x7f874c141a50 2021-06-25T04:48:37.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f87497fa700 1 -- 172.21.15.57:0/3228075669 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8744012560 con 0x7f874c141a50 2021-06-25T04:48:37.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8751396700 1 -- 172.21.15.57:0/3228075669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874c060a90 con 0x7f874c141a50 2021-06-25T04:48:37.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f87497fa700 1 -- 172.21.15.57:0/3228075669 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87440128c0 con 0x7f874c141a50 2021-06-25T04:48:37.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.703+0000 7f8751396700 1 -- 172.21.15.57:0/3228075669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c060f30 con 0x7f874c141a50 2021-06-25T04:48:37.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.707+0000 7f8751396700 1 -- 172.21.15.57:0/3228075669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874c060c20 con 0x7f874c141a50 2021-06-25T04:48:37.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.707+0000 7f87497fa700 1 -- 172.21.15.57:0/3228075669 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8744019030 con 0x7f874c141a50 2021-06-25T04:48:37.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.707+0000 7f87497fa700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f872c0553d0 0x7f872c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:37.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.707+0000 7f87497fa700 1 -- 172.21.15.57:0/3228075669 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f874406d310 con 0x7f874c141a50 2021-06-25T04:48:37.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.707+0000 7f874bfff700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f872c0553d0 0x7f872c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:37.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.707+0000 7f874bfff700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f872c0553d0 0x7f872c057890 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f874000b000 tx=0x7f8740006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:37.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.715+0000 7f87497fa700 1 -- 172.21.15.57:0/3228075669 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f87440433b0 con 0x7f874c141a50 2021-06-25T04:48:37.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f8751396700 1 -- 172.21.15.57:0/3228075669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f874c057310 con 0x7f874c141a50 2021-06-25T04:48:37.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f87497fa700 1 -- 172.21.15.57:0/3228075669 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f87440469d0 con 0x7f874c141a50 2021-06-25T04:48:37.988 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:37.989 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3329294132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329294132},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329294132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/1504287390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1504287390},{"type":"v1","addr":"172.21.15.57:6833","nonce":1504287390}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:48:18.873057+0000","modified":"2021-06-25T04:48:19.875996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2421744077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2421744077},{"type":"v1","addr":"172.21.15.57:6835","nonce":2421744077}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-06-25T04:48:37.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f8751396700 1 -- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f872c0553d0 msgr2=0x7f872c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f8751396700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f872c0553d0 0x7f872c057890 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f874000b000 tx=0x7f8740006df0).stop 2021-06-25T04:48:37.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f8751396700 1 -- 172.21.15.57:0/3228075669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874c141a50 msgr2=0x7f874c13fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:37.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f8751396700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874c141a50 0x7f874c13fc80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f874c0628d0 tx=0x7f8744007b90).stop 2021-06-25T04:48:37.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f8751396700 1 -- 172.21.15.57:0/3228075669 shutdown_connections 2021-06-25T04:48:37.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f8751396700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f872c0553d0 0x7f872c057890 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f8751396700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874c141a50 0x7f874c13fc80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f8751396700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f874c0ab120 0x7f874c0ab970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f8751396700 1 --2- 172.21.15.57:0/3228075669 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f874c0aad40 0x7f874c0adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:37.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.879+0000 7f8751396700 1 -- 172.21.15.57:0/3228075669 >> 172.21.15.57:0/3228075669 conn(0x7f874c062ba0 msgr2=0x7f874c1422b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:37.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.883+0000 7f8751396700 1 -- 172.21.15.57:0/3228075669 shutdown_connections 2021-06-25T04:48:37.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:37.883+0000 7f8751396700 1 -- 172.21.15.57:0/3228075669 wait complete. 2021-06-25T04:48:38.000 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 13 2021-06-25T04:48:38.001 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-06-25T04:48:38.124 INFO:teuthology.orchestra.run.smithi057.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-06-25T04:48:38.125 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-06-25T04:48:38.126 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:48:38.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff376da6700 1 Processor -- start 2021-06-25T04:48:38.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff376da6700 1 -- start start 2021-06-25T04:48:38.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff376da6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff3700b2770 0x7ff370147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff376da6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff37005f670 0x7ff370060c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff376da6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3700b35e0 con 0x7ff3700b3200 2021-06-25T04:48:38.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff376da6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37005fa80 con 0x7ff3700b2770 2021-06-25T04:48:38.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff376da6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff370146830 con 0x7ff37005f670 2021-06-25T04:48:38.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff36ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff3700b2770 0x7ff370147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff36ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff3700b2770 0x7ff370147210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36740/0 (socket says 172.21.15.57:36740) 2021-06-25T04:48:38.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff36ffff700 1 -- 172.21.15.57:0/3221609332 learned_addr learned my addr 172.21.15.57:0/3221609332 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:38.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff375343700 1 --2- 172.21.15.57:0/3221609332 >> v2:172.21.15.87:3300/0 conn(0x7ff37005f670 0x7ff370060c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff36ffff700 1 -- 172.21.15.57:0/3221609332 >> v2:172.21.15.87:3300/0 conn(0x7ff37005f670 msgr2=0x7ff370060c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:38.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff36ffff700 1 --2- 172.21.15.57:0/3221609332 >> v2:172.21.15.87:3300/0 conn(0x7ff37005f670 0x7ff370060c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff36ffff700 1 -- 172.21.15.57:0/3221609332 >> v1:172.21.15.87:6789/0 conn(0x7ff3700b3200 legacy=0x7ff370060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:38.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.219+0000 7ff36ffff700 1 -- 172.21.15.57:0/3221609332 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff370146ad0 con 0x7ff3700b2770 2021-06-25T04:48:38.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff36ffff700 1 --2- 172.21.15.57:0/3221609332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3700b2770 0x7ff370147210 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7ff3700b3880 tx=0x7ff35c006eb0).ready entity=mon.0 client_cookie=3732ed2704143e4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:38.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff36f7fe700 1 -- 172.21.15.57:0/3221609332 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff35c00d5c0 con 0x7ff3700b2770 2021-06-25T04:48:38.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff36f7fe700 1 -- 172.21.15.57:0/3221609332 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c000e90 con 0x7ff3700b2770 2021-06-25T04:48:38.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff36f7fe700 1 -- 172.21.15.57:0/3221609332 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff35c00d910 con 0x7ff3700b2770 2021-06-25T04:48:38.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 -- 172.21.15.57:0/3221609332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3700b2770 msgr2=0x7ff370147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 --2- 172.21.15.57:0/3221609332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3700b2770 0x7ff370147210 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7ff3700b3880 tx=0x7ff35c006eb0).stop 2021-06-25T04:48:38.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 -- 172.21.15.57:0/3221609332 shutdown_connections 2021-06-25T04:48:38.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 --2- 172.21.15.57:0/3221609332 >> v2:172.21.15.87:3300/0 conn(0x7ff37005f670 0x7ff370060c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 --2- 172.21.15.57:0/3221609332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3700b2770 0x7ff370147210 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 -- 172.21.15.57:0/3221609332 >> 172.21.15.57:0/3221609332 conn(0x7ff37005c450 msgr2=0x7ff37005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:38.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 -- 172.21.15.57:0/3221609332 shutdown_connections 2021-06-25T04:48:38.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 -- 172.21.15.57:0/3221609332 wait complete. 2021-06-25T04:48:38.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 Processor -- start 2021-06-25T04:48:38.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 -- start start 2021-06-25T04:48:38.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff37005f670 0x7ff3700b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3700b2770 0x7ff3700a9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3700b3200 0x7ff3700a9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700afaa0 con 0x7ff3700b2770 2021-06-25T04:48:38.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700ac5f0 con 0x7ff37005f670 2021-06-25T04:48:38.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff376da6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700ac850 con 0x7ff3700b3200 2021-06-25T04:48:38.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff36ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3700b2770 0x7ff3700a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff36ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3700b2770 0x7ff3700a9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36746/0 (socket says 172.21.15.57:36746) 2021-06-25T04:48:38.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.223+0000 7ff36ffff700 1 -- 172.21.15.57:0/6761394 learned_addr learned my addr 172.21.15.57:0/6761394 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:38.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff374b42700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff37005f670 0x7ff3700b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff375343700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3700b3200 0x7ff3700a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36ffff700 1 -- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3700b3200 msgr2=0x7ff3700a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36ffff700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3700b3200 0x7ff3700a9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36ffff700 1 -- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff37005f670 msgr2=0x7ff3700b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36ffff700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff37005f670 0x7ff3700b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36ffff700 1 -- 172.21.15.57:0/6761394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c00b1e0 con 0x7ff3700b2770 2021-06-25T04:48:38.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36ffff700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3700b2770 0x7ff3700a9240 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7ff3700b3880 tx=0x7ff35c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:38.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36dffb700 1 -- 172.21.15.57:0/6761394 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff35c021070 con 0x7ff3700b2770 2021-06-25T04:48:38.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36dffb700 1 -- 172.21.15.57:0/6761394 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c000e90 con 0x7ff3700b2770 2021-06-25T04:48:38.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36dffb700 1 -- 172.21.15.57:0/6761394 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff35c006be0 con 0x7ff3700b2770 2021-06-25T04:48:38.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff376da6700 1 -- 172.21.15.57:0/6761394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3700aebc0 con 0x7ff3700b2770 2021-06-25T04:48:38.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff376da6700 1 -- 172.21.15.57:0/6761394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3700abc20 con 0x7ff3700b2770 2021-06-25T04:48:38.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff376da6700 1 -- 172.21.15.57:0/6761394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff370057310 con 0x7ff3700b2770 2021-06-25T04:48:38.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36dffb700 1 -- 172.21.15.57:0/6761394 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff35c00f070 con 0x7ff3700b2770 2021-06-25T04:48:38.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36dffb700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff358055450 0x7ff358057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff36dffb700 1 -- 172.21.15.57:0/6761394 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff35c06f210 con 0x7ff3700b2770 2021-06-25T04:48:38.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff374b42700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff358055450 0x7ff358057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.227+0000 7ff374b42700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff358055450 0x7ff358057910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7ff36400a000 tx=0x7ff364008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:38.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.231+0000 7ff36dffb700 1 -- 172.21.15.57:0/6761394 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff35c0453c0 con 0x7ff3700b2770 2021-06-25T04:48:38.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.391+0000 7ff376da6700 1 -- 172.21.15.57:0/6761394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff37005d720 con 0x7ff3700b2770 2021-06-25T04:48:38.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.391+0000 7ff36dffb700 1 -- 172.21.15.57:0/6761394 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7ff35c0489e0 con 0x7ff3700b2770 2021-06-25T04:48:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:48:38.399 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3329294132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329294132},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329294132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/1504287390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1504287390},{"type":"v1","addr":"172.21.15.57:6833","nonce":1504287390}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:48:18.873057+0000","modified":"2021-06-25T04:48:19.875996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2421744077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2421744077},{"type":"v1","addr":"172.21.15.57:6835","nonce":2421744077}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-06-25T04:48:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.391+0000 7ff376da6700 1 -- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff358055450 msgr2=0x7ff358057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.391+0000 7ff376da6700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff358055450 0x7ff358057910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7ff36400a000 tx=0x7ff364008040).stop 2021-06-25T04:48:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.391+0000 7ff376da6700 1 -- 172.21.15.57:0/6761394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3700b2770 msgr2=0x7ff3700a9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.391+0000 7ff376da6700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3700b2770 0x7ff3700a9240 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7ff3700b3880 tx=0x7ff35c015000).stop 2021-06-25T04:48:38.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.395+0000 7ff376da6700 1 -- 172.21.15.57:0/6761394 shutdown_connections 2021-06-25T04:48:38.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.395+0000 7ff376da6700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff358055450 0x7ff358057910 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.395+0000 7ff376da6700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3700b3200 0x7ff3700a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.395+0000 7ff376da6700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3700b2770 0x7ff3700a9240 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.395+0000 7ff376da6700 1 --2- 172.21.15.57:0/6761394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff37005f670 0x7ff3700b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.395+0000 7ff376da6700 1 -- 172.21.15.57:0/6761394 >> 172.21.15.57:0/6761394 conn(0x7ff37005c450 msgr2=0x7ff370060120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.395+0000 7ff376da6700 1 -- 172.21.15.57:0/6761394 shutdown_connections 2021-06-25T04:48:38.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.395+0000 7ff376da6700 1 -- 172.21.15.57:0/6761394 wait complete. 2021-06-25T04:48:38.405 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 13 2021-06-25T04:48:38.412 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 2021-06-25T04:48:38.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.511+0000 7f049f59e700 1 Processor -- start 2021-06-25T04:48:38.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.511+0000 7f049f59e700 1 -- start start 2021-06-25T04:48:38.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04a00b3020 0x7f04a00b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049f59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a00b2340 con 0x7f04a00b7330 2021-06-25T04:48:38.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049f59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a0144210 con 0x7f04a00aabe0 2021-06-25T04:48:38.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a00b3530 con 0x7f04a00b3020 2021-06-25T04:48:38.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049e59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f04a00b7330 0x7f04a013e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53970/0 (socket says 172.21.15.57:53970) 2021-06-25T04:48:38.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049e59c700 1 -- 172.21.15.57:0/2430326903 learned_addr learned my addr 172.21.15.57:0/2430326903 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:48:38.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049dd9b700 1 --2- 172.21.15.57:0/2430326903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04a00b3020 0x7f04a00b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049d59a700 1 -- 172.21.15.57:0/2430326903 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558662606 0 0) 0x7f04a00b2340 con 0x7f04a00b7330 2021-06-25T04:48:38.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049d59a700 1 -- 172.21.15.57:0/2430326903 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0484003260 con 0x7f04a00b7330 2021-06-25T04:48:38.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049d59a700 1 -- 172.21.15.57:0/2430326903 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567670856 0 0) 0x7f04a0144210 con 0x7f04a00aabe0 2021-06-25T04:48:38.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049dd9b700 1 -- 172.21.15.57:0/2430326903 >> v1:172.21.15.87:6789/0 conn(0x7f04a00aabe0 legacy=0x7f04a0064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049dd9b700 1 -- 172.21.15.57:0/2430326903 >> v1:172.21.15.57:6789/0 conn(0x7f04a00b7330 legacy=0x7f04a013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049dd9b700 1 -- 172.21.15.57:0/2430326903 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a00b2570 con 0x7f04a00b3020 2021-06-25T04:48:38.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049dd9b700 1 --2- 172.21.15.57:0/2430326903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04a00b3020 0x7f04a00b7710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0488002f70 tx=0x7f0488006df0).ready entity=mon.2 client_cookie=cc2cab4d60958ed3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:38.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049d59a700 1 -- 172.21.15.57:0/2430326903 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f048800d570 con 0x7f04a00b3020 2021-06-25T04:48:38.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049d59a700 1 -- 172.21.15.57:0/2430326903 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0488000e90 con 0x7f04a00b3020 2021-06-25T04:48:38.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049f59e700 1 -- 172.21.15.57:0/2430326903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04a00b3020 msgr2=0x7f04a00b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049d59a700 1 -- 172.21.15.57:0/2430326903 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f048800d8c0 con 0x7f04a00b3020 2021-06-25T04:48:38.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049f59e700 1 --2- 172.21.15.57:0/2430326903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04a00b3020 0x7f04a00b7710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0488002f70 tx=0x7f0488006df0).stop 2021-06-25T04:48:38.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049f59e700 1 -- 172.21.15.57:0/2430326903 shutdown_connections 2021-06-25T04:48:38.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049f59e700 1 --2- 172.21.15.57:0/2430326903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04a00b3020 0x7f04a00b7710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049f59e700 1 -- 172.21.15.57:0/2430326903 >> 172.21.15.57:0/2430326903 conn(0x7f04a005f670 msgr2=0x7f04a005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:38.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049f59e700 1 -- 172.21.15.57:0/2430326903 shutdown_connections 2021-06-25T04:48:38.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.515+0000 7f049f59e700 1 -- 172.21.15.57:0/2430326903 wait complete. 2021-06-25T04:48:38.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049f59e700 1 Processor -- start 2021-06-25T04:48:38.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049f59e700 1 -- start start 2021-06-25T04:48:38.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04a00aabe0 0x7f04a0143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a00b3020 0x7f04a00b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04a00b7330 0x7f04a0145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049f59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a00acf20 con 0x7f04a00b7330 2021-06-25T04:48:38.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a0148460 con 0x7f04a00b3020 2021-06-25T04:48:38.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a00abcb0 con 0x7f04a00aabe0 2021-06-25T04:48:38.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04a00b7330 0x7f04a0145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04a00b7330 0x7f04a0145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36762/0 (socket says 172.21.15.57:36762) 2021-06-25T04:48:38.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049ed9d700 1 -- 172.21.15.57:0/556935602 learned_addr learned my addr 172.21.15.57:0/556935602 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:38.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049e59c700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04a00aabe0 0x7f04a0143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049dd9b700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a00b3020 0x7f04a00b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049ed9d700 1 -- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04a00aabe0 msgr2=0x7f04a0143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049ed9d700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04a00aabe0 0x7f04a0143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049ed9d700 1 -- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a00b3020 msgr2=0x7f04a00b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049ed9d700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a00b3020 0x7f04a00b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049ed9d700 1 -- 172.21.15.57:0/556935602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048800b180 con 0x7f04a00b7330 2021-06-25T04:48:38.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.519+0000 7f049ed9d700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04a00b7330 0x7f04a0145b30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f0498001250 tx=0x7f0498007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:38.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.523+0000 7f04977fe700 1 -- 172.21.15.57:0/556935602 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049800f470 con 0x7f04a00b7330 2021-06-25T04:48:38.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.523+0000 7f04977fe700 1 -- 172.21.15.57:0/556935602 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049800f5d0 con 0x7f04a00b7330 2021-06-25T04:48:38.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.523+0000 7f049f59e700 1 -- 172.21.15.57:0/556935602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a00ad150 con 0x7f04a00b7330 2021-06-25T04:48:38.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.523+0000 7f04977fe700 1 -- 172.21.15.57:0/556935602 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049800f930 con 0x7f04a00b7330 2021-06-25T04:48:38.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.523+0000 7f049f59e700 1 -- 172.21.15.57:0/556935602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a00b6ae0 con 0x7f04a00b7330 2021-06-25T04:48:38.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.523+0000 7f04977fe700 1 -- 172.21.15.57:0/556935602 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0498019030 con 0x7f04a00b7330 2021-06-25T04:48:38.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.523+0000 7f04977fe700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0478055510 0x7f04780579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.523+0000 7f04977fe700 1 -- 172.21.15.57:0/556935602 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f049806d3c0 con 0x7f04a00b7330 2021-06-25T04:48:38.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049e59c700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0478055510 0x7f04780579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049e59c700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0478055510 0x7f04780579d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f049000d000 tx=0x7f0490009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:38.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f04aee96740 1 Processor -- start 2021-06-25T04:48:38.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f04aee96740 1 -- start start 2021-06-25T04:48:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f04aee96740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x290c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f04aee96740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x290f4f0 0x2909340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f04aee96740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2909830 0x2909cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f04aee96740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x287d650 con 0x2909830 2021-06-25T04:48:38.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f04aee96740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x287d790 con 0x290f4f0 2021-06-25T04:48:38.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f04aee96740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x287ee60 con 0x290dc30 2021-06-25T04:48:38.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2909830 0x2909cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049e59c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x290c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2909830 0x2909cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36770/0 (socket says 172.21.15.57:36770) 2021-06-25T04:48:38.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049ed9d700 1 -- 172.21.15.57:0/3191004940 learned_addr learned my addr 172.21.15.57:0/3191004940 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:38.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049dd9b700 1 --2- 172.21.15.57:0/3191004940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x290f4f0 0x2909340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049ed9d700 1 -- 172.21.15.57:0/3191004940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 msgr2=0x290c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:38.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049ed9d700 1 --2- 172.21.15.57:0/3191004940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x290c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049ed9d700 1 -- 172.21.15.57:0/3191004940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x290f4f0 msgr2=0x2909340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:38.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049ed9d700 1 --2- 172.21.15.57:0/3191004940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x290f4f0 0x2909340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049ed9d700 1 -- 172.21.15.57:0/3191004940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28b6750 con 0x2909830 2021-06-25T04:48:38.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049ed9d700 1 --2- 172.21.15.57:0/3191004940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2909830 0x2909cb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f049806d5d0 tx=0x7f0498010000).ready entity=mon.0 client_cookie=98f842e84202b929 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:38.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049f59e700 1 -- 172.21.15.57:0/3191004940 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04980430d0 con 0x2909830 2021-06-25T04:48:38.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049f59e700 1 -- 172.21.15.57:0/3191004940 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0498043230 con 0x2909830 2021-06-25T04:48:38.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f049f59e700 1 -- 172.21.15.57:0/3191004940 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0498046240 con 0x2909830 2021-06-25T04:48:38.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f04aee96740 1 -- 172.21.15.57:0/3191004940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2909830 msgr2=0x2909cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.527+0000 7f04aee96740 1 --2- 172.21.15.57:0/3191004940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2909830 0x2909cb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f049806d5d0 tx=0x7f0498010000).stop 2021-06-25T04:48:38.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 -- 172.21.15.57:0/3191004940 shutdown_connections 2021-06-25T04:48:38.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 --2- 172.21.15.57:0/3191004940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2909830 0x2909cb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 --2- 172.21.15.57:0/3191004940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x290f4f0 0x2909340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 --2- 172.21.15.57:0/3191004940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x290c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 -- 172.21.15.57:0/3191004940 >> 172.21.15.57:0/3191004940 conn(0x290a5d0 msgr2=0x290b500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:38.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 -- 172.21.15.57:0/3191004940 shutdown_connections 2021-06-25T04:48:38.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 -- 172.21.15.57:0/3191004940 wait complete. 2021-06-25T04:48:38.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 -- start start 2021-06-25T04:48:38.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 Processor -- start 2021-06-25T04:48:38.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x2946d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x293fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x29393b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x29455c0 con 0x290f4f0 2021-06-25T04:48:38.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x2953ab0 con 0x29471f0 2021-06-25T04:48:38.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x2953d50 con 0x290dc30 2021-06-25T04:48:38.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f04aee96740 10 client.0 ll_register_callbacks cb 0x28c5d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-06-25T04:48:38.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f049dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x293fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f049e59c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x2946d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f049ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x29393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f049dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x293fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36774/0 (socket says 172.21.15.57:36774) 2021-06-25T04:48:38.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f049dd9b700 1 -- 172.21.15.57:0/3275783201 learned_addr learned my addr 172.21.15.57:0/3275783201 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:38.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f049dd9b700 1 -- 172.21.15.57:0/3275783201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 msgr2=0x2946d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:38.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f049dd9b700 1 --2- 172.21.15.57:0/3275783201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x2946d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f049dd9b700 1 -- 172.21.15.57:0/3275783201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 msgr2=0x29393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:38.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f049dd9b700 1 --2- 172.21.15.57:0/3275783201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x29393b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f049dd9b700 1 -- 172.21.15.57:0/3275783201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a00b6ae0 con 0x290f4f0 2021-06-25T04:48:38.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.531+0000 7f049dd9b700 1 --2- 172.21.15.57:0/3275783201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x293fd50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f0488019000 tx=0x7f0488014000).ready entity=mon.0 client_cookie=ade976c13d43d65e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:38.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f048d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2021-06-25T04:48:38.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f048d7fa700 1 -- 172.21.15.57:0/3275783201 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0488025070 con 0x290f4f0 2021-06-25T04:48:38.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f04aee96740 1 -- 172.21.15.57:0/3275783201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x26f7c20 con 0x290f4f0 2021-06-25T04:48:38.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f048d7fa700 1 -- 172.21.15.57:0/3275783201 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0488012460 con 0x290f4f0 2021-06-25T04:48:38.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f048d7fa700 1 -- 172.21.15.57:0/3275783201 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0488012620 con 0x290f4f0 2021-06-25T04:48:38.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f04aee96740 10 client.5133 fetch_fsmap learned FSMap version 13 2021-06-25T04:48:38.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f04aee96740 1 -- 172.21.15.57:0/3275783201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x286dcf0 con 0x290f4f0 2021-06-25T04:48:38.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f048d7fa700 1 -- 172.21.15.57:0/3275783201 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x26f7c20 con 0x290f4f0 2021-06-25T04:48:38.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f048d7fa700 1 -- 172.21.15.57:0/3275783201 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 13) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f0488010070 con 0x290f4f0 2021-06-25T04:48:38.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f04aee96740 10 client.5133 fetch_fsmap finished waiting for FSMap version 13 2021-06-25T04:48:38.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f04aee96740 10 client.5133 resolve_mds: resolved ID 'a' to GID 4926 2021-06-25T04:48:38.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f04aee96740 20 client.5133 populate_metadata read hostname 'smithi057' 2021-06-25T04:48:38.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f04aee96740 1 --2- 172.21.15.57:0/3275783201 >> [v2:172.21.15.57:6834/2421744077,v1:172.21.15.57:6835/2421744077] conn(0x29398a0 0x29564f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f04aee96740 4 client.5133 mds_command: new command op to 4926 tid=0[{"prefix": "get_command_descriptions"}] 2021-06-25T04:48:38.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f04aee96740 1 -- 172.21.15.57:0/3275783201 --> [v2:172.21.15.57:6834/2421744077,v1:172.21.15.57:6835/2421744077] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x270d460 con 0x29398a0 2021-06-25T04:48:38.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.535+0000 7f049e59c700 1 --2- 172.21.15.57:0/3275783201 >> [v2:172.21.15.57:6834/2421744077,v1:172.21.15.57:6835/2421744077] conn(0x29398a0 0x29564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f048d7fa700 10 client.5133 ms_handle_connect on v2:172.21.15.57:6834/2421744077 2021-06-25T04:48:38.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f049e59c700 1 --2- 172.21.15.57:0/3275783201 >> [v2:172.21.15.57:6834/2421744077,v1:172.21.15.57:6835/2421744077] conn(0x29398a0 0x29564f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=63dcd4dcdec40bea server_cookie=1a9960032c77e873 in_seq=0 out_seq=0 2021-06-25T04:48:38.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f048d7fa700 1 -- 172.21.15.57:0/3275783201 <== mds.0 v2:172.21.15.57:6834/2421744077 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x270d460 con 0x29398a0 2021-06-25T04:48:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f048d7fa700 10 client.5133 handle_command_reply: tid=0 2021-06-25T04:48:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 1 client.5133 shutdown 2021-06-25T04:48:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 1 -- 172.21.15.57:0/3275783201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 msgr2=0x293fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 1 --2- 172.21.15.57:0/3275783201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x293fd50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f0488019000 tx=0x7f0488014000).stop 2021-06-25T04:48:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 1 -- 172.21.15.57:0/3275783201 shutdown_connections 2021-06-25T04:48:38.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 1 --2- 172.21.15.57:0/3275783201 >> [v2:172.21.15.57:6834/2421744077,v1:172.21.15.57:6835/2421744077] conn(0x29398a0 0x29564f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 1 --2- 172.21.15.57:0/3275783201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x29393b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 1 --2- 172.21.15.57:0/3275783201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x293fd50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 1 --2- 172.21.15.57:0/3275783201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x2946d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 1 -- 172.21.15.57:0/3275783201 >> 172.21.15.57:0/3275783201 conn(0x2909830 msgr2=0x290ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f048d7fa700 0 client.5133 ms_handle_reset on v2:172.21.15.57:6834/2421744077 2021-06-25T04:48:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 1 -- 172.21.15.57:0/3275783201 shutdown_connections 2021-06-25T04:48:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 1 -- 172.21.15.57:0/3275783201 wait complete. 2021-06-25T04:48:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.539+0000 7f04aee96740 20 client.5133 trim_cache size 0 max 16384 2021-06-25T04:48:38.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.551+0000 7f04aee96740 1 Processor -- start 2021-06-25T04:48:38.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.551+0000 7f04aee96740 1 -- start start 2021-06-25T04:48:38.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290dc30 0x29394a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290f4f0 0x2939990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x29448d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x2942040 con 0x290dc30 2021-06-25T04:48:38.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x2910520 con 0x29471f0 2021-06-25T04:48:38.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x2942250 con 0x290f4f0 2021-06-25T04:48:38.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f049e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290dc30 0x29394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f049dd9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290f4f0 0x2939990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f049e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290dc30 0x29394a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36780/0 (socket says 172.21.15.57:36780) 2021-06-25T04:48:38.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f049e59c700 1 -- 172.21.15.57:0/1500237366 learned_addr learned my addr 172.21.15.57:0/1500237366 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:38.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f049ed9d700 1 --2- 172.21.15.57:0/1500237366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x29448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f049dd9b700 1 -- 172.21.15.57:0/1500237366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 msgr2=0x29448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:38.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f049dd9b700 1 --2- 172.21.15.57:0/1500237366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x29448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f049dd9b700 1 -- 172.21.15.57:0/1500237366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290dc30 msgr2=0x29394a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:38.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f049dd9b700 1 --2- 172.21.15.57:0/1500237366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290dc30 0x29394a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f049dd9b700 1 -- 172.21.15.57:0/1500237366 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a00b5a80 con 0x290f4f0 2021-06-25T04:48:38.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f049dd9b700 1 --2- 172.21.15.57:0/1500237366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290f4f0 0x2939990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x290bb90 tx=0x7f0488021000).ready entity=mon.2 client_cookie=a83aee1148de3daa server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:38.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f048f7fe700 1 -- 172.21.15.57:0/1500237366 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0488025040 con 0x290f4f0 2021-06-25T04:48:38.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f048f7fe700 1 -- 172.21.15.57:0/1500237366 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048802a5f0 con 0x290f4f0 2021-06-25T04:48:38.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f048f7fe700 1 -- 172.21.15.57:0/1500237366 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f048802aa30 con 0x290f4f0 2021-06-25T04:48:38.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 -- 172.21.15.57:0/1500237366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290f4f0 msgr2=0x2939990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:48:38.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 --2- 172.21.15.57:0/1500237366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290f4f0 0x2939990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x290bb90 tx=0x7f0488021000).stop 2021-06-25T04:48:38.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 -- 172.21.15.57:0/1500237366 shutdown_connections 2021-06-25T04:48:38.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 --2- 172.21.15.57:0/1500237366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x29448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 --2- 172.21.15.57:0/1500237366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290f4f0 0x2939990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 --2- 172.21.15.57:0/1500237366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290dc30 0x29394a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 -- 172.21.15.57:0/1500237366 >> 172.21.15.57:0/1500237366 conn(0x2909830 msgr2=0x290f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:48:38.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 -- 172.21.15.57:0/1500237366 shutdown_connections 2021-06-25T04:48:38.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 -- 172.21.15.57:0/1500237366 wait complete. 2021-06-25T04:48:38.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 -- start start 2021-06-25T04:48:38.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.555+0000 7f04aee96740 1 Processor -- start 2021-06-25T04:48:38.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x29adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x2947b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x290eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x290e0a0 con 0x290f4f0 2021-06-25T04:48:38.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x2948030 con 0x29471f0 2021-06-25T04:48:38.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x29482f0 con 0x290dc30 2021-06-25T04:48:38.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 10 client.0 ll_register_callbacks cb 0x2946680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-06-25T04:48:38.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x2947b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x2947b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36786/0 (socket says 172.21.15.57:36786) 2021-06-25T04:48:38.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049dd9b700 1 -- 172.21.15.57:0/4281651703 learned_addr learned my addr 172.21.15.57:0/4281651703 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:48:38.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049e59c700 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x29adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049ed9d700 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x290eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049dd9b700 1 -- 172.21.15.57:0/4281651703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 msgr2=0x29adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:38.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049dd9b700 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x29adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049dd9b700 1 -- 172.21.15.57:0/4281651703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 msgr2=0x290eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:48:38.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049dd9b700 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x290eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:48:38.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049dd9b700 1 -- 172.21.15.57:0/4281651703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x286dcf0 con 0x290f4f0 2021-06-25T04:48:38.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049dd9b700 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x2947b40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x2948210 tx=0x7f0488015040).ready entity=mon.0 client_cookie=621bc8c813c80eb1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:48:38.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f048e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2021-06-25T04:48:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f048e7fc700 1 -- 172.21.15.57:0/4281651703 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f048802a840 con 0x290f4f0 2021-06-25T04:48:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f048e7fc700 1 -- 172.21.15.57:0/4281651703 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0488000e40 con 0x290f4f0 2021-06-25T04:48:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 1 -- 172.21.15.57:0/4281651703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27887d0 con 0x290f4f0 2021-06-25T04:48:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f048e7fc700 1 -- 172.21.15.57:0/4281651703 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f048802a9a0 con 0x290f4f0 2021-06-25T04:48:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 10 client.5139 fetch_fsmap learned FSMap version 13 2021-06-25T04:48:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 1 -- 172.21.15.57:0/4281651703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x28768e0 con 0x290f4f0 2021-06-25T04:48:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f048e7fc700 1 -- 172.21.15.57:0/4281651703 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27887d0 con 0x290f4f0 2021-06-25T04:48:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f048e7fc700 1 -- 172.21.15.57:0/4281651703 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 13) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f0488012a70 con 0x290f4f0 2021-06-25T04:48:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 10 client.5139 fetch_fsmap finished waiting for FSMap version 13 2021-06-25T04:48:38.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 10 client.5139 resolve_mds: resolved ID 'a' to GID 4926 2021-06-25T04:48:38.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 20 client.5139 populate_metadata read hostname 'smithi057' 2021-06-25T04:48:38.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.57:6834/2421744077,v1:172.21.15.57:6835/2421744077] conn(0x29a9ca0 0x29aa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:48:38.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 4 client.5139 mds_command: new command op to 4926 tid=0[{"prefix": "cache drop"}] 2021-06-25T04:48:38.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f04aee96740 1 -- 172.21.15.57:0/4281651703 --> [v2:172.21.15.57:6834/2421744077,v1:172.21.15.57:6835/2421744077] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x290cc90 con 0x29a9ca0 2021-06-25T04:48:38.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049e59c700 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.57:6834/2421744077,v1:172.21.15.57:6835/2421744077] conn(0x29a9ca0 0x29aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:48:38.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f048e7fc700 10 client.5139 ms_handle_connect on v2:172.21.15.57:6834/2421744077 2021-06-25T04:48:38.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:48:38.559+0000 7f049e59c700 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.57:6834/2421744077,v1:172.21.15.57:6835/2421744077] conn(0x29a9ca0 0x29aa080 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=89f8f6e2c84f9e0a server_cookie=4f7a46970b7904c5 in_seq=0 out_seq=0 2021-06-25T04:49:07.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:49:07.099 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:49:07.106 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:49:07.109 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:49:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f048e7fc700 1 -- 172.21.15.57:0/4281651703 <== mds.0 v2:172.21.15.57:6834/2421744077 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x290cc90 con 0x29a9ca0 2021-06-25T04:49:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f048e7fc700 10 client.5139 handle_command_reply: tid=0 2021-06-25T04:49:22.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 1 client.5139 shutdown 2021-06-25T04:49:22.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 1 -- 172.21.15.57:0/4281651703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 msgr2=0x2947b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:22.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x2947b40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x2948210 tx=0x7f0488015040).stop 2021-06-25T04:49:22.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 1 -- 172.21.15.57:0/4281651703 shutdown_connections 2021-06-25T04:49:22.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.57:6834/2421744077,v1:172.21.15.57:6835/2421744077] conn(0x29a9ca0 0x29aa080 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:22.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29471f0 0x290eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:22.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x290f4f0 0x2947b40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:22.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f048e7fc700 0 client.5139 ms_handle_reset on v2:172.21.15.57:6834/2421744077 2021-06-25T04:49:22.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 1 --2- 172.21.15.57:0/4281651703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x290dc30 0x29adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:22.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 1 -- 172.21.15.57:0/4281651703 >> 172.21.15.57:0/4281651703 conn(0x2909830 msgr2=0x29448d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:22.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 1 -- 172.21.15.57:0/4281651703 shutdown_connections 2021-06-25T04:49:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 1 -- 172.21.15.57:0/4281651703 wait complete. 2021-06-25T04:49:22.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f04aee96740 20 client.5139 trim_cache size 0 max 16384 2021-06-25T04:49:22.927 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:49:22.928 INFO:teuthology.orchestra.run.smithi057.stdout: "client_recall": { 2021-06-25T04:49:22.928 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": 0, 2021-06-25T04:49:22.928 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "(0) Success", 2021-06-25T04:49:22.929 INFO:teuthology.orchestra.run.smithi057.stdout: "recalled": 920 2021-06-25T04:49:22.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:22.929 INFO:teuthology.orchestra.run.smithi057.stdout: "flush_journal": { 2021-06-25T04:49:22.929 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": 0, 2021-06-25T04:49:22.930 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "" 2021-06-25T04:49:22.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:22.930 INFO:teuthology.orchestra.run.smithi057.stdout: "trim_cache": { 2021-06-25T04:49:22.930 INFO:teuthology.orchestra.run.smithi057.stdout: "trimmed": 900 2021-06-25T04:49:22.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:22.931 INFO:teuthology.orchestra.run.smithi057.stdout: "cache": { 2021-06-25T04:49:22.931 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": { 2021-06-25T04:49:22.931 INFO:teuthology.orchestra.run.smithi057.stdout: "items": 2495, 2021-06-25T04:49:22.932 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes": 431680 2021-06-25T04:49:22.935 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:22.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:22.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 44.354526382000003 2021-06-25T04:49:22.936 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:49:22.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 -- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0478055510 msgr2=0x7f04780579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:22.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0478055510 0x7f04780579d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f049000d000 tx=0x7f0490009040).stop 2021-06-25T04:49:22.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 -- 172.21.15.57:0/556935602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04a00b7330 msgr2=0x7f04a0145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:22.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04a00b7330 0x7f04a0145b30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f0498001250 tx=0x7f0498007dc0).stop 2021-06-25T04:49:22.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 -- 172.21.15.57:0/556935602 shutdown_connections 2021-06-25T04:49:22.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0478055510 0x7f04780579d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:22.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04a00b7330 0x7f04a0145b30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:22.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a00b3020 0x7f04a00b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:22.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 --2- 172.21.15.57:0/556935602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04a00aabe0 0x7f04a0143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:22.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 -- 172.21.15.57:0/556935602 >> 172.21.15.57:0/556935602 conn(0x7f04a005f670 msgr2=0x7f04a0140d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:22.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 -- 172.21.15.57:0/556935602 shutdown_connections 2021-06-25T04:49:22.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:22.915+0000 7f049f59e700 1 -- 172.21.15.57:0/556935602 wait complete. 2021-06-25T04:49:22.942 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:49:22.943 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:49:22.960 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:49:22.981 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:49:23.004 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:49:23.026 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:49:23.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:23.028 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:49:23.029 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:49:23.056 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:49:23.058 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:49:23.059 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:49:23.060 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:49:23.061 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:49:23.079 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14449]: fuse finished with error 0 and tester_r 0 2021-06-25T04:49:23.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:23.082 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:49:23.082 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:49:23.087 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:49:23.089 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:49:23.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:49:23.207 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:49:23.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:23.214 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:49:23.215 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:49:23.224 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:49:23.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:49:23.225 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:49:23.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:49:23.227 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:49:23.275 INFO:teuthology.orchestra.run.smithi161.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:49:23.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:49:23.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:49:23.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6402ee7700 1 Processor -- start 2021-06-25T04:49:23.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6402ee7700 1 -- start start 2021-06-25T04:49:23.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6402ee7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f63fc0aaed0 0x7f63fc0afd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6402ee7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63fc0671a0 con 0x7f63fc060cc0 2021-06-25T04:49:23.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6402ee7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63fc0a9410 con 0x7f63fc066dc0 2021-06-25T04:49:23.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6402ee7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc0ab2e0 con 0x7f63fc0aaed0 2021-06-25T04:49:23.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6401484700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f63fc0aaed0 0x7f63fc0afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6401484700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f63fc0aaed0 0x7f63fc0afd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36800/0 (socket says 172.21.15.57:36800) 2021-06-25T04:49:23.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6401484700 1 -- 172.21.15.57:0/2418881294 learned_addr learned my addr 172.21.15.57:0/2418881294 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:23.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f63fbfff700 1 --1- 172.21.15.57:0/2418881294 >> v1:172.21.15.57:6789/0 conn(0x7f63fc060cc0 0x7f63fc143420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54014/0 (socket says 172.21.15.57:54014) 2021-06-25T04:49:23.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6401484700 1 -- 172.21.15.57:0/2418881294 >> v1:172.21.15.87:6789/0 conn(0x7f63fc066dc0 legacy=0x7f63fc0aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6401484700 1 -- 172.21.15.57:0/2418881294 >> v1:172.21.15.57:6789/0 conn(0x7f63fc060cc0 legacy=0x7f63fc143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6401484700 1 -- 172.21.15.57:0/2418881294 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc0b0370 con 0x7f63fc0aaed0 2021-06-25T04:49:23.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.383+0000 7f6401484700 1 --2- 172.21.15.57:0/2418881294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63fc0aaed0 0x7f63fc0afd40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f63f40032f0 tx=0x7f63f4009290).ready entity=mon.0 client_cookie=8d49034ab3cc6f80 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:23.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f63fb7fe700 1 -- 172.21.15.57:0/2418881294 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f400b8a0 con 0x7f63fc0aaed0 2021-06-25T04:49:23.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f63fb7fe700 1 -- 172.21.15.57:0/2418881294 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f400ba00 con 0x7f63fc0aaed0 2021-06-25T04:49:23.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f63fb7fe700 1 -- 172.21.15.57:0/2418881294 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f400bb70 con 0x7f63fc0aaed0 2021-06-25T04:49:23.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 -- 172.21.15.57:0/2418881294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63fc0aaed0 msgr2=0x7f63fc0afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 --2- 172.21.15.57:0/2418881294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63fc0aaed0 0x7f63fc0afd40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f63f40032f0 tx=0x7f63f4009290).stop 2021-06-25T04:49:23.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 -- 172.21.15.57:0/2418881294 shutdown_connections 2021-06-25T04:49:23.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 --2- 172.21.15.57:0/2418881294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63fc0aaed0 0x7f63fc0afd40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 -- 172.21.15.57:0/2418881294 >> 172.21.15.57:0/2418881294 conn(0x7f63fc0b53a0 msgr2=0x7f63fc0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:23.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 -- 172.21.15.57:0/2418881294 shutdown_connections 2021-06-25T04:49:23.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 -- 172.21.15.57:0/2418881294 wait complete. 2021-06-25T04:49:23.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 Processor -- start 2021-06-25T04:49:23.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 -- start start 2021-06-25T04:49:23.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63fc060cc0 0x7f63fc0b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63fc066dc0 0x7f63fc1395c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63fc0aaed0 0x7f63fc138660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0b3da0 con 0x7f63fc060cc0 2021-06-25T04:49:23.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc13c1a0 con 0x7f63fc066dc0 2021-06-25T04:49:23.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6402ee7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0b3fd0 con 0x7f63fc0aaed0 2021-06-25T04:49:23.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.387+0000 7f6400c83700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63fc060cc0 0x7f63fc0b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6400c83700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63fc060cc0 0x7f63fc0b4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36802/0 (socket says 172.21.15.57:36802) 2021-06-25T04:49:23.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6400c83700 1 -- 172.21.15.57:0/4280360647 learned_addr learned my addr 172.21.15.57:0/4280360647 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:23.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f63fbfff700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63fc066dc0 0x7f63fc1395c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6401484700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63fc0aaed0 0x7f63fc138660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6400c83700 1 -- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63fc0aaed0 msgr2=0x7f63fc138660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6400c83700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63fc0aaed0 0x7f63fc138660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6400c83700 1 -- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63fc066dc0 msgr2=0x7f63fc1395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6400c83700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63fc066dc0 0x7f63fc1395c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6400c83700 1 -- 172.21.15.57:0/4280360647 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f4009530 con 0x7f63fc060cc0 2021-06-25T04:49:23.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f63fbfff700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63fc066dc0 0x7f63fc1395c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:23.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6400c83700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63fc060cc0 0x7f63fc0b4a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f63fc05f2e0 tx=0x7f63f0007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:23.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f63f9ffb700 1 -- 172.21.15.57:0/4280360647 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f000ce30 con 0x7f63fc060cc0 2021-06-25T04:49:23.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f63f9ffb700 1 -- 172.21.15.57:0/4280360647 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f0007240 con 0x7f63fc060cc0 2021-06-25T04:49:23.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6402ee7700 1 -- 172.21.15.57:0/4280360647 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc0b4270 con 0x7f63fc060cc0 2021-06-25T04:49:23.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f63f9ffb700 1 -- 172.21.15.57:0/4280360647 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f0006700 con 0x7f63fc060cc0 2021-06-25T04:49:23.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6402ee7700 1 -- 172.21.15.57:0/4280360647 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc0b4710 con 0x7f63fc060cc0 2021-06-25T04:49:23.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f6402ee7700 1 -- 172.21.15.57:0/4280360647 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc057310 con 0x7f63fc060cc0 2021-06-25T04:49:23.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.391+0000 7f63f9ffb700 1 -- 172.21.15.57:0/4280360647 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f63f0010030 con 0x7f63fc060cc0 2021-06-25T04:49:23.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.395+0000 7f63f9ffb700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f63dc0553d0 0x7f63dc057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.395+0000 7f63f9ffb700 1 -- 172.21.15.57:0/4280360647 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f63f006dcd0 con 0x7f63fc060cc0 2021-06-25T04:49:23.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.395+0000 7f63fbfff700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f63dc0553d0 0x7f63dc057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.395+0000 7f63fbfff700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f63dc0553d0 0x7f63dc057890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f63ec00b000 tx=0x7f63ec0070e0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:23.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.399+0000 7f63f9ffb700 1 -- 172.21.15.57:0/4280360647 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f63f0043d70 con 0x7f63fc060cc0 2021-06-25T04:49:23.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.527+0000 7f6402ee7700 1 -- 172.21.15.57:0/4280360647 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f63fc0698a0 con 0x7f63fc060cc0 2021-06-25T04:49:23.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f63f9ffb700 1 -- 172.21.15.57:0/4280360647 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v35) v1 ==== 81+0+34037 (secure 0 0 0) 0x7f63f0047390 con 0x7f63fc060cc0 2021-06-25T04:49:23.538 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:23.538 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:49:23.538 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 35, 2021-06-25T04:49:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:49:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:49:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:48:19.876788+0000", 2021-06-25T04:49:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:49:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:49:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:49:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:49:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:49:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:49:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:49:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:49:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:49:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:49:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:49:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:49:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:49:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:49:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:49:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 6, 2021-06-25T04:49:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:49:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:49:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:49:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:49:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:49:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:49:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:49:23.546 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:49:23.546 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:49:23.546 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:49:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:49:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:49:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:49:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:49:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:49:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:49:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:49:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:49:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:49:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:49:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:49:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:49:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:49:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:49:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:49:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:49:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:49:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:49:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:49:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:49:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:49:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:49:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:49:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:49:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:49:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:49:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:49:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:49:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:49:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:49:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:49:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:49:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:49:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:49:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:49:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:49:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:49:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:49:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:49:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:49:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:49:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:49:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:49:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:49:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:49:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:49:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:49:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:49:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:49:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:49:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:49:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:49:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:49:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:49:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:49:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:49:23.566 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:49:23.566 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:49:23.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.567 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:49:23.568 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:49:23.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:49:23.571 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:49:23.571 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:49:23.571 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:49:23.572 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:49:23.572 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:49:23.572 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:49:23.573 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:49:23.573 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:49:23.573 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:49:23.573 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:49:23.574 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:49:23.574 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:49:23.575 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:49:23.575 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:49:23.575 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:49:23.576 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:49:23.576 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:49:23.577 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:49:23.577 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:49:23.577 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:49:23.578 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:49:23.578 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:49:23.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.579 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:49:23.579 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:49:23.580 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:49:23.580 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:49:23.581 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:49:23.581 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:49:23.581 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:49:23.581 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:49:23.582 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:49:23.582 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:49:23.582 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:49:23.583 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:49:23.583 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:49:23.583 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:49:23.583 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:49:23.583 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:49:23.584 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:49:23.584 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:49:23.584 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:49:23.584 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:49:23.585 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:49:23.585 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:49:23.585 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:49:23.585 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:49:23.586 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:49:23.586 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:49:23.586 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:49:23.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.587 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:49:23.587 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:49:23.587 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:49:23.588 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:49:23.588 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:49:23.589 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:49:23.589 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:49:23.589 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:49:23.589 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:49:23.590 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:49:23.590 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:49:23.590 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:49:23.590 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:49:23.591 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:49:23.591 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.592 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 5, 2021-06-25T04:49:23.592 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:49:23.592 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:48:17.192457+0000", 2021-06-25T04:49:23.592 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:49:23.593 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:49:23.593 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:49:23.593 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:49:23.593 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:49:23.593 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:49:23.594 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:49:23.594 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:49:23.594 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:49:23.595 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:49:23.595 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:49:23.595 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:49:23.595 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:49:23.596 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:49:23.596 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:49:23.596 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:49:23.596 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:49:23.596 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:49:23.597 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:49:23.597 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:49:23.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.598 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "34", 2021-06-25T04:49:23.598 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:49:23.598 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:49:23.598 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:49:23.599 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:49:23.599 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:49:23.599 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:49:23.599 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:49:23.600 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:49:23.600 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:49:23.600 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:49:23.600 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:49:23.600 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:49:23.601 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:49:23.601 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:49:23.601 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:49:23.601 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:49:23.602 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:49:23.602 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:49:23.602 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:49:23.602 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:49:23.603 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:49:23.603 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:49:23.603 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:49:23.603 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:49:23.603 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:49:23.604 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:49:23.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.604 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:49:23.604 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:49:23.605 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:49:23.605 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:49:23.605 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:49:23.605 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:49:23.605 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:49:23.606 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:49:23.606 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:49:23.606 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:49:23.606 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:49:23.607 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:49:23.607 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:49:23.607 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:49:23.608 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:49:23.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.608 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:49:23.608 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:49:23.609 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:49:23.609 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.609 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.610 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 6, 2021-06-25T04:49:23.610 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:49:23.610 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:48:17.888021+0000", 2021-06-25T04:49:23.611 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:49:23.611 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:49:23.611 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:49:23.611 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:49:23.612 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:49:23.612 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:49:23.612 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:49:23.612 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:49:23.612 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:49:23.613 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:49:23.613 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:49:23.613 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:49:23.613 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:49:23.614 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:49:23.614 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:49:23.614 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:49:23.614 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:49:23.615 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:49:23.615 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:49:23.615 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:49:23.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.616 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "35", 2021-06-25T04:49:23.616 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:49:23.616 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:49:23.616 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:49:23.616 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:49:23.617 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:49:23.617 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:49:23.617 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:49:23.617 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:49:23.618 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:49:23.618 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:49:23.618 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:49:23.619 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:49:23.619 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:49:23.619 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:49:23.619 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:49:23.620 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:49:23.620 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:49:23.620 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:49:23.620 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:49:23.621 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:49:23.621 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:49:23.621 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:49:23.621 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:49:23.622 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:49:23.622 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:49:23.622 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:49:23.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.623 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:49:23.623 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:49:23.623 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:49:23.623 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:49:23.624 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:49:23.624 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:49:23.624 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:49:23.624 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:49:23.624 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:49:23.625 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:49:23.625 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:49:23.625 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:49:23.625 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:49:23.626 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:49:23.626 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:49:23.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.627 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:49:23.627 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:49:23.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.628 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:49:23.628 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:49:23.628 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:23.628 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:23.629 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:23.629 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:23.629 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:23.629 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:23.630 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:23.630 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:23.630 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:23.630 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:23.631 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:23.631 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.632 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:49:23.632 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:23.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.633 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.633 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:49:23.633 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:23.633 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.633 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.634 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:23.634 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.635 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.635 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:49:23.635 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:23.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.636 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.636 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:49:23.636 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:23.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.637 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.637 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:23.638 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.638 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.638 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:49:23.638 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:23.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.639 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.640 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:49:23.640 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:23.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.640 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.641 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:23.641 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.641 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.642 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:49:23.642 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:23.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.643 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.643 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:49:23.643 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:23.643 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.644 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.644 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:49:23.644 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:49:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:49:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:49:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:49:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:49:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:49:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:49:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:49:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:49:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:49:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:49:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:49:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:49:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:49:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:49:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:49:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:49:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:49:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:49:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 32, 2021-06-25T04:49:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:23.678 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:23.678 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:23.679 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.679 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.680 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:49:23.680 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:23.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.681 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.682 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:49:23.682 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:23.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.683 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.684 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:23.684 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.685 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.686 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:49:23.686 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:23.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.687 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.687 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:49:23.687 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:23.688 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.688 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.688 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:23.688 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.689 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.689 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:49:23.689 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:23.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.690 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.690 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:49:23.691 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:23.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.691 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.692 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:23.692 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.692 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.693 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:49:23.693 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:23.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.694 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.694 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:49:23.694 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:23.694 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.695 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.695 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:49:23.695 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:49:23.696 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:49:23.696 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:49:23.696 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:23.696 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:23.697 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:23.697 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.698 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:49:23.698 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:49:23.698 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:23.699 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:23.699 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:23.699 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:23.699 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:23.700 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:23.700 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:23.700 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:23.700 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:23.700 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:23.701 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:23.701 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.701 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.702 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:49:23.702 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:23.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.702 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.703 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:49:23.703 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:23.703 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.703 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.704 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:23.704 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.705 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.705 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:49:23.705 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:23.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.706 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.706 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:49:23.706 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:23.707 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.707 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.707 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:23.707 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.708 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.708 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:49:23.708 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:23.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.709 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.709 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:49:23.710 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:23.710 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.710 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.711 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:23.711 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.712 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.712 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:49:23.713 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:23.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.714 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.715 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:49:23.715 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:23.715 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.716 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.716 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:49:23.716 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:49:23.716 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:49:23.717 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:49:23.717 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:23.717 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:23.717 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:23.718 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.718 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:49:23.719 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:49:23.719 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:23.719 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:23.720 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:23.720 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:23.720 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:23.720 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:23.721 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:23.721 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:23.721 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:23.721 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:23.721 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:23.722 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.722 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.722 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:49:23.723 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:23.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.723 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.724 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:49:23.724 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:23.724 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.724 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.725 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:23.725 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.726 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.726 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:49:23.726 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:23.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.727 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.727 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:49:23.728 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:23.728 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.728 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.728 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:23.729 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.729 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.729 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:49:23.730 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:23.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.730 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.731 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:49:23.731 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:23.731 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.731 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.732 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:23.732 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.733 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.733 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:49:23.733 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:23.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.734 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.734 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:49:23.734 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:23.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.735 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.735 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:49:23.735 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:49:23.735 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:49:23.736 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:49:23.736 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:23.736 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:23.737 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:23.737 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.738 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:49:23.738 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:49:23.738 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:23.738 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:23.738 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:23.739 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:23.739 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:23.739 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:23.739 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:23.740 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:23.740 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:23.740 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:23.740 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:23.740 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.741 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.741 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:49:23.741 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:23.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.742 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.742 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:49:23.743 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:23.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.743 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.743 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:23.744 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.744 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.744 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:49:23.745 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:23.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.745 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.745 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:49:23.746 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:23.746 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.746 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.747 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:23.747 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.748 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.748 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:49:23.748 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:23.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.749 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.749 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:49:23.749 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:23.750 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.750 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.750 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:23.751 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.751 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.751 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:49:23.752 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:23.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.752 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.752 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:49:23.753 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:23.753 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.753 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.754 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:49:23.754 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:49:23.754 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:49:23.754 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:49:23.754 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:23.755 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:23.755 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:23.755 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.756 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:49:23.756 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:49:23.756 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:23.756 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:23.757 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:23.757 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:23.757 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:23.757 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:23.758 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:23.758 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 32, 2021-06-25T04:49:23.758 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:23.758 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:23.758 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:23.759 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.759 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.759 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:49:23.760 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:23.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.760 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.760 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:49:23.761 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:23.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.761 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.762 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:23.762 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.762 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.763 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:49:23.763 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:23.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.763 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.764 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:49:23.764 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:23.764 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.764 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.765 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:23.765 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.765 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.766 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:49:23.766 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:23.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.767 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.767 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:49:23.767 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:23.767 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.767 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.768 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:23.768 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.769 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.769 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:49:23.769 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:23.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.770 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.770 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:49:23.770 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:23.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.771 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.771 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:49:23.771 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:49:23.771 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:49:23.772 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:49:23.772 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:23.772 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:23.772 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:23.773 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.773 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:49:23.773 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:49:23.774 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:23.774 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:23.774 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:23.774 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:23.775 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:23.775 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:23.775 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:23.775 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:23.775 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:23.776 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:23.776 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:23.776 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.777 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.777 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:49:23.777 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:23.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.778 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.778 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:49:23.778 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:23.778 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.779 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.779 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:23.779 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.780 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.780 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:49:23.780 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:23.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.781 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.781 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:49:23.781 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:23.782 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.782 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.782 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:23.782 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.783 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.783 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:49:23.783 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:23.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.784 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.784 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:49:23.784 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:23.785 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.785 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.785 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:23.786 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:23.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.786 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:23.786 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:49:23.787 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:23.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.787 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:23.787 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:49:23.788 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:23.788 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.788 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.788 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:49:23.789 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:49:23.789 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:49:23.789 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:49:23.789 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:23.790 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:23.790 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:23.790 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:23.790 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.791 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:49:23.791 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:49:23.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.791 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:49:23.791 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:23.792 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:23.792 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:23.792 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:23.792 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:23.793 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:49:23.793 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:23.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.794 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:49:23.794 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:23.794 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:23.794 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:23.794 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:23.795 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:23.795 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:49:23.795 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:23.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.796 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:49:23.796 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:23.796 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:23.797 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:23.797 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:23.797 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:23.797 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:49:23.797 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:23.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.798 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:49:23.798 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:23.799 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:23.799 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:23.799 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:23.799 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:23.800 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:49:23.800 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:23.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.800 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:49:23.801 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:23.801 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:23.801 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:23.801 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:23.802 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:23.802 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:49:23.802 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:23.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.803 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:49:23.803 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:23.803 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:23.803 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:23.804 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:23.804 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:23.804 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:49:23.804 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:23.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.805 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:49:23.805 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:23.805 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:23.806 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:23.806 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:23.806 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:23.806 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:49:23.807 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:23.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:23.807 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:49:23.807 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:23.808 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:23.808 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:23.808 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:23.808 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:23.809 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:49:23.809 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:23.809 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.809 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:49:23.809 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:49:23.810 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:49:23.810 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:49:23.810 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:49:23.810 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": {}, 2021-06-25T04:49:23.811 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:49:23.811 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:49:23.811 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:49:23.811 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:49:23.812 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:49:23.812 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:49:23.812 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:49:23.812 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:49:23.812 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:49:23.813 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:49:23.813 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:49:23.813 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:49:23.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.814 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:49:23.814 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:49:23.814 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:49:23.814 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:49:23.814 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:49:23.815 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:49:23.815 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:49:23.815 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:23.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:23.816 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:49:23.816 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:49:23.816 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:49:23.816 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:49:23.816 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:49:23.817 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:49:23.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 -- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f63dc0553d0 msgr2=0x7f63dc057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f63dc0553d0 0x7f63dc057890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f63ec00b000 tx=0x7f63ec0070e0).stop 2021-06-25T04:49:23.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 -- 172.21.15.57:0/4280360647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63fc060cc0 msgr2=0x7f63fc0b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63fc060cc0 0x7f63fc0b4a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f63fc05f2e0 tx=0x7f63f0007c10).stop 2021-06-25T04:49:23.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 -- 172.21.15.57:0/4280360647 shutdown_connections 2021-06-25T04:49:23.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f63dc0553d0 0x7f63dc057890 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f63fc0aaed0 0x7f63fc138660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63fc066dc0 0x7f63fc1395c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 --2- 172.21.15.57:0/4280360647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63fc060cc0 0x7f63fc0b4a80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 -- 172.21.15.57:0/4280360647 >> 172.21.15.57:0/4280360647 conn(0x7f63fc0b53a0 msgr2=0x7f63fc0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:23.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 -- 172.21.15.57:0/4280360647 shutdown_connections 2021-06-25T04:49:23.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.531+0000 7f6402ee7700 1 -- 172.21.15.57:0/4280360647 wait complete. 2021-06-25T04:49:23.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:49:23.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f3109d63700 1 Processor -- start 2021-06-25T04:49:23.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f3109d63700 1 -- start start 2021-06-25T04:49:23.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f3109d63700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3104064b00 0x7f3104143860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f3109d63700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31040b2230 con 0x7f31040b2cb0 2021-06-25T04:49:23.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f3109d63700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3104064ee0 con 0x7f31040b3900 2021-06-25T04:49:23.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f3109d63700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31040621f0 con 0x7f3104064b00 2021-06-25T04:49:23.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f3103fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f31040b2cb0 0x7f31040b31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54028/0 (socket says 172.21.15.57:54028) 2021-06-25T04:49:23.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f3103fff700 1 -- 172.21.15.57:0/2462067641 learned_addr learned my addr 172.21.15.57:0/2462067641 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:23.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f3108d61700 1 --2- 172.21.15.57:0/2462067641 >> v2:172.21.15.87:3300/0 conn(0x7f3104064b00 0x7f3104143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328488653 0 0) 0x7f31040b2230 con 0x7f31040b2cb0 2021-06-25T04:49:23.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30e4003260 con 0x7f31040b2cb0 2021-06-25T04:49:23.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959934503 0 0) 0x7f3104064ee0 con 0x7f31040b3900 2021-06-25T04:49:23.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.927+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31040b2230 con 0x7f31040b3900 2021-06-25T04:49:23.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3697444730 0 0) 0x7f30e4003260 con 0x7f31040b2cb0 2021-06-25T04:49:23.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 >> v2:172.21.15.87:3300/0 conn(0x7f3104064b00 msgr2=0x7f3104143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:23.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 --2- 172.21.15.57:0/2462067641 >> v2:172.21.15.87:3300/0 conn(0x7f3104064b00 0x7f3104143860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 >> v1:172.21.15.87:6789/0 conn(0x7f31040b3900 legacy=0x7f310414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040b3d10 con 0x7f31040b2cb0 2021-06-25T04:49:23.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f30ec0017e0 con 0x7f31040b2cb0 2021-06-25T04:49:23.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 >> v1:172.21.15.57:6789/0 conn(0x7f31040b2cb0 legacy=0x7f31040b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30e40038e0 0x7f30e4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 0x7f30e4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30e4004e70 0x7f30e400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31040621f0 con 0x7f30e4004500 2021-06-25T04:49:23.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e400bdd0 con 0x7f30e40038e0 2021-06-25T04:49:23.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e400bf40 con 0x7f30e4004e70 2021-06-25T04:49:23.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3103fff700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 0x7f30e4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3108d61700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30e40038e0 0x7f30e4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3109562700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30e4004e70 0x7f30e400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3103fff700 1 -- 172.21.15.57:0/2462067641 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30e4004e70 msgr2=0x7f30e400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:23.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3103fff700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30e4004e70 0x7f30e400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3103fff700 1 -- 172.21.15.57:0/2462067641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30e40038e0 msgr2=0x7f30e4003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:23.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3103fff700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30e40038e0 0x7f30e4003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3109562700 1 -- 172.21.15.57:0/2462067641 reap_dead start 2021-06-25T04:49:23.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3103fff700 1 -- 172.21.15.57:0/2462067641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e4003260 con 0x7f30e4004500 2021-06-25T04:49:23.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3108d61700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30e40038e0 0x7f30e4003ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:23.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3103fff700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 0x7f30e4004980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f30ec0015b0 tx=0x7f30ec007590).ready entity=mon.0 client_cookie=5a95269401dc464b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:23.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30ec0070d0 con 0x7f30e4004500 2021-06-25T04:49:23.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec007230 con 0x7f30e4004500 2021-06-25T04:49:23.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f31037fe700 1 -- 172.21.15.57:0/2462067641 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30ec0073a0 con 0x7f30e4004500 2021-06-25T04:49:23.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3109d63700 1 -- 172.21.15.57:0/2462067641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 msgr2=0x7f30e4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3109d63700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 0x7f30e4004980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f30ec0015b0 tx=0x7f30ec007590).stop 2021-06-25T04:49:23.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3109d63700 1 -- 172.21.15.57:0/2462067641 shutdown_connections 2021-06-25T04:49:23.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3109d63700 1 --2- 172.21.15.57:0/2462067641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 0x7f30e4004980 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3109d63700 1 -- 172.21.15.57:0/2462067641 >> 172.21.15.57:0/2462067641 conn(0x7f3104062ba0 msgr2=0x7f310405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:23.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3109d63700 1 -- 172.21.15.57:0/2462067641 shutdown_connections 2021-06-25T04:49:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.931+0000 7f3109d63700 1 -- 172.21.15.57:0/2462067641 wait complete. 2021-06-25T04:49:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3109d63700 1 Processor -- start 2021-06-25T04:49:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3109d63700 1 -- start start 2021-06-25T04:49:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3109d63700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 0x7f31040a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3109d63700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31041469f0 0x7f31040b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.962 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3109d63700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040a62d0 0x7f31040b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.962 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3109d63700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31040b14f0 con 0x7f30e4004500 2021-06-25T04:49:23.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3109d63700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31041521a0 con 0x7f31041469f0 2021-06-25T04:49:23.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3109d63700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31040a4340 con 0x7f31040a62d0 2021-06-25T04:49:23.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3108d61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 0x7f31040a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3108d61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 0x7f31040a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36824/0 (socket says 172.21.15.57:36824) 2021-06-25T04:49:23.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3108d61700 1 -- 172.21.15.57:0/260595237 learned_addr learned my addr 172.21.15.57:0/260595237 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:23.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3103fff700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31041469f0 0x7f31040b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3109562700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040a62d0 0x7f31040b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3108d61700 1 -- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040a62d0 msgr2=0x7f31040b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3108d61700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040a62d0 0x7f31040b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3108d61700 1 -- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31041469f0 msgr2=0x7f31040b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:23.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3108d61700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31041469f0 0x7f31040b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:23.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3108d61700 1 -- 172.21.15.57:0/260595237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040a45e0 con 0x7f30e4004500 2021-06-25T04:49:23.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3108d61700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 0x7f31040a5de0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f3104146dd0 tx=0x7f30f4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:23.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3101ffb700 1 -- 172.21.15.57:0/260595237 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f400f700 con 0x7f30e4004500 2021-06-25T04:49:23.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3101ffb700 1 -- 172.21.15.57:0/260595237 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f400f860 con 0x7f30e4004500 2021-06-25T04:49:23.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3109d63700 1 -- 172.21.15.57:0/260595237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3104151f00 con 0x7f30e4004500 2021-06-25T04:49:23.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.935+0000 7f3101ffb700 1 -- 172.21.15.57:0/260595237 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f400fbc0 con 0x7f30e4004500 2021-06-25T04:49:23.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.939+0000 7f3109d63700 1 -- 172.21.15.57:0/260595237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31041467d0 con 0x7f30e4004500 2021-06-25T04:49:23.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.939+0000 7f3109d63700 1 -- 172.21.15.57:0/260595237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3104057310 con 0x7f30e4004500 2021-06-25T04:49:23.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.939+0000 7f3101ffb700 1 -- 172.21.15.57:0/260595237 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f30f400fd20 con 0x7f30e4004500 2021-06-25T04:49:23.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.939+0000 7f3101ffb700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30e80553f0 0x7f30e80578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:23.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.939+0000 7f3101ffb700 1 -- 172.21.15.57:0/260595237 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f30f406e5f0 con 0x7f30e4004500 2021-06-25T04:49:23.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.939+0000 7f3103fff700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30e80553f0 0x7f30e80578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:23.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.939+0000 7f3103fff700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30e80553f0 0x7f30e80578b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f30ec018000 tx=0x7f30ec015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:23.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:23.947+0000 7f3101ffb700 1 -- 172.21.15.57:0/260595237 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f30f40447a0 con 0x7f30e4004500 2021-06-25T04:49:24.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.107+0000 7f3109d63700 1 -- 172.21.15.57:0/260595237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31040a2c80 con 0x7f30e4004500 2021-06-25T04:49:24.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3101ffb700 1 -- 172.21.15.57:0/260595237 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f30f4018020 con 0x7f30e4004500 2021-06-25T04:49:24.116 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:24.116 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3329294132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329294132},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329294132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/1504287390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1504287390},{"type":"v1","addr":"172.21.15.57:6833","nonce":1504287390}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:48:18.873057+0000","modified":"2021-06-25T04:48:19.875996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2421744077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2421744077},{"type":"v1","addr":"172.21.15.57:6835","nonce":2421744077}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-06-25T04:49:24.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 -- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30e80553f0 msgr2=0x7f30e80578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30e80553f0 0x7f30e80578b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f30ec018000 tx=0x7f30ec015000).stop 2021-06-25T04:49:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 -- 172.21.15.57:0/260595237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 msgr2=0x7f31040a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 0x7f31040a5de0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f3104146dd0 tx=0x7f30f4006df0).stop 2021-06-25T04:49:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 -- 172.21.15.57:0/260595237 shutdown_connections 2021-06-25T04:49:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30e80553f0 0x7f30e80578b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040a62d0 0x7f31040b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31041469f0 0x7f31040b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 --2- 172.21.15.57:0/260595237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30e4004500 0x7f31040a5de0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 -- 172.21.15.57:0/260595237 >> 172.21.15.57:0/260595237 conn(0x7f3104062ba0 msgr2=0x7f3104066b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 -- 172.21.15.57:0/260595237 shutdown_connections 2021-06-25T04:49:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.111+0000 7f3109d63700 1 -- 172.21.15.57:0/260595237 wait complete. 2021-06-25T04:49:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 13 2021-06-25T04:49:24.128 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:49:24.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.227+0000 7fbbd46df700 1 Processor -- start 2021-06-25T04:49:24.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.227+0000 7fbbd46df700 1 -- start start 2021-06-25T04:49:24.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.227+0000 7fbbd46df700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbbcc0b0f90 0x7fbbcc1446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:24.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.227+0000 7fbbd46df700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbcc0b0310 con 0x7fbbcc0b1d70 2021-06-25T04:49:24.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.227+0000 7fbbd46df700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbcc0b05b0 con 0x7fbbcc148360 2021-06-25T04:49:24.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.227+0000 7fbbd46df700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbcc0a9080 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.227+0000 7fbbd2c7c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbbcc0b0f90 0x7fbbcc1446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.227+0000 7fbbd2c7c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbbcc0b0f90 0x7fbbcc1446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36834/0 (socket says 172.21.15.57:36834) 2021-06-25T04:49:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.227+0000 7fbbd2c7c700 1 -- 172.21.15.57:0/2645097644 learned_addr learned my addr 172.21.15.57:0/2645097644 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.227+0000 7fbbd2c7c700 1 -- 172.21.15.57:0/2645097644 >> v1:172.21.15.87:6789/0 conn(0x7fbbcc148360 legacy=0x7fbbcc0a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.227+0000 7fbbd2c7c700 1 -- 172.21.15.57:0/2645097644 >> v1:172.21.15.57:6789/0 conn(0x7fbbcc0b1d70 legacy=0x7fbbcc0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd2c7c700 1 -- 172.21.15.57:0/2645097644 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc0b0850 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd2c7c700 1 --2- 172.21.15.57:0/2645097644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbcc0b0f90 0x7fbbcc1446e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fbbcc1476f0 tx=0x7fbbc4006eb0).ready entity=mon.0 client_cookie=adfb80affd900287 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:24.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd1479700 1 -- 172.21.15.57:0/2645097644 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc400d660 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd1479700 1 -- 172.21.15.57:0/2645097644 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc4000e90 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd1479700 1 -- 172.21.15.57:0/2645097644 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc400d9f0 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd46df700 1 -- 172.21.15.57:0/2645097644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbcc0b0f90 msgr2=0x7fbbcc1446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd46df700 1 --2- 172.21.15.57:0/2645097644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbcc0b0f90 0x7fbbcc1446e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fbbcc1476f0 tx=0x7fbbc4006eb0).stop 2021-06-25T04:49:24.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd46df700 1 -- 172.21.15.57:0/2645097644 shutdown_connections 2021-06-25T04:49:24.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd46df700 1 --2- 172.21.15.57:0/2645097644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbcc0b0f90 0x7fbbcc1446e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd46df700 1 -- 172.21.15.57:0/2645097644 >> 172.21.15.57:0/2645097644 conn(0x7fbbcc05f670 msgr2=0x7fbbcc05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:24.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd46df700 1 -- 172.21.15.57:0/2645097644 shutdown_connections 2021-06-25T04:49:24.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.231+0000 7fbbd46df700 1 -- 172.21.15.57:0/2645097644 wait complete. 2021-06-25T04:49:24.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd46df700 1 Processor -- start 2021-06-25T04:49:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd46df700 1 -- start start 2021-06-25T04:49:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd46df700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbcc0b0f90 0x7fbbcc0adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd46df700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbcc0b1d70 0x7fbbcc156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd46df700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbcc148360 0x7fbbcc1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd46df700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc148ac0 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd46df700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc156980 con 0x7fbbcc148360 2021-06-25T04:49:24.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd46df700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc149d40 con 0x7fbbcc0b1d70 2021-06-25T04:49:24.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd247b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbcc0b0f90 0x7fbbcc0adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:24.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd247b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbcc0b0f90 0x7fbbcc0adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36836/0 (socket says 172.21.15.57:36836) 2021-06-25T04:49:24.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd247b700 1 -- 172.21.15.57:0/2095707981 learned_addr learned my addr 172.21.15.57:0/2095707981 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd2c7c700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbcc148360 0x7fbbcc1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd1c7a700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbcc0b1d70 0x7fbbcc156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd247b700 1 -- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbcc0b1d70 msgr2=0x7fbbcc156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd247b700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbcc0b1d70 0x7fbbcc156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd247b700 1 -- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbcc148360 msgr2=0x7fbbcc1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd247b700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbcc148360 0x7fbbcc1572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd247b700 1 -- 172.21.15.57:0/2095707981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc400b1e0 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd247b700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbcc0b0f90 0x7fbbcc0adf90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fbbcc0ace20 tx=0x7fbbbc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:24.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbbb7fe700 1 -- 172.21.15.57:0/2095707981 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbbc007030 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbbb7fe700 1 -- 172.21.15.57:0/2095707981 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc007190 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd46df700 1 -- 172.21.15.57:0/2095707981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbcc149fe0 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbbb7fe700 1 -- 172.21.15.57:0/2095707981 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbbc006510 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.235+0000 7fbbd46df700 1 -- 172.21.15.57:0/2095707981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbcc14ba90 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.239+0000 7fbbbb7fe700 1 -- 172.21.15.57:0/2095707981 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbbbc010030 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.239+0000 7fbbd46df700 1 -- 172.21.15.57:0/2095707981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbcc156af0 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.239+0000 7fbbbb7fe700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbac055490 0x7fbbac057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:24.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.239+0000 7fbbbb7fe700 1 -- 172.21.15.57:0/2095707981 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbbbc06db30 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.239+0000 7fbbd1c7a700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbac055490 0x7fbbac057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:24.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.239+0000 7fbbd1c7a700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbac055490 0x7fbbac057950 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fbbc800d000 tx=0x7fbbc8007f10).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:24.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.243+0000 7fbbbb7fe700 1 -- 172.21.15.57:0/2095707981 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbbbc043bd0 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.411+0000 7fbbd46df700 1 -- 172.21.15.57:0/2095707981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbbcc14a170 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.538 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:49:24.531+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:49:24.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.539+0000 7fbbbb7fe700 1 -- 172.21.15.57:0/2095707981 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbbbc0471f0 con 0x7fbbcc0b0f90 2021-06-25T04:49:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 -- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbac055490 msgr2=0x7fbbac057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbac055490 0x7fbbac057950 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fbbc800d000 tx=0x7fbbc8007f10).stop 2021-06-25T04:49:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 -- 172.21.15.57:0/2095707981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbcc0b0f90 msgr2=0x7fbbcc0adf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbcc0b0f90 0x7fbbcc0adf90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fbbcc0ace20 tx=0x7fbbbc007c10).stop 2021-06-25T04:49:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 -- 172.21.15.57:0/2095707981 shutdown_connections 2021-06-25T04:49:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbac055490 0x7fbbac057950 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbcc148360 0x7fbbcc1572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbcc0b1d70 0x7fbbcc156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 --2- 172.21.15.57:0/2095707981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbcc0b0f90 0x7fbbcc0adf90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 -- 172.21.15.57:0/2095707981 >> 172.21.15.57:0/2095707981 conn(0x7fbbcc05f670 msgr2=0x7fbbcc0b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 -- 172.21.15.57:0/2095707981 shutdown_connections 2021-06-25T04:49:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.543+0000 7fbbd46df700 1 -- 172.21.15.57:0/2095707981 wait complete. 2021-06-25T04:49:24.553 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:49:24.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:49:24.586 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:49:24.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.659+0000 7f7fb5a87700 1 Processor -- start 2021-06-25T04:49:24.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.659+0000 7f7fb5a87700 1 -- start start 2021-06-25T04:49:24.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.659+0000 7f7fb5a87700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb013c6a0 0x7f7fb013cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:24.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.659+0000 7f7fb5a87700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7fb00acee0 0x7f7fb00ad370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:24.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.659+0000 7f7fb5a87700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb00b2bf0 con 0x7f7fb00b2810 2021-06-25T04:49:24.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.659+0000 7f7fb5a87700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb00b1170 con 0x7f7fb00acee0 2021-06-25T04:49:24.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.659+0000 7f7fb5a87700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00b1620 con 0x7f7fb013c6a0 2021-06-25T04:49:24.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb4a85700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7fb00b2810 0x7f7fb00b0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:54822/0 (socket says 172.21.15.57:54822) 2021-06-25T04:49:24.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb4a85700 1 -- 172.21.15.57:0/771961632 learned_addr learned my addr 172.21.15.57:0/771961632 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:24.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5286700 1 --2- 172.21.15.57:0/771961632 >> v2:172.21.15.87:3300/0 conn(0x7f7fb00acee0 0x7f7fb00ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:24.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7faffff700 1 --2- 172.21.15.57:0/771961632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb013c6a0 0x7f7fb013cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:24.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7faf7fe700 1 -- 172.21.15.57:0/771961632 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502027100 0 0) 0x7f7fb00b2bf0 con 0x7f7fb00b2810 2021-06-25T04:49:24.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7faf7fe700 1 -- 172.21.15.57:0/771961632 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f90003260 con 0x7f7fb00b2810 2021-06-25T04:49:24.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5286700 1 -- 172.21.15.57:0/771961632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb013c6a0 msgr2=0x7f7fb013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:24.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5286700 1 --2- 172.21.15.57:0/771961632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb013c6a0 0x7f7fb013cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5286700 1 -- 172.21.15.57:0/771961632 >> v1:172.21.15.87:6789/0 conn(0x7f7fb00b2810 legacy=0x7f7fb00b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5286700 1 -- 172.21.15.57:0/771961632 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb00b18c0 con 0x7f7fb00acee0 2021-06-25T04:49:24.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5286700 1 --2- 172.21.15.57:0/771961632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00acee0 0x7f7fb00ad370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f7fa0002f70 tx=0x7f7fa0006e80).ready entity=mon.1 client_cookie=decc92e3165013b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:24.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7faf7fe700 1 -- 172.21.15.57:0/771961632 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa0014070 con 0x7f7fb00acee0 2021-06-25T04:49:24.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7faf7fe700 1 -- 172.21.15.57:0/771961632 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa0000e90 con 0x7f7fb00acee0 2021-06-25T04:49:24.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7faf7fe700 1 -- 172.21.15.57:0/771961632 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa00107f0 con 0x7f7fb00acee0 2021-06-25T04:49:24.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5a87700 1 -- 172.21.15.57:0/771961632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00acee0 msgr2=0x7f7fb00ad370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5a87700 1 --2- 172.21.15.57:0/771961632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00acee0 0x7f7fb00ad370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f7fa0002f70 tx=0x7f7fa0006e80).stop 2021-06-25T04:49:24.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5a87700 1 -- 172.21.15.57:0/771961632 shutdown_connections 2021-06-25T04:49:24.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5a87700 1 --2- 172.21.15.57:0/771961632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00acee0 0x7f7fb00ad370 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5a87700 1 --2- 172.21.15.57:0/771961632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb013c6a0 0x7f7fb013cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5a87700 1 -- 172.21.15.57:0/771961632 >> 172.21.15.57:0/771961632 conn(0x7f7fb00611f0 msgr2=0x7f7fb0062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:24.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5a87700 1 -- 172.21.15.57:0/771961632 shutdown_connections 2021-06-25T04:49:24.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.663+0000 7f7fb5a87700 1 -- 172.21.15.57:0/771961632 wait complete. 2021-06-25T04:49:24.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5a87700 1 Processor -- start 2021-06-25T04:49:24.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5a87700 1 -- start start 2021-06-25T04:49:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5a87700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00acee0 0x7f7fb0140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5a87700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00b2810 0x7f7fb0065040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:24.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5a87700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb013c6a0 0x7f7fb0065530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:24.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5a87700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0136ac0 con 0x7f7fb013c6a0 2021-06-25T04:49:24.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5a87700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0063b30 con 0x7f7fb00b2810 2021-06-25T04:49:24.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5a87700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb01372d0 con 0x7f7fb00acee0 2021-06-25T04:49:24.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5286700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb013c6a0 0x7f7fb0065530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:24.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5286700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb013c6a0 0x7f7fb0065530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36866/0 (socket says 172.21.15.57:36866) 2021-06-25T04:49:24.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5286700 1 -- 172.21.15.57:0/1914561266 learned_addr learned my addr 172.21.15.57:0/1914561266 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:24.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb4a85700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00acee0 0x7f7fb0140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:24.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7faffff700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00b2810 0x7f7fb0065040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:24.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5286700 1 -- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00acee0 msgr2=0x7f7fb0140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5286700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00acee0 0x7f7fb0140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5286700 1 -- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00b2810 msgr2=0x7f7fb0065040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5286700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00b2810 0x7f7fb0065040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5286700 1 -- 172.21.15.57:0/1914561266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa000c310 con 0x7f7fb013c6a0 2021-06-25T04:49:24.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5286700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb013c6a0 0x7f7fb0065530 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f7fa0002f70 tx=0x7f7fb013f4b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:24.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fadffb700 1 -- 172.21.15.57:0/1914561266 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa001b710 con 0x7f7fb013c6a0 2021-06-25T04:49:24.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fadffb700 1 -- 172.21.15.57:0/1914561266 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa001b870 con 0x7f7fb013c6a0 2021-06-25T04:49:24.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5a87700 1 -- 172.21.15.57:0/1914561266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb0137570 con 0x7f7fb013c6a0 2021-06-25T04:49:24.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fadffb700 1 -- 172.21.15.57:0/1914561266 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa001bbd0 con 0x7f7fb013c6a0 2021-06-25T04:49:24.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.667+0000 7f7fb5a87700 1 -- 172.21.15.57:0/1914561266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb0065a20 con 0x7f7fb013c6a0 2021-06-25T04:49:24.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.671+0000 7f7fadffb700 1 -- 172.21.15.57:0/1914561266 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7fa0021020 con 0x7f7fb013c6a0 2021-06-25T04:49:24.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.671+0000 7f7fb5a87700 1 -- 172.21.15.57:0/1914561266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb0137980 con 0x7f7fb013c6a0 2021-06-25T04:49:24.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.671+0000 7f7fadffb700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f94055450 0x7f7f94057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:24.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.671+0000 7f7fadffb700 1 -- 172.21.15.57:0/1914561266 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f7fa006f2c0 con 0x7f7fb013c6a0 2021-06-25T04:49:24.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.671+0000 7f7fb4a85700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f94055450 0x7f7f94057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:24.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.671+0000 7f7fb4a85700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f94055450 0x7f7f94057910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f7fa800d000 tx=0x7f7fa8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:24.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.679+0000 7f7fadffb700 1 -- 172.21.15.57:0/1914561266 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7fa0045420 con 0x7f7fb013c6a0 2021-06-25T04:49:24.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 -- 172.21.15.57:0/1914561266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fb0136c00 con 0x7f7fb013c6a0 2021-06-25T04:49:24.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fadffb700 1 -- 172.21.15.57:0/1914561266 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2130 (secure 0 0 0) 0x7f7fa0048a40 con 0x7f7fb013c6a0 2021-06-25T04:49:24.849 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:24.849 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3329294132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329294132},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329294132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/1504287390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1504287390},{"type":"v1","addr":"172.21.15.57:6833","nonce":1504287390}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:48:18.873057+0000","modified":"2021-06-25T04:49:24.535855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-06-25T04:49:24.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 -- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f94055450 msgr2=0x7f7f94057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f94055450 0x7f7f94057910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f7fa800d000 tx=0x7f7fa8009040).stop 2021-06-25T04:49:24.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 -- 172.21.15.57:0/1914561266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb013c6a0 msgr2=0x7f7fb0065530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:24.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb013c6a0 0x7f7fb0065530 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f7fa0002f70 tx=0x7f7fb013f4b0).stop 2021-06-25T04:49:24.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 -- 172.21.15.57:0/1914561266 shutdown_connections 2021-06-25T04:49:24.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f94055450 0x7f7f94057910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb013c6a0 0x7f7fb0065530 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00b2810 0x7f7fb0065040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 --2- 172.21.15.57:0/1914561266 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00acee0 0x7f7fb0140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:24.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 -- 172.21.15.57:0/1914561266 >> 172.21.15.57:0/1914561266 conn(0x7f7fb00611f0 msgr2=0x7f7fb01353e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:24.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 -- 172.21.15.57:0/1914561266 shutdown_connections 2021-06-25T04:49:24.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:24.843+0000 7f7fb5a87700 1 -- 172.21.15.57:0/1914561266 wait complete. 2021-06-25T04:49:24.856 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2021-06-25T04:49:24.862 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:49:25.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc8d2a7700 1 Processor -- start 2021-06-25T04:49:25.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc8d2a7700 1 -- start start 2021-06-25T04:49:25.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc8d2a7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdc8805fbc0 0x7fdc880b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc8d2a7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc880b6520 0x7fdc880b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc8d2a7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc88143f20 con 0x7fdc880b5950 2021-06-25T04:49:25.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc8d2a7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8805ffa0 con 0x7fdc8805fbc0 2021-06-25T04:49:25.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc8d2a7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc88143a10 con 0x7fdc880b6520 2021-06-25T04:49:25.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc877fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdc880b5950 0x7fdc880b49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54092/0 (socket says 172.21.15.57:54092) 2021-06-25T04:49:25.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc877fe700 1 -- 172.21.15.57:0/3825966992 learned_addr learned my addr 172.21.15.57:0/3825966992 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc86ffd700 1 --2- 172.21.15.57:0/3825966992 >> v2:172.21.15.87:3300/0 conn(0x7fdc8805fbc0 0x7fdc880b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc867fc700 1 --2- 172.21.15.57:0/3825966992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc880b6520 0x7fdc880b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc85ffb700 1 -- 172.21.15.57:0/3825966992 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128066269 0 0) 0x7fdc88143f20 con 0x7fdc880b5950 2021-06-25T04:49:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc85ffb700 1 -- 172.21.15.57:0/3825966992 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc6c003260 con 0x7fdc880b5950 2021-06-25T04:49:25.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc86ffd700 1 -- 172.21.15.57:0/3825966992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc880b6520 msgr2=0x7fdc880b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:25.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc86ffd700 1 --2- 172.21.15.57:0/3825966992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc880b6520 0x7fdc880b9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc86ffd700 1 -- 172.21.15.57:0/3825966992 >> v1:172.21.15.57:6789/0 conn(0x7fdc880b5950 legacy=0x7fdc880b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:25.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc85ffb700 1 -- 172.21.15.57:0/3825966992 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1419782578 0 0) 0x7fdc6c003260 con 0x7fdc880b5950 2021-06-25T04:49:25.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc86ffd700 1 -- 172.21.15.57:0/3825966992 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88143c80 con 0x7fdc8805fbc0 2021-06-25T04:49:25.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc86ffd700 1 --2- 172.21.15.57:0/3825966992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc8805fbc0 0x7fdc880b4170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fdc78002f70 tx=0x7fdc78006df0).ready entity=mon.1 client_cookie=1ce3fc788419039e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:25.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc85ffb700 1 -- 172.21.15.57:0/3825966992 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc7800d4a0 con 0x7fdc8805fbc0 2021-06-25T04:49:25.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc85ffb700 1 -- 172.21.15.57:0/3825966992 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc78000e90 con 0x7fdc8805fbc0 2021-06-25T04:49:25.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc85ffb700 1 -- 172.21.15.57:0/3825966992 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc7800d7f0 con 0x7fdc8805fbc0 2021-06-25T04:49:25.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/3825966992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc8805fbc0 msgr2=0x7fdc880b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:25.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.007+0000 7fdc8d2a7700 1 --2- 172.21.15.57:0/3825966992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc8805fbc0 0x7fdc880b4170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fdc78002f70 tx=0x7fdc78006df0).stop 2021-06-25T04:49:25.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/3825966992 shutdown_connections 2021-06-25T04:49:25.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 --2- 172.21.15.57:0/3825966992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc880b6520 0x7fdc880b9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 --2- 172.21.15.57:0/3825966992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc8805fbc0 0x7fdc880b4170 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/3825966992 >> 172.21.15.57:0/3825966992 conn(0x7fdc88062360 msgr2=0x7fdc88066da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:25.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/3825966992 shutdown_connections 2021-06-25T04:49:25.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/3825966992 wait complete. 2021-06-25T04:49:25.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 Processor -- start 2021-06-25T04:49:25.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 -- start start 2021-06-25T04:49:25.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc8805fbc0 0x7fdc88142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc880b5950 0x7fdc880b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc880b6520 0x7fdc880b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880b35f0 con 0x7fdc880b6520 2021-06-25T04:49:25.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880adaf0 con 0x7fdc880b5950 2021-06-25T04:49:25.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc8d2a7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880b3820 con 0x7fdc8805fbc0 2021-06-25T04:49:25.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc877fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc880b6520 0x7fdc880b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc877fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc880b6520 0x7fdc880b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36880/0 (socket says 172.21.15.57:36880) 2021-06-25T04:49:25.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc877fe700 1 -- 172.21.15.57:0/1402048142 learned_addr learned my addr 172.21.15.57:0/1402048142 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:25.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc867fc700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc880b5950 0x7fdc880b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.011+0000 7fdc86ffd700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc8805fbc0 0x7fdc88142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc877fe700 1 -- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc8805fbc0 msgr2=0x7fdc88142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:25.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc877fe700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc8805fbc0 0x7fdc88142330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc877fe700 1 -- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc880b5950 msgr2=0x7fdc880b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc877fe700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc880b5950 0x7fdc880b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc877fe700 1 -- 172.21.15.57:0/1402048142 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7800b180 con 0x7fdc880b6520 2021-06-25T04:49:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc877fe700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc880b6520 0x7fdc880b00d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fdc80001250 tx=0x7fdc80007b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc77fff700 1 -- 172.21.15.57:0/1402048142 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc80004ab0 con 0x7fdc880b6520 2021-06-25T04:49:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc77fff700 1 -- 172.21.15.57:0/1402048142 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc80004c10 con 0x7fdc880b6520 2021-06-25T04:49:25.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/1402048142 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc880b2dc0 con 0x7fdc880b6520 2021-06-25T04:49:25.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc77fff700 1 -- 172.21.15.57:0/1402048142 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc80007170 con 0x7fdc880b6520 2021-06-25T04:49:25.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/1402048142 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc880add90 con 0x7fdc880b6520 2021-06-25T04:49:25.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/1402048142 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc880b3a20 con 0x7fdc880b6520 2021-06-25T04:49:25.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc77fff700 1 -- 172.21.15.57:0/1402048142 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdc800072d0 con 0x7fdc880b6520 2021-06-25T04:49:25.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc77fff700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdc640553d0 0x7fdc64057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc86ffd700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdc640553d0 0x7fdc64057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.015+0000 7fdc77fff700 1 -- 172.21.15.57:0/1402048142 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fdc8006db20 con 0x7fdc880b6520 2021-06-25T04:49:25.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.019+0000 7fdc86ffd700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdc640553d0 0x7fdc64057890 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fdc78017000 tx=0x7fdc78014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:25.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.023+0000 7fdc77fff700 1 -- 172.21.15.57:0/1402048142 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdc880b3a20 con 0x7fdc880b6520 2021-06-25T04:49:25.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.191+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/1402048142 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdc880b3a20 con 0x7fdc880b6520 2021-06-25T04:49:25.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.551+0000 7fdc77fff700 1 -- 172.21.15.57:0/1402048142 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdc880b3a20 con 0x7fdc880b6520 2021-06-25T04:49:25.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdc640553d0 msgr2=0x7fdc64057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:25.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdc640553d0 0x7fdc64057890 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fdc78017000 tx=0x7fdc78014000).stop 2021-06-25T04:49:25.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/1402048142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc880b6520 msgr2=0x7fdc880b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:25.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc880b6520 0x7fdc880b00d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fdc80001250 tx=0x7fdc80007b40).stop 2021-06-25T04:49:25.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/1402048142 shutdown_connections 2021-06-25T04:49:25.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdc640553d0 0x7fdc64057890 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc880b6520 0x7fdc880b00d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc880b5950 0x7fdc880b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 --2- 172.21.15.57:0/1402048142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdc8805fbc0 0x7fdc88142330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/1402048142 >> 172.21.15.57:0/1402048142 conn(0x7fdc88062360 msgr2=0x7fdc880b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:25.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/1402048142 shutdown_connections 2021-06-25T04:49:25.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.555+0000 7fdc8d2a7700 1 -- 172.21.15.57:0/1402048142 wait complete. 2021-06-25T04:49:25.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:49:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329f59e700 1 Processor -- start 2021-06-25T04:49:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329f59e700 1 -- start start 2021-06-25T04:49:25.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32a00612e0 0x7f32a00616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329f59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f32a00ad580 0x7f32a00b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329f59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32a0140400 0x7f32a01408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329f59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a00aecb0 con 0x7f32a0140400 2021-06-25T04:49:25.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329f59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a00b6ee0 con 0x7f32a00ad580 2021-06-25T04:49:25.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a00aeee0 con 0x7f32a00612e0 2021-06-25T04:49:25.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329ed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32a0140400 0x7f32a01408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329ed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32a0140400 0x7f32a01408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36890/0 (socket says 172.21.15.57:36890) 2021-06-25T04:49:25.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329ed9d700 1 -- 172.21.15.57:0/3059864207 learned_addr learned my addr 172.21.15.57:0/3059864207 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:25.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329e59c700 1 --2- 172.21.15.57:0/3059864207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32a00612e0 0x7f32a00616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329dd9b700 1 --2- 172.21.15.57:0/3059864207 >> v2:172.21.15.87:3300/0 conn(0x7f32a00ad580 0x7f32a00b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329ed9d700 1 -- 172.21.15.57:0/3059864207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32a00612e0 msgr2=0x7f32a00616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:25.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329ed9d700 1 --2- 172.21.15.57:0/3059864207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32a00612e0 0x7f32a00616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329ed9d700 1 -- 172.21.15.57:0/3059864207 >> v2:172.21.15.87:3300/0 conn(0x7f32a00ad580 msgr2=0x7f32a00b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:25.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329ed9d700 1 --2- 172.21.15.57:0/3059864207 >> v2:172.21.15.87:3300/0 conn(0x7f32a00ad580 0x7f32a00b9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329ed9d700 1 -- 172.21.15.57:0/3059864207 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a00af180 con 0x7f32a0140400 2021-06-25T04:49:25.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329ed9d700 1 --2- 172.21.15.57:0/3059864207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32a0140400 0x7f32a01408b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f32980032f0 tx=0x7f3298009290).ready entity=mon.0 client_cookie=be5a13dd9e37289e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:25.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329d59a700 1 -- 172.21.15.57:0/3059864207 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f329800b680 con 0x7f32a0140400 2021-06-25T04:49:25.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329d59a700 1 -- 172.21.15.57:0/3059864207 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329800b7e0 con 0x7f32a0140400 2021-06-25T04:49:25.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329d59a700 1 -- 172.21.15.57:0/3059864207 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f329800b950 con 0x7f32a0140400 2021-06-25T04:49:25.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329f59e700 1 -- 172.21.15.57:0/3059864207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32a0140400 msgr2=0x7f32a01408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:25.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.691+0000 7f329f59e700 1 --2- 172.21.15.57:0/3059864207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32a0140400 0x7f32a01408b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f32980032f0 tx=0x7f3298009290).stop 2021-06-25T04:49:25.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.695+0000 7f329f59e700 1 -- 172.21.15.57:0/3059864207 shutdown_connections 2021-06-25T04:49:25.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.695+0000 7f329f59e700 1 --2- 172.21.15.57:0/3059864207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32a0140400 0x7f32a01408b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.695+0000 7f329f59e700 1 --2- 172.21.15.57:0/3059864207 >> v2:172.21.15.87:3300/0 conn(0x7f32a00ad580 0x7f32a00b9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.695+0000 7f329f59e700 1 --2- 172.21.15.57:0/3059864207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32a00612e0 0x7f32a00616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.695+0000 7f329f59e700 1 -- 172.21.15.57:0/3059864207 >> 172.21.15.57:0/3059864207 conn(0x7f32a0066da0 msgr2=0x7f32a0067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:25.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.695+0000 7f329f59e700 1 -- 172.21.15.57:0/3059864207 shutdown_connections 2021-06-25T04:49:25.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.695+0000 7f329f59e700 1 -- 172.21.15.57:0/3059864207 wait complete. 2021-06-25T04:49:25.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.695+0000 7f329f59e700 1 Processor -- start 2021-06-25T04:49:25.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.695+0000 7f329f59e700 1 -- start start 2021-06-25T04:49:25.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32a00612e0 0x7f32a0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32a00ad580 0x7f32a00ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32a0140400 0x7f32a0146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329f59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a0146710 con 0x7f32a00ad580 2021-06-25T04:49:25.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a00ab640 con 0x7f32a00612e0 2021-06-25T04:49:25.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a01528c0 con 0x7f32a0140400 2021-06-25T04:49:25.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32a00ad580 0x7f32a00ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32a00ad580 0x7f32a00ab150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36894/0 (socket says 172.21.15.57:36894) 2021-06-25T04:49:25.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329e59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32a00612e0 0x7f32a0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329dd9b700 1 -- 172.21.15.57:0/1008571957 learned_addr learned my addr 172.21.15.57:0/1008571957 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:25.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329ed9d700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32a0140400 0x7f32a0146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329dd9b700 1 -- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32a0140400 msgr2=0x7f32a0146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:25.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329dd9b700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32a0140400 0x7f32a0146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329dd9b700 1 -- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32a00612e0 msgr2=0x7f32a0152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:25.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329dd9b700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32a00612e0 0x7f32a0152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:25.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329dd9b700 1 -- 172.21.15.57:0/1008571957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3298009530 con 0x7f32a00ad580 2021-06-25T04:49:25.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329dd9b700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32a00ad580 0x7f32a00ab150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f328800c000 tx=0x7f3288006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:25.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f32977fe700 1 -- 172.21.15.57:0/1008571957 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3288010780 con 0x7f32a00ad580 2021-06-25T04:49:25.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f32977fe700 1 -- 172.21.15.57:0/1008571957 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32880108e0 con 0x7f32a00ad580 2021-06-25T04:49:25.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329f59e700 1 -- 172.21.15.57:0/1008571957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a0152b60 con 0x7f32a00ad580 2021-06-25T04:49:25.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f32977fe700 1 -- 172.21.15.57:0/1008571957 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3288010c40 con 0x7f32a00ad580 2021-06-25T04:49:25.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329f59e700 1 -- 172.21.15.57:0/1008571957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a01449c0 con 0x7f32a00ad580 2021-06-25T04:49:25.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.699+0000 7f329f59e700 1 -- 172.21.15.57:0/1008571957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a0057310 con 0x7f32a00ad580 2021-06-25T04:49:25.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.703+0000 7f32977fe700 1 -- 172.21.15.57:0/1008571957 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f328801c460 con 0x7f32a00ad580 2021-06-25T04:49:25.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.703+0000 7f32977fe700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3284055340 0x7f3284057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:25.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.703+0000 7f32977fe700 1 -- 172.21.15.57:0/1008571957 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f328806e4c0 con 0x7f32a00ad580 2021-06-25T04:49:25.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.703+0000 7f329e59c700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3284055340 0x7f3284057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:25.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.703+0000 7f329e59c700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3284055340 0x7f3284057800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f329000b000 tx=0x7f3290006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:25.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.707+0000 7f32977fe700 1 -- 172.21.15.57:0/1008571957 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3288044430 con 0x7f32a00ad580 2021-06-25T04:49:25.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:25.835+0000 7f329f59e700 1 -- 172.21.15.57:0/1008571957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32a00620c0 con 0x7f32a00ad580 2021-06-25T04:49:26.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.571+0000 7f32977fe700 1 -- 172.21.15.57:0/1008571957 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 185+0+0 (secure 0 0 0) 0x7f3288047a50 con 0x7f32a00ad580 2021-06-25T04:49:26.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 -- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3284055340 msgr2=0x7f3284057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:26.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3284055340 0x7f3284057800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f329000b000 tx=0x7f3290006df0).stop 2021-06-25T04:49:26.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 -- 172.21.15.57:0/1008571957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32a00ad580 msgr2=0x7f32a00ab150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:26.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32a00ad580 0x7f32a00ab150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f328800c000 tx=0x7f3288006df0).stop 2021-06-25T04:49:26.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 -- 172.21.15.57:0/1008571957 shutdown_connections 2021-06-25T04:49:26.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3284055340 0x7f3284057800 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:26.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32a0140400 0x7f32a0146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:26.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32a00ad580 0x7f32a00ab150 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:26.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 --2- 172.21.15.57:0/1008571957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32a00612e0 0x7f32a0152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:26.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 -- 172.21.15.57:0/1008571957 >> 172.21.15.57:0/1008571957 conn(0x7f32a0066da0 msgr2=0x7f32a00ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:26.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 -- 172.21.15.57:0/1008571957 shutdown_connections 2021-06-25T04:49:26.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.579+0000 7f329f59e700 1 -- 172.21.15.57:0/1008571957 wait complete. 2021-06-25T04:49:26.589 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:49:26.599 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:49:26.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.691+0000 7f2ace416700 1 Processor -- start 2021-06-25T04:49:26.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.691+0000 7f2ace416700 1 -- start start 2021-06-25T04:49:26.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ace416700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2ac80af920 0x7f2ac80b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:26.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ace416700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac80ad560 con 0x7f2ac80b04b0 2021-06-25T04:49:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ace416700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac80ad020 con 0x7f2ac80afd00 2021-06-25T04:49:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ace416700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac80af420 con 0x7f2ac80af920 2021-06-25T04:49:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac77fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2ac80b04b0 0x7f2ac80b2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54122/0 (socket says 172.21.15.57:54122) 2021-06-25T04:49:26.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac77fe700 1 -- 172.21.15.57:0/2159419500 learned_addr learned my addr 172.21.15.57:0/2159419500 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:26.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac7fff700 1 --2- 172.21.15.57:0/2159419500 >> v2:172.21.15.87:3300/0 conn(0x7f2ac80af920 0x7f2ac80b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:26.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731859693 0 0) 0x7f2ac80ad560 con 0x7f2ac80b04b0 2021-06-25T04:49:26.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aa8003260 con 0x7f2ac80b04b0 2021-06-25T04:49:26.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2573906843 0 0) 0x7f2aa8003260 con 0x7f2ac80b04b0 2021-06-25T04:49:26.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 >> v2:172.21.15.87:3300/0 conn(0x7f2ac80af920 msgr2=0x7f2ac80b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:26.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 --2- 172.21.15.57:0/2159419500 >> v2:172.21.15.87:3300/0 conn(0x7f2ac80af920 0x7f2ac80b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:26.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 >> v1:172.21.15.87:6789/0 conn(0x7f2ac80afd00 legacy=0x7f2ac813fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:26.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80ad2c0 con 0x7f2ac80b04b0 2021-06-25T04:49:26.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f2ab0001660 con 0x7f2ac80b04b0 2021-06-25T04:49:26.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac7fff700 1 --2- 172.21.15.57:0/2159419500 >> v2:172.21.15.87:3300/0 conn(0x7f2ac80af920 0x7f2ac80b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 >> v1:172.21.15.57:6789/0 conn(0x7f2ac80b04b0 legacy=0x7f2ac80b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 --2- 172.21.15.57:0/2159419500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2aa8003750 0x7f2aa8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 --2- 172.21.15.57:0/2159419500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2aa8004500 0x7f2aa8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:26.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 --2- 172.21.15.57:0/2159419500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 0x7f2aa800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:26.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80af420 con 0x7f2aa8004e70 2021-06-25T04:49:26.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa800bd20 con 0x7f2aa8003750 2021-06-25T04:49:26.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa800bee0 con 0x7f2aa8004500 2021-06-25T04:49:26.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac7fff700 1 --2- 172.21.15.57:0/2159419500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2aa8003750 0x7f2aa8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:26.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2acc9b3700 1 --2- 172.21.15.57:0/2159419500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 0x7f2aa800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:26.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac77fe700 1 --2- 172.21.15.57:0/2159419500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2aa8004500 0x7f2aa8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:26.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2acc9b3700 1 -- 172.21.15.57:0/2159419500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2aa8004500 msgr2=0x7f2aa8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:26.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2acc9b3700 1 --2- 172.21.15.57:0/2159419500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2aa8004500 0x7f2aa8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:26.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2acc9b3700 1 -- 172.21.15.57:0/2159419500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2aa8003750 msgr2=0x7f2aa8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:26.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2acc9b3700 1 --2- 172.21.15.57:0/2159419500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2aa8003750 0x7f2aa8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:26.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2acc9b3700 1 -- 172.21.15.57:0/2159419500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa8003260 con 0x7f2aa8004e70 2021-06-25T04:49:26.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2acc9b3700 1 -- 172.21.15.57:0/2159419500 reap_dead start 2021-06-25T04:49:26.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2acc9b3700 1 --2- 172.21.15.57:0/2159419500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 0x7f2aa800b750 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f2ac80b3040 tx=0x7f2ac0007a00).ready entity=mon.0 client_cookie=bf37ff956dfc330c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:26.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.695+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ac0007d10 con 0x7f2aa8004e70 2021-06-25T04:49:26.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.699+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac0007030 con 0x7f2aa8004e70 2021-06-25T04:49:26.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.699+0000 7f2ac6ffd700 1 -- 172.21.15.57:0/2159419500 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ac0007390 con 0x7f2aa8004e70 2021-06-25T04:49:26.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.699+0000 7f2ace416700 1 -- 172.21.15.57:0/2159419500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 msgr2=0x7f2aa800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:26.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.699+0000 7f2ace416700 1 --2- 172.21.15.57:0/2159419500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 0x7f2aa800b750 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f2ac80b3040 tx=0x7f2ac0007a00).stop 2021-06-25T04:49:26.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.699+0000 7f2ace416700 1 -- 172.21.15.57:0/2159419500 shutdown_connections 2021-06-25T04:49:26.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.699+0000 7f2ace416700 1 --2- 172.21.15.57:0/2159419500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 0x7f2aa800b750 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:26.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.699+0000 7f2ace416700 1 -- 172.21.15.57:0/2159419500 >> 172.21.15.57:0/2159419500 conn(0x7f2ac805cce0 msgr2=0x7f2ac8062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:26.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.699+0000 7f2ace416700 1 -- 172.21.15.57:0/2159419500 shutdown_connections 2021-06-25T04:49:26.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.699+0000 7f2ace416700 1 -- 172.21.15.57:0/2159419500 wait complete. 2021-06-25T04:49:26.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.699+0000 7f2ace416700 1 Processor -- start 2021-06-25T04:49:26.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.699+0000 7f2ace416700 1 -- start start 2021-06-25T04:49:26.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ace416700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 0x7f2ac809f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:26.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ace416700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ac80671d0 0x7f2ac8155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:26.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ace416700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac809fc00 0x7f2ac8155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:26.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ace416700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8065860 con 0x7f2aa8004e70 2021-06-25T04:49:26.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ace416700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8064da0 con 0x7f2ac809fc00 2021-06-25T04:49:26.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ace416700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8065a90 con 0x7f2ac80671d0 2021-06-25T04:49:26.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 0x7f2ac809f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:26.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 0x7f2ac809f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36914/0 (socket says 172.21.15.57:36914) 2021-06-25T04:49:26.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac7fff700 1 -- 172.21.15.57:0/1589307573 learned_addr learned my addr 172.21.15.57:0/1589307573 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:26.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac77fe700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ac80671d0 0x7f2ac8155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:26.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac7fff700 1 -- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ac80671d0 msgr2=0x7f2ac8155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:26.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac7fff700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ac80671d0 0x7f2ac8155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:26.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac7fff700 1 -- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac809fc00 msgr2=0x7f2ac8155e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-06-25T04:49:26.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac7fff700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac809fc00 0x7f2ac8155e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-06-25T04:49:26.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac7fff700 1 -- 172.21.15.57:0/1589307573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8065040 con 0x7f2aa8004e70 2021-06-25T04:49:26.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac77fe700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ac80671d0 0x7f2ac8155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:26.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac7fff700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 0x7f2ac809f710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f2ab800c000 tx=0x7f2ab800a370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:26.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac57fa700 1 -- 172.21.15.57:0/1589307573 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ab800fcd0 con 0x7f2aa8004e70 2021-06-25T04:49:26.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac57fa700 1 -- 172.21.15.57:0/1589307573 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab800fe30 con 0x7f2aa8004e70 2021-06-25T04:49:26.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ace416700 1 -- 172.21.15.57:0/1589307573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac8066470 con 0x7f2aa8004e70 2021-06-25T04:49:26.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ac57fa700 1 -- 172.21.15.57:0/1589307573 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ab8013630 con 0x7f2aa8004e70 2021-06-25T04:49:26.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.703+0000 7f2ace416700 1 -- 172.21.15.57:0/1589307573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac80a5120 con 0x7f2aa8004e70 2021-06-25T04:49:26.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.707+0000 7f2ace416700 1 -- 172.21.15.57:0/1589307573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac8057310 con 0x7f2aa8004e70 2021-06-25T04:49:26.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.707+0000 7f2ac57fa700 1 -- 172.21.15.57:0/1589307573 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2ab8023070 con 0x7f2aa8004e70 2021-06-25T04:49:26.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.707+0000 7f2ac57fa700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2aac0553d0 0x7f2aac057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:26.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.707+0000 7f2ac57fa700 1 -- 172.21.15.57:0/1589307573 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f2ab806ebf0 con 0x7f2aa8004e70 2021-06-25T04:49:26.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.707+0000 7f2ac77fe700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2aac0553d0 0x7f2aac057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:26.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.707+0000 7f2ac77fe700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2aac0553d0 0x7f2aac057890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f2ab0005000 tx=0x7f2ab0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:26.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.711+0000 7f2ac57fa700 1 -- 172.21.15.57:0/1589307573 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2ab8044e60 con 0x7f2aa8004e70 2021-06-25T04:49:26.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:26.835+0000 7f2ace416700 1 -- 172.21.15.57:0/1589307573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ac805d720 con 0x7f2aa8004e70 2021-06-25T04:49:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.583+0000 7f2ac57fa700 1 -- 172.21.15.57:0/1589307573 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2ab8021030 con 0x7f2aa8004e70 2021-06-25T04:49:27.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.587+0000 7f2ace416700 1 -- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2aac0553d0 msgr2=0x7f2aac057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:27.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.587+0000 7f2ace416700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2aac0553d0 0x7f2aac057890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f2ab0005000 tx=0x7f2ab0009040).stop 2021-06-25T04:49:27.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.587+0000 7f2ace416700 1 -- 172.21.15.57:0/1589307573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 msgr2=0x7f2ac809f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:27.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.587+0000 7f2ace416700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 0x7f2ac809f710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f2ab800c000 tx=0x7f2ab800a370).stop 2021-06-25T04:49:27.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.591+0000 7f2ace416700 1 -- 172.21.15.57:0/1589307573 shutdown_connections 2021-06-25T04:49:27.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.591+0000 7f2ace416700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2aac0553d0 0x7f2aac057890 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.591+0000 7f2ace416700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac809fc00 0x7f2ac8155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-06-25T04:49:27.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.591+0000 7f2ace416700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ac80671d0 0x7f2ac8155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.591+0000 7f2ace416700 1 --2- 172.21.15.57:0/1589307573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aa8004e70 0x7f2ac809f710 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.591+0000 7f2ace416700 1 -- 172.21.15.57:0/1589307573 >> 172.21.15.57:0/1589307573 conn(0x7f2ac805cce0 msgr2=0x7f2ac813de50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:27.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.591+0000 7f2ace416700 1 -- 172.21.15.57:0/1589307573 shutdown_connections 2021-06-25T04:49:27.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.591+0000 7f2ace416700 1 -- 172.21.15.57:0/1589307573 wait complete. 2021-06-25T04:49:27.604 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:49:27.609 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-06-25T04:49:27.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.711+0000 7fcfd9147700 1 Processor -- start 2021-06-25T04:49:27.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.711+0000 7fcfd9147700 1 -- start start 2021-06-25T04:49:27.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfd413e700 0x7fcfd4141040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:27.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcfd40b0fb0 0x7fcfd4141530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:27.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd40aaa50 con 0x7fcfd40b26e0 2021-06-25T04:49:27.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd4140c50 con 0x7fcfd40b0fb0 2021-06-25T04:49:27.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40b2ac0 con 0x7fcfd413e700 2021-06-25T04:49:27.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcfd40b26e0 0x7fcfd413dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54138/0 (socket says 172.21.15.57:54138) 2021-06-25T04:49:27.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd3fff700 1 -- 172.21.15.57:0/2212937644 learned_addr learned my addr 172.21.15.57:0/2212937644 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:27.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd37fe700 1 --2- 172.21.15.57:0/2212937644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfd413e700 0x7fcfd4141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:27.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd8946700 1 --2- 172.21.15.57:0/2212937644 >> v2:172.21.15.87:3300/0 conn(0x7fcfd40b0fb0 0x7fcfd4141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:27.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd2ffd700 1 -- 172.21.15.57:0/2212937644 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883459347 0 0) 0x7fcfc4001110 con 0x7fcfd40b26e0 2021-06-25T04:49:27.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd2ffd700 1 -- 172.21.15.57:0/2212937644 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfb4003260 con 0x7fcfd40b26e0 2021-06-25T04:49:27.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd8946700 1 -- 172.21.15.57:0/2212937644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfd413e700 msgr2=0x7fcfd4141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:27.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd8946700 1 --2- 172.21.15.57:0/2212937644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfd413e700 0x7fcfd4141040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd8946700 1 -- 172.21.15.57:0/2212937644 >> v1:172.21.15.57:6789/0 conn(0x7fcfd40b26e0 legacy=0x7fcfd413dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:27.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd8946700 1 -- 172.21.15.57:0/2212937644 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd40aa270 con 0x7fcfd40b0fb0 2021-06-25T04:49:27.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd37fe700 1 --2- 172.21.15.57:0/2212937644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfd413e700 0x7fcfd4141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:27.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd8946700 1 --2- 172.21.15.57:0/2212937644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfd40b0fb0 0x7fcfd4141530 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fcfcc0032f0 tx=0x7fcfcc0091d0).ready entity=mon.1 client_cookie=c61c4963bdbe7cf6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd2ffd700 1 -- 172.21.15.57:0/2212937644 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfcc00b600 con 0x7fcfd40b0fb0 2021-06-25T04:49:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd2ffd700 1 -- 172.21.15.57:0/2212937644 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc00b760 con 0x7fcfd40b0fb0 2021-06-25T04:49:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd2ffd700 1 -- 172.21.15.57:0/2212937644 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfcc00b8d0 con 0x7fcfd40b0fb0 2021-06-25T04:49:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 -- 172.21.15.57:0/2212937644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfd40b0fb0 msgr2=0x7fcfd4141530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:27.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 --2- 172.21.15.57:0/2212937644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfd40b0fb0 0x7fcfd4141530 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fcfcc0032f0 tx=0x7fcfcc0091d0).stop 2021-06-25T04:49:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 -- 172.21.15.57:0/2212937644 shutdown_connections 2021-06-25T04:49:27.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 --2- 172.21.15.57:0/2212937644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfd40b0fb0 0x7fcfd4141530 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 --2- 172.21.15.57:0/2212937644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfd413e700 0x7fcfd4141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 -- 172.21.15.57:0/2212937644 >> 172.21.15.57:0/2212937644 conn(0x7fcfd4060140 msgr2=0x7fcfd40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:27.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 -- 172.21.15.57:0/2212937644 shutdown_connections 2021-06-25T04:49:27.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 -- 172.21.15.57:0/2212937644 wait complete. 2021-06-25T04:49:27.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 Processor -- start 2021-06-25T04:49:27.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.715+0000 7fcfd9147700 1 -- start start 2021-06-25T04:49:27.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd9147700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfd40b0fb0 0x7fcfd40af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:27.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd9147700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfd40b26e0 0x7fcfd40b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:27.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd9147700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfd40b34d0 0x7fcfd40b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:27.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd9147700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40b3970 con 0x7fcfd40b0fb0 2021-06-25T04:49:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd9147700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40b3c10 con 0x7fcfd40b26e0 2021-06-25T04:49:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd9147700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40b3eb0 con 0x7fcfd40b34d0 2021-06-25T04:49:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd37fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfd40b26e0 0x7fcfd40b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfd40b0fb0 0x7fcfd40af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd37fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfd40b26e0 0x7fcfd40b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:45420/0 (socket says 172.21.15.57:45420) 2021-06-25T04:49:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd37fe700 1 -- 172.21.15.57:0/1962076850 learned_addr learned my addr 172.21.15.57:0/1962076850 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd8946700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfd40b34d0 0x7fcfd40b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd37fe700 1 -- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfd40b34d0 msgr2=0x7fcfd40b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd37fe700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfd40b34d0 0x7fcfd40b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd37fe700 1 -- 172.21.15.57:0/1962076850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfd40b0fb0 msgr2=0x7fcfd40af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:27.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd37fe700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfd40b0fb0 0x7fcfd40af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd37fe700 1 -- 172.21.15.57:0/1962076850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc00b180 con 0x7fcfd40b26e0 2021-06-25T04:49:27.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd37fe700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfd40b26e0 0x7fcfd40b4670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fcfbc00c000 tx=0x7fcfbc006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:27.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd17fa700 1 -- 172.21.15.57:0/1962076850 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfbc010780 con 0x7fcfd40b26e0 2021-06-25T04:49:27.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd17fa700 1 -- 172.21.15.57:0/1962076850 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc0108e0 con 0x7fcfd40b26e0 2021-06-25T04:49:27.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd9147700 1 -- 172.21.15.57:0/1962076850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc009470 con 0x7fcfd40b26e0 2021-06-25T04:49:27.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd17fa700 1 -- 172.21.15.57:0/1962076850 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfbc010c40 con 0x7fcfd40b26e0 2021-06-25T04:49:27.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd9147700 1 -- 172.21.15.57:0/1962076850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd40afc30 con 0x7fcfd40b26e0 2021-06-25T04:49:27.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd9147700 1 -- 172.21.15.57:0/1962076850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd40b43b0 con 0x7fcfd40b26e0 2021-06-25T04:49:27.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd17fa700 1 -- 172.21.15.57:0/1962076850 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcfbc01c460 con 0x7fcfd40b26e0 2021-06-25T04:49:27.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd17fa700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcfb8055450 0x7fcfb8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:27.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.719+0000 7fcfd17fa700 1 -- 172.21.15.57:0/1962076850 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fcfbc06e190 con 0x7fcfd40b26e0 2021-06-25T04:49:27.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.723+0000 7fcfd3fff700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcfb8055450 0x7fcfb8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:27.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.723+0000 7fcfd3fff700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcfb8055450 0x7fcfb8057910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fcfc400d000 tx=0x7fcfc40078a0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:27.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.731+0000 7fcfd17fa700 1 -- 172.21.15.57:0/1962076850 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcfd40b43b0 con 0x7fcfd40b26e0 2021-06-25T04:49:27.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.859+0000 7fcfd9147700 1 -- 172.21.15.57:0/1962076850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcfd40b43b0 con 0x7fcfd40b26e0 2021-06-25T04:49:27.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.867+0000 7fcfd17fa700 1 -- 172.21.15.57:0/1962076850 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcfd40b43b0 con 0x7fcfd40b26e0 2021-06-25T04:49:27.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 -- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcfb8055450 msgr2=0x7fcfb8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:27.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcfb8055450 0x7fcfb8057910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fcfc400d000 tx=0x7fcfc40078a0).stop 2021-06-25T04:49:27.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 -- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfd40b26e0 msgr2=0x7fcfd40b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:27.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfd40b26e0 0x7fcfd40b4670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fcfbc00c000 tx=0x7fcfbc006df0).stop 2021-06-25T04:49:27.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 -- 172.21.15.57:0/1962076850 shutdown_connections 2021-06-25T04:49:27.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcfb8055450 0x7fcfb8057910 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfd40b34d0 0x7fcfd40b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfd40b26e0 0x7fcfd40b4670 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 --2- 172.21.15.57:0/1962076850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfd40b0fb0 0x7fcfd40af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:27.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 -- 172.21.15.57:0/1962076850 >> 172.21.15.57:0/1962076850 conn(0x7fcfd4060140 msgr2=0x7fcfd413c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:27.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 -- 172.21.15.57:0/1962076850 shutdown_connections 2021-06-25T04:49:27.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.871+0000 7fcfd9147700 1 -- 172.21.15.57:0/1962076850 wait complete. 2021-06-25T04:49:27.890 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-06-25T04:49:27.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb8b59e700 1 Processor -- start 2021-06-25T04:49:27.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb8b59e700 1 -- start start 2021-06-25T04:49:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb8b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feb8c0b4a60 0x7feb8c0b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb8b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8c0649e0 0x7feb8c0664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb8b59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c0b8050 con 0x7feb8c064600 2021-06-25T04:49:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb8b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c142f00 con 0x7feb8c0b4a60 2021-06-25T04:49:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb8b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c1430f0 con 0x7feb8c0649e0 2021-06-25T04:49:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb89d9b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feb8c0b4a60 0x7feb8c0b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb8a59c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7feb8c064600 0x7feb8c143830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:54900/0 (socket says 172.21.15.57:54900) 2021-06-25T04:49:28.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb8a59c700 1 -- 172.21.15.57:0/4056135335 learned_addr learned my addr 172.21.15.57:0/4056135335 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:28.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb8ad9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8c0649e0 0x7feb8c0664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb89d9b700 1 -- 172.21.15.57:0/4056135335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8c0649e0 msgr2=0x7feb8c0664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:28.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb89d9b700 1 --2- 172.21.15.57:0/4056135335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8c0649e0 0x7feb8c0664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb89d9b700 1 -- 172.21.15.57:0/4056135335 >> v1:172.21.15.87:6789/0 conn(0x7feb8c064600 legacy=0x7feb8c143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:28.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.991+0000 7feb89d9b700 1 -- 172.21.15.57:0/4056135335 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c143390 con 0x7feb8c0b4a60 2021-06-25T04:49:28.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb89d9b700 1 --2- 172.21.15.57:0/4056135335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0b4a60 0x7feb8c0b36d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7feb80002f70 tx=0x7feb80006df0).ready entity=mon.1 client_cookie=ba85377915e7c07d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:28.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb8959a700 1 -- 172.21.15.57:0/4056135335 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb8000d570 con 0x7feb8c0b4a60 2021-06-25T04:49:28.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb8959a700 1 -- 172.21.15.57:0/4056135335 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80000e90 con 0x7feb8c0b4a60 2021-06-25T04:49:28.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb8959a700 1 -- 172.21.15.57:0/4056135335 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb8000d8c0 con 0x7feb8c0b4a60 2021-06-25T04:49:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb8b59e700 1 -- 172.21.15.57:0/4056135335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0b4a60 msgr2=0x7feb8c0b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb8b59e700 1 --2- 172.21.15.57:0/4056135335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0b4a60 0x7feb8c0b36d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7feb80002f70 tx=0x7feb80006df0).stop 2021-06-25T04:49:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb8b59e700 1 -- 172.21.15.57:0/4056135335 shutdown_connections 2021-06-25T04:49:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb8b59e700 1 --2- 172.21.15.57:0/4056135335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8c0649e0 0x7feb8c0664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb8b59e700 1 --2- 172.21.15.57:0/4056135335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0b4a60 0x7feb8c0b36d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb8b59e700 1 -- 172.21.15.57:0/4056135335 >> 172.21.15.57:0/4056135335 conn(0x7feb8c05f670 msgr2=0x7feb8c05fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:28.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb8b59e700 1 -- 172.21.15.57:0/4056135335 shutdown_connections 2021-06-25T04:49:28.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.995+0000 7feb8b59e700 1 -- 172.21.15.57:0/4056135335 wait complete. 2021-06-25T04:49:28.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8b59e700 1 Processor -- start 2021-06-25T04:49:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8b59e700 1 -- start start 2021-06-25T04:49:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb8c064600 0x7feb8c144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8c0649e0 0x7feb8c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0b4a60 0x7feb8c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c147060 con 0x7feb8c064600 2021-06-25T04:49:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c147250 con 0x7feb8c0b4a60 2021-06-25T04:49:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c146430 con 0x7feb8c0649e0 2021-06-25T04:49:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb8c064600 0x7feb8c144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb8c064600 0x7feb8c144600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36940/0 (socket says 172.21.15.57:36940) 2021-06-25T04:49:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8a59c700 1 -- 172.21.15.57:0/3005471712 learned_addr learned my addr 172.21.15.57:0/3005471712 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb89d9b700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8c0649e0 0x7feb8c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8ad9d700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0b4a60 0x7feb8c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8a59c700 1 -- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8c0649e0 msgr2=0x7feb8c146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8a59c700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8c0649e0 0x7feb8c146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8a59c700 1 -- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0b4a60 msgr2=0x7feb8c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:28.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8a59c700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0b4a60 0x7feb8c0ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8a59c700 1 -- 172.21.15.57:0/3005471712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8000b180 con 0x7feb8c064600 2021-06-25T04:49:28.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8a59c700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb8c064600 0x7feb8c144600 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7feb8c063c00 tx=0x7feb840014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:28.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb7b7fe700 1 -- 172.21.15.57:0/3005471712 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb84005ba0 con 0x7feb8c064600 2021-06-25T04:49:28.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb7b7fe700 1 -- 172.21.15.57:0/3005471712 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb84005d00 con 0x7feb8c064600 2021-06-25T04:49:28.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb8b59e700 1 -- 172.21.15.57:0/3005471712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c1466d0 con 0x7feb8c064600 2021-06-25T04:49:28.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:27.999+0000 7feb7b7fe700 1 -- 172.21.15.57:0/3005471712 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb840072c0 con 0x7feb8c064600 2021-06-25T04:49:28.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.003+0000 7feb8b59e700 1 -- 172.21.15.57:0/3005471712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c140a70 con 0x7feb8c064600 2021-06-25T04:49:28.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.003+0000 7feb7b7fe700 1 -- 172.21.15.57:0/3005471712 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7feb84010070 con 0x7feb8c064600 2021-06-25T04:49:28.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.003+0000 7feb8b59e700 1 -- 172.21.15.57:0/3005471712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c0b0020 con 0x7feb8c064600 2021-06-25T04:49:28.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.003+0000 7feb7b7fe700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb680553f0 0x7feb680578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.003+0000 7feb7b7fe700 1 -- 172.21.15.57:0/3005471712 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5686+0+0 (secure 0 0 0) 0x7feb8406d610 con 0x7feb8c064600 2021-06-25T04:49:28.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.003+0000 7feb89d9b700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb680553f0 0x7feb680578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.003+0000 7feb89d9b700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb680553f0 0x7feb680578b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7feb80019000 tx=0x7feb80014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:28.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.011+0000 7feb7b7fe700 1 -- 172.21.15.57:0/3005471712 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7feb8c0b0020 con 0x7feb8c064600 2021-06-25T04:49:28.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.175+0000 7feb8b59e700 1 -- 172.21.15.57:0/3005471712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7feb8c0b0020 con 0x7feb8c064600 2021-06-25T04:49:28.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.587+0000 7feb7b7fe700 1 -- 172.21.15.57:0/3005471712 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v101) v1 ==== 139+0+0 (secure 0 0 0) 0x7feb8c0b0020 con 0x7feb8c064600 2021-06-25T04:49:28.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.587+0000 7feb8b59e700 1 -- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb680553f0 msgr2=0x7feb680578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:28.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.587+0000 7feb8b59e700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb680553f0 0x7feb680578b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7feb80019000 tx=0x7feb80014000).stop 2021-06-25T04:49:28.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.587+0000 7feb8b59e700 1 -- 172.21.15.57:0/3005471712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb8c064600 msgr2=0x7feb8c144600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:28.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.587+0000 7feb8b59e700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb8c064600 0x7feb8c144600 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7feb8c063c00 tx=0x7feb840014a0).stop 2021-06-25T04:49:28.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.587+0000 7feb8b59e700 1 -- 172.21.15.57:0/3005471712 shutdown_connections 2021-06-25T04:49:28.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.587+0000 7feb8b59e700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb680553f0 0x7feb680578b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.591+0000 7feb8b59e700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0b4a60 0x7feb8c0ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.591+0000 7feb8b59e700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8c0649e0 0x7feb8c146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.591+0000 7feb8b59e700 1 --2- 172.21.15.57:0/3005471712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb8c064600 0x7feb8c144600 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.591+0000 7feb8b59e700 1 -- 172.21.15.57:0/3005471712 >> 172.21.15.57:0/3005471712 conn(0x7feb8c05f670 msgr2=0x7feb8c0b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:28.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.591+0000 7feb8b59e700 1 -- 172.21.15.57:0/3005471712 shutdown_connections 2021-06-25T04:49:28.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.591+0000 7feb8b59e700 1 -- 172.21.15.57:0/3005471712 wait complete. 2021-06-25T04:49:28.613 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-06-25T04:49:28.613 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2021-06-25T04:49:28.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-06-25T04:49:28.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff333e50700 1 Processor -- start 2021-06-25T04:49:28.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff333e50700 1 -- start start 2021-06-25T04:49:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff333e50700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff32c0b1d70 0x7ff32c0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff333e50700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff32c0a7080 0x7ff32c1446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff333e50700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c0b0310 con 0x7ff32c148360 2021-06-25T04:49:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff333e50700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32c0a9080 con 0x7ff32c0b1d70 2021-06-25T04:49:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff333e50700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0b05b0 con 0x7ff32c0a7080 2021-06-25T04:49:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff3313eb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff32c148360 0x7ff32c0b2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54170/0 (socket says 172.21.15.57:54170) 2021-06-25T04:49:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff3313eb700 1 -- 172.21.15.57:0/2457651219 learned_addr learned my addr 172.21.15.57:0/2457651219 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff331bec700 1 --2- 172.21.15.57:0/2457651219 >> v2:172.21.15.87:3300/0 conn(0x7ff32c0b1d70 0x7ff32c0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff3323ed700 1 --2- 172.21.15.57:0/2457651219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff32c0a7080 0x7ff32c1446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff330bea700 1 -- 172.21.15.57:0/2457651219 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744838746 0 0) 0x7ff32c0b0310 con 0x7ff32c148360 2021-06-25T04:49:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff330bea700 1 -- 172.21.15.57:0/2457651219 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff318003260 con 0x7ff32c148360 2021-06-25T04:49:28.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff331bec700 1 -- 172.21.15.57:0/2457651219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff32c0a7080 msgr2=0x7ff32c1446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:28.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff331bec700 1 --2- 172.21.15.57:0/2457651219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff32c0a7080 0x7ff32c1446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff331bec700 1 -- 172.21.15.57:0/2457651219 >> v1:172.21.15.57:6789/0 conn(0x7ff32c148360 legacy=0x7ff32c0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:28.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff331bec700 1 -- 172.21.15.57:0/2457651219 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c0b0850 con 0x7ff32c0b1d70 2021-06-25T04:49:28.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff331bec700 1 --2- 172.21.15.57:0/2457651219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff32c0b1d70 0x7ff32c0b0f90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7ff32c1476f0 tx=0x7ff3240091d0).ready entity=mon.1 client_cookie=859f50f8a67ee5f0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:28.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.719+0000 7ff330bea700 1 -- 172.21.15.57:0/2457651219 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff32400b600 con 0x7ff32c0b1d70 2021-06-25T04:49:28.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff330bea700 1 -- 172.21.15.57:0/2457651219 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32400b760 con 0x7ff32c0b1d70 2021-06-25T04:49:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff330bea700 1 -- 172.21.15.57:0/2457651219 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff32400b8d0 con 0x7ff32c0b1d70 2021-06-25T04:49:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 -- 172.21.15.57:0/2457651219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff32c0b1d70 msgr2=0x7ff32c0b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 --2- 172.21.15.57:0/2457651219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff32c0b1d70 0x7ff32c0b0f90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7ff32c1476f0 tx=0x7ff3240091d0).stop 2021-06-25T04:49:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 -- 172.21.15.57:0/2457651219 shutdown_connections 2021-06-25T04:49:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 --2- 172.21.15.57:0/2457651219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff32c0a7080 0x7ff32c1446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 --2- 172.21.15.57:0/2457651219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff32c0b1d70 0x7ff32c0b0f90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 -- 172.21.15.57:0/2457651219 >> 172.21.15.57:0/2457651219 conn(0x7ff32c05f670 msgr2=0x7ff32c05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 -- 172.21.15.57:0/2457651219 shutdown_connections 2021-06-25T04:49:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 -- 172.21.15.57:0/2457651219 wait complete. 2021-06-25T04:49:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 Processor -- start 2021-06-25T04:49:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 -- start start 2021-06-25T04:49:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff32c0a7080 0x7ff32c0adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0b1d70 0x7ff32c066dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff32c148360 0x7ff32c0672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c063e80 con 0x7ff32c0b1d70 2021-06-25T04:49:28.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0640b0 con 0x7ff32c148360 2021-06-25T04:49:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff333e50700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c064350 con 0x7ff32c0a7080 2021-06-25T04:49:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff3313eb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0b1d70 0x7ff32c066dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff3313eb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0b1d70 0x7ff32c066dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36956/0 (socket says 172.21.15.57:36956) 2021-06-25T04:49:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff3313eb700 1 -- 172.21.15.57:0/1903258733 learned_addr learned my addr 172.21.15.57:0/1903258733 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff3323ed700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff32c148360 0x7ff32c0672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.723+0000 7ff331bec700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff32c0a7080 0x7ff32c0adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff3313eb700 1 -- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff32c0a7080 msgr2=0x7ff32c0adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff3313eb700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff32c0a7080 0x7ff32c0adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff3313eb700 1 -- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff32c148360 msgr2=0x7ff32c0672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:28.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff3313eb700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff32c148360 0x7ff32c0672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:28.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff3313eb700 1 -- 172.21.15.57:0/1903258733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324009470 con 0x7ff32c0b1d70 2021-06-25T04:49:28.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff3323ed700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff32c148360 0x7ff32c0672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:28.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff3313eb700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0b1d70 0x7ff32c066dd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7ff320001110 tx=0x7ff320007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:28.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff32affd700 1 -- 172.21.15.57:0/1903258733 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3200070d0 con 0x7ff32c0b1d70 2021-06-25T04:49:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff32affd700 1 -- 172.21.15.57:0/1903258733 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff320007230 con 0x7ff32c0b1d70 2021-06-25T04:49:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff333e50700 1 -- 172.21.15.57:0/1903258733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c0645f0 con 0x7ff32c0b1d70 2021-06-25T04:49:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff32affd700 1 -- 172.21.15.57:0/1903258733 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff320005610 con 0x7ff32c0b1d70 2021-06-25T04:49:28.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff333e50700 1 -- 172.21.15.57:0/1903258733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c0ae480 con 0x7ff32c0b1d70 2021-06-25T04:49:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff333e50700 1 -- 172.21.15.57:0/1903258733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c0647b0 con 0x7ff32c0b1d70 2021-06-25T04:49:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff32affd700 1 -- 172.21.15.57:0/1903258733 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff320010070 con 0x7ff32c0b1d70 2021-06-25T04:49:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff32affd700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff30c0553d0 0x7ff30c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.727+0000 7ff32affd700 1 -- 172.21.15.57:0/1903258733 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ff32006d1f0 con 0x7ff32c0b1d70 2021-06-25T04:49:28.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.731+0000 7ff331bec700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff30c0553d0 0x7ff30c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:28.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.731+0000 7ff331bec700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff30c0553d0 0x7ff30c057890 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7ff32401b000 tx=0x7ff324016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:28.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.735+0000 7ff32affd700 1 -- 172.21.15.57:0/1903258733 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff320043680 con 0x7ff32c0b1d70 2021-06-25T04:49:28.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:28.911+0000 7ff333e50700 1 -- 172.21.15.57:0/1903258733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7ff32c057310 con 0x7ff32c0b1d70 2021-06-25T04:49:29.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.587+0000 7ff32affd700 1 -- 172.21.15.57:0/1903258733 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v102) v1 ==== 147+0+0 (secure 0 0 0) 0x7ff320046ca0 con 0x7ff32c0b1d70 2021-06-25T04:49:29.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 -- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff30c0553d0 msgr2=0x7ff30c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:29.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff30c0553d0 0x7ff30c057890 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7ff32401b000 tx=0x7ff324016000).stop 2021-06-25T04:49:29.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 -- 172.21.15.57:0/1903258733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0b1d70 msgr2=0x7ff32c066dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:29.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0b1d70 0x7ff32c066dd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7ff320001110 tx=0x7ff320007aa0).stop 2021-06-25T04:49:29.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 -- 172.21.15.57:0/1903258733 shutdown_connections 2021-06-25T04:49:29.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff30c0553d0 0x7ff30c057890 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff32c148360 0x7ff32c0672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0b1d70 0x7ff32c066dd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 --2- 172.21.15.57:0/1903258733 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff32c0a7080 0x7ff32c0adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 -- 172.21.15.57:0/1903258733 >> 172.21.15.57:0/1903258733 conn(0x7ff32c05f670 msgr2=0x7ff32c146c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:29.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 -- 172.21.15.57:0/1903258733 shutdown_connections 2021-06-25T04:49:29.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.591+0000 7ff333e50700 1 -- 172.21.15.57:0/1903258733 wait complete. 2021-06-25T04:49:29.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:49:29.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319ffff700 1 Processor -- start 2021-06-25T04:49:29.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319ffff700 1 -- start start 2021-06-25T04:49:29.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31a005f9b0 0x7f31a013fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:29.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f31a00b1e80 0x7f31a01402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:29.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319ffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a00af880 con 0x7f31a00ae1f0 2021-06-25T04:49:29.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319ffff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a00b01f0 con 0x7f31a00b1e80 2021-06-25T04:49:29.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319ffff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a005fd90 con 0x7f31a005f9b0 2021-06-25T04:49:29.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319e7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f31a00b1e80 0x7f31a01402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:29.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319e7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f31a00b1e80 0x7f31a01402b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36964/0 (socket says 172.21.15.57:36964) 2021-06-25T04:49:29.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319e7fc700 1 -- 172.21.15.57:0/3477437999 learned_addr learned my addr 172.21.15.57:0/3477437999 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:29.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319effd700 1 --2- 172.21.15.57:0/3477437999 >> v2:172.21.15.87:3300/0 conn(0x7f31a005f9b0 0x7f31a013fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:29.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319e7fc700 1 -- 172.21.15.57:0/3477437999 >> v2:172.21.15.87:3300/0 conn(0x7f31a005f9b0 msgr2=0x7f31a013fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:29.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319e7fc700 1 --2- 172.21.15.57:0/3477437999 >> v2:172.21.15.87:3300/0 conn(0x7f31a005f9b0 0x7f31a013fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319e7fc700 1 -- 172.21.15.57:0/3477437999 >> v1:172.21.15.57:6789/0 conn(0x7f31a00ae1f0 legacy=0x7f31a0143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:29.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319e7fc700 1 -- 172.21.15.57:0/3477437999 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a00acff0 con 0x7f31a00b1e80 2021-06-25T04:49:29.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.723+0000 7f319dffb700 1 -- 172.21.15.57:0/3477437999 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426365963 0 0) 0x7f31a00af880 con 0x7f31a00ae1f0 2021-06-25T04:49:29.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319e7fc700 1 --2- 172.21.15.57:0/3477437999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00b1e80 0x7f31a01402b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f3194002f70 tx=0x7f3194006eb0).ready entity=mon.0 client_cookie=47ec2d1ea55cf6b0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:29.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319dffb700 1 -- 172.21.15.57:0/3477437999 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f319400d610 con 0x7f31a00b1e80 2021-06-25T04:49:29.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319dffb700 1 -- 172.21.15.57:0/3477437999 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3194000e90 con 0x7f31a00b1e80 2021-06-25T04:49:29.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319dffb700 1 -- 172.21.15.57:0/3477437999 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f319400d960 con 0x7f31a00b1e80 2021-06-25T04:49:29.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319ffff700 1 -- 172.21.15.57:0/3477437999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00b1e80 msgr2=0x7f31a01402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:29.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319ffff700 1 --2- 172.21.15.57:0/3477437999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00b1e80 0x7f31a01402b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f3194002f70 tx=0x7f3194006eb0).stop 2021-06-25T04:49:29.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319ffff700 1 -- 172.21.15.57:0/3477437999 shutdown_connections 2021-06-25T04:49:29.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319ffff700 1 --2- 172.21.15.57:0/3477437999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00b1e80 0x7f31a01402b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319ffff700 1 --2- 172.21.15.57:0/3477437999 >> v2:172.21.15.87:3300/0 conn(0x7f31a005f9b0 0x7f31a013fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319ffff700 1 -- 172.21.15.57:0/3477437999 >> 172.21.15.57:0/3477437999 conn(0x7f31a00611f0 msgr2=0x7f31a0062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:29.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319ffff700 1 -- 172.21.15.57:0/3477437999 shutdown_connections 2021-06-25T04:49:29.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319ffff700 1 -- 172.21.15.57:0/3477437999 wait complete. 2021-06-25T04:49:29.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319ffff700 1 Processor -- start 2021-06-25T04:49:29.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.727+0000 7f319ffff700 1 -- start start 2021-06-25T04:49:29.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a005f9b0 0x7f31a0146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:29.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00ae1f0 0x7f31a013fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31a00b1e80 0x7f31a0063cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319ffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a0140430 con 0x7f31a005f9b0 2021-06-25T04:49:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319ffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a00668c0 con 0x7f31a00ae1f0 2021-06-25T04:49:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319ffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a0064830 con 0x7f31a00b1e80 2021-06-25T04:49:29.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a005f9b0 0x7f31a0146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:29.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a005f9b0 0x7f31a0146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36968/0 (socket says 172.21.15.57:36968) 2021-06-25T04:49:29.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319effd700 1 -- 172.21.15.57:0/769678284 learned_addr learned my addr 172.21.15.57:0/769678284 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:29.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319e7fc700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00ae1f0 0x7f31a013fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:29.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319f7fe700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31a00b1e80 0x7f31a0063cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:29.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319effd700 1 -- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31a00b1e80 msgr2=0x7f31a0063cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:29.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319effd700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31a00b1e80 0x7f31a0063cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319effd700 1 -- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00ae1f0 msgr2=0x7f31a013fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:29.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319effd700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00ae1f0 0x7f31a013fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319effd700 1 -- 172.21.15.57:0/769678284 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319400b1e0 con 0x7f31a005f9b0 2021-06-25T04:49:29.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319effd700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a005f9b0 0x7f31a0146980 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f31900030b0 tx=0x7f3190008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:29.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f318ffff700 1 -- 172.21.15.57:0/769678284 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3190011780 con 0x7f31a005f9b0 2021-06-25T04:49:29.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f318ffff700 1 -- 172.21.15.57:0/769678284 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31900118e0 con 0x7f31a005f9b0 2021-06-25T04:49:29.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319ffff700 1 -- 172.21.15.57:0/769678284 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a0140660 con 0x7f31a005f9b0 2021-06-25T04:49:29.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f318ffff700 1 -- 172.21.15.57:0/769678284 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3190011c40 con 0x7f31a005f9b0 2021-06-25T04:49:29.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319ffff700 1 -- 172.21.15.57:0/769678284 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a0140a20 con 0x7f31a005f9b0 2021-06-25T04:49:29.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.731+0000 7f319ffff700 1 -- 172.21.15.57:0/769678284 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a013fa20 con 0x7f31a005f9b0 2021-06-25T04:49:29.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.735+0000 7f318ffff700 1 -- 172.21.15.57:0/769678284 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f319001c460 con 0x7f31a005f9b0 2021-06-25T04:49:29.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.735+0000 7f318ffff700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f317c0553d0 0x7f317c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:29.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.735+0000 7f318ffff700 1 -- 172.21.15.57:0/769678284 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f319006e0f0 con 0x7f31a005f9b0 2021-06-25T04:49:29.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.735+0000 7f319e7fc700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f317c0553d0 0x7f317c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:29.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.735+0000 7f319e7fc700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f317c0553d0 0x7f317c057890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f3194019000 tx=0x7f3194015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:29.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.739+0000 7f318ffff700 1 -- 172.21.15.57:0/769678284 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3190044520 con 0x7f31a005f9b0 2021-06-25T04:49:29.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.871+0000 7f319ffff700 1 -- 172.21.15.57:0/769678284 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f31a0057310 con 0x7f31a005f9b0 2021-06-25T04:49:29.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.879+0000 7f318ffff700 1 -- 172.21.15.57:0/769678284 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3190047b40 con 0x7f31a005f9b0 2021-06-25T04:49:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 -- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f317c0553d0 msgr2=0x7f317c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f317c0553d0 0x7f317c057890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f3194019000 tx=0x7f3194015000).stop 2021-06-25T04:49:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 -- 172.21.15.57:0/769678284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a005f9b0 msgr2=0x7f31a0146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:29.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a005f9b0 0x7f31a0146980 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f31900030b0 tx=0x7f3190008040).stop 2021-06-25T04:49:29.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 -- 172.21.15.57:0/769678284 shutdown_connections 2021-06-25T04:49:29.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f317c0553d0 0x7f317c057890 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31a00b1e80 0x7f31a0063cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00ae1f0 0x7f31a013fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 --2- 172.21.15.57:0/769678284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a005f9b0 0x7f31a0146980 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:29.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 -- 172.21.15.57:0/769678284 >> 172.21.15.57:0/769678284 conn(0x7f31a00611f0 msgr2=0x7f31a0142f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:29.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 -- 172.21.15.57:0/769678284 shutdown_connections 2021-06-25T04:49:29.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:29.883+0000 7f319ffff700 1 -- 172.21.15.57:0/769678284 wait complete. 2021-06-25T04:49:29.904 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:49:29.904 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:49:29.921 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:49:29.943 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:49:29.966 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:49:29.988 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:49:29.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:29.990 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:49:29.990 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:49:30.014 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:49:30.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:49:30.016 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:49:30.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:30.017 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:49:30.017 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:49:30.025 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:49:30.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:49:30.026 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:49:30.027 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:49:30.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 Processor -- start 2021-06-25T04:49:30.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 -- start start 2021-06-25T04:49:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fca9c063890 0x7fca9c143d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0618e0 0x7fca9c140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c063c70 con 0x7fca9c0b1290 2021-06-25T04:49:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c13fd70 con 0x7fca9c063890 2021-06-25T04:49:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c061fb0 con 0x7fca9c0618e0 2021-06-25T04:49:30.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa1b8e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fca9c063890 0x7fca9c143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa238f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fca9c0b1290 0x7fca9c128c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54196/0 (socket says 172.21.15.57:54196) 2021-06-25T04:49:30.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa238f700 1 -- 172.21.15.57:0/4046876748 learned_addr learned my addr 172.21.15.57:0/4046876748 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:30.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa138d700 1 --2- 172.21.15.57:0/4046876748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0618e0 0x7fca9c140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa0b8c700 1 -- 172.21.15.57:0/4046876748 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513428598 0 0) 0x7fca9c063c70 con 0x7fca9c0b1290 2021-06-25T04:49:30.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa0b8c700 1 -- 172.21.15.57:0/4046876748 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca88003260 con 0x7fca9c0b1290 2021-06-25T04:49:30.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa1b8e700 1 -- 172.21.15.57:0/4046876748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0618e0 msgr2=0x7fca9c140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:30.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa1b8e700 1 --2- 172.21.15.57:0/4046876748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0618e0 0x7fca9c140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa1b8e700 1 -- 172.21.15.57:0/4046876748 >> v1:172.21.15.57:6789/0 conn(0x7fca9c0b1290 legacy=0x7fca9c128c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa1b8e700 1 -- 172.21.15.57:0/4046876748 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c13ff60 con 0x7fca9c063890 2021-06-25T04:49:30.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa1b8e700 1 --2- 172.21.15.57:0/4046876748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c063890 0x7fca9c143d10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fca9c061860 tx=0x7fca98006df0).ready entity=mon.0 client_cookie=87fad249281e7b20 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:30.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa0b8c700 1 -- 172.21.15.57:0/4046876748 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9800d570 con 0x7fca9c063890 2021-06-25T04:49:30.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa0b8c700 1 -- 172.21.15.57:0/4046876748 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca98000e90 con 0x7fca9c063890 2021-06-25T04:49:30.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa0b8c700 1 -- 172.21.15.57:0/4046876748 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9800d8c0 con 0x7fca9c063890 2021-06-25T04:49:30.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 -- 172.21.15.57:0/4046876748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c063890 msgr2=0x7fca9c143d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 --2- 172.21.15.57:0/4046876748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c063890 0x7fca9c143d10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fca9c061860 tx=0x7fca98006df0).stop 2021-06-25T04:49:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 -- 172.21.15.57:0/4046876748 shutdown_connections 2021-06-25T04:49:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 --2- 172.21.15.57:0/4046876748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0618e0 0x7fca9c140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 --2- 172.21.15.57:0/4046876748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c063890 0x7fca9c143d10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 -- 172.21.15.57:0/4046876748 >> 172.21.15.57:0/4046876748 conn(0x7fca9c05c450 msgr2=0x7fca9c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.135+0000 7fcaa2b90700 1 -- 172.21.15.57:0/4046876748 shutdown_connections 2021-06-25T04:49:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa2b90700 1 -- 172.21.15.57:0/4046876748 wait complete. 2021-06-25T04:49:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa2b90700 1 Processor -- start 2021-06-25T04:49:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa2b90700 1 -- start start 2021-06-25T04:49:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa2b90700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0618e0 0x7fca9c0afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa2b90700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c063890 0x7fca9c148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa2b90700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c0b1290 0x7fca9c1493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa2b90700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c148ac0 con 0x7fca9c063890 2021-06-25T04:49:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa2b90700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b2860 con 0x7fca9c0b1290 2021-06-25T04:49:30.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa2b90700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b17f0 con 0x7fca9c0618e0 2021-06-25T04:49:30.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa138d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c063890 0x7fca9c148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa138d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c063890 0x7fca9c148ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36984/0 (socket says 172.21.15.57:36984) 2021-06-25T04:49:30.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa138d700 1 -- 172.21.15.57:0/2171719529 learned_addr learned my addr 172.21.15.57:0/2171719529 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:30.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa1b8e700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0618e0 0x7fca9c0afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.139+0000 7fcaa238f700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c0b1290 0x7fca9c1493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fcaa138d700 1 -- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0618e0 msgr2=0x7fca9c0afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fcaa138d700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0618e0 0x7fca9c0afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fcaa138d700 1 -- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c0b1290 msgr2=0x7fca9c1493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fcaa138d700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c0b1290 0x7fca9c1493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fcaa138d700 1 -- 172.21.15.57:0/2171719529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9800b180 con 0x7fca9c063890 2021-06-25T04:49:30.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fcaa138d700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c063890 0x7fca9c148ef0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fca9400c000 tx=0x7fca940091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:30.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fca92ffd700 1 -- 172.21.15.57:0/2171719529 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9400c6a0 con 0x7fca9c063890 2021-06-25T04:49:30.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fca92ffd700 1 -- 172.21.15.57:0/2171719529 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9400c800 con 0x7fca9c063890 2021-06-25T04:49:30.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fcaa2b90700 1 -- 172.21.15.57:0/2171719529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c0b1a90 con 0x7fca9c063890 2021-06-25T04:49:30.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fca92ffd700 1 -- 172.21.15.57:0/2171719529 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9400cb60 con 0x7fca9c063890 2021-06-25T04:49:30.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fcaa2b90700 1 -- 172.21.15.57:0/2171719529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c1498d0 con 0x7fca9c063890 2021-06-25T04:49:30.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fca92ffd700 1 -- 172.21.15.57:0/2171719529 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fca94022070 con 0x7fca9c063890 2021-06-25T04:49:30.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.143+0000 7fcaa2b90700 1 -- 172.21.15.57:0/2171719529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c148c30 con 0x7fca9c063890 2021-06-25T04:49:30.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.147+0000 7fca92ffd700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca7c055450 0x7fca7c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.147+0000 7fca92ffd700 1 -- 172.21.15.57:0/2171719529 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fca9406e2f0 con 0x7fca9c063890 2021-06-25T04:49:30.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.147+0000 7fcaa1b8e700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca7c055450 0x7fca7c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.147+0000 7fcaa1b8e700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca7c055450 0x7fca7c057910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fca98019000 tx=0x7fca98014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:30.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.155+0000 7fca92ffd700 1 -- 172.21.15.57:0/2171719529 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fca9c148c30 con 0x7fca9c063890 2021-06-25T04:49:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.287+0000 7fcaa2b90700 1 -- 172.21.15.57:0/2171719529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fca9c057310 con 0x7fca9c063890 2021-06-25T04:49:30.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.287+0000 7fca92ffd700 1 -- 172.21.15.57:0/2171719529 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v38) v1 ==== 81+0+29219 (secure 0 0 0) 0x7fca94044700 con 0x7fca9c063890 2021-06-25T04:49:30.295 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:30.295 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:49:30.295 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 38, 2021-06-25T04:49:30.295 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:49:30.296 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:49:30.296 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:49:27.570976+0000", 2021-06-25T04:49:30.296 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:49:30.296 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:49:30.297 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:49:30.297 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:49:30.297 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:49:30.297 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:49:30.297 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:49:30.298 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:49:30.299 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:49:30.299 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:49:30.299 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:49:30.299 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:49:30.300 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:49:30.300 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:49:30.300 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:49:30.300 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 6, 2021-06-25T04:49:30.300 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:49:30.301 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:49:30.301 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:49:30.301 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:49:30.301 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:49:30.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.302 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:49:30.302 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:49:30.302 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:49:30.303 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:49:30.303 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:49:30.303 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:49:30.303 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:49:30.303 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:49:30.304 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:49:30.304 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:49:30.304 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:49:30.304 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:49:30.305 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:49:30.305 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:49:30.305 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:49:30.305 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:49:30.305 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:49:30.306 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:49:30.306 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:49:30.306 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:49:30.306 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:49:30.307 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:49:30.307 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:49:30.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.307 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:49:30.307 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:49:30.308 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:49:30.308 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:49:30.308 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:49:30.308 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:49:30.309 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:49:30.309 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:49:30.309 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:49:30.309 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:49:30.309 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:49:30.310 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:49:30.310 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:49:30.310 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:49:30.310 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:49:30.311 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:49:30.311 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:49:30.311 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:49:30.311 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:49:30.312 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:49:30.312 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:49:30.312 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:49:30.312 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:49:30.312 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:49:30.313 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:49:30.313 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:49:30.313 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:49:30.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.314 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:49:30.314 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:49:30.314 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:49:30.314 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:49:30.315 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:49:30.315 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:49:30.315 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:49:30.315 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:49:30.315 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:49:30.316 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:49:30.316 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:49:30.316 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:49:30.316 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:49:30.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.317 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:49:30.317 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:49:30.317 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.318 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:49:30.318 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:49:30.318 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:49:30.319 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:49:30.319 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:49:30.319 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:49:30.319 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:49:30.320 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:49:30.320 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:49:30.320 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:49:30.320 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:49:30.320 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:49:30.321 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:49:30.321 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:49:30.321 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:49:30.321 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:49:30.322 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:49:30.322 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:49:30.322 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:49:30.322 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:49:30.323 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:49:30.323 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:49:30.323 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:49:30.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.323 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:49:30.324 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:49:30.324 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:49:30.324 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:49:30.324 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:49:30.325 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:49:30.325 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:49:30.325 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:49:30.325 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:49:30.325 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:49:30.326 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:49:30.326 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:49:30.326 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:49:30.326 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:49:30.327 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:49:30.327 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:49:30.327 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:49:30.327 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:49:30.328 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:49:30.328 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:49:30.328 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:49:30.328 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:49:30.328 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:49:30.329 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:49:30.329 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:49:30.329 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:49:30.329 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:49:30.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.330 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:49:30.330 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:49:30.330 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:49:30.330 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:49:30.331 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:49:30.331 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:49:30.331 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:49:30.331 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:49:30.332 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:49:30.332 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:49:30.332 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:49:30.332 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:49:30.332 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:49:30.333 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:49:30.333 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.333 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.333 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:49:30.334 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:49:30.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.334 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:49:30.334 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:49:30.334 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:30.335 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:30.335 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:30.335 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:30.335 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:30.336 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:30.336 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:30.336 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:30.336 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:30.336 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:30.337 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:30.337 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.337 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.338 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:49:30.338 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:30.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.339 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.339 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:49:30.339 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:30.339 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.339 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.340 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:30.340 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.340 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.341 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:49:30.341 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:30.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.342 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.342 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:49:30.342 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:30.342 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.343 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.343 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:30.343 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.344 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.344 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:49:30.344 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:30.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.345 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.345 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:49:30.345 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:30.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.346 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.346 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:30.346 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.347 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.347 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:49:30.347 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:30.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.348 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.348 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:49:30.348 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:49:30.349 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.349 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.349 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:49:30.349 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:49:30.350 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:49:30.350 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:49:30.350 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:30.350 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:30.351 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:30.351 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.351 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:49:30.352 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:49:30.352 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:30.352 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:30.352 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:30.353 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:30.353 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:30.353 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:30.353 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:30.354 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:30.354 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:30.354 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:30.354 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:30.354 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.355 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.355 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:49:30.355 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:30.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.356 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.356 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:49:30.356 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:30.357 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.357 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.357 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:30.358 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.358 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.358 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:49:30.358 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:30.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.359 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.359 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:49:30.360 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:30.360 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.360 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.360 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:30.361 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.361 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.361 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:49:30.362 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:30.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.362 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.363 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:49:30.363 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:30.363 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.363 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.364 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:30.364 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.364 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.365 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:49:30.365 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:30.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.365 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.366 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:49:30.366 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:49:30.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.366 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.367 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:49:30.367 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:49:30.367 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:49:30.367 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:49:30.368 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:30.368 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:30.368 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:30.368 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.369 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:49:30.369 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:49:30.369 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:30.370 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:30.370 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:30.370 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:30.370 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:30.371 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:30.371 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:30.371 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 32, 2021-06-25T04:49:30.371 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:30.371 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:30.372 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:30.372 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.372 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.373 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:49:30.373 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:30.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.373 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.374 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:49:30.374 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:30.374 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.374 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.375 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:30.375 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.375 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.376 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:49:30.376 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:30.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.377 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.377 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:49:30.377 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:30.377 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.377 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.378 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:30.378 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.379 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.379 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:49:30.379 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:30.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.380 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.380 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:49:30.380 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:30.380 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.381 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.381 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:30.381 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.382 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.382 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:49:30.382 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:30.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.383 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.383 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:49:30.383 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:49:30.384 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.384 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.384 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:49:30.384 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:49:30.385 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:49:30.385 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:49:30.385 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:30.385 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:30.386 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:30.386 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.386 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:49:30.387 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:49:30.387 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:30.387 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:30.387 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:30.388 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:30.388 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:30.388 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:30.388 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:30.388 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:30.389 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:30.389 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:30.389 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:30.389 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.390 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.390 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:49:30.390 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:30.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.391 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.391 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:49:30.391 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:30.392 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.392 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.392 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:30.393 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.393 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.393 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:49:30.393 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:30.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.394 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.394 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:49:30.395 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:30.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.395 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.395 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:30.396 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.396 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.396 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:49:30.397 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:30.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.397 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.397 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:49:30.398 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:30.398 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.398 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.399 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:30.399 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.399 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.400 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:49:30.400 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:30.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.400 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.401 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:49:30.401 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:49:30.401 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.401 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.402 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:49:30.402 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:49:30.402 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:49:30.402 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:49:30.403 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:30.403 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:30.403 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:30.403 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.404 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:49:30.404 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:49:30.404 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:30.405 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:30.405 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:30.405 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:30.405 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:30.406 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:30.406 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:30.406 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:30.406 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:30.406 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:30.407 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:30.407 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.407 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.407 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:49:30.408 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:30.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.408 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.409 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:49:30.409 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:30.409 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.409 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.410 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:30.410 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.410 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.411 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:49:30.411 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:30.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.412 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.412 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:49:30.412 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:30.412 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.412 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.413 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:30.413 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.414 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.414 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:49:30.414 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:30.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.415 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.415 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:49:30.415 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:30.415 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.416 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.416 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:30.416 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.417 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.417 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:49:30.417 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:30.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.418 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.418 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:49:30.418 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:49:30.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.419 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.419 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:49:30.420 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:49:30.420 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:49:30.420 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:49:30.420 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:30.420 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:30.421 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:30.421 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.422 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:49:30.422 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:49:30.422 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:30.422 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:30.422 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:30.423 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:30.423 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:30.423 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:30.423 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:30.424 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:30.424 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:30.424 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:30.424 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:30.424 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.425 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.425 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:49:30.425 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:30.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.426 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.426 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:49:30.426 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:30.427 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.427 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.427 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:30.428 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.428 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.428 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:49:30.429 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:30.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.429 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.429 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:49:30.430 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:30.430 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.430 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.431 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:30.431 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.431 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.432 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:49:30.432 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:30.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.433 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.433 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:49:30.433 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:30.434 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.434 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.434 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:30.435 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.435 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.435 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:49:30.436 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:30.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.436 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.437 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:49:30.437 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:49:30.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.437 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.438 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:49:30.438 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:49:30.438 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:49:30.438 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:49:30.439 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:30.439 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:30.439 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:30.439 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.440 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:49:30.440 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:49:30.440 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:30.441 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:30.441 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:30.441 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:30.441 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:30.442 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:30.442 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:30.442 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 32, 2021-06-25T04:49:30.442 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:30.442 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:30.443 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:30.443 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.443 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.444 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:49:30.444 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:30.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.444 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.445 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:49:30.445 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:30.445 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.445 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.446 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:30.446 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.446 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.447 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:49:30.447 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:30.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.448 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.448 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:49:30.448 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:30.448 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.449 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.449 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:30.449 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.450 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.450 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:49:30.450 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:30.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.451 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.451 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:49:30.451 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:30.451 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.452 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.452 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:30.452 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.453 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.453 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:49:30.453 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:30.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.454 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.454 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:49:30.454 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:49:30.455 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.455 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.455 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:49:30.455 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:49:30.456 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:49:30.456 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:49:30.456 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:30.456 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:30.457 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:30.457 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.457 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:49:30.458 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:49:30.458 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:49:30.458 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:49:30.458 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:49:30.459 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:49:30.459 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:49:30.459 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:49:30.459 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:49:30.460 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 33, 2021-06-25T04:49:30.460 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:49:30.460 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:49:30.460 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:49:30.461 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.461 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.461 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:49:30.461 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:30.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.462 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.462 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:49:30.463 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:30.463 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.463 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.463 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:49:30.464 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.464 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.464 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:49:30.465 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:30.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.465 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.465 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:49:30.466 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:30.466 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.466 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.467 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:49:30.467 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.467 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.468 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:49:30.468 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:30.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.469 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.469 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:49:30.469 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:30.469 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.469 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.470 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:49:30.470 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:49:30.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.471 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:49:30.471 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:49:30.471 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:30.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.472 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:49:30.472 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:49:30.472 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:49:30.472 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.473 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.473 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:49:30.473 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:49:30.474 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:49:30.474 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:49:30.474 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:49:30.474 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:49:30.475 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:49:30.475 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:30.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.475 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:49:30.475 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:49:30.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.476 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:49:30.476 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:30.476 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:30.477 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:30.477 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:30.477 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:30.477 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:49:30.477 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:30.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.478 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:49:30.478 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:30.479 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:30.479 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:30.479 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:30.479 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:30.480 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:49:30.480 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:30.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.480 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:49:30.481 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:30.481 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:30.481 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:30.481 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:30.482 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:30.482 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:49:30.482 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:30.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.483 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:49:30.483 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:30.483 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:30.483 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:30.484 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:30.484 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:30.484 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:49:30.484 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:30.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.485 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:49:30.485 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:30.486 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:30.486 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:30.486 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:30.486 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:30.487 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:49:30.487 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:30.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.487 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:49:30.488 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:30.488 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:30.488 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:30.488 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:30.489 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:30.489 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:49:30.489 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:30.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.490 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:49:30.490 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:30.490 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:30.491 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:30.491 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:30.491 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:30.491 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:49:30.491 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:30.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:30.492 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:49:30.492 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:49:30.493 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:49:30.493 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:49:30.493 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:49:30.493 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:49:30.494 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:49:30.494 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:49:30.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.494 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:49:30.494 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:49:30.495 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:49:30.495 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:49:30.495 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:49:30.495 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:49:30.496 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6835/2421744077": "2021-06-26T04:49:24.416173+0000", 2021-06-25T04:49:30.496 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6834/2421744077": "2021-06-26T04:49:24.416173+0000" 2021-06-25T04:49:30.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.496 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:49:30.497 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:49:30.497 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:49:30.497 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:49:30.497 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:49:30.497 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:49:30.498 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:49:30.498 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:49:30.498 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:49:30.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:49:30.499 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:49:30.499 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:49:30.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.499 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:49:30.500 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:49:30.500 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:49:30.500 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:49:30.500 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:49:30.501 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:49:30.501 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:49:30.501 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:30.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:30.501 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:49:30.502 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:49:30.502 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:49:30.502 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:49:30.502 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:49:30.503 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:49:30.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 -- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca7c055450 msgr2=0x7fca7c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca7c055450 0x7fca7c057910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fca98019000 tx=0x7fca98014000).stop 2021-06-25T04:49:30.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 -- 172.21.15.57:0/2171719529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c063890 msgr2=0x7fca9c148ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c063890 0x7fca9c148ef0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fca9400c000 tx=0x7fca940091d0).stop 2021-06-25T04:49:30.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 -- 172.21.15.57:0/2171719529 shutdown_connections 2021-06-25T04:49:30.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca7c055450 0x7fca7c057910 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c0b1290 0x7fca9c1493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c063890 0x7fca9c148ef0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 --2- 172.21.15.57:0/2171719529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0618e0 0x7fca9c0afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 -- 172.21.15.57:0/2171719529 >> 172.21.15.57:0/2171719529 conn(0x7fca9c05c450 msgr2=0x7fca9c141170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:30.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 -- 172.21.15.57:0/2171719529 shutdown_connections 2021-06-25T04:49:30.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.291+0000 7fcaa2b90700 1 -- 172.21.15.57:0/2171719529 wait complete. 2021-06-25T04:49:30.508 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:49:30.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.611+0000 7f33c15f6700 1 Processor -- start 2021-06-25T04:49:30.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.611+0000 7f33c15f6700 1 -- start start 2021-06-25T04:49:30.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f33bc063890 0x7f33bc143d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33bc0618e0 0x7f33bc140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33bc0b1290 0x7f33bc128c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33bc13fd70 con 0x7f33bc0b1290 2021-06-25T04:49:30.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33bc063c70 con 0x7f33bc063890 2021-06-25T04:49:30.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc061fb0 con 0x7f33bc0618e0 2021-06-25T04:49:30.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c0df5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33bc0b1290 0x7f33bc128c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c0df5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33bc0b1290 0x7f33bc128c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36994/0 (socket says 172.21.15.57:36994) 2021-06-25T04:49:30.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c0df5700 1 -- 172.21.15.57:0/3457318971 learned_addr learned my addr 172.21.15.57:0/3457318971 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:30.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33b37fe700 1 --2- 172.21.15.57:0/3457318971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33bc0618e0 0x7f33bc140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33bbfff700 1 --2- 172.21.15.57:0/3457318971 >> v2:172.21.15.87:3300/0 conn(0x7f33bc063890 0x7f33bc143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c0df5700 1 -- 172.21.15.57:0/3457318971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33bc0618e0 msgr2=0x7f33bc140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:30.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c0df5700 1 --2- 172.21.15.57:0/3457318971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33bc0618e0 0x7f33bc140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c0df5700 1 -- 172.21.15.57:0/3457318971 >> v2:172.21.15.87:3300/0 conn(0x7f33bc063890 msgr2=0x7f33bc143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:30.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c0df5700 1 --2- 172.21.15.57:0/3457318971 >> v2:172.21.15.87:3300/0 conn(0x7f33bc063890 0x7f33bc143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c0df5700 1 -- 172.21.15.57:0/3457318971 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc13ff60 con 0x7f33bc0b1290 2021-06-25T04:49:30.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33b37fe700 1 --2- 172.21.15.57:0/3457318971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33bc0618e0 0x7f33bc140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:30.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33bbfff700 1 --2- 172.21.15.57:0/3457318971 >> v2:172.21.15.87:3300/0 conn(0x7f33bc063890 0x7f33bc143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:30.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c0df5700 1 --2- 172.21.15.57:0/3457318971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33bc0b1290 0x7f33bc128c40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f33b40032f0 tx=0x7f33b4009290).ready entity=mon.0 client_cookie=b88f129b8fe3bdf3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:30.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33bb7fe700 1 -- 172.21.15.57:0/3457318971 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33b400b870 con 0x7f33bc0b1290 2021-06-25T04:49:30.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33bb7fe700 1 -- 172.21.15.57:0/3457318971 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b400b9d0 con 0x7f33bc0b1290 2021-06-25T04:49:30.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33bb7fe700 1 -- 172.21.15.57:0/3457318971 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33b400bb40 con 0x7f33bc0b1290 2021-06-25T04:49:30.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 -- 172.21.15.57:0/3457318971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33bc0b1290 msgr2=0x7f33bc128c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 --2- 172.21.15.57:0/3457318971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33bc0b1290 0x7f33bc128c40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f33b40032f0 tx=0x7f33b4009290).stop 2021-06-25T04:49:30.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 -- 172.21.15.57:0/3457318971 shutdown_connections 2021-06-25T04:49:30.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 --2- 172.21.15.57:0/3457318971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33bc0b1290 0x7f33bc128c40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 --2- 172.21.15.57:0/3457318971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33bc0618e0 0x7f33bc140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 --2- 172.21.15.57:0/3457318971 >> v2:172.21.15.87:3300/0 conn(0x7f33bc063890 0x7f33bc143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 -- 172.21.15.57:0/3457318971 >> 172.21.15.57:0/3457318971 conn(0x7f33bc05c450 msgr2=0x7f33bc05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:30.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 -- 172.21.15.57:0/3457318971 shutdown_connections 2021-06-25T04:49:30.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.615+0000 7f33c15f6700 1 -- 172.21.15.57:0/3457318971 wait complete. 2021-06-25T04:49:30.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33c15f6700 1 Processor -- start 2021-06-25T04:49:30.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33c15f6700 1 -- start start 2021-06-25T04:49:30.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33c15f6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33bc0618e0 0x7f33bc142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33c15f6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33bc063890 0x7f33bc156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33c15f6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33bc0b1290 0x7f33bc156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33c15f6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0b1cd0 con 0x7f33bc0618e0 2021-06-25T04:49:30.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33c15f6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc123300 con 0x7f33bc063890 2021-06-25T04:49:30.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33c15f6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc1235a0 con 0x7f33bc0b1290 2021-06-25T04:49:30.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33bc0618e0 0x7f33bc142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33bc0618e0 0x7f33bc142500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36996/0 (socket says 172.21.15.57:36996) 2021-06-25T04:49:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33bbfff700 1 -- 172.21.15.57:0/3702731002 learned_addr learned my addr 172.21.15.57:0/3702731002 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33b37fe700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33bc063890 0x7f33bc156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33c0df5700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33bc0b1290 0x7f33bc156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33bbfff700 1 -- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33bc0b1290 msgr2=0x7f33bc156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33bbfff700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33bc0b1290 0x7f33bc156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33bbfff700 1 -- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33bc063890 msgr2=0x7f33bc156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33bbfff700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33bc063890 0x7f33bc156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33bbfff700 1 -- 172.21.15.57:0/3702731002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b4009530 con 0x7f33bc0618e0 2021-06-25T04:49:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33b37fe700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33bc063890 0x7f33bc156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33bbfff700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33bc0618e0 0x7f33bc142500 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f33ac006940 tx=0x7f33ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33b9ffb700 1 -- 172.21.15.57:0/3702731002 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33ac011780 con 0x7f33bc0618e0 2021-06-25T04:49:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33c15f6700 1 -- 172.21.15.57:0/3702731002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc155b90 con 0x7f33bc0618e0 2021-06-25T04:49:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33b9ffb700 1 -- 172.21.15.57:0/3702731002 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac0118e0 con 0x7f33bc0618e0 2021-06-25T04:49:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33b9ffb700 1 -- 172.21.15.57:0/3702731002 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33ac011c40 con 0x7f33bc0618e0 2021-06-25T04:49:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.619+0000 7f33c15f6700 1 -- 172.21.15.57:0/3702731002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc0b3780 con 0x7f33bc0618e0 2021-06-25T04:49:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.623+0000 7f33c15f6700 1 -- 172.21.15.57:0/3702731002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33bc123760 con 0x7f33bc0618e0 2021-06-25T04:49:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.623+0000 7f33b9ffb700 1 -- 172.21.15.57:0/3702731002 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f33ac012420 con 0x7f33bc0618e0 2021-06-25T04:49:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.623+0000 7f33b9ffb700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33a00553d0 0x7f33a0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.623+0000 7f33b9ffb700 1 -- 172.21.15.57:0/3702731002 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f33ac06d9f0 con 0x7f33bc0618e0 2021-06-25T04:49:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.623+0000 7f33b37fe700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33a00553d0 0x7f33a0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.627+0000 7f33b37fe700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33a00553d0 0x7f33a0057890 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f33a400c000 tx=0x7f33a4008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.627+0000 7f33b9ffb700 1 -- 172.21.15.57:0/3702731002 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f33ac06fe60 con 0x7f33bc0618e0 2021-06-25T04:49:30.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.799+0000 7f33c15f6700 1 -- 172.21.15.57:0/3702731002 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33bc057310 con 0x7f33bc0618e0 2021-06-25T04:49:30.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33b9ffb700 1 -- 172.21.15.57:0/3702731002 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f33ac043d80 con 0x7f33bc0618e0 2021-06-25T04:49:30.808 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:30.809 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3329294132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329294132},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329294132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/1504287390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1504287390},{"type":"v1","addr":"172.21.15.57:6833","nonce":1504287390}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":5131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2882834477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2882834477},{"type":"v1","addr":"172.21.15.57:6835","nonce":2882834477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":15}],"filesystems":[]} 2021-06-25T04:49:30.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 -- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33a00553d0 msgr2=0x7f33a0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33a00553d0 0x7f33a0057890 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f33a400c000 tx=0x7f33a4008040).stop 2021-06-25T04:49:30.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 -- 172.21.15.57:0/3702731002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33bc0618e0 msgr2=0x7f33bc142500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33bc0618e0 0x7f33bc142500 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f33ac006940 tx=0x7f33ac008040).stop 2021-06-25T04:49:30.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 -- 172.21.15.57:0/3702731002 shutdown_connections 2021-06-25T04:49:30.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33a00553d0 0x7f33a0057890 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33bc0b1290 0x7f33bc156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33bc063890 0x7f33bc156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 --2- 172.21.15.57:0/3702731002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33bc0618e0 0x7f33bc142500 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 -- 172.21.15.57:0/3702731002 >> 172.21.15.57:0/3702731002 conn(0x7f33bc05c450 msgr2=0x7f33bc149910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:30.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 -- 172.21.15.57:0/3702731002 shutdown_connections 2021-06-25T04:49:30.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.803+0000 7f33c15f6700 1 -- 172.21.15.57:0/3702731002 wait complete. 2021-06-25T04:49:30.815 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 15 2021-06-25T04:49:30.825 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:49:30.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.919+0000 7f3ab9daf700 1 Processor -- start 2021-06-25T04:49:30.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.919+0000 7f3ab9daf700 1 -- start start 2021-06-25T04:49:30.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab9daf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ab4061640 0x7f3ab40b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab9daf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab40b68d0 con 0x7f3ab40b46d0 2021-06-25T04:49:30.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab9daf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab40b6b70 con 0x7f3ab4143960 2021-06-25T04:49:30.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab9daf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab40b9640 con 0x7f3ab4061640 2021-06-25T04:49:30.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3ab40b46d0 0x7f3ab413fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54222/0 (socket says 172.21.15.57:54222) 2021-06-25T04:49:30.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab3fff700 1 -- 172.21.15.57:0/2620011492 learned_addr learned my addr 172.21.15.57:0/2620011492 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:30.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab8dad700 1 --2- 172.21.15.57:0/2620011492 >> v2:172.21.15.57:3300/0 conn(0x7f3ab4061640 0x7f3ab40b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab37fe700 1 -- 172.21.15.57:0/2620011492 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117084755 0 0) 0x7f3ab40b68d0 con 0x7f3ab40b46d0 2021-06-25T04:49:30.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab37fe700 1 -- 172.21.15.57:0/2620011492 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a98003260 con 0x7f3ab40b46d0 2021-06-25T04:49:30.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab37fe700 1 -- 172.21.15.57:0/2620011492 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417108757 0 0) 0x7f3ab40b6b70 con 0x7f3ab4143960 2021-06-25T04:49:30.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab37fe700 1 -- 172.21.15.57:0/2620011492 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ab40b68d0 con 0x7f3ab4143960 2021-06-25T04:49:30.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab37fe700 1 -- 172.21.15.57:0/2620011492 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3647858519 0 0) 0x7f3a98003260 con 0x7f3ab40b46d0 2021-06-25T04:49:30.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab8dad700 1 -- 172.21.15.57:0/2620011492 >> v1:172.21.15.87:6789/0 conn(0x7f3ab4143960 legacy=0x7f3ab414d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab8dad700 1 -- 172.21.15.57:0/2620011492 >> v1:172.21.15.57:6789/0 conn(0x7f3ab40b46d0 legacy=0x7f3ab413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab8dad700 1 -- 172.21.15.57:0/2620011492 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab40b6e10 con 0x7f3ab4061640 2021-06-25T04:49:30.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab8dad700 1 --2- 172.21.15.57:0/2620011492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab4061640 0x7f3ab40b9cd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f3aa0001110 tx=0x7f3aa8006df0).ready entity=mon.0 client_cookie=94314c6a905cf9d6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:30.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab37fe700 1 -- 172.21.15.57:0/2620011492 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa0001660 con 0x7f3ab4061640 2021-06-25T04:49:30.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab37fe700 1 -- 172.21.15.57:0/2620011492 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa8000e90 con 0x7f3ab4061640 2021-06-25T04:49:30.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab37fe700 1 -- 172.21.15.57:0/2620011492 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa8012460 con 0x7f3ab4061640 2021-06-25T04:49:30.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab9daf700 1 -- 172.21.15.57:0/2620011492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab4061640 msgr2=0x7f3ab40b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab9daf700 1 --2- 172.21.15.57:0/2620011492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab4061640 0x7f3ab40b9cd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f3aa0001110 tx=0x7f3aa8006df0).stop 2021-06-25T04:49:30.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab9daf700 1 -- 172.21.15.57:0/2620011492 shutdown_connections 2021-06-25T04:49:30.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab9daf700 1 --2- 172.21.15.57:0/2620011492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab4061640 0x7f3ab40b9cd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab9daf700 1 -- 172.21.15.57:0/2620011492 >> 172.21.15.57:0/2620011492 conn(0x7f3ab406adb0 msgr2=0x7f3ab405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:30.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab9daf700 1 -- 172.21.15.57:0/2620011492 shutdown_connections 2021-06-25T04:49:30.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.923+0000 7f3ab9daf700 1 -- 172.21.15.57:0/2620011492 wait complete. 2021-06-25T04:49:30.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab9daf700 1 Processor -- start 2021-06-25T04:49:30.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab9daf700 1 -- start start 2021-06-25T04:49:30.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab9daf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab4061640 0x7f3ab40b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab9daf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ab4143960 0x7f3ab4155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab9daf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4139780 0x7f3ab41560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab9daf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab40b8170 con 0x7f3ab4061640 2021-06-25T04:49:30.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab9daf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab40b7a10 con 0x7f3ab4139780 2021-06-25T04:49:30.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab9daf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab40b7cb0 con 0x7f3ab4143960 2021-06-25T04:49:30.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab8dad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab4061640 0x7f3ab40b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab8dad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab4061640 0x7f3ab40b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37012/0 (socket says 172.21.15.57:37012) 2021-06-25T04:49:30.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab8dad700 1 -- 172.21.15.57:0/1122075555 learned_addr learned my addr 172.21.15.57:0/1122075555 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:30.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab3fff700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ab4143960 0x7f3ab4155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab95ae700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4139780 0x7f3ab41560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab8dad700 1 -- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ab4143960 msgr2=0x7f3ab4155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab8dad700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ab4143960 0x7f3ab4155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab8dad700 1 -- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4139780 msgr2=0x7f3ab41560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:30.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab8dad700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4139780 0x7f3ab41560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:30.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab8dad700 1 -- 172.21.15.57:0/1122075555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa800b180 con 0x7f3ab4061640 2021-06-25T04:49:30.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab3fff700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ab4143960 0x7f3ab4155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:30.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab8dad700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab4061640 0x7f3ab40b2550 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f3aa0001110 tx=0x7f3aa8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:30.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab1ffb700 1 -- 172.21.15.57:0/1122075555 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa800ddf0 con 0x7f3ab4061640 2021-06-25T04:49:30.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab1ffb700 1 -- 172.21.15.57:0/1122075555 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa800bec0 con 0x7f3ab4061640 2021-06-25T04:49:30.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab9daf700 1 -- 172.21.15.57:0/1122075555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab40b83a0 con 0x7f3ab4061640 2021-06-25T04:49:30.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab1ffb700 1 -- 172.21.15.57:0/1122075555 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa801f630 con 0x7f3ab4061640 2021-06-25T04:49:30.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.927+0000 7f3ab9daf700 1 -- 172.21.15.57:0/1122075555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab41565a0 con 0x7f3ab4061640 2021-06-25T04:49:30.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.931+0000 7f3ab9daf700 1 -- 172.21.15.57:0/1122075555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab40b6310 con 0x7f3ab4061640 2021-06-25T04:49:30.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.931+0000 7f3ab1ffb700 1 -- 172.21.15.57:0/1122075555 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3aa8025020 con 0x7f3ab4061640 2021-06-25T04:49:30.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.931+0000 7f3ab1ffb700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a9c055450 0x7f3a9c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:30.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.931+0000 7f3ab1ffb700 1 -- 172.21.15.57:0/1122075555 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f3aa806ead0 con 0x7f3ab4061640 2021-06-25T04:49:30.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.931+0000 7f3ab3fff700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a9c055450 0x7f3a9c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:30.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.931+0000 7f3ab3fff700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a9c055450 0x7f3a9c057910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f3aa000b000 tx=0x7f3aa0000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:30.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:30.939+0000 7f3ab1ffb700 1 -- 172.21.15.57:0/1122075555 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3aa8044f60 con 0x7f3ab4061640 2021-06-25T04:49:31.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.103+0000 7f3ab9daf700 1 -- 172.21.15.57:0/1122075555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ab4057310 con 0x7f3ab4061640 2021-06-25T04:49:31.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.103+0000 7f3ab1ffb700 1 -- 172.21.15.57:0/1122075555 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f3aa8048580 con 0x7f3ab4061640 2021-06-25T04:49:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:31.111 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3329294132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329294132},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329294132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/1504287390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1504287390},{"type":"v1","addr":"172.21.15.57:6833","nonce":1504287390}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":5131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2882834477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2882834477},{"type":"v1","addr":"172.21.15.57:6835","nonce":2882834477}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":15}],"filesystems":[]} 2021-06-25T04:49:31.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 -- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a9c055450 msgr2=0x7f3a9c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:31.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a9c055450 0x7f3a9c057910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f3aa000b000 tx=0x7f3aa0000bc0).stop 2021-06-25T04:49:31.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 -- 172.21.15.57:0/1122075555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab4061640 msgr2=0x7f3ab40b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:31.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab4061640 0x7f3ab40b2550 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f3aa0001110 tx=0x7f3aa8014000).stop 2021-06-25T04:49:31.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 -- 172.21.15.57:0/1122075555 shutdown_connections 2021-06-25T04:49:31.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a9c055450 0x7f3a9c057910 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:31.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4139780 0x7f3ab41560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:31.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ab4143960 0x7f3ab4155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:31.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 --2- 172.21.15.57:0/1122075555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ab4061640 0x7f3ab40b2550 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:31.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 -- 172.21.15.57:0/1122075555 >> 172.21.15.57:0/1122075555 conn(0x7f3ab406adb0 msgr2=0x7f3ab4142e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:31.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 -- 172.21.15.57:0/1122075555 shutdown_connections 2021-06-25T04:49:31.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.107+0000 7f3ab9daf700 1 -- 172.21.15.57:0/1122075555 wait complete. 2021-06-25T04:49:31.117 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 15 2021-06-25T04:49:31.129 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:49:31.129 INFO:tasks.ceph.mds.a:Stopping old one... 2021-06-25T04:49:31.130 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:49:31.130 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:49:31.131 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:49:31.131 INFO:tasks.ceph.mds.c:Stopping old one... 2021-06-25T04:49:31.131 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:49:31.131 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:49:31.132 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:49:31.132 INFO:tasks.ceph.mds.b:Stopping old one... 2021-06-25T04:49:31.132 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:49:31.133 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:49:31.142 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:49:31.143 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:49:31.146 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:49:31.146 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:49:31.148 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:49:31.148 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:49:31.151 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:49:31.152 DEBUG:teuthology.parallel:result is None 2021-06-25T04:49:31.188 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:49:31.191 DEBUG:teuthology.parallel:result is None 2021-06-25T04:49:31.191 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:49:31.192 DEBUG:teuthology.parallel:result is None 2021-06-25T04:49:31.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:49:31.225 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:49:31.270 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:49:31.273 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:49:31.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb7470c700 1 Processor -- start 2021-06-25T04:49:31.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb7470c700 1 -- start start 2021-06-25T04:49:31.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb7470c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 0x7ffb6c0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:31.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb7470c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb6c0a9b30 0x7ffb6c0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:31.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb7470c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6c0aa350 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb7470c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6c0ab220 con 0x7ffb6c0a9b30 2021-06-25T04:49:31.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb7470c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0b0460 con 0x7ffb6c0b0080 2021-06-25T04:49:31.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb724a8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 0x7ffb6c0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:31.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb72ca9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb6c0a9b30 0x7ffb6c0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:31.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb724a8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 0x7ffb6c0b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:48206/0 (socket says 172.21.15.57:48206) 2021-06-25T04:49:31.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb71ca7700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ffb6c0b1ed0 0x7ffb6c0aab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:55010/0 (socket says 172.21.15.57:55010) 2021-06-25T04:49:31.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.291+0000 7ffb724a8700 1 -- 172.21.15.57:0/2984789925 learned_addr learned my addr 172.21.15.57:0/2984789925 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:31.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb714a6700 1 -- 172.21.15.57:0/2984789925 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812479496 0 0) 0x7ffb6c0aa350 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb714a6700 1 -- 172.21.15.57:0/2984789925 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb54003260 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb724a8700 1 -- 172.21.15.57:0/2984789925 >> v2:172.21.15.87:3300/0 conn(0x7ffb6c0a9b30 msgr2=0x7ffb6c0b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:31.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb724a8700 1 --2- 172.21.15.57:0/2984789925 >> v2:172.21.15.87:3300/0 conn(0x7ffb6c0a9b30 0x7ffb6c0b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:31.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb724a8700 1 -- 172.21.15.57:0/2984789925 >> v1:172.21.15.87:6789/0 conn(0x7ffb6c0b1ed0 legacy=0x7ffb6c0aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:31.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb724a8700 1 -- 172.21.15.57:0/2984789925 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c0aa0b0 con 0x7ffb6c0b0080 2021-06-25T04:49:31.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb72ca9700 1 --2- 172.21.15.57:0/2984789925 >> v2:172.21.15.87:3300/0 conn(0x7ffb6c0a9b30 0x7ffb6c0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:31.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb724a8700 1 --2- 172.21.15.57:0/2984789925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 0x7ffb6c0b18e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ffb68002f70 tx=0x7ffb68006eb0).ready entity=mon.2 client_cookie=8e285e283fdc0cec server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:31.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb714a6700 1 -- 172.21.15.57:0/2984789925 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6800d5c0 con 0x7ffb6c0b0080 2021-06-25T04:49:31.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb714a6700 1 -- 172.21.15.57:0/2984789925 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb68000e90 con 0x7ffb6c0b0080 2021-06-25T04:49:31.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb714a6700 1 -- 172.21.15.57:0/2984789925 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6800d950 con 0x7ffb6c0b0080 2021-06-25T04:49:31.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 -- 172.21.15.57:0/2984789925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 msgr2=0x7ffb6c0b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:31.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 --2- 172.21.15.57:0/2984789925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 0x7ffb6c0b18e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ffb68002f70 tx=0x7ffb68006eb0).stop 2021-06-25T04:49:31.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 -- 172.21.15.57:0/2984789925 shutdown_connections 2021-06-25T04:49:31.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 --2- 172.21.15.57:0/2984789925 >> v2:172.21.15.87:3300/0 conn(0x7ffb6c0a9b30 0x7ffb6c0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:31.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 --2- 172.21.15.57:0/2984789925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 0x7ffb6c0b18e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:31.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 -- 172.21.15.57:0/2984789925 >> 172.21.15.57:0/2984789925 conn(0x7ffb6c060780 msgr2=0x7ffb6c060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:31.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 -- 172.21.15.57:0/2984789925 shutdown_connections 2021-06-25T04:49:31.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 -- 172.21.15.57:0/2984789925 wait complete. 2021-06-25T04:49:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 Processor -- start 2021-06-25T04:49:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 -- start start 2021-06-25T04:49:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0a9b30 0x7ffb6c143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 0x7ffb6c0adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb6c0b1ed0 0x7ffb6c0ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0af7c0 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0adb30 con 0x7ffb6c0a9b30 2021-06-25T04:49:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.295+0000 7ffb7470c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c067760 con 0x7ffb6c0b0080 2021-06-25T04:49:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb72ca9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb6c0b1ed0 0x7ffb6c0ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:31.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb71ca7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 0x7ffb6c0adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:31.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb72ca9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb6c0b1ed0 0x7ffb6c0ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37052/0 (socket says 172.21.15.57:37052) 2021-06-25T04:49:31.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb724a8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0a9b30 0x7ffb6c143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:31.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb72ca9700 1 -- 172.21.15.57:0/1583739451 learned_addr learned my addr 172.21.15.57:0/1583739451 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:31.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb72ca9700 1 -- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 msgr2=0x7ffb6c0adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:31.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb72ca9700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 0x7ffb6c0adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:31.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb72ca9700 1 -- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0a9b30 msgr2=0x7ffb6c143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:31.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb72ca9700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0a9b30 0x7ffb6c143540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:31.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb72ca9700 1 -- 172.21.15.57:0/1583739451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64009470 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb71ca7700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 0x7ffb6c0adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb72ca9700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb6c0b1ed0 0x7ffb6c0ae4e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7ffb6400c000 tx=0x7ffb640091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb5b7fe700 1 -- 172.21.15.57:0/1583739451 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6400c850 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb5b7fe700 1 -- 172.21.15.57:0/1583739451 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6400c9b0 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb7470c700 1 -- 172.21.15.57:0/1583739451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6800b1e0 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb5b7fe700 1 -- 172.21.15.57:0/1583739451 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6400cd10 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb7470c700 1 -- 172.21.15.57:0/1583739451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c13e0e0 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.299+0000 7ffb7470c700 1 -- 172.21.15.57:0/1583739451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6c13e520 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.303+0000 7ffb5b7fe700 1 -- 172.21.15.57:0/1583739451 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ffb64022070 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.303+0000 7ffb5b7fe700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb4c0554b0 0x7ffb4c057970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.303+0000 7ffb5b7fe700 1 -- 172.21.15.57:0/1583739451 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ffb6406e4b0 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.303+0000 7ffb724a8700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb4c0554b0 0x7ffb4c057970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.303+0000 7ffb724a8700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb4c0554b0 0x7ffb4c057970 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ffb6801b000 tx=0x7ffb68015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.307+0000 7ffb5b7fe700 1 -- 172.21.15.57:0/1583739451 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ffb64044830 con 0x7ffb6c0b1ed0 2021-06-25T04:49:31.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:31.443+0000 7ffb7470c700 1 -- 172.21.15.57:0/1583739451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7ffb6c057310 con 0x7ffb6c0b1ed0 2021-06-25T04:49:32.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.291+0000 7ffb5b7fe700 1 -- 172.21.15.57:0/1583739451 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffb64016080 con 0x7ffb6c0b1ed0 2021-06-25T04:49:32.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 -- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb4c0554b0 msgr2=0x7ffb4c057970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb4c0554b0 0x7ffb4c057970 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ffb6801b000 tx=0x7ffb68015000).stop 2021-06-25T04:49:32.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 -- 172.21.15.57:0/1583739451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb6c0b1ed0 msgr2=0x7ffb6c0ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb6c0b1ed0 0x7ffb6c0ae4e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7ffb6400c000 tx=0x7ffb640091d0).stop 2021-06-25T04:49:32.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 -- 172.21.15.57:0/1583739451 shutdown_connections 2021-06-25T04:49:32.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb4c0554b0 0x7ffb4c057970 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb6c0b1ed0 0x7ffb6c0ae4e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b0080 0x7ffb6c0adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 --2- 172.21.15.57:0/1583739451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0a9b30 0x7ffb6c143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 -- 172.21.15.57:0/1583739451 >> 172.21.15.57:0/1583739451 conn(0x7ffb6c060780 msgr2=0x7ffb6c0b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:32.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 -- 172.21.15.57:0/1583739451 shutdown_connections 2021-06-25T04:49:32.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.295+0000 7ffb7470c700 1 -- 172.21.15.57:0/1583739451 wait complete. 2021-06-25T04:49:32.305 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:49:32.317 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:49:32.318 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:49:32.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.419+0000 7f56d23e1700 1 Processor -- start 2021-06-25T04:49:32.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.419+0000 7f56d23e1700 1 -- start start 2021-06-25T04:49:32.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.419+0000 7f56d23e1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56cc0ab120 0x7f56cc0672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:32.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.419+0000 7f56d23e1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc065920 con 0x7f56cc0aad40 2021-06-25T04:49:32.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.419+0000 7f56d23e1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc064ed0 con 0x7f56cc0b4d10 2021-06-25T04:49:32.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.419+0000 7f56d23e1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0b3ca0 con 0x7f56cc0ab120 2021-06-25T04:49:32.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.419+0000 7f56d13df700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f56cc0aad40 0x7f56cc0647c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54278/0 (socket says 172.21.15.57:54278) 2021-06-25T04:49:32.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.419+0000 7f56d13df700 1 -- 172.21.15.57:0/2706362602 learned_addr learned my addr 172.21.15.57:0/2706362602 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:32.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d0bde700 1 --2- 172.21.15.57:0/2706362602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56cc0ab120 0x7f56cc0672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:32.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56bbfff700 1 -- 172.21.15.57:0/2706362602 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085856785 0 0) 0x7f56cc065920 con 0x7f56cc0aad40 2021-06-25T04:49:32.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56bbfff700 1 -- 172.21.15.57:0/2706362602 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b4003260 con 0x7f56cc0aad40 2021-06-25T04:49:32.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56bbfff700 1 -- 172.21.15.57:0/2706362602 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574932520 0 0) 0x7f56cc064ed0 con 0x7f56cc0b4d10 2021-06-25T04:49:32.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56bbfff700 1 -- 172.21.15.57:0/2706362602 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56cc065920 con 0x7f56cc0b4d10 2021-06-25T04:49:32.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d0bde700 1 -- 172.21.15.57:0/2706362602 >> v1:172.21.15.87:6789/0 conn(0x7f56cc0b4d10 legacy=0x7f56cc0b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d0bde700 1 -- 172.21.15.57:0/2706362602 >> v1:172.21.15.57:6789/0 conn(0x7f56cc0aad40 legacy=0x7f56cc0647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d0bde700 1 -- 172.21.15.57:0/2706362602 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc066e20 con 0x7f56cc0ab120 2021-06-25T04:49:32.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d0bde700 1 --2- 172.21.15.57:0/2706362602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56cc0ab120 0x7f56cc0672c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f56bc002f70 tx=0x7f56bc006d90).ready entity=mon.2 client_cookie=832d17e2fe4462b7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:32.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56bbfff700 1 -- 172.21.15.57:0/2706362602 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56bc00d4a0 con 0x7f56cc0ab120 2021-06-25T04:49:32.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56bbfff700 1 -- 172.21.15.57:0/2706362602 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc000e90 con 0x7f56cc0ab120 2021-06-25T04:49:32.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d23e1700 1 -- 172.21.15.57:0/2706362602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56cc0ab120 msgr2=0x7f56cc0672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56bbfff700 1 -- 172.21.15.57:0/2706362602 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56bc00d7f0 con 0x7f56cc0ab120 2021-06-25T04:49:32.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d23e1700 1 --2- 172.21.15.57:0/2706362602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56cc0ab120 0x7f56cc0672c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f56bc002f70 tx=0x7f56bc006d90).stop 2021-06-25T04:49:32.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d23e1700 1 -- 172.21.15.57:0/2706362602 shutdown_connections 2021-06-25T04:49:32.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d23e1700 1 --2- 172.21.15.57:0/2706362602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56cc0ab120 0x7f56cc0672c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d23e1700 1 -- 172.21.15.57:0/2706362602 >> 172.21.15.57:0/2706362602 conn(0x7f56cc062ba0 msgr2=0x7f56cc05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:32.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d23e1700 1 -- 172.21.15.57:0/2706362602 shutdown_connections 2021-06-25T04:49:32.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d23e1700 1 -- 172.21.15.57:0/2706362602 wait complete. 2021-06-25T04:49:32.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d23e1700 1 Processor -- start 2021-06-25T04:49:32.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.423+0000 7f56d23e1700 1 -- start start 2021-06-25T04:49:32.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d23e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56cc0aad40 0x7f56cc062080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:32.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d23e1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56cc0ab120 0x7f56cc140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:32.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d23e1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56cc0b4d10 0x7f56cc140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:32.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d23e1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc062570 con 0x7f56cc0aad40 2021-06-25T04:49:32.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d23e1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc060c20 con 0x7f56cc0ab120 2021-06-25T04:49:32.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d23e1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc13ec10 con 0x7f56cc0b4d10 2021-06-25T04:49:32.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d13df700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56cc0aad40 0x7f56cc062080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:32.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d13df700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56cc0aad40 0x7f56cc062080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37064/0 (socket says 172.21.15.57:37064) 2021-06-25T04:49:32.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d13df700 1 -- 172.21.15.57:0/3946249378 learned_addr learned my addr 172.21.15.57:0/3946249378 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:32.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d0bde700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56cc0ab120 0x7f56cc140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:32.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d1be0700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56cc0b4d10 0x7f56cc140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:32.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d13df700 1 -- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56cc0b4d10 msgr2=0x7f56cc140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d13df700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56cc0b4d10 0x7f56cc140920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d13df700 1 -- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56cc0ab120 msgr2=0x7f56cc140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d13df700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56cc0ab120 0x7f56cc140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d13df700 1 -- 172.21.15.57:0/3946249378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc00b120 con 0x7f56cc0aad40 2021-06-25T04:49:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d0bde700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56cc0ab120 0x7f56cc140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:32.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d13df700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56cc0aad40 0x7f56cc062080 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f56c8001110 tx=0x7f56c8007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:32.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56ba7fc700 1 -- 172.21.15.57:0/3946249378 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56c800ce80 con 0x7f56cc0aad40 2021-06-25T04:49:32.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56ba7fc700 1 -- 172.21.15.57:0/3946249378 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c80070d0 con 0x7f56cc0aad40 2021-06-25T04:49:32.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d23e1700 1 -- 172.21.15.57:0/3946249378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc13eeb0 con 0x7f56cc0aad40 2021-06-25T04:49:32.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56ba7fc700 1 -- 172.21.15.57:0/3946249378 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56c8007430 con 0x7f56cc0aad40 2021-06-25T04:49:32.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.427+0000 7f56d23e1700 1 -- 172.21.15.57:0/3946249378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc140e10 con 0x7f56cc0aad40 2021-06-25T04:49:32.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.431+0000 7f56d23e1700 1 -- 172.21.15.57:0/3946249378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc13f350 con 0x7f56cc0aad40 2021-06-25T04:49:32.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.431+0000 7f56ba7fc700 1 -- 172.21.15.57:0/3946249378 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f56c801a070 con 0x7f56cc0aad40 2021-06-25T04:49:32.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.431+0000 7f56ba7fc700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56ac0553d0 0x7f56ac057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:32.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.431+0000 7f56ba7fc700 1 -- 172.21.15.57:0/3946249378 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f56c806ce50 con 0x7f56cc0aad40 2021-06-25T04:49:32.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.431+0000 7f56d0bde700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56ac0553d0 0x7f56ac057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:32.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.431+0000 7f56d0bde700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56ac0553d0 0x7f56ac057890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f56bc019000 tx=0x7f56bc014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:32.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.439+0000 7f56ba7fc700 1 -- 172.21.15.57:0/3946249378 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f56cc13f350 con 0x7f56cc0aad40 2021-06-25T04:49:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.611+0000 7f56d23e1700 1 -- 172.21.15.57:0/3946249378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f56cc13f350 con 0x7f56cc0aad40 2021-06-25T04:49:32.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.611+0000 7f56ba7fc700 1 -- 172.21.15.57:0/3946249378 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f56cc13f350 con 0x7f56cc0aad40 2021-06-25T04:49:32.618 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:32.618 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:49:32.619 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:49:32.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.619 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:49:32.619 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:49:32.620 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.620 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:49:32.620 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.620 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.620 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.621 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.621 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:49:32.622 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:49:32.622 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.622 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:49:32.623 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.623 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.623 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.623 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.624 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:49:32.624 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:49:32.624 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.625 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:49:32.625 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.626 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.626 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.627 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:49:32.628 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:49:32.628 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.628 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.628 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.629 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.629 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.630 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:49:32.630 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:49:32.630 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.630 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.631 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.631 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.632 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:49:32.632 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:49:32.632 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.633 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.633 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.633 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.633 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.636 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:49:32.636 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:49:32.636 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.637 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.637 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.637 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.638 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:49:32.639 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:49:32.639 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.639 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.640 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.640 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.641 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:49:32.641 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:49:32.641 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.641 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.642 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.642 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.643 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:49:32.643 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:49:32.643 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.644 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.644 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.644 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.644 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.645 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:49:32.645 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:49:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.648 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.649 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:49:32.649 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:49:32.649 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.649 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:49:32.650 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:49:32.650 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:49:32.650 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.651 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:49:32.651 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:49:32.652 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.652 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:49:32.652 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:49:32.652 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:49:32.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.653 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:49:32.654 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:49:32.654 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.654 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:49:32.655 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:49:32.655 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:49:32.655 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.655 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.656 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:49:32.656 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:49:32.657 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.658 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:49:32.658 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:49:32.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.658 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:32.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:32.660 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:49:32.661 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:49:32.661 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:49:32.661 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:49:32.661 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:49:32.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:49:32.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:32.662 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:49:32.663 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:49:32.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 -- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56ac0553d0 msgr2=0x7f56ac057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56ac0553d0 0x7f56ac057890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f56bc019000 tx=0x7f56bc014000).stop 2021-06-25T04:49:32.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 -- 172.21.15.57:0/3946249378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56cc0aad40 msgr2=0x7f56cc062080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56cc0aad40 0x7f56cc062080 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f56c8001110 tx=0x7f56c8007aa0).stop 2021-06-25T04:49:32.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 -- 172.21.15.57:0/3946249378 shutdown_connections 2021-06-25T04:49:32.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56ac0553d0 0x7f56ac057890 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56cc0b4d10 0x7f56cc140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56cc0ab120 0x7f56cc140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 --2- 172.21.15.57:0/3946249378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56cc0aad40 0x7f56cc062080 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 -- 172.21.15.57:0/3946249378 >> 172.21.15.57:0/3946249378 conn(0x7f56cc062ba0 msgr2=0x7f56cc05caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:32.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 -- 172.21.15.57:0/3946249378 shutdown_connections 2021-06-25T04:49:32.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.615+0000 7f56d23e1700 1 -- 172.21.15.57:0/3946249378 wait complete. 2021-06-25T04:49:32.669 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:49:32.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b6de2700 1 Processor -- start 2021-06-25T04:49:32.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b6de2700 1 -- start start 2021-06-25T04:49:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b6de2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00aad40 0x7fa2b00672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b6de2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b0065920 con 0x7fa2b00ab120 2021-06-25T04:49:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b6de2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b0064ed0 con 0x7fa2b00b4d10 2021-06-25T04:49:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b6de2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b00b3ca0 con 0x7fa2b00aad40 2021-06-25T04:49:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b55df700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa2b00ab120 0x7fa2b00647c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54292/0 (socket says 172.21.15.57:54292) 2021-06-25T04:49:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b55df700 1 -- 172.21.15.57:0/4257708828 learned_addr learned my addr 172.21.15.57:0/4257708828 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b5de0700 1 --2- 172.21.15.57:0/4257708828 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00aad40 0x7fa2b00672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b4dde700 1 -- 172.21.15.57:0/4257708828 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307723578 0 0) 0x7fa2b0065920 con 0x7fa2b00ab120 2021-06-25T04:49:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b4dde700 1 -- 172.21.15.57:0/4257708828 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa298003260 con 0x7fa2b00ab120 2021-06-25T04:49:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b5de0700 1 -- 172.21.15.57:0/4257708828 >> v1:172.21.15.87:6789/0 conn(0x7fa2b00b4d10 legacy=0x7fa2b00b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b4dde700 1 -- 172.21.15.57:0/4257708828 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369356161 0 0) 0x7fa2b0064ed0 con 0x7fa2b00b4d10 2021-06-25T04:49:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b5de0700 1 -- 172.21.15.57:0/4257708828 >> v1:172.21.15.57:6789/0 conn(0x7fa2b00ab120 legacy=0x7fa2b00647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b5de0700 1 -- 172.21.15.57:0/4257708828 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b0066e20 con 0x7fa2b00aad40 2021-06-25T04:49:32.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.759+0000 7fa2b5de0700 1 --2- 172.21.15.57:0/4257708828 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00aad40 0x7fa2b00672c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa2ac0032f0 tx=0x7fa2ac0091d0).ready entity=mon.2 client_cookie=97a70da3524702dd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:32.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b4dde700 1 -- 172.21.15.57:0/4257708828 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2ac00b6c0 con 0x7fa2b00aad40 2021-06-25T04:49:32.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b4dde700 1 -- 172.21.15.57:0/4257708828 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac00b820 con 0x7fa2b00aad40 2021-06-25T04:49:32.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b4dde700 1 -- 172.21.15.57:0/4257708828 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2ac00b990 con 0x7fa2b00aad40 2021-06-25T04:49:32.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 -- 172.21.15.57:0/4257708828 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00aad40 msgr2=0x7fa2b00672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 --2- 172.21.15.57:0/4257708828 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00aad40 0x7fa2b00672c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa2ac0032f0 tx=0x7fa2ac0091d0).stop 2021-06-25T04:49:32.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 -- 172.21.15.57:0/4257708828 shutdown_connections 2021-06-25T04:49:32.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 --2- 172.21.15.57:0/4257708828 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00aad40 0x7fa2b00672c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 -- 172.21.15.57:0/4257708828 >> 172.21.15.57:0/4257708828 conn(0x7fa2b0062ba0 msgr2=0x7fa2b005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:32.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 -- 172.21.15.57:0/4257708828 shutdown_connections 2021-06-25T04:49:32.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 -- 172.21.15.57:0/4257708828 wait complete. 2021-06-25T04:49:32.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 Processor -- start 2021-06-25T04:49:32.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 -- start start 2021-06-25T04:49:32.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2b00aad40 0x7fa2b005c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:32.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2b00ab120 0x7fa2b0150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:32.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00b4d10 0x7fa2b0150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:32.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b014fca0 con 0x7fa2b00aad40 2021-06-25T04:49:32.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b013fd60 con 0x7fa2b00ab120 2021-06-25T04:49:32.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b6de2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b013ec80 con 0x7fa2b00b4d10 2021-06-25T04:49:32.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b5de0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2b00aad40 0x7fa2b005c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:32.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b5de0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2b00aad40 0x7fa2b005c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37078/0 (socket says 172.21.15.57:37078) 2021-06-25T04:49:32.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b5de0700 1 -- 172.21.15.57:0/3134246974 learned_addr learned my addr 172.21.15.57:0/3134246974 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:32.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b55df700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2b00ab120 0x7fa2b0150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:32.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.763+0000 7fa2b65e1700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00b4d10 0x7fa2b0150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:32.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa2b5de0700 1 -- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00b4d10 msgr2=0x7fa2b0150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa2b5de0700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00b4d10 0x7fa2b0150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa2b5de0700 1 -- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2b00ab120 msgr2=0x7fa2b0150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa2b5de0700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2b00ab120 0x7fa2b0150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa2b5de0700 1 -- 172.21.15.57:0/3134246974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac009470 con 0x7fa2b00aad40 2021-06-25T04:49:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa2b65e1700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00b4d10 0x7fa2b0150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa2b55df700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2b00ab120 0x7fa2b0150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:32.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa2b5de0700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2b00aad40 0x7fa2b005c4b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fa2ac0032f0 tx=0x7fa2ac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:32.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa29effd700 1 -- 172.21.15.57:0/3134246974 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2ac011e90 con 0x7fa2b00aad40 2021-06-25T04:49:32.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa29effd700 1 -- 172.21.15.57:0/3134246974 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac021480 con 0x7fa2b00aad40 2021-06-25T04:49:32.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa2b6de2700 1 -- 172.21.15.57:0/3134246974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b014fe90 con 0x7fa2b00aad40 2021-06-25T04:49:32.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa29effd700 1 -- 172.21.15.57:0/3134246974 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2ac0217e0 con 0x7fa2b00aad40 2021-06-25T04:49:32.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa2b6de2700 1 -- 172.21.15.57:0/3134246974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b0147f20 con 0x7fa2b00aad40 2021-06-25T04:49:32.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa2b6de2700 1 -- 172.21.15.57:0/3134246974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b0057310 con 0x7fa2b00aad40 2021-06-25T04:49:32.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa29effd700 1 -- 172.21.15.57:0/3134246974 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa2ac00f070 con 0x7fa2b00aad40 2021-06-25T04:49:32.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.767+0000 7fa29effd700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa290055450 0x7fa290057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:32.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.771+0000 7fa29effd700 1 -- 172.21.15.57:0/3134246974 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa2ac06ef80 con 0x7fa2b00aad40 2021-06-25T04:49:32.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.771+0000 7fa2b55df700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa290055450 0x7fa290057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:32.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.771+0000 7fa2b55df700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa290055450 0x7fa290057910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa2a000b000 tx=0x7fa2a0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:32.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.779+0000 7fa29effd700 1 -- 172.21.15.57:0/3134246974 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa2ac0453d0 con 0x7fa2b00aad40 2021-06-25T04:49:32.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.911+0000 7fa2b6de2700 1 -- 172.21.15.57:0/3134246974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2b0150020 con 0x7fa2b00aad40 2021-06-25T04:49:32.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.911+0000 7fa29effd700 1 -- 172.21.15.57:0/3134246974 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13414 (secure 0 0 0) 0x7fa2ac026090 con 0x7fa2b00aad40 2021-06-25T04:49:32.918 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:49:32.286021+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:49:32.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 -- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa290055450 msgr2=0x7fa290057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa290055450 0x7fa290057910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa2a000b000 tx=0x7fa2a0009040).stop 2021-06-25T04:49:32.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 -- 172.21.15.57:0/3134246974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2b00aad40 msgr2=0x7fa2b005c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:32.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2b00aad40 0x7fa2b005c4b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fa2ac0032f0 tx=0x7fa2ac016000).stop 2021-06-25T04:49:32.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 -- 172.21.15.57:0/3134246974 shutdown_connections 2021-06-25T04:49:32.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa290055450 0x7fa290057910 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2b00b4d10 0x7fa2b0150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2b00ab120 0x7fa2b0150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 --2- 172.21.15.57:0/3134246974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2b00aad40 0x7fa2b005c4b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:32.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 -- 172.21.15.57:0/3134246974 >> 172.21.15.57:0/3134246974 conn(0x7fa2b0062ba0 msgr2=0x7fa2b00b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:32.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 -- 172.21.15.57:0/3134246974 shutdown_connections 2021-06-25T04:49:32.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:32.915+0000 7fa2b6de2700 1 -- 172.21.15.57:0/3134246974 wait complete. 2021-06-25T04:49:32.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:49:32.932 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:49:33.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205359e700 1 Processor -- start 2021-06-25T04:49:33.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205359e700 1 -- start start 2021-06-25T04:49:33.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f20540b2540 0x7f205414ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20540affd0 0x7f205414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20540afb90 0x7f20540a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20540a7080 con 0x7f20540b2540 2021-06-25T04:49:33.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20540a72b0 con 0x7f20540affd0 2021-06-25T04:49:33.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20540a7550 con 0x7f20540afb90 2021-06-25T04:49:33.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f20540b2540 0x7f205414ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f20540b2540 0x7f205414ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37086/0 (socket says 172.21.15.57:37086) 2021-06-25T04:49:33.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205259c700 1 -- 172.21.15.57:0/1113226313 learned_addr learned my addr 172.21.15.57:0/1113226313 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:33.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f2052d9d700 1 --2- 172.21.15.57:0/1113226313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20540afb90 0x7f20540a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f2051d9b700 1 --2- 172.21.15.57:0/1113226313 >> v2:172.21.15.87:3300/0 conn(0x7f20540affd0 0x7f205414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205259c700 1 -- 172.21.15.57:0/1113226313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20540afb90 msgr2=0x7f20540a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:33.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205259c700 1 --2- 172.21.15.57:0/1113226313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20540afb90 0x7f20540a8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205259c700 1 -- 172.21.15.57:0/1113226313 >> v2:172.21.15.87:3300/0 conn(0x7f20540affd0 msgr2=0x7f205414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:33.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205259c700 1 --2- 172.21.15.57:0/1113226313 >> v2:172.21.15.87:3300/0 conn(0x7f20540affd0 0x7f205414b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205259c700 1 -- 172.21.15.57:0/1113226313 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540a77f0 con 0x7f20540b2540 2021-06-25T04:49:33.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205259c700 1 --2- 172.21.15.57:0/1113226313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540b2540 0x7f205414ae00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f203c002f70 tx=0x7f203c006eb0).ready entity=mon.0 client_cookie=9471e6b631fe7811 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205159a700 1 -- 172.21.15.57:0/1113226313 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f203c00d570 con 0x7f20540b2540 2021-06-25T04:49:33.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205159a700 1 -- 172.21.15.57:0/1113226313 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c000e90 con 0x7f20540b2540 2021-06-25T04:49:33.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205159a700 1 -- 172.21.15.57:0/1113226313 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f203c00d900 con 0x7f20540b2540 2021-06-25T04:49:33.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205359e700 1 -- 172.21.15.57:0/1113226313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540b2540 msgr2=0x7f205414ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.035+0000 7f205359e700 1 --2- 172.21.15.57:0/1113226313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540b2540 0x7f205414ae00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f203c002f70 tx=0x7f203c006eb0).stop 2021-06-25T04:49:33.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 -- 172.21.15.57:0/1113226313 shutdown_connections 2021-06-25T04:49:33.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 --2- 172.21.15.57:0/1113226313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20540afb90 0x7f20540a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 --2- 172.21.15.57:0/1113226313 >> v2:172.21.15.87:3300/0 conn(0x7f20540affd0 0x7f205414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 --2- 172.21.15.57:0/1113226313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540b2540 0x7f205414ae00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 -- 172.21.15.57:0/1113226313 >> 172.21.15.57:0/1113226313 conn(0x7f2054060140 msgr2=0x7f20540b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:33.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 -- 172.21.15.57:0/1113226313 shutdown_connections 2021-06-25T04:49:33.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 -- 172.21.15.57:0/1113226313 wait complete. 2021-06-25T04:49:33.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 Processor -- start 2021-06-25T04:49:33.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 -- start start 2021-06-25T04:49:33.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20540afb90 0x7f20540aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540affd0 0x7f2054159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20540b2540 0x7f205415a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205415a5f0 con 0x7f20540affd0 2021-06-25T04:49:33.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20541597e0 con 0x7f20540b2540 2021-06-25T04:49:33.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20540ac010 con 0x7f20540afb90 2021-06-25T04:49:33.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f2051d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540affd0 0x7f2054159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f205259c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20540afb90 0x7f20540aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f2051d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540affd0 0x7f2054159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37094/0 (socket says 172.21.15.57:37094) 2021-06-25T04:49:33.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f2051d9b700 1 -- 172.21.15.57:0/2908338588 learned_addr learned my addr 172.21.15.57:0/2908338588 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:33.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.039+0000 7f2052d9d700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20540b2540 0x7f205415a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f2051d9b700 1 -- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20540afb90 msgr2=0x7f20540aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f2051d9b700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20540afb90 0x7f20540aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f2051d9b700 1 -- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20540b2540 msgr2=0x7f205415a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f2051d9b700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20540b2540 0x7f205415a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f2051d9b700 1 -- 172.21.15.57:0/2908338588 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c00b1e0 con 0x7f20540affd0 2021-06-25T04:49:33.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f2051d9b700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540affd0 0x7f2054159c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f204400c000 tx=0x7f2044006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f204b7fe700 1 -- 172.21.15.57:0/2908338588 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2044010780 con 0x7f20540affd0 2021-06-25T04:49:33.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f204b7fe700 1 -- 172.21.15.57:0/2908338588 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20440108e0 con 0x7f20540affd0 2021-06-25T04:49:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f205359e700 1 -- 172.21.15.57:0/2908338588 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20540ac2b0 con 0x7f20540affd0 2021-06-25T04:49:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f204b7fe700 1 -- 172.21.15.57:0/2908338588 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2044010c40 con 0x7f20540affd0 2021-06-25T04:49:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f205359e700 1 -- 172.21.15.57:0/2908338588 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20540b4310 con 0x7f20540affd0 2021-06-25T04:49:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f204b7fe700 1 -- 172.21.15.57:0/2908338588 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f204401c460 con 0x7f20540affd0 2021-06-25T04:49:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.043+0000 7f205359e700 1 -- 172.21.15.57:0/2908338588 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2054057310 con 0x7f20540affd0 2021-06-25T04:49:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.047+0000 7f204b7fe700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2038055360 0x7f2038057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.047+0000 7f204b7fe700 1 -- 172.21.15.57:0/2908338588 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f204406e0e0 con 0x7f20540affd0 2021-06-25T04:49:33.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.047+0000 7f205259c700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2038055360 0x7f2038057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.047+0000 7f205259c700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2038055360 0x7f2038057820 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f203c01b000 tx=0x7f203c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.051+0000 7f204b7fe700 1 -- 172.21.15.57:0/2908338588 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f20440443e0 con 0x7f20540affd0 2021-06-25T04:49:33.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.183+0000 7f205359e700 1 -- 172.21.15.57:0/2908338588 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f20540698a0 con 0x7f20540affd0 2021-06-25T04:49:33.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.183+0000 7f204b7fe700 1 -- 172.21.15.57:0/2908338588 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v41) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2044047a00 con 0x7f20540affd0 2021-06-25T04:49:33.189 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:49:33.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 -- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2038055360 msgr2=0x7f2038057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2038055360 0x7f2038057820 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f203c01b000 tx=0x7f203c015000).stop 2021-06-25T04:49:33.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 -- 172.21.15.57:0/2908338588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540affd0 msgr2=0x7f2054159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540affd0 0x7f2054159c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f204400c000 tx=0x7f2044006df0).stop 2021-06-25T04:49:33.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 -- 172.21.15.57:0/2908338588 shutdown_connections 2021-06-25T04:49:33.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2038055360 0x7f2038057820 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20540b2540 0x7f205415a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540affd0 0x7f2054159c10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 --2- 172.21.15.57:0/2908338588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20540afb90 0x7f20540aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 -- 172.21.15.57:0/2908338588 >> 172.21.15.57:0/2908338588 conn(0x7f2054060140 msgr2=0x7f2054148870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:33.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 -- 172.21.15.57:0/2908338588 shutdown_connections 2021-06-25T04:49:33.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.187+0000 7f205359e700 1 -- 172.21.15.57:0/2908338588 wait complete. 2021-06-25T04:49:33.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:49:33.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.307+0000 7f460f295700 1 Processor -- start 2021-06-25T04:49:33.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.307+0000 7f460f295700 1 -- start start 2021-06-25T04:49:33.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.307+0000 7f460f295700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f460805ff20 0x7f4608140400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.307+0000 7f460f295700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4608061190 0x7f46081408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.307+0000 7f460f295700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4608140de0 con 0x7f46080b26d0 2021-06-25T04:49:33.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.307+0000 7f460f295700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46080648d0 con 0x7f4608061190 2021-06-25T04:49:33.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.307+0000 7f460f295700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4608064b70 con 0x7f460805ff20 2021-06-25T04:49:33.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.307+0000 7f460d832700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4608061190 0x7f46081408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460d832700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4608061190 0x7f46081408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37104/0 (socket says 172.21.15.57:37104) 2021-06-25T04:49:33.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460d832700 1 -- 172.21.15.57:0/4142544075 learned_addr learned my addr 172.21.15.57:0/4142544075 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:33.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460d031700 1 --2- 172.21.15.57:0/4142544075 >> v2:172.21.15.87:3300/0 conn(0x7f460805ff20 0x7f4608140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460d832700 1 -- 172.21.15.57:0/4142544075 >> v2:172.21.15.87:3300/0 conn(0x7f460805ff20 msgr2=0x7f4608140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:33.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460d832700 1 --2- 172.21.15.57:0/4142544075 >> v2:172.21.15.87:3300/0 conn(0x7f460805ff20 0x7f4608140400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460d832700 1 -- 172.21.15.57:0/4142544075 >> v1:172.21.15.87:6789/0 conn(0x7f46080b26d0 legacy=0x7f46081430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460d832700 1 -- 172.21.15.57:0/4142544075 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4608064e10 con 0x7f4608061190 2021-06-25T04:49:33.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460d832700 1 --2- 172.21.15.57:0/4142544075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4608061190 0x7f46081408f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f46000032f0 tx=0x7f4600009290).ready entity=mon.0 client_cookie=8b7b27e8d7081ef8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f4607fff700 1 -- 172.21.15.57:0/4142544075 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f460000b870 con 0x7f4608061190 2021-06-25T04:49:33.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f4607fff700 1 -- 172.21.15.57:0/4142544075 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460000b9d0 con 0x7f4608061190 2021-06-25T04:49:33.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f4607fff700 1 -- 172.21.15.57:0/4142544075 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f460000bb40 con 0x7f4608061190 2021-06-25T04:49:33.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 -- 172.21.15.57:0/4142544075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4608061190 msgr2=0x7f46081408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 --2- 172.21.15.57:0/4142544075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4608061190 0x7f46081408f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f46000032f0 tx=0x7f4600009290).stop 2021-06-25T04:49:33.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 -- 172.21.15.57:0/4142544075 shutdown_connections 2021-06-25T04:49:33.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 --2- 172.21.15.57:0/4142544075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4608061190 0x7f46081408f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 --2- 172.21.15.57:0/4142544075 >> v2:172.21.15.87:3300/0 conn(0x7f460805ff20 0x7f4608140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 -- 172.21.15.57:0/4142544075 >> 172.21.15.57:0/4142544075 conn(0x7f460805cf20 msgr2=0x7f460805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:33.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 -- 172.21.15.57:0/4142544075 shutdown_connections 2021-06-25T04:49:33.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 -- 172.21.15.57:0/4142544075 wait complete. 2021-06-25T04:49:33.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 Processor -- start 2021-06-25T04:49:33.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 -- start start 2021-06-25T04:49:33.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460805ff20 0x7f46081412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4608061190 0x7f46081435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46080b26d0 0x7f4608146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4608143ab0 con 0x7f46080b26d0 2021-06-25T04:49:33.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4608145bc0 con 0x7f460805ff20 2021-06-25T04:49:33.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.311+0000 7f460f295700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4608143120 con 0x7f4608061190 2021-06-25T04:49:33.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460d832700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46080b26d0 0x7f4608146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460c830700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4608061190 0x7f46081435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460d031700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460805ff20 0x7f46081412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460d832700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46080b26d0 0x7f4608146140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37110/0 (socket says 172.21.15.57:37110) 2021-06-25T04:49:33.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460c830700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4608061190 0x7f46081435c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:48272/0 (socket says 172.21.15.57:48272) 2021-06-25T04:49:33.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460c830700 1 -- 172.21.15.57:0/350944058 learned_addr learned my addr 172.21.15.57:0/350944058 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:33.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460d031700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460805ff20 0x7f46081412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:45600/0 (socket says 172.21.15.57:45600) 2021-06-25T04:49:33.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460c830700 1 -- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460805ff20 msgr2=0x7f46081412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460c830700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460805ff20 0x7f46081412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460c830700 1 -- 172.21.15.57:0/350944058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46080b26d0 msgr2=0x7f4608146140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460c830700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46080b26d0 0x7f4608146140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460c830700 1 -- 172.21.15.57:0/350944058 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4600009530 con 0x7f4608061190 2021-06-25T04:49:33.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460c830700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4608061190 0x7f46081435c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4608062770 tx=0x7f45fc007bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f46067fc700 1 -- 172.21.15.57:0/350944058 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45fc00ce50 con 0x7f4608061190 2021-06-25T04:49:33.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f46067fc700 1 -- 172.21.15.57:0/350944058 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc007030 con 0x7f4608061190 2021-06-25T04:49:33.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460f295700 1 -- 172.21.15.57:0/350944058 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4608149600 con 0x7f4608061190 2021-06-25T04:49:33.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f46067fc700 1 -- 172.21.15.57:0/350944058 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45fc007390 con 0x7f4608061190 2021-06-25T04:49:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460f295700 1 -- 172.21.15.57:0/350944058 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4608146630 con 0x7f4608061190 2021-06-25T04:49:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f460f295700 1 -- 172.21.15.57:0/350944058 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4608057310 con 0x7f4608061190 2021-06-25T04:49:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f46067fc700 1 -- 172.21.15.57:0/350944058 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f45fc010030 con 0x7f4608061190 2021-06-25T04:49:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.315+0000 7f46067fc700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45e8055450 0x7f45e8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.319+0000 7f46067fc700 1 -- 172.21.15.57:0/350944058 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f45fc06d7e0 con 0x7f4608061190 2021-06-25T04:49:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.319+0000 7f460d031700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45e8055450 0x7f45e8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.319+0000 7f460d031700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45e8055450 0x7f45e8057910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f45f800b000 tx=0x7f45f8006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.327+0000 7f46067fc700 1 -- 172.21.15.57:0/350944058 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f45fc043bc0 con 0x7f4608061190 2021-06-25T04:49:33.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.451+0000 7f460f295700 1 -- 172.21.15.57:0/350944058 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4608141b00 con 0x7f4608061190 2021-06-25T04:49:33.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f46067fc700 1 -- 172.21.15.57:0/350944058 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f45fc0471e0 con 0x7f4608061190 2021-06-25T04:49:33.460 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:49:33.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 -- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45e8055450 msgr2=0x7f45e8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45e8055450 0x7f45e8057910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f45f800b000 tx=0x7f45f8006df0).stop 2021-06-25T04:49:33.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 -- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4608061190 msgr2=0x7f46081435c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4608061190 0x7f46081435c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4608062770 tx=0x7f45fc007bd0).stop 2021-06-25T04:49:33.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 -- 172.21.15.57:0/350944058 shutdown_connections 2021-06-25T04:49:33.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45e8055450 0x7f45e8057910 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46080b26d0 0x7f4608146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4608061190 0x7f46081435c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 --2- 172.21.15.57:0/350944058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460805ff20 0x7f46081412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 -- 172.21.15.57:0/350944058 >> 172.21.15.57:0/350944058 conn(0x7f460805cf20 msgr2=0x7f4608065470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:33.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 -- 172.21.15.57:0/350944058 shutdown_connections 2021-06-25T04:49:33.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.455+0000 7f460f295700 1 -- 172.21.15.57:0/350944058 wait complete. 2021-06-25T04:49:33.473 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:49:33.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.567+0000 7fc2432bd700 1 Processor -- start 2021-06-25T04:49:33.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.567+0000 7fc2432bd700 1 -- start start 2021-06-25T04:49:33.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.567+0000 7fc2432bd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc23c143960 0x7fc23c140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.567+0000 7fc2432bd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c0b68d0 con 0x7fc23c061640 2021-06-25T04:49:33.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.567+0000 7fc2432bd700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c0b6b70 con 0x7fc23c0b46d0 2021-06-25T04:49:33.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2432bd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23c0b9640 con 0x7fc23c143960 2021-06-25T04:49:33.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc242abc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc23c143960 0x7fc23c140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2422bb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc23c061640 0x7fc23c0b9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54332/0 (socket says 172.21.15.57:54332) 2021-06-25T04:49:33.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc242abc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc23c143960 0x7fc23c140470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37118/0 (socket says 172.21.15.57:37118) 2021-06-25T04:49:33.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2422bb700 1 -- 172.21.15.57:0/360316421 learned_addr learned my addr 172.21.15.57:0/360316421 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:33.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc242abc700 1 -- 172.21.15.57:0/360316421 >> v1:172.21.15.87:6789/0 conn(0x7fc23c0b46d0 legacy=0x7fc23c13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc242abc700 1 -- 172.21.15.57:0/360316421 >> v1:172.21.15.57:6789/0 conn(0x7fc23c061640 legacy=0x7fc23c0b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc242abc700 1 -- 172.21.15.57:0/360316421 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c0b6e10 con 0x7fc23c143960 2021-06-25T04:49:33.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc242abc700 1 --2- 172.21.15.57:0/360316421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc23c143960 0x7fc23c140470 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fc2340032f0 tx=0x7fc2340091d0).ready entity=mon.0 client_cookie=de5cdcd34bdb8437 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2412b9700 1 -- 172.21.15.57:0/360316421 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc234009ea0 con 0x7fc23c143960 2021-06-25T04:49:33.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2412b9700 1 -- 172.21.15.57:0/360316421 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23400b8a0 con 0x7fc23c143960 2021-06-25T04:49:33.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2412b9700 1 -- 172.21.15.57:0/360316421 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc23400ba10 con 0x7fc23c143960 2021-06-25T04:49:33.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2432bd700 1 -- 172.21.15.57:0/360316421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc23c143960 msgr2=0x7fc23c140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2432bd700 1 --2- 172.21.15.57:0/360316421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc23c143960 0x7fc23c140470 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fc2340032f0 tx=0x7fc2340091d0).stop 2021-06-25T04:49:33.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2432bd700 1 -- 172.21.15.57:0/360316421 shutdown_connections 2021-06-25T04:49:33.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2432bd700 1 --2- 172.21.15.57:0/360316421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc23c143960 0x7fc23c140470 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2432bd700 1 -- 172.21.15.57:0/360316421 >> 172.21.15.57:0/360316421 conn(0x7fc23c06adb0 msgr2=0x7fc23c05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:33.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2432bd700 1 -- 172.21.15.57:0/360316421 shutdown_connections 2021-06-25T04:49:33.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2432bd700 1 -- 172.21.15.57:0/360316421 wait complete. 2021-06-25T04:49:33.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2432bd700 1 Processor -- start 2021-06-25T04:49:33.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.571+0000 7fc2432bd700 1 -- start start 2021-06-25T04:49:33.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc2432bd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc23c061640 0x7fc23c148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc2432bd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc23c143960 0x7fc23c139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc2432bd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc23c136cb0 0x7fc23c139810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc2432bd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c138f80 con 0x7fc23c136cb0 2021-06-25T04:49:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc2432bd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0b7670 con 0x7fc23c061640 2021-06-25T04:49:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc2432bd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0b7990 con 0x7fc23c143960 2021-06-25T04:49:33.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc242abc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc23c136cb0 0x7fc23c139810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc2422bb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc23c061640 0x7fc23c148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc242abc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc23c136cb0 0x7fc23c139810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37124/0 (socket says 172.21.15.57:37124) 2021-06-25T04:49:33.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc242abc700 1 -- 172.21.15.57:0/102620521 learned_addr learned my addr 172.21.15.57:0/102620521 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:33.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc241aba700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc23c143960 0x7fc23c139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc242abc700 1 -- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc23c143960 msgr2=0x7fc23c139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc242abc700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc23c143960 0x7fc23c139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc242abc700 1 -- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc23c061640 msgr2=0x7fc23c148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc242abc700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc23c061640 0x7fc23c148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc242abc700 1 -- 172.21.15.57:0/102620521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234009470 con 0x7fc23c136cb0 2021-06-25T04:49:33.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc2422bb700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc23c061640 0x7fc23c148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:33.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc242abc700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc23c136cb0 0x7fc23c139810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fc2340032f0 tx=0x7fc234016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc22b7fe700 1 -- 172.21.15.57:0/102620521 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc234011e20 con 0x7fc23c136cb0 2021-06-25T04:49:33.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc22b7fe700 1 -- 172.21.15.57:0/102620521 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234021440 con 0x7fc23c136cb0 2021-06-25T04:49:33.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc2432bd700 1 -- 172.21.15.57:0/102620521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c0b7c30 con 0x7fc23c136cb0 2021-06-25T04:49:33.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc22b7fe700 1 -- 172.21.15.57:0/102620521 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2340217a0 con 0x7fc23c136cb0 2021-06-25T04:49:33.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc2432bd700 1 -- 172.21.15.57:0/102620521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c0b72f0 con 0x7fc23c136cb0 2021-06-25T04:49:33.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.575+0000 7fc2432bd700 1 -- 172.21.15.57:0/102620521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23c0b7fb0 con 0x7fc23c136cb0 2021-06-25T04:49:33.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.579+0000 7fc22b7fe700 1 -- 172.21.15.57:0/102620521 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc234029070 con 0x7fc23c136cb0 2021-06-25T04:49:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.579+0000 7fc22b7fe700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc21c0553d0 0x7fc21c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.579+0000 7fc22b7fe700 1 -- 172.21.15.57:0/102620521 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fc23406ea00 con 0x7fc23c136cb0 2021-06-25T04:49:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.579+0000 7fc2422bb700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc21c0553d0 0x7fc21c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.579+0000 7fc2422bb700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc21c0553d0 0x7fc21c057890 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc23800d000 tx=0x7fc238009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.587+0000 7fc22b7fe700 1 -- 172.21.15.57:0/102620521 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc234044ef0 con 0x7fc23c136cb0 2021-06-25T04:49:33.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.707+0000 7fc2432bd700 1 -- 172.21.15.57:0/102620521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc23c057310 con 0x7fc23c136cb0 2021-06-25T04:49:33.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.707+0000 7fc22b7fe700 1 -- 172.21.15.57:0/102620521 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc234048510 con 0x7fc23c136cb0 2021-06-25T04:49:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:33.716 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:49:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:49:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:49:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:49:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:49:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:49:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:49:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:49:33.718 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:49:33.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 -- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc21c0553d0 msgr2=0x7fc21c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc21c0553d0 0x7fc21c057890 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc23800d000 tx=0x7fc238009040).stop 2021-06-25T04:49:33.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 -- 172.21.15.57:0/102620521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc23c136cb0 msgr2=0x7fc23c139810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc23c136cb0 0x7fc23c139810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fc2340032f0 tx=0x7fc234016000).stop 2021-06-25T04:49:33.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 -- 172.21.15.57:0/102620521 shutdown_connections 2021-06-25T04:49:33.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc21c0553d0 0x7fc21c057890 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc23c136cb0 0x7fc23c139810 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc23c143960 0x7fc23c139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 --2- 172.21.15.57:0/102620521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc23c061640 0x7fc23c148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 -- 172.21.15.57:0/102620521 >> 172.21.15.57:0/102620521 conn(0x7fc23c06adb0 msgr2=0x7fc23c141590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:33.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 -- 172.21.15.57:0/102620521 shutdown_connections 2021-06-25T04:49:33.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.711+0000 7fc2432bd700 1 -- 172.21.15.57:0/102620521 wait complete. 2021-06-25T04:49:33.728 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:49:33.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:49:33.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.823+0000 7f757523a700 1 Processor -- start 2021-06-25T04:49:33.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.823+0000 7f757523a700 1 -- start start 2021-06-25T04:49:33.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.823+0000 7f757523a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f75700b2540 0x7f7570140010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.823+0000 7f757523a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75700ac6b0 0x7f7570140500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.823+0000 7f757523a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7570067840 con 0x7f75700b00a0 2021-06-25T04:49:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.823+0000 7f757523a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75700ad570 con 0x7f75700b2540 2021-06-25T04:49:33.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.823+0000 7f757523a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7570067ae0 con 0x7f75700ac6b0 2021-06-25T04:49:33.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f75700b2540 0x7f7570140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f75700b00a0 0x7f7570142e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54348/0 (socket says 172.21.15.57:54348) 2021-06-25T04:49:33.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756f7fe700 1 -- 172.21.15.57:0/1158832294 learned_addr learned my addr 172.21.15.57:0/1158832294 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:33.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f7574a39700 1 --2- 172.21.15.57:0/1158832294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75700ac6b0 0x7f7570140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756ffff700 1 -- 172.21.15.57:0/1158832294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75700ac6b0 msgr2=0x7f7570140500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:33.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756ffff700 1 --2- 172.21.15.57:0/1158832294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75700ac6b0 0x7f7570140500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756ffff700 1 -- 172.21.15.57:0/1158832294 >> v1:172.21.15.57:6789/0 conn(0x7f75700b00a0 legacy=0x7f7570142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756ffff700 1 -- 172.21.15.57:0/1158832294 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570146f90 con 0x7f75700b2540 2021-06-25T04:49:33.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756effd700 1 -- 172.21.15.57:0/1158832294 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670317991 0 0) 0x7f7570067840 con 0x7f75700b00a0 2021-06-25T04:49:33.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756ffff700 1 --2- 172.21.15.57:0/1158832294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75700b2540 0x7f7570140010 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f7564002f70 tx=0x7f7564006df0).ready entity=mon.0 client_cookie=395e0acdb4b747b1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756effd700 1 -- 172.21.15.57:0/1158832294 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f756400d570 con 0x7f75700b2540 2021-06-25T04:49:33.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756effd700 1 -- 172.21.15.57:0/1158832294 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7564000e90 con 0x7f75700b2540 2021-06-25T04:49:33.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f756effd700 1 -- 172.21.15.57:0/1158832294 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f756400d8c0 con 0x7f75700b2540 2021-06-25T04:49:33.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f757523a700 1 -- 172.21.15.57:0/1158832294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75700b2540 msgr2=0x7f7570140010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f757523a700 1 --2- 172.21.15.57:0/1158832294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75700b2540 0x7f7570140010 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f7564002f70 tx=0x7f7564006df0).stop 2021-06-25T04:49:33.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f757523a700 1 -- 172.21.15.57:0/1158832294 shutdown_connections 2021-06-25T04:49:33.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f757523a700 1 --2- 172.21.15.57:0/1158832294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75700ac6b0 0x7f7570140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f757523a700 1 --2- 172.21.15.57:0/1158832294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75700b2540 0x7f7570140010 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f757523a700 1 -- 172.21.15.57:0/1158832294 >> 172.21.15.57:0/1158832294 conn(0x7f7570060140 msgr2=0x7f75700b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f757523a700 1 -- 172.21.15.57:0/1158832294 shutdown_connections 2021-06-25T04:49:33.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f757523a700 1 -- 172.21.15.57:0/1158832294 wait complete. 2021-06-25T04:49:33.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f757523a700 1 Processor -- start 2021-06-25T04:49:33.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.827+0000 7f757523a700 1 -- start start 2021-06-25T04:49:33.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f757523a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75700ac6b0 0x7f7570141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f757523a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75700b00a0 0x7f7570152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f757523a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75700b2540 0x7f7570145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f757523a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7570152f60 con 0x7f75700ac6b0 2021-06-25T04:49:33.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f757523a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75701520d0 con 0x7f75700b00a0 2021-06-25T04:49:33.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f757523a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7570152330 con 0x7f75700b2540 2021-06-25T04:49:33.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75700ac6b0 0x7f7570141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75700ac6b0 0x7f7570141010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37134/0 (socket says 172.21.15.57:37134) 2021-06-25T04:49:33.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756ffff700 1 -- 172.21.15.57:0/2934898965 learned_addr learned my addr 172.21.15.57:0/2934898965 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:33.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756f7fe700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75700b00a0 0x7f7570152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f7574a39700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75700b2540 0x7f7570145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756ffff700 1 -- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75700b2540 msgr2=0x7f7570145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756ffff700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75700b2540 0x7f7570145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756ffff700 1 -- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75700b00a0 msgr2=0x7f7570152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:33.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756ffff700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75700b00a0 0x7f7570152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:33.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756ffff700 1 -- 172.21.15.57:0/2934898965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756400b180 con 0x7f75700ac6b0 2021-06-25T04:49:33.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756f7fe700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75700b00a0 0x7f7570152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:33.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756ffff700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75700ac6b0 0x7f7570141010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f7564002f70 tx=0x7f7564014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756d7fa700 1 -- 172.21.15.57:0/2934898965 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f756400de20 con 0x7f75700ac6b0 2021-06-25T04:49:33.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756d7fa700 1 -- 172.21.15.57:0/2934898965 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7564000e90 con 0x7f75700ac6b0 2021-06-25T04:49:33.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f757523a700 1 -- 172.21.15.57:0/2934898965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75701525d0 con 0x7f75700ac6b0 2021-06-25T04:49:33.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f756d7fa700 1 -- 172.21.15.57:0/2934898965 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f756401e5e0 con 0x7f75700ac6b0 2021-06-25T04:49:33.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f757523a700 1 -- 172.21.15.57:0/2934898965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7570145100 con 0x7f75700ac6b0 2021-06-25T04:49:33.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.831+0000 7f757523a700 1 -- 172.21.15.57:0/2934898965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7570152760 con 0x7f75700ac6b0 2021-06-25T04:49:33.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.835+0000 7f756d7fa700 1 -- 172.21.15.57:0/2934898965 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7564024020 con 0x7f75700ac6b0 2021-06-25T04:49:33.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.835+0000 7f756d7fa700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75500553d0 0x7f7550057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:33.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.835+0000 7f756d7fa700 1 -- 172.21.15.57:0/2934898965 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f756406e740 con 0x7f75700ac6b0 2021-06-25T04:49:33.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.835+0000 7f756f7fe700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75500553d0 0x7f7550057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:33.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.835+0000 7f756f7fe700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75500553d0 0x7f7550057890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f756000b000 tx=0x7f7560009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:33.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.839+0000 7f756d7fa700 1 -- 172.21.15.57:0/2934898965 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7564044b90 con 0x7f75700ac6b0 2021-06-25T04:49:33.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:33.967+0000 7f757523a700 1 -- 172.21.15.57:0/2934898965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f7570057310 con 0x7f75700ac6b0 2021-06-25T04:49:34.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.299+0000 7f756d7fa700 1 -- 172.21.15.57:0/2934898965 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7f75640481b0 con 0x7f75700ac6b0 2021-06-25T04:49:34.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 -- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75500553d0 msgr2=0x7f7550057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:34.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75500553d0 0x7f7550057890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f756000b000 tx=0x7f7560009040).stop 2021-06-25T04:49:34.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 -- 172.21.15.57:0/2934898965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75700ac6b0 msgr2=0x7f7570141010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:34.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75700ac6b0 0x7f7570141010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f7564002f70 tx=0x7f7564014000).stop 2021-06-25T04:49:34.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 -- 172.21.15.57:0/2934898965 shutdown_connections 2021-06-25T04:49:34.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75500553d0 0x7f7550057890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:34.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75700b2540 0x7f7570145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:34.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75700b00a0 0x7f7570152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:34.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 --2- 172.21.15.57:0/2934898965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75700ac6b0 0x7f7570141010 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:34.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 -- 172.21.15.57:0/2934898965 >> 172.21.15.57:0/2934898965 conn(0x7f7570060140 msgr2=0x7f757013f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:34.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 -- 172.21.15.57:0/2934898965 shutdown_connections 2021-06-25T04:49:34.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.303+0000 7f757523a700 1 -- 172.21.15.57:0/2934898965 wait complete. 2021-06-25T04:49:34.315 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:49:34.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:49:34.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.431+0000 7f2eb6e3c700 1 Processor -- start 2021-06-25T04:49:34.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.431+0000 7f2eb6e3c700 1 -- start start 2021-06-25T04:49:34.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.431+0000 7f2eb6e3c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2eb00612e0 0x7f2eb00616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:34.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.431+0000 7f2eb6e3c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb0140400 0x7f2eb0140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:34.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.431+0000 7f2eb6e3c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb00aecb0 con 0x7f2eb00ad580 2021-06-25T04:49:34.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.431+0000 7f2eb6e3c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb00b6ee0 con 0x7f2eb00612e0 2021-06-25T04:49:34.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.431+0000 7f2eb6e3c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00aeee0 con 0x7f2eb0140400 2021-06-25T04:49:34.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.431+0000 7f2eb5639700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2eb00ad580 0x7f2eb00b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54362/0 (socket says 172.21.15.57:54362) 2021-06-25T04:49:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.431+0000 7f2eb5639700 1 -- 172.21.15.57:0/168956904 learned_addr learned my addr 172.21.15.57:0/168956904 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:34.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb663b700 1 --2- 172.21.15.57:0/168956904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb0140400 0x7f2eb0140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:34.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb5e3a700 1 --2- 172.21.15.57:0/168956904 >> v2:172.21.15.87:3300/0 conn(0x7f2eb00612e0 0x7f2eb00616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:34.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb4e38700 1 -- 172.21.15.57:0/168956904 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065197204 0 0) 0x7f2eb00aecb0 con 0x7f2eb00ad580 2021-06-25T04:49:34.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb4e38700 1 -- 172.21.15.57:0/168956904 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e98003260 con 0x7f2eb00ad580 2021-06-25T04:49:34.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb663b700 1 -- 172.21.15.57:0/168956904 >> v2:172.21.15.87:3300/0 conn(0x7f2eb00612e0 msgr2=0x7f2eb00616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:34.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb663b700 1 --2- 172.21.15.57:0/168956904 >> v2:172.21.15.87:3300/0 conn(0x7f2eb00612e0 0x7f2eb00616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:34.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb663b700 1 -- 172.21.15.57:0/168956904 >> v1:172.21.15.57:6789/0 conn(0x7f2eb00ad580 legacy=0x7f2eb00b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:34.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb4e38700 1 -- 172.21.15.57:0/168956904 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 676132581 0 0) 0x7f2e98003260 con 0x7f2eb00ad580 2021-06-25T04:49:34.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb663b700 1 -- 172.21.15.57:0/168956904 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb00af180 con 0x7f2eb0140400 2021-06-25T04:49:34.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb663b700 1 --2- 172.21.15.57:0/168956904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb0140400 0x7f2eb0140890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2eb00aeb60 tx=0x7f2ea80091d0).ready entity=mon.2 client_cookie=27de5bde4f49d45d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:34.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb4e38700 1 -- 172.21.15.57:0/168956904 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea0001660 con 0x7f2eb0140400 2021-06-25T04:49:34.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb4e38700 1 -- 172.21.15.57:0/168956904 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800f510 con 0x7f2eb0140400 2021-06-25T04:49:34.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb4e38700 1 -- 172.21.15.57:0/168956904 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea800f680 con 0x7f2eb0140400 2021-06-25T04:49:34.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/168956904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb0140400 msgr2=0x7f2eb0140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:34.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb6e3c700 1 --2- 172.21.15.57:0/168956904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb0140400 0x7f2eb0140890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2eb00aeb60 tx=0x7f2ea80091d0).stop 2021-06-25T04:49:34.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/168956904 shutdown_connections 2021-06-25T04:49:34.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb6e3c700 1 --2- 172.21.15.57:0/168956904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb0140400 0x7f2eb0140890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb6e3c700 1 --2- 172.21.15.57:0/168956904 >> v2:172.21.15.87:3300/0 conn(0x7f2eb00612e0 0x7f2eb00616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/168956904 >> 172.21.15.57:0/168956904 conn(0x7f2eb0066da0 msgr2=0x7f2eb0067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/168956904 shutdown_connections 2021-06-25T04:49:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.435+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/168956904 wait complete. 2021-06-25T04:49:34.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb6e3c700 1 Processor -- start 2021-06-25T04:49:34.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb6e3c700 1 -- start start 2021-06-25T04:49:34.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb6e3c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb00612e0 0x7f2eb00abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:34.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb6e3c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eb00ad580 0x7f2eb0143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:34.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb6e3c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb0140400 0x7f2eb0155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:34.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb6e3c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0143160 con 0x7f2eb00612e0 2021-06-25T04:49:34.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb6e3c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0142bc0 con 0x7f2eb00ad580 2021-06-25T04:49:34.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb6e3c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb01433c0 con 0x7f2eb0140400 2021-06-25T04:49:34.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb5e3a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb00612e0 0x7f2eb00abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb5e3a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb00612e0 0x7f2eb00abc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37148/0 (socket says 172.21.15.57:37148) 2021-06-25T04:49:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb5e3a700 1 -- 172.21.15.57:0/131267326 learned_addr learned my addr 172.21.15.57:0/131267326 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb5639700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eb00ad580 0x7f2eb0143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.439+0000 7f2eb663b700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb0140400 0x7f2eb0155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2eb5e3a700 1 -- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb0140400 msgr2=0x7f2eb0155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2eb5e3a700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb0140400 0x7f2eb0155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2eb5e3a700 1 -- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eb00ad580 msgr2=0x7f2eb0143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2eb5e3a700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eb00ad580 0x7f2eb0143860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2eb5e3a700 1 -- 172.21.15.57:0/131267326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8009470 con 0x7f2eb00612e0 2021-06-25T04:49:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2eb5639700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eb00ad580 0x7f2eb0143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2eb5e3a700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb00612e0 0x7f2eb00abc70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f2eac00c000 tx=0x7f2eac006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:34.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2e9effd700 1 -- 172.21.15.57:0/131267326 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eac010780 con 0x7f2eb00612e0 2021-06-25T04:49:34.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2e9effd700 1 -- 172.21.15.57:0/131267326 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0108e0 con 0x7f2eb00612e0 2021-06-25T04:49:34.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/131267326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb0142e60 con 0x7f2eb00612e0 2021-06-25T04:49:34.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2e9effd700 1 -- 172.21.15.57:0/131267326 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eac010c40 con 0x7f2eb00612e0 2021-06-25T04:49:34.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/131267326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb01427d0 con 0x7f2eb00612e0 2021-06-25T04:49:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/131267326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb0057310 con 0x7f2eb00612e0 2021-06-25T04:49:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.443+0000 7f2e9effd700 1 -- 172.21.15.57:0/131267326 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2eac01c460 con 0x7f2eb00612e0 2021-06-25T04:49:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.447+0000 7f2e9effd700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e90055340 0x7f2e90057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.447+0000 7f2e9effd700 1 -- 172.21.15.57:0/131267326 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f2eac06e0d0 con 0x7f2eb00612e0 2021-06-25T04:49:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.447+0000 7f2eb5639700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e90055340 0x7f2e90057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.447+0000 7f2eb5639700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e90055340 0x7f2e90057800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f2ea000d000 tx=0x7f2ea0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.451+0000 7f2e9effd700 1 -- 172.21.15.57:0/131267326 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2eac0443f0 con 0x7f2eb00612e0 2021-06-25T04:49:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:34.579+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/131267326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f2eb00620c0 con 0x7f2eb00612e0 2021-06-25T04:49:35.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.311+0000 7f2e9effd700 1 -- 172.21.15.57:0/131267326 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v43) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2eac047a10 con 0x7f2eb00612e0 2021-06-25T04:49:35.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e90055340 msgr2=0x7f2e90057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e90055340 0x7f2e90057800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f2ea000d000 tx=0x7f2ea0009040).stop 2021-06-25T04:49:35.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/131267326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb00612e0 msgr2=0x7f2eb00abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb00612e0 0x7f2eb00abc70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f2eac00c000 tx=0x7f2eac006df0).stop 2021-06-25T04:49:35.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/131267326 shutdown_connections 2021-06-25T04:49:35.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e90055340 0x7f2e90057800 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb0140400 0x7f2eb0155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eb00ad580 0x7f2eb0143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 --2- 172.21.15.57:0/131267326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb00612e0 0x7f2eb00abc70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/131267326 >> 172.21.15.57:0/131267326 conn(0x7f2eb0066da0 msgr2=0x7f2eb00b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:35.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/131267326 shutdown_connections 2021-06-25T04:49:35.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.315+0000 7f2eb6e3c700 1 -- 172.21.15.57:0/131267326 wait complete. 2021-06-25T04:49:35.325 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:49:35.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:49:35.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1f9bd700 1 Processor -- start 2021-06-25T04:49:35.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1f9bd700 1 -- start start 2021-06-25T04:49:35.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1f9bd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e180b2710 0x7f0e1805fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1f9bd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e180b2e80 con 0x7f0e1805f670 2021-06-25T04:49:35.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1f9bd700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e18066e60 con 0x7f0e18066a80 2021-06-25T04:49:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1f9bd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180b0770 con 0x7f0e180b2710 2021-06-25T04:49:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1cf58700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e180b2710 0x7f0e1805fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1df5a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0e1805f670 0x7f0e18060230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54378/0 (socket says 172.21.15.57:54378) 2021-06-25T04:49:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1df5a700 1 -- 172.21.15.57:0/2734815579 learned_addr learned my addr 172.21.15.57:0/2734815579 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e0ffff700 1 -- 172.21.15.57:0/2734815579 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893230173 0 0) 0x7f0e180b2e80 con 0x7f0e1805f670 2021-06-25T04:49:35.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e0ffff700 1 -- 172.21.15.57:0/2734815579 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dfc003260 con 0x7f0e1805f670 2021-06-25T04:49:35.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e0ffff700 1 -- 172.21.15.57:0/2734815579 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040946033 0 0) 0x7f0e18066e60 con 0x7f0e18066a80 2021-06-25T04:49:35.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e0ffff700 1 -- 172.21.15.57:0/2734815579 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e180b2e80 con 0x7f0e18066a80 2021-06-25T04:49:35.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1cf58700 1 -- 172.21.15.57:0/2734815579 >> v1:172.21.15.87:6789/0 conn(0x7f0e18066a80 legacy=0x7f0e180b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e0ffff700 1 -- 172.21.15.57:0/2734815579 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 896557354 0 0) 0x7f0dfc003260 con 0x7f0e1805f670 2021-06-25T04:49:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1cf58700 1 -- 172.21.15.57:0/2734815579 >> v1:172.21.15.57:6789/0 conn(0x7f0e1805f670 legacy=0x7f0e18060230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1cf58700 1 -- 172.21.15.57:0/2734815579 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180b1a60 con 0x7f0e180b2710 2021-06-25T04:49:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.463+0000 7f0e1cf58700 1 --2- 172.21.15.57:0/2734815579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e180b2710 0x7f0e1805fd40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f0e10001490 tx=0x7f0e08006df0).ready entity=mon.0 client_cookie=8df6c2984eeaa6bf server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e0ffff700 1 -- 172.21.15.57:0/2734815579 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e10001a00 con 0x7f0e180b2710 2021-06-25T04:49:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e0ffff700 1 -- 172.21.15.57:0/2734815579 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e08000e90 con 0x7f0e180b2710 2021-06-25T04:49:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e0ffff700 1 -- 172.21.15.57:0/2734815579 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e08012460 con 0x7f0e180b2710 2021-06-25T04:49:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/2734815579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e180b2710 msgr2=0x7f0e1805fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e1f9bd700 1 --2- 172.21.15.57:0/2734815579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e180b2710 0x7f0e1805fd40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f0e10001490 tx=0x7f0e08006df0).stop 2021-06-25T04:49:35.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/2734815579 shutdown_connections 2021-06-25T04:49:35.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e1f9bd700 1 --2- 172.21.15.57:0/2734815579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e180b2710 0x7f0e1805fd40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/2734815579 >> 172.21.15.57:0/2734815579 conn(0x7f0e1805c450 msgr2=0x7f0e1805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:35.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/2734815579 shutdown_connections 2021-06-25T04:49:35.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/2734815579 wait complete. 2021-06-25T04:49:35.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e1f9bd700 1 Processor -- start 2021-06-25T04:49:35.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.467+0000 7f0e1f9bd700 1 -- start start 2021-06-25T04:49:35.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1f9bd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e1805f670 0x7f0e18141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1f9bd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e18066a80 0x7f0e180a2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1f9bd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e180b2710 0x7f0e180a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1f9bd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18148160 con 0x7f0e18066a80 2021-06-25T04:49:35.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1f9bd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1809f7e0 con 0x7f0e1805f670 2021-06-25T04:49:35.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1f9bd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1809f1c0 con 0x7f0e180b2710 2021-06-25T04:49:35.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1cf58700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e18066a80 0x7f0e180a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1cf58700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e18066a80 0x7f0e180a2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37164/0 (socket says 172.21.15.57:37164) 2021-06-25T04:49:35.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1cf58700 1 -- 172.21.15.57:0/960946066 learned_addr learned my addr 172.21.15.57:0/960946066 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:35.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1d759700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e1805f670 0x7f0e18141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1df5a700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e180b2710 0x7f0e180a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1cf58700 1 -- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e180b2710 msgr2=0x7f0e180a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1cf58700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e180b2710 0x7f0e180a2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1cf58700 1 -- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e1805f670 msgr2=0x7f0e18141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1cf58700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e1805f670 0x7f0e18141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1cf58700 1 -- 172.21.15.57:0/960946066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0800b180 con 0x7f0e18066a80 2021-06-25T04:49:35.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1cf58700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e18066a80 0x7f0e180a2890 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f0e10001490 tx=0x7f0e08014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:35.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e0e7fc700 1 -- 172.21.15.57:0/960946066 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e0800d9a0 con 0x7f0e18066a80 2021-06-25T04:49:35.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e0e7fc700 1 -- 172.21.15.57:0/960946066 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0800db00 con 0x7f0e18066a80 2021-06-25T04:49:35.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/960946066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e181509f0 con 0x7f0e18066a80 2021-06-25T04:49:35.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e0e7fc700 1 -- 172.21.15.57:0/960946066 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e0800de60 con 0x7f0e18066a80 2021-06-25T04:49:35.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/960946066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1809f540 con 0x7f0e18066a80 2021-06-25T04:49:35.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/960946066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e18150820 con 0x7f0e18066a80 2021-06-25T04:49:35.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.471+0000 7f0e0e7fc700 1 -- 172.21.15.57:0/960946066 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0e08025020 con 0x7f0e18066a80 2021-06-25T04:49:35.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.475+0000 7f0e0e7fc700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e00055450 0x7f0e00057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.475+0000 7f0e0e7fc700 1 -- 172.21.15.57:0/960946066 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f0e0806ece0 con 0x7f0e18066a80 2021-06-25T04:49:35.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.475+0000 7f0e1d759700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e00055450 0x7f0e00057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.475+0000 7f0e1d759700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e00055450 0x7f0e00057910 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f0e1400b000 tx=0x7f0e14009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:35.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.479+0000 7f0e0e7fc700 1 -- 172.21.15.57:0/960946066 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0e08044f10 con 0x7f0e18066a80 2021-06-25T04:49:35.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.643+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/960946066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f0e18057310 con 0x7f0e18066a80 2021-06-25T04:49:35.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.655+0000 7f0e0e7fc700 1 -- 172.21.15.57:0/960946066 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v17) v1 ==== 187+0+0 (secure 0 0 0) 0x7f0e08048530 con 0x7f0e18066a80 2021-06-25T04:49:35.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e00055450 msgr2=0x7f0e00057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e00055450 0x7f0e00057910 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f0e1400b000 tx=0x7f0e14009040).stop 2021-06-25T04:49:35.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/960946066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e18066a80 msgr2=0x7f0e180a2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e18066a80 0x7f0e180a2890 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f0e10001490 tx=0x7f0e08014000).stop 2021-06-25T04:49:35.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/960946066 shutdown_connections 2021-06-25T04:49:35.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e00055450 0x7f0e00057910 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e180b2710 0x7f0e180a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e18066a80 0x7f0e180a2890 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 --2- 172.21.15.57:0/960946066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e1805f670 0x7f0e18141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/960946066 >> 172.21.15.57:0/960946066 conn(0x7f0e1805c450 msgr2=0x7f0e180b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/960946066 shutdown_connections 2021-06-25T04:49:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.663+0000 7f0e1f9bd700 1 -- 172.21.15.57:0/960946066 wait complete. 2021-06-25T04:49:35.675 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 7 and data pool 8 2021-06-25T04:49:35.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:49:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe10860700 1 Processor -- start 2021-06-25T04:49:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe10860700 1 -- start start 2021-06-25T04:49:35.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe10860700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe0c063890 0x7fbe0c143d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe10860700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c0618e0 0x7fbe0c140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe10860700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c063c70 con 0x7fbe0c0b1290 2021-06-25T04:49:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe10860700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c13fd70 con 0x7fbe0c063890 2021-06-25T04:49:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe10860700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c061fb0 con 0x7fbe0c0618e0 2021-06-25T04:49:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0b59e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbe0c0b1290 0x7fbe0c128c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54402/0 (socket says 172.21.15.57:54402) 2021-06-25T04:49:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0b59e700 1 -- 172.21.15.57:0/2381479348 learned_addr learned my addr 172.21.15.57:0/2381479348 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:35.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0ad9d700 1 --2- 172.21.15.57:0/2381479348 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c063890 0x7fbe0c143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0a59c700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c0618e0 0x7fbe0c140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346778162 0 0) 0x7fbe0c063c70 con 0x7fbe0c0b1290 2021-06-25T04:49:35.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf0003260 con 0x7fbe0c0b1290 2021-06-25T04:49:35.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2323457216 0 0) 0x7fbdf0003260 con 0x7fbe0c0b1290 2021-06-25T04:49:35.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c0618e0 msgr2=0x7fbe0c140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:35.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c0618e0 0x7fbe0c140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c063890 msgr2=0x7fbe0c143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:35.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 --2- 172.21.15.57:0/2381479348 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c063890 0x7fbe0c143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c13ff60 con 0x7fbe0c0b1290 2021-06-25T04:49:35.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fbe04001a00 con 0x7fbe0c0b1290 2021-06-25T04:49:35.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 >> v1:172.21.15.57:6789/0 conn(0x7fbe0c0b1290 legacy=0x7fbe0c128c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf0003750 0x7fbdf0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdf0004500 0x7fbdf0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c0618e0 0x7fbdf0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c061fb0 con 0x7fbdf0003750 2021-06-25T04:49:35.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0004350 con 0x7fbdf0004500 2021-06-25T04:49:35.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf000d9e0 con 0x7fbe0c0618e0 2021-06-25T04:49:35.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0ad9d700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf0003750 0x7fbdf0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0a59c700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdf0004500 0x7fbdf0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0b59e700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c0618e0 0x7fbdf0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0ad9d700 1 -- 172.21.15.57:0/2381479348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c0618e0 msgr2=0x7fbdf0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:35.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0ad9d700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c0618e0 0x7fbdf0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0ad9d700 1 -- 172.21.15.57:0/2381479348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdf0004500 msgr2=0x7fbdf0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:35.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0ad9d700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdf0004500 0x7fbdf0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0ad9d700 1 -- 172.21.15.57:0/2381479348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0003260 con 0x7fbdf0003750 2021-06-25T04:49:35.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0ad9d700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf0003750 0x7fbdf0003b70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fbdfc00c000 tx=0x7fbdfc006df0).ready entity=mon.0 client_cookie=442eed5e390903b5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:35.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdfc00e830 con 0x7fbdf0003750 2021-06-25T04:49:35.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc00e990 con 0x7fbdf0003750 2021-06-25T04:49:35.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe09d9b700 1 -- 172.21.15.57:0/2381479348 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdfc00ecf0 con 0x7fbdf0003750 2021-06-25T04:49:35.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe10860700 1 -- 172.21.15.57:0/2381479348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf0003750 msgr2=0x7fbdf0003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe10860700 1 --2- 172.21.15.57:0/2381479348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf0003750 0x7fbdf0003b70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fbdfc00c000 tx=0x7fbdfc006df0).stop 2021-06-25T04:49:35.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.775+0000 7fbe0b59e700 1 -- 172.21.15.57:0/2381479348 reap_dead start 2021-06-25T04:49:35.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 -- 172.21.15.57:0/2381479348 shutdown_connections 2021-06-25T04:49:35.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 -- 172.21.15.57:0/2381479348 >> 172.21.15.57:0/2381479348 conn(0x7fbe0c05c450 msgr2=0x7fbe0c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:35.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 -- 172.21.15.57:0/2381479348 shutdown_connections 2021-06-25T04:49:35.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 -- 172.21.15.57:0/2381479348 wait complete. 2021-06-25T04:49:35.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 Processor -- start 2021-06-25T04:49:35.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 -- start start 2021-06-25T04:49:35.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c12e800 0x7fbe0c12ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0b31c0 0x7fbe0c0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe0c0b2b00 0x7fbe0c155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0b1f10 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1526e0 con 0x7fbe0c0b2b00 2021-06-25T04:49:35.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe10860700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c152440 con 0x7fbe0c12e800 2021-06-25T04:49:35.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.779+0000 7fbe0a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0b31c0 0x7fbe0c0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe0a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0b31c0 0x7fbe0c0b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37194/0 (socket says 172.21.15.57:37194) 2021-06-25T04:49:35.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe0a59c700 1 -- 172.21.15.57:0/1529604994 learned_addr learned my addr 172.21.15.57:0/1529604994 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:35.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe0ad9d700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c12e800 0x7fbe0c12ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe0b59e700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe0c0b2b00 0x7fbe0c155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe0a59c700 1 -- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c12e800 msgr2=0x7fbe0c12ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe0a59c700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c12e800 0x7fbe0c12ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe0a59c700 1 -- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe0c0b2b00 msgr2=0x7fbe0c155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe0a59c700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe0c0b2b00 0x7fbe0c155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe0a59c700 1 -- 172.21.15.57:0/1529604994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0b2170 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe0a59c700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0b31c0 0x7fbe0c0b2610 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fbe0000b000 tx=0x7fbe00006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:35.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbdfbfff700 1 -- 172.21.15.57:0/1529604994 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe00011e70 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbdfbfff700 1 -- 172.21.15.57:0/1529604994 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0000f940 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe10860700 1 -- 172.21.15.57:0/1529604994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c1531d0 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbdfbfff700 1 -- 172.21.15.57:0/1529604994 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe0000fca0 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe10860700 1 -- 172.21.15.57:0/1529604994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c155df0 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.783+0000 7fbe10860700 1 -- 172.21.15.57:0/1529604994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0c0b2300 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.787+0000 7fbdfbfff700 1 -- 172.21.15.57:0/1529604994 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbe00014440 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.787+0000 7fbdfbfff700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbde80553d0 0x7fbde8057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:35.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.787+0000 7fbdfbfff700 1 -- 172.21.15.57:0/1529604994 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbe0006e860 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.787+0000 7fbe0ad9d700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbde80553d0 0x7fbde8057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:35.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.787+0000 7fbe0ad9d700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbde80553d0 0x7fbde8057890 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fbdfc01c000 tx=0x7fbdfc019000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:35.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.791+0000 7fbdfbfff700 1 -- 172.21.15.57:0/1529604994 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbe000449b0 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.923+0000 7fbe10860700 1 -- 172.21.15.57:0/1529604994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe0c05f200 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbdfbfff700 1 -- 172.21.15.57:0/1529604994 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16284 (secure 0 0 0) 0x7fbe00018020 con 0x7fbe0c0b31c0 2021-06-25T04:49:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:35.934 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":45,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:49:35.649076+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:49:34.024108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-06-25T04:49:34.636596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:49:35.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 -- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbde80553d0 msgr2=0x7fbde8057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbde80553d0 0x7fbde8057890 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fbdfc01c000 tx=0x7fbdfc019000).stop 2021-06-25T04:49:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 -- 172.21.15.57:0/1529604994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0b31c0 msgr2=0x7fbe0c0b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0b31c0 0x7fbe0c0b2610 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fbe0000b000 tx=0x7fbe00006df0).stop 2021-06-25T04:49:35.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 -- 172.21.15.57:0/1529604994 shutdown_connections 2021-06-25T04:49:35.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbde80553d0 0x7fbde8057890 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe0c0b2b00 0x7fbe0c155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0b31c0 0x7fbe0c0b2610 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 --2- 172.21.15.57:0/1529604994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe0c12e800 0x7fbe0c12ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:35.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 -- 172.21.15.57:0/1529604994 >> 172.21.15.57:0/1529604994 conn(0x7fbe0c05c450 msgr2=0x7fbe0c142710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:35.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 -- 172.21.15.57:0/1529604994 shutdown_connections 2021-06-25T04:49:35.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:35.927+0000 7fbe10860700 1 -- 172.21.15.57:0/1529604994 wait complete. 2021-06-25T04:49:35.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:49:36.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.043+0000 7f53a50a4700 1 Processor -- start 2021-06-25T04:49:36.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.043+0000 7f53a50a4700 1 -- start start 2021-06-25T04:49:36.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00af920 0x7f53a00b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53a00b04b0 0x7f53a00b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a00ad560 con 0x7f53a00b2570 2021-06-25T04:49:36.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a00af420 con 0x7f53a00b04b0 2021-06-25T04:49:36.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a00ad020 con 0x7f53a00af920 2021-06-25T04:49:36.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539e59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53a00b04b0 0x7f53a00b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539ed9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00af920 0x7f53a00b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539ed9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00af920 0x7f53a00b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:48364/0 (socket says 172.21.15.57:48364) 2021-06-25T04:49:36.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539ed9d700 1 -- 172.21.15.57:0/1785527695 learned_addr learned my addr 172.21.15.57:0/1785527695 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:36.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539e59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53a00b04b0 0x7f53a00b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:45696/0 (socket says 172.21.15.57:45696) 2021-06-25T04:49:36.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539f59e700 1 --1- 172.21.15.57:0/1785527695 >> v1:172.21.15.87:6789/0 conn(0x7f53a00b2570 0x7f53a005f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:55170/0 (socket says 172.21.15.57:55170) 2021-06-25T04:49:36.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539ed9d700 1 -- 172.21.15.57:0/1785527695 >> v2:172.21.15.87:3300/0 conn(0x7f53a00b04b0 msgr2=0x7f53a00b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:36.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539ed9d700 1 --2- 172.21.15.57:0/1785527695 >> v2:172.21.15.87:3300/0 conn(0x7f53a00b04b0 0x7f53a00b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539ed9d700 1 -- 172.21.15.57:0/1785527695 >> v1:172.21.15.87:6789/0 conn(0x7f53a00b2570 legacy=0x7f53a005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539ed9d700 1 -- 172.21.15.57:0/1785527695 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a00ad2c0 con 0x7f53a00af920 2021-06-25T04:49:36.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539ed9d700 1 --2- 172.21.15.57:0/1785527695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00af920 0x7f53a00b1b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f53980032f0 tx=0x7f539800b530).ready entity=mon.2 client_cookie=863113d5e758930d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:36.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539dd9b700 1 -- 172.21.15.57:0/1785527695 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53980153f0 con 0x7f53a00af920 2021-06-25T04:49:36.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539dd9b700 1 -- 172.21.15.57:0/1785527695 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398015550 con 0x7f53a00af920 2021-06-25T04:49:36.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f539dd9b700 1 -- 172.21.15.57:0/1785527695 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53980158b0 con 0x7f53a00af920 2021-06-25T04:49:36.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 -- 172.21.15.57:0/1785527695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00af920 msgr2=0x7f53a00b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 --2- 172.21.15.57:0/1785527695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00af920 0x7f53a00b1b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f53980032f0 tx=0x7f539800b530).stop 2021-06-25T04:49:36.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 -- 172.21.15.57:0/1785527695 shutdown_connections 2021-06-25T04:49:36.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 --2- 172.21.15.57:0/1785527695 >> v2:172.21.15.87:3300/0 conn(0x7f53a00b04b0 0x7f53a00b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 --2- 172.21.15.57:0/1785527695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00af920 0x7f53a00b1b90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 -- 172.21.15.57:0/1785527695 >> 172.21.15.57:0/1785527695 conn(0x7f53a005cce0 msgr2=0x7f53a0062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:36.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 -- 172.21.15.57:0/1785527695 shutdown_connections 2021-06-25T04:49:36.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.047+0000 7f53a50a4700 1 -- 172.21.15.57:0/1785527695 wait complete. 2021-06-25T04:49:36.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f53a50a4700 1 Processor -- start 2021-06-25T04:49:36.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f53a50a4700 1 -- start start 2021-06-25T04:49:36.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f53a50a4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a00af920 0x7f53a00ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f53a50a4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00b04b0 0x7f53a00a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f53a50a4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53a00b2570 0x7f53a014e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f53a50a4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a00a8ca0 con 0x7f53a00b2570 2021-06-25T04:49:36.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f53a50a4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a00667a0 con 0x7f53a00af920 2021-06-25T04:49:36.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f53a50a4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a00673e0 con 0x7f53a00b04b0 2021-06-25T04:49:36.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f539f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53a00b2570 0x7f53a014e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f539e59c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00b04b0 0x7f53a00a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f539ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a00af920 0x7f53a00ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f539f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53a00b2570 0x7f53a014e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37210/0 (socket says 172.21.15.57:37210) 2021-06-25T04:49:36.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.051+0000 7f539f59e700 1 -- 172.21.15.57:0/4202564247 learned_addr learned my addr 172.21.15.57:0/4202564247 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:36.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f539e59c700 1 -- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a00af920 msgr2=0x7f53a00ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f539e59c700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a00af920 0x7f53a00ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f539e59c700 1 -- 172.21.15.57:0/4202564247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53a00b2570 msgr2=0x7f53a014e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f539e59c700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53a00b2570 0x7f53a014e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f539e59c700 1 -- 172.21.15.57:0/4202564247 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539800b7d0 con 0x7f53a00b04b0 2021-06-25T04:49:36.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f539e59c700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00b04b0 0x7f53a00a67f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f539400c000 tx=0x7f5394006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:36.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f538ffff700 1 -- 172.21.15.57:0/4202564247 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5394011750 con 0x7f53a00b04b0 2021-06-25T04:49:36.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f538ffff700 1 -- 172.21.15.57:0/4202564247 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53940118b0 con 0x7f53a00b04b0 2021-06-25T04:49:36.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f538ffff700 1 -- 172.21.15.57:0/4202564247 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5394011c10 con 0x7f53a00b04b0 2021-06-25T04:49:36.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f53a50a4700 1 -- 172.21.15.57:0/4202564247 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a014e0c0 con 0x7f53a00b04b0 2021-06-25T04:49:36.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f53a50a4700 1 -- 172.21.15.57:0/4202564247 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a0066a20 con 0x7f53a00b04b0 2021-06-25T04:49:36.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f53a50a4700 1 -- 172.21.15.57:0/4202564247 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a0057310 con 0x7f53a00b04b0 2021-06-25T04:49:36.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f538ffff700 1 -- 172.21.15.57:0/4202564247 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5394011d70 con 0x7f53a00b04b0 2021-06-25T04:49:36.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.055+0000 7f538ffff700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f537c055450 0x7f537c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.059+0000 7f538ffff700 1 -- 172.21.15.57:0/4202564247 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f539406e4b0 con 0x7f53a00b04b0 2021-06-25T04:49:36.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.059+0000 7f539ed9d700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f537c055450 0x7f537c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.059+0000 7f539ed9d700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f537c055450 0x7f537c057910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f539801c000 tx=0x7f5398019000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:36.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.063+0000 7f538ffff700 1 -- 172.21.15.57:0/4202564247 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5394044660 con 0x7f53a00b04b0 2021-06-25T04:49:36.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.199+0000 7f53a50a4700 1 -- 172.21.15.57:0/4202564247 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53a005d720 con 0x7f53a00b04b0 2021-06-25T04:49:36.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.199+0000 7f538ffff700 1 -- 172.21.15.57:0/4202564247 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16284 (secure 0 0 0) 0x7f5394047c80 con 0x7f53a00b04b0 2021-06-25T04:49:36.207 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:36.207 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":45,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:49:35.649076+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:49:34.024108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-06-25T04:49:34.636596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:49:36.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 -- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f537c055450 msgr2=0x7f537c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f537c055450 0x7f537c057910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f539801c000 tx=0x7f5398019000).stop 2021-06-25T04:49:36.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 -- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00b04b0 msgr2=0x7f53a00a67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00b04b0 0x7f53a00a67f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f539400c000 tx=0x7f5394006df0).stop 2021-06-25T04:49:36.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 -- 172.21.15.57:0/4202564247 shutdown_connections 2021-06-25T04:49:36.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f537c055450 0x7f537c057910 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53a00b2570 0x7f53a014e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00b04b0 0x7f53a00a67f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 --2- 172.21.15.57:0/4202564247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a00af920 0x7f53a00ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 -- 172.21.15.57:0/4202564247 >> 172.21.15.57:0/4202564247 conn(0x7f53a005cce0 msgr2=0x7f53a00b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:36.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 -- 172.21.15.57:0/4202564247 shutdown_connections 2021-06-25T04:49:36.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.203+0000 7f53a50a4700 1 -- 172.21.15.57:0/4202564247 wait complete. 2021-06-25T04:49:36.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:49:36.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0ab59e700 1 Processor -- start 2021-06-25T04:49:36.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0ab59e700 1 -- start start 2021-06-25T04:49:36.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0ab59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe0ac066990 0x7fe0ac13e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0ab59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac05f710 con 0x7fe0ac0665b0 2021-06-25T04:49:36.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0ab59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac0b1460 con 0x7fe0ac0b19f0 2021-06-25T04:49:36.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0ab59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac05f940 con 0x7fe0ac066990 2021-06-25T04:49:36.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0aa59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe0ac0665b0 0x7fe0ac05fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54432/0 (socket says 172.21.15.57:54432) 2021-06-25T04:49:36.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0aa59c700 1 -- 172.21.15.57:0/586922100 learned_addr learned my addr 172.21.15.57:0/586922100 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:36.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0aad9d700 1 --2- 172.21.15.57:0/586922100 >> v2:172.21.15.57:3300/0 conn(0x7fe0ac066990 0x7fe0ac13e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0a959a700 1 -- 172.21.15.57:0/586922100 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071974020 0 0) 0x7fe0ac05f710 con 0x7fe0ac0665b0 2021-06-25T04:49:36.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0a959a700 1 -- 172.21.15.57:0/586922100 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe08c003260 con 0x7fe0ac0665b0 2021-06-25T04:49:36.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0a959a700 1 -- 172.21.15.57:0/586922100 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204208481 0 0) 0x7fe0ac0b1460 con 0x7fe0ac0b19f0 2021-06-25T04:49:36.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0a959a700 1 -- 172.21.15.57:0/586922100 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0ac05f710 con 0x7fe0ac0b19f0 2021-06-25T04:49:36.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0aad9d700 1 -- 172.21.15.57:0/586922100 >> v1:172.21.15.87:6789/0 conn(0x7fe0ac0b19f0 legacy=0x7fe0ac140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0aad9d700 1 -- 172.21.15.57:0/586922100 >> v1:172.21.15.57:6789/0 conn(0x7fe0ac0665b0 legacy=0x7fe0ac05fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0aad9d700 1 -- 172.21.15.57:0/586922100 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac0b1700 con 0x7fe0ac066990 2021-06-25T04:49:36.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.331+0000 7fe0aad9d700 1 --2- 172.21.15.57:0/586922100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0ac066990 0x7fe0ac13e0e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fe0a40032f0 tx=0x7fe0a40091d0).ready entity=mon.0 client_cookie=a2d08656c507ccb3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:36.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a959a700 1 -- 172.21.15.57:0/586922100 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0a400b600 con 0x7fe0ac066990 2021-06-25T04:49:36.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a959a700 1 -- 172.21.15.57:0/586922100 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a400b760 con 0x7fe0ac066990 2021-06-25T04:49:36.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a959a700 1 -- 172.21.15.57:0/586922100 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0a400b8d0 con 0x7fe0ac066990 2021-06-25T04:49:36.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 -- 172.21.15.57:0/586922100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0ac066990 msgr2=0x7fe0ac13e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 --2- 172.21.15.57:0/586922100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0ac066990 0x7fe0ac13e0e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fe0a40032f0 tx=0x7fe0a40091d0).stop 2021-06-25T04:49:36.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 -- 172.21.15.57:0/586922100 shutdown_connections 2021-06-25T04:49:36.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 --2- 172.21.15.57:0/586922100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0ac066990 0x7fe0ac13e0e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 -- 172.21.15.57:0/586922100 >> 172.21.15.57:0/586922100 conn(0x7fe0ac0636a0 msgr2=0x7fe0ac063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:36.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 -- 172.21.15.57:0/586922100 shutdown_connections 2021-06-25T04:49:36.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 -- 172.21.15.57:0/586922100 wait complete. 2021-06-25T04:49:36.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 Processor -- start 2021-06-25T04:49:36.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 -- start start 2021-06-25T04:49:36.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0ac0665b0 0x7fe0ac13c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0ac066990 0x7fe0ac0ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0ac0b19f0 0x7fe0ac0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac064cd0 con 0x7fe0ac066990 2021-06-25T04:49:36.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0afd60 con 0x7fe0ac0b19f0 2021-06-25T04:49:36.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0ab59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac065af0 con 0x7fe0ac0665b0 2021-06-25T04:49:36.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0ac066990 0x7fe0ac0ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0ac066990 0x7fe0ac0ae9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37220/0 (socket says 172.21.15.57:37220) 2021-06-25T04:49:36.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a9d9b700 1 -- 172.21.15.57:0/4166662838 learned_addr learned my addr 172.21.15.57:0/4166662838 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:36.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0aa59c700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0ac0665b0 0x7fe0ac13c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0aad9d700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0ac0b19f0 0x7fe0ac0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a9d9b700 1 -- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0ac0665b0 msgr2=0x7fe0ac13c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a9d9b700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0ac0665b0 0x7fe0ac13c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a9d9b700 1 -- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0ac0b19f0 msgr2=0x7fe0ac0aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a9d9b700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0ac0b19f0 0x7fe0ac0aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a9d9b700 1 -- 172.21.15.57:0/4166662838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a4009470 con 0x7fe0ac066990 2021-06-25T04:49:36.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0aa59c700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0ac0665b0 0x7fe0ac13c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:49:36.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.335+0000 7fe0a9d9b700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0ac066990 0x7fe0ac0ae9f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fe094001110 tx=0x7fe094007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:36.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.339+0000 7fe0a37fe700 1 -- 172.21.15.57:0/4166662838 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe094012400 con 0x7fe0ac066990 2021-06-25T04:49:36.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.339+0000 7fe0a37fe700 1 -- 172.21.15.57:0/4166662838 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094012560 con 0x7fe0ac066990 2021-06-25T04:49:36.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.339+0000 7fe0ab59e700 1 -- 172.21.15.57:0/4166662838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac064440 con 0x7fe0ac066990 2021-06-25T04:49:36.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.339+0000 7fe0a37fe700 1 -- 172.21.15.57:0/4166662838 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0940128c0 con 0x7fe0ac066990 2021-06-25T04:49:36.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.339+0000 7fe0ab59e700 1 -- 172.21.15.57:0/4166662838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac064980 con 0x7fe0ac066990 2021-06-25T04:49:36.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.339+0000 7fe0ab59e700 1 -- 172.21.15.57:0/4166662838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac0ae790 con 0x7fe0ac066990 2021-06-25T04:49:36.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.339+0000 7fe0a37fe700 1 -- 172.21.15.57:0/4166662838 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe094019030 con 0x7fe0ac066990 2021-06-25T04:49:36.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.339+0000 7fe0a37fe700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe090055450 0x7fe090057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.339+0000 7fe0a37fe700 1 -- 172.21.15.57:0/4166662838 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe09406d2c0 con 0x7fe0ac066990 2021-06-25T04:49:36.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.339+0000 7fe0aa59c700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe090055450 0x7fe090057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.343+0000 7fe0aa59c700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe090055450 0x7fe090057910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fe09c008000 tx=0x7fe09c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:36.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.351+0000 7fe0a37fe700 1 -- 172.21.15.57:0/4166662838 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe094043470 con 0x7fe0ac066990 2021-06-25T04:49:36.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.519+0000 7fe0ab59e700 1 -- 172.21.15.57:0/4166662838 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe0ac057310 con 0x7fe0ac066990 2021-06-25T04:49:36.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.655+0000 7fe0a37fe700 1 -- 172.21.15.57:0/4166662838 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe094046a90 con 0x7fe0ac066990 2021-06-25T04:49:36.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 -- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe090055450 msgr2=0x7fe090057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe090055450 0x7fe090057910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fe09c008000 tx=0x7fe09c009040).stop 2021-06-25T04:49:36.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 -- 172.21.15.57:0/4166662838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0ac066990 msgr2=0x7fe0ac0ae9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0ac066990 0x7fe0ac0ae9f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fe094001110 tx=0x7fe094007ab0).stop 2021-06-25T04:49:36.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 -- 172.21.15.57:0/4166662838 shutdown_connections 2021-06-25T04:49:36.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe090055450 0x7fe090057910 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0ac0b19f0 0x7fe0ac0aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0ac066990 0x7fe0ac0ae9f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 --2- 172.21.15.57:0/4166662838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0ac0665b0 0x7fe0ac13c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 -- 172.21.15.57:0/4166662838 >> 172.21.15.57:0/4166662838 conn(0x7fe0ac0636a0 msgr2=0x7fe0ac0b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:36.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 -- 172.21.15.57:0/4166662838 shutdown_connections 2021-06-25T04:49:36.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.659+0000 7fe0ab59e700 1 -- 172.21.15.57:0/4166662838 wait complete. 2021-06-25T04:49:36.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:49:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 Processor -- start 2021-06-25T04:49:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 -- start start 2021-06-25T04:49:36.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb074067140 0x7fb07405f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0740a7a50 con 0x7fb0740a7670 2021-06-25T04:49:36.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0741475e0 con 0x7fb0740b1930 2021-06-25T04:49:36.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb074147880 con 0x7fb074067140 2021-06-25T04:49:36.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb078f6b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb0740a7670 0x7fb074066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54446/0 (socket says 172.21.15.57:54446) 2021-06-25T04:49:36.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb078f6b700 1 -- 172.21.15.57:0/96152195 learned_addr learned my addr 172.21.15.57:0/96152195 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:36.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb06bfff700 1 --2- 172.21.15.57:0/96152195 >> v2:172.21.15.87:3300/0 conn(0x7fb074067140 0x7fb07405f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb06b7fe700 1 -- 172.21.15.57:0/96152195 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194990156 0 0) 0x7fb0740a7a50 con 0x7fb0740a7670 2021-06-25T04:49:36.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb06b7fe700 1 -- 172.21.15.57:0/96152195 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb060003260 con 0x7fb0740a7670 2021-06-25T04:49:36.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb06bfff700 1 -- 172.21.15.57:0/96152195 >> v1:172.21.15.87:6789/0 conn(0x7fb0740b1930 legacy=0x7fb07405fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb06bfff700 1 -- 172.21.15.57:0/96152195 >> v1:172.21.15.57:6789/0 conn(0x7fb0740a7670 legacy=0x7fb074066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb06bfff700 1 -- 172.21.15.57:0/96152195 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074147b20 con 0x7fb074067140 2021-06-25T04:49:36.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb06bfff700 1 --2- 172.21.15.57:0/96152195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb074067140 0x7fb07405f670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fb064002f70 tx=0x7fb064006df0).ready entity=mon.1 client_cookie=8e3ee80e4ef0dd25 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:36.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb06b7fe700 1 -- 172.21.15.57:0/96152195 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb06400d610 con 0x7fb074067140 2021-06-25T04:49:36.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb06b7fe700 1 -- 172.21.15.57:0/96152195 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb064000e90 con 0x7fb074067140 2021-06-25T04:49:36.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb06b7fe700 1 -- 172.21.15.57:0/96152195 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb06400d960 con 0x7fb074067140 2021-06-25T04:49:36.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 -- 172.21.15.57:0/96152195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb074067140 msgr2=0x7fb07405f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 --2- 172.21.15.57:0/96152195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb074067140 0x7fb07405f670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fb064002f70 tx=0x7fb064006df0).stop 2021-06-25T04:49:36.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 -- 172.21.15.57:0/96152195 shutdown_connections 2021-06-25T04:49:36.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 --2- 172.21.15.57:0/96152195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb074067140 0x7fb07405f670 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 -- 172.21.15.57:0/96152195 >> 172.21.15.57:0/96152195 conn(0x7fb0740b53a0 msgr2=0x7fb0740b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:36.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 -- 172.21.15.57:0/96152195 shutdown_connections 2021-06-25T04:49:36.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.783+0000 7fb07b1cf700 1 -- 172.21.15.57:0/96152195 wait complete. 2021-06-25T04:49:36.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.787+0000 7fb07b1cf700 1 Processor -- start 2021-06-25T04:49:36.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.787+0000 7fb07b1cf700 1 -- start start 2021-06-25T04:49:36.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb07b1cf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb074067140 0x7fb0740abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb07b1cf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0740a7670 0x7fb0740adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb07b1cf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0740b1930 0x7fb0740ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb07b1cf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0740ae5c0 con 0x7fb0740a7670 2021-06-25T04:49:36.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb07b1cf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0740ac4e0 con 0x7fb0740b1930 2021-06-25T04:49:36.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb07b1cf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0740aa300 con 0x7fb074067140 2021-06-25T04:49:36.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb06bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0740a7670 0x7fb0740adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb06bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0740a7670 0x7fb0740adbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37236/0 (socket says 172.21.15.57:37236) 2021-06-25T04:49:36.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb06bfff700 1 -- 172.21.15.57:0/3279485296 learned_addr learned my addr 172.21.15.57:0/3279485296 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:36.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb078f6b700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb074067140 0x7fb0740abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb07976c700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0740b1930 0x7fb0740ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb078f6b700 1 -- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0740b1930 msgr2=0x7fb0740ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb078f6b700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0740b1930 0x7fb0740ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb078f6b700 1 -- 172.21.15.57:0/3279485296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0740a7670 msgr2=0x7fb0740adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb078f6b700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0740a7670 0x7fb0740adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb078f6b700 1 -- 172.21.15.57:0/3279485296 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06400b180 con 0x7fb074067140 2021-06-25T04:49:36.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb06bfff700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0740a7670 0x7fb0740adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:36.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb078f6b700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb074067140 0x7fb0740abba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb0740ae700 tx=0x7fb070007a20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:36.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb069ffb700 1 -- 172.21.15.57:0/3279485296 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07000ce70 con 0x7fb074067140 2021-06-25T04:49:36.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb069ffb700 1 -- 172.21.15.57:0/3279485296 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0700070d0 con 0x7fb074067140 2021-06-25T04:49:36.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb07b1cf700 1 -- 172.21.15.57:0/3279485296 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0740aa560 con 0x7fb074067140 2021-06-25T04:49:36.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb069ffb700 1 -- 172.21.15.57:0/3279485296 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb070007430 con 0x7fb074067140 2021-06-25T04:49:36.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb07b1cf700 1 -- 172.21.15.57:0/3279485296 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07415a840 con 0x7fb074067140 2021-06-25T04:49:36.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.791+0000 7fb07b1cf700 1 -- 172.21.15.57:0/3279485296 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb074057310 con 0x7fb074067140 2021-06-25T04:49:36.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.795+0000 7fb069ffb700 1 -- 172.21.15.57:0/3279485296 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb070010070 con 0x7fb074067140 2021-06-25T04:49:36.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.795+0000 7fb069ffb700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb054055510 0x7fb0540579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:36.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.795+0000 7fb069ffb700 1 -- 172.21.15.57:0/3279485296 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb07006d580 con 0x7fb074067140 2021-06-25T04:49:36.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.795+0000 7fb06bfff700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb054055510 0x7fb0540579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:36.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.795+0000 7fb06bfff700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb054055510 0x7fb0540579d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fb064019000 tx=0x7fb064014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:36.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.803+0000 7fb069ffb700 1 -- 172.21.15.57:0/3279485296 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb0700435a0 con 0x7fb074067140 2021-06-25T04:49:36.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.967+0000 7fb07b1cf700 1 -- 172.21.15.57:0/3279485296 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0740698a0 con 0x7fb074067140 2021-06-25T04:49:36.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.967+0000 7fb069ffb700 1 -- 172.21.15.57:0/3279485296 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7fb070046bc0 con 0x7fb074067140 2021-06-25T04:49:36.974 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:36.974 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/587697587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":587697587},{"type":"v1","addr":"172.21.15.87:6835","nonce":587697587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/3950506435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3950506435},{"type":"v1","addr":"172.21.15.57:6833","nonce":3950506435}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:49:35.649253+0000","modified":"2021-06-25T04:49:36.652144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/792452299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":792452299},{"type":"v1","addr":"172.21.15.57:6835","nonce":792452299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-06-25T04:49:36.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 -- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb054055510 msgr2=0x7fb0540579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb054055510 0x7fb0540579d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fb064019000 tx=0x7fb064014000).stop 2021-06-25T04:49:36.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 -- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb074067140 msgr2=0x7fb0740abba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:36.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb074067140 0x7fb0740abba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb0740ae700 tx=0x7fb070007a20).stop 2021-06-25T04:49:36.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 -- 172.21.15.57:0/3279485296 shutdown_connections 2021-06-25T04:49:36.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb054055510 0x7fb0540579d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0740b1930 0x7fb0740ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0740a7670 0x7fb0740adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 --2- 172.21.15.57:0/3279485296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb074067140 0x7fb0740abba0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:36.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 -- 172.21.15.57:0/3279485296 >> 172.21.15.57:0/3279485296 conn(0x7fb0740b53a0 msgr2=0x7fb0741499a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:36.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 -- 172.21.15.57:0/3279485296 shutdown_connections 2021-06-25T04:49:36.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:36.971+0000 7fb07b1cf700 1 -- 172.21.15.57:0/3279485296 wait complete. 2021-06-25T04:49:36.979 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2021-06-25T04:49:36.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:49:37.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45d759e700 1 Processor -- start 2021-06-25T04:49:37.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45d759e700 1 -- start start 2021-06-25T04:49:37.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45d759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45d80aea00 0x7f45d8143770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45d759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45d80acfc0 0x7f45d8143c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45d759e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f45d80b0440 0x7f45d8146af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45d759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d80adc10 con 0x7f45d80acfc0 2021-06-25T04:49:37.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45d759e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d80b0950 con 0x7f45d80b0440 2021-06-25T04:49:37.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45d759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d81466c0 con 0x7f45d80aea00 2021-06-25T04:49:37.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45cffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45d80acfc0 0x7f45d8143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45cffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45d80acfc0 0x7f45d8143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37242/0 (socket says 172.21.15.57:37242) 2021-06-25T04:49:37.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45cffff700 1 -- 172.21.15.57:0/2891867755 learned_addr learned my addr 172.21.15.57:0/2891867755 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:37.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45d6d9d700 1 --2- 172.21.15.57:0/2891867755 >> v2:172.21.15.87:3300/0 conn(0x7f45d80b0440 0x7f45d8146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.083+0000 7f45d659c700 1 --2- 172.21.15.57:0/2891867755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45d80aea00 0x7f45d8143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45cffff700 1 -- 172.21.15.57:0/2891867755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45d80aea00 msgr2=0x7f45d8143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:37.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45cffff700 1 --2- 172.21.15.57:0/2891867755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45d80aea00 0x7f45d8143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45cffff700 1 -- 172.21.15.57:0/2891867755 >> v2:172.21.15.87:3300/0 conn(0x7f45d80b0440 msgr2=0x7f45d8146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:37.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45cffff700 1 --2- 172.21.15.57:0/2891867755 >> v2:172.21.15.87:3300/0 conn(0x7f45d80b0440 0x7f45d8146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45cffff700 1 -- 172.21.15.57:0/2891867755 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80aede0 con 0x7f45d80acfc0 2021-06-25T04:49:37.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d659c700 1 --2- 172.21.15.57:0/2891867755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45d80aea00 0x7f45d8143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:37.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45cffff700 1 --2- 172.21.15.57:0/2891867755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45d80acfc0 0x7f45d8143c60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f45c0002f70 tx=0x7f45c0006eb0).ready entity=mon.0 client_cookie=490aec60b41f06ea server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:37.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d5d9b700 1 -- 172.21.15.57:0/2891867755 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45c000d570 con 0x7f45d80acfc0 2021-06-25T04:49:37.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d5d9b700 1 -- 172.21.15.57:0/2891867755 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c0000e90 con 0x7f45d80acfc0 2021-06-25T04:49:37.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d5d9b700 1 -- 172.21.15.57:0/2891867755 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45c000d900 con 0x7f45d80acfc0 2021-06-25T04:49:37.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d759e700 1 -- 172.21.15.57:0/2891867755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45d80acfc0 msgr2=0x7f45d8143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d759e700 1 --2- 172.21.15.57:0/2891867755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45d80acfc0 0x7f45d8143c60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f45c0002f70 tx=0x7f45c0006eb0).stop 2021-06-25T04:49:37.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d759e700 1 -- 172.21.15.57:0/2891867755 shutdown_connections 2021-06-25T04:49:37.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d759e700 1 --2- 172.21.15.57:0/2891867755 >> v2:172.21.15.87:3300/0 conn(0x7f45d80b0440 0x7f45d8146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d759e700 1 --2- 172.21.15.57:0/2891867755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45d80acfc0 0x7f45d8143c60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d759e700 1 --2- 172.21.15.57:0/2891867755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45d80aea00 0x7f45d8143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d759e700 1 -- 172.21.15.57:0/2891867755 >> 172.21.15.57:0/2891867755 conn(0x7f45d80611f0 msgr2=0x7f45d8062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:37.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d759e700 1 -- 172.21.15.57:0/2891867755 shutdown_connections 2021-06-25T04:49:37.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d759e700 1 -- 172.21.15.57:0/2891867755 wait complete. 2021-06-25T04:49:37.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d759e700 1 Processor -- start 2021-06-25T04:49:37.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.087+0000 7f45d759e700 1 -- start start 2021-06-25T04:49:37.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45d80acfc0 0x7f45d81421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d80aea00 0x7f45d81426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45d80b0440 0x7f45d8141650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d813d000 con 0x7f45d80b0440 2021-06-25T04:49:37.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d81576d0 con 0x7f45d80aea00 2021-06-25T04:49:37.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d813d230 con 0x7f45d80acfc0 2021-06-25T04:49:37.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45d80b0440 0x7f45d8141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45d80b0440 0x7f45d8141650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37250/0 (socket says 172.21.15.57:37250) 2021-06-25T04:49:37.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d6d9d700 1 -- 172.21.15.57:0/3591703459 learned_addr learned my addr 172.21.15.57:0/3591703459 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:37.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d659c700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45d80acfc0 0x7f45d81421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45cffff700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d80aea00 0x7f45d81426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d6d9d700 1 -- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45d80acfc0 msgr2=0x7f45d81421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d6d9d700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45d80acfc0 0x7f45d81421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d6d9d700 1 -- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d80aea00 msgr2=0x7f45d81426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d6d9d700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d80aea00 0x7f45d81426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d6d9d700 1 -- 172.21.15.57:0/3591703459 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c000b1e0 con 0x7f45d80b0440 2021-06-25T04:49:37.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d6d9d700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45d80b0440 0x7f45d8141650 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f45d0006e00 tx=0x7f45d00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:37.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45cf7fe700 1 -- 172.21.15.57:0/3591703459 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45d0012600 con 0x7f45d80b0440 2021-06-25T04:49:37.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45cf7fe700 1 -- 172.21.15.57:0/3591703459 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0012760 con 0x7f45d80b0440 2021-06-25T04:49:37.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d759e700 1 -- 172.21.15.57:0/3591703459 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d8157430 con 0x7f45d80b0440 2021-06-25T04:49:37.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45cf7fe700 1 -- 172.21.15.57:0/3591703459 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45d0012ac0 con 0x7f45d80b0440 2021-06-25T04:49:37.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.091+0000 7f45d759e700 1 -- 172.21.15.57:0/3591703459 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d813dd00 con 0x7f45d80b0440 2021-06-25T04:49:37.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.095+0000 7f45d759e700 1 -- 172.21.15.57:0/3591703459 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d813d590 con 0x7f45d80b0440 2021-06-25T04:49:37.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.095+0000 7f45cf7fe700 1 -- 172.21.15.57:0/3591703459 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f45d0022070 con 0x7f45d80b0440 2021-06-25T04:49:37.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.095+0000 7f45cf7fe700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45bc0553f0 0x7f45bc0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.095+0000 7f45cf7fe700 1 -- 172.21.15.57:0/3591703459 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f45d006e550 con 0x7f45d80b0440 2021-06-25T04:49:37.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.095+0000 7f45d659c700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45bc0553f0 0x7f45bc0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.095+0000 7f45d659c700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45bc0553f0 0x7f45bc0578b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f45c800c000 tx=0x7f45c8006f90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:37.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.099+0000 7f45cf7fe700 1 -- 172.21.15.57:0/3591703459 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f45d00445f0 con 0x7f45d80b0440 2021-06-25T04:49:37.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:49:37.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:49:37.165 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:49:37.168 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:49:37.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.231+0000 7f45d759e700 1 -- 172.21.15.57:0/3591703459 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45d80af3a0 con 0x7f45d80b0440 2021-06-25T04:49:37.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.231+0000 7f45cf7fe700 1 -- 172.21.15.57:0/3591703459 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f45d0016020 con 0x7f45d80b0440 2021-06-25T04:49:37.239 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:37.239 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":46,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:49:36.652945+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:49:34.024108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-06-25T04:49:34.636596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:49:37.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 -- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45bc0553f0 msgr2=0x7f45bc0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45bc0553f0 0x7f45bc0578b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f45c800c000 tx=0x7f45c8006f90).stop 2021-06-25T04:49:37.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 -- 172.21.15.57:0/3591703459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45d80b0440 msgr2=0x7f45d8141650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45d80b0440 0x7f45d8141650 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f45d0006e00 tx=0x7f45d00091d0).stop 2021-06-25T04:49:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 -- 172.21.15.57:0/3591703459 shutdown_connections 2021-06-25T04:49:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45bc0553f0 0x7f45bc0578b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45d80b0440 0x7f45d8141650 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d80aea00 0x7f45d81426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 --2- 172.21.15.57:0/3591703459 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45d80acfc0 0x7f45d81421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 -- 172.21.15.57:0/3591703459 >> 172.21.15.57:0/3591703459 conn(0x7f45d80611f0 msgr2=0x7f45d8062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 -- 172.21.15.57:0/3591703459 shutdown_connections 2021-06-25T04:49:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.235+0000 7f45d759e700 1 -- 172.21.15.57:0/3591703459 wait complete. 2021-06-25T04:49:37.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:49:37.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 Processor -- start 2021-06-25T04:49:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 -- start start 2021-06-25T04:49:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb43c0affd0 0x7fb43c0a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb43c0afb90 0x7fb43c0a8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c0a7080 con 0x7fb43c0b2540 2021-06-25T04:49:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c0a72b0 con 0x7fb43c0afb90 2021-06-25T04:49:37.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c0a7550 con 0x7fb43c0affd0 2021-06-25T04:49:37.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442244700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb43c0afb90 0x7fb43c0a8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb441a43700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb43c0b2540 0x7fb43c14ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54476/0 (socket says 172.21.15.57:54476) 2021-06-25T04:49:37.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb441a43700 1 -- 172.21.15.57:0/1744114143 learned_addr learned my addr 172.21.15.57:0/1744114143 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:37.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb441242700 1 --2- 172.21.15.57:0/1744114143 >> v2:172.21.15.87:3300/0 conn(0x7fb43c0affd0 0x7fb43c0a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442244700 1 -- 172.21.15.57:0/1744114143 >> v2:172.21.15.87:3300/0 conn(0x7fb43c0affd0 msgr2=0x7fb43c0a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442244700 1 --2- 172.21.15.57:0/1744114143 >> v2:172.21.15.87:3300/0 conn(0x7fb43c0affd0 0x7fb43c0a8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442244700 1 -- 172.21.15.57:0/1744114143 >> v1:172.21.15.57:6789/0 conn(0x7fb43c0b2540 legacy=0x7fb43c14ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb440a41700 1 -- 172.21.15.57:0/1744114143 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422728699 0 0) 0x7fb43c0a7080 con 0x7fb43c0b2540 2021-06-25T04:49:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442244700 1 -- 172.21.15.57:0/1744114143 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0a77f0 con 0x7fb43c0afb90 2021-06-25T04:49:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb441242700 1 --2- 172.21.15.57:0/1744114143 >> v2:172.21.15.87:3300/0 conn(0x7fb43c0affd0 0x7fb43c0a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442244700 1 --2- 172.21.15.57:0/1744114143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0afb90 0x7fb43c0a8860 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fb4340032f0 tx=0x7fb4340091d0).ready entity=mon.0 client_cookie=6693a7193531c9b0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb440a41700 1 -- 172.21.15.57:0/1744114143 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43400b680 con 0x7fb43c0afb90 2021-06-25T04:49:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb440a41700 1 -- 172.21.15.57:0/1744114143 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400b7e0 con 0x7fb43c0afb90 2021-06-25T04:49:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb440a41700 1 -- 172.21.15.57:0/1744114143 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43400b950 con 0x7fb43c0afb90 2021-06-25T04:49:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 -- 172.21.15.57:0/1744114143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0afb90 msgr2=0x7fb43c0a8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 --2- 172.21.15.57:0/1744114143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0afb90 0x7fb43c0a8860 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fb4340032f0 tx=0x7fb4340091d0).stop 2021-06-25T04:49:37.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 -- 172.21.15.57:0/1744114143 shutdown_connections 2021-06-25T04:49:37.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 --2- 172.21.15.57:0/1744114143 >> v2:172.21.15.87:3300/0 conn(0x7fb43c0affd0 0x7fb43c0a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 --2- 172.21.15.57:0/1744114143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0afb90 0x7fb43c0a8860 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 -- 172.21.15.57:0/1744114143 >> 172.21.15.57:0/1744114143 conn(0x7fb43c060140 msgr2=0x7fb43c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:37.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 -- 172.21.15.57:0/1744114143 shutdown_connections 2021-06-25T04:49:37.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.351+0000 7fb442a45700 1 -- 172.21.15.57:0/1744114143 wait complete. 2021-06-25T04:49:37.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb442a45700 1 Processor -- start 2021-06-25T04:49:37.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb442a45700 1 -- start start 2021-06-25T04:49:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb442a45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0afb90 0x7fb43c0abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb442a45700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb43c0affd0 0x7fb43c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb442a45700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb43c0b2540 0x7fb43c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb442a45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c156280 con 0x7fb43c0afb90 2021-06-25T04:49:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb442a45700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0b55e0 con 0x7fb43c0b2540 2021-06-25T04:49:37.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb442a45700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c156470 con 0x7fb43c0affd0 2021-06-25T04:49:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb441a43700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0afb90 0x7fb43c0abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb441a43700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0afb90 0x7fb43c0abf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37260/0 (socket says 172.21.15.57:37260) 2021-06-25T04:49:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb441a43700 1 -- 172.21.15.57:0/1357960050 learned_addr learned my addr 172.21.15.57:0/1357960050 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:37.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb442244700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb43c0b2540 0x7fb43c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb441242700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb43c0affd0 0x7fb43c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb441a43700 1 -- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb43c0affd0 msgr2=0x7fb43c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb441a43700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb43c0affd0 0x7fb43c0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb441a43700 1 -- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb43c0b2540 msgr2=0x7fb43c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb441a43700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb43c0b2540 0x7fb43c0b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb441a43700 1 -- 172.21.15.57:0/1357960050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43800b180 con 0x7fb43c0afb90 2021-06-25T04:49:37.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb441a43700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0afb90 0x7fb43c0abf40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fb42c000ed0 tx=0x7fb42c007ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:37.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb432ffd700 1 -- 172.21.15.57:0/1357960050 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb42c0070d0 con 0x7fb43c0afb90 2021-06-25T04:49:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb442a45700 1 -- 172.21.15.57:0/1357960050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb434009470 con 0x7fb43c0afb90 2021-06-25T04:49:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb442a45700 1 -- 172.21.15.57:0/1357960050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c0b4af0 con 0x7fb43c0afb90 2021-06-25T04:49:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb432ffd700 1 -- 172.21.15.57:0/1357960050 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c007230 con 0x7fb43c0afb90 2021-06-25T04:49:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.355+0000 7fb432ffd700 1 -- 172.21.15.57:0/1357960050 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb42c005610 con 0x7fb43c0afb90 2021-06-25T04:49:37.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.359+0000 7fb442a45700 1 -- 172.21.15.57:0/1357960050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c057310 con 0x7fb43c0afb90 2021-06-25T04:49:37.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.359+0000 7fb432ffd700 1 -- 172.21.15.57:0/1357960050 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb42c01a060 con 0x7fb43c0afb90 2021-06-25T04:49:37.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.359+0000 7fb432ffd700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb424055450 0x7fb424057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.359+0000 7fb432ffd700 1 -- 172.21.15.57:0/1357960050 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb42c06d580 con 0x7fb43c0afb90 2021-06-25T04:49:37.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.359+0000 7fb441242700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb424055450 0x7fb424057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.359+0000 7fb441242700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb424055450 0x7fb424057910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb43800b000 tx=0x7fb438006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:37.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.367+0000 7fb432ffd700 1 -- 172.21.15.57:0/1357960050 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb42c043690 con 0x7fb43c0afb90 2021-06-25T04:49:37.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.531+0000 7fb442a45700 1 -- 172.21.15.57:0/1357960050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb43c0b57a0 con 0x7fb43c0afb90 2021-06-25T04:49:37.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.535+0000 7fb432ffd700 1 -- 172.21.15.57:0/1357960050 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb42c018070 con 0x7fb43c0afb90 2021-06-25T04:49:37.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 -- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb424055450 msgr2=0x7fb424057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb424055450 0x7fb424057910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb43800b000 tx=0x7fb438006df0).stop 2021-06-25T04:49:37.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 -- 172.21.15.57:0/1357960050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0afb90 msgr2=0x7fb43c0abf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0afb90 0x7fb43c0abf40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fb42c000ed0 tx=0x7fb42c007ce0).stop 2021-06-25T04:49:37.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 -- 172.21.15.57:0/1357960050 shutdown_connections 2021-06-25T04:49:37.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb424055450 0x7fb424057910 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb43c0b2540 0x7fb43c0b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb43c0affd0 0x7fb43c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 --2- 172.21.15.57:0/1357960050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0afb90 0x7fb43c0abf40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 -- 172.21.15.57:0/1357960050 >> 172.21.15.57:0/1357960050 conn(0x7fb43c060140 msgr2=0x7fb43c144660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:37.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 -- 172.21.15.57:0/1357960050 shutdown_connections 2021-06-25T04:49:37.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.539+0000 7fb442a45700 1 -- 172.21.15.57:0/1357960050 wait complete. 2021-06-25T04:49:37.549 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:49:37.557 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:49:37.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.663+0000 7f396bfc9700 1 Processor -- start 2021-06-25T04:49:37.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.663+0000 7f396bfc9700 1 -- start start 2021-06-25T04:49:37.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.663+0000 7f396bfc9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f39640b6540 0x7f39640b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.663+0000 7f396bfc9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39640b4380 0x7f39640b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.663+0000 7f396bfc9700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3964144070 con 0x7f3964061cf0 2021-06-25T04:49:37.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.663+0000 7f396bfc9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39640b6e10 con 0x7f39640b6540 2021-06-25T04:49:37.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.663+0000 7f396bfc9700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3964143b30 con 0x7f39640b4380 2021-06-25T04:49:37.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.663+0000 7f3969d65700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f39640b6540 0x7f39640b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.663+0000 7f3969d65700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f39640b6540 0x7f39640b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37268/0 (socket says 172.21.15.57:37268) 2021-06-25T04:49:37.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.663+0000 7f3969d65700 1 -- 172.21.15.57:0/2267806483 learned_addr learned my addr 172.21.15.57:0/2267806483 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:37.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.663+0000 7f3969564700 1 --2- 172.21.15.57:0/2267806483 >> v2:172.21.15.87:3300/0 conn(0x7f39640b4380 0x7f39640b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f3969d65700 1 -- 172.21.15.57:0/2267806483 >> v2:172.21.15.87:3300/0 conn(0x7f39640b4380 msgr2=0x7f39640b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:37.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f3969d65700 1 --2- 172.21.15.57:0/2267806483 >> v2:172.21.15.87:3300/0 conn(0x7f39640b4380 0x7f39640b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f3969d65700 1 -- 172.21.15.57:0/2267806483 >> v1:172.21.15.87:6789/0 conn(0x7f3964061cf0 legacy=0x7f3964146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f3969d65700 1 -- 172.21.15.57:0/2267806483 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3964143dd0 con 0x7f39640b6540 2021-06-25T04:49:37.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f3969d65700 1 --2- 172.21.15.57:0/2267806483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39640b6540 0x7f39640b5bb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f39641430e0 tx=0x7f3960006eb0).ready entity=mon.0 client_cookie=b26c0c985db071ca server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:37.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f3968d63700 1 -- 172.21.15.57:0/2267806483 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f396000d610 con 0x7f39640b6540 2021-06-25T04:49:37.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f3968d63700 1 -- 172.21.15.57:0/2267806483 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3960000e90 con 0x7f39640b6540 2021-06-25T04:49:37.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f3968d63700 1 -- 172.21.15.57:0/2267806483 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f396000d9a0 con 0x7f39640b6540 2021-06-25T04:49:37.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f396bfc9700 1 -- 172.21.15.57:0/2267806483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39640b6540 msgr2=0x7f39640b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f396bfc9700 1 --2- 172.21.15.57:0/2267806483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39640b6540 0x7f39640b5bb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f39641430e0 tx=0x7f3960006eb0).stop 2021-06-25T04:49:37.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f396bfc9700 1 -- 172.21.15.57:0/2267806483 shutdown_connections 2021-06-25T04:49:37.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f396bfc9700 1 --2- 172.21.15.57:0/2267806483 >> v2:172.21.15.87:3300/0 conn(0x7f39640b4380 0x7f39640b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f396bfc9700 1 --2- 172.21.15.57:0/2267806483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39640b6540 0x7f39640b5bb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f396bfc9700 1 -- 172.21.15.57:0/2267806483 >> 172.21.15.57:0/2267806483 conn(0x7f396405c450 msgr2=0x7f396405c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:37.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f396bfc9700 1 -- 172.21.15.57:0/2267806483 shutdown_connections 2021-06-25T04:49:37.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.667+0000 7f396bfc9700 1 -- 172.21.15.57:0/2267806483 wait complete. 2021-06-25T04:49:37.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396bfc9700 1 Processor -- start 2021-06-25T04:49:37.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396bfc9700 1 -- start start 2021-06-25T04:49:37.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396bfc9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3964061cf0 0x7f3964123650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396bfc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39640b4380 0x7f39640aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396bfc9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39640b6540 0x7f39640af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396bfc9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640b3760 con 0x7f39640b4380 2021-06-25T04:49:37.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396bfc9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640b3a00 con 0x7f39640b6540 2021-06-25T04:49:37.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396bfc9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39640ae900 con 0x7f3964061cf0 2021-06-25T04:49:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3969564700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39640b4380 0x7f39640aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3969564700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39640b4380 0x7f39640aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37276/0 (socket says 172.21.15.57:37276) 2021-06-25T04:49:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3969564700 1 -- 172.21.15.57:0/1614885158 learned_addr learned my addr 172.21.15.57:0/1614885158 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3969d65700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3964061cf0 0x7f3964123650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396a566700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39640b6540 0x7f39640af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3969564700 1 -- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3964061cf0 msgr2=0x7f3964123650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3969564700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3964061cf0 0x7f3964123650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3969564700 1 -- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39640b6540 msgr2=0x7f39640af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3969564700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39640b6540 0x7f39640af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3969564700 1 -- 172.21.15.57:0/1614885158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396000b1e0 con 0x7f39640b4380 2021-06-25T04:49:37.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396a566700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39640b6540 0x7f39640af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:37.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3969564700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39640b4380 0x7f39640aeda0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f395400c000 tx=0x7f3954006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:37.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3952ffd700 1 -- 172.21.15.57:0/1614885158 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3954010590 con 0x7f39640b4380 2021-06-25T04:49:37.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3952ffd700 1 -- 172.21.15.57:0/1614885158 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39540106f0 con 0x7f39640b4380 2021-06-25T04:49:37.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396bfc9700 1 -- 172.21.15.57:0/1614885158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39640b0630 con 0x7f39640b4380 2021-06-25T04:49:37.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f3952ffd700 1 -- 172.21.15.57:0/1614885158 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3954010a90 con 0x7f39640b4380 2021-06-25T04:49:37.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.671+0000 7f396bfc9700 1 -- 172.21.15.57:0/1614885158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39640af780 con 0x7f39640b4380 2021-06-25T04:49:37.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.675+0000 7f396bfc9700 1 -- 172.21.15.57:0/1614885158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3964057310 con 0x7f39640b4380 2021-06-25T04:49:37.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.675+0000 7f3952ffd700 1 -- 172.21.15.57:0/1614885158 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3954010bf0 con 0x7f39640b4380 2021-06-25T04:49:37.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.675+0000 7f3952ffd700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3944055450 0x7f3944057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.675+0000 7f3952ffd700 1 -- 172.21.15.57:0/1614885158 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f395406e0a0 con 0x7f39640b4380 2021-06-25T04:49:37.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.675+0000 7f3969d65700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3944055450 0x7f3944057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.675+0000 7f3969d65700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3944055450 0x7f3944057910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f396001b000 tx=0x7f3960015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:37.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.679+0000 7f3952ffd700 1 -- 172.21.15.57:0/1614885158 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f39540440f0 con 0x7f39640b4380 2021-06-25T04:49:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.843+0000 7f396bfc9700 1 -- 172.21.15.57:0/1614885158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f39640aeb00 con 0x7f39640b4380 2021-06-25T04:49:37.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.851+0000 7f3952ffd700 1 -- 172.21.15.57:0/1614885158 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3954047710 con 0x7f39640b4380 2021-06-25T04:49:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 -- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3944055450 msgr2=0x7f3944057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3944055450 0x7f3944057910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f396001b000 tx=0x7f3960015000).stop 2021-06-25T04:49:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 -- 172.21.15.57:0/1614885158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39640b4380 msgr2=0x7f39640aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39640b4380 0x7f39640aeda0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f395400c000 tx=0x7f3954006df0).stop 2021-06-25T04:49:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 -- 172.21.15.57:0/1614885158 shutdown_connections 2021-06-25T04:49:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3944055450 0x7f3944057910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39640b6540 0x7f39640af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39640b4380 0x7f39640aeda0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 --2- 172.21.15.57:0/1614885158 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3964061cf0 0x7f3964123650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 -- 172.21.15.57:0/1614885158 >> 172.21.15.57:0/1614885158 conn(0x7f396405c450 msgr2=0x7f3964128270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:37.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 -- 172.21.15.57:0/1614885158 shutdown_connections 2021-06-25T04:49:37.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.855+0000 7f396bfc9700 1 -- 172.21.15.57:0/1614885158 wait complete. 2021-06-25T04:49:37.866 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:49:37.875 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:49:37.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f4576514700 1 Processor -- start 2021-06-25T04:49:37.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f4576514700 1 -- start start 2021-06-25T04:49:37.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f4576514700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45700aaed0 0x7f45700afd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f4576514700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45700671a0 con 0x7f4570060cc0 2021-06-25T04:49:37.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f4576514700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45700a9410 con 0x7f4570066dc0 2021-06-25T04:49:37.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f4576514700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45700ab2e0 con 0x7f45700aaed0 2021-06-25T04:49:37.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f456f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4570060cc0 0x7f4570143420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54502/0 (socket says 172.21.15.57:54502) 2021-06-25T04:49:37.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f456f7fe700 1 -- 172.21.15.57:0/174844040 learned_addr learned my addr 172.21.15.57:0/174844040 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:37.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f4574ab1700 1 --2- 172.21.15.57:0/174844040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45700aaed0 0x7f45700afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f456effd700 1 -- 172.21.15.57:0/174844040 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898648528 0 0) 0x7f45700671a0 con 0x7f4570060cc0 2021-06-25T04:49:37.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f456effd700 1 -- 172.21.15.57:0/174844040 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4550003260 con 0x7f4570060cc0 2021-06-25T04:49:37.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f456effd700 1 -- 172.21.15.57:0/174844040 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006626813 0 0) 0x7f45700a9410 con 0x7f4570066dc0 2021-06-25T04:49:37.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.971+0000 7f456effd700 1 -- 172.21.15.57:0/174844040 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45700671a0 con 0x7f4570066dc0 2021-06-25T04:49:37.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4574ab1700 1 -- 172.21.15.57:0/174844040 >> v1:172.21.15.87:6789/0 conn(0x7f4570066dc0 legacy=0x7f45700aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4574ab1700 1 -- 172.21.15.57:0/174844040 >> v1:172.21.15.57:6789/0 conn(0x7f4570060cc0 legacy=0x7f4570143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4574ab1700 1 -- 172.21.15.57:0/174844040 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45700b0370 con 0x7f45700aaed0 2021-06-25T04:49:37.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4574ab1700 1 --2- 172.21.15.57:0/174844040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45700aaed0 0x7f45700afd40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4568002f70 tx=0x7f4568006df0).ready entity=mon.2 client_cookie=5a9d017d89270a52 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:37.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f456effd700 1 -- 172.21.15.57:0/174844040 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f456800d5c0 con 0x7f45700aaed0 2021-06-25T04:49:37.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f456effd700 1 -- 172.21.15.57:0/174844040 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4568000e90 con 0x7f45700aaed0 2021-06-25T04:49:37.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4576514700 1 -- 172.21.15.57:0/174844040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45700aaed0 msgr2=0x7f45700afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f456effd700 1 -- 172.21.15.57:0/174844040 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f456800d910 con 0x7f45700aaed0 2021-06-25T04:49:37.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4576514700 1 --2- 172.21.15.57:0/174844040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45700aaed0 0x7f45700afd40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f4568002f70 tx=0x7f4568006df0).stop 2021-06-25T04:49:37.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4576514700 1 -- 172.21.15.57:0/174844040 shutdown_connections 2021-06-25T04:49:37.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4576514700 1 --2- 172.21.15.57:0/174844040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45700aaed0 0x7f45700afd40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4576514700 1 -- 172.21.15.57:0/174844040 >> 172.21.15.57:0/174844040 conn(0x7f45700b53a0 msgr2=0x7f45700b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:37.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4576514700 1 -- 172.21.15.57:0/174844040 shutdown_connections 2021-06-25T04:49:37.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4576514700 1 -- 172.21.15.57:0/174844040 wait complete. 2021-06-25T04:49:37.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4576514700 1 Processor -- start 2021-06-25T04:49:37.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.975+0000 7f4576514700 1 -- start start 2021-06-25T04:49:37.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f4576514700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4570060cc0 0x7f457013f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f4576514700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4570066dc0 0x7f457013b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f4576514700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45700aaed0 0x7f457013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:37.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f4576514700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457013c070 con 0x7f4570060cc0 2021-06-25T04:49:37.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f4576514700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4570146e60 con 0x7f4570066dc0 2021-06-25T04:49:37.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f4576514700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457014ff70 con 0x7f45700aaed0 2021-06-25T04:49:37.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4570060cc0 0x7f457013f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4570060cc0 0x7f457013f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37288/0 (socket says 172.21.15.57:37288) 2021-06-25T04:49:37.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456ffff700 1 -- 172.21.15.57:0/907260219 learned_addr learned my addr 172.21.15.57:0/907260219 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:37.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f4574ab1700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45700aaed0 0x7f457013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456f7fe700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4570066dc0 0x7f457013b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:37.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456ffff700 1 -- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45700aaed0 msgr2=0x7f457013bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456ffff700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45700aaed0 0x7f457013bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456ffff700 1 -- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4570066dc0 msgr2=0x7f457013b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:37.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456ffff700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4570066dc0 0x7f457013b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:37.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456ffff700 1 -- 172.21.15.57:0/907260219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456800b180 con 0x7f4570060cc0 2021-06-25T04:49:37.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456f7fe700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4570066dc0 0x7f457013b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:37.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456ffff700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4570060cc0 0x7f457013f0b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f457014fe80 tx=0x7f4560007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:37.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456d7fa700 1 -- 172.21.15.57:0/907260219 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4560002030 con 0x7f4570060cc0 2021-06-25T04:49:37.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456d7fa700 1 -- 172.21.15.57:0/907260219 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4560002190 con 0x7f4570060cc0 2021-06-25T04:49:37.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f4576514700 1 -- 172.21.15.57:0/907260219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4570146480 con 0x7f4570060cc0 2021-06-25T04:49:37.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f456d7fa700 1 -- 172.21.15.57:0/907260219 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45600024f0 con 0x7f4570060cc0 2021-06-25T04:49:37.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f4576514700 1 -- 172.21.15.57:0/907260219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45701469c0 con 0x7f4570060cc0 2021-06-25T04:49:37.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.979+0000 7f4576514700 1 -- 172.21.15.57:0/907260219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45701476e0 con 0x7f4570060cc0 2021-06-25T04:49:37.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.983+0000 7f456d7fa700 1 -- 172.21.15.57:0/907260219 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4560010070 con 0x7f4570060cc0 2021-06-25T04:49:37.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.983+0000 7f456d7fa700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4554055340 0x7f4554057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:38.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.983+0000 7f456d7fa700 1 -- 172.21.15.57:0/907260219 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f456006d520 con 0x7f4570060cc0 2021-06-25T04:49:38.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.983+0000 7f456f7fe700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4554055340 0x7f4554057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:38.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.983+0000 7f456f7fe700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4554055340 0x7f4554057800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f455800b000 tx=0x7f4558009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:38.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:37.991+0000 7f456d7fa700 1 -- 172.21.15.57:0/907260219 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4560041c50 con 0x7f4570060cc0 2021-06-25T04:49:38.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.155+0000 7f4576514700 1 -- 172.21.15.57:0/907260219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4570057310 con 0x7f4570060cc0 2021-06-25T04:49:38.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.155+0000 7f456d7fa700 1 -- 172.21.15.57:0/907260219 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f45600436d0 con 0x7f4570060cc0 2021-06-25T04:49:38.163 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:38.163 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/587697587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":587697587},{"type":"v1","addr":"172.21.15.87:6835","nonce":587697587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/3950506435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3950506435},{"type":"v1","addr":"172.21.15.57:6833","nonce":3950506435}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:49:35.649253+0000","modified":"2021-06-25T04:49:36.652144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/792452299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":792452299},{"type":"v1","addr":"172.21.15.57:6835","nonce":792452299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-06-25T04:49:38.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 -- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4554055340 msgr2=0x7f4554057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4554055340 0x7f4554057800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f455800b000 tx=0x7f4558009040).stop 2021-06-25T04:49:38.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 -- 172.21.15.57:0/907260219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4570060cc0 msgr2=0x7f457013f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4570060cc0 0x7f457013f0b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f457014fe80 tx=0x7f4560007e60).stop 2021-06-25T04:49:38.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 -- 172.21.15.57:0/907260219 shutdown_connections 2021-06-25T04:49:38.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4554055340 0x7f4554057800 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45700aaed0 0x7f457013bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4570066dc0 0x7f457013b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 --2- 172.21.15.57:0/907260219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4570060cc0 0x7f457013f0b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 -- 172.21.15.57:0/907260219 >> 172.21.15.57:0/907260219 conn(0x7f45700b53a0 msgr2=0x7f45700b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:38.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 -- 172.21.15.57:0/907260219 shutdown_connections 2021-06-25T04:49:38.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.159+0000 7f4576514700 1 -- 172.21.15.57:0/907260219 wait complete. 2021-06-25T04:49:38.168 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2021-06-25T04:49:38.479 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:49:35.649253+0000', 'modified': '2021-06-25T04:49:36.652144+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5256}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5256': {'gid': 5256, 'name': 'c', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/792452299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 792452299}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 792452299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:49:38.479 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:49:38.480 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-06-25T04:49:38.597 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":5256,"want_state":"up:active","state":"up:active","rank_uptime":2.9328718760000001,"mdsmap_epoch":18,"osdmap_epoch":46,"osdmap_epoch_barrier":45,"uptime":7.3134294100000004} 2021-06-25T04:49:38.598 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 5256, "mdsmap_epoch": 18, "osdmap_epoch": 46, "osdmap_epoch_barrier": 45, "rank_uptime": 2.932871876, "state": "up:active", "uptime": 7.31342941, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:49:38.599 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:49:38.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6ed9b700 1 Processor -- start 2021-06-25T04:49:38.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6ed9b700 1 -- start start 2021-06-25T04:49:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6ed9b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a680b15c0 0x7f3a68141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6ed9b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a68141fb0 con 0x7f3a680ab810 2021-06-25T04:49:38.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6ed9b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a68144d10 con 0x7f3a6813e910 2021-06-25T04:49:38.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6ed9b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a681454f0 con 0x7f3a680b15c0 2021-06-25T04:49:38.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6cb37700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3a680ab810 0x7f3a6813e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54514/0 (socket says 172.21.15.57:54514) 2021-06-25T04:49:38.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6cb37700 1 -- 172.21.15.57:0/4225274267 learned_addr learned my addr 172.21.15.57:0/4225274267 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:38.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6d338700 1 --2- 172.21.15.57:0/4225274267 >> v2:172.21.15.87:3300/0 conn(0x7f3a680b15c0 0x7f3a68141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:38.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a677fe700 1 -- 172.21.15.57:0/4225274267 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072718613 0 0) 0x7f3a68141fb0 con 0x7f3a680ab810 2021-06-25T04:49:38.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a677fe700 1 -- 172.21.15.57:0/4225274267 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a4c003260 con 0x7f3a680ab810 2021-06-25T04:49:38.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a677fe700 1 -- 172.21.15.57:0/4225274267 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394061103 0 0) 0x7f3a68144d10 con 0x7f3a6813e910 2021-06-25T04:49:38.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a677fe700 1 -- 172.21.15.57:0/4225274267 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a68141fb0 con 0x7f3a6813e910 2021-06-25T04:49:38.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6d338700 1 -- 172.21.15.57:0/4225274267 >> v1:172.21.15.87:6789/0 conn(0x7f3a6813e910 legacy=0x7f3a681413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6d338700 1 -- 172.21.15.57:0/4225274267 >> v1:172.21.15.57:6789/0 conn(0x7f3a680ab810 legacy=0x7f3a6813e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a677fe700 1 -- 172.21.15.57:0/4225274267 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2398440472 0 0) 0x7f3a4c003260 con 0x7f3a680ab810 2021-06-25T04:49:38.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.691+0000 7f3a6d338700 1 -- 172.21.15.57:0/4225274267 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68144fb0 con 0x7f3a680b15c0 2021-06-25T04:49:38.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a6d338700 1 --2- 172.21.15.57:0/4225274267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a680b15c0 0x7f3a68141ac0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3a58001110 tx=0x7f3a600091d0).ready entity=mon.1 client_cookie=cd19325eae124daf server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:38.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a677fe700 1 -- 172.21.15.57:0/4225274267 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a58001660 con 0x7f3a680b15c0 2021-06-25T04:49:38.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a677fe700 1 -- 172.21.15.57:0/4225274267 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6000f510 con 0x7f3a680b15c0 2021-06-25T04:49:38.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a677fe700 1 -- 172.21.15.57:0/4225274267 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6000f680 con 0x7f3a680b15c0 2021-06-25T04:49:38.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/4225274267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a680b15c0 msgr2=0x7f3a68141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a6ed9b700 1 --2- 172.21.15.57:0/4225274267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a680b15c0 0x7f3a68141ac0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3a58001110 tx=0x7f3a600091d0).stop 2021-06-25T04:49:38.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/4225274267 shutdown_connections 2021-06-25T04:49:38.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a6ed9b700 1 --2- 172.21.15.57:0/4225274267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a680b15c0 0x7f3a68141ac0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/4225274267 >> 172.21.15.57:0/4225274267 conn(0x7f3a680b53a0 msgr2=0x7f3a680b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:38.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/4225274267 shutdown_connections 2021-06-25T04:49:38.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/4225274267 wait complete. 2021-06-25T04:49:38.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a6ed9b700 1 Processor -- start 2021-06-25T04:49:38.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.695+0000 7f3a6ed9b700 1 -- start start 2021-06-25T04:49:38.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6ed9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a680ab810 0x7f3a680628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:38.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6ed9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a680b15c0 0x7f3a6813ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:38.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6ed9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a6813e910 0x7f3a68150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:38.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6ed9b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68142d40 con 0x7f3a680ab810 2021-06-25T04:49:38.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6ed9b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68140aa0 con 0x7f3a680b15c0 2021-06-25T04:49:38.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6ed9b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6813f350 con 0x7f3a6813e910 2021-06-25T04:49:38.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6cb37700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a680ab810 0x7f3a680628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:38.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6cb37700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a680ab810 0x7f3a680628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37302/0 (socket says 172.21.15.57:37302) 2021-06-25T04:49:38.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6cb37700 1 -- 172.21.15.57:0/3461962439 learned_addr learned my addr 172.21.15.57:0/3461962439 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:38.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6d338700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a6813e910 0x7f3a68150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:38.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a67fff700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a680b15c0 0x7f3a6813ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:38.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6cb37700 1 -- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a6813e910 msgr2=0x7f3a68150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6cb37700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a6813e910 0x7f3a68150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6cb37700 1 -- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a680b15c0 msgr2=0x7f3a6813ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6cb37700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a680b15c0 0x7f3a6813ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6cb37700 1 -- 172.21.15.57:0/3461962439 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a60009470 con 0x7f3a680ab810 2021-06-25T04:49:38.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6cb37700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a680ab810 0x7f3a680628d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f3a58000fe0 tx=0x7f3a58001b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:38.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a65ffb700 1 -- 172.21.15.57:0/3461962439 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a58007170 con 0x7f3a680ab810 2021-06-25T04:49:38.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a65ffb700 1 -- 172.21.15.57:0/3461962439 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580072d0 con 0x7f3a680ab810 2021-06-25T04:49:38.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a65ffb700 1 -- 172.21.15.57:0/3461962439 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a58004920 con 0x7f3a680ab810 2021-06-25T04:49:38.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/3461962439 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a68151130 con 0x7f3a680ab810 2021-06-25T04:49:38.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/3461962439 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a68143280 con 0x7f3a680ab810 2021-06-25T04:49:38.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.699+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/3461962439 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a68057310 con 0x7f3a680ab810 2021-06-25T04:49:38.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.703+0000 7f3a65ffb700 1 -- 172.21.15.57:0/3461962439 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3a5801b070 con 0x7f3a680ab810 2021-06-25T04:49:38.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.703+0000 7f3a65ffb700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a40055420 0x7f3a400578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:38.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.703+0000 7f3a65ffb700 1 -- 172.21.15.57:0/3461962439 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3a5806d760 con 0x7f3a680ab810 2021-06-25T04:49:38.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.703+0000 7f3a67fff700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a40055420 0x7f3a400578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:38.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.703+0000 7f3a67fff700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a40055420 0x7f3a400578e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f3a5000d000 tx=0x7f3a50007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:38.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.707+0000 7f3a65ffb700 1 -- 172.21.15.57:0/3461962439 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3a58043910 con 0x7f3a680ab810 2021-06-25T04:49:38.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.835+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/3461962439 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a680698a0 con 0x7f3a680ab810 2021-06-25T04:49:38.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a65ffb700 1 -- 172.21.15.57:0/3461962439 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f3a58046f30 con 0x7f3a680ab810 2021-06-25T04:49:38.844 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:38.845 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":46,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:49:36.652945+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:49:34.024108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-06-25T04:49:34.636596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:49:38.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a40055420 msgr2=0x7f3a400578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a40055420 0x7f3a400578e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f3a5000d000 tx=0x7f3a50007a20).stop 2021-06-25T04:49:38.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/3461962439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a680ab810 msgr2=0x7f3a680628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a680ab810 0x7f3a680628d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f3a58000fe0 tx=0x7f3a58001b60).stop 2021-06-25T04:49:38.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/3461962439 shutdown_connections 2021-06-25T04:49:38.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3a40055420 0x7f3a400578e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a6813e910 0x7f3a68150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a680b15c0 0x7f3a6813ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 --2- 172.21.15.57:0/3461962439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a680ab810 0x7f3a680628d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/3461962439 >> 172.21.15.57:0/3461962439 conn(0x7f3a680b53a0 msgr2=0x7f3a680b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:38.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/3461962439 shutdown_connections 2021-06-25T04:49:38.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.839+0000 7f3a6ed9b700 1 -- 172.21.15.57:0/3461962439 wait complete. 2021-06-25T04:49:38.856 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:49:34.024108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:49:34.636596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:49:38.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:49:38.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.955+0000 7ff52ec5d700 1 Processor -- start 2021-06-25T04:49:38.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.955+0000 7ff52ec5d700 1 -- start start 2021-06-25T04:49:38.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52ec5d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5280a9590 0x7ff5280a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:38.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52ec5d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff528139b80 con 0x7ff5280b2bc0 2021-06-25T04:49:38.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52ec5d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5281404c0 con 0x7ff5280aca10 2021-06-25T04:49:38.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52ec5d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5280b00f0 con 0x7ff5280a9590 2021-06-25T04:49:38.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52c9f9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5280a9590 0x7ff5280a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:38.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52c9f9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5280a9590 0x7ff5280a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37310/0 (socket says 172.21.15.57:37310) 2021-06-25T04:49:38.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52c9f9700 1 -- 172.21.15.57:0/754469437 learned_addr learned my addr 172.21.15.57:0/754469437 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:38.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52d1fa700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff5280b2bc0 0x7ff5280b0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54530/0 (socket says 172.21.15.57:54530) 2021-06-25T04:49:38.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52c9f9700 1 -- 172.21.15.57:0/754469437 >> v1:172.21.15.87:6789/0 conn(0x7ff5280aca10 legacy=0x7ff5280a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52c9f9700 1 -- 172.21.15.57:0/754469437 >> v1:172.21.15.57:6789/0 conn(0x7ff5280b2bc0 legacy=0x7ff5280b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff5277fe700 1 -- 172.21.15.57:0/754469437 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907431633 0 0) 0x7ff528139b80 con 0x7ff5280b2bc0 2021-06-25T04:49:38.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52c9f9700 1 -- 172.21.15.57:0/754469437 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5280b0390 con 0x7ff5280a9590 2021-06-25T04:49:38.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52c9f9700 1 --2- 172.21.15.57:0/754469437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5280a9590 0x7ff5280a9970 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7ff510002f70 tx=0x7ff510006f40).ready entity=mon.0 client_cookie=8b19f57efe234df0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:38.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff5277fe700 1 -- 172.21.15.57:0/754469437 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51000dc70 con 0x7ff5280a9590 2021-06-25T04:49:38.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff5277fe700 1 -- 172.21.15.57:0/754469437 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff510000e90 con 0x7ff5280a9590 2021-06-25T04:49:38.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff5277fe700 1 -- 172.21.15.57:0/754469437 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51000be90 con 0x7ff5280a9590 2021-06-25T04:49:38.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52ec5d700 1 -- 172.21.15.57:0/754469437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5280a9590 msgr2=0x7ff5280a9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52ec5d700 1 --2- 172.21.15.57:0/754469437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5280a9590 0x7ff5280a9970 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7ff510002f70 tx=0x7ff510006f40).stop 2021-06-25T04:49:38.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52ec5d700 1 -- 172.21.15.57:0/754469437 shutdown_connections 2021-06-25T04:49:38.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52ec5d700 1 --2- 172.21.15.57:0/754469437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5280a9590 0x7ff5280a9970 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52ec5d700 1 -- 172.21.15.57:0/754469437 >> 172.21.15.57:0/754469437 conn(0x7ff52805f670 msgr2=0x7ff52805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:38.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52ec5d700 1 -- 172.21.15.57:0/754469437 shutdown_connections 2021-06-25T04:49:38.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.959+0000 7ff52ec5d700 1 -- 172.21.15.57:0/754469437 wait complete. 2021-06-25T04:49:38.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52ec5d700 1 Processor -- start 2021-06-25T04:49:38.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52ec5d700 1 -- start start 2021-06-25T04:49:38.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52ec5d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5280a9590 0x7ff5280aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:38.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52ec5d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5280aca10 0x7ff5281516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:38.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52ec5d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5280b2bc0 0x7ff5280b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:38.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52ec5d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5280ac320 con 0x7ff5280a9590 2021-06-25T04:49:38.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52ec5d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5280a9ce0 con 0x7ff5280aca10 2021-06-25T04:49:38.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52ec5d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5280aafa0 con 0x7ff5280b2bc0 2021-06-25T04:49:38.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52c9f9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5280a9590 0x7ff5280aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:38.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff527fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5280aca10 0x7ff5281516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:38.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52c9f9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5280a9590 0x7ff5280aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37316/0 (socket says 172.21.15.57:37316) 2021-06-25T04:49:38.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52c9f9700 1 -- 172.21.15.57:0/971126071 learned_addr learned my addr 172.21.15.57:0/971126071 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:38.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52d1fa700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5280b2bc0 0x7ff5280b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:38.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52c9f9700 1 -- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5280b2bc0 msgr2=0x7ff5280b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52c9f9700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5280b2bc0 0x7ff5280b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52c9f9700 1 -- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5280aca10 msgr2=0x7ff5281516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:38.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52c9f9700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5280aca10 0x7ff5281516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:38.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52c9f9700 1 -- 172.21.15.57:0/971126071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51000b460 con 0x7ff5280a9590 2021-06-25T04:49:38.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff527fff700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5280aca10 0x7ff5281516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:38.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52c9f9700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5280a9590 0x7ff5280aa370 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7ff510002f70 tx=0x7ff5280b18d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:38.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff525ffb700 1 -- 172.21.15.57:0/971126071 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff510010e50 con 0x7ff5280a9590 2021-06-25T04:49:38.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff525ffb700 1 -- 172.21.15.57:0/971126071 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51001e040 con 0x7ff5280a9590 2021-06-25T04:49:38.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff525ffb700 1 -- 172.21.15.57:0/971126071 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff510023630 con 0x7ff5280a9590 2021-06-25T04:49:38.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52ec5d700 1 -- 172.21.15.57:0/971126071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5280ac080 con 0x7ff5280a9590 2021-06-25T04:49:38.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.963+0000 7ff52ec5d700 1 -- 172.21.15.57:0/971126071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5280b4810 con 0x7ff5280a9590 2021-06-25T04:49:38.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.967+0000 7ff52ec5d700 1 -- 172.21.15.57:0/971126071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5280aa0d0 con 0x7ff5280a9590 2021-06-25T04:49:38.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.967+0000 7ff525ffb700 1 -- 172.21.15.57:0/971126071 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff510029020 con 0x7ff5280a9590 2021-06-25T04:49:38.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.967+0000 7ff525ffb700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0554e0 0x7ff50c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:38.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.967+0000 7ff525ffb700 1 -- 172.21.15.57:0/971126071 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff510071ad0 con 0x7ff5280a9590 2021-06-25T04:49:38.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.967+0000 7ff527fff700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0554e0 0x7ff50c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:38.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.967+0000 7ff527fff700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0554e0 0x7ff50c0579a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7ff51800d000 tx=0x7ff518009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:38.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:38.971+0000 7ff525ffb700 1 -- 172.21.15.57:0/971126071 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff5280aa0d0 con 0x7ff5280a9590 2021-06-25T04:49:39.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 -- 172.21.15.57:0/971126071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff5280aa0d0 con 0x7ff5280a9590 2021-06-25T04:49:39.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff525ffb700 1 -- 172.21.15.57:0/971126071 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v46) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff5280aa0d0 con 0x7ff5280a9590 2021-06-25T04:49:39.105 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:49:39.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 -- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0554e0 msgr2=0x7ff50c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0554e0 0x7ff50c0579a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7ff51800d000 tx=0x7ff518009040).stop 2021-06-25T04:49:39.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 -- 172.21.15.57:0/971126071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5280a9590 msgr2=0x7ff5280aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5280a9590 0x7ff5280aa370 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7ff510002f70 tx=0x7ff5280b18d0).stop 2021-06-25T04:49:39.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 -- 172.21.15.57:0/971126071 shutdown_connections 2021-06-25T04:49:39.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0554e0 0x7ff50c0579a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5280b2bc0 0x7ff5280b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5280aca10 0x7ff5281516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 --2- 172.21.15.57:0/971126071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5280a9590 0x7ff5280aa370 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 -- 172.21.15.57:0/971126071 >> 172.21.15.57:0/971126071 conn(0x7ff52805f670 msgr2=0x7ff52813db80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:39.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 -- 172.21.15.57:0/971126071 shutdown_connections 2021-06-25T04:49:39.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.099+0000 7ff52ec5d700 1 -- 172.21.15.57:0/971126071 wait complete. 2021-06-25T04:49:39.118 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:49:39.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4d8bc700 1 Processor -- start 2021-06-25T04:49:39.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4d8bc700 1 -- start start 2021-06-25T04:49:39.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4d8bc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fce480a9150 0x7fce48146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4d8bc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480b0b40 0x7fce48146a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4d8bc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fce480b0390 0x7fce48140180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4d8bc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce480b1100 con 0x7fce480a9150 2021-06-25T04:49:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4d8bc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce480a9530 con 0x7fce480b0390 2021-06-25T04:49:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4d8bc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce480b1330 con 0x7fce480b0b40 2021-06-25T04:49:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4c8ba700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fce480a9150 0x7fce48146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4c8ba700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fce480a9150 0x7fce48146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37324/0 (socket says 172.21.15.57:37324) 2021-06-25T04:49:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4c8ba700 1 -- 172.21.15.57:0/661382654 learned_addr learned my addr 172.21.15.57:0/661382654 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce47fff700 1 --2- 172.21.15.57:0/661382654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480b0b40 0x7fce48146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4d0bb700 1 --2- 172.21.15.57:0/661382654 >> v2:172.21.15.87:3300/0 conn(0x7fce480b0390 0x7fce48140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.223+0000 7fce4c8ba700 1 -- 172.21.15.57:0/661382654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480b0b40 msgr2=0x7fce48146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4c8ba700 1 --2- 172.21.15.57:0/661382654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480b0b40 0x7fce48146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4c8ba700 1 -- 172.21.15.57:0/661382654 >> v2:172.21.15.87:3300/0 conn(0x7fce480b0390 msgr2=0x7fce48140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4c8ba700 1 --2- 172.21.15.57:0/661382654 >> v2:172.21.15.87:3300/0 conn(0x7fce480b0390 0x7fce48140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4c8ba700 1 -- 172.21.15.57:0/661382654 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce480b15d0 con 0x7fce480a9150 2021-06-25T04:49:39.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4d0bb700 1 --2- 172.21.15.57:0/661382654 >> v2:172.21.15.87:3300/0 conn(0x7fce480b0390 0x7fce48140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:39.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce47fff700 1 --2- 172.21.15.57:0/661382654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480b0b40 0x7fce48146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:39.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4c8ba700 1 --2- 172.21.15.57:0/661382654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce480a9150 0x7fce48146510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fce3c002f70 tx=0x7fce3c006eb0).ready entity=mon.0 client_cookie=688106533b8a006e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:39.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce477fe700 1 -- 172.21.15.57:0/661382654 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce3c00d570 con 0x7fce480a9150 2021-06-25T04:49:39.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce477fe700 1 -- 172.21.15.57:0/661382654 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c000e90 con 0x7fce480a9150 2021-06-25T04:49:39.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce477fe700 1 -- 172.21.15.57:0/661382654 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce3c00d900 con 0x7fce480a9150 2021-06-25T04:49:39.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4d8bc700 1 -- 172.21.15.57:0/661382654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce480a9150 msgr2=0x7fce48146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4d8bc700 1 --2- 172.21.15.57:0/661382654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce480a9150 0x7fce48146510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fce3c002f70 tx=0x7fce3c006eb0).stop 2021-06-25T04:49:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4d8bc700 1 -- 172.21.15.57:0/661382654 shutdown_connections 2021-06-25T04:49:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4d8bc700 1 --2- 172.21.15.57:0/661382654 >> v2:172.21.15.87:3300/0 conn(0x7fce480b0390 0x7fce48140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4d8bc700 1 --2- 172.21.15.57:0/661382654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480b0b40 0x7fce48146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4d8bc700 1 --2- 172.21.15.57:0/661382654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce480a9150 0x7fce48146510 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4d8bc700 1 -- 172.21.15.57:0/661382654 >> 172.21.15.57:0/661382654 conn(0x7fce48061100 msgr2=0x7fce48062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4d8bc700 1 -- 172.21.15.57:0/661382654 shutdown_connections 2021-06-25T04:49:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.227+0000 7fce4d8bc700 1 -- 172.21.15.57:0/661382654 wait complete. 2021-06-25T04:49:39.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d8bc700 1 Processor -- start 2021-06-25T04:49:39.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d8bc700 1 -- start start 2021-06-25T04:49:39.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d8bc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480a9150 0x7fce481457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d8bc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce480b0390 0x7fce48152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d8bc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce480b0b40 0x7fce48152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d8bc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce48146090 con 0x7fce480b0390 2021-06-25T04:49:39.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d8bc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce48143050 con 0x7fce480b0b40 2021-06-25T04:49:39.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d8bc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce481432f0 con 0x7fce480a9150 2021-06-25T04:49:39.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce47fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce480b0390 0x7fce48152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce47fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce480b0390 0x7fce48152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37332/0 (socket says 172.21.15.57:37332) 2021-06-25T04:49:39.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce47fff700 1 -- 172.21.15.57:0/76872082 learned_addr learned my addr 172.21.15.57:0/76872082 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:39.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d0bb700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce480b0b40 0x7fce48152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4c8ba700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480a9150 0x7fce481457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce47fff700 1 -- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480a9150 msgr2=0x7fce481457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce47fff700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480a9150 0x7fce481457c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce47fff700 1 -- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce480b0b40 msgr2=0x7fce48152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce47fff700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce480b0b40 0x7fce48152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce47fff700 1 -- 172.21.15.57:0/76872082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c00b1e0 con 0x7fce480b0390 2021-06-25T04:49:39.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d0bb700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce480b0b40 0x7fce48152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:39.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4c8ba700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480a9150 0x7fce481457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:39.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce47fff700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce480b0390 0x7fce48152980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fce34006940 tx=0x7fce34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:39.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce45ffb700 1 -- 172.21.15.57:0/76872082 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce34011780 con 0x7fce480b0390 2021-06-25T04:49:39.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce45ffb700 1 -- 172.21.15.57:0/76872082 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce340118e0 con 0x7fce480b0390 2021-06-25T04:49:39.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d8bc700 1 -- 172.21.15.57:0/76872082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce48143590 con 0x7fce480b0390 2021-06-25T04:49:39.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce45ffb700 1 -- 172.21.15.57:0/76872082 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce34011c40 con 0x7fce480b0390 2021-06-25T04:49:39.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.231+0000 7fce4d8bc700 1 -- 172.21.15.57:0/76872082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce480a9800 con 0x7fce480b0390 2021-06-25T04:49:39.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.235+0000 7fce4d8bc700 1 -- 172.21.15.57:0/76872082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce48142e10 con 0x7fce480b0390 2021-06-25T04:49:39.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.235+0000 7fce45ffb700 1 -- 172.21.15.57:0/76872082 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fce3401c460 con 0x7fce480b0390 2021-06-25T04:49:39.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.235+0000 7fce45ffb700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fce30055340 0x7fce30057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.235+0000 7fce45ffb700 1 -- 172.21.15.57:0/76872082 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fce3406e330 con 0x7fce480b0390 2021-06-25T04:49:39.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.235+0000 7fce4c8ba700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fce30055340 0x7fce30057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.235+0000 7fce4c8ba700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fce30055340 0x7fce30057800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fce3c019000 tx=0x7fce3c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:39.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.239+0000 7fce45ffb700 1 -- 172.21.15.57:0/76872082 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fce48142e10 con 0x7fce480b0390 2021-06-25T04:49:39.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.363+0000 7fce4d8bc700 1 -- 172.21.15.57:0/76872082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fce48142e10 con 0x7fce480b0390 2021-06-25T04:49:39.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce45ffb700 1 -- 172.21.15.57:0/76872082 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7fce48142e10 con 0x7fce480b0390 2021-06-25T04:49:39.373 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:49:39.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 -- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fce30055340 msgr2=0x7fce30057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fce30055340 0x7fce30057800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fce3c019000 tx=0x7fce3c015000).stop 2021-06-25T04:49:39.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 -- 172.21.15.57:0/76872082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce480b0390 msgr2=0x7fce48152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce480b0390 0x7fce48152980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fce34006940 tx=0x7fce34008040).stop 2021-06-25T04:49:39.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 -- 172.21.15.57:0/76872082 shutdown_connections 2021-06-25T04:49:39.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fce30055340 0x7fce30057800 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce480b0b40 0x7fce48152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce480b0390 0x7fce48152980 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 --2- 172.21.15.57:0/76872082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce480a9150 0x7fce481457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 -- 172.21.15.57:0/76872082 >> 172.21.15.57:0/76872082 conn(0x7fce48061100 msgr2=0x7fce4813c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 -- 172.21.15.57:0/76872082 shutdown_connections 2021-06-25T04:49:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.367+0000 7fce4d8bc700 1 -- 172.21.15.57:0/76872082 wait complete. 2021-06-25T04:49:39.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:49:39.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad55a4f700 1 Processor -- start 2021-06-25T04:49:39.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad55a4f700 1 -- start start 2021-06-25T04:49:39.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad55a4f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500affd0 0x7fad500a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad55a4f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad500a7080 con 0x7fad500afb90 2021-06-25T04:49:39.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad55a4f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad500a72b0 con 0x7fad500b2540 2021-06-25T04:49:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad55a4f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad500a7550 con 0x7fad500affd0 2021-06-25T04:49:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad5524e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fad500afb90 0x7fad50151b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54558/0 (socket says 172.21.15.57:54558) 2021-06-25T04:49:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad5524e700 1 -- 172.21.15.57:0/2567882646 learned_addr learned my addr 172.21.15.57:0/2567882646 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:39.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad4ffff700 1 --2- 172.21.15.57:0/2567882646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500affd0 0x7fad500a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad4f7fe700 1 -- 172.21.15.57:0/2567882646 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141168249 0 0) 0x7fad500a7080 con 0x7fad500afb90 2021-06-25T04:49:39.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad4f7fe700 1 -- 172.21.15.57:0/2567882646 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad3c003260 con 0x7fad500afb90 2021-06-25T04:49:39.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad4f7fe700 1 -- 172.21.15.57:0/2567882646 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481486686 0 0) 0x7fad500a72b0 con 0x7fad500b2540 2021-06-25T04:49:39.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad4f7fe700 1 -- 172.21.15.57:0/2567882646 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad500a7080 con 0x7fad500b2540 2021-06-25T04:49:39.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad4f7fe700 1 -- 172.21.15.57:0/2567882646 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1174744834 0 0) 0x7fad3c003260 con 0x7fad500afb90 2021-06-25T04:49:39.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad4ffff700 1 -- 172.21.15.57:0/2567882646 >> v1:172.21.15.87:6789/0 conn(0x7fad500b2540 legacy=0x7fad5014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad4ffff700 1 -- 172.21.15.57:0/2567882646 >> v1:172.21.15.57:6789/0 conn(0x7fad500afb90 legacy=0x7fad50151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.487+0000 7fad4ffff700 1 -- 172.21.15.57:0/2567882646 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad500a77f0 con 0x7fad500affd0 2021-06-25T04:49:39.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad4ffff700 1 --2- 172.21.15.57:0/2567882646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500affd0 0x7fad500a8370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fad48001b80 tx=0x7fad40006df0).ready entity=mon.2 client_cookie=fd026e69e137fe4d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:39.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad4f7fe700 1 -- 172.21.15.57:0/2567882646 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad480019e0 con 0x7fad500affd0 2021-06-25T04:49:39.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad4f7fe700 1 -- 172.21.15.57:0/2567882646 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad40000e90 con 0x7fad500affd0 2021-06-25T04:49:39.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad4f7fe700 1 -- 172.21.15.57:0/2567882646 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad40012460 con 0x7fad500affd0 2021-06-25T04:49:39.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad55a4f700 1 -- 172.21.15.57:0/2567882646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500affd0 msgr2=0x7fad500a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad55a4f700 1 --2- 172.21.15.57:0/2567882646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500affd0 0x7fad500a8370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fad48001b80 tx=0x7fad40006df0).stop 2021-06-25T04:49:39.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad55a4f700 1 -- 172.21.15.57:0/2567882646 shutdown_connections 2021-06-25T04:49:39.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad55a4f700 1 --2- 172.21.15.57:0/2567882646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500affd0 0x7fad500a8370 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad55a4f700 1 -- 172.21.15.57:0/2567882646 >> 172.21.15.57:0/2567882646 conn(0x7fad50060140 msgr2=0x7fad500b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:39.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad55a4f700 1 -- 172.21.15.57:0/2567882646 shutdown_connections 2021-06-25T04:49:39.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad55a4f700 1 -- 172.21.15.57:0/2567882646 wait complete. 2021-06-25T04:49:39.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad55a4f700 1 Processor -- start 2021-06-25T04:49:39.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.491+0000 7fad55a4f700 1 -- start start 2021-06-25T04:49:39.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad55a4f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad500afb90 0x7fad500b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad55a4f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad500affd0 0x7fad50143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad55a4f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500b2540 0x7fad500b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad55a4f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad501561f0 con 0x7fad500afb90 2021-06-25T04:49:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad55a4f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad501570d0 con 0x7fad500affd0 2021-06-25T04:49:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad55a4f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad50156450 con 0x7fad500b2540 2021-06-25T04:49:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad54a4d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad500afb90 0x7fad500b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad5524e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500b2540 0x7fad500b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad4ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad500affd0 0x7fad50143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad5524e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500b2540 0x7fad500b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:48510/0 (socket says 172.21.15.57:48510) 2021-06-25T04:49:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad5524e700 1 -- 172.21.15.57:0/3341983895 learned_addr learned my addr 172.21.15.57:0/3341983895 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad5524e700 1 -- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad500affd0 msgr2=0x7fad50143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad5524e700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad500affd0 0x7fad50143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad5524e700 1 -- 172.21.15.57:0/3341983895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad500afb90 msgr2=0x7fad500b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad5524e700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad500afb90 0x7fad500b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad5524e700 1 -- 172.21.15.57:0/3341983895 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4000b180 con 0x7fad500b2540 2021-06-25T04:49:39.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad5524e700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500b2540 0x7fad500b4960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fad48001360 tx=0x7fad48001ca0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:39.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad4dffb700 1 -- 172.21.15.57:0/3341983895 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad48004ab0 con 0x7fad500b2540 2021-06-25T04:49:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad4dffb700 1 -- 172.21.15.57:0/3341983895 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad48004c10 con 0x7fad500b2540 2021-06-25T04:49:39.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad55a4f700 1 -- 172.21.15.57:0/3341983895 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad501566f0 con 0x7fad500b2540 2021-06-25T04:49:39.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad4dffb700 1 -- 172.21.15.57:0/3341983895 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad48007170 con 0x7fad500b2540 2021-06-25T04:49:39.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad55a4f700 1 -- 172.21.15.57:0/3341983895 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad50156c30 con 0x7fad500b2540 2021-06-25T04:49:39.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad4dffb700 1 -- 172.21.15.57:0/3341983895 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fad480072d0 con 0x7fad500b2540 2021-06-25T04:49:39.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.495+0000 7fad55a4f700 1 -- 172.21.15.57:0/3341983895 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad50057310 con 0x7fad500b2540 2021-06-25T04:49:39.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.499+0000 7fad4dffb700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad300553f0 0x7fad300578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.499+0000 7fad4dffb700 1 -- 172.21.15.57:0/3341983895 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fad4806dcd0 con 0x7fad500b2540 2021-06-25T04:49:39.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.499+0000 7fad54a4d700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad300553f0 0x7fad300578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.499+0000 7fad54a4d700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad300553f0 0x7fad300578b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fad4400d000 tx=0x7fad44007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:39.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.507+0000 7fad4dffb700 1 -- 172.21.15.57:0/3341983895 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fad48043cf0 con 0x7fad500b2540 2021-06-25T04:49:39.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.631+0000 7fad55a4f700 1 -- 172.21.15.57:0/3341983895 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad500698a0 con 0x7fad500b2540 2021-06-25T04:49:39.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.631+0000 7fad4dffb700 1 -- 172.21.15.57:0/3341983895 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+10 (secure 0 0 0) 0x7fad48047310 con 0x7fad500b2540 2021-06-25T04:49:39.638 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:49:39.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 -- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad300553f0 msgr2=0x7fad300578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad300553f0 0x7fad300578b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fad4400d000 tx=0x7fad44007a20).stop 2021-06-25T04:49:39.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 -- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500b2540 msgr2=0x7fad500b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500b2540 0x7fad500b4960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fad48001360 tx=0x7fad48001ca0).stop 2021-06-25T04:49:39.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 -- 172.21.15.57:0/3341983895 shutdown_connections 2021-06-25T04:49:39.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad300553f0 0x7fad300578b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad500b2540 0x7fad500b4960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad500affd0 0x7fad50143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 --2- 172.21.15.57:0/3341983895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad500afb90 0x7fad500b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 -- 172.21.15.57:0/3341983895 >> 172.21.15.57:0/3341983895 conn(0x7fad50060140 msgr2=0x7fad50146300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:39.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 -- 172.21.15.57:0/3341983895 shutdown_connections 2021-06-25T04:49:39.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.635+0000 7fad55a4f700 1 -- 172.21.15.57:0/3341983895 wait complete. 2021-06-25T04:49:39.652 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:49:39.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.755+0000 7f605aa96700 1 Processor -- start 2021-06-25T04:49:39.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.755+0000 7f605aa96700 1 -- start start 2021-06-25T04:49:39.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60540612e0 0x7f60540616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60540ad580 0x7f60540b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60540aecb0 con 0x7f6054140400 2021-06-25T04:49:39.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60540b6ee0 con 0x7f60540ad580 2021-06-25T04:49:39.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60540aeee0 con 0x7f60540612e0 2021-06-25T04:49:39.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605a295700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6054140400 0x7f60541464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54570/0 (socket says 172.21.15.57:54570) 2021-06-25T04:49:39.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605a295700 1 -- 172.21.15.57:0/877774480 learned_addr learned my addr 172.21.15.57:0/877774480 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:39.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6059a94700 1 --2- 172.21.15.57:0/877774480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60540612e0 0x7f60540616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6059293700 1 --2- 172.21.15.57:0/877774480 >> v2:172.21.15.87:3300/0 conn(0x7f60540ad580 0x7f60540b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6058a92700 1 -- 172.21.15.57:0/877774480 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967392812 0 0) 0x7f60540aecb0 con 0x7f6054140400 2021-06-25T04:49:39.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6058a92700 1 -- 172.21.15.57:0/877774480 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f603c003260 con 0x7f6054140400 2021-06-25T04:49:39.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6059a94700 1 -- 172.21.15.57:0/877774480 >> v2:172.21.15.87:3300/0 conn(0x7f60540ad580 msgr2=0x7f60540b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:39.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6059a94700 1 --2- 172.21.15.57:0/877774480 >> v2:172.21.15.87:3300/0 conn(0x7f60540ad580 0x7f60540b9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6059a94700 1 -- 172.21.15.57:0/877774480 >> v1:172.21.15.57:6789/0 conn(0x7f6054140400 legacy=0x7f60541464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6058a92700 1 -- 172.21.15.57:0/877774480 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2772653250 0 0) 0x7f603c003260 con 0x7f6054140400 2021-06-25T04:49:39.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6059a94700 1 -- 172.21.15.57:0/877774480 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60540af180 con 0x7f60540612e0 2021-06-25T04:49:39.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6059a94700 1 --2- 172.21.15.57:0/877774480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60540612e0 0x7f60540616c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f604c001b80 tx=0x7f6044006df0).ready entity=mon.2 client_cookie=649e3f97904a97bf server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:39.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6058a92700 1 -- 172.21.15.57:0/877774480 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f604c0019e0 con 0x7f60540612e0 2021-06-25T04:49:39.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6058a92700 1 -- 172.21.15.57:0/877774480 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6044000e90 con 0x7f60540612e0 2021-06-25T04:49:39.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f6058a92700 1 -- 172.21.15.57:0/877774480 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6044012460 con 0x7f60540612e0 2021-06-25T04:49:39.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 -- 172.21.15.57:0/877774480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60540612e0 msgr2=0x7f60540616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 --2- 172.21.15.57:0/877774480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60540612e0 0x7f60540616c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f604c001b80 tx=0x7f6044006df0).stop 2021-06-25T04:49:39.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 -- 172.21.15.57:0/877774480 shutdown_connections 2021-06-25T04:49:39.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 --2- 172.21.15.57:0/877774480 >> v2:172.21.15.87:3300/0 conn(0x7f60540ad580 0x7f60540b9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 --2- 172.21.15.57:0/877774480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60540612e0 0x7f60540616c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 -- 172.21.15.57:0/877774480 >> 172.21.15.57:0/877774480 conn(0x7f6054066da0 msgr2=0x7f6054067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:39.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 -- 172.21.15.57:0/877774480 shutdown_connections 2021-06-25T04:49:39.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.759+0000 7f605aa96700 1 -- 172.21.15.57:0/877774480 wait complete. 2021-06-25T04:49:39.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f605aa96700 1 Processor -- start 2021-06-25T04:49:39.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f605aa96700 1 -- start start 2021-06-25T04:49:39.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f605aa96700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60540612e0 0x7f60540b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f605aa96700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60540ad580 0x7f60541453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f605aa96700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6054140400 0x7f60541458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f605aa96700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60540aad60 con 0x7f60540ad580 2021-06-25T04:49:39.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f605aa96700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6054151fd0 con 0x7f60540612e0 2021-06-25T04:49:39.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f605aa96700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6054152270 con 0x7f6054140400 2021-06-25T04:49:39.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6059293700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60540ad580 0x7f60541453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6059293700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60540ad580 0x7f60541453e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37360/0 (socket says 172.21.15.57:37360) 2021-06-25T04:49:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6059a94700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60540612e0 0x7f60540b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6059293700 1 -- 172.21.15.57:0/2569471155 learned_addr learned my addr 172.21.15.57:0/2569471155 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f605a295700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6054140400 0x7f60541458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6059a94700 1 -- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6054140400 msgr2=0x7f60541458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6059a94700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6054140400 0x7f60541458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6059a94700 1 -- 172.21.15.57:0/2569471155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60540ad580 msgr2=0x7f60541453e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6059a94700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60540ad580 0x7f60541453e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6059a94700 1 -- 172.21.15.57:0/2569471155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604400b180 con 0x7f60540612e0 2021-06-25T04:49:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6059a94700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60540612e0 0x7f60540b0d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f604c001b80 tx=0x7f6044014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6042ffd700 1 -- 172.21.15.57:0/2569471155 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f604400d8a0 con 0x7f60540612e0 2021-06-25T04:49:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6042ffd700 1 -- 172.21.15.57:0/2569471155 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604400da00 con 0x7f60540612e0 2021-06-25T04:49:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f605aa96700 1 -- 172.21.15.57:0/2569471155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6054147270 con 0x7f60540612e0 2021-06-25T04:49:39.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f6042ffd700 1 -- 172.21.15.57:0/2569471155 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f604400dd60 con 0x7f60540612e0 2021-06-25T04:49:39.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.763+0000 7f605aa96700 1 -- 172.21.15.57:0/2569471155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60540aa840 con 0x7f60540612e0 2021-06-25T04:49:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.767+0000 7f605aa96700 1 -- 172.21.15.57:0/2569471155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6054057310 con 0x7f60540612e0 2021-06-25T04:49:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.767+0000 7f6042ffd700 1 -- 172.21.15.57:0/2569471155 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6044025020 con 0x7f60540612e0 2021-06-25T04:49:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.767+0000 7f6042ffd700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6034055450 0x7f6034057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.767+0000 7f6042ffd700 1 -- 172.21.15.57:0/2569471155 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f604406ec70 con 0x7f60540612e0 2021-06-25T04:49:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.767+0000 7f6059293700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6034055450 0x7f6034057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.767+0000 7f6059293700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6034055450 0x7f6034057910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f605000b000 tx=0x7f6050006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.775+0000 7f6042ffd700 1 -- 172.21.15.57:0/2569471155 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6044044d10 con 0x7f60540612e0 2021-06-25T04:49:39.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.907+0000 7f605aa96700 1 -- 172.21.15.57:0/2569471155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60540620c0 con 0x7f60540612e0 2021-06-25T04:49:39.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.907+0000 7f6042ffd700 1 -- 172.21.15.57:0/2569471155 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6044048330 con 0x7f60540612e0 2021-06-25T04:49:39.914 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:49:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 -- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6034055450 msgr2=0x7f6034057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6034055450 0x7f6034057910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f605000b000 tx=0x7f6050006df0).stop 2021-06-25T04:49:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 -- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60540612e0 msgr2=0x7f60540b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60540612e0 0x7f60540b0d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f604c001b80 tx=0x7f6044014000).stop 2021-06-25T04:49:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 -- 172.21.15.57:0/2569471155 shutdown_connections 2021-06-25T04:49:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6034055450 0x7f6034057910 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6054140400 0x7f60541458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60540ad580 0x7f60541453e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 --2- 172.21.15.57:0/2569471155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60540612e0 0x7f60540b0d80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 -- 172.21.15.57:0/2569471155 >> 172.21.15.57:0/2569471155 conn(0x7f6054066da0 msgr2=0x7f6054141ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 -- 172.21.15.57:0/2569471155 shutdown_connections 2021-06-25T04:49:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:39.911+0000 7f605aa96700 1 -- 172.21.15.57:0/2569471155 wait complete. 2021-06-25T04:49:39.932 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:49:39.933 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:49:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffad08c1700 1 Processor -- start 2021-06-25T04:49:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffad08c1700 1 -- start start 2021-06-25T04:49:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffad08c1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffacc061640 0x7ffacc0b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffad08c1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffacc143960 0x7ffacc140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:40.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffad08c1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc0b68d0 con 0x7ffacc0b46d0 2021-06-25T04:49:40.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffad08c1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0b9640 con 0x7ffacc143960 2021-06-25T04:49:40.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffad08c1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0b6b70 con 0x7ffacc061640 2021-06-25T04:49:40.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffacbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffacc143960 0x7ffacc140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:40.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffacaffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffacc0b46d0 0x7ffacc13fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54586/0 (socket says 172.21.15.57:54586) 2021-06-25T04:49:40.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffacbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffacc143960 0x7ffacc140470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37370/0 (socket says 172.21.15.57:37370) 2021-06-25T04:49:40.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffacaffd700 1 -- 172.21.15.57:0/3685839422 learned_addr learned my addr 172.21.15.57:0/3685839422 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:40.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.031+0000 7ffacb7fe700 1 --2- 172.21.15.57:0/3685839422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffacc061640 0x7ffacc0b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:40.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffacbfff700 1 -- 172.21.15.57:0/3685839422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffacc061640 msgr2=0x7ffacc0b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:40.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffacbfff700 1 --2- 172.21.15.57:0/3685839422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffacc061640 0x7ffacc0b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:40.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffacbfff700 1 -- 172.21.15.57:0/3685839422 >> v1:172.21.15.57:6789/0 conn(0x7ffacc0b46d0 legacy=0x7ffacc13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:40.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffacbfff700 1 -- 172.21.15.57:0/3685839422 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0b6e10 con 0x7ffacc143960 2021-06-25T04:49:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffacbfff700 1 --2- 172.21.15.57:0/3685839422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffacc143960 0x7ffacc140470 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7ffabc002f70 tx=0x7ffabc006df0).ready entity=mon.0 client_cookie=ba6c191a341a9d93 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffaca7fc700 1 -- 172.21.15.57:0/3685839422 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffabc00d570 con 0x7ffacc143960 2021-06-25T04:49:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffaca7fc700 1 -- 172.21.15.57:0/3685839422 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc000e90 con 0x7ffacc143960 2021-06-25T04:49:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffaca7fc700 1 -- 172.21.15.57:0/3685839422 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffabc00d8c0 con 0x7ffacc143960 2021-06-25T04:49:40.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffad08c1700 1 -- 172.21.15.57:0/3685839422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffacc143960 msgr2=0x7ffacc140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:40.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffad08c1700 1 --2- 172.21.15.57:0/3685839422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffacc143960 0x7ffacc140470 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7ffabc002f70 tx=0x7ffabc006df0).stop 2021-06-25T04:49:40.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffad08c1700 1 -- 172.21.15.57:0/3685839422 shutdown_connections 2021-06-25T04:49:40.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffad08c1700 1 --2- 172.21.15.57:0/3685839422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffacc143960 0x7ffacc140470 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:40.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffad08c1700 1 --2- 172.21.15.57:0/3685839422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffacc061640 0x7ffacc0b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:40.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffad08c1700 1 -- 172.21.15.57:0/3685839422 >> 172.21.15.57:0/3685839422 conn(0x7ffacc06adb0 msgr2=0x7ffacc05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:40.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffad08c1700 1 -- 172.21.15.57:0/3685839422 shutdown_connections 2021-06-25T04:49:40.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffad08c1700 1 -- 172.21.15.57:0/3685839422 wait complete. 2021-06-25T04:49:40.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffad08c1700 1 Processor -- start 2021-06-25T04:49:40.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.035+0000 7ffad08c1700 1 -- start start 2021-06-25T04:49:40.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffad08c1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffacc061640 0x7ffacc13fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:40.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffad08c1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffacc143960 0x7ffacc0b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:40.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffad08c1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffacc138ff0 0x7ffacc1394a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:40.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffad08c1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0b9400 con 0x7ffacc138ff0 2021-06-25T04:49:40.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffad08c1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc139990 con 0x7ffacc061640 2021-06-25T04:49:40.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffad08c1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0ad700 con 0x7ffacc143960 2021-06-25T04:49:40.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffacc138ff0 0x7ffacc1394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:40.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffacc138ff0 0x7ffacc1394a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37374/0 (socket says 172.21.15.57:37374) 2021-06-25T04:49:40.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacbfff700 1 -- 172.21.15.57:0/1091468011 learned_addr learned my addr 172.21.15.57:0/1091468011 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:40.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacaffd700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffacc143960 0x7ffacc0b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:40.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacb7fe700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffacc061640 0x7ffacc13fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:40.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacbfff700 1 -- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffacc143960 msgr2=0x7ffacc0b8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:40.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacbfff700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffacc143960 0x7ffacc0b8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:40.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacbfff700 1 -- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffacc061640 msgr2=0x7ffacc13fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:40.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacbfff700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffacc061640 0x7ffacc13fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:40.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacbfff700 1 -- 172.21.15.57:0/1091468011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc00b180 con 0x7ffacc138ff0 2021-06-25T04:49:40.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacb7fe700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffacc061640 0x7ffacc13fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffacbfff700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffacc138ff0 0x7ffacc1394a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7ffabc002f70 tx=0x7ffabc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffac8ff9700 1 -- 172.21.15.57:0/1091468011 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffabc006b20 con 0x7ffacc138ff0 2021-06-25T04:49:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffad08c1700 1 -- 172.21.15.57:0/1091468011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc0ad9a0 con 0x7ffacc138ff0 2021-06-25T04:49:40.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffac8ff9700 1 -- 172.21.15.57:0/1091468011 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc012e80 con 0x7ffacc138ff0 2021-06-25T04:49:40.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffac8ff9700 1 -- 172.21.15.57:0/1091468011 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffabc01f630 con 0x7ffacc138ff0 2021-06-25T04:49:40.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffad08c1700 1 -- 172.21.15.57:0/1091468011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc0ae0e0 con 0x7ffacc138ff0 2021-06-25T04:49:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.039+0000 7ffac8ff9700 1 -- 172.21.15.57:0/1091468011 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ffabc025020 con 0x7ffacc138ff0 2021-06-25T04:49:40.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.043+0000 7ffad08c1700 1 -- 172.21.15.57:0/1091468011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc057310 con 0x7ffacc138ff0 2021-06-25T04:49:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.043+0000 7ffac8ff9700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffab0055510 0x7ffab00579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.043+0000 7ffac8ff9700 1 -- 172.21.15.57:0/1091468011 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ffabc06ef20 con 0x7ffacc138ff0 2021-06-25T04:49:40.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.043+0000 7ffacb7fe700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffab0055510 0x7ffab00579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:40.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.043+0000 7ffacb7fe700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffab0055510 0x7ffab00579d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7ffac400b000 tx=0x7ffac4008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:40.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.047+0000 7ffac8ff9700 1 -- 172.21.15.57:0/1091468011 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ffabc045030 con 0x7ffacc138ff0 2021-06-25T04:49:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.211+0000 7ffad08c1700 1 -- 172.21.15.57:0/1091468011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffacc05d990 con 0x7ffacc138ff0 2021-06-25T04:49:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffac8ff9700 1 -- 172.21.15.57:0/1091468011 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7ffabc048650 con 0x7ffacc138ff0 2021-06-25T04:49:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:40.221 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/587697587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":587697587},{"type":"v1","addr":"172.21.15.87:6835","nonce":587697587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/3950506435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3950506435},{"type":"v1","addr":"172.21.15.57:6833","nonce":3950506435}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:49:35.649253+0000","modified":"2021-06-25T04:49:36.652144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/792452299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":792452299},{"type":"v1","addr":"172.21.15.57:6835","nonce":792452299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-06-25T04:49:40.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 -- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffab0055510 msgr2=0x7ffab00579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:40.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffab0055510 0x7ffab00579d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7ffac400b000 tx=0x7ffac4008040).stop 2021-06-25T04:49:40.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 -- 172.21.15.57:0/1091468011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffacc138ff0 msgr2=0x7ffacc1394a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:40.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffacc138ff0 0x7ffacc1394a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7ffabc002f70 tx=0x7ffabc014000).stop 2021-06-25T04:49:40.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 -- 172.21.15.57:0/1091468011 shutdown_connections 2021-06-25T04:49:40.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffab0055510 0x7ffab00579d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:40.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffacc138ff0 0x7ffacc1394a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:40.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffacc143960 0x7ffacc0b8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:40.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 --2- 172.21.15.57:0/1091468011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffacc061640 0x7ffacc13fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:40.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 -- 172.21.15.57:0/1091468011 >> 172.21.15.57:0/1091468011 conn(0x7ffacc06adb0 msgr2=0x7ffacc13e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:40.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 -- 172.21.15.57:0/1091468011 shutdown_connections 2021-06-25T04:49:40.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:40.215+0000 7ffad08c1700 1 -- 172.21.15.57:0/1091468011 wait complete. 2021-06-25T04:49:40.226 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2021-06-25T04:49:40.536 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:49:35.649253+0000', 'modified': '2021-06-25T04:49:36.652144+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5256}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5256': {'gid': 5256, 'name': 'c', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/792452299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 792452299}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 792452299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:49:40.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:49:40.537 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-06-25T04:49:40.653 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":5256,"want_state":"up:active","state":"up:active","rank_uptime":4.9893227580000001,"mdsmap_epoch":18,"osdmap_epoch":46,"osdmap_epoch_barrier":45,"uptime":9.3698716100000006} 2021-06-25T04:49:40.653 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 5256, "mdsmap_epoch": 18, "osdmap_epoch": 46, "osdmap_epoch_barrier": 45, "rank_uptime": 4.989322758, "state": "up:active", "uptime": 9.36987161, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:49:40.654 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:49:40.654 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:49:40.655 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:49:40.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:40.656 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:49:40.664 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:49:40.681 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:49:40.681 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:49:40.696 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:49:40.697 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:49:40.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:40.699 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:49:40.704 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:49:40.704 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:49:40.750 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:49:40.769 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:49:40.770 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:49:40.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:49:40.826+0000 7f2b037ca080 -1 init, newargv = 0x559a9b5f7ab0 newargc=9ceph-fuse[ 2021-06-25T04:49:40.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:14548]: starting ceph client 2021-06-25T04:49:40.827 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:49:40.828 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:49:40.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:40.831 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:49:40.835 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14548]: starting fuse 2021-06-25T04:49:40.841 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:49:40.842 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:49:40.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:40.844 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:49:40.845 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:49:40.846 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:49:40.847 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:49:40.847 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:49:40.848 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:49:40.848 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:49:40.848 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:49:40.849 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:49:40.849 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:49:40.850 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:49:40.850 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:49:40.851 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:49:40.851 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:49:40.851 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:49:40.852 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:49:40.852 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:49:40.853 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:49:40.853 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:49:40.853 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:49:40.854 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:49:40.854 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:49:40.855 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:49:40.929 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.14548.asok 2021-06-25T04:49:40.933 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14548.asok 2021-06-25T04:49:40.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:40.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14548.asok status 2021-06-25T04:49:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:49:41.030 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:49:41.030 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:49:41.031 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:49:41.031 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:49:41.032 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:49:41.032 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:49:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "14548", 2021-06-25T04:49:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:49:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:49:41.033 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:49:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:49:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 5051, 2021-06-25T04:49:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:49:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:49:41.034 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:49:41.035 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 5051 2021-06-25T04:49:41.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:49:41.035 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:49:41.035 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:49:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:49:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3442093898 2021-06-25T04:49:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:49:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:49:41.036 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:49:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:49:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:49:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3442093898 2021-06-25T04:49:41.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:49:41.038 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.5051 172.21.15.102:0/3442093898", 2021-06-25T04:49:41.038 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/3442093898", 2021-06-25T04:49:41.038 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:49:41.043 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 18, 2021-06-25T04:49:41.043 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 46, 2021-06-25T04:49:41.043 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:49:41.044 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:49:41.044 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:49:41.044 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:49:41.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:41.046 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:49:41.046 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:49:41.054 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:49:41.055 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:49:41.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:41.056 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:49:41.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:49:41.119 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:49:41.120 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:49:41.129 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:49:41.130 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:49:41.131 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-06-25T04:49:41.131 DEBUG:teuthology.orchestra.run.smithi102:> import sys 2021-06-25T04:49:41.131 DEBUG:teuthology.orchestra.run.smithi102:> import time 2021-06-25T04:49:41.132 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:49:41.132 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:49:41.133 DEBUG:teuthology.orchestra.run.smithi102:> n = 1000 2021-06-25T04:49:41.133 DEBUG:teuthology.orchestra.run.smithi102:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-06-25T04:49:41.133 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:49:41.134 DEBUG:teuthology.orchestra.run.smithi102:> if not os.path.exists(os.path.dirname(abs_path)): 2021-06-25T04:49:41.134 DEBUG:teuthology.orchestra.run.smithi102:> os.makedirs(os.path.dirname(abs_path)) 2021-06-25T04:49:41.134 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:49:41.135 DEBUG:teuthology.orchestra.run.smithi102:> for i in range(0, n): 2021-06-25T04:49:41.135 DEBUG:teuthology.orchestra.run.smithi102:> fname = "{0}_{1}".format(abs_path, i) 2021-06-25T04:49:41.136 DEBUG:teuthology.orchestra.run.smithi102:> with open(fname, '"'"'w'"'"') as f: 2021-06-25T04:49:41.136 DEBUG:teuthology.orchestra.run.smithi102:> f.write('"'"'content'"'"') 2021-06-25T04:49:41.136 DEBUG:teuthology.orchestra.run.smithi102:> if True: 2021-06-25T04:49:41.137 DEBUG:teuthology.orchestra.run.smithi102:> f.flush() 2021-06-25T04:49:41.137 DEBUG:teuthology.orchestra.run.smithi102:> os.fsync(f.fileno()) 2021-06-25T04:49:41.138 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:49:52.251 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:49:52.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a4759e700 1 Processor -- start 2021-06-25T04:49:52.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a4759e700 1 -- start start 2021-06-25T04:49:52.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a4759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a480b05d0 0x7f1a480af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a4759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a48147560 0x7f1a480acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a4759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a480b5840 con 0x7f1a480b5460 2021-06-25T04:49:52.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a4759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a481452a0 con 0x7f1a48147560 2021-06-25T04:49:52.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a4759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480adfb0 con 0x7f1a480b05d0 2021-06-25T04:49:52.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a46d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a48147560 0x7f1a480acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a46d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a48147560 0x7f1a480acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37386/0 (socket says 172.21.15.57:37386) 2021-06-25T04:49:52.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a46d9d700 1 -- 172.21.15.57:0/956563154 learned_addr learned my addr 172.21.15.57:0/956563154 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:52.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a4659c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1a480b5460 0x7f1a48067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54602/0 (socket says 172.21.15.57:54602) 2021-06-25T04:49:52.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a45d9b700 1 --2- 172.21.15.57:0/956563154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a480b05d0 0x7f1a480af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a46d9d700 1 -- 172.21.15.57:0/956563154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a480b05d0 msgr2=0x7f1a480af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:52.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a46d9d700 1 --2- 172.21.15.57:0/956563154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a480b05d0 0x7f1a480af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a46d9d700 1 -- 172.21.15.57:0/956563154 >> v1:172.21.15.57:6789/0 conn(0x7f1a480b5460 legacy=0x7f1a48067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.351+0000 7f1a4559a700 1 -- 172.21.15.57:0/956563154 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116993454 0 0) 0x7f1a480b5840 con 0x7f1a480b5460 2021-06-25T04:49:52.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a46d9d700 1 -- 172.21.15.57:0/956563154 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a480ac7c0 con 0x7f1a48147560 2021-06-25T04:49:52.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a46d9d700 1 --2- 172.21.15.57:0/956563154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a48147560 0x7f1a480acc20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f1a400032f0 tx=0x7f1a40009290).ready entity=mon.0 client_cookie=c3d54be3c180b3a0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:52.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a4559a700 1 -- 172.21.15.57:0/956563154 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a4000b8a0 con 0x7f1a48147560 2021-06-25T04:49:52.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a4559a700 1 -- 172.21.15.57:0/956563154 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4000ba00 con 0x7f1a48147560 2021-06-25T04:49:52.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a4559a700 1 -- 172.21.15.57:0/956563154 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a4000bb70 con 0x7f1a48147560 2021-06-25T04:49:52.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a4759e700 1 -- 172.21.15.57:0/956563154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a48147560 msgr2=0x7f1a480acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a4759e700 1 --2- 172.21.15.57:0/956563154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a48147560 0x7f1a480acc20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f1a400032f0 tx=0x7f1a40009290).stop 2021-06-25T04:49:52.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a4759e700 1 -- 172.21.15.57:0/956563154 shutdown_connections 2021-06-25T04:49:52.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a4759e700 1 --2- 172.21.15.57:0/956563154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a480b05d0 0x7f1a480af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a4759e700 1 --2- 172.21.15.57:0/956563154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a48147560 0x7f1a480acc20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a4759e700 1 -- 172.21.15.57:0/956563154 >> 172.21.15.57:0/956563154 conn(0x7f1a48062520 msgr2=0x7f1a48062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a4759e700 1 -- 172.21.15.57:0/956563154 shutdown_connections 2021-06-25T04:49:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.355+0000 7f1a4759e700 1 -- 172.21.15.57:0/956563154 wait complete. 2021-06-25T04:49:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4759e700 1 Processor -- start 2021-06-25T04:49:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4759e700 1 -- start start 2021-06-25T04:49:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a480b05d0 0x7f1a48143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a480b5460 0x7f1a4815a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a48147560 0x7f1a48066860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a48141490 con 0x7f1a480b5460 2021-06-25T04:49:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a481567c0 con 0x7f1a480b05d0 2021-06-25T04:49:52.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4814c300 con 0x7f1a48147560 2021-06-25T04:49:52.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a45d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a480b5460 0x7f1a4815a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a45d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a480b5460 0x7f1a4815a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37390/0 (socket says 172.21.15.57:37390) 2021-06-25T04:49:52.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a45d9b700 1 -- 172.21.15.57:0/1383914183 learned_addr learned my addr 172.21.15.57:0/1383914183 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:52.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4659c700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a480b05d0 0x7f1a48143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a46d9d700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a48147560 0x7f1a48066860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a45d9b700 1 -- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a48147560 msgr2=0x7f1a48066860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a45d9b700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a48147560 0x7f1a48066860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a45d9b700 1 -- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a480b05d0 msgr2=0x7f1a48143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a45d9b700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a480b05d0 0x7f1a48143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a45d9b700 1 -- 172.21.15.57:0/1383914183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a40009530 con 0x7f1a480b5460 2021-06-25T04:49:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a46d9d700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a48147560 0x7f1a48066860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4659c700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a480b05d0 0x7f1a48143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a45d9b700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a480b5460 0x7f1a4815a760 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f1a3800c000 tx=0x7f1a38006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a377fe700 1 -- 172.21.15.57:0/1383914183 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a3800c830 con 0x7f1a480b5460 2021-06-25T04:49:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a377fe700 1 -- 172.21.15.57:0/1383914183 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800c990 con 0x7f1a480b5460 2021-06-25T04:49:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4759e700 1 -- 172.21.15.57:0/1383914183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a480b45b0 con 0x7f1a480b5460 2021-06-25T04:49:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a377fe700 1 -- 172.21.15.57:0/1383914183 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a3800ccf0 con 0x7f1a480b5460 2021-06-25T04:49:52.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.359+0000 7f1a4759e700 1 -- 172.21.15.57:0/1383914183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a480b4af0 con 0x7f1a480b5460 2021-06-25T04:49:52.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.363+0000 7f1a4759e700 1 -- 172.21.15.57:0/1383914183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a480b4cb0 con 0x7f1a480b5460 2021-06-25T04:49:52.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.363+0000 7f1a377fe700 1 -- 172.21.15.57:0/1383914183 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1a3801c460 con 0x7f1a480b5460 2021-06-25T04:49:52.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.363+0000 7f1a377fe700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1a240553d0 0x7f1a24057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.363+0000 7f1a377fe700 1 -- 172.21.15.57:0/1383914183 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1a3806e3e0 con 0x7f1a480b5460 2021-06-25T04:49:52.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.363+0000 7f1a4659c700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1a240553d0 0x7f1a24057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.363+0000 7f1a4659c700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1a240553d0 0x7f1a24057890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f1a3c00b000 tx=0x7f1a3c007100).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:52.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.367+0000 7f1a377fe700 1 -- 172.21.15.57:0/1383914183 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1a380445e0 con 0x7f1a480b5460 2021-06-25T04:49:52.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.535+0000 7f1a4759e700 1 -- 172.21.15.57:0/1383914183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a48156980 con 0x7f1a480b5460 2021-06-25T04:49:52.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.535+0000 7f1a377fe700 1 -- 172.21.15.57:0/1383914183 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f1a48156980 con 0x7f1a480b5460 2021-06-25T04:49:52.541 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:52.542 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/587697587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":587697587},{"type":"v1","addr":"172.21.15.87:6835","nonce":587697587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/3950506435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3950506435},{"type":"v1","addr":"172.21.15.57:6833","nonce":3950506435}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:49:35.649253+0000","modified":"2021-06-25T04:49:36.652144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/792452299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":792452299},{"type":"v1","addr":"172.21.15.57:6835","nonce":792452299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-06-25T04:49:52.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 -- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1a240553d0 msgr2=0x7f1a24057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1a240553d0 0x7f1a24057890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f1a3c00b000 tx=0x7f1a3c007100).stop 2021-06-25T04:49:52.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 -- 172.21.15.57:0/1383914183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a480b5460 msgr2=0x7f1a4815a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a480b5460 0x7f1a4815a760 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f1a3800c000 tx=0x7f1a38006df0).stop 2021-06-25T04:49:52.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 -- 172.21.15.57:0/1383914183 shutdown_connections 2021-06-25T04:49:52.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1a240553d0 0x7f1a24057890 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a48147560 0x7f1a48066860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a480b5460 0x7f1a4815a760 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 --2- 172.21.15.57:0/1383914183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a480b05d0 0x7f1a48143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 -- 172.21.15.57:0/1383914183 >> 172.21.15.57:0/1383914183 conn(0x7f1a48062520 msgr2=0x7f1a4814a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:52.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 -- 172.21.15.57:0/1383914183 shutdown_connections 2021-06-25T04:49:52.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.539+0000 7f1a4759e700 1 -- 172.21.15.57:0/1383914183 wait complete. 2021-06-25T04:49:52.550 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2021-06-25T04:49:52.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_caps 20 2021-06-25T04:49:52.668 INFO:teuthology.orchestra.run.smithi057.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-06-25T04:49:52.668 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-06-25T04:49:52.669 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:49:52.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.759+0000 7f443ffff700 1 Processor -- start 2021-06-25T04:49:52.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.759+0000 7f443ffff700 1 -- start start 2021-06-25T04:49:52.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.759+0000 7f443ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f44400b05d0 0x7f44400af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.759+0000 7f443ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4440147560 0x7f44400acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.759+0000 7f443ffff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44401479b0 con 0x7f44400b5460 2021-06-25T04:49:52.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.759+0000 7f443ffff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44401452a0 con 0x7f4440147560 2021-06-25T04:49:52.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.759+0000 7f443ffff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44400adfb0 con 0x7f44400b05d0 2021-06-25T04:49:52.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.759+0000 7f443f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4440147560 0x7f44400acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.759+0000 7f443f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4440147560 0x7f44400acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37400/0 (socket says 172.21.15.57:37400) 2021-06-25T04:49:52.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.759+0000 7f443f7fe700 1 -- 172.21.15.57:0/1597201079 learned_addr learned my addr 172.21.15.57:0/1597201079 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:52.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.759+0000 7f443e7fc700 1 --2- 172.21.15.57:0/1597201079 >> v2:172.21.15.87:3300/0 conn(0x7f44400b05d0 0x7f44400af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443f7fe700 1 -- 172.21.15.57:0/1597201079 >> v2:172.21.15.87:3300/0 conn(0x7f44400b05d0 msgr2=0x7f44400af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:52.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443f7fe700 1 --2- 172.21.15.57:0/1597201079 >> v2:172.21.15.87:3300/0 conn(0x7f44400b05d0 0x7f44400af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443f7fe700 1 -- 172.21.15.57:0/1597201079 >> v1:172.21.15.87:6789/0 conn(0x7f44400b5460 legacy=0x7f4440067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443f7fe700 1 -- 172.21.15.57:0/1597201079 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400b5840 con 0x7f4440147560 2021-06-25T04:49:52.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443f7fe700 1 --2- 172.21.15.57:0/1597201079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4440147560 0x7f44400acc20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f4438002f70 tx=0x7f4438006eb0).ready entity=mon.0 client_cookie=d98deae7023d8b6b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:52.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443dffb700 1 -- 172.21.15.57:0/1597201079 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f443800d5c0 con 0x7f4440147560 2021-06-25T04:49:52.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443dffb700 1 -- 172.21.15.57:0/1597201079 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4438000e90 con 0x7f4440147560 2021-06-25T04:49:52.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443dffb700 1 -- 172.21.15.57:0/1597201079 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f443800d950 con 0x7f4440147560 2021-06-25T04:49:52.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 -- 172.21.15.57:0/1597201079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4440147560 msgr2=0x7f44400acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 --2- 172.21.15.57:0/1597201079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4440147560 0x7f44400acc20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f4438002f70 tx=0x7f4438006eb0).stop 2021-06-25T04:49:52.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 -- 172.21.15.57:0/1597201079 shutdown_connections 2021-06-25T04:49:52.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 --2- 172.21.15.57:0/1597201079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4440147560 0x7f44400acc20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 --2- 172.21.15.57:0/1597201079 >> v2:172.21.15.87:3300/0 conn(0x7f44400b05d0 0x7f44400af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 -- 172.21.15.57:0/1597201079 >> 172.21.15.57:0/1597201079 conn(0x7f4440062520 msgr2=0x7f4440062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:52.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 -- 172.21.15.57:0/1597201079 shutdown_connections 2021-06-25T04:49:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 -- 172.21.15.57:0/1597201079 wait complete. 2021-06-25T04:49:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 Processor -- start 2021-06-25T04:49:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 -- start start 2021-06-25T04:49:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44400b05d0 0x7f4440156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44400b5460 0x7f444014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4440147560 0x7f4440145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44401453e0 con 0x7f44400b05d0 2021-06-25T04:49:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4440140840 con 0x7f4440147560 2021-06-25T04:49:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.763+0000 7f443ffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4440140ae0 con 0x7f44400b5460 2021-06-25T04:49:52.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44400b05d0 0x7f4440156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443e7fc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44400b5460 0x7f444014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44400b05d0 0x7f4440156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37402/0 (socket says 172.21.15.57:37402) 2021-06-25T04:49:52.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4440147560 0x7f4440145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443effd700 1 -- 172.21.15.57:0/2903390372 learned_addr learned my addr 172.21.15.57:0/2903390372 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:52.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443effd700 1 -- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44400b5460 msgr2=0x7f444014e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443effd700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44400b5460 0x7f444014e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443effd700 1 -- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4440147560 msgr2=0x7f4440145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443effd700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4440147560 0x7f4440145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443effd700 1 -- 172.21.15.57:0/2903390372 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443800b1e0 con 0x7f44400b05d0 2021-06-25T04:49:52.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443f7fe700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4440147560 0x7f4440145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:49:52.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443effd700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44400b05d0 0x7f4440156940 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f4440069d50 tx=0x7f4434007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:52.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f442ffff700 1 -- 172.21.15.57:0/2903390372 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4434012400 con 0x7f44400b05d0 2021-06-25T04:49:52.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f442ffff700 1 -- 172.21.15.57:0/2903390372 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4434012560 con 0x7f44400b05d0 2021-06-25T04:49:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443ffff700 1 -- 172.21.15.57:0/2903390372 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4440140d80 con 0x7f44400b05d0 2021-06-25T04:49:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f442ffff700 1 -- 172.21.15.57:0/2903390372 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44340128c0 con 0x7f44400b05d0 2021-06-25T04:49:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443ffff700 1 -- 172.21.15.57:0/2903390372 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4440141620 con 0x7f44400b05d0 2021-06-25T04:49:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f443ffff700 1 -- 172.21.15.57:0/2903390372 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4440057310 con 0x7f44400b05d0 2021-06-25T04:49:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.767+0000 7f442ffff700 1 -- 172.21.15.57:0/2903390372 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4434019030 con 0x7f44400b05d0 2021-06-25T04:49:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.771+0000 7f442ffff700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f441c055510 0x7f441c0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.771+0000 7f442ffff700 1 -- 172.21.15.57:0/2903390372 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f443406d2a0 con 0x7f44400b05d0 2021-06-25T04:49:52.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.771+0000 7f443e7fc700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f441c055510 0x7f441c0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:52.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.771+0000 7f443e7fc700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f441c055510 0x7f441c0579d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f443000b000 tx=0x7f44300091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:52.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.775+0000 7f442ffff700 1 -- 172.21.15.57:0/2903390372 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f44340433b0 con 0x7f44400b05d0 2021-06-25T04:49:52.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.939+0000 7f443ffff700 1 -- 172.21.15.57:0/2903390372 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4440145780 con 0x7f44400b05d0 2021-06-25T04:49:52.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f442ffff700 1 -- 172.21.15.57:0/2903390372 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f44340469d0 con 0x7f44400b05d0 2021-06-25T04:49:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:52.948 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/587697587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":587697587},{"type":"v1","addr":"172.21.15.87:6835","nonce":587697587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/3950506435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3950506435},{"type":"v1","addr":"172.21.15.57:6833","nonce":3950506435}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:49:35.649253+0000","modified":"2021-06-25T04:49:36.652144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/792452299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":792452299},{"type":"v1","addr":"172.21.15.57:6835","nonce":792452299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-06-25T04:49:52.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 -- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f441c055510 msgr2=0x7f441c0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f441c055510 0x7f441c0579d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f443000b000 tx=0x7f44300091d0).stop 2021-06-25T04:49:52.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 -- 172.21.15.57:0/2903390372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44400b05d0 msgr2=0x7f4440156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:52.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44400b05d0 0x7f4440156940 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f4440069d50 tx=0x7f4434007c50).stop 2021-06-25T04:49:52.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 -- 172.21.15.57:0/2903390372 shutdown_connections 2021-06-25T04:49:52.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f441c055510 0x7f441c0579d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4440147560 0x7f4440145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44400b5460 0x7f444014e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 --2- 172.21.15.57:0/2903390372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44400b05d0 0x7f4440156940 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:52.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 -- 172.21.15.57:0/2903390372 >> 172.21.15.57:0/2903390372 conn(0x7f4440062520 msgr2=0x7f44400acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:52.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 -- 172.21.15.57:0/2903390372 shutdown_connections 2021-06-25T04:49:52.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:52.943+0000 7f443ffff700 1 -- 172.21.15.57:0/2903390372 wait complete. 2021-06-25T04:49:52.953 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2021-06-25T04:49:52.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_decay_threshold 400 2021-06-25T04:49:53.061 INFO:teuthology.orchestra.run.smithi057.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-06-25T04:49:53.062 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-06-25T04:49:53.063 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:49:53.079 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:49:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.179+0000 7f566d873700 1 Processor -- start 2021-06-25T04:49:53.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.179+0000 7f566d873700 1 -- start start 2021-06-25T04:49:53.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f566d873700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f56680afd20 0x7f5668067820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f566d873700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5668144410 con 0x7f56680af0f0 2021-06-25T04:49:53.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f566d873700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56680b2bf0 con 0x7f56680b2810 2021-06-25T04:49:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f566d873700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56681452c0 con 0x7f56680afd20 2021-06-25T04:49:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f566d072700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f56680afd20 0x7f5668067820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f5667fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f56680af0f0 0x7f5668140e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54630/0 (socket says 172.21.15.57:54630) 2021-06-25T04:49:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f5667fff700 1 -- 172.21.15.57:0/2721463111 learned_addr learned my addr 172.21.15.57:0/2721463111 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:53.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f56677fe700 1 -- 172.21.15.57:0/2721463111 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623924483 0 0) 0x7f5668144410 con 0x7f56680af0f0 2021-06-25T04:49:53.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f56677fe700 1 -- 172.21.15.57:0/2721463111 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5654003260 con 0x7f56680af0f0 2021-06-25T04:49:53.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f56677fe700 1 -- 172.21.15.57:0/2721463111 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635259290 0 0) 0x7f56680b2bf0 con 0x7f56680b2810 2021-06-25T04:49:53.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f56677fe700 1 -- 172.21.15.57:0/2721463111 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5668144410 con 0x7f56680b2810 2021-06-25T04:49:53.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f566d072700 1 -- 172.21.15.57:0/2721463111 >> v1:172.21.15.87:6789/0 conn(0x7f56680b2810 legacy=0x7f5668067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f566d072700 1 -- 172.21.15.57:0/2721463111 >> v1:172.21.15.57:6789/0 conn(0x7f56680af0f0 legacy=0x7f5668140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f566d072700 1 -- 172.21.15.57:0/2721463111 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5668144640 con 0x7f56680afd20 2021-06-25T04:49:53.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f566d072700 1 --2- 172.21.15.57:0/2721463111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56680afd20 0x7f5668067820 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f56600032f0 tx=0x7f56600091d0).ready entity=mon.0 client_cookie=1dbd78e78da40b39 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:53.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f56677fe700 1 -- 172.21.15.57:0/2721463111 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566000b600 con 0x7f56680afd20 2021-06-25T04:49:53.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f56677fe700 1 -- 172.21.15.57:0/2721463111 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566000b760 con 0x7f56680afd20 2021-06-25T04:49:53.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f56677fe700 1 -- 172.21.15.57:0/2721463111 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566000b8d0 con 0x7f56680afd20 2021-06-25T04:49:53.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f566d873700 1 -- 172.21.15.57:0/2721463111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56680afd20 msgr2=0x7f5668067820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.183+0000 7f566d873700 1 --2- 172.21.15.57:0/2721463111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56680afd20 0x7f5668067820 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f56600032f0 tx=0x7f56600091d0).stop 2021-06-25T04:49:53.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 -- 172.21.15.57:0/2721463111 shutdown_connections 2021-06-25T04:49:53.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 --2- 172.21.15.57:0/2721463111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56680afd20 0x7f5668067820 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 -- 172.21.15.57:0/2721463111 >> 172.21.15.57:0/2721463111 conn(0x7f56680611f0 msgr2=0x7f5668062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:53.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 -- 172.21.15.57:0/2721463111 shutdown_connections 2021-06-25T04:49:53.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 -- 172.21.15.57:0/2721463111 wait complete. 2021-06-25T04:49:53.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 Processor -- start 2021-06-25T04:49:53.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 -- start start 2021-06-25T04:49:53.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56680af0f0 0x7f5668145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56680afd20 0x7f56680650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56680b2810 0x7f56680acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5668153380 con 0x7f56680b2810 2021-06-25T04:49:53.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5668147270 con 0x7f56680afd20 2021-06-25T04:49:53.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d873700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56681530e0 con 0x7f56680af0f0 2021-06-25T04:49:53.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d072700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56680b2810 0x7f56680acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d072700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56680b2810 0x7f56680acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37420/0 (socket says 172.21.15.57:37420) 2021-06-25T04:49:53.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d072700 1 -- 172.21.15.57:0/2830043795 learned_addr learned my addr 172.21.15.57:0/2830043795 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:53.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f5667fff700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56680afd20 0x7f56680650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566c871700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56680af0f0 0x7f5668145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d072700 1 -- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56680af0f0 msgr2=0x7f5668145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d072700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56680af0f0 0x7f5668145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d072700 1 -- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56680afd20 msgr2=0x7f56680650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d072700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56680afd20 0x7f56680650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d072700 1 -- 172.21.15.57:0/2830043795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5660009470 con 0x7f56680b2810 2021-06-25T04:49:53.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566c871700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56680af0f0 0x7f5668145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:53.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.187+0000 7f566d072700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56680b2810 0x7f56680acee0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f56600032f0 tx=0x7f5660016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:53.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.191+0000 7f5665ffb700 1 -- 172.21.15.57:0/2830043795 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5660006ea0 con 0x7f56680b2810 2021-06-25T04:49:53.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.191+0000 7f5665ffb700 1 -- 172.21.15.57:0/2830043795 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5660011de0 con 0x7f56680b2810 2021-06-25T04:49:53.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.191+0000 7f566d873700 1 -- 172.21.15.57:0/2830043795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56680655b0 con 0x7f56680b2810 2021-06-25T04:49:53.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.191+0000 7f5665ffb700 1 -- 172.21.15.57:0/2830043795 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5660021630 con 0x7f56680b2810 2021-06-25T04:49:53.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.191+0000 7f566d873700 1 -- 172.21.15.57:0/2830043795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5668065870 con 0x7f56680b2810 2021-06-25T04:49:53.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.191+0000 7f566d873700 1 -- 172.21.15.57:0/2830043795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56681467e0 con 0x7f56680b2810 2021-06-25T04:49:53.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.191+0000 7f5665ffb700 1 -- 172.21.15.57:0/2830043795 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5660027020 con 0x7f56680b2810 2021-06-25T04:49:53.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.191+0000 7f5665ffb700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5648055340 0x7f5648057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.191+0000 7f5665ffb700 1 -- 172.21.15.57:0/2830043795 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f566006eff0 con 0x7f56680b2810 2021-06-25T04:49:53.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.191+0000 7f566c871700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5648055340 0x7f5648057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.191+0000 7f566c871700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5648055340 0x7f5648057800 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f565800b000 tx=0x7f5658009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:53.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.199+0000 7f5665ffb700 1 -- 172.21.15.57:0/2830043795 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f56600451a0 con 0x7f56680b2810 2021-06-25T04:49:53.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.363+0000 7f566d873700 1 -- 172.21.15.57:0/2830043795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5668057310 con 0x7f56680b2810 2021-06-25T04:49:53.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.363+0000 7f5665ffb700 1 -- 172.21.15.57:0/2830043795 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f56600487c0 con 0x7f56680b2810 2021-06-25T04:49:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:49:53.370 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/587697587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":587697587},{"type":"v1","addr":"172.21.15.87:6835","nonce":587697587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/3950506435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3950506435},{"type":"v1","addr":"172.21.15.57:6833","nonce":3950506435}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:49:35.649253+0000","modified":"2021-06-25T04:49:36.652144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/792452299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":792452299},{"type":"v1","addr":"172.21.15.57:6835","nonce":792452299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-06-25T04:49:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 -- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5648055340 msgr2=0x7f5648057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5648055340 0x7f5648057800 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f565800b000 tx=0x7f5658009040).stop 2021-06-25T04:49:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 -- 172.21.15.57:0/2830043795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56680b2810 msgr2=0x7f56680acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56680b2810 0x7f56680acee0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f56600032f0 tx=0x7f5660016000).stop 2021-06-25T04:49:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 -- 172.21.15.57:0/2830043795 shutdown_connections 2021-06-25T04:49:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5648055340 0x7f5648057800 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56680b2810 0x7f56680acee0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56680afd20 0x7f56680650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 --2- 172.21.15.57:0/2830043795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56680af0f0 0x7f5668145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 -- 172.21.15.57:0/2830043795 >> 172.21.15.57:0/2830043795 conn(0x7f56680611f0 msgr2=0x7f566813de90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 -- 172.21.15.57:0/2830043795 shutdown_connections 2021-06-25T04:49:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.367+0000 7f566d873700 1 -- 172.21.15.57:0/2830043795 wait complete. 2021-06-25T04:49:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2021-06-25T04:49:53.382 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c cache drop 2021-06-25T04:49:53.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d727f3700 1 Processor -- start 2021-06-25T04:49:53.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d727f3700 1 -- start start 2021-06-25T04:49:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d727f3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5d6c146910 0x7f5d6c1401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d727f3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d6c0b4140 0x7f5d6c1406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d727f3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6c143b20 con 0x7f5d6c0b4650 2021-06-25T04:49:53.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d727f3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c1474d0 con 0x7f5d6c146910 2021-06-25T04:49:53.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d727f3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c143dc0 con 0x7f5d6c0b4140 2021-06-25T04:49:53.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d70d90700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5d6c0b4650 0x7f5d6c0b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54644/0 (socket says 172.21.15.57:54644) 2021-06-25T04:49:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d70d90700 1 -- 172.21.15.57:0/482551779 learned_addr learned my addr 172.21.15.57:0/482551779 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:49:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/482551779 >> v2:172.21.15.87:3300/0 conn(0x7f5d6c146910 0x7f5d6c1401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6b7fe700 1 --2- 172.21.15.57:0/482551779 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d6c0b4140 0x7f5d6c1406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6affd700 1 -- 172.21.15.57:0/482551779 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876435301 0 0) 0x7f5d6c143b20 con 0x7f5d6c0b4650 2021-06-25T04:49:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6affd700 1 -- 172.21.15.57:0/482551779 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d58003260 con 0x7f5d6c0b4650 2021-06-25T04:49:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6bfff700 1 -- 172.21.15.57:0/482551779 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d6c0b4140 msgr2=0x7f5d6c1406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/482551779 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d6c0b4140 0x7f5d6c1406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6affd700 1 -- 172.21.15.57:0/482551779 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2472337055 0 0) 0x7f5d58003260 con 0x7f5d6c0b4650 2021-06-25T04:49:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6bfff700 1 -- 172.21.15.57:0/482551779 >> v1:172.21.15.57:6789/0 conn(0x7f5d6c0b4650 legacy=0x7f5d6c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6bfff700 1 -- 172.21.15.57:0/482551779 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0b0c50 con 0x7f5d6c146910 2021-06-25T04:49:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/482551779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c146910 0x7f5d6c1401f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f5d64001b80 tx=0x7f5d5c006df0).ready entity=mon.1 client_cookie=38dc8c414b899f4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:53.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6affd700 1 -- 172.21.15.57:0/482551779 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d640019e0 con 0x7f5d6c146910 2021-06-25T04:49:53.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6affd700 1 -- 172.21.15.57:0/482551779 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c000e90 con 0x7f5d6c146910 2021-06-25T04:49:53.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d6affd700 1 -- 172.21.15.57:0/482551779 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d5c012460 con 0x7f5d6c146910 2021-06-25T04:49:53.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d727f3700 1 -- 172.21.15.57:0/482551779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c146910 msgr2=0x7f5d6c1401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.483+0000 7f5d727f3700 1 --2- 172.21.15.57:0/482551779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c146910 0x7f5d6c1401f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f5d64001b80 tx=0x7f5d5c006df0).stop 2021-06-25T04:49:53.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 -- 172.21.15.57:0/482551779 shutdown_connections 2021-06-25T04:49:53.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 --2- 172.21.15.57:0/482551779 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d6c0b4140 0x7f5d6c1406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 --2- 172.21.15.57:0/482551779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c146910 0x7f5d6c1401f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 -- 172.21.15.57:0/482551779 >> 172.21.15.57:0/482551779 conn(0x7f5d6c05c450 msgr2=0x7f5d6c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:53.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 -- 172.21.15.57:0/482551779 shutdown_connections 2021-06-25T04:49:53.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 -- 172.21.15.57:0/482551779 wait complete. 2021-06-25T04:49:53.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 Processor -- start 2021-06-25T04:49:53.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 -- start start 2021-06-25T04:49:53.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d6c0b4140 0x7f5d6c0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d6c0b4650 0x7f5d6c13f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c146910 0x7f5d6c13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c149fe0 con 0x7f5d6c0b4650 2021-06-25T04:49:53.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c1499d0 con 0x7f5d6c146910 2021-06-25T04:49:53.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d727f3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c13fa90 con 0x7f5d6c0b4140 2021-06-25T04:49:53.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d6bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d6c0b4140 0x7f5d6c0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d70d90700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c146910 0x7f5d6c13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d70d90700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c146910 0x7f5d6c13f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:45926/0 (socket says 172.21.15.57:45926) 2021-06-25T04:49:53.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d70d90700 1 -- 172.21.15.57:0/1484933720 learned_addr learned my addr 172.21.15.57:0/1484933720 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:53.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d6bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d6c0b4140 0x7f5d6c0b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:48594/0 (socket says 172.21.15.57:48594) 2021-06-25T04:49:53.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d6b7fe700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d6c0b4650 0x7f5d6c13f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d70d90700 1 -- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d6c0b4140 msgr2=0x7f5d6c0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d70d90700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d6c0b4140 0x7f5d6c0b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d70d90700 1 -- 172.21.15.57:0/1484933720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d6c0b4650 msgr2=0x7f5d6c13f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d70d90700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d6c0b4650 0x7f5d6c13f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.487+0000 7f5d70d90700 1 -- 172.21.15.57:0/1484933720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c00b180 con 0x7f5d6c146910 2021-06-25T04:49:53.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.491+0000 7f5d70d90700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c146910 0x7f5d6c13f5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f5d6c149f00 tx=0x7f5d6400cb20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.491+0000 7f5d697fa700 1 -- 172.21.15.57:0/1484933720 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d64004ab0 con 0x7f5d6c146910 2021-06-25T04:49:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.491+0000 7f5d697fa700 1 -- 172.21.15.57:0/1484933720 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d64004c10 con 0x7f5d6c146910 2021-06-25T04:49:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.491+0000 7f5d727f3700 1 -- 172.21.15.57:0/1484933720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c0ae2e0 con 0x7f5d6c146910 2021-06-25T04:49:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.491+0000 7f5d697fa700 1 -- 172.21.15.57:0/1484933720 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d64007170 con 0x7f5d6c146910 2021-06-25T04:49:53.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.491+0000 7f5d727f3700 1 -- 172.21.15.57:0/1484933720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c0b06b0 con 0x7f5d6c146910 2021-06-25T04:49:53.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.491+0000 7f5d697fa700 1 -- 172.21.15.57:0/1484933720 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5d6401b060 con 0x7f5d6c146910 2021-06-25T04:49:53.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.491+0000 7f5d697fa700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d4c055450 0x7f5d4c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.491+0000 7f5d697fa700 1 -- 172.21.15.57:0/1484933720 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5d6406dcc0 con 0x7f5d6c146910 2021-06-25T04:49:53.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.491+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d4c055450 0x7f5d4c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d4c055450 0x7f5d4c057910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f5d5c019000 tx=0x7f5d5c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:53.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d7ca43740 1 Processor -- start 2021-06-25T04:49:53.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d7ca43740 1 -- start start 2021-06-25T04:49:53.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e6560 0x29e6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e39e0 0x29e0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a15140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x2955650 con 0x29e5b10 2021-06-25T04:49:53.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x2955790 con 0x29e6560 2021-06-25T04:49:53.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x2956e60 con 0x29e39e0 2021-06-25T04:49:53.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d70d90700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a15140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d6bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e6560 0x29e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d70d90700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a15140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37442/0 (socket says 172.21.15.57:37442) 2021-06-25T04:49:53.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d6b7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e39e0 0x29e0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d70d90700 1 -- 172.21.15.57:0/1450072228 learned_addr learned my addr 172.21.15.57:0/1450072228 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:53.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d70d90700 1 -- 172.21.15.57:0/1450072228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e39e0 msgr2=0x29e0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:53.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d70d90700 1 --2- 172.21.15.57:0/1450072228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e39e0 0x29e0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d70d90700 1 -- 172.21.15.57:0/1450072228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e6560 msgr2=0x29e6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:53.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d70d90700 1 --2- 172.21.15.57:0/1450072228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e6560 0x29e6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.495+0000 7f5d70d90700 1 -- 172.21.15.57:0/1450072228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x298e750 con 0x29e5b10 2021-06-25T04:49:53.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d70d90700 1 --2- 172.21.15.57:0/1450072228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a15140 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f5d6406c200 tx=0x7f5d64010000).ready entity=mon.0 client_cookie=19b9b0b6751ad44b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:53.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d727f3700 1 -- 172.21.15.57:0/1450072228 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d6404e070 con 0x29e5b10 2021-06-25T04:49:53.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d727f3700 1 -- 172.21.15.57:0/1450072228 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6401b2f0 con 0x29e5b10 2021-06-25T04:49:53.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d727f3700 1 -- 172.21.15.57:0/1450072228 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d64043a00 con 0x29e5b10 2021-06-25T04:49:53.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1450072228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 msgr2=0x2a15140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/1450072228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a15140 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f5d6406c200 tx=0x7f5d64010000).stop 2021-06-25T04:49:53.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1450072228 shutdown_connections 2021-06-25T04:49:53.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/1450072228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a15140 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/1450072228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e39e0 0x29e0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/1450072228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e6560 0x29e6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1450072228 >> 172.21.15.57:0/1450072228 conn(0x29e23a0 msgr2=0x29e32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1450072228 shutdown_connections 2021-06-25T04:49:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1450072228 wait complete. 2021-06-25T04:49:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 -- start start 2021-06-25T04:49:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 Processor -- start 2021-06-25T04:49:53.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e5b10 0x2a1cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a2e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x2a1d030 0x2a2ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a19f10 con 0x29e6560 2021-06-25T04:49:53.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a2f0d0 con 0x2a1d030 2021-06-25T04:49:53.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a1ba60 con 0x29e5b10 2021-06-25T04:49:53.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d7ca43740 10 client.0 ll_register_callbacks cb 0x299dd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-06-25T04:49:53.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d6b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a2e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d6b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a2e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37448/0 (socket says 172.21.15.57:37448) 2021-06-25T04:49:53.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d6b7fe700 1 -- 172.21.15.57:0/1920139652 learned_addr learned my addr 172.21.15.57:0/1920139652 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:53.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e5b10 0x2a1cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.499+0000 7f5d70d90700 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x2a1d030 0x2a2ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d6b7fe700 1 -- 172.21.15.57:0/1920139652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e5b10 msgr2=0x2a1cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d6b7fe700 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e5b10 0x2a1cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d6b7fe700 1 -- 172.21.15.57:0/1920139652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x2a1d030 msgr2=0x2a2ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d6b7fe700 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x2a1d030 0x2a2ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d6b7fe700 1 -- 172.21.15.57:0/1920139652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c0b06b0 con 0x29e6560 2021-06-25T04:49:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d6b7fe700 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a2e6f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x2a2f210 tx=0x7f5d60006df0).ready entity=mon.0 client_cookie=17404bc59f5c5117 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2021-06-25T04:49:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d46ffd700 1 -- 172.21.15.57:0/1920139652 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d60014e70 con 0x29e6560 2021-06-25T04:49:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d46ffd700 1 -- 172.21.15.57:0/1920139652 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5d60015630 con 0x29e6560 2021-06-25T04:49:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1920139652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27cfc20 con 0x29e6560 2021-06-25T04:49:53.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d46ffd700 1 -- 172.21.15.57:0/1920139652 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d600157f0 con 0x29e6560 2021-06-25T04:49:53.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 10 client.5451 fetch_fsmap learned FSMap version 18 2021-06-25T04:49:53.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1920139652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x2945cf0 con 0x29e6560 2021-06-25T04:49:53.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d46ffd700 1 -- 172.21.15.57:0/1920139652 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27cfc20 con 0x29e6560 2021-06-25T04:49:53.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d46ffd700 1 -- 172.21.15.57:0/1920139652 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 18) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f5d60012040 con 0x29e6560 2021-06-25T04:49:53.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 10 client.5451 fetch_fsmap finished waiting for FSMap version 18 2021-06-25T04:49:53.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 10 client.5451 resolve_mds: resolved ID 'c' to GID 5256 2021-06-25T04:49:53.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 20 client.5451 populate_metadata read hostname 'smithi057' 2021-06-25T04:49:53.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.57:6834/792452299,v1:172.21.15.57:6835/792452299] conn(0x2a2b660 0x2a1a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 4 client.5451 mds_command: new command op to 5256 tid=0[{"prefix": "get_command_descriptions"}] 2021-06-25T04:49:53.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1920139652 --> [v2:172.21.15.57:6834/792452299,v1:172.21.15.57:6835/792452299] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27e5460 con 0x2a2b660 2021-06-25T04:49:53.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.57:6834/792452299,v1:172.21.15.57:6835/792452299] conn(0x2a2b660 0x2a1a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.57:6834/792452299,v1:172.21.15.57:6835/792452299] conn(0x2a2b660 0x2a1a410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d32845c4a55b2162 server_cookie=a4ce57963a79c999 in_seq=0 out_seq=0 2021-06-25T04:49:53.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d46ffd700 10 client.5451 ms_handle_connect on v2:172.21.15.57:6834/792452299 2021-06-25T04:49:53.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d46ffd700 1 -- 172.21.15.57:0/1920139652 <== mds.0 v2:172.21.15.57:6834/792452299 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x27e5460 con 0x2a2b660 2021-06-25T04:49:53.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d46ffd700 10 client.5451 handle_command_reply: tid=0 2021-06-25T04:49:53.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 client.5451 shutdown 2021-06-25T04:49:53.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1920139652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 msgr2=0x2a2e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a2e6f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x2a2f210 tx=0x7f5d60006df0).stop 2021-06-25T04:49:53.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1920139652 shutdown_connections 2021-06-25T04:49:53.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.57:6834/792452299,v1:172.21.15.57:6835/792452299] conn(0x2a2b660 0x2a1a410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x2a1d030 0x2a2ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a2e6f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/1920139652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e5b10 0x2a1cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d46ffd700 0 client.5451 ms_handle_reset on v2:172.21.15.57:6834/792452299 2021-06-25T04:49:53.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1920139652 >> 172.21.15.57:0/1920139652 conn(0x29e39e0 msgr2=0x29e4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:53.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1920139652 shutdown_connections 2021-06-25T04:49:53.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 1 -- 172.21.15.57:0/1920139652 wait complete. 2021-06-25T04:49:53.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.503+0000 7f5d7ca43740 20 client.5451 trim_cache size 0 max 16384 2021-06-25T04:49:53.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d7ca43740 1 Processor -- start 2021-06-25T04:49:53.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d7ca43740 1 -- start start 2021-06-25T04:49:53.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e5b10 0x29dfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a15ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e0390 0x2a163b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x2955650 con 0x29e6560 2021-06-25T04:49:53.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a1c240 con 0x29e0390 2021-06-25T04:49:53.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a1b880 con 0x29e5b10 2021-06-25T04:49:53.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d6b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a15ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d6b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a15ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37456/0 (socket says 172.21.15.57:37456) 2021-06-25T04:49:53.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d6b7fe700 1 -- 172.21.15.57:0/305163905 learned_addr learned my addr 172.21.15.57:0/305163905 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:53.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d70d90700 1 --2- 172.21.15.57:0/305163905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e0390 0x2a163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/305163905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e5b10 0x29dfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d6b7fe700 1 -- 172.21.15.57:0/305163905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e5b10 msgr2=0x29dfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:53.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d6b7fe700 1 --2- 172.21.15.57:0/305163905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e5b10 0x29dfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d6b7fe700 1 -- 172.21.15.57:0/305163905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e0390 msgr2=0x2a163b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:53.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d6b7fe700 1 --2- 172.21.15.57:0/305163905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e0390 0x2a163b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d6b7fe700 1 -- 172.21.15.57:0/305163905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c141c60 con 0x29e6560 2021-06-25T04:49:53.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/305163905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e5b10 0x29dfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:49:53.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d6b7fe700 1 --2- 172.21.15.57:0/305163905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a15ec0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x2a2f210 tx=0x7f5d6001d000).ready entity=mon.0 client_cookie=de7d1dfdd6871a21 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:53.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.519+0000 7f5d517fa700 1 -- 172.21.15.57:0/305163905 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d60014e70 con 0x29e6560 2021-06-25T04:49:53.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d517fa700 1 -- 172.21.15.57:0/305163905 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6002d070 con 0x29e6560 2021-06-25T04:49:53.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 -- 172.21.15.57:0/305163905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 msgr2=0x2a15ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:49:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d517fa700 1 -- 172.21.15.57:0/305163905 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d6001d870 con 0x29e6560 2021-06-25T04:49:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/305163905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a15ec0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x2a2f210 tx=0x7f5d6001d000).stop 2021-06-25T04:49:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 -- 172.21.15.57:0/305163905 shutdown_connections 2021-06-25T04:49:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/305163905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e0390 0x2a163b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/305163905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e6560 0x2a15ec0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/305163905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e5b10 0x29dfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 -- 172.21.15.57:0/305163905 >> 172.21.15.57:0/305163905 conn(0x29e39e0 msgr2=0x2a191e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:49:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 -- 172.21.15.57:0/305163905 shutdown_connections 2021-06-25T04:49:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 -- 172.21.15.57:0/305163905 wait complete. 2021-06-25T04:49:53.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 -- start start 2021-06-25T04:49:53.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 Processor -- start 2021-06-25T04:49:53.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a81ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e6560 0x2a81fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e4260 0x29e46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x29e7a10 con 0x29e5b10 2021-06-25T04:49:53.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a1b1b0 con 0x29e6560 2021-06-25T04:49:53.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a824c0 con 0x29e4260 2021-06-25T04:49:53.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 10 client.0 ll_register_callbacks cb 0x2a19140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-06-25T04:49:53.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d6bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a81ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d6bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a81ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37460/0 (socket says 172.21.15.57:37460) 2021-06-25T04:49:53.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d6bfff700 1 -- 172.21.15.57:0/2504005307 learned_addr learned my addr 172.21.15.57:0/2504005307 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:49:53.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d6b7fe700 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e6560 0x2a81fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d70d90700 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e4260 0x29e46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d6bfff700 1 -- 172.21.15.57:0/2504005307 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e4260 msgr2=0x29e46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:53.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e4260 0x29e46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d6bfff700 1 -- 172.21.15.57:0/2504005307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e6560 msgr2=0x2a81fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:49:53.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e6560 0x2a81fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:49:53.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d6bfff700 1 -- 172.21.15.57:0/2504005307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2945cf0 con 0x29e5b10 2021-06-25T04:49:53.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a81ae0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f5d5c02a000 tx=0x7f5d5c012000).ready entity=mon.0 client_cookie=5dd93a7b49b98110 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:49:53.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d47fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2021-06-25T04:49:53.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d47fff700 1 -- 172.21.15.57:0/2504005307 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d5c0310b0 con 0x29e5b10 2021-06-25T04:49:53.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d7ca43740 1 -- 172.21.15.57:0/2504005307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x28607d0 con 0x29e5b10 2021-06-25T04:49:53.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d47fff700 1 -- 172.21.15.57:0/2504005307 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5d5c013e00 con 0x29e5b10 2021-06-25T04:49:53.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.523+0000 7f5d47fff700 1 -- 172.21.15.57:0/2504005307 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d5c02fa90 con 0x29e5b10 2021-06-25T04:49:53.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d7ca43740 10 client.5457 fetch_fsmap learned FSMap version 18 2021-06-25T04:49:53.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d7ca43740 1 -- 172.21.15.57:0/2504005307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x294e8e0 con 0x29e5b10 2021-06-25T04:49:53.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d47fff700 1 -- 172.21.15.57:0/2504005307 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x28607d0 con 0x29e5b10 2021-06-25T04:49:53.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d47fff700 1 -- 172.21.15.57:0/2504005307 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 18) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f5d5c02c040 con 0x29e5b10 2021-06-25T04:49:53.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d7ca43740 10 client.5457 fetch_fsmap finished waiting for FSMap version 18 2021-06-25T04:49:53.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d7ca43740 10 client.5457 resolve_mds: resolved ID 'c' to GID 5256 2021-06-25T04:49:53.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d7ca43740 20 client.5457 populate_metadata read hostname 'smithi057' 2021-06-25T04:49:53.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.57:6834/792452299,v1:172.21.15.57:6835/792452299] conn(0x29e4bd0 0x2a7b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:49:53.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d7ca43740 4 client.5457 mds_command: new command op to 5256 tid=0[{"prefix": "cache drop"}] 2021-06-25T04:49:53.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d7ca43740 1 -- 172.21.15.57:0/2504005307 --> [v2:172.21.15.57:6834/792452299,v1:172.21.15.57:6835/792452299] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x29e5060 con 0x29e4bd0 2021-06-25T04:49:53.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d6b7fe700 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.57:6834/792452299,v1:172.21.15.57:6835/792452299] conn(0x29e4bd0 0x2a7b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:49:53.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d47fff700 10 client.5457 ms_handle_connect on v2:172.21.15.57:6834/792452299 2021-06-25T04:49:53.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:49:53.527+0000 7f5d6b7fe700 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.57:6834/792452299,v1:172.21.15.57:6835/792452299] conn(0x29e4bd0 0x2a7b300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d61749084d1de20d server_cookie=7160f8c8e55881a5 in_seq=0 out_seq=0 2021-06-25T04:50:04.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d47fff700 1 -- 172.21.15.57:0/2504005307 <== mds.0 v2:172.21.15.57:6834/792452299 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+380 (crc 0 0 0) 0x29e5060 con 0x29e4bd0 2021-06-25T04:50:04.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d47fff700 10 client.5457 handle_command_reply: tid=0 2021-06-25T04:50:04.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 1 client.5457 shutdown 2021-06-25T04:50:04.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 1 -- 172.21.15.57:0/2504005307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 msgr2=0x2a81ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:04.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a81ae0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f5d5c02a000 tx=0x7f5d5c012000).stop 2021-06-25T04:50:04.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 1 -- 172.21.15.57:0/2504005307 shutdown_connections 2021-06-25T04:50:04.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.57:6834/792452299,v1:172.21.15.57:6835/792452299] conn(0x29e4bd0 0x2a7b300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x29e4260 0x29e46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x29e6560 0x2a81fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 1 --2- 172.21.15.57:0/2504005307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x29e5b10 0x2a81ae0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d47fff700 0 client.5457 ms_handle_reset on v2:172.21.15.57:6834/792452299 2021-06-25T04:50:04.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 1 -- 172.21.15.57:0/2504005307 >> 172.21.15.57:0/2504005307 conn(0x29e39e0 msgr2=0x2a1a160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:04.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 1 -- 172.21.15.57:0/2504005307 shutdown_connections 2021-06-25T04:50:04.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 1 -- 172.21.15.57:0/2504005307 wait complete. 2021-06-25T04:50:04.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d7ca43740 20 client.5457 trim_cache size 0 max 16384 2021-06-25T04:50:04.739 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:50:04.739 INFO:teuthology.orchestra.run.smithi057.stdout: "client_recall": { 2021-06-25T04:50:04.739 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": 0, 2021-06-25T04:50:04.740 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "(0) Success", 2021-06-25T04:50:04.740 INFO:teuthology.orchestra.run.smithi057.stdout: "recalled": 220 2021-06-25T04:50:04.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:04.740 INFO:teuthology.orchestra.run.smithi057.stdout: "flush_journal": { 2021-06-25T04:50:04.741 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": 0, 2021-06-25T04:50:04.741 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "" 2021-06-25T04:50:04.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:04.741 INFO:teuthology.orchestra.run.smithi057.stdout: "trim_cache": { 2021-06-25T04:50:04.742 INFO:teuthology.orchestra.run.smithi057.stdout: "trimmed": 0 2021-06-25T04:50:04.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:04.742 INFO:teuthology.orchestra.run.smithi057.stdout: "cache": { 2021-06-25T04:50:04.742 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": { 2021-06-25T04:50:04.742 INFO:teuthology.orchestra.run.smithi057.stdout: "items": 19976, 2021-06-25T04:50:04.743 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes": 3098784 2021-06-25T04:50:04.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:04.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:04.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 11.200219912 2021-06-25T04:50:04.744 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:50:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 -- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d4c055450 msgr2=0x7f5d4c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d4c055450 0x7f5d4c057910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f5d5c019000 tx=0x7f5d5c014000).stop 2021-06-25T04:50:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 -- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c146910 msgr2=0x7f5d6c13f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c146910 0x7f5d6c13f5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f5d6c149f00 tx=0x7f5d6400cb20).stop 2021-06-25T04:50:04.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 -- 172.21.15.57:0/1484933720 shutdown_connections 2021-06-25T04:50:04.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d4c055450 0x7f5d4c057910 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c146910 0x7f5d6c13f5a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d6c0b4650 0x7f5d6c13f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 --2- 172.21.15.57:0/1484933720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d6c0b4140 0x7f5d6c0b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 -- 172.21.15.57:0/1484933720 >> 172.21.15.57:0/1484933720 conn(0x7f5d6c05c450 msgr2=0x7f5d6c1456a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:04.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 -- 172.21.15.57:0/1484933720 shutdown_connections 2021-06-25T04:50:04.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.727+0000 7f5d727f3700 1 -- 172.21.15.57:0/1484933720 wait complete. 2021-06-25T04:50:04.750 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-06-25T04:50:04.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:04.751 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:50:04.751 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:04.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:50:04.762 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-06-25T04:50:04.762 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-06-25T04:50:04.763 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:50:04.763 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:50:04.764 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:04.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:04.826 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:50:04.827 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:04.833 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:50:04.834 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:50:04.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:50:04.835 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:04.843 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:50:04.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45b1b5c700 1 Processor -- start 2021-06-25T04:50:04.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45b1b5c700 1 -- start start 2021-06-25T04:50:04.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45b1b5c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f45ac0a7670 0x7f45ac066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:04.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45b1b5c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45ac0b1930 0x7f45ac066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:04.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45b1b5c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac067410 con 0x7f45ac0b0020 2021-06-25T04:50:04.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45b1b5c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac0a7a50 con 0x7f45ac0b1930 2021-06-25T04:50:04.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45b1b5c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac1475e0 con 0x7f45ac0a7670 2021-06-25T04:50:04.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aaffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45ac0b1930 0x7f45ac066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aaffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45ac0b1930 0x7f45ac066f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37468/0 (socket says 172.21.15.57:37468) 2021-06-25T04:50:04.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aaffd700 1 -- 172.21.15.57:0/167346525 learned_addr learned my addr 172.21.15.57:0/167346525 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:04.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45abfff700 1 --1- 172.21.15.57:0/167346525 >> v1:172.21.15.57:6789/0 conn(0x7f45ac0b0020 0x7f45ac05f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54690/0 (socket says 172.21.15.57:54690) 2021-06-25T04:50:04.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45ab7fe700 1 --2- 172.21.15.57:0/167346525 >> v2:172.21.15.87:3300/0 conn(0x7f45ac0a7670 0x7f45ac066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:04.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aaffd700 1 -- 172.21.15.57:0/167346525 >> v2:172.21.15.87:3300/0 conn(0x7f45ac0a7670 msgr2=0x7f45ac066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:04.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aaffd700 1 --2- 172.21.15.57:0/167346525 >> v2:172.21.15.87:3300/0 conn(0x7f45ac0a7670 0x7f45ac066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aa7fc700 1 -- 172.21.15.57:0/167346525 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515741242 0 0) 0x7f45ac067410 con 0x7f45ac0b0020 2021-06-25T04:50:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aaffd700 1 -- 172.21.15.57:0/167346525 >> v1:172.21.15.57:6789/0 conn(0x7f45ac0b0020 legacy=0x7f45ac05f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aaffd700 1 -- 172.21.15.57:0/167346525 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac147880 con 0x7f45ac0b1930 2021-06-25T04:50:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aaffd700 1 --2- 172.21.15.57:0/167346525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b1930 0x7f45ac066f20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f459c002f70 tx=0x7f459c006eb0).ready entity=mon.0 client_cookie=7732a1e15d7cff7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aa7fc700 1 -- 172.21.15.57:0/167346525 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c00d5c0 con 0x7f45ac0b1930 2021-06-25T04:50:04.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aa7fc700 1 -- 172.21.15.57:0/167346525 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c000e90 con 0x7f45ac0b1930 2021-06-25T04:50:04.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45aa7fc700 1 -- 172.21.15.57:0/167346525 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c00d910 con 0x7f45ac0b1930 2021-06-25T04:50:04.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45b1b5c700 1 -- 172.21.15.57:0/167346525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b1930 msgr2=0x7f45ac066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:04.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.943+0000 7f45b1b5c700 1 --2- 172.21.15.57:0/167346525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b1930 0x7f45ac066f20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f459c002f70 tx=0x7f459c006eb0).stop 2021-06-25T04:50:04.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 -- 172.21.15.57:0/167346525 shutdown_connections 2021-06-25T04:50:04.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 --2- 172.21.15.57:0/167346525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b1930 0x7f45ac066f20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 --2- 172.21.15.57:0/167346525 >> v2:172.21.15.87:3300/0 conn(0x7f45ac0a7670 0x7f45ac066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 -- 172.21.15.57:0/167346525 >> 172.21.15.57:0/167346525 conn(0x7f45ac0b53a0 msgr2=0x7f45ac0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:04.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 -- 172.21.15.57:0/167346525 shutdown_connections 2021-06-25T04:50:04.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 -- 172.21.15.57:0/167346525 wait complete. 2021-06-25T04:50:04.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 Processor -- start 2021-06-25T04:50:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 -- start start 2021-06-25T04:50:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0a7670 0x7f45ac14d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:04.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45ac0b0020 0x7f45ac159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:04.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45ac0b1930 0x7f45ac159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:04.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac15a330 con 0x7f45ac0a7670 2021-06-25T04:50:04.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0ac220 con 0x7f45ac0b1930 2021-06-25T04:50:04.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45b1b5c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0ac580 con 0x7f45ac0b0020 2021-06-25T04:50:04.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45ab7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0a7670 0x7f45ac14d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45ab7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0a7670 0x7f45ac14d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37474/0 (socket says 172.21.15.57:37474) 2021-06-25T04:50:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45ab7fe700 1 -- 172.21.15.57:0/2545281074 learned_addr learned my addr 172.21.15.57:0/2545281074 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:04.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45abfff700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45ac0b1930 0x7f45ac159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:04.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.947+0000 7f45aaffd700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45ac0b0020 0x7f45ac159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:04.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45ab7fe700 1 -- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45ac0b0020 msgr2=0x7f45ac159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:04.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45ab7fe700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45ac0b0020 0x7f45ac159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45ab7fe700 1 -- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45ac0b1930 msgr2=0x7f45ac159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:04.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45ab7fe700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45ac0b1930 0x7f45ac159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:04.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45ab7fe700 1 -- 172.21.15.57:0/2545281074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c00b1e0 con 0x7f45ac0a7670 2021-06-25T04:50:04.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45ab7fe700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0a7670 0x7f45ac14d930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f45a000c000 tx=0x7f45a0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:04.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45a8ff9700 1 -- 172.21.15.57:0/2545281074 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45a0010780 con 0x7f45ac0a7670 2021-06-25T04:50:04.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45a8ff9700 1 -- 172.21.15.57:0/2545281074 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a000b3b0 con 0x7f45ac0a7670 2021-06-25T04:50:04.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45b1b5c700 1 -- 172.21.15.57:0/2545281074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac0ac820 con 0x7f45ac0a7670 2021-06-25T04:50:04.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45a8ff9700 1 -- 172.21.15.57:0/2545281074 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45a0010ad0 con 0x7f45ac0a7670 2021-06-25T04:50:04.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45b1b5c700 1 -- 172.21.15.57:0/2545281074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac0aef00 con 0x7f45ac0a7670 2021-06-25T04:50:04.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45b1b5c700 1 -- 172.21.15.57:0/2545281074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac0ad100 con 0x7f45ac0a7670 2021-06-25T04:50:04.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45a8ff9700 1 -- 172.21.15.57:0/2545281074 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f45a0010c30 con 0x7f45ac0a7670 2021-06-25T04:50:04.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45a8ff9700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 0x7f458c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:04.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45a8ff9700 1 -- 172.21.15.57:0/2545281074 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f45a006e200 con 0x7f45ac0a7670 2021-06-25T04:50:04.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.951+0000 7f45aaffd700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 0x7f458c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:04.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.955+0000 7f45aaffd700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 0x7f458c057910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f459c01b000 tx=0x7f459c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:04.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:04.959+0000 7f45a8ff9700 1 -- 172.21.15.57:0/2545281074 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f45ac0ad100 con 0x7f45ac0a7670 2021-06-25T04:50:05.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.087+0000 7f45b1b5c700 1 -- 172.21.15.57:0/2545281074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45ac0accc0 con 0x7f45ac0a7670 2021-06-25T04:50:05.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.087+0000 7f45a8ff9700 1 -- 172.21.15.57:0/2545281074 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f45ac0accc0 con 0x7f45ac0a7670 2021-06-25T04:50:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:50:05.094 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":46,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:49:36.652945+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:49:34.024108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-06-25T04:49:34.636596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:50:05.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.087+0000 7f45b1b5c700 1 -- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 msgr2=0x7f458c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.087+0000 7f45b1b5c700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 0x7f458c057910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f459c01b000 tx=0x7f459c015000).stop 2021-06-25T04:50:05.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.087+0000 7f45b1b5c700 1 -- 172.21.15.57:0/2545281074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0a7670 msgr2=0x7f45ac14d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.087+0000 7f45b1b5c700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0a7670 0x7f45ac14d930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f45a000c000 tx=0x7f45a0006df0).stop 2021-06-25T04:50:05.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.091+0000 7f45b1b5c700 1 -- 172.21.15.57:0/2545281074 shutdown_connections 2021-06-25T04:50:05.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.091+0000 7f45b1b5c700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 0x7f458c057910 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.091+0000 7f45b1b5c700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45ac0b1930 0x7f45ac159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.091+0000 7f45b1b5c700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45ac0b0020 0x7f45ac159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.091+0000 7f45b1b5c700 1 --2- 172.21.15.57:0/2545281074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0a7670 0x7f45ac14d930 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.091+0000 7f45b1b5c700 1 -- 172.21.15.57:0/2545281074 >> 172.21.15.57:0/2545281074 conn(0x7f45ac0b53a0 msgr2=0x7f45ac1458d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:05.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.091+0000 7f45b1b5c700 1 -- 172.21.15.57:0/2545281074 shutdown_connections 2021-06-25T04:50:05.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.091+0000 7f45b1b5c700 1 -- 172.21.15.57:0/2545281074 wait complete. 2021-06-25T04:50:05.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:49:34.024108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:49:34.636596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:50:05.108 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:50:05.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.207+0000 7f859ffff700 1 Processor -- start 2021-06-25T04:50:05.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.207+0000 7f859ffff700 1 -- start start 2021-06-25T04:50:05.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.207+0000 7f859ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f859803da40 0x7f85980417f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.207+0000 7f859ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8598042560 0x7f8598005630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.207+0000 7f859ffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8598041ce0 con 0x7f85980d88c0 2021-06-25T04:50:05.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.207+0000 7f859ffff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85980400d0 con 0x7f8598042560 2021-06-25T04:50:05.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.207+0000 7f859ffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859803de20 con 0x7f859803da40 2021-06-25T04:50:05.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f85980d88c0 0x7f85980d8d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54704/0 (socket says 172.21.15.57:54704) 2021-06-25T04:50:05.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859f7fe700 1 -- 172.21.15.57:0/3541978297 learned_addr learned my addr 172.21.15.57:0/3541978297 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:50:05.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859effd700 1 --2- 172.21.15.57:0/3541978297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f859803da40 0x7f85980417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859e7fc700 1 --2- 172.21.15.57:0/3541978297 >> v2:172.21.15.87:3300/0 conn(0x7f8598042560 0x7f8598005630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859dffb700 1 -- 172.21.15.57:0/3541978297 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305478639 0 0) 0x7f8598041ce0 con 0x7f85980d88c0 2021-06-25T04:50:05.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859dffb700 1 -- 172.21.15.57:0/3541978297 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8584003260 con 0x7f85980d88c0 2021-06-25T04:50:05.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859e7fc700 1 -- 172.21.15.57:0/3541978297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f859803da40 msgr2=0x7f85980417f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:05.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859e7fc700 1 --2- 172.21.15.57:0/3541978297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f859803da40 0x7f85980417f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859e7fc700 1 -- 172.21.15.57:0/3541978297 >> v1:172.21.15.57:6789/0 conn(0x7f85980d88c0 legacy=0x7f85980d8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859e7fc700 1 -- 172.21.15.57:0/3541978297 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598040fe0 con 0x7f8598042560 2021-06-25T04:50:05.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859e7fc700 1 --2- 172.21.15.57:0/3541978297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8598042560 0x7f8598005630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8594002f70 tx=0x7f8594006df0).ready entity=mon.1 client_cookie=d79f402d51e34351 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:05.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859dffb700 1 -- 172.21.15.57:0/3541978297 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f859400d4a0 con 0x7f8598042560 2021-06-25T04:50:05.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859dffb700 1 -- 172.21.15.57:0/3541978297 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8594000e90 con 0x7f8598042560 2021-06-25T04:50:05.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859dffb700 1 -- 172.21.15.57:0/3541978297 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f859400d7f0 con 0x7f8598042560 2021-06-25T04:50:05.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859ffff700 1 -- 172.21.15.57:0/3541978297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8598042560 msgr2=0x7f8598005630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859ffff700 1 --2- 172.21.15.57:0/3541978297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8598042560 0x7f8598005630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8594002f70 tx=0x7f8594006df0).stop 2021-06-25T04:50:05.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859ffff700 1 -- 172.21.15.57:0/3541978297 shutdown_connections 2021-06-25T04:50:05.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859ffff700 1 --2- 172.21.15.57:0/3541978297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8598042560 0x7f8598005630 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859ffff700 1 --2- 172.21.15.57:0/3541978297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f859803da40 0x7f85980417f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859ffff700 1 -- 172.21.15.57:0/3541978297 >> 172.21.15.57:0/3541978297 conn(0x7f85980462c0 msgr2=0x7f85980466d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:05.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859ffff700 1 -- 172.21.15.57:0/3541978297 shutdown_connections 2021-06-25T04:50:05.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859ffff700 1 -- 172.21.15.57:0/3541978297 wait complete. 2021-06-25T04:50:05.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859ffff700 1 Processor -- start 2021-06-25T04:50:05.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.211+0000 7f859ffff700 1 -- start start 2021-06-25T04:50:05.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859803da40 0x7f8598044200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8598042560 0x7f85980dd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85980d88c0 0x7f85980cf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859ffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85980de250 con 0x7f859803da40 2021-06-25T04:50:05.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859ffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85980dced0 con 0x7f85980d88c0 2021-06-25T04:50:05.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859ffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85980d0830 con 0x7f8598042560 2021-06-25T04:50:05.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859803da40 0x7f8598044200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859803da40 0x7f8598044200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37488/0 (socket says 172.21.15.57:37488) 2021-06-25T04:50:05.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859effd700 1 -- 172.21.15.57:0/2197440210 learned_addr learned my addr 172.21.15.57:0/2197440210 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:05.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859f7fe700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85980d88c0 0x7f85980cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859e7fc700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8598042560 0x7f85980dd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859effd700 1 -- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8598042560 msgr2=0x7f85980dd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859effd700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8598042560 0x7f85980dd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859effd700 1 -- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85980d88c0 msgr2=0x7f85980cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859effd700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85980d88c0 0x7f85980cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859effd700 1 -- 172.21.15.57:0/2197440210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859400b180 con 0x7f859803da40 2021-06-25T04:50:05.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859effd700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859803da40 0x7f8598044200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f859000c000 tx=0x7f8590006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:05.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f858ffff700 1 -- 172.21.15.57:0/2197440210 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8590010780 con 0x7f859803da40 2021-06-25T04:50:05.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f858ffff700 1 -- 172.21.15.57:0/2197440210 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85900108e0 con 0x7f859803da40 2021-06-25T04:50:05.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859ffff700 1 -- 172.21.15.57:0/2197440210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85980de680 con 0x7f859803da40 2021-06-25T04:50:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f858ffff700 1 -- 172.21.15.57:0/2197440210 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8590010c40 con 0x7f859803da40 2021-06-25T04:50:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859ffff700 1 -- 172.21.15.57:0/2197440210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85980dd7f0 con 0x7f859803da40 2021-06-25T04:50:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.215+0000 7f859ffff700 1 -- 172.21.15.57:0/2197440210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85980dd090 con 0x7f859803da40 2021-06-25T04:50:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.219+0000 7f858ffff700 1 -- 172.21.15.57:0/2197440210 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f859001c460 con 0x7f859803da40 2021-06-25T04:50:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.219+0000 7f858ffff700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f857c055510 0x7f857c0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.219+0000 7f858ffff700 1 -- 172.21.15.57:0/2197440210 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f859006e3f0 con 0x7f859803da40 2021-06-25T04:50:05.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.219+0000 7f859e7fc700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f857c055510 0x7f857c0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.219+0000 7f859e7fc700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f857c055510 0x7f857c0579d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f8594017000 tx=0x7f8594014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:05.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.223+0000 7f858ffff700 1 -- 172.21.15.57:0/2197440210 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f85900444a0 con 0x7f859803da40 2021-06-25T04:50:05.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 -- 172.21.15.57:0/2197440210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f85980d0670 con 0x7f859803da40 2021-06-25T04:50:05.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f858ffff700 1 -- 172.21.15.57:0/2197440210 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v46) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8590047ac0 con 0x7f859803da40 2021-06-25T04:50:05.349 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:50:05.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 -- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f857c055510 msgr2=0x7f857c0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f857c055510 0x7f857c0579d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f8594017000 tx=0x7f8594014000).stop 2021-06-25T04:50:05.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 -- 172.21.15.57:0/2197440210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859803da40 msgr2=0x7f8598044200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859803da40 0x7f8598044200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f859000c000 tx=0x7f8590006df0).stop 2021-06-25T04:50:05.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 -- 172.21.15.57:0/2197440210 shutdown_connections 2021-06-25T04:50:05.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f857c055510 0x7f857c0579d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85980d88c0 0x7f85980cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8598042560 0x7f85980dd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 --2- 172.21.15.57:0/2197440210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f859803da40 0x7f8598044200 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 -- 172.21.15.57:0/2197440210 >> 172.21.15.57:0/2197440210 conn(0x7f85980462c0 msgr2=0x7f8598043340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:05.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 -- 172.21.15.57:0/2197440210 shutdown_connections 2021-06-25T04:50:05.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.343+0000 7f859ffff700 1 -- 172.21.15.57:0/2197440210 wait complete. 2021-06-25T04:50:05.360 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:50:05.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.455+0000 7f7958efc700 1 Processor -- start 2021-06-25T04:50:05.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.455+0000 7f7958efc700 1 -- start start 2021-06-25T04:50:05.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f79540b36d0 0x7f79540b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79540a9bd0 0x7f79540b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79541438e0 con 0x7f79540b0570 2021-06-25T04:50:05.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7954143b80 con 0x7f79540b36d0 2021-06-25T04:50:05.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7954143e20 con 0x7f79540a9bd0 2021-06-25T04:50:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7949d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f79540b36d0 0x7f79540b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7949d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f79540b36d0 0x7f79540b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37498/0 (socket says 172.21.15.57:37498) 2021-06-25T04:50:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7949d9b700 1 -- 172.21.15.57:0/3062025148 learned_addr learned my addr 172.21.15.57:0/3062025148 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f795259c700 1 --1- 172.21.15.57:0/3062025148 >> v1:172.21.15.57:6789/0 conn(0x7f79540b0570 0x7f795413d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54714/0 (socket says 172.21.15.57:54714) 2021-06-25T04:50:05.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7952d9d700 1 --2- 172.21.15.57:0/3062025148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79540a9bd0 0x7f79540b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7949d9b700 1 -- 172.21.15.57:0/3062025148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79540a9bd0 msgr2=0x7f79540b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:05.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7949d9b700 1 --2- 172.21.15.57:0/3062025148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79540a9bd0 0x7f79540b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7949d9b700 1 -- 172.21.15.57:0/3062025148 >> v1:172.21.15.57:6789/0 conn(0x7f79540b0570 legacy=0x7f795413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7949d9b700 1 -- 172.21.15.57:0/3062025148 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79541440c0 con 0x7f79540b36d0 2021-06-25T04:50:05.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7949d9b700 1 --2- 172.21.15.57:0/3062025148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79540b36d0 0x7f79540b0950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f793c002f70 tx=0x7f793c006eb0).ready entity=mon.0 client_cookie=9e9501d69705fb5c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:05.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7951d9b700 1 -- 172.21.15.57:0/3062025148 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f793c00d5c0 con 0x7f79540b36d0 2021-06-25T04:50:05.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7951d9b700 1 -- 172.21.15.57:0/3062025148 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c000e90 con 0x7f79540b36d0 2021-06-25T04:50:05.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 -- 172.21.15.57:0/3062025148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79540b36d0 msgr2=0x7f79540b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7951d9b700 1 -- 172.21.15.57:0/3062025148 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f793c00d950 con 0x7f79540b36d0 2021-06-25T04:50:05.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 --2- 172.21.15.57:0/3062025148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79540b36d0 0x7f79540b0950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f793c002f70 tx=0x7f793c006eb0).stop 2021-06-25T04:50:05.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 -- 172.21.15.57:0/3062025148 shutdown_connections 2021-06-25T04:50:05.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 --2- 172.21.15.57:0/3062025148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79540a9bd0 0x7f79540b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 --2- 172.21.15.57:0/3062025148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79540b36d0 0x7f79540b0950 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 -- 172.21.15.57:0/3062025148 >> 172.21.15.57:0/3062025148 conn(0x7f7954060780 msgr2=0x7f7954060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:05.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 -- 172.21.15.57:0/3062025148 shutdown_connections 2021-06-25T04:50:05.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.459+0000 7f7958efc700 1 -- 172.21.15.57:0/3062025148 wait complete. 2021-06-25T04:50:05.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7958efc700 1 Processor -- start 2021-06-25T04:50:05.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7958efc700 1 -- start start 2021-06-25T04:50:05.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7958efc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79540a9bd0 0x7f7954140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7958efc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79540b0570 0x7f795413f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7958efc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79540b36d0 0x7f7954136800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7958efc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79540aa4c0 con 0x7f79540b36d0 2021-06-25T04:50:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7958efc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79540ab090 con 0x7f79540b0570 2021-06-25T04:50:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7958efc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79540aa6b0 con 0x7f79540a9bd0 2021-06-25T04:50:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7952d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79540b36d0 0x7f7954136800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7952d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79540b36d0 0x7f7954136800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37506/0 (socket says 172.21.15.57:37506) 2021-06-25T04:50:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7952d9d700 1 -- 172.21.15.57:0/2603127632 learned_addr learned my addr 172.21.15.57:0/2603127632 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7949d9b700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79540b0570 0x7f795413f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f795259c700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79540a9bd0 0x7f7954140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7952d9d700 1 -- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79540a9bd0 msgr2=0x7f7954140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7952d9d700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79540a9bd0 0x7f7954140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7952d9d700 1 -- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79540b0570 msgr2=0x7f795413f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7952d9d700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79540b0570 0x7f795413f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7952d9d700 1 -- 172.21.15.57:0/2603127632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c00b1e0 con 0x7f79540b36d0 2021-06-25T04:50:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7952d9d700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79540b36d0 0x7f7954136800 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f79540ab1d0 tx=0x7f794c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f794bfff700 1 -- 172.21.15.57:0/2603127632 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794c013620 con 0x7f79540b36d0 2021-06-25T04:50:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f794bfff700 1 -- 172.21.15.57:0/2603127632 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c013780 con 0x7f79540b36d0 2021-06-25T04:50:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7958efc700 1 -- 172.21.15.57:0/2603127632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79540aa950 con 0x7f79540b36d0 2021-06-25T04:50:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f794bfff700 1 -- 172.21.15.57:0/2603127632 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794c013ae0 con 0x7f79540b36d0 2021-06-25T04:50:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.463+0000 7f7958efc700 1 -- 172.21.15.57:0/2603127632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795413f790 con 0x7f79540b36d0 2021-06-25T04:50:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.467+0000 7f7958efc700 1 -- 172.21.15.57:0/2603127632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7954140370 con 0x7f79540b36d0 2021-06-25T04:50:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.467+0000 7f794bfff700 1 -- 172.21.15.57:0/2603127632 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f794c013c40 con 0x7f79540b36d0 2021-06-25T04:50:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.467+0000 7f794bfff700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7938055450 0x7f7938057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.467+0000 7f794bfff700 1 -- 172.21.15.57:0/2603127632 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f794c06e2d0 con 0x7f79540b36d0 2021-06-25T04:50:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.467+0000 7f795259c700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7938055450 0x7f7938057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.467+0000 7f795259c700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7938055450 0x7f7938057910 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f794400d000 tx=0x7f7944009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.471+0000 7f794bfff700 1 -- 172.21.15.57:0/2603127632 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7954140370 con 0x7f79540b36d0 2021-06-25T04:50:05.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 -- 172.21.15.57:0/2603127632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7954140370 con 0x7f79540b36d0 2021-06-25T04:50:05.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f794bfff700 1 -- 172.21.15.57:0/2603127632 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7954140370 con 0x7f79540b36d0 2021-06-25T04:50:05.600 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:50:05.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 -- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7938055450 msgr2=0x7f7938057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7938055450 0x7f7938057910 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f794400d000 tx=0x7f7944009040).stop 2021-06-25T04:50:05.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 -- 172.21.15.57:0/2603127632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79540b36d0 msgr2=0x7f7954136800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79540b36d0 0x7f7954136800 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f79540ab1d0 tx=0x7f794c008040).stop 2021-06-25T04:50:05.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 -- 172.21.15.57:0/2603127632 shutdown_connections 2021-06-25T04:50:05.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7938055450 0x7f7938057910 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79540b36d0 0x7f7954136800 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79540b0570 0x7f795413f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 --2- 172.21.15.57:0/2603127632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79540a9bd0 0x7f7954140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 -- 172.21.15.57:0/2603127632 >> 172.21.15.57:0/2603127632 conn(0x7f7954060780 msgr2=0x7f79541376c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:05.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 -- 172.21.15.57:0/2603127632 shutdown_connections 2021-06-25T04:50:05.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.595+0000 7f7958efc700 1 -- 172.21.15.57:0/2603127632 wait complete. 2021-06-25T04:50:05.616 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:50:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 Processor -- start 2021-06-25T04:50:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 -- start start 2021-06-25T04:50:05.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06980b2540 0x7f069814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f06980affd0 0x7f069814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f06980afb90 0x7f06980a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06980a7080 con 0x7f06980afb90 2021-06-25T04:50:05.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06980a72b0 con 0x7f06980affd0 2021-06-25T04:50:05.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980a7550 con 0x7f06980b2540 2021-06-25T04:50:05.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e1c2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f06980afb90 0x7f06980a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e1c2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f06980afb90 0x7f06980a8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37514/0 (socket says 172.21.15.57:37514) 2021-06-25T04:50:05.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e1c2700 1 -- 172.21.15.57:0/347127952 learned_addr learned my addr 172.21.15.57:0/347127952 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:05.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069d1c0700 1 --2- 172.21.15.57:0/347127952 >> v2:172.21.15.87:3300/0 conn(0x7f06980affd0 0x7f069814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069d9c1700 1 --2- 172.21.15.57:0/347127952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06980b2540 0x7f069814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e1c2700 1 -- 172.21.15.57:0/347127952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06980b2540 msgr2=0x7f069814ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:05.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e1c2700 1 --2- 172.21.15.57:0/347127952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06980b2540 0x7f069814ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e1c2700 1 -- 172.21.15.57:0/347127952 >> v2:172.21.15.87:3300/0 conn(0x7f06980affd0 msgr2=0x7f069814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:05.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e1c2700 1 --2- 172.21.15.57:0/347127952 >> v2:172.21.15.87:3300/0 conn(0x7f06980affd0 0x7f069814b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e1c2700 1 -- 172.21.15.57:0/347127952 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980a77f0 con 0x7f06980afb90 2021-06-25T04:50:05.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e1c2700 1 --2- 172.21.15.57:0/347127952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06980afb90 0x7f06980a8370 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f0690002f70 tx=0x7f0690006eb0).ready entity=mon.0 client_cookie=ac64c96d6838002d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:05.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069c9bf700 1 -- 172.21.15.57:0/347127952 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f069000d570 con 0x7f06980afb90 2021-06-25T04:50:05.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069c9bf700 1 -- 172.21.15.57:0/347127952 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0690000e90 con 0x7f06980afb90 2021-06-25T04:50:05.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069c9bf700 1 -- 172.21.15.57:0/347127952 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f069000d900 con 0x7f06980afb90 2021-06-25T04:50:05.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 -- 172.21.15.57:0/347127952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06980afb90 msgr2=0x7f06980a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 --2- 172.21.15.57:0/347127952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06980afb90 0x7f06980a8370 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f0690002f70 tx=0x7f0690006eb0).stop 2021-06-25T04:50:05.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 -- 172.21.15.57:0/347127952 shutdown_connections 2021-06-25T04:50:05.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 --2- 172.21.15.57:0/347127952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06980afb90 0x7f06980a8370 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 --2- 172.21.15.57:0/347127952 >> v2:172.21.15.87:3300/0 conn(0x7f06980affd0 0x7f069814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 --2- 172.21.15.57:0/347127952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06980b2540 0x7f069814ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 -- 172.21.15.57:0/347127952 >> 172.21.15.57:0/347127952 conn(0x7f0698060140 msgr2=0x7f06980b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:05.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 -- 172.21.15.57:0/347127952 shutdown_connections 2021-06-25T04:50:05.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.719+0000 7f069e9c3700 1 -- 172.21.15.57:0/347127952 wait complete. 2021-06-25T04:50:05.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069e9c3700 1 Processor -- start 2021-06-25T04:50:05.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069e9c3700 1 -- start start 2021-06-25T04:50:05.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069e9c3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06980afb90 0x7f06980b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069e9c3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06980affd0 0x7f06980a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069e9c3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06980b2540 0x7f0698156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069e9c3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980a9fd0 con 0x7f06980afb90 2021-06-25T04:50:05.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069e9c3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980aa270 con 0x7f06980b2540 2021-06-25T04:50:05.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069e9c3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980aa510 con 0x7f06980affd0 2021-06-25T04:50:05.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069d9c1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06980afb90 0x7f06980b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069d9c1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06980afb90 0x7f06980b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37518/0 (socket says 172.21.15.57:37518) 2021-06-25T04:50:05.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069d9c1700 1 -- 172.21.15.57:0/458303353 learned_addr learned my addr 172.21.15.57:0/458303353 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:05.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069d1c0700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06980affd0 0x7f06980a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069e1c2700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06980b2540 0x7f0698156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069d9c1700 1 -- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06980affd0 msgr2=0x7f06980a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069d9c1700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06980affd0 0x7f06980a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069d9c1700 1 -- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06980b2540 msgr2=0x7f0698156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069d9c1700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06980b2540 0x7f0698156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069d9c1700 1 -- 172.21.15.57:0/458303353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069000b1e0 con 0x7f06980afb90 2021-06-25T04:50:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069d9c1700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06980afb90 0x7f06980b3d20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f068c0030b0 tx=0x7f068c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f0696ffd700 1 -- 172.21.15.57:0/458303353 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f068c011780 con 0x7f06980afb90 2021-06-25T04:50:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f0696ffd700 1 -- 172.21.15.57:0/458303353 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c0118e0 con 0x7f06980afb90 2021-06-25T04:50:05.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069e9c3700 1 -- 172.21.15.57:0/458303353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06980aa7b0 con 0x7f06980afb90 2021-06-25T04:50:05.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f0696ffd700 1 -- 172.21.15.57:0/458303353 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f068c011c40 con 0x7f06980afb90 2021-06-25T04:50:05.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.723+0000 7f069e9c3700 1 -- 172.21.15.57:0/458303353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06980abad0 con 0x7f06980afb90 2021-06-25T04:50:05.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.727+0000 7f069e9c3700 1 -- 172.21.15.57:0/458303353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06981570f0 con 0x7f06980afb90 2021-06-25T04:50:05.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.727+0000 7f0696ffd700 1 -- 172.21.15.57:0/458303353 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f068c01c460 con 0x7f06980afb90 2021-06-25T04:50:05.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.727+0000 7f0696ffd700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0678055450 0x7f0678057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.727+0000 7f0696ffd700 1 -- 172.21.15.57:0/458303353 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f068c06e380 con 0x7f06980afb90 2021-06-25T04:50:05.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.727+0000 7f069d1c0700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0678055450 0x7f0678057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.731+0000 7f069d1c0700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0678055450 0x7f0678057910 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f068800d000 tx=0x7f0688008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:05.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.735+0000 7f0696ffd700 1 -- 172.21.15.57:0/458303353 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f068c044340 con 0x7f06980afb90 2021-06-25T04:50:05.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.863+0000 7f069e9c3700 1 -- 172.21.15.57:0/458303353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0698057310 con 0x7f06980afb90 2021-06-25T04:50:05.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.863+0000 7f0696ffd700 1 -- 172.21.15.57:0/458303353 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+10 (secure 0 0 0) 0x7f068c047960 con 0x7f06980afb90 2021-06-25T04:50:05.870 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:50:05.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 -- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0678055450 msgr2=0x7f0678057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0678055450 0x7f0678057910 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f068800d000 tx=0x7f0688008040).stop 2021-06-25T04:50:05.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 -- 172.21.15.57:0/458303353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06980afb90 msgr2=0x7f06980b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:05.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06980afb90 0x7f06980b3d20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f068c0030b0 tx=0x7f068c008040).stop 2021-06-25T04:50:05.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 -- 172.21.15.57:0/458303353 shutdown_connections 2021-06-25T04:50:05.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0678055450 0x7f0678057910 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06980b2540 0x7f0698156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06980affd0 0x7f06980a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 --2- 172.21.15.57:0/458303353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06980afb90 0x7f06980b3d20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:05.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 -- 172.21.15.57:0/458303353 >> 172.21.15.57:0/458303353 conn(0x7f0698060140 msgr2=0x7f06981498a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:05.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 -- 172.21.15.57:0/458303353 shutdown_connections 2021-06-25T04:50:05.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.867+0000 7f069e9c3700 1 -- 172.21.15.57:0/458303353 wait complete. 2021-06-25T04:50:05.883 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:50:05.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f262759e700 1 Processor -- start 2021-06-25T04:50:05.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f262759e700 1 -- start start 2021-06-25T04:50:05.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f262759e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f26280b2540 0x7f26280abad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f262759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 0x7f26280abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:05.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f262759e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26280add40 con 0x7f26280b1220 2021-06-25T04:50:05.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f262759e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280adfe0 con 0x7f26280b2540 2021-06-25T04:50:05.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f262759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280a9350 con 0x7f26280b02a0 2021-06-25T04:50:05.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f262659c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f26280b2540 0x7f26280abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f2626d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 0x7f26280abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:05.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f2626d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 0x7f26280abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:48692/0 (socket says 172.21.15.57:48692) 2021-06-25T04:50:05.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f2626d9d700 1 -- 172.21.15.57:0/1353826163 learned_addr learned my addr 172.21.15.57:0/1353826163 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:06.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f2626d9d700 1 -- 172.21.15.57:0/1353826163 >> v2:172.21.15.87:3300/0 conn(0x7f26280b2540 msgr2=0x7f26280abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:06.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f2626d9d700 1 --2- 172.21.15.57:0/1353826163 >> v2:172.21.15.87:3300/0 conn(0x7f26280b2540 0x7f26280abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f2626d9d700 1 -- 172.21.15.57:0/1353826163 >> v1:172.21.15.87:6789/0 conn(0x7f26280b1220 legacy=0x7f26280afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.987+0000 7f2626d9d700 1 -- 172.21.15.57:0/1353826163 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280a97f0 con 0x7f26280b02a0 2021-06-25T04:50:06.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f2626d9d700 1 --2- 172.21.15.57:0/1353826163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 0x7f26280abfc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f26200032f0 tx=0x7f2620009290).ready entity=mon.2 client_cookie=f13c84bc336e5bed server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:06.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262559a700 1 -- 172.21.15.57:0/1353826163 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262000b8a0 con 0x7f26280b02a0 2021-06-25T04:50:06.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262559a700 1 -- 172.21.15.57:0/1353826163 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000ba00 con 0x7f26280b02a0 2021-06-25T04:50:06.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262559a700 1 -- 172.21.15.57:0/1353826163 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262000bb70 con 0x7f26280b02a0 2021-06-25T04:50:06.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 -- 172.21.15.57:0/1353826163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 msgr2=0x7f26280abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 --2- 172.21.15.57:0/1353826163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 0x7f26280abfc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f26200032f0 tx=0x7f2620009290).stop 2021-06-25T04:50:06.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 -- 172.21.15.57:0/1353826163 shutdown_connections 2021-06-25T04:50:06.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 --2- 172.21.15.57:0/1353826163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 0x7f26280abfc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 --2- 172.21.15.57:0/1353826163 >> v2:172.21.15.87:3300/0 conn(0x7f26280b2540 0x7f26280abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 -- 172.21.15.57:0/1353826163 >> 172.21.15.57:0/1353826163 conn(0x7f2628060140 msgr2=0x7f26280b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:06.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 -- 172.21.15.57:0/1353826163 shutdown_connections 2021-06-25T04:50:06.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 -- 172.21.15.57:0/1353826163 wait complete. 2021-06-25T04:50:06.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 Processor -- start 2021-06-25T04:50:06.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 -- start start 2021-06-25T04:50:06.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 0x7f262813eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:06.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26280b1220 0x7f26280aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:06.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26280b2540 0x7f26280ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:06.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280ac430 con 0x7f26280b1220 2021-06-25T04:50:06.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280abfc0 con 0x7f26280b2540 2021-06-25T04:50:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280aaa90 con 0x7f26280b02a0 2021-06-25T04:50:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f2625d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26280b1220 0x7f26280aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f2626d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26280b2540 0x7f26280ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f2625d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26280b1220 0x7f26280aaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37534/0 (socket says 172.21.15.57:37534) 2021-06-25T04:50:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f2625d9b700 1 -- 172.21.15.57:0/3245290318 learned_addr learned my addr 172.21.15.57:0/3245290318 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:06.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.991+0000 7f262659c700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 0x7f262813eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:06.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f2626d9d700 1 -- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 msgr2=0x7f262813eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f2626d9d700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 0x7f262813eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f2626d9d700 1 -- 172.21.15.57:0/3245290318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26280b1220 msgr2=0x7f26280aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f2626d9d700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26280b1220 0x7f26280aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f2626d9d700 1 -- 172.21.15.57:0/3245290318 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2620009530 con 0x7f26280b2540 2021-06-25T04:50:06.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f2625d9b700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26280b1220 0x7f26280aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:50:06.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f262659c700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 0x7f262813eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:50:06.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f2626d9d700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26280b2540 0x7f26280ab420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f26200032f0 tx=0x7f2620016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:06.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f261f7fe700 1 -- 172.21.15.57:0/3245290318 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2620011b20 con 0x7f26280b2540 2021-06-25T04:50:06.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f261f7fe700 1 -- 172.21.15.57:0/3245290318 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620011c80 con 0x7f26280b2540 2021-06-25T04:50:06.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f262759e700 1 -- 172.21.15.57:0/3245290318 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2628062fc0 con 0x7f26280b2540 2021-06-25T04:50:06.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f261f7fe700 1 -- 172.21.15.57:0/3245290318 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2620020470 con 0x7f26280b2540 2021-06-25T04:50:06.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f262759e700 1 -- 172.21.15.57:0/3245290318 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26280634d0 con 0x7f26280b2540 2021-06-25T04:50:06.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f262759e700 1 -- 172.21.15.57:0/3245290318 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26280b2210 con 0x7f26280b2540 2021-06-25T04:50:06.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.995+0000 7f261f7fe700 1 -- 172.21.15.57:0/3245290318 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f262000f070 con 0x7f26280b2540 2021-06-25T04:50:06.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.999+0000 7f261f7fe700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f260c055490 0x7f260c057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:06.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.999+0000 7f261f7fe700 1 -- 172.21.15.57:0/3245290318 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f262006e960 con 0x7f26280b2540 2021-06-25T04:50:06.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.999+0000 7f262659c700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f260c055490 0x7f260c057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:06.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:05.999+0000 7f262659c700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f260c055490 0x7f260c057950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f261800a000 tx=0x7f2618006e80).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:06.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.007+0000 7f261f7fe700 1 -- 172.21.15.57:0/3245290318 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2620044b10 con 0x7f26280b2540 2021-06-25T04:50:06.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.131+0000 7f262759e700 1 -- 172.21.15.57:0/3245290318 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2628057310 con 0x7f26280b2540 2021-06-25T04:50:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.135+0000 7f261f7fe700 1 -- 172.21.15.57:0/3245290318 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2620015070 con 0x7f26280b2540 2021-06-25T04:50:06.140 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:50:06.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.135+0000 7f262759e700 1 -- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f260c055490 msgr2=0x7f260c057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.135+0000 7f262759e700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f260c055490 0x7f260c057950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f261800a000 tx=0x7f2618006e80).stop 2021-06-25T04:50:06.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.135+0000 7f262759e700 1 -- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26280b2540 msgr2=0x7f26280ab420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.135+0000 7f262759e700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26280b2540 0x7f26280ab420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f26200032f0 tx=0x7f2620016000).stop 2021-06-25T04:50:06.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.135+0000 7f262759e700 1 -- 172.21.15.57:0/3245290318 shutdown_connections 2021-06-25T04:50:06.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.135+0000 7f262759e700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f260c055490 0x7f260c057950 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.135+0000 7f262759e700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26280b2540 0x7f26280ab420 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.135+0000 7f262759e700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26280b1220 0x7f26280aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.135+0000 7f262759e700 1 --2- 172.21.15.57:0/3245290318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26280b02a0 0x7f262813eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.135+0000 7f262759e700 1 -- 172.21.15.57:0/3245290318 >> 172.21.15.57:0/3245290318 conn(0x7f2628060140 msgr2=0x7f26280b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:06.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.139+0000 7f262759e700 1 -- 172.21.15.57:0/3245290318 shutdown_connections 2021-06-25T04:50:06.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.139+0000 7f262759e700 1 -- 172.21.15.57:0/3245290318 wait complete. 2021-06-25T04:50:06.156 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:50:06.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:50:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f382b335700 1 Processor -- start 2021-06-25T04:50:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f382b335700 1 -- start start 2021-06-25T04:50:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f382b335700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38240b3200 0x7f3824147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f382b335700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f382405f670 0x7f3824060c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f382b335700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382405fac0 con 0x7f38240b2770 2021-06-25T04:50:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f382b335700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38240b35e0 con 0x7f382405f670 2021-06-25T04:50:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f382b335700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3824146830 con 0x7f38240b3200 2021-06-25T04:50:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f38298d2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f382405f670 0x7f3824060c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f38298d2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f382405f670 0x7f3824060c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37540/0 (socket says 172.21.15.57:37540) 2021-06-25T04:50:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f38288d0700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f38240b2770 0x7f3824060120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54760/0 (socket says 172.21.15.57:54760) 2021-06-25T04:50:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f38298d2700 1 -- 172.21.15.57:0/2801714073 learned_addr learned my addr 172.21.15.57:0/2801714073 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f38290d1700 1 --2- 172.21.15.57:0/2801714073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38240b3200 0x7f3824147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f38298d2700 1 -- 172.21.15.57:0/2801714073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38240b3200 msgr2=0x7f3824147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f38298d2700 1 --2- 172.21.15.57:0/2801714073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38240b3200 0x7f3824147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f38298d2700 1 -- 172.21.15.57:0/2801714073 >> v1:172.21.15.57:6789/0 conn(0x7f38240b2770 legacy=0x7f3824060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f38298d2700 1 -- 172.21.15.57:0/2801714073 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824146ad0 con 0x7f382405f670 2021-06-25T04:50:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f38298d2700 1 --2- 172.21.15.57:0/2801714073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f382405f670 0x7f3824060c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f381c002f70 tx=0x7f381c006eb0).ready entity=mon.0 client_cookie=f8067e168469c68d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f3817fff700 1 -- 172.21.15.57:0/2801714073 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381c00d5c0 con 0x7f382405f670 2021-06-25T04:50:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f3817fff700 1 -- 172.21.15.57:0/2801714073 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c000e90 con 0x7f382405f670 2021-06-25T04:50:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f3817fff700 1 -- 172.21.15.57:0/2801714073 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381c00d950 con 0x7f382405f670 2021-06-25T04:50:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f382b335700 1 -- 172.21.15.57:0/2801714073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f382405f670 msgr2=0x7f3824060c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.251+0000 7f382b335700 1 --2- 172.21.15.57:0/2801714073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f382405f670 0x7f3824060c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f381c002f70 tx=0x7f381c006eb0).stop 2021-06-25T04:50:06.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 -- 172.21.15.57:0/2801714073 shutdown_connections 2021-06-25T04:50:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 --2- 172.21.15.57:0/2801714073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f382405f670 0x7f3824060c80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 --2- 172.21.15.57:0/2801714073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38240b3200 0x7f3824147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 -- 172.21.15.57:0/2801714073 >> 172.21.15.57:0/2801714073 conn(0x7f382405c450 msgr2=0x7f382405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 -- 172.21.15.57:0/2801714073 shutdown_connections 2021-06-25T04:50:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 -- 172.21.15.57:0/2801714073 wait complete. 2021-06-25T04:50:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 Processor -- start 2021-06-25T04:50:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 -- start start 2021-06-25T04:50:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f382405f670 0x7f3824151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38240b2770 0x7f38240adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38240b3200 0x7f382414a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38240b04c0 con 0x7f382405f670 2021-06-25T04:50:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824155540 con 0x7f38240b3200 2021-06-25T04:50:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f382b335700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38240b06b0 con 0x7f38240b2770 2021-06-25T04:50:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f38290d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f382405f670 0x7f3824151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f38290d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f382405f670 0x7f3824151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37544/0 (socket says 172.21.15.57:37544) 2021-06-25T04:50:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f38290d1700 1 -- 172.21.15.57:0/3931112695 learned_addr learned my addr 172.21.15.57:0/3931112695 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f38288d0700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38240b2770 0x7f38240adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f38298d2700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38240b3200 0x7f382414a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f38290d1700 1 -- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38240b2770 msgr2=0x7f38240adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f38290d1700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38240b2770 0x7f38240adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f38290d1700 1 -- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38240b3200 msgr2=0x7f382414a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f38290d1700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38240b3200 0x7f382414a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.255+0000 7f38290d1700 1 -- 172.21.15.57:0/3931112695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c00b1e0 con 0x7f382405f670 2021-06-25T04:50:06.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.259+0000 7f38290d1700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f382405f670 0x7f3824151fd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f382000a000 tx=0x7f3820008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:06.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.259+0000 7f38167fc700 1 -- 172.21.15.57:0/3931112695 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3820011780 con 0x7f382405f670 2021-06-25T04:50:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.259+0000 7f38167fc700 1 -- 172.21.15.57:0/3931112695 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38200118e0 con 0x7f382405f670 2021-06-25T04:50:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.259+0000 7f382b335700 1 -- 172.21.15.57:0/3931112695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38240b0950 con 0x7f382405f670 2021-06-25T04:50:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.259+0000 7f38167fc700 1 -- 172.21.15.57:0/3931112695 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3820011c40 con 0x7f382405f670 2021-06-25T04:50:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.259+0000 7f382b335700 1 -- 172.21.15.57:0/3931112695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38240a2c80 con 0x7f382405f670 2021-06-25T04:50:06.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.259+0000 7f382b335700 1 -- 172.21.15.57:0/3931112695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3824057310 con 0x7f382405f670 2021-06-25T04:50:06.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.259+0000 7f38167fc700 1 -- 172.21.15.57:0/3931112695 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3820012420 con 0x7f382405f670 2021-06-25T04:50:06.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.263+0000 7f38167fc700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f380c0553f0 0x7f380c0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:06.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.263+0000 7f38167fc700 1 -- 172.21.15.57:0/3931112695 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f382006e440 con 0x7f382405f670 2021-06-25T04:50:06.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.263+0000 7f38288d0700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f380c0553f0 0x7f380c0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:06.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.263+0000 7f38288d0700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f380c0553f0 0x7f380c0578b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f381800d000 tx=0x7f3818007b40).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:06.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.267+0000 7f38167fc700 1 -- 172.21.15.57:0/3931112695 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3820044590 con 0x7f382405f670 2021-06-25T04:50:06.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.431+0000 7f382b335700 1 -- 172.21.15.57:0/3931112695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f382405d720 con 0x7f382405f670 2021-06-25T04:50:06.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f38167fc700 1 -- 172.21.15.57:0/3931112695 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f3820047bb0 con 0x7f382405f670 2021-06-25T04:50:06.440 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:50:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/587697587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":587697587},{"type":"v1","addr":"172.21.15.87:6835","nonce":587697587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/3950506435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3950506435},{"type":"v1","addr":"172.21.15.57:6833","nonce":3950506435}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:49:35.649253+0000","modified":"2021-06-25T04:49:36.652144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/792452299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":792452299},{"type":"v1","addr":"172.21.15.57:6835","nonce":792452299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-06-25T04:50:06.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 -- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f380c0553f0 msgr2=0x7f380c0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f380c0553f0 0x7f380c0578b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f381800d000 tx=0x7f3818007b40).stop 2021-06-25T04:50:06.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 -- 172.21.15.57:0/3931112695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f382405f670 msgr2=0x7f3824151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:06.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f382405f670 0x7f3824151fd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f382000a000 tx=0x7f3820008040).stop 2021-06-25T04:50:06.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 -- 172.21.15.57:0/3931112695 shutdown_connections 2021-06-25T04:50:06.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f380c0553f0 0x7f380c0578b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38240b3200 0x7f382414a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38240b2770 0x7f38240adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 --2- 172.21.15.57:0/3931112695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f382405f670 0x7f3824151fd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:06.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 -- 172.21.15.57:0/3931112695 >> 172.21.15.57:0/3931112695 conn(0x7f382405c450 msgr2=0x7f3824060120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:06.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 -- 172.21.15.57:0/3931112695 shutdown_connections 2021-06-25T04:50:06.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:06.435+0000 7f382b335700 1 -- 172.21.15.57:0/3931112695 wait complete. 2021-06-25T04:50:06.446 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2021-06-25T04:50:06.757 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:49:35.649253+0000', 'modified': '2021-06-25T04:49:36.652144+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5256}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5256': {'gid': 5256, 'name': 'c', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/792452299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 792452299}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 792452299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:50:06.758 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:50:06.758 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-06-25T04:50:06.878 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":5256,"want_state":"up:active","state":"up:active","rank_uptime":31.214211120000002,"mdsmap_epoch":18,"osdmap_epoch":46,"osdmap_epoch_barrier":45,"uptime":35.594769753999998} 2021-06-25T04:50:06.878 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 5256, "mdsmap_epoch": 18, "osdmap_epoch": 46, "osdmap_epoch_barrier": 45, "rank_uptime": 31.21421112, "state": "up:active", "uptime": 35.594769754, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:50:06.879 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:50:06.880 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:50:06.880 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:50:06.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:06.881 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:06.889 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:50:06.908 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:50:06.909 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:50:06.966 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:50:06.967 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:50:06.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:06.968 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:50:06.976 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:50:06.976 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:06.979 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:50:06.997 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:50:06.998 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:50:07.009 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:50:07.010 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:50:07.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:07.012 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:50:07.052 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:50:07.058+0000 7f07b41f4080 -1 init, newargv = 0x55705820db50 newargc=9ceph-fuse[14626]: starting ceph client 2021-06-25T04:50:07.053 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr: 2021-06-25T04:50:07.062 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14626]: starting fuse 2021-06-25T04:50:07.255 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:50:07.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:50:07.262 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:50:07.265 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:50:08.161 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:50:08.179 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:50:08.179 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:50:08.189 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:50:08.190 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:50:08.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:08.191 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:50:08.242 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:50:08.243 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:50:08.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:08.244 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:50:08.244 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:50:08.245 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:50:08.245 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:50:08.245 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:50:08.246 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:50:08.246 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:50:08.247 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:50:08.247 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:50:08.247 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:50:08.248 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:50:08.248 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:50:08.249 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:50:08.249 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:50:08.250 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:50:08.250 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:50:08.250 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:50:08.251 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:50:08.251 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:50:08.252 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:50:08.252 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:50:08.252 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:50:08.253 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:50:08.297 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.14626.asok 2021-06-25T04:50:08.302 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14626.asok 2021-06-25T04:50:08.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:08.303 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14626.asok status 2021-06-25T04:50:08.437 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:50:08.437 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:50:08.437 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:50:08.438 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:50:08.438 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:50:08.438 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:50:08.438 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:50:08.439 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "14626", 2021-06-25T04:50:08.439 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:50:08.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:50:08.439 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:50:08.440 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:50:08.440 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 5449, 2021-06-25T04:50:08.440 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:50:08.440 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:50:08.441 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:50:08.441 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 5449 2021-06-25T04:50:08.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:50:08.441 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:50:08.441 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:50:08.442 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:50:08.442 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2830340249 2021-06-25T04:50:08.442 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:50:08.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:50:08.443 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:50:08.443 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:50:08.443 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:50:08.443 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2830340249 2021-06-25T04:50:08.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:50:08.444 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.5449 172.21.15.102:0/2830340249", 2021-06-25T04:50:08.444 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/2830340249", 2021-06-25T04:50:08.444 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:50:08.444 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 18, 2021-06-25T04:50:08.445 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 46, 2021-06-25T04:50:08.445 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:50:08.445 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:50:08.445 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:50:08.445 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:50:08.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:08.448 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:50:08.448 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:08.455 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:50:08.456 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:50:08.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:08.457 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:37.330 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:50:37.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:50:37.337 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:50:37.339 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:50:56.281 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:50:56.282 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:50:56.303 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:50:56.325 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:50:56.346 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:50:56.368 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:50:56.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:56.370 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:50:56.371 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:56.397 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:50:56.398 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:50:56.398 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:50:56.399 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:50:56.399 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:56.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14626]: fuse finished with error 0 and tester_r 0 2021-06-25T04:50:56.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:56.417 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:50:56.417 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:56.425 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:50:56.426 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:50:56.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:50:56.518 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:50:56.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:50:56.525 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:50:56.526 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:50:56.539 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:50:56.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:50:56.540 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:50:56.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:50:56.541 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:50:56.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:50:56.552 INFO:teuthology.orchestra.run.smithi161.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:50:56.553 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:50:56.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab77647700 1 Processor -- start 2021-06-25T04:50:56.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab77647700 1 -- start start 2021-06-25T04:50:56.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab77647700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab70067140 0x7fab7005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:56.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab77647700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab700a7a50 con 0x7fab700a7670 2021-06-25T04:50:56.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab77647700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab701475e0 con 0x7fab700b1930 2021-06-25T04:50:56.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab77647700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab70147880 con 0x7fab70067140 2021-06-25T04:50:56.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab753e3700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fab700a7670 0x7fab70066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54770/0 (socket says 172.21.15.57:54770) 2021-06-25T04:50:56.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab753e3700 1 -- 172.21.15.57:0/2523735342 learned_addr learned my addr 172.21.15.57:0/2523735342 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:50:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab74be2700 1 --2- 172.21.15.57:0/2523735342 >> v2:172.21.15.87:3300/0 conn(0x7fab70067140 0x7fab7005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779569869 0 0) 0x7fab700a7a50 con 0x7fab700a7670 2021-06-25T04:50:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab54003260 con 0x7fab700a7670 2021-06-25T04:50:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3541372179 0 0) 0x7fab54003260 con 0x7fab700a7670 2021-06-25T04:50:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 >> v2:172.21.15.87:3300/0 conn(0x7fab70067140 msgr2=0x7fab7005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:56.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 --2- 172.21.15.57:0/2523735342 >> v2:172.21.15.87:3300/0 conn(0x7fab70067140 0x7fab7005f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:56.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 >> v1:172.21.15.87:6789/0 conn(0x7fab700b1930 legacy=0x7fab7005fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:56.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70147b20 con 0x7fab700a7670 2021-06-25T04:50:56.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fab640019e0 con 0x7fab700a7670 2021-06-25T04:50:56.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 >> v1:172.21.15.57:6789/0 conn(0x7fab700a7670 legacy=0x7fab70066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:56.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab54003750 0x7fab54003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:56.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab54004500 0x7fab54004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:56.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab54004e70 0x7fab5400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab70147880 con 0x7fab54003750 2021-06-25T04:50:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5400bc70 con 0x7fab54004500 2021-06-25T04:50:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5400be30 con 0x7fab54004e70 2021-06-25T04:50:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.659+0000 7fab753e3700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab54003750 0x7fab54003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab74be2700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab54004500 0x7fab54004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab75be4700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab54004e70 0x7fab5400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab74be2700 1 -- 172.21.15.57:0/2523735342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab54004e70 msgr2=0x7fab5400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab74be2700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab54004e70 0x7fab5400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab74be2700 1 -- 172.21.15.57:0/2523735342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab54003750 msgr2=0x7fab54003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab74be2700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab54003750 0x7fab54003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab74be2700 1 -- 172.21.15.57:0/2523735342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54003260 con 0x7fab54004500 2021-06-25T04:50:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab75be4700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab54004e70 0x7fab5400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:50:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab75be4700 1 -- 172.21.15.57:0/2523735342 reap_dead start 2021-06-25T04:50:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab74be2700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab54004500 0x7fab54004980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fab6c00c000 tx=0x7fab6c006df0).ready entity=mon.1 client_cookie=c656823a99a8f058 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:56.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab6c00e800 con 0x7fab54004500 2021-06-25T04:50:56.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c00e960 con 0x7fab54004500 2021-06-25T04:50:56.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab77647700 1 -- 172.21.15.57:0/2523735342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab54004500 msgr2=0x7fab54004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab63fff700 1 -- 172.21.15.57:0/2523735342 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab6c00ecc0 con 0x7fab54004500 2021-06-25T04:50:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab77647700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab54004500 0x7fab54004980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fab6c00c000 tx=0x7fab6c006df0).stop 2021-06-25T04:50:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab77647700 1 -- 172.21.15.57:0/2523735342 shutdown_connections 2021-06-25T04:50:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab77647700 1 --2- 172.21.15.57:0/2523735342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab54004500 0x7fab54004980 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab77647700 1 -- 172.21.15.57:0/2523735342 >> 172.21.15.57:0/2523735342 conn(0x7fab700b53a0 msgr2=0x7fab700b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:56.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab77647700 1 -- 172.21.15.57:0/2523735342 shutdown_connections 2021-06-25T04:50:56.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab77647700 1 -- 172.21.15.57:0/2523735342 wait complete. 2021-06-25T04:50:56.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab77647700 1 Processor -- start 2021-06-25T04:50:56.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.663+0000 7fab77647700 1 -- start start 2021-06-25T04:50:56.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab77647700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab54004500 0x7fab700b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:56.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab77647700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab70159c50 0x7fab7015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:56.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab77647700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70144260 0x7fab701446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:56.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab77647700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab700b4c10 con 0x7fab70159c50 2021-06-25T04:50:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab77647700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab700ac860 con 0x7fab70144260 2021-06-25T04:50:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab77647700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7015a5c0 con 0x7fab54004500 2021-06-25T04:50:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab74be2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab70159c50 0x7fab7015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab74be2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab70159c50 0x7fab7015a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37564/0 (socket says 172.21.15.57:37564) 2021-06-25T04:50:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab74be2700 1 -- 172.21.15.57:0/3684419933 learned_addr learned my addr 172.21.15.57:0/3684419933 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab753e3700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab54004500 0x7fab700b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab75be4700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70144260 0x7fab701446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab74be2700 1 -- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab54004500 msgr2=0x7fab700b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab74be2700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab54004500 0x7fab700b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab74be2700 1 -- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70144260 msgr2=0x7fab701446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab74be2700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70144260 0x7fab701446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:56.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab74be2700 1 -- 172.21.15.57:0/3684419933 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab700aebb0 con 0x7fab70159c50 2021-06-25T04:50:56.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab753e3700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab54004500 0x7fab700b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:50:56.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab75be4700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70144260 0x7fab701446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:50:56.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab74be2700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab70159c50 0x7fab7015a0d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fab700adcf0 tx=0x7fab6c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:56.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab62ffd700 1 -- 172.21.15.57:0/3684419933 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab6c01b820 con 0x7fab70159c50 2021-06-25T04:50:56.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab62ffd700 1 -- 172.21.15.57:0/3684419933 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c000e90 con 0x7fab70159c50 2021-06-25T04:50:56.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab77647700 1 -- 172.21.15.57:0/3684419933 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab700aee50 con 0x7fab70159c50 2021-06-25T04:50:56.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab62ffd700 1 -- 172.21.15.57:0/3684419933 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab6c01bb70 con 0x7fab70159c50 2021-06-25T04:50:56.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab77647700 1 -- 172.21.15.57:0/3684419933 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab700aae80 con 0x7fab70159c50 2021-06-25T04:50:56.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.667+0000 7fab77647700 1 -- 172.21.15.57:0/3684419933 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab70057310 con 0x7fab70159c50 2021-06-25T04:50:56.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.671+0000 7fab62ffd700 1 -- 172.21.15.57:0/3684419933 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fab6c01bcd0 con 0x7fab70159c50 2021-06-25T04:50:56.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.671+0000 7fab62ffd700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab4c0553f0 0x7fab4c0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:56.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.671+0000 7fab62ffd700 1 -- 172.21.15.57:0/3684419933 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fab6c06f460 con 0x7fab70159c50 2021-06-25T04:50:56.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.671+0000 7fab753e3700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab4c0553f0 0x7fab4c0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:56.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.671+0000 7fab753e3700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab4c0553f0 0x7fab4c0578b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fab64005000 tx=0x7fab64009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:56.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.675+0000 7fab62ffd700 1 -- 172.21.15.57:0/3684419933 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fab6c045500 con 0x7fab70159c50 2021-06-25T04:50:56.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.803+0000 7fab77647700 1 -- 172.21.15.57:0/3684419933 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fab70066670 con 0x7fab70159c50 2021-06-25T04:50:56.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.803+0000 7fab62ffd700 1 -- 172.21.15.57:0/3684419933 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v46) v1 ==== 81+0+34037 (secure 0 0 0) 0x7fab6c048b20 con 0x7fab70159c50 2021-06-25T04:50:56.811 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:50:56.811 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:50:56.811 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 46, 2021-06-25T04:50:56.812 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:50:56.813 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:50:56.814 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:49:36.652945+0000", 2021-06-25T04:50:56.814 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:50:56.815 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:50:56.815 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:50:56.816 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:50:56.816 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:50:56.817 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:50:56.817 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:50:56.818 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:50:56.818 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:50:56.819 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:50:56.819 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:50:56.819 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:50:56.820 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:50:56.820 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:50:56.821 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:50:56.821 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 8, 2021-06-25T04:50:56.822 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:50:56.822 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:50:56.822 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:50:56.823 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:50:56.823 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:50:56.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.825 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:50:56.825 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:50:56.826 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:50:56.826 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:50:56.827 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:50:56.828 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:50:56.828 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:50:56.828 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:50:56.829 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:50:56.829 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:50:56.830 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:50:56.831 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:50:56.831 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:50:56.831 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:50:56.832 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:50:56.832 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:50:56.833 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:50:56.833 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:50:56.834 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:50:56.834 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:50:56.835 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:50:56.835 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:50:56.836 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:50:56.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.837 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:50:56.838 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:50:56.838 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:50:56.838 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:50:56.839 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:50:56.839 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:50:56.840 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:50:56.840 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:50:56.841 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:50:56.841 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:50:56.841 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:50:56.842 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:50:56.843 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:50:56.843 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:50:56.843 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:50:56.844 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:50:56.844 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:50:56.845 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:50:56.847 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:50:56.847 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:50:56.847 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:50:56.848 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:50:56.848 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:50:56.849 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:50:56.849 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:50:56.849 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:50:56.849 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:50:56.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.850 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:50:56.850 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:50:56.850 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:50:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:50:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:50:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:50:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:50:56.852 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:50:56.852 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:50:56.852 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:50:56.852 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:50:56.853 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:50:56.853 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:50:56.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.854 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:50:56.855 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:50:56.855 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.856 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:50:56.856 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:50:56.857 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:50:56.857 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:50:56.857 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:50:56.857 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:50:56.858 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:50:56.858 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:50:56.858 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:50:56.858 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:50:56.859 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:50:56.859 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:50:56.859 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:50:56.859 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:50:56.860 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:50:56.860 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:50:56.860 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:50:56.861 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:50:56.861 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:50:56.862 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:50:56.862 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:50:56.862 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:50:56.862 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:50:56.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.863 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:50:56.863 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:50:56.863 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:50:56.864 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:50:56.864 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:50:56.864 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:50:56.864 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:50:56.864 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:50:56.865 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:50:56.865 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:50:56.865 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:50:56.865 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:50:56.866 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:50:56.866 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:50:56.866 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:50:56.866 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:50:56.867 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:50:56.867 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:50:56.867 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:50:56.867 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:50:56.867 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:50:56.868 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:50:56.868 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:50:56.868 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:50:56.868 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:50:56.869 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:50:56.869 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:50:56.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.869 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:50:56.870 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:50:56.870 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:50:56.870 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:50:56.870 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:50:56.870 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:50:56.871 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:50:56.871 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:50:56.871 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:50:56.871 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:50:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:50:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:50:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:50:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:50:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.873 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 7, 2021-06-25T04:50:56.873 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:50:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:49:34.024108+0000", 2021-06-25T04:50:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:50:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:50:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:50:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:50:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:50:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:50:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:50:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:50:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:50:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:50:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:50:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:50:56.877 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:50:56.877 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:50:56.877 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:50:56.877 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:50:56.877 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:50:56.878 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:50:56.878 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:50:56.878 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:50:56.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.879 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "45", 2021-06-25T04:50:56.879 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:50:56.879 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:50:56.879 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:50:56.879 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:50:56.880 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:50:56.880 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:50:56.880 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:50:56.880 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:50:56.881 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:50:56.881 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:50:56.881 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:50:56.881 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:50:56.882 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:50:56.882 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:50:56.882 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:50:56.882 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:50:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:50:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:50:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:50:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:50:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:50:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:50:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:50:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:50:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:50:56.885 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:50:56.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.885 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:50:56.885 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:50:56.886 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:50:56.886 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:50:56.886 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:50:56.886 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:50:56.887 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:50:56.887 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:50:56.887 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:50:56.888 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:50:56.888 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:50:56.888 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:50:56.888 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:50:56.888 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:50:56.889 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:50:56.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.889 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:50:56.889 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:50:56.890 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:50:56.890 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.890 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.891 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 8, 2021-06-25T04:50:56.891 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:50:56.891 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:49:34.636596+0000", 2021-06-25T04:50:56.891 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:50:56.892 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:50:56.892 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:50:56.892 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:50:56.892 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:50:56.893 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:50:56.893 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:50:56.893 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:50:56.893 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:50:56.893 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:50:56.894 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:50:56.894 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:50:56.894 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:50:56.894 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:50:56.895 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:50:56.895 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:50:56.895 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:50:56.895 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:50:56.896 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:50:56.896 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:50:56.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.896 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "46", 2021-06-25T04:50:56.896 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:50:56.897 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:50:56.897 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:50:56.897 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:50:56.897 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:50:56.898 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:50:56.898 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:50:56.898 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:50:56.898 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:50:56.899 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:50:56.899 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:50:56.899 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:50:56.899 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:50:56.899 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:50:56.900 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:50:56.900 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:50:56.900 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:50:56.900 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:50:56.901 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:50:56.901 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:50:56.901 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:50:56.901 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:50:56.901 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:50:56.902 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:50:56.902 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:50:56.902 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:50:56.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.903 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:50:56.903 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:50:56.903 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:50:56.904 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:50:56.904 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:50:56.904 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:50:56.904 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:50:56.905 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:50:56.905 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:50:56.905 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:50:56.905 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:50:56.906 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:50:56.906 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:50:56.906 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:50:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:50:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:50:56.908 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:50:56.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.908 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:50:56.908 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:50:56.909 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:50:56.909 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:50:56.909 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:50:56.909 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:50:56.910 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:50:56.910 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:50:56.910 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:50:56.910 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:50:56.910 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:50:56.911 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:50:56.911 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:50:56.911 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:50:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:50:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.913 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.913 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:50:56.913 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:50:56.913 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.914 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.914 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:50:56.914 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:50:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:50:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.916 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.916 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:50:56.916 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:50:56.917 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.917 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.917 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:50:56.917 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.918 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.918 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:50:56.918 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:50:56.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.919 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.919 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:50:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:50:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:50:56.921 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.921 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.921 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:50:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:50:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:50:56.923 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:50:56.923 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.923 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.924 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:50:56.924 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:50:56.924 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:50:56.924 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:50:56.924 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:50:56.925 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:50:56.925 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:50:56.925 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.926 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:50:56.926 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:50:56.926 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:50:56.926 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:50:56.927 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:50:56.927 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:50:56.927 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:50:56.927 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:50:56.928 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:50:56.928 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:50:56.928 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:50:56.928 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:50:56.928 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:50:56.929 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.929 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.929 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:50:56.930 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:50:56.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.930 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.931 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:50:56.931 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:50:56.931 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.931 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.932 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:50:56.932 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.932 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.933 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:50:56.933 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:50:56.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.933 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.934 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:50:56.934 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:50:56.934 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.934 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.935 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:50:56.935 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.935 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.936 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:50:56.936 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:50:56.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.937 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.937 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:50:56.937 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:50:56.937 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.937 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.938 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:50:56.938 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.939 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.939 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:50:56.939 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:50:56.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.940 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.940 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:50:56.940 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:50:56.940 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.941 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.941 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:50:56.941 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:50:56.942 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:50:56.942 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:50:56.942 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:50:56.942 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:50:56.942 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:50:56.943 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.943 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:50:56.944 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:50:56.944 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:50:56.944 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:50:56.944 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:50:56.944 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:50:56.945 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:50:56.945 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:50:56.945 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:50:56.945 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 32, 2021-06-25T04:50:56.945 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:50:56.946 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:50:56.946 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:50:56.946 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.947 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.947 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:50:56.947 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:50:56.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.948 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.948 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:50:56.948 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:50:56.949 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.949 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.949 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:50:56.950 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.950 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.950 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:50:56.951 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:50:56.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.951 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.952 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:50:56.952 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:50:56.952 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.952 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.953 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:50:56.953 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.953 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.954 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:50:56.954 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:50:56.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.954 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.955 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:50:56.955 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:50:56.955 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.955 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.956 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:50:56.956 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.957 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.957 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:50:56.957 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:50:56.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.958 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.958 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:50:56.958 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:50:56.958 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.959 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.959 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:50:56.959 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:50:56.960 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:50:56.960 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:50:56.960 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:50:56.960 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:50:56.960 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:50:56.961 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.961 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:50:56.962 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:50:56.962 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:50:56.962 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:50:56.962 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:50:56.962 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:50:56.963 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:50:56.963 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:50:56.963 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:50:56.963 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:50:56.964 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:50:56.964 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:50:56.964 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:50:56.964 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.965 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.965 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:50:56.965 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:50:56.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.966 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.966 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:50:56.966 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:50:56.966 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.967 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.967 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:50:56.967 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.968 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.968 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:50:56.968 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:50:56.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.969 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.969 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:50:56.969 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:50:56.970 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.970 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.970 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:50:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:50:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:50:56.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.972 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.972 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:50:56.973 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:50:56.973 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.973 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.973 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:50:56.974 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.974 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.974 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:50:56.975 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:50:56.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.975 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.975 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:50:56.976 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:50:56.976 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.976 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.977 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:50:56.977 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:50:56.977 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:50:56.978 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:50:56.978 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:50:56.978 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:50:56.978 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:50:56.979 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.979 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:50:56.979 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:50:56.980 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:50:56.980 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:50:56.980 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:50:56.980 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:50:56.981 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:50:56.981 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:50:56.981 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:50:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:50:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:50:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:50:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:50:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:50:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:50:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:50:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:50:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:50:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:50:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:50:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:50:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:50:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:50:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.991 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.991 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:50:56.991 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:50:56.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.992 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.992 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:50:56.992 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:50:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:50:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:50:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:50:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:50:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:50:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:50:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:50:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:50:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:50:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:50:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:50:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:50:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:50:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:50:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:50:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:50:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:50:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:50:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:50:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:50:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:50:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:50:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:50:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:50:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:50:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:50:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:50:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:50:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:50:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:50:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:50:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:50:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:50:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:50:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:50:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:50:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:50:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:50:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:50:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:50:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:50:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:50:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:50:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:50:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:50:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:50:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:50:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:50:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:50:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:50:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:50:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:50:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:50:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:50:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:50:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:50:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:50:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:50:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:50:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:50:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:50:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:50:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:50:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:50:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:50:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:50:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:50:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:50:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:50:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:50:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:50:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:50:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:50:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.025 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:50:57.025 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.025 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.026 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:50:57.026 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:50:57.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.026 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:50:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:50:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:50:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:50:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:50:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:50:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:50:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:50:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:50:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:50:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:50:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:50:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:50:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:50:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:50:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:50:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:50:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:50:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:50:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:50:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:50:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:50:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:50:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 42, 2021-06-25T04:50:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:50:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:50:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:50:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:50:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:50:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:50:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:50:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:50:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:50:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:50:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:50:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:50:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:50:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:50:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:50:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:50:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:50:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:50:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:50:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:50:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:50:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:50:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:50:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:50:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:50:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:50:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:50:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:50:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:50:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:50:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:50:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:50:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:50:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:50:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:50:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:50:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:50:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:50:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:50:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:50:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:50:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:50:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:50:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:50:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:50:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:50:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:50:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:50:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:50:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:50:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:50:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:50:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:50:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:50:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:50:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:50:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:50:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:50:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:50:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:50:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:50:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:50:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:50:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:50:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:50:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:50:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:50:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:50:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:50:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:50:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:50:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:50:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:50:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:50:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:50:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:50:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:50:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:50:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:50:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:50:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:50:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:50:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:50:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:50:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:50:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:50:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:50:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:50:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:50:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:50:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:50:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:50:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:50:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:50:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:50:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:50:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:50:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:50:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:50:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:50:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:50:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:50:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:50:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:50:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:50:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": {}, 2021-06-25T04:50:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:50:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:50:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:50:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:50:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:50:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:50:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:50:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:50:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:50:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:50:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:50:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:50:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:50:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:50:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:50:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:50:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:50:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:50:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:50:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:50:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:50:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:50:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:50:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:50:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:50:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:50:57.082 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:50:57.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 -- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab4c0553f0 msgr2=0x7fab4c0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab4c0553f0 0x7fab4c0578b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fab64005000 tx=0x7fab64009040).stop 2021-06-25T04:50:57.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 -- 172.21.15.57:0/3684419933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab70159c50 msgr2=0x7fab7015a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab70159c50 0x7fab7015a0d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fab700adcf0 tx=0x7fab6c019000).stop 2021-06-25T04:50:57.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 -- 172.21.15.57:0/3684419933 shutdown_connections 2021-06-25T04:50:57.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab4c0553f0 0x7fab4c0578b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70144260 0x7fab701446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab70159c50 0x7fab7015a0d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 --2- 172.21.15.57:0/3684419933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab54004500 0x7fab700b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 -- 172.21.15.57:0/3684419933 >> 172.21.15.57:0/3684419933 conn(0x7fab700b53a0 msgr2=0x7fab701489c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 -- 172.21.15.57:0/3684419933 shutdown_connections 2021-06-25T04:50:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:56.807+0000 7fab77647700 1 -- 172.21.15.57:0/3684419933 wait complete. 2021-06-25T04:50:57.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:50:57.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f084d549700 1 Processor -- start 2021-06-25T04:50:57.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f084d549700 1 -- start start 2021-06-25T04:50:57.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f084d549700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0848140ee0 0x7f0848066de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f084d549700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08481445c0 con 0x7f08480b1f10 2021-06-25T04:50:57.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f084d549700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08480b42a0 con 0x7f0848066a00 2021-06-25T04:50:57.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f084d549700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0848141f30 con 0x7f0848140ee0 2021-06-25T04:50:57.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f08467fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0848140ee0 0x7f0848066de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f08467fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0848140ee0 0x7f0848066de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37574/0 (socket says 172.21.15.57:37574) 2021-06-25T04:50:57.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f08467fc700 1 -- 172.21.15.57:0/545738766 learned_addr learned my addr 172.21.15.57:0/545738766 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:57.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f08477fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f08480b1f10 0x7f0848144a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54794/0 (socket says 172.21.15.57:54794) 2021-06-25T04:50:57.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f08467fc700 1 -- 172.21.15.57:0/545738766 >> v1:172.21.15.87:6789/0 conn(0x7f0848066a00 legacy=0x7f084813e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f08467fc700 1 -- 172.21.15.57:0/545738766 >> v1:172.21.15.57:6789/0 conn(0x7f08480b1f10 legacy=0x7f0848144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f08467fc700 1 -- 172.21.15.57:0/545738766 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480aaf10 con 0x7f0848140ee0 2021-06-25T04:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f08467fc700 1 --2- 172.21.15.57:0/545738766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0848140ee0 0x7f0848066de0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f08400032f0 tx=0x7f0840009290).ready entity=mon.0 client_cookie=59dbbc546ae510b2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f0845ffb700 1 -- 172.21.15.57:0/545738766 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f084000b8a0 con 0x7f0848140ee0 2021-06-25T04:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f0845ffb700 1 -- 172.21.15.57:0/545738766 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084000ba00 con 0x7f0848140ee0 2021-06-25T04:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f0845ffb700 1 -- 172.21.15.57:0/545738766 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f084000bb70 con 0x7f0848140ee0 2021-06-25T04:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f084d549700 1 -- 172.21.15.57:0/545738766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0848140ee0 msgr2=0x7f0848066de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.203+0000 7f084d549700 1 --2- 172.21.15.57:0/545738766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0848140ee0 0x7f0848066de0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f08400032f0 tx=0x7f0840009290).stop 2021-06-25T04:50:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.207+0000 7f084d549700 1 -- 172.21.15.57:0/545738766 shutdown_connections 2021-06-25T04:50:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.207+0000 7f084d549700 1 --2- 172.21.15.57:0/545738766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0848140ee0 0x7f0848066de0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.207+0000 7f084d549700 1 -- 172.21.15.57:0/545738766 >> 172.21.15.57:0/545738766 conn(0x7f084805c450 msgr2=0x7f084805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.207+0000 7f084d549700 1 -- 172.21.15.57:0/545738766 shutdown_connections 2021-06-25T04:50:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.207+0000 7f084d549700 1 -- 172.21.15.57:0/545738766 wait complete. 2021-06-25T04:50:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.207+0000 7f084d549700 1 Processor -- start 2021-06-25T04:50:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.207+0000 7f084d549700 1 -- start start 2021-06-25T04:50:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f084d549700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0848066a00 0x7f084813ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f084d549700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08480b1f10 0x7f08480af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f084d549700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0848143c90 0x7f0848142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f084d549700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0848062050 con 0x7f08480b1f10 2021-06-25T04:50:57.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f084d549700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0848062520 con 0x7f0848143c90 2021-06-25T04:50:57.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f084d549700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0848062750 con 0x7f0848066a00 2021-06-25T04:50:57.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f08467fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08480b1f10 0x7f08480af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f08467fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08480b1f10 0x7f08480af880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37580/0 (socket says 172.21.15.57:37580) 2021-06-25T04:50:57.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f08467fc700 1 -- 172.21.15.57:0/1206234313 learned_addr learned my addr 172.21.15.57:0/1206234313 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:57.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f0846ffd700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0848066a00 0x7f084813ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f08477fe700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0848143c90 0x7f0848142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f08467fc700 1 -- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0848066a00 msgr2=0x7f084813ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f08467fc700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0848066a00 0x7f084813ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f08467fc700 1 -- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0848143c90 msgr2=0x7f0848142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f08467fc700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0848143c90 0x7f0848142890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f08467fc700 1 -- 172.21.15.57:0/1206234313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0840009530 con 0x7f08480b1f10 2021-06-25T04:50:57.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f08477fe700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0848143c90 0x7f0848142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:50:57.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f08467fc700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08480b1f10 0x7f08480af880 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f08400032f0 tx=0x7f0840016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:57.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f083ffff700 1 -- 172.21.15.57:0/1206234313 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0840011dc0 con 0x7f08480b1f10 2021-06-25T04:50:57.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f083ffff700 1 -- 172.21.15.57:0/1206234313 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840021440 con 0x7f08480b1f10 2021-06-25T04:50:57.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f084d549700 1 -- 172.21.15.57:0/1206234313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08480afd70 con 0x7f08480b1f10 2021-06-25T04:50:57.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f083ffff700 1 -- 172.21.15.57:0/1206234313 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08400217a0 con 0x7f08480b1f10 2021-06-25T04:50:57.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.211+0000 7f084d549700 1 -- 172.21.15.57:0/1206234313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0848062280 con 0x7f08480b1f10 2021-06-25T04:50:57.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.215+0000 7f084d549700 1 -- 172.21.15.57:0/1206234313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0848057310 con 0x7f08480b1f10 2021-06-25T04:50:57.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.215+0000 7f083ffff700 1 -- 172.21.15.57:0/1206234313 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0840027020 con 0x7f08480b1f10 2021-06-25T04:50:57.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.215+0000 7f083ffff700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0820055450 0x7f0820057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.215+0000 7f083ffff700 1 -- 172.21.15.57:0/1206234313 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f084006f160 con 0x7f08480b1f10 2021-06-25T04:50:57.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.215+0000 7f0846ffd700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0820055450 0x7f0820057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.215+0000 7f0846ffd700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0820055450 0x7f0820057910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f083000d000 tx=0x7f0830000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:57.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.219+0000 7f083ffff700 1 -- 172.21.15.57:0/1206234313 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0840045310 con 0x7f08480b1f10 2021-06-25T04:50:57.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.383+0000 7f084d549700 1 -- 172.21.15.57:0/1206234313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0848142590 con 0x7f08480b1f10 2021-06-25T04:50:57.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.383+0000 7f083ffff700 1 -- 172.21.15.57:0/1206234313 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f08400159d0 con 0x7f08480b1f10 2021-06-25T04:50:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:50:57.391 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/587697587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":587697587},{"type":"v1","addr":"172.21.15.87:6835","nonce":587697587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/3950506435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3950506435},{"type":"v1","addr":"172.21.15.57:6833","nonce":3950506435}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:49:35.649253+0000","modified":"2021-06-25T04:49:36.652144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/792452299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":792452299},{"type":"v1","addr":"172.21.15.57:6835","nonce":792452299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-06-25T04:50:57.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 -- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0820055450 msgr2=0x7f0820057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0820055450 0x7f0820057910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f083000d000 tx=0x7f0830000bc0).stop 2021-06-25T04:50:57.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 -- 172.21.15.57:0/1206234313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08480b1f10 msgr2=0x7f08480af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08480b1f10 0x7f08480af880 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f08400032f0 tx=0x7f0840016000).stop 2021-06-25T04:50:57.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 -- 172.21.15.57:0/1206234313 shutdown_connections 2021-06-25T04:50:57.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0820055450 0x7f0820057910 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0848143c90 0x7f0848142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08480b1f10 0x7f08480af880 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 --2- 172.21.15.57:0/1206234313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0848066a00 0x7f084813ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 -- 172.21.15.57:0/1206234313 >> 172.21.15.57:0/1206234313 conn(0x7f084805c450 msgr2=0x7f0848066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:57.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 -- 172.21.15.57:0/1206234313 shutdown_connections 2021-06-25T04:50:57.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.387+0000 7f084d549700 1 -- 172.21.15.57:0/1206234313 wait complete. 2021-06-25T04:50:57.398 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2021-06-25T04:50:57.407 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:50:57.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 Processor -- start 2021-06-25T04:50:57.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 -- start start 2021-06-25T04:50:57.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6080b21c0 0x7fb6080abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb6080aff90 0x7fb6080ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb608141660 0x7fb608141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080ac7a0 con 0x7fb608141660 2021-06-25T04:50:57.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb608145210 con 0x7fb6080aff90 2021-06-25T04:50:57.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6081454b0 con 0x7fb6080b21c0 2021-06-25T04:50:57.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb6077fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb608141660 0x7fb608141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb6077fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb608141660 0x7fb608141ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37590/0 (socket says 172.21.15.57:37590) 2021-06-25T04:50:57.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb6077fe700 1 -- 172.21.15.57:0/319730737 learned_addr learned my addr 172.21.15.57:0/319730737 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:57.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb6067fc700 1 --2- 172.21.15.57:0/319730737 >> v2:172.21.15.87:3300/0 conn(0x7fb6080aff90 0x7fb6080ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb606ffd700 1 --2- 172.21.15.57:0/319730737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6080b21c0 0x7fb6080abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb6077fe700 1 -- 172.21.15.57:0/319730737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6080b21c0 msgr2=0x7fb6080abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:57.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb6077fe700 1 --2- 172.21.15.57:0/319730737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6080b21c0 0x7fb6080abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb6077fe700 1 -- 172.21.15.57:0/319730737 >> v2:172.21.15.87:3300/0 conn(0x7fb6080aff90 msgr2=0x7fb6080ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:57.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb6077fe700 1 --2- 172.21.15.57:0/319730737 >> v2:172.21.15.87:3300/0 conn(0x7fb6080aff90 0x7fb6080ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb6077fe700 1 -- 172.21.15.57:0/319730737 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6081411c0 con 0x7fb608141660 2021-06-25T04:50:57.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb6067fc700 1 --2- 172.21.15.57:0/319730737 >> v2:172.21.15.87:3300/0 conn(0x7fb6080aff90 0x7fb6080ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:50:57.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb6077fe700 1 --2- 172.21.15.57:0/319730737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb608141660 0x7fb608141ab0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fb6000032f0 tx=0x7fb600009290).ready entity=mon.0 client_cookie=59f5615c91c1dd1c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:57.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb605ffb700 1 -- 172.21.15.57:0/319730737 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60000b680 con 0x7fb608141660 2021-06-25T04:50:57.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb605ffb700 1 -- 172.21.15.57:0/319730737 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60000b7e0 con 0x7fb608141660 2021-06-25T04:50:57.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb605ffb700 1 -- 172.21.15.57:0/319730737 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60000b950 con 0x7fb608141660 2021-06-25T04:50:57.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 -- 172.21.15.57:0/319730737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb608141660 msgr2=0x7fb608141ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 --2- 172.21.15.57:0/319730737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb608141660 0x7fb608141ab0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fb6000032f0 tx=0x7fb600009290).stop 2021-06-25T04:50:57.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 -- 172.21.15.57:0/319730737 shutdown_connections 2021-06-25T04:50:57.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 --2- 172.21.15.57:0/319730737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb608141660 0x7fb608141ab0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 --2- 172.21.15.57:0/319730737 >> v2:172.21.15.87:3300/0 conn(0x7fb6080aff90 0x7fb6080ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 --2- 172.21.15.57:0/319730737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6080b21c0 0x7fb6080abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 -- 172.21.15.57:0/319730737 >> 172.21.15.57:0/319730737 conn(0x7fb60805f670 msgr2=0x7fb60805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:57.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 -- 172.21.15.57:0/319730737 shutdown_connections 2021-06-25T04:50:57.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.499+0000 7fb60da50700 1 -- 172.21.15.57:0/319730737 wait complete. 2021-06-25T04:50:57.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb60da50700 1 Processor -- start 2021-06-25T04:50:57.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb60da50700 1 -- start start 2021-06-25T04:50:57.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb60da50700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6080aff90 0x7fb608144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb60da50700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6080b21c0 0x7fb60813de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb60da50700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb608141660 0x7fb60813e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb60da50700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60813bb00 con 0x7fb608141660 2021-06-25T04:50:57.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb60da50700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60813d130 con 0x7fb6080b21c0 2021-06-25T04:50:57.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb60da50700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60813e7f0 con 0x7fb6080aff90 2021-06-25T04:50:57.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb6077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb608141660 0x7fb60813e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb6077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb608141660 0x7fb60813e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37594/0 (socket says 172.21.15.57:37594) 2021-06-25T04:50:57.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb6077fe700 1 -- 172.21.15.57:0/2078905741 learned_addr learned my addr 172.21.15.57:0/2078905741 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:57.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb6067fc700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6080b21c0 0x7fb60813de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb606ffd700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6080aff90 0x7fb608144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb6077fe700 1 -- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6080aff90 msgr2=0x7fb608144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb6077fe700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6080aff90 0x7fb608144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb6077fe700 1 -- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6080b21c0 msgr2=0x7fb60813de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:57.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb6077fe700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6080b21c0 0x7fb60813de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:57.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb6077fe700 1 -- 172.21.15.57:0/2078905741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f800b180 con 0x7fb608141660 2021-06-25T04:50:57.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb6077fe700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb608141660 0x7fb60813e300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fb6080b5150 tx=0x7fb600017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:57.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb5fffff700 1 -- 172.21.15.57:0/2078905741 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60001e070 con 0x7fb608141660 2021-06-25T04:50:57.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb5fffff700 1 -- 172.21.15.57:0/2078905741 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb600011c20 con 0x7fb608141660 2021-06-25T04:50:57.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb5fffff700 1 -- 172.21.15.57:0/2078905741 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60001a430 con 0x7fb608141660 2021-06-25T04:50:57.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb60da50700 1 -- 172.21.15.57:0/2078905741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb600009530 con 0x7fb608141660 2021-06-25T04:50:57.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.503+0000 7fb60da50700 1 -- 172.21.15.57:0/2078905741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60813d360 con 0x7fb608141660 2021-06-25T04:50:57.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.507+0000 7fb60da50700 1 -- 172.21.15.57:0/2078905741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60813d7a0 con 0x7fb608141660 2021-06-25T04:50:57.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.507+0000 7fb5fffff700 1 -- 172.21.15.57:0/2078905741 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb60000f070 con 0x7fb608141660 2021-06-25T04:50:57.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.507+0000 7fb5fffff700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5ec0554e0 0x7fb5ec0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:57.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.507+0000 7fb5fffff700 1 -- 172.21.15.57:0/2078905741 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb60006e800 con 0x7fb608141660 2021-06-25T04:50:57.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.507+0000 7fb606ffd700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5ec0554e0 0x7fb5ec0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:57.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.507+0000 7fb606ffd700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5ec0554e0 0x7fb5ec0579a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fb5f000b000 tx=0x7fb5f0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:57.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.511+0000 7fb5fffff700 1 -- 172.21.15.57:0/2078905741 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb6000449b0 con 0x7fb608141660 2021-06-25T04:50:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:57.671+0000 7fb60da50700 1 -- 172.21.15.57:0/2078905741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb608057310 con 0x7fb608141660 2021-06-25T04:50:58.577 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:50:58.571+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:50:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.579+0000 7fb5fffff700 1 -- 172.21.15.57:0/2078905741 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb600047fd0 con 0x7fb608141660 2021-06-25T04:50:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 -- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5ec0554e0 msgr2=0x7fb5ec0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5ec0554e0 0x7fb5ec0579a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fb5f000b000 tx=0x7fb5f0008040).stop 2021-06-25T04:50:58.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 -- 172.21.15.57:0/2078905741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb608141660 msgr2=0x7fb60813e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:58.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb608141660 0x7fb60813e300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fb6080b5150 tx=0x7fb600017000).stop 2021-06-25T04:50:58.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 -- 172.21.15.57:0/2078905741 shutdown_connections 2021-06-25T04:50:58.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5ec0554e0 0x7fb5ec0579a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb608141660 0x7fb60813e300 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6080b21c0 0x7fb60813de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 --2- 172.21.15.57:0/2078905741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6080aff90 0x7fb608144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 -- 172.21.15.57:0/2078905741 >> 172.21.15.57:0/2078905741 conn(0x7fb60805f670 msgr2=0x7fb608066f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:58.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 -- 172.21.15.57:0/2078905741 shutdown_connections 2021-06-25T04:50:58.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.583+0000 7fb60da50700 1 -- 172.21.15.57:0/2078905741 wait complete. 2021-06-25T04:50:58.594 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:50:58.604 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:50:58.627 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:50:58.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.695+0000 7f431836a700 1 Processor -- start 2021-06-25T04:50:58.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.695+0000 7f431836a700 1 -- start start 2021-06-25T04:50:58.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.695+0000 7f431836a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f43100b2770 0x7f4310147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:58.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.695+0000 7f431836a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f431005f670 0x7f4310060c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:58.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.695+0000 7f431836a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43100b35e0 con 0x7f43100b3200 2021-06-25T04:50:58.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.695+0000 7f431836a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f431005fa80 con 0x7f431005f670 2021-06-25T04:50:58.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.695+0000 7f431836a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4310146830 con 0x7f43100b2770 2021-06-25T04:50:58.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.695+0000 7f4316907700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f431005f670 0x7f4310060c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:58.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4316907700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f431005f670 0x7f4310060c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37616/0 (socket says 172.21.15.57:37616) 2021-06-25T04:50:58.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4316106700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f43100b3200 0x7f4310060120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54830/0 (socket says 172.21.15.57:54830) 2021-06-25T04:50:58.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4316907700 1 -- 172.21.15.57:0/621215898 learned_addr learned my addr 172.21.15.57:0/621215898 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:58.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4315905700 1 --2- 172.21.15.57:0/621215898 >> v2:172.21.15.87:3300/0 conn(0x7f43100b2770 0x7f4310147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:58.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4316907700 1 -- 172.21.15.57:0/621215898 >> v2:172.21.15.87:3300/0 conn(0x7f43100b2770 msgr2=0x7f4310147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:58.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4316907700 1 --2- 172.21.15.57:0/621215898 >> v2:172.21.15.87:3300/0 conn(0x7f43100b2770 0x7f4310147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4316907700 1 -- 172.21.15.57:0/621215898 >> v1:172.21.15.57:6789/0 conn(0x7f43100b3200 legacy=0x7f4310060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:58.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4315104700 1 -- 172.21.15.57:0/621215898 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937627714 0 0) 0x7f43100b35e0 con 0x7f43100b3200 2021-06-25T04:50:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4316907700 1 -- 172.21.15.57:0/621215898 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4310146ad0 con 0x7f431005f670 2021-06-25T04:50:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4316907700 1 --2- 172.21.15.57:0/621215898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f431005f670 0x7f4310060c80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f4308002f70 tx=0x7f4308006eb0).ready entity=mon.0 client_cookie=27616b90bc34b4f6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4315104700 1 -- 172.21.15.57:0/621215898 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f430800d5c0 con 0x7f431005f670 2021-06-25T04:50:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4315104700 1 -- 172.21.15.57:0/621215898 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4308000e90 con 0x7f431005f670 2021-06-25T04:50:58.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f4315104700 1 -- 172.21.15.57:0/621215898 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f430800d910 con 0x7f431005f670 2021-06-25T04:50:58.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f431836a700 1 -- 172.21.15.57:0/621215898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f431005f670 msgr2=0x7f4310060c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:58.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f431836a700 1 --2- 172.21.15.57:0/621215898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f431005f670 0x7f4310060c80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f4308002f70 tx=0x7f4308006eb0).stop 2021-06-25T04:50:58.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f431836a700 1 -- 172.21.15.57:0/621215898 shutdown_connections 2021-06-25T04:50:58.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f431836a700 1 --2- 172.21.15.57:0/621215898 >> v2:172.21.15.87:3300/0 conn(0x7f43100b2770 0x7f4310147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f431836a700 1 --2- 172.21.15.57:0/621215898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f431005f670 0x7f4310060c80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f431836a700 1 -- 172.21.15.57:0/621215898 >> 172.21.15.57:0/621215898 conn(0x7f431005c450 msgr2=0x7f431005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:58.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f431836a700 1 -- 172.21.15.57:0/621215898 shutdown_connections 2021-06-25T04:50:58.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f431836a700 1 -- 172.21.15.57:0/621215898 wait complete. 2021-06-25T04:50:58.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f431836a700 1 Processor -- start 2021-06-25T04:50:58.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.699+0000 7f431836a700 1 -- start start 2021-06-25T04:50:58.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f431836a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f431005f670 0x7f43100b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:58.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f431836a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43100b2770 0x7f4310148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:58.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f431836a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43100b3200 0x7f43100aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:58.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f431836a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43100ad060 con 0x7f43100b2770 2021-06-25T04:50:58.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f431836a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431014a5d0 con 0x7f431005f670 2021-06-25T04:50:58.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f431836a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4310149650 con 0x7f43100b3200 2021-06-25T04:50:58.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f4315905700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43100b2770 0x7f4310148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:58.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f4315905700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43100b2770 0x7f4310148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37620/0 (socket says 172.21.15.57:37620) 2021-06-25T04:50:58.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f4315905700 1 -- 172.21.15.57:0/2062698847 learned_addr learned my addr 172.21.15.57:0/2062698847 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:58.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f4316907700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43100b3200 0x7f43100aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:58.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f4316106700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f431005f670 0x7f43100b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:58.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f4315905700 1 -- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43100b3200 msgr2=0x7f43100aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:58.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f4315905700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43100b3200 0x7f43100aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f4315905700 1 -- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f431005f670 msgr2=0x7f43100b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:58.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f4315905700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f431005f670 0x7f43100b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f4315905700 1 -- 172.21.15.57:0/2062698847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430800b1e0 con 0x7f43100b2770 2021-06-25T04:50:58.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f4315905700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43100b2770 0x7f4310148ed0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f430c006e00 tx=0x7f430c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:58.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f43037fe700 1 -- 172.21.15.57:0/2062698847 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f430c00ee60 con 0x7f43100b2770 2021-06-25T04:50:58.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f43037fe700 1 -- 172.21.15.57:0/2062698847 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430c00c850 con 0x7f43100b2770 2021-06-25T04:50:58.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f431836a700 1 -- 172.21.15.57:0/2062698847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43101498f0 con 0x7f43100b2770 2021-06-25T04:50:58.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f43037fe700 1 -- 172.21.15.57:0/2062698847 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f430c00cbb0 con 0x7f43100b2770 2021-06-25T04:50:58.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f431836a700 1 -- 172.21.15.57:0/2062698847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43100b5d00 con 0x7f43100b2770 2021-06-25T04:50:58.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.703+0000 7f431836a700 1 -- 172.21.15.57:0/2062698847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43100aaa60 con 0x7f43100b2770 2021-06-25T04:50:58.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.707+0000 7f43037fe700 1 -- 172.21.15.57:0/2062698847 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f430c022070 con 0x7f43100b2770 2021-06-25T04:50:58.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.707+0000 7f43037fe700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f42f0055340 0x7f42f0057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:58.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.707+0000 7f43037fe700 1 -- 172.21.15.57:0/2062698847 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f430c06e580 con 0x7f43100b2770 2021-06-25T04:50:58.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.707+0000 7f4316106700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f42f0055340 0x7f42f0057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:58.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.707+0000 7f4316106700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f42f0055340 0x7f42f0057800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f430400d000 tx=0x7f4304009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:58.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.711+0000 7f43037fe700 1 -- 172.21.15.57:0/2062698847 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f430c0446e0 con 0x7f43100b2770 2021-06-25T04:50:58.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.879+0000 7f431836a700 1 -- 172.21.15.57:0/2062698847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4310057310 con 0x7f43100b2770 2021-06-25T04:50:58.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.879+0000 7f43037fe700 1 -- 172.21.15.57:0/2062698847 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2127 (secure 0 0 0) 0x7f430c016090 con 0x7f43100b2770 2021-06-25T04:50:58.886 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:50:58.886 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/587697587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":587697587},{"type":"v1","addr":"172.21.15.87:6835","nonce":587697587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/3950506435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3950506435},{"type":"v1","addr":"172.21.15.57:6833","nonce":3950506435}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:49:35.649253+0000","modified":"2021-06-25T04:50:58.575748+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-06-25T04:50:58.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 -- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f42f0055340 msgr2=0x7f42f0057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:58.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f42f0055340 0x7f42f0057800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f430400d000 tx=0x7f4304009040).stop 2021-06-25T04:50:58.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 -- 172.21.15.57:0/2062698847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43100b2770 msgr2=0x7f4310148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:58.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43100b2770 0x7f4310148ed0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f430c006e00 tx=0x7f430c0091d0).stop 2021-06-25T04:50:58.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 -- 172.21.15.57:0/2062698847 shutdown_connections 2021-06-25T04:50:58.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f42f0055340 0x7f42f0057800 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43100b3200 0x7f43100aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43100b2770 0x7f4310148ed0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 --2- 172.21.15.57:0/2062698847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f431005f670 0x7f43100b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:58.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 -- 172.21.15.57:0/2062698847 >> 172.21.15.57:0/2062698847 conn(0x7f431005c450 msgr2=0x7f4310142cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:58.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 -- 172.21.15.57:0/2062698847 shutdown_connections 2021-06-25T04:50:58.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.883+0000 7f431836a700 1 -- 172.21.15.57:0/2062698847 wait complete. 2021-06-25T04:50:58.892 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 19 2021-06-25T04:50:58.899 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:50:59.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9dffff700 1 Processor -- start 2021-06-25T04:50:59.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9dffff700 1 -- start start 2021-06-25T04:50:59.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9e00b05d0 0x7ff9e00af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9dffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9e0147560 0x7ff9e00acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9dffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e00b5840 con 0x7ff9e00b5460 2021-06-25T04:50:59.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9dffff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e01452a0 con 0x7ff9e0147560 2021-06-25T04:50:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9dffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00adfb0 con 0x7ff9e00b05d0 2021-06-25T04:50:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9df7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9e0147560 0x7ff9e00acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9df7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9e0147560 0x7ff9e00acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37630/0 (socket says 172.21.15.57:37630) 2021-06-25T04:50:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9df7fe700 1 -- 172.21.15.57:0/1037006822 learned_addr learned my addr 172.21.15.57:0/1037006822 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:59.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9deffd700 1 --1- 172.21.15.57:0/1037006822 >> v1:172.21.15.57:6789/0 conn(0x7ff9e00b5460 0x7ff9e0067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54844/0 (socket says 172.21.15.57:54844) 2021-06-25T04:50:59.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9de7fc700 1 --2- 172.21.15.57:0/1037006822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9e00b05d0 0x7ff9e00af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9df7fe700 1 -- 172.21.15.57:0/1037006822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9e00b05d0 msgr2=0x7ff9e00af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:59.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9ddffb700 1 -- 172.21.15.57:0/1037006822 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557495983 0 0) 0x7ff9e00b5840 con 0x7ff9e00b5460 2021-06-25T04:50:59.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9df7fe700 1 --2- 172.21.15.57:0/1037006822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9e00b05d0 0x7ff9e00af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9df7fe700 1 -- 172.21.15.57:0/1037006822 >> v1:172.21.15.57:6789/0 conn(0x7ff9e00b5460 legacy=0x7ff9e0067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:59.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9df7fe700 1 -- 172.21.15.57:0/1037006822 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e00ac7c0 con 0x7ff9e0147560 2021-06-25T04:50:59.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:58.999+0000 7ff9df7fe700 1 --2- 172.21.15.57:0/1037006822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9e0147560 0x7ff9e00acc20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7ff9d8002f70 tx=0x7ff9d8006eb0).ready entity=mon.0 client_cookie=43d082274ce0e06e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:59.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9ddffb700 1 -- 172.21.15.57:0/1037006822 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d800d570 con 0x7ff9e0147560 2021-06-25T04:50:59.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9ddffb700 1 -- 172.21.15.57:0/1037006822 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d8000e90 con 0x7ff9e0147560 2021-06-25T04:50:59.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9ddffb700 1 -- 172.21.15.57:0/1037006822 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d800d8c0 con 0x7ff9e0147560 2021-06-25T04:50:59.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9dffff700 1 -- 172.21.15.57:0/1037006822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9e0147560 msgr2=0x7ff9e00acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:59.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9dffff700 1 --2- 172.21.15.57:0/1037006822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9e0147560 0x7ff9e00acc20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7ff9d8002f70 tx=0x7ff9d8006eb0).stop 2021-06-25T04:50:59.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9dffff700 1 -- 172.21.15.57:0/1037006822 shutdown_connections 2021-06-25T04:50:59.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9dffff700 1 --2- 172.21.15.57:0/1037006822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9e00b05d0 0x7ff9e00af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9dffff700 1 --2- 172.21.15.57:0/1037006822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9e0147560 0x7ff9e00acc20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9dffff700 1 -- 172.21.15.57:0/1037006822 >> 172.21.15.57:0/1037006822 conn(0x7ff9e0062520 msgr2=0x7ff9e0062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:59.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9dffff700 1 -- 172.21.15.57:0/1037006822 shutdown_connections 2021-06-25T04:50:59.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9dffff700 1 -- 172.21.15.57:0/1037006822 wait complete. 2021-06-25T04:50:59.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9dffff700 1 Processor -- start 2021-06-25T04:50:59.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.003+0000 7ff9dffff700 1 -- start start 2021-06-25T04:50:59.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e00b05d0 0x7ff9e015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9e00b5460 0x7ff9e0063350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9e0147560 0x7ff9e0156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9dffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0159d40 con 0x7ff9e0147560 2021-06-25T04:50:59.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9dffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00b46c0 con 0x7ff9e00b05d0 2021-06-25T04:50:59.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9dffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0159f70 con 0x7ff9e00b5460 2021-06-25T04:50:59.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9df7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9e0147560 0x7ff9e0156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9deffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e00b05d0 0x7ff9e015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9df7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9e0147560 0x7ff9e0156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37636/0 (socket says 172.21.15.57:37636) 2021-06-25T04:50:59.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9de7fc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9e00b5460 0x7ff9e0063350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9df7fe700 1 -- 172.21.15.57:0/215075107 learned_addr learned my addr 172.21.15.57:0/215075107 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:59.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9deffd700 1 -- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9e00b5460 msgr2=0x7ff9e0063350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:59.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9deffd700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9e00b5460 0x7ff9e0063350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9deffd700 1 -- 172.21.15.57:0/215075107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9e0147560 msgr2=0x7ff9e0156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:59.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9deffd700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9e0147560 0x7ff9e0156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9deffd700 1 -- 172.21.15.57:0/215075107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d800b1e0 con 0x7ff9e00b05d0 2021-06-25T04:50:59.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9df7fe700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9e0147560 0x7ff9e0156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:50:59.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9deffd700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e00b05d0 0x7ff9e015a6b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7ff9d4000bc0 tx=0x7ff9d4007a00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:59.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9cffff700 1 -- 172.21.15.57:0/215075107 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d40070d0 con 0x7ff9e00b05d0 2021-06-25T04:50:59.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9cffff700 1 -- 172.21.15.57:0/215075107 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d4007230 con 0x7ff9e00b05d0 2021-06-25T04:50:59.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9dffff700 1 -- 172.21.15.57:0/215075107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e015a210 con 0x7ff9e00b05d0 2021-06-25T04:50:59.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9cffff700 1 -- 172.21.15.57:0/215075107 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d4005550 con 0x7ff9e00b05d0 2021-06-25T04:50:59.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.007+0000 7ff9dffff700 1 -- 172.21.15.57:0/215075107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e0063840 con 0x7ff9e00b05d0 2021-06-25T04:50:59.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.011+0000 7ff9dffff700 1 -- 172.21.15.57:0/215075107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e0057310 con 0x7ff9e00b05d0 2021-06-25T04:50:59.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.011+0000 7ff9cffff700 1 -- 172.21.15.57:0/215075107 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff9d401a060 con 0x7ff9e00b05d0 2021-06-25T04:50:59.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.011+0000 7ff9cffff700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9bc0553f0 0x7ff9bc0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.011+0000 7ff9cffff700 1 -- 172.21.15.57:0/215075107 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6506+0+0 (secure 0 0 0) 0x7ff9d406d660 con 0x7ff9e00b05d0 2021-06-25T04:50:59.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.011+0000 7ff9de7fc700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9bc0553f0 0x7ff9bc0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.011+0000 7ff9de7fc700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9bc0553f0 0x7ff9bc0578b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7ff9d000b000 tx=0x7ff9d00091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:59.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.023+0000 7ff9cffff700 1 -- 172.21.15.57:0/215075107 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff9d40436b0 con 0x7ff9e00b05d0 2021-06-25T04:50:59.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.183+0000 7ff9dffff700 1 -- 172.21.15.57:0/215075107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff9e00b4800 con 0x7ff9e00b05d0 2021-06-25T04:50:59.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.591+0000 7ff9cffff700 1 -- 172.21.15.57:0/215075107 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff9d40180a0 con 0x7ff9e00b05d0 2021-06-25T04:50:59.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 -- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9bc0553f0 msgr2=0x7ff9bc0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:59.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9bc0553f0 0x7ff9bc0578b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7ff9d000b000 tx=0x7ff9d00091d0).stop 2021-06-25T04:50:59.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 -- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e00b05d0 msgr2=0x7ff9e015a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:59.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e00b05d0 0x7ff9e015a6b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7ff9d4000bc0 tx=0x7ff9d4007a00).stop 2021-06-25T04:50:59.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 -- 172.21.15.57:0/215075107 shutdown_connections 2021-06-25T04:50:59.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9bc0553f0 0x7ff9bc0578b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9e0147560 0x7ff9e0156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9e00b5460 0x7ff9e0063350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 --2- 172.21.15.57:0/215075107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e00b05d0 0x7ff9e015a6b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 -- 172.21.15.57:0/215075107 >> 172.21.15.57:0/215075107 conn(0x7ff9e0062520 msgr2=0x7ff9e0147970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:59.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 -- 172.21.15.57:0/215075107 shutdown_connections 2021-06-25T04:50:59.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.595+0000 7ff9dffff700 1 -- 172.21.15.57:0/215075107 wait complete. 2021-06-25T04:50:59.618 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:50:59.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.723+0000 7f05d7110700 1 Processor -- start 2021-06-25T04:50:59.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.723+0000 7f05d7110700 1 -- start start 2021-06-25T04:50:59.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d7110700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f05d00600c0 0x7f05d0066440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d7110700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d00604a0 con 0x7f05d00b3700 2021-06-25T04:50:59.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d7110700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d014ba70 con 0x7f05d0066930 2021-06-25T04:50:59.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d7110700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d0065a60 con 0x7f05d00600c0 2021-06-25T04:50:59.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f05d00b3700 0x7f05d014ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54860/0 (socket says 172.21.15.57:54860) 2021-06-25T04:50:59.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cffff700 1 -- 172.21.15.57:0/2304142894 learned_addr learned my addr 172.21.15.57:0/2304142894 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:50:59.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d4eac700 1 --2- 172.21.15.57:0/2304142894 >> v2:172.21.15.87:3300/0 conn(0x7f05d00600c0 0x7f05d0066440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025393277 0 0) 0x7f05d00604a0 con 0x7f05d00b3700 2021-06-25T04:50:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05b0003260 con 0x7f05d00b3700 2021-06-25T04:50:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244344628 0 0) 0x7f05d014ba70 con 0x7f05d0066930 2021-06-25T04:50:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d00604a0 con 0x7f05d0066930 2021-06-25T04:50:59.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2584780996 0 0) 0x7f05b0003260 con 0x7f05d00b3700 2021-06-25T04:50:59.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 >> v2:172.21.15.87:3300/0 conn(0x7f05d00600c0 msgr2=0x7f05d0066440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:59.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 --2- 172.21.15.57:0/2304142894 >> v2:172.21.15.87:3300/0 conn(0x7f05d00600c0 0x7f05d0066440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 >> v1:172.21.15.87:6789/0 conn(0x7f05d0066930 legacy=0x7f05d014b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:59.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d0065d00 con 0x7f05d00b3700 2021-06-25T04:50:59.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f05c0001680 con 0x7f05d00b3700 2021-06-25T04:50:59.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 >> v1:172.21.15.57:6789/0 conn(0x7f05d00b3700 legacy=0x7f05d014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:59.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 --2- 172.21.15.57:0/2304142894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05b0003930 0x7f05b0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 --2- 172.21.15.57:0/2304142894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05b0004500 0x7f05b0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 --2- 172.21.15.57:0/2304142894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b0004e70 0x7f05b000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0065a60 con 0x7f05b0004e70 2021-06-25T04:50:59.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b000bd20 con 0x7f05b0004500 2021-06-25T04:50:59.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b000bee0 con 0x7f05b0003930 2021-06-25T04:50:59.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d4eac700 1 --2- 172.21.15.57:0/2304142894 >> v2:172.21.15.87:3300/0 conn(0x7f05d00600c0 0x7f05d0066440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:50:59.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d56ad700 1 --2- 172.21.15.57:0/2304142894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b0004e70 0x7f05b000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cffff700 1 --2- 172.21.15.57:0/2304142894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05b0004500 0x7f05b0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d4eac700 1 --2- 172.21.15.57:0/2304142894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05b0003930 0x7f05b0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d56ad700 1 -- 172.21.15.57:0/2304142894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05b0003930 msgr2=0x7f05b0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:59.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d56ad700 1 --2- 172.21.15.57:0/2304142894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05b0003930 0x7f05b0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d56ad700 1 -- 172.21.15.57:0/2304142894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05b0004500 msgr2=0x7f05b0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:50:59.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d56ad700 1 --2- 172.21.15.57:0/2304142894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05b0004500 0x7f05b0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d56ad700 1 -- 172.21.15.57:0/2304142894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b0003260 con 0x7f05b0004e70 2021-06-25T04:50:59.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d56ad700 1 -- 172.21.15.57:0/2304142894 reap_dead start 2021-06-25T04:50:59.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d56ad700 1 --2- 172.21.15.57:0/2304142894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b0004e70 0x7f05b000b750 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f05c8001490 tx=0x7f05c8007d60).ready entity=mon.0 client_cookie=79f0c86ff62d05b3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:59.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05c80017b0 con 0x7f05b0004e70 2021-06-25T04:50:59.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8006890 con 0x7f05b0004e70 2021-06-25T04:50:59.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05cf7fe700 1 -- 172.21.15.57:0/2304142894 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05c8006bf0 con 0x7f05b0004e70 2021-06-25T04:50:59.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d7110700 1 -- 172.21.15.57:0/2304142894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b0004e70 msgr2=0x7f05b000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:59.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d7110700 1 --2- 172.21.15.57:0/2304142894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b0004e70 0x7f05b000b750 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f05c8001490 tx=0x7f05c8007d60).stop 2021-06-25T04:50:59.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d7110700 1 -- 172.21.15.57:0/2304142894 shutdown_connections 2021-06-25T04:50:59.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d7110700 1 --2- 172.21.15.57:0/2304142894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b0004e70 0x7f05b000b750 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d7110700 1 -- 172.21.15.57:0/2304142894 >> 172.21.15.57:0/2304142894 conn(0x7f05d005cef0 msgr2=0x7f05d005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:50:59.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d7110700 1 -- 172.21.15.57:0/2304142894 shutdown_connections 2021-06-25T04:50:59.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.727+0000 7f05d7110700 1 -- 172.21.15.57:0/2304142894 wait complete. 2021-06-25T04:50:59.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05d7110700 1 Processor -- start 2021-06-25T04:50:59.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05d7110700 1 -- start start 2021-06-25T04:50:59.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05d7110700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05b0004e70 0x7f05d009f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05d7110700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05d00b0c90 0x7f05d009f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05d7110700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05d014e0c0 0x7f05d014e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05d7110700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d009fcb0 con 0x7f05d00b0c90 2021-06-25T04:50:59.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05d7110700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0157030 con 0x7f05d014e0c0 2021-06-25T04:50:59.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05d7110700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01572d0 con 0x7f05b0004e70 2021-06-25T04:50:59.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05cffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05d00b0c90 0x7f05d009f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05cffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05d00b0c90 0x7f05d009f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37654/0 (socket says 172.21.15.57:37654) 2021-06-25T04:50:59.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05cffff700 1 -- 172.21.15.57:0/3253500084 learned_addr learned my addr 172.21.15.57:0/3253500084 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:50:59.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05d56ad700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05d014e0c0 0x7f05d014e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05d4eac700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05b0004e70 0x7f05d009f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.731+0000 7f05cffff700 1 -- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05b0004e70 msgr2=0x7f05d009f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:59.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05cffff700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05b0004e70 0x7f05d009f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05cffff700 1 -- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05d014e0c0 msgr2=0x7f05d014e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:50:59.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05cffff700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05d014e0c0 0x7f05d014e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:50:59.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05cffff700 1 -- 172.21.15.57:0/3253500084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00ae930 con 0x7f05d00b0c90 2021-06-25T04:50:59.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05d4eac700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05b0004e70 0x7f05d009f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:50:59.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05cffff700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05d00b0c90 0x7f05d009f7c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f05c000d000 tx=0x7f05d0067020).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:59.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05cdffb700 1 -- 172.21.15.57:0/3253500084 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05c0012540 con 0x7f05d00b0c90 2021-06-25T04:50:59.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05cdffb700 1 -- 172.21.15.57:0/3253500084 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c00126a0 con 0x7f05d00b0c90 2021-06-25T04:50:59.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05d7110700 1 -- 172.21.15.57:0/3253500084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d00aebd0 con 0x7f05d00b0c90 2021-06-25T04:50:59.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05cdffb700 1 -- 172.21.15.57:0/3253500084 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05c0012a00 con 0x7f05d00b0c90 2021-06-25T04:50:59.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05d7110700 1 -- 172.21.15.57:0/3253500084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d00b7020 con 0x7f05d00b0c90 2021-06-25T04:50:59.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05d7110700 1 -- 172.21.15.57:0/3253500084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d0057310 con 0x7f05d00b0c90 2021-06-25T04:50:59.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05cdffb700 1 -- 172.21.15.57:0/3253500084 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f05c001b030 con 0x7f05d00b0c90 2021-06-25T04:50:59.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.735+0000 7f05cdffb700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05b4055450 0x7f05b4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:50:59.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.739+0000 7f05cdffb700 1 -- 172.21.15.57:0/3253500084 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f05c006d830 con 0x7f05d00b0c90 2021-06-25T04:50:59.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.739+0000 7f05d4eac700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05b4055450 0x7f05b4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:50:59.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.739+0000 7f05d4eac700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05b4055450 0x7f05b4057910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f05b800b000 tx=0x7f05b8008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:50:59.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.743+0000 7f05cdffb700 1 -- 172.21.15.57:0/3253500084 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f05c0043880 con 0x7f05d00b0c90 2021-06-25T04:50:59.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:50:59.875+0000 7f05d7110700 1 -- 172.21.15.57:0/3253500084 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f05d00698a0 con 0x7f05d00b0c90 2021-06-25T04:51:00.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.611+0000 7f05cdffb700 1 -- 172.21.15.57:0/3253500084 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) v1 ==== 185+0+0 (secure 0 0 0) 0x7f05c0019030 con 0x7f05d00b0c90 2021-06-25T04:51:00.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 -- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05b4055450 msgr2=0x7f05b4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:00.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05b4055450 0x7f05b4057910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f05b800b000 tx=0x7f05b8008040).stop 2021-06-25T04:51:00.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 -- 172.21.15.57:0/3253500084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05d00b0c90 msgr2=0x7f05d009f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:00.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05d00b0c90 0x7f05d009f7c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f05c000d000 tx=0x7f05d0067020).stop 2021-06-25T04:51:00.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 -- 172.21.15.57:0/3253500084 shutdown_connections 2021-06-25T04:51:00.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05b4055450 0x7f05b4057910 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:00.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05d014e0c0 0x7f05d014e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:00.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05d00b0c90 0x7f05d009f7c0 secure :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0x7f05c000d000 tx=0x7f05d0067020).stop 2021-06-25T04:51:00.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 --2- 172.21.15.57:0/3253500084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05b0004e70 0x7f05d009f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:00.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 -- 172.21.15.57:0/3253500084 >> 172.21.15.57:0/3253500084 conn(0x7f05d005cef0 msgr2=0x7f05d014ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:00.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 -- 172.21.15.57:0/3253500084 shutdown_connections 2021-06-25T04:51:00.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.619+0000 7f05d7110700 1 -- 172.21.15.57:0/3253500084 wait complete. 2021-06-25T04:51:00.626 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:51:00.639 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:51:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.743+0000 7fd1c898b700 1 Processor -- start 2021-06-25T04:51:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.743+0000 7fd1c898b700 1 -- start start 2021-06-25T04:51:00.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.743+0000 7fd1c898b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1c40b52c0 0x7fd1c413e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.743+0000 7fd1c898b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40aeee0 con 0x7fd1c40b1420 2021-06-25T04:51:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.743+0000 7fd1c898b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40ac2c0 con 0x7fd1c413e560 2021-06-25T04:51:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.743+0000 7fd1c898b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40af110 con 0x7fd1c40b52c0 2021-06-25T04:51:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.743+0000 7fd1baffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd1c40b1420 0x7fd1c4141000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54882/0 (socket says 172.21.15.57:54882) 2021-06-25T04:51:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.743+0000 7fd1baffd700 1 -- 172.21.15.57:0/3453753032 learned_addr learned my addr 172.21.15.57:0/3453753032 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c37fe700 1 --2- 172.21.15.57:0/3453753032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1c40b52c0 0x7fd1c413e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c2ffd700 1 -- 172.21.15.57:0/3453753032 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797195083 0 0) 0x7fd1c40aeee0 con 0x7fd1c40b1420 2021-06-25T04:51:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c2ffd700 1 -- 172.21.15.57:0/3453753032 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a4003260 con 0x7fd1c40b1420 2021-06-25T04:51:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c2ffd700 1 -- 172.21.15.57:0/3453753032 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690032491 0 0) 0x7fd1c40ac2c0 con 0x7fd1c413e560 2021-06-25T04:51:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c2ffd700 1 -- 172.21.15.57:0/3453753032 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c40aeee0 con 0x7fd1c413e560 2021-06-25T04:51:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c2ffd700 1 -- 172.21.15.57:0/3453753032 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 932854043 0 0) 0x7fd1a4003260 con 0x7fd1c40b1420 2021-06-25T04:51:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c37fe700 1 -- 172.21.15.57:0/3453753032 >> v1:172.21.15.87:6789/0 conn(0x7fd1c413e560 legacy=0x7fd1c4141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c37fe700 1 -- 172.21.15.57:0/3453753032 >> v1:172.21.15.57:6789/0 conn(0x7fd1c40b1420 legacy=0x7fd1c4141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c37fe700 1 -- 172.21.15.57:0/3453753032 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40af3b0 con 0x7fd1c40b52c0 2021-06-25T04:51:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c37fe700 1 --2- 172.21.15.57:0/3453753032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1c40b52c0 0x7fd1c413e070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd1ac001110 tx=0x7fd1b4006df0).ready entity=mon.2 client_cookie=9b6d00beb4e65f2f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:00.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c2ffd700 1 -- 172.21.15.57:0/3453753032 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1ac001660 con 0x7fd1c40b52c0 2021-06-25T04:51:00.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c2ffd700 1 -- 172.21.15.57:0/3453753032 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b4000e90 con 0x7fd1c40b52c0 2021-06-25T04:51:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c2ffd700 1 -- 172.21.15.57:0/3453753032 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1b4012460 con 0x7fd1c40b52c0 2021-06-25T04:51:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c898b700 1 -- 172.21.15.57:0/3453753032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1c40b52c0 msgr2=0x7fd1c413e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c898b700 1 --2- 172.21.15.57:0/3453753032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1c40b52c0 0x7fd1c413e070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd1ac001110 tx=0x7fd1b4006df0).stop 2021-06-25T04:51:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c898b700 1 -- 172.21.15.57:0/3453753032 shutdown_connections 2021-06-25T04:51:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c898b700 1 --2- 172.21.15.57:0/3453753032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1c40b52c0 0x7fd1c413e070 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c898b700 1 -- 172.21.15.57:0/3453753032 >> 172.21.15.57:0/3453753032 conn(0x7fd1c4062520 msgr2=0x7fd1c4062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c898b700 1 -- 172.21.15.57:0/3453753032 shutdown_connections 2021-06-25T04:51:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.747+0000 7fd1c898b700 1 -- 172.21.15.57:0/3453753032 wait complete. 2021-06-25T04:51:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c898b700 1 Processor -- start 2021-06-25T04:51:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c898b700 1 -- start start 2021-06-25T04:51:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c898b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c40b1420 0x7fd1c41541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c898b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1c40b52c0 0x7fd1c41477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c898b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1c413e560 0x7fd1c413f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c898b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4146bd0 con 0x7fd1c40b52c0 2021-06-25T04:51:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c898b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4148120 con 0x7fd1c40b1420 2021-06-25T04:51:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c898b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4145330 con 0x7fd1c413e560 2021-06-25T04:51:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1baffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1c40b52c0 0x7fd1c41477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1baffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1c40b52c0 0x7fd1c41477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37668/0 (socket says 172.21.15.57:37668) 2021-06-25T04:51:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1baffd700 1 -- 172.21.15.57:0/4231358148 learned_addr learned my addr 172.21.15.57:0/4231358148 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c37fe700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c40b1420 0x7fd1c41541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c3fff700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1c413e560 0x7fd1c413f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1baffd700 1 -- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1c413e560 msgr2=0x7fd1c413f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1baffd700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1c413e560 0x7fd1c413f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:00.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1baffd700 1 -- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c40b1420 msgr2=0x7fd1c41541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:00.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1baffd700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c40b1420 0x7fd1c41541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:00.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1baffd700 1 -- 172.21.15.57:0/4231358148 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b400b180 con 0x7fd1c40b52c0 2021-06-25T04:51:00.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1baffd700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1c40b52c0 0x7fd1c41477a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fd1c4146d10 tx=0x7fd1ac001970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c17fa700 1 -- 172.21.15.57:0/4231358148 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1ac007170 con 0x7fd1c40b52c0 2021-06-25T04:51:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c17fa700 1 -- 172.21.15.57:0/4231358148 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac0072d0 con 0x7fd1c40b52c0 2021-06-25T04:51:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c17fa700 1 -- 172.21.15.57:0/4231358148 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1ac004710 con 0x7fd1c40b52c0 2021-06-25T04:51:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c898b700 1 -- 172.21.15.57:0/4231358148 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c4148350 con 0x7fd1c40b52c0 2021-06-25T04:51:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.751+0000 7fd1c898b700 1 -- 172.21.15.57:0/4231358148 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c4144e90 con 0x7fd1c40b52c0 2021-06-25T04:51:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.755+0000 7fd1c898b700 1 -- 172.21.15.57:0/4231358148 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c41503b0 con 0x7fd1c40b52c0 2021-06-25T04:51:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.755+0000 7fd1c17fa700 1 -- 172.21.15.57:0/4231358148 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd1ac01b070 con 0x7fd1c40b52c0 2021-06-25T04:51:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.755+0000 7fd1c17fa700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1a80554b0 0x7fd1a8057970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.755+0000 7fd1c17fa700 1 -- 172.21.15.57:0/4231358148 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fd1ac06d3e0 con 0x7fd1c40b52c0 2021-06-25T04:51:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.755+0000 7fd1c37fe700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1a80554b0 0x7fd1a8057970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.755+0000 7fd1c37fe700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1a80554b0 0x7fd1a8057970 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fd1b4019000 tx=0x7fd1b4014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.763+0000 7fd1c17fa700 1 -- 172.21.15.57:0/4231358148 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd1ac0436f0 con 0x7fd1c40b52c0 2021-06-25T04:51:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:00.891+0000 7fd1c898b700 1 -- 172.21.15.57:0/4231358148 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd1c4057310 con 0x7fd1c40b52c0 2021-06-25T04:51:01.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.619+0000 7fd1c17fa700 1 -- 172.21.15.57:0/4231358148 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd1ac046d10 con 0x7fd1c40b52c0 2021-06-25T04:51:01.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.623+0000 7fd1c898b700 1 -- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1a80554b0 msgr2=0x7fd1a8057970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:01.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.623+0000 7fd1c898b700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1a80554b0 0x7fd1a8057970 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fd1b4019000 tx=0x7fd1b4014000).stop 2021-06-25T04:51:01.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.623+0000 7fd1c898b700 1 -- 172.21.15.57:0/4231358148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1c40b52c0 msgr2=0x7fd1c41477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.623+0000 7fd1c898b700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1c40b52c0 0x7fd1c41477a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fd1c4146d10 tx=0x7fd1ac001970).stop 2021-06-25T04:51:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.623+0000 7fd1c898b700 1 -- 172.21.15.57:0/4231358148 shutdown_connections 2021-06-25T04:51:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.623+0000 7fd1c898b700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1a80554b0 0x7fd1a8057970 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.623+0000 7fd1c898b700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1c413e560 0x7fd1c413f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.623+0000 7fd1c898b700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1c40b52c0 0x7fd1c41477a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.623+0000 7fd1c898b700 1 --2- 172.21.15.57:0/4231358148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c40b1420 0x7fd1c41541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.623+0000 7fd1c898b700 1 -- 172.21.15.57:0/4231358148 >> 172.21.15.57:0/4231358148 conn(0x7fd1c4062520 msgr2=0x7fd1c405fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.627+0000 7fd1c898b700 1 -- 172.21.15.57:0/4231358148 shutdown_connections 2021-06-25T04:51:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.627+0000 7fd1c898b700 1 -- 172.21.15.57:0/4231358148 wait complete. 2021-06-25T04:51:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:51:01.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-06-25T04:51:01.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.743+0000 7f73f425a700 1 Processor -- start 2021-06-25T04:51:01.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.743+0000 7f73f425a700 1 -- start start 2021-06-25T04:51:01.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f425a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73ec0a9e80 0x7f73ec0aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:01.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f425a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec061950 con 0x7f73ec060390 2021-06-25T04:51:01.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f425a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec061bf0 con 0x7f73ec13f750 2021-06-25T04:51:01.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f425a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec060b50 con 0x7f73ec0a9e80 2021-06-25T04:51:01.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f17f5700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f73ec060390 0x7f73ec13cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54896/0 (socket says 172.21.15.57:54896) 2021-06-25T04:51:01.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f17f5700 1 -- 172.21.15.57:0/3889716085 learned_addr learned my addr 172.21.15.57:0/3889716085 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:01.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f1ff6700 1 --2- 172.21.15.57:0/3889716085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73ec0a9e80 0x7f73ec0aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f0ff4700 1 -- 172.21.15.57:0/3889716085 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59231800 0 0) 0x7f73ec061950 con 0x7f73ec060390 2021-06-25T04:51:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f0ff4700 1 -- 172.21.15.57:0/3889716085 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d4003260 con 0x7f73ec060390 2021-06-25T04:51:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f0ff4700 1 -- 172.21.15.57:0/3889716085 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245166312 0 0) 0x7f73ec061bf0 con 0x7f73ec13f750 2021-06-25T04:51:01.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f1ff6700 1 -- 172.21.15.57:0/3889716085 >> v1:172.21.15.87:6789/0 conn(0x7f73ec13f750 legacy=0x7f73ec149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:01.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f1ff6700 1 -- 172.21.15.57:0/3889716085 >> v1:172.21.15.57:6789/0 conn(0x7f73ec060390 legacy=0x7f73ec13cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:01.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f1ff6700 1 -- 172.21.15.57:0/3889716085 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec060df0 con 0x7f73ec0a9e80 2021-06-25T04:51:01.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f1ff6700 1 --2- 172.21.15.57:0/3889716085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73ec0a9e80 0x7f73ec0aa260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f73e8002f70 tx=0x7f73e8006e80).ready entity=mon.2 client_cookie=750b02eef7b0e663 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f0ff4700 1 -- 172.21.15.57:0/3889716085 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e8014070 con 0x7f73ec0a9e80 2021-06-25T04:51:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f0ff4700 1 -- 172.21.15.57:0/3889716085 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8000e90 con 0x7f73ec0a9e80 2021-06-25T04:51:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f0ff4700 1 -- 172.21.15.57:0/3889716085 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e80107f0 con 0x7f73ec0a9e80 2021-06-25T04:51:01.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f425a700 1 -- 172.21.15.57:0/3889716085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73ec0a9e80 msgr2=0x7f73ec0aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:01.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.747+0000 7f73f425a700 1 --2- 172.21.15.57:0/3889716085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73ec0a9e80 0x7f73ec0aa260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f73e8002f70 tx=0x7f73e8006e80).stop 2021-06-25T04:51:01.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 -- 172.21.15.57:0/3889716085 shutdown_connections 2021-06-25T04:51:01.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 --2- 172.21.15.57:0/3889716085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73ec0a9e80 0x7f73ec0aa260 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:01.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 -- 172.21.15.57:0/3889716085 >> 172.21.15.57:0/3889716085 conn(0x7f73ec0b2930 msgr2=0x7f73ec0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:01.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 -- 172.21.15.57:0/3889716085 shutdown_connections 2021-06-25T04:51:01.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 -- 172.21.15.57:0/3889716085 wait complete. 2021-06-25T04:51:01.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 Processor -- start 2021-06-25T04:51:01.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 -- start start 2021-06-25T04:51:01.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73ec060390 0x7f73ec0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:01.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73ec0a9e80 0x7f73ec152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:01.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73ec13f750 0x7f73ec152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:01.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec142f50 con 0x7f73ec13f750 2021-06-25T04:51:01.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec142cb0 con 0x7f73ec060390 2021-06-25T04:51:01.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f425a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec065840 con 0x7f73ec0a9e80 2021-06-25T04:51:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.751+0000 7f73f27f7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73ec13f750 0x7f73ec152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f27f7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73ec13f750 0x7f73ec152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37686/0 (socket says 172.21.15.57:37686) 2021-06-25T04:51:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f27f7700 1 -- 172.21.15.57:0/830673061 learned_addr learned my addr 172.21.15.57:0/830673061 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:01.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f1ff6700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73ec060390 0x7f73ec0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:01.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f17f5700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73ec0a9e80 0x7f73ec152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:01.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f27f7700 1 -- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73ec0a9e80 msgr2=0x7f73ec152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:01.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f27f7700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73ec0a9e80 0x7f73ec152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:01.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f27f7700 1 -- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73ec060390 msgr2=0x7f73ec0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:01.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f27f7700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73ec060390 0x7f73ec0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:01.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f27f7700 1 -- 172.21.15.57:0/830673061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e800c310 con 0x7f73ec13f750 2021-06-25T04:51:01.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f27f7700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73ec13f750 0x7f73ec152b00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f73e4000f40 tx=0x7f73e4007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:01.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73daffd700 1 -- 172.21.15.57:0/830673061 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e4006aa0 con 0x7f73ec13f750 2021-06-25T04:51:01.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73daffd700 1 -- 172.21.15.57:0/830673061 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e4006c00 con 0x7f73ec13f750 2021-06-25T04:51:01.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f425a700 1 -- 172.21.15.57:0/830673061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec065ae0 con 0x7f73ec13f750 2021-06-25T04:51:01.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73daffd700 1 -- 172.21.15.57:0/830673061 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e4007030 con 0x7f73ec13f750 2021-06-25T04:51:01.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f425a700 1 -- 172.21.15.57:0/830673061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec143870 con 0x7f73ec13f750 2021-06-25T04:51:01.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73f425a700 1 -- 172.21.15.57:0/830673061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec142970 con 0x7f73ec13f750 2021-06-25T04:51:01.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73daffd700 1 -- 172.21.15.57:0/830673061 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f73e4010030 con 0x7f73ec13f750 2021-06-25T04:51:01.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73daffd700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73cc055450 0x7f73cc057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:01.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.755+0000 7f73daffd700 1 -- 172.21.15.57:0/830673061 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f73e406d9e0 con 0x7f73ec13f750 2021-06-25T04:51:01.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.759+0000 7f73f1ff6700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73cc055450 0x7f73cc057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:01.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.759+0000 7f73f1ff6700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73cc055450 0x7f73cc057910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f73e801a000 tx=0x7f73ec061d80).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:01.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.763+0000 7f73daffd700 1 -- 172.21.15.57:0/830673061 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f73e4043e70 con 0x7f73ec13f750 2021-06-25T04:51:01.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.891+0000 7f73f425a700 1 -- 172.21.15.57:0/830673061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f73ec057310 con 0x7f73ec13f750 2021-06-25T04:51:01.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.899+0000 7f73daffd700 1 -- 172.21.15.57:0/830673061 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f73e4047490 con 0x7f73ec13f750 2021-06-25T04:51:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 -- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73cc055450 msgr2=0x7f73cc057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73cc055450 0x7f73cc057910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f73e801a000 tx=0x7f73ec061d80).stop 2021-06-25T04:51:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 -- 172.21.15.57:0/830673061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73ec13f750 msgr2=0x7f73ec152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73ec13f750 0x7f73ec152b00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f73e4000f40 tx=0x7f73e4007f90).stop 2021-06-25T04:51:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 -- 172.21.15.57:0/830673061 shutdown_connections 2021-06-25T04:51:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73cc055450 0x7f73cc057910 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73ec13f750 0x7f73ec152b00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:01.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73ec0a9e80 0x7f73ec152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:01.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 --2- 172.21.15.57:0/830673061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73ec060390 0x7f73ec0b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:01.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 -- 172.21.15.57:0/830673061 >> 172.21.15.57:0/830673061 conn(0x7f73ec0b2930 msgr2=0x7f73ec0b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:01.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 -- 172.21.15.57:0/830673061 shutdown_connections 2021-06-25T04:51:01.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:01.903+0000 7f73f425a700 1 -- 172.21.15.57:0/830673061 wait complete. 2021-06-25T04:51:01.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-06-25T04:51:02.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 Processor -- start 2021-06-25T04:51:02.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 -- start start 2021-06-25T04:51:02.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f78e0148360 0x7f78e00b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:02.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00a7080 0x7f78e01446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:02.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e00b0310 con 0x7f78e00b1d70 2021-06-25T04:51:02.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e00a9080 con 0x7f78e0148360 2021-06-25T04:51:02.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00b05b0 con 0x7f78e00a7080 2021-06-25T04:51:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78df7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f78e00b1d70 0x7f78e00b2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54908/0 (socket says 172.21.15.57:54908) 2021-06-25T04:51:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78df7fe700 1 -- 172.21.15.57:0/2376223127 learned_addr learned my addr 172.21.15.57:0/2376223127 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78deffd700 1 --2- 172.21.15.57:0/2376223127 >> v2:172.21.15.87:3300/0 conn(0x7f78e0148360 0x7f78e00b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78dffff700 1 --2- 172.21.15.57:0/2376223127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00a7080 0x7f78e01446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78de7fc700 1 -- 172.21.15.57:0/2376223127 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975510270 0 0) 0x7f78e00b0310 con 0x7f78e00b1d70 2021-06-25T04:51:02.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78de7fc700 1 -- 172.21.15.57:0/2376223127 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c0003260 con 0x7f78e00b1d70 2021-06-25T04:51:02.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78dffff700 1 -- 172.21.15.57:0/2376223127 >> v2:172.21.15.87:3300/0 conn(0x7f78e0148360 msgr2=0x7f78e00b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:02.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78dffff700 1 --2- 172.21.15.57:0/2376223127 >> v2:172.21.15.87:3300/0 conn(0x7f78e0148360 0x7f78e00b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78dffff700 1 -- 172.21.15.57:0/2376223127 >> v1:172.21.15.57:6789/0 conn(0x7f78e00b1d70 legacy=0x7f78e00b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78dffff700 1 -- 172.21.15.57:0/2376223127 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e00b0850 con 0x7f78e00a7080 2021-06-25T04:51:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78deffd700 1 --2- 172.21.15.57:0/2376223127 >> v2:172.21.15.87:3300/0 conn(0x7f78e0148360 0x7f78e00b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:51:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78dffff700 1 --2- 172.21.15.57:0/2376223127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00a7080 0x7f78e01446e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f78e01476f0 tx=0x7f78d8006df0).ready entity=mon.2 client_cookie=df528be3cb759178 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78de7fc700 1 -- 172.21.15.57:0/2376223127 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d800d570 con 0x7f78e00a7080 2021-06-25T04:51:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78de7fc700 1 -- 172.21.15.57:0/2376223127 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d8000e90 con 0x7f78e00a7080 2021-06-25T04:51:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78de7fc700 1 -- 172.21.15.57:0/2376223127 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d800d8c0 con 0x7f78e00a7080 2021-06-25T04:51:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2376223127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00a7080 msgr2=0x7f78e01446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 --2- 172.21.15.57:0/2376223127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00a7080 0x7f78e01446e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f78e01476f0 tx=0x7f78d8006df0).stop 2021-06-25T04:51:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2376223127 shutdown_connections 2021-06-25T04:51:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 --2- 172.21.15.57:0/2376223127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00a7080 0x7f78e01446e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 --2- 172.21.15.57:0/2376223127 >> v2:172.21.15.87:3300/0 conn(0x7f78e0148360 0x7f78e00b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2376223127 >> 172.21.15.57:0/2376223127 conn(0x7f78e005f670 msgr2=0x7f78e005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:02.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2376223127 shutdown_connections 2021-06-25T04:51:02.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.023+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2376223127 wait complete. 2021-06-25T04:51:02.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.027+0000 7f78e5c3b700 1 Processor -- start 2021-06-25T04:51:02.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.027+0000 7f78e5c3b700 1 -- start start 2021-06-25T04:51:02.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78e5c3b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78e00a7080 0x7f78e00adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:02.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78e5c3b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00b1d70 0x7f78e0062780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:02.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78e5c3b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78e0148360 0x7f78e0066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:02.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78e5c3b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0067840 con 0x7f78e0148360 2021-06-25T04:51:02.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78e5c3b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00ab750 con 0x7f78e00a7080 2021-06-25T04:51:02.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78e5c3b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00ac060 con 0x7f78e00b1d70 2021-06-25T04:51:02.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78e0148360 0x7f78e0066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:02.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78e0148360 0x7f78e0066ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37700/0 (socket says 172.21.15.57:37700) 2021-06-25T04:51:02.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dffff700 1 -- 172.21.15.57:0/2614149872 learned_addr learned my addr 172.21.15.57:0/2614149872 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:02.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78df7fe700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78e00a7080 0x7f78e00adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:02.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78deffd700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00b1d70 0x7f78e0062780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:02.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dffff700 1 -- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00b1d70 msgr2=0x7f78e0062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:02.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dffff700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00b1d70 0x7f78e0062780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dffff700 1 -- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78e00a7080 msgr2=0x7f78e00adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:02.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dffff700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78e00a7080 0x7f78e00adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dffff700 1 -- 172.21.15.57:0/2614149872 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d0009470 con 0x7f78e0148360 2021-06-25T04:51:02.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78deffd700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00b1d70 0x7f78e0062780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:02.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dffff700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78e0148360 0x7f78e0066ef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f78e01476f0 tx=0x7f78d8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:02.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dcff9700 1 -- 172.21.15.57:0/2614149872 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d8006b20 con 0x7f78e0148360 2021-06-25T04:51:02.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dcff9700 1 -- 172.21.15.57:0/2614149872 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d8012e80 con 0x7f78e0148360 2021-06-25T04:51:02.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2614149872 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d800b180 con 0x7f78e0148360 2021-06-25T04:51:02.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78dcff9700 1 -- 172.21.15.57:0/2614149872 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d801f630 con 0x7f78e0148360 2021-06-25T04:51:02.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2614149872 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e00ac2c0 con 0x7f78e0148360 2021-06-25T04:51:02.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.031+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2614149872 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e0057310 con 0x7f78e0148360 2021-06-25T04:51:02.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.035+0000 7f78dcff9700 1 -- 172.21.15.57:0/2614149872 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f78d8025020 con 0x7f78e0148360 2021-06-25T04:51:02.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.035+0000 7f78dcff9700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f78c4055340 0x7f78c4057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:02.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.035+0000 7f78dcff9700 1 -- 172.21.15.57:0/2614149872 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f78d806eb30 con 0x7f78e0148360 2021-06-25T04:51:02.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.035+0000 7f78df7fe700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f78c4055340 0x7f78c4057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:02.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.035+0000 7f78df7fe700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f78c4055340 0x7f78c4057800 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f78c800d000 tx=0x7f78c8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:02.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.043+0000 7f78dcff9700 1 -- 172.21.15.57:0/2614149872 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f78d8044fc0 con 0x7f78e0148360 2021-06-25T04:51:02.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.207+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2614149872 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f78e0044610 con 0x7f78e0148360 2021-06-25T04:51:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.631+0000 7f78dcff9700 1 -- 172.21.15.57:0/2614149872 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v160) v1 ==== 144+0+0 (secure 0 0 0) 0x7f78d80485e0 con 0x7f78e0148360 2021-06-25T04:51:02.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.631+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f78c4055340 msgr2=0x7f78c4057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:02.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.631+0000 7f78e5c3b700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f78c4055340 0x7f78c4057800 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f78c800d000 tx=0x7f78c8009040).stop 2021-06-25T04:51:02.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.631+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2614149872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78e0148360 msgr2=0x7f78e0066ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:02.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.631+0000 7f78e5c3b700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78e0148360 0x7f78e0066ef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f78e01476f0 tx=0x7f78d8014000).stop 2021-06-25T04:51:02.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.631+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2614149872 shutdown_connections 2021-06-25T04:51:02.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.631+0000 7f78e5c3b700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f78c4055340 0x7f78c4057800 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.631+0000 7f78e5c3b700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78e0148360 0x7f78e0066ef0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.631+0000 7f78e5c3b700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78e00b1d70 0x7f78e0062780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.631+0000 7f78e5c3b700 1 --2- 172.21.15.57:0/2614149872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78e00a7080 0x7f78e00adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.631+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2614149872 >> 172.21.15.57:0/2614149872 conn(0x7f78e005f670 msgr2=0x7f78e00b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:02.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.635+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2614149872 shutdown_connections 2021-06-25T04:51:02.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.635+0000 7f78e5c3b700 1 -- 172.21.15.57:0/2614149872 wait complete. 2021-06-25T04:51:02.652 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-06-25T04:51:02.653 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-06-25T04:51:02.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-06-25T04:51:02.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.751+0000 7f4899c0e700 1 Processor -- start 2021-06-25T04:51:02.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.751+0000 7f4899c0e700 1 -- start start 2021-06-25T04:51:02.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.751+0000 7f4899c0e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48940672c0 0x7f48941438b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:02.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4899c0e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48940aab70 con 0x7f4894143da0 2021-06-25T04:51:02.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4899c0e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48940604a0 con 0x7f48940600c0 2021-06-25T04:51:02.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4899c0e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4894066e60 con 0x7f48940672c0 2021-06-25T04:51:02.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4893fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4894143da0 0x7f489414b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54926/0 (socket says 172.21.15.57:54926) 2021-06-25T04:51:02.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4893fff700 1 -- 172.21.15.57:0/3813079342 learned_addr learned my addr 172.21.15.57:0/3813079342 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:02.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f488affd700 1 --2- 172.21.15.57:0/3813079342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48940672c0 0x7f48941438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:02.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4892ffd700 1 -- 172.21.15.57:0/3813079342 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439774761 0 0) 0x7f48940aab70 con 0x7f4894143da0 2021-06-25T04:51:02.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4892ffd700 1 -- 172.21.15.57:0/3813079342 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4874003260 con 0x7f4894143da0 2021-06-25T04:51:02.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4892ffd700 1 -- 172.21.15.57:0/3813079342 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471368027 0 0) 0x7f48940604a0 con 0x7f48940600c0 2021-06-25T04:51:02.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4892ffd700 1 -- 172.21.15.57:0/3813079342 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48940aab70 con 0x7f48940600c0 2021-06-25T04:51:02.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f488affd700 1 -- 172.21.15.57:0/3813079342 >> v1:172.21.15.87:6789/0 conn(0x7f48940600c0 legacy=0x7f48940b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:02.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4892ffd700 1 -- 172.21.15.57:0/3813079342 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3911793608 0 0) 0x7f4874003260 con 0x7f4894143da0 2021-06-25T04:51:02.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f488affd700 1 -- 172.21.15.57:0/3813079342 >> v1:172.21.15.57:6789/0 conn(0x7f4894143da0 legacy=0x7f489414b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:02.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f488affd700 1 -- 172.21.15.57:0/3813079342 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940b3370 con 0x7f48940672c0 2021-06-25T04:51:02.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f488affd700 1 --2- 172.21.15.57:0/3813079342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48940672c0 0x7f48941438b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f488c001490 tx=0x7f487c006df0).ready entity=mon.2 client_cookie=29ae5a54449fc655 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:02.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4892ffd700 1 -- 172.21.15.57:0/3813079342 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f488c0019e0 con 0x7f48940672c0 2021-06-25T04:51:02.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4892ffd700 1 -- 172.21.15.57:0/3813079342 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c000e90 con 0x7f48940672c0 2021-06-25T04:51:02.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4892ffd700 1 -- 172.21.15.57:0/3813079342 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f487c012460 con 0x7f48940672c0 2021-06-25T04:51:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4899c0e700 1 -- 172.21.15.57:0/3813079342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48940672c0 msgr2=0x7f48941438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4899c0e700 1 --2- 172.21.15.57:0/3813079342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48940672c0 0x7f48941438b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f488c001490 tx=0x7f487c006df0).stop 2021-06-25T04:51:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4899c0e700 1 -- 172.21.15.57:0/3813079342 shutdown_connections 2021-06-25T04:51:02.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4899c0e700 1 --2- 172.21.15.57:0/3813079342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48940672c0 0x7f48941438b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4899c0e700 1 -- 172.21.15.57:0/3813079342 >> 172.21.15.57:0/3813079342 conn(0x7f489405cef0 msgr2=0x7f489405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4899c0e700 1 -- 172.21.15.57:0/3813079342 shutdown_connections 2021-06-25T04:51:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.755+0000 7f4899c0e700 1 -- 172.21.15.57:0/3813079342 wait complete. 2021-06-25T04:51:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f4899c0e700 1 Processor -- start 2021-06-25T04:51:02.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f4899c0e700 1 -- start start 2021-06-25T04:51:02.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f4899c0e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48940600c0 0x7f48940add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:02.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f4899c0e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48940672c0 0x7f489409efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:02.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f4899c0e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4894143da0 0x7f489409f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:02.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f4899c0e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48940a09b0 con 0x7f4894143da0 2021-06-25T04:51:02.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f4899c0e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489409e910 con 0x7f48940672c0 2021-06-25T04:51:02.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f4899c0e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48940aa7c0 con 0x7f48940600c0 2021-06-25T04:51:02.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f4893fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4894143da0 0x7f489409f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:02.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f4893fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4894143da0 0x7f489409f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37714/0 (socket says 172.21.15.57:37714) 2021-06-25T04:51:02.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f4893fff700 1 -- 172.21.15.57:0/1551111799 learned_addr learned my addr 172.21.15.57:0/1551111799 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:02.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f48937fe700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48940600c0 0x7f48940add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:02.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.759+0000 7f488affd700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48940672c0 0x7f489409efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:02.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f4893fff700 1 -- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48940600c0 msgr2=0x7f48940add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:02.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f4893fff700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48940600c0 0x7f48940add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f4893fff700 1 -- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48940672c0 msgr2=0x7f489409efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:02.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f4893fff700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48940672c0 0x7f489409efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:02.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f4893fff700 1 -- 172.21.15.57:0/1551111799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c00b180 con 0x7f4894143da0 2021-06-25T04:51:02.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f4893fff700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4894143da0 0x7f489409f4d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f48940ad290 tx=0x7f488c001a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:02.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f48917fa700 1 -- 172.21.15.57:0/1551111799 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f488c004ab0 con 0x7f4894143da0 2021-06-25T04:51:02.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f48917fa700 1 -- 172.21.15.57:0/1551111799 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c004c10 con 0x7f4894143da0 2021-06-25T04:51:02.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f4899c0e700 1 -- 172.21.15.57:0/1551111799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4894150530 con 0x7f4894143da0 2021-06-25T04:51:02.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f48917fa700 1 -- 172.21.15.57:0/1551111799 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f488c007170 con 0x7f4894143da0 2021-06-25T04:51:02.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f4899c0e700 1 -- 172.21.15.57:0/1551111799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48940ace30 con 0x7f4894143da0 2021-06-25T04:51:02.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f4899c0e700 1 -- 172.21.15.57:0/1551111799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4894057310 con 0x7f4894143da0 2021-06-25T04:51:02.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f48917fa700 1 -- 172.21.15.57:0/1551111799 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f488c0072d0 con 0x7f4894143da0 2021-06-25T04:51:02.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f48917fa700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f48780553d0 0x7f4878057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:02.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f48917fa700 1 -- 172.21.15.57:0/1551111799 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f488c06d9c0 con 0x7f4894143da0 2021-06-25T04:51:02.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.763+0000 7f48937fe700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f48780553d0 0x7f4878057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:02.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.767+0000 7f48937fe700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f48780553d0 0x7f4878057890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f488400d000 tx=0x7f4884007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:02.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.767+0000 7f48917fa700 1 -- 172.21.15.57:0/1551111799 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f488c043d40 con 0x7f4894143da0 2021-06-25T04:51:02.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:02.943+0000 7f4899c0e700 1 -- 172.21.15.57:0/1551111799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f489409fc30 con 0x7f4894143da0 2021-06-25T04:51:03.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.631+0000 7f48917fa700 1 -- 172.21.15.57:0/1551111799 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v161) v1 ==== 155+0+0 (secure 0 0 0) 0x7f488c047360 con 0x7f4894143da0 2021-06-25T04:51:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 -- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f48780553d0 msgr2=0x7f4878057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f48780553d0 0x7f4878057890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f488400d000 tx=0x7f4884007a00).stop 2021-06-25T04:51:03.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 -- 172.21.15.57:0/1551111799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4894143da0 msgr2=0x7f489409f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:03.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4894143da0 0x7f489409f4d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f48940ad290 tx=0x7f488c001a80).stop 2021-06-25T04:51:03.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 -- 172.21.15.57:0/1551111799 shutdown_connections 2021-06-25T04:51:03.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f48780553d0 0x7f4878057890 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4894143da0 0x7f489409f4d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48940672c0 0x7f489409efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 --2- 172.21.15.57:0/1551111799 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48940600c0 0x7f48940add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 -- 172.21.15.57:0/1551111799 >> 172.21.15.57:0/1551111799 conn(0x7f489405cef0 msgr2=0x7f4894065680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:03.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 -- 172.21.15.57:0/1551111799 shutdown_connections 2021-06-25T04:51:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.639+0000 7f4899c0e700 1 -- 172.21.15.57:0/1551111799 wait complete. 2021-06-25T04:51:03.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:51:03.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.767+0000 7fdfd359e700 1 Processor -- start 2021-06-25T04:51:03.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.767+0000 7fdfd359e700 1 -- start start 2021-06-25T04:51:03.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.767+0000 7fdfd359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdfd40b5460 0x7fdfd40af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:03.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.767+0000 7fdfd359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdfd40b05d0 0x7fdfd4147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:03.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.767+0000 7fdfd359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd40b5840 con 0x7fdfd4067560 2021-06-25T04:51:03.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.767+0000 7fdfd359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd41452a0 con 0x7fdfd40b5460 2021-06-25T04:51:03.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.767+0000 7fdfd359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd40adfb0 con 0x7fdfd40b05d0 2021-06-25T04:51:03.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.767+0000 7fdfd259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdfd40b5460 0x7fdfd40af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:03.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.767+0000 7fdfd2d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdfd4067560 0x7fdfd40acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54936/0 (socket says 172.21.15.57:54936) 2021-06-25T04:51:03.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.767+0000 7fdfd2d9d700 1 -- 172.21.15.57:0/1732632333 learned_addr learned my addr 172.21.15.57:0/1732632333 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:03.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd1d9b700 1 --2- 172.21.15.57:0/1732632333 >> v2:172.21.15.87:3300/0 conn(0x7fdfd40b05d0 0x7fdfd4147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:03.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd159a700 1 -- 172.21.15.57:0/1732632333 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975985160 0 0) 0x7fdfd40b5840 con 0x7fdfd4067560 2021-06-25T04:51:03.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd159a700 1 -- 172.21.15.57:0/1732632333 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb8003260 con 0x7fdfd4067560 2021-06-25T04:51:03.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd259c700 1 -- 172.21.15.57:0/1732632333 >> v2:172.21.15.87:3300/0 conn(0x7fdfd40b05d0 msgr2=0x7fdfd4147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:03.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd259c700 1 --2- 172.21.15.57:0/1732632333 >> v2:172.21.15.87:3300/0 conn(0x7fdfd40b05d0 0x7fdfd4147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd259c700 1 -- 172.21.15.57:0/1732632333 >> v1:172.21.15.57:6789/0 conn(0x7fdfd4067560 legacy=0x7fdfd40acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:03.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd259c700 1 -- 172.21.15.57:0/1732632333 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd40ac7c0 con 0x7fdfd40b5460 2021-06-25T04:51:03.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd259c700 1 --2- 172.21.15.57:0/1732632333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfd40b5460 0x7fdfd40af510 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fdfc8002f70 tx=0x7fdfc8006df0).ready entity=mon.0 client_cookie=1948f74c25a3fd34 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:03.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd159a700 1 -- 172.21.15.57:0/1732632333 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc800d4f0 con 0x7fdfd40b5460 2021-06-25T04:51:03.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd159a700 1 -- 172.21.15.57:0/1732632333 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8000e90 con 0x7fdfd40b5460 2021-06-25T04:51:03.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd159a700 1 -- 172.21.15.57:0/1732632333 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc800d880 con 0x7fdfd40b5460 2021-06-25T04:51:03.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd359e700 1 -- 172.21.15.57:0/1732632333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfd40b5460 msgr2=0x7fdfd40af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:03.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd359e700 1 --2- 172.21.15.57:0/1732632333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfd40b5460 0x7fdfd40af510 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fdfc8002f70 tx=0x7fdfc8006df0).stop 2021-06-25T04:51:03.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd359e700 1 -- 172.21.15.57:0/1732632333 shutdown_connections 2021-06-25T04:51:03.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd359e700 1 --2- 172.21.15.57:0/1732632333 >> v2:172.21.15.87:3300/0 conn(0x7fdfd40b05d0 0x7fdfd4147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd359e700 1 --2- 172.21.15.57:0/1732632333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfd40b5460 0x7fdfd40af510 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd359e700 1 -- 172.21.15.57:0/1732632333 >> 172.21.15.57:0/1732632333 conn(0x7fdfd4062520 msgr2=0x7fdfd4062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:03.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd359e700 1 -- 172.21.15.57:0/1732632333 shutdown_connections 2021-06-25T04:51:03.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.771+0000 7fdfd359e700 1 -- 172.21.15.57:0/1732632333 wait complete. 2021-06-25T04:51:03.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd359e700 1 Processor -- start 2021-06-25T04:51:03.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd359e700 1 -- start start 2021-06-25T04:51:03.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfd4067560 0x7fdfd4063f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:03.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfd40b05d0 0x7fdfd40abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:03.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd40b5460 0x7fdfd40ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:03.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd414e340 con 0x7fdfd4067560 2021-06-25T04:51:03.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd4065810 con 0x7fdfd40b05d0 2021-06-25T04:51:03.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd414a830 con 0x7fdfd40b5460 2021-06-25T04:51:03.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfd4067560 0x7fdfd4063f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:03.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfd4067560 0x7fdfd4063f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37724/0 (socket says 172.21.15.57:37724) 2021-06-25T04:51:03.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd259c700 1 -- 172.21.15.57:0/1430103596 learned_addr learned my addr 172.21.15.57:0/1430103596 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:03.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd1d9b700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfd40b05d0 0x7fdfd40abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:03.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd2d9d700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd40b5460 0x7fdfd40ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:03.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd259c700 1 -- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd40b5460 msgr2=0x7fdfd40ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd259c700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd40b5460 0x7fdfd40ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd259c700 1 -- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfd40b05d0 msgr2=0x7fdfd40abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd259c700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfd40b05d0 0x7fdfd40abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd259c700 1 -- 172.21.15.57:0/1430103596 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc800b180 con 0x7fdfd4067560 2021-06-25T04:51:03.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.775+0000 7fdfd259c700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfd4067560 0x7fdfd4063f30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fdfc8002f70 tx=0x7fdfc8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:03.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.779+0000 7fdfc37fe700 1 -- 172.21.15.57:0/1430103596 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc8012ab0 con 0x7fdfd4067560 2021-06-25T04:51:03.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.779+0000 7fdfc37fe700 1 -- 172.21.15.57:0/1430103596 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8012c10 con 0x7fdfd4067560 2021-06-25T04:51:03.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.779+0000 7fdfd359e700 1 -- 172.21.15.57:0/1430103596 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd414acd0 con 0x7fdfd4067560 2021-06-25T04:51:03.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.779+0000 7fdfc37fe700 1 -- 172.21.15.57:0/1430103596 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc801f480 con 0x7fdfd4067560 2021-06-25T04:51:03.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.779+0000 7fdfd359e700 1 -- 172.21.15.57:0/1430103596 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd4064910 con 0x7fdfd4067560 2021-06-25T04:51:03.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.779+0000 7fdfd359e700 1 -- 172.21.15.57:0/1430103596 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd40659d0 con 0x7fdfd4067560 2021-06-25T04:51:03.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.779+0000 7fdfc37fe700 1 -- 172.21.15.57:0/1430103596 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdfc800f030 con 0x7fdfd4067560 2021-06-25T04:51:03.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.779+0000 7fdfc37fe700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfb0055450 0x7fdfb0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:03.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.779+0000 7fdfc37fe700 1 -- 172.21.15.57:0/1430103596 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fdfc806ebb0 con 0x7fdfd4067560 2021-06-25T04:51:03.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.779+0000 7fdfd1d9b700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfb0055450 0x7fdfb0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:03.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.783+0000 7fdfd1d9b700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfb0055450 0x7fdfb0057910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fdfc400b000 tx=0x7fdfc4006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:03.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.787+0000 7fdfc37fe700 1 -- 172.21.15.57:0/1430103596 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdfc8075080 con 0x7fdfd4067560 2021-06-25T04:51:03.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.919+0000 7fdfd359e700 1 -- 172.21.15.57:0/1430103596 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdfd4057310 con 0x7fdfd4067560 2021-06-25T04:51:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfc37fe700 1 -- 172.21.15.57:0/1430103596 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdfc8024030 con 0x7fdfd4067560 2021-06-25T04:51:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 -- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfb0055450 msgr2=0x7fdfb0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfb0055450 0x7fdfb0057910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fdfc400b000 tx=0x7fdfc4006df0).stop 2021-06-25T04:51:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 -- 172.21.15.57:0/1430103596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfd4067560 msgr2=0x7fdfd4063f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfd4067560 0x7fdfd4063f30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fdfc8002f70 tx=0x7fdfc8014000).stop 2021-06-25T04:51:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 -- 172.21.15.57:0/1430103596 shutdown_connections 2021-06-25T04:51:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfb0055450 0x7fdfb0057910 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd40b5460 0x7fdfd40ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfd40b05d0 0x7fdfd40abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 --2- 172.21.15.57:0/1430103596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfd4067560 0x7fdfd4063f30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:03.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 -- 172.21.15.57:0/1430103596 >> 172.21.15.57:0/1430103596 conn(0x7fdfd4062520 msgr2=0x7fdfd41488d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:03.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 -- 172.21.15.57:0/1430103596 shutdown_connections 2021-06-25T04:51:03.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:03.927+0000 7fdfd359e700 1 -- 172.21.15.57:0/1430103596 wait complete. 2021-06-25T04:51:03.945 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:51:03.946 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:51:03.961 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:51:03.983 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:51:04.005 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:51:04.030 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:51:04.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:04.031 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:51:04.031 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:04.039 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:51:04.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:51:04.041 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:51:04.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:04.042 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:51:04.042 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:51:04.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:51:04.053 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:51:04.054 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:51:04.055 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:51:04.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.159+0000 7f22f8ceb700 1 Processor -- start 2021-06-25T04:51:04.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.159+0000 7f22f8ceb700 1 -- start start 2021-06-25T04:51:04.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 0x7f22f4143990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f405f7f0 con 0x7f22f40ae1f0 2021-06-25T04:51:04.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f405fa90 con 0x7f22f405c450 2021-06-25T04:51:04.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f405fd30 con 0x7f22f40b0920 2021-06-25T04:51:04.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f259c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f22f40ae1f0 0x7f22f4143280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54952/0 (socket says 172.21.15.57:54952) 2021-06-25T04:51:04.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f259c700 1 -- 172.21.15.57:0/3451466536 learned_addr learned my addr 172.21.15.57:0/3451466536 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:04.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f2d9d700 1 --2- 172.21.15.57:0/3451466536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 0x7f22f4143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f1d9b700 1 -- 172.21.15.57:0/3451466536 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820800703 0 0) 0x7f22f405f7f0 con 0x7f22f40ae1f0 2021-06-25T04:51:04.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f1d9b700 1 -- 172.21.15.57:0/3451466536 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d4003260 con 0x7f22f40ae1f0 2021-06-25T04:51:04.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f1d9b700 1 -- 172.21.15.57:0/3451466536 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697117716 0 0) 0x7f22f405fa90 con 0x7f22f405c450 2021-06-25T04:51:04.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f1d9b700 1 -- 172.21.15.57:0/3451466536 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f405f7f0 con 0x7f22f405c450 2021-06-25T04:51:04.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f2d9d700 1 -- 172.21.15.57:0/3451466536 >> v1:172.21.15.87:6789/0 conn(0x7f22f405c450 legacy=0x7f22f40b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f2d9d700 1 -- 172.21.15.57:0/3451466536 >> v1:172.21.15.57:6789/0 conn(0x7f22f40ae1f0 legacy=0x7f22f4143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f2d9d700 1 -- 172.21.15.57:0/3451466536 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f405ffd0 con 0x7f22f40b0920 2021-06-25T04:51:04.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f2d9d700 1 --2- 172.21.15.57:0/3451466536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 0x7f22f4143990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f22ec0032f0 tx=0x7f22ec0091d0).ready entity=mon.2 client_cookie=7d32d56a33e8f8f4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:04.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f1d9b700 1 -- 172.21.15.57:0/3451466536 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22ec00b640 con 0x7f22f40b0920 2021-06-25T04:51:04.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f1d9b700 1 -- 172.21.15.57:0/3451466536 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec00b7a0 con 0x7f22f40b0920 2021-06-25T04:51:04.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f1d9b700 1 -- 172.21.15.57:0/3451466536 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22ec00b910 con 0x7f22f40b0920 2021-06-25T04:51:04.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 -- 172.21.15.57:0/3451466536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 msgr2=0x7f22f4143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 --2- 172.21.15.57:0/3451466536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 0x7f22f4143990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f22ec0032f0 tx=0x7f22ec0091d0).stop 2021-06-25T04:51:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 -- 172.21.15.57:0/3451466536 shutdown_connections 2021-06-25T04:51:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 --2- 172.21.15.57:0/3451466536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 0x7f22f4143990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 -- 172.21.15.57:0/3451466536 >> 172.21.15.57:0/3451466536 conn(0x7f22f405cce0 msgr2=0x7f22f4062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:04.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 -- 172.21.15.57:0/3451466536 shutdown_connections 2021-06-25T04:51:04.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 -- 172.21.15.57:0/3451466536 wait complete. 2021-06-25T04:51:04.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 Processor -- start 2021-06-25T04:51:04.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.163+0000 7f22f8ceb700 1 -- start start 2021-06-25T04:51:04.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f8ceb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22f405c450 0x7f22f40a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f8ceb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f40ae1f0 0x7f22f4063c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f8ceb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 0x7f22f4064100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f8ceb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f41465b0 con 0x7f22f40ae1f0 2021-06-25T04:51:04.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f8ceb700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f41475d0 con 0x7f22f405c450 2021-06-25T04:51:04.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f8ceb700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40ac9f0 con 0x7f22f40b0920 2021-06-25T04:51:04.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22ebfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f40ae1f0 0x7f22f4063c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22ebfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f40ae1f0 0x7f22f4063c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37740/0 (socket says 172.21.15.57:37740) 2021-06-25T04:51:04.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22ebfff700 1 -- 172.21.15.57:0/1891919157 learned_addr learned my addr 172.21.15.57:0/1891919157 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:04.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f259c700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22f405c450 0x7f22f40a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f2d9d700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 0x7f22f4064100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22ebfff700 1 -- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 msgr2=0x7f22f4064100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22ebfff700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 0x7f22f4064100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22ebfff700 1 -- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22f405c450 msgr2=0x7f22f40a2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22ebfff700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22f405c450 0x7f22f40a2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22ebfff700 1 -- 172.21.15.57:0/1891919157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec009470 con 0x7f22f40ae1f0 2021-06-25T04:51:04.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f259c700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22f405c450 0x7f22f40a2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:04.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f2d9d700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 0x7f22f4064100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:04.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22ebfff700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f40ae1f0 0x7f22f4063c10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f22f4147710 tx=0x7f22dc007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:04.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22eb7fe700 1 -- 172.21.15.57:0/1891919157 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22dc00ce20 con 0x7f22f40ae1f0 2021-06-25T04:51:04.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22eb7fe700 1 -- 172.21.15.57:0/1891919157 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc00f470 con 0x7f22f40ae1f0 2021-06-25T04:51:04.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f8ceb700 1 -- 172.21.15.57:0/1891919157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f4147130 con 0x7f22f40ae1f0 2021-06-25T04:51:04.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22eb7fe700 1 -- 172.21.15.57:0/1891919157 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22dc00f7d0 con 0x7f22f40ae1f0 2021-06-25T04:51:04.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f8ceb700 1 -- 172.21.15.57:0/1891919157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f40a4af0 con 0x7f22f40ae1f0 2021-06-25T04:51:04.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.167+0000 7f22f8ceb700 1 -- 172.21.15.57:0/1891919157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f40ac850 con 0x7f22f40ae1f0 2021-06-25T04:51:04.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.171+0000 7f22eb7fe700 1 -- 172.21.15.57:0/1891919157 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f22dc019030 con 0x7f22f40ae1f0 2021-06-25T04:51:04.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.171+0000 7f22eb7fe700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22d80553f0 0x7f22d80578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.171+0000 7f22eb7fe700 1 -- 172.21.15.57:0/1891919157 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f22dc06d0a0 con 0x7f22f40ae1f0 2021-06-25T04:51:04.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.171+0000 7f22f259c700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22d80553f0 0x7f22d80578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.171+0000 7f22f259c700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22d80553f0 0x7f22d80578b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f22e400b000 tx=0x7f22e4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:04.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.175+0000 7f22eb7fe700 1 -- 172.21.15.57:0/1891919157 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f22f40ac850 con 0x7f22f40ae1f0 2021-06-25T04:51:04.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.303+0000 7f22f8ceb700 1 -- 172.21.15.57:0/1891919157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f22f40ac850 con 0x7f22f40ae1f0 2021-06-25T04:51:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.307+0000 7f22eb7fe700 1 -- 172.21.15.57:0/1891919157 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+29217 (secure 0 0 0) 0x7f22f40ac850 con 0x7f22f40ae1f0 2021-06-25T04:51:04.313 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:04.313 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:51:04.313 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 49, 2021-06-25T04:51:04.313 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:51:04.314 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:51:04.314 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:51:01.611604+0000", 2021-06-25T04:51:04.314 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:51:04.314 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:51:04.315 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:51:04.315 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:51:04.316 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:51:04.316 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:51:04.316 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:51:04.316 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:51:04.317 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:51:04.317 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:51:04.317 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:51:04.317 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:51:04.318 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:51:04.318 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:51:04.318 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:51:04.318 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 8, 2021-06-25T04:51:04.319 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:51:04.319 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:51:04.319 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:51:04.319 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:51:04.319 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:51:04.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.320 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:51:04.321 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:51:04.321 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:51:04.321 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:51:04.322 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:51:04.322 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:51:04.322 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:51:04.322 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:51:04.323 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:51:04.323 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:51:04.323 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:51:04.323 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:51:04.324 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:51:04.324 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:51:04.324 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:51:04.324 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:51:04.325 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:51:04.325 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:51:04.325 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:51:04.325 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:51:04.326 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:51:04.326 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:51:04.326 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:51:04.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.327 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:51:04.327 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:51:04.327 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:51:04.327 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:51:04.328 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:51:04.328 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:51:04.328 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:51:04.328 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:51:04.329 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:51:04.329 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:51:04.329 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:51:04.330 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:51:04.330 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:51:04.330 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:51:04.330 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:51:04.331 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:51:04.331 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:51:04.331 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:51:04.331 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:51:04.332 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:51:04.332 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:51:04.332 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:51:04.334 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:51:04.334 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:51:04.334 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:51:04.334 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:51:04.334 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:51:04.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.335 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:51:04.335 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:51:04.335 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:51:04.336 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:51:04.336 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:51:04.336 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:51:04.337 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:51:04.338 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:51:04.338 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:51:04.338 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:51:04.339 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:51:04.339 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:51:04.339 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:51:04.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.340 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:51:04.340 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:51:04.340 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.341 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:51:04.341 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:51:04.342 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:51:04.342 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:51:04.343 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:51:04.343 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:51:04.343 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:51:04.343 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:51:04.344 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:51:04.344 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:51:04.344 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:51:04.345 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:51:04.345 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:51:04.345 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:51:04.346 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:51:04.346 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:51:04.346 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:51:04.346 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:51:04.346 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:51:04.347 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:51:04.347 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:51:04.347 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:51:04.347 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:51:04.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.348 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:51:04.349 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:51:04.349 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:51:04.349 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:51:04.349 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:51:04.350 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:51:04.350 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:51:04.350 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:51:04.350 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:51:04.351 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:51:04.351 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:51:04.351 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:51:04.351 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:51:04.352 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:51:04.352 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:51:04.352 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:51:04.352 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:51:04.353 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:51:04.353 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:51:04.353 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:51:04.353 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:51:04.354 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:51:04.354 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:51:04.354 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:51:04.354 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:51:04.355 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:51:04.355 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:51:04.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.355 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:51:04.356 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:51:04.356 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:51:04.356 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:51:04.356 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:51:04.357 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:51:04.357 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:51:04.357 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:51:04.357 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:51:04.358 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:51:04.358 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:51:04.358 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:51:04.359 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:51:04.359 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:51:04.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.360 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:51:04.360 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:51:04.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.361 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:51:04.361 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:51:04.361 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:51:04.362 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:51:04.362 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:51:04.362 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:51:04.363 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:51:04.363 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:51:04.363 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:51:04.363 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:51:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:51:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:51:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:51:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:51:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:51:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:51:04.367 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:51:04.367 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.367 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.368 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:51:04.368 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.368 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.369 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:51:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:51:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:51:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:51:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:51:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:51:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:51:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:51:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:51:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:51:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:51:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:51:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:51:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:51:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:51:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:51:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:51:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:51:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:51:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:51:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:51:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:51:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:51:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:51:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:51:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:51:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:51:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:51:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:51:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:51:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:51:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:51:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:51:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:51:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:51:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:51:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:51:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:51:04.388 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.388 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.388 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:51:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:51:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:51:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:51:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:51:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:51:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:51:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:51:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:51:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:51:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:51:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:51:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:51:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:51:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:51:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:51:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:51:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:51:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:51:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:51:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:51:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:51:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:51:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:51:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:51:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:51:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:51:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:51:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:51:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:51:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:51:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 32, 2021-06-25T04:51:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:51:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:51:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:51:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:51:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:51:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:51:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:51:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:51:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:51:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:51:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:51:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:51:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:51:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:51:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:51:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:51:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:51:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:51:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:51:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:51:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:51:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:51:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:51:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:51:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:51:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:51:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:51:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:51:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:51:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:51:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:51:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:51:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:51:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:51:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:51:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:51:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:51:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:51:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:51:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:51:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:51:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:51:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:51:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:51:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:51:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:51:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:51:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:51:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:51:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:51:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:51:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:51:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:51:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:51:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:51:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:51:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:51:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:51:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:51:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:51:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:51:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:51:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:51:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:51:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:51:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:51:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:51:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:51:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:51:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:51:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:51:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:51:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:51:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:51:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:51:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:51:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:51:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:51:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:51:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:51:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:51:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:51:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:51:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:51:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:51:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:51:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:51:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:51:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:51:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:51:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:51:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:51:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:51:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:51:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:51:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:51:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:51:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:51:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:51:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:51:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:51:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:51:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:51:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:51:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:51:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:51:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:51:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:51:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:51:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:51:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:51:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:51:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:51:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:51:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:51:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:51:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:51:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:51:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:51:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:51:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:51:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:51:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:51:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:51:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:51:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.472 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:51:04.472 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:51:04.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.473 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.473 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:51:04.473 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:51:04.473 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.474 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.474 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:51:04.474 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.475 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.475 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:51:04.475 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:51:04.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.476 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.476 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:51:04.477 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:51:04.477 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.477 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.478 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:51:04.478 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.479 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.479 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:51:04.479 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:51:04.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.480 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.480 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:51:04.480 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:51:04.480 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.481 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.481 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:51:04.482 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:51:04.482 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:51:04.482 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:51:04.482 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:51:04.482 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:51:04.483 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:51:04.483 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.484 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:51:04.484 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:51:04.484 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:51:04.484 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:51:04.485 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:51:04.485 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:51:04.485 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:51:04.485 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:51:04.486 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:51:04.486 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 43, 2021-06-25T04:51:04.486 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:51:04.486 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:51:04.487 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:51:04.487 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.488 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.488 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:51:04.488 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:51:04.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.489 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.489 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:51:04.490 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:51:04.490 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.490 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.490 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:51:04.491 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.491 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.491 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:51:04.492 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:51:04.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.492 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.492 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:51:04.493 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:51:04.493 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.493 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.494 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:51:04.494 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.494 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.495 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:51:04.495 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:51:04.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.495 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.496 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:51:04.496 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:51:04.496 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.496 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.497 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:51:04.497 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.498 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.498 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:51:04.499 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:51:04.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.500 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.500 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:51:04.500 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:51:04.500 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.500 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.501 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:51:04.501 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:51:04.501 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:51:04.502 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:51:04.502 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:51:04.502 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:51:04.502 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:51:04.502 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:51:04.503 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:51:04.504 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:51:04.504 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:51:04.504 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:51:04.504 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:51:04.504 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:51:04.505 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:51:04.505 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:51:04.505 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 42, 2021-06-25T04:51:04.505 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:51:04.505 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:51:04.506 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:51:04.506 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.506 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.507 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:51:04.507 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:51:04.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.508 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.508 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:51:04.508 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:51:04.508 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.509 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.509 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:51:04.509 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.510 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.510 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:51:04.510 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:51:04.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.511 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.511 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:51:04.511 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:51:04.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.512 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.512 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:51:04.512 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.513 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.513 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:51:04.513 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:51:04.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.514 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.514 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:51:04.515 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:51:04.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.515 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.516 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:51:04.516 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:51:04.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.517 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:51:04.517 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:51:04.517 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:51:04.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.518 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:51:04.518 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:51:04.518 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:51:04.519 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.519 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.519 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:51:04.520 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:51:04.520 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:51:04.520 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:51:04.520 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:51:04.520 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:51:04.521 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:51:04.521 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:04.521 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.521 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:51:04.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:51:04.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:51:04.522 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:51:04.523 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:51:04.523 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:51:04.523 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:51:04.523 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:51:04.524 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:51:04.524 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:51:04.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.524 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:51:04.525 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:51:04.525 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:51:04.525 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:51:04.525 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:51:04.525 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:51:04.526 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:51:04.526 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:51:04.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.527 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:51:04.527 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:51:04.527 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:51:04.527 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:51:04.527 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:51:04.528 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:51:04.528 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:51:04.528 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:51:04.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.529 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:51:04.529 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:51:04.529 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:51:04.530 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:51:04.530 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:51:04.530 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:51:04.530 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:51:04.531 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:51:04.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.531 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:51:04.531 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:51:04.532 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:51:04.532 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:51:04.532 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:51:04.532 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:51:04.533 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:51:04.533 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:51:04.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.534 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:51:04.534 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:51:04.534 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:51:04.534 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:51:04.535 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:51:04.535 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:51:04.535 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:51:04.535 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:51:04.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.536 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:51:04.536 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:51:04.536 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:51:04.537 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:51:04.537 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:51:04.537 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:51:04.537 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:51:04.538 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:51:04.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:04.539 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:51:04.539 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:51:04.539 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:51:04.539 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:51:04.540 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:51:04.540 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:51:04.540 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:51:04.540 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:51:04.540 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.541 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:51:04.541 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:51:04.541 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:51:04.541 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:51:04.542 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:51:04.542 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:51:04.542 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6835/792452299": "2021-06-26T04:50:57.678160+0000", 2021-06-25T04:51:04.542 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6834/792452299": "2021-06-26T04:50:57.678160+0000" 2021-06-25T04:51:04.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.543 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:51:04.543 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:51:04.543 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:51:04.544 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:51:04.544 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:51:04.544 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:51:04.544 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:51:04.544 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:51:04.545 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:51:04.545 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:51:04.545 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:51:04.545 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:51:04.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.546 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:51:04.546 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:51:04.546 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:51:04.547 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:51:04.547 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:51:04.547 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:51:04.547 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:51:04.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:04.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:04.548 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:51:04.548 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:51:04.548 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:51:04.549 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:51:04.549 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:51:04.549 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:51:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.307+0000 7f22f8ceb700 1 -- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22d80553f0 msgr2=0x7f22d80578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.307+0000 7f22f8ceb700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22d80553f0 0x7f22d80578b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f22e400b000 tx=0x7f22e4009040).stop 2021-06-25T04:51:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.307+0000 7f22f8ceb700 1 -- 172.21.15.57:0/1891919157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f40ae1f0 msgr2=0x7f22f4063c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.307+0000 7f22f8ceb700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f40ae1f0 0x7f22f4063c10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f22f4147710 tx=0x7f22dc007a90).stop 2021-06-25T04:51:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.307+0000 7f22f8ceb700 1 -- 172.21.15.57:0/1891919157 shutdown_connections 2021-06-25T04:51:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.307+0000 7f22f8ceb700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22d80553f0 0x7f22d80578b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.307+0000 7f22f8ceb700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22f40b0920 0x7f22f4064100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.307+0000 7f22f8ceb700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f40ae1f0 0x7f22f4063c10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.307+0000 7f22f8ceb700 1 --2- 172.21.15.57:0/1891919157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22f405c450 0x7f22f40a2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.307+0000 7f22f8ceb700 1 -- 172.21.15.57:0/1891919157 >> 172.21.15.57:0/1891919157 conn(0x7f22f405cce0 msgr2=0x7f22f40af910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.311+0000 7f22f8ceb700 1 -- 172.21.15.57:0/1891919157 shutdown_connections 2021-06-25T04:51:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.311+0000 7f22f8ceb700 1 -- 172.21.15.57:0/1891919157 wait complete. 2021-06-25T04:51:04.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:51:04.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f13456ab700 1 Processor -- start 2021-06-25T04:51:04.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f13456ab700 1 -- start start 2021-06-25T04:51:04.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f13456ab700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f13400b05d0 0x7f13400af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f13456ab700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1340147560 0x7f13400acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f13456ab700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13401479b0 con 0x7f13400b5460 2021-06-25T04:51:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f13456ab700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13401452a0 con 0x7f1340147560 2021-06-25T04:51:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f13456ab700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13400adfb0 con 0x7f13400b05d0 2021-06-25T04:51:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f1344eaa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1340147560 0x7f13400acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f133f7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f13400b05d0 0x7f13400af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f1344eaa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1340147560 0x7f13400acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37750/0 (socket says 172.21.15.57:37750) 2021-06-25T04:51:04.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f1344eaa700 1 -- 172.21.15.57:0/1854258494 learned_addr learned my addr 172.21.15.57:0/1854258494 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:04.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f133ffff700 1 --1- 172.21.15.57:0/1854258494 >> v1:172.21.15.87:6789/0 conn(0x7f13400b5460 0x7f1340067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:55712/0 (socket says 172.21.15.57:55712) 2021-06-25T04:51:04.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f1344eaa700 1 -- 172.21.15.57:0/1854258494 >> v2:172.21.15.87:3300/0 conn(0x7f13400b05d0 msgr2=0x7f13400af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:04.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f1344eaa700 1 --2- 172.21.15.57:0/1854258494 >> v2:172.21.15.87:3300/0 conn(0x7f13400b05d0 0x7f13400af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f1344eaa700 1 -- 172.21.15.57:0/1854258494 >> v1:172.21.15.87:6789/0 conn(0x7f13400b5460 legacy=0x7f1340067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f1344eaa700 1 -- 172.21.15.57:0/1854258494 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13400b5840 con 0x7f1340147560 2021-06-25T04:51:04.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f1344eaa700 1 --2- 172.21.15.57:0/1854258494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1340147560 0x7f13400acc20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f1330002f70 tx=0x7f1330006eb0).ready entity=mon.0 client_cookie=a77994ec205c8932 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:04.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f133effd700 1 -- 172.21.15.57:0/1854258494 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f133000d5c0 con 0x7f1340147560 2021-06-25T04:51:04.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f133effd700 1 -- 172.21.15.57:0/1854258494 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330000e90 con 0x7f1340147560 2021-06-25T04:51:04.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f133effd700 1 -- 172.21.15.57:0/1854258494 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f133000d950 con 0x7f1340147560 2021-06-25T04:51:04.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f13456ab700 1 -- 172.21.15.57:0/1854258494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1340147560 msgr2=0x7f13400acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.659+0000 7f13456ab700 1 --2- 172.21.15.57:0/1854258494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1340147560 0x7f13400acc20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f1330002f70 tx=0x7f1330006eb0).stop 2021-06-25T04:51:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 -- 172.21.15.57:0/1854258494 shutdown_connections 2021-06-25T04:51:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 --2- 172.21.15.57:0/1854258494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1340147560 0x7f13400acc20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 --2- 172.21.15.57:0/1854258494 >> v2:172.21.15.87:3300/0 conn(0x7f13400b05d0 0x7f13400af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 -- 172.21.15.57:0/1854258494 >> 172.21.15.57:0/1854258494 conn(0x7f1340062520 msgr2=0x7f1340062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 -- 172.21.15.57:0/1854258494 shutdown_connections 2021-06-25T04:51:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 -- 172.21.15.57:0/1854258494 wait complete. 2021-06-25T04:51:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 Processor -- start 2021-06-25T04:51:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 -- start start 2021-06-25T04:51:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13400b05d0 0x7f1340156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13400b5460 0x7f134014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1340147560 0x7f1340145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13401453e0 con 0x7f13400b05d0 2021-06-25T04:51:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1340140840 con 0x7f13400b5460 2021-06-25T04:51:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f13456ab700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1340140ae0 con 0x7f1340147560 2021-06-25T04:51:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f133ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13400b05d0 0x7f1340156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f133ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13400b05d0 0x7f1340156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37752/0 (socket says 172.21.15.57:37752) 2021-06-25T04:51:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f133f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13400b5460 0x7f134014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f133ffff700 1 -- 172.21.15.57:0/2361858205 learned_addr learned my addr 172.21.15.57:0/2361858205 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.663+0000 7f1344eaa700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1340147560 0x7f1340145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f133ffff700 1 -- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1340147560 msgr2=0x7f1340145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f133ffff700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1340147560 0x7f1340145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f133ffff700 1 -- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13400b5460 msgr2=0x7f134014e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f133ffff700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13400b5460 0x7f134014e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f133ffff700 1 -- 172.21.15.57:0/2361858205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133000b1e0 con 0x7f13400b05d0 2021-06-25T04:51:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f1344eaa700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1340147560 0x7f1340145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f133ffff700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13400b05d0 0x7f1340156940 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f1340069d50 tx=0x7f1328007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f133d7fa700 1 -- 172.21.15.57:0/2361858205 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13280070d0 con 0x7f13400b05d0 2021-06-25T04:51:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f133d7fa700 1 -- 172.21.15.57:0/2361858205 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1328007230 con 0x7f13400b05d0 2021-06-25T04:51:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f13456ab700 1 -- 172.21.15.57:0/2361858205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1340140d80 con 0x7f13400b05d0 2021-06-25T04:51:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f133d7fa700 1 -- 172.21.15.57:0/2361858205 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1328005550 con 0x7f13400b05d0 2021-06-25T04:51:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f13456ab700 1 -- 172.21.15.57:0/2361858205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1340141620 con 0x7f13400b05d0 2021-06-25T04:51:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f13456ab700 1 -- 172.21.15.57:0/2361858205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1340057310 con 0x7f13400b05d0 2021-06-25T04:51:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.667+0000 7f133d7fa700 1 -- 172.21.15.57:0/2361858205 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1328010070 con 0x7f13400b05d0 2021-06-25T04:51:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.671+0000 7f133d7fa700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1318055510 0x7f13180579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.671+0000 7f133d7fa700 1 -- 172.21.15.57:0/2361858205 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f132806d3b0 con 0x7f13400b05d0 2021-06-25T04:51:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.671+0000 7f133f7fe700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1318055510 0x7f13180579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.671+0000 7f133f7fe700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1318055510 0x7f13180579d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f133800b000 tx=0x7f13380091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.675+0000 7f133d7fa700 1 -- 172.21.15.57:0/2361858205 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1328043730 con 0x7f13400b05d0 2021-06-25T04:51:04.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.839+0000 7f13456ab700 1 -- 172.21.15.57:0/2361858205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1340145780 con 0x7f13400b05d0 2021-06-25T04:51:04.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.839+0000 7f133d7fa700 1 -- 172.21.15.57:0/2361858205 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f1328046d50 con 0x7f13400b05d0 2021-06-25T04:51:04.846 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:04.846 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/587697587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":587697587},{"type":"v1","addr":"172.21.15.87:6835","nonce":587697587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/3950506435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3950506435},{"type":"v1","addr":"172.21.15.57:6833","nonce":3950506435}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3826968575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3826968575},{"type":"v1","addr":"172.21.15.57:6835","nonce":3826968575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20}],"filesystems":[]} 2021-06-25T04:51:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.839+0000 7f13456ab700 1 -- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1318055510 msgr2=0x7f13180579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.839+0000 7f13456ab700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1318055510 0x7f13180579d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f133800b000 tx=0x7f13380091d0).stop 2021-06-25T04:51:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.843+0000 7f13456ab700 1 -- 172.21.15.57:0/2361858205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13400b05d0 msgr2=0x7f1340156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.843+0000 7f13456ab700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13400b05d0 0x7f1340156940 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f1340069d50 tx=0x7f1328007c40).stop 2021-06-25T04:51:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.843+0000 7f13456ab700 1 -- 172.21.15.57:0/2361858205 shutdown_connections 2021-06-25T04:51:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.843+0000 7f13456ab700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1318055510 0x7f13180579d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.843+0000 7f13456ab700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1340147560 0x7f1340145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.843+0000 7f13456ab700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13400b5460 0x7f134014e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.843+0000 7f13456ab700 1 --2- 172.21.15.57:0/2361858205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13400b05d0 0x7f1340156940 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.843+0000 7f13456ab700 1 -- 172.21.15.57:0/2361858205 >> 172.21.15.57:0/2361858205 conn(0x7f1340062520 msgr2=0x7f13400acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.843+0000 7f13456ab700 1 -- 172.21.15.57:0/2361858205 shutdown_connections 2021-06-25T04:51:04.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.843+0000 7f13456ab700 1 -- 172.21.15.57:0/2361858205 wait complete. 2021-06-25T04:51:04.854 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 20 2021-06-25T04:51:04.858 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:51:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0bbdc7700 1 Processor -- start 2021-06-25T04:51:04.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0bbdc7700 1 -- start start 2021-06-25T04:51:04.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0bbdc7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe0b40ab610 0x7fe0b40ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0bbdc7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0b4140a10 0x7fe0b40605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0bbdc7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b4143130 con 0x7fe0b405fae0 2021-06-25T04:51:04.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0bbdc7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b4143560 con 0x7fe0b40ab610 2021-06-25T04:51:04.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0bbdc7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4140e70 con 0x7fe0b4140a10 2021-06-25T04:51:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0b9b63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe0b40ab610 0x7fe0b40ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0b9362700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe0b405fae0 0x7fe0b4140300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54980/0 (socket says 172.21.15.57:54980) 2021-06-25T04:51:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0b9362700 1 -- 172.21.15.57:0/925076056 learned_addr learned my addr 172.21.15.57:0/925076056 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:04.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0ba364700 1 --2- 172.21.15.57:0/925076056 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0b4140a10 0x7fe0b40605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0b9b63700 1 -- 172.21.15.57:0/925076056 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0b4140a10 msgr2=0x7fe0b40605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:04.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0b9b63700 1 --2- 172.21.15.57:0/925076056 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0b4140a10 0x7fe0b40605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0b9b63700 1 -- 172.21.15.57:0/925076056 >> v1:172.21.15.57:6789/0 conn(0x7fe0b405fae0 legacy=0x7fe0b4140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.955+0000 7fe0b9b63700 1 -- 172.21.15.57:0/925076056 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b4060350 con 0x7fe0b40ab610 2021-06-25T04:51:04.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0b9b63700 1 --2- 172.21.15.57:0/925076056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b40ab610 0x7fe0b40ab9f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fe0b0002f70 tx=0x7fe0b0006df0).ready entity=mon.0 client_cookie=6aeea98909bfd288 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:04.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0b8b61700 1 -- 172.21.15.57:0/925076056 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b000d570 con 0x7fe0b40ab610 2021-06-25T04:51:04.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0b8b61700 1 -- 172.21.15.57:0/925076056 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0000e90 con 0x7fe0b40ab610 2021-06-25T04:51:04.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0b8b61700 1 -- 172.21.15.57:0/925076056 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b000d8c0 con 0x7fe0b40ab610 2021-06-25T04:51:04.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/925076056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b40ab610 msgr2=0x7fe0b40ab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0bbdc7700 1 --2- 172.21.15.57:0/925076056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b40ab610 0x7fe0b40ab9f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fe0b0002f70 tx=0x7fe0b0006df0).stop 2021-06-25T04:51:04.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/925076056 shutdown_connections 2021-06-25T04:51:04.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0bbdc7700 1 --2- 172.21.15.57:0/925076056 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0b4140a10 0x7fe0b40605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0bbdc7700 1 --2- 172.21.15.57:0/925076056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b40ab610 0x7fe0b40ab9f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/925076056 >> 172.21.15.57:0/925076056 conn(0x7fe0b40b6490 msgr2=0x7fe0b40b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:04.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/925076056 shutdown_connections 2021-06-25T04:51:04.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/925076056 wait complete. 2021-06-25T04:51:04.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0bbdc7700 1 Processor -- start 2021-06-25T04:51:04.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.959+0000 7fe0bbdc7700 1 -- start start 2021-06-25T04:51:04.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0bbdc7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b405fae0 0x7fe0b41422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0bbdc7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0b40ab610 0x7fe0b41479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0bbdc7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0b4140a10 0x7fe0b413f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0bbdc7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4149460 con 0x7fe0b405fae0 2021-06-25T04:51:04.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0bbdc7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4149700 con 0x7fe0b4140a10 2021-06-25T04:51:04.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0bbdc7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b41499a0 con 0x7fe0b40ab610 2021-06-25T04:51:04.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0b9b63700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b405fae0 0x7fe0b41422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0b9b63700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b405fae0 0x7fe0b41422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37766/0 (socket says 172.21.15.57:37766) 2021-06-25T04:51:04.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0b9b63700 1 -- 172.21.15.57:0/2323522844 learned_addr learned my addr 172.21.15.57:0/2323522844 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:04.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0b9362700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0b40ab610 0x7fe0b41479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0ba364700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0b4140a10 0x7fe0b413f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0b9b63700 1 -- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0b40ab610 msgr2=0x7fe0b41479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0b9b63700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0b40ab610 0x7fe0b41479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0b9b63700 1 -- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0b4140a10 msgr2=0x7fe0b413f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:04.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0b9b63700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0b4140a10 0x7fe0b413f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:04.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0b9b63700 1 -- 172.21.15.57:0/2323522844 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b000b180 con 0x7fe0b405fae0 2021-06-25T04:51:04.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0ba364700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0b4140a10 0x7fe0b413f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0b9b63700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b405fae0 0x7fe0b41422a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fe0b0002f70 tx=0x7fe0b0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0a2ffd700 1 -- 172.21.15.57:0/2323522844 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b0006b20 con 0x7fe0b405fae0 2021-06-25T04:51:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0a2ffd700 1 -- 172.21.15.57:0/2323522844 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000d8f0 con 0x7fe0b405fae0 2021-06-25T04:51:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/2323522844 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b40610f0 con 0x7fe0b405fae0 2021-06-25T04:51:04.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0a2ffd700 1 -- 172.21.15.57:0/2323522844 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b001f630 con 0x7fe0b405fae0 2021-06-25T04:51:04.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/2323522844 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b4148080 con 0x7fe0b405fae0 2021-06-25T04:51:04.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0a2ffd700 1 -- 172.21.15.57:0/2323522844 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe0b0025020 con 0x7fe0b405fae0 2021-06-25T04:51:04.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.963+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/2323522844 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b4057310 con 0x7fe0b405fae0 2021-06-25T04:51:04.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.967+0000 7fe0a2ffd700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0940553d0 0x7fe094057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:04.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.967+0000 7fe0a2ffd700 1 -- 172.21.15.57:0/2323522844 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe0b006ed00 con 0x7fe0b405fae0 2021-06-25T04:51:04.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.967+0000 7fe0b9362700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0940553d0 0x7fe094057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:04.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.967+0000 7fe0b9362700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0940553d0 0x7fe094057890 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fe0a400b000 tx=0x7fe0a4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:04.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:04.975+0000 7fe0a2ffd700 1 -- 172.21.15.57:0/2323522844 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe0b0072030 con 0x7fe0b405fae0 2021-06-25T04:51:05.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.131+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/2323522844 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0b4142f10 con 0x7fe0b405fae0 2021-06-25T04:51:05.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.131+0000 7fe0a2ffd700 1 -- 172.21.15.57:0/2323522844 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+1559 (secure 0 0 0) 0x7fe0b0045190 con 0x7fe0b405fae0 2021-06-25T04:51:05.138 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:05.138 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/587697587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":587697587},{"type":"v1","addr":"172.21.15.87:6835","nonce":587697587}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/3950506435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3950506435},{"type":"v1","addr":"172.21.15.57:6833","nonce":3950506435}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3826968575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3826968575},{"type":"v1","addr":"172.21.15.57:6835","nonce":3826968575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20}],"filesystems":[]} 2021-06-25T04:51:05.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0940553d0 msgr2=0x7fe094057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:05.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0940553d0 0x7fe094057890 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fe0a400b000 tx=0x7fe0a4009040).stop 2021-06-25T04:51:05.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/2323522844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b405fae0 msgr2=0x7fe0b41422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:05.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b405fae0 0x7fe0b41422a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fe0b0002f70 tx=0x7fe0b0014000).stop 2021-06-25T04:51:05.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/2323522844 shutdown_connections 2021-06-25T04:51:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0940553d0 0x7fe094057890 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0b4140a10 0x7fe0b413f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:05.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0b40ab610 0x7fe0b41479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:05.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 --2- 172.21.15.57:0/2323522844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b405fae0 0x7fe0b41422a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:05.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/2323522844 >> 172.21.15.57:0/2323522844 conn(0x7fe0b40b6490 msgr2=0x7fe0b4066970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:05.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/2323522844 shutdown_connections 2021-06-25T04:51:05.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.135+0000 7fe0bbdc7700 1 -- 172.21.15.57:0/2323522844 wait complete. 2021-06-25T04:51:05.144 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 20 2021-06-25T04:51:05.152 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:51:05.152 INFO:tasks.ceph.mds.a:Stopping old one... 2021-06-25T04:51:05.153 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:51:05.153 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:51:05.154 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:51:05.154 INFO:tasks.ceph.mds.c:Stopping old one... 2021-06-25T04:51:05.154 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:51:05.154 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:51:05.155 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:51:05.155 INFO:tasks.ceph.mds.b:Stopping old one... 2021-06-25T04:51:05.155 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:51:05.156 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:51:05.165 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:51:05.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:51:05.168 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:51:05.168 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:51:05.171 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:51:05.172 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:51:05.174 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:51:05.175 DEBUG:teuthology.parallel:result is None 2021-06-25T04:51:05.211 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:51:05.212 DEBUG:teuthology.parallel:result is None 2021-06-25T04:51:05.213 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:51:05.213 DEBUG:teuthology.parallel:result is None 2021-06-25T04:51:05.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:51:05.248 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:51:05.280 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:51:05.298 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:51:05.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.319+0000 7fb2f372a700 1 Processor -- start 2021-06-25T04:51:05.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.319+0000 7fb2f372a700 1 -- start start 2021-06-25T04:51:05.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.319+0000 7fb2f372a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2ec0a8bb0 0x7fb2ec1435e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:05.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.319+0000 7fb2f372a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec0adfc0 con 0x7fb2ec0b10a0 2021-06-25T04:51:05.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.319+0000 7fb2f372a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec0b17e0 con 0x7fb2ec0aca30 2021-06-25T04:51:05.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.319+0000 7fb2f372a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0b1540 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f0cc5700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb2ec0b10a0 0x7fb2ec0ae6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55018/0 (socket says 172.21.15.57:55018) 2021-06-25T04:51:05.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f0cc5700 1 -- 172.21.15.57:0/2091649237 learned_addr learned my addr 172.21.15.57:0/2091649237 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f14c6700 1 --2- 172.21.15.57:0/2091649237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2ec0a8bb0 0x7fb2ec1435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2dbfff700 1 -- 172.21.15.57:0/2091649237 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632337015 0 0) 0x7fb2ec0adfc0 con 0x7fb2ec0b10a0 2021-06-25T04:51:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2dbfff700 1 -- 172.21.15.57:0/2091649237 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d4003260 con 0x7fb2ec0b10a0 2021-06-25T04:51:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2dbfff700 1 -- 172.21.15.57:0/2091649237 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415764053 0 0) 0x7fb2ec0b17e0 con 0x7fb2ec0aca30 2021-06-25T04:51:05.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2dbfff700 1 -- 172.21.15.57:0/2091649237 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ec0adfc0 con 0x7fb2ec0aca30 2021-06-25T04:51:05.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f14c6700 1 -- 172.21.15.57:0/2091649237 >> v1:172.21.15.87:6789/0 conn(0x7fb2ec0aca30 legacy=0x7fb2ec0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:05.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f14c6700 1 -- 172.21.15.57:0/2091649237 >> v1:172.21.15.57:6789/0 conn(0x7fb2ec0b10a0 legacy=0x7fb2ec0ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:05.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f14c6700 1 -- 172.21.15.57:0/2091649237 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0ae220 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f14c6700 1 --2- 172.21.15.57:0/2091649237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2ec0a8bb0 0x7fb2ec1435e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb2e40032f0 tx=0x7fb2e40091d0).ready entity=mon.2 client_cookie=b3a3226867c63129 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:05.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2dbfff700 1 -- 172.21.15.57:0/2091649237 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2e400f8a0 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2dbfff700 1 -- 172.21.15.57:0/2091649237 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e400fa00 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2dbfff700 1 -- 172.21.15.57:0/2091649237 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2e400fd60 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f372a700 1 -- 172.21.15.57:0/2091649237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2ec0a8bb0 msgr2=0x7fb2ec1435e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:05.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f372a700 1 --2- 172.21.15.57:0/2091649237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2ec0a8bb0 0x7fb2ec1435e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb2e40032f0 tx=0x7fb2e40091d0).stop 2021-06-25T04:51:05.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f372a700 1 -- 172.21.15.57:0/2091649237 shutdown_connections 2021-06-25T04:51:05.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f372a700 1 --2- 172.21.15.57:0/2091649237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2ec0a8bb0 0x7fb2ec1435e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:05.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f372a700 1 -- 172.21.15.57:0/2091649237 >> 172.21.15.57:0/2091649237 conn(0x7fb2ec060890 msgr2=0x7fb2ec060ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:05.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f372a700 1 -- 172.21.15.57:0/2091649237 shutdown_connections 2021-06-25T04:51:05.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f372a700 1 -- 172.21.15.57:0/2091649237 wait complete. 2021-06-25T04:51:05.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f372a700 1 Processor -- start 2021-06-25T04:51:05.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.323+0000 7fb2f372a700 1 -- start start 2021-06-25T04:51:05.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f372a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ec0a8bb0 0x7fb2ec0ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:05.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f372a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2ec0aca30 0x7fb2ec138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:05.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f372a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2ec0b10a0 0x7fb2ec137830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:05.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f372a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0b0220 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f372a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec13ca70 con 0x7fb2ec0b10a0 2021-06-25T04:51:05.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f372a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0b0450 con 0x7fb2ec0aca30 2021-06-25T04:51:05.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f14c6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ec0a8bb0 0x7fb2ec0ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:05.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f14c6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ec0a8bb0 0x7fb2ec0ac370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37804/0 (socket says 172.21.15.57:37804) 2021-06-25T04:51:05.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f14c6700 1 -- 172.21.15.57:0/2800510309 learned_addr learned my addr 172.21.15.57:0/2800510309 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:05.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f0cc5700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2ec0aca30 0x7fb2ec138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:05.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f1cc7700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2ec0b10a0 0x7fb2ec137830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f14c6700 1 -- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2ec0aca30 msgr2=0x7fb2ec138de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f14c6700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2ec0aca30 0x7fb2ec138de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f14c6700 1 -- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2ec0b10a0 msgr2=0x7fb2ec137830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f14c6700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2ec0b10a0 0x7fb2ec137830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:05.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f14c6700 1 -- 172.21.15.57:0/2800510309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4009470 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f14c6700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ec0a8bb0 0x7fb2ec0ac370 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fb2e40032f0 tx=0x7fb2e4018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:05.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2da7fc700 1 -- 172.21.15.57:0/2800510309 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2e401f070 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2da7fc700 1 -- 172.21.15.57:0/2800510309 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e4018400 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f372a700 1 -- 172.21.15.57:0/2800510309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec0b06f0 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2da7fc700 1 -- 172.21.15.57:0/2800510309 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2e4006ea0 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f372a700 1 -- 172.21.15.57:0/2800510309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec13c6f0 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2f372a700 1 -- 172.21.15.57:0/2800510309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec057310 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.327+0000 7fb2da7fc700 1 -- 172.21.15.57:0/2800510309 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb2e4024460 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.331+0000 7fb2da7fc700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2cc055340 0x7fb2cc057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:05.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.331+0000 7fb2da7fc700 1 -- 172.21.15.57:0/2800510309 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb2e4070be0 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.331+0000 7fb2f0cc5700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2cc055340 0x7fb2cc057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:05.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.331+0000 7fb2f0cc5700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2cc055340 0x7fb2cc057800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb2dc00d000 tx=0x7fb2dc009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:05.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.335+0000 7fb2da7fc700 1 -- 172.21.15.57:0/2800510309 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb2e404ae60 con 0x7fb2ec0a8bb0 2021-06-25T04:51:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:05.475+0000 7fb2f372a700 1 -- 172.21.15.57:0/2800510309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fb2ec0b0880 con 0x7fb2ec0a8bb0 2021-06-25T04:51:06.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.327+0000 7fb2da7fc700 1 -- 172.21.15.57:0/2800510309 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb2e4046f70 con 0x7fb2ec0a8bb0 2021-06-25T04:51:06.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 -- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2cc055340 msgr2=0x7fb2cc057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2cc055340 0x7fb2cc057800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb2dc00d000 tx=0x7fb2dc009040).stop 2021-06-25T04:51:06.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 -- 172.21.15.57:0/2800510309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ec0a8bb0 msgr2=0x7fb2ec0ac370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ec0a8bb0 0x7fb2ec0ac370 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fb2e40032f0 tx=0x7fb2e4018000).stop 2021-06-25T04:51:06.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 -- 172.21.15.57:0/2800510309 shutdown_connections 2021-06-25T04:51:06.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2cc055340 0x7fb2cc057800 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2ec0b10a0 0x7fb2ec137830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2ec0aca30 0x7fb2ec138de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 --2- 172.21.15.57:0/2800510309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ec0a8bb0 0x7fb2ec0ac370 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 -- 172.21.15.57:0/2800510309 >> 172.21.15.57:0/2800510309 conn(0x7fb2ec060890 msgr2=0x7fb2ec140080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:06.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 -- 172.21.15.57:0/2800510309 shutdown_connections 2021-06-25T04:51:06.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.331+0000 7fb2f372a700 1 -- 172.21.15.57:0/2800510309 wait complete. 2021-06-25T04:51:06.339 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:51:06.349 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:51:06.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:51:06.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.451+0000 7f93419d0700 1 Processor -- start 2021-06-25T04:51:06.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.451+0000 7f93419d0700 1 -- start start 2021-06-25T04:51:06.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93419d0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f933c0af510 0x7f933c147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93419d0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c0b5840 con 0x7f933c0b05d0 2021-06-25T04:51:06.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93419d0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c0ac7c0 con 0x7f933c0b5460 2021-06-25T04:51:06.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93419d0700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c1452a0 con 0x7f933c0af510 2021-06-25T04:51:06.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f933c0b05d0 0x7f933c0acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55032/0 (socket says 172.21.15.57:55032) 2021-06-25T04:51:06.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933bfff700 1 -- 172.21.15.57:0/42705938 learned_addr learned my addr 172.21.15.57:0/42705938 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:06.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93411cf700 1 --2- 172.21.15.57:0/42705938 >> v2:172.21.15.87:3300/0 conn(0x7f933c0af510 0x7f933c147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988291130 0 0) 0x7f933c0b5840 con 0x7f933c0b05d0 2021-06-25T04:51:06.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9328003260 con 0x7f933c0b05d0 2021-06-25T04:51:06.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009220644 0 0) 0x7f9328003260 con 0x7f933c0b05d0 2021-06-25T04:51:06.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 >> v2:172.21.15.87:3300/0 conn(0x7f933c0af510 msgr2=0x7f933c147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:06.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 --2- 172.21.15.57:0/42705938 >> v2:172.21.15.87:3300/0 conn(0x7f933c0af510 0x7f933c147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 >> v1:172.21.15.87:6789/0 conn(0x7f933c0b5460 legacy=0x7f933c067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c0b19f0 con 0x7f933c0b05d0 2021-06-25T04:51:06.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f932c0019e0 con 0x7f933c0b05d0 2021-06-25T04:51:06.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 >> v1:172.21.15.57:6789/0 conn(0x7f933c0b05d0 legacy=0x7f933c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 --2- 172.21.15.57:0/42705938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9328003750 0x7f9328003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 --2- 172.21.15.57:0/42705938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9328004500 0x7f9328004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 --2- 172.21.15.57:0/42705938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9328004e70 0x7f932800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c1452a0 con 0x7f9328004e70 2021-06-25T04:51:06.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932800bd20 con 0x7f9328003750 2021-06-25T04:51:06.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932800bee0 con 0x7f9328004500 2021-06-25T04:51:06.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93411cf700 1 --2- 172.21.15.57:0/42705938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9328004e70 0x7f932800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933bfff700 1 --2- 172.21.15.57:0/42705938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9328004500 0x7f9328004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93409ce700 1 --2- 172.21.15.57:0/42705938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9328003750 0x7f9328003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93411cf700 1 -- 172.21.15.57:0/42705938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9328004500 msgr2=0x7f9328004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:06.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93411cf700 1 --2- 172.21.15.57:0/42705938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9328004500 0x7f9328004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93411cf700 1 -- 172.21.15.57:0/42705938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9328003750 msgr2=0x7f9328003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:06.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93411cf700 1 --2- 172.21.15.57:0/42705938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9328003750 0x7f9328003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93411cf700 1 -- 172.21.15.57:0/42705938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9328003260 con 0x7f9328004e70 2021-06-25T04:51:06.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93411cf700 1 -- 172.21.15.57:0/42705938 reap_dead start 2021-06-25T04:51:06.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93411cf700 1 --2- 172.21.15.57:0/42705938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9328004e70 0x7f932800b750 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f933400c000 tx=0x7f9334006df0).ready entity=mon.0 client_cookie=959aa06ddecd0ecc server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:06.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933400e830 con 0x7f9328004e70 2021-06-25T04:51:06.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933400e990 con 0x7f9328004e70 2021-06-25T04:51:06.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f933b7fe700 1 -- 172.21.15.57:0/42705938 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933400ecf0 con 0x7f9328004e70 2021-06-25T04:51:06.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93419d0700 1 -- 172.21.15.57:0/42705938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9328004e70 msgr2=0x7f932800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.455+0000 7f93419d0700 1 --2- 172.21.15.57:0/42705938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9328004e70 0x7f932800b750 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f933400c000 tx=0x7f9334006df0).stop 2021-06-25T04:51:06.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 -- 172.21.15.57:0/42705938 shutdown_connections 2021-06-25T04:51:06.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 --2- 172.21.15.57:0/42705938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9328004e70 0x7f932800b750 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 -- 172.21.15.57:0/42705938 >> 172.21.15.57:0/42705938 conn(0x7f933c062520 msgr2=0x7f933c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:06.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 -- 172.21.15.57:0/42705938 shutdown_connections 2021-06-25T04:51:06.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 -- 172.21.15.57:0/42705938 wait complete. 2021-06-25T04:51:06.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 Processor -- start 2021-06-25T04:51:06.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 -- start start 2021-06-25T04:51:06.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9328004e70 0x7f933c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f933c0654e0 0x7f933c066be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c156a10 0x7f933c0ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0adfb0 con 0x7f933c156a10 2021-06-25T04:51:06.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c063200 con 0x7f933c0654e0 2021-06-25T04:51:06.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0634a0 con 0x7f9328004e70 2021-06-25T04:51:06.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93411cf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c156a10 0x7f933c0ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93411cf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c156a10 0x7f933c0ab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37830/0 (socket says 172.21.15.57:37830) 2021-06-25T04:51:06.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93411cf700 1 -- 172.21.15.57:0/2762793100 learned_addr learned my addr 172.21.15.57:0/2762793100 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:06.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93409ce700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9328004e70 0x7f933c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f933bfff700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f933c0654e0 0x7f933c066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93411cf700 1 -- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9328004e70 msgr2=0x7f933c0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93411cf700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9328004e70 0x7f933c0b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93411cf700 1 -- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f933c0654e0 msgr2=0x7f933c066be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93411cf700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f933c0654e0 0x7f933c066be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93411cf700 1 -- 172.21.15.57:0/2762793100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c15ac90 con 0x7f933c156a10 2021-06-25T04:51:06.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93411cf700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c156a10 0x7f933c0ab7a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f933400c000 tx=0x7f9334018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:06.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f9339ffb700 1 -- 172.21.15.57:0/2762793100 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9334012d60 con 0x7f933c156a10 2021-06-25T04:51:06.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 -- 172.21.15.57:0/2762793100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c15a9b0 con 0x7f933c156a10 2021-06-25T04:51:06.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f9339ffb700 1 -- 172.21.15.57:0/2762793100 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9334000e90 con 0x7f933c156a10 2021-06-25T04:51:06.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f9339ffb700 1 -- 172.21.15.57:0/2762793100 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933401e610 con 0x7f933c156a10 2021-06-25T04:51:06.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.459+0000 7f93419d0700 1 -- 172.21.15.57:0/2762793100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c146830 con 0x7f933c156a10 2021-06-25T04:51:06.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.463+0000 7f93419d0700 1 -- 172.21.15.57:0/2762793100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933c057310 con 0x7f933c156a10 2021-06-25T04:51:06.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.463+0000 7f9339ffb700 1 -- 172.21.15.57:0/2762793100 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9334027450 con 0x7f933c156a10 2021-06-25T04:51:06.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.463+0000 7f9339ffb700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f931c055490 0x7f931c057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.463+0000 7f9339ffb700 1 -- 172.21.15.57:0/2762793100 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f933406e5f0 con 0x7f933c156a10 2021-06-25T04:51:06.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.463+0000 7f93409ce700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f931c055490 0x7f931c057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.467+0000 7f93409ce700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f931c055490 0x7f931c057950 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f933000c000 tx=0x7f93300079e0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:06.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.471+0000 7f9339ffb700 1 -- 172.21.15.57:0/2762793100 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f93340449e0 con 0x7f933c156a10 2021-06-25T04:51:06.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.647+0000 7f93419d0700 1 -- 172.21.15.57:0/2762793100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f933c05f200 con 0x7f933c156a10 2021-06-25T04:51:06.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.647+0000 7f9339ffb700 1 -- 172.21.15.57:0/2762793100 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f933400be60 con 0x7f933c156a10 2021-06-25T04:51:06.653 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:06.653 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:51:06.654 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:51:06.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.654 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:51:06.654 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:51:06.654 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.655 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:51:06.655 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.655 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.655 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:51:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:51:06.657 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.657 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:51:06.657 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.657 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.658 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.658 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:51:06.659 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:51:06.659 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.659 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:51:06.659 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.660 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.660 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.661 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:51:06.661 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:51:06.661 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.661 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.661 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.663 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:51:06.663 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:51:06.663 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.663 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.663 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.664 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.665 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:51:06.665 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:51:06.665 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.665 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.665 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.666 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.666 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.667 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:51:06.667 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:51:06.667 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.667 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.667 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.668 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.668 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.668 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:51:06.669 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:51:06.669 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.669 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.669 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.670 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.670 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.670 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:51:06.671 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:51:06.671 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.671 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.671 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.672 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.672 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.672 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:51:06.673 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:51:06.673 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.673 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.673 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.674 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.674 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.674 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:51:06.675 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:51:06.675 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.675 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.675 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.676 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.676 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:51:06.677 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:51:06.677 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.677 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:51:06.677 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:51:06.678 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:51:06.678 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.678 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:51:06.679 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:51:06.679 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.679 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:51:06.679 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:51:06.679 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:51:06.680 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.680 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:51:06.680 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:51:06.681 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.681 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:51:06.681 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:51:06.681 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:51:06.682 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.682 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.682 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:51:06.683 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:51:06.683 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.683 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:51:06.683 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:51:06.684 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.684 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:06.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:06.685 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:51:06.685 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:51:06.685 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:51:06.685 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:51:06.686 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:51:06.686 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:51:06.686 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.690 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:06.692 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:51:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:51:06.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 -- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f931c055490 msgr2=0x7f931c057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f931c055490 0x7f931c057950 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f933000c000 tx=0x7f93300079e0).stop 2021-06-25T04:51:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 -- 172.21.15.57:0/2762793100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c156a10 msgr2=0x7f933c0ab7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c156a10 0x7f933c0ab7a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f933400c000 tx=0x7f9334018000).stop 2021-06-25T04:51:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 -- 172.21.15.57:0/2762793100 shutdown_connections 2021-06-25T04:51:06.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f931c055490 0x7f931c057950 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c156a10 0x7f933c0ab7a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f933c0654e0 0x7f933c066be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 --2- 172.21.15.57:0/2762793100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9328004e70 0x7f933c0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 -- 172.21.15.57:0/2762793100 >> 172.21.15.57:0/2762793100 conn(0x7f933c062520 msgr2=0x7f933c0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:06.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 -- 172.21.15.57:0/2762793100 shutdown_connections 2021-06-25T04:51:06.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.651+0000 7f93419d0700 1 -- 172.21.15.57:0/2762793100 wait complete. 2021-06-25T04:51:06.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:51:06.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 Processor -- start 2021-06-25T04:51:06.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 -- start start 2021-06-25T04:51:06.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe6c0b4d10 0x7fbe6c0672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c065920 con 0x7fbe6c0ab120 2021-06-25T04:51:06.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c064ed0 con 0x7fbe6c0aad40 2021-06-25T04:51:06.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c0b3ca0 con 0x7fbe6c0b4d10 2021-06-25T04:51:06.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe70d13700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe6c0b4d10 0x7fbe6c0672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe63fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbe6c0ab120 0x7fbe6c0b74e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55054/0 (socket says 172.21.15.57:55054) 2021-06-25T04:51:06.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe70d13700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe6c0b4d10 0x7fbe6c0672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37838/0 (socket says 172.21.15.57:37838) 2021-06-25T04:51:06.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe63fff700 1 -- 172.21.15.57:0/4110547669 learned_addr learned my addr 172.21.15.57:0/4110547669 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:06.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe70d13700 1 -- 172.21.15.57:0/4110547669 >> v1:172.21.15.87:6789/0 conn(0x7fbe6c0aad40 legacy=0x7fbe6c0647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe70d13700 1 -- 172.21.15.57:0/4110547669 >> v1:172.21.15.57:6789/0 conn(0x7fbe6c0ab120 legacy=0x7fbe6c0b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe70d13700 1 -- 172.21.15.57:0/4110547669 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c066e20 con 0x7fbe6c0b4d10 2021-06-25T04:51:06.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe70d13700 1 --2- 172.21.15.57:0/4110547669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c0b4d10 0x7fbe6c0672c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fbe640032f0 tx=0x7fbe640091d0).ready entity=mon.0 client_cookie=d6166d4bdc6ce80f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:06.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe6b7fe700 1 -- 172.21.15.57:0/4110547669 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe64009ea0 con 0x7fbe6c0b4d10 2021-06-25T04:51:06.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe6b7fe700 1 -- 172.21.15.57:0/4110547669 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6400b8a0 con 0x7fbe6c0b4d10 2021-06-25T04:51:06.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe6b7fe700 1 -- 172.21.15.57:0/4110547669 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6400ba10 con 0x7fbe6c0b4d10 2021-06-25T04:51:06.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 -- 172.21.15.57:0/4110547669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c0b4d10 msgr2=0x7fbe6c0672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 --2- 172.21.15.57:0/4110547669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c0b4d10 0x7fbe6c0672c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fbe640032f0 tx=0x7fbe640091d0).stop 2021-06-25T04:51:06.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 -- 172.21.15.57:0/4110547669 shutdown_connections 2021-06-25T04:51:06.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 --2- 172.21.15.57:0/4110547669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c0b4d10 0x7fbe6c0672c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 -- 172.21.15.57:0/4110547669 >> 172.21.15.57:0/4110547669 conn(0x7fbe6c062ba0 msgr2=0x7fbe6c05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:06.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 -- 172.21.15.57:0/4110547669 shutdown_connections 2021-06-25T04:51:06.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.803+0000 7fbe71514700 1 -- 172.21.15.57:0/4110547669 wait complete. 2021-06-25T04:51:06.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe71514700 1 Processor -- start 2021-06-25T04:51:06.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe71514700 1 -- start start 2021-06-25T04:51:06.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe71514700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c0aad40 0x7fbe6c13f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe71514700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe6c0ab120 0x7fbe6c062090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe71514700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe6c0b4d10 0x7fbe6c146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe71514700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c061620 con 0x7fbe6c0aad40 2021-06-25T04:51:06.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe71514700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c062580 con 0x7fbe6c0ab120 2021-06-25T04:51:06.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe71514700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0611a0 con 0x7fbe6c0b4d10 2021-06-25T04:51:06.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe6bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c0aad40 0x7fbe6c13f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe6bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c0aad40 0x7fbe6c13f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37840/0 (socket says 172.21.15.57:37840) 2021-06-25T04:51:06.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe6bfff700 1 -- 172.21.15.57:0/3743284421 learned_addr learned my addr 172.21.15.57:0/3743284421 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:06.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe63fff700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe6c0ab120 0x7fbe6c062090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe70d13700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe6c0b4d10 0x7fbe6c146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe6bfff700 1 -- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe6c0b4d10 msgr2=0x7fbe6c146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe6bfff700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe6c0b4d10 0x7fbe6c146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe6bfff700 1 -- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe6c0ab120 msgr2=0x7fbe6c062090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe6bfff700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe6c0ab120 0x7fbe6c062090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe6bfff700 1 -- 172.21.15.57:0/3743284421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64009470 con 0x7fbe6c0aad40 2021-06-25T04:51:06.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe6bfff700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c0aad40 0x7fbe6c13f610 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fbe6c061760 tx=0x7fbe5c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:06.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe69ffb700 1 -- 172.21.15.57:0/3743284421 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5c012400 con 0x7fbe6c0aad40 2021-06-25T04:51:06.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe69ffb700 1 -- 172.21.15.57:0/3743284421 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c012560 con 0x7fbe6c0aad40 2021-06-25T04:51:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe69ffb700 1 -- 172.21.15.57:0/3743284421 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5c0128c0 con 0x7fbe6c0aad40 2021-06-25T04:51:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe71514700 1 -- 172.21.15.57:0/3743284421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c060820 con 0x7fbe6c0aad40 2021-06-25T04:51:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.807+0000 7fbe71514700 1 -- 172.21.15.57:0/3743284421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c060d60 con 0x7fbe6c0aad40 2021-06-25T04:51:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.811+0000 7fbe71514700 1 -- 172.21.15.57:0/3743284421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c061e30 con 0x7fbe6c0aad40 2021-06-25T04:51:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.811+0000 7fbe69ffb700 1 -- 172.21.15.57:0/3743284421 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbe5c019030 con 0x7fbe6c0aad40 2021-06-25T04:51:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.811+0000 7fbe69ffb700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe500553d0 0x7fbe50057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.811+0000 7fbe69ffb700 1 -- 172.21.15.57:0/3743284421 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fbe5c06ceb0 con 0x7fbe6c0aad40 2021-06-25T04:51:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.811+0000 7fbe63fff700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe500553d0 0x7fbe50057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:06.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.811+0000 7fbe63fff700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe500553d0 0x7fbe50057890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fbe5400d000 tx=0x7fbe54009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:06.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.819+0000 7fbe69ffb700 1 -- 172.21.15.57:0/3743284421 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbe5c043340 con 0x7fbe6c0aad40 2021-06-25T04:51:06.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.943+0000 7fbe71514700 1 -- 172.21.15.57:0/3743284421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe6c057310 con 0x7fbe6c0aad40 2021-06-25T04:51:06.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.943+0000 7fbe69ffb700 1 -- 172.21.15.57:0/3743284421 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+13414 (secure 0 0 0) 0x7fbe5c046960 con 0x7fbe6c0aad40 2021-06-25T04:51:06.948 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:06.949 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":51,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:51:06.318802+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:51:06.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.943+0000 7fbe71514700 1 -- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe500553d0 msgr2=0x7fbe50057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.943+0000 7fbe71514700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe500553d0 0x7fbe50057890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fbe5400d000 tx=0x7fbe54009040).stop 2021-06-25T04:51:06.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.947+0000 7fbe71514700 1 -- 172.21.15.57:0/3743284421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c0aad40 msgr2=0x7fbe6c13f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:06.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.947+0000 7fbe71514700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c0aad40 0x7fbe6c13f610 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fbe6c061760 tx=0x7fbe5c007c50).stop 2021-06-25T04:51:06.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.947+0000 7fbe71514700 1 -- 172.21.15.57:0/3743284421 shutdown_connections 2021-06-25T04:51:06.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.947+0000 7fbe71514700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe500553d0 0x7fbe50057890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.947+0000 7fbe71514700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe6c0b4d10 0x7fbe6c146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.947+0000 7fbe71514700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe6c0ab120 0x7fbe6c062090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.947+0000 7fbe71514700 1 --2- 172.21.15.57:0/3743284421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c0aad40 0x7fbe6c13f610 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:06.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.947+0000 7fbe71514700 1 -- 172.21.15.57:0/3743284421 >> 172.21.15.57:0/3743284421 conn(0x7fbe6c062ba0 msgr2=0x7fbe6c0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:06.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.947+0000 7fbe71514700 1 -- 172.21.15.57:0/3743284421 shutdown_connections 2021-06-25T04:51:06.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:06.947+0000 7fbe71514700 1 -- 172.21.15.57:0/3743284421 wait complete. 2021-06-25T04:51:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:51:06.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:51:07.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.071+0000 7fd8fd024700 1 Processor -- start 2021-06-25T04:51:07.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.071+0000 7fd8fd024700 1 -- start start 2021-06-25T04:51:07.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8f8146910 0x7fd8f81401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd8f80b4140 0x7fd8f81406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f80b4650 0x7fd8f80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f81474d0 con 0x7fd8f8146910 2021-06-25T04:51:07.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f8143b20 con 0x7fd8f80b4140 2021-06-25T04:51:07.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f8143dc0 con 0x7fd8f80b4650 2021-06-25T04:51:07.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f6d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8f8146910 0x7fd8f81401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f6d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8f8146910 0x7fd8f81401f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37850/0 (socket says 172.21.15.57:37850) 2021-06-25T04:51:07.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f6d9d700 1 -- 172.21.15.57:0/2967340252 learned_addr learned my addr 172.21.15.57:0/2967340252 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:07.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f659c700 1 --2- 172.21.15.57:0/2967340252 >> v2:172.21.15.87:3300/0 conn(0x7fd8f80b4140 0x7fd8f81406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f759e700 1 --2- 172.21.15.57:0/2967340252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f80b4650 0x7fd8f80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f6d9d700 1 -- 172.21.15.57:0/2967340252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f80b4650 msgr2=0x7fd8f80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:07.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f6d9d700 1 --2- 172.21.15.57:0/2967340252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f80b4650 0x7fd8f80b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f6d9d700 1 -- 172.21.15.57:0/2967340252 >> v2:172.21.15.87:3300/0 conn(0x7fd8f80b4140 msgr2=0x7fd8f81406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:07.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f6d9d700 1 --2- 172.21.15.57:0/2967340252 >> v2:172.21.15.87:3300/0 conn(0x7fd8f80b4140 0x7fd8f81406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f6d9d700 1 -- 172.21.15.57:0/2967340252 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f80b0c50 con 0x7fd8f8146910 2021-06-25T04:51:07.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f659c700 1 --2- 172.21.15.57:0/2967340252 >> v2:172.21.15.87:3300/0 conn(0x7fd8f80b4140 0x7fd8f81406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:51:07.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f6d9d700 1 --2- 172.21.15.57:0/2967340252 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f8146910 0x7fd8f81401f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fd8e0002f70 tx=0x7fd8e0006eb0).ready entity=mon.0 client_cookie=4d746bdc76da5949 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:07.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f5d9b700 1 -- 172.21.15.57:0/2967340252 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e000d570 con 0x7fd8f8146910 2021-06-25T04:51:07.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f5d9b700 1 -- 172.21.15.57:0/2967340252 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e0000e90 con 0x7fd8f8146910 2021-06-25T04:51:07.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8f5d9b700 1 -- 172.21.15.57:0/2967340252 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e000d900 con 0x7fd8f8146910 2021-06-25T04:51:07.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 -- 172.21.15.57:0/2967340252 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f8146910 msgr2=0x7fd8f81401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 --2- 172.21.15.57:0/2967340252 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f8146910 0x7fd8f81401f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fd8e0002f70 tx=0x7fd8e0006eb0).stop 2021-06-25T04:51:07.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 -- 172.21.15.57:0/2967340252 shutdown_connections 2021-06-25T04:51:07.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 --2- 172.21.15.57:0/2967340252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f80b4650 0x7fd8f80b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 --2- 172.21.15.57:0/2967340252 >> v2:172.21.15.87:3300/0 conn(0x7fd8f80b4140 0x7fd8f81406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 --2- 172.21.15.57:0/2967340252 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f8146910 0x7fd8f81401f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 -- 172.21.15.57:0/2967340252 >> 172.21.15.57:0/2967340252 conn(0x7fd8f805c450 msgr2=0x7fd8f805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:07.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 -- 172.21.15.57:0/2967340252 shutdown_connections 2021-06-25T04:51:07.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.075+0000 7fd8fd024700 1 -- 172.21.15.57:0/2967340252 wait complete. 2021-06-25T04:51:07.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8fd024700 1 Processor -- start 2021-06-25T04:51:07.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8fd024700 1 -- start start 2021-06-25T04:51:07.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8fd024700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f80b4140 0x7fd8f80b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8fd024700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8f80b4650 0x7fd8f813a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8fd024700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f8146910 0x7fd8f813a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8fd024700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f8141c00 con 0x7fd8f8146910 2021-06-25T04:51:07.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8fd024700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f81422d0 con 0x7fd8f80b4650 2021-06-25T04:51:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8fd024700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f8141630 con 0x7fd8f80b4140 2021-06-25T04:51:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8f759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f8146910 0x7fd8f813a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8f759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f8146910 0x7fd8f813a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37858/0 (socket says 172.21.15.57:37858) 2021-06-25T04:51:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8f759e700 1 -- 172.21.15.57:0/1416330826 learned_addr learned my addr 172.21.15.57:0/1416330826 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8f6d9d700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f80b4140 0x7fd8f80b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8f659c700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8f80b4650 0x7fd8f813a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8f759e700 1 -- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f80b4140 msgr2=0x7fd8f80b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8f759e700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f80b4140 0x7fd8f80b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8f759e700 1 -- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8f80b4650 msgr2=0x7fd8f813a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8f759e700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8f80b4650 0x7fd8f813a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8f759e700 1 -- 172.21.15.57:0/1416330826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e800b180 con 0x7fd8f8146910 2021-06-25T04:51:07.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8f759e700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f8146910 0x7fd8f813a9e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fd8f0006e00 tx=0x7fd8f00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:07.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8effff700 1 -- 172.21.15.57:0/1416330826 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8f000c640 con 0x7fd8f8146910 2021-06-25T04:51:07.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8effff700 1 -- 172.21.15.57:0/1416330826 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f000c7a0 con 0x7fd8f8146910 2021-06-25T04:51:07.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8fd024700 1 -- 172.21.15.57:0/1416330826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e000b1e0 con 0x7fd8f8146910 2021-06-25T04:51:07.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8effff700 1 -- 172.21.15.57:0/1416330826 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8f000cb00 con 0x7fd8f8146910 2021-06-25T04:51:07.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.079+0000 7fd8fd024700 1 -- 172.21.15.57:0/1416330826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f81429c0 con 0x7fd8f8146910 2021-06-25T04:51:07.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.083+0000 7fd8fd024700 1 -- 172.21.15.57:0/1416330826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f8142cf0 con 0x7fd8f8146910 2021-06-25T04:51:07.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.083+0000 7fd8effff700 1 -- 172.21.15.57:0/1416330826 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd8f0022070 con 0x7fd8f8146910 2021-06-25T04:51:07.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.083+0000 7fd8effff700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8dc055490 0x7fd8dc057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.083+0000 7fd8effff700 1 -- 172.21.15.57:0/1416330826 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fd8f006e0c0 con 0x7fd8f8146910 2021-06-25T04:51:07.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.083+0000 7fd8f6d9d700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8dc055490 0x7fd8dc057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.083+0000 7fd8f6d9d700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8dc055490 0x7fd8dc057950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fd8e001b000 tx=0x7fd8e0015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:07.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.091+0000 7fd8effff700 1 -- 172.21.15.57:0/1416330826 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd8f00445b0 con 0x7fd8f8146910 2021-06-25T04:51:07.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.215+0000 7fd8fd024700 1 -- 172.21.15.57:0/1416330826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd8f8057310 con 0x7fd8f8146910 2021-06-25T04:51:07.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.215+0000 7fd8effff700 1 -- 172.21.15.57:0/1416330826 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v51) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd8f0047bd0 con 0x7fd8f8146910 2021-06-25T04:51:07.221 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:51:07.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 -- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8dc055490 msgr2=0x7fd8dc057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8dc055490 0x7fd8dc057950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fd8e001b000 tx=0x7fd8e0015000).stop 2021-06-25T04:51:07.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 -- 172.21.15.57:0/1416330826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f8146910 msgr2=0x7fd8f813a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f8146910 0x7fd8f813a9e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fd8f0006e00 tx=0x7fd8f00091d0).stop 2021-06-25T04:51:07.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 -- 172.21.15.57:0/1416330826 shutdown_connections 2021-06-25T04:51:07.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8dc055490 0x7fd8dc057950 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f8146910 0x7fd8f813a9e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8f80b4650 0x7fd8f813a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 --2- 172.21.15.57:0/1416330826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f80b4140 0x7fd8f80b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 -- 172.21.15.57:0/1416330826 >> 172.21.15.57:0/1416330826 conn(0x7fd8f805c450 msgr2=0x7fd8f80b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:07.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 -- 172.21.15.57:0/1416330826 shutdown_connections 2021-06-25T04:51:07.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.219+0000 7fd8fd024700 1 -- 172.21.15.57:0/1416330826 wait complete. 2021-06-25T04:51:07.240 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:51:07.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b93fff700 1 Processor -- start 2021-06-25T04:51:07.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b93fff700 1 -- start start 2021-06-25T04:51:07.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b93fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0b940ad580 0x7f0b940616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b93fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b940aecb0 con 0x7f0b94140400 2021-06-25T04:51:07.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b93fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b940b6ee0 con 0x7f0b940612e0 2021-06-25T04:51:07.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b93fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b940aeee0 con 0x7f0b940ad580 2021-06-25T04:51:07.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b937fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0b94140400 0x7f0b941464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55084/0 (socket says 172.21.15.57:55084) 2021-06-25T04:51:07.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b937fe700 1 -- 172.21.15.57:0/1302466500 learned_addr learned my addr 172.21.15.57:0/1302466500 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:07.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b8a7fc700 1 --2- 172.21.15.57:0/1302466500 >> v2:172.21.15.87:3300/0 conn(0x7f0b940ad580 0x7f0b940616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160876345 0 0) 0x7f0b940aecb0 con 0x7f0b94140400 2021-06-25T04:51:07.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b74003260 con 0x7f0b94140400 2021-06-25T04:51:07.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 835952588 0 0) 0x7f0b74003260 con 0x7f0b94140400 2021-06-25T04:51:07.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 >> v2:172.21.15.87:3300/0 conn(0x7f0b940ad580 msgr2=0x7f0b940616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:07.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 --2- 172.21.15.57:0/1302466500 >> v2:172.21.15.87:3300/0 conn(0x7f0b940ad580 0x7f0b940616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 >> v1:172.21.15.87:6789/0 conn(0x7f0b940612e0 legacy=0x7f0b940b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b940af180 con 0x7f0b94140400 2021-06-25T04:51:07.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f0b8c0019e0 con 0x7f0b94140400 2021-06-25T04:51:07.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 >> v1:172.21.15.57:6789/0 conn(0x7f0b94140400 legacy=0x7f0b941464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 --2- 172.21.15.57:0/1302466500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b74003750 0x7f0b74003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 --2- 172.21.15.57:0/1302466500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b74004500 0x7f0b74004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 --2- 172.21.15.57:0/1302466500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 0x7f0b7400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940aeee0 con 0x7f0b74004e70 2021-06-25T04:51:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7400bd20 con 0x7f0b74003750 2021-06-25T04:51:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7400bee0 con 0x7f0b74004500 2021-06-25T04:51:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b937fe700 1 --2- 172.21.15.57:0/1302466500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 0x7f0b7400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.343+0000 7f0b92ffd700 1 --2- 172.21.15.57:0/1302466500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b74003750 0x7f0b74003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b8a7fc700 1 --2- 172.21.15.57:0/1302466500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b74004500 0x7f0b74004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b937fe700 1 -- 172.21.15.57:0/1302466500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b74004500 msgr2=0x7f0b74004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:07.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b937fe700 1 --2- 172.21.15.57:0/1302466500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b74004500 0x7f0b74004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b937fe700 1 -- 172.21.15.57:0/1302466500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b74003750 msgr2=0x7f0b74003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:07.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b937fe700 1 --2- 172.21.15.57:0/1302466500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b74003750 0x7f0b74003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b937fe700 1 -- 172.21.15.57:0/1302466500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b74003260 con 0x7f0b74004e70 2021-06-25T04:51:07.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b937fe700 1 -- 172.21.15.57:0/1302466500 reap_dead start 2021-06-25T04:51:07.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b937fe700 1 --2- 172.21.15.57:0/1302466500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 0x7f0b7400b750 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f0b8c0016f0 tx=0x7f0b940af310).ready entity=mon.0 client_cookie=ac236dc6636d0ca4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:07.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8c00cc70 con 0x7f0b74004e70 2021-06-25T04:51:07.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c00cdd0 con 0x7f0b74004e70 2021-06-25T04:51:07.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b927fc700 1 -- 172.21.15.57:0/1302466500 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8c005b80 con 0x7f0b74004e70 2021-06-25T04:51:07.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b93fff700 1 -- 172.21.15.57:0/1302466500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 msgr2=0x7f0b7400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b93fff700 1 --2- 172.21.15.57:0/1302466500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 0x7f0b7400b750 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f0b8c0016f0 tx=0x7f0b940af310).stop 2021-06-25T04:51:07.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b93fff700 1 -- 172.21.15.57:0/1302466500 shutdown_connections 2021-06-25T04:51:07.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b93fff700 1 --2- 172.21.15.57:0/1302466500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 0x7f0b7400b750 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b93fff700 1 -- 172.21.15.57:0/1302466500 >> 172.21.15.57:0/1302466500 conn(0x7f0b94066da0 msgr2=0x7f0b94067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:07.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b93fff700 1 -- 172.21.15.57:0/1302466500 shutdown_connections 2021-06-25T04:51:07.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.347+0000 7f0b93fff700 1 -- 172.21.15.57:0/1302466500 wait complete. 2021-06-25T04:51:07.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b93fff700 1 Processor -- start 2021-06-25T04:51:07.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b93fff700 1 -- start start 2021-06-25T04:51:07.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 0x7f0b940b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b940b0f20 0x7f0b940abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b940ac260 0x7f0b940b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b93fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b941532a0 con 0x7f0b74004e70 2021-06-25T04:51:07.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b93fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94152380 con 0x7f0b940b0f20 2021-06-25T04:51:07.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b93fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94152620 con 0x7f0b940ac260 2021-06-25T04:51:07.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b92ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 0x7f0b940b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b92ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 0x7f0b940b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37874/0 (socket says 172.21.15.57:37874) 2021-06-25T04:51:07.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b92ffd700 1 -- 172.21.15.57:0/3870329753 learned_addr learned my addr 172.21.15.57:0/3870329753 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:07.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b8a7fc700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b940b0f20 0x7f0b940abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b937fe700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b940ac260 0x7f0b940b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b92ffd700 1 -- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b940ac260 msgr2=0x7f0b940b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b92ffd700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b940ac260 0x7f0b940b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b92ffd700 1 -- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b940b0f20 msgr2=0x7f0b940abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b92ffd700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b940b0f20 0x7f0b940abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b92ffd700 1 -- 172.21.15.57:0/3870329753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b941528c0 con 0x7f0b74004e70 2021-06-25T04:51:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b92ffd700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 0x7f0b940b06a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f0b8400d000 tx=0x7f0b84007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b90ff9700 1 -- 172.21.15.57:0/3870329753 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b840114c0 con 0x7f0b74004e70 2021-06-25T04:51:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.351+0000 7f0b90ff9700 1 -- 172.21.15.57:0/3870329753 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b84011620 con 0x7f0b74004e70 2021-06-25T04:51:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.355+0000 7f0b93fff700 1 -- 172.21.15.57:0/3870329753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b94152b60 con 0x7f0b74004e70 2021-06-25T04:51:07.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.355+0000 7f0b90ff9700 1 -- 172.21.15.57:0/3870329753 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b84011980 con 0x7f0b74004e70 2021-06-25T04:51:07.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.355+0000 7f0b93fff700 1 -- 172.21.15.57:0/3870329753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b940ac6e0 con 0x7f0b74004e70 2021-06-25T04:51:07.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.355+0000 7f0b93fff700 1 -- 172.21.15.57:0/3870329753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b94057310 con 0x7f0b74004e70 2021-06-25T04:51:07.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.355+0000 7f0b90ff9700 1 -- 172.21.15.57:0/3870329753 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0b8401a030 con 0x7f0b74004e70 2021-06-25T04:51:07.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.355+0000 7f0b90ff9700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b78055450 0x7f0b78057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.355+0000 7f0b90ff9700 1 -- 172.21.15.57:0/3870329753 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f0b8406d420 con 0x7f0b74004e70 2021-06-25T04:51:07.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.355+0000 7f0b8a7fc700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b78055450 0x7f0b78057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.359+0000 7f0b8a7fc700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b78055450 0x7f0b78057910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0b7c00b000 tx=0x7f0b7c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:07.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.363+0000 7f0b90ff9700 1 -- 172.21.15.57:0/3870329753 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0b840439c0 con 0x7f0b74004e70 2021-06-25T04:51:07.405 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:51:07.409 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:51:07.412 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:51:07.415 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:51:07.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 -- 172.21.15.57:0/3870329753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0b94143f30 con 0x7f0b74004e70 2021-06-25T04:51:07.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b90ff9700 1 -- 172.21.15.57:0/3870329753 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0b84046fe0 con 0x7f0b74004e70 2021-06-25T04:51:07.497 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:51:07.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 -- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b78055450 msgr2=0x7f0b78057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b78055450 0x7f0b78057910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0b7c00b000 tx=0x7f0b7c006df0).stop 2021-06-25T04:51:07.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 -- 172.21.15.57:0/3870329753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 msgr2=0x7f0b940b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 0x7f0b940b06a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f0b8400d000 tx=0x7f0b84007a00).stop 2021-06-25T04:51:07.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 -- 172.21.15.57:0/3870329753 shutdown_connections 2021-06-25T04:51:07.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b78055450 0x7f0b78057910 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b940ac260 0x7f0b940b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b940b0f20 0x7f0b940abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 --2- 172.21.15.57:0/3870329753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b74004e70 0x7f0b940b06a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 -- 172.21.15.57:0/3870329753 >> 172.21.15.57:0/3870329753 conn(0x7f0b94066da0 msgr2=0x7f0b94067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:07.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.491+0000 7f0b93fff700 1 -- 172.21.15.57:0/3870329753 shutdown_connections 2021-06-25T04:51:07.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.495+0000 7f0b93fff700 1 -- 172.21.15.57:0/3870329753 wait complete. 2021-06-25T04:51:07.514 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:51:07.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4502580700 1 Processor -- start 2021-06-25T04:51:07.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4502580700 1 -- start start 2021-06-25T04:51:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4502580700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44fc0b96a0 0x7f44fc0aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4502580700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc13ffb0 0x7f44fc140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4502580700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc0674c0 con 0x7f44fc0670e0 2021-06-25T04:51:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4502580700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc143040 con 0x7f44fc0b96a0 2021-06-25T04:51:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4502580700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0af490 con 0x7f44fc13ffb0 2021-06-25T04:51:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f44fb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44fc0b96a0 0x7f44fc0aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4500b1d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc13ffb0 0x7f44fc140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f44fb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44fc0b96a0 0x7f44fc0aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37886/0 (socket says 172.21.15.57:37886) 2021-06-25T04:51:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4500b1d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc13ffb0 0x7f44fc140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:49048/0 (socket says 172.21.15.57:49048) 2021-06-25T04:51:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f44fbfff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f44fc0670e0 0x7f44fc143970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:55848/0 (socket says 172.21.15.57:55848) 2021-06-25T04:51:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f44fb7fe700 1 -- 172.21.15.57:0/6338428 learned_addr learned my addr 172.21.15.57:0/6338428 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4500b1d700 1 -- 172.21.15.57:0/6338428 >> v2:172.21.15.57:3300/0 conn(0x7f44fc0b96a0 msgr2=0x7f44fc0aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4500b1d700 1 --2- 172.21.15.57:0/6338428 >> v2:172.21.15.57:3300/0 conn(0x7f44fc0b96a0 0x7f44fc0aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4500b1d700 1 -- 172.21.15.57:0/6338428 >> v1:172.21.15.87:6789/0 conn(0x7f44fc0670e0 legacy=0x7f44fc143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4500b1d700 1 -- 172.21.15.57:0/6338428 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc143230 con 0x7f44fc13ffb0 2021-06-25T04:51:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f44fb7fe700 1 --2- 172.21.15.57:0/6338428 >> v2:172.21.15.57:3300/0 conn(0x7f44fc0b96a0 0x7f44fc0aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:51:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4500b1d700 1 --2- 172.21.15.57:0/6338428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc13ffb0 0x7f44fc140440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f44f4001490 tx=0x7f44ec006df0).ready entity=mon.2 client_cookie=6f0f1a7254e7f6c3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:07.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f44faffd700 1 -- 172.21.15.57:0/6338428 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44ec00d4a0 con 0x7f44fc13ffb0 2021-06-25T04:51:07.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f44faffd700 1 -- 172.21.15.57:0/6338428 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec000e90 con 0x7f44fc13ffb0 2021-06-25T04:51:07.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f44faffd700 1 -- 172.21.15.57:0/6338428 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44ec00d7f0 con 0x7f44fc13ffb0 2021-06-25T04:51:07.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4502580700 1 -- 172.21.15.57:0/6338428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc13ffb0 msgr2=0x7f44fc140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.607+0000 7f4502580700 1 --2- 172.21.15.57:0/6338428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc13ffb0 0x7f44fc140440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f44f4001490 tx=0x7f44ec006df0).stop 2021-06-25T04:51:07.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 -- 172.21.15.57:0/6338428 shutdown_connections 2021-06-25T04:51:07.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 --2- 172.21.15.57:0/6338428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc13ffb0 0x7f44fc140440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 --2- 172.21.15.57:0/6338428 >> v2:172.21.15.57:3300/0 conn(0x7f44fc0b96a0 0x7f44fc0aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 -- 172.21.15.57:0/6338428 >> 172.21.15.57:0/6338428 conn(0x7f44fc05f9b0 msgr2=0x7f44fc061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:07.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 -- 172.21.15.57:0/6338428 shutdown_connections 2021-06-25T04:51:07.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 -- 172.21.15.57:0/6338428 wait complete. 2021-06-25T04:51:07.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 Processor -- start 2021-06-25T04:51:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 -- start start 2021-06-25T04:51:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc0670e0 0x7f44fc1480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44fc0b96a0 0x7f44fc1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44fc13ffb0 0x7f44fc139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc145f60 con 0x7f44fc13ffb0 2021-06-25T04:51:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc148bd0 con 0x7f44fc0b96a0 2021-06-25T04:51:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc156110 con 0x7f44fc0670e0 2021-06-25T04:51:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4500b1d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44fc13ffb0 0x7f44fc139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4500b1d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44fc13ffb0 0x7f44fc139bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37892/0 (socket says 172.21.15.57:37892) 2021-06-25T04:51:07.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4500b1d700 1 -- 172.21.15.57:0/3389786881 learned_addr learned my addr 172.21.15.57:0/3389786881 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:07.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f44fbfff700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc0670e0 0x7f44fc1480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f44fb7fe700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44fc0b96a0 0x7f44fc1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4500b1d700 1 -- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc0670e0 msgr2=0x7f44fc1480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4500b1d700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc0670e0 0x7f44fc1480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4500b1d700 1 -- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44fc0b96a0 msgr2=0x7f44fc1520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4500b1d700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44fc0b96a0 0x7f44fc1520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4500b1d700 1 -- 172.21.15.57:0/3389786881 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e400b1e0 con 0x7f44fc13ffb0 2021-06-25T04:51:07.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4500b1d700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44fc13ffb0 0x7f44fc139bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f44fc0b7710 tx=0x7f44ec014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:07.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f44f97fa700 1 -- 172.21.15.57:0/3389786881 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44ec0129b0 con 0x7f44fc13ffb0 2021-06-25T04:51:07.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f44f97fa700 1 -- 172.21.15.57:0/3389786881 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec000e90 con 0x7f44fc13ffb0 2021-06-25T04:51:07.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 -- 172.21.15.57:0/3389786881 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ec00b180 con 0x7f44fc13ffb0 2021-06-25T04:51:07.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f44f97fa700 1 -- 172.21.15.57:0/3389786881 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44ec012d00 con 0x7f44fc13ffb0 2021-06-25T04:51:07.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.611+0000 7f4502580700 1 -- 172.21.15.57:0/3389786881 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc156370 con 0x7f44fc13ffb0 2021-06-25T04:51:07.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.615+0000 7f4502580700 1 -- 172.21.15.57:0/3389786881 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc057310 con 0x7f44fc13ffb0 2021-06-25T04:51:07.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.615+0000 7f44f97fa700 1 -- 172.21.15.57:0/3389786881 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f44ec024020 con 0x7f44fc13ffb0 2021-06-25T04:51:07.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.615+0000 7f44f97fa700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44e00554e0 0x7f44e00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.615+0000 7f44f97fa700 1 -- 172.21.15.57:0/3389786881 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f44ec06e760 con 0x7f44fc13ffb0 2021-06-25T04:51:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.615+0000 7f44fbfff700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44e00554e0 0x7f44e00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.619+0000 7f44fbfff700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44e00554e0 0x7f44e00579a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f44f400b000 tx=0x7f44f4007d20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.623+0000 7f44f97fa700 1 -- 172.21.15.57:0/3389786881 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f44ec044d00 con 0x7f44fc13ffb0 2021-06-25T04:51:07.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.747+0000 7f4502580700 1 -- 172.21.15.57:0/3389786881 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f44fc1525c0 con 0x7f44fc13ffb0 2021-06-25T04:51:07.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.747+0000 7f44f97fa700 1 -- 172.21.15.57:0/3389786881 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+143 (secure 0 0 0) 0x7f44ec048320 con 0x7f44fc13ffb0 2021-06-25T04:51:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:07.754 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:51:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:51:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:51:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:51:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:51:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:51:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:07.756 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:51:07.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 -- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44e00554e0 msgr2=0x7f44e00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44e00554e0 0x7f44e00579a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f44f400b000 tx=0x7f44f4007d20).stop 2021-06-25T04:51:07.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 -- 172.21.15.57:0/3389786881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44fc13ffb0 msgr2=0x7f44fc139bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:07.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44fc13ffb0 0x7f44fc139bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f44fc0b7710 tx=0x7f44ec014000).stop 2021-06-25T04:51:07.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 -- 172.21.15.57:0/3389786881 shutdown_connections 2021-06-25T04:51:07.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f44e00554e0 0x7f44e00579a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44fc13ffb0 0x7f44fc139bf0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44fc0b96a0 0x7f44fc1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 --2- 172.21.15.57:0/3389786881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44fc0670e0 0x7f44fc1480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:07.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 -- 172.21.15.57:0/3389786881 >> 172.21.15.57:0/3389786881 conn(0x7f44fc05f9b0 msgr2=0x7f44fc0b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:07.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 -- 172.21.15.57:0/3389786881 shutdown_connections 2021-06-25T04:51:07.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.751+0000 7f4502580700 1 -- 172.21.15.57:0/3389786881 wait complete. 2021-06-25T04:51:07.767 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:51:07.767 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:51:07.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.871+0000 7fda13fbe700 1 Processor -- start 2021-06-25T04:51:08.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.871+0000 7fda13fbe700 1 -- start start 2021-06-25T04:51:08.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda0c146910 0x7fda0c1401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda0c0b4140 0x7fda0c1406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c143b20 con 0x7fda0c0b4650 2021-06-25T04:51:08.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c1474d0 con 0x7fda0c0b4140 2021-06-25T04:51:08.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c143dc0 con 0x7fda0c146910 2021-06-25T04:51:08.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda11559700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda0c0b4140 0x7fda0c1406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda11559700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda0c0b4140 0x7fda0c1406e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37898/0 (socket says 172.21.15.57:37898) 2021-06-25T04:51:08.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda11559700 1 -- 172.21.15.57:0/552930407 learned_addr learned my addr 172.21.15.57:0/552930407 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:08.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda11d5a700 1 --2- 172.21.15.57:0/552930407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda0c146910 0x7fda0c1401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda11559700 1 -- 172.21.15.57:0/552930407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda0c146910 msgr2=0x7fda0c1401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:08.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda11559700 1 --2- 172.21.15.57:0/552930407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda0c146910 0x7fda0c1401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda11559700 1 -- 172.21.15.57:0/552930407 >> v1:172.21.15.87:6789/0 conn(0x7fda0c0b4650 legacy=0x7fda0c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:08.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda11559700 1 -- 172.21.15.57:0/552930407 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0b0c50 con 0x7fda0c0b4140 2021-06-25T04:51:08.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda11559700 1 --2- 172.21.15.57:0/552930407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda0c0b4140 0x7fda0c1406e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fda00002f70 tx=0x7fda00006eb0).ready entity=mon.0 client_cookie=af8116ae49ee9b28 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:08.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda10d58700 1 -- 172.21.15.57:0/552930407 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda0000d5c0 con 0x7fda0c0b4140 2021-06-25T04:51:08.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda10d58700 1 -- 172.21.15.57:0/552930407 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda00000e90 con 0x7fda0c0b4140 2021-06-25T04:51:08.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda10d58700 1 -- 172.21.15.57:0/552930407 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda0000d950 con 0x7fda0c0b4140 2021-06-25T04:51:08.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 -- 172.21.15.57:0/552930407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda0c0b4140 msgr2=0x7fda0c1406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:08.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 --2- 172.21.15.57:0/552930407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda0c0b4140 0x7fda0c1406e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fda00002f70 tx=0x7fda00006eb0).stop 2021-06-25T04:51:08.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 -- 172.21.15.57:0/552930407 shutdown_connections 2021-06-25T04:51:08.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 --2- 172.21.15.57:0/552930407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda0c0b4140 0x7fda0c1406e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 --2- 172.21.15.57:0/552930407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda0c146910 0x7fda0c1401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 -- 172.21.15.57:0/552930407 >> 172.21.15.57:0/552930407 conn(0x7fda0c05c450 msgr2=0x7fda0c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:08.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 -- 172.21.15.57:0/552930407 shutdown_connections 2021-06-25T04:51:08.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 -- 172.21.15.57:0/552930407 wait complete. 2021-06-25T04:51:08.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.875+0000 7fda13fbe700 1 Processor -- start 2021-06-25T04:51:08.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda13fbe700 1 -- start start 2021-06-25T04:51:08.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda13fbe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda0c0b4140 0x7fda0c141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda13fbe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda0c0b4650 0x7fda0c0addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda13fbe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda0c146910 0x7fda0c0ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda13fbe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0ae7d0 con 0x7fda0c0b4650 2021-06-25T04:51:08.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda13fbe700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0b8c30 con 0x7fda0c0b4140 2021-06-25T04:51:08.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda13fbe700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0b8ed0 con 0x7fda0c146910 2021-06-25T04:51:08.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda11559700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda0c0b4650 0x7fda0c0addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda11559700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda0c0b4650 0x7fda0c0addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37904/0 (socket says 172.21.15.57:37904) 2021-06-25T04:51:08.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda11559700 1 -- 172.21.15.57:0/3338562367 learned_addr learned my addr 172.21.15.57:0/3338562367 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:08.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda11d5a700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda0c0b4140 0x7fda0c141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda1255b700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda0c146910 0x7fda0c0ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda11559700 1 -- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda0c146910 msgr2=0x7fda0c0ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:08.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda11559700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda0c146910 0x7fda0c0ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda11559700 1 -- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda0c0b4140 msgr2=0x7fda0c141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:08.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda11559700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda0c0b4140 0x7fda0c141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda11559700 1 -- 172.21.15.57:0/3338562367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0000b1e0 con 0x7fda0c0b4650 2021-06-25T04:51:08.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda11559700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda0c0b4650 0x7fda0c0addf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fda00002f70 tx=0x7fda00015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:08.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fd9feffd700 1 -- 172.21.15.57:0/3338562367 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda00011760 con 0x7fda0c0b4650 2021-06-25T04:51:08.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fd9feffd700 1 -- 172.21.15.57:0/3338562367 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda000118c0 con 0x7fda0c0b4650 2021-06-25T04:51:08.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fd9feffd700 1 -- 172.21.15.57:0/3338562367 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda00011c20 con 0x7fda0c0b4650 2021-06-25T04:51:08.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda13fbe700 1 -- 172.21.15.57:0/3338562367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c0b9170 con 0x7fda0c0b4650 2021-06-25T04:51:08.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.879+0000 7fda13fbe700 1 -- 172.21.15.57:0/3338562367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c1556c0 con 0x7fda0c0b4650 2021-06-25T04:51:08.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.883+0000 7fda13fbe700 1 -- 172.21.15.57:0/3338562367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0c0b9300 con 0x7fda0c0b4650 2021-06-25T04:51:08.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.883+0000 7fd9feffd700 1 -- 172.21.15.57:0/3338562367 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fda0000f070 con 0x7fda0c0b4650 2021-06-25T04:51:08.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.883+0000 7fd9feffd700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9ec055490 0x7fd9ec057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.883+0000 7fd9feffd700 1 -- 172.21.15.57:0/3338562367 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fda0006f1b0 con 0x7fda0c0b4650 2021-06-25T04:51:08.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.883+0000 7fda11d5a700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9ec055490 0x7fd9ec057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.883+0000 7fda11d5a700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9ec055490 0x7fd9ec057950 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fda0800c000 tx=0x7fda08008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:08.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:07.887+0000 7fd9feffd700 1 -- 172.21.15.57:0/3338562367 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fda00045640 con 0x7fda0c0b4650 2021-06-25T04:51:08.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.015+0000 7fda13fbe700 1 -- 172.21.15.57:0/3338562367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fda0c057310 con 0x7fda0c0b4650 2021-06-25T04:51:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.339+0000 7fd9feffd700 1 -- 172.21.15.57:0/3338562367 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v52) v1 ==== 133+0+0 (secure 0 0 0) 0x7fda00048c60 con 0x7fda0c0b4650 2021-06-25T04:51:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 -- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9ec055490 msgr2=0x7fd9ec057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9ec055490 0x7fd9ec057950 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fda0800c000 tx=0x7fda08008040).stop 2021-06-25T04:51:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 -- 172.21.15.57:0/3338562367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda0c0b4650 msgr2=0x7fda0c0addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda0c0b4650 0x7fda0c0addf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fda00002f70 tx=0x7fda00015000).stop 2021-06-25T04:51:08.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 -- 172.21.15.57:0/3338562367 shutdown_connections 2021-06-25T04:51:08.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9ec055490 0x7fd9ec057950 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda0c146910 0x7fda0c0ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda0c0b4650 0x7fda0c0addf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 --2- 172.21.15.57:0/3338562367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda0c0b4140 0x7fda0c141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 -- 172.21.15.57:0/3338562367 >> 172.21.15.57:0/3338562367 conn(0x7fda0c05c450 msgr2=0x7fda0c145970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:08.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 -- 172.21.15.57:0/3338562367 shutdown_connections 2021-06-25T04:51:08.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.343+0000 7fda13fbe700 1 -- 172.21.15.57:0/3338562367 wait complete. 2021-06-25T04:51:08.352 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:51:08.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:51:08.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.467+0000 7f28354d6700 1 Processor -- start 2021-06-25T04:51:08.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.467+0000 7f28354d6700 1 -- start start 2021-06-25T04:51:08.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2830064940 0x7f2830144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28300b3510 0x7f28300669c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28300664c0 con 0x7f2830066eb0 2021-06-25T04:51:08.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28300b3e60 con 0x7f28300b3510 2021-06-25T04:51:08.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2830140d00 con 0x7f2830064940 2021-06-25T04:51:08.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f2834cd5700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2830066eb0 0x7f28301410f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55132/0 (socket says 172.21.15.57:55132) 2021-06-25T04:51:08.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f2834cd5700 1 -- 172.21.15.57:0/3038390238 learned_addr learned my addr 172.21.15.57:0/3038390238 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:08.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282f7fe700 1 --2- 172.21.15.57:0/3038390238 >> v2:172.21.15.87:3300/0 conn(0x7f28300b3510 0x7f28300669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282ffff700 1 --2- 172.21.15.57:0/3038390238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2830064940 0x7f2830144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282effd700 1 -- 172.21.15.57:0/3038390238 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633790807 0 0) 0x7f28300664c0 con 0x7f2830066eb0 2021-06-25T04:51:08.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282effd700 1 -- 172.21.15.57:0/3038390238 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f281c003260 con 0x7f2830066eb0 2021-06-25T04:51:08.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282effd700 1 -- 172.21.15.57:0/3038390238 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2912694058 0 0) 0x7f281c003260 con 0x7f2830066eb0 2021-06-25T04:51:08.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282f7fe700 1 -- 172.21.15.57:0/3038390238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2830064940 msgr2=0x7f2830144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:08.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282f7fe700 1 --2- 172.21.15.57:0/3038390238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2830064940 0x7f2830144ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282f7fe700 1 -- 172.21.15.57:0/3038390238 >> v1:172.21.15.57:6789/0 conn(0x7f2830066eb0 legacy=0x7f28301410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:08.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282f7fe700 1 -- 172.21.15.57:0/3038390238 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28300b4680 con 0x7f28300b3510 2021-06-25T04:51:08.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282f7fe700 1 --2- 172.21.15.57:0/3038390238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28300b3510 0x7f28300669c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f2828001ba0 tx=0x7f2820006df0).ready entity=mon.1 client_cookie=2bca89e74d1dc1fd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:08.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282effd700 1 -- 172.21.15.57:0/3038390238 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2828001a00 con 0x7f28300b3510 2021-06-25T04:51:08.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282effd700 1 -- 172.21.15.57:0/3038390238 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2820000e90 con 0x7f28300b3510 2021-06-25T04:51:08.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f282effd700 1 -- 172.21.15.57:0/3038390238 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2820012460 con 0x7f28300b3510 2021-06-25T04:51:08.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 -- 172.21.15.57:0/3038390238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28300b3510 msgr2=0x7f28300669c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:08.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 --2- 172.21.15.57:0/3038390238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28300b3510 0x7f28300669c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f2828001ba0 tx=0x7f2820006df0).stop 2021-06-25T04:51:08.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 -- 172.21.15.57:0/3038390238 shutdown_connections 2021-06-25T04:51:08.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 --2- 172.21.15.57:0/3038390238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28300b3510 0x7f28300669c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 --2- 172.21.15.57:0/3038390238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2830064940 0x7f2830144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 -- 172.21.15.57:0/3038390238 >> 172.21.15.57:0/3038390238 conn(0x7f283005f670 msgr2=0x7f283005fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:08.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 -- 172.21.15.57:0/3038390238 shutdown_connections 2021-06-25T04:51:08.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.471+0000 7f28354d6700 1 -- 172.21.15.57:0/3038390238 wait complete. 2021-06-25T04:51:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f28354d6700 1 Processor -- start 2021-06-25T04:51:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f28354d6700 1 -- start start 2021-06-25T04:51:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f28354d6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2830064940 0x7f28300b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f28354d6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2830066eb0 0x7f28301356a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f28354d6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28300b3510 0x7f2830135b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f28354d6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2830136080 con 0x7f2830064940 2021-06-25T04:51:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f28354d6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2830144e10 con 0x7f28300b3510 2021-06-25T04:51:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f28354d6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2830142280 con 0x7f2830066eb0 2021-06-25T04:51:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2830064940 0x7f28300b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2830064940 0x7f28300b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37916/0 (socket says 172.21.15.57:37916) 2021-06-25T04:51:08.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282ffff700 1 -- 172.21.15.57:0/1940975835 learned_addr learned my addr 172.21.15.57:0/1940975835 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:08.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f2834cd5700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28300b3510 0x7f2830135b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282f7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2830066eb0 0x7f28301356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282f7fe700 1 -- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28300b3510 msgr2=0x7f2830135b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:08.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282f7fe700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28300b3510 0x7f2830135b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282f7fe700 1 -- 172.21.15.57:0/1940975835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2830064940 msgr2=0x7f28300b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:08.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282f7fe700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2830064940 0x7f28300b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:08.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282f7fe700 1 -- 172.21.15.57:0/1940975835 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282000b180 con 0x7f2830066eb0 2021-06-25T04:51:08.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282ffff700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2830064940 0x7f28300b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:51:08.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282f7fe700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2830066eb0 0x7f28301356a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2828001ba0 tx=0x7f2820014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:08.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282d7fa700 1 -- 172.21.15.57:0/1940975835 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f282000bec0 con 0x7f2830066eb0 2021-06-25T04:51:08.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282d7fa700 1 -- 172.21.15.57:0/1940975835 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282000db50 con 0x7f2830066eb0 2021-06-25T04:51:08.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f28354d6700 1 -- 172.21.15.57:0/1940975835 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2830142520 con 0x7f2830066eb0 2021-06-25T04:51:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f282d7fa700 1 -- 172.21.15.57:0/1940975835 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f282001e430 con 0x7f2830066eb0 2021-06-25T04:51:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.475+0000 7f28354d6700 1 -- 172.21.15.57:0/1940975835 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2830146f00 con 0x7f2830066eb0 2021-06-25T04:51:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.479+0000 7f28354d6700 1 -- 172.21.15.57:0/1940975835 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28301426b0 con 0x7f2830066eb0 2021-06-25T04:51:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.479+0000 7f282d7fa700 1 -- 172.21.15.57:0/1940975835 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f282000f030 con 0x7f2830066eb0 2021-06-25T04:51:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.479+0000 7f282d7fa700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f28100553d0 0x7f2810057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.479+0000 7f282d7fa700 1 -- 172.21.15.57:0/1940975835 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f282006eb40 con 0x7f2830066eb0 2021-06-25T04:51:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.479+0000 7f282ffff700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f28100553d0 0x7f2810057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.479+0000 7f282ffff700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f28100553d0 0x7f2810057890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f282400b000 tx=0x7f2824006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.491+0000 7f282d7fa700 1 -- 172.21.15.57:0/1940975835 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2820044d30 con 0x7f2830066eb0 2021-06-25T04:51:08.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:08.623+0000 7f28354d6700 1 -- 172.21.15.57:0/1940975835 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f2830057310 con 0x7f2830066eb0 2021-06-25T04:51:09.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.267+0000 7f282d7fa700 1 -- 172.21.15.57:0/1940975835 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v53) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2820023020 con 0x7f2830066eb0 2021-06-25T04:51:09.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.271+0000 7f28354d6700 1 -- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f28100553d0 msgr2=0x7f2810057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.271+0000 7f28354d6700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f28100553d0 0x7f2810057890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f282400b000 tx=0x7f2824006df0).stop 2021-06-25T04:51:09.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.271+0000 7f28354d6700 1 -- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2830066eb0 msgr2=0x7f28301356a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.271+0000 7f28354d6700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2830066eb0 0x7f28301356a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2828001ba0 tx=0x7f2820014000).stop 2021-06-25T04:51:09.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.275+0000 7f28354d6700 1 -- 172.21.15.57:0/1940975835 shutdown_connections 2021-06-25T04:51:09.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.275+0000 7f28354d6700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f28100553d0 0x7f2810057890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.275+0000 7f28354d6700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28300b3510 0x7f2830135b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.275+0000 7f28354d6700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2830066eb0 0x7f28301356a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.275+0000 7f28354d6700 1 --2- 172.21.15.57:0/1940975835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2830064940 0x7f28300b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.275+0000 7f28354d6700 1 -- 172.21.15.57:0/1940975835 >> 172.21.15.57:0/1940975835 conn(0x7f283005f670 msgr2=0x7f283013fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:09.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.275+0000 7f28354d6700 1 -- 172.21.15.57:0/1940975835 shutdown_connections 2021-06-25T04:51:09.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.275+0000 7f28354d6700 1 -- 172.21.15.57:0/1940975835 wait complete. 2021-06-25T04:51:09.282 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:51:09.291 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:51:09.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.391+0000 7f6a729d9700 1 Processor -- start 2021-06-25T04:51:09.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.391+0000 7f6a729d9700 1 -- start start 2021-06-25T04:51:09.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.391+0000 7f6a729d9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a6c0b2610 0x7f6a6c144070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.391+0000 7f6a729d9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6a6c05c450 0x7f6a6c0ad020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.391+0000 7f6a729d9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c0b2240 con 0x7f6a6c0b1da0 2021-06-25T04:51:09.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.391+0000 7f6a729d9700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6c13de00 con 0x7f6a6c05c450 2021-06-25T04:51:09.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.391+0000 7f6a729d9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c143690 con 0x7f6a6c0b2610 2021-06-25T04:51:09.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a6b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6a6c0b1da0 0x7f6a6c1400a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55146/0 (socket says 172.21.15.57:55146) 2021-06-25T04:51:09.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a6b7fe700 1 -- 172.21.15.57:0/1882549967 learned_addr learned my addr 172.21.15.57:0/1882549967 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:09.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a70f76700 1 --2- 172.21.15.57:0/1882549967 >> v2:172.21.15.87:3300/0 conn(0x7f6a6c05c450 0x7f6a6c0ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a6bfff700 1 --2- 172.21.15.57:0/1882549967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a6c0b2610 0x7f6a6c144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a6affd700 1 -- 172.21.15.57:0/1882549967 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390254722 0 0) 0x7f6a6c0b2240 con 0x7f6a6c0b1da0 2021-06-25T04:51:09.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a6affd700 1 -- 172.21.15.57:0/1882549967 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a4c003260 con 0x7f6a6c0b1da0 2021-06-25T04:51:09.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a70f76700 1 -- 172.21.15.57:0/1882549967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a6c0b2610 msgr2=0x7f6a6c144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:09.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a70f76700 1 --2- 172.21.15.57:0/1882549967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a6c0b2610 0x7f6a6c144070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a70f76700 1 -- 172.21.15.57:0/1882549967 >> v1:172.21.15.57:6789/0 conn(0x7f6a6c0b1da0 legacy=0x7f6a6c1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a70f76700 1 -- 172.21.15.57:0/1882549967 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c143930 con 0x7f6a6c05c450 2021-06-25T04:51:09.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a6bfff700 1 --2- 172.21.15.57:0/1882549967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a6c0b2610 0x7f6a6c144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:51:09.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a70f76700 1 --2- 172.21.15.57:0/1882549967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6c05c450 0x7f6a6c0ad020 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f6a64002f70 tx=0x7f6a64006df0).ready entity=mon.1 client_cookie=989238756d2ada82 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:09.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a6affd700 1 -- 172.21.15.57:0/1882549967 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a64014070 con 0x7f6a6c05c450 2021-06-25T04:51:09.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a6affd700 1 -- 172.21.15.57:0/1882549967 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a64000e90 con 0x7f6a6c05c450 2021-06-25T04:51:09.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a6affd700 1 -- 172.21.15.57:0/1882549967 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a6400fa90 con 0x7f6a6c05c450 2021-06-25T04:51:09.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a729d9700 1 -- 172.21.15.57:0/1882549967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6c05c450 msgr2=0x7f6a6c0ad020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a729d9700 1 --2- 172.21.15.57:0/1882549967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6c05c450 0x7f6a6c0ad020 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f6a64002f70 tx=0x7f6a64006df0).stop 2021-06-25T04:51:09.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a729d9700 1 -- 172.21.15.57:0/1882549967 shutdown_connections 2021-06-25T04:51:09.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a729d9700 1 --2- 172.21.15.57:0/1882549967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6c05c450 0x7f6a6c0ad020 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a729d9700 1 --2- 172.21.15.57:0/1882549967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a6c0b2610 0x7f6a6c144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a729d9700 1 -- 172.21.15.57:0/1882549967 >> 172.21.15.57:0/1882549967 conn(0x7f6a6c05cce0 msgr2=0x7f6a6c062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:09.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a729d9700 1 -- 172.21.15.57:0/1882549967 shutdown_connections 2021-06-25T04:51:09.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.395+0000 7f6a729d9700 1 -- 172.21.15.57:0/1882549967 wait complete. 2021-06-25T04:51:09.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a729d9700 1 Processor -- start 2021-06-25T04:51:09.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a729d9700 1 -- start start 2021-06-25T04:51:09.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a729d9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a6c05c450 0x7f6a6c0b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a729d9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a6c0b1da0 0x7f6a6c138430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a729d9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6c0b2610 0x7f6a6c138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a729d9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0ab350 con 0x7f6a6c05c450 2021-06-25T04:51:09.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a729d9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c142060 con 0x7f6a6c0b2610 2021-06-25T04:51:09.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a729d9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c142650 con 0x7f6a6c0b1da0 2021-06-25T04:51:09.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a6bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a6c05c450 0x7f6a6c0b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a6bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a6c05c450 0x7f6a6c0b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37932/0 (socket says 172.21.15.57:37932) 2021-06-25T04:51:09.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a6bfff700 1 -- 172.21.15.57:0/207163893 learned_addr learned my addr 172.21.15.57:0/207163893 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:09.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a6b7fe700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a6c0b1da0 0x7f6a6c138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a70f76700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6c0b2610 0x7f6a6c138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a6bfff700 1 -- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a6c0b1da0 msgr2=0x7f6a6c138430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a6bfff700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a6c0b1da0 0x7f6a6c138430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a6bfff700 1 -- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6c0b2610 msgr2=0x7f6a6c138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a6bfff700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6c0b2610 0x7f6a6c138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a6bfff700 1 -- 172.21.15.57:0/207163893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c009470 con 0x7f6a6c05c450 2021-06-25T04:51:09.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a6bfff700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a6c05c450 0x7f6a6c0b5f00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6a6c0abd50 tx=0x7f6a5c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:09.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a697fa700 1 -- 172.21.15.57:0/207163893 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a5c00c9d0 con 0x7f6a6c05c450 2021-06-25T04:51:09.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a697fa700 1 -- 172.21.15.57:0/207163893 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c00cb30 con 0x7f6a6c05c450 2021-06-25T04:51:09.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a729d9700 1 -- 172.21.15.57:0/207163893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6400b180 con 0x7f6a6c05c450 2021-06-25T04:51:09.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a697fa700 1 -- 172.21.15.57:0/207163893 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a5c00ce90 con 0x7f6a6c05c450 2021-06-25T04:51:09.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a729d9700 1 -- 172.21.15.57:0/207163893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6c142290 con 0x7f6a6c05c450 2021-06-25T04:51:09.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.399+0000 7f6a729d9700 1 -- 172.21.15.57:0/207163893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6c14de90 con 0x7f6a6c05c450 2021-06-25T04:51:09.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.403+0000 7f6a697fa700 1 -- 172.21.15.57:0/207163893 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6a5c022070 con 0x7f6a6c05c450 2021-06-25T04:51:09.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.403+0000 7f6a697fa700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6a50055450 0x7f6a50057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.403+0000 7f6a697fa700 1 -- 172.21.15.57:0/207163893 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f6a5c06e750 con 0x7f6a6c05c450 2021-06-25T04:51:09.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.403+0000 7f6a6b7fe700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6a50055450 0x7f6a50057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.403+0000 7f6a6b7fe700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6a50055450 0x7f6a50057910 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6a5400b000 tx=0x7f6a54009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:09.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.407+0000 7f6a697fa700 1 -- 172.21.15.57:0/207163893 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6a5c044980 con 0x7f6a6c05c450 2021-06-25T04:51:09.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.579+0000 7f6a729d9700 1 -- 172.21.15.57:0/207163893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f6a6c057310 con 0x7f6a6c05c450 2021-06-25T04:51:09.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.591+0000 7f6a697fa700 1 -- 172.21.15.57:0/207163893 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v23) v1 ==== 188+0+0 (secure 0 0 0) 0x7f6a5c047fa0 con 0x7f6a6c05c450 2021-06-25T04:51:09.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 -- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6a50055450 msgr2=0x7f6a50057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6a50055450 0x7f6a50057910 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6a5400b000 tx=0x7f6a54009040).stop 2021-06-25T04:51:09.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 -- 172.21.15.57:0/207163893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a6c05c450 msgr2=0x7f6a6c0b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a6c05c450 0x7f6a6c0b5f00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6a6c0abd50 tx=0x7f6a5c0091d0).stop 2021-06-25T04:51:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 -- 172.21.15.57:0/207163893 shutdown_connections 2021-06-25T04:51:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6a50055450 0x7f6a50057910 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6c0b2610 0x7f6a6c138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a6c0b1da0 0x7f6a6c138430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 --2- 172.21.15.57:0/207163893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a6c05c450 0x7f6a6c0b5f00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 -- 172.21.15.57:0/207163893 >> 172.21.15.57:0/207163893 conn(0x7f6a6c05cce0 msgr2=0x7f6a6c05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:09.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 -- 172.21.15.57:0/207163893 shutdown_connections 2021-06-25T04:51:09.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.595+0000 7f6a729d9700 1 -- 172.21.15.57:0/207163893 wait complete. 2021-06-25T04:51:09.602 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 9 and data pool 10 2021-06-25T04:51:09.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:51:09.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a9d839700 1 Processor -- start 2021-06-25T04:51:09.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a9d839700 1 -- start start 2021-06-25T04:51:09.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a9d839700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5a980b3200 0x7f5a98066640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a9d839700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a980b0e30 0x7f5a98066b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a9d839700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a980b35e0 con 0x7f5a980b1800 2021-06-25T04:51:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a9d839700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a981436b0 con 0x7f5a980b3200 2021-06-25T04:51:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a9d839700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a98065c60 con 0x7f5a980b0e30 2021-06-25T04:51:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a96ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5a980b3200 0x7f5a98066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a96ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5a980b3200 0x7f5a98066640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37950/0 (socket says 172.21.15.57:37950) 2021-06-25T04:51:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a96ffd700 1 -- 172.21.15.57:0/3104647880 learned_addr learned my addr 172.21.15.57:0/3104647880 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:09.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a977fe700 1 --2- 172.21.15.57:0/3104647880 >> v2:172.21.15.87:3300/0 conn(0x7f5a980b0e30 0x7f5a98066b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a96ffd700 1 -- 172.21.15.57:0/3104647880 >> v2:172.21.15.87:3300/0 conn(0x7f5a980b0e30 msgr2=0x7f5a98066b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:09.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a96ffd700 1 --2- 172.21.15.57:0/3104647880 >> v2:172.21.15.87:3300/0 conn(0x7f5a980b0e30 0x7f5a98066b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a96ffd700 1 -- 172.21.15.57:0/3104647880 >> v1:172.21.15.87:6789/0 conn(0x7f5a980b1800 legacy=0x7f5a98142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a96ffd700 1 -- 172.21.15.57:0/3104647880 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a98065f00 con 0x7f5a980b3200 2021-06-25T04:51:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.703+0000 7f5a96ffd700 1 --2- 172.21.15.57:0/3104647880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980b3200 0x7f5a98066640 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f5a98061d50 tx=0x7f5a88006eb0).ready entity=mon.0 client_cookie=49209f30d4e7f95 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a95ffb700 1 -- 172.21.15.57:0/3104647880 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a8800d5c0 con 0x7f5a980b3200 2021-06-25T04:51:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a95ffb700 1 -- 172.21.15.57:0/3104647880 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a88000e90 con 0x7f5a980b3200 2021-06-25T04:51:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a95ffb700 1 -- 172.21.15.57:0/3104647880 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a8800d910 con 0x7f5a980b3200 2021-06-25T04:51:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a9d839700 1 -- 172.21.15.57:0/3104647880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980b3200 msgr2=0x7f5a98066640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a9d839700 1 --2- 172.21.15.57:0/3104647880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980b3200 0x7f5a98066640 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f5a98061d50 tx=0x7f5a88006eb0).stop 2021-06-25T04:51:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a9d839700 1 -- 172.21.15.57:0/3104647880 shutdown_connections 2021-06-25T04:51:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a9d839700 1 --2- 172.21.15.57:0/3104647880 >> v2:172.21.15.87:3300/0 conn(0x7f5a980b0e30 0x7f5a98066b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a9d839700 1 --2- 172.21.15.57:0/3104647880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980b3200 0x7f5a98066640 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a9d839700 1 -- 172.21.15.57:0/3104647880 >> 172.21.15.57:0/3104647880 conn(0x7f5a9805c450 msgr2=0x7f5a9805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a9d839700 1 -- 172.21.15.57:0/3104647880 shutdown_connections 2021-06-25T04:51:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a9d839700 1 -- 172.21.15.57:0/3104647880 wait complete. 2021-06-25T04:51:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a9d839700 1 Processor -- start 2021-06-25T04:51:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.707+0000 7f5a9d839700 1 -- start start 2021-06-25T04:51:09.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a9d839700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a980b0e30 0x7f5a9805f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a9d839700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980b1800 0x7f5a980b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a9d839700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980b3200 0x7f5a980b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a9d839700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980b4210 con 0x7f5a980b1800 2021-06-25T04:51:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a9d839700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980aa420 con 0x7f5a980b3200 2021-06-25T04:51:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a9d839700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980b0b60 con 0x7f5a980b0e30 2021-06-25T04:51:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a967fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980b1800 0x7f5a980b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a967fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980b1800 0x7f5a980b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37958/0 (socket says 172.21.15.57:37958) 2021-06-25T04:51:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a96ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a980b0e30 0x7f5a9805f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a967fc700 1 -- 172.21.15.57:0/2391166425 learned_addr learned my addr 172.21.15.57:0/2391166425 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a977fe700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980b3200 0x7f5a980b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a967fc700 1 -- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a980b0e30 msgr2=0x7f5a9805f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a967fc700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a980b0e30 0x7f5a9805f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a967fc700 1 -- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980b3200 msgr2=0x7f5a980b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a967fc700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980b3200 0x7f5a980b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a967fc700 1 -- 172.21.15.57:0/2391166425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8800b1e0 con 0x7f5a980b1800 2021-06-25T04:51:09.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a967fc700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980b1800 0x7f5a980b52b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f5a8c001fa0 tx=0x7f5a8c007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:09.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a87fff700 1 -- 172.21.15.57:0/2391166425 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a8c012400 con 0x7f5a980b1800 2021-06-25T04:51:09.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a87fff700 1 -- 172.21.15.57:0/2391166425 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c012560 con 0x7f5a980b1800 2021-06-25T04:51:09.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a9d839700 1 -- 172.21.15.57:0/2391166425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9813d810 con 0x7f5a980b1800 2021-06-25T04:51:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a87fff700 1 -- 172.21.15.57:0/2391166425 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a8c0128c0 con 0x7f5a980b1800 2021-06-25T04:51:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a9d839700 1 -- 172.21.15.57:0/2391166425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a980b4990 con 0x7f5a980b1800 2021-06-25T04:51:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.711+0000 7f5a9d839700 1 -- 172.21.15.57:0/2391166425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a98057310 con 0x7f5a980b1800 2021-06-25T04:51:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.715+0000 7f5a87fff700 1 -- 172.21.15.57:0/2391166425 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5a8c019030 con 0x7f5a980b1800 2021-06-25T04:51:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.715+0000 7f5a87fff700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a74055450 0x7f5a74057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.715+0000 7f5a87fff700 1 -- 172.21.15.57:0/2391166425 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5a8c06d1c0 con 0x7f5a980b1800 2021-06-25T04:51:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.715+0000 7f5a96ffd700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a74055450 0x7f5a74057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.715+0000 7f5a96ffd700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a74055450 0x7f5a74057910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f5a8801b000 tx=0x7f5a88015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:09.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.719+0000 7f5a87fff700 1 -- 172.21.15.57:0/2391166425 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5a8c043370 con 0x7f5a980b1800 2021-06-25T04:51:09.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.851+0000 7f5a9d839700 1 -- 172.21.15.57:0/2391166425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a9805cce0 con 0x7f5a980b1800 2021-06-25T04:51:09.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.851+0000 7f5a87fff700 1 -- 172.21.15.57:0/2391166425 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f5a8c046990 con 0x7f5a980b1800 2021-06-25T04:51:09.857 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:09.858 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":55,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:51:09.583251+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:51:08.069175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-06-25T04:51:08.684458+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:51:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 -- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a74055450 msgr2=0x7f5a74057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a74055450 0x7f5a74057910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f5a8801b000 tx=0x7f5a88015000).stop 2021-06-25T04:51:09.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 -- 172.21.15.57:0/2391166425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980b1800 msgr2=0x7f5a980b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980b1800 0x7f5a980b52b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f5a8c001fa0 tx=0x7f5a8c007bf0).stop 2021-06-25T04:51:09.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 -- 172.21.15.57:0/2391166425 shutdown_connections 2021-06-25T04:51:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a74055450 0x7f5a74057910 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a980b3200 0x7f5a980b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a980b1800 0x7f5a980b52b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 --2- 172.21.15.57:0/2391166425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a980b0e30 0x7f5a9805f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 -- 172.21.15.57:0/2391166425 >> 172.21.15.57:0/2391166425 conn(0x7f5a9805c450 msgr2=0x7f5a98141c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:09.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 -- 172.21.15.57:0/2391166425 shutdown_connections 2021-06-25T04:51:09.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.855+0000 7f5a9d839700 1 -- 172.21.15.57:0/2391166425 wait complete. 2021-06-25T04:51:09.871 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:51:09.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.975+0000 7f40c09aa700 1 Processor -- start 2021-06-25T04:51:09.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.975+0000 7f40c09aa700 1 -- start start 2021-06-25T04:51:09.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.975+0000 7f40c09aa700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc0b5460 0x7f40bc0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.975+0000 7f40c09aa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40bc0b05d0 0x7f40bc147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.975+0000 7f40c09aa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc0b5840 con 0x7f40bc067560 2021-06-25T04:51:09.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.975+0000 7f40c09aa700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc1452a0 con 0x7f40bc0b05d0 2021-06-25T04:51:09.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.975+0000 7f40c09aa700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0adfb0 con 0x7f40bc0b5460 2021-06-25T04:51:09.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.975+0000 7f40baffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40bc0b05d0 0x7f40bc147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.975+0000 7f40bbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f40bc067560 0x7f40bc0acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55186/0 (socket says 172.21.15.57:55186) 2021-06-25T04:51:09.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.975+0000 7f40bbfff700 1 -- 172.21.15.57:0/1124426029 learned_addr learned my addr 172.21.15.57:0/1124426029 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:09.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.975+0000 7f40bb7fe700 1 --2- 172.21.15.57:0/1124426029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc0b5460 0x7f40bc0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40baffd700 1 -- 172.21.15.57:0/1124426029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc0b5460 msgr2=0x7f40bc0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:09.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40baffd700 1 --2- 172.21.15.57:0/1124426029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc0b5460 0x7f40bc0af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40baffd700 1 -- 172.21.15.57:0/1124426029 >> v1:172.21.15.57:6789/0 conn(0x7f40bc067560 legacy=0x7f40bc0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40baffd700 1 -- 172.21.15.57:0/1124426029 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc0ac7c0 con 0x7f40bc0b05d0 2021-06-25T04:51:09.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40baffd700 1 --2- 172.21.15.57:0/1124426029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40bc0b05d0 0x7f40bc147560 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f40ac002f70 tx=0x7f40ac006df0).ready entity=mon.0 client_cookie=f640dfe76157fe26 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:09.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40ba7fc700 1 -- 172.21.15.57:0/1124426029 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40ac00d570 con 0x7f40bc0b05d0 2021-06-25T04:51:09.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40ba7fc700 1 -- 172.21.15.57:0/1124426029 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac000e90 con 0x7f40bc0b05d0 2021-06-25T04:51:09.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40ba7fc700 1 -- 172.21.15.57:0/1124426029 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40ac00d8c0 con 0x7f40bc0b05d0 2021-06-25T04:51:09.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 -- 172.21.15.57:0/1124426029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40bc0b05d0 msgr2=0x7f40bc147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 --2- 172.21.15.57:0/1124426029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40bc0b05d0 0x7f40bc147560 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f40ac002f70 tx=0x7f40ac006df0).stop 2021-06-25T04:51:09.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 -- 172.21.15.57:0/1124426029 shutdown_connections 2021-06-25T04:51:09.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 --2- 172.21.15.57:0/1124426029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40bc0b05d0 0x7f40bc147560 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 --2- 172.21.15.57:0/1124426029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc0b5460 0x7f40bc0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 -- 172.21.15.57:0/1124426029 >> 172.21.15.57:0/1124426029 conn(0x7f40bc062520 msgr2=0x7f40bc062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:09.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 -- 172.21.15.57:0/1124426029 shutdown_connections 2021-06-25T04:51:09.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 -- 172.21.15.57:0/1124426029 wait complete. 2021-06-25T04:51:09.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 Processor -- start 2021-06-25T04:51:09.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 -- start start 2021-06-25T04:51:09.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40bc067560 0x7f40bc14b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40bc0b05d0 0x7f40bc066ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc0b5460 0x7f40bc0b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0a7080 con 0x7f40bc067560 2021-06-25T04:51:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc15acc0 con 0x7f40bc0b05d0 2021-06-25T04:51:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40c09aa700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc063380 con 0x7f40bc0b5460 2021-06-25T04:51:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40bb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40bc067560 0x7f40bc14b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40bb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40bc067560 0x7f40bc14b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37970/0 (socket says 172.21.15.57:37970) 2021-06-25T04:51:09.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.979+0000 7f40bb7fe700 1 -- 172.21.15.57:0/3040441991 learned_addr learned my addr 172.21.15.57:0/3040441991 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:09.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40baffd700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40bc0b05d0 0x7f40bc066ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40bbfff700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc0b5460 0x7f40bc0b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40bb7fe700 1 -- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc0b5460 msgr2=0x7f40bc0b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40bb7fe700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc0b5460 0x7f40bc0b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40bb7fe700 1 -- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40bc0b05d0 msgr2=0x7f40bc066ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:09.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40bb7fe700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40bc0b05d0 0x7f40bc066ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:09.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40bb7fe700 1 -- 172.21.15.57:0/3040441991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac00b180 con 0x7f40bc067560 2021-06-25T04:51:09.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40bbfff700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc0b5460 0x7f40bc0b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:09.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40bb7fe700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40bc067560 0x7f40bc14b0a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f40b000c000 tx=0x7f40b0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:09.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40b8ff9700 1 -- 172.21.15.57:0/3040441991 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b0010780 con 0x7f40bc067560 2021-06-25T04:51:09.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40b8ff9700 1 -- 172.21.15.57:0/3040441991 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b00108e0 con 0x7f40bc067560 2021-06-25T04:51:09.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40c09aa700 1 -- 172.21.15.57:0/3040441991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc0a72b0 con 0x7f40bc067560 2021-06-25T04:51:09.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40b8ff9700 1 -- 172.21.15.57:0/3040441991 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b0010c40 con 0x7f40bc067560 2021-06-25T04:51:09.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40c09aa700 1 -- 172.21.15.57:0/3040441991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc14b590 con 0x7f40bc067560 2021-06-25T04:51:09.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40c09aa700 1 -- 172.21.15.57:0/3040441991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc0638b0 con 0x7f40bc067560 2021-06-25T04:51:09.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.983+0000 7f40b8ff9700 1 -- 172.21.15.57:0/3040441991 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f40b001c460 con 0x7f40bc067560 2021-06-25T04:51:09.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.987+0000 7f40b8ff9700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f409c055450 0x7f409c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.987+0000 7f40b8ff9700 1 -- 172.21.15.57:0/3040441991 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f40b006e440 con 0x7f40bc067560 2021-06-25T04:51:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.987+0000 7f40baffd700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f409c055450 0x7f409c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.987+0000 7f40baffd700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f409c055450 0x7f409c057910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f40ac019000 tx=0x7f40ac014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:10.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:09.991+0000 7f40b8ff9700 1 -- 172.21.15.57:0/3040441991 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f40b0044400 con 0x7f40bc067560 2021-06-25T04:51:10.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.119+0000 7f40c09aa700 1 -- 172.21.15.57:0/3040441991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40bc15ae30 con 0x7f40bc067560 2021-06-25T04:51:10.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40b8ff9700 1 -- 172.21.15.57:0/3040441991 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f40b0047a20 con 0x7f40bc067560 2021-06-25T04:51:10.128 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:10.129 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":55,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:51:09.583251+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:51:08.069175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-06-25T04:51:08.684458+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:51:10.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40c09aa700 1 -- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f409c055450 msgr2=0x7f409c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:10.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40c09aa700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f409c055450 0x7f409c057910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f40ac019000 tx=0x7f40ac014000).stop 2021-06-25T04:51:10.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40c09aa700 1 -- 172.21.15.57:0/3040441991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40bc067560 msgr2=0x7f40bc14b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40c09aa700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40bc067560 0x7f40bc14b0a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f40b000c000 tx=0x7f40b0006df0).stop 2021-06-25T04:51:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40c09aa700 1 -- 172.21.15.57:0/3040441991 shutdown_connections 2021-06-25T04:51:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40c09aa700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f409c055450 0x7f409c057910 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40c09aa700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc0b5460 0x7f40bc0b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40c09aa700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40bc0b05d0 0x7f40bc066ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40c09aa700 1 --2- 172.21.15.57:0/3040441991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40bc067560 0x7f40bc14b0a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40c09aa700 1 -- 172.21.15.57:0/3040441991 >> 172.21.15.57:0/3040441991 conn(0x7f40bc062520 msgr2=0x7f40bc0ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.123+0000 7f40c09aa700 1 -- 172.21.15.57:0/3040441991 shutdown_connections 2021-06-25T04:51:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.127+0000 7f40c09aa700 1 -- 172.21.15.57:0/3040441991 wait complete. 2021-06-25T04:51:10.143 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:51:10.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5417fdf700 1 Processor -- start 2021-06-25T04:51:10.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5417fdf700 1 -- start start 2021-06-25T04:51:10.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5417fdf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f54100b13b0 0x7f54100b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:10.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5417fdf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54100ae610 con 0x7f54100b1d20 2021-06-25T04:51:10.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5417fdf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54100b1790 con 0x7f5410147280 2021-06-25T04:51:10.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5417fdf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54100b22a0 con 0x7f54100b13b0 2021-06-25T04:51:10.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5415d7b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f54100b13b0 0x7f54100b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:10.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f541557a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f54100b1d20 0x7f5410146b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55198/0 (socket says 172.21.15.57:55198) 2021-06-25T04:51:10.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f541557a700 1 -- 172.21.15.57:0/1772714933 learned_addr learned my addr 172.21.15.57:0/1772714933 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:10.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5415d7b700 1 -- 172.21.15.57:0/1772714933 >> v1:172.21.15.87:6789/0 conn(0x7f5410147280 legacy=0x7f5410143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:10.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5415d7b700 1 -- 172.21.15.57:0/1772714933 >> v1:172.21.15.57:6789/0 conn(0x7f54100b1d20 legacy=0x7f5410146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:10.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5414d79700 1 -- 172.21.15.57:0/1772714933 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373201233 0 0) 0x7f54100ae610 con 0x7f54100b1d20 2021-06-25T04:51:10.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5415d7b700 1 -- 172.21.15.57:0/1772714933 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54100b2540 con 0x7f54100b13b0 2021-06-25T04:51:10.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5415d7b700 1 --2- 172.21.15.57:0/1772714933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54100b13b0 0x7f54100b3040 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f5410063130 tx=0x7f540c006df0).ready entity=mon.0 client_cookie=f109b0b2223bf2d5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:10.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5414d79700 1 -- 172.21.15.57:0/1772714933 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c00d5c0 con 0x7f54100b13b0 2021-06-25T04:51:10.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5414d79700 1 -- 172.21.15.57:0/1772714933 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c000e90 con 0x7f54100b13b0 2021-06-25T04:51:10.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5417fdf700 1 -- 172.21.15.57:0/1772714933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54100b13b0 msgr2=0x7f54100b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:10.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5414d79700 1 -- 172.21.15.57:0/1772714933 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c00d910 con 0x7f54100b13b0 2021-06-25T04:51:10.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5417fdf700 1 --2- 172.21.15.57:0/1772714933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54100b13b0 0x7f54100b3040 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f5410063130 tx=0x7f540c006df0).stop 2021-06-25T04:51:10.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5417fdf700 1 -- 172.21.15.57:0/1772714933 shutdown_connections 2021-06-25T04:51:10.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5417fdf700 1 --2- 172.21.15.57:0/1772714933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54100b13b0 0x7f54100b3040 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:10.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.251+0000 7f5417fdf700 1 -- 172.21.15.57:0/1772714933 >> 172.21.15.57:0/1772714933 conn(0x7f5410060780 msgr2=0x7f5410060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:10.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f5417fdf700 1 -- 172.21.15.57:0/1772714933 shutdown_connections 2021-06-25T04:51:10.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f5417fdf700 1 -- 172.21.15.57:0/1772714933 wait complete. 2021-06-25T04:51:10.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f5417fdf700 1 Processor -- start 2021-06-25T04:51:10.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f5417fdf700 1 -- start start 2021-06-25T04:51:10.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f5417fdf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54100b13b0 0x7f5410063bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:10.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f5417fdf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54100b1d20 0x7f5410152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:10.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f5417fdf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5410147280 0x7f54100a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:10.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f5417fdf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54100664a0 con 0x7f54100b1d20 2021-06-25T04:51:10.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f5417fdf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54101533e0 con 0x7f54100b13b0 2021-06-25T04:51:10.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f5417fdf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54100a2c80 con 0x7f5410147280 2021-06-25T04:51:10.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f541557a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54100b1d20 0x7f5410152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:10.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f541557a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54100b1d20 0x7f5410152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37988/0 (socket says 172.21.15.57:37988) 2021-06-25T04:51:10.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f541557a700 1 -- 172.21.15.57:0/3432110726 learned_addr learned my addr 172.21.15.57:0/3432110726 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:10.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f5415d7b700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54100b13b0 0x7f5410063bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:10.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.255+0000 7f541657c700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5410147280 0x7f54100a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:10.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f541557a700 1 -- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5410147280 msgr2=0x7f54100a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:10.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f541557a700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5410147280 0x7f54100a9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:10.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f541557a700 1 -- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54100b13b0 msgr2=0x7f5410063bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:10.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f541557a700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54100b13b0 0x7f5410063bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:10.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f541557a700 1 -- 172.21.15.57:0/3432110726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c00b180 con 0x7f54100b1d20 2021-06-25T04:51:10.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f541557a700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54100b1d20 0x7f5410152ef0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f5410153570 tx=0x7f5400007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:10.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f53feffd700 1 -- 172.21.15.57:0/3432110726 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54000070d0 con 0x7f54100b1d20 2021-06-25T04:51:10.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f53feffd700 1 -- 172.21.15.57:0/3432110726 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5400007230 con 0x7f54100b1d20 2021-06-25T04:51:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f5417fdf700 1 -- 172.21.15.57:0/3432110726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5410067260 con 0x7f54100b1d20 2021-06-25T04:51:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f53feffd700 1 -- 172.21.15.57:0/3432110726 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5400005610 con 0x7f54100b1d20 2021-06-25T04:51:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f5417fdf700 1 -- 172.21.15.57:0/3432110726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54100677a0 con 0x7f54100b1d20 2021-06-25T04:51:10.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f5417fdf700 1 -- 172.21.15.57:0/3432110726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5410057310 con 0x7f54100b1d20 2021-06-25T04:51:10.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.259+0000 7f53feffd700 1 -- 172.21.15.57:0/3432110726 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5400010070 con 0x7f54100b1d20 2021-06-25T04:51:10.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.263+0000 7f53feffd700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53f00553d0 0x7f53f0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:10.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.263+0000 7f53feffd700 1 -- 172.21.15.57:0/3432110726 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f540006d610 con 0x7f54100b1d20 2021-06-25T04:51:10.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.263+0000 7f5415d7b700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53f00553d0 0x7f53f0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:10.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.263+0000 7f5415d7b700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53f00553d0 0x7f53f0057890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f540c018000 tx=0x7f540c012000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:10.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.271+0000 7f53feffd700 1 -- 172.21.15.57:0/3432110726 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f54000436b0 con 0x7f54100b1d20 2021-06-25T04:51:10.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:10.439+0000 7f5417fdf700 1 -- 172.21.15.57:0/3432110726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f54100b37d0 con 0x7f54100b1d20 2021-06-25T04:51:11.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.359+0000 7f53feffd700 1 -- 172.21.15.57:0/3432110726 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5400046cd0 con 0x7f54100b1d20 2021-06-25T04:51:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 -- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53f00553d0 msgr2=0x7f53f0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53f00553d0 0x7f53f0057890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f540c018000 tx=0x7f540c012000).stop 2021-06-25T04:51:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 -- 172.21.15.57:0/3432110726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54100b1d20 msgr2=0x7f5410152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54100b1d20 0x7f5410152ef0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f5410153570 tx=0x7f5400007a60).stop 2021-06-25T04:51:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 -- 172.21.15.57:0/3432110726 shutdown_connections 2021-06-25T04:51:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53f00553d0 0x7f53f0057890 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5410147280 0x7f54100a9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54100b1d20 0x7f5410152ef0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 --2- 172.21.15.57:0/3432110726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54100b13b0 0x7f5410063bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 -- 172.21.15.57:0/3432110726 >> 172.21.15.57:0/3432110726 conn(0x7f5410060780 msgr2=0x7f5410146a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:11.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 -- 172.21.15.57:0/3432110726 shutdown_connections 2021-06-25T04:51:11.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.363+0000 7f5417fdf700 1 -- 172.21.15.57:0/3432110726 wait complete. 2021-06-25T04:51:11.383 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:51:11.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 Processor -- start 2021-06-25T04:51:11.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 -- start start 2021-06-25T04:51:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9c000b46d0 0x7f9c0013fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c00143960 0x7f9c00140250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c000b68d0 con 0x7f9c00061640 2021-06-25T04:51:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c000b9640 con 0x7f9c000b46d0 2021-06-25T04:51:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000b6b70 con 0x7f9c00143960 2021-06-25T04:51:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05835700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9c000b46d0 0x7f9c0013fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05835700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9c000b46d0 0x7f9c0013fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37992/0 (socket says 172.21.15.57:37992) 2021-06-25T04:51:11.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05835700 1 -- 172.21.15.57:0/325565399 learned_addr learned my addr 172.21.15.57:0/325565399 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:11.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c06837700 1 --2- 172.21.15.57:0/325565399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c00143960 0x7f9c00140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05835700 1 -- 172.21.15.57:0/325565399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c00143960 msgr2=0x7f9c00140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:11.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05835700 1 --2- 172.21.15.57:0/325565399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c00143960 0x7f9c00140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05835700 1 -- 172.21.15.57:0/325565399 >> v1:172.21.15.87:6789/0 conn(0x7f9c00061640 legacy=0x7f9c000b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05835700 1 -- 172.21.15.57:0/325565399 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c000b6e10 con 0x7f9c000b46d0 2021-06-25T04:51:11.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05034700 1 -- 172.21.15.57:0/325565399 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587846439 0 0) 0x7f9c000b68d0 con 0x7f9c00061640 2021-06-25T04:51:11.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05835700 1 --2- 172.21.15.57:0/325565399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c000b46d0 0x7f9c0013fd60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f9bf00032f0 tx=0x7f9bf0009290).ready entity=mon.0 client_cookie=e5915427ba164788 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:11.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05034700 1 -- 172.21.15.57:0/325565399 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bf000b8a0 con 0x7f9c000b46d0 2021-06-25T04:51:11.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05034700 1 -- 172.21.15.57:0/325565399 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf000ba00 con 0x7f9c000b46d0 2021-06-25T04:51:11.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c05034700 1 -- 172.21.15.57:0/325565399 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bf000bb70 con 0x7f9c000b46d0 2021-06-25T04:51:11.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 -- 172.21.15.57:0/325565399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c000b46d0 msgr2=0x7f9c0013fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 --2- 172.21.15.57:0/325565399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c000b46d0 0x7f9c0013fd60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f9bf00032f0 tx=0x7f9bf0009290).stop 2021-06-25T04:51:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 -- 172.21.15.57:0/325565399 shutdown_connections 2021-06-25T04:51:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 --2- 172.21.15.57:0/325565399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c00143960 0x7f9c00140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 --2- 172.21.15.57:0/325565399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c000b46d0 0x7f9c0013fd60 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 -- 172.21.15.57:0/325565399 >> 172.21.15.57:0/325565399 conn(0x7f9c0006adb0 msgr2=0x7f9c0005f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 -- 172.21.15.57:0/325565399 shutdown_connections 2021-06-25T04:51:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.491+0000 7f9c07038700 1 -- 172.21.15.57:0/325565399 wait complete. 2021-06-25T04:51:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c07038700 1 Processor -- start 2021-06-25T04:51:11.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c07038700 1 -- start start 2021-06-25T04:51:11.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c07038700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c00061640 0x7f9c001488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c07038700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c00143960 0x7f9c00146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c07038700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c00139590 0x7f9c00146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c07038700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000b8cd0 con 0x7f9c00061640 2021-06-25T04:51:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c07038700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0005c9d0 con 0x7f9c00139590 2021-06-25T04:51:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c07038700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000b72f0 con 0x7f9c00143960 2021-06-25T04:51:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c06036700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c00061640 0x7f9c001488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c06036700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c00061640 0x7f9c001488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37996/0 (socket says 172.21.15.57:37996) 2021-06-25T04:51:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c06036700 1 -- 172.21.15.57:0/921105004 learned_addr learned my addr 172.21.15.57:0/921105004 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c06837700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c00139590 0x7f9c00146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c05835700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c00143960 0x7f9c00146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c06036700 1 -- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c00143960 msgr2=0x7f9c00146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c06036700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c00143960 0x7f9c00146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c06036700 1 -- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c00139590 msgr2=0x7f9c00146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c06036700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c00139590 0x7f9c00146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c06036700 1 -- 172.21.15.57:0/921105004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf0009530 con 0x7f9c00061640 2021-06-25T04:51:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c06036700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c00061640 0x7f9c001488e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f9bfc000bc0 tx=0x7f9bfc007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:11.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9bf77fe700 1 -- 172.21.15.57:0/921105004 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bfc00ce00 con 0x7f9c00061640 2021-06-25T04:51:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c07038700 1 -- 172.21.15.57:0/921105004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c000b7590 con 0x7f9c00061640 2021-06-25T04:51:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9bf77fe700 1 -- 172.21.15.57:0/921105004 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc00f470 con 0x7f9c00061640 2021-06-25T04:51:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9bf77fe700 1 -- 172.21.15.57:0/921105004 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bfc00f7d0 con 0x7f9c00061640 2021-06-25T04:51:11.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.495+0000 7f9c07038700 1 -- 172.21.15.57:0/921105004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c000b7ad0 con 0x7f9c00061640 2021-06-25T04:51:11.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.499+0000 7f9bf77fe700 1 -- 172.21.15.57:0/921105004 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9bfc019030 con 0x7f9c00061640 2021-06-25T04:51:11.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.499+0000 7f9c07038700 1 -- 172.21.15.57:0/921105004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c00057310 con 0x7f9c00061640 2021-06-25T04:51:11.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.499+0000 7f9bf77fe700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9be0055450 0x7f9be0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.499+0000 7f9bf77fe700 1 -- 172.21.15.57:0/921105004 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9bfc06d2b0 con 0x7f9c00061640 2021-06-25T04:51:11.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.499+0000 7f9c05835700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9be0055450 0x7f9be0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.499+0000 7f9c05835700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9be0055450 0x7f9be0057910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f9bf0018000 tx=0x7f9bf0016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:11.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.507+0000 7f9bf77fe700 1 -- 172.21.15.57:0/921105004 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9bfc043410 con 0x7f9c00061640 2021-06-25T04:51:11.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.671+0000 7f9c07038700 1 -- 172.21.15.57:0/921105004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c000b7cd0 con 0x7f9c00061640 2021-06-25T04:51:11.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9bf77fe700 1 -- 172.21.15.57:0/921105004 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f9bfc046a30 con 0x7f9c00061640 2021-06-25T04:51:11.679 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:11.679 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/289042329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":289042329},{"type":"v1","addr":"172.21.15.87:6835","nonce":289042329}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/824739091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":824739091},{"type":"v1","addr":"172.21.15.57:6833","nonce":824739091}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:51:09.583588+0000","modified":"2021-06-25T04:51:11.349725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3353139901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3353139901},{"type":"v1","addr":"172.21.15.57:6835","nonce":3353139901}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-06-25T04:51:11.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 -- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9be0055450 msgr2=0x7f9be0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9be0055450 0x7f9be0057910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f9bf0018000 tx=0x7f9bf0016000).stop 2021-06-25T04:51:11.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 -- 172.21.15.57:0/921105004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c00061640 msgr2=0x7f9c001488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c00061640 0x7f9c001488e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f9bfc000bc0 tx=0x7f9bfc007a70).stop 2021-06-25T04:51:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 -- 172.21.15.57:0/921105004 shutdown_connections 2021-06-25T04:51:11.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9be0055450 0x7f9be0057910 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c00139590 0x7f9c00146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c00143960 0x7f9c00146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 --2- 172.21.15.57:0/921105004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c00061640 0x7f9c001488e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 -- 172.21.15.57:0/921105004 >> 172.21.15.57:0/921105004 conn(0x7f9c0006adb0 msgr2=0x7f9c00142660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 -- 172.21.15.57:0/921105004 shutdown_connections 2021-06-25T04:51:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.675+0000 7f9c07038700 1 -- 172.21.15.57:0/921105004 wait complete. 2021-06-25T04:51:11.688 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2021-06-25T04:51:11.697 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:51:11.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.799+0000 7f3bd6386700 1 Processor -- start 2021-06-25T04:51:11.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.799+0000 7f3bd6386700 1 -- start start 2021-06-25T04:51:11.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3bd00aad40 0x7f3bd00672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3bd00b4d10 0x7f3bd00b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd0065920 con 0x7f3bd00ab120 2021-06-25T04:51:11.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd0064ed0 con 0x7f3bd00b4d10 2021-06-25T04:51:11.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00b3ca0 con 0x7f3bd00aad40 2021-06-25T04:51:11.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd5b85700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3bd00b4d10 0x7f3bd00b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd5b85700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3bd00b4d10 0x7f3bd00b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38006/0 (socket says 172.21.15.57:38006) 2021-06-25T04:51:11.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd5b85700 1 -- 172.21.15.57:0/243315087 learned_addr learned my addr 172.21.15.57:0/243315087 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:11.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd5384700 1 --2- 172.21.15.57:0/243315087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3bd00aad40 0x7f3bd00672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd5b85700 1 -- 172.21.15.57:0/243315087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3bd00aad40 msgr2=0x7f3bd00672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:11.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd5b85700 1 --2- 172.21.15.57:0/243315087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3bd00aad40 0x7f3bd00672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd5b85700 1 -- 172.21.15.57:0/243315087 >> v1:172.21.15.87:6789/0 conn(0x7f3bd00ab120 legacy=0x7f3bd00647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bbffff700 1 -- 172.21.15.57:0/243315087 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927622574 0 0) 0x7f3bd0065920 con 0x7f3bd00ab120 2021-06-25T04:51:11.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd5b85700 1 -- 172.21.15.57:0/243315087 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd0066e20 con 0x7f3bd00b4d10 2021-06-25T04:51:11.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd5b85700 1 --2- 172.21.15.57:0/243315087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00b4d10 0x7f3bd00b74e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f3bc80032f0 tx=0x7f3bc8009290).ready entity=mon.0 client_cookie=d0a86103fa547dad server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:11.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bbffff700 1 -- 172.21.15.57:0/243315087 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bc800b8a0 con 0x7f3bd00b4d10 2021-06-25T04:51:11.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bbffff700 1 -- 172.21.15.57:0/243315087 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc800ba00 con 0x7f3bd00b4d10 2021-06-25T04:51:11.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 -- 172.21.15.57:0/243315087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00b4d10 msgr2=0x7f3bd00b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 --2- 172.21.15.57:0/243315087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00b4d10 0x7f3bd00b74e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f3bc80032f0 tx=0x7f3bc8009290).stop 2021-06-25T04:51:11.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 -- 172.21.15.57:0/243315087 shutdown_connections 2021-06-25T04:51:11.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 --2- 172.21.15.57:0/243315087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00b4d10 0x7f3bd00b74e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 --2- 172.21.15.57:0/243315087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3bd00aad40 0x7f3bd00672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 -- 172.21.15.57:0/243315087 >> 172.21.15.57:0/243315087 conn(0x7f3bd0062ba0 msgr2=0x7f3bd005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:11.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 -- 172.21.15.57:0/243315087 shutdown_connections 2021-06-25T04:51:11.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.803+0000 7f3bd6386700 1 -- 172.21.15.57:0/243315087 wait complete. 2021-06-25T04:51:11.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd6386700 1 Processor -- start 2021-06-25T04:51:11.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd6386700 1 -- start start 2021-06-25T04:51:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd6386700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3bd00aad40 0x7f3bd00ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd6386700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00ab120 0x7f3bd0141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd6386700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd00b4d10 0x7f3bd0141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd6386700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd0141e30 con 0x7f3bd00ab120 2021-06-25T04:51:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd6386700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd01509d0 con 0x7f3bd00b4d10 2021-06-25T04:51:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd6386700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd014fab0 con 0x7f3bd00aad40 2021-06-25T04:51:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd4b83700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00ab120 0x7f3bd0141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd4b83700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00ab120 0x7f3bd0141450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38012/0 (socket says 172.21.15.57:38012) 2021-06-25T04:51:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd4b83700 1 -- 172.21.15.57:0/2520964584 learned_addr learned my addr 172.21.15.57:0/2520964584 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:11.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd5384700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3bd00aad40 0x7f3bd00ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd5b85700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd00b4d10 0x7f3bd0141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd4b83700 1 -- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3bd00aad40 msgr2=0x7f3bd00ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd4b83700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3bd00aad40 0x7f3bd00ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd4b83700 1 -- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd00b4d10 msgr2=0x7f3bd0141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd4b83700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd00b4d10 0x7f3bd0141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd4b83700 1 -- 172.21.15.57:0/2520964584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8009530 con 0x7f3bd00ab120 2021-06-25T04:51:11.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd4b83700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00ab120 0x7f3bd0141450 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f3bc0000bc0 tx=0x7f3bc0007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:11.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bbe7fc700 1 -- 172.21.15.57:0/2520964584 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bc0013450 con 0x7f3bd00ab120 2021-06-25T04:51:11.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bbe7fc700 1 -- 172.21.15.57:0/2520964584 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc00135b0 con 0x7f3bd00ab120 2021-06-25T04:51:11.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd6386700 1 -- 172.21.15.57:0/2520964584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd014fd50 con 0x7f3bd00ab120 2021-06-25T04:51:11.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bbe7fc700 1 -- 172.21.15.57:0/2520964584 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bc0013910 con 0x7f3bd00ab120 2021-06-25T04:51:11.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.807+0000 7f3bd6386700 1 -- 172.21.15.57:0/2520964584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd0150290 con 0x7f3bd00ab120 2021-06-25T04:51:11.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.811+0000 7f3bd6386700 1 -- 172.21.15.57:0/2520964584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd0057310 con 0x7f3bd00ab120 2021-06-25T04:51:11.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.811+0000 7f3bbe7fc700 1 -- 172.21.15.57:0/2520964584 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3bc001a060 con 0x7f3bd00ab120 2021-06-25T04:51:11.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.811+0000 7f3bbe7fc700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3bb0055450 0x7f3bb0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:11.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.811+0000 7f3bbe7fc700 1 -- 172.21.15.57:0/2520964584 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3bc006d630 con 0x7f3bd00ab120 2021-06-25T04:51:11.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.811+0000 7f3bd5384700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3bb0055450 0x7f3bb0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:11.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.811+0000 7f3bd5384700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3bb0055450 0x7f3bb0057910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f3bcc00b000 tx=0x7f3bcc006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:11.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.815+0000 7f3bbe7fc700 1 -- 172.21.15.57:0/2520964584 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3bc00437e0 con 0x7f3bd00ab120 2021-06-25T04:51:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.939+0000 7f3bd6386700 1 -- 172.21.15.57:0/2520964584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bd005d990 con 0x7f3bd00ab120 2021-06-25T04:51:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bbe7fc700 1 -- 172.21.15.57:0/2520964584 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16273 (secure 0 0 0) 0x7f3bc0018070 con 0x7f3bd00ab120 2021-06-25T04:51:11.947 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:11.947 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":56,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:51:10.586886+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:51:08.069175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-06-25T04:51:08.684458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:51:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 -- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3bb0055450 msgr2=0x7f3bb0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3bb0055450 0x7f3bb0057910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f3bcc00b000 tx=0x7f3bcc006df0).stop 2021-06-25T04:51:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 -- 172.21.15.57:0/2520964584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00ab120 msgr2=0x7f3bd0141450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00ab120 0x7f3bd0141450 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f3bc0000bc0 tx=0x7f3bc0007a40).stop 2021-06-25T04:51:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 -- 172.21.15.57:0/2520964584 shutdown_connections 2021-06-25T04:51:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3bb0055450 0x7f3bb0057910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd00b4d10 0x7f3bd0141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00ab120 0x7f3bd0141450 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 --2- 172.21.15.57:0/2520964584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3bd00aad40 0x7f3bd00ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:11.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 -- 172.21.15.57:0/2520964584 >> 172.21.15.57:0/2520964584 conn(0x7f3bd0062ba0 msgr2=0x7f3bd00b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:11.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 -- 172.21.15.57:0/2520964584 shutdown_connections 2021-06-25T04:51:11.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:11.943+0000 7f3bd6386700 1 -- 172.21.15.57:0/2520964584 wait complete. 2021-06-25T04:51:11.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:51:12.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.067+0000 7f2bb0814700 1 Processor -- start 2021-06-25T04:51:12.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.067+0000 7f2bb0814700 1 -- start start 2021-06-25T04:51:12.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2bac0b06d0 0x7f2bac142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0ace30 0x7f2bac13f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac1438e0 con 0x7f2bac0b3090 2021-06-25T04:51:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac0b0ab0 con 0x7f2bac0b06d0 2021-06-25T04:51:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0ae640 con 0x7f2bac0ace30 2021-06-25T04:51:12.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2baad9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2bac0b06d0 0x7f2bac142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bab59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0ace30 0x7f2bac13f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2baa59c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2bac0b3090 0x7f2bac1431d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:55986/0 (socket says 172.21.15.57:55986) 2021-06-25T04:51:12.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bab59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0ace30 0x7f2bac13f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:49186/0 (socket says 172.21.15.57:49186) 2021-06-25T04:51:12.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2baa59c700 1 -- 172.21.15.57:0/4113529411 learned_addr learned my addr 172.21.15.57:0/4113529411 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:12.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bab59e700 1 -- 172.21.15.57:0/4113529411 >> v2:172.21.15.87:3300/0 conn(0x7f2bac0b06d0 msgr2=0x7f2bac142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:12.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bab59e700 1 --2- 172.21.15.57:0/4113529411 >> v2:172.21.15.87:3300/0 conn(0x7f2bac0b06d0 0x7f2bac142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bab59e700 1 -- 172.21.15.57:0/4113529411 >> v1:172.21.15.87:6789/0 conn(0x7f2bac0b3090 legacy=0x7f2bac1431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2ba9d9b700 1 -- 172.21.15.57:0/4113529411 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16773844 0 0) 0x7f2bac1438e0 con 0x7f2bac0b3090 2021-06-25T04:51:12.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bab59e700 1 -- 172.21.15.57:0/4113529411 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac0ae8e0 con 0x7f2bac0ace30 2021-06-25T04:51:12.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bab59e700 1 --2- 172.21.15.57:0/4113529411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0ace30 0x7f2bac13f860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2ba40032f0 tx=0x7f2ba40091d0).ready entity=mon.2 client_cookie=1d92fc71c3abaef1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:12.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2ba9d9b700 1 -- 172.21.15.57:0/4113529411 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ba400b6c0 con 0x7f2bac0ace30 2021-06-25T04:51:12.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2ba9d9b700 1 -- 172.21.15.57:0/4113529411 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba400b820 con 0x7f2bac0ace30 2021-06-25T04:51:12.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2ba9d9b700 1 -- 172.21.15.57:0/4113529411 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ba400b990 con 0x7f2bac0ace30 2021-06-25T04:51:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 -- 172.21.15.57:0/4113529411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0ace30 msgr2=0x7f2bac13f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 --2- 172.21.15.57:0/4113529411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0ace30 0x7f2bac13f860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2ba40032f0 tx=0x7f2ba40091d0).stop 2021-06-25T04:51:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 -- 172.21.15.57:0/4113529411 shutdown_connections 2021-06-25T04:51:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 --2- 172.21.15.57:0/4113529411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0ace30 0x7f2bac13f860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 --2- 172.21.15.57:0/4113529411 >> v2:172.21.15.87:3300/0 conn(0x7f2bac0b06d0 0x7f2bac142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 -- 172.21.15.57:0/4113529411 >> 172.21.15.57:0/4113529411 conn(0x7f2bac061100 msgr2=0x7f2bac062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:12.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 -- 172.21.15.57:0/4113529411 shutdown_connections 2021-06-25T04:51:12.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.071+0000 7f2bb0814700 1 -- 172.21.15.57:0/4113529411 wait complete. 2021-06-25T04:51:12.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2bb0814700 1 Processor -- start 2021-06-25T04:51:12.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2bb0814700 1 -- start start 2021-06-25T04:51:12.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2bb0814700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bac0ace30 0x7f2bac13bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2bb0814700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bac0b06d0 0x7f2bac13f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2bb0814700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0b3090 0x7f2bac153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2bb0814700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac067520 con 0x7f2bac0ace30 2021-06-25T04:51:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2bb0814700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac13b930 con 0x7f2bac0b06d0 2021-06-25T04:51:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2bb0814700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac067750 con 0x7f2bac0b3090 2021-06-25T04:51:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2baad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bac0ace30 0x7f2bac13bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2baad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bac0ace30 0x7f2bac13bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38026/0 (socket says 172.21.15.57:38026) 2021-06-25T04:51:12.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2baad9d700 1 -- 172.21.15.57:0/1863404001 learned_addr learned my addr 172.21.15.57:0/1863404001 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:12.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2baa59c700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bac0b06d0 0x7f2bac13f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2bab59e700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0b3090 0x7f2bac153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2baad9d700 1 -- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0b3090 msgr2=0x7f2bac153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2baad9d700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0b3090 0x7f2bac153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2baad9d700 1 -- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bac0b06d0 msgr2=0x7f2bac13f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2baad9d700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bac0b06d0 0x7f2bac13f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2baad9d700 1 -- 172.21.15.57:0/1863404001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009470 con 0x7f2bac0ace30 2021-06-25T04:51:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2baad9d700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bac0ace30 0x7f2bac13bff0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f2b9400c000 tx=0x7f2b94006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2ba3fff700 1 -- 172.21.15.57:0/1863404001 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b94010780 con 0x7f2bac0ace30 2021-06-25T04:51:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2bb0814700 1 -- 172.21.15.57:0/1863404001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac13c4e0 con 0x7f2bac0ace30 2021-06-25T04:51:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2ba3fff700 1 -- 172.21.15.57:0/1863404001 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b940108e0 con 0x7f2bac0ace30 2021-06-25T04:51:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.075+0000 7f2ba3fff700 1 -- 172.21.15.57:0/1863404001 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b94010c40 con 0x7f2bac0ace30 2021-06-25T04:51:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.079+0000 7f2bb0814700 1 -- 172.21.15.57:0/1863404001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac066960 con 0x7f2bac0ace30 2021-06-25T04:51:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.079+0000 7f2bb0814700 1 -- 172.21.15.57:0/1863404001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac057310 con 0x7f2bac0ace30 2021-06-25T04:51:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.079+0000 7f2ba3fff700 1 -- 172.21.15.57:0/1863404001 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2b9401c460 con 0x7f2bac0ace30 2021-06-25T04:51:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.079+0000 7f2ba3fff700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b900554e0 0x7f2b900579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.079+0000 7f2ba3fff700 1 -- 172.21.15.57:0/1863404001 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2b9406e330 con 0x7f2bac0ace30 2021-06-25T04:51:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.079+0000 7f2baa59c700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b900554e0 0x7f2b900579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.083+0000 7f2baa59c700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b900554e0 0x7f2b900579a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f2b9c00d000 tx=0x7f2b9c007c20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.087+0000 7f2ba3fff700 1 -- 172.21.15.57:0/1863404001 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2b940443e0 con 0x7f2bac0ace30 2021-06-25T04:51:12.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.255+0000 7f2bb0814700 1 -- 172.21.15.57:0/1863404001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2bac0b2c30 con 0x7f2bac0ace30 2021-06-25T04:51:12.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.263+0000 7f2ba3fff700 1 -- 172.21.15.57:0/1863404001 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2b94047a00 con 0x7f2bac0ace30 2021-06-25T04:51:12.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 -- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b900554e0 msgr2=0x7f2b900579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b900554e0 0x7f2b900579a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f2b9c00d000 tx=0x7f2b9c007c20).stop 2021-06-25T04:51:12.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 -- 172.21.15.57:0/1863404001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bac0ace30 msgr2=0x7f2bac13bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bac0ace30 0x7f2bac13bff0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f2b9400c000 tx=0x7f2b94006df0).stop 2021-06-25T04:51:12.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 -- 172.21.15.57:0/1863404001 shutdown_connections 2021-06-25T04:51:12.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b900554e0 0x7f2b900579a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bac0b3090 0x7f2bac153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bac0b06d0 0x7f2bac13f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 --2- 172.21.15.57:0/1863404001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bac0ace30 0x7f2bac13bff0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 -- 172.21.15.57:0/1863404001 >> 172.21.15.57:0/1863404001 conn(0x7f2bac061100 msgr2=0x7f2bac0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:12.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 -- 172.21.15.57:0/1863404001 shutdown_connections 2021-06-25T04:51:12.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.267+0000 7f2bb0814700 1 -- 172.21.15.57:0/1863404001 wait complete. 2021-06-25T04:51:12.277 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:51:12.288 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:51:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.399+0000 7f5eef2d2700 1 Processor -- start 2021-06-25T04:51:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.399+0000 7f5eef2d2700 1 -- start start 2021-06-25T04:51:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.399+0000 7f5eef2d2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b5bb0 0x7f5ee80b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.399+0000 7f5eef2d2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee8144070 con 0x7f5ee80b6540 2021-06-25T04:51:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.399+0000 7f5eef2d2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee80b6e10 con 0x7f5ee80b4380 2021-06-25T04:51:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.399+0000 7f5eef2d2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8143b30 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.399+0000 7f5eed06e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5ee80b6540 0x7f5ee8061cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55250/0 (socket says 172.21.15.57:55250) 2021-06-25T04:51:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.399+0000 7f5eed06e700 1 -- 172.21.15.57:0/3120985876 learned_addr learned my addr 172.21.15.57:0/3120985876 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eed86f700 1 --2- 172.21.15.57:0/3120985876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b5bb0 0x7f5ee80b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5ed7fff700 1 -- 172.21.15.57:0/3120985876 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574664984 0 0) 0x7f5ee8144070 con 0x7f5ee80b6540 2021-06-25T04:51:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5ed7fff700 1 -- 172.21.15.57:0/3120985876 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed0003260 con 0x7f5ee80b6540 2021-06-25T04:51:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eed86f700 1 -- 172.21.15.57:0/3120985876 >> v1:172.21.15.87:6789/0 conn(0x7f5ee80b4380 legacy=0x7f5ee812b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eed86f700 1 -- 172.21.15.57:0/3120985876 >> v1:172.21.15.57:6789/0 conn(0x7f5ee80b6540 legacy=0x7f5ee8061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eed86f700 1 -- 172.21.15.57:0/3120985876 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8143dd0 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eed86f700 1 --2- 172.21.15.57:0/3120985876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b5bb0 0x7f5ee80b6920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5ee00032f0 tx=0x7f5ee00091d0).ready entity=mon.2 client_cookie=fa467da8eab1a0b5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5ed7fff700 1 -- 172.21.15.57:0/3120985876 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee000b6c0 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5ed7fff700 1 -- 172.21.15.57:0/3120985876 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee000b820 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5ed7fff700 1 -- 172.21.15.57:0/3120985876 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee000b990 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eef2d2700 1 -- 172.21.15.57:0/3120985876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b5bb0 msgr2=0x7f5ee80b6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eef2d2700 1 --2- 172.21.15.57:0/3120985876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b5bb0 0x7f5ee80b6920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5ee00032f0 tx=0x7f5ee00091d0).stop 2021-06-25T04:51:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eef2d2700 1 -- 172.21.15.57:0/3120985876 shutdown_connections 2021-06-25T04:51:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eef2d2700 1 --2- 172.21.15.57:0/3120985876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b5bb0 0x7f5ee80b6920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eef2d2700 1 -- 172.21.15.57:0/3120985876 >> 172.21.15.57:0/3120985876 conn(0x7f5ee805c450 msgr2=0x7f5ee805c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eef2d2700 1 -- 172.21.15.57:0/3120985876 shutdown_connections 2021-06-25T04:51:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.403+0000 7f5eef2d2700 1 -- 172.21.15.57:0/3120985876 wait complete. 2021-06-25T04:51:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eef2d2700 1 Processor -- start 2021-06-25T04:51:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eef2d2700 1 -- start start 2021-06-25T04:51:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eef2d2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b4380 0x7f5ee813db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eef2d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ee80b5bb0 0x7f5ee8155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eef2d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ee80b6540 0x7f5ee8125ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eef2d2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee81564b0 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eef2d2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee813e430 con 0x7f5ee80b6540 2021-06-25T04:51:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eef2d2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80b1d20 con 0x7f5ee80b4380 2021-06-25T04:51:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eec86d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ee80b5bb0 0x7f5ee8155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eec86d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ee80b5bb0 0x7f5ee8155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38038/0 (socket says 172.21.15.57:38038) 2021-06-25T04:51:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eed06e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b4380 0x7f5ee813db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eec86d700 1 -- 172.21.15.57:0/59807382 learned_addr learned my addr 172.21.15.57:0/59807382 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eed86f700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ee80b6540 0x7f5ee8125ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eec86d700 1 -- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b4380 msgr2=0x7f5ee813db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eec86d700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b4380 0x7f5ee813db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eec86d700 1 -- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ee80b6540 msgr2=0x7f5ee8125ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eec86d700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ee80b6540 0x7f5ee8125ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eec86d700 1 -- 172.21.15.57:0/59807382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee0009470 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eed06e700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b4380 0x7f5ee813db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:51:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eec86d700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ee80b5bb0 0x7f5ee8155fc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f5ee8060f30 tx=0x7f5ee4007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5ed67fc700 1 -- 172.21.15.57:0/59807382 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee4007030 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5ed67fc700 1 -- 172.21.15.57:0/59807382 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee4007190 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eef2d2700 1 -- 172.21.15.57:0/59807382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee80b1fc0 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5ed67fc700 1 -- 172.21.15.57:0/59807382 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee4006510 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.407+0000 7f5eef2d2700 1 -- 172.21.15.57:0/59807382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee80b2500 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.411+0000 7f5eef2d2700 1 -- 172.21.15.57:0/59807382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee80b26c0 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.411+0000 7f5ed67fc700 1 -- 172.21.15.57:0/59807382 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5ee4010030 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.411+0000 7f5ed67fc700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ec80553f0 0x7f5ec80578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.411+0000 7f5ed67fc700 1 -- 172.21.15.57:0/59807382 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5ee406dbc0 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.411+0000 7f5eed06e700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ec80553f0 0x7f5ec80578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.411+0000 7f5eed06e700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ec80553f0 0x7f5ec80578b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f5ed800d000 tx=0x7f5ed8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.419+0000 7f5ed67fc700 1 -- 172.21.15.57:0/59807382 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5ee4043be0 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.583+0000 7f5eef2d2700 1 -- 172.21.15.57:0/59807382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5ee8057310 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.591+0000 7f5ed67fc700 1 -- 172.21.15.57:0/59807382 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5ee4047200 con 0x7f5ee80b5bb0 2021-06-25T04:51:12.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 -- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ec80553f0 msgr2=0x7f5ec80578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ec80553f0 0x7f5ec80578b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f5ed800d000 tx=0x7f5ed8009040).stop 2021-06-25T04:51:12.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 -- 172.21.15.57:0/59807382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ee80b5bb0 msgr2=0x7f5ee8155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ee80b5bb0 0x7f5ee8155fc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f5ee8060f30 tx=0x7f5ee4007be0).stop 2021-06-25T04:51:12.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 -- 172.21.15.57:0/59807382 shutdown_connections 2021-06-25T04:51:12.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ec80553f0 0x7f5ec80578b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ee80b6540 0x7f5ee8125ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ee80b5bb0 0x7f5ee8155fc0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 --2- 172.21.15.57:0/59807382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ee80b4380 0x7f5ee813db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 -- 172.21.15.57:0/59807382 >> 172.21.15.57:0/59807382 conn(0x7f5ee805c450 msgr2=0x7f5ee8128270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:12.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 -- 172.21.15.57:0/59807382 shutdown_connections 2021-06-25T04:51:12.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.595+0000 7f5eef2d2700 1 -- 172.21.15.57:0/59807382 wait complete. 2021-06-25T04:51:12.604 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:51:12.612 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:51:12.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.707+0000 7f02a135c700 1 Processor -- start 2021-06-25T04:51:12.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.707+0000 7f02a135c700 1 -- start start 2021-06-25T04:51:12.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f029c0b46d0 0x7f029c13fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f029c143960 0x7f029c140250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029c0b68d0 con 0x7f029c061640 2021-06-25T04:51:12.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0b9640 con 0x7f029c143960 2021-06-25T04:51:12.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0b6b70 con 0x7f029c0b46d0 2021-06-25T04:51:12.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a0b5b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f029c143960 0x7f029c140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a0b5b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f029c143960 0x7f029c140250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38050/0 (socket says 172.21.15.57:38050) 2021-06-25T04:51:12.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a0b5b700 1 -- 172.21.15.57:0/2615315641 learned_addr learned my addr 172.21.15.57:0/2615315641 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:12.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f029b7fe700 1 --2- 172.21.15.57:0/2615315641 >> v2:172.21.15.87:3300/0 conn(0x7f029c0b46d0 0x7f029c13fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a0b5b700 1 -- 172.21.15.57:0/2615315641 >> v2:172.21.15.87:3300/0 conn(0x7f029c0b46d0 msgr2=0x7f029c13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:12.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a0b5b700 1 --2- 172.21.15.57:0/2615315641 >> v2:172.21.15.87:3300/0 conn(0x7f029c0b46d0 0x7f029c13fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a0b5b700 1 -- 172.21.15.57:0/2615315641 >> v1:172.21.15.87:6789/0 conn(0x7f029c061640 legacy=0x7f029c0b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a0b5b700 1 -- 172.21.15.57:0/2615315641 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c0b6e10 con 0x7f029c143960 2021-06-25T04:51:12.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a0b5b700 1 --2- 172.21.15.57:0/2615315641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c143960 0x7f029c140250 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f02940032f0 tx=0x7f0294009290).ready entity=mon.0 client_cookie=4df2920ba8db7060 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:12.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f029affd700 1 -- 172.21.15.57:0/2615315641 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029400b870 con 0x7f029c143960 2021-06-25T04:51:12.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f029affd700 1 -- 172.21.15.57:0/2615315641 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029400b9d0 con 0x7f029c143960 2021-06-25T04:51:12.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f029affd700 1 -- 172.21.15.57:0/2615315641 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029400bb40 con 0x7f029c143960 2021-06-25T04:51:12.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 -- 172.21.15.57:0/2615315641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c143960 msgr2=0x7f029c140250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 --2- 172.21.15.57:0/2615315641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c143960 0x7f029c140250 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f02940032f0 tx=0x7f0294009290).stop 2021-06-25T04:51:12.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 -- 172.21.15.57:0/2615315641 shutdown_connections 2021-06-25T04:51:12.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 --2- 172.21.15.57:0/2615315641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c143960 0x7f029c140250 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 --2- 172.21.15.57:0/2615315641 >> v2:172.21.15.87:3300/0 conn(0x7f029c0b46d0 0x7f029c13fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 -- 172.21.15.57:0/2615315641 >> 172.21.15.57:0/2615315641 conn(0x7f029c06adb0 msgr2=0x7f029c05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:12.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 -- 172.21.15.57:0/2615315641 shutdown_connections 2021-06-25T04:51:12.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.711+0000 7f02a135c700 1 -- 172.21.15.57:0/2615315641 wait complete. 2021-06-25T04:51:12.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f02a135c700 1 Processor -- start 2021-06-25T04:51:12.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f02a135c700 1 -- start start 2021-06-25T04:51:12.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f02a135c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f029c061640 0x7f029c0b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f02a135c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f029c143960 0x7f029c146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f02a135c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c148560 0x7f029c1469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f02a135c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c147cf0 con 0x7f029c148560 2021-06-25T04:51:12.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f02a135c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c156410 con 0x7f029c143960 2021-06-25T04:51:12.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f02a135c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c147f20 con 0x7f029c061640 2021-06-25T04:51:12.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f02a0b5b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c148560 0x7f029c1469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f02a0b5b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c148560 0x7f029c1469f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38056/0 (socket says 172.21.15.57:38056) 2021-06-25T04:51:12.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f029b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f029c143960 0x7f029c146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.715+0000 7f02a0b5b700 1 -- 172.21.15.57:0/2631601677 learned_addr learned my addr 172.21.15.57:0/2631601677 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:12.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f029bfff700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f029c061640 0x7f029c0b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02a0b5b700 1 -- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f029c061640 msgr2=0x7f029c0b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02a0b5b700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f029c061640 0x7f029c0b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02a0b5b700 1 -- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f029c143960 msgr2=0x7f029c146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02a0b5b700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f029c143960 0x7f029c146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02a0b5b700 1 -- 172.21.15.57:0/2631601677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294009530 con 0x7f029c148560 2021-06-25T04:51:12.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f029bfff700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f029c061640 0x7f029c0b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:51:12.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f029b7fe700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f029c143960 0x7f029c146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:51:12.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02a0b5b700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c148560 0x7f029c1469f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f02940032f0 tx=0x7f0294016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:12.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02997fa700 1 -- 172.21.15.57:0/2631601677 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0294011bb0 con 0x7f029c148560 2021-06-25T04:51:12.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02997fa700 1 -- 172.21.15.57:0/2631601677 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294011d10 con 0x7f029c148560 2021-06-25T04:51:12.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02997fa700 1 -- 172.21.15.57:0/2631601677 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0294020670 con 0x7f029c148560 2021-06-25T04:51:12.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02a135c700 1 -- 172.21.15.57:0/2631601677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c0b2570 con 0x7f029c148560 2021-06-25T04:51:12.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02a135c700 1 -- 172.21.15.57:0/2631601677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c0b2c80 con 0x7f029c148560 2021-06-25T04:51:12.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02a135c700 1 -- 172.21.15.57:0/2631601677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c147080 con 0x7f029c148560 2021-06-25T04:51:12.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.719+0000 7f02997fa700 1 -- 172.21.15.57:0/2631601677 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f029400f070 con 0x7f029c148560 2021-06-25T04:51:12.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.723+0000 7f02997fa700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0280055450 0x7f0280057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:12.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.723+0000 7f02997fa700 1 -- 172.21.15.57:0/2631601677 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f029406e350 con 0x7f029c148560 2021-06-25T04:51:12.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.723+0000 7f029bfff700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0280055450 0x7f0280057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:12.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.723+0000 7f029bfff700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0280055450 0x7f0280057910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f028400d000 tx=0x7f0284009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:12.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.731+0000 7f02997fa700 1 -- 172.21.15.57:0/2631601677 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f029c147080 con 0x7f029c148560 2021-06-25T04:51:12.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.899+0000 7f02a135c700 1 -- 172.21.15.57:0/2631601677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f029c147080 con 0x7f029c148560 2021-06-25T04:51:12.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.899+0000 7f02997fa700 1 -- 172.21.15.57:0/2631601677 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f029c147080 con 0x7f029c148560 2021-06-25T04:51:12.905 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:12.905 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/289042329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":289042329},{"type":"v1","addr":"172.21.15.87:6835","nonce":289042329}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/824739091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":824739091},{"type":"v1","addr":"172.21.15.57:6833","nonce":824739091}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:51:09.583588+0000","modified":"2021-06-25T04:51:11.349725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3353139901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3353139901},{"type":"v1","addr":"172.21.15.57:6835","nonce":3353139901}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-06-25T04:51:12.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 -- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0280055450 msgr2=0x7f0280057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0280055450 0x7f0280057910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f028400d000 tx=0x7f0284009040).stop 2021-06-25T04:51:12.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 -- 172.21.15.57:0/2631601677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c148560 msgr2=0x7f029c1469f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:12.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c148560 0x7f029c1469f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f02940032f0 tx=0x7f0294016000).stop 2021-06-25T04:51:12.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 -- 172.21.15.57:0/2631601677 shutdown_connections 2021-06-25T04:51:12.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0280055450 0x7f0280057910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c148560 0x7f029c1469f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f029c143960 0x7f029c146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 --2- 172.21.15.57:0/2631601677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f029c061640 0x7f029c0b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:12.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 -- 172.21.15.57:0/2631601677 >> 172.21.15.57:0/2631601677 conn(0x7f029c06adb0 msgr2=0x7f029c13e350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:12.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 -- 172.21.15.57:0/2631601677 shutdown_connections 2021-06-25T04:51:12.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:12.903+0000 7f02a135c700 1 -- 172.21.15.57:0/2631601677 wait complete. 2021-06-25T04:51:12.914 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2021-06-25T04:51:13.222 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:51:09.583588+0000', 'modified': '2021-06-25T04:51:11.349725+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5634': {'gid': 5634, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/3353139901', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 3353139901}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3353139901}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:51:13.223 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:51:13.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:51:13.340 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":5634,"want_state":"up:active","state":"up:active","rank_uptime":3.7425239449999999,"mdsmap_epoch":25,"osdmap_epoch":56,"osdmap_epoch_barrier":56,"uptime":8.0304513429999993} 2021-06-25T04:51:13.340 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 5634, "mdsmap_epoch": 25, "osdmap_epoch": 56, "osdmap_epoch_barrier": 56, "rank_uptime": 3.742523945, "state": "up:active", "uptime": 8.030451343, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:51:13.341 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:51:13.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.439+0000 7f4292ff3700 1 Processor -- start 2021-06-25T04:51:13.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.439+0000 7f4292ff3700 1 -- start start 2021-06-25T04:51:13.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f428c0b2810 0x7f428c067110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f428c0af0f0 0x7f428c067600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c144410 con 0x7f428c0afd20 2021-06-25T04:51:13.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428c0b2bf0 con 0x7f428c0af0f0 2021-06-25T04:51:13.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428c1452c0 con 0x7f428c0b2810 2021-06-25T04:51:13.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f42917f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f428c0af0f0 0x7f428c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f42917f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f428c0af0f0 0x7f428c067600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38062/0 (socket says 172.21.15.57:38062) 2021-06-25T04:51:13.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f42917f0700 1 -- 172.21.15.57:0/248895948 learned_addr learned my addr 172.21.15.57:0/248895948 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:13.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f42927f2700 1 --1- 172.21.15.57:0/248895948 >> v1:172.21.15.57:6789/0 conn(0x7f428c0afd20 0x7f428c140e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55282/0 (socket says 172.21.15.57:55282) 2021-06-25T04:51:13.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4291ff1700 1 --2- 172.21.15.57:0/248895948 >> v2:172.21.15.87:3300/0 conn(0x7f428c0b2810 0x7f428c067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f42917f0700 1 -- 172.21.15.57:0/248895948 >> v2:172.21.15.87:3300/0 conn(0x7f428c0b2810 msgr2=0x7f428c067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:13.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f42917f0700 1 --2- 172.21.15.57:0/248895948 >> v2:172.21.15.87:3300/0 conn(0x7f428c0b2810 0x7f428c067110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f42917f0700 1 -- 172.21.15.57:0/248895948 >> v1:172.21.15.57:6789/0 conn(0x7f428c0afd20 legacy=0x7f428c140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4290fef700 1 -- 172.21.15.57:0/248895948 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093718995 0 0) 0x7f428c144410 con 0x7f428c0afd20 2021-06-25T04:51:13.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f42917f0700 1 -- 172.21.15.57:0/248895948 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c144640 con 0x7f428c0af0f0 2021-06-25T04:51:13.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f42917f0700 1 --2- 172.21.15.57:0/248895948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428c0af0f0 0x7f428c067600 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f427c002f70 tx=0x7f427c006eb0).ready entity=mon.0 client_cookie=1fd2da4c98a8e38e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:13.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4290fef700 1 -- 172.21.15.57:0/248895948 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f427c00d5c0 con 0x7f428c0af0f0 2021-06-25T04:51:13.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4290fef700 1 -- 172.21.15.57:0/248895948 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c000e90 con 0x7f428c0af0f0 2021-06-25T04:51:13.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4290fef700 1 -- 172.21.15.57:0/248895948 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f427c00d910 con 0x7f428c0af0f0 2021-06-25T04:51:13.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 -- 172.21.15.57:0/248895948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428c0af0f0 msgr2=0x7f428c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 --2- 172.21.15.57:0/248895948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428c0af0f0 0x7f428c067600 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f427c002f70 tx=0x7f427c006eb0).stop 2021-06-25T04:51:13.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 -- 172.21.15.57:0/248895948 shutdown_connections 2021-06-25T04:51:13.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 --2- 172.21.15.57:0/248895948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428c0af0f0 0x7f428c067600 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 --2- 172.21.15.57:0/248895948 >> v2:172.21.15.87:3300/0 conn(0x7f428c0b2810 0x7f428c067110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 -- 172.21.15.57:0/248895948 >> 172.21.15.57:0/248895948 conn(0x7f428c0611f0 msgr2=0x7f428c062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:13.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 -- 172.21.15.57:0/248895948 shutdown_connections 2021-06-25T04:51:13.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.443+0000 7f4292ff3700 1 -- 172.21.15.57:0/248895948 wait complete. 2021-06-25T04:51:13.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4292ff3700 1 Processor -- start 2021-06-25T04:51:13.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4292ff3700 1 -- start start 2021-06-25T04:51:13.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4292ff3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428c0af0f0 0x7f428c139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4292ff3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f428c0afd20 0x7f428c1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4292ff3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f428c0b2810 0x7f428c066060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4292ff3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c139310 con 0x7f428c0af0f0 2021-06-25T04:51:13.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4292ff3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c13ab70 con 0x7f428c0afd20 2021-06-25T04:51:13.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4292ff3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c139570 con 0x7f428c0b2810 2021-06-25T04:51:13.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4291ff1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428c0af0f0 0x7f428c139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4291ff1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428c0af0f0 0x7f428c139cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38066/0 (socket says 172.21.15.57:38066) 2021-06-25T04:51:13.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4291ff1700 1 -- 172.21.15.57:0/3054665570 learned_addr learned my addr 172.21.15.57:0/3054665570 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:13.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f42927f2700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f428c0b2810 0x7f428c066060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f42917f0700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f428c0afd20 0x7f428c1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4291ff1700 1 -- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f428c0b2810 msgr2=0x7f428c066060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4291ff1700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f428c0b2810 0x7f428c066060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4291ff1700 1 -- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f428c0afd20 msgr2=0x7f428c1500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4291ff1700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f428c0afd20 0x7f428c1500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4291ff1700 1 -- 172.21.15.57:0/3054665570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c00b1e0 con 0x7f428c0af0f0 2021-06-25T04:51:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.447+0000 7f4291ff1700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428c0af0f0 0x7f428c139cb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f428800c000 tx=0x7f4288006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.451+0000 7f427affd700 1 -- 172.21.15.57:0/3054665570 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4288011750 con 0x7f428c0af0f0 2021-06-25T04:51:13.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.451+0000 7f427affd700 1 -- 172.21.15.57:0/3054665570 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42880118b0 con 0x7f428c0af0f0 2021-06-25T04:51:13.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.451+0000 7f4292ff3700 1 -- 172.21.15.57:0/3054665570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c139810 con 0x7f428c0af0f0 2021-06-25T04:51:13.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.451+0000 7f427affd700 1 -- 172.21.15.57:0/3054665570 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4288011c10 con 0x7f428c0af0f0 2021-06-25T04:51:13.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.451+0000 7f4292ff3700 1 -- 172.21.15.57:0/3054665570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c066a20 con 0x7f428c0af0f0 2021-06-25T04:51:13.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.451+0000 7f4292ff3700 1 -- 172.21.15.57:0/3054665570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c057310 con 0x7f428c0af0f0 2021-06-25T04:51:13.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.451+0000 7f427affd700 1 -- 172.21.15.57:0/3054665570 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4288011d70 con 0x7f428c0af0f0 2021-06-25T04:51:13.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.451+0000 7f427affd700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f426c0553d0 0x7f426c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.451+0000 7f427affd700 1 -- 172.21.15.57:0/3054665570 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f428806e310 con 0x7f428c0af0f0 2021-06-25T04:51:13.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.451+0000 7f42917f0700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f426c0553d0 0x7f426c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.451+0000 7f42917f0700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f426c0553d0 0x7f426c057890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f427c01b000 tx=0x7f427c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:13.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.459+0000 7f427affd700 1 -- 172.21.15.57:0/3054665570 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4288044460 con 0x7f428c0af0f0 2021-06-25T04:51:13.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 -- 172.21.15.57:0/3054665570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f428c13eaa0 con 0x7f428c0af0f0 2021-06-25T04:51:13.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f427affd700 1 -- 172.21.15.57:0/3054665570 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16273 (secure 0 0 0) 0x7f4288047a80 con 0x7f428c0af0f0 2021-06-25T04:51:13.596 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:13.596 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":56,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:51:10.586886+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:51:08.069175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-06-25T04:51:08.684458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:51:13.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 -- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f426c0553d0 msgr2=0x7f426c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f426c0553d0 0x7f426c057890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f427c01b000 tx=0x7f427c015000).stop 2021-06-25T04:51:13.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 -- 172.21.15.57:0/3054665570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428c0af0f0 msgr2=0x7f428c139cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428c0af0f0 0x7f428c139cb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f428800c000 tx=0x7f4288006df0).stop 2021-06-25T04:51:13.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 -- 172.21.15.57:0/3054665570 shutdown_connections 2021-06-25T04:51:13.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f426c0553d0 0x7f426c057890 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f428c0b2810 0x7f428c066060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f428c0afd20 0x7f428c1500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 --2- 172.21.15.57:0/3054665570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428c0af0f0 0x7f428c139cb0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 -- 172.21.15.57:0/3054665570 >> 172.21.15.57:0/3054665570 conn(0x7f428c0611f0 msgr2=0x7f428c142d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:13.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 -- 172.21.15.57:0/3054665570 shutdown_connections 2021-06-25T04:51:13.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.591+0000 7f4292ff3700 1 -- 172.21.15.57:0/3054665570 wait complete. 2021-06-25T04:51:13.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:51:08.069175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:51:08.684458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:51:13.612 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:51:13.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.719+0000 7f33a51e2700 1 Processor -- start 2021-06-25T04:51:13.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.719+0000 7f33a51e2700 1 -- start start 2021-06-25T04:51:13.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33a00b2760 0x7f33a0061120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a0067010 con 0x7f33a00b7670 2021-06-25T04:51:13.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a0061610 con 0x7f33a0143230 2021-06-25T04:51:13.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a0065370 con 0x7f33a00b2760 2021-06-25T04:51:13.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f339f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33a00b2760 0x7f33a0061120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f339f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33a00b2760 0x7f33a0061120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38074/0 (socket says 172.21.15.57:38074) 2021-06-25T04:51:13.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f339f7fe700 1 -- 172.21.15.57:0/1188529146 learned_addr learned my addr 172.21.15.57:0/1188529146 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:13.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f339ffff700 1 --1- 172.21.15.57:0/1188529146 >> v1:172.21.15.57:6789/0 conn(0x7f33a00b7670 0x7f33a0060a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55292/0 (socket says 172.21.15.57:55292) 2021-06-25T04:51:13.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f339f7fe700 1 -- 172.21.15.57:0/1188529146 >> v1:172.21.15.87:6789/0 conn(0x7f33a0143230 legacy=0x7f33a01436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f339f7fe700 1 -- 172.21.15.57:0/1188529146 >> v1:172.21.15.57:6789/0 conn(0x7f33a00b7670 legacy=0x7f33a0060a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f339f7fe700 1 -- 172.21.15.57:0/1188529146 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a00b7a50 con 0x7f33a00b2760 2021-06-25T04:51:13.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f339f7fe700 1 --2- 172.21.15.57:0/1188529146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33a00b2760 0x7f33a0061120 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f3390002f70 tx=0x7f3390006eb0).ready entity=mon.0 client_cookie=49d8e844578f4200 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:13.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f339effd700 1 -- 172.21.15.57:0/1188529146 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f339000d660 con 0x7f33a00b2760 2021-06-25T04:51:13.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f339effd700 1 -- 172.21.15.57:0/1188529146 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3390000e90 con 0x7f33a00b2760 2021-06-25T04:51:13.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 -- 172.21.15.57:0/1188529146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33a00b2760 msgr2=0x7f33a0061120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f339effd700 1 -- 172.21.15.57:0/1188529146 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f339000d9f0 con 0x7f33a00b2760 2021-06-25T04:51:13.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 --2- 172.21.15.57:0/1188529146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33a00b2760 0x7f33a0061120 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f3390002f70 tx=0x7f3390006eb0).stop 2021-06-25T04:51:13.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 -- 172.21.15.57:0/1188529146 shutdown_connections 2021-06-25T04:51:13.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 --2- 172.21.15.57:0/1188529146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33a00b2760 0x7f33a0061120 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 -- 172.21.15.57:0/1188529146 >> 172.21.15.57:0/1188529146 conn(0x7f33a005f670 msgr2=0x7f33a005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:13.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 -- 172.21.15.57:0/1188529146 shutdown_connections 2021-06-25T04:51:13.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 -- 172.21.15.57:0/1188529146 wait complete. 2021-06-25T04:51:13.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 Processor -- start 2021-06-25T04:51:13.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.723+0000 7f33a51e2700 1 -- start start 2021-06-25T04:51:13.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a51e2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33a00b2760 0x7f33a00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a51e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33a00b7670 0x7f33a0152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a51e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33a0143230 0x7f33a0152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a51e2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a00ad140 con 0x7f33a0143230 2021-06-25T04:51:13.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a51e2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a00ac420 con 0x7f33a00b7670 2021-06-25T04:51:13.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a51e2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a00ac6c0 con 0x7f33a00b2760 2021-06-25T04:51:13.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a49e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33a0143230 0x7f33a0152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a49e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33a0143230 0x7f33a0152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38084/0 (socket says 172.21.15.57:38084) 2021-06-25T04:51:13.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a49e1700 1 -- 172.21.15.57:0/1552723404 learned_addr learned my addr 172.21.15.57:0/1552723404 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:13.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f339ffff700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33a00b2760 0x7f33a00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f339f7fe700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33a00b7670 0x7f33a0152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a49e1700 1 -- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33a00b2760 msgr2=0x7f33a00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a49e1700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33a00b2760 0x7f33a00b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a49e1700 1 -- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33a00b7670 msgr2=0x7f33a0152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a49e1700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33a00b7670 0x7f33a0152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a49e1700 1 -- 172.21.15.57:0/1552723404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339000b1e0 con 0x7f33a0143230 2021-06-25T04:51:13.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a49e1700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33a0143230 0x7f33a0152940 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f33a0069c40 tx=0x7f33980013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:13.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f339d7fa700 1 -- 172.21.15.57:0/1552723404 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3398006aa0 con 0x7f33a0143230 2021-06-25T04:51:13.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a51e2700 1 -- 172.21.15.57:0/1552723404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a00ab6e0 con 0x7f33a0143230 2021-06-25T04:51:13.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f339d7fa700 1 -- 172.21.15.57:0/1552723404 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3398006c00 con 0x7f33a0143230 2021-06-25T04:51:13.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a51e2700 1 -- 172.21.15.57:0/1552723404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a00b0990 con 0x7f33a0143230 2021-06-25T04:51:13.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f339d7fa700 1 -- 172.21.15.57:0/1552723404 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3398007030 con 0x7f33a0143230 2021-06-25T04:51:13.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f33a51e2700 1 -- 172.21.15.57:0/1552723404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a00ac880 con 0x7f33a0143230 2021-06-25T04:51:13.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.727+0000 7f339d7fa700 1 -- 172.21.15.57:0/1552723404 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3398010030 con 0x7f33a0143230 2021-06-25T04:51:13.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.731+0000 7f339d7fa700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3384055490 0x7f3384057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.731+0000 7f339d7fa700 1 -- 172.21.15.57:0/1552723404 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f339806dcf0 con 0x7f33a0143230 2021-06-25T04:51:13.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.731+0000 7f339ffff700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3384055490 0x7f3384057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.731+0000 7f339ffff700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3384055490 0x7f3384057950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f338800b000 tx=0x7f3388009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:13.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.739+0000 7f339d7fa700 1 -- 172.21.15.57:0/1552723404 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3398043e00 con 0x7f33a0143230 2021-06-25T04:51:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.859+0000 7f33a51e2700 1 -- 172.21.15.57:0/1552723404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f33a0057310 con 0x7f33a0143230 2021-06-25T04:51:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.859+0000 7f339d7fa700 1 -- 172.21.15.57:0/1552723404 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v56) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3398047420 con 0x7f33a0143230 2021-06-25T04:51:13.866 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:51:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 -- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3384055490 msgr2=0x7f3384057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3384055490 0x7f3384057950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f338800b000 tx=0x7f3388009040).stop 2021-06-25T04:51:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 -- 172.21.15.57:0/1552723404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33a0143230 msgr2=0x7f33a0152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33a0143230 0x7f33a0152940 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f33a0069c40 tx=0x7f33980013a0).stop 2021-06-25T04:51:13.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 -- 172.21.15.57:0/1552723404 shutdown_connections 2021-06-25T04:51:13.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3384055490 0x7f3384057950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33a0143230 0x7f33a0152940 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33a00b7670 0x7f33a0152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 --2- 172.21.15.57:0/1552723404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33a00b2760 0x7f33a00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 -- 172.21.15.57:0/1552723404 >> 172.21.15.57:0/1552723404 conn(0x7f33a005f670 msgr2=0x7f33a01499c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:13.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 -- 172.21.15.57:0/1552723404 shutdown_connections 2021-06-25T04:51:13.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.863+0000 7f33a51e2700 1 -- 172.21.15.57:0/1552723404 wait complete. 2021-06-25T04:51:13.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:51:13.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f3449538700 1 Processor -- start 2021-06-25T04:51:13.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f3449538700 1 -- start start 2021-06-25T04:51:13.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f3449538700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34440b27e0 0x7f34440afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:13.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f3449538700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34440b1790 con 0x7f34440b13b0 2021-06-25T04:51:13.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f3449538700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34440b32b0 con 0x7f34440adee0 2021-06-25T04:51:13.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f3449538700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344414bd40 con 0x7f34440b27e0 2021-06-25T04:51:13.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f3442ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f34440b13b0 0x7f344414b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55306/0 (socket says 172.21.15.57:55306) 2021-06-25T04:51:13.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f3442ffd700 1 -- 172.21.15.57:0/3585827878 learned_addr learned my addr 172.21.15.57:0/3585827878 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34437fe700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34440b27e0 0x7f34440afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924558529 0 0) 0x7f34440b1790 con 0x7f34440b13b0 2021-06-25T04:51:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3424003260 con 0x7f34440b13b0 2021-06-25T04:51:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2607534441 0 0) 0x7f3424003260 con 0x7f34440b13b0 2021-06-25T04:51:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34440b27e0 msgr2=0x7f34440afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:13.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34440b27e0 0x7f34440afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:13.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 >> v1:172.21.15.87:6789/0 conn(0x7f34440adee0 legacy=0x7f34440af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:13.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34440b3550 con 0x7f34440b13b0 2021-06-25T04:51:13.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f3434001660 con 0x7f34440b13b0 2021-06-25T04:51:14.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 >> v1:172.21.15.57:6789/0 conn(0x7f34440b13b0 legacy=0x7f344414b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34440b27e0 0x7f3424003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3424003cb0 0x7f3424004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34240049f0 0x7f3424004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344414bd40 con 0x7f3424003cb0 2021-06-25T04:51:14.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342400b800 con 0x7f34240049f0 2021-06-25T04:51:14.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342400b9c0 con 0x7f34440b27e0 2021-06-25T04:51:14.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f343a7fc700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3424003cb0 0x7f3424004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f3442ffd700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34440b27e0 0x7f3424003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f34437fe700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34240049f0 0x7f3424004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f343a7fc700 1 -- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34440b27e0 msgr2=0x7f3424003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:14.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f343a7fc700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34440b27e0 0x7f3424003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f343a7fc700 1 -- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34240049f0 msgr2=0x7f3424004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:14.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f343a7fc700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34240049f0 0x7f3424004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.987+0000 7f343a7fc700 1 -- 172.21.15.57:0/3585827878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424003260 con 0x7f3424003cb0 2021-06-25T04:51:14.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f3442ffd700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34440b27e0 0x7f3424003780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:14.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f343a7fc700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3424003cb0 0x7f3424004500 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f344405cef0 tx=0x7f342c007a00).ready entity=mon.0 client_cookie=23e93085353cbd94 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f342c007d10 con 0x7f3424003cb0 2021-06-25T04:51:14.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c007030 con 0x7f3424003cb0 2021-06-25T04:51:14.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f34427fc700 1 -- 172.21.15.57:0/3585827878 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f342c007390 con 0x7f3424003cb0 2021-06-25T04:51:14.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f3449538700 1 -- 172.21.15.57:0/3585827878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3424003cb0 msgr2=0x7f3424004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f3449538700 1 --2- 172.21.15.57:0/3585827878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3424003cb0 0x7f3424004500 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f344405cef0 tx=0x7f342c007a00).stop 2021-06-25T04:51:14.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f34437fe700 1 -- 172.21.15.57:0/3585827878 reap_dead start 2021-06-25T04:51:14.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f3449538700 1 -- 172.21.15.57:0/3585827878 shutdown_connections 2021-06-25T04:51:14.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f3449538700 1 -- 172.21.15.57:0/3585827878 >> 172.21.15.57:0/3585827878 conn(0x7f3444060780 msgr2=0x7f3444060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:14.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f3449538700 1 -- 172.21.15.57:0/3585827878 shutdown_connections 2021-06-25T04:51:14.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f3449538700 1 -- 172.21.15.57:0/3585827878 wait complete. 2021-06-25T04:51:14.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f3449538700 1 Processor -- start 2021-06-25T04:51:14.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.991+0000 7f3449538700 1 -- start start 2021-06-25T04:51:14.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3449538700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3444065af0 0x7f34440662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3449538700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3444067010 0x7f34440a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3449538700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34440a09a0 0x7f34440a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3449538700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3444065ed0 con 0x7f3444067010 2021-06-25T04:51:14.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3449538700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3444159dc0 con 0x7f34440a09a0 2021-06-25T04:51:14.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3449538700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344414e630 con 0x7f3444065af0 2021-06-25T04:51:14.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f343a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3444067010 0x7f34440a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f343a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3444067010 0x7f34440a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38102/0 (socket says 172.21.15.57:38102) 2021-06-25T04:51:14.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f343a7fc700 1 -- 172.21.15.57:0/1676033165 learned_addr learned my addr 172.21.15.57:0/1676033165 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:14.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3442ffd700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3444065af0 0x7f34440662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f34437fe700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34440a09a0 0x7f34440a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f343a7fc700 1 -- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3444065af0 msgr2=0x7f34440662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f343a7fc700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3444065af0 0x7f34440662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f343a7fc700 1 -- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34440a09a0 msgr2=0x7f34440a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f343a7fc700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34440a09a0 0x7f34440a93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f343a7fc700 1 -- 172.21.15.57:0/1676033165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3444067590 con 0x7f3444067010 2021-06-25T04:51:14.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f343a7fc700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3444067010 0x7f34440a04b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f344405cef0 tx=0x7f342c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3440ff9700 1 -- 172.21.15.57:0/1676033165 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f342c007430 con 0x7f3444067010 2021-06-25T04:51:14.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3440ff9700 1 -- 172.21.15.57:0/1676033165 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c006510 con 0x7f3444067010 2021-06-25T04:51:14.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3449538700 1 -- 172.21.15.57:0/1676033165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344414e890 con 0x7f3444067010 2021-06-25T04:51:14.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3449538700 1 -- 172.21.15.57:0/1676033165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344409f2f0 con 0x7f3444067010 2021-06-25T04:51:14.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.995+0000 7f3440ff9700 1 -- 172.21.15.57:0/1676033165 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f342c006870 con 0x7f3444067010 2021-06-25T04:51:14.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.999+0000 7f3449538700 1 -- 172.21.15.57:0/1676033165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3444057310 con 0x7f3444067010 2021-06-25T04:51:14.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.999+0000 7f3440ff9700 1 -- 172.21.15.57:0/1676033165 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f342c027070 con 0x7f3444067010 2021-06-25T04:51:14.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.999+0000 7f3440ff9700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f34280553d0 0x7f3428057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.999+0000 7f3440ff9700 1 -- 172.21.15.57:0/1676033165 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f342c06e980 con 0x7f3444067010 2021-06-25T04:51:14.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.999+0000 7f3442ffd700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f34280553d0 0x7f3428057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:13.999+0000 7f3442ffd700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f34280553d0 0x7f3428057890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f343400d000 tx=0x7f3434007040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.007+0000 7f3440ff9700 1 -- 172.21.15.57:0/1676033165 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f342c0449a0 con 0x7f3444067010 2021-06-25T04:51:14.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.135+0000 7f3449538700 1 -- 172.21.15.57:0/1676033165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3444044610 con 0x7f3444067010 2021-06-25T04:51:14.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.135+0000 7f3440ff9700 1 -- 172.21.15.57:0/1676033165 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7f342c047fc0 con 0x7f3444067010 2021-06-25T04:51:14.140 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:51:14.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 -- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f34280553d0 msgr2=0x7f3428057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f34280553d0 0x7f3428057890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f343400d000 tx=0x7f3434007040).stop 2021-06-25T04:51:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 -- 172.21.15.57:0/1676033165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3444067010 msgr2=0x7f34440a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3444067010 0x7f34440a04b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f344405cef0 tx=0x7f342c015000).stop 2021-06-25T04:51:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 -- 172.21.15.57:0/1676033165 shutdown_connections 2021-06-25T04:51:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f34280553d0 0x7f3428057890 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34440a09a0 0x7f34440a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3444067010 0x7f34440a04b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 --2- 172.21.15.57:0/1676033165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3444065af0 0x7f34440662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 -- 172.21.15.57:0/1676033165 >> 172.21.15.57:0/1676033165 conn(0x7f3444060780 msgr2=0x7f34440b6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 -- 172.21.15.57:0/1676033165 shutdown_connections 2021-06-25T04:51:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.139+0000 7f3449538700 1 -- 172.21.15.57:0/1676033165 wait complete. 2021-06-25T04:51:14.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:51:14.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e3fff700 1 Processor -- start 2021-06-25T04:51:14.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e3fff700 1 -- start start 2021-06-25T04:51:14.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1e4060160 0x7fe1e40b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e3fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e40aa460 con 0x7fe1e405c520 2021-06-25T04:51:14.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e3fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e405fb40 con 0x7fe1e40af380 2021-06-25T04:51:14.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e3fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40b1410 con 0x7fe1e4060160 2021-06-25T04:51:14.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e27fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1e4060160 0x7fe1e40b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e37fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe1e405c520 0x7fe1e40a8bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55330/0 (socket says 172.21.15.57:55330) 2021-06-25T04:51:14.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e27fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1e4060160 0x7fe1e40b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38110/0 (socket says 172.21.15.57:38110) 2021-06-25T04:51:14.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e37fe700 1 -- 172.21.15.57:0/1807580911 learned_addr learned my addr 172.21.15.57:0/1807580911 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:14.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e27fc700 1 -- 172.21.15.57:0/1807580911 >> v1:172.21.15.87:6789/0 conn(0x7fe1e40af380 legacy=0x7fe1e4144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e27fc700 1 -- 172.21.15.57:0/1807580911 >> v1:172.21.15.57:6789/0 conn(0x7fe1e405c520 legacy=0x7fe1e40a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e1ffb700 1 -- 172.21.15.57:0/1807580911 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615598501 0 0) 0x7fe1e40aa460 con 0x7fe1e405c520 2021-06-25T04:51:14.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.263+0000 7fe1e27fc700 1 -- 172.21.15.57:0/1807580911 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e405f670 con 0x7fe1e4060160 2021-06-25T04:51:14.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e27fc700 1 --2- 172.21.15.57:0/1807580911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e4060160 0x7fe1e40b0c70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fe1cc002f70 tx=0x7fe1cc006df0).ready entity=mon.0 client_cookie=e6af149c462b87da server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e1ffb700 1 -- 172.21.15.57:0/1807580911 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1cc00d610 con 0x7fe1e4060160 2021-06-25T04:51:14.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e1ffb700 1 -- 172.21.15.57:0/1807580911 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc000e90 con 0x7fe1e4060160 2021-06-25T04:51:14.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e1ffb700 1 -- 172.21.15.57:0/1807580911 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1cc00d960 con 0x7fe1e4060160 2021-06-25T04:51:14.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 -- 172.21.15.57:0/1807580911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e4060160 msgr2=0x7fe1e40b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 --2- 172.21.15.57:0/1807580911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e4060160 0x7fe1e40b0c70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fe1cc002f70 tx=0x7fe1cc006df0).stop 2021-06-25T04:51:14.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 -- 172.21.15.57:0/1807580911 shutdown_connections 2021-06-25T04:51:14.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 --2- 172.21.15.57:0/1807580911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e4060160 0x7fe1e40b0c70 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 -- 172.21.15.57:0/1807580911 >> 172.21.15.57:0/1807580911 conn(0x7fe1e4061100 msgr2=0x7fe1e4062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:14.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 -- 172.21.15.57:0/1807580911 shutdown_connections 2021-06-25T04:51:14.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 -- 172.21.15.57:0/1807580911 wait complete. 2021-06-25T04:51:14.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 Processor -- start 2021-06-25T04:51:14.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 -- start start 2021-06-25T04:51:14.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1e405c520 0x7fe1e4142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e4060160 0x7fe1e40adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1e40af380 0x7fe1e4147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40acfd0 con 0x7fe1e4060160 2021-06-25T04:51:14.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40ae0e0 con 0x7fe1e405c520 2021-06-25T04:51:14.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e3fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4142580 con 0x7fe1e40af380 2021-06-25T04:51:14.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e4060160 0x7fe1e40adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e4060160 0x7fe1e40adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38118/0 (socket says 172.21.15.57:38118) 2021-06-25T04:51:14.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e27fc700 1 -- 172.21.15.57:0/201205172 learned_addr learned my addr 172.21.15.57:0/201205172 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:14.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e37fe700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1e40af380 0x7fe1e4147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.267+0000 7fe1e2ffd700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1e405c520 0x7fe1e4142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e27fc700 1 -- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1e40af380 msgr2=0x7fe1e4147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e27fc700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1e40af380 0x7fe1e4147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e27fc700 1 -- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1e405c520 msgr2=0x7fe1e4142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e27fc700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1e405c520 0x7fe1e4142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e27fc700 1 -- 172.21.15.57:0/201205172 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc00b180 con 0x7fe1e4060160 2021-06-25T04:51:14.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e37fe700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1e40af380 0x7fe1e4147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:14.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e2ffd700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1e405c520 0x7fe1e4142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:14.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e27fc700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e4060160 0x7fe1e40adbf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fe1cc002f70 tx=0x7fe1cc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1dbfff700 1 -- 172.21.15.57:0/201205172 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1cc00de90 con 0x7fe1e4060160 2021-06-25T04:51:14.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e3fff700 1 -- 172.21.15.57:0/201205172 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e4142820 con 0x7fe1e4060160 2021-06-25T04:51:14.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1dbfff700 1 -- 172.21.15.57:0/201205172 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc000e90 con 0x7fe1e4060160 2021-06-25T04:51:14.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e3fff700 1 -- 172.21.15.57:0/201205172 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e4152d40 con 0x7fe1e4060160 2021-06-25T04:51:14.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1dbfff700 1 -- 172.21.15.57:0/201205172 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1cc01e440 con 0x7fe1e4060160 2021-06-25T04:51:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e3fff700 1 -- 172.21.15.57:0/201205172 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e4057310 con 0x7fe1e4060160 2021-06-25T04:51:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1dbfff700 1 -- 172.21.15.57:0/201205172 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe1cc024020 con 0x7fe1e4060160 2021-06-25T04:51:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1dbfff700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1c80553f0 0x7fe1c80578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1dbfff700 1 -- 172.21.15.57:0/201205172 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe1cc06ef60 con 0x7fe1e4060160 2021-06-25T04:51:14.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.271+0000 7fe1e2ffd700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1c80553f0 0x7fe1c80578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.275+0000 7fe1e2ffd700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1c80553f0 0x7fe1c80578b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe1d400b000 tx=0x7fe1d4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.275+0000 7fe1dbfff700 1 -- 172.21.15.57:0/201205172 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe1cc045070 con 0x7fe1e4060160 2021-06-25T04:51:14.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.403+0000 7fe1e3fff700 1 -- 172.21.15.57:0/201205172 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1e4057310 con 0x7fe1e4060160 2021-06-25T04:51:14.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.403+0000 7fe1dbfff700 1 -- 172.21.15.57:0/201205172 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe1cc048690 con 0x7fe1e4060160 2021-06-25T04:51:14.409 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:51:14.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 -- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1c80553f0 msgr2=0x7fe1c80578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1c80553f0 0x7fe1c80578b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe1d400b000 tx=0x7fe1d4009040).stop 2021-06-25T04:51:14.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 -- 172.21.15.57:0/201205172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e4060160 msgr2=0x7fe1e40adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e4060160 0x7fe1e40adbf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fe1cc002f70 tx=0x7fe1cc014000).stop 2021-06-25T04:51:14.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 -- 172.21.15.57:0/201205172 shutdown_connections 2021-06-25T04:51:14.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1c80553f0 0x7fe1c80578b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1e40af380 0x7fe1e4147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1e4060160 0x7fe1e40adbf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 --2- 172.21.15.57:0/201205172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1e405c520 0x7fe1e4142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 -- 172.21.15.57:0/201205172 >> 172.21.15.57:0/201205172 conn(0x7fe1e4061100 msgr2=0x7fe1e40b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:14.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 -- 172.21.15.57:0/201205172 shutdown_connections 2021-06-25T04:51:14.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.407+0000 7fe1e3fff700 1 -- 172.21.15.57:0/201205172 wait complete. 2021-06-25T04:51:14.430 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:51:14.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e7cd3a700 1 Processor -- start 2021-06-25T04:51:14.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e7cd3a700 1 -- start start 2021-06-25T04:51:14.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e7cd3a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1e780b26d0 0x7f1e781430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e7cd3a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e78061190 0x7f1e781435c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e7cd3a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e780648d0 con 0x7f1e7805ff20 2021-06-25T04:51:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e7cd3a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e78064b70 con 0x7f1e780b26d0 2021-06-25T04:51:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e7cd3a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78064e10 con 0x7f1e78061190 2021-06-25T04:51:14.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e6dd9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1e780b26d0 0x7f1e781430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e6dd9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1e780b26d0 0x7f1e781430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38124/0 (socket says 172.21.15.57:38124) 2021-06-25T04:51:14.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e6dd9b700 1 -- 172.21.15.57:0/1772960911 learned_addr learned my addr 172.21.15.57:0/1772960911 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:14.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e76d9d700 1 --2- 172.21.15.57:0/1772960911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e78061190 0x7f1e781435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e6dd9b700 1 -- 172.21.15.57:0/1772960911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e78061190 msgr2=0x7f1e781435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:14.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e6dd9b700 1 --2- 172.21.15.57:0/1772960911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e78061190 0x7f1e781435c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e6dd9b700 1 -- 172.21.15.57:0/1772960911 >> v1:172.21.15.87:6789/0 conn(0x7f1e7805ff20 legacy=0x7f1e78140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e6dd9b700 1 -- 172.21.15.57:0/1772960911 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e780650b0 con 0x7f1e780b26d0 2021-06-25T04:51:14.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e6dd9b700 1 --2- 172.21.15.57:0/1772960911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e780b26d0 0x7f1e781430d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f1e60002f70 tx=0x7f1e60006eb0).ready entity=mon.0 client_cookie=a9ebfbec6023935a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e75d9b700 1 -- 172.21.15.57:0/1772960911 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e6000d5c0 con 0x7f1e780b26d0 2021-06-25T04:51:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e75d9b700 1 -- 172.21.15.57:0/1772960911 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e60000e90 con 0x7f1e780b26d0 2021-06-25T04:51:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e75d9b700 1 -- 172.21.15.57:0/1772960911 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e6000d950 con 0x7f1e780b26d0 2021-06-25T04:51:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/1772960911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e780b26d0 msgr2=0x7f1e781430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.539+0000 7f1e7cd3a700 1 --2- 172.21.15.57:0/1772960911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e780b26d0 0x7f1e781430d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f1e60002f70 tx=0x7f1e60006eb0).stop 2021-06-25T04:51:14.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/1772960911 shutdown_connections 2021-06-25T04:51:14.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 --2- 172.21.15.57:0/1772960911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e78061190 0x7f1e781435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 --2- 172.21.15.57:0/1772960911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e780b26d0 0x7f1e781430d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/1772960911 >> 172.21.15.57:0/1772960911 conn(0x7f1e7805cf20 msgr2=0x7f1e7805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:14.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/1772960911 shutdown_connections 2021-06-25T04:51:14.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/1772960911 wait complete. 2021-06-25T04:51:14.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 Processor -- start 2021-06-25T04:51:14.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 -- start start 2021-06-25T04:51:14.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e7805ff20 0x7f1e781520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e78061190 0x7f1e78066a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e780b26d0 0x7f1e780b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780af940 con 0x7f1e780b26d0 2021-06-25T04:51:14.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78156250 con 0x7f1e78061190 2021-06-25T04:51:14.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780adcb0 con 0x7f1e7805ff20 2021-06-25T04:51:14.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e76d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e780b26d0 0x7f1e780b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e76d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e780b26d0 0x7f1e780b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38132/0 (socket says 172.21.15.57:38132) 2021-06-25T04:51:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e76d9d700 1 -- 172.21.15.57:0/3580410889 learned_addr learned my addr 172.21.15.57:0/3580410889 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7659c700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e7805ff20 0x7f1e781520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e6dd9b700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e78061190 0x7f1e78066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e76d9d700 1 -- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e7805ff20 msgr2=0x7f1e781520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e76d9d700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e7805ff20 0x7f1e781520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e76d9d700 1 -- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e78061190 msgr2=0x7f1e78066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e76d9d700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e78061190 0x7f1e78066a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e76d9d700 1 -- 172.21.15.57:0/3580410889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6000b1e0 con 0x7f1e780b26d0 2021-06-25T04:51:14.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e76d9d700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e780b26d0 0x7f1e780b0340 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f1e7000a000 tx=0x7f1e70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e6ffff700 1 -- 172.21.15.57:0/3580410889 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7000c070 con 0x7f1e780b26d0 2021-06-25T04:51:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e6ffff700 1 -- 172.21.15.57:0/3580410889 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e700133f0 con 0x7f1e780b26d0 2021-06-25T04:51:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/3580410889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e780adf50 con 0x7f1e780b26d0 2021-06-25T04:51:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e6ffff700 1 -- 172.21.15.57:0/3580410889 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e70013750 con 0x7f1e780b26d0 2021-06-25T04:51:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.543+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/3580410889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e781564f0 con 0x7f1e780b26d0 2021-06-25T04:51:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.547+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/3580410889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e780ae0e0 con 0x7f1e780b26d0 2021-06-25T04:51:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.547+0000 7f1e6ffff700 1 -- 172.21.15.57:0/3580410889 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1e700138b0 con 0x7f1e780b26d0 2021-06-25T04:51:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.547+0000 7f1e6ffff700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1e5c0554e0 0x7f1e5c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.547+0000 7f1e6ffff700 1 -- 172.21.15.57:0/3580410889 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1e7006e540 con 0x7f1e780b26d0 2021-06-25T04:51:14.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.547+0000 7f1e7659c700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1e5c0554e0 0x7f1e5c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.547+0000 7f1e7659c700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1e5c0554e0 0x7f1e5c0579a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f1e6800d000 tx=0x7f1e68007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.555+0000 7f1e6ffff700 1 -- 172.21.15.57:0/3580410889 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1e700446f0 con 0x7f1e780b26d0 2021-06-25T04:51:14.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.679+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/3580410889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e78057310 con 0x7f1e780b26d0 2021-06-25T04:51:14.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.679+0000 7f1e6ffff700 1 -- 172.21.15.57:0/3580410889 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1e7000f040 con 0x7f1e780b26d0 2021-06-25T04:51:14.686 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:51:14.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1e5c0554e0 msgr2=0x7f1e5c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1e5c0554e0 0x7f1e5c0579a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f1e6800d000 tx=0x7f1e68007b90).stop 2021-06-25T04:51:14.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/3580410889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e780b26d0 msgr2=0x7f1e780b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e780b26d0 0x7f1e780b0340 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f1e7000a000 tx=0x7f1e70008040).stop 2021-06-25T04:51:14.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/3580410889 shutdown_connections 2021-06-25T04:51:14.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1e5c0554e0 0x7f1e5c0579a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e780b26d0 0x7f1e780b0340 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e78061190 0x7f1e78066a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 --2- 172.21.15.57:0/3580410889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e7805ff20 0x7f1e781520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/3580410889 >> 172.21.15.57:0/3580410889 conn(0x7f1e7805cf20 msgr2=0x7f1e78065470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:14.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/3580410889 shutdown_connections 2021-06-25T04:51:14.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.683+0000 7f1e7cd3a700 1 -- 172.21.15.57:0/3580410889 wait complete. 2021-06-25T04:51:14.699 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:51:14.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:51:14.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.795+0000 7f827a2d1700 1 Processor -- start 2021-06-25T04:51:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.795+0000 7f827a2d1700 1 -- start start 2021-06-25T04:51:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82740a7670 0x7f8274066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82740b1930 0x7f8274066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8274067410 con 0x7f82740b0020 2021-06-25T04:51:14.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82740a7a50 con 0x7f82740b1930 2021-06-25T04:51:14.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82741475e0 con 0x7f82740a7670 2021-06-25T04:51:14.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f8273fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82740a7670 0x7f8274066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f82737fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82740b1930 0x7f8274066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f82737fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82740b1930 0x7f8274066f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:46630/0 (socket says 172.21.15.57:46630) 2021-06-25T04:51:14.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f82737fe700 1 -- 172.21.15.57:0/686282216 learned_addr learned my addr 172.21.15.57:0/686282216 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:14.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f82737fe700 1 -- 172.21.15.57:0/686282216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82740a7670 msgr2=0x7f8274066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:14.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f82737fe700 1 --2- 172.21.15.57:0/686282216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82740a7670 0x7f8274066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f82737fe700 1 -- 172.21.15.57:0/686282216 >> v1:172.21.15.87:6789/0 conn(0x7f82740b0020 legacy=0x7f827405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f82737fe700 1 -- 172.21.15.57:0/686282216 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274147880 con 0x7f82740b1930 2021-06-25T04:51:14.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f82737fe700 1 --2- 172.21.15.57:0/686282216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82740b1930 0x7f8274066f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f8264002f70 tx=0x7f8264006eb0).ready entity=mon.1 client_cookie=e4f14a00a6a1629e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f8272ffd700 1 -- 172.21.15.57:0/686282216 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f826400d570 con 0x7f82740b1930 2021-06-25T04:51:14.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f8272ffd700 1 -- 172.21.15.57:0/686282216 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8264000e90 con 0x7f82740b1930 2021-06-25T04:51:14.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f8272ffd700 1 -- 172.21.15.57:0/686282216 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f826400d900 con 0x7f82740b1930 2021-06-25T04:51:14.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 -- 172.21.15.57:0/686282216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82740b1930 msgr2=0x7f8274066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 --2- 172.21.15.57:0/686282216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82740b1930 0x7f8274066f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f8264002f70 tx=0x7f8264006eb0).stop 2021-06-25T04:51:14.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 -- 172.21.15.57:0/686282216 shutdown_connections 2021-06-25T04:51:14.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 --2- 172.21.15.57:0/686282216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82740b1930 0x7f8274066f20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 --2- 172.21.15.57:0/686282216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82740a7670 0x7f8274066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 -- 172.21.15.57:0/686282216 >> 172.21.15.57:0/686282216 conn(0x7f82740b53a0 msgr2=0x7f82740b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:14.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 -- 172.21.15.57:0/686282216 shutdown_connections 2021-06-25T04:51:14.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.799+0000 7f827a2d1700 1 -- 172.21.15.57:0/686282216 wait complete. 2021-06-25T04:51:14.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f827a2d1700 1 Processor -- start 2021-06-25T04:51:14.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f827a2d1700 1 -- start start 2021-06-25T04:51:14.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f827a2d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82740a7670 0x7f82740af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f827a2d1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82740b0020 0x7f8274146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f827a2d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82740b1930 0x7f8274156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f827a2d1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82740abc50 con 0x7f82740a7670 2021-06-25T04:51:14.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f827a2d1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827415a8a0 con 0x7f82740b1930 2021-06-25T04:51:14.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f827a2d1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82740abe80 con 0x7f82740b0020 2021-06-25T04:51:14.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f8273fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82740a7670 0x7f82740af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f82737fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82740b0020 0x7f8274146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f827886e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82740b1930 0x7f8274156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f8273fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82740a7670 0x7f82740af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38144/0 (socket says 172.21.15.57:38144) 2021-06-25T04:51:14.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.803+0000 7f8273fff700 1 -- 172.21.15.57:0/770789599 learned_addr learned my addr 172.21.15.57:0/770789599 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:14.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82737fe700 1 -- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82740b1930 msgr2=0x7f8274156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82737fe700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82740b1930 0x7f8274156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82737fe700 1 -- 172.21.15.57:0/770789599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82740a7670 msgr2=0x7f82740af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82737fe700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82740a7670 0x7f82740af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82737fe700 1 -- 172.21.15.57:0/770789599 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826400b1e0 con 0x7f82740b0020 2021-06-25T04:51:14.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82737fe700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82740b0020 0x7f8274146be0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8264002f70 tx=0x7f8264015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82717fa700 1 -- 172.21.15.57:0/770789599 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82640118a0 con 0x7f82740b0020 2021-06-25T04:51:14.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82717fa700 1 -- 172.21.15.57:0/770789599 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8264000e90 con 0x7f82740b0020 2021-06-25T04:51:14.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f827a2d1700 1 -- 172.21.15.57:0/770789599 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827415a360 con 0x7f82740b0020 2021-06-25T04:51:14.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82717fa700 1 -- 172.21.15.57:0/770789599 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8264011a40 con 0x7f82740b0020 2021-06-25T04:51:14.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f827a2d1700 1 -- 172.21.15.57:0/770789599 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82740ad760 con 0x7f82740b0020 2021-06-25T04:51:14.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f827a2d1700 1 -- 172.21.15.57:0/770789599 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8274057310 con 0x7f82740b0020 2021-06-25T04:51:14.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82717fa700 1 -- 172.21.15.57:0/770789599 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8264023030 con 0x7f82740b0020 2021-06-25T04:51:14.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82717fa700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8254055510 0x7f82540579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:14.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f82717fa700 1 -- 172.21.15.57:0/770789599 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f826406e890 con 0x7f82740b0020 2021-06-25T04:51:14.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.807+0000 7f8273fff700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8254055510 0x7f82540579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:14.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.811+0000 7f8273fff700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8254055510 0x7f82540579d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f826800b000 tx=0x7f8268006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:14.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.819+0000 7f82717fa700 1 -- 172.21.15.57:0/770789599 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8264044a40 con 0x7f82740b0020 2021-06-25T04:51:14.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.987+0000 7f827a2d1700 1 -- 172.21.15.57:0/770789599 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82740aef80 con 0x7f82740b0020 2021-06-25T04:51:14.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.987+0000 7f82717fa700 1 -- 172.21.15.57:0/770789599 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f8264048060 con 0x7f82740b0020 2021-06-25T04:51:14.994 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:14.994 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/289042329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":289042329},{"type":"v1","addr":"172.21.15.87:6835","nonce":289042329}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/824739091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":824739091},{"type":"v1","addr":"172.21.15.57:6833","nonce":824739091}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:51:09.583588+0000","modified":"2021-06-25T04:51:11.349725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3353139901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3353139901},{"type":"v1","addr":"172.21.15.57:6835","nonce":3353139901}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-06-25T04:51:14.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 -- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8254055510 msgr2=0x7f82540579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8254055510 0x7f82540579d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f826800b000 tx=0x7f8268006df0).stop 2021-06-25T04:51:14.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 -- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82740b0020 msgr2=0x7f8274146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:14.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82740b0020 0x7f8274146be0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8264002f70 tx=0x7f8264015000).stop 2021-06-25T04:51:14.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 -- 172.21.15.57:0/770789599 shutdown_connections 2021-06-25T04:51:14.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8254055510 0x7f82540579d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:14.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82740b1930 0x7f8274156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:15.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82740b0020 0x7f8274146be0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:15.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 --2- 172.21.15.57:0/770789599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82740a7670 0x7f82740af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:15.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 -- 172.21.15.57:0/770789599 >> 172.21.15.57:0/770789599 conn(0x7f82740b53a0 msgr2=0x7f82741489c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:15.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 -- 172.21.15.57:0/770789599 shutdown_connections 2021-06-25T04:51:15.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:14.991+0000 7f827a2d1700 1 -- 172.21.15.57:0/770789599 wait complete. 2021-06-25T04:51:15.003 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2021-06-25T04:51:15.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:51:09.583588+0000', 'modified': '2021-06-25T04:51:11.349725+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5634': {'gid': 5634, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/3353139901', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 3353139901}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3353139901}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:51:15.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:51:15.317 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:51:15.434 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":5634,"want_state":"up:active","state":"up:active","rank_uptime":5.8369559029999998,"mdsmap_epoch":25,"osdmap_epoch":56,"osdmap_epoch_barrier":56,"uptime":10.124877246} 2021-06-25T04:51:15.435 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 5634, "mdsmap_epoch": 25, "osdmap_epoch": 56, "osdmap_epoch_barrier": 56, "rank_uptime": 5.836955903, "state": "up:active", "uptime": 10.124877246, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:51:15.435 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:51:15.436 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:51:15.436 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:51:15.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:15.437 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:15.446 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:51:15.461 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:51:15.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:51:15.520 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:51:15.521 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:51:15.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:15.523 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:51:15.530 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:51:15.531 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:15.534 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:51:15.556 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:51:15.557 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:51:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:51:15.570 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:51:15.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:15.572 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:51:15.608 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:51:15.614+0000 7f4940047080 -1 init, newargv = 0x55f81bbed4c0 newargc=9ceph-fuse[14716]: starting ceph client 2021-06-25T04:51:15.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr: 2021-06-25T04:51:15.618 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14716]: starting fuse 2021-06-25T04:51:16.715 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:51:16.734 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:51:16.735 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:51:16.790 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:51:16.791 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:51:16.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:16.793 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:51:16.799 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:51:16.800 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:51:16.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:16.800 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:51:16.801 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:51:16.801 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:51:16.802 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:51:16.802 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:51:16.803 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:51:16.803 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:51:16.804 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:51:16.804 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:51:16.804 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:51:16.805 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:51:16.806 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:51:16.806 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:51:16.807 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:51:16.807 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:51:16.807 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:51:16.808 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:51:16.808 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:51:16.809 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:51:16.809 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:51:16.810 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:51:16.810 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:51:16.810 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:51:16.855 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.14716.asok 2021-06-25T04:51:16.861 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14716.asok 2021-06-25T04:51:16.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:16.862 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14716.asok status 2021-06-25T04:51:16.998 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:51:16.999 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:51:16.999 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:51:16.999 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:51:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:51:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:51:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:51:17.000 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "14716", 2021-06-25T04:51:17.001 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:51:17.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:51:17.002 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:51:17.002 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:51:17.002 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 5701, 2021-06-25T04:51:17.002 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:51:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:51:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:51:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 5701 2021-06-25T04:51:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:51:17.003 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:51:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:51:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:51:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 452699985 2021-06-25T04:51:17.004 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:51:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:51:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:51:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:51:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:51:17.005 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 452699985 2021-06-25T04:51:17.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:51:17.006 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.5701 172.21.15.102:0/452699985", 2021-06-25T04:51:17.006 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/452699985", 2021-06-25T04:51:17.006 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:51:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 25, 2021-06-25T04:51:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 56, 2021-06-25T04:51:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:51:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:51:17.007 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:51:17.008 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:51:17.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:17.010 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:51:17.010 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:17.017 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:51:17.018 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:51:17.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:17.019 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:17.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:17.080 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:51:17.080 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:17.088 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:51:17.089 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:51:17.089 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-06-25T04:51:17.090 DEBUG:teuthology.orchestra.run.smithi102:> import sys 2021-06-25T04:51:17.090 DEBUG:teuthology.orchestra.run.smithi102:> import time 2021-06-25T04:51:17.091 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:51:17.091 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:51:17.092 DEBUG:teuthology.orchestra.run.smithi102:> n = 1000 2021-06-25T04:51:17.092 DEBUG:teuthology.orchestra.run.smithi102:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-06-25T04:51:17.092 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:51:17.093 DEBUG:teuthology.orchestra.run.smithi102:> if not os.path.exists(os.path.dirname(abs_path)): 2021-06-25T04:51:17.094 DEBUG:teuthology.orchestra.run.smithi102:> os.makedirs(os.path.dirname(abs_path)) 2021-06-25T04:51:17.094 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:51:17.095 DEBUG:teuthology.orchestra.run.smithi102:> for i in range(0, n): 2021-06-25T04:51:17.096 DEBUG:teuthology.orchestra.run.smithi102:> fname = "{0}_{1}".format(abs_path, i) 2021-06-25T04:51:17.096 DEBUG:teuthology.orchestra.run.smithi102:> with open(fname, '"'"'w'"'"') as f: 2021-06-25T04:51:17.097 DEBUG:teuthology.orchestra.run.smithi102:> f.write('"'"'content'"'"') 2021-06-25T04:51:17.097 DEBUG:teuthology.orchestra.run.smithi102:> if True: 2021-06-25T04:51:17.097 DEBUG:teuthology.orchestra.run.smithi102:> f.flush() 2021-06-25T04:51:17.098 DEBUG:teuthology.orchestra.run.smithi102:> os.fsync(f.fileno()) 2021-06-25T04:51:17.098 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:51:28.380 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:51:28.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbef283700 1 Processor -- start 2021-06-25T04:51:28.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbef283700 1 -- start start 2021-06-25T04:51:28.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbef283700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcbe80b3200 0x7fcbe8066640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:28.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbef283700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbe80b0e30 0x7fcbe8066b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbef283700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe80b35e0 con 0x7fcbe80b1800 2021-06-25T04:51:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbef283700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe81436b0 con 0x7fcbe80b3200 2021-06-25T04:51:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbef283700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8065c60 con 0x7fcbe80b0e30 2021-06-25T04:51:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbed01f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcbe80b3200 0x7fcbe8066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:28.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbed01f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcbe80b3200 0x7fcbe8066640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38150/0 (socket says 172.21.15.57:38150) 2021-06-25T04:51:28.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbed01f700 1 -- 172.21.15.57:0/2694793739 learned_addr learned my addr 172.21.15.57:0/2694793739 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:28.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbed820700 1 --2- 172.21.15.57:0/2694793739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbe80b0e30 0x7fcbe8066b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbed01f700 1 -- 172.21.15.57:0/2694793739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbe80b0e30 msgr2=0x7fcbe8066b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbed01f700 1 --2- 172.21.15.57:0/2694793739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbe80b0e30 0x7fcbe8066b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbed01f700 1 -- 172.21.15.57:0/2694793739 >> v1:172.21.15.87:6789/0 conn(0x7fcbe80b1800 legacy=0x7fcbe8142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbed01f700 1 -- 172.21.15.57:0/2694793739 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe8065f00 con 0x7fcbe80b3200 2021-06-25T04:51:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbdffff700 1 -- 172.21.15.57:0/2694793739 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892240639 0 0) 0x7fcbe80b35e0 con 0x7fcbe80b1800 2021-06-25T04:51:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbed01f700 1 --2- 172.21.15.57:0/2694793739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80b3200 0x7fcbe8066640 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fcbe4002f70 tx=0x7fcbe4006f40).ready entity=mon.0 client_cookie=7103ce9d9dd60e32 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbdffff700 1 -- 172.21.15.57:0/2694793739 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe400da80 con 0x7fcbe80b3200 2021-06-25T04:51:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbdffff700 1 -- 172.21.15.57:0/2694793739 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe4000e90 con 0x7fcbe80b3200 2021-06-25T04:51:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbdffff700 1 -- 172.21.15.57:0/2694793739 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe400ddd0 con 0x7fcbe80b3200 2021-06-25T04:51:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbef283700 1 -- 172.21.15.57:0/2694793739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80b3200 msgr2=0x7fcbe8066640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.487+0000 7fcbef283700 1 --2- 172.21.15.57:0/2694793739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80b3200 0x7fcbe8066640 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fcbe4002f70 tx=0x7fcbe4006f40).stop 2021-06-25T04:51:28.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.491+0000 7fcbef283700 1 -- 172.21.15.57:0/2694793739 shutdown_connections 2021-06-25T04:51:28.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.491+0000 7fcbef283700 1 --2- 172.21.15.57:0/2694793739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbe80b0e30 0x7fcbe8066b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.491+0000 7fcbef283700 1 --2- 172.21.15.57:0/2694793739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80b3200 0x7fcbe8066640 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.491+0000 7fcbef283700 1 -- 172.21.15.57:0/2694793739 >> 172.21.15.57:0/2694793739 conn(0x7fcbe805c450 msgr2=0x7fcbe805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:28.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.491+0000 7fcbef283700 1 -- 172.21.15.57:0/2694793739 shutdown_connections 2021-06-25T04:51:28.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.491+0000 7fcbef283700 1 -- 172.21.15.57:0/2694793739 wait complete. 2021-06-25T04:51:28.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.491+0000 7fcbef283700 1 Processor -- start 2021-06-25T04:51:28.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.491+0000 7fcbef283700 1 -- start start 2021-06-25T04:51:28.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbef283700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbe80b0e30 0x7fcbe814e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:28.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbef283700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe80b1800 0x7fcbe80afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:28.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbef283700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80b3200 0x7fcbe80a95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:28.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbef283700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe809e870 con 0x7fcbe80b3200 2021-06-25T04:51:28.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbef283700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe814ed70 con 0x7fcbe80b1800 2021-06-25T04:51:28.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbef283700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe809ead0 con 0x7fcbe80b0e30 2021-06-25T04:51:28.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbed820700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80b3200 0x7fcbe80a95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:28.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbed820700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80b3200 0x7fcbe80a95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38160/0 (socket says 172.21.15.57:38160) 2021-06-25T04:51:28.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbed820700 1 -- 172.21.15.57:0/154991302 learned_addr learned my addr 172.21.15.57:0/154991302 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:28.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbed01f700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbe80b0e30 0x7fcbe814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:28.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbec81e700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe80b1800 0x7fcbe80afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:28.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbed820700 1 -- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbe80b0e30 msgr2=0x7fcbe814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:28.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbed820700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbe80b0e30 0x7fcbe814e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbed820700 1 -- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe80b1800 msgr2=0x7fcbe80afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:28.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbed820700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe80b1800 0x7fcbe80afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbed820700 1 -- 172.21.15.57:0/154991302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe400b460 con 0x7fcbe80b3200 2021-06-25T04:51:28.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbec81e700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe80b1800 0x7fcbe80afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:28.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbed820700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80b3200 0x7fcbe80a95d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fcbe000c000 tx=0x7fcbe0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:28.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbde7fc700 1 -- 172.21.15.57:0/154991302 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe0010780 con 0x7fcbe80b3200 2021-06-25T04:51:28.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbde7fc700 1 -- 172.21.15.57:0/154991302 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe00108e0 con 0x7fcbe80b3200 2021-06-25T04:51:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbef283700 1 -- 172.21.15.57:0/154991302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe809ed70 con 0x7fcbe80b3200 2021-06-25T04:51:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbde7fc700 1 -- 172.21.15.57:0/154991302 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe0010c40 con 0x7fcbe80b3200 2021-06-25T04:51:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbef283700 1 -- 172.21.15.57:0/154991302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe80aa840 con 0x7fcbe80b3200 2021-06-25T04:51:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbef283700 1 -- 172.21.15.57:0/154991302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe80aa9d0 con 0x7fcbe80b3200 2021-06-25T04:51:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.495+0000 7fcbde7fc700 1 -- 172.21.15.57:0/154991302 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcbe001c460 con 0x7fcbe80b3200 2021-06-25T04:51:28.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.499+0000 7fcbde7fc700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbc8055450 0x7fcbc8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:28.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.499+0000 7fcbde7fc700 1 -- 172.21.15.57:0/154991302 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcbe006e400 con 0x7fcbe80b3200 2021-06-25T04:51:28.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.499+0000 7fcbed01f700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbc8055450 0x7fcbc8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:28.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.499+0000 7fcbed01f700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbc8055450 0x7fcbc8057910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fcbe401d000 tx=0x7fcbe4006f40).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:28.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.503+0000 7fcbde7fc700 1 -- 172.21.15.57:0/154991302 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcbe0044480 con 0x7fcbe80b3200 2021-06-25T04:51:28.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 -- 172.21.15.57:0/154991302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbe8057310 con 0x7fcbe80b3200 2021-06-25T04:51:28.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbde7fc700 1 -- 172.21.15.57:0/154991302 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2486 (secure 0 0 0) 0x7fcbe0047aa0 con 0x7fcbe80b3200 2021-06-25T04:51:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:28.676 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/289042329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":289042329},{"type":"v1","addr":"172.21.15.87:6835","nonce":289042329}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/824739091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":824739091},{"type":"v1","addr":"172.21.15.57:6833","nonce":824739091}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:51:09.583588+0000","modified":"2021-06-25T04:51:11.349725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3353139901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3353139901},{"type":"v1","addr":"172.21.15.57:6835","nonce":3353139901}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-06-25T04:51:28.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 -- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbc8055450 msgr2=0x7fcbc8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:28.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbc8055450 0x7fcbc8057910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fcbe401d000 tx=0x7fcbe4006f40).stop 2021-06-25T04:51:28.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 -- 172.21.15.57:0/154991302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80b3200 msgr2=0x7fcbe80a95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:28.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80b3200 0x7fcbe80a95d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fcbe000c000 tx=0x7fcbe0006df0).stop 2021-06-25T04:51:28.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 -- 172.21.15.57:0/154991302 shutdown_connections 2021-06-25T04:51:28.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbc8055450 0x7fcbc8057910 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbe80b3200 0x7fcbe80a95d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe80b1800 0x7fcbe80afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 --2- 172.21.15.57:0/154991302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbe80b0e30 0x7fcbe814e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 -- 172.21.15.57:0/154991302 >> 172.21.15.57:0/154991302 conn(0x7fcbe805c450 msgr2=0x7fcbe81415c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:28.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 -- 172.21.15.57:0/154991302 shutdown_connections 2021-06-25T04:51:28.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.671+0000 7fcbef283700 1 -- 172.21.15.57:0/154991302 wait complete. 2021-06-25T04:51:28.681 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2021-06-25T04:51:28.689 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-06-25T04:51:28.787 INFO:teuthology.orchestra.run.smithi057.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-06-25T04:51:28.787 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-06-25T04:51:28.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:51:28.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7e68e8700 1 Processor -- start 2021-06-25T04:51:28.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7e68e8700 1 -- start start 2021-06-25T04:51:28.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7e68e8700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa7e00b77d0 0x7fa7e0144560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:28.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7e68e8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e00b3190 con 0x7fa7e0144a50 2021-06-25T04:51:28.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7e68e8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e00b7bb0 con 0x7fa7e00b1130 2021-06-25T04:51:28.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7e68e8700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e0144ee0 con 0x7fa7e00b77d0 2021-06-25T04:51:28.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7e4e85700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa7e0144a50 0x7fa7e0064f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55386/0 (socket says 172.21.15.57:55386) 2021-06-25T04:51:28.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7e4e85700 1 -- 172.21.15.57:0/4253966028 learned_addr learned my addr 172.21.15.57:0/4253966028 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:28.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7dffff700 1 --2- 172.21.15.57:0/4253966028 >> v2:172.21.15.87:3300/0 conn(0x7fa7e00b77d0 0x7fa7e0144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:28.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7df7fe700 1 -- 172.21.15.57:0/4253966028 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715458328 0 0) 0x7fa7e00b3190 con 0x7fa7e0144a50 2021-06-25T04:51:28.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7dffff700 1 -- 172.21.15.57:0/4253966028 >> v1:172.21.15.87:6789/0 conn(0x7fa7e00b1130 legacy=0x7fa7e0064830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:28.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7dffff700 1 -- 172.21.15.57:0/4253966028 >> v1:172.21.15.57:6789/0 conn(0x7fa7e0144a50 legacy=0x7fa7e0064f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:28.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7dffff700 1 -- 172.21.15.57:0/4253966028 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0067580 con 0x7fa7e00b77d0 2021-06-25T04:51:28.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7dffff700 1 --2- 172.21.15.57:0/4253966028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e00b77d0 0x7fa7e0144560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fa7d0002f70 tx=0x7fa7d0006df0).ready entity=mon.1 client_cookie=c4369637a6a92c4c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:28.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7df7fe700 1 -- 172.21.15.57:0/4253966028 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7d000d610 con 0x7fa7e00b77d0 2021-06-25T04:51:28.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7df7fe700 1 -- 172.21.15.57:0/4253966028 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0000e90 con 0x7fa7e00b77d0 2021-06-25T04:51:28.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7df7fe700 1 -- 172.21.15.57:0/4253966028 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7d000d960 con 0x7fa7e00b77d0 2021-06-25T04:51:28.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7e68e8700 1 -- 172.21.15.57:0/4253966028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e00b77d0 msgr2=0x7fa7e0144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:28.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.887+0000 7fa7e68e8700 1 --2- 172.21.15.57:0/4253966028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e00b77d0 0x7fa7e0144560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fa7d0002f70 tx=0x7fa7d0006df0).stop 2021-06-25T04:51:28.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.891+0000 7fa7e68e8700 1 -- 172.21.15.57:0/4253966028 shutdown_connections 2021-06-25T04:51:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.891+0000 7fa7e68e8700 1 --2- 172.21.15.57:0/4253966028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e00b77d0 0x7fa7e0144560 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.891+0000 7fa7e68e8700 1 -- 172.21.15.57:0/4253966028 >> 172.21.15.57:0/4253966028 conn(0x7fa7e005f670 msgr2=0x7fa7e005fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.891+0000 7fa7e68e8700 1 -- 172.21.15.57:0/4253966028 shutdown_connections 2021-06-25T04:51:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.891+0000 7fa7e68e8700 1 -- 172.21.15.57:0/4253966028 wait complete. 2021-06-25T04:51:28.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.891+0000 7fa7e68e8700 1 Processor -- start 2021-06-25T04:51:28.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.891+0000 7fa7e68e8700 1 -- start start 2021-06-25T04:51:28.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7e68e8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7e00b1130 0x7fa7e00afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:28.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7e68e8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e00b77d0 0x7fa7e0060a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:28.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7e68e8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e0144a50 0x7fa7e0060f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:28.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7e68e8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e013eea0 con 0x7fa7e00b77d0 2021-06-25T04:51:28.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7e68e8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01407a0 con 0x7fa7e0144a50 2021-06-25T04:51:28.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7e68e8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e009ead0 con 0x7fa7e00b1130 2021-06-25T04:51:28.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7d7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e00b77d0 0x7fa7e0060a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:28.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7dffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7e00b1130 0x7fa7e00afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:28.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7d7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e00b77d0 0x7fa7e0060a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38172/0 (socket says 172.21.15.57:38172) 2021-06-25T04:51:28.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7d7fff700 1 -- 172.21.15.57:0/3846722913 learned_addr learned my addr 172.21.15.57:0/3846722913 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:28.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7e4e85700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e0144a50 0x7fa7e0060f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:28.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7d7fff700 1 -- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7e00b1130 msgr2=0x7fa7e00afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:28.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7d7fff700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7e00b1130 0x7fa7e00afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7d7fff700 1 -- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e0144a50 msgr2=0x7fa7e0060f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:28.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7d7fff700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e0144a50 0x7fa7e0060f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:28.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7d7fff700 1 -- 172.21.15.57:0/3846722913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d000b180 con 0x7fa7e00b77d0 2021-06-25T04:51:28.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7e4e85700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e0144a50 0x7fa7e0060f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:51:28.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7dffff700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7e00b1130 0x7fa7e00afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:51:28.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7d7fff700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e00b77d0 0x7fa7e0060a80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fa7e0060700 tx=0x7fa7c8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:28.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7ddffb700 1 -- 172.21.15.57:0/3846722913 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7c8007030 con 0x7fa7e00b77d0 2021-06-25T04:51:28.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7ddffb700 1 -- 172.21.15.57:0/3846722913 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c8007190 con 0x7fa7e00b77d0 2021-06-25T04:51:28.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7e68e8700 1 -- 172.21.15.57:0/3846722913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e009ed70 con 0x7fa7e00b77d0 2021-06-25T04:51:28.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7ddffb700 1 -- 172.21.15.57:0/3846722913 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7c8006510 con 0x7fa7e00b77d0 2021-06-25T04:51:28.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.895+0000 7fa7e68e8700 1 -- 172.21.15.57:0/3846722913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e01401b0 con 0x7fa7e00b77d0 2021-06-25T04:51:28.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.899+0000 7fa7e68e8700 1 -- 172.21.15.57:0/3846722913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e009ef00 con 0x7fa7e00b77d0 2021-06-25T04:51:28.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.899+0000 7fa7ddffb700 1 -- 172.21.15.57:0/3846722913 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa7c8010030 con 0x7fa7e00b77d0 2021-06-25T04:51:28.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.899+0000 7fa7ddffb700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7c40553d0 0x7fa7c4057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:28.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.899+0000 7fa7ddffb700 1 -- 172.21.15.57:0/3846722913 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa7c806daa0 con 0x7fa7e00b77d0 2021-06-25T04:51:28.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.899+0000 7fa7dffff700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7c40553d0 0x7fa7c4057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:28.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.899+0000 7fa7dffff700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7c40553d0 0x7fa7c4057890 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fa7d001b000 tx=0x7fa7d0015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:28.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:28.903+0000 7fa7ddffb700 1 -- 172.21.15.57:0/3846722913 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa7c8043c50 con 0x7fa7e00b77d0 2021-06-25T04:51:29.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.067+0000 7fa7e68e8700 1 -- 172.21.15.57:0/3846722913 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7e0057310 con 0x7fa7e00b77d0 2021-06-25T04:51:29.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.067+0000 7fa7ddffb700 1 -- 172.21.15.57:0/3846722913 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2486 (secure 0 0 0) 0x7fa7c8047270 con 0x7fa7e00b77d0 2021-06-25T04:51:29.073 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:29.073 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/289042329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":289042329},{"type":"v1","addr":"172.21.15.87:6835","nonce":289042329}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/824739091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":824739091},{"type":"v1","addr":"172.21.15.57:6833","nonce":824739091}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:51:09.583588+0000","modified":"2021-06-25T04:51:11.349725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3353139901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3353139901},{"type":"v1","addr":"172.21.15.57:6835","nonce":3353139901}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-06-25T04:51:29.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 -- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7c40553d0 msgr2=0x7fa7c4057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7c40553d0 0x7fa7c4057890 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fa7d001b000 tx=0x7fa7d0015000).stop 2021-06-25T04:51:29.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 -- 172.21.15.57:0/3846722913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e00b77d0 msgr2=0x7fa7e0060a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e00b77d0 0x7fa7e0060a80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fa7e0060700 tx=0x7fa7c8007c10).stop 2021-06-25T04:51:29.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 -- 172.21.15.57:0/3846722913 shutdown_connections 2021-06-25T04:51:29.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa7c40553d0 0x7fa7c4057890 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7e0144a50 0x7fa7e0060f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e00b77d0 0x7fa7e0060a80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 --2- 172.21.15.57:0/3846722913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7e00b1130 0x7fa7e00afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 -- 172.21.15.57:0/3846722913 >> 172.21.15.57:0/3846722913 conn(0x7fa7e005f670 msgr2=0x7fa7e0147890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:29.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 -- 172.21.15.57:0/3846722913 shutdown_connections 2021-06-25T04:51:29.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.071+0000 7fa7e68e8700 1 -- 172.21.15.57:0/3846722913 wait complete. 2021-06-25T04:51:29.078 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2021-06-25T04:51:29.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-06-25T04:51:29.189 INFO:teuthology.orchestra.run.smithi057.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-06-25T04:51:29.190 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-06-25T04:51:29.190 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:51:29.208 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:51:29.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6b536700 1 Processor -- start 2021-06-25T04:51:29.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6b536700 1 -- start start 2021-06-25T04:51:29.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6b536700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffb640b2810 0x7ffb640b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6b536700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6413c6a0 0x7ffb6413cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6b536700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb640b2bf0 con 0x7ffb640acee0 2021-06-25T04:51:29.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6b536700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb640b1620 con 0x7ffb640b2810 2021-06-25T04:51:29.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6a534700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffb640b2810 0x7ffb640b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6b536700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb640b18c0 con 0x7ffb6413c6a0 2021-06-25T04:51:29.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6a534700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffb640b2810 0x7ffb640b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38178/0 (socket says 172.21.15.57:38178) 2021-06-25T04:51:29.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6a534700 1 -- 172.21.15.57:0/2269767582 learned_addr learned my addr 172.21.15.57:0/2269767582 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:29.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb69d33700 1 --2- 172.21.15.57:0/2269767582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6413c6a0 0x7ffb6413cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6a534700 1 -- 172.21.15.57:0/2269767582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6413c6a0 msgr2=0x7ffb6413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:29.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6a534700 1 --2- 172.21.15.57:0/2269767582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6413c6a0 0x7ffb6413cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6a534700 1 -- 172.21.15.57:0/2269767582 >> v1:172.21.15.87:6789/0 conn(0x7ffb640acee0 legacy=0x7ffb640ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6a534700 1 -- 172.21.15.57:0/2269767582 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb640b1b60 con 0x7ffb640b2810 2021-06-25T04:51:29.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6a534700 1 --2- 172.21.15.57:0/2269767582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640b2810 0x7ffb640b0a60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7ffb60002f70 tx=0x7ffb60006f40).ready entity=mon.0 client_cookie=63901c710637ba09 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:29.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb69532700 1 -- 172.21.15.57:0/2269767582 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb60014070 con 0x7ffb640b2810 2021-06-25T04:51:29.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb69532700 1 -- 172.21.15.57:0/2269767582 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb60000e90 con 0x7ffb640b2810 2021-06-25T04:51:29.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb69532700 1 -- 172.21.15.57:0/2269767582 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6000ca50 con 0x7ffb640b2810 2021-06-25T04:51:29.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6b536700 1 -- 172.21.15.57:0/2269767582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640b2810 msgr2=0x7ffb640b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.315+0000 7ffb6b536700 1 --2- 172.21.15.57:0/2269767582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640b2810 0x7ffb640b0a60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7ffb60002f70 tx=0x7ffb60006f40).stop 2021-06-25T04:51:29.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 -- 172.21.15.57:0/2269767582 shutdown_connections 2021-06-25T04:51:29.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 --2- 172.21.15.57:0/2269767582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6413c6a0 0x7ffb6413cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 --2- 172.21.15.57:0/2269767582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640b2810 0x7ffb640b0a60 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 -- 172.21.15.57:0/2269767582 >> 172.21.15.57:0/2269767582 conn(0x7ffb640611f0 msgr2=0x7ffb64062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:29.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 -- 172.21.15.57:0/2269767582 shutdown_connections 2021-06-25T04:51:29.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 -- 172.21.15.57:0/2269767582 wait complete. 2021-06-25T04:51:29.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 Processor -- start 2021-06-25T04:51:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 -- start start 2021-06-25T04:51:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb640acee0 0x7ffb64137e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640b2810 0x7ffb64131ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6413c6a0 0x7ffb641323b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64140670 con 0x7ffb640b2810 2021-06-25T04:51:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64140910 con 0x7ffb640acee0 2021-06-25T04:51:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.319+0000 7ffb6b536700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64140bb0 con 0x7ffb6413c6a0 2021-06-25T04:51:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb69d33700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640b2810 0x7ffb64131ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb6a534700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb640acee0 0x7ffb64137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb6a534700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb640acee0 0x7ffb64137e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:46678/0 (socket says 172.21.15.57:46678) 2021-06-25T04:51:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb6a534700 1 -- 172.21.15.57:0/1275048786 learned_addr learned my addr 172.21.15.57:0/1275048786 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb69d33700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640b2810 0x7ffb64131ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38186/0 (socket says 172.21.15.57:38186) 2021-06-25T04:51:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb6ad35700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6413c6a0 0x7ffb641323b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb69d33700 1 -- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6413c6a0 msgr2=0x7ffb641323b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb69d33700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6413c6a0 0x7ffb641323b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb69d33700 1 -- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb640acee0 msgr2=0x7ffb64137e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb69d33700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb640acee0 0x7ffb64137e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb69d33700 1 -- 172.21.15.57:0/1275048786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6000a360 con 0x7ffb640b2810 2021-06-25T04:51:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb69d33700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640b2810 0x7ffb64131ec0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ffb5400e000 tx=0x7ffb54006e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb537fe700 1 -- 172.21.15.57:0/1275048786 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5400ec50 con 0x7ffb640b2810 2021-06-25T04:51:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb537fe700 1 -- 172.21.15.57:0/1275048786 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5400edb0 con 0x7ffb640b2810 2021-06-25T04:51:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb6b536700 1 -- 172.21.15.57:0/1275048786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb641328a0 con 0x7ffb640b2810 2021-06-25T04:51:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb537fe700 1 -- 172.21.15.57:0/1275048786 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5401a660 con 0x7ffb640b2810 2021-06-25T04:51:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb6b536700 1 -- 172.21.15.57:0/1275048786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb640b5660 con 0x7ffb640b2810 2021-06-25T04:51:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb6b536700 1 -- 172.21.15.57:0/1275048786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb64057310 con 0x7ffb640b2810 2021-06-25T04:51:29.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb537fe700 1 -- 172.21.15.57:0/1275048786 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ffb54021060 con 0x7ffb640b2810 2021-06-25T04:51:29.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.323+0000 7ffb537fe700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb44055510 0x7ffb440579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.327+0000 7ffb537fe700 1 -- 172.21.15.57:0/1275048786 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ffb54070a70 con 0x7ffb640b2810 2021-06-25T04:51:29.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.327+0000 7ffb6a534700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb44055510 0x7ffb440579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.327+0000 7ffb6a534700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb44055510 0x7ffb440579d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7ffb6001a000 tx=0x7ffb60016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.331+0000 7ffb537fe700 1 -- 172.21.15.57:0/1275048786 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ffb54046c20 con 0x7ffb640b2810 2021-06-25T04:51:29.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.499+0000 7ffb6b536700 1 -- 172.21.15.57:0/1275048786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb64140d70 con 0x7ffb640b2810 2021-06-25T04:51:29.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.499+0000 7ffb537fe700 1 -- 172.21.15.57:0/1275048786 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2486 (secure 0 0 0) 0x7ffb54070e60 con 0x7ffb640b2810 2021-06-25T04:51:29.505 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:29.505 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/289042329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":289042329},{"type":"v1","addr":"172.21.15.87:6835","nonce":289042329}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/824739091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":824739091},{"type":"v1","addr":"172.21.15.57:6833","nonce":824739091}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:51:09.583588+0000","modified":"2021-06-25T04:51:11.349725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3353139901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3353139901},{"type":"v1","addr":"172.21.15.57:6835","nonce":3353139901}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-06-25T04:51:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 -- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb44055510 msgr2=0x7ffb440579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb44055510 0x7ffb440579d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7ffb6001a000 tx=0x7ffb60016000).stop 2021-06-25T04:51:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 -- 172.21.15.57:0/1275048786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640b2810 msgr2=0x7ffb64131ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640b2810 0x7ffb64131ec0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ffb5400e000 tx=0x7ffb54006e80).stop 2021-06-25T04:51:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 -- 172.21.15.57:0/1275048786 shutdown_connections 2021-06-25T04:51:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffb44055510 0x7ffb440579d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6413c6a0 0x7ffb641323b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640b2810 0x7ffb64131ec0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 --2- 172.21.15.57:0/1275048786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb640acee0 0x7ffb64137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 -- 172.21.15.57:0/1275048786 >> 172.21.15.57:0/1275048786 conn(0x7ffb640611f0 msgr2=0x7ffb6405fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:29.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 -- 172.21.15.57:0/1275048786 shutdown_connections 2021-06-25T04:51:29.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.503+0000 7ffb6b536700 1 -- 172.21.15.57:0/1275048786 wait complete. 2021-06-25T04:51:29.511 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2021-06-25T04:51:29.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 5 2021-06-25T04:51:29.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.619+0000 7fe4306ec700 1 Processor -- start 2021-06-25T04:51:29.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.619+0000 7fe4306ec700 1 -- start start 2021-06-25T04:51:29.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.619+0000 7fe4306ec700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe4280a9e80 0x7fe4280aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.619+0000 7fe4306ec700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe428060390 0x7fe42813cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.619+0000 7fe4306ec700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe428061950 con 0x7fe42813d180 2021-06-25T04:51:29.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe428061bf0 con 0x7fe4280a9e80 2021-06-25T04:51:29.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe428060b50 con 0x7fe428060390 2021-06-25T04:51:29.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42e488700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe4280a9e80 0x7fe4280aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42e488700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe4280a9e80 0x7fe4280aa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38192/0 (socket says 172.21.15.57:38192) 2021-06-25T04:51:29.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42e488700 1 -- 172.21.15.57:0/3647594544 learned_addr learned my addr 172.21.15.57:0/3647594544 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:29.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42dc87700 1 --2- 172.21.15.57:0/3647594544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe428060390 0x7fe42813cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42e488700 1 -- 172.21.15.57:0/3647594544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe428060390 msgr2=0x7fe42813cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:29.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42e488700 1 --2- 172.21.15.57:0/3647594544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe428060390 0x7fe42813cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42e488700 1 -- 172.21.15.57:0/3647594544 >> v1:172.21.15.57:6789/0 conn(0x7fe42813d180 legacy=0x7fe42813f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42e488700 1 -- 172.21.15.57:0/3647594544 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe428060df0 con 0x7fe4280a9e80 2021-06-25T04:51:29.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42d486700 1 -- 172.21.15.57:0/3647594544 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946669400 0 0) 0x7fe428061950 con 0x7fe42813d180 2021-06-25T04:51:29.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42e488700 1 --2- 172.21.15.57:0/3647594544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4280a9e80 0x7fe4280aa260 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fe42805f830 tx=0x7fe424006eb0).ready entity=mon.0 client_cookie=6dd48635801de4de server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:29.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42d486700 1 -- 172.21.15.57:0/3647594544 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42400d5c0 con 0x7fe4280a9e80 2021-06-25T04:51:29.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42d486700 1 -- 172.21.15.57:0/3647594544 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424000e90 con 0x7fe4280a9e80 2021-06-25T04:51:29.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe42d486700 1 -- 172.21.15.57:0/3647594544 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42400d910 con 0x7fe4280a9e80 2021-06-25T04:51:29.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 -- 172.21.15.57:0/3647594544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4280a9e80 msgr2=0x7fe4280aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 --2- 172.21.15.57:0/3647594544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4280a9e80 0x7fe4280aa260 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fe42805f830 tx=0x7fe424006eb0).stop 2021-06-25T04:51:29.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 -- 172.21.15.57:0/3647594544 shutdown_connections 2021-06-25T04:51:29.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 --2- 172.21.15.57:0/3647594544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe428060390 0x7fe42813cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 --2- 172.21.15.57:0/3647594544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4280a9e80 0x7fe4280aa260 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 -- 172.21.15.57:0/3647594544 >> 172.21.15.57:0/3647594544 conn(0x7fe4280b2930 msgr2=0x7fe4280b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:29.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 -- 172.21.15.57:0/3647594544 shutdown_connections 2021-06-25T04:51:29.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 -- 172.21.15.57:0/3647594544 wait complete. 2021-06-25T04:51:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 Processor -- start 2021-06-25T04:51:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.623+0000 7fe4306ec700 1 -- start start 2021-06-25T04:51:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe4306ec700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe428060390 0x7fe4280b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe4306ec700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4280a9e80 0x7fe428150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe4306ec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe42813d180 0x7fe428150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe4306ec700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe428151030 con 0x7fe42813d180 2021-06-25T04:51:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe4306ec700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280b0500 con 0x7fe428060390 2021-06-25T04:51:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe4306ec700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4281501f0 con 0x7fe4280a9e80 2021-06-25T04:51:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe42ec89700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe42813d180 0x7fe428150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe42ec89700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe42813d180 0x7fe428150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38202/0 (socket says 172.21.15.57:38202) 2021-06-25T04:51:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe42e488700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe428060390 0x7fe4280b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe42dc87700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4280a9e80 0x7fe428150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe42ec89700 1 -- 172.21.15.57:0/3411710370 learned_addr learned my addr 172.21.15.57:0/3411710370 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:29.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe42ec89700 1 -- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4280a9e80 msgr2=0x7fe428150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe42ec89700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4280a9e80 0x7fe428150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe42ec89700 1 -- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe428060390 msgr2=0x7fe4280b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe42ec89700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe428060390 0x7fe4280b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe42ec89700 1 -- 172.21.15.57:0/3411710370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42400b1e0 con 0x7fe42813d180 2021-06-25T04:51:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe42ec89700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe42813d180 0x7fe428150b40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fe4280b0640 tx=0x7fe420007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe4177fe700 1 -- 172.21.15.57:0/3411710370 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe420006aa0 con 0x7fe42813d180 2021-06-25T04:51:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe4177fe700 1 -- 172.21.15.57:0/3411710370 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe420006c00 con 0x7fe42813d180 2021-06-25T04:51:29.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe4306ec700 1 -- 172.21.15.57:0/3411710370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4280afe90 con 0x7fe42813d180 2021-06-25T04:51:29.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe4177fe700 1 -- 172.21.15.57:0/3411710370 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe420007030 con 0x7fe42813d180 2021-06-25T04:51:29.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.627+0000 7fe4306ec700 1 -- 172.21.15.57:0/3411710370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe428063a70 con 0x7fe42813d180 2021-06-25T04:51:29.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.631+0000 7fe4177fe700 1 -- 172.21.15.57:0/3411710370 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe420010030 con 0x7fe42813d180 2021-06-25T04:51:29.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.631+0000 7fe4177fe700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe4080553f0 0x7fe4080578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.631+0000 7fe4177fe700 1 -- 172.21.15.57:0/3411710370 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe42006de50 con 0x7fe42813d180 2021-06-25T04:51:29.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.631+0000 7fe42e488700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe4080553f0 0x7fe4080578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.631+0000 7fe42e488700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe4080553f0 0x7fe4080578b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fe42401b000 tx=0x7fe424015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:29.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.631+0000 7fe43a93c740 1 Processor -- start 2021-06-25T04:51:29.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.631+0000 7fe43a93c740 1 -- start start 2021-06-25T04:51:29.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1d58490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d58980 0x1d58de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d1e7b0 0x1d1ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c92610 con 0x1d5d200 2021-06-25T04:51:29.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c92750 con 0x1d58980 2021-06-25T04:51:29.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c93e20 con 0x1d1e7b0 2021-06-25T04:51:29.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42e488700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1d58490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42e488700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1d58490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38206/0 (socket says 172.21.15.57:38206) 2021-06-25T04:51:29.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42e488700 1 -- 172.21.15.57:0/226070016 learned_addr learned my addr 172.21.15.57:0/226070016 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:29.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42ec89700 1 --2- 172.21.15.57:0/226070016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d1e7b0 0x1d1ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42dc87700 1 --2- 172.21.15.57:0/226070016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d58980 0x1d58de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42e488700 1 -- 172.21.15.57:0/226070016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d1e7b0 msgr2=0x1d1ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:29.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42e488700 1 --2- 172.21.15.57:0/226070016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d1e7b0 0x1d1ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42e488700 1 -- 172.21.15.57:0/226070016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d58980 msgr2=0x1d58de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:29.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42e488700 1 --2- 172.21.15.57:0/226070016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d58980 0x1d58de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42e488700 1 -- 172.21.15.57:0/226070016 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ccb970 con 0x1d5d200 2021-06-25T04:51:29.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42dc87700 1 --2- 172.21.15.57:0/226070016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d58980 0x1d58de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:29.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe42e488700 1 --2- 172.21.15.57:0/226070016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1d58490 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fe42805f830 tx=0x7fe424020070).ready entity=mon.0 client_cookie=10cfb0172324fe8b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:29.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe4306ec700 1 -- 172.21.15.57:0/226070016 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42400d950 con 0x1d5d200 2021-06-25T04:51:29.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe4306ec700 1 -- 172.21.15.57:0/226070016 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42400ddb0 con 0x1d5d200 2021-06-25T04:51:29.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe4306ec700 1 -- 172.21.15.57:0/226070016 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42401eac0 con 0x1d5d200 2021-06-25T04:51:29.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 -- 172.21.15.57:0/226070016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 msgr2=0x1d58490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 --2- 172.21.15.57:0/226070016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1d58490 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fe42805f830 tx=0x7fe424020070).stop 2021-06-25T04:51:29.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 -- 172.21.15.57:0/226070016 shutdown_connections 2021-06-25T04:51:29.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 --2- 172.21.15.57:0/226070016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d1e7b0 0x1d1ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 --2- 172.21.15.57:0/226070016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d58980 0x1d58de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 --2- 172.21.15.57:0/226070016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1d58490 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 -- 172.21.15.57:0/226070016 >> 172.21.15.57:0/226070016 conn(0x1d20550 msgr2=0x1d21480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 -- 172.21.15.57:0/226070016 shutdown_connections 2021-06-25T04:51:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 -- 172.21.15.57:0/226070016 wait complete. 2021-06-25T04:51:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 -- start start 2021-06-25T04:51:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.635+0000 7fe43a93c740 1 Processor -- start 2021-06-25T04:51:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d47e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d5d200 0x1d27020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d48630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d68cb0 con 0x1d58980 2021-06-25T04:51:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d687b0 con 0x1d5d200 2021-06-25T04:51:29.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d68a10 con 0x1d5bf20 2021-06-25T04:51:29.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 10 client.0 ll_register_callbacks cb 0x1cdce80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-06-25T04:51:29.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42e488700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d47e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42e488700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d47e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38212/0 (socket says 172.21.15.57:38212) 2021-06-25T04:51:29.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42e488700 1 -- 172.21.15.57:0/3628047931 learned_addr learned my addr 172.21.15.57:0/3628047931 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:29.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42dc87700 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d5d200 0x1d27020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42ec89700 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d48630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42e488700 1 -- 172.21.15.57:0/3628047931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 msgr2=0x1d48630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:29.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42e488700 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d48630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42e488700 1 -- 172.21.15.57:0/3628047931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d5d200 msgr2=0x1d27020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:29.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42e488700 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d5d200 0x1d27020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42e488700 1 -- 172.21.15.57:0/3628047931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe428060df0 con 0x1d58980 2021-06-25T04:51:29.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42e488700 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d47e50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fe42805f830 tx=0x7fe424029000).ready entity=mon.0 client_cookie=b0b0a9fc7a101aeb server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:29.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe4057fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2021-06-25T04:51:29.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe4057fa700 1 -- 172.21.15.57:0/3628047931 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe424031660 con 0x1d58980 2021-06-25T04:51:29.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 1 -- 172.21.15.57:0/3628047931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b0cc70 con 0x1d58980 2021-06-25T04:51:29.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe4057fa700 1 -- 172.21.15.57:0/3628047931 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe4240317c0 con 0x1d58980 2021-06-25T04:51:29.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe4057fa700 1 -- 172.21.15.57:0/3628047931 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe424031980 con 0x1d58980 2021-06-25T04:51:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 10 client.5823 fetch_fsmap learned FSMap version 25 2021-06-25T04:51:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 1 -- 172.21.15.57:0/3628047931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x1c82cb0 con 0x1d58980 2021-06-25T04:51:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe4057fa700 1 -- 172.21.15.57:0/3628047931 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b0cc70 con 0x1d58980 2021-06-25T04:51:29.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe4057fa700 1 -- 172.21.15.57:0/3628047931 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 25) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fe42402f070 con 0x1d58980 2021-06-25T04:51:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 10 client.5823 fetch_fsmap finished waiting for FSMap version 25 2021-06-25T04:51:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 10 client.5823 resolve_mds: resolved ID 'a' to GID 5634 2021-06-25T04:51:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 20 client.5823 populate_metadata read hostname 'smithi057' 2021-06-25T04:51:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.57:6834/3353139901,v1:172.21.15.57:6835/3353139901] conn(0x1d48b20 0x1d6b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 4 client.5823 mds_command: new command op to 5634 tid=0[{"prefix": "get_command_descriptions"}] 2021-06-25T04:51:29.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe43a93c740 1 -- 172.21.15.57:0/3628047931 --> [v2:172.21.15.57:6834/3353139901,v1:172.21.15.57:6835/3353139901] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b224b0 con 0x1d48b20 2021-06-25T04:51:29.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42dc87700 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.57:6834/3353139901,v1:172.21.15.57:6835/3353139901] conn(0x1d48b20 0x1d6b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe4057fa700 10 client.5823 ms_handle_connect on v2:172.21.15.57:6834/3353139901 2021-06-25T04:51:29.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.639+0000 7fe42dc87700 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.57:6834/3353139901,v1:172.21.15.57:6835/3353139901] conn(0x1d48b20 0x1d6b310 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=25af41781329fea4 server_cookie=1ce25ab12dd76b17 in_seq=0 out_seq=0 2021-06-25T04:51:29.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe4057fa700 1 -- 172.21.15.57:0/3628047931 <== mds.0 v2:172.21.15.57:6834/3353139901 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1b224b0 con 0x1d48b20 2021-06-25T04:51:29.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe4057fa700 10 client.5823 handle_command_reply: tid=0 2021-06-25T04:51:29.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 1 client.5823 shutdown 2021-06-25T04:51:29.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 1 -- 172.21.15.57:0/3628047931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 msgr2=0x1d47e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d47e50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fe42805f830 tx=0x7fe424029000).stop 2021-06-25T04:51:29.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 1 -- 172.21.15.57:0/3628047931 shutdown_connections 2021-06-25T04:51:29.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.57:6834/3353139901,v1:172.21.15.57:6835/3353139901] conn(0x1d48b20 0x1d6b310 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d48630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d5d200 0x1d27020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe4057fa700 0 client.5823 ms_handle_reset on v2:172.21.15.57:6834/3353139901 2021-06-25T04:51:29.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 1 --2- 172.21.15.57:0/3628047931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d47e50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 1 -- 172.21.15.57:0/3628047931 >> 172.21.15.57:0/3628047931 conn(0x1d1e7b0 msgr2=0x1d57b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:29.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 1 -- 172.21.15.57:0/3628047931 shutdown_connections 2021-06-25T04:51:29.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 1 -- 172.21.15.57:0/3628047931 wait complete. 2021-06-25T04:51:29.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.643+0000 7fe43a93c740 20 client.5823 trim_cache size 0 max 16384 2021-06-25T04:51:29.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.655+0000 7fe43a93c740 1 Processor -- start 2021-06-25T04:51:29.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.655+0000 7fe43a93c740 1 -- start start 2021-06-25T04:51:29.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d67fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d58d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d5d200 0x1d525a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d5b9b0 con 0x1d58980 2021-06-25T04:51:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ca6c10 con 0x1d5d200 2021-06-25T04:51:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b224b0 con 0x1d5bf20 2021-06-25T04:51:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42e488700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d67fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42e488700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d67fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38220/0 (socket says 172.21.15.57:38220) 2021-06-25T04:51:29.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42e488700 1 -- 172.21.15.57:0/2858446843 learned_addr learned my addr 172.21.15.57:0/2858446843 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:29.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42ec89700 1 --2- 172.21.15.57:0/2858446843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d5d200 0x1d525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42dc87700 1 --2- 172.21.15.57:0/2858446843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d58d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42e488700 1 -- 172.21.15.57:0/2858446843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 msgr2=0x1d58d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:29.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42e488700 1 --2- 172.21.15.57:0/2858446843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d58d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42e488700 1 -- 172.21.15.57:0/2858446843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d5d200 msgr2=0x1d525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:29.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42e488700 1 --2- 172.21.15.57:0/2858446843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d5d200 0x1d525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42e488700 1 -- 172.21.15.57:0/2858446843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280b45c0 con 0x1d58980 2021-06-25T04:51:29.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42ec89700 1 --2- 172.21.15.57:0/2858446843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d5d200 0x1d525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:51:29.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42dc87700 1 --2- 172.21.15.57:0/2858446843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d58d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:51:29.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe42e488700 1 --2- 172.21.15.57:0/2858446843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d67fe0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x1c87f80 tx=0x7fe424033070).ready entity=mon.0 client_cookie=6b7c58da336af383 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:29.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe4077fe700 1 -- 172.21.15.57:0/2858446843 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42400dd30 con 0x1d58980 2021-06-25T04:51:29.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe4077fe700 1 -- 172.21.15.57:0/2858446843 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424031660 con 0x1d58980 2021-06-25T04:51:29.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- 172.21.15.57:0/2858446843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 msgr2=0x1d67fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:29.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 --2- 172.21.15.57:0/2858446843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d67fe0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x1c87f80 tx=0x7fe424033070).stop 2021-06-25T04:51:29.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe4077fe700 1 -- 172.21.15.57:0/2858446843 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42403a470 con 0x1d58980 2021-06-25T04:51:29.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- 172.21.15.57:0/2858446843 shutdown_connections 2021-06-25T04:51:29.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 --2- 172.21.15.57:0/2858446843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d5d200 0x1d525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 --2- 172.21.15.57:0/2858446843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d58d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 --2- 172.21.15.57:0/2858446843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d58980 0x1d67fe0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- 172.21.15.57:0/2858446843 >> 172.21.15.57:0/2858446843 conn(0x1d1e7b0 msgr2=0x1d25e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:29.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- 172.21.15.57:0/2858446843 shutdown_connections 2021-06-25T04:51:29.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- 172.21.15.57:0/2858446843 wait complete. 2021-06-25T04:51:29.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- start start 2021-06-25T04:51:29.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 Processor -- start 2021-06-25T04:51:29.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d58980 0x1d1eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d55cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1dbbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d561a0 con 0x1d5d200 2021-06-25T04:51:29.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d5d760 con 0x1d58980 2021-06-25T04:51:29.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d59270 con 0x1d5bf20 2021-06-25T04:51:29.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.659+0000 7fe43a93c740 10 client.0 ll_register_callbacks cb 0x1d225b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-06-25T04:51:29.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42ec89700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1dbbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42ec89700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1dbbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38228/0 (socket says 172.21.15.57:38228) 2021-06-25T04:51:29.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42e488700 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d58980 0x1d1eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42ec89700 1 -- 172.21.15.57:0/4230190619 learned_addr learned my addr 172.21.15.57:0/4230190619 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:29.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42dc87700 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d55cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42ec89700 1 -- 172.21.15.57:0/4230190619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 msgr2=0x1d55cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:29.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42ec89700 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d55cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42ec89700 1 -- 172.21.15.57:0/4230190619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d58980 msgr2=0x1d1eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:29.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42ec89700 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d58980 0x1d1eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:29.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42ec89700 1 -- 172.21.15.57:0/4230190619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1c82cb0 con 0x1d5d200 2021-06-25T04:51:29.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42ec89700 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1dbbd10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x1d649e0 tx=0x7fe42001f040).ready entity=mon.0 client_cookie=5bc8d904cf1daf31 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:29.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe4067fc700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2021-06-25T04:51:29.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe4067fc700 1 -- 172.21.15.57:0/4230190619 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4200439a0 con 0x1d5d200 2021-06-25T04:51:29.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe4067fc700 1 -- 172.21.15.57:0/4230190619 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe420043b00 con 0x1d5d200 2021-06-25T04:51:29.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe43a93c740 1 -- 172.21.15.57:0/4230190619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b9d820 con 0x1d5d200 2021-06-25T04:51:29.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe4067fc700 1 -- 172.21.15.57:0/4230190619 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe420043cc0 con 0x1d5d200 2021-06-25T04:51:29.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe43a93c740 10 client.5829 fetch_fsmap learned FSMap version 25 2021-06-25T04:51:29.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe43a93c740 1 -- 172.21.15.57:0/4230190619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x1c88290 con 0x1d5d200 2021-06-25T04:51:29.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe4067fc700 1 -- 172.21.15.57:0/4230190619 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b9d820 con 0x1d5d200 2021-06-25T04:51:29.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe4067fc700 1 -- 172.21.15.57:0/4230190619 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 25) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fe420027070 con 0x1d5d200 2021-06-25T04:51:29.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe43a93c740 10 client.5829 fetch_fsmap finished waiting for FSMap version 25 2021-06-25T04:51:29.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe43a93c740 10 client.5829 resolve_mds: resolved ID 'a' to GID 5634 2021-06-25T04:51:29.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe43a93c740 20 client.5829 populate_metadata read hostname 'smithi057' 2021-06-25T04:51:29.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe43a93c740 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.57:6834/3353139901,v1:172.21.15.57:6835/3353139901] conn(0x1db4f00 0x1db52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:29.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe43a93c740 4 client.5829 mds_command: new command op to 5634 tid=0[{"prefix": "cache drop", "timeout": 5}] 2021-06-25T04:51:29.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe43a93c740 1 -- 172.21.15.57:0/4230190619 --> [v2:172.21.15.57:6834/3353139901,v1:172.21.15.57:6835/3353139901] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0x1db57d0 con 0x1db4f00 2021-06-25T04:51:29.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42e488700 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.57:6834/3353139901,v1:172.21.15.57:6835/3353139901] conn(0x1db4f00 0x1db52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:29.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe4067fc700 10 client.5829 ms_handle_connect on v2:172.21.15.57:6834/3353139901 2021-06-25T04:51:29.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:29.663+0000 7fe42e488700 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.57:6834/3353139901,v1:172.21.15.57:6835/3353139901] conn(0x1db4f00 0x1db52e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5db64bd3df80ce01 server_cookie=fbdfaf7ec57a8c35 in_seq=0 out_seq=0 2021-06-25T04:51:34.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4067fc700 1 -- 172.21.15.57:0/4230190619 <== mds.0 v2:172.21.15.57:6834/3353139901 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+404 (crc 0 0 0) 0x1db57d0 con 0x1db4f00 2021-06-25T04:51:34.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4067fc700 10 client.5829 handle_command_reply: tid=0 2021-06-25T04:51:34.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 1 client.5829 shutdown 2021-06-25T04:51:34.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 1 -- 172.21.15.57:0/4230190619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 msgr2=0x1dbbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:34.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1dbbd10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x1d649e0 tx=0x7fe42001f040).stop 2021-06-25T04:51:34.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 1 -- 172.21.15.57:0/4230190619 shutdown_connections 2021-06-25T04:51:34.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.57:6834/3353139901,v1:172.21.15.57:6835/3353139901] conn(0x1db4f00 0x1db52e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:34.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1d5d200 0x1dbbd10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:34.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1d5bf20 0x1d55cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:34.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 1 --2- 172.21.15.57:0/4230190619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1d58980 0x1d1eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:34.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4067fc700 0 client.5829 ms_handle_reset on v2:172.21.15.57:6834/3353139901 2021-06-25T04:51:34.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 1 -- 172.21.15.57:0/4230190619 >> 172.21.15.57:0/4230190619 conn(0x1d1e7b0 msgr2=0x1d52540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:34.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 1 -- 172.21.15.57:0/4230190619 shutdown_connections 2021-06-25T04:51:34.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 1 -- 172.21.15.57:0/4230190619 wait complete. 2021-06-25T04:51:34.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe43a93c740 20 client.5829 trim_cache size 0 max 16384 2021-06-25T04:51:34.876 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:51:34.876 INFO:teuthology.orchestra.run.smithi057.stdout: "client_recall": { 2021-06-25T04:51:34.877 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": -110, 2021-06-25T04:51:34.877 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "(110) Connection timed out", 2021-06-25T04:51:34.877 INFO:teuthology.orchestra.run.smithi057.stdout: "recalled": 120 2021-06-25T04:51:34.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:34.878 INFO:teuthology.orchestra.run.smithi057.stdout: "flush_journal": { 2021-06-25T04:51:34.878 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": 0, 2021-06-25T04:51:34.878 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "" 2021-06-25T04:51:34.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:34.878 INFO:teuthology.orchestra.run.smithi057.stdout: "trim_cache": { 2021-06-25T04:51:34.879 INFO:teuthology.orchestra.run.smithi057.stdout: "trimmed": 0 2021-06-25T04:51:34.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:34.879 INFO:teuthology.orchestra.run.smithi057.stdout: "cache": { 2021-06-25T04:51:34.879 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": { 2021-06-25T04:51:34.880 INFO:teuthology.orchestra.run.smithi057.stdout: "items": 19984, 2021-06-25T04:51:34.880 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes": 3099296 2021-06-25T04:51:34.880 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:51:34.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:51:34.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2019507340000004 2021-06-25T04:51:34.881 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:51:34.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 -- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe4080553f0 msgr2=0x7fe4080578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:34.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe4080553f0 0x7fe4080578b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fe42401b000 tx=0x7fe424015000).stop 2021-06-25T04:51:34.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 -- 172.21.15.57:0/3411710370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe42813d180 msgr2=0x7fe428150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe42813d180 0x7fe428150b40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fe4280b0640 tx=0x7fe420007f50).stop 2021-06-25T04:51:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 -- 172.21.15.57:0/3411710370 shutdown_connections 2021-06-25T04:51:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe4080553f0 0x7fe4080578b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe42813d180 0x7fe428150b40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:34.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4280a9e80 0x7fe428150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:34.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 --2- 172.21.15.57:0/3411710370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe428060390 0x7fe4280b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:34.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 -- 172.21.15.57:0/3411710370 >> 172.21.15.57:0/3411710370 conn(0x7fe4280b2930 msgr2=0x7fe42813ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:34.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 -- 172.21.15.57:0/3411710370 shutdown_connections 2021-06-25T04:51:34.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:34.867+0000 7fe4306ec700 1 -- 172.21.15.57:0/3411710370 wait complete. 2021-06-25T04:51:34.886 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-06-25T04:51:34.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:34.887 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:51:34.888 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:34.895 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-06-25T04:51:34.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:51:34.897 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-06-25T04:51:34.897 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:51:34.898 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:51:34.898 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:34.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:34.918 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:51:34.919 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:34.967 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:51:34.968 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:51:34.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:51:34.969 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:34.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:51:35.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fed85700 1 Processor -- start 2021-06-25T04:51:35.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fed85700 1 -- start start 2021-06-25T04:51:35.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fed85700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f30f80670e0 0x7f30f80b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fed85700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f30f813ffb0 0x7f30f8140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fed85700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f80b9b90 con 0x7f30f8143970 2021-06-25T04:51:35.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fed85700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f8143040 con 0x7f30f813ffb0 2021-06-25T04:51:35.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fed85700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f80674c0 con 0x7f30f80670e0 2021-06-25T04:51:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fd322700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f30f813ffb0 0x7f30f8140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fd322700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f30f813ffb0 0x7f30f8140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38244/0 (socket says 172.21.15.57:38244) 2021-06-25T04:51:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fd322700 1 -- 172.21.15.57:0/441282512 learned_addr learned my addr 172.21.15.57:0/441282512 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fcb21700 1 --2- 172.21.15.57:0/441282512 >> v2:172.21.15.87:3300/0 conn(0x7f30f80670e0 0x7f30f80b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fd322700 1 -- 172.21.15.57:0/441282512 >> v2:172.21.15.87:3300/0 conn(0x7f30f80670e0 msgr2=0x7f30f80b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fd322700 1 --2- 172.21.15.57:0/441282512 >> v2:172.21.15.87:3300/0 conn(0x7f30f80670e0 0x7f30f80b96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fd322700 1 -- 172.21.15.57:0/441282512 >> v1:172.21.15.87:6789/0 conn(0x7f30f8143970 legacy=0x7f30f80aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fd322700 1 -- 172.21.15.57:0/441282512 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f80af490 con 0x7f30f813ffb0 2021-06-25T04:51:35.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fd322700 1 --2- 172.21.15.57:0/441282512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f813ffb0 0x7f30f8140440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f30e8002f70 tx=0x7f30e8006eb0).ready entity=mon.0 client_cookie=c55850a5bccf5b41 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30f77fe700 1 -- 172.21.15.57:0/441282512 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e800d5c0 con 0x7f30f813ffb0 2021-06-25T04:51:35.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30f77fe700 1 -- 172.21.15.57:0/441282512 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8000e90 con 0x7f30f813ffb0 2021-06-25T04:51:35.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30f77fe700 1 -- 172.21.15.57:0/441282512 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e800d950 con 0x7f30f813ffb0 2021-06-25T04:51:35.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fed85700 1 -- 172.21.15.57:0/441282512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f813ffb0 msgr2=0x7f30f8140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.079+0000 7f30fed85700 1 --2- 172.21.15.57:0/441282512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f813ffb0 0x7f30f8140440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f30e8002f70 tx=0x7f30e8006eb0).stop 2021-06-25T04:51:35.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 -- 172.21.15.57:0/441282512 shutdown_connections 2021-06-25T04:51:35.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 --2- 172.21.15.57:0/441282512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f813ffb0 0x7f30f8140440 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 --2- 172.21.15.57:0/441282512 >> v2:172.21.15.87:3300/0 conn(0x7f30f80670e0 0x7f30f80b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 -- 172.21.15.57:0/441282512 >> 172.21.15.57:0/441282512 conn(0x7f30f805f9b0 msgr2=0x7f30f8061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:35.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 -- 172.21.15.57:0/441282512 shutdown_connections 2021-06-25T04:51:35.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 -- 172.21.15.57:0/441282512 wait complete. 2021-06-25T04:51:35.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 Processor -- start 2021-06-25T04:51:35.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 -- start start 2021-06-25T04:51:35.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30f80670e0 0x7f30f80afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f813ffb0 0x7f30f80b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f8143970 0x7f30f80b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80b8350 con 0x7f30f8143970 2021-06-25T04:51:35.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80b8e00 con 0x7f30f813ffb0 2021-06-25T04:51:35.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fed85700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80b90a0 con 0x7f30f80670e0 2021-06-25T04:51:35.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fd322700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f8143970 0x7f30f80b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fd322700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f8143970 0x7f30f80b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38248/0 (socket says 172.21.15.57:38248) 2021-06-25T04:51:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fd322700 1 -- 172.21.15.57:0/172483979 learned_addr learned my addr 172.21.15.57:0/172483979 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fcb21700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30f80670e0 0x7f30f80afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30f7fff700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f813ffb0 0x7f30f80b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fd322700 1 -- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30f80670e0 msgr2=0x7f30f80afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fd322700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30f80670e0 0x7f30f80afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fd322700 1 -- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f813ffb0 msgr2=0x7f30f80b79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fd322700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f813ffb0 0x7f30f80b79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fd322700 1 -- 172.21.15.57:0/172483979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e800b1e0 con 0x7f30f8143970 2021-06-25T04:51:35.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30fd322700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f8143970 0x7f30f80b3130 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f30e8002f70 tx=0x7f30e8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.083+0000 7f30f5ffb700 1 -- 172.21.15.57:0/172483979 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e80117e0 con 0x7f30f8143970 2021-06-25T04:51:35.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.087+0000 7f30f5ffb700 1 -- 172.21.15.57:0/172483979 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8011940 con 0x7f30f8143970 2021-06-25T04:51:35.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.087+0000 7f30fed85700 1 -- 172.21.15.57:0/172483979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f80b9340 con 0x7f30f8143970 2021-06-25T04:51:35.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.087+0000 7f30f5ffb700 1 -- 172.21.15.57:0/172483979 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e8011ca0 con 0x7f30f8143970 2021-06-25T04:51:35.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.087+0000 7f30fed85700 1 -- 172.21.15.57:0/172483979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f80aff50 con 0x7f30f8143970 2021-06-25T04:51:35.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.087+0000 7f30fed85700 1 -- 172.21.15.57:0/172483979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f80b94d0 con 0x7f30f8143970 2021-06-25T04:51:35.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.087+0000 7f30f5ffb700 1 -- 172.21.15.57:0/172483979 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f30e800f070 con 0x7f30f8143970 2021-06-25T04:51:35.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.087+0000 7f30f5ffb700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30dc055490 0x7f30dc057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.087+0000 7f30f5ffb700 1 -- 172.21.15.57:0/172483979 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f30e806f7a0 con 0x7f30f8143970 2021-06-25T04:51:35.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.087+0000 7f30fcb21700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30dc055490 0x7f30dc057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.087+0000 7f30fcb21700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30dc055490 0x7f30dc057950 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f30e000b000 tx=0x7f30e0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.091+0000 7f30f5ffb700 1 -- 172.21.15.57:0/172483979 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f30e80457c0 con 0x7f30f8143970 2021-06-25T04:51:35.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.215+0000 7f30fed85700 1 -- 172.21.15.57:0/172483979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30f8057310 con 0x7f30f8143970 2021-06-25T04:51:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30f5ffb700 1 -- 172.21.15.57:0/172483979 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16273 (secure 0 0 0) 0x7f30e8048de0 con 0x7f30f8143970 2021-06-25T04:51:35.224 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:35.224 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":56,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:51:10.586886+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:51:08.069175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-06-25T04:51:08.684458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:51:35.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 -- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30dc055490 msgr2=0x7f30dc057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30dc055490 0x7f30dc057950 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f30e000b000 tx=0x7f30e0008040).stop 2021-06-25T04:51:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 -- 172.21.15.57:0/172483979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f8143970 msgr2=0x7f30f80b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f8143970 0x7f30f80b3130 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f30e8002f70 tx=0x7f30e8015000).stop 2021-06-25T04:51:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 -- 172.21.15.57:0/172483979 shutdown_connections 2021-06-25T04:51:35.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f30dc055490 0x7f30dc057950 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f8143970 0x7f30f80b3130 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f813ffb0 0x7f30f80b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 --2- 172.21.15.57:0/172483979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30f80670e0 0x7f30f80afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 -- 172.21.15.57:0/172483979 >> 172.21.15.57:0/172483979 conn(0x7f30f805f9b0 msgr2=0x7f30f80b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:35.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 -- 172.21.15.57:0/172483979 shutdown_connections 2021-06-25T04:51:35.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.219+0000 7f30fed85700 1 -- 172.21.15.57:0/172483979 wait complete. 2021-06-25T04:51:35.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:51:08.069175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:51:08.684458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:51:35.237 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:51:35.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd9b15700 1 Processor -- start 2021-06-25T04:51:35.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd9b15700 1 -- start start 2021-06-25T04:51:35.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd9b15700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbbd4146910 0x7fbbd41401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd9b15700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4140 0x7fbbd41406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd9b15700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd4143b20 con 0x7fbbd40b4650 2021-06-25T04:51:35.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd9b15700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd41474d0 con 0x7fbbd4146910 2021-06-25T04:51:35.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd9b15700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4143dc0 con 0x7fbbd40b4140 2021-06-25T04:51:35.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd37fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbbd4146910 0x7fbbd41401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd2ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4140 0x7fbbd41406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd3fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbbd40b4650 0x7fbbd40b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:56224/0 (socket says 172.21.15.57:56224) 2021-06-25T04:51:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd2ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4140 0x7fbbd41406e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:49420/0 (socket says 172.21.15.57:49420) 2021-06-25T04:51:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd37fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbbd4146910 0x7fbbd41401f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:46748/0 (socket says 172.21.15.57:46748) 2021-06-25T04:51:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd3fff700 1 -- 172.21.15.57:0/1400298447 learned_addr learned my addr 172.21.15.57:0/1400298447 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:35.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd2ffd700 1 -- 172.21.15.57:0/1400298447 >> v2:172.21.15.87:3300/0 conn(0x7fbbd4146910 msgr2=0x7fbbd41401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:35.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd2ffd700 1 --2- 172.21.15.57:0/1400298447 >> v2:172.21.15.87:3300/0 conn(0x7fbbd4146910 0x7fbbd41401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd2ffd700 1 -- 172.21.15.57:0/1400298447 >> v1:172.21.15.87:6789/0 conn(0x7fbbd40b4650 legacy=0x7fbbd40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd2ffd700 1 -- 172.21.15.57:0/1400298447 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd40b0c50 con 0x7fbbd40b4140 2021-06-25T04:51:35.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.343+0000 7fbbd2ffd700 1 --2- 172.21.15.57:0/1400298447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4140 0x7fbbd41406e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fbbbc002f70 tx=0x7fbbbc006df0).ready entity=mon.2 client_cookie=eb26c548502ca227 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd27fc700 1 -- 172.21.15.57:0/1400298447 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbbc00d570 con 0x7fbbd40b4140 2021-06-25T04:51:35.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd27fc700 1 -- 172.21.15.57:0/1400298447 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc000e90 con 0x7fbbd40b4140 2021-06-25T04:51:35.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd27fc700 1 -- 172.21.15.57:0/1400298447 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbbc00d8c0 con 0x7fbbd40b4140 2021-06-25T04:51:35.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd9b15700 1 -- 172.21.15.57:0/1400298447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4140 msgr2=0x7fbbd41406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd9b15700 1 --2- 172.21.15.57:0/1400298447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4140 0x7fbbd41406e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fbbbc002f70 tx=0x7fbbbc006df0).stop 2021-06-25T04:51:35.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd9b15700 1 -- 172.21.15.57:0/1400298447 shutdown_connections 2021-06-25T04:51:35.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd9b15700 1 --2- 172.21.15.57:0/1400298447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4140 0x7fbbd41406e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd9b15700 1 --2- 172.21.15.57:0/1400298447 >> v2:172.21.15.87:3300/0 conn(0x7fbbd4146910 0x7fbbd41401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd9b15700 1 -- 172.21.15.57:0/1400298447 >> 172.21.15.57:0/1400298447 conn(0x7fbbd405c450 msgr2=0x7fbbd405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:35.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd9b15700 1 -- 172.21.15.57:0/1400298447 shutdown_connections 2021-06-25T04:51:35.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd9b15700 1 -- 172.21.15.57:0/1400298447 wait complete. 2021-06-25T04:51:35.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd9b15700 1 Processor -- start 2021-06-25T04:51:35.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.347+0000 7fbbd9b15700 1 -- start start 2021-06-25T04:51:35.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd9b15700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbd40b4140 0x7fbbd40ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd9b15700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4650 0x7fbbd4142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd9b15700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbd4146910 0x7fbbd413f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd9b15700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4112db0 con 0x7fbbd40b4140 2021-06-25T04:51:35.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd9b15700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4141400 con 0x7fbbd4146910 2021-06-25T04:51:35.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd9b15700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4142bb0 con 0x7fbbd40b4650 2021-06-25T04:51:35.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbd40b4140 0x7fbbd40ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbd40b4140 0x7fbbd40ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38260/0 (socket says 172.21.15.57:38260) 2021-06-25T04:51:35.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd37fe700 1 -- 172.21.15.57:0/2651641454 learned_addr learned my addr 172.21.15.57:0/2651641454 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:35.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd3fff700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbd4146910 0x7fbbd413f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd2ffd700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4650 0x7fbbd4142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd37fe700 1 -- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4650 msgr2=0x7fbbd4142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd37fe700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4650 0x7fbbd4142040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd37fe700 1 -- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbd4146910 msgr2=0x7fbbd413f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd37fe700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbd4146910 0x7fbbd413f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd37fe700 1 -- 172.21.15.57:0/2651641454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc00b180 con 0x7fbbd40b4140 2021-06-25T04:51:35.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd37fe700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbd40b4140 0x7fbbd40ae8b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fbbc400c000 tx=0x7fbbc4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd0ff9700 1 -- 172.21.15.57:0/2651641454 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc4011750 con 0x7fbbd40b4140 2021-06-25T04:51:35.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd0ff9700 1 -- 172.21.15.57:0/2651641454 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc40118b0 con 0x7fbbd40b4140 2021-06-25T04:51:35.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd9b15700 1 -- 172.21.15.57:0/2651641454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd4112b10 con 0x7fbbd40b4140 2021-06-25T04:51:35.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd0ff9700 1 -- 172.21.15.57:0/2651641454 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc4011c10 con 0x7fbbd40b4140 2021-06-25T04:51:35.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.351+0000 7fbbd9b15700 1 -- 172.21.15.57:0/2651641454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd40b0470 con 0x7fbbd40b4140 2021-06-25T04:51:35.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.355+0000 7fbbd9b15700 1 -- 172.21.15.57:0/2651641454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd40b0160 con 0x7fbbd40b4140 2021-06-25T04:51:35.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.355+0000 7fbbd0ff9700 1 -- 172.21.15.57:0/2651641454 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbbc4011d70 con 0x7fbbd40b4140 2021-06-25T04:51:35.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.355+0000 7fbbd0ff9700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbb8055450 0x7fbbb8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.355+0000 7fbbd0ff9700 1 -- 172.21.15.57:0/2651641454 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbbc406e430 con 0x7fbbd40b4140 2021-06-25T04:51:35.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.355+0000 7fbbd2ffd700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbb8055450 0x7fbbb8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.355+0000 7fbbd2ffd700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbb8055450 0x7fbbb8057910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fbbbc019000 tx=0x7fbbbc014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.363+0000 7fbbd0ff9700 1 -- 172.21.15.57:0/2651641454 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbbc40443f0 con 0x7fbbd40b4140 2021-06-25T04:51:35.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 -- 172.21.15.57:0/2651641454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbbd4057310 con 0x7fbbd40b4140 2021-06-25T04:51:35.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd0ff9700 1 -- 172.21.15.57:0/2651641454 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v56) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbbc4047a10 con 0x7fbbd40b4140 2021-06-25T04:51:35.492 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:51:35.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 -- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbb8055450 msgr2=0x7fbbb8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbb8055450 0x7fbbb8057910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fbbbc019000 tx=0x7fbbbc014000).stop 2021-06-25T04:51:35.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 -- 172.21.15.57:0/2651641454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbd40b4140 msgr2=0x7fbbd40ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbd40b4140 0x7fbbd40ae8b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fbbc400c000 tx=0x7fbbc4006df0).stop 2021-06-25T04:51:35.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 -- 172.21.15.57:0/2651641454 shutdown_connections 2021-06-25T04:51:35.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbbb8055450 0x7fbbb8057910 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbd4146910 0x7fbbd413f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd40b4650 0x7fbbd4142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 --2- 172.21.15.57:0/2651641454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbd40b4140 0x7fbbd40ae8b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 -- 172.21.15.57:0/2651641454 >> 172.21.15.57:0/2651641454 conn(0x7fbbd405c450 msgr2=0x7fbbd40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:35.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 -- 172.21.15.57:0/2651641454 shutdown_connections 2021-06-25T04:51:35.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.487+0000 7fbbd9b15700 1 -- 172.21.15.57:0/2651641454 wait complete. 2021-06-25T04:51:35.504 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:51:35.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.603+0000 7fd91674d700 1 Processor -- start 2021-06-25T04:51:35.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.603+0000 7fd91674d700 1 -- start start 2021-06-25T04:51:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.603+0000 7fd91674d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9100b2540 0x7fd91014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.603+0000 7fd91674d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd9100a8a80 0x7fd91014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.603+0000 7fd91674d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9100a7080 con 0x7fd9100affd0 2021-06-25T04:51:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.603+0000 7fd91674d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9100a72b0 con 0x7fd9100a8a80 2021-06-25T04:51:35.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.603+0000 7fd91674d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100a7550 con 0x7fd9100b2540 2021-06-25T04:51:35.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.603+0000 7fd915f4c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd9100a8a80 0x7fd91014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd915f4c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd9100a8a80 0x7fd91014b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38272/0 (socket says 172.21.15.57:38272) 2021-06-25T04:51:35.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd915f4c700 1 -- 172.21.15.57:0/3560964450 learned_addr learned my addr 172.21.15.57:0/3560964450 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:35.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd91574b700 1 --2- 172.21.15.57:0/3560964450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9100b2540 0x7fd91014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd915f4c700 1 -- 172.21.15.57:0/3560964450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9100b2540 msgr2=0x7fd91014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:35.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd915f4c700 1 --2- 172.21.15.57:0/3560964450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9100b2540 0x7fd91014ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd915f4c700 1 -- 172.21.15.57:0/3560964450 >> v1:172.21.15.87:6789/0 conn(0x7fd9100affd0 legacy=0x7fd9100a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd915f4c700 1 -- 172.21.15.57:0/3560964450 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9100a77f0 con 0x7fd9100a8a80 2021-06-25T04:51:35.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd915f4c700 1 --2- 172.21.15.57:0/3560964450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9100a8a80 0x7fd91014b2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fd9080032f0 tx=0x7fd908009290).ready entity=mon.0 client_cookie=7164b692508b7a68 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd90ffff700 1 -- 172.21.15.57:0/3560964450 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd90800b8a0 con 0x7fd9100a8a80 2021-06-25T04:51:35.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd90ffff700 1 -- 172.21.15.57:0/3560964450 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90800ba00 con 0x7fd9100a8a80 2021-06-25T04:51:35.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd90ffff700 1 -- 172.21.15.57:0/3560964450 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd90800bb70 con 0x7fd9100a8a80 2021-06-25T04:51:35.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd91674d700 1 -- 172.21.15.57:0/3560964450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9100a8a80 msgr2=0x7fd91014b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd91674d700 1 --2- 172.21.15.57:0/3560964450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9100a8a80 0x7fd91014b2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fd9080032f0 tx=0x7fd908009290).stop 2021-06-25T04:51:35.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd91674d700 1 -- 172.21.15.57:0/3560964450 shutdown_connections 2021-06-25T04:51:35.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd91674d700 1 --2- 172.21.15.57:0/3560964450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9100a8a80 0x7fd91014b2f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd91674d700 1 --2- 172.21.15.57:0/3560964450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9100b2540 0x7fd91014ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd91674d700 1 -- 172.21.15.57:0/3560964450 >> 172.21.15.57:0/3560964450 conn(0x7fd910060140 msgr2=0x7fd9100b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:35.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd91674d700 1 -- 172.21.15.57:0/3560964450 shutdown_connections 2021-06-25T04:51:35.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.607+0000 7fd91674d700 1 -- 172.21.15.57:0/3560964450 wait complete. 2021-06-25T04:51:35.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd91674d700 1 Processor -- start 2021-06-25T04:51:35.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd91674d700 1 -- start start 2021-06-25T04:51:35.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd91674d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9100a8a80 0x7fd91014b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd91674d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9100affd0 0x7fd9100ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd91674d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9100b2540 0x7fd9100a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd91674d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91015a4c0 con 0x7fd9100b2540 2021-06-25T04:51:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd91674d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91015a990 con 0x7fd9100affd0 2021-06-25T04:51:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd91674d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91015a6f0 con 0x7fd9100a8a80 2021-06-25T04:51:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd915f4c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9100b2540 0x7fd9100a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd91574b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9100a8a80 0x7fd91014b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd915f4c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9100b2540 0x7fd9100a9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38278/0 (socket says 172.21.15.57:38278) 2021-06-25T04:51:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd915f4c700 1 -- 172.21.15.57:0/549005794 learned_addr learned my addr 172.21.15.57:0/549005794 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd914f4a700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9100affd0 0x7fd9100ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd915f4c700 1 -- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9100a8a80 msgr2=0x7fd91014b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd915f4c700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9100a8a80 0x7fd91014b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd915f4c700 1 -- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9100affd0 msgr2=0x7fd9100ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd915f4c700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9100affd0 0x7fd9100ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd915f4c700 1 -- 172.21.15.57:0/549005794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908009530 con 0x7fd9100b2540 2021-06-25T04:51:35.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.611+0000 7fd915f4c700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9100b2540 0x7fd9100a9100 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fd9080032f0 tx=0x7fd908016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.615+0000 7fd90e7fc700 1 -- 172.21.15.57:0/549005794 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd908011b20 con 0x7fd9100b2540 2021-06-25T04:51:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.615+0000 7fd90e7fc700 1 -- 172.21.15.57:0/549005794 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908011c80 con 0x7fd9100b2540 2021-06-25T04:51:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.615+0000 7fd91674d700 1 -- 172.21.15.57:0/549005794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9100b5b90 con 0x7fd9100b2540 2021-06-25T04:51:35.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.615+0000 7fd90e7fc700 1 -- 172.21.15.57:0/549005794 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd908020470 con 0x7fd9100b2540 2021-06-25T04:51:35.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.615+0000 7fd91674d700 1 -- 172.21.15.57:0/549005794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9100b2d90 con 0x7fd9100b2540 2021-06-25T04:51:35.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.615+0000 7fd91674d700 1 -- 172.21.15.57:0/549005794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9100b5d20 con 0x7fd9100b2540 2021-06-25T04:51:35.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.615+0000 7fd90e7fc700 1 -- 172.21.15.57:0/549005794 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd908029070 con 0x7fd9100b2540 2021-06-25T04:51:35.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.615+0000 7fd90e7fc700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8f0055450 0x7fd8f0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.615+0000 7fd90e7fc700 1 -- 172.21.15.57:0/549005794 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd90806e9c0 con 0x7fd9100b2540 2021-06-25T04:51:35.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.615+0000 7fd91574b700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8f0055450 0x7fd8f0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.619+0000 7fd91574b700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8f0055450 0x7fd8f0057910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fd90000b000 tx=0x7fd900006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.623+0000 7fd90e7fc700 1 -- 172.21.15.57:0/549005794 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd908044b70 con 0x7fd9100b2540 2021-06-25T04:51:35.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.751+0000 7fd91674d700 1 -- 172.21.15.57:0/549005794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd910057310 con 0x7fd9100b2540 2021-06-25T04:51:35.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.751+0000 7fd90e7fc700 1 -- 172.21.15.57:0/549005794 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd908015020 con 0x7fd9100b2540 2021-06-25T04:51:35.757 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:51:35.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 -- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8f0055450 msgr2=0x7fd8f0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8f0055450 0x7fd8f0057910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fd90000b000 tx=0x7fd900006df0).stop 2021-06-25T04:51:35.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 -- 172.21.15.57:0/549005794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9100b2540 msgr2=0x7fd9100a9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9100b2540 0x7fd9100a9100 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fd9080032f0 tx=0x7fd908016000).stop 2021-06-25T04:51:35.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 -- 172.21.15.57:0/549005794 shutdown_connections 2021-06-25T04:51:35.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8f0055450 0x7fd8f0057910 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9100b2540 0x7fd9100a9100 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9100affd0 0x7fd9100ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 --2- 172.21.15.57:0/549005794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9100a8a80 0x7fd91014b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 -- 172.21.15.57:0/549005794 >> 172.21.15.57:0/549005794 conn(0x7fd910060140 msgr2=0x7fd9100adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:35.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 -- 172.21.15.57:0/549005794 shutdown_connections 2021-06-25T04:51:35.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.755+0000 7fd91674d700 1 -- 172.21.15.57:0/549005794 wait complete. 2021-06-25T04:51:35.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:51:35.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.867+0000 7ff59b59e700 1 Processor -- start 2021-06-25T04:51:35.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.867+0000 7ff59b59e700 1 -- start start 2021-06-25T04:51:35.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff59c0612e0 0x7ff59c0616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff59c0ad580 0x7ff59c0b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff59c140400 0x7ff59c140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59c0aecb0 con 0x7ff59c140400 2021-06-25T04:51:35.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59c0b6ee0 con 0x7ff59c0612e0 2021-06-25T04:51:35.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0aeee0 con 0x7ff59c0ad580 2021-06-25T04:51:35.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff59c140400 0x7ff59c140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff59c140400 0x7ff59c140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38286/0 (socket says 172.21.15.57:38286) 2021-06-25T04:51:35.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59ad9d700 1 -- 172.21.15.57:0/370356013 learned_addr learned my addr 172.21.15.57:0/370356013 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:35.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff591d9b700 1 --2- 172.21.15.57:0/370356013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff59c0ad580 0x7ff59c0b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59a59c700 1 --2- 172.21.15.57:0/370356013 >> v2:172.21.15.87:3300/0 conn(0x7ff59c0612e0 0x7ff59c0616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59ad9d700 1 -- 172.21.15.57:0/370356013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff59c0ad580 msgr2=0x7ff59c0b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:35.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59ad9d700 1 --2- 172.21.15.57:0/370356013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff59c0ad580 0x7ff59c0b9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59ad9d700 1 -- 172.21.15.57:0/370356013 >> v2:172.21.15.87:3300/0 conn(0x7ff59c0612e0 msgr2=0x7ff59c0616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:35.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59ad9d700 1 --2- 172.21.15.57:0/370356013 >> v2:172.21.15.87:3300/0 conn(0x7ff59c0612e0 0x7ff59c0616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59ad9d700 1 -- 172.21.15.57:0/370356013 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c0af180 con 0x7ff59c140400 2021-06-25T04:51:35.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59ad9d700 1 --2- 172.21.15.57:0/370356013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff59c140400 0x7ff59c140890 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7ff5940032f0 tx=0x7ff594009290).ready entity=mon.0 client_cookie=76a1a4c6020cb52a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff599d9b700 1 -- 172.21.15.57:0/370356013 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff59400b870 con 0x7ff59c140400 2021-06-25T04:51:35.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff599d9b700 1 -- 172.21.15.57:0/370356013 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59400b9d0 con 0x7ff59c140400 2021-06-25T04:51:35.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff599d9b700 1 -- 172.21.15.57:0/370356013 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff59400bb40 con 0x7ff59c140400 2021-06-25T04:51:35.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 -- 172.21.15.57:0/370356013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff59c140400 msgr2=0x7ff59c140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 --2- 172.21.15.57:0/370356013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff59c140400 0x7ff59c140890 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7ff5940032f0 tx=0x7ff594009290).stop 2021-06-25T04:51:35.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 -- 172.21.15.57:0/370356013 shutdown_connections 2021-06-25T04:51:35.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 --2- 172.21.15.57:0/370356013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff59c140400 0x7ff59c140890 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 --2- 172.21.15.57:0/370356013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff59c0ad580 0x7ff59c0b9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 --2- 172.21.15.57:0/370356013 >> v2:172.21.15.87:3300/0 conn(0x7ff59c0612e0 0x7ff59c0616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 -- 172.21.15.57:0/370356013 >> 172.21.15.57:0/370356013 conn(0x7ff59c066da0 msgr2=0x7ff59c067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:35.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 -- 172.21.15.57:0/370356013 shutdown_connections 2021-06-25T04:51:35.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.871+0000 7ff59b59e700 1 -- 172.21.15.57:0/370356013 wait complete. 2021-06-25T04:51:35.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59b59e700 1 Processor -- start 2021-06-25T04:51:35.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59b59e700 1 -- start start 2021-06-25T04:51:35.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff59c0612e0 0x7ff59c0afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c0ad580 0x7ff59c0ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff59c140400 0x7ff59c0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0b2d90 con 0x7ff59c0612e0 2021-06-25T04:51:35.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0b3950 con 0x7ff59c0ad580 2021-06-25T04:51:35.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0b3bf0 con 0x7ff59c140400 2021-06-25T04:51:35.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff59c0612e0 0x7ff59c0afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff59c0612e0 0x7ff59c0afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38288/0 (socket says 172.21.15.57:38288) 2021-06-25T04:51:35.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59a59c700 1 -- 172.21.15.57:0/2139110578 learned_addr learned my addr 172.21.15.57:0/2139110578 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:35.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff591d9b700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c0ad580 0x7ff59c0ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59ad9d700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff59c140400 0x7ff59c0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59a59c700 1 -- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff59c140400 msgr2=0x7ff59c0ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59a59c700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff59c140400 0x7ff59c0ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59a59c700 1 -- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c0ad580 msgr2=0x7ff59c0ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:35.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59a59c700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c0ad580 0x7ff59c0ac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:35.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59a59c700 1 -- 172.21.15.57:0/2139110578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594009530 con 0x7ff59c0612e0 2021-06-25T04:51:35.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59ad9d700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff59c140400 0x7ff59c0ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:51:35.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59a59c700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff59c0612e0 0x7ff59c0afee0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7ff58c0030b0 tx=0x7ff58c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff593fff700 1 -- 172.21.15.57:0/2139110578 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff58c011780 con 0x7ff59c0612e0 2021-06-25T04:51:35.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff593fff700 1 -- 172.21.15.57:0/2139110578 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c0118e0 con 0x7ff59c0612e0 2021-06-25T04:51:35.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59b59e700 1 -- 172.21.15.57:0/2139110578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c152d70 con 0x7ff59c0612e0 2021-06-25T04:51:35.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff593fff700 1 -- 172.21.15.57:0/2139110578 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff58c011c40 con 0x7ff59c0612e0 2021-06-25T04:51:35.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.875+0000 7ff59b59e700 1 -- 172.21.15.57:0/2139110578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c0acb90 con 0x7ff59c0612e0 2021-06-25T04:51:35.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.879+0000 7ff59b59e700 1 -- 172.21.15.57:0/2139110578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c0b3db0 con 0x7ff59c0612e0 2021-06-25T04:51:35.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.879+0000 7ff593fff700 1 -- 172.21.15.57:0/2139110578 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff58c01c460 con 0x7ff59c0612e0 2021-06-25T04:51:35.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.879+0000 7ff593fff700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff580055340 0x7ff580057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:35.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.879+0000 7ff593fff700 1 -- 172.21.15.57:0/2139110578 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff58c06e210 con 0x7ff59c0612e0 2021-06-25T04:51:35.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.879+0000 7ff591d9b700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff580055340 0x7ff580057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:35.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.879+0000 7ff591d9b700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff580055340 0x7ff580057800 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff58400b000 tx=0x7ff584006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:35.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:35.887+0000 7ff593fff700 1 -- 172.21.15.57:0/2139110578 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff58c044250 con 0x7ff59c0612e0 2021-06-25T04:51:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.015+0000 7ff59b59e700 1 -- 172.21.15.57:0/2139110578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff59c057310 con 0x7ff59c0612e0 2021-06-25T04:51:36.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.015+0000 7ff593fff700 1 -- 172.21.15.57:0/2139110578 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff58c047870 con 0x7ff59c0612e0 2021-06-25T04:51:36.021 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:51:36.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.015+0000 7ff59b59e700 1 -- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff580055340 msgr2=0x7ff580057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.015+0000 7ff59b59e700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff580055340 0x7ff580057800 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff58400b000 tx=0x7ff584006df0).stop 2021-06-25T04:51:36.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.015+0000 7ff59b59e700 1 -- 172.21.15.57:0/2139110578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff59c0612e0 msgr2=0x7ff59c0afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.015+0000 7ff59b59e700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff59c0612e0 0x7ff59c0afee0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7ff58c0030b0 tx=0x7ff58c008040).stop 2021-06-25T04:51:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.019+0000 7ff59b59e700 1 -- 172.21.15.57:0/2139110578 shutdown_connections 2021-06-25T04:51:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.019+0000 7ff59b59e700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff580055340 0x7ff580057800 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.019+0000 7ff59b59e700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff59c140400 0x7ff59c0ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.019+0000 7ff59b59e700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c0ad580 0x7ff59c0ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.019+0000 7ff59b59e700 1 --2- 172.21.15.57:0/2139110578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff59c0612e0 0x7ff59c0afee0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.019+0000 7ff59b59e700 1 -- 172.21.15.57:0/2139110578 >> 172.21.15.57:0/2139110578 conn(0x7ff59c066da0 msgr2=0x7ff59c0b7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:36.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.019+0000 7ff59b59e700 1 -- 172.21.15.57:0/2139110578 shutdown_connections 2021-06-25T04:51:36.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.019+0000 7ff59b59e700 1 -- 172.21.15.57:0/2139110578 wait complete. 2021-06-25T04:51:36.032 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:51:36.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.135+0000 7f85da832700 1 Processor -- start 2021-06-25T04:51:36.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.135+0000 7f85da832700 1 -- start start 2021-06-25T04:51:36.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85da832700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f85d40aff70 0x7f85d40b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85da832700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d40ae480 con 0x7f85d40b20e0 2021-06-25T04:51:36.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85da832700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d40b19c0 con 0x7f85d40acff0 2021-06-25T04:51:36.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85da832700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d40ae6b0 con 0x7f85d40aff70 2021-06-25T04:51:36.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f85d40b20e0 0x7f85d4143b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55514/0 (socket says 172.21.15.57:55514) 2021-06-25T04:51:36.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d3fff700 1 -- 172.21.15.57:0/1312175875 learned_addr learned my addr 172.21.15.57:0/1312175875 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:51:36.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d8dcf700 1 --2- 172.21.15.57:0/1312175875 >> v2:172.21.15.87:3300/0 conn(0x7f85d40aff70 0x7f85d40b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d37fe700 1 -- 172.21.15.57:0/1312175875 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541259154 0 0) 0x7f85d40ae480 con 0x7f85d40b20e0 2021-06-25T04:51:36.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d37fe700 1 -- 172.21.15.57:0/1312175875 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b8003260 con 0x7f85d40b20e0 2021-06-25T04:51:36.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d37fe700 1 -- 172.21.15.57:0/1312175875 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512254045 0 0) 0x7f85d40b19c0 con 0x7f85d40acff0 2021-06-25T04:51:36.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d37fe700 1 -- 172.21.15.57:0/1312175875 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d40ae480 con 0x7f85d40acff0 2021-06-25T04:51:36.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d8dcf700 1 -- 172.21.15.57:0/1312175875 >> v1:172.21.15.87:6789/0 conn(0x7f85d40acff0 legacy=0x7f85d40b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d8dcf700 1 -- 172.21.15.57:0/1312175875 >> v1:172.21.15.57:6789/0 conn(0x7f85d40b20e0 legacy=0x7f85d4143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d8dcf700 1 -- 172.21.15.57:0/1312175875 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40ae950 con 0x7f85d40aff70 2021-06-25T04:51:36.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d8dcf700 1 --2- 172.21.15.57:0/1312175875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85d40aff70 0x7f85d40b14d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f85cc0032f0 tx=0x7f85cc0091d0).ready entity=mon.1 client_cookie=4053cedbfb156687 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:36.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d37fe700 1 -- 172.21.15.57:0/1312175875 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85cc00b600 con 0x7f85d40aff70 2021-06-25T04:51:36.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d37fe700 1 -- 172.21.15.57:0/1312175875 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00b760 con 0x7f85d40aff70 2021-06-25T04:51:36.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85d37fe700 1 -- 172.21.15.57:0/1312175875 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85cc00b8d0 con 0x7f85d40aff70 2021-06-25T04:51:36.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85da832700 1 -- 172.21.15.57:0/1312175875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85d40aff70 msgr2=0x7f85d40b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85da832700 1 --2- 172.21.15.57:0/1312175875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85d40aff70 0x7f85d40b14d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f85cc0032f0 tx=0x7f85cc0091d0).stop 2021-06-25T04:51:36.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85da832700 1 -- 172.21.15.57:0/1312175875 shutdown_connections 2021-06-25T04:51:36.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85da832700 1 --2- 172.21.15.57:0/1312175875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85d40aff70 0x7f85d40b14d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85da832700 1 -- 172.21.15.57:0/1312175875 >> 172.21.15.57:0/1312175875 conn(0x7f85d405f670 msgr2=0x7f85d405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:36.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85da832700 1 -- 172.21.15.57:0/1312175875 shutdown_connections 2021-06-25T04:51:36.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.139+0000 7f85da832700 1 -- 172.21.15.57:0/1312175875 wait complete. 2021-06-25T04:51:36.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85da832700 1 Processor -- start 2021-06-25T04:51:36.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85da832700 1 -- start start 2021-06-25T04:51:36.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85da832700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85d40acff0 0x7f85d40a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85da832700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85d40aff70 0x7f85d409f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85da832700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85d40b20e0 0x7f85d409f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85da832700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4145070 con 0x7f85d40acff0 2021-06-25T04:51:36.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85da832700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4144790 con 0x7f85d40b20e0 2021-06-25T04:51:36.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85da832700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d41452a0 con 0x7f85d40aff70 2021-06-25T04:51:36.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85d3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85d40acff0 0x7f85d40a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85d3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85d40acff0 0x7f85d40a9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38300/0 (socket says 172.21.15.57:38300) 2021-06-25T04:51:36.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85d3fff700 1 -- 172.21.15.57:0/59910583 learned_addr learned my addr 172.21.15.57:0/59910583 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:36.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85d8dcf700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85d40b20e0 0x7f85d409f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85cb7fe700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85d40aff70 0x7f85d409f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85d3fff700 1 -- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85d40aff70 msgr2=0x7f85d409f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85d3fff700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85d40aff70 0x7f85d409f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85d3fff700 1 -- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85d40b20e0 msgr2=0x7f85d409f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85d3fff700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85d40b20e0 0x7f85d409f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.143+0000 7f85d3fff700 1 -- 172.21.15.57:0/59910583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc009470 con 0x7f85d40acff0 2021-06-25T04:51:36.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.147+0000 7f85d3fff700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85d40acff0 0x7f85d40a9910 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f85c40010d0 tx=0x7f85c4007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:36.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.147+0000 7f85d1ffb700 1 -- 172.21.15.57:0/59910583 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c400ce50 con 0x7f85d40acff0 2021-06-25T04:51:36.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.147+0000 7f85d1ffb700 1 -- 172.21.15.57:0/59910583 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c40070d0 con 0x7f85d40acff0 2021-06-25T04:51:36.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.147+0000 7f85da832700 1 -- 172.21.15.57:0/59910583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d4145540 con 0x7f85d40acff0 2021-06-25T04:51:36.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.147+0000 7f85d1ffb700 1 -- 172.21.15.57:0/59910583 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c4007430 con 0x7f85d40acff0 2021-06-25T04:51:36.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.147+0000 7f85da832700 1 -- 172.21.15.57:0/59910583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d4144a30 con 0x7f85d40acff0 2021-06-25T04:51:36.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.147+0000 7f85da832700 1 -- 172.21.15.57:0/59910583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d40aa9f0 con 0x7f85d40acff0 2021-06-25T04:51:36.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.147+0000 7f85d1ffb700 1 -- 172.21.15.57:0/59910583 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f85c401a070 con 0x7f85d40acff0 2021-06-25T04:51:36.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.151+0000 7f85d1ffb700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f85ac0553d0 0x7f85ac057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.151+0000 7f85d1ffb700 1 -- 172.21.15.57:0/59910583 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f85c406cdb0 con 0x7f85d40acff0 2021-06-25T04:51:36.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.151+0000 7f85cb7fe700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f85ac0553d0 0x7f85ac057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.151+0000 7f85cb7fe700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f85ac0553d0 0x7f85ac057890 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f85bc00d000 tx=0x7f85bc007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:36.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.155+0000 7f85d1ffb700 1 -- 172.21.15.57:0/59910583 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f85c4042f60 con 0x7f85d40acff0 2021-06-25T04:51:36.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.279+0000 7f85da832700 1 -- 172.21.15.57:0/59910583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85d4057310 con 0x7f85d40acff0 2021-06-25T04:51:36.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.279+0000 7f85d1ffb700 1 -- 172.21.15.57:0/59910583 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+10 (secure 0 0 0) 0x7f85c4046580 con 0x7f85d40acff0 2021-06-25T04:51:36.285 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:51:36.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 -- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f85ac0553d0 msgr2=0x7f85ac057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f85ac0553d0 0x7f85ac057890 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f85bc00d000 tx=0x7f85bc007a20).stop 2021-06-25T04:51:36.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 -- 172.21.15.57:0/59910583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85d40acff0 msgr2=0x7f85d40a9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85d40acff0 0x7f85d40a9910 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f85c40010d0 tx=0x7f85c4007b00).stop 2021-06-25T04:51:36.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 -- 172.21.15.57:0/59910583 shutdown_connections 2021-06-25T04:51:36.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f85ac0553d0 0x7f85ac057890 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85d40b20e0 0x7f85d409f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85d40aff70 0x7f85d409f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 --2- 172.21.15.57:0/59910583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85d40acff0 0x7f85d40a9910 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 -- 172.21.15.57:0/59910583 >> 172.21.15.57:0/59910583 conn(0x7f85d405f670 msgr2=0x7f85d405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:36.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 -- 172.21.15.57:0/59910583 shutdown_connections 2021-06-25T04:51:36.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.283+0000 7f85da832700 1 -- 172.21.15.57:0/59910583 wait complete. 2021-06-25T04:51:36.297 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:51:36.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:51:36.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.391+0000 7fc7d361f700 1 Processor -- start 2021-06-25T04:51:36.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.391+0000 7fc7d361f700 1 -- start start 2021-06-25T04:51:36.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.391+0000 7fc7d361f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc0b7630 0x7fc7cc143b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.391+0000 7fc7d361f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc7cc0b2740 0x7fc7cc0b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.391+0000 7fc7d361f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc7cc1403e0 0x7fc7cc140850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc140d40 con 0x7fc7cc1403e0 2021-06-25T04:51:36.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc144020 con 0x7fc7cc0b2740 2021-06-25T04:51:36.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc143150 con 0x7fc7cc0b7630 2021-06-25T04:51:36.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d1bbc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc7cc1403e0 0x7fc7cc140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d1bbc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc7cc1403e0 0x7fc7cc140850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38312/0 (socket says 172.21.15.57:38312) 2021-06-25T04:51:36.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d1bbc700 1 -- 172.21.15.57:0/3778684800 learned_addr learned my addr 172.21.15.57:0/3778684800 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:36.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d0bba700 1 --2- 172.21.15.57:0/3778684800 >> v2:172.21.15.87:3300/0 conn(0x7fc7cc0b2740 0x7fc7cc0b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d13bb700 1 --2- 172.21.15.57:0/3778684800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc0b7630 0x7fc7cc143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d1bbc700 1 -- 172.21.15.57:0/3778684800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc0b7630 msgr2=0x7fc7cc143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:36.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d1bbc700 1 --2- 172.21.15.57:0/3778684800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc0b7630 0x7fc7cc143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d1bbc700 1 -- 172.21.15.57:0/3778684800 >> v2:172.21.15.87:3300/0 conn(0x7fc7cc0b2740 msgr2=0x7fc7cc0b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:51:36.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d1bbc700 1 --2- 172.21.15.57:0/3778684800 >> v2:172.21.15.87:3300/0 conn(0x7fc7cc0b2740 0x7fc7cc0b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d1bbc700 1 -- 172.21.15.57:0/3778684800 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc1433f0 con 0x7fc7cc1403e0 2021-06-25T04:51:36.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d0bba700 1 --2- 172.21.15.57:0/3778684800 >> v2:172.21.15.87:3300/0 conn(0x7fc7cc0b2740 0x7fc7cc0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:51:36.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d1bbc700 1 --2- 172.21.15.57:0/3778684800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7cc1403e0 0x7fc7cc140850 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fc7c40032f0 tx=0x7fc7c4009290).ready entity=mon.0 client_cookie=e98c964ef391a189 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:36.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7c3fff700 1 -- 172.21.15.57:0/3778684800 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c400b680 con 0x7fc7cc1403e0 2021-06-25T04:51:36.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7c3fff700 1 -- 172.21.15.57:0/3778684800 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c400b7e0 con 0x7fc7cc1403e0 2021-06-25T04:51:36.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7c3fff700 1 -- 172.21.15.57:0/3778684800 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c400b950 con 0x7fc7cc1403e0 2021-06-25T04:51:36.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 -- 172.21.15.57:0/3778684800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7cc1403e0 msgr2=0x7fc7cc140850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 --2- 172.21.15.57:0/3778684800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7cc1403e0 0x7fc7cc140850 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fc7c40032f0 tx=0x7fc7c4009290).stop 2021-06-25T04:51:36.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 -- 172.21.15.57:0/3778684800 shutdown_connections 2021-06-25T04:51:36.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 --2- 172.21.15.57:0/3778684800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7cc1403e0 0x7fc7cc140850 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 --2- 172.21.15.57:0/3778684800 >> v2:172.21.15.87:3300/0 conn(0x7fc7cc0b2740 0x7fc7cc0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 --2- 172.21.15.57:0/3778684800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc0b7630 0x7fc7cc143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 -- 172.21.15.57:0/3778684800 >> 172.21.15.57:0/3778684800 conn(0x7fc7cc05f670 msgr2=0x7fc7cc05fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:36.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 -- 172.21.15.57:0/3778684800 shutdown_connections 2021-06-25T04:51:36.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.395+0000 7fc7d361f700 1 -- 172.21.15.57:0/3778684800 wait complete. 2021-06-25T04:51:36.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d361f700 1 Processor -- start 2021-06-25T04:51:36.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d361f700 1 -- start start 2021-06-25T04:51:36.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d361f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7cc0b2740 0x7fc7cc149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d361f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7cc0b7630 0x7fc7cc1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d361f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc1403e0 0x7fc7cc1527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d361f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0ad4c0 con 0x7fc7cc0b2740 2021-06-25T04:51:36.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d361f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0ad760 con 0x7fc7cc0b7630 2021-06-25T04:51:36.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d361f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0ada00 con 0x7fc7cc1403e0 2021-06-25T04:51:36.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d13bb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7cc0b2740 0x7fc7cc149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d13bb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7cc0b2740 0x7fc7cc149930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38314/0 (socket says 172.21.15.57:38314) 2021-06-25T04:51:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d13bb700 1 -- 172.21.15.57:0/1477016796 learned_addr learned my addr 172.21.15.57:0/1477016796 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:51:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d0bba700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7cc0b7630 0x7fc7cc1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d1bbc700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc1403e0 0x7fc7cc1527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d13bb700 1 -- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc1403e0 msgr2=0x7fc7cc1527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d13bb700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc1403e0 0x7fc7cc1527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d13bb700 1 -- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7cc0b7630 msgr2=0x7fc7cc1522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d13bb700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7cc0b7630 0x7fc7cc1522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d13bb700 1 -- 172.21.15.57:0/1477016796 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c800b180 con 0x7fc7cc0b2740 2021-06-25T04:51:36.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d13bb700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7cc0b2740 0x7fc7cc149930 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc7bc00c000 tx=0x7fc7bc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:36.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7c27fc700 1 -- 172.21.15.57:0/1477016796 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7bc010780 con 0x7fc7cc0b2740 2021-06-25T04:51:36.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7c27fc700 1 -- 172.21.15.57:0/1477016796 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc0108e0 con 0x7fc7cc0b2740 2021-06-25T04:51:36.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d361f700 1 -- 172.21.15.57:0/1477016796 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c4009530 con 0x7fc7cc0b2740 2021-06-25T04:51:36.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7c27fc700 1 -- 172.21.15.57:0/1477016796 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7bc010c40 con 0x7fc7cc0b2740 2021-06-25T04:51:36.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.399+0000 7fc7d361f700 1 -- 172.21.15.57:0/1477016796 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc0abf30 con 0x7fc7cc0b2740 2021-06-25T04:51:36.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.403+0000 7fc7d361f700 1 -- 172.21.15.57:0/1477016796 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc057310 con 0x7fc7cc0b2740 2021-06-25T04:51:36.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.403+0000 7fc7c27fc700 1 -- 172.21.15.57:0/1477016796 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc7bc01c460 con 0x7fc7cc0b2740 2021-06-25T04:51:36.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.403+0000 7fc7c27fc700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b40553d0 0x7fc7b4057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:51:36.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.403+0000 7fc7c27fc700 1 -- 172.21.15.57:0/1477016796 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc7bc06e400 con 0x7fc7cc0b2740 2021-06-25T04:51:36.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.403+0000 7fc7d0bba700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b40553d0 0x7fc7b4057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:51:36.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.403+0000 7fc7d0bba700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b40553d0 0x7fc7b4057890 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc7c800b000 tx=0x7fc7c8006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:51:36.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.411+0000 7fc7c27fc700 1 -- 172.21.15.57:0/1477016796 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc7bc0444b0 con 0x7fc7cc0b2740 2021-06-25T04:51:36.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.571+0000 7fc7d361f700 1 -- 172.21.15.57:0/1477016796 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7cc0b18f0 con 0x7fc7cc0b2740 2021-06-25T04:51:36.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.571+0000 7fc7c27fc700 1 -- 172.21.15.57:0/1477016796 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2486 (secure 0 0 0) 0x7fc7bc047ad0 con 0x7fc7cc0b2740 2021-06-25T04:51:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:51:36.577 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/289042329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":289042329},{"type":"v1","addr":"172.21.15.87:6835","nonce":289042329}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/824739091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":824739091},{"type":"v1","addr":"172.21.15.57:6833","nonce":824739091}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:51:09.583588+0000","modified":"2021-06-25T04:51:11.349725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3353139901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3353139901},{"type":"v1","addr":"172.21.15.57:6835","nonce":3353139901}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-06-25T04:51:36.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 -- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b40553d0 msgr2=0x7fc7b4057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b40553d0 0x7fc7b4057890 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fc7c800b000 tx=0x7fc7c8006df0).stop 2021-06-25T04:51:36.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 -- 172.21.15.57:0/1477016796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7cc0b2740 msgr2=0x7fc7cc149930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:51:36.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7cc0b2740 0x7fc7cc149930 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc7bc00c000 tx=0x7fc7bc006df0).stop 2021-06-25T04:51:36.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 -- 172.21.15.57:0/1477016796 shutdown_connections 2021-06-25T04:51:36.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b40553d0 0x7fc7b4057890 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc1403e0 0x7fc7cc1527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7cc0b7630 0x7fc7cc1522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 --2- 172.21.15.57:0/1477016796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7cc0b2740 0x7fc7cc149930 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:51:36.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 -- 172.21.15.57:0/1477016796 >> 172.21.15.57:0/1477016796 conn(0x7fc7cc05f670 msgr2=0x7fc7cc0b7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:51:36.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 -- 172.21.15.57:0/1477016796 shutdown_connections 2021-06-25T04:51:36.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:51:36.575+0000 7fc7d361f700 1 -- 172.21.15.57:0/1477016796 wait complete. 2021-06-25T04:51:36.584 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2021-06-25T04:51:36.893 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:51:09.583588+0000', 'modified': '2021-06-25T04:51:11.349725+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5634': {'gid': 5634, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/3353139901', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 3353139901}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3353139901}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:51:36.893 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:51:36.894 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:51:37.008 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":5634,"want_state":"up:active","state":"up:active","rank_uptime":27.410850253,"mdsmap_epoch":25,"osdmap_epoch":56,"osdmap_epoch_barrier":56,"uptime":31.698782114} 2021-06-25T04:51:37.009 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 5634, "mdsmap_epoch": 25, "osdmap_epoch": 56, "osdmap_epoch_barrier": 56, "rank_uptime": 27.410850253, "state": "up:active", "uptime": 31.698782114, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:51:37.009 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:51:37.010 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:51:37.010 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:51:37.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:37.011 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:37.019 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:51:37.082 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:51:37.082 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:51:37.092 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:51:37.094 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:51:37.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:37.095 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:51:37.101 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:51:37.101 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:37.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:51:37.121 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:51:37.121 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:51:37.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:51:37.186+0000 7ff3e1944080 -1 init, newargv = 0x55a0c74ad8e0 newargc=9 2021-06-25T04:51:37.180 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14793]: starting ceph client 2021-06-25T04:51:37.184 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:51:37.185 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:51:37.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:37.188 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:51:37.191 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14793]: starting fuse 2021-06-25T04:51:37.195 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:51:37.195 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:51:37.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:37.196 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:51:37.196 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:51:37.197 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:51:37.197 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:51:37.198 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:51:37.198 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:51:37.198 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:51:37.199 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:51:37.199 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:51:37.200 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:51:37.200 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:51:37.201 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:51:37.201 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:51:37.201 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:51:37.202 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:51:37.202 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:51:37.203 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:51:37.203 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:51:37.203 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:51:37.204 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:51:37.205 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:51:37.205 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:51:37.206 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:51:37.248 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.14793.asok 2021-06-25T04:51:37.253 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14793.asok 2021-06-25T04:51:37.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:37.254 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14793.asok status 2021-06-25T04:51:37.391 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:51:37.391 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:51:37.391 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:51:37.391 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:51:37.392 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:51:37.392 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:51:37.392 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:51:37.392 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "14793", 2021-06-25T04:51:37.393 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:51:37.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:51:37.393 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:51:37.393 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:51:37.394 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 5785, 2021-06-25T04:51:37.394 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:51:37.394 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:51:37.394 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:51:37.395 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 5785 2021-06-25T04:51:37.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:51:37.395 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:51:37.395 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:51:37.396 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:51:37.396 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1822943922 2021-06-25T04:51:37.396 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:51:37.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:51:37.396 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:51:37.397 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:51:37.397 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:51:37.397 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1822943922 2021-06-25T04:51:37.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:51:37.398 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.5785 172.21.15.102:0/1822943922", 2021-06-25T04:51:37.398 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/1822943922", 2021-06-25T04:51:37.398 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:51:37.398 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 25, 2021-06-25T04:51:37.398 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 56, 2021-06-25T04:51:37.399 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:51:37.399 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:51:37.399 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:51:37.399 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:51:37.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:37.401 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:51:37.401 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:37.409 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:51:37.410 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:51:37.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:51:37.411 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:51:37.503 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:51:37.506 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:51:37.509 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:51:37.511 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:52:07.557 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:52:07.561 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:52:07.564 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:52:07.567 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:52:30.309 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:52:30.310 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:52:30.333 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:52:30.357 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:52:30.377 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:52:30.402 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:52:30.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:30.404 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:52:30.405 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:52:30.416 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:52:30.417 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:52:30.418 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:52:30.418 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:52:30.419 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:52:30.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14793]: fuse finished with error 0 and tester_r 0 2021-06-25T04:52:30.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:30.481 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:52:30.481 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:52:30.490 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:52:30.492 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:52:30.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:52:30.609 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:52:30.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:30.661 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:52:30.661 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:52:30.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:52:30.671 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:52:30.672 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:52:30.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:52:30.673 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:52:30.719 INFO:teuthology.orchestra.run.smithi161.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:52:30.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:52:30.721 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:52:30.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.831+0000 7fb05139a700 1 Processor -- start 2021-06-25T04:52:30.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.831+0000 7fb05139a700 1 -- start start 2021-06-25T04:52:30.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.831+0000 7fb05139a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb04c0b2810 0x7fb04c0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:30.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.831+0000 7fb05139a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb04c13c6a0 0x7fb04c13cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:30.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.831+0000 7fb05139a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c0b2bf0 con 0x7fb04c0acee0 2021-06-25T04:52:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.831+0000 7fb05139a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c0b1620 con 0x7fb04c13c6a0 2021-06-25T04:52:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.831+0000 7fb05139a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c0b18c0 con 0x7fb04c0b2810 2021-06-25T04:52:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb04c13c6a0 0x7fb04c13cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb04c13c6a0 0x7fb04c13cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38324/0 (socket says 172.21.15.57:38324) 2021-06-25T04:52:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb050b99700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb04c0acee0 0x7fb04c0ad300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55544/0 (socket says 172.21.15.57:55544) 2021-06-25T04:52:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04b7fe700 1 -- 172.21.15.57:0/2391601744 learned_addr learned my addr 172.21.15.57:0/2391601744 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04bfff700 1 --2- 172.21.15.57:0/2391601744 >> v2:172.21.15.87:3300/0 conn(0x7fb04c0b2810 0x7fb04c0b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04b7fe700 1 -- 172.21.15.57:0/2391601744 >> v2:172.21.15.87:3300/0 conn(0x7fb04c0b2810 msgr2=0x7fb04c0b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04b7fe700 1 --2- 172.21.15.57:0/2391601744 >> v2:172.21.15.87:3300/0 conn(0x7fb04c0b2810 0x7fb04c0b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04b7fe700 1 -- 172.21.15.57:0/2391601744 >> v1:172.21.15.57:6789/0 conn(0x7fb04c0acee0 legacy=0x7fb04c0ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04affd700 1 -- 172.21.15.57:0/2391601744 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680964603 0 0) 0x7fb04c0b2bf0 con 0x7fb04c0acee0 2021-06-25T04:52:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04b7fe700 1 -- 172.21.15.57:0/2391601744 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0b1b60 con 0x7fb04c13c6a0 2021-06-25T04:52:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04b7fe700 1 --2- 172.21.15.57:0/2391601744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c13c6a0 0x7fb04c13cae0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fb03c002f70 tx=0x7fb03c006f40).ready entity=mon.0 client_cookie=f9ecfd60842d71e4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04affd700 1 -- 172.21.15.57:0/2391601744 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb03c00c880 con 0x7fb04c13c6a0 2021-06-25T04:52:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04affd700 1 -- 172.21.15.57:0/2391601744 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c000e90 con 0x7fb04c13c6a0 2021-06-25T04:52:30.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb04affd700 1 -- 172.21.15.57:0/2391601744 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb03c00cbd0 con 0x7fb04c13c6a0 2021-06-25T04:52:30.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb05139a700 1 -- 172.21.15.57:0/2391601744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c13c6a0 msgr2=0x7fb04c13cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:30.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb05139a700 1 --2- 172.21.15.57:0/2391601744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c13c6a0 0x7fb04c13cae0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fb03c002f70 tx=0x7fb03c006f40).stop 2021-06-25T04:52:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb05139a700 1 -- 172.21.15.57:0/2391601744 shutdown_connections 2021-06-25T04:52:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb05139a700 1 --2- 172.21.15.57:0/2391601744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c13c6a0 0x7fb04c13cae0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb05139a700 1 --2- 172.21.15.57:0/2391601744 >> v2:172.21.15.87:3300/0 conn(0x7fb04c0b2810 0x7fb04c0b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb05139a700 1 -- 172.21.15.57:0/2391601744 >> 172.21.15.57:0/2391601744 conn(0x7fb04c0611f0 msgr2=0x7fb04c062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb05139a700 1 -- 172.21.15.57:0/2391601744 shutdown_connections 2021-06-25T04:52:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.835+0000 7fb05139a700 1 -- 172.21.15.57:0/2391601744 wait complete. 2021-06-25T04:52:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb05139a700 1 Processor -- start 2021-06-25T04:52:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb05139a700 1 -- start start 2021-06-25T04:52:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb05139a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0acee0 0x7fb04c0ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb05139a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb04c0b2810 0x7fb04c063ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb05139a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb04c13c6a0 0x7fb04c0643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb05139a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c142720 con 0x7fb04c0acee0 2021-06-25T04:52:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb05139a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c1416f0 con 0x7fb04c13c6a0 2021-06-25T04:52:30.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb05139a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c140740 con 0x7fb04c0b2810 2021-06-25T04:52:30.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb04bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0acee0 0x7fb04c0ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:30.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb04bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0acee0 0x7fb04c0ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38328/0 (socket says 172.21.15.57:38328) 2021-06-25T04:52:30.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb04bfff700 1 -- 172.21.15.57:0/1465152152 learned_addr learned my addr 172.21.15.57:0/1465152152 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:30.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb050b99700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb04c13c6a0 0x7fb04c0643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.839+0000 7fb04b7fe700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb04c0b2810 0x7fb04c063ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb04bfff700 1 -- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb04c0b2810 msgr2=0x7fb04c063ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb04bfff700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb04c0b2810 0x7fb04c063ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb04bfff700 1 -- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb04c13c6a0 msgr2=0x7fb04c0643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:30.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb04bfff700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb04c13c6a0 0x7fb04c0643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:30.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb04bfff700 1 -- 172.21.15.57:0/1465152152 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c00a360 con 0x7fb04c0acee0 2021-06-25T04:52:30.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb04bfff700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0acee0 0x7fb04c0ada00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fb03400c000 tx=0x7fb034006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:30.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb0497fa700 1 -- 172.21.15.57:0/1465152152 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb034015660 con 0x7fb04c0acee0 2021-06-25T04:52:30.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb0497fa700 1 -- 172.21.15.57:0/1465152152 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0340157c0 con 0x7fb04c0acee0 2021-06-25T04:52:30.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb05139a700 1 -- 172.21.15.57:0/1465152152 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c141920 con 0x7fb04c0acee0 2021-06-25T04:52:30.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb0497fa700 1 -- 172.21.15.57:0/1465152152 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb034015b20 con 0x7fb04c0acee0 2021-06-25T04:52:30.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb05139a700 1 -- 172.21.15.57:0/1465152152 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c151200 con 0x7fb04c0acee0 2021-06-25T04:52:30.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb05139a700 1 -- 172.21.15.57:0/1465152152 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c140d20 con 0x7fb04c0acee0 2021-06-25T04:52:30.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb0497fa700 1 -- 172.21.15.57:0/1465152152 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb03401c030 con 0x7fb04c0acee0 2021-06-25T04:52:30.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb0497fa700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0300553d0 0x7fb030057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:30.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb0497fa700 1 -- 172.21.15.57:0/1465152152 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb03406ff20 con 0x7fb04c0acee0 2021-06-25T04:52:30.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.843+0000 7fb04b7fe700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0300553d0 0x7fb030057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:30.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.847+0000 7fb04b7fe700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0300553d0 0x7fb030057890 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fb03c01a000 tx=0x7fb04c0aeea0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:30.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.847+0000 7fb0497fa700 1 -- 172.21.15.57:0/1465152152 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb034046070 con 0x7fb04c0acee0 2021-06-25T04:52:30.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.975+0000 7fb05139a700 1 -- 172.21.15.57:0/1465152152 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb04c057310 con 0x7fb04c0acee0 2021-06-25T04:52:30.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.975+0000 7fb0497fa700 1 -- 172.21.15.57:0/1465152152 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v56) v1 ==== 81+0+34039 (secure 0 0 0) 0x7fb03402c510 con 0x7fb04c0acee0 2021-06-25T04:52:30.980 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:30.982 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:52:30.982 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 56, 2021-06-25T04:52:30.982 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:52:30.983 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:52:30.983 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:51:10.586886+0000", 2021-06-25T04:52:30.984 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:52:30.984 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:52:30.984 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:52:30.985 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:52:30.985 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:52:30.985 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:52:30.986 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:52:30.986 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:52:30.986 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:52:30.986 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:52:30.987 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:52:30.987 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:52:30.987 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:52:30.987 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:52:30.987 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:52:30.988 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 10, 2021-06-25T04:52:30.988 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:52:30.988 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:52:30.988 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:52:30.989 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:52:30.989 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:52:30.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:30.989 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:52:30.989 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:52:30.990 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:52:30.990 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:52:30.990 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:52:30.990 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:52:30.991 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:52:30.991 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:52:30.991 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:52:30.991 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:52:30.991 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:52:30.992 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:52:30.992 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:52:30.992 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:52:30.992 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:52:30.993 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:52:30.993 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:52:30.993 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:52:30.993 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:52:30.993 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:52:30.994 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:52:30.994 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:52:30.994 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:52:30.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:30.995 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:52:30.995 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:52:30.995 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:52:30.996 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:52:30.996 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:52:30.997 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:52:30.997 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:52:30.997 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:52:30.997 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:52:30.998 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:52:30.998 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:52:30.998 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:52:30.998 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:52:30.999 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:52:30.999 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:52:30.999 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:52:30.999 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:52:30.999 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:52:31.000 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:52:31.000 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:52:31.000 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:52:31.000 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:52:31.001 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:52:31.001 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:52:31.001 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:52:31.002 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:52:31.002 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:52:31.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.002 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:52:31.003 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:52:31.003 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:52:31.004 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:52:31.004 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:52:31.004 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:52:31.005 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:52:31.005 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:52:31.006 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:52:31.006 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:52:31.007 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:52:31.007 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:52:31.007 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:52:31.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.008 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:52:31.009 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:52:31.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.010 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:52:31.010 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:52:31.010 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:52:31.011 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:52:31.011 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:52:31.011 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:52:31.011 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:52:31.011 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:52:31.012 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:52:31.012 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:52:31.013 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:52:31.013 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:52:31.013 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:52:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:52:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:52:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:52:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:52:31.015 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:52:31.015 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:52:31.015 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:52:31.015 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:52:31.016 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:52:31.016 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:52:31.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.016 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:52:31.017 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:52:31.017 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:52:31.017 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:52:31.017 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:52:31.017 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:52:31.018 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:52:31.018 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:52:31.018 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:52:31.018 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:52:31.019 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:52:31.019 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:52:31.019 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:52:31.019 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:52:31.020 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:52:31.020 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:52:31.020 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:52:31.020 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:52:31.021 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:52:31.021 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:52:31.021 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:52:31.021 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:52:31.021 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:52:31.022 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:52:31.022 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:52:31.022 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:52:31.022 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:52:31.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.023 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:52:31.023 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:52:31.023 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:52:31.023 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:52:31.024 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:52:31.024 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:52:31.024 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:52:31.024 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:52:31.024 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:52:31.025 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:52:31.025 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:52:31.025 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:52:31.025 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:52:31.026 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:52:31.026 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.026 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 9, 2021-06-25T04:52:31.027 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:52:31.027 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:51:08.069175+0000", 2021-06-25T04:52:31.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:52:31.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:52:31.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:52:31.028 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:52:31.028 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:52:31.028 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:52:31.028 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:52:31.029 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:52:31.029 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:52:31.029 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:52:31.029 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:52:31.029 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:52:31.030 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:52:31.030 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:52:31.030 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:52:31.030 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:52:31.031 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:52:31.031 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:52:31.031 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:52:31.031 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:52:31.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.032 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "55", 2021-06-25T04:52:31.032 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:52:31.032 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:52:31.032 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:52:31.032 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:52:31.033 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:52:31.033 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:52:31.033 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:52:31.033 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:52:31.034 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:52:31.034 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:52:31.034 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:52:31.034 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:52:31.034 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:52:31.035 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:52:31.035 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:52:31.035 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:52:31.035 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:52:31.036 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:52:31.036 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:52:31.036 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:52:31.036 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:52:31.036 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:52:31.037 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:52:31.037 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:52:31.037 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:52:31.037 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:52:31.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.038 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:52:31.038 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:52:31.038 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:52:31.038 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:52:31.039 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:52:31.039 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:52:31.039 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:52:31.039 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:52:31.039 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:52:31.040 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:52:31.040 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:52:31.040 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:52:31.040 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:52:31.041 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:52:31.041 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:52:31.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.041 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:52:31.041 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:52:31.042 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:52:31.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.043 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 10, 2021-06-25T04:52:31.043 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:52:31.043 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:51:08.684458+0000", 2021-06-25T04:52:31.043 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:52:31.044 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:52:31.044 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:52:31.044 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:52:31.044 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:52:31.044 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:52:31.045 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:52:31.045 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:52:31.045 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:52:31.045 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:52:31.046 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:52:31.046 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:52:31.046 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:52:31.046 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:52:31.046 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:52:31.047 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:52:31.047 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:52:31.047 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:52:31.047 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:52:31.048 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:52:31.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.048 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "56", 2021-06-25T04:52:31.048 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:52:31.048 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:52:31.049 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:52:31.049 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:52:31.049 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:52:31.049 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:52:31.049 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:52:31.050 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:52:31.050 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:52:31.050 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:52:31.050 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:52:31.051 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:52:31.051 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:52:31.051 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:52:31.051 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:52:31.051 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:52:31.052 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:52:31.052 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:52:31.052 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:52:31.052 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:52:31.053 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:52:31.053 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:52:31.053 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:52:31.053 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:52:31.053 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:52:31.054 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:52:31.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.054 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:52:31.054 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:52:31.054 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:52:31.055 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:52:31.055 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:52:31.055 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:52:31.055 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:52:31.056 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:52:31.056 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:52:31.056 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:52:31.056 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:52:31.057 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:52:31.057 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:52:31.057 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:52:31.057 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:52:31.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.058 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:52:31.058 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:52:31.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.059 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:52:31.059 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:52:31.059 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:31.060 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:31.060 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:31.060 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:31.060 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:31.060 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:31.061 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:31.061 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 53, 2021-06-25T04:52:31.061 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:31.061 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:31.061 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:31.062 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.062 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.062 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:52:31.063 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:31.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.063 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.063 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:52:31.064 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:31.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.064 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.064 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:31.065 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.065 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.065 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:52:31.066 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:31.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.066 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.066 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:52:31.067 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:31.067 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.067 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.069 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:52:31.069 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:31.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.069 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.070 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:52:31.070 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:31.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.070 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.072 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:52:31.072 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:31.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.072 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.073 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:52:31.073 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:31.073 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.073 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.074 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:52:31.074 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:52:31.074 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:52:31.074 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:52:31.075 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:31.075 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:31.075 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:31.075 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.076 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:52:31.076 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:52:31.076 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:31.077 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:31.077 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:31.077 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:31.077 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:31.077 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:31.078 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:31.078 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 53, 2021-06-25T04:52:31.078 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:31.079 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:31.079 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:31.079 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.079 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.080 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:52:31.080 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:31.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.081 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.081 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:52:31.081 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:31.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.081 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.082 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:31.082 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.083 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.083 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:52:31.083 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:31.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.084 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.084 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:52:31.084 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:31.085 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.085 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.085 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:31.085 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.086 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.086 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:52:31.086 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:31.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.087 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.087 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:52:31.087 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:31.088 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.088 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.088 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:31.089 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.089 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.089 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:52:31.089 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:31.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.090 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.090 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:52:31.090 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:31.091 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.091 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.091 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:52:31.092 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:52:31.092 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:52:31.092 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:52:31.092 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:31.092 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:31.093 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:31.093 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.093 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:52:31.094 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:52:31.094 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:31.094 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:31.094 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:31.095 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:31.095 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:31.095 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:31.095 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:31.095 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 54, 2021-06-25T04:52:31.096 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:31.096 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:31.096 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:31.096 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.097 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.097 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:52:31.097 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:31.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.098 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.098 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:52:31.098 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:31.098 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.099 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.099 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:31.099 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.100 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.100 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:52:31.100 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:31.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.101 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.101 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:52:31.101 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:31.101 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.102 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.102 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:31.102 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.103 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.103 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:52:31.103 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:31.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.104 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.104 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:52:31.104 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:31.104 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.105 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.105 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:31.105 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.106 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.106 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:52:31.106 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:31.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.107 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.107 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:52:31.107 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:31.108 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.108 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.108 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:52:31.108 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:52:31.109 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:52:31.109 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:52:31.109 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:31.109 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:31.109 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:31.110 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.110 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:52:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:52:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:31.112 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:31.112 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:31.112 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:31.112 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 52, 2021-06-25T04:52:31.112 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:31.113 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:31.113 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:31.113 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.114 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.114 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:52:31.114 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:31.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.115 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.115 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:52:31.115 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:31.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.116 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.116 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:31.116 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.117 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.117 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:52:31.117 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:31.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.118 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.118 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:52:31.118 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:31.118 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.119 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.119 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:31.119 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.120 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.120 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:52:31.120 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:31.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.121 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.121 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:52:31.121 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:31.121 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.122 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.122 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:31.122 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.123 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.123 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:52:31.123 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:31.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.124 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.124 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:52:31.124 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:31.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.125 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.125 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:52:31.125 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:52:31.125 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:52:31.126 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:52:31.126 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:31.126 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:31.126 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:31.126 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.127 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:52:31.127 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:52:31.127 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:31.128 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:31.128 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:31.128 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:31.128 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:31.129 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:31.129 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:31.129 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 53, 2021-06-25T04:52:31.129 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:31.129 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:31.130 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:31.130 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.130 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.131 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:52:31.131 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:31.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.131 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.132 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:52:31.132 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:31.132 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.132 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.133 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:31.133 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.133 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.134 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:52:31.134 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:31.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.134 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.135 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:52:31.135 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:31.135 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.135 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.136 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:31.136 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.136 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.137 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:52:31.137 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:31.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.137 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.138 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:52:31.138 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:31.138 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.138 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.139 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:31.139 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.139 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.140 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:52:31.140 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:31.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.140 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.141 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:52:31.141 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:31.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.141 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.142 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:52:31.142 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:52:31.142 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:52:31.142 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:52:31.143 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:31.143 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:31.143 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:31.143 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.144 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:52:31.144 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:52:31.144 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:31.144 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:31.145 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:31.145 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:31.145 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:31.145 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:31.146 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:31.146 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 53, 2021-06-25T04:52:31.146 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:31.146 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:31.146 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:31.147 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.147 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.147 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:52:31.147 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:31.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.148 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.148 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:52:31.149 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:31.149 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.149 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.149 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:31.150 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.150 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.150 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:52:31.150 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:31.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.151 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.151 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:52:31.152 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:31.152 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.152 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.152 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:31.153 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.153 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.153 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:52:31.153 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:31.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.154 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.154 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:52:31.155 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:31.155 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.155 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.155 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:31.156 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.156 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.156 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:52:31.156 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:31.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.157 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.158 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:52:31.158 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:31.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.158 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.159 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:52:31.159 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:52:31.159 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:52:31.159 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:52:31.160 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:31.160 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:31.160 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:31.160 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.161 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:52:31.161 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:52:31.161 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:31.162 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:31.162 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:31.162 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:31.162 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:31.162 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:31.163 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:31.163 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 53, 2021-06-25T04:52:31.163 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:31.163 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:31.163 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:31.164 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.164 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.164 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:52:31.165 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:31.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.165 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.165 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:52:31.166 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:31.166 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.166 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.166 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:31.167 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.167 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.167 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:52:31.168 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:31.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.168 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.168 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:52:31.169 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:31.169 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.169 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.170 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:31.170 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.170 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.170 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:52:31.171 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:31.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.171 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.172 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:52:31.172 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:31.172 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.172 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.173 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:31.173 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.173 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.173 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:52:31.174 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:31.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.174 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.175 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:52:31.175 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:31.175 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.175 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.176 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:52:31.176 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:52:31.177 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:52:31.177 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:52:31.177 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:31.177 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:31.178 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:31.178 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.179 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:52:31.179 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:52:31.179 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:31.179 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:31.180 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:31.180 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:31.180 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:31.180 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:31.181 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:31.181 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 52, 2021-06-25T04:52:31.181 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:31.181 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:31.182 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:31.182 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.182 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.183 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:52:31.183 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:31.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.184 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.184 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:52:31.184 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:31.184 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.185 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.185 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:31.185 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.186 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.186 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:52:31.186 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:31.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.187 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.187 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:52:31.187 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:31.188 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.188 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.188 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:31.189 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.189 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.189 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:52:31.190 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:31.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.190 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:52:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.192 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:31.192 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:31.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.192 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:31.193 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:52:31.193 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:31.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.194 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:31.194 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:52:31.194 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:31.194 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.195 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.195 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:52:31.195 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:52:31.195 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:52:31.196 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:52:31.196 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:31.196 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:31.196 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:31.197 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:31.197 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.197 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:52:31.197 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:52:31.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.198 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:52:31.198 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:31.198 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:31.199 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:31.199 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:31.199 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:31.199 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:52:31.200 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:31.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.200 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:52:31.201 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:31.201 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:31.201 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:31.201 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:31.202 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:31.202 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:52:31.202 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:31.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.203 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:52:31.203 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:31.205 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:52:31.205 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:31.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.206 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:52:31.206 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:31.206 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:31.206 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:31.207 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:31.207 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:31.207 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:52:31.207 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:31.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.208 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:52:31.208 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:31.208 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:31.209 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:31.209 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:31.209 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:31.209 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:52:31.210 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:31.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.210 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:52:31.210 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:31.211 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:31.211 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:31.211 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:31.211 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:31.212 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:52:31.212 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:31.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.213 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:52:31.213 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:31.213 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:31.213 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:31.214 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:31.214 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:31.214 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:52:31.214 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:31.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:31.215 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:52:31.215 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:31.216 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:31.216 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:31.216 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:31.216 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:31.216 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:52:31.217 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:31.217 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.217 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:52:31.217 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:52:31.218 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:52:31.218 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:52:31.218 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:52:31.218 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": {}, 2021-06-25T04:52:31.219 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:52:31.219 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:52:31.219 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:52:31.219 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:52:31.219 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:52:31.220 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:52:31.220 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:52:31.220 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:52:31.220 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:52:31.221 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:52:31.221 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:52:31.221 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:52:31.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.222 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:52:31.222 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:52:31.222 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:52:31.222 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:52:31.222 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:52:31.223 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:52:31.223 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:52:31.223 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:31.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:31.224 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:52:31.224 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:52:31.224 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:52:31.224 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:52:31.225 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:52:31.225 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:52:31.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 -- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0300553d0 msgr2=0x7fb030057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0300553d0 0x7fb030057890 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fb03c01a000 tx=0x7fb04c0aeea0).stop 2021-06-25T04:52:31.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 -- 172.21.15.57:0/1465152152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0acee0 msgr2=0x7fb04c0ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0acee0 0x7fb04c0ada00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fb03400c000 tx=0x7fb034006df0).stop 2021-06-25T04:52:31.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 -- 172.21.15.57:0/1465152152 shutdown_connections 2021-06-25T04:52:31.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb0300553d0 0x7fb030057890 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb04c13c6a0 0x7fb04c0643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb04c0b2810 0x7fb04c063ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 --2- 172.21.15.57:0/1465152152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0acee0 0x7fb04c0ada00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 -- 172.21.15.57:0/1465152152 >> 172.21.15.57:0/1465152152 conn(0x7fb04c0611f0 msgr2=0x7fb04c13fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:31.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 -- 172.21.15.57:0/1465152152 shutdown_connections 2021-06-25T04:52:31.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:30.979+0000 7fb05139a700 1 -- 172.21.15.57:0/1465152152 wait complete. 2021-06-25T04:52:31.231 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:52:31.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.339+0000 7fda0082a700 1 Processor -- start 2021-06-25T04:52:31.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.339+0000 7fda0082a700 1 -- start start 2021-06-25T04:52:31.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fda0082a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13c6a0 0x7fd9fc13cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fda0082a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd9fc0acee0 0x7fd9fc0ad370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fda0082a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc0b2bf0 con 0x7fd9fc0b2810 2021-06-25T04:52:31.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fda0082a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc0b1170 con 0x7fd9fc0acee0 2021-06-25T04:52:31.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fda0082a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0b1620 con 0x7fd9fc13c6a0 2021-06-25T04:52:31.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fb7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd9fc0b2810 0x7fd9fc0b0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55554/0 (socket says 172.21.15.57:55554) 2021-06-25T04:52:31.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fb7fe700 1 -- 172.21.15.57:0/1754499889 learned_addr learned my addr 172.21.15.57:0/1754499889 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:31.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9f3fff700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13c6a0 0x7fd9fc13cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737861243 0 0) 0x7fd9fc0b2bf0 con 0x7fd9fc0b2810 2021-06-25T04:52:31.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9dc004370 con 0x7fd9fc0b2810 2021-06-25T04:52:31.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fbfff700 1 --2- 172.21.15.57:0/1754499889 >> v2:172.21.15.87:3300/0 conn(0x7fd9fc0acee0 0x7fd9fc0ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2468605344 0 0) 0x7fd9dc004370 con 0x7fd9fc0b2810 2021-06-25T04:52:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13c6a0 msgr2=0x7fd9fc13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13c6a0 0x7fd9fc13cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 >> v2:172.21.15.87:3300/0 conn(0x7fd9fc0acee0 msgr2=0x7fd9fc0ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:31.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 --2- 172.21.15.57:0/1754499889 >> v2:172.21.15.87:3300/0 conn(0x7fd9fc0acee0 0x7fd9fc0ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc0b18c0 con 0x7fd9fc0b2810 2021-06-25T04:52:31.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fd9ec001660 con 0x7fd9fc0b2810 2021-06-25T04:52:31.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 >> v1:172.21.15.57:6789/0 conn(0x7fd9fc0b2810 legacy=0x7fd9fc0b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9dc004860 0x7fd9dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13c6a0 0x7fd9dc005610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9dc005b00 0x7fd9dc005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0b1170 con 0x7fd9dc005b00 2021-06-25T04:52:31.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0b1620 con 0x7fd9dc004860 2021-06-25T04:52:31.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0031d0 con 0x7fd9fc13c6a0 2021-06-25T04:52:31.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fb7fe700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9dc004860 0x7fd9dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9f3fff700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13c6a0 0x7fd9dc005610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fbfff700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9dc005b00 0x7fd9dc005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fb7fe700 1 -- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13c6a0 msgr2=0x7fd9dc005610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:31.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fb7fe700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13c6a0 0x7fd9dc005610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fb7fe700 1 -- 172.21.15.57:0/1754499889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9dc005b00 msgr2=0x7fd9dc005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:31.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fb7fe700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9dc005b00 0x7fd9dc005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fb7fe700 1 -- 172.21.15.57:0/1754499889 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc004370 con 0x7fd9dc004860 2021-06-25T04:52:31.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9f3fff700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13c6a0 0x7fd9dc005610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:52:31.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fb7fe700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9dc004860 0x7fd9dc004c80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fd9ec001370 tx=0x7fd9fc13f4b0).ready entity=mon.1 client_cookie=ce1961e2907096de server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:31.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9ec0070d0 con 0x7fd9dc004860 2021-06-25T04:52:31.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec007230 con 0x7fd9dc004860 2021-06-25T04:52:31.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9faffd700 1 -- 172.21.15.57:0/1754499889 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9ec00c8f0 con 0x7fd9dc004860 2021-06-25T04:52:31.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fda0082a700 1 -- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9dc004860 msgr2=0x7fd9dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fda0082a700 1 --2- 172.21.15.57:0/1754499889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9dc004860 0x7fd9dc004c80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fd9ec001370 tx=0x7fd9fc13f4b0).stop 2021-06-25T04:52:31.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.343+0000 7fd9fbfff700 1 -- 172.21.15.57:0/1754499889 reap_dead start 2021-06-25T04:52:31.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 -- 172.21.15.57:0/1754499889 shutdown_connections 2021-06-25T04:52:31.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 -- 172.21.15.57:0/1754499889 >> 172.21.15.57:0/1754499889 conn(0x7fd9fc0611f0 msgr2=0x7fd9fc062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:31.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 -- 172.21.15.57:0/1754499889 shutdown_connections 2021-06-25T04:52:31.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 -- 172.21.15.57:0/1754499889 wait complete. 2021-06-25T04:52:31.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 Processor -- start 2021-06-25T04:52:31.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 -- start start 2021-06-25T04:52:31.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13ffb0 0x7fd9fc140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9fc141170 0x7fd9fc152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc13d350 0x7fd9fc135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1430e0 con 0x7fd9fc13d350 2021-06-25T04:52:31.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc156340 con 0x7fd9fc141170 2021-06-25T04:52:31.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fda0082a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc152370 con 0x7fd9fc13ffb0 2021-06-25T04:52:31.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fd9fbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc13d350 0x7fd9fc135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fd9fbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc13d350 0x7fd9fc135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38352/0 (socket says 172.21.15.57:38352) 2021-06-25T04:52:31.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fd9fbfff700 1 -- 172.21.15.57:0/2519249337 learned_addr learned my addr 172.21.15.57:0/2519249337 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:31.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fd9f3fff700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9fc141170 0x7fd9fc152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.347+0000 7fd9fb7fe700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13ffb0 0x7fd9fc140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9fbfff700 1 -- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13ffb0 msgr2=0x7fd9fc140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9fbfff700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13ffb0 0x7fd9fc140390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9fbfff700 1 -- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9fc141170 msgr2=0x7fd9fc152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9fbfff700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9fc141170 0x7fd9fc152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9fbfff700 1 -- 172.21.15.57:0/2519249337 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc152610 con 0x7fd9fc13d350 2021-06-25T04:52:31.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9fbfff700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc13d350 0x7fd9fc135870 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd9f400d000 tx=0x7fd9f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:31.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9f97fa700 1 -- 172.21.15.57:0/2519249337 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9f4013550 con 0x7fd9fc13d350 2021-06-25T04:52:31.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9f97fa700 1 -- 172.21.15.57:0/2519249337 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f40136b0 con 0x7fd9fc13d350 2021-06-25T04:52:31.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fda0082a700 1 -- 172.21.15.57:0/2519249337 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc152060 con 0x7fd9fc13d350 2021-06-25T04:52:31.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9f97fa700 1 -- 172.21.15.57:0/2519249337 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9f4013a50 con 0x7fd9fc13d350 2021-06-25T04:52:31.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fda0082a700 1 -- 172.21.15.57:0/2519249337 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc13d7d0 con 0x7fd9fc13d350 2021-06-25T04:52:31.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fda0082a700 1 -- 172.21.15.57:0/2519249337 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc1527a0 con 0x7fd9fc13d350 2021-06-25T04:52:31.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9f97fa700 1 -- 172.21.15.57:0/2519249337 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd9f4012040 con 0x7fd9fc13d350 2021-06-25T04:52:31.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9f97fa700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9e0055490 0x7fd9e0057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.351+0000 7fd9f97fa700 1 -- 172.21.15.57:0/2519249337 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd9f406de70 con 0x7fd9fc13d350 2021-06-25T04:52:31.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.355+0000 7fd9fb7fe700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9e0055490 0x7fd9e0057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.355+0000 7fd9fb7fe700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9e0055490 0x7fd9e0057950 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fd9ec01a000 tx=0x7fd9ec015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:31.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.359+0000 7fd9f97fa700 1 -- 172.21.15.57:0/2519249337 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd9f4043f10 con 0x7fd9fc13d350 2021-06-25T04:52:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.527+0000 7fda0082a700 1 -- 172.21.15.57:0/2519249337 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9fc057310 con 0x7fd9fc13d350 2021-06-25T04:52:31.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.527+0000 7fd9f97fa700 1 -- 172.21.15.57:0/2519249337 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2486 (secure 0 0 0) 0x7fd9f4047530 con 0x7fd9fc13d350 2021-06-25T04:52:31.531 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:31.532 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/289042329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":289042329},{"type":"v1","addr":"172.21.15.87:6835","nonce":289042329}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/824739091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":824739091},{"type":"v1","addr":"172.21.15.57:6833","nonce":824739091}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:51:09.583588+0000","modified":"2021-06-25T04:51:11.349725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3353139901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3353139901},{"type":"v1","addr":"172.21.15.57:6835","nonce":3353139901}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-06-25T04:52:31.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 -- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9e0055490 msgr2=0x7fd9e0057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9e0055490 0x7fd9e0057950 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fd9ec01a000 tx=0x7fd9ec015000).stop 2021-06-25T04:52:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 -- 172.21.15.57:0/2519249337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc13d350 msgr2=0x7fd9fc135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc13d350 0x7fd9fc135870 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd9f400d000 tx=0x7fd9f4008040).stop 2021-06-25T04:52:31.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 -- 172.21.15.57:0/2519249337 shutdown_connections 2021-06-25T04:52:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9e0055490 0x7fd9e0057950 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9fc13d350 0x7fd9fc135870 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9fc141170 0x7fd9fc152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 --2- 172.21.15.57:0/2519249337 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9fc13ffb0 0x7fd9fc140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 -- 172.21.15.57:0/2519249337 >> 172.21.15.57:0/2519249337 conn(0x7fd9fc0611f0 msgr2=0x7fd9fc0ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 -- 172.21.15.57:0/2519249337 shutdown_connections 2021-06-25T04:52:31.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.531+0000 7fda0082a700 1 -- 172.21.15.57:0/2519249337 wait complete. 2021-06-25T04:52:31.537 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2021-06-25T04:52:31.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:52:31.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfda3f700 1 Processor -- start 2021-06-25T04:52:31.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfda3f700 1 -- start start 2021-06-25T04:52:31.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfda3f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df80b2540 0x7f9df814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfda3f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df80a7080 con 0x7f9df80affd0 2021-06-25T04:52:31.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfda3f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df80a72b0 con 0x7f9df80a8a80 2021-06-25T04:52:31.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfda3f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80a7550 con 0x7f9df80b2540 2021-06-25T04:52:31.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9df7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9df80affd0 0x7f9df80a8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55574/0 (socket says 172.21.15.57:55574) 2021-06-25T04:52:31.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9df7fff700 1 -- 172.21.15.57:0/2198128475 learned_addr learned my addr 172.21.15.57:0/2198128475 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:31.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfca3d700 1 --2- 172.21.15.57:0/2198128475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df80b2540 0x7f9df814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9df77fe700 1 -- 172.21.15.57:0/2198128475 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813028341 0 0) 0x7f9df80a7080 con 0x7f9df80affd0 2021-06-25T04:52:31.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9df77fe700 1 -- 172.21.15.57:0/2198128475 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ddc003260 con 0x7f9df80affd0 2021-06-25T04:52:31.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9df77fe700 1 -- 172.21.15.57:0/2198128475 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150427074 0 0) 0x7f9df80a72b0 con 0x7f9df80a8a80 2021-06-25T04:52:31.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9df77fe700 1 -- 172.21.15.57:0/2198128475 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df80a7080 con 0x7f9df80a8a80 2021-06-25T04:52:31.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfca3d700 1 -- 172.21.15.57:0/2198128475 >> v1:172.21.15.87:6789/0 conn(0x7f9df80a8a80 legacy=0x7f9df8151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfca3d700 1 -- 172.21.15.57:0/2198128475 >> v1:172.21.15.57:6789/0 conn(0x7f9df80affd0 legacy=0x7f9df80a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfca3d700 1 -- 172.21.15.57:0/2198128475 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80a77f0 con 0x7f9df80b2540 2021-06-25T04:52:31.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfca3d700 1 --2- 172.21.15.57:0/2198128475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df80b2540 0x7f9df814ae00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9dec002f70 tx=0x7f9dec006df0).ready entity=mon.2 client_cookie=6452f330f26e0e51 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9df77fe700 1 -- 172.21.15.57:0/2198128475 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dec00d5c0 con 0x7f9df80b2540 2021-06-25T04:52:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9df77fe700 1 -- 172.21.15.57:0/2198128475 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec000e90 con 0x7f9df80b2540 2021-06-25T04:52:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9df77fe700 1 -- 172.21.15.57:0/2198128475 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dec00d910 con 0x7f9df80b2540 2021-06-25T04:52:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfda3f700 1 -- 172.21.15.57:0/2198128475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df80b2540 msgr2=0x7f9df814ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.647+0000 7f9dfda3f700 1 --2- 172.21.15.57:0/2198128475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df80b2540 0x7f9df814ae00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9dec002f70 tx=0x7f9dec006df0).stop 2021-06-25T04:52:31.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 -- 172.21.15.57:0/2198128475 shutdown_connections 2021-06-25T04:52:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 --2- 172.21.15.57:0/2198128475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df80b2540 0x7f9df814ae00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 -- 172.21.15.57:0/2198128475 >> 172.21.15.57:0/2198128475 conn(0x7f9df8060140 msgr2=0x7f9df80b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 -- 172.21.15.57:0/2198128475 shutdown_connections 2021-06-25T04:52:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 -- 172.21.15.57:0/2198128475 wait complete. 2021-06-25T04:52:31.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 Processor -- start 2021-06-25T04:52:31.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 -- start start 2021-06-25T04:52:31.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df80a8a80 0x7f9df814ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80affd0 0x7f9df80b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df80b2540 0x7f9df81596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80b3460 con 0x7f9df80affd0 2021-06-25T04:52:31.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80b2d90 con 0x7f9df80a8a80 2021-06-25T04:52:31.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80b4580 con 0x7f9df80b2540 2021-06-25T04:52:31.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80affd0 0x7f9df80b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80affd0 0x7f9df80b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38364/0 (socket says 172.21.15.57:38364) 2021-06-25T04:52:31.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfca3d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df80a8a80 0x7f9df814ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df7fff700 1 -- 172.21.15.57:0/669233386 learned_addr learned my addr 172.21.15.57:0/669233386 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:31.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfd23e700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df80b2540 0x7f9df81596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df7fff700 1 -- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df80b2540 msgr2=0x7f9df81596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df7fff700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df80b2540 0x7f9df81596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df7fff700 1 -- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df80a8a80 msgr2=0x7f9df814ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:31.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df7fff700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df80a8a80 0x7f9df814ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:31.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df7fff700 1 -- 172.21.15.57:0/669233386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec00b180 con 0x7f9df80affd0 2021-06-25T04:52:31.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfca3d700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df80a8a80 0x7f9df814ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:52:31.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df7fff700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80affd0 0x7f9df80b3870 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f9de40011d0 tx=0x7f9de4007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:31.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df5ffb700 1 -- 172.21.15.57:0/669233386 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9de40070d0 con 0x7f9df80affd0 2021-06-25T04:52:31.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df5ffb700 1 -- 172.21.15.57:0/669233386 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de4007230 con 0x7f9df80affd0 2021-06-25T04:52:31.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 -- 172.21.15.57:0/669233386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df80b4820 con 0x7f9df80affd0 2021-06-25T04:52:31.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9df5ffb700 1 -- 172.21.15.57:0/669233386 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9de4005610 con 0x7f9df80affd0 2021-06-25T04:52:31.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.651+0000 7f9dfda3f700 1 -- 172.21.15.57:0/669233386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df80b2fc0 con 0x7f9df80affd0 2021-06-25T04:52:31.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.655+0000 7f9dfda3f700 1 -- 172.21.15.57:0/669233386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df8057310 con 0x7f9df80affd0 2021-06-25T04:52:31.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.655+0000 7f9df5ffb700 1 -- 172.21.15.57:0/669233386 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9de401a060 con 0x7f9df80affd0 2021-06-25T04:52:31.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.655+0000 7f9df5ffb700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9de0055510 0x7f9de00579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:31.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.655+0000 7f9df5ffb700 1 -- 172.21.15.57:0/669233386 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9de406d590 con 0x7f9df80affd0 2021-06-25T04:52:31.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.655+0000 7f9dfca3d700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9de0055510 0x7f9de00579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:31.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.659+0000 7f9dfca3d700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9de0055510 0x7f9de00579d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f9dec017000 tx=0x7f9dec014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:31.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.663+0000 7f9df5ffb700 1 -- 172.21.15.57:0/669233386 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9de4043740 con 0x7f9df80affd0 2021-06-25T04:52:31.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:31.823+0000 7f9dfda3f700 1 -- 172.21.15.57:0/669233386 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9df80698a0 con 0x7f9df80affd0 2021-06-25T04:52:32.223 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:52:32.219+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:52:32.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.227+0000 7f9df5ffb700 1 -- 172.21.15.57:0/669233386 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9de4018020 con 0x7f9df80affd0 2021-06-25T04:52:32.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 -- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9de0055510 msgr2=0x7f9de00579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:32.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9de0055510 0x7f9de00579d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f9dec017000 tx=0x7f9dec014000).stop 2021-06-25T04:52:32.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 -- 172.21.15.57:0/669233386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80affd0 msgr2=0x7f9df80b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:32.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80affd0 0x7f9df80b3870 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f9de40011d0 tx=0x7f9de4007b50).stop 2021-06-25T04:52:32.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 -- 172.21.15.57:0/669233386 shutdown_connections 2021-06-25T04:52:32.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9de0055510 0x7f9de00579d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df80b2540 0x7f9df81596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80affd0 0x7f9df80b3870 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 --2- 172.21.15.57:0/669233386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df80a8a80 0x7f9df814ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 -- 172.21.15.57:0/669233386 >> 172.21.15.57:0/669233386 conn(0x7f9df8060140 msgr2=0x7f9df80af080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:32.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 -- 172.21.15.57:0/669233386 shutdown_connections 2021-06-25T04:52:32.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.231+0000 7f9dfda3f700 1 -- 172.21.15.57:0/669233386 wait complete. 2021-06-25T04:52:32.238 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:52:32.254 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:52:32.269 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:52:32.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.351+0000 7f0ad65f8700 1 Processor -- start 2021-06-25T04:52:32.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.351+0000 7f0ad65f8700 1 -- start start 2021-06-25T04:52:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0ad0063890 0x7f0ad0143d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ad00618e0 0x7f0ad0140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ad00b1290 0x7f0ad00b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad013fd70 con 0x7f0ad0063890 2021-06-25T04:52:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad0063c70 con 0x7f0ad00618e0 2021-06-25T04:52:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0061fb0 con 0x7f0ad00b1290 2021-06-25T04:52:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad55f6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0ad0063890 0x7f0ad0143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad55f6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0ad0063890 0x7f0ad0143d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38382/0 (socket says 172.21.15.57:38382) 2021-06-25T04:52:32.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad55f6700 1 -- 172.21.15.57:0/3523319339 learned_addr learned my addr 172.21.15.57:0/3523319339 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad4df5700 1 --2- 172.21.15.57:0/3523319339 >> v2:172.21.15.87:3300/0 conn(0x7f0ad00618e0 0x7f0ad0140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad5df7700 1 --2- 172.21.15.57:0/3523319339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ad00b1290 0x7f0ad00b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad55f6700 1 -- 172.21.15.57:0/3523319339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ad00b1290 msgr2=0x7f0ad00b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad55f6700 1 --2- 172.21.15.57:0/3523319339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ad00b1290 0x7f0ad00b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad55f6700 1 -- 172.21.15.57:0/3523319339 >> v2:172.21.15.87:3300/0 conn(0x7f0ad00618e0 msgr2=0x7f0ad0140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad55f6700 1 --2- 172.21.15.57:0/3523319339 >> v2:172.21.15.87:3300/0 conn(0x7f0ad00618e0 0x7f0ad0140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad55f6700 1 -- 172.21.15.57:0/3523319339 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad013ff60 con 0x7f0ad0063890 2021-06-25T04:52:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad55f6700 1 --2- 172.21.15.57:0/3523319339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad0063890 0x7f0ad0143d10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0ac80032f0 tx=0x7f0ac800b530).ready entity=mon.0 client_cookie=35aea685e3b36f19 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:32.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ac7fff700 1 -- 172.21.15.57:0/3523319339 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac800dd40 con 0x7f0ad0063890 2021-06-25T04:52:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ac7fff700 1 -- 172.21.15.57:0/3523319339 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8010470 con 0x7f0ad0063890 2021-06-25T04:52:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ac7fff700 1 -- 172.21.15.57:0/3523319339 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac800dea0 con 0x7f0ad0063890 2021-06-25T04:52:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 -- 172.21.15.57:0/3523319339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad0063890 msgr2=0x7f0ad0143d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:32.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 --2- 172.21.15.57:0/3523319339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad0063890 0x7f0ad0143d10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0ac80032f0 tx=0x7f0ac800b530).stop 2021-06-25T04:52:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 -- 172.21.15.57:0/3523319339 shutdown_connections 2021-06-25T04:52:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 --2- 172.21.15.57:0/3523319339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ad00b1290 0x7f0ad00b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 --2- 172.21.15.57:0/3523319339 >> v2:172.21.15.87:3300/0 conn(0x7f0ad00618e0 0x7f0ad0140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 --2- 172.21.15.57:0/3523319339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad0063890 0x7f0ad0143d10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 -- 172.21.15.57:0/3523319339 >> 172.21.15.57:0/3523319339 conn(0x7f0ad005c450 msgr2=0x7f0ad005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:32.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 -- 172.21.15.57:0/3523319339 shutdown_connections 2021-06-25T04:52:32.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.355+0000 7f0ad65f8700 1 -- 172.21.15.57:0/3523319339 wait complete. 2021-06-25T04:52:32.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad65f8700 1 Processor -- start 2021-06-25T04:52:32.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad65f8700 1 -- start start 2021-06-25T04:52:32.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad65f8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ad00618e0 0x7f0ad00b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad65f8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ad0063890 0x7f0ad0151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad65f8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad00b1290 0x7f0ad0151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad65f8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0126df0 con 0x7f0ad00b1290 2021-06-25T04:52:32.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad65f8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0123800 con 0x7f0ad00618e0 2021-06-25T04:52:32.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad65f8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0152310 con 0x7f0ad0063890 2021-06-25T04:52:32.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad5df7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad00b1290 0x7f0ad0151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad5df7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad00b1290 0x7f0ad0151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38392/0 (socket says 172.21.15.57:38392) 2021-06-25T04:52:32.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad5df7700 1 -- 172.21.15.57:0/2210679705 learned_addr learned my addr 172.21.15.57:0/2210679705 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:32.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad4df5700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ad0063890 0x7f0ad0151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad55f6700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ad00618e0 0x7f0ad00b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad5df7700 1 -- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ad0063890 msgr2=0x7f0ad0151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:32.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad5df7700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ad0063890 0x7f0ad0151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad5df7700 1 -- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ad00618e0 msgr2=0x7f0ad00b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:32.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad5df7700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ad00618e0 0x7f0ad00b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.359+0000 7f0ad5df7700 1 -- 172.21.15.57:0/2210679705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac800b7d0 con 0x7f0ad00b1290 2021-06-25T04:52:32.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.363+0000 7f0ad5df7700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad00b1290 0x7f0ad0151e20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f0acc00c000 tx=0x7f0acc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:32.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.363+0000 7f0ac67fc700 1 -- 172.21.15.57:0/2210679705 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0acc011750 con 0x7f0ad00b1290 2021-06-25T04:52:32.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.363+0000 7f0ac67fc700 1 -- 172.21.15.57:0/2210679705 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc0118b0 con 0x7f0ad00b1290 2021-06-25T04:52:32.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.363+0000 7f0ad65f8700 1 -- 172.21.15.57:0/2210679705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad0125ef0 con 0x7f0ad00b1290 2021-06-25T04:52:32.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.363+0000 7f0ac67fc700 1 -- 172.21.15.57:0/2210679705 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0acc011c10 con 0x7f0ad00b1290 2021-06-25T04:52:32.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.363+0000 7f0ad65f8700 1 -- 172.21.15.57:0/2210679705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad01263f0 con 0x7f0ad00b1290 2021-06-25T04:52:32.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.363+0000 7f0ad65f8700 1 -- 172.21.15.57:0/2210679705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad0151630 con 0x7f0ad00b1290 2021-06-25T04:52:32.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.363+0000 7f0ac67fc700 1 -- 172.21.15.57:0/2210679705 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0acc011d70 con 0x7f0ad00b1290 2021-06-25T04:52:32.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.363+0000 7f0ac67fc700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ab80553d0 0x7f0ab8057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.363+0000 7f0ac67fc700 1 -- 172.21.15.57:0/2210679705 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f0acc06e3e0 con 0x7f0ad00b1290 2021-06-25T04:52:32.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.367+0000 7f0ad55f6700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ab80553d0 0x7f0ab8057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.367+0000 7f0ad55f6700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ab80553d0 0x7f0ab8057890 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f0ac801e000 tx=0x7f0ac800b530).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:32.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.371+0000 7f0ac67fc700 1 -- 172.21.15.57:0/2210679705 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0acc044430 con 0x7f0ad00b1290 2021-06-25T04:52:32.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.535+0000 7f0ad65f8700 1 -- 172.21.15.57:0/2210679705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ad0067360 con 0x7f0ad00b1290 2021-06-25T04:52:32.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.535+0000 7f0ac67fc700 1 -- 172.21.15.57:0/2210679705 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+2125 (secure 0 0 0) 0x7f0acc047a50 con 0x7f0ad00b1290 2021-06-25T04:52:32.541 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:32.541 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/289042329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":289042329},{"type":"v1","addr":"172.21.15.87:6835","nonce":289042329}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/824739091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":824739091},{"type":"v1","addr":"172.21.15.57:6833","nonce":824739091}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:51:09.583588+0000","modified":"2021-06-25T04:52:32.223499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-06-25T04:52:32.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 -- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ab80553d0 msgr2=0x7f0ab8057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:32.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ab80553d0 0x7f0ab8057890 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f0ac801e000 tx=0x7f0ac800b530).stop 2021-06-25T04:52:32.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 -- 172.21.15.57:0/2210679705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad00b1290 msgr2=0x7f0ad0151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:32.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad00b1290 0x7f0ad0151e20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f0acc00c000 tx=0x7f0acc006df0).stop 2021-06-25T04:52:32.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 -- 172.21.15.57:0/2210679705 shutdown_connections 2021-06-25T04:52:32.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ab80553d0 0x7f0ab8057890 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad00b1290 0x7f0ad0151e20 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ad0063890 0x7f0ad0151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 --2- 172.21.15.57:0/2210679705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ad00618e0 0x7f0ad00b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 -- 172.21.15.57:0/2210679705 >> 172.21.15.57:0/2210679705 conn(0x7f0ad005c450 msgr2=0x7f0ad005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:32.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 -- 172.21.15.57:0/2210679705 shutdown_connections 2021-06-25T04:52:32.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.539+0000 7f0ad65f8700 1 -- 172.21.15.57:0/2210679705 wait complete. 2021-06-25T04:52:32.548 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2021-06-25T04:52:32.558 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:52:32.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d73e0700 1 Processor -- start 2021-06-25T04:52:32.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d73e0700 1 -- start start 2021-06-25T04:52:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d73e0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2d014ab40 0x7ff2d005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d73e0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2d00ac970 0x7ff2d014af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d73e0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d0061320 con 0x7ff2d00afed0 2021-06-25T04:52:32.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d73e0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d014b5a0 con 0x7ff2d00ac970 2021-06-25T04:52:32.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d73e0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d014b840 con 0x7ff2d014ab40 2021-06-25T04:52:32.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d597d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2d00ac970 0x7ff2d014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d517c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2d014ab40 0x7ff2d005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d597d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2d00ac970 0x7ff2d014af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38398/0 (socket says 172.21.15.57:38398) 2021-06-25T04:52:32.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d597d700 1 -- 172.21.15.57:0/793240905 learned_addr learned my addr 172.21.15.57:0/793240905 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:32.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d597d700 1 -- 172.21.15.57:0/793240905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2d014ab40 msgr2=0x7ff2d005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:32.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2cffff700 1 -- 172.21.15.57:0/793240905 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562003154 0 0) 0x7ff2d0061320 con 0x7ff2d00afed0 2021-06-25T04:52:32.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d597d700 1 --2- 172.21.15.57:0/793240905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2d014ab40 0x7ff2d005f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d597d700 1 -- 172.21.15.57:0/793240905 >> v1:172.21.15.87:6789/0 conn(0x7ff2d00afed0 legacy=0x7ff2d00af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:32.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d597d700 1 -- 172.21.15.57:0/793240905 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d00aece0 con 0x7ff2d00ac970 2021-06-25T04:52:32.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d597d700 1 --2- 172.21.15.57:0/793240905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2d00ac970 0x7ff2d014af20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7ff2c0002f70 tx=0x7ff2c0006eb0).ready entity=mon.0 client_cookie=9b7a3a447d28506 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:32.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2cffff700 1 -- 172.21.15.57:0/793240905 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c000d570 con 0x7ff2d00ac970 2021-06-25T04:52:32.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2cffff700 1 -- 172.21.15.57:0/793240905 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c0000e90 con 0x7ff2d00ac970 2021-06-25T04:52:32.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2cffff700 1 -- 172.21.15.57:0/793240905 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c000d8c0 con 0x7ff2d00ac970 2021-06-25T04:52:32.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d73e0700 1 -- 172.21.15.57:0/793240905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2d00ac970 msgr2=0x7ff2d014af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:32.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.667+0000 7ff2d73e0700 1 --2- 172.21.15.57:0/793240905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2d00ac970 0x7ff2d014af20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7ff2c0002f70 tx=0x7ff2c0006eb0).stop 2021-06-25T04:52:32.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 -- 172.21.15.57:0/793240905 shutdown_connections 2021-06-25T04:52:32.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 --2- 172.21.15.57:0/793240905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2d00ac970 0x7ff2d014af20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 --2- 172.21.15.57:0/793240905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2d014ab40 0x7ff2d005f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 -- 172.21.15.57:0/793240905 >> 172.21.15.57:0/793240905 conn(0x7ff2d00b5530 msgr2=0x7ff2d00b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:32.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 -- 172.21.15.57:0/793240905 shutdown_connections 2021-06-25T04:52:32.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 -- 172.21.15.57:0/793240905 wait complete. 2021-06-25T04:52:32.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 Processor -- start 2021-06-25T04:52:32.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 -- start start 2021-06-25T04:52:32.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2d00ac970 0x7ff2d0145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2d00afed0 0x7ff2d0146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2d014ab40 0x7ff2d0146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0144700 con 0x7ff2d00ac970 2021-06-25T04:52:32.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0141e80 con 0x7ff2d014ab40 2021-06-25T04:52:32.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d73e0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0146fe0 con 0x7ff2d00afed0 2021-06-25T04:52:32.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d517c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2d00ac970 0x7ff2d0145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d517c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2d00ac970 0x7ff2d0145750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38402/0 (socket says 172.21.15.57:38402) 2021-06-25T04:52:32.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d517c700 1 -- 172.21.15.57:0/1766902588 learned_addr learned my addr 172.21.15.57:0/1766902588 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:32.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d597d700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2d014ab40 0x7ff2d0146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.671+0000 7ff2d497b700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2d00afed0 0x7ff2d0146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2d517c700 1 -- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2d00afed0 msgr2=0x7ff2d0146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:32.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2d517c700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2d00afed0 0x7ff2d0146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2d517c700 1 -- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2d014ab40 msgr2=0x7ff2d0146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:32.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2d517c700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2d014ab40 0x7ff2d0146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2d517c700 1 -- 172.21.15.57:0/1766902588 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c000b1e0 con 0x7ff2d00ac970 2021-06-25T04:52:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2d497b700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2d00afed0 0x7ff2d0146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:52:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2d517c700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2d00ac970 0x7ff2d0145750 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7ff2d0144270 tx=0x7ff2c80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:32.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2ce7fc700 1 -- 172.21.15.57:0/1766902588 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c800eea0 con 0x7ff2d00ac970 2021-06-25T04:52:32.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2ce7fc700 1 -- 172.21.15.57:0/1766902588 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c800c850 con 0x7ff2d00ac970 2021-06-25T04:52:32.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2d73e0700 1 -- 172.21.15.57:0/1766902588 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d01485c0 con 0x7ff2d00ac970 2021-06-25T04:52:32.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2ce7fc700 1 -- 172.21.15.57:0/1766902588 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c800cbb0 con 0x7ff2d00ac970 2021-06-25T04:52:32.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2d73e0700 1 -- 172.21.15.57:0/1766902588 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d0157180 con 0x7ff2d00ac970 2021-06-25T04:52:32.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2d73e0700 1 -- 172.21.15.57:0/1766902588 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d0141ca0 con 0x7ff2d00ac970 2021-06-25T04:52:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2ce7fc700 1 -- 172.21.15.57:0/1766902588 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff2c8022070 con 0x7ff2d00ac970 2021-06-25T04:52:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2ce7fc700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff2b40554e0 0x7ff2b40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2ce7fc700 1 -- 172.21.15.57:0/1766902588 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6506+0+0 (secure 0 0 0) 0x7ff2c806e530 con 0x7ff2d00ac970 2021-06-25T04:52:32.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.675+0000 7ff2d497b700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff2b40554e0 0x7ff2b40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:32.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.679+0000 7ff2d497b700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff2b40554e0 0x7ff2b40579a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7ff2b800b000 tx=0x7ff2b8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:32.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.679+0000 7ff2ce7fc700 1 -- 172.21.15.57:0/1766902588 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff2c8044690 con 0x7ff2d00ac970 2021-06-25T04:52:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:32.847+0000 7ff2d73e0700 1 -- 172.21.15.57:0/1766902588 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff2d0157310 con 0x7ff2d00ac970 2021-06-25T04:52:33.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2ce7fc700 1 -- 172.21.15.57:0/1766902588 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff2c8047cb0 con 0x7ff2d00ac970 2021-06-25T04:52:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 -- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff2b40554e0 msgr2=0x7ff2b40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff2b40554e0 0x7ff2b40579a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7ff2b800b000 tx=0x7ff2b8009040).stop 2021-06-25T04:52:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 -- 172.21.15.57:0/1766902588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2d00ac970 msgr2=0x7ff2d0145750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2d00ac970 0x7ff2d0145750 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7ff2d0144270 tx=0x7ff2c80091d0).stop 2021-06-25T04:52:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 -- 172.21.15.57:0/1766902588 shutdown_connections 2021-06-25T04:52:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff2b40554e0 0x7ff2b40579a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2d014ab40 0x7ff2d0146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2d00afed0 0x7ff2d0146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 --2- 172.21.15.57:0/1766902588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2d00ac970 0x7ff2d0145750 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 -- 172.21.15.57:0/1766902588 >> 172.21.15.57:0/1766902588 conn(0x7ff2d00b5530 msgr2=0x7ff2d0060e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 -- 172.21.15.57:0/1766902588 shutdown_connections 2021-06-25T04:52:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.247+0000 7ff2d73e0700 1 -- 172.21.15.57:0/1766902588 wait complete. 2021-06-25T04:52:33.267 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:52:33.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.383+0000 7f37bffff700 1 Processor -- start 2021-06-25T04:52:33.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.383+0000 7f37bffff700 1 -- start start 2021-06-25T04:52:33.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.383+0000 7f37bffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f37c00612e0 0x7f37c00616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:33.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.383+0000 7f37bffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00aecb0 con 0x7f37c0140400 2021-06-25T04:52:33.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.383+0000 7f37bffff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00b6ee0 con 0x7f37c00ad580 2021-06-25T04:52:33.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.383+0000 7f37bffff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c00aeee0 con 0x7f37c00612e0 2021-06-25T04:52:33.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.383+0000 7f37bf7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f37c0140400 0x7f37c01464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55628/0 (socket says 172.21.15.57:55628) 2021-06-25T04:52:33.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.383+0000 7f37bf7fe700 1 -- 172.21.15.57:0/2508745308 learned_addr learned my addr 172.21.15.57:0/2508745308 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:33.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37beffd700 1 --2- 172.21.15.57:0/2508745308 >> v2:172.21.15.87:3300/0 conn(0x7f37c00612e0 0x7f37c00616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:33.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bdffb700 1 -- 172.21.15.57:0/2508745308 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376023673 0 0) 0x7f37c00aecb0 con 0x7f37c0140400 2021-06-25T04:52:33.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bdffb700 1 -- 172.21.15.57:0/2508745308 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a4003260 con 0x7f37c0140400 2021-06-25T04:52:33.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bdffb700 1 -- 172.21.15.57:0/2508745308 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275583249 0 0) 0x7f37c00b6ee0 con 0x7f37c00ad580 2021-06-25T04:52:33.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bdffb700 1 -- 172.21.15.57:0/2508745308 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37c00aecb0 con 0x7f37c00ad580 2021-06-25T04:52:33.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37beffd700 1 -- 172.21.15.57:0/2508745308 >> v1:172.21.15.87:6789/0 conn(0x7f37c00ad580 legacy=0x7f37c00b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:33.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37beffd700 1 -- 172.21.15.57:0/2508745308 >> v1:172.21.15.57:6789/0 conn(0x7f37c0140400 legacy=0x7f37c01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:33.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37beffd700 1 -- 172.21.15.57:0/2508745308 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c00af180 con 0x7f37c00612e0 2021-06-25T04:52:33.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37beffd700 1 --2- 172.21.15.57:0/2508745308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c00612e0 0x7f37c00616c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f37c00aeb60 tx=0x7f37b4006df0).ready entity=mon.1 client_cookie=96782142f7c2114 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:33.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bdffb700 1 -- 172.21.15.57:0/2508745308 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b400d610 con 0x7f37c00612e0 2021-06-25T04:52:33.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bdffb700 1 -- 172.21.15.57:0/2508745308 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b4000e90 con 0x7f37c00612e0 2021-06-25T04:52:33.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bdffb700 1 -- 172.21.15.57:0/2508745308 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b400d960 con 0x7f37c00612e0 2021-06-25T04:52:33.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bffff700 1 -- 172.21.15.57:0/2508745308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c00612e0 msgr2=0x7f37c00616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:33.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bffff700 1 --2- 172.21.15.57:0/2508745308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c00612e0 0x7f37c00616c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f37c00aeb60 tx=0x7f37b4006df0).stop 2021-06-25T04:52:33.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bffff700 1 -- 172.21.15.57:0/2508745308 shutdown_connections 2021-06-25T04:52:33.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bffff700 1 --2- 172.21.15.57:0/2508745308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c00612e0 0x7f37c00616c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:33.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bffff700 1 -- 172.21.15.57:0/2508745308 >> 172.21.15.57:0/2508745308 conn(0x7f37c0066da0 msgr2=0x7f37c0067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:33.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bffff700 1 -- 172.21.15.57:0/2508745308 shutdown_connections 2021-06-25T04:52:33.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.387+0000 7f37bffff700 1 -- 172.21.15.57:0/2508745308 wait complete. 2021-06-25T04:52:33.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37bffff700 1 Processor -- start 2021-06-25T04:52:33.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37bffff700 1 -- start start 2021-06-25T04:52:33.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37bffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00612e0 0x7f37c0155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:33.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37bffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c00ad580 0x7f37c0141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:33.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37bffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37c0140400 0x7f37c00aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:33.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37bffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0156080 con 0x7f37c00612e0 2021-06-25T04:52:33.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37bffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00ac840 con 0x7f37c00ad580 2021-06-25T04:52:33.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37bffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c01562e0 con 0x7f37c0140400 2021-06-25T04:52:33.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37beffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00612e0 0x7f37c0155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:33.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37beffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00612e0 0x7f37c0155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38414/0 (socket says 172.21.15.57:38414) 2021-06-25T04:52:33.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37beffd700 1 -- 172.21.15.57:0/1454409106 learned_addr learned my addr 172.21.15.57:0/1454409106 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:33.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.391+0000 7f37be7fc700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c00ad580 0x7f37c0141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:33.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37bf7fe700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37c0140400 0x7f37c00aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:33.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37beffd700 1 -- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37c0140400 msgr2=0x7f37c00aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:33.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37beffd700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37c0140400 0x7f37c00aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:33.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37beffd700 1 -- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c00ad580 msgr2=0x7f37c0141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:33.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37beffd700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c00ad580 0x7f37c0141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:33.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37beffd700 1 -- 172.21.15.57:0/1454409106 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b400b180 con 0x7f37c00612e0 2021-06-25T04:52:33.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37beffd700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00612e0 0x7f37c0155a40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f37c00aeb60 tx=0x7f37b4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:33.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37affff700 1 -- 172.21.15.57:0/1454409106 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b4012d50 con 0x7f37c00612e0 2021-06-25T04:52:33.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37bffff700 1 -- 172.21.15.57:0/1454409106 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c00ac560 con 0x7f37c00612e0 2021-06-25T04:52:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37affff700 1 -- 172.21.15.57:0/1454409106 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b4000e90 con 0x7f37c00612e0 2021-06-25T04:52:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37affff700 1 -- 172.21.15.57:0/1454409106 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b401e5e0 con 0x7f37c00612e0 2021-06-25T04:52:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37bffff700 1 -- 172.21.15.57:0/1454409106 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c00ab080 con 0x7f37c00612e0 2021-06-25T04:52:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37bffff700 1 -- 172.21.15.57:0/1454409106 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c01564a0 con 0x7f37c00612e0 2021-06-25T04:52:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.395+0000 7f37affff700 1 -- 172.21.15.57:0/1454409106 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f37b4024020 con 0x7f37c00612e0 2021-06-25T04:52:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.399+0000 7f37affff700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f379c0553d0 0x7f379c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.399+0000 7f37affff700 1 -- 172.21.15.57:0/1454409106 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f37b406eba0 con 0x7f37c00612e0 2021-06-25T04:52:33.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.399+0000 7f37be7fc700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f379c0553d0 0x7f379c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:33.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.399+0000 7f37be7fc700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f379c0553d0 0x7f379c057890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f37b000d000 tx=0x7f37b0007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:33.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.407+0000 7f37affff700 1 -- 172.21.15.57:0/1454409106 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f37b4044c60 con 0x7f37c00612e0 2021-06-25T04:52:33.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:33.531+0000 7f37bffff700 1 -- 172.21.15.57:0/1454409106 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37c0057310 con 0x7f37c00612e0 2021-06-25T04:52:34.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.259+0000 7f37affff700 1 -- 172.21.15.57:0/1454409106 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 185+0+0 (secure 0 0 0) 0x7f37b4048280 con 0x7f37c00612e0 2021-06-25T04:52:34.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 -- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f379c0553d0 msgr2=0x7f379c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:34.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f379c0553d0 0x7f379c057890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f37b000d000 tx=0x7f37b0007a20).stop 2021-06-25T04:52:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 -- 172.21.15.57:0/1454409106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00612e0 msgr2=0x7f37c0155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:34.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00612e0 0x7f37c0155a40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f37c00aeb60 tx=0x7f37b4014000).stop 2021-06-25T04:52:34.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 -- 172.21.15.57:0/1454409106 shutdown_connections 2021-06-25T04:52:34.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f379c0553d0 0x7f379c057890 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:34.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37c0140400 0x7f37c00aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:34.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c00ad580 0x7f37c0141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:34.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 --2- 172.21.15.57:0/1454409106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00612e0 0x7f37c0155a40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:34.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 -- 172.21.15.57:0/1454409106 >> 172.21.15.57:0/1454409106 conn(0x7f37c0066da0 msgr2=0x7f37c0149a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:34.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 -- 172.21.15.57:0/1454409106 shutdown_connections 2021-06-25T04:52:34.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.263+0000 7f37bffff700 1 -- 172.21.15.57:0/1454409106 wait complete. 2021-06-25T04:52:34.269 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:52:34.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:52:34.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 Processor -- start 2021-06-25T04:52:34.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 -- start start 2021-06-25T04:52:34.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ee8143500 0x7f1ee80a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:34.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ee805f670 0x7f1ee81438e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:34.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee80b1480 con 0x7f1ee80a8b20 2021-06-25T04:52:34.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee80ab3a0 con 0x7f1ee805f670 2021-06-25T04:52:34.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee80b1b50 con 0x7f1ee8143500 2021-06-25T04:52:34.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ee805f670 0x7f1ee81438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:34.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1ee80a8b20 0x7f1ee80b0d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55644/0 (socket says 172.21.15.57:55644) 2021-06-25T04:52:34.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee7fff700 1 -- 172.21.15.57:0/3763183683 learned_addr learned my addr 172.21.15.57:0/3763183683 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:34.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee77fe700 1 --2- 172.21.15.57:0/3763183683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ee8143500 0x7f1ee80a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:34.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee67fc700 1 -- 172.21.15.57:0/3763183683 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119829764 0 0) 0x7f1ee80b1480 con 0x7f1ee80a8b20 2021-06-25T04:52:34.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee67fc700 1 -- 172.21.15.57:0/3763183683 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed4003260 con 0x7f1ee80a8b20 2021-06-25T04:52:34.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee6ffd700 1 -- 172.21.15.57:0/3763183683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ee8143500 msgr2=0x7f1ee80a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:34.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee6ffd700 1 --2- 172.21.15.57:0/3763183683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ee8143500 0x7f1ee80a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:34.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee6ffd700 1 -- 172.21.15.57:0/3763183683 >> v1:172.21.15.57:6789/0 conn(0x7f1ee80a8b20 legacy=0x7f1ee80b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:34.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee6ffd700 1 -- 172.21.15.57:0/3763183683 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee8143f60 con 0x7f1ee805f670 2021-06-25T04:52:34.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee6ffd700 1 --2- 172.21.15.57:0/3763183683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee805f670 0x7f1ee81438e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f1edc002f70 tx=0x7f1edc006df0).ready entity=mon.0 client_cookie=523e18f98cbc3f94 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:34.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee67fc700 1 -- 172.21.15.57:0/3763183683 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1edc00d4a0 con 0x7f1ee805f670 2021-06-25T04:52:34.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee67fc700 1 -- 172.21.15.57:0/3763183683 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1edc000e90 con 0x7f1ee805f670 2021-06-25T04:52:34.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1ee67fc700 1 -- 172.21.15.57:0/3763183683 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1edc00d7f0 con 0x7f1ee805f670 2021-06-25T04:52:34.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 -- 172.21.15.57:0/3763183683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee805f670 msgr2=0x7f1ee81438e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:34.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 --2- 172.21.15.57:0/3763183683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee805f670 0x7f1ee81438e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f1edc002f70 tx=0x7f1edc006df0).stop 2021-06-25T04:52:34.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 -- 172.21.15.57:0/3763183683 shutdown_connections 2021-06-25T04:52:34.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 --2- 172.21.15.57:0/3763183683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee805f670 0x7f1ee81438e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:34.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 --2- 172.21.15.57:0/3763183683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ee8143500 0x7f1ee80a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:34.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 -- 172.21.15.57:0/3763183683 >> 172.21.15.57:0/3763183683 conn(0x7f1ee80b53a0 msgr2=0x7f1ee80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:34.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 -- 172.21.15.57:0/3763183683 shutdown_connections 2021-06-25T04:52:34.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.379+0000 7f1eeddfb700 1 -- 172.21.15.57:0/3763183683 wait complete. 2021-06-25T04:52:34.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1eeddfb700 1 Processor -- start 2021-06-25T04:52:34.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1eeddfb700 1 -- start start 2021-06-25T04:52:34.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1eeddfb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee805f670 0x7f1ee80a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:34.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1eeddfb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ee80a8b20 0x7f1ee80a2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:34.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1eeddfb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee8143500 0x7f1ee80a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:34.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1eeddfb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee809f960 con 0x7f1ee805f670 2021-06-25T04:52:34.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1eeddfb700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee80a32b0 con 0x7f1ee8143500 2021-06-25T04:52:34.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1eeddfb700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee814d140 con 0x7f1ee80a8b20 2021-06-25T04:52:34.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee805f670 0x7f1ee80a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:34.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee805f670 0x7f1ee80a28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38428/0 (socket says 172.21.15.57:38428) 2021-06-25T04:52:34.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee77fe700 1 -- 172.21.15.57:0/4129982473 learned_addr learned my addr 172.21.15.57:0/4129982473 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:34.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee6ffd700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ee80a8b20 0x7f1ee80a2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:34.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee7fff700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee8143500 0x7f1ee80a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:34.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee77fe700 1 -- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ee80a8b20 msgr2=0x7f1ee80a2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:34.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee77fe700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ee80a8b20 0x7f1ee80a2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:34.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee77fe700 1 -- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee8143500 msgr2=0x7f1ee80a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:34.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee77fe700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee8143500 0x7f1ee80a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee77fe700 1 -- 172.21.15.57:0/4129982473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc00b180 con 0x7f1ee805f670 2021-06-25T04:52:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee77fe700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee805f670 0x7f1ee80a28d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f1ee80a33f0 tx=0x7f1ed8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee4ff9700 1 -- 172.21.15.57:0/4129982473 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ed8010780 con 0x7f1ee805f670 2021-06-25T04:52:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee4ff9700 1 -- 172.21.15.57:0/4129982473 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed80108e0 con 0x7f1ee805f670 2021-06-25T04:52:34.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1eeddfb700 1 -- 172.21.15.57:0/4129982473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee809ef80 con 0x7f1ee805f670 2021-06-25T04:52:34.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee4ff9700 1 -- 172.21.15.57:0/4129982473 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ed8010c40 con 0x7f1ee805f670 2021-06-25T04:52:34.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1eeddfb700 1 -- 172.21.15.57:0/4129982473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee809f4c0 con 0x7f1ee805f670 2021-06-25T04:52:34.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1eeddfb700 1 -- 172.21.15.57:0/4129982473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee8057310 con 0x7f1ee805f670 2021-06-25T04:52:34.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.383+0000 7f1ee4ff9700 1 -- 172.21.15.57:0/4129982473 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1ed801c460 con 0x7f1ee805f670 2021-06-25T04:52:34.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.387+0000 7f1ee4ff9700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ec80553f0 0x7f1ec80578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:34.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.387+0000 7f1ee4ff9700 1 -- 172.21.15.57:0/4129982473 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f1ed806e030 con 0x7f1ee805f670 2021-06-25T04:52:34.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.387+0000 7f1ee6ffd700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ec80553f0 0x7f1ec80578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:34.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.387+0000 7f1ee6ffd700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ec80553f0 0x7f1ec80578b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f1edc019000 tx=0x7f1edc014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:34.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.391+0000 7f1ee4ff9700 1 -- 172.21.15.57:0/4129982473 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1ed80442e0 con 0x7f1ee805f670 2021-06-25T04:52:34.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:34.515+0000 7f1eeddfb700 1 -- 172.21.15.57:0/4129982473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1ee80b1480 con 0x7f1ee805f670 2021-06-25T04:52:35.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.271+0000 7f1ee4ff9700 1 -- 172.21.15.57:0/4129982473 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1ed8047900 con 0x7f1ee805f670 2021-06-25T04:52:35.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.275+0000 7f1eeddfb700 1 -- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ec80553f0 msgr2=0x7f1ec80578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:35.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.275+0000 7f1eeddfb700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ec80553f0 0x7f1ec80578b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f1edc019000 tx=0x7f1edc014000).stop 2021-06-25T04:52:35.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.275+0000 7f1eeddfb700 1 -- 172.21.15.57:0/4129982473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee805f670 msgr2=0x7f1ee80a28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:35.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.275+0000 7f1eeddfb700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee805f670 0x7f1ee80a28d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f1ee80a33f0 tx=0x7f1ed8006df0).stop 2021-06-25T04:52:35.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.279+0000 7f1eeddfb700 1 -- 172.21.15.57:0/4129982473 shutdown_connections 2021-06-25T04:52:35.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.279+0000 7f1eeddfb700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1ec80553f0 0x7f1ec80578b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.279+0000 7f1eeddfb700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee8143500 0x7f1ee80a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.279+0000 7f1eeddfb700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ee80a8b20 0x7f1ee80a2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.279+0000 7f1eeddfb700 1 --2- 172.21.15.57:0/4129982473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee805f670 0x7f1ee80a28d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.279+0000 7f1eeddfb700 1 -- 172.21.15.57:0/4129982473 >> 172.21.15.57:0/4129982473 conn(0x7f1ee80b53a0 msgr2=0x7f1ee80ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:35.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.279+0000 7f1eeddfb700 1 -- 172.21.15.57:0/4129982473 shutdown_connections 2021-06-25T04:52:35.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.279+0000 7f1eeddfb700 1 -- 172.21.15.57:0/4129982473 wait complete. 2021-06-25T04:52:35.285 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:52:35.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-06-25T04:52:35.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.395+0000 7f7fb7582700 1 Processor -- start 2021-06-25T04:52:35.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.395+0000 7f7fb7582700 1 -- start start 2021-06-25T04:52:35.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.395+0000 7f7fb7582700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00a9150 0x7f7fb0146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.395+0000 7f7fb7582700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7fb00b0b40 0x7f7fb0146a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.395+0000 7f7fb7582700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7fb00b0390 0x7f7fb0140180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.395+0000 7f7fb7582700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb00b1100 con 0x7f7fb00b0b40 2021-06-25T04:52:35.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.395+0000 7f7fb7582700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb00a9530 con 0x7f7fb00b0390 2021-06-25T04:52:35.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.395+0000 7f7fb7582700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00b1330 con 0x7f7fb00a9150 2021-06-25T04:52:35.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb5d7f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7fb00b0b40 0x7f7fb0146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb5d7f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7fb00b0b40 0x7f7fb0146a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38438/0 (socket says 172.21.15.57:38438) 2021-06-25T04:52:35.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb5d7f700 1 -- 172.21.15.57:0/2782256867 learned_addr learned my addr 172.21.15.57:0/2782256867 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:35.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb6d81700 1 --2- 172.21.15.57:0/2782256867 >> v2:172.21.15.87:3300/0 conn(0x7f7fb00b0390 0x7f7fb0140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb6580700 1 --2- 172.21.15.57:0/2782256867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00a9150 0x7f7fb0146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb5d7f700 1 -- 172.21.15.57:0/2782256867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00a9150 msgr2=0x7f7fb0146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:35.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb5d7f700 1 --2- 172.21.15.57:0/2782256867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00a9150 0x7f7fb0146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb5d7f700 1 -- 172.21.15.57:0/2782256867 >> v2:172.21.15.87:3300/0 conn(0x7f7fb00b0390 msgr2=0x7f7fb0140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:35.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb5d7f700 1 --2- 172.21.15.57:0/2782256867 >> v2:172.21.15.87:3300/0 conn(0x7f7fb00b0390 0x7f7fb0140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb5d7f700 1 -- 172.21.15.57:0/2782256867 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb00b15d0 con 0x7f7fb00b0b40 2021-06-25T04:52:35.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb5d7f700 1 --2- 172.21.15.57:0/2782256867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb00b0b40 0x7f7fb0146a00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f7fa4002f70 tx=0x7f7fa4006eb0).ready entity=mon.0 client_cookie=1f78448523d48106 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:35.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb557e700 1 -- 172.21.15.57:0/2782256867 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa400d570 con 0x7f7fb00b0b40 2021-06-25T04:52:35.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb557e700 1 -- 172.21.15.57:0/2782256867 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa4000e90 con 0x7f7fb00b0b40 2021-06-25T04:52:35.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb557e700 1 -- 172.21.15.57:0/2782256867 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa400d900 con 0x7f7fb00b0b40 2021-06-25T04:52:35.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb7582700 1 -- 172.21.15.57:0/2782256867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb00b0b40 msgr2=0x7f7fb0146a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:35.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb7582700 1 --2- 172.21.15.57:0/2782256867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb00b0b40 0x7f7fb0146a00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f7fa4002f70 tx=0x7f7fa4006eb0).stop 2021-06-25T04:52:35.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb7582700 1 -- 172.21.15.57:0/2782256867 shutdown_connections 2021-06-25T04:52:35.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb7582700 1 --2- 172.21.15.57:0/2782256867 >> v2:172.21.15.87:3300/0 conn(0x7f7fb00b0390 0x7f7fb0140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb7582700 1 --2- 172.21.15.57:0/2782256867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb00b0b40 0x7f7fb0146a00 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb7582700 1 --2- 172.21.15.57:0/2782256867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00a9150 0x7f7fb0146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb7582700 1 -- 172.21.15.57:0/2782256867 >> 172.21.15.57:0/2782256867 conn(0x7f7fb0061100 msgr2=0x7f7fb0062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:35.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb7582700 1 -- 172.21.15.57:0/2782256867 shutdown_connections 2021-06-25T04:52:35.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb7582700 1 -- 172.21.15.57:0/2782256867 wait complete. 2021-06-25T04:52:35.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb7582700 1 Processor -- start 2021-06-25T04:52:35.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.399+0000 7f7fb7582700 1 -- start start 2021-06-25T04:52:35.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb7582700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00a9150 0x7f7fb0142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb7582700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00b0390 0x7f7fb0144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb7582700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb00b0b40 0x7f7fb013bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb7582700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0145220 con 0x7f7fb00b0b40 2021-06-25T04:52:35.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb7582700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb01454b0 con 0x7f7fb00a9150 2021-06-25T04:52:35.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb7582700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00a98a0 con 0x7f7fb00b0390 2021-06-25T04:52:35.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb6d81700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb00b0b40 0x7f7fb013bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb6d81700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb00b0b40 0x7f7fb013bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38446/0 (socket says 172.21.15.57:38446) 2021-06-25T04:52:35.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb6d81700 1 -- 172.21.15.57:0/182104207 learned_addr learned my addr 172.21.15.57:0/182104207 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:35.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb6580700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00a9150 0x7f7fb0142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb5d7f700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00b0390 0x7f7fb0144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb6d81700 1 -- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00b0390 msgr2=0x7f7fb0144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:35.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb6d81700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00b0390 0x7f7fb0144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb6d81700 1 -- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00a9150 msgr2=0x7f7fb0142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:35.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb6d81700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00a9150 0x7f7fb0142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb6d81700 1 -- 172.21.15.57:0/182104207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa400b1e0 con 0x7f7fb00b0b40 2021-06-25T04:52:35.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb6d81700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb00b0b40 0x7f7fb013bd50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f7fa800c000 tx=0x7f7fa8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:35.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7faf7fe700 1 -- 172.21.15.57:0/182104207 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa8011750 con 0x7f7fb00b0b40 2021-06-25T04:52:35.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7faf7fe700 1 -- 172.21.15.57:0/182104207 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa80118b0 con 0x7f7fb00b0b40 2021-06-25T04:52:35.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb7582700 1 -- 172.21.15.57:0/182104207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb00a9b40 con 0x7f7fb00b0b40 2021-06-25T04:52:35.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7faf7fe700 1 -- 172.21.15.57:0/182104207 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa8011c10 con 0x7f7fb00b0b40 2021-06-25T04:52:35.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb7582700 1 -- 172.21.15.57:0/182104207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb00aa280 con 0x7f7fb00b0b40 2021-06-25T04:52:35.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7fb7582700 1 -- 172.21.15.57:0/182104207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb00a9fe0 con 0x7f7fb00b0b40 2021-06-25T04:52:35.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7faf7fe700 1 -- 172.21.15.57:0/182104207 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7fa8011d70 con 0x7f7fb00b0b40 2021-06-25T04:52:35.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7faf7fe700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f90055490 0x7f7f90057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.403+0000 7f7faf7fe700 1 -- 172.21.15.57:0/182104207 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f7fa806dfe0 con 0x7f7fb00b0b40 2021-06-25T04:52:35.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.407+0000 7f7fb6580700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f90055490 0x7f7f90057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.407+0000 7f7fb6580700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f90055490 0x7f7f90057950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f7fa000b000 tx=0x7f7fa00091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:35.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.411+0000 7f7faf7fe700 1 -- 172.21.15.57:0/182104207 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7fb00a9fe0 con 0x7f7fb00b0b40 2021-06-25T04:52:35.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.539+0000 7f7fb7582700 1 -- 172.21.15.57:0/182104207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7fb00a9fe0 con 0x7f7fb00b0b40 2021-06-25T04:52:35.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.547+0000 7f7faf7fe700 1 -- 172.21.15.57:0/182104207 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7fb00a9fe0 con 0x7f7fb00b0b40 2021-06-25T04:52:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 -- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f90055490 msgr2=0x7f7f90057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f90055490 0x7f7f90057950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f7fa000b000 tx=0x7f7fa00091d0).stop 2021-06-25T04:52:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 -- 172.21.15.57:0/182104207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb00b0b40 msgr2=0x7f7fb013bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb00b0b40 0x7f7fb013bd50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f7fa800c000 tx=0x7f7fa8006df0).stop 2021-06-25T04:52:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 -- 172.21.15.57:0/182104207 shutdown_connections 2021-06-25T04:52:35.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7f90055490 0x7f7f90057950 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fb00b0b40 0x7f7fb013bd50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fb00b0390 0x7f7fb0144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 --2- 172.21.15.57:0/182104207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb00a9150 0x7f7fb0142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 -- 172.21.15.57:0/182104207 >> 172.21.15.57:0/182104207 conn(0x7f7fb0061100 msgr2=0x7f7fb013cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 -- 172.21.15.57:0/182104207 shutdown_connections 2021-06-25T04:52:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.551+0000 7f7fb7582700 1 -- 172.21.15.57:0/182104207 wait complete. 2021-06-25T04:52:35.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-06-25T04:52:35.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.667+0000 7f22d3e65700 1 Processor -- start 2021-06-25T04:52:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.667+0000 7f22d3e65700 1 -- start start 2021-06-25T04:52:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.667+0000 7f22d3e65700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22cc0b68c0 0x7f22cc0acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.667+0000 7f22d3e65700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 0x7f22cc0a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.667+0000 7f22d3e65700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc0b6ca0 con 0x7f22cc0aa370 2021-06-25T04:52:35.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.667+0000 7f22d3e65700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0611a0 con 0x7f22cc0b68c0 2021-06-25T04:52:35.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.667+0000 7f22d3e65700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc061440 con 0x7f22cc0608d0 2021-06-25T04:52:35.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d1c01700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22cc0b68c0 0x7f22cc0acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d2402700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f22cc0aa370 0x7f22cc0b1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55672/0 (socket says 172.21.15.57:55672) 2021-06-25T04:52:35.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d2402700 1 -- 172.21.15.57:0/328274827 learned_addr learned my addr 172.21.15.57:0/328274827 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:35.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d1400700 1 --2- 172.21.15.57:0/328274827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 0x7f22cc0a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d0bff700 1 -- 172.21.15.57:0/328274827 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699232571 0 0) 0x7f22cc0b6ca0 con 0x7f22cc0aa370 2021-06-25T04:52:35.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d0bff700 1 -- 172.21.15.57:0/328274827 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b4003260 con 0x7f22cc0aa370 2021-06-25T04:52:35.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d1c01700 1 -- 172.21.15.57:0/328274827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 msgr2=0x7f22cc0a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:35.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d1c01700 1 --2- 172.21.15.57:0/328274827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 0x7f22cc0a9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d1c01700 1 -- 172.21.15.57:0/328274827 >> v1:172.21.15.57:6789/0 conn(0x7f22cc0aa370 legacy=0x7f22cc0b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:35.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d1c01700 1 -- 172.21.15.57:0/328274827 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0616e0 con 0x7f22cc0b68c0 2021-06-25T04:52:35.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d1c01700 1 --2- 172.21.15.57:0/328274827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc0b68c0 0x7f22cc0acd10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f22c8002f70 tx=0x7f22c8006df0).ready entity=mon.0 client_cookie=94ab2e3292219623 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:35.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d0bff700 1 -- 172.21.15.57:0/328274827 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c800d4a0 con 0x7f22cc0b68c0 2021-06-25T04:52:35.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d0bff700 1 -- 172.21.15.57:0/328274827 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c8000e90 con 0x7f22cc0b68c0 2021-06-25T04:52:35.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d0bff700 1 -- 172.21.15.57:0/328274827 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c800d7f0 con 0x7f22cc0b68c0 2021-06-25T04:52:35.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d3e65700 1 -- 172.21.15.57:0/328274827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc0b68c0 msgr2=0x7f22cc0acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:35.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d3e65700 1 --2- 172.21.15.57:0/328274827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc0b68c0 0x7f22cc0acd10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f22c8002f70 tx=0x7f22c8006df0).stop 2021-06-25T04:52:35.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d3e65700 1 -- 172.21.15.57:0/328274827 shutdown_connections 2021-06-25T04:52:35.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d3e65700 1 --2- 172.21.15.57:0/328274827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 0x7f22cc0a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d3e65700 1 --2- 172.21.15.57:0/328274827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc0b68c0 0x7f22cc0acd10 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d3e65700 1 -- 172.21.15.57:0/328274827 >> 172.21.15.57:0/328274827 conn(0x7f22cc0b3440 msgr2=0x7f22cc0b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:35.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d3e65700 1 -- 172.21.15.57:0/328274827 shutdown_connections 2021-06-25T04:52:35.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.671+0000 7f22d3e65700 1 -- 172.21.15.57:0/328274827 wait complete. 2021-06-25T04:52:35.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d3e65700 1 Processor -- start 2021-06-25T04:52:35.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d3e65700 1 -- start start 2021-06-25T04:52:35.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d3e65700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 0x7f22cc13fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d3e65700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22cc0aa370 0x7f22cc136100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d3e65700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc0b68c0 0x7f22cc1365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d3e65700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc136ae0 con 0x7f22cc0b68c0 2021-06-25T04:52:35.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d3e65700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc140b00 con 0x7f22cc0aa370 2021-06-25T04:52:35.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d3e65700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0afdf0 con 0x7f22cc0608d0 2021-06-25T04:52:35.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d2402700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc0b68c0 0x7f22cc1365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d1400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22cc0aa370 0x7f22cc136100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d1c01700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 0x7f22cc13fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d1400700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22cc0aa370 0x7f22cc136100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:46952/0 (socket says 172.21.15.57:46952) 2021-06-25T04:52:35.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d1c01700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 0x7f22cc13fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:49620/0 (socket says 172.21.15.57:49620) 2021-06-25T04:52:35.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d2402700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc0b68c0 0x7f22cc1365f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38460/0 (socket says 172.21.15.57:38460) 2021-06-25T04:52:35.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d1400700 1 -- 172.21.15.57:0/337236173 learned_addr learned my addr 172.21.15.57:0/337236173 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:35.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d2402700 1 -- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 msgr2=0x7f22cc13fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:35.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d2402700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 0x7f22cc13fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d2402700 1 -- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22cc0aa370 msgr2=0x7f22cc136100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:35.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d2402700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22cc0aa370 0x7f22cc136100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:35.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d2402700 1 -- 172.21.15.57:0/337236173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c800b180 con 0x7f22cc0b68c0 2021-06-25T04:52:35.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d1c01700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 0x7f22cc13fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:52:35.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d1400700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22cc0aa370 0x7f22cc136100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:52:35.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d2402700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc0b68c0 0x7f22cc1365f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f22c4001490 tx=0x7f22c4007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:35.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22baffd700 1 -- 172.21.15.57:0/337236173 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c4005ba0 con 0x7f22cc0b68c0 2021-06-25T04:52:35.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22baffd700 1 -- 172.21.15.57:0/337236173 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c4005d00 con 0x7f22cc0b68c0 2021-06-25T04:52:35.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d3e65700 1 -- 172.21.15.57:0/337236173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc0b0090 con 0x7f22cc0b68c0 2021-06-25T04:52:35.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22baffd700 1 -- 172.21.15.57:0/337236173 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c40072c0 con 0x7f22cc0b68c0 2021-06-25T04:52:35.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.675+0000 7f22d3e65700 1 -- 172.21.15.57:0/337236173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc14fd70 con 0x7f22cc0b68c0 2021-06-25T04:52:35.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.679+0000 7f22d3e65700 1 -- 172.21.15.57:0/337236173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc154090 con 0x7f22cc0b68c0 2021-06-25T04:52:35.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.679+0000 7f22baffd700 1 -- 172.21.15.57:0/337236173 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f22c4010070 con 0x7f22cc0b68c0 2021-06-25T04:52:35.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.679+0000 7f22baffd700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22ac055450 0x7f22ac057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:35.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.679+0000 7f22baffd700 1 -- 172.21.15.57:0/337236173 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f22c406d570 con 0x7f22cc0b68c0 2021-06-25T04:52:35.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.679+0000 7f22d1c01700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22ac055450 0x7f22ac057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:35.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.679+0000 7f22d1c01700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22ac055450 0x7f22ac057910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f22c8019000 tx=0x7f22c8014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:35.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.687+0000 7f22baffd700 1 -- 172.21.15.57:0/337236173 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f22cc154090 con 0x7f22cc0b68c0 2021-06-25T04:52:35.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:35.855+0000 7f22d3e65700 1 -- 172.21.15.57:0/337236173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f22cc0afc50 con 0x7f22cc0b68c0 2021-06-25T04:52:36.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.271+0000 7f22baffd700 1 -- 172.21.15.57:0/337236173 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v218) v1 ==== 152+0+0 (secure 0 0 0) 0x7f22cc0afc50 con 0x7f22cc0b68c0 2021-06-25T04:52:36.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 -- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22ac055450 msgr2=0x7f22ac057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:36.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22ac055450 0x7f22ac057910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f22c8019000 tx=0x7f22c8014000).stop 2021-06-25T04:52:36.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 -- 172.21.15.57:0/337236173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc0b68c0 msgr2=0x7f22cc1365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:36.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc0b68c0 0x7f22cc1365f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f22c4001490 tx=0x7f22c4007d40).stop 2021-06-25T04:52:36.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 -- 172.21.15.57:0/337236173 shutdown_connections 2021-06-25T04:52:36.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f22ac055450 0x7f22ac057910 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:36.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc0b68c0 0x7f22cc1365f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:36.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22cc0aa370 0x7f22cc136100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:36.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 --2- 172.21.15.57:0/337236173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22cc0608d0 0x7f22cc13fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:36.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 -- 172.21.15.57:0/337236173 >> 172.21.15.57:0/337236173 conn(0x7f22cc0b3440 msgr2=0x7f22cc137550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:36.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 -- 172.21.15.57:0/337236173 shutdown_connections 2021-06-25T04:52:36.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.275+0000 7f22d3e65700 1 -- 172.21.15.57:0/337236173 wait complete. 2021-06-25T04:52:36.296 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-06-25T04:52:36.297 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-06-25T04:52:36.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-06-25T04:52:36.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.399+0000 7fb95bfff700 1 Processor -- start 2021-06-25T04:52:36.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.399+0000 7fb95bfff700 1 -- start start 2021-06-25T04:52:36.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb95c0b2540 0x7fb95c0abad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:36.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb95c0b1220 0x7fb95c0abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:36.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb95c0b1750 0x7fb95c0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:36.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c0add40 con 0x7fb95c0b1220 2021-06-25T04:52:36.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c0adfe0 con 0x7fb95c0b1750 2021-06-25T04:52:36.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0a9350 con 0x7fb95c0b2540 2021-06-25T04:52:36.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb953fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb95c0b1220 0x7fb95c0abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:36.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb953fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb95c0b1220 0x7fb95c0abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38464/0 (socket says 172.21.15.57:38464) 2021-06-25T04:52:36.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb953fff700 1 -- 172.21.15.57:0/4035154570 learned_addr learned my addr 172.21.15.57:0/4035154570 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:36.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95b7fe700 1 --2- 172.21.15.57:0/4035154570 >> v2:172.21.15.87:3300/0 conn(0x7fb95c0b1750 0x7fb95c0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:36.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95affd700 1 --2- 172.21.15.57:0/4035154570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb95c0b2540 0x7fb95c0abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:36.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb953fff700 1 -- 172.21.15.57:0/4035154570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb95c0b2540 msgr2=0x7fb95c0abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:36.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb953fff700 1 --2- 172.21.15.57:0/4035154570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb95c0b2540 0x7fb95c0abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:36.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb953fff700 1 -- 172.21.15.57:0/4035154570 >> v2:172.21.15.87:3300/0 conn(0x7fb95c0b1750 msgr2=0x7fb95c0afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:36.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb953fff700 1 --2- 172.21.15.57:0/4035154570 >> v2:172.21.15.87:3300/0 conn(0x7fb95c0b1750 0x7fb95c0afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:36.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb953fff700 1 -- 172.21.15.57:0/4035154570 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c0a97f0 con 0x7fb95c0b1220 2021-06-25T04:52:36.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb953fff700 1 --2- 172.21.15.57:0/4035154570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb95c0b1220 0x7fb95c0abfc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fb95c0679f0 tx=0x7fb944006eb0).ready entity=mon.0 client_cookie=33a8d90855dece3f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:36.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95a7fc700 1 -- 172.21.15.57:0/4035154570 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb94400e610 con 0x7fb95c0b1220 2021-06-25T04:52:36.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95a7fc700 1 -- 172.21.15.57:0/4035154570 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb944000e90 con 0x7fb95c0b1220 2021-06-25T04:52:36.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95a7fc700 1 -- 172.21.15.57:0/4035154570 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb94400e9a0 con 0x7fb95c0b1220 2021-06-25T04:52:36.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 -- 172.21.15.57:0/4035154570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb95c0b1220 msgr2=0x7fb95c0abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:36.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 --2- 172.21.15.57:0/4035154570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb95c0b1220 0x7fb95c0abfc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fb95c0679f0 tx=0x7fb944006eb0).stop 2021-06-25T04:52:36.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 -- 172.21.15.57:0/4035154570 shutdown_connections 2021-06-25T04:52:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 --2- 172.21.15.57:0/4035154570 >> v2:172.21.15.87:3300/0 conn(0x7fb95c0b1750 0x7fb95c0afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 --2- 172.21.15.57:0/4035154570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb95c0b1220 0x7fb95c0abfc0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 --2- 172.21.15.57:0/4035154570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb95c0b2540 0x7fb95c0abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 -- 172.21.15.57:0/4035154570 >> 172.21.15.57:0/4035154570 conn(0x7fb95c060140 msgr2=0x7fb95c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:36.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 -- 172.21.15.57:0/4035154570 shutdown_connections 2021-06-25T04:52:36.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.403+0000 7fb95bfff700 1 -- 172.21.15.57:0/4035154570 wait complete. 2021-06-25T04:52:36.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95bfff700 1 Processor -- start 2021-06-25T04:52:36.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95bfff700 1 -- start start 2021-06-25T04:52:36.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb95c0b1220 0x7fb95c13bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:36.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb95c0b1750 0x7fb95c062fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:36.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb95c0b2540 0x7fb95c0634b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:36.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c064850 con 0x7fb95c0b1750 2021-06-25T04:52:36.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0aa9b0 con 0x7fb95c0b1220 2021-06-25T04:52:36.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0ac690 con 0x7fb95c0b2540 2021-06-25T04:52:36.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb953fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb95c0b1750 0x7fb95c062fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:36.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb953fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb95c0b1750 0x7fb95c062fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38472/0 (socket says 172.21.15.57:38472) 2021-06-25T04:52:36.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb953fff700 1 -- 172.21.15.57:0/4089553811 learned_addr learned my addr 172.21.15.57:0/4089553811 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:36.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95affd700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb95c0b1220 0x7fb95c13bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:36.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95b7fe700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb95c0b2540 0x7fb95c0634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:36.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb953fff700 1 -- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb95c0b2540 msgr2=0x7fb95c0634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:36.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb953fff700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb95c0b2540 0x7fb95c0634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:36.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb953fff700 1 -- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb95c0b1220 msgr2=0x7fb95c13bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:36.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb953fff700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb95c0b1220 0x7fb95c13bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:36.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb953fff700 1 -- 172.21.15.57:0/4089553811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94400b1e0 con 0x7fb95c0b1750 2021-06-25T04:52:36.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb953fff700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb95c0b1750 0x7fb95c062fc0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fb95c0679f0 tx=0x7fb944015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:36.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb958ff9700 1 -- 172.21.15.57:0/4089553811 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb944011610 con 0x7fb95c0b1750 2021-06-25T04:52:36.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb958ff9700 1 -- 172.21.15.57:0/4089553811 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb944011770 con 0x7fb95c0b1750 2021-06-25T04:52:36.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95bfff700 1 -- 172.21.15.57:0/4089553811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c0aae70 con 0x7fb95c0b1750 2021-06-25T04:52:36.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb958ff9700 1 -- 172.21.15.57:0/4089553811 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb944011ad0 con 0x7fb95c0b1750 2021-06-25T04:52:36.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.407+0000 7fb95bfff700 1 -- 172.21.15.57:0/4089553811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c0ab510 con 0x7fb95c0b1750 2021-06-25T04:52:36.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.411+0000 7fb95bfff700 1 -- 172.21.15.57:0/4089553811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c0aa4e0 con 0x7fb95c0b1750 2021-06-25T04:52:36.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.411+0000 7fb958ff9700 1 -- 172.21.15.57:0/4089553811 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb94400f070 con 0x7fb95c0b1750 2021-06-25T04:52:36.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.411+0000 7fb958ff9700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb940055450 0x7fb940057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:36.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.411+0000 7fb958ff9700 1 -- 172.21.15.57:0/4089553811 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb94406f4b0 con 0x7fb95c0b1750 2021-06-25T04:52:36.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.411+0000 7fb95affd700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb940055450 0x7fb940057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:36.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.411+0000 7fb95affd700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb940055450 0x7fb940057910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fb94c00b000 tx=0x7fb94c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:36.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.419+0000 7fb958ff9700 1 -- 172.21.15.57:0/4089553811 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb944045830 con 0x7fb95c0b1750 2021-06-25T04:52:36.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:36.591+0000 7fb95bfff700 1 -- 172.21.15.57:0/4089553811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7fb95c0ab950 con 0x7fb95c0b1750 2021-06-25T04:52:37.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.279+0000 7fb958ff9700 1 -- 172.21.15.57:0/4089553811 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v219) v1 ==== 150+0+0 (secure 0 0 0) 0x7fb944048e50 con 0x7fb95c0b1750 2021-06-25T04:52:37.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 -- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb940055450 msgr2=0x7fb940057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:37.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb940055450 0x7fb940057910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fb94c00b000 tx=0x7fb94c006df0).stop 2021-06-25T04:52:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 -- 172.21.15.57:0/4089553811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb95c0b1750 msgr2=0x7fb95c062fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb95c0b1750 0x7fb95c062fc0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fb95c0679f0 tx=0x7fb944015000).stop 2021-06-25T04:52:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 -- 172.21.15.57:0/4089553811 shutdown_connections 2021-06-25T04:52:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb940055450 0x7fb940057910 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb95c0b2540 0x7fb95c0634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb95c0b1750 0x7fb95c062fc0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 --2- 172.21.15.57:0/4089553811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb95c0b1220 0x7fb95c13bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 -- 172.21.15.57:0/4089553811 >> 172.21.15.57:0/4089553811 conn(0x7fb95c060140 msgr2=0x7fb95c0b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:37.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 -- 172.21.15.57:0/4089553811 shutdown_connections 2021-06-25T04:52:37.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.283+0000 7fb95bfff700 1 -- 172.21.15.57:0/4089553811 wait complete. 2021-06-25T04:52:37.306 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:52:37.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.415+0000 7f760eb0f700 1 Processor -- start 2021-06-25T04:52:37.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.415+0000 7f760eb0f700 1 -- start start 2021-06-25T04:52:37.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760eb0f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f760805fbc0 0x7f76080b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760eb0f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76080b5950 0x7f76080b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760eb0f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7608143f20 con 0x7f76080b6520 2021-06-25T04:52:37.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760eb0f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76080ba670 con 0x7f76080b5950 2021-06-25T04:52:37.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760eb0f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760805ffa0 con 0x7f760805fbc0 2021-06-25T04:52:37.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760d0ac700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76080b5950 0x7f76080b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760d0ac700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76080b5950 0x7f76080b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38484/0 (socket says 172.21.15.57:38484) 2021-06-25T04:52:37.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760d0ac700 1 -- 172.21.15.57:0/378859864 learned_addr learned my addr 172.21.15.57:0/378859864 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:37.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760c8ab700 1 --2- 172.21.15.57:0/378859864 >> v2:172.21.15.87:3300/0 conn(0x7f760805fbc0 0x7f76080b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760d0ac700 1 -- 172.21.15.57:0/378859864 >> v2:172.21.15.87:3300/0 conn(0x7f760805fbc0 msgr2=0x7f76080b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:37.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760d0ac700 1 --2- 172.21.15.57:0/378859864 >> v2:172.21.15.87:3300/0 conn(0x7f760805fbc0 0x7f76080b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760d0ac700 1 -- 172.21.15.57:0/378859864 >> v1:172.21.15.87:6789/0 conn(0x7f76080b6520 legacy=0x7f76080b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:37.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760d0ac700 1 -- 172.21.15.57:0/378859864 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7608143a10 con 0x7f76080b5950 2021-06-25T04:52:37.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760d0ac700 1 --2- 172.21.15.57:0/378859864 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76080b5950 0x7f76080b49c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f7608143000 tx=0x7f7600009290).ready entity=mon.0 client_cookie=cab0f2a0a351a44b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:37.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f76077fe700 1 -- 172.21.15.57:0/378859864 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f760000b830 con 0x7f76080b5950 2021-06-25T04:52:37.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f76077fe700 1 -- 172.21.15.57:0/378859864 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760000b990 con 0x7f76080b5950 2021-06-25T04:52:37.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f76077fe700 1 -- 172.21.15.57:0/378859864 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f760000bb40 con 0x7f76080b5950 2021-06-25T04:52:37.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760eb0f700 1 -- 172.21.15.57:0/378859864 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76080b5950 msgr2=0x7f76080b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:37.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760eb0f700 1 --2- 172.21.15.57:0/378859864 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76080b5950 0x7f76080b49c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f7608143000 tx=0x7f7600009290).stop 2021-06-25T04:52:37.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.419+0000 7f760eb0f700 1 -- 172.21.15.57:0/378859864 shutdown_connections 2021-06-25T04:52:37.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 --2- 172.21.15.57:0/378859864 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76080b5950 0x7f76080b49c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 --2- 172.21.15.57:0/378859864 >> v2:172.21.15.87:3300/0 conn(0x7f760805fbc0 0x7f76080b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 -- 172.21.15.57:0/378859864 >> 172.21.15.57:0/378859864 conn(0x7f7608062360 msgr2=0x7f7608066da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:37.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 -- 172.21.15.57:0/378859864 shutdown_connections 2021-06-25T04:52:37.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 -- 172.21.15.57:0/378859864 wait complete. 2021-06-25T04:52:37.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 Processor -- start 2021-06-25T04:52:37.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 -- start start 2021-06-25T04:52:37.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f760805fbc0 0x7f760813f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76080b5950 0x7f76080afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76080b6520 0x7f76081465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7608144f50 con 0x7f760805fbc0 2021-06-25T04:52:37.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760813d080 con 0x7f76080b6520 2021-06-25T04:52:37.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760eb0f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760813d320 con 0x7f76080b5950 2021-06-25T04:52:37.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760c8ab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f760805fbc0 0x7f760813f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760c8ab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f760805fbc0 0x7f760813f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38486/0 (socket says 172.21.15.57:38486) 2021-06-25T04:52:37.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.423+0000 7f760c8ab700 1 -- 172.21.15.57:0/3874143339 learned_addr learned my addr 172.21.15.57:0/3874143339 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:37.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f7607fff700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76080b5950 0x7f76080afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f760d0ac700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76080b6520 0x7f76081465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f760c8ab700 1 -- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76080b5950 msgr2=0x7f76080afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:37.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f760c8ab700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76080b5950 0x7f76080afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f760c8ab700 1 -- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76080b6520 msgr2=0x7f76081465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:37.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f760c8ab700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76080b6520 0x7f76081465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f760c8ab700 1 -- 172.21.15.57:0/3874143339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600009530 con 0x7f760805fbc0 2021-06-25T04:52:37.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f760d0ac700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76080b6520 0x7f76081465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:52:37.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f760c8ab700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f760805fbc0 0x7f760813f960 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f75f80030b0 tx=0x7f75f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:37.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f7605ffb700 1 -- 172.21.15.57:0/3874143339 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f8011780 con 0x7f760805fbc0 2021-06-25T04:52:37.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f7605ffb700 1 -- 172.21.15.57:0/3874143339 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f80118e0 con 0x7f760805fbc0 2021-06-25T04:52:37.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f760eb0f700 1 -- 172.21.15.57:0/3874143339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760813eda0 con 0x7f760805fbc0 2021-06-25T04:52:37.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f7605ffb700 1 -- 172.21.15.57:0/3874143339 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f8011c40 con 0x7f760805fbc0 2021-06-25T04:52:37.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f760eb0f700 1 -- 172.21.15.57:0/3874143339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7608146ae0 con 0x7f760805fbc0 2021-06-25T04:52:37.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f7605ffb700 1 -- 172.21.15.57:0/3874143339 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f75f8012420 con 0x7f760805fbc0 2021-06-25T04:52:37.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.427+0000 7f760eb0f700 1 -- 172.21.15.57:0/3874143339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760813cee0 con 0x7f760805fbc0 2021-06-25T04:52:37.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.431+0000 7f7605ffb700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ec0553f0 0x7f75ec0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.431+0000 7f7605ffb700 1 -- 172.21.15.57:0/3874143339 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f75f806dab0 con 0x7f760805fbc0 2021-06-25T04:52:37.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.431+0000 7f7607fff700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ec0553f0 0x7f75ec0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.431+0000 7f7607fff700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ec0553f0 0x7f75ec0578b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f75f000a000 tx=0x7f75f0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:37.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.439+0000 7f7605ffb700 1 -- 172.21.15.57:0/3874143339 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f760813cee0 con 0x7f760805fbc0 2021-06-25T04:52:37.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.575+0000 7f760eb0f700 1 -- 172.21.15.57:0/3874143339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f760813cee0 con 0x7f760805fbc0 2021-06-25T04:52:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f7605ffb700 1 -- 172.21.15.57:0/3874143339 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f760813cee0 con 0x7f760805fbc0 2021-06-25T04:52:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 -- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ec0553f0 msgr2=0x7f75ec0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ec0553f0 0x7f75ec0578b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f75f000a000 tx=0x7f75f0008040).stop 2021-06-25T04:52:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 -- 172.21.15.57:0/3874143339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f760805fbc0 msgr2=0x7f760813f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f760805fbc0 0x7f760813f960 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f75f80030b0 tx=0x7f75f8008040).stop 2021-06-25T04:52:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 -- 172.21.15.57:0/3874143339 shutdown_connections 2021-06-25T04:52:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f75ec0553f0 0x7f75ec0578b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76080b6520 0x7f76081465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76080b5950 0x7f76080afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 --2- 172.21.15.57:0/3874143339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f760805fbc0 0x7f760813f960 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 -- 172.21.15.57:0/3874143339 >> 172.21.15.57:0/3874143339 conn(0x7f7608062360 msgr2=0x7f7608140e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 -- 172.21.15.57:0/3874143339 shutdown_connections 2021-06-25T04:52:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.579+0000 7f760eb0f700 1 -- 172.21.15.57:0/3874143339 wait complete. 2021-06-25T04:52:37.598 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:52:37.599 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:52:37.615 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:52:37.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:52:37.634 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:52:37.656 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:52:37.659 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:52:37.665 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:52:37.668 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:52:37.677 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:52:37.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:37.678 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:52:37.678 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:52:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:52:37.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:52:37.759 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:52:37.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:37.760 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:52:37.760 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:52:37.767 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:52:37.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:52:37.769 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:52:37.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:52:37.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faefb4c9700 1 Processor -- start 2021-06-25T04:52:37.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faefb4c9700 1 -- start start 2021-06-25T04:52:37.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faefb4c9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faef40670e0 0x7faef40b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faefb4c9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faef4143970 0x7faef40aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faefb4c9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faef413ffb0 0x7faef4140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faefb4c9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef4143040 con 0x7faef413ffb0 2021-06-25T04:52:37.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faefb4c9700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef40b9b90 con 0x7faef40670e0 2021-06-25T04:52:37.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faefb4c9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef40674c0 con 0x7faef4143970 2021-06-25T04:52:37.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef9a66700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faef413ffb0 0x7faef4140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef9a66700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faef413ffb0 0x7faef4140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38498/0 (socket says 172.21.15.57:38498) 2021-06-25T04:52:37.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef9265700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faef40670e0 0x7faef40b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef9a66700 1 -- 172.21.15.57:0/2277055527 learned_addr learned my addr 172.21.15.57:0/2277055527 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:37.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef8a64700 1 --2- 172.21.15.57:0/2277055527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faef4143970 0x7faef40aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef9265700 1 -- 172.21.15.57:0/2277055527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faef4143970 msgr2=0x7faef40aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:37.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef9265700 1 --2- 172.21.15.57:0/2277055527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faef4143970 0x7faef40aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef9265700 1 -- 172.21.15.57:0/2277055527 >> v2:172.21.15.57:3300/0 conn(0x7faef413ffb0 msgr2=0x7faef4140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:37.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef9265700 1 --2- 172.21.15.57:0/2277055527 >> v2:172.21.15.57:3300/0 conn(0x7faef413ffb0 0x7faef4140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef9265700 1 -- 172.21.15.57:0/2277055527 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef40af490 con 0x7faef40670e0 2021-06-25T04:52:37.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef9a66700 1 --2- 172.21.15.57:0/2277055527 >> v2:172.21.15.57:3300/0 conn(0x7faef413ffb0 0x7faef4140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:52:37.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faef9265700 1 --2- 172.21.15.57:0/2277055527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faef40670e0 0x7faef40b96a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7faef0002f70 tx=0x7faef0006df0).ready entity=mon.1 client_cookie=640bbbf36c935c1b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:37.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faedffff700 1 -- 172.21.15.57:0/2277055527 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef000d4a0 con 0x7faef40670e0 2021-06-25T04:52:37.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faedffff700 1 -- 172.21.15.57:0/2277055527 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef0000e90 con 0x7faef40670e0 2021-06-25T04:52:37.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faedffff700 1 -- 172.21.15.57:0/2277055527 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef000d7f0 con 0x7faef40670e0 2021-06-25T04:52:37.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faefb4c9700 1 -- 172.21.15.57:0/2277055527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faef40670e0 msgr2=0x7faef40b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:37.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.875+0000 7faefb4c9700 1 --2- 172.21.15.57:0/2277055527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faef40670e0 0x7faef40b96a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7faef0002f70 tx=0x7faef0006df0).stop 2021-06-25T04:52:37.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 -- 172.21.15.57:0/2277055527 shutdown_connections 2021-06-25T04:52:37.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 --2- 172.21.15.57:0/2277055527 >> v2:172.21.15.57:3300/0 conn(0x7faef413ffb0 0x7faef4140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 --2- 172.21.15.57:0/2277055527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faef4143970 0x7faef40aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 --2- 172.21.15.57:0/2277055527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faef40670e0 0x7faef40b96a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 -- 172.21.15.57:0/2277055527 >> 172.21.15.57:0/2277055527 conn(0x7faef405f9b0 msgr2=0x7faef4061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:37.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 -- 172.21.15.57:0/2277055527 shutdown_connections 2021-06-25T04:52:37.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 -- 172.21.15.57:0/2277055527 wait complete. 2021-06-25T04:52:37.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 Processor -- start 2021-06-25T04:52:37.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 -- start start 2021-06-25T04:52:37.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faef40670e0 0x7faef41451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faef413ffb0 0x7faef4155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faef4143970 0x7faef41560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef40b9510 con 0x7faef413ffb0 2021-06-25T04:52:37.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef4155720 con 0x7faef40670e0 2021-06-25T04:52:37.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faefb4c9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef40b3e90 con 0x7faef4143970 2021-06-25T04:52:37.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faef8a64700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faef413ffb0 0x7faef4155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faef8a64700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faef413ffb0 0x7faef4155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38502/0 (socket says 172.21.15.57:38502) 2021-06-25T04:52:37.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faef8a64700 1 -- 172.21.15.57:0/1194734652 learned_addr learned my addr 172.21.15.57:0/1194734652 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:37.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faef9a66700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faef4143970 0x7faef41560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.879+0000 7faef9265700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faef40670e0 0x7faef41451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faef8a64700 1 -- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faef4143970 msgr2=0x7faef41560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:37.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faef8a64700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faef4143970 0x7faef41560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faef8a64700 1 -- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faef40670e0 msgr2=0x7faef41451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:37.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faef8a64700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faef40670e0 0x7faef41451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:37.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faef8a64700 1 -- 172.21.15.57:0/1194734652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec009530 con 0x7faef413ffb0 2021-06-25T04:52:37.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faef8a64700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faef413ffb0 0x7faef4155bc0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7faee800c000 tx=0x7faee8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:37.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faee6ffd700 1 -- 172.21.15.57:0/1194734652 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faee8011750 con 0x7faef413ffb0 2021-06-25T04:52:37.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faee6ffd700 1 -- 172.21.15.57:0/1194734652 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee80118b0 con 0x7faef413ffb0 2021-06-25T04:52:37.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faefb4c9700 1 -- 172.21.15.57:0/1194734652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef000b180 con 0x7faef413ffb0 2021-06-25T04:52:37.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faee6ffd700 1 -- 172.21.15.57:0/1194734652 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faee8011c10 con 0x7faef413ffb0 2021-06-25T04:52:37.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faefb4c9700 1 -- 172.21.15.57:0/1194734652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef40b8ba0 con 0x7faef413ffb0 2021-06-25T04:52:37.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.883+0000 7faefb4c9700 1 -- 172.21.15.57:0/1194734652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef41558e0 con 0x7faef413ffb0 2021-06-25T04:52:37.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.887+0000 7faee6ffd700 1 -- 172.21.15.57:0/1194734652 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7faee8011d70 con 0x7faef413ffb0 2021-06-25T04:52:37.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.887+0000 7faee6ffd700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed00553d0 0x7faed0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:37.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.887+0000 7faee6ffd700 1 -- 172.21.15.57:0/1194734652 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7faee806dfc0 con 0x7faef413ffb0 2021-06-25T04:52:37.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.887+0000 7faef9265700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed00553d0 0x7faed0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:37.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.887+0000 7faef9265700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed00553d0 0x7faed0057890 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7faef0019000 tx=0x7faef0014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:37.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:37.891+0000 7faee6ffd700 1 -- 172.21.15.57:0/1194734652 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7faee80443b0 con 0x7faef413ffb0 2021-06-25T04:52:38.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.019+0000 7faefb4c9700 1 -- 172.21.15.57:0/1194734652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7faef4057310 con 0x7faef413ffb0 2021-06-25T04:52:38.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.019+0000 7faee6ffd700 1 -- 172.21.15.57:0/1194734652 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v59) v1 ==== 81+0+29220 (secure 0 0 0) 0x7faee8018270 con 0x7faef413ffb0 2021-06-25T04:52:38.024 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:38.025 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:52:38.025 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 59, 2021-06-25T04:52:38.025 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:52:38.025 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:52:38.026 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:52:35.254309+0000", 2021-06-25T04:52:38.026 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:52:38.026 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:52:38.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:52:38.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:52:38.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:52:38.027 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:52:38.028 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:52:38.028 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:52:38.028 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:52:38.028 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:52:38.029 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:52:38.029 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:52:38.029 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:52:38.029 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:52:38.030 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:52:38.030 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 10, 2021-06-25T04:52:38.030 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:52:38.031 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:52:38.032 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:52:38.032 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:52:38.032 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:52:38.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.033 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:52:38.033 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:52:38.033 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:52:38.034 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:52:38.034 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:52:38.034 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:52:38.035 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:52:38.035 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:52:38.035 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:52:38.035 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:52:38.036 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:52:38.036 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:52:38.036 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:52:38.036 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:52:38.037 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:52:38.037 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:52:38.037 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:52:38.038 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:52:38.038 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:52:38.038 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:52:38.038 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:52:38.039 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:52:38.039 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:52:38.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.039 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:52:38.040 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:52:38.040 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:52:38.040 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:52:38.040 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:52:38.040 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:52:38.041 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:52:38.041 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:52:38.042 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:52:38.042 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:52:38.042 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:52:38.043 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:52:38.043 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:52:38.043 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:52:38.043 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:52:38.043 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:52:38.044 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:52:38.044 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:52:38.044 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:52:38.045 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:52:38.045 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:52:38.045 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:52:38.045 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:52:38.045 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:52:38.046 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:52:38.046 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:52:38.046 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:52:38.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.047 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:52:38.047 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:52:38.048 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:52:38.048 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:52:38.048 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:52:38.048 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:52:38.048 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:52:38.049 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:52:38.049 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:52:38.050 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:52:38.050 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:52:38.050 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:52:38.050 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:52:38.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.051 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:52:38.051 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:52:38.051 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.052 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:52:38.052 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:52:38.053 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:52:38.053 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:52:38.053 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:52:38.053 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:52:38.053 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:52:38.054 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:52:38.054 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:52:38.054 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:52:38.054 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:52:38.055 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:52:38.055 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:52:38.055 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:52:38.055 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:52:38.055 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:52:38.056 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:52:38.056 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:52:38.056 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:52:38.056 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:52:38.057 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:52:38.057 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:52:38.057 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:52:38.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.058 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:52:38.058 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:52:38.058 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:52:38.059 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:52:38.059 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:52:38.059 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:52:38.059 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:52:38.060 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:52:38.060 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:52:38.060 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:52:38.060 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:52:38.060 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:52:38.061 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:52:38.061 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:52:38.061 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:52:38.061 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:52:38.061 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:52:38.062 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:52:38.062 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:52:38.062 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:52:38.063 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:52:38.063 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:52:38.063 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:52:38.063 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:52:38.063 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:52:38.064 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:52:38.064 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:52:38.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.064 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:52:38.065 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:52:38.065 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:52:38.065 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:52:38.065 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:52:38.065 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:52:38.066 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:52:38.066 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:52:38.066 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:52:38.066 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:52:38.067 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:52:38.067 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:52:38.067 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:52:38.067 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:52:38.068 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.068 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.068 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:52:38.069 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:52:38.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.069 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:52:38.069 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:52:38.069 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:38.070 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:38.070 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:38.070 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:38.070 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:38.071 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:38.071 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:38.071 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 53, 2021-06-25T04:52:38.071 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:38.072 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:38.072 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:38.072 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.073 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.073 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:52:38.073 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:38.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.074 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.074 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:52:38.074 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:38.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.075 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.075 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:38.076 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.076 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.076 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:52:38.076 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:38.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.077 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.077 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:52:38.078 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:38.078 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.078 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.079 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:38.079 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.080 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.080 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:52:38.080 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:38.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.081 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.081 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:52:38.081 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:38.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.082 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.082 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:38.083 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.083 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.083 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:52:38.083 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:38.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.084 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.084 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:52:38.085 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:52:38.085 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.085 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.086 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:52:38.086 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:52:38.086 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:52:38.086 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:52:38.086 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:38.087 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:38.087 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:38.087 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.088 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:52:38.088 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:52:38.088 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:38.089 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:38.089 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:38.089 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:38.090 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:38.090 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:38.090 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:38.090 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 53, 2021-06-25T04:52:38.090 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:38.091 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:38.091 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:38.091 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.092 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.092 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:52:38.092 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:38.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.093 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.093 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:52:38.093 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:38.094 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.094 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.094 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:38.095 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.095 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.095 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:52:38.095 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:38.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.096 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.096 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:52:38.097 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:38.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.097 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.097 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:38.098 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.098 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.098 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:52:38.099 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:38.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.099 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.100 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:52:38.100 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:38.100 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.100 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.101 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:38.101 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.102 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.102 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:52:38.102 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:38.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.103 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.103 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:52:38.103 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:52:38.103 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.104 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.104 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:52:38.104 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:52:38.105 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:52:38.105 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:52:38.105 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:38.105 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:38.105 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:38.106 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.106 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:52:38.107 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:52:38.107 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:38.107 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:38.107 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:38.108 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:38.108 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:38.108 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:38.108 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:38.109 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 54, 2021-06-25T04:52:38.109 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:38.109 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:38.109 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:38.110 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.110 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.110 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:52:38.111 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:38.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.111 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.112 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:52:38.112 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:38.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.112 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.113 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:38.113 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.114 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.114 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:52:38.114 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:38.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.115 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.115 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:52:38.115 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:38.116 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.116 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.116 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:38.116 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.117 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.117 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:52:38.117 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:38.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.118 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.118 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:52:38.119 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:38.119 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.119 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.120 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:38.120 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.121 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.121 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:52:38.121 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:38.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.122 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.122 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:52:38.122 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:52:38.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.123 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.123 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:52:38.123 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:52:38.124 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:52:38.124 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:52:38.124 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:38.124 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:38.125 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:38.125 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.126 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:52:38.126 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:52:38.126 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:38.126 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:38.126 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:38.127 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:38.127 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:38.127 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:38.127 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:38.128 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 52, 2021-06-25T04:52:38.128 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:38.128 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:38.128 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:38.128 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.129 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.129 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:52:38.129 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:38.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.130 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.130 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:52:38.131 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:38.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.131 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.132 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:38.132 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.133 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.133 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:52:38.133 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:38.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.134 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.134 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:52:38.134 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:38.135 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.135 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.135 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:38.136 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.136 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.137 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:52:38.137 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:38.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.138 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.138 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:52:38.138 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:38.138 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.139 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.139 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:38.139 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.140 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.140 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:52:38.140 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:38.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.141 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.141 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:52:38.142 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:52:38.142 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.142 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.143 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:52:38.143 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:52:38.143 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:52:38.144 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:52:38.144 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:38.144 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:38.144 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:38.145 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.145 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:52:38.146 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:52:38.146 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:38.146 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:38.146 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:38.147 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:38.147 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:38.147 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:38.147 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:38.148 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 53, 2021-06-25T04:52:38.148 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:38.148 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:38.148 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:38.148 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.149 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.149 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:52:38.150 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:38.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.151 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.151 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:52:38.151 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:38.151 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.152 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.152 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:38.152 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.153 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.153 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:52:38.153 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:38.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.154 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.154 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:52:38.155 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:38.155 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.155 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.155 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:38.156 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.156 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.156 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:52:38.157 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:38.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.157 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.158 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:52:38.158 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:38.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.158 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.159 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:38.159 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.159 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.160 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:52:38.160 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:38.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.160 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.161 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:52:38.161 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:52:38.161 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.162 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.162 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:52:38.162 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:52:38.163 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:52:38.163 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:52:38.163 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:38.163 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:38.164 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:38.164 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.164 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:52:38.165 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:52:38.165 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:38.165 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:38.165 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:38.166 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:38.166 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:38.166 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:38.166 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:38.167 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 53, 2021-06-25T04:52:38.167 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:38.167 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:38.167 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:38.167 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.168 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.168 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:52:38.168 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:38.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.169 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.169 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:52:38.170 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:38.170 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.170 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.171 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:38.171 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.171 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.172 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:52:38.172 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:38.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.173 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.173 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:52:38.173 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:38.173 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.174 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.174 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:38.174 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.175 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.175 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:52:38.175 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:38.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.176 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.176 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:52:38.177 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:38.177 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.177 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.178 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:38.178 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.178 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.178 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:52:38.179 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:38.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.179 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.180 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:52:38.180 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:52:38.180 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.180 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.181 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:52:38.181 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:52:38.181 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:52:38.181 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:52:38.182 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:38.182 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:38.182 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:38.183 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.183 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:52:38.184 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:52:38.184 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:38.184 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:38.184 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:38.184 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:38.185 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:38.185 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:38.185 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:38.185 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 53, 2021-06-25T04:52:38.186 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:38.186 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:38.186 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:38.186 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.187 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.187 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:52:38.187 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:38.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.188 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.188 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:52:38.188 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:38.189 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.189 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.189 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:38.189 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.190 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.190 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:52:38.190 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:38.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.191 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.191 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:52:38.192 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:38.192 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.192 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.193 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:38.193 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.194 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.194 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:52:38.194 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:38.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.195 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.195 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:52:38.195 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:38.195 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.196 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.196 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:38.196 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.197 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.197 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:52:38.197 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:38.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.198 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.198 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:52:38.198 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:52:38.199 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.199 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.199 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:52:38.199 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:52:38.200 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:52:38.200 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:52:38.200 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:38.200 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:38.201 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:38.201 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.202 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:52:38.202 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:52:38.202 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:52:38.202 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:52:38.203 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:52:38.203 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:52:38.203 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:52:38.204 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:52:38.204 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:52:38.204 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 52, 2021-06-25T04:52:38.204 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:52:38.205 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:52:38.205 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:52:38.205 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.205 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.206 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:52:38.206 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:38.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.207 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.207 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:52:38.207 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:38.207 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.208 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.208 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:52:38.208 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.209 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.209 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:52:38.209 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:38.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.210 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.210 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:52:38.211 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:38.211 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.211 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.212 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:52:38.212 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.213 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.213 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:52:38.213 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:38.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.214 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.214 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:52:38.214 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:38.215 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.215 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.215 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:52:38.216 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:52:38.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.216 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:52:38.216 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:52:38.216 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:38.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.217 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:52:38.217 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:52:38.218 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:52:38.218 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.218 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.219 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:52:38.219 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:52:38.219 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:52:38.219 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:52:38.220 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:52:38.220 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:52:38.220 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:52:38.220 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:38.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.221 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:52:38.221 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:52:38.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.222 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:52:38.222 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:38.222 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:38.222 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:38.222 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:38.223 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:38.223 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:52:38.223 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:38.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.224 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:52:38.224 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:38.225 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:38.225 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:38.225 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:38.225 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:38.226 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:52:38.226 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:38.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.227 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:52:38.227 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:38.227 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:38.227 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:38.227 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:38.228 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:38.228 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:52:38.228 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:38.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.229 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:52:38.229 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:38.230 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:38.230 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:38.230 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:38.230 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:38.231 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:52:38.231 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:38.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.232 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:52:38.232 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:38.232 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:38.233 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:38.233 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:38.233 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:38.233 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:52:38.234 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:38.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.234 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:52:38.235 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:38.235 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:38.235 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:38.235 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:38.236 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:38.236 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:52:38.236 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:38.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.237 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:52:38.237 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:38.237 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:38.238 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:38.238 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:38.238 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:38.238 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:52:38.238 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:38.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:38.239 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:52:38.239 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:52:38.240 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:52:38.240 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:52:38.240 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:52:38.240 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:52:38.240 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:52:38.241 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:52:38.241 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.241 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:52:38.241 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:52:38.242 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:52:38.242 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:52:38.242 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:52:38.242 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:52:38.243 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6835/3353139901": "2021-06-26T04:52:31.829942+0000", 2021-06-25T04:52:38.243 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6834/3353139901": "2021-06-26T04:52:31.829942+0000" 2021-06-25T04:52:38.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.243 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:52:38.243 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:52:38.244 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:52:38.244 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:52:38.244 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:52:38.245 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:52:38.245 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:52:38.245 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:52:38.245 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:52:38.246 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:52:38.246 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:52:38.247 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:52:38.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.247 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:52:38.248 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:52:38.248 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:52:38.248 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:52:38.248 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:52:38.249 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:52:38.249 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:52:38.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:38.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:38.250 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:52:38.250 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:52:38.251 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:52:38.251 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:52:38.251 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:52:38.252 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:52:38.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 -- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed00553d0 msgr2=0x7faed0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed00553d0 0x7faed0057890 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7faef0019000 tx=0x7faef0014000).stop 2021-06-25T04:52:38.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 -- 172.21.15.57:0/1194734652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faef413ffb0 msgr2=0x7faef4155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faef413ffb0 0x7faef4155bc0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7faee800c000 tx=0x7faee8006df0).stop 2021-06-25T04:52:38.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 -- 172.21.15.57:0/1194734652 shutdown_connections 2021-06-25T04:52:38.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed00553d0 0x7faed0057890 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faef4143970 0x7faef41560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faef413ffb0 0x7faef4155bc0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 --2- 172.21.15.57:0/1194734652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faef40670e0 0x7faef41451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 -- 172.21.15.57:0/1194734652 >> 172.21.15.57:0/1194734652 conn(0x7faef405f9b0 msgr2=0x7faef405ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:38.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 -- 172.21.15.57:0/1194734652 shutdown_connections 2021-06-25T04:52:38.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.023+0000 7faefb4c9700 1 -- 172.21.15.57:0/1194734652 wait complete. 2021-06-25T04:52:38.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:52:38.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.363+0000 7f578bfff700 1 Processor -- start 2021-06-25T04:52:38.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.363+0000 7f578bfff700 1 -- start start 2021-06-25T04:52:38.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.363+0000 7f578bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578c061640 0x7f578c0b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:38.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.363+0000 7f578bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f578c0b46d0 0x7f578c0ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:38.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.363+0000 7f578bfff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c0b68d0 con 0x7f578c143960 2021-06-25T04:52:38.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.363+0000 7f578bfff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c0b9640 con 0x7f578c0b46d0 2021-06-25T04:52:38.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.363+0000 7f578bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0b6b70 con 0x7f578c061640 2021-06-25T04:52:38.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.363+0000 7f578b7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f578c143960 0x7f578c13fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:56476/0 (socket says 172.21.15.57:56476) 2021-06-25T04:52:38.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578b7fe700 1 -- 172.21.15.57:0/673648389 learned_addr learned my addr 172.21.15.57:0/673648389 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:38.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578affd700 1 --2- 172.21.15.57:0/673648389 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578c061640 0x7f578c0b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:38.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578a7fc700 1 --2- 172.21.15.57:0/673648389 >> v2:172.21.15.87:3300/0 conn(0x7f578c0b46d0 0x7f578c0ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:38.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578affd700 1 -- 172.21.15.57:0/673648389 >> v2:172.21.15.87:3300/0 conn(0x7f578c0b46d0 msgr2=0x7f578c0ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:38.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578affd700 1 --2- 172.21.15.57:0/673648389 >> v2:172.21.15.87:3300/0 conn(0x7f578c0b46d0 0x7f578c0ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578affd700 1 -- 172.21.15.57:0/673648389 >> v1:172.21.15.87:6789/0 conn(0x7f578c143960 legacy=0x7f578c13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578affd700 1 -- 172.21.15.57:0/673648389 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0b6e10 con 0x7f578c061640 2021-06-25T04:52:38.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578affd700 1 --2- 172.21.15.57:0/673648389 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578c061640 0x7f578c0b9cd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f57840032f0 tx=0x7f57840091d0).ready entity=mon.2 client_cookie=e9b40d87b0fc0186 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:38.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f5789ffb700 1 -- 172.21.15.57:0/673648389 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f578400b6c0 con 0x7f578c061640 2021-06-25T04:52:38.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f5789ffb700 1 -- 172.21.15.57:0/673648389 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578400b820 con 0x7f578c061640 2021-06-25T04:52:38.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f5789ffb700 1 -- 172.21.15.57:0/673648389 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f578400b990 con 0x7f578c061640 2021-06-25T04:52:38.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578bfff700 1 -- 172.21.15.57:0/673648389 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578c061640 msgr2=0x7f578c0b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578bfff700 1 --2- 172.21.15.57:0/673648389 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578c061640 0x7f578c0b9cd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f57840032f0 tx=0x7f57840091d0).stop 2021-06-25T04:52:38.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578bfff700 1 -- 172.21.15.57:0/673648389 shutdown_connections 2021-06-25T04:52:38.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578bfff700 1 --2- 172.21.15.57:0/673648389 >> v2:172.21.15.87:3300/0 conn(0x7f578c0b46d0 0x7f578c0ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578bfff700 1 --2- 172.21.15.57:0/673648389 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578c061640 0x7f578c0b9cd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578bfff700 1 -- 172.21.15.57:0/673648389 >> 172.21.15.57:0/673648389 conn(0x7f578c06adb0 msgr2=0x7f578c05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:38.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578bfff700 1 -- 172.21.15.57:0/673648389 shutdown_connections 2021-06-25T04:52:38.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.367+0000 7f578bfff700 1 -- 172.21.15.57:0/673648389 wait complete. 2021-06-25T04:52:38.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578bfff700 1 Processor -- start 2021-06-25T04:52:38.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578bfff700 1 -- start start 2021-06-25T04:52:38.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f578c061640 0x7f578c13dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:38.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f578c143960 0x7f578c1444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:38.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578c156580 0x7f578c13c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:38.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c067710 con 0x7f578c143960 2021-06-25T04:52:38.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c13dad0 con 0x7f578c061640 2021-06-25T04:52:38.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c155970 con 0x7f578c156580 2021-06-25T04:52:38.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f578c143960 0x7f578c1444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:38.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f578c143960 0x7f578c1444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38516/0 (socket says 172.21.15.57:38516) 2021-06-25T04:52:38.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578a7fc700 1 -- 172.21.15.57:0/3626646295 learned_addr learned my addr 172.21.15.57:0/3626646295 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:38.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578affd700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f578c061640 0x7f578c13dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:38.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578b7fe700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578c156580 0x7f578c13c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:38.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578a7fc700 1 -- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578c156580 msgr2=0x7f578c13c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578a7fc700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578c156580 0x7f578c13c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578a7fc700 1 -- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f578c061640 msgr2=0x7f578c13dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578a7fc700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f578c061640 0x7f578c13dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578a7fc700 1 -- 172.21.15.57:0/3626646295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5784009470 con 0x7f578c143960 2021-06-25T04:52:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578a7fc700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f578c143960 0x7f578c1444d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f577400c000 tx=0x7f5774006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f5783fff700 1 -- 172.21.15.57:0/3626646295 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5774010780 con 0x7f578c143960 2021-06-25T04:52:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f5783fff700 1 -- 172.21.15.57:0/3626646295 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57740108e0 con 0x7f578c143960 2021-06-25T04:52:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578bfff700 1 -- 172.21.15.57:0/3626646295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c155ba0 con 0x7f578c143960 2021-06-25T04:52:38.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f5783fff700 1 -- 172.21.15.57:0/3626646295 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5774010c40 con 0x7f578c143960 2021-06-25T04:52:38.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.371+0000 7f578bfff700 1 -- 172.21.15.57:0/3626646295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c1560e0 con 0x7f578c143960 2021-06-25T04:52:38.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.375+0000 7f578bfff700 1 -- 172.21.15.57:0/3626646295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c0b93a0 con 0x7f578c143960 2021-06-25T04:52:38.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.375+0000 7f5783fff700 1 -- 172.21.15.57:0/3626646295 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f577401c460 con 0x7f578c143960 2021-06-25T04:52:38.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.375+0000 7f5783fff700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5770055450 0x7f5770057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:38.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.375+0000 7f5783fff700 1 -- 172.21.15.57:0/3626646295 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f577406e000 con 0x7f578c143960 2021-06-25T04:52:38.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.375+0000 7f578affd700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5770055450 0x7f5770057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:38.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.379+0000 7f578affd700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5770055450 0x7f5770057910 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f578401b000 tx=0x7f5784016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:38.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.387+0000 7f5783fff700 1 -- 172.21.15.57:0/3626646295 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5774044390 con 0x7f578c143960 2021-06-25T04:52:38.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.551+0000 7f578bfff700 1 -- 172.21.15.57:0/3626646295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f578c057310 con 0x7f578c143960 2021-06-25T04:52:38.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.551+0000 7f5783fff700 1 -- 172.21.15.57:0/3626646295 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1556 (secure 0 0 0) 0x7f57740479b0 con 0x7f578c143960 2021-06-25T04:52:38.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:38.558 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/289042329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":289042329},{"type":"v1","addr":"172.21.15.87:6835","nonce":289042329}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/824739091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":824739091},{"type":"v1","addr":"172.21.15.57:6833","nonce":824739091}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5895,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6835/1197823189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1197823189},{"type":"v1","addr":"172.21.15.57:6835","nonce":1197823189}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[]} 2021-06-25T04:52:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 -- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5770055450 msgr2=0x7f5770057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5770055450 0x7f5770057910 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f578401b000 tx=0x7f5784016000).stop 2021-06-25T04:52:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 -- 172.21.15.57:0/3626646295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f578c143960 msgr2=0x7f578c1444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f578c143960 0x7f578c1444d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f577400c000 tx=0x7f5774006df0).stop 2021-06-25T04:52:38.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 -- 172.21.15.57:0/3626646295 shutdown_connections 2021-06-25T04:52:38.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5770055450 0x7f5770057910 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578c156580 0x7f578c13c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f578c143960 0x7f578c1444d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 --2- 172.21.15.57:0/3626646295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f578c061640 0x7f578c13dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 -- 172.21.15.57:0/3626646295 >> 172.21.15.57:0/3626646295 conn(0x7f578c06adb0 msgr2=0x7f578c0b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:38.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 -- 172.21.15.57:0/3626646295 shutdown_connections 2021-06-25T04:52:38.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.559+0000 7f578bfff700 1 -- 172.21.15.57:0/3626646295 wait complete. 2021-06-25T04:52:38.565 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 28 2021-06-25T04:52:38.576 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:52:38.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825209d700 1 Processor -- start 2021-06-25T04:52:38.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825209d700 1 -- start start 2021-06-25T04:52:38.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825209d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f824c1480e0 0x7f824c0ab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:38.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825209d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824c0ad600 con 0x7f824c0afe20 2021-06-25T04:52:38.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825209d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824c147480 con 0x7f824c0ad220 2021-06-25T04:52:38.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825209d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c0ab980 con 0x7f824c1480e0 2021-06-25T04:52:38.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825089a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f824c1480e0 0x7f824c0ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:38.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825189c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f824c0afe20 0x7f824c0ac0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55744/0 (socket says 172.21.15.57:55744) 2021-06-25T04:52:38.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825189c700 1 -- 172.21.15.57:0/1250968082 learned_addr learned my addr 172.21.15.57:0/1250968082 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:38.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825089a700 1 -- 172.21.15.57:0/1250968082 >> v1:172.21.15.87:6789/0 conn(0x7f824c0ad220 legacy=0x7f824c1479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825089a700 1 -- 172.21.15.57:0/1250968082 >> v1:172.21.15.57:6789/0 conn(0x7f824c0afe20 legacy=0x7f824c0ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f823ffff700 1 -- 172.21.15.57:0/1250968082 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374507664 0 0) 0x7f824c0ad600 con 0x7f824c0afe20 2021-06-25T04:52:38.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825089a700 1 -- 172.21.15.57:0/1250968082 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c0b0440 con 0x7f824c1480e0 2021-06-25T04:52:38.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825089a700 1 --2- 172.21.15.57:0/1250968082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c1480e0 0x7f824c0ab490 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f8240002f70 tx=0x7f8240006df0).ready entity=mon.0 client_cookie=a6db151ad7236180 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:38.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f823ffff700 1 -- 172.21.15.57:0/1250968082 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824000d610 con 0x7f824c1480e0 2021-06-25T04:52:38.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f823ffff700 1 -- 172.21.15.57:0/1250968082 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8240000e90 con 0x7f824c1480e0 2021-06-25T04:52:38.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825209d700 1 -- 172.21.15.57:0/1250968082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c1480e0 msgr2=0x7f824c0ab490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.671+0000 7f825209d700 1 --2- 172.21.15.57:0/1250968082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c1480e0 0x7f824c0ab490 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f8240002f70 tx=0x7f8240006df0).stop 2021-06-25T04:52:38.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.675+0000 7f825209d700 1 -- 172.21.15.57:0/1250968082 shutdown_connections 2021-06-25T04:52:38.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.675+0000 7f825209d700 1 --2- 172.21.15.57:0/1250968082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c1480e0 0x7f824c0ab490 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.675+0000 7f825209d700 1 -- 172.21.15.57:0/1250968082 >> 172.21.15.57:0/1250968082 conn(0x7f824c0611f0 msgr2=0x7f824c062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:38.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.675+0000 7f825209d700 1 -- 172.21.15.57:0/1250968082 shutdown_connections 2021-06-25T04:52:38.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.675+0000 7f825209d700 1 -- 172.21.15.57:0/1250968082 wait complete. 2021-06-25T04:52:38.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.675+0000 7f825209d700 1 Processor -- start 2021-06-25T04:52:38.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.675+0000 7f825209d700 1 -- start start 2021-06-25T04:52:38.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825209d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f824c0ad220 0x7f824c0b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:38.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825209d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c0afe20 0x7f824c14be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:38.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825209d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f824c1480e0 0x7f824c0b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:38.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825209d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0b41a0 con 0x7f824c0afe20 2021-06-25T04:52:38.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825209d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0b54a0 con 0x7f824c0ad220 2021-06-25T04:52:38.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825209d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0b6210 con 0x7f824c1480e0 2021-06-25T04:52:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825089a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c0afe20 0x7f824c14be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825089a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c0afe20 0x7f824c14be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38530/0 (socket says 172.21.15.57:38530) 2021-06-25T04:52:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825089a700 1 -- 172.21.15.57:0/786141145 learned_addr learned my addr 172.21.15.57:0/786141145 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825109b700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f824c0ad220 0x7f824c0b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:38.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825189c700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f824c1480e0 0x7f824c0b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:38.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825089a700 1 -- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f824c1480e0 msgr2=0x7f824c0b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825089a700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f824c1480e0 0x7f824c0b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825089a700 1 -- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f824c0ad220 msgr2=0x7f824c0b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825089a700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f824c0ad220 0x7f824c0b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825089a700 1 -- 172.21.15.57:0/786141145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824000b180 con 0x7f824c0afe20 2021-06-25T04:52:38.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825089a700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c0afe20 0x7f824c14be10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f8240002f70 tx=0x7f8240015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:38.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f823e7fc700 1 -- 172.21.15.57:0/786141145 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8240021070 con 0x7f824c0afe20 2021-06-25T04:52:38.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f823e7fc700 1 -- 172.21.15.57:0/786141145 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8240000e90 con 0x7f824c0afe20 2021-06-25T04:52:38.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825209d700 1 -- 172.21.15.57:0/786141145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824c143200 con 0x7f824c0afe20 2021-06-25T04:52:38.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f823e7fc700 1 -- 172.21.15.57:0/786141145 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8240006b20 con 0x7f824c0afe20 2021-06-25T04:52:38.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825209d700 1 -- 172.21.15.57:0/786141145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824c143740 con 0x7f824c0afe20 2021-06-25T04:52:38.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.679+0000 7f825209d700 1 -- 172.21.15.57:0/786141145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824c057310 con 0x7f824c0afe20 2021-06-25T04:52:38.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.683+0000 7f823e7fc700 1 -- 172.21.15.57:0/786141145 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f824001a040 con 0x7f824c0afe20 2021-06-25T04:52:38.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.683+0000 7f823e7fc700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8234055490 0x7f8234057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:38.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.683+0000 7f823e7fc700 1 -- 172.21.15.57:0/786141145 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f824006ee00 con 0x7f824c0afe20 2021-06-25T04:52:38.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.683+0000 7f825109b700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8234055490 0x7f8234057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:38.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.683+0000 7f825109b700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8234055490 0x7f8234057950 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f824800d000 tx=0x7f8248000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:38.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.687+0000 7f823e7fc700 1 -- 172.21.15.57:0/786141145 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8240045290 con 0x7f824c0afe20 2021-06-25T04:52:38.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.855+0000 7f825209d700 1 -- 172.21.15.57:0/786141145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f824c05f200 con 0x7f824c0afe20 2021-06-25T04:52:38.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.855+0000 7f823e7fc700 1 -- 172.21.15.57:0/786141145 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1556 (secure 0 0 0) 0x7f8240006980 con 0x7f824c0afe20 2021-06-25T04:52:38.859 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:38.859 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5545,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/289042329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":289042329},{"type":"v1","addr":"172.21.15.87:6835","nonce":289042329}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/824739091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":824739091},{"type":"v1","addr":"172.21.15.57:6833","nonce":824739091}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5895,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6835/1197823189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1197823189},{"type":"v1","addr":"172.21.15.57:6835","nonce":1197823189}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[]} 2021-06-25T04:52:38.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.855+0000 7f825209d700 1 -- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8234055490 msgr2=0x7f8234057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.855+0000 7f825209d700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8234055490 0x7f8234057950 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f824800d000 tx=0x7f8248000bc0).stop 2021-06-25T04:52:38.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.855+0000 7f825209d700 1 -- 172.21.15.57:0/786141145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c0afe20 msgr2=0x7f824c14be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:38.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.855+0000 7f825209d700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c0afe20 0x7f824c14be10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f8240002f70 tx=0x7f8240015000).stop 2021-06-25T04:52:38.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.859+0000 7f825209d700 1 -- 172.21.15.57:0/786141145 shutdown_connections 2021-06-25T04:52:38.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.859+0000 7f825209d700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8234055490 0x7f8234057950 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.859+0000 7f825209d700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f824c1480e0 0x7f824c0b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.859+0000 7f825209d700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c0afe20 0x7f824c14be10 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.859+0000 7f825209d700 1 --2- 172.21.15.57:0/786141145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f824c0ad220 0x7f824c0b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.859+0000 7f825209d700 1 -- 172.21.15.57:0/786141145 >> 172.21.15.57:0/786141145 conn(0x7f824c0611f0 msgr2=0x7f824c0ac400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.859+0000 7f825209d700 1 -- 172.21.15.57:0/786141145 shutdown_connections 2021-06-25T04:52:38.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:38.859+0000 7f825209d700 1 -- 172.21.15.57:0/786141145 wait complete. 2021-06-25T04:52:38.864 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 28 2021-06-25T04:52:38.878 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:52:38.879 INFO:tasks.ceph.mds.a:Stopping old one... 2021-06-25T04:52:38.879 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:52:38.880 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:52:38.880 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:52:38.880 INFO:tasks.ceph.mds.c:Stopping old one... 2021-06-25T04:52:38.881 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:52:38.881 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:52:38.881 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:52:38.882 INFO:tasks.ceph.mds.b:Stopping old one... 2021-06-25T04:52:38.882 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:52:38.882 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:52:38.893 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:52:38.893 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:52:38.894 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:52:38.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:52:38.897 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:52:38.897 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:52:38.900 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:52:38.900 DEBUG:teuthology.parallel:result is None 2021-06-25T04:52:38.939 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:52:38.939 DEBUG:teuthology.parallel:result is None 2021-06-25T04:52:38.940 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:52:38.941 DEBUG:teuthology.parallel:result is None 2021-06-25T04:52:38.942 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:52:38.973 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:52:39.004 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:52:39.016 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:52:39.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.035+0000 7fa9ccbe3700 1 Processor -- start 2021-06-25T04:52:39.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.035+0000 7fa9ccbe3700 1 -- start start 2021-06-25T04:52:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.039+0000 7fa9ccbe3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa9c80aed80 0x7fa9c814b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.039+0000 7fa9ccbe3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c81402d0 con 0x7fa9c80b1240 2021-06-25T04:52:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.039+0000 7fa9ccbe3700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c8140570 con 0x7fa9c8140cb0 2021-06-25T04:52:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.039+0000 7fa9ccbe3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c8140810 con 0x7fa9c80aed80 2021-06-25T04:52:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.039+0000 7fa9c659c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa9c80b1240 0x7fa9c80b1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55782/0 (socket says 172.21.15.57:55782) 2021-06-25T04:52:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.039+0000 7fa9c659c700 1 -- 172.21.15.57:0/3638019445 learned_addr learned my addr 172.21.15.57:0/3638019445 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.039+0000 7fa9c6d9d700 1 --2- 172.21.15.57:0/3638019445 >> v2:172.21.15.57:3300/0 conn(0x7fa9c80aed80 0x7fa9c814b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.039+0000 7fa9c6d9d700 1 -- 172.21.15.57:0/3638019445 >> v1:172.21.15.87:6789/0 conn(0x7fa9c8140cb0 legacy=0x7fa9c80ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.039+0000 7fa9c6d9d700 1 -- 172.21.15.57:0/3638019445 >> v1:172.21.15.57:6789/0 conn(0x7fa9c80b1240 legacy=0x7fa9c80b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.039+0000 7fa9c6d9d700 1 -- 172.21.15.57:0/3638019445 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c813ffc0 con 0x7fa9c80aed80 2021-06-25T04:52:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.039+0000 7fa9c6d9d700 1 --2- 172.21.15.57:0/3638019445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9c80aed80 0x7fa9c814b940 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fa9c00032f0 tx=0x7fa9c00091d0).ready entity=mon.0 client_cookie=76ef6b69652dcb3d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:39.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.043+0000 7fa9c559a700 1 -- 172.21.15.57:0/3638019445 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c0009ea0 con 0x7fa9c80aed80 2021-06-25T04:52:39.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.043+0000 7fa9c559a700 1 -- 172.21.15.57:0/3638019445 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c000b8a0 con 0x7fa9c80aed80 2021-06-25T04:52:39.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.043+0000 7fa9c559a700 1 -- 172.21.15.57:0/3638019445 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c000ba10 con 0x7fa9c80aed80 2021-06-25T04:52:39.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.043+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/3638019445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9c80aed80 msgr2=0x7fa9c814b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:39.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.043+0000 7fa9ccbe3700 1 --2- 172.21.15.57:0/3638019445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9c80aed80 0x7fa9c814b940 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fa9c00032f0 tx=0x7fa9c00091d0).stop 2021-06-25T04:52:39.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.043+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/3638019445 shutdown_connections 2021-06-25T04:52:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.043+0000 7fa9ccbe3700 1 --2- 172.21.15.57:0/3638019445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9c80aed80 0x7fa9c814b940 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.043+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/3638019445 >> 172.21.15.57:0/3638019445 conn(0x7fa9c805f670 msgr2=0x7fa9c805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:39.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.043+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/3638019445 shutdown_connections 2021-06-25T04:52:39.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.043+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/3638019445 wait complete. 2021-06-25T04:52:39.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9ccbe3700 1 Processor -- start 2021-06-25T04:52:39.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9ccbe3700 1 -- start start 2021-06-25T04:52:39.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9ccbe3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9c80aed80 0x7fa9c8142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:39.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9ccbe3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9c80b1240 0x7fa9c81398c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:39.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9ccbe3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c8140cb0 0x7fa9c8139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:39.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9ccbe3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c8142000 con 0x7fa9c80b1240 2021-06-25T04:52:39.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9ccbe3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c813b0e0 con 0x7fa9c8140cb0 2021-06-25T04:52:39.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9ccbe3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c813c6c0 con 0x7fa9c80aed80 2021-06-25T04:52:39.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9c5d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9c80b1240 0x7fa9c81398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:39.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9c5d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9c80b1240 0x7fa9c81398c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38570/0 (socket says 172.21.15.57:38570) 2021-06-25T04:52:39.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9c5d9b700 1 -- 172.21.15.57:0/1196021983 learned_addr learned my addr 172.21.15.57:0/1196021983 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:39.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9c6d9d700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c8140cb0 0x7fa9c8139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:39.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9c659c700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9c80aed80 0x7fa9c8142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:39.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9c5d9b700 1 -- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9c80aed80 msgr2=0x7fa9c8142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:39.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9c5d9b700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9c80aed80 0x7fa9c8142e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:39.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9c5d9b700 1 -- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c8140cb0 msgr2=0x7fa9c8139db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:39.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9c5d9b700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c8140cb0 0x7fa9c8139db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:39.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9c5d9b700 1 -- 172.21.15.57:0/1196021983 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c0009470 con 0x7fa9c80b1240 2021-06-25T04:52:39.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9c5d9b700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9c80b1240 0x7fa9c81398c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fa9c814f2a0 tx=0x7fa9b8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:39.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9b77fe700 1 -- 172.21.15.57:0/1196021983 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b8012400 con 0x7fa9c80b1240 2021-06-25T04:52:39.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9b77fe700 1 -- 172.21.15.57:0/1196021983 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b8012560 con 0x7fa9c80b1240 2021-06-25T04:52:39.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/1196021983 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c813a2a0 con 0x7fa9c80b1240 2021-06-25T04:52:39.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9b77fe700 1 -- 172.21.15.57:0/1196021983 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b80128c0 con 0x7fa9c80b1240 2021-06-25T04:52:39.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.047+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/1196021983 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c813b340 con 0x7fa9c80b1240 2021-06-25T04:52:39.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.051+0000 7fa9b77fe700 1 -- 172.21.15.57:0/1196021983 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa9b8019030 con 0x7fa9c80b1240 2021-06-25T04:52:39.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.051+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/1196021983 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c813b500 con 0x7fa9c80b1240 2021-06-25T04:52:39.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.051+0000 7fa9b77fe700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa9a4055340 0x7fa9a4057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:39.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.051+0000 7fa9b77fe700 1 -- 172.21.15.57:0/1196021983 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fa9b806cfe0 con 0x7fa9c80b1240 2021-06-25T04:52:39.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.051+0000 7fa9c659c700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa9a4055340 0x7fa9a4057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:39.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.051+0000 7fa9c659c700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa9a4055340 0x7fa9a4057800 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fa9bc00b000 tx=0x7fa9bc009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:39.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.059+0000 7fa9b77fe700 1 -- 172.21.15.57:0/1196021983 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa9b80433a0 con 0x7fa9c80b1240 2021-06-25T04:52:39.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:39.199+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/1196021983 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fa9c8057310 con 0x7fa9c80b1240 2021-06-25T04:52:40.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.051+0000 7fa9b77fe700 1 -- 172.21.15.57:0/1196021983 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa9b80469c0 con 0x7fa9c80b1240 2021-06-25T04:52:40.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa9a4055340 msgr2=0x7fa9a4057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa9a4055340 0x7fa9a4057800 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fa9bc00b000 tx=0x7fa9bc009040).stop 2021-06-25T04:52:40.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/1196021983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9c80b1240 msgr2=0x7fa9c81398c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9c80b1240 0x7fa9c81398c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fa9c814f2a0 tx=0x7fa9b8007c50).stop 2021-06-25T04:52:40.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/1196021983 shutdown_connections 2021-06-25T04:52:40.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa9a4055340 0x7fa9a4057800 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c8140cb0 0x7fa9c8139db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9c80b1240 0x7fa9c81398c0 secure :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0x7fa9c814f2a0 tx=0x7fa9b8007c50).stop 2021-06-25T04:52:40.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 --2- 172.21.15.57:0/1196021983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9c80aed80 0x7fa9c8142e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/1196021983 >> 172.21.15.57:0/1196021983 conn(0x7fa9c805f670 msgr2=0x7fa9c813de60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:40.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/1196021983 shutdown_connections 2021-06-25T04:52:40.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.055+0000 7fa9ccbe3700 1 -- 172.21.15.57:0/1196021983 wait complete. 2021-06-25T04:52:40.065 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:52:40.075 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:52:40.076 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:52:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 Processor -- start 2021-06-25T04:52:40.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 -- start start 2021-06-25T04:52:40.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc066dc0 0x7f41dc0afd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41dc060cc0 0x7f41dc0aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41dc0aacb0 0x7f41dc146940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41dc0671a0 con 0x7f41dc060cc0 2021-06-25T04:52:40.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41dc0a9410 con 0x7f41dc0aacb0 2021-06-25T04:52:40.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0b0370 con 0x7f41dc066dc0 2021-06-25T04:52:40.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e0bdc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41dc060cc0 0x7f41dc0aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e0bdc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41dc060cc0 0x7f41dc0aa7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38582/0 (socket says 172.21.15.57:38582) 2021-06-25T04:52:40.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e0bdc700 1 -- 172.21.15.57:0/616991780 learned_addr learned my addr 172.21.15.57:0/616991780 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:40.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e13dd700 1 --2- 172.21.15.57:0/616991780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc066dc0 0x7f41dc0afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e1bde700 1 --2- 172.21.15.57:0/616991780 >> v2:172.21.15.87:3300/0 conn(0x7f41dc0aacb0 0x7f41dc146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e0bdc700 1 -- 172.21.15.57:0/616991780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc066dc0 msgr2=0x7f41dc0afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:40.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e0bdc700 1 --2- 172.21.15.57:0/616991780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc066dc0 0x7f41dc0afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e0bdc700 1 -- 172.21.15.57:0/616991780 >> v2:172.21.15.87:3300/0 conn(0x7f41dc0aacb0 msgr2=0x7f41dc146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:40.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e0bdc700 1 --2- 172.21.15.57:0/616991780 >> v2:172.21.15.87:3300/0 conn(0x7f41dc0aacb0 0x7f41dc146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e0bdc700 1 -- 172.21.15.57:0/616991780 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc0b14e0 con 0x7f41dc060cc0 2021-06-25T04:52:40.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e1bde700 1 --2- 172.21.15.57:0/616991780 >> v2:172.21.15.87:3300/0 conn(0x7f41dc0aacb0 0x7f41dc146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:52:40.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e0bdc700 1 --2- 172.21.15.57:0/616991780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc060cc0 0x7f41dc0aa7c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f41cc002f70 tx=0x7f41cc006eb0).ready entity=mon.0 client_cookie=36a4c55f9ca1a774 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:40.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41cbfff700 1 -- 172.21.15.57:0/616991780 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc00d570 con 0x7f41dc060cc0 2021-06-25T04:52:40.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41cbfff700 1 -- 172.21.15.57:0/616991780 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc000e90 con 0x7f41dc060cc0 2021-06-25T04:52:40.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41cbfff700 1 -- 172.21.15.57:0/616991780 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc00d900 con 0x7f41dc060cc0 2021-06-25T04:52:40.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 -- 172.21.15.57:0/616991780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc060cc0 msgr2=0x7f41dc0aa7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 --2- 172.21.15.57:0/616991780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc060cc0 0x7f41dc0aa7c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f41cc002f70 tx=0x7f41cc006eb0).stop 2021-06-25T04:52:40.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 -- 172.21.15.57:0/616991780 shutdown_connections 2021-06-25T04:52:40.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 --2- 172.21.15.57:0/616991780 >> v2:172.21.15.87:3300/0 conn(0x7f41dc0aacb0 0x7f41dc146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 --2- 172.21.15.57:0/616991780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc060cc0 0x7f41dc0aa7c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 --2- 172.21.15.57:0/616991780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc066dc0 0x7f41dc0afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 -- 172.21.15.57:0/616991780 >> 172.21.15.57:0/616991780 conn(0x7f41dc0b53a0 msgr2=0x7f41dc0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:40.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 -- 172.21.15.57:0/616991780 shutdown_connections 2021-06-25T04:52:40.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.183+0000 7f41e3641700 1 -- 172.21.15.57:0/616991780 wait complete. 2021-06-25T04:52:40.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e3641700 1 Processor -- start 2021-06-25T04:52:40.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e3641700 1 -- start start 2021-06-25T04:52:40.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e3641700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060cc0 0x7f41dc0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e3641700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc066dc0 0x7f41dc0ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e3641700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc0aacb0 0x7f41dc0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e3641700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc152a90 con 0x7f41dc0aacb0 2021-06-25T04:52:40.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e3641700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc152cc0 con 0x7f41dc066dc0 2021-06-25T04:52:40.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e3641700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0ae1f0 con 0x7f41dc060cc0 2021-06-25T04:52:40.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e1bde700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc0aacb0 0x7f41dc0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e1bde700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc0aacb0 0x7f41dc0aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38592/0 (socket says 172.21.15.57:38592) 2021-06-25T04:52:40.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e1bde700 1 -- 172.21.15.57:0/2544671763 learned_addr learned my addr 172.21.15.57:0/2544671763 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:40.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e13dd700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060cc0 0x7f41dc0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.187+0000 7f41e0bdc700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc066dc0 0x7f41dc0ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41e1bde700 1 -- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060cc0 msgr2=0x7f41dc0b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41e1bde700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060cc0 0x7f41dc0b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41e1bde700 1 -- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc066dc0 msgr2=0x7f41dc0ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41e1bde700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc066dc0 0x7f41dc0ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41e1bde700 1 -- 172.21.15.57:0/2544671763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc00b1e0 con 0x7f41dc0aacb0 2021-06-25T04:52:40.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41e1bde700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc0aacb0 0x7f41dc0aeb80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f41d4007000 tx=0x7f41d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:40.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41ca7fc700 1 -- 172.21.15.57:0/2544671763 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d400ce20 con 0x7f41dc0aacb0 2021-06-25T04:52:40.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41ca7fc700 1 -- 172.21.15.57:0/2544671763 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d400f4e0 con 0x7f41dc0aacb0 2021-06-25T04:52:40.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41e3641700 1 -- 172.21.15.57:0/2544671763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41dc0add40 con 0x7f41dc0aacb0 2021-06-25T04:52:40.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41ca7fc700 1 -- 172.21.15.57:0/2544671763 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d400f840 con 0x7f41dc0aacb0 2021-06-25T04:52:40.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41e3641700 1 -- 172.21.15.57:0/2544671763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc144700 con 0x7f41dc0aacb0 2021-06-25T04:52:40.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41e3641700 1 -- 172.21.15.57:0/2544671763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41dc152ec0 con 0x7f41dc0aacb0 2021-06-25T04:52:40.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41ca7fc700 1 -- 172.21.15.57:0/2544671763 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f41d4019030 con 0x7f41dc0aacb0 2021-06-25T04:52:40.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41ca7fc700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41bc0553f0 0x7f41bc0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41ca7fc700 1 -- 172.21.15.57:0/2544671763 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f41d406d540 con 0x7f41dc0aacb0 2021-06-25T04:52:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.191+0000 7f41e13dd700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41bc0553f0 0x7f41bc0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.195+0000 7f41e13dd700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41bc0553f0 0x7f41bc0578b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f41d800d000 tx=0x7f41d8008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.199+0000 7f41ca7fc700 1 -- 172.21.15.57:0/2544671763 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f41d4043920 con 0x7f41dc0aacb0 2021-06-25T04:52:40.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.371+0000 7f41e3641700 1 -- 172.21.15.57:0/2544671763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f41dc0ae3b0 con 0x7f41dc0aacb0 2021-06-25T04:52:40.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.371+0000 7f41ca7fc700 1 -- 172.21.15.57:0/2544671763 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f41d4046f40 con 0x7f41dc0aacb0 2021-06-25T04:52:40.376 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:40.376 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:52:40.377 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:52:40.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.377 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:52:40.377 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:52:40.377 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.378 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:52:40.378 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.378 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.378 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.379 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.379 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:52:40.380 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:52:40.380 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.380 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:52:40.380 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.380 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.381 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.381 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.381 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:52:40.382 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:52:40.382 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.382 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:52:40.382 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.383 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.383 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.384 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:52:40.384 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:52:40.384 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.384 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.385 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.385 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.385 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.386 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:52:40.386 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:52:40.386 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.386 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.387 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.387 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.387 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.388 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:52:40.388 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:52:40.388 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.388 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.389 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.389 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.389 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.390 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:52:40.390 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:52:40.390 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.390 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.391 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.391 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.391 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.392 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:52:40.392 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:52:40.392 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.392 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.393 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.393 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.394 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:52:40.394 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:52:40.394 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.394 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.395 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.395 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.396 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:52:40.396 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:52:40.396 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.396 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.397 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.397 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.397 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.398 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:52:40.398 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:52:40.398 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.398 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.399 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.399 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.399 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.400 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:52:40.400 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:52:40.400 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.400 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:52:40.401 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:52:40.401 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:52:40.401 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.402 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:52:40.402 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:52:40.402 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.402 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:52:40.402 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:52:40.403 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:52:40.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.404 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:52:40.404 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:52:40.404 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.404 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:52:40.404 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:52:40.405 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:52:40.405 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.406 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:52:40.406 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:52:40.406 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.407 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:52:40.407 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:52:40.407 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:40.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:40.409 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:52:40.409 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:52:40.409 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:52:40.409 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:52:40.409 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:52:40.410 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:52:40.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:40.410 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:52:40.411 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:52:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 -- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41bc0553f0 msgr2=0x7f41bc0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41bc0553f0 0x7f41bc0578b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f41d800d000 tx=0x7f41d8008040).stop 2021-06-25T04:52:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 -- 172.21.15.57:0/2544671763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc0aacb0 msgr2=0x7f41dc0aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc0aacb0 0x7f41dc0aeb80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f41d4007000 tx=0x7f41d4008040).stop 2021-06-25T04:52:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 -- 172.21.15.57:0/2544671763 shutdown_connections 2021-06-25T04:52:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41bc0553f0 0x7f41bc0578b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc0aacb0 0x7f41dc0aeb80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc066dc0 0x7f41dc0ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 --2- 172.21.15.57:0/2544671763 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060cc0 0x7f41dc0b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 -- 172.21.15.57:0/2544671763 >> 172.21.15.57:0/2544671763 conn(0x7f41dc0b53a0 msgr2=0x7f41dc1413e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 -- 172.21.15.57:0/2544671763 shutdown_connections 2021-06-25T04:52:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.375+0000 7f41e3641700 1 -- 172.21.15.57:0/2544671763 wait complete. 2021-06-25T04:52:40.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:52:40.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.519+0000 7f126419d700 1 Processor -- start 2021-06-25T04:52:40.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.519+0000 7f126419d700 1 -- start start 2021-06-25T04:52:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.519+0000 7f126419d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f125c0b1960 0x7f125c066f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.519+0000 7f126419d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c0abe60 con 0x7f125c060240 2021-06-25T04:52:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.519+0000 7f126419d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c1402c0 con 0x7f125c0a9760 2021-06-25T04:52:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.519+0000 7f126419d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125c0ab2d0 con 0x7f125c0b1960 2021-06-25T04:52:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.519+0000 7f1261738700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f125c0b1960 0x7f125c066f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.519+0000 7f1261f39700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f125c060240 0x7f125c066870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55814/0 (socket says 172.21.15.57:55814) 2021-06-25T04:52:40.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.519+0000 7f1261f39700 1 -- 172.21.15.57:0/155558150 learned_addr learned my addr 172.21.15.57:0/155558150 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:40.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f1261738700 1 -- 172.21.15.57:0/155558150 >> v1:172.21.15.87:6789/0 conn(0x7f125c0a9760 legacy=0x7f125c0a9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f1261738700 1 -- 172.21.15.57:0/155558150 >> v1:172.21.15.57:6789/0 conn(0x7f125c060240 legacy=0x7f125c066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f1260f37700 1 -- 172.21.15.57:0/155558150 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883715403 0 0) 0x7f125c0abe60 con 0x7f125c060240 2021-06-25T04:52:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f1261738700 1 -- 172.21.15.57:0/155558150 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c140560 con 0x7f125c0b1960 2021-06-25T04:52:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f1261738700 1 --2- 172.21.15.57:0/155558150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125c0b1960 0x7f125c066f80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f124c002f70 tx=0x7f124c006df0).ready entity=mon.0 client_cookie=de6717b50af22f96 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f1260f37700 1 -- 172.21.15.57:0/155558150 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f124c00d610 con 0x7f125c0b1960 2021-06-25T04:52:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f1260f37700 1 -- 172.21.15.57:0/155558150 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c000e90 con 0x7f125c0b1960 2021-06-25T04:52:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f1260f37700 1 -- 172.21.15.57:0/155558150 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f124c00d960 con 0x7f125c0b1960 2021-06-25T04:52:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f126419d700 1 -- 172.21.15.57:0/155558150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125c0b1960 msgr2=0x7f125c066f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f126419d700 1 --2- 172.21.15.57:0/155558150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125c0b1960 0x7f125c066f80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f124c002f70 tx=0x7f124c006df0).stop 2021-06-25T04:52:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f126419d700 1 -- 172.21.15.57:0/155558150 shutdown_connections 2021-06-25T04:52:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f126419d700 1 --2- 172.21.15.57:0/155558150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125c0b1960 0x7f125c066f80 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f126419d700 1 -- 172.21.15.57:0/155558150 >> 172.21.15.57:0/155558150 conn(0x7f125c0b53a0 msgr2=0x7f125c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f126419d700 1 -- 172.21.15.57:0/155558150 shutdown_connections 2021-06-25T04:52:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f126419d700 1 -- 172.21.15.57:0/155558150 wait complete. 2021-06-25T04:52:40.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f126419d700 1 Processor -- start 2021-06-25T04:52:40.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.523+0000 7f126419d700 1 -- start start 2021-06-25T04:52:40.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f126419d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f125c060240 0x7f125c13a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f126419d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125c0a9760 0x7f125c12e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f126419d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125c0b1960 0x7f125c12eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f126419d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c131ee0 con 0x7f125c0a9760 2021-06-25T04:52:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f126419d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0b4870 con 0x7f125c060240 2021-06-25T04:52:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f126419d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0ac660 con 0x7f125c0b1960 2021-06-25T04:52:40.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f1261738700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125c0a9760 0x7f125c12e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f1261738700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125c0a9760 0x7f125c12e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38604/0 (socket says 172.21.15.57:38604) 2021-06-25T04:52:40.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f1261738700 1 -- 172.21.15.57:0/1158787907 learned_addr learned my addr 172.21.15.57:0/1158787907 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:40.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f126273a700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125c0b1960 0x7f125c12eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f1261f39700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f125c060240 0x7f125c13a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f1261738700 1 -- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125c0b1960 msgr2=0x7f125c12eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f1261738700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125c0b1960 0x7f125c12eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f1261738700 1 -- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f125c060240 msgr2=0x7f125c13a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f1261738700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f125c060240 0x7f125c13a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f1261738700 1 -- 172.21.15.57:0/1158787907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c00b180 con 0x7f125c0a9760 2021-06-25T04:52:40.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f1261f39700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f125c060240 0x7f125c13a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:52:40.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f1261738700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125c0a9760 0x7f125c12e690 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f124c002f70 tx=0x7f124c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:40.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f124affd700 1 -- 172.21.15.57:0/1158787907 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f124c021070 con 0x7f125c0a9760 2021-06-25T04:52:40.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f124affd700 1 -- 172.21.15.57:0/1158787907 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c000e90 con 0x7f125c0a9760 2021-06-25T04:52:40.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f126419d700 1 -- 172.21.15.57:0/1158787907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c0ac900 con 0x7f125c0a9760 2021-06-25T04:52:40.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f124affd700 1 -- 172.21.15.57:0/1158787907 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f124c011e20 con 0x7f125c0a9760 2021-06-25T04:52:40.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.527+0000 7f126419d700 1 -- 172.21.15.57:0/1158787907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c0b4ea0 con 0x7f125c0a9760 2021-06-25T04:52:40.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.531+0000 7f126419d700 1 -- 172.21.15.57:0/1158787907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c0aca90 con 0x7f125c0a9760 2021-06-25T04:52:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.531+0000 7f124affd700 1 -- 172.21.15.57:0/1158787907 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f124c00f070 con 0x7f125c0a9760 2021-06-25T04:52:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.531+0000 7f124affd700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f123c0553d0 0x7f123c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.531+0000 7f124affd700 1 -- 172.21.15.57:0/1158787907 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f124c06efe0 con 0x7f125c0a9760 2021-06-25T04:52:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.531+0000 7f1261f39700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f123c0553d0 0x7f123c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.531+0000 7f1261f39700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f123c0553d0 0x7f123c057890 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f125800b000 tx=0x7f1258009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:40.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.539+0000 7f124affd700 1 -- 172.21.15.57:0/1158787907 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f124c0454d0 con 0x7f125c0a9760 2021-06-25T04:52:40.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.671+0000 7f126419d700 1 -- 172.21.15.57:0/1158787907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f125c0b4a30 con 0x7f125c0a9760 2021-06-25T04:52:40.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f124affd700 1 -- 172.21.15.57:0/1158787907 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f124c048af0 con 0x7f125c0a9760 2021-06-25T04:52:40.678 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:40.678 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":63,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:52:40.047620+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:52:40.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 -- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f123c0553d0 msgr2=0x7f123c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f123c0553d0 0x7f123c057890 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f125800b000 tx=0x7f1258009040).stop 2021-06-25T04:52:40.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 -- 172.21.15.57:0/1158787907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125c0a9760 msgr2=0x7f125c12e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125c0a9760 0x7f125c12e690 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f124c002f70 tx=0x7f124c015000).stop 2021-06-25T04:52:40.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 -- 172.21.15.57:0/1158787907 shutdown_connections 2021-06-25T04:52:40.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f123c0553d0 0x7f123c057890 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125c0b1960 0x7f125c12eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f125c0a9760 0x7f125c12e690 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 --2- 172.21.15.57:0/1158787907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f125c060240 0x7f125c13a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 -- 172.21.15.57:0/1158787907 >> 172.21.15.57:0/1158787907 conn(0x7f125c0b53a0 msgr2=0x7f125c066c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:40.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 -- 172.21.15.57:0/1158787907 shutdown_connections 2021-06-25T04:52:40.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.675+0000 7f126419d700 1 -- 172.21.15.57:0/1158787907 wait complete. 2021-06-25T04:52:40.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:52:40.693 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:52:40.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c7ccba700 1 Processor -- start 2021-06-25T04:52:40.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c7ccba700 1 -- start start 2021-06-25T04:52:40.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c7ccba700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2c780affd0 0x7f2c780a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c7ccba700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c780afb90 0x7f2c780a8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c7ccba700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c780a7080 con 0x7f2c780b2540 2021-06-25T04:52:40.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c7ccba700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c780a72b0 con 0x7f2c780affd0 2021-06-25T04:52:40.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c7ccba700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c780a7550 con 0x7f2c780afb90 2021-06-25T04:52:40.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c777fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2c780b2540 0x7f2c7814ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55828/0 (socket says 172.21.15.57:55828) 2021-06-25T04:52:40.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c777fe700 1 -- 172.21.15.57:0/2327173171 learned_addr learned my addr 172.21.15.57:0/2327173171 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:40.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c76ffd700 1 --2- 172.21.15.57:0/2327173171 >> v2:172.21.15.87:3300/0 conn(0x7f2c780affd0 0x7f2c780a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c77fff700 1 --2- 172.21.15.57:0/2327173171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c780afb90 0x7f2c780a8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c767fc700 1 -- 172.21.15.57:0/2327173171 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144894916 0 0) 0x7f2c780a7080 con 0x7f2c780b2540 2021-06-25T04:52:40.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c767fc700 1 -- 172.21.15.57:0/2327173171 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c64003260 con 0x7f2c780b2540 2021-06-25T04:52:40.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c76ffd700 1 -- 172.21.15.57:0/2327173171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c780afb90 msgr2=0x7f2c780a8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:40.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c76ffd700 1 --2- 172.21.15.57:0/2327173171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c780afb90 0x7f2c780a8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c76ffd700 1 -- 172.21.15.57:0/2327173171 >> v1:172.21.15.57:6789/0 conn(0x7f2c780b2540 legacy=0x7f2c7814ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.795+0000 7f2c76ffd700 1 -- 172.21.15.57:0/2327173171 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c780a77f0 con 0x7f2c780affd0 2021-06-25T04:52:40.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c76ffd700 1 --2- 172.21.15.57:0/2327173171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c780affd0 0x7f2c780a8370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f2c68002f70 tx=0x7f2c68006df0).ready entity=mon.1 client_cookie=d908393971ac663b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:40.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c767fc700 1 -- 172.21.15.57:0/2327173171 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c6800d4a0 con 0x7f2c780affd0 2021-06-25T04:52:40.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c767fc700 1 -- 172.21.15.57:0/2327173171 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c68000e90 con 0x7f2c780affd0 2021-06-25T04:52:40.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c767fc700 1 -- 172.21.15.57:0/2327173171 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c6800d7f0 con 0x7f2c780affd0 2021-06-25T04:52:40.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 -- 172.21.15.57:0/2327173171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c780affd0 msgr2=0x7f2c780a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 --2- 172.21.15.57:0/2327173171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c780affd0 0x7f2c780a8370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f2c68002f70 tx=0x7f2c68006df0).stop 2021-06-25T04:52:40.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 -- 172.21.15.57:0/2327173171 shutdown_connections 2021-06-25T04:52:40.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 --2- 172.21.15.57:0/2327173171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c780afb90 0x7f2c780a8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 --2- 172.21.15.57:0/2327173171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c780affd0 0x7f2c780a8370 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 -- 172.21.15.57:0/2327173171 >> 172.21.15.57:0/2327173171 conn(0x7f2c78060140 msgr2=0x7f2c780b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:40.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 -- 172.21.15.57:0/2327173171 shutdown_connections 2021-06-25T04:52:40.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 -- 172.21.15.57:0/2327173171 wait complete. 2021-06-25T04:52:40.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 Processor -- start 2021-06-25T04:52:40.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 -- start start 2021-06-25T04:52:40.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c780afb90 0x7f2c780ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c780affd0 0x7f2c78159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c780b2540 0x7f2c7815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c78159990 con 0x7f2c780b2540 2021-06-25T04:52:40.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c780ab870 con 0x7f2c780afb90 2021-06-25T04:52:40.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c7ccba700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7815a7d0 con 0x7f2c780affd0 2021-06-25T04:52:40.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c77fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c780b2540 0x7f2c7815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c77fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c780b2540 0x7f2c7815a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38618/0 (socket says 172.21.15.57:38618) 2021-06-25T04:52:40.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c77fff700 1 -- 172.21.15.57:0/784762714 learned_addr learned my addr 172.21.15.57:0/784762714 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:40.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c777fe700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c780afb90 0x7f2c780ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.799+0000 7f2c76ffd700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c780affd0 0x7f2c78159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c77fff700 1 -- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c780affd0 msgr2=0x7f2c78159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c77fff700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c780affd0 0x7f2c78159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c77fff700 1 -- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c780afb90 msgr2=0x7f2c780ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c77fff700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c780afb90 0x7f2c780ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c77fff700 1 -- 172.21.15.57:0/784762714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6800b180 con 0x7f2c780b2540 2021-06-25T04:52:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c77fff700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c780b2540 0x7f2c7815a2e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f2c70006e00 tx=0x7f2c700091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:40.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c74ff9700 1 -- 172.21.15.57:0/784762714 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c7000c640 con 0x7f2c780b2540 2021-06-25T04:52:40.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c7ccba700 1 -- 172.21.15.57:0/784762714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c780ac110 con 0x7f2c780b2540 2021-06-25T04:52:40.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c7ccba700 1 -- 172.21.15.57:0/784762714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c780abe40 con 0x7f2c780b2540 2021-06-25T04:52:40.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c74ff9700 1 -- 172.21.15.57:0/784762714 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7000c7a0 con 0x7f2c780b2540 2021-06-25T04:52:40.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c74ff9700 1 -- 172.21.15.57:0/784762714 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c7000cb00 con 0x7f2c780b2540 2021-06-25T04:52:40.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c7ccba700 1 -- 172.21.15.57:0/784762714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c780ae9a0 con 0x7f2c780b2540 2021-06-25T04:52:40.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c74ff9700 1 -- 172.21.15.57:0/784762714 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2c7000cc60 con 0x7f2c780b2540 2021-06-25T04:52:40.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c74ff9700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c58055510 0x7f2c580579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:40.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.803+0000 7f2c74ff9700 1 -- 172.21.15.57:0/784762714 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f2c7006de30 con 0x7f2c780b2540 2021-06-25T04:52:40.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.807+0000 7f2c777fe700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c58055510 0x7f2c580579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:40.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.807+0000 7f2c777fe700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c58055510 0x7f2c580579d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f2c6c00d000 tx=0x7f2c6c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:40.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.811+0000 7f2c74ff9700 1 -- 172.21.15.57:0/784762714 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2c7006ac50 con 0x7f2c780b2540 2021-06-25T04:52:40.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 -- 172.21.15.57:0/784762714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2c78057310 con 0x7f2c780b2540 2021-06-25T04:52:40.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c74ff9700 1 -- 172.21.15.57:0/784762714 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v63) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2c70016020 con 0x7f2c780b2540 2021-06-25T04:52:40.943 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:52:40.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 -- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c58055510 msgr2=0x7f2c580579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c58055510 0x7f2c580579d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f2c6c00d000 tx=0x7f2c6c009040).stop 2021-06-25T04:52:40.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 -- 172.21.15.57:0/784762714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c780b2540 msgr2=0x7f2c7815a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:40.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c780b2540 0x7f2c7815a2e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f2c70006e00 tx=0x7f2c700091d0).stop 2021-06-25T04:52:40.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 -- 172.21.15.57:0/784762714 shutdown_connections 2021-06-25T04:52:40.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c58055510 0x7f2c580579d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c780b2540 0x7f2c7815a2e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c780affd0 0x7f2c78159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 --2- 172.21.15.57:0/784762714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c780afb90 0x7f2c780ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:40.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 -- 172.21.15.57:0/784762714 >> 172.21.15.57:0/784762714 conn(0x7f2c78060140 msgr2=0x7f2c78148680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:40.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 -- 172.21.15.57:0/784762714 shutdown_connections 2021-06-25T04:52:40.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:40.939+0000 7f2c7ccba700 1 -- 172.21.15.57:0/784762714 wait complete. 2021-06-25T04:52:40.958 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:52:41.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.059+0000 7f4a5c976700 1 Processor -- start 2021-06-25T04:52:41.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.059+0000 7f4a5c976700 1 -- start start 2021-06-25T04:52:41.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a5c976700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a580b19f0 0x7f4a58066990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a5c976700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5805f710 con 0x7f4a58140c70 2021-06-25T04:52:41.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a5c976700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a580b1460 con 0x7f4a580665b0 2021-06-25T04:52:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a5c976700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5805f940 con 0x7f4a580b19f0 2021-06-25T04:52:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a57fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4a58140c70 0x7f4a5813e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55844/0 (socket says 172.21.15.57:55844) 2021-06-25T04:52:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a57fff700 1 -- 172.21.15.57:0/140946996 learned_addr learned my addr 172.21.15.57:0/140946996 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:41.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a4ffff700 1 --2- 172.21.15.57:0/140946996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a580b19f0 0x7f4a58066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a56ffd700 1 -- 172.21.15.57:0/140946996 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091516017 0 0) 0x7f4a5805f710 con 0x7f4a58140c70 2021-06-25T04:52:41.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a56ffd700 1 -- 172.21.15.57:0/140946996 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a38003260 con 0x7f4a58140c70 2021-06-25T04:52:41.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a56ffd700 1 -- 172.21.15.57:0/140946996 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433681776 0 0) 0x7f4a580b1460 con 0x7f4a580665b0 2021-06-25T04:52:41.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a56ffd700 1 -- 172.21.15.57:0/140946996 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a5805f710 con 0x7f4a580665b0 2021-06-25T04:52:41.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a4ffff700 1 -- 172.21.15.57:0/140946996 >> v1:172.21.15.87:6789/0 conn(0x7f4a580665b0 legacy=0x7f4a5805fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a4ffff700 1 -- 172.21.15.57:0/140946996 >> v1:172.21.15.57:6789/0 conn(0x7f4a58140c70 legacy=0x7f4a5813e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a4ffff700 1 -- 172.21.15.57:0/140946996 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a580b1700 con 0x7f4a580b19f0 2021-06-25T04:52:41.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a4ffff700 1 --2- 172.21.15.57:0/140946996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a580b19f0 0x7f4a58066990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4a40002f70 tx=0x7f4a40006df0).ready entity=mon.2 client_cookie=d29033b9a82a4898 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:41.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a56ffd700 1 -- 172.21.15.57:0/140946996 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4000d5c0 con 0x7f4a580b19f0 2021-06-25T04:52:41.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a56ffd700 1 -- 172.21.15.57:0/140946996 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a40000e90 con 0x7f4a580b19f0 2021-06-25T04:52:41.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a56ffd700 1 -- 172.21.15.57:0/140946996 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4000d910 con 0x7f4a580b19f0 2021-06-25T04:52:41.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a5c976700 1 -- 172.21.15.57:0/140946996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a580b19f0 msgr2=0x7f4a58066990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.063+0000 7f4a5c976700 1 --2- 172.21.15.57:0/140946996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a580b19f0 0x7f4a58066990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4a40002f70 tx=0x7f4a40006df0).stop 2021-06-25T04:52:41.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.067+0000 7f4a5c976700 1 -- 172.21.15.57:0/140946996 shutdown_connections 2021-06-25T04:52:41.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.067+0000 7f4a5c976700 1 --2- 172.21.15.57:0/140946996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a580b19f0 0x7f4a58066990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.067+0000 7f4a5c976700 1 -- 172.21.15.57:0/140946996 >> 172.21.15.57:0/140946996 conn(0x7f4a580636a0 msgr2=0x7f4a58063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:41.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.067+0000 7f4a5c976700 1 -- 172.21.15.57:0/140946996 shutdown_connections 2021-06-25T04:52:41.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.067+0000 7f4a5c976700 1 -- 172.21.15.57:0/140946996 wait complete. 2021-06-25T04:52:41.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.067+0000 7f4a5c976700 1 Processor -- start 2021-06-25T04:52:41.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.067+0000 7f4a5c976700 1 -- start start 2021-06-25T04:52:41.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a5c976700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a580665b0 0x7f4a580b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a5c976700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a580b19f0 0x7f4a581598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a5c976700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a58140c70 0x7f4a58159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a5c976700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580a7160 con 0x7f4a580665b0 2021-06-25T04:52:41.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a5c976700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580660f0 con 0x7f4a58140c70 2021-06-25T04:52:41.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a5c976700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58066390 con 0x7f4a580b19f0 2021-06-25T04:52:41.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a577fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a580665b0 0x7f4a580b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a57fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a58140c70 0x7f4a58159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a577fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a580665b0 0x7f4a580b5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38630/0 (socket says 172.21.15.57:38630) 2021-06-25T04:52:41.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a4ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a580b19f0 0x7f4a581598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a577fe700 1 -- 172.21.15.57:0/1126471483 learned_addr learned my addr 172.21.15.57:0/1126471483 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:41.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a577fe700 1 -- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a580b19f0 msgr2=0x7f4a581598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a577fe700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a580b19f0 0x7f4a581598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a577fe700 1 -- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a58140c70 msgr2=0x7f4a58159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a577fe700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a58140c70 0x7f4a58159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a577fe700 1 -- 172.21.15.57:0/1126471483 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4000b180 con 0x7f4a580665b0 2021-06-25T04:52:41.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a577fe700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a580665b0 0x7f4a580b5160 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f4a48001110 tx=0x7f4a48007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:41.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a557fa700 1 -- 172.21.15.57:0/1126471483 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a48012400 con 0x7f4a580665b0 2021-06-25T04:52:41.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a557fa700 1 -- 172.21.15.57:0/1126471483 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48012560 con 0x7f4a580665b0 2021-06-25T04:52:41.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a5c976700 1 -- 172.21.15.57:0/1126471483 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a58065500 con 0x7f4a580665b0 2021-06-25T04:52:41.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a557fa700 1 -- 172.21.15.57:0/1126471483 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a480128c0 con 0x7f4a580665b0 2021-06-25T04:52:41.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.071+0000 7f4a5c976700 1 -- 172.21.15.57:0/1126471483 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a58142d10 con 0x7f4a580665b0 2021-06-25T04:52:41.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.075+0000 7f4a5c976700 1 -- 172.21.15.57:0/1126471483 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a58057310 con 0x7f4a580665b0 2021-06-25T04:52:41.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.075+0000 7f4a557fa700 1 -- 172.21.15.57:0/1126471483 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4a48019030 con 0x7f4a580665b0 2021-06-25T04:52:41.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.075+0000 7f4a557fa700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a3c055510 0x7f4a3c0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.075+0000 7f4a557fa700 1 -- 172.21.15.57:0/1126471483 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f4a4806cf70 con 0x7f4a580665b0 2021-06-25T04:52:41.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.075+0000 7f4a4ffff700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a3c055510 0x7f4a3c0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.075+0000 7f4a4ffff700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a3c055510 0x7f4a3c0579d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f4a40019000 tx=0x7f4a40014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:41.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.079+0000 7f4a557fa700 1 -- 172.21.15.57:0/1126471483 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4a48043460 con 0x7f4a580665b0 2021-06-25T04:52:41.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.207+0000 7f4a5c976700 1 -- 172.21.15.57:0/1126471483 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4a5815a470 con 0x7f4a580665b0 2021-06-25T04:52:41.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.207+0000 7f4a557fa700 1 -- 172.21.15.57:0/1126471483 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4a48046a80 con 0x7f4a580665b0 2021-06-25T04:52:41.211 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:52:41.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.207+0000 7f4a5c976700 1 -- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a3c055510 msgr2=0x7f4a3c0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.207+0000 7f4a5c976700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a3c055510 0x7f4a3c0579d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f4a40019000 tx=0x7f4a40014000).stop 2021-06-25T04:52:41.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.207+0000 7f4a5c976700 1 -- 172.21.15.57:0/1126471483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a580665b0 msgr2=0x7f4a580b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.207+0000 7f4a5c976700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a580665b0 0x7f4a580b5160 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f4a48001110 tx=0x7f4a48007ae0).stop 2021-06-25T04:52:41.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.207+0000 7f4a5c976700 1 -- 172.21.15.57:0/1126471483 shutdown_connections 2021-06-25T04:52:41.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.207+0000 7f4a5c976700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a3c055510 0x7f4a3c0579d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.207+0000 7f4a5c976700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a58140c70 0x7f4a58159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.207+0000 7f4a5c976700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a580b19f0 0x7f4a581598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.207+0000 7f4a5c976700 1 --2- 172.21.15.57:0/1126471483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a580665b0 0x7f4a580b5160 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.211+0000 7f4a5c976700 1 -- 172.21.15.57:0/1126471483 >> 172.21.15.57:0/1126471483 conn(0x7f4a580636a0 msgr2=0x7f4a5813eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:41.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.211+0000 7f4a5c976700 1 -- 172.21.15.57:0/1126471483 shutdown_connections 2021-06-25T04:52:41.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.211+0000 7f4a5c976700 1 -- 172.21.15.57:0/1126471483 wait complete. 2021-06-25T04:52:41.225 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:52:41.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.331+0000 7f6e25b39700 1 Processor -- start 2021-06-25T04:52:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.331+0000 7f6e25b39700 1 -- start start 2021-06-25T04:52:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6e200b5460 0x7f6e200af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e20147560 0x7f6e200acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e200b5840 con 0x7f6e200b05d0 2021-06-25T04:52:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e201452a0 con 0x7f6e200b5460 2021-06-25T04:52:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200adfb0 con 0x7f6e20147560 2021-06-25T04:52:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e1ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6e200b05d0 0x7f6e20067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55860/0 (socket says 172.21.15.57:55860) 2021-06-25T04:52:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e24b37700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6e200b5460 0x7f6e200af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25338700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e20147560 0x7f6e200acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e1ffff700 1 -- 172.21.15.57:0/242426966 learned_addr learned my addr 172.21.15.57:0/242426966 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:41.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e1f7fe700 1 -- 172.21.15.57:0/242426966 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202683458 0 0) 0x7f6e200b5840 con 0x7f6e200b05d0 2021-06-25T04:52:41.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e1f7fe700 1 -- 172.21.15.57:0/242426966 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e0c003260 con 0x7f6e200b05d0 2021-06-25T04:52:41.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e24b37700 1 -- 172.21.15.57:0/242426966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e20147560 msgr2=0x7f6e200acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:41.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e24b37700 1 --2- 172.21.15.57:0/242426966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e20147560 0x7f6e200acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e24b37700 1 -- 172.21.15.57:0/242426966 >> v1:172.21.15.57:6789/0 conn(0x7f6e200b05d0 legacy=0x7f6e20067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e24b37700 1 -- 172.21.15.57:0/242426966 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e200ac7c0 con 0x7f6e200b5460 2021-06-25T04:52:41.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e24b37700 1 --2- 172.21.15.57:0/242426966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e200b5460 0x7f6e200af510 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f6e14001110 tx=0x7f6e180091d0).ready entity=mon.1 client_cookie=b1d7d072580f9c36 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e1f7fe700 1 -- 172.21.15.57:0/242426966 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e1800b580 con 0x7f6e200b5460 2021-06-25T04:52:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e1f7fe700 1 -- 172.21.15.57:0/242426966 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1800b6e0 con 0x7f6e200b5460 2021-06-25T04:52:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e1f7fe700 1 -- 172.21.15.57:0/242426966 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e1800b850 con 0x7f6e200b5460 2021-06-25T04:52:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 -- 172.21.15.57:0/242426966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e200b5460 msgr2=0x7f6e200af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 --2- 172.21.15.57:0/242426966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e200b5460 0x7f6e200af510 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f6e14001110 tx=0x7f6e180091d0).stop 2021-06-25T04:52:41.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 -- 172.21.15.57:0/242426966 shutdown_connections 2021-06-25T04:52:41.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 --2- 172.21.15.57:0/242426966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e20147560 0x7f6e200acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 --2- 172.21.15.57:0/242426966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e200b5460 0x7f6e200af510 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 -- 172.21.15.57:0/242426966 >> 172.21.15.57:0/242426966 conn(0x7f6e20062520 msgr2=0x7f6e20062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:41.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 -- 172.21.15.57:0/242426966 shutdown_connections 2021-06-25T04:52:41.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.335+0000 7f6e25b39700 1 -- 172.21.15.57:0/242426966 wait complete. 2021-06-25T04:52:41.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25b39700 1 Processor -- start 2021-06-25T04:52:41.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25b39700 1 -- start start 2021-06-25T04:52:41.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25b39700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e200b05d0 0x7f6e2014cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25b39700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e200b5460 0x7f6e2015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25b39700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e20147560 0x7f6e20145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25b39700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e201448d0 con 0x7f6e20147560 2021-06-25T04:52:41.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25b39700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e20143210 con 0x7f6e200b05d0 2021-06-25T04:52:41.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25b39700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e201434b0 con 0x7f6e200b5460 2021-06-25T04:52:41.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25338700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e20147560 0x7f6e20145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25338700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e20147560 0x7f6e20145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38648/0 (socket says 172.21.15.57:38648) 2021-06-25T04:52:41.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25338700 1 -- 172.21.15.57:0/2046007466 learned_addr learned my addr 172.21.15.57:0/2046007466 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:41.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e1ffff700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e200b5460 0x7f6e2015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e24b37700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e200b05d0 0x7f6e2014cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25338700 1 -- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e200b5460 msgr2=0x7f6e2015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25338700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e200b5460 0x7f6e2015a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25338700 1 -- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e200b05d0 msgr2=0x7f6e2014cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25338700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e200b05d0 0x7f6e2014cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25338700 1 -- 172.21.15.57:0/2046007466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e18009470 con 0x7f6e20147560 2021-06-25T04:52:41.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25338700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e20147560 0x7f6e20145450 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f6e1000c000 tx=0x7f6e10006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:41.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e1dffb700 1 -- 172.21.15.57:0/2046007466 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e10011750 con 0x7f6e20147560 2021-06-25T04:52:41.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e1dffb700 1 -- 172.21.15.57:0/2046007466 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e100118b0 con 0x7f6e20147560 2021-06-25T04:52:41.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25b39700 1 -- 172.21.15.57:0/2046007466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e20144550 con 0x7f6e20147560 2021-06-25T04:52:41.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e1dffb700 1 -- 172.21.15.57:0/2046007466 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e10011c10 con 0x7f6e20147560 2021-06-25T04:52:41.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25b39700 1 -- 172.21.15.57:0/2046007466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e20149450 con 0x7f6e20147560 2021-06-25T04:52:41.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.339+0000 7f6e25b39700 1 -- 172.21.15.57:0/2046007466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e20143670 con 0x7f6e20147560 2021-06-25T04:52:41.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.343+0000 7f6e1dffb700 1 -- 172.21.15.57:0/2046007466 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6e10011d70 con 0x7f6e20147560 2021-06-25T04:52:41.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.343+0000 7f6e1dffb700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e000554e0 0x7f6e000579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.343+0000 7f6e1dffb700 1 -- 172.21.15.57:0/2046007466 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f6e1006de30 con 0x7f6e20147560 2021-06-25T04:52:41.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.343+0000 7f6e24b37700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e000554e0 0x7f6e000579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.343+0000 7f6e24b37700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e000554e0 0x7f6e000579a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f6e1801b000 tx=0x7f6e18016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:41.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.351+0000 7f6e1dffb700 1 -- 172.21.15.57:0/2046007466 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6e100441b0 con 0x7f6e20147560 2021-06-25T04:52:41.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.479+0000 7f6e25b39700 1 -- 172.21.15.57:0/2046007466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6e20149450 con 0x7f6e20147560 2021-06-25T04:52:41.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.479+0000 7f6e1dffb700 1 -- 172.21.15.57:0/2046007466 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+143 (secure 0 0 0) 0x7f6e20149450 con 0x7f6e20147560 2021-06-25T04:52:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:52:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:52:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:52:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:52:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:52:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:52:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:52:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:52:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:52:41.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 -- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e000554e0 msgr2=0x7f6e000579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e000554e0 0x7f6e000579a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f6e1801b000 tx=0x7f6e18016000).stop 2021-06-25T04:52:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 -- 172.21.15.57:0/2046007466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e20147560 msgr2=0x7f6e20145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e20147560 0x7f6e20145450 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f6e1000c000 tx=0x7f6e10006df0).stop 2021-06-25T04:52:41.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 -- 172.21.15.57:0/2046007466 shutdown_connections 2021-06-25T04:52:41.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e000554e0 0x7f6e000579a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e20147560 0x7f6e20145450 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e200b5460 0x7f6e2015a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 --2- 172.21.15.57:0/2046007466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e200b05d0 0x7f6e2014cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 -- 172.21.15.57:0/2046007466 >> 172.21.15.57:0/2046007466 conn(0x7f6e20062520 msgr2=0x7f6e20067330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 -- 172.21.15.57:0/2046007466 shutdown_connections 2021-06-25T04:52:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.483+0000 7f6e25b39700 1 -- 172.21.15.57:0/2046007466 wait complete. 2021-06-25T04:52:41.501 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:52:41.502 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:52:41.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.599+0000 7fe2d2aa4700 1 Processor -- start 2021-06-25T04:52:41.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 -- start start 2021-06-25T04:52:41.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2cc0b3090 0x7fe2cc1433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe2cc0ace30 0x7fe2cc13f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc1438e0 con 0x7fe2cc0b06d0 2021-06-25T04:52:41.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc0b0ab0 con 0x7fe2cc0ace30 2021-06-25T04:52:41.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0ae640 con 0x7fe2cc0b3090 2021-06-25T04:52:41.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d22a3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe2cc0ace30 0x7fe2cc13f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d22a3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe2cc0ace30 0x7fe2cc13f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38656/0 (socket says 172.21.15.57:38656) 2021-06-25T04:52:41.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d22a3700 1 -- 172.21.15.57:0/1401554766 learned_addr learned my addr 172.21.15.57:0/1401554766 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:41.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d12a1700 1 --2- 172.21.15.57:0/1401554766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2cc0b3090 0x7fe2cc1433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d22a3700 1 -- 172.21.15.57:0/1401554766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2cc0b3090 msgr2=0x7fe2cc1433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:41.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d22a3700 1 --2- 172.21.15.57:0/1401554766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2cc0b3090 0x7fe2cc1433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d22a3700 1 -- 172.21.15.57:0/1401554766 >> v1:172.21.15.87:6789/0 conn(0x7fe2cc0b06d0 legacy=0x7fe2cc142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d22a3700 1 -- 172.21.15.57:0/1401554766 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0ae8e0 con 0x7fe2cc0ace30 2021-06-25T04:52:41.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d22a3700 1 --2- 172.21.15.57:0/1401554766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2cc0ace30 0x7fe2cc13f860 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fe2c40032f0 tx=0x7fe2c4009290).ready entity=mon.0 client_cookie=7a7ca9b6b2e379c9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:41.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d0aa0700 1 -- 172.21.15.57:0/1401554766 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2c400b8a0 con 0x7fe2cc0ace30 2021-06-25T04:52:41.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d0aa0700 1 -- 172.21.15.57:0/1401554766 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c400ba00 con 0x7fe2cc0ace30 2021-06-25T04:52:41.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d0aa0700 1 -- 172.21.15.57:0/1401554766 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2c400bb70 con 0x7fe2cc0ace30 2021-06-25T04:52:41.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/1401554766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2cc0ace30 msgr2=0x7fe2cc13f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 --2- 172.21.15.57:0/1401554766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2cc0ace30 0x7fe2cc13f860 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fe2c40032f0 tx=0x7fe2c4009290).stop 2021-06-25T04:52:41.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/1401554766 shutdown_connections 2021-06-25T04:52:41.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 --2- 172.21.15.57:0/1401554766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2cc0ace30 0x7fe2cc13f860 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 --2- 172.21.15.57:0/1401554766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2cc0b3090 0x7fe2cc1433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.603+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/1401554766 >> 172.21.15.57:0/1401554766 conn(0x7fe2cc061100 msgr2=0x7fe2cc062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:41.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/1401554766 shutdown_connections 2021-06-25T04:52:41.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/1401554766 wait complete. 2021-06-25T04:52:41.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d2aa4700 1 Processor -- start 2021-06-25T04:52:41.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d2aa4700 1 -- start start 2021-06-25T04:52:41.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d2aa4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2cc0ace30 0x7fe2cc0aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d2aa4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2cc0b06d0 0x7fe2cc1363b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d2aa4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2cc0b3090 0x7fe2cc0a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d2aa4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0665c0 con 0x7fe2cc0b3090 2021-06-25T04:52:41.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d2aa4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0ab770 con 0x7fe2cc0ace30 2021-06-25T04:52:41.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d2aa4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc140590 con 0x7fe2cc0b06d0 2021-06-25T04:52:41.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d22a3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2cc0b3090 0x7fe2cc0a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d22a3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2cc0b3090 0x7fe2cc0a9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38660/0 (socket says 172.21.15.57:38660) 2021-06-25T04:52:41.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d22a3700 1 -- 172.21.15.57:0/4254940738 learned_addr learned my addr 172.21.15.57:0/4254940738 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:41.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d12a1700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2cc0b06d0 0x7fe2cc1363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.607+0000 7fe2d1aa2700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2cc0ace30 0x7fe2cc0aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2d22a3700 1 -- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2cc0b06d0 msgr2=0x7fe2cc1363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2d22a3700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2cc0b06d0 0x7fe2cc1363b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2d22a3700 1 -- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2cc0ace30 msgr2=0x7fe2cc0aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:41.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2d22a3700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2cc0ace30 0x7fe2cc0aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:41.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2d22a3700 1 -- 172.21.15.57:0/4254940738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c4009530 con 0x7fe2cc0b3090 2021-06-25T04:52:41.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2d22a3700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2cc0b3090 0x7fe2cc0a9620 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fe2c40032f0 tx=0x7fe2c4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:41.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2baffd700 1 -- 172.21.15.57:0/4254940738 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2c4011b60 con 0x7fe2cc0b3090 2021-06-25T04:52:41.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2baffd700 1 -- 172.21.15.57:0/4254940738 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c4011cc0 con 0x7fe2cc0b3090 2021-06-25T04:52:41.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/4254940738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc140830 con 0x7fe2cc0b3090 2021-06-25T04:52:41.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2baffd700 1 -- 172.21.15.57:0/4254940738 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2c4020620 con 0x7fe2cc0b3090 2021-06-25T04:52:41.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/4254940738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc137010 con 0x7fe2cc0b3090 2021-06-25T04:52:41.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/4254940738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc0abd70 con 0x7fe2cc0b3090 2021-06-25T04:52:41.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2baffd700 1 -- 172.21.15.57:0/4254940738 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe2c400f070 con 0x7fe2cc0b3090 2021-06-25T04:52:41.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.611+0000 7fe2baffd700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe2ac0553d0 0x7fe2ac057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:41.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.615+0000 7fe2baffd700 1 -- 172.21.15.57:0/4254940738 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fe2c406e8e0 con 0x7fe2cc0b3090 2021-06-25T04:52:41.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.615+0000 7fe2d1aa2700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe2ac0553d0 0x7fe2ac057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:41.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.615+0000 7fe2d1aa2700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe2ac0553d0 0x7fe2ac057890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fe2c800d000 tx=0x7fe2c8007b50).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:41.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.619+0000 7fe2baffd700 1 -- 172.21.15.57:0/4254940738 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe2c4044cc0 con 0x7fe2cc0b3090 2021-06-25T04:52:41.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:41.743+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/4254940738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fe2cc0a8f10 con 0x7fe2cc0b3090 2021-06-25T04:52:42.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.315+0000 7fe2baffd700 1 -- 172.21.15.57:0/4254940738 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v64) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe2c4015070 con 0x7fe2cc0b3090 2021-06-25T04:52:42.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe2ac0553d0 msgr2=0x7fe2ac057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:42.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe2ac0553d0 0x7fe2ac057890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fe2c800d000 tx=0x7fe2c8007b50).stop 2021-06-25T04:52:42.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/4254940738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2cc0b3090 msgr2=0x7fe2cc0a9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:42.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2cc0b3090 0x7fe2cc0a9620 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fe2c40032f0 tx=0x7fe2c4016000).stop 2021-06-25T04:52:42.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/4254940738 shutdown_connections 2021-06-25T04:52:42.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe2ac0553d0 0x7fe2ac057890 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:42.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2cc0b3090 0x7fe2cc0a9620 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:42.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2cc0b06d0 0x7fe2cc1363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:42.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 --2- 172.21.15.57:0/4254940738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2cc0ace30 0x7fe2cc0aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:42.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/4254940738 >> 172.21.15.57:0/4254940738 conn(0x7fe2cc061100 msgr2=0x7fe2cc062cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:42.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/4254940738 shutdown_connections 2021-06-25T04:52:42.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.323+0000 7fe2d2aa4700 1 -- 172.21.15.57:0/4254940738 wait complete. 2021-06-25T04:52:42.329 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:52:42.339 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:52:42.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.443+0000 7fa449706700 1 Processor -- start 2021-06-25T04:52:42.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.443+0000 7fa449706700 1 -- start start 2021-06-25T04:52:42.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4440b4140 0x7fa444140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:42.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa4440b4650 0x7fa4440b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:42.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa444143b20 con 0x7fa444146910 2021-06-25T04:52:42.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4441474d0 con 0x7fa4440b4650 2021-06-25T04:52:42.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa444143dc0 con 0x7fa4440b4140 2021-06-25T04:52:42.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa442ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa444146910 0x7fa4441401f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55884/0 (socket says 172.21.15.57:55884) 2021-06-25T04:52:42.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa442ffd700 1 -- 172.21.15.57:0/1183341001 learned_addr learned my addr 172.21.15.57:0/1183341001 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:42.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa4437fe700 1 --2- 172.21.15.57:0/1183341001 >> v2:172.21.15.87:3300/0 conn(0x7fa4440b4650 0x7fa4440b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:42.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa4427fc700 1 --2- 172.21.15.57:0/1183341001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4440b4140 0x7fa444140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:42.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa441ffb700 1 -- 172.21.15.57:0/1183341001 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239243867 0 0) 0x7fa444143b20 con 0x7fa444146910 2021-06-25T04:52:42.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa441ffb700 1 -- 172.21.15.57:0/1183341001 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa428003260 con 0x7fa444146910 2021-06-25T04:52:42.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa4437fe700 1 -- 172.21.15.57:0/1183341001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4440b4140 msgr2=0x7fa444140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:42.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa4437fe700 1 --2- 172.21.15.57:0/1183341001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4440b4140 0x7fa444140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:42.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa4437fe700 1 -- 172.21.15.57:0/1183341001 >> v1:172.21.15.57:6789/0 conn(0x7fa444146910 legacy=0x7fa4441401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:42.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa4437fe700 1 -- 172.21.15.57:0/1183341001 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440b0c50 con 0x7fa4440b4650 2021-06-25T04:52:42.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa4437fe700 1 --2- 172.21.15.57:0/1183341001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4440b4650 0x7fa4440b4e90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fa43c0032f0 tx=0x7fa43c0091d0).ready entity=mon.1 client_cookie=517ace69e52142d1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:42.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa441ffb700 1 -- 172.21.15.57:0/1183341001 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43c00b600 con 0x7fa4440b4650 2021-06-25T04:52:42.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa441ffb700 1 -- 172.21.15.57:0/1183341001 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c00b760 con 0x7fa4440b4650 2021-06-25T04:52:42.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 -- 172.21.15.57:0/1183341001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4440b4650 msgr2=0x7fa4440b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:42.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa441ffb700 1 -- 172.21.15.57:0/1183341001 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43c00b8d0 con 0x7fa4440b4650 2021-06-25T04:52:42.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 --2- 172.21.15.57:0/1183341001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4440b4650 0x7fa4440b4e90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fa43c0032f0 tx=0x7fa43c0091d0).stop 2021-06-25T04:52:42.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 -- 172.21.15.57:0/1183341001 shutdown_connections 2021-06-25T04:52:42.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 --2- 172.21.15.57:0/1183341001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4440b4650 0x7fa4440b4e90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:42.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 --2- 172.21.15.57:0/1183341001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4440b4140 0x7fa444140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:42.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 -- 172.21.15.57:0/1183341001 >> 172.21.15.57:0/1183341001 conn(0x7fa44405c450 msgr2=0x7fa44405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:42.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 -- 172.21.15.57:0/1183341001 shutdown_connections 2021-06-25T04:52:42.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 -- 172.21.15.57:0/1183341001 wait complete. 2021-06-25T04:52:42.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.447+0000 7fa449706700 1 Processor -- start 2021-06-25T04:52:42.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa449706700 1 -- start start 2021-06-25T04:52:42.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa449706700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4440b4140 0x7fa444142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:42.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa449706700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4440b4650 0x7fa444149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:42.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa449706700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa444146910 0x7fa444147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:42.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa449706700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa444155bb0 con 0x7fa444146910 2021-06-25T04:52:42.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa449706700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440ad960 con 0x7fa4440b4650 2021-06-25T04:52:42.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa449706700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440adc00 con 0x7fa4440b4140 2021-06-25T04:52:42.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa4437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa444146910 0x7fa444147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:42.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa4437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa444146910 0x7fa444147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38676/0 (socket says 172.21.15.57:38676) 2021-06-25T04:52:42.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa4437fe700 1 -- 172.21.15.57:0/3851654103 learned_addr learned my addr 172.21.15.57:0/3851654103 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:42.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa4427fc700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4440b4650 0x7fa444149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:42.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa442ffd700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4440b4140 0x7fa444142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:42.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa4437fe700 1 -- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4440b4140 msgr2=0x7fa444142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:42.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa4437fe700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4440b4140 0x7fa444142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:42.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa4437fe700 1 -- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4440b4650 msgr2=0x7fa444149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:42.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa4437fe700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4440b4650 0x7fa444149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:42.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa4437fe700 1 -- 172.21.15.57:0/3851654103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009470 con 0x7fa444146910 2021-06-25T04:52:42.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa4437fe700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa444146910 0x7fa444147690 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fa43c0032f0 tx=0x7fa43c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:42.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa433fff700 1 -- 172.21.15.57:0/3851654103 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43c006ea0 con 0x7fa444146910 2021-06-25T04:52:42.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa433fff700 1 -- 172.21.15.57:0/3851654103 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c011e90 con 0x7fa444146910 2021-06-25T04:52:42.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa449706700 1 -- 172.21.15.57:0/3851654103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4440ae920 con 0x7fa444146910 2021-06-25T04:52:42.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa433fff700 1 -- 172.21.15.57:0/3851654103 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43c021630 con 0x7fa444146910 2021-06-25T04:52:42.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa449706700 1 -- 172.21.15.57:0/3851654103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa444149a20 con 0x7fa444146910 2021-06-25T04:52:42.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.451+0000 7fa449706700 1 -- 172.21.15.57:0/3851654103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa444057310 con 0x7fa444146910 2021-06-25T04:52:42.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.455+0000 7fa433fff700 1 -- 172.21.15.57:0/3851654103 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa43c027020 con 0x7fa444146910 2021-06-25T04:52:42.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.455+0000 7fa433fff700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa420055490 0x7fa420057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:42.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.455+0000 7fa433fff700 1 -- 172.21.15.57:0/3851654103 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5954+0+0 (secure 0 0 0) 0x7fa43c06eea0 con 0x7fa444146910 2021-06-25T04:52:42.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.455+0000 7fa442ffd700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa420055490 0x7fa420057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:42.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.455+0000 7fa442ffd700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa420055490 0x7fa420057950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fa43800b000 tx=0x7fa438009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:42.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.459+0000 7fa433fff700 1 -- 172.21.15.57:0/3851654103 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa43c045220 con 0x7fa444146910 2021-06-25T04:52:42.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:42.591+0000 7fa449706700 1 -- 172.21.15.57:0/3851654103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fa4440b6fe0 con 0x7fa444146910 2021-06-25T04:52:43.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.319+0000 7fa433fff700 1 -- 172.21.15.57:0/3851654103 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v65) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa43c0150a0 con 0x7fa444146910 2021-06-25T04:52:43.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 -- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa420055490 msgr2=0x7fa420057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa420055490 0x7fa420057950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fa43800b000 tx=0x7fa438009040).stop 2021-06-25T04:52:43.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 -- 172.21.15.57:0/3851654103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa444146910 msgr2=0x7fa444147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa444146910 0x7fa444147690 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fa43c0032f0 tx=0x7fa43c016000).stop 2021-06-25T04:52:43.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 -- 172.21.15.57:0/3851654103 shutdown_connections 2021-06-25T04:52:43.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa420055490 0x7fa420057950 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa444146910 0x7fa444147690 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4440b4650 0x7fa444149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 --2- 172.21.15.57:0/3851654103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4440b4140 0x7fa444142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 -- 172.21.15.57:0/3851654103 >> 172.21.15.57:0/3851654103 conn(0x7fa44405c450 msgr2=0x7fa4440b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:43.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 -- 172.21.15.57:0/3851654103 shutdown_connections 2021-06-25T04:52:43.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.327+0000 7fa449706700 1 -- 172.21.15.57:0/3851654103 wait complete. 2021-06-25T04:52:43.333 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:52:43.345 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:52:43.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f3c37700 1 Processor -- start 2021-06-25T04:52:43.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f3c37700 1 -- start start 2021-06-25T04:52:43.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f3c37700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f10ec0b0e30 0x7f10ec14b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f3c37700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec0b35e0 con 0x7f10ec0b3200 2021-06-25T04:52:43.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f3c37700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec1436b0 con 0x7f10ec0b1800 2021-06-25T04:52:43.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f3c37700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec065c60 con 0x7f10ec0b0e30 2021-06-25T04:52:43.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f19d3700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f10ec0b3200 0x7f10ec066640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55898/0 (socket says 172.21.15.57:55898) 2021-06-25T04:52:43.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f19d3700 1 -- 172.21.15.57:0/238968498 learned_addr learned my addr 172.21.15.57:0/238968498 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:43.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f21d4700 1 --2- 172.21.15.57:0/238968498 >> v2:172.21.15.87:3300/0 conn(0x7f10ec0b0e30 0x7f10ec14b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298962587 0 0) 0x7f10ec0b35e0 con 0x7f10ec0b3200 2021-06-25T04:52:43.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d4003260 con 0x7f10ec0b3200 2021-06-25T04:52:43.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216664205 0 0) 0x7f10d4003260 con 0x7f10ec0b3200 2021-06-25T04:52:43.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 >> v2:172.21.15.87:3300/0 conn(0x7f10ec0b0e30 msgr2=0x7f10ec14b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:43.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 --2- 172.21.15.57:0/238968498 >> v2:172.21.15.87:3300/0 conn(0x7f10ec0b0e30 0x7f10ec14b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 >> v1:172.21.15.87:6789/0 conn(0x7f10ec0b1800 legacy=0x7f10ec142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec065f00 con 0x7f10ec0b3200 2021-06-25T04:52:43.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f10e8001680 con 0x7f10ec0b3200 2021-06-25T04:52:43.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 >> v1:172.21.15.57:6789/0 conn(0x7f10ec0b3200 legacy=0x7f10ec066640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 --2- 172.21.15.57:0/238968498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d4003750 0x7f10d4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 --2- 172.21.15.57:0/238968498 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10d4004500 0x7f10d4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 --2- 172.21.15.57:0/238968498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d4004e70 0x7f10d400d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec065c60 con 0x7f10d4004e70 2021-06-25T04:52:43.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d400df30 con 0x7f10d4003750 2021-06-25T04:52:43.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d400e0f0 con 0x7f10d4004500 2021-06-25T04:52:43.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f21d4700 1 --2- 172.21.15.57:0/238968498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d4004e70 0x7f10d400d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f19d3700 1 --2- 172.21.15.57:0/238968498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d4003750 0x7f10d4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f11d2700 1 --2- 172.21.15.57:0/238968498 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10d4004500 0x7f10d4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f21d4700 1 -- 172.21.15.57:0/238968498 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10d4004500 msgr2=0x7f10d4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:43.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f21d4700 1 --2- 172.21.15.57:0/238968498 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10d4004500 0x7f10d4004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f21d4700 1 -- 172.21.15.57:0/238968498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d4003750 msgr2=0x7f10d4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:43.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f21d4700 1 --2- 172.21.15.57:0/238968498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d4003750 0x7f10d4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.447+0000 7f10f21d4700 1 -- 172.21.15.57:0/238968498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4003260 con 0x7f10d4004e70 2021-06-25T04:52:43.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f21d4700 1 -- 172.21.15.57:0/238968498 reap_dead start 2021-06-25T04:52:43.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f21d4700 1 --2- 172.21.15.57:0/238968498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d4004e70 0x7f10d400d960 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f10e400c000 tx=0x7f10e40091d0).ready entity=mon.0 client_cookie=6078e2c0befbb858 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:43.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10e400e7e0 con 0x7f10d4004e70 2021-06-25T04:52:43.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e400e940 con 0x7f10d4004e70 2021-06-25T04:52:43.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f09d1700 1 -- 172.21.15.57:0/238968498 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10e400eca0 con 0x7f10d4004e70 2021-06-25T04:52:43.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f3c37700 1 -- 172.21.15.57:0/238968498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d4004e70 msgr2=0x7f10d400d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f3c37700 1 --2- 172.21.15.57:0/238968498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d4004e70 0x7f10d400d960 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f10e400c000 tx=0x7f10e40091d0).stop 2021-06-25T04:52:43.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f3c37700 1 -- 172.21.15.57:0/238968498 shutdown_connections 2021-06-25T04:52:43.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f3c37700 1 --2- 172.21.15.57:0/238968498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d4004e70 0x7f10d400d960 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f3c37700 1 -- 172.21.15.57:0/238968498 >> 172.21.15.57:0/238968498 conn(0x7f10ec05c450 msgr2=0x7f10ec05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:43.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f3c37700 1 -- 172.21.15.57:0/238968498 shutdown_connections 2021-06-25T04:52:43.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f3c37700 1 -- 172.21.15.57:0/238968498 wait complete. 2021-06-25T04:52:43.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.451+0000 7f10f3c37700 1 Processor -- start 2021-06-25T04:52:43.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f3c37700 1 -- start start 2021-06-25T04:52:43.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f3c37700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d4004e70 0x7f10ec151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f3c37700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10ec0af140 0x7f10ec0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f3c37700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10ec0ae920 0x7f10ec13f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f3c37700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0aa2a0 con 0x7f10ec0af140 2021-06-25T04:52:43.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f3c37700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec151910 con 0x7f10d4004e70 2021-06-25T04:52:43.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f3c37700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec151b40 con 0x7f10ec0ae920 2021-06-25T04:52:43.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f11d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10ec0af140 0x7f10ec0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f19d3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d4004e70 0x7f10ec151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f21d4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10ec0ae920 0x7f10ec13f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f19d3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d4004e70 0x7f10ec151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:47186/0 (socket says 172.21.15.57:47186) 2021-06-25T04:52:43.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f19d3700 1 -- 172.21.15.57:0/2416574633 learned_addr learned my addr 172.21.15.57:0/2416574633 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:43.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f11d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10ec0af140 0x7f10ec0acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38694/0 (socket says 172.21.15.57:38694) 2021-06-25T04:52:43.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f11d2700 1 -- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10ec0ae920 msgr2=0x7f10ec13f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f11d2700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10ec0ae920 0x7f10ec13f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f11d2700 1 -- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d4004e70 msgr2=0x7f10ec151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f11d2700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d4004e70 0x7f10ec151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f11d2700 1 -- 172.21.15.57:0/2416574633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec151de0 con 0x7f10ec0af140 2021-06-25T04:52:43.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f19d3700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d4004e70 0x7f10ec151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:52:43.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f11d2700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10ec0af140 0x7f10ec0acb20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f10dc00d000 tx=0x7f10dc007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:43.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10daffd700 1 -- 172.21.15.57:0/2416574633 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10dc0133f0 con 0x7f10ec0af140 2021-06-25T04:52:43.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10daffd700 1 -- 172.21.15.57:0/2416574633 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc013550 con 0x7f10ec0af140 2021-06-25T04:52:43.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f3c37700 1 -- 172.21.15.57:0/2416574633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec0b0860 con 0x7f10ec0af140 2021-06-25T04:52:43.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10daffd700 1 -- 172.21.15.57:0/2416574633 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10dc0138b0 con 0x7f10ec0af140 2021-06-25T04:52:43.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.455+0000 7f10f3c37700 1 -- 172.21.15.57:0/2416574633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec0ad010 con 0x7f10ec0af140 2021-06-25T04:52:43.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.459+0000 7f10f3c37700 1 -- 172.21.15.57:0/2416574633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec151f70 con 0x7f10ec0af140 2021-06-25T04:52:43.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.459+0000 7f10daffd700 1 -- 172.21.15.57:0/2416574633 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f10dc01a030 con 0x7f10ec0af140 2021-06-25T04:52:43.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.459+0000 7f10daffd700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10cc0554e0 0x7f10cc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.459+0000 7f10daffd700 1 -- 172.21.15.57:0/2416574633 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f10dc06d6a0 con 0x7f10ec0af140 2021-06-25T04:52:43.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.459+0000 7f10f19d3700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10cc0554e0 0x7f10cc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.463+0000 7f10f19d3700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10cc0554e0 0x7f10cc0579a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f10e8005000 tx=0x7f10e8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:43.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.467+0000 7f10daffd700 1 -- 172.21.15.57:0/2416574633 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f10dc043870 con 0x7f10ec0af140 2021-06-25T04:52:43.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.635+0000 7f10f3c37700 1 -- 172.21.15.57:0/2416574633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f10ec0b09f0 con 0x7f10ec0af140 2021-06-25T04:52:43.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.651+0000 7f10daffd700 1 -- 172.21.15.57:0/2416574633 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v30) v1 ==== 189+0+0 (secure 0 0 0) 0x7f10ec0b09f0 con 0x7f10ec0af140 2021-06-25T04:52:43.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 -- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10cc0554e0 msgr2=0x7f10cc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10cc0554e0 0x7f10cc0579a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f10e8005000 tx=0x7f10e8009040).stop 2021-06-25T04:52:43.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 -- 172.21.15.57:0/2416574633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10ec0af140 msgr2=0x7f10ec0acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10ec0af140 0x7f10ec0acb20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f10dc00d000 tx=0x7f10dc007a00).stop 2021-06-25T04:52:43.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 -- 172.21.15.57:0/2416574633 shutdown_connections 2021-06-25T04:52:43.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10cc0554e0 0x7f10cc0579a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10ec0ae920 0x7f10ec13f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10ec0af140 0x7f10ec0acb20 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 --2- 172.21.15.57:0/2416574633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d4004e70 0x7f10ec151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 -- 172.21.15.57:0/2416574633 >> 172.21.15.57:0/2416574633 conn(0x7f10ec05c450 msgr2=0x7f10ec0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:43.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 -- 172.21.15.57:0/2416574633 shutdown_connections 2021-06-25T04:52:43.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.655+0000 7f10f3c37700 1 -- 172.21.15.57:0/2416574633 wait complete. 2021-06-25T04:52:43.662 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 11 and data pool 12 2021-06-25T04:52:43.674 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:52:43.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 Processor -- start 2021-06-25T04:52:43.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 -- start start 2021-06-25T04:52:43.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53f8067140 0x7f53f805f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f80a7a50 con 0x7f53f80b1930 2021-06-25T04:52:43.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f81475e0 con 0x7f53f80a7670 2021-06-25T04:52:43.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f8147880 con 0x7f53f8067140 2021-06-25T04:52:43.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f77fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f53f80b1930 0x7f53f805fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55934/0 (socket says 172.21.15.57:55934) 2021-06-25T04:52:43.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f77fe700 1 -- 172.21.15.57:0/3346720594 learned_addr learned my addr 172.21.15.57:0/3346720594 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:43.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f67fc700 1 --2- 172.21.15.57:0/3346720594 >> v2:172.21.15.87:3300/0 conn(0x7f53f8067140 0x7f53f805f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f5ffb700 1 -- 172.21.15.57:0/3346720594 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387017696 0 0) 0x7f53f80a7a50 con 0x7f53f80b1930 2021-06-25T04:52:43.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f5ffb700 1 -- 172.21.15.57:0/3346720594 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d8003260 con 0x7f53f80b1930 2021-06-25T04:52:43.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f67fc700 1 -- 172.21.15.57:0/3346720594 >> v1:172.21.15.87:6789/0 conn(0x7f53f80a7670 legacy=0x7f53f8066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f67fc700 1 -- 172.21.15.57:0/3346720594 >> v1:172.21.15.57:6789/0 conn(0x7f53f80b1930 legacy=0x7f53f805fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f67fc700 1 -- 172.21.15.57:0/3346720594 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f8147b20 con 0x7f53f8067140 2021-06-25T04:52:43.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f67fc700 1 --2- 172.21.15.57:0/3346720594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f8067140 0x7f53f805f670 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f53e0002f70 tx=0x7f53e0006df0).ready entity=mon.1 client_cookie=84a253056769e209 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:43.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f5ffb700 1 -- 172.21.15.57:0/3346720594 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53e000d610 con 0x7f53f8067140 2021-06-25T04:52:43.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f5ffb700 1 -- 172.21.15.57:0/3346720594 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e0000e90 con 0x7f53f8067140 2021-06-25T04:52:43.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53f5ffb700 1 -- 172.21.15.57:0/3346720594 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53e000d960 con 0x7f53f8067140 2021-06-25T04:52:43.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3346720594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f8067140 msgr2=0x7f53f805f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 --2- 172.21.15.57:0/3346720594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f8067140 0x7f53f805f670 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f53e0002f70 tx=0x7f53e0006df0).stop 2021-06-25T04:52:43.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3346720594 shutdown_connections 2021-06-25T04:52:43.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 --2- 172.21.15.57:0/3346720594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f8067140 0x7f53f805f670 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3346720594 >> 172.21.15.57:0/3346720594 conn(0x7f53f80b53a0 msgr2=0x7f53f80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:43.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.763+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3346720594 shutdown_connections 2021-06-25T04:52:43.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.767+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3346720594 wait complete. 2021-06-25T04:52:43.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.767+0000 7f53fd4c1700 1 Processor -- start 2021-06-25T04:52:43.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.767+0000 7f53fd4c1700 1 -- start start 2021-06-25T04:52:43.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53fd4c1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f8067140 0x7f53f8145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53fd4c1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53f80a7670 0x7f53f80a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53fd4c1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80b1930 0x7f53f80abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53fd4c1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80ab170 con 0x7f53f80b1930 2021-06-25T04:52:43.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53fd4c1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80ab410 con 0x7f53f8067140 2021-06-25T04:52:43.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53fd4c1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80ab6b0 con 0x7f53f80a7670 2021-06-25T04:52:43.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80b1930 0x7f53f80abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f6ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f8067140 0x7f53f8145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80b1930 0x7f53f80abb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38722/0 (socket says 172.21.15.57:38722) 2021-06-25T04:52:43.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f77fe700 1 -- 172.21.15.57:0/3133837967 learned_addr learned my addr 172.21.15.57:0/3133837967 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:43.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f67fc700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53f80a7670 0x7f53f80a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f77fe700 1 -- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53f80a7670 msgr2=0x7f53f80a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f77fe700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53f80a7670 0x7f53f80a91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f77fe700 1 -- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f8067140 msgr2=0x7f53f8145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f77fe700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f8067140 0x7f53f8145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f77fe700 1 -- 172.21.15.57:0/3133837967 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e000b180 con 0x7f53f80b1930 2021-06-25T04:52:43.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f6ffd700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f8067140 0x7f53f8145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:52:43.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53f77fe700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80b1930 0x7f53f80abb50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f53f0001490 tx=0x7f53f0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:43.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53effff700 1 -- 172.21.15.57:0/3133837967 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53f0005ba0 con 0x7f53f80b1930 2021-06-25T04:52:43.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53effff700 1 -- 172.21.15.57:0/3133837967 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f0005d00 con 0x7f53f80b1930 2021-06-25T04:52:43.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3133837967 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f80b45d0 con 0x7f53f80b1930 2021-06-25T04:52:43.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53effff700 1 -- 172.21.15.57:0/3133837967 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53f00072c0 con 0x7f53f80b1930 2021-06-25T04:52:43.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3133837967 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f80ac260 con 0x7f53f80b1930 2021-06-25T04:52:43.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.771+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3133837967 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f80ab870 con 0x7f53f80b1930 2021-06-25T04:52:43.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.775+0000 7f53effff700 1 -- 172.21.15.57:0/3133837967 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f53f0010070 con 0x7f53f80b1930 2021-06-25T04:52:43.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.775+0000 7f53effff700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53dc055340 0x7f53dc057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:43.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.775+0000 7f53effff700 1 -- 172.21.15.57:0/3133837967 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f53f006d870 con 0x7f53f80b1930 2021-06-25T04:52:43.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.775+0000 7f53f6ffd700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53dc055340 0x7f53dc057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:43.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.775+0000 7f53f6ffd700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53dc055340 0x7f53dc057800 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f53e800d000 tx=0x7f53e8000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.779+0000 7f53effff700 1 -- 172.21.15.57:0/3133837967 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f53f0043980 con 0x7f53f80b1930 2021-06-25T04:52:43.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.907+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3133837967 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53f8057310 con 0x7f53f80b1930 2021-06-25T04:52:43.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.907+0000 7f53effff700 1 -- 172.21.15.57:0/3133837967 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f53f0046fa0 con 0x7f53f80b1930 2021-06-25T04:52:43.914 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:43.914 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":66,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:52:43.641676+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:52:41.803683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-06-25T04:52:42.643832+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:52:43.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53dc055340 msgr2=0x7f53dc057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53dc055340 0x7f53dc057800 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f53e800d000 tx=0x7f53e8000bc0).stop 2021-06-25T04:52:43.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3133837967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80b1930 msgr2=0x7f53f80abb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:43.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80b1930 0x7f53f80abb50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f53f0001490 tx=0x7f53f0007e00).stop 2021-06-25T04:52:43.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3133837967 shutdown_connections 2021-06-25T04:52:43.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f53dc055340 0x7f53dc057800 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80b1930 0x7f53f80abb50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53f80a7670 0x7f53f80a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 --2- 172.21.15.57:0/3133837967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53f8067140 0x7f53f8145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:43.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3133837967 >> 172.21.15.57:0/3133837967 conn(0x7f53f80b53a0 msgr2=0x7f53f8149830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:43.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3133837967 shutdown_connections 2021-06-25T04:52:43.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:43.911+0000 7f53fd4c1700 1 -- 172.21.15.57:0/3133837967 wait complete. 2021-06-25T04:52:43.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:52:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393ffff700 1 Processor -- start 2021-06-25T04:52:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393ffff700 1 -- start start 2021-06-25T04:52:44.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39400b05d0 0x7f39400af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3940147560 0x7f39400acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393ffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39400b5840 con 0x7f39400b5460 2021-06-25T04:52:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393ffff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39401452a0 con 0x7f39400b05d0 2021-06-25T04:52:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393ffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39400adfb0 con 0x7f3940147560 2021-06-25T04:52:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f39400b5460 0x7f3940067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55946/0 (socket says 172.21.15.57:55946) 2021-06-25T04:52:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393effd700 1 -- 172.21.15.57:0/4273358480 learned_addr learned my addr 172.21.15.57:0/4273358480 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:44.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393f7fe700 1 --2- 172.21.15.57:0/4273358480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3940147560 0x7f39400acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393e7fc700 1 --2- 172.21.15.57:0/4273358480 >> v2:172.21.15.87:3300/0 conn(0x7f39400b05d0 0x7f39400af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393dffb700 1 -- 172.21.15.57:0/4273358480 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241526623 0 0) 0x7f39400b5840 con 0x7f39400b5460 2021-06-25T04:52:44.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.027+0000 7f393dffb700 1 -- 172.21.15.57:0/4273358480 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3924003260 con 0x7f39400b5460 2021-06-25T04:52:44.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393f7fe700 1 -- 172.21.15.57:0/4273358480 >> v2:172.21.15.87:3300/0 conn(0x7f39400b05d0 msgr2=0x7f39400af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:44.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393f7fe700 1 --2- 172.21.15.57:0/4273358480 >> v2:172.21.15.87:3300/0 conn(0x7f39400b05d0 0x7f39400af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393f7fe700 1 -- 172.21.15.57:0/4273358480 >> v1:172.21.15.57:6789/0 conn(0x7f39400b5460 legacy=0x7f3940067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393f7fe700 1 -- 172.21.15.57:0/4273358480 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400ac7c0 con 0x7f3940147560 2021-06-25T04:52:44.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393f7fe700 1 --2- 172.21.15.57:0/4273358480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3940147560 0x7f39400acc20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3938002f70 tx=0x7f3938006df0).ready entity=mon.2 client_cookie=1c7e5b43653a4ae4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:44.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393dffb700 1 -- 172.21.15.57:0/4273358480 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f393800d4a0 con 0x7f3940147560 2021-06-25T04:52:44.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393dffb700 1 -- 172.21.15.57:0/4273358480 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3938000e90 con 0x7f3940147560 2021-06-25T04:52:44.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393dffb700 1 -- 172.21.15.57:0/4273358480 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f393800d830 con 0x7f3940147560 2021-06-25T04:52:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 -- 172.21.15.57:0/4273358480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3940147560 msgr2=0x7f39400acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 --2- 172.21.15.57:0/4273358480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3940147560 0x7f39400acc20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3938002f70 tx=0x7f3938006df0).stop 2021-06-25T04:52:44.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 -- 172.21.15.57:0/4273358480 shutdown_connections 2021-06-25T04:52:44.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 --2- 172.21.15.57:0/4273358480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3940147560 0x7f39400acc20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 --2- 172.21.15.57:0/4273358480 >> v2:172.21.15.87:3300/0 conn(0x7f39400b05d0 0x7f39400af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 -- 172.21.15.57:0/4273358480 >> 172.21.15.57:0/4273358480 conn(0x7f3940062520 msgr2=0x7f3940062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:44.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 -- 172.21.15.57:0/4273358480 shutdown_connections 2021-06-25T04:52:44.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 -- 172.21.15.57:0/4273358480 wait complete. 2021-06-25T04:52:44.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 Processor -- start 2021-06-25T04:52:44.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 -- start start 2021-06-25T04:52:44.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39400b05d0 0x7f39400b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39400b5460 0x7f394014afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3940147560 0x7f39401565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39400b3c50 con 0x7f3940147560 2021-06-25T04:52:44.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39400b4850 con 0x7f39400b5460 2021-06-25T04:52:44.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393ffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39400b4af0 con 0x7f39400b05d0 2021-06-25T04:52:44.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.031+0000 7f393f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3940147560 0x7f39401565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3940147560 0x7f39401565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38736/0 (socket says 172.21.15.57:38736) 2021-06-25T04:52:44.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393e7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39400b5460 0x7f394014afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393effd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39400b05d0 0x7f39400b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393f7fe700 1 -- 172.21.15.57:0/2341691071 learned_addr learned my addr 172.21.15.57:0/2341691071 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:44.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393f7fe700 1 -- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39400b05d0 msgr2=0x7f39400b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393f7fe700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39400b05d0 0x7f39400b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393f7fe700 1 -- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39400b5460 msgr2=0x7f394014afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393f7fe700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39400b5460 0x7f394014afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393f7fe700 1 -- 172.21.15.57:0/2341691071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393800b180 con 0x7f3940147560 2021-06-25T04:52:44.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393f7fe700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3940147560 0x7f39401565e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f3938002f70 tx=0x7f3938014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:44.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f392ffff700 1 -- 172.21.15.57:0/2341691071 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3938012860 con 0x7f3940147560 2021-06-25T04:52:44.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f392ffff700 1 -- 172.21.15.57:0/2341691071 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3938000e90 con 0x7f3940147560 2021-06-25T04:52:44.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393ffff700 1 -- 172.21.15.57:0/2341691071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39400b4d90 con 0x7f3940147560 2021-06-25T04:52:44.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f392ffff700 1 -- 172.21.15.57:0/2341691071 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3938012bb0 con 0x7f3940147560 2021-06-25T04:52:44.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393ffff700 1 -- 172.21.15.57:0/2341691071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394014b4b0 con 0x7f3940147560 2021-06-25T04:52:44.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f393ffff700 1 -- 172.21.15.57:0/2341691071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3940057310 con 0x7f3940147560 2021-06-25T04:52:44.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.035+0000 7f392ffff700 1 -- 172.21.15.57:0/2341691071 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3938024020 con 0x7f3940147560 2021-06-25T04:52:44.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.039+0000 7f392ffff700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f391c055450 0x7f391c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.039+0000 7f392ffff700 1 -- 172.21.15.57:0/2341691071 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f393806e880 con 0x7f3940147560 2021-06-25T04:52:44.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.039+0000 7f393effd700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f391c055450 0x7f391c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.039+0000 7f393effd700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f391c055450 0x7f391c057910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f393400d000 tx=0x7f3934009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:44.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.043+0000 7f392ffff700 1 -- 172.21.15.57:0/2341691071 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3938044ae0 con 0x7f3940147560 2021-06-25T04:52:44.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.167+0000 7f393ffff700 1 -- 172.21.15.57:0/2341691071 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f394005f200 con 0x7f3940147560 2021-06-25T04:52:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f392ffff700 1 -- 172.21.15.57:0/2341691071 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f3938006980 con 0x7f3940147560 2021-06-25T04:52:44.176 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:44.176 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":66,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:52:43.641676+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:52:41.803683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-06-25T04:52:42.643832+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:52:44.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 -- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f391c055450 msgr2=0x7f391c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f391c055450 0x7f391c057910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f393400d000 tx=0x7f3934009040).stop 2021-06-25T04:52:44.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 -- 172.21.15.57:0/2341691071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3940147560 msgr2=0x7f39401565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3940147560 0x7f39401565e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f3938002f70 tx=0x7f3938014000).stop 2021-06-25T04:52:44.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 -- 172.21.15.57:0/2341691071 shutdown_connections 2021-06-25T04:52:44.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f391c055450 0x7f391c057910 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3940147560 0x7f39401565e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39400b5460 0x7f394014afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 --2- 172.21.15.57:0/2341691071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39400b05d0 0x7f39400b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 -- 172.21.15.57:0/2341691071 >> 172.21.15.57:0/2341691071 conn(0x7f3940062520 msgr2=0x7f39400acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:44.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 -- 172.21.15.57:0/2341691071 shutdown_connections 2021-06-25T04:52:44.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.171+0000 7f393ffff700 1 -- 172.21.15.57:0/2341691071 wait complete. 2021-06-25T04:52:44.193 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:52:44.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.299+0000 7f4b0dc2b700 1 Processor -- start 2021-06-25T04:52:44.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.299+0000 7f4b0dc2b700 1 -- start start 2021-06-25T04:52:44.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b080b6250 0x7f4b08061430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4b080b4020 0x7f4b08061920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b080b5f10 con 0x7f4b08061e10 2021-06-25T04:52:44.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b080b1f30 con 0x7f4b080b4020 2021-06-25T04:52:44.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080b21d0 con 0x7f4b080b6250 2021-06-25T04:52:44.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0d42a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4b08061e10 0x7f4b081463f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55962/0 (socket says 172.21.15.57:55962) 2021-06-25T04:52:44.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0d42a700 1 -- 172.21.15.57:0/487824867 learned_addr learned my addr 172.21.15.57:0/487824867 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:44.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b07fff700 1 --2- 172.21.15.57:0/487824867 >> v2:172.21.15.87:3300/0 conn(0x7f4b080b4020 0x7f4b08061920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0cc29700 1 --2- 172.21.15.57:0/487824867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b080b6250 0x7f4b08061430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b077fe700 1 -- 172.21.15.57:0/487824867 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687439010 0 0) 0x7f4b00001490 con 0x7f4b08061e10 2021-06-25T04:52:44.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b077fe700 1 -- 172.21.15.57:0/487824867 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4af4003260 con 0x7f4b08061e10 2021-06-25T04:52:44.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b07fff700 1 -- 172.21.15.57:0/487824867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b080b6250 msgr2=0x7f4b08061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:44.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b07fff700 1 --2- 172.21.15.57:0/487824867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b080b6250 0x7f4b08061430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b07fff700 1 -- 172.21.15.57:0/487824867 >> v1:172.21.15.57:6789/0 conn(0x7f4b08061e10 legacy=0x7f4b081463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b07fff700 1 -- 172.21.15.57:0/487824867 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b080b2470 con 0x7f4b080b4020 2021-06-25T04:52:44.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b07fff700 1 --2- 172.21.15.57:0/487824867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b080b4020 0x7f4b08061920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f4afc002f70 tx=0x7f4afc006df0).ready entity=mon.1 client_cookie=1d4c533f06a9acea server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:44.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b077fe700 1 -- 172.21.15.57:0/487824867 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4afc00d4a0 con 0x7f4b080b4020 2021-06-25T04:52:44.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b077fe700 1 -- 172.21.15.57:0/487824867 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc000e90 con 0x7f4b080b4020 2021-06-25T04:52:44.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b077fe700 1 -- 172.21.15.57:0/487824867 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4afc00d7f0 con 0x7f4b080b4020 2021-06-25T04:52:44.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/487824867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b080b4020 msgr2=0x7f4b08061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 --2- 172.21.15.57:0/487824867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b080b4020 0x7f4b08061920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f4afc002f70 tx=0x7f4afc006df0).stop 2021-06-25T04:52:44.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/487824867 shutdown_connections 2021-06-25T04:52:44.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 --2- 172.21.15.57:0/487824867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b080b4020 0x7f4b08061920 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 --2- 172.21.15.57:0/487824867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b080b6250 0x7f4b08061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/487824867 >> 172.21.15.57:0/487824867 conn(0x7f4b0805c450 msgr2=0x7f4b0805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:44.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/487824867 shutdown_connections 2021-06-25T04:52:44.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.303+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/487824867 wait complete. 2021-06-25T04:52:44.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b0dc2b700 1 Processor -- start 2021-06-25T04:52:44.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b0dc2b700 1 -- start start 2021-06-25T04:52:44.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b0dc2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b08061e10 0x7f4b080ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b0dc2b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b080b4020 0x7f4b080adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b0dc2b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b080b6250 0x7f4b08155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b0dc2b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08140dd0 con 0x7f4b08061e10 2021-06-25T04:52:44.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b0dc2b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08143af0 con 0x7f4b080b4020 2021-06-25T04:52:44.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b0dc2b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08155b80 con 0x7f4b080b6250 2021-06-25T04:52:44.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b080b4020 0x7f4b080adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b0cc29700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b08061e10 0x7f4b080ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b0d42a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b080b6250 0x7f4b08155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b07fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b080b4020 0x7f4b080adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:47240/0 (socket says 172.21.15.57:47240) 2021-06-25T04:52:44.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b07fff700 1 -- 172.21.15.57:0/3205389260 learned_addr learned my addr 172.21.15.57:0/3205389260 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:44.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b07fff700 1 -- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b080b6250 msgr2=0x7f4b08155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b07fff700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b080b6250 0x7f4b08155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b07fff700 1 -- 172.21.15.57:0/3205389260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b08061e10 msgr2=0x7f4b080ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b07fff700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b08061e10 0x7f4b080ad710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b07fff700 1 -- 172.21.15.57:0/3205389260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc00b180 con 0x7f4b080b4020 2021-06-25T04:52:44.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.307+0000 7f4b07fff700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b080b4020 0x7f4b080adc00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f4afc002f70 tx=0x7f4afc014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.311+0000 7f4b05ffb700 1 -- 172.21.15.57:0/3205389260 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4afc012930 con 0x7f4b080b4020 2021-06-25T04:52:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.311+0000 7f4b05ffb700 1 -- 172.21.15.57:0/3205389260 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc012a90 con 0x7f4b080b4020 2021-06-25T04:52:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.311+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/3205389260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b08143830 con 0x7f4b080b4020 2021-06-25T04:52:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.311+0000 7f4b05ffb700 1 -- 172.21.15.57:0/3205389260 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4afc012df0 con 0x7f4b080b4020 2021-06-25T04:52:44.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.311+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/3205389260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b08143490 con 0x7f4b080b4020 2021-06-25T04:52:44.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.311+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/3205389260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b08140f40 con 0x7f4b080b4020 2021-06-25T04:52:44.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.311+0000 7f4b05ffb700 1 -- 172.21.15.57:0/3205389260 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4afc025020 con 0x7f4b080b4020 2021-06-25T04:52:44.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.311+0000 7f4b05ffb700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ae8055510 0x7f4ae80579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.311+0000 7f4b05ffb700 1 -- 172.21.15.57:0/3205389260 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4afc06ef00 con 0x7f4b080b4020 2021-06-25T04:52:44.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.311+0000 7f4b0cc29700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ae8055510 0x7f4ae80579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.315+0000 7f4b0cc29700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ae8055510 0x7f4ae80579d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f4af800b000 tx=0x7f4af8006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:44.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.323+0000 7f4b05ffb700 1 -- 172.21.15.57:0/3205389260 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4afc045160 con 0x7f4b080b4020 2021-06-25T04:52:44.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.491+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/3205389260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4b08057310 con 0x7f4b080b4020 2021-06-25T04:52:44.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.651+0000 7f4b05ffb700 1 -- 172.21.15.57:0/3205389260 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4afc048780 con 0x7f4b080b4020 2021-06-25T04:52:44.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.655+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ae8055510 msgr2=0x7f4ae80579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.655+0000 7f4b0dc2b700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ae8055510 0x7f4ae80579d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f4af800b000 tx=0x7f4af8006df0).stop 2021-06-25T04:52:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.655+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b080b4020 msgr2=0x7f4b080adc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.655+0000 7f4b0dc2b700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b080b4020 0x7f4b080adc00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f4afc002f70 tx=0x7f4afc014000).stop 2021-06-25T04:52:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.655+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/3205389260 shutdown_connections 2021-06-25T04:52:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.655+0000 7f4b0dc2b700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ae8055510 0x7f4ae80579d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.655+0000 7f4b0dc2b700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b080b6250 0x7f4b08155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.655+0000 7f4b0dc2b700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b080b4020 0x7f4b080adc00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.655+0000 7f4b0dc2b700 1 --2- 172.21.15.57:0/3205389260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b08061e10 0x7f4b080ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.655+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/3205389260 >> 172.21.15.57:0/3205389260 conn(0x7f4b0805c450 msgr2=0x7f4b080b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.659+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/3205389260 shutdown_connections 2021-06-25T04:52:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.659+0000 7f4b0dc2b700 1 -- 172.21.15.57:0/3205389260 wait complete. 2021-06-25T04:52:44.678 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:52:44.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.787+0000 7feddb563700 1 Processor -- start 2021-06-25T04:52:44.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.787+0000 7feddb563700 1 -- start start 2021-06-25T04:52:44.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.787+0000 7feddb563700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fedd4064b60 0x7fedd40b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.787+0000 7feddb563700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fedd40b1f90 0x7fedd40619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.787+0000 7feddb563700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fedd4061eb0 0x7fedd40b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.787+0000 7feddb563700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd4066110 con 0x7fedd4061eb0 2021-06-25T04:52:44.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.787+0000 7feddb563700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd4064f40 con 0x7fedd4064b60 2021-06-25T04:52:44.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.787+0000 7feddb563700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4065880 con 0x7fedd40b1f90 2021-06-25T04:52:44.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.787+0000 7feddad62700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fedd4061eb0 0x7fedd40b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.787+0000 7feddad62700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fedd4061eb0 0x7fedd40b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38758/0 (socket says 172.21.15.57:38758) 2021-06-25T04:52:44.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.787+0000 7feddad62700 1 -- 172.21.15.57:0/1117314379 learned_addr learned my addr 172.21.15.57:0/1117314379 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:44.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7fedda561700 1 --2- 172.21.15.57:0/1117314379 >> v2:172.21.15.87:3300/0 conn(0x7fedd4064b60 0x7fedd40b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7fedd9d60700 1 --2- 172.21.15.57:0/1117314379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fedd40b1f90 0x7fedd40619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddad62700 1 -- 172.21.15.57:0/1117314379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fedd40b1f90 msgr2=0x7fedd40619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:44.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddad62700 1 --2- 172.21.15.57:0/1117314379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fedd40b1f90 0x7fedd40619c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddad62700 1 -- 172.21.15.57:0/1117314379 >> v2:172.21.15.87:3300/0 conn(0x7fedd4064b60 msgr2=0x7fedd40b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:44.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddad62700 1 --2- 172.21.15.57:0/1117314379 >> v2:172.21.15.87:3300/0 conn(0x7fedd4064b60 0x7fedd40b7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddad62700 1 -- 172.21.15.57:0/1117314379 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4066bc0 con 0x7fedd4061eb0 2021-06-25T04:52:44.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7fedda561700 1 --2- 172.21.15.57:0/1117314379 >> v2:172.21.15.87:3300/0 conn(0x7fedd4064b60 0x7fedd40b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:52:44.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddad62700 1 --2- 172.21.15.57:0/1117314379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedd4061eb0 0x7fedd40b2aa0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fedd40b45b0 tx=0x7fedcc009290).ready entity=mon.0 client_cookie=9af120edad8fb946 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:44.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7fedd955f700 1 -- 172.21.15.57:0/1117314379 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedcc00b7f0 con 0x7fedd4061eb0 2021-06-25T04:52:44.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7fedd955f700 1 -- 172.21.15.57:0/1117314379 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc00b950 con 0x7fedd4061eb0 2021-06-25T04:52:44.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7fedd955f700 1 -- 172.21.15.57:0/1117314379 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedcc00bac0 con 0x7fedd4061eb0 2021-06-25T04:52:44.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddb563700 1 -- 172.21.15.57:0/1117314379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedd4061eb0 msgr2=0x7fedd40b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddb563700 1 --2- 172.21.15.57:0/1117314379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedd4061eb0 0x7fedd40b2aa0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fedd40b45b0 tx=0x7fedcc009290).stop 2021-06-25T04:52:44.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddb563700 1 -- 172.21.15.57:0/1117314379 shutdown_connections 2021-06-25T04:52:44.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddb563700 1 --2- 172.21.15.57:0/1117314379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedd4061eb0 0x7fedd40b2aa0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddb563700 1 --2- 172.21.15.57:0/1117314379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fedd40b1f90 0x7fedd40619c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddb563700 1 --2- 172.21.15.57:0/1117314379 >> v2:172.21.15.87:3300/0 conn(0x7fedd4064b60 0x7fedd40b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddb563700 1 -- 172.21.15.57:0/1117314379 >> 172.21.15.57:0/1117314379 conn(0x7fedd4062ba0 msgr2=0x7fedd405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddb563700 1 -- 172.21.15.57:0/1117314379 shutdown_connections 2021-06-25T04:52:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.791+0000 7feddb563700 1 -- 172.21.15.57:0/1117314379 wait complete. 2021-06-25T04:52:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7feddb563700 1 Processor -- start 2021-06-25T04:52:44.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7feddb563700 1 -- start start 2021-06-25T04:52:44.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7feddb563700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd4061eb0 0x7fedd414b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7feddb563700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedd4064b60 0x7fedd40af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7feddb563700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fedd40b1f90 0x7fedd4156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7feddb563700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4145af0 con 0x7fedd4064b60 2021-06-25T04:52:44.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7feddb563700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd414c380 con 0x7fedd4061eb0 2021-06-25T04:52:44.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7feddb563700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd414be40 con 0x7fedd40b1f90 2021-06-25T04:52:44.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7fedd9d60700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedd4064b60 0x7fedd40af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7fedda561700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd4061eb0 0x7fedd414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7fedd9d60700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedd4064b60 0x7fedd40af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38762/0 (socket says 172.21.15.57:38762) 2021-06-25T04:52:44.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7fedd9d60700 1 -- 172.21.15.57:0/1678012039 learned_addr learned my addr 172.21.15.57:0/1678012039 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:44.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7feddad62700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fedd40b1f90 0x7fedd4156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7fedd9d60700 1 -- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fedd40b1f90 msgr2=0x7fedd4156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7fedd9d60700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fedd40b1f90 0x7fedd4156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7fedd9d60700 1 -- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd4061eb0 msgr2=0x7fedd414b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7fedd9d60700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd4061eb0 0x7fedd414b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7fedd9d60700 1 -- 172.21.15.57:0/1678012039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc009530 con 0x7fedd4064b60 2021-06-25T04:52:44.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.795+0000 7fedda561700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd4061eb0 0x7fedd414b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:52:44.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.799+0000 7fedd9d60700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedd4064b60 0x7fedd40af270 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fedd40b0170 tx=0x7fedc4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:44.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.799+0000 7fedc37fe700 1 -- 172.21.15.57:0/1678012039 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedc40104f0 con 0x7fedd4064b60 2021-06-25T04:52:44.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.799+0000 7fedc37fe700 1 -- 172.21.15.57:0/1678012039 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4010650 con 0x7fedd4064b60 2021-06-25T04:52:44.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.799+0000 7feddb563700 1 -- 172.21.15.57:0/1678012039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd414c0e0 con 0x7fedd4064b60 2021-06-25T04:52:44.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.799+0000 7fedc37fe700 1 -- 172.21.15.57:0/1678012039 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedc40109b0 con 0x7fedd4064b60 2021-06-25T04:52:44.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.799+0000 7feddb563700 1 -- 172.21.15.57:0/1678012039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd40afd90 con 0x7fedd4064b60 2021-06-25T04:52:44.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.799+0000 7feddb563700 1 -- 172.21.15.57:0/1678012039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd4057310 con 0x7fedd4064b60 2021-06-25T04:52:44.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.799+0000 7fedc37fe700 1 -- 172.21.15.57:0/1678012039 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fedc401a030 con 0x7fedd4064b60 2021-06-25T04:52:44.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.799+0000 7fedc37fe700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fedb4055450 0x7fedb4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:44.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.799+0000 7fedc37fe700 1 -- 172.21.15.57:0/1678012039 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fedc406dc00 con 0x7fedd4064b60 2021-06-25T04:52:44.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.799+0000 7fedda561700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fedb4055450 0x7fedb4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:44.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.803+0000 7fedda561700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fedb4055450 0x7fedb4057910 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fedd000c000 tx=0x7fedd0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:44.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.807+0000 7fedc37fe700 1 -- 172.21.15.57:0/1678012039 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fedc4073020 con 0x7fedd4064b60 2021-06-25T04:52:44.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.971+0000 7feddb563700 1 -- 172.21.15.57:0/1678012039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedd41599c0 con 0x7fedd4064b60 2021-06-25T04:52:44.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.971+0000 7fedc37fe700 1 -- 172.21.15.57:0/1678012039 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fedc4043d10 con 0x7fedd4064b60 2021-06-25T04:52:44.977 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:44.977 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4117950639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4117950639},{"type":"v1","addr":"172.21.15.87:6835","nonce":4117950639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5477,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3471432498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3471432498},{"type":"v1","addr":"172.21.15.57:6833","nonce":3471432498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:52:43.642049+0000","modified":"2021-06-25T04:52:44.644941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3818355049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3818355049},{"type":"v1","addr":"172.21.15.57:6835","nonce":3818355049}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-06-25T04:52:44.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 -- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fedb4055450 msgr2=0x7fedb4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fedb4055450 0x7fedb4057910 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fedd000c000 tx=0x7fedd0008040).stop 2021-06-25T04:52:44.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 -- 172.21.15.57:0/1678012039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedd4064b60 msgr2=0x7fedd40af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:44.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedd4064b60 0x7fedd40af270 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fedd40b0170 tx=0x7fedc4008040).stop 2021-06-25T04:52:44.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 -- 172.21.15.57:0/1678012039 shutdown_connections 2021-06-25T04:52:44.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fedb4055450 0x7fedb4057910 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fedd40b1f90 0x7fedd4156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedd4064b60 0x7fedd40af270 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 --2- 172.21.15.57:0/1678012039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedd4061eb0 0x7fedd414b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:44.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 -- 172.21.15.57:0/1678012039 >> 172.21.15.57:0/1678012039 conn(0x7fedd4062ba0 msgr2=0x7fedd405cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:44.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 -- 172.21.15.57:0/1678012039 shutdown_connections 2021-06-25T04:52:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:44.975+0000 7feddb563700 1 -- 172.21.15.57:0/1678012039 wait complete. 2021-06-25T04:52:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 31 2021-06-25T04:52:44.989 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:52:45.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd53fff700 1 Processor -- start 2021-06-25T04:52:45.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd53fff700 1 -- start start 2021-06-25T04:52:45.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd53fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540ad220 0x7fdd540ab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd53fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdd541480e0 0x7fdd540ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd53fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd540ad600 con 0x7fdd540afe20 2021-06-25T04:52:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd53fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd540ab980 con 0x7fdd541480e0 2021-06-25T04:52:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd53fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54147480 con 0x7fdd540ad220 2021-06-25T04:52:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd527fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdd540afe20 0x7fdd541479d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55986/0 (socket says 172.21.15.57:55986) 2021-06-25T04:52:45.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd527fc700 1 -- 172.21.15.57:0/49686404 learned_addr learned my addr 172.21.15.57:0/49686404 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:45.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd537fe700 1 --2- 172.21.15.57:0/49686404 >> v2:172.21.15.87:3300/0 conn(0x7fdd541480e0 0x7fdd540ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd52ffd700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540ad220 0x7fdd540ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730073263 0 0) 0x7fdd540ad600 con 0x7fdd540afe20 2021-06-25T04:52:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd38003260 con 0x7fdd540afe20 2021-06-25T04:52:45.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1371685026 0 0) 0x7fdd38003260 con 0x7fdd540afe20 2021-06-25T04:52:45.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540ad220 msgr2=0x7fdd540ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:45.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540ad220 0x7fdd540ab490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 >> v2:172.21.15.87:3300/0 conn(0x7fdd541480e0 msgr2=0x7fdd540ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:45.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 --2- 172.21.15.57:0/49686404 >> v2:172.21.15.87:3300/0 conn(0x7fdd541480e0 0x7fdd540ac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540b0440 con 0x7fdd540afe20 2021-06-25T04:52:45.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fdd48001660 con 0x7fdd540afe20 2021-06-25T04:52:45.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 >> v1:172.21.15.57:6789/0 conn(0x7fdd540afe20 legacy=0x7fdd541479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd38003750 0x7fdd38003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540ad220 0x7fdd38004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd380049f0 0x7fdd38004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540ab980 con 0x7fdd380049f0 2021-06-25T04:52:45.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54147480 con 0x7fdd38003750 2021-06-25T04:52:45.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3800b750 con 0x7fdd540ad220 2021-06-25T04:52:45.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd537fe700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd380049f0 0x7fdd38004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd527fc700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540ad220 0x7fdd38004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd52ffd700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd38003750 0x7fdd38003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd527fc700 1 -- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd38003750 msgr2=0x7fdd38003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:45.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd527fc700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd38003750 0x7fdd38003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd527fc700 1 -- 172.21.15.57:0/49686404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd380049f0 msgr2=0x7fdd38004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:45.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd527fc700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd380049f0 0x7fdd38004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd527fc700 1 -- 172.21.15.57:0/49686404 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd38003260 con 0x7fdd540ad220 2021-06-25T04:52:45.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd527fc700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540ad220 0x7fdd38004500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fdd540b2ee0 tx=0x7fdd540b3090).ready entity=mon.2 client_cookie=71814137f3be3edc server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:45.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd480070d0 con 0x7fdd540ad220 2021-06-25T04:52:45.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48007230 con 0x7fdd540ad220 2021-06-25T04:52:45.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd51ffb700 1 -- 172.21.15.57:0/49686404 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd4800c8f0 con 0x7fdd540ad220 2021-06-25T04:52:45.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd53fff700 1 -- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540ad220 msgr2=0x7fdd38004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd53fff700 1 --2- 172.21.15.57:0/49686404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540ad220 0x7fdd38004500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fdd540b2ee0 tx=0x7fdd540b3090).stop 2021-06-25T04:52:45.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.095+0000 7fdd537fe700 1 -- 172.21.15.57:0/49686404 reap_dead start 2021-06-25T04:52:45.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.099+0000 7fdd53fff700 1 -- 172.21.15.57:0/49686404 shutdown_connections 2021-06-25T04:52:45.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.099+0000 7fdd53fff700 1 -- 172.21.15.57:0/49686404 >> 172.21.15.57:0/49686404 conn(0x7fdd540611f0 msgr2=0x7fdd54062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:45.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.099+0000 7fdd53fff700 1 -- 172.21.15.57:0/49686404 shutdown_connections 2021-06-25T04:52:45.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.099+0000 7fdd53fff700 1 -- 172.21.15.57:0/49686404 wait complete. 2021-06-25T04:52:45.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.099+0000 7fdd53fff700 1 Processor -- start 2021-06-25T04:52:45.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.099+0000 7fdd53fff700 1 -- start start 2021-06-25T04:52:45.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd53fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd5414df20 0x7fdd541446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd53fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540b4960 0x7fdd54144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd53fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd540b60f0 0x7fdd540b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd53fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54145080 con 0x7fdd5414df20 2021-06-25T04:52:45.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd53fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5414e300 con 0x7fdd540b60f0 2021-06-25T04:52:45.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd53fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540b4ee0 con 0x7fdd540b4960 2021-06-25T04:52:45.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd52ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd5414df20 0x7fdd541446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd52ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd5414df20 0x7fdd541446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38780/0 (socket says 172.21.15.57:38780) 2021-06-25T04:52:45.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd52ffd700 1 -- 172.21.15.57:0/2427709825 learned_addr learned my addr 172.21.15.57:0/2427709825 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:45.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd527fc700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540b4960 0x7fdd54144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd537fe700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd540b60f0 0x7fdd540b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd52ffd700 1 -- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540b4960 msgr2=0x7fdd54144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd52ffd700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540b4960 0x7fdd54144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd52ffd700 1 -- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd540b60f0 msgr2=0x7fdd540b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd52ffd700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd540b60f0 0x7fdd540b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd52ffd700 1 -- 172.21.15.57:0/2427709825 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540b5600 con 0x7fdd5414df20 2021-06-25T04:52:45.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd537fe700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd540b60f0 0x7fdd540b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:52:45.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd52ffd700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd5414df20 0x7fdd541446a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fdd4400b000 tx=0x7fdd440091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:45.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd43fff700 1 -- 172.21.15.57:0/2427709825 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd44011e40 con 0x7fdd5414df20 2021-06-25T04:52:45.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd53fff700 1 -- 172.21.15.57:0/2427709825 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd540b58a0 con 0x7fdd5414df20 2021-06-25T04:52:45.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd43fff700 1 -- 172.21.15.57:0/2427709825 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4400fcd0 con 0x7fdd5414df20 2021-06-25T04:52:45.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd43fff700 1 -- 172.21.15.57:0/2427709825 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd4400fe40 con 0x7fdd5414df20 2021-06-25T04:52:45.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.103+0000 7fdd53fff700 1 -- 172.21.15.57:0/2427709825 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd540b5d40 con 0x7fdd5414df20 2021-06-25T04:52:45.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.107+0000 7fdd53fff700 1 -- 172.21.15.57:0/2427709825 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd540b5a30 con 0x7fdd5414df20 2021-06-25T04:52:45.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.107+0000 7fdd43fff700 1 -- 172.21.15.57:0/2427709825 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdd44024070 con 0x7fdd5414df20 2021-06-25T04:52:45.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.107+0000 7fdd43fff700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd300553d0 0x7fdd30057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.107+0000 7fdd43fff700 1 -- 172.21.15.57:0/2427709825 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdd4406ee30 con 0x7fdd5414df20 2021-06-25T04:52:45.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.107+0000 7fdd527fc700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd300553d0 0x7fdd30057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.107+0000 7fdd527fc700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd300553d0 0x7fdd30057890 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fdd48019000 tx=0x7fdd48013000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:45.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.111+0000 7fdd43fff700 1 -- 172.21.15.57:0/2427709825 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdd44044e50 con 0x7fdd5414df20 2021-06-25T04:52:45.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.243+0000 7fdd53fff700 1 -- 172.21.15.57:0/2427709825 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd54057310 con 0x7fdd5414df20 2021-06-25T04:52:45.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.243+0000 7fdd43fff700 1 -- 172.21.15.57:0/2427709825 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16287 (secure 0 0 0) 0x7fdd44048470 con 0x7fdd5414df20 2021-06-25T04:52:45.248 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:45.248 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":67,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:52:44.645743+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:52:41.803683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-06-25T04:52:42.643832+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:52:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 -- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd300553d0 msgr2=0x7fdd30057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd300553d0 0x7fdd30057890 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fdd48019000 tx=0x7fdd48013000).stop 2021-06-25T04:52:45.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 -- 172.21.15.57:0/2427709825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd5414df20 msgr2=0x7fdd541446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd5414df20 0x7fdd541446a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fdd4400b000 tx=0x7fdd440091d0).stop 2021-06-25T04:52:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 -- 172.21.15.57:0/2427709825 shutdown_connections 2021-06-25T04:52:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd300553d0 0x7fdd30057890 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd540b60f0 0x7fdd540b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd540b4960 0x7fdd54144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 --2- 172.21.15.57:0/2427709825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd5414df20 0x7fdd541446a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 -- 172.21.15.57:0/2427709825 >> 172.21.15.57:0/2427709825 conn(0x7fdd540611f0 msgr2=0x7fdd5414a810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 -- 172.21.15.57:0/2427709825 shutdown_connections 2021-06-25T04:52:45.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.247+0000 7fdd53fff700 1 -- 172.21.15.57:0/2427709825 wait complete. 2021-06-25T04:52:45.262 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:52:45.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f308388a700 1 Processor -- start 2021-06-25T04:52:45.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f308388a700 1 -- start start 2021-06-25T04:52:45.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f308388a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f307c0672c0 0x7f307c1438b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f308388a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f307c143da0 0x7f307c14b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f308388a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307c0aab70 con 0x7f307c0600c0 2021-06-25T04:52:45.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f308388a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307c0604a0 con 0x7f307c0672c0 2021-06-25T04:52:45.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f308388a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307c066e60 con 0x7f307c143da0 2021-06-25T04:52:45.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f3081626700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f307c0600c0 0x7f307c0b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56006/0 (socket says 172.21.15.57:56006) 2021-06-25T04:52:45.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f3081626700 1 -- 172.21.15.57:0/2760028899 learned_addr learned my addr 172.21.15.57:0/2760028899 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:45.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f3080e25700 1 --2- 172.21.15.57:0/2760028899 >> v2:172.21.15.87:3300/0 conn(0x7f307c0672c0 0x7f307c1438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f3081e27700 1 --2- 172.21.15.57:0/2760028899 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f307c143da0 0x7f307c14b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f3073fff700 1 -- 172.21.15.57:0/2760028899 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430616701 0 0) 0x7f307c0aab70 con 0x7f307c0600c0 2021-06-25T04:52:45.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f3073fff700 1 -- 172.21.15.57:0/2760028899 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3060003260 con 0x7f307c0600c0 2021-06-25T04:52:45.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f3073fff700 1 -- 172.21.15.57:0/2760028899 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3454819131 0 0) 0x7f3060003260 con 0x7f307c0600c0 2021-06-25T04:52:45.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f3080e25700 1 -- 172.21.15.57:0/2760028899 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f307c143da0 msgr2=0x7f307c14b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:45.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f3080e25700 1 --2- 172.21.15.57:0/2760028899 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f307c143da0 0x7f307c14b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f3080e25700 1 -- 172.21.15.57:0/2760028899 >> v1:172.21.15.57:6789/0 conn(0x7f307c0600c0 legacy=0x7f307c0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.363+0000 7f3080e25700 1 -- 172.21.15.57:0/2760028899 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c0b3370 con 0x7f307c0672c0 2021-06-25T04:52:45.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f3080e25700 1 --2- 172.21.15.57:0/2760028899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f307c0672c0 0x7f307c1438b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f3078001800 tx=0x7f306c006df0).ready entity=mon.1 client_cookie=223e05c3a2e15b6f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:45.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f3073fff700 1 -- 172.21.15.57:0/2760028899 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3078001660 con 0x7f307c0672c0 2021-06-25T04:52:45.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f3073fff700 1 -- 172.21.15.57:0/2760028899 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c000e90 con 0x7f307c0672c0 2021-06-25T04:52:45.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f3073fff700 1 -- 172.21.15.57:0/2760028899 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f306c012460 con 0x7f307c0672c0 2021-06-25T04:52:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f308388a700 1 -- 172.21.15.57:0/2760028899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f307c0672c0 msgr2=0x7f307c1438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f308388a700 1 --2- 172.21.15.57:0/2760028899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f307c0672c0 0x7f307c1438b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f3078001800 tx=0x7f306c006df0).stop 2021-06-25T04:52:45.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f308388a700 1 -- 172.21.15.57:0/2760028899 shutdown_connections 2021-06-25T04:52:45.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f308388a700 1 --2- 172.21.15.57:0/2760028899 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f307c143da0 0x7f307c14b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f308388a700 1 --2- 172.21.15.57:0/2760028899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f307c0672c0 0x7f307c1438b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f308388a700 1 -- 172.21.15.57:0/2760028899 >> 172.21.15.57:0/2760028899 conn(0x7f307c05cef0 msgr2=0x7f307c05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:45.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f308388a700 1 -- 172.21.15.57:0/2760028899 shutdown_connections 2021-06-25T04:52:45.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f308388a700 1 -- 172.21.15.57:0/2760028899 wait complete. 2021-06-25T04:52:45.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f308388a700 1 Processor -- start 2021-06-25T04:52:45.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.367+0000 7f308388a700 1 -- start start 2021-06-25T04:52:45.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f308388a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f307c0600c0 0x7f307c061a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f308388a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f307c0672c0 0x7f307c0ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f308388a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f307c143da0 0x7f307c155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f308388a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c156450 con 0x7f307c0672c0 2021-06-25T04:52:45.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f308388a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c061310 con 0x7f307c0600c0 2021-06-25T04:52:45.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f308388a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307c0615b0 con 0x7f307c143da0 2021-06-25T04:52:45.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f3080e25700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f307c0672c0 0x7f307c0ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f3080e25700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f307c0672c0 0x7f307c0ac320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38796/0 (socket says 172.21.15.57:38796) 2021-06-25T04:52:45.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f3080e25700 1 -- 172.21.15.57:0/1971440053 learned_addr learned my addr 172.21.15.57:0/1971440053 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:45.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f3081e27700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f307c143da0 0x7f307c155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f3081626700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f307c0600c0 0x7f307c061a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f3080e25700 1 -- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f307c143da0 msgr2=0x7f307c155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f3080e25700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f307c143da0 0x7f307c155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f3080e25700 1 -- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f307c0600c0 msgr2=0x7f307c061a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f3080e25700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f307c0600c0 0x7f307c061a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f3080e25700 1 -- 172.21.15.57:0/1971440053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c00b180 con 0x7f307c0672c0 2021-06-25T04:52:45.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f3080e25700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f307c0672c0 0x7f307c0ac320 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f3078001800 tx=0x7f306c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:45.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f30727fc700 1 -- 172.21.15.57:0/1971440053 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f306c00d8a0 con 0x7f307c0672c0 2021-06-25T04:52:45.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f30727fc700 1 -- 172.21.15.57:0/1971440053 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c00da00 con 0x7f307c0672c0 2021-06-25T04:52:45.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f308388a700 1 -- 172.21.15.57:0/1971440053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307c061f40 con 0x7f307c0672c0 2021-06-25T04:52:45.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f30727fc700 1 -- 172.21.15.57:0/1971440053 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f306c00dd60 con 0x7f307c0672c0 2021-06-25T04:52:45.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.371+0000 7f308388a700 1 -- 172.21.15.57:0/1971440053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307c0ac810 con 0x7f307c0672c0 2021-06-25T04:52:45.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.375+0000 7f308388a700 1 -- 172.21.15.57:0/1971440053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307c057310 con 0x7f307c0672c0 2021-06-25T04:52:45.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.375+0000 7f30727fc700 1 -- 172.21.15.57:0/1971440053 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f306c025020 con 0x7f307c0672c0 2021-06-25T04:52:45.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.375+0000 7f30727fc700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3064055450 0x7f3064057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.375+0000 7f30727fc700 1 -- 172.21.15.57:0/1971440053 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f306c06ed60 con 0x7f307c0672c0 2021-06-25T04:52:45.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.375+0000 7f3081626700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3064055450 0x7f3064057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.375+0000 7f3081626700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3064055450 0x7f3064057910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f307800d000 tx=0x7f3078001e40).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:45.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.379+0000 7f30727fc700 1 -- 172.21.15.57:0/1971440053 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f306c044e00 con 0x7f307c0672c0 2021-06-25T04:52:45.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.547+0000 7f308388a700 1 -- 172.21.15.57:0/1971440053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f307c156620 con 0x7f307c0672c0 2021-06-25T04:52:45.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.559+0000 7f30727fc700 1 -- 172.21.15.57:0/1971440053 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f306c048420 con 0x7f307c0672c0 2021-06-25T04:52:45.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 -- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3064055450 msgr2=0x7f3064057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3064055450 0x7f3064057910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f307800d000 tx=0x7f3078001e40).stop 2021-06-25T04:52:45.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 -- 172.21.15.57:0/1971440053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f307c0672c0 msgr2=0x7f307c0ac320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f307c0672c0 0x7f307c0ac320 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f3078001800 tx=0x7f306c014000).stop 2021-06-25T04:52:45.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 -- 172.21.15.57:0/1971440053 shutdown_connections 2021-06-25T04:52:45.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3064055450 0x7f3064057910 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f307c143da0 0x7f307c155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f307c0672c0 0x7f307c0ac320 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 --2- 172.21.15.57:0/1971440053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f307c0600c0 0x7f307c061a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 -- 172.21.15.57:0/1971440053 >> 172.21.15.57:0/1971440053 conn(0x7f307c05cef0 msgr2=0x7f307c0b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:45.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 -- 172.21.15.57:0/1971440053 shutdown_connections 2021-06-25T04:52:45.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.563+0000 7f308388a700 1 -- 172.21.15.57:0/1971440053 wait complete. 2021-06-25T04:52:45.569 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:52:45.580 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:52:45.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8ee0ad3700 1 Processor -- start 2021-06-25T04:52:45.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8ee0ad3700 1 -- start start 2021-06-25T04:52:45.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8ee0ad3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8edc0b6540 0x7f8edc0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8ee0ad3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 0x7f8edc0b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8ee0ad3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc144070 con 0x7f8edc061cf0 2021-06-25T04:52:45.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8ee0ad3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8edc0b6e10 con 0x7f8edc0b6540 2021-06-25T04:52:45.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8ee0ad3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc143b30 con 0x7f8edc0b4380 2021-06-25T04:52:45.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8eda59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8edc0b6540 0x7f8edc0b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8edad9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8edc061cf0 0x7f8edc146680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56024/0 (socket says 172.21.15.57:56024) 2021-06-25T04:52:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8edad9d700 1 -- 172.21.15.57:0/1536039406 learned_addr learned my addr 172.21.15.57:0/1536039406 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8eda59c700 1 --2- 172.21.15.57:0/1536039406 >> v2:172.21.15.57:3300/0 conn(0x7f8edc0b6540 0x7f8edc0b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38802/0 (socket says 172.21.15.57:38802) 2021-06-25T04:52:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8ed9d9b700 1 --2- 172.21.15.57:0/1536039406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 0x7f8edc0b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.683+0000 7f8eda59c700 1 -- 172.21.15.57:0/1536039406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 msgr2=0x7f8edc0b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8eda59c700 1 --2- 172.21.15.57:0/1536039406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 0x7f8edc0b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8eda59c700 1 -- 172.21.15.57:0/1536039406 >> v1:172.21.15.57:6789/0 conn(0x7f8edc061cf0 legacy=0x7f8edc146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8eda59c700 1 -- 172.21.15.57:0/1536039406 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc143dd0 con 0x7f8edc0b6540 2021-06-25T04:52:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ed959a700 1 -- 172.21.15.57:0/1536039406 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120267530 0 0) 0x7f8edc144070 con 0x7f8edc061cf0 2021-06-25T04:52:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ed9d9b700 1 --2- 172.21.15.57:0/1536039406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 0x7f8edc0b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:52:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8eda59c700 1 --2- 172.21.15.57:0/1536039406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8edc0b6540 0x7f8edc0b5bb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f8ed40032f0 tx=0x7f8ed40091d0).ready entity=mon.0 client_cookie=e48c1d91c3a5bd20 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ed959a700 1 -- 172.21.15.57:0/1536039406 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ed4009ea0 con 0x7f8edc0b6540 2021-06-25T04:52:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ed959a700 1 -- 172.21.15.57:0/1536039406 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed400b8a0 con 0x7f8edc0b6540 2021-06-25T04:52:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ed959a700 1 -- 172.21.15.57:0/1536039406 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ed400ba10 con 0x7f8edc0b6540 2021-06-25T04:52:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/1536039406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8edc0b6540 msgr2=0x7f8edc0b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ee0ad3700 1 --2- 172.21.15.57:0/1536039406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8edc0b6540 0x7f8edc0b5bb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f8ed40032f0 tx=0x7f8ed40091d0).stop 2021-06-25T04:52:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/1536039406 shutdown_connections 2021-06-25T04:52:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ee0ad3700 1 --2- 172.21.15.57:0/1536039406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 0x7f8edc0b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ee0ad3700 1 --2- 172.21.15.57:0/1536039406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8edc0b6540 0x7f8edc0b5bb0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/1536039406 >> 172.21.15.57:0/1536039406 conn(0x7f8edc05c450 msgr2=0x7f8edc05c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/1536039406 shutdown_connections 2021-06-25T04:52:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/1536039406 wait complete. 2021-06-25T04:52:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ee0ad3700 1 Processor -- start 2021-06-25T04:52:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.687+0000 7f8ee0ad3700 1 -- start start 2021-06-25T04:52:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ee0ad3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc061cf0 0x7f8edc12bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ee0ad3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 0x7f8edc155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ee0ad3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8edc0b6540 0x7f8edc0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ee0ad3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc12af70 con 0x7f8edc0b6540 2021-06-25T04:52:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ee0ad3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc12c2a0 con 0x7f8edc061cf0 2021-06-25T04:52:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ee0ad3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc129be0 con 0x7f8edc0b4380 2021-06-25T04:52:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8edad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8edc0b6540 0x7f8edc0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8edad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8edc0b6540 0x7f8edc0b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38812/0 (socket says 172.21.15.57:38812) 2021-06-25T04:52:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8edad9d700 1 -- 172.21.15.57:0/3787488599 learned_addr learned my addr 172.21.15.57:0/3787488599 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8eda59c700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc061cf0 0x7f8edc12bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ed9d9b700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 0x7f8edc155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8edad9d700 1 -- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 msgr2=0x7f8edc155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8edad9d700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 0x7f8edc155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8edad9d700 1 -- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc061cf0 msgr2=0x7f8edc12bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8edad9d700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc061cf0 0x7f8edc12bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8edad9d700 1 -- 172.21.15.57:0/3787488599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed4009470 con 0x7f8edc0b6540 2021-06-25T04:52:45.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ed9d9b700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 0x7f8edc155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:52:45.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8edad9d700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8edc0b6540 0x7f8edc0b3300 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f8ecc000ed0 tx=0x7f8ecc007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:45.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ecb7fe700 1 -- 172.21.15.57:0/3787488599 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ecc0070d0 con 0x7f8edc0b6540 2021-06-25T04:52:45.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ecb7fe700 1 -- 172.21.15.57:0/3787488599 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc007230 con 0x7f8edc0b6540 2021-06-25T04:52:45.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/3787488599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc129e80 con 0x7f8edc0b6540 2021-06-25T04:52:45.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ecb7fe700 1 -- 172.21.15.57:0/3787488599 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ecc005610 con 0x7f8edc0b6540 2021-06-25T04:52:45.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.691+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/3787488599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc156200 con 0x7f8edc0b6540 2021-06-25T04:52:45.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.695+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/3787488599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc13b3a0 con 0x7f8edc0b6540 2021-06-25T04:52:45.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.695+0000 7f8ecb7fe700 1 -- 172.21.15.57:0/3787488599 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8ecc01a060 con 0x7f8edc0b6540 2021-06-25T04:52:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.695+0000 7f8ecb7fe700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8eb80553f0 0x7f8eb80578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.695+0000 7f8ecb7fe700 1 -- 172.21.15.57:0/3787488599 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8ecc06d680 con 0x7f8edc0b6540 2021-06-25T04:52:45.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.695+0000 7f8eda59c700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8eb80553f0 0x7f8eb80578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.695+0000 7f8eda59c700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8eb80553f0 0x7f8eb80578b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f8ed401b000 tx=0x7f8ed4016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.699+0000 7f8ecb7fe700 1 -- 172.21.15.57:0/3787488599 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8ecc043830 con 0x7f8edc0b6540 2021-06-25T04:52:45.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.863+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/3787488599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8edc057310 con 0x7f8edc0b6540 2021-06-25T04:52:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ecb7fe700 1 -- 172.21.15.57:0/3787488599 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8ecc018070 con 0x7f8edc0b6540 2021-06-25T04:52:45.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8eb80553f0 msgr2=0x7f8eb80578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8eb80553f0 0x7f8eb80578b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f8ed401b000 tx=0x7f8ed4016000).stop 2021-06-25T04:52:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/3787488599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8edc0b6540 msgr2=0x7f8edc0b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8edc0b6540 0x7f8edc0b3300 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f8ecc000ed0 tx=0x7f8ecc007a20).stop 2021-06-25T04:52:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/3787488599 shutdown_connections 2021-06-25T04:52:45.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8eb80553f0 0x7f8eb80578b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8edc0b6540 0x7f8edc0b3300 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8edc0b4380 0x7f8edc155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 --2- 172.21.15.57:0/3787488599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc061cf0 0x7f8edc12bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/3787488599 >> 172.21.15.57:0/3787488599 conn(0x7f8edc05c450 msgr2=0x7f8edc1282d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:45.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/3787488599 shutdown_connections 2021-06-25T04:52:45.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.871+0000 7f8ee0ad3700 1 -- 172.21.15.57:0/3787488599 wait complete. 2021-06-25T04:52:45.879 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:52:45.887 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:52:45.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 Processor -- start 2021-06-25T04:52:45.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 -- start start 2021-06-25T04:52:45.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d1c0b2810 0x7f8d1c13e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d1c0afc60 0x7f8d1c13e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8d1c0af0f0 0x7f8d1c1444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c067190 con 0x7f8d1c0af0f0 2021-06-25T04:52:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c0b2bf0 con 0x7f8d1c0afc60 2021-06-25T04:52:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c0673c0 con 0x7f8d1c0b2810 2021-06-25T04:52:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8d1c0af0f0 0x7f8d1c1444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8d1c0af0f0 0x7f8d1c1444c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38820/0 (socket says 172.21.15.57:38820) 2021-06-25T04:52:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1ad9d700 1 -- 172.21.15.57:0/3637061027 learned_addr learned my addr 172.21.15.57:0/3637061027 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d19d9b700 1 --2- 172.21.15.57:0/3637061027 >> v2:172.21.15.87:3300/0 conn(0x7f8d1c0afc60 0x7f8d1c13e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1a59c700 1 --2- 172.21.15.57:0/3637061027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d1c0b2810 0x7f8d1c13e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1ad9d700 1 -- 172.21.15.57:0/3637061027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d1c0b2810 msgr2=0x7f8d1c13e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1ad9d700 1 --2- 172.21.15.57:0/3637061027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d1c0b2810 0x7f8d1c13e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1ad9d700 1 -- 172.21.15.57:0/3637061027 >> v2:172.21.15.87:3300/0 conn(0x7f8d1c0afc60 msgr2=0x7f8d1c13e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:45.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1ad9d700 1 --2- 172.21.15.57:0/3637061027 >> v2:172.21.15.87:3300/0 conn(0x7f8d1c0afc60 0x7f8d1c13e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:45.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1ad9d700 1 -- 172.21.15.57:0/3637061027 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c067660 con 0x7f8d1c0af0f0 2021-06-25T04:52:45.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1ad9d700 1 --2- 172.21.15.57:0/3637061027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d1c0af0f0 0x7f8d1c1444c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f8d14002f70 tx=0x7f8d14006eb0).ready entity=mon.0 client_cookie=6700712680091a87 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:45.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1959a700 1 -- 172.21.15.57:0/3637061027 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d1400d570 con 0x7f8d1c0af0f0 2021-06-25T04:52:45.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1959a700 1 -- 172.21.15.57:0/3637061027 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d14000e90 con 0x7f8d1c0af0f0 2021-06-25T04:52:45.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1959a700 1 -- 172.21.15.57:0/3637061027 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d1400d900 con 0x7f8d1c0af0f0 2021-06-25T04:52:45.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3637061027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d1c0af0f0 msgr2=0x7f8d1c1444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:45.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 --2- 172.21.15.57:0/3637061027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d1c0af0f0 0x7f8d1c1444c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f8d14002f70 tx=0x7f8d14006eb0).stop 2021-06-25T04:52:45.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3637061027 shutdown_connections 2021-06-25T04:52:45.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 --2- 172.21.15.57:0/3637061027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d1c0af0f0 0x7f8d1c1444c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 --2- 172.21.15.57:0/3637061027 >> v2:172.21.15.87:3300/0 conn(0x7f8d1c0afc60 0x7f8d1c13e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.983+0000 7f8d1b59e700 1 --2- 172.21.15.57:0/3637061027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d1c0b2810 0x7f8d1c13e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3637061027 >> 172.21.15.57:0/3637061027 conn(0x7f8d1c0611f0 msgr2=0x7f8d1c062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:46.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3637061027 shutdown_connections 2021-06-25T04:52:46.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3637061027 wait complete. 2021-06-25T04:52:46.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 Processor -- start 2021-06-25T04:52:46.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 -- start start 2021-06-25T04:52:46.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d1c0af0f0 0x7f8d1c0ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d1c0afc60 0x7f8d1c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d1c0b2810 0x7f8d1c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c0b6650 con 0x7f8d1c0afc60 2021-06-25T04:52:46.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c145250 con 0x7f8d1c0b2810 2021-06-25T04:52:46.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c140f90 con 0x7f8d1c0af0f0 2021-06-25T04:52:46.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d19d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d1c0afc60 0x7f8d1c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d19d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d1c0afc60 0x7f8d1c0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38824/0 (socket says 172.21.15.57:38824) 2021-06-25T04:52:46.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d19d9b700 1 -- 172.21.15.57:0/3898227447 learned_addr learned my addr 172.21.15.57:0/3898227447 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:46.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1ad9d700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d1c0b2810 0x7f8d1c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1a59c700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d1c0af0f0 0x7f8d1c0ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d19d9b700 1 -- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d1c0af0f0 msgr2=0x7f8d1c0ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:46.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d19d9b700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d1c0af0f0 0x7f8d1c0ada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d19d9b700 1 -- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d1c0b2810 msgr2=0x7f8d1c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:46.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d19d9b700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d1c0b2810 0x7f8d1c0b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d19d9b700 1 -- 172.21.15.57:0/3898227447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1400b1e0 con 0x7f8d1c0afc60 2021-06-25T04:52:46.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d19d9b700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d1c0afc60 0x7f8d1c0b43f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f8d0c00c000 tx=0x7f8d0c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:46.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d137fe700 1 -- 172.21.15.57:0/3898227447 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d0c00c6a0 con 0x7f8d1c0afc60 2021-06-25T04:52:46.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d137fe700 1 -- 172.21.15.57:0/3898227447 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c00c800 con 0x7f8d1c0afc60 2021-06-25T04:52:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3898227447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1c0b63b0 con 0x7f8d1c0afc60 2021-06-25T04:52:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d137fe700 1 -- 172.21.15.57:0/3898227447 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d0c00cb60 con 0x7f8d1c0afc60 2021-06-25T04:52:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.987+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3898227447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c0b4dd0 con 0x7f8d1c0afc60 2021-06-25T04:52:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.991+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3898227447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c057310 con 0x7f8d1c0afc60 2021-06-25T04:52:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.991+0000 7f8d137fe700 1 -- 172.21.15.57:0/3898227447 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8d0c022070 con 0x7f8d1c0afc60 2021-06-25T04:52:46.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.991+0000 7f8d137fe700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d00055450 0x7f8d00057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.991+0000 7f8d137fe700 1 -- 172.21.15.57:0/3898227447 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8d0c06e620 con 0x7f8d1c0afc60 2021-06-25T04:52:46.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.991+0000 7f8d1a59c700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d00055450 0x7f8d00057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.991+0000 7f8d1a59c700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d00055450 0x7f8d00057910 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8d0400c000 tx=0x7f8d04008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:46.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:45.995+0000 7f8d137fe700 1 -- 172.21.15.57:0/3898227447 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8d0c0446c0 con 0x7f8d1c0afc60 2021-06-25T04:52:46.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3898227447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d1c0ace10 con 0x7f8d1c0afc60 2021-06-25T04:52:46.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d137fe700 1 -- 172.21.15.57:0/3898227447 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f8d0c047ce0 con 0x7f8d1c0afc60 2021-06-25T04:52:46.159 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:46.159 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4117950639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4117950639},{"type":"v1","addr":"172.21.15.87:6835","nonce":4117950639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5477,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3471432498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3471432498},{"type":"v1","addr":"172.21.15.57:6833","nonce":3471432498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:52:43.642049+0000","modified":"2021-06-25T04:52:44.644941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3818355049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3818355049},{"type":"v1","addr":"172.21.15.57:6835","nonce":3818355049}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-06-25T04:52:46.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d00055450 msgr2=0x7f8d00057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:46.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d00055450 0x7f8d00057910 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8d0400c000 tx=0x7f8d04008040).stop 2021-06-25T04:52:46.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3898227447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d1c0afc60 msgr2=0x7f8d1c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:46.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d1c0afc60 0x7f8d1c0b43f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f8d0c00c000 tx=0x7f8d0c0091d0).stop 2021-06-25T04:52:46.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3898227447 shutdown_connections 2021-06-25T04:52:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d00055450 0x7f8d00057910 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d1c0b2810 0x7f8d1c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d1c0afc60 0x7f8d1c0b43f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 --2- 172.21.15.57:0/3898227447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d1c0af0f0 0x7f8d1c0ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3898227447 >> 172.21.15.57:0/3898227447 conn(0x7f8d1c0611f0 msgr2=0x7f8d1c060060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:46.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3898227447 shutdown_connections 2021-06-25T04:52:46.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.155+0000 7f8d1b59e700 1 -- 172.21.15.57:0/3898227447 wait complete. 2021-06-25T04:52:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 31 2021-06-25T04:52:46.478 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:52:43.642049+0000', 'modified': '2021-06-25T04:52:44.644941+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5985}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5985': {'gid': 5985, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/3818355049', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 3818355049}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3818355049}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:52:46.479 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:52:46.480 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:52:46.603 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":5985,"want_state":"up:active","state":"up:active","rank_uptime":2.9489897979999999,"mdsmap_epoch":31,"osdmap_epoch":68,"osdmap_epoch_barrier":66,"uptime":7.5766280689999999} 2021-06-25T04:52:46.604 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 5985, "mdsmap_epoch": 31, "osdmap_epoch": 68, "osdmap_epoch_barrier": 66, "rank_uptime": 2.948989798, "state": "up:active", "uptime": 7.576628069, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:52:46.605 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:52:46.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.707+0000 7fbf48232700 1 Processor -- start 2021-06-25T04:52:46.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.707+0000 7fbf48232700 1 -- start start 2021-06-25T04:52:46.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbf400a7670 0x7fbf40066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b1930 0x7fbf40066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf40067410 con 0x7fbf400b0020 2021-06-25T04:52:46.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf400a7a50 con 0x7fbf400a7670 2021-06-25T04:52:46.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401475e0 con 0x7fbf400b1930 2021-06-25T04:52:46.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf457cd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b1930 0x7fbf40066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf45fce700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbf400a7670 0x7fbf40066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf457cd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b1930 0x7fbf40066f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:49994/0 (socket says 172.21.15.57:49994) 2021-06-25T04:52:46.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf457cd700 1 -- 172.21.15.57:0/3797912444 learned_addr learned my addr 172.21.15.57:0/3797912444 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:46.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf467cf700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbf400b0020 0x7fbf4005f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:56800/0 (socket says 172.21.15.57:56800) 2021-06-25T04:52:46.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf44fcc700 1 -- 172.21.15.57:0/3797912444 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751325260 0 0) 0x7fbf40067410 con 0x7fbf400b0020 2021-06-25T04:52:46.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf44fcc700 1 -- 172.21.15.57:0/3797912444 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf28003260 con 0x7fbf400b0020 2021-06-25T04:52:46.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf457cd700 1 -- 172.21.15.57:0/3797912444 >> v2:172.21.15.87:3300/0 conn(0x7fbf400a7670 msgr2=0x7fbf40066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:46.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf457cd700 1 --2- 172.21.15.57:0/3797912444 >> v2:172.21.15.87:3300/0 conn(0x7fbf400a7670 0x7fbf40066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf457cd700 1 -- 172.21.15.57:0/3797912444 >> v1:172.21.15.87:6789/0 conn(0x7fbf400b0020 legacy=0x7fbf4005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:46.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf457cd700 1 -- 172.21.15.57:0/3797912444 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf40147880 con 0x7fbf400b1930 2021-06-25T04:52:46.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf457cd700 1 --2- 172.21.15.57:0/3797912444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b1930 0x7fbf40066f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fbf3c0032f0 tx=0x7fbf3c009290).ready entity=mon.2 client_cookie=e43a1eb3368634fb server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:46.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf44fcc700 1 -- 172.21.15.57:0/3797912444 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf3c00b6c0 con 0x7fbf400b1930 2021-06-25T04:52:46.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf44fcc700 1 -- 172.21.15.57:0/3797912444 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c00b820 con 0x7fbf400b1930 2021-06-25T04:52:46.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf44fcc700 1 -- 172.21.15.57:0/3797912444 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf3c00b990 con 0x7fbf400b1930 2021-06-25T04:52:46.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 -- 172.21.15.57:0/3797912444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b1930 msgr2=0x7fbf40066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:46.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 --2- 172.21.15.57:0/3797912444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b1930 0x7fbf40066f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fbf3c0032f0 tx=0x7fbf3c009290).stop 2021-06-25T04:52:46.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 -- 172.21.15.57:0/3797912444 shutdown_connections 2021-06-25T04:52:46.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 --2- 172.21.15.57:0/3797912444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b1930 0x7fbf40066f20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 --2- 172.21.15.57:0/3797912444 >> v2:172.21.15.87:3300/0 conn(0x7fbf400a7670 0x7fbf40066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 -- 172.21.15.57:0/3797912444 >> 172.21.15.57:0/3797912444 conn(0x7fbf400b53a0 msgr2=0x7fbf400b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:46.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 -- 172.21.15.57:0/3797912444 shutdown_connections 2021-06-25T04:52:46.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.711+0000 7fbf48232700 1 -- 172.21.15.57:0/3797912444 wait complete. 2021-06-25T04:52:46.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf48232700 1 Processor -- start 2021-06-25T04:52:46.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf48232700 1 -- start start 2021-06-25T04:52:46.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf48232700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf400a7670 0x7fbf400ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf48232700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b0020 0x7fbf40156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf48232700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf400b1930 0x7fbf401573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf48232700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4014ca90 con 0x7fbf400a7670 2021-06-25T04:52:46.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf48232700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401578c0 con 0x7fbf400b1930 2021-06-25T04:52:46.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf48232700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40154560 con 0x7fbf400b0020 2021-06-25T04:52:46.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf45fce700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf400a7670 0x7fbf400ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf457cd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b0020 0x7fbf40156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf457cd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b0020 0x7fbf40156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:50000/0 (socket says 172.21.15.57:50000) 2021-06-25T04:52:46.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf457cd700 1 -- 172.21.15.57:0/1300274609 learned_addr learned my addr 172.21.15.57:0/1300274609 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:46.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf45fce700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf400a7670 0x7fbf400ad9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38838/0 (socket says 172.21.15.57:38838) 2021-06-25T04:52:46.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf467cf700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf400b1930 0x7fbf401573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf45fce700 1 -- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b0020 msgr2=0x7fbf40156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:46.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf45fce700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b0020 0x7fbf40156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf45fce700 1 -- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf400b1930 msgr2=0x7fbf401573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf45fce700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf400b1930 0x7fbf401573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf45fce700 1 -- 172.21.15.57:0/1300274609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c009530 con 0x7fbf400a7670 2021-06-25T04:52:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf45fce700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf400a7670 0x7fbf400ad9c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fbf40157a00 tx=0x7fbf30006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf2effd700 1 -- 172.21.15.57:0/1300274609 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf30010780 con 0x7fbf400a7670 2021-06-25T04:52:46.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.715+0000 7fbf2effd700 1 -- 172.21.15.57:0/1300274609 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf300108e0 con 0x7fbf400a7670 2021-06-25T04:52:46.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.719+0000 7fbf48232700 1 -- 172.21.15.57:0/1300274609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4014bd50 con 0x7fbf400a7670 2021-06-25T04:52:46.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.719+0000 7fbf2effd700 1 -- 172.21.15.57:0/1300274609 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf30010c40 con 0x7fbf400a7670 2021-06-25T04:52:46.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.719+0000 7fbf48232700 1 -- 172.21.15.57:0/1300274609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4014c7f0 con 0x7fbf400a7670 2021-06-25T04:52:46.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.719+0000 7fbf48232700 1 -- 172.21.15.57:0/1300274609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40156c10 con 0x7fbf400a7670 2021-06-25T04:52:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.719+0000 7fbf2effd700 1 -- 172.21.15.57:0/1300274609 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbf3001b410 con 0x7fbf400a7670 2021-06-25T04:52:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.719+0000 7fbf2effd700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf20055340 0x7fbf20057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.719+0000 7fbf2effd700 1 -- 172.21.15.57:0/1300274609 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbf3006dfd0 con 0x7fbf400a7670 2021-06-25T04:52:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.719+0000 7fbf457cd700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf20055340 0x7fbf20057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.723+0000 7fbf457cd700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf20055340 0x7fbf20057800 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fbf3c01a000 tx=0x7fbf3c016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:46.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.727+0000 7fbf2effd700 1 -- 172.21.15.57:0/1300274609 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbf30044080 con 0x7fbf400a7670 2021-06-25T04:52:46.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.855+0000 7fbf48232700 1 -- 172.21.15.57:0/1300274609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf40057310 con 0x7fbf400a7670 2021-06-25T04:52:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf2effd700 1 -- 172.21.15.57:0/1300274609 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fbf300476a0 con 0x7fbf400a7670 2021-06-25T04:52:46.861 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:46.862 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":68,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:52:45.658297+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:52:41.803683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-06-25T04:52:42.643832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:52:46.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 -- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf20055340 msgr2=0x7fbf20057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:46.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf20055340 0x7fbf20057800 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fbf3c01a000 tx=0x7fbf3c016000).stop 2021-06-25T04:52:46.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 -- 172.21.15.57:0/1300274609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf400a7670 msgr2=0x7fbf400ad9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:46.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf400a7670 0x7fbf400ad9c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fbf40157a00 tx=0x7fbf30006df0).stop 2021-06-25T04:52:46.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 -- 172.21.15.57:0/1300274609 shutdown_connections 2021-06-25T04:52:46.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf20055340 0x7fbf20057800 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf400b1930 0x7fbf401573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf400b0020 0x7fbf40156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 --2- 172.21.15.57:0/1300274609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf400a7670 0x7fbf400ad9c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 -- 172.21.15.57:0/1300274609 >> 172.21.15.57:0/1300274609 conn(0x7fbf400b53a0 msgr2=0x7fbf40145ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:46.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 -- 172.21.15.57:0/1300274609 shutdown_connections 2021-06-25T04:52:46.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.859+0000 7fbf48232700 1 -- 172.21.15.57:0/1300274609 wait complete. 2021-06-25T04:52:46.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:52:41.803683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:52:42.643832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:52:46.876 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:52:46.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.983+0000 7fc14df80700 1 Processor -- start 2021-06-25T04:52:46.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.983+0000 7fc14df80700 1 -- start start 2021-06-25T04:52:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc1480b7670 0x7fc148060a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 0x7fc148060f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc148146550 0x7fc1481469a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:46.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc148067010 con 0x7fc1480b7670 2021-06-25T04:52:46.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc148065370 con 0x7fc148146550 2021-06-25T04:52:46.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480b7a50 con 0x7fc1480b2760 2021-06-25T04:52:46.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14cf7e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc1480b7670 0x7fc148060a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14cf7e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc1480b7670 0x7fc148060a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38846/0 (socket says 172.21.15.57:38846) 2021-06-25T04:52:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14cf7e700 1 -- 172.21.15.57:0/922617793 learned_addr learned my addr 172.21.15.57:0/922617793 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc147fff700 1 --2- 172.21.15.57:0/922617793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 0x7fc148060f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14d77f700 1 --2- 172.21.15.57:0/922617793 >> v2:172.21.15.87:3300/0 conn(0x7fc148146550 0x7fc1481469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14cf7e700 1 -- 172.21.15.57:0/922617793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 msgr2=0x7fc148060f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:46.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14cf7e700 1 --2- 172.21.15.57:0/922617793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 0x7fc148060f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:46.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14cf7e700 1 -- 172.21.15.57:0/922617793 >> v2:172.21.15.87:3300/0 conn(0x7fc148146550 msgr2=0x7fc1481469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:47.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14cf7e700 1 --2- 172.21.15.57:0/922617793 >> v2:172.21.15.87:3300/0 conn(0x7fc148146550 0x7fc1481469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14cf7e700 1 -- 172.21.15.57:0/922617793 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc148066b10 con 0x7fc1480b7670 2021-06-25T04:52:47.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc147fff700 1 --2- 172.21.15.57:0/922617793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 0x7fc148060f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:52:47.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14d77f700 1 --2- 172.21.15.57:0/922617793 >> v2:172.21.15.87:3300/0 conn(0x7fc148146550 0x7fc1481469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:52:47.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14cf7e700 1 --2- 172.21.15.57:0/922617793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1480b7670 0x7fc148060a10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fc138002f70 tx=0x7fc138006eb0).ready entity=mon.0 client_cookie=b0310cc787ba8a16 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc1477fe700 1 -- 172.21.15.57:0/922617793 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc13800d570 con 0x7fc1480b7670 2021-06-25T04:52:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc1477fe700 1 -- 172.21.15.57:0/922617793 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138000e90 con 0x7fc1480b7670 2021-06-25T04:52:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc1477fe700 1 -- 172.21.15.57:0/922617793 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc13800d900 con 0x7fc1480b7670 2021-06-25T04:52:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 -- 172.21.15.57:0/922617793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1480b7670 msgr2=0x7fc148060a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 --2- 172.21.15.57:0/922617793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1480b7670 0x7fc148060a10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fc138002f70 tx=0x7fc138006eb0).stop 2021-06-25T04:52:47.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 -- 172.21.15.57:0/922617793 shutdown_connections 2021-06-25T04:52:47.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 --2- 172.21.15.57:0/922617793 >> v2:172.21.15.87:3300/0 conn(0x7fc148146550 0x7fc1481469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 --2- 172.21.15.57:0/922617793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 0x7fc148060f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 --2- 172.21.15.57:0/922617793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1480b7670 0x7fc148060a10 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 -- 172.21.15.57:0/922617793 >> 172.21.15.57:0/922617793 conn(0x7fc14805f670 msgr2=0x7fc14805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:47.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 -- 172.21.15.57:0/922617793 shutdown_connections 2021-06-25T04:52:47.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.987+0000 7fc14df80700 1 -- 172.21.15.57:0/922617793 wait complete. 2021-06-25T04:52:47.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc14df80700 1 Processor -- start 2021-06-25T04:52:47.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc14df80700 1 -- start start 2021-06-25T04:52:47.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc14df80700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 0x7fc1480ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc14df80700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1480b7670 0x7fc148149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc14df80700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc148146550 0x7fc14814a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc14df80700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480afe10 con 0x7fc1480b7670 2021-06-25T04:52:47.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc14df80700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc148142950 con 0x7fc148146550 2021-06-25T04:52:47.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc14df80700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480acba0 con 0x7fc1480b2760 2021-06-25T04:52:47.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc147fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1480b7670 0x7fc148149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc147fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1480b7670 0x7fc148149ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38852/0 (socket says 172.21.15.57:38852) 2021-06-25T04:52:47.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc147fff700 1 -- 172.21.15.57:0/2500016633 learned_addr learned my addr 172.21.15.57:0/2500016633 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:47.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc14cf7e700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 0x7fc1480ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc14d77f700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc148146550 0x7fc14814a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc147fff700 1 -- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 msgr2=0x7fc1480ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc147fff700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 0x7fc1480ab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc147fff700 1 -- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc148146550 msgr2=0x7fc14814a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc147fff700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc148146550 0x7fc14814a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc147fff700 1 -- 172.21.15.57:0/2500016633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13000b180 con 0x7fc1480b7670 2021-06-25T04:52:47.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc14cf7e700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 0x7fc1480ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:52:47.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.991+0000 7fc147fff700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1480b7670 0x7fc148149ba0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fc13000c000 tx=0x7fc130006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.995+0000 7fc145ffb700 1 -- 172.21.15.57:0/2500016633 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc13000ca40 con 0x7fc1480b7670 2021-06-25T04:52:47.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.995+0000 7fc145ffb700 1 -- 172.21.15.57:0/2500016633 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13000cba0 con 0x7fc1480b7670 2021-06-25T04:52:47.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.995+0000 7fc145ffb700 1 -- 172.21.15.57:0/2500016633 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1300123f0 con 0x7fc1480b7670 2021-06-25T04:52:47.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.995+0000 7fc14df80700 1 -- 172.21.15.57:0/2500016633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc140009470 con 0x7fc1480b7670 2021-06-25T04:52:47.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.995+0000 7fc14df80700 1 -- 172.21.15.57:0/2500016633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13800b1e0 con 0x7fc1480b7670 2021-06-25T04:52:47.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.995+0000 7fc14df80700 1 -- 172.21.15.57:0/2500016633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1480ad1d0 con 0x7fc1480b7670 2021-06-25T04:52:47.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.995+0000 7fc145ffb700 1 -- 172.21.15.57:0/2500016633 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc130012550 con 0x7fc1480b7670 2021-06-25T04:52:47.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.995+0000 7fc145ffb700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc12c055450 0x7fc12c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.995+0000 7fc145ffb700 1 -- 172.21.15.57:0/2500016633 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc13006e590 con 0x7fc1480b7670 2021-06-25T04:52:47.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.995+0000 7fc14cf7e700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc12c055450 0x7fc12c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:46.999+0000 7fc14cf7e700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc12c055450 0x7fc12c057910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fc138017000 tx=0x7fc138014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.003+0000 7fc145ffb700 1 -- 172.21.15.57:0/2500016633 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc1300446e0 con 0x7fc1480b7670 2021-06-25T04:52:47.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.135+0000 7fc14df80700 1 -- 172.21.15.57:0/2500016633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc1480ad520 con 0x7fc1480b7670 2021-06-25T04:52:47.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.135+0000 7fc145ffb700 1 -- 172.21.15.57:0/2500016633 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v68) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc130047d00 con 0x7fc1480b7670 2021-06-25T04:52:47.140 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:52:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 -- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc12c055450 msgr2=0x7fc12c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc12c055450 0x7fc12c057910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fc138017000 tx=0x7fc138014000).stop 2021-06-25T04:52:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 -- 172.21.15.57:0/2500016633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1480b7670 msgr2=0x7fc148149ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1480b7670 0x7fc148149ba0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fc13000c000 tx=0x7fc130006df0).stop 2021-06-25T04:52:47.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 -- 172.21.15.57:0/2500016633 shutdown_connections 2021-06-25T04:52:47.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc12c055450 0x7fc12c057910 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc148146550 0x7fc14814a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1480b7670 0x7fc148149ba0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 --2- 172.21.15.57:0/2500016633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1480b2760 0x7fc1480ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 -- 172.21.15.57:0/2500016633 >> 172.21.15.57:0/2500016633 conn(0x7fc14805f670 msgr2=0x7fc14805c450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 -- 172.21.15.57:0/2500016633 shutdown_connections 2021-06-25T04:52:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.139+0000 7fc14df80700 1 -- 172.21.15.57:0/2500016633 wait complete. 2021-06-25T04:52:47.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:52:47.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.259+0000 7f6862565700 1 Processor -- start 2021-06-25T04:52:47.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.259+0000 7f6862565700 1 -- start start 2021-06-25T04:52:47.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.259+0000 7f6862565700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f685c0a8a80 0x7f685c152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.259+0000 7f6862565700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0a7080 con 0x7f685c0affd0 2021-06-25T04:52:47.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.259+0000 7f6862565700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0a72b0 con 0x7f685c0b2540 2021-06-25T04:52:47.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.259+0000 7f6862565700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c0a7550 con 0x7f685c0a8a80 2021-06-25T04:52:47.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.259+0000 7f6860d62700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f685c0affd0 0x7f685c0a8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56078/0 (socket says 172.21.15.57:56078) 2021-06-25T04:52:47.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.259+0000 7f6860d62700 1 -- 172.21.15.57:0/2101285202 learned_addr learned my addr 172.21.15.57:0/2101285202 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:52:47.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.259+0000 7f6861d64700 1 --2- 172.21.15.57:0/2101285202 >> v2:172.21.15.87:3300/0 conn(0x7f685c0a8a80 0x7f685c152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.259+0000 7f6853fff700 1 -- 172.21.15.57:0/2101285202 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030496549 0 0) 0x7f685c0a7080 con 0x7f685c0affd0 2021-06-25T04:52:47.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.259+0000 7f6853fff700 1 -- 172.21.15.57:0/2101285202 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6840003260 con 0x7f685c0affd0 2021-06-25T04:52:47.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6853fff700 1 -- 172.21.15.57:0/2101285202 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176365288 0 0) 0x7f685c0a72b0 con 0x7f685c0b2540 2021-06-25T04:52:47.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6853fff700 1 -- 172.21.15.57:0/2101285202 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f685c0a7080 con 0x7f685c0b2540 2021-06-25T04:52:47.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6861d64700 1 -- 172.21.15.57:0/2101285202 >> v1:172.21.15.87:6789/0 conn(0x7f685c0b2540 legacy=0x7f685c14ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6861d64700 1 -- 172.21.15.57:0/2101285202 >> v1:172.21.15.57:6789/0 conn(0x7f685c0affd0 legacy=0x7f685c0a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6853fff700 1 -- 172.21.15.57:0/2101285202 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1127356207 0 0) 0x7f6840003260 con 0x7f685c0affd0 2021-06-25T04:52:47.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6861d64700 1 -- 172.21.15.57:0/2101285202 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c0a77f0 con 0x7f685c0a8a80 2021-06-25T04:52:47.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6861d64700 1 --2- 172.21.15.57:0/2101285202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f685c0a8a80 0x7f685c152ba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f6858001110 tx=0x7f68540091d0).ready entity=mon.1 client_cookie=ec3cdf2cefd04e77 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6853fff700 1 -- 172.21.15.57:0/2101285202 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6858001660 con 0x7f685c0a8a80 2021-06-25T04:52:47.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6853fff700 1 -- 172.21.15.57:0/2101285202 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685400f510 con 0x7f685c0a8a80 2021-06-25T04:52:47.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6853fff700 1 -- 172.21.15.57:0/2101285202 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f685400f680 con 0x7f685c0a8a80 2021-06-25T04:52:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6862565700 1 -- 172.21.15.57:0/2101285202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f685c0a8a80 msgr2=0x7f685c152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6862565700 1 --2- 172.21.15.57:0/2101285202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f685c0a8a80 0x7f685c152ba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f6858001110 tx=0x7f68540091d0).stop 2021-06-25T04:52:47.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6862565700 1 -- 172.21.15.57:0/2101285202 shutdown_connections 2021-06-25T04:52:47.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6862565700 1 --2- 172.21.15.57:0/2101285202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f685c0a8a80 0x7f685c152ba0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6862565700 1 -- 172.21.15.57:0/2101285202 >> 172.21.15.57:0/2101285202 conn(0x7f685c060140 msgr2=0x7f685c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:47.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6862565700 1 -- 172.21.15.57:0/2101285202 shutdown_connections 2021-06-25T04:52:47.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.263+0000 7f6862565700 1 -- 172.21.15.57:0/2101285202 wait complete. 2021-06-25T04:52:47.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6862565700 1 Processor -- start 2021-06-25T04:52:47.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6862565700 1 -- start start 2021-06-25T04:52:47.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6862565700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f685c0a8a80 0x7f685c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6862565700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685c0affd0 0x7f685c0ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6862565700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f685c0b2540 0x7f685c0aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6862565700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c153fa0 con 0x7f685c0b2540 2021-06-25T04:52:47.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6862565700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0b5ee0 con 0x7f685c0a8a80 2021-06-25T04:52:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6862565700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c156e70 con 0x7f685c0affd0 2021-06-25T04:52:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6861d64700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f685c0b2540 0x7f685c0aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6861d64700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f685c0b2540 0x7f685c0aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38868/0 (socket says 172.21.15.57:38868) 2021-06-25T04:52:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6861d64700 1 -- 172.21.15.57:0/3322658739 learned_addr learned my addr 172.21.15.57:0/3322658739 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:47.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6861563700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f685c0a8a80 0x7f685c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6860d62700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685c0affd0 0x7f685c0ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6861d64700 1 -- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685c0affd0 msgr2=0x7f685c0ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6861d64700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685c0affd0 0x7f685c0ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6861d64700 1 -- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f685c0a8a80 msgr2=0x7f685c0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6861d64700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f685c0a8a80 0x7f685c0aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6861d64700 1 -- 172.21.15.57:0/3322658739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854009470 con 0x7f685c0b2540 2021-06-25T04:52:47.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.267+0000 7f6861d64700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f685c0b2540 0x7f685c0aba00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f6858001110 tx=0x7f6854016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.271+0000 7f68527fc700 1 -- 172.21.15.57:0/3322658739 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6854006ea0 con 0x7f685c0b2540 2021-06-25T04:52:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.271+0000 7f6862565700 1 -- 172.21.15.57:0/3322658739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685c0b5c40 con 0x7f685c0b2540 2021-06-25T04:52:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.271+0000 7f68527fc700 1 -- 172.21.15.57:0/3322658739 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685400fe20 con 0x7f685c0b2540 2021-06-25T04:52:47.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.271+0000 7f68527fc700 1 -- 172.21.15.57:0/3322658739 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6854011d70 con 0x7f685c0b2540 2021-06-25T04:52:47.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.271+0000 7f6862565700 1 -- 172.21.15.57:0/3322658739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c067210 con 0x7f685c0b2540 2021-06-25T04:52:47.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.271+0000 7f6862565700 1 -- 172.21.15.57:0/3322658739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c0b5120 con 0x7f685c0b2540 2021-06-25T04:52:47.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.271+0000 7f68527fc700 1 -- 172.21.15.57:0/3322658739 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f685400f070 con 0x7f685c0b2540 2021-06-25T04:52:47.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.271+0000 7f68527fc700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6844055450 0x7f6844057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.271+0000 7f68527fc700 1 -- 172.21.15.57:0/3322658739 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f685406e620 con 0x7f685c0b2540 2021-06-25T04:52:47.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.271+0000 7f6861563700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6844055450 0x7f6844057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.275+0000 7f6861563700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6844055450 0x7f6844057910 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f684c00d000 tx=0x7f684c007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.279+0000 7f68527fc700 1 -- 172.21.15.57:0/3322658739 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6854044730 con 0x7f685c0b2540 2021-06-25T04:52:47.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.407+0000 7f6862565700 1 -- 172.21.15.57:0/3322658739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f685c0b49b0 con 0x7f685c0b2540 2021-06-25T04:52:47.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f68527fc700 1 -- 172.21.15.57:0/3322658739 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f685c0b49b0 con 0x7f685c0b2540 2021-06-25T04:52:47.413 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:52:47.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 -- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6844055450 msgr2=0x7f6844057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6844055450 0x7f6844057910 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f684c00d000 tx=0x7f684c007a20).stop 2021-06-25T04:52:47.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 -- 172.21.15.57:0/3322658739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f685c0b2540 msgr2=0x7f685c0aba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f685c0b2540 0x7f685c0aba00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f6858001110 tx=0x7f6854016000).stop 2021-06-25T04:52:47.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 -- 172.21.15.57:0/3322658739 shutdown_connections 2021-06-25T04:52:47.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6844055450 0x7f6844057910 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f685c0b2540 0x7f685c0aba00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685c0affd0 0x7f685c0ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 --2- 172.21.15.57:0/3322658739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f685c0a8a80 0x7f685c0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 -- 172.21.15.57:0/3322658739 >> 172.21.15.57:0/3322658739 conn(0x7f685c060140 msgr2=0x7f685c148680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:47.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 -- 172.21.15.57:0/3322658739 shutdown_connections 2021-06-25T04:52:47.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.411+0000 7f6862565700 1 -- 172.21.15.57:0/3322658739 wait complete. 2021-06-25T04:52:47.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:52:47.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bc5905700 1 Processor -- start 2021-06-25T04:52:47.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bc5905700 1 -- start start 2021-06-25T04:52:47.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bc5905700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0bc00a9e80 0x7f0bc00aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bc5905700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0bc0060390 0x7f0bc013cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bc5905700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bc013d180 0x7f0bc013f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bc5905700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc0061950 con 0x7f0bc00a9e80 2021-06-25T04:52:47.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bc5905700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc0061bf0 con 0x7f0bc0060390 2021-06-25T04:52:47.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bc5905700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0060b50 con 0x7f0bc013d180 2021-06-25T04:52:47.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bbeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0bc00a9e80 0x7f0bc00aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bbeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0bc00a9e80 0x7f0bc00aa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38872/0 (socket says 172.21.15.57:38872) 2021-06-25T04:52:47.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bbeffd700 1 -- 172.21.15.57:0/1208303376 learned_addr learned my addr 172.21.15.57:0/1208303376 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:47.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bbf7fe700 1 --2- 172.21.15.57:0/1208303376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bc013d180 0x7f0bc013f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bb7fff700 1 --2- 172.21.15.57:0/1208303376 >> v2:172.21.15.87:3300/0 conn(0x7f0bc0060390 0x7f0bc013cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bbeffd700 1 -- 172.21.15.57:0/1208303376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bc013d180 msgr2=0x7f0bc013f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:47.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bbeffd700 1 --2- 172.21.15.57:0/1208303376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bc013d180 0x7f0bc013f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bbeffd700 1 -- 172.21.15.57:0/1208303376 >> v2:172.21.15.87:3300/0 conn(0x7f0bc0060390 msgr2=0x7f0bc013cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bbeffd700 1 --2- 172.21.15.57:0/1208303376 >> v2:172.21.15.87:3300/0 conn(0x7f0bc0060390 0x7f0bc013cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.543+0000 7f0bbeffd700 1 -- 172.21.15.57:0/1208303376 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc0060df0 con 0x7f0bc00a9e80 2021-06-25T04:52:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bbeffd700 1 --2- 172.21.15.57:0/1208303376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc00a9e80 0x7f0bc00aa260 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f0bb0002f70 tx=0x7f0bb0006eb0).ready entity=mon.0 client_cookie=762b3f0ac9c49ba3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bbe7fc700 1 -- 172.21.15.57:0/1208303376 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb000f940 con 0x7f0bc00a9e80 2021-06-25T04:52:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bbe7fc700 1 -- 172.21.15.57:0/1208303376 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0000e90 con 0x7f0bc00a9e80 2021-06-25T04:52:47.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bbe7fc700 1 -- 172.21.15.57:0/1208303376 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb000fcd0 con 0x7f0bc00a9e80 2021-06-25T04:52:47.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bc5905700 1 -- 172.21.15.57:0/1208303376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc00a9e80 msgr2=0x7f0bc00aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bc5905700 1 --2- 172.21.15.57:0/1208303376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc00a9e80 0x7f0bc00aa260 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f0bb0002f70 tx=0x7f0bb0006eb0).stop 2021-06-25T04:52:47.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bc5905700 1 -- 172.21.15.57:0/1208303376 shutdown_connections 2021-06-25T04:52:47.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bc5905700 1 --2- 172.21.15.57:0/1208303376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bc013d180 0x7f0bc013f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bc5905700 1 --2- 172.21.15.57:0/1208303376 >> v2:172.21.15.87:3300/0 conn(0x7f0bc0060390 0x7f0bc013cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bc5905700 1 --2- 172.21.15.57:0/1208303376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc00a9e80 0x7f0bc00aa260 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bc5905700 1 -- 172.21.15.57:0/1208303376 >> 172.21.15.57:0/1208303376 conn(0x7f0bc00b2930 msgr2=0x7f0bc00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:47.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bc5905700 1 -- 172.21.15.57:0/1208303376 shutdown_connections 2021-06-25T04:52:47.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bc5905700 1 -- 172.21.15.57:0/1208303376 wait complete. 2021-06-25T04:52:47.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bc5905700 1 Processor -- start 2021-06-25T04:52:47.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.547+0000 7f0bc5905700 1 -- start start 2021-06-25T04:52:47.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bc5905700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc0060390 0x7f0bc00aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bc5905700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bc00a9e80 0x7f0bc014e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bc5905700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc013d180 0x7f0bc014e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bc5905700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc013eb50 con 0x7f0bc013d180 2021-06-25T04:52:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bc5905700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00b0130 con 0x7f0bc0060390 2021-06-25T04:52:47.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bc5905700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00b0360 con 0x7f0bc00a9e80 2021-06-25T04:52:47.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc013d180 0x7f0bc014e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc013d180 0x7f0bc014e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38882/0 (socket says 172.21.15.57:38882) 2021-06-25T04:52:47.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbf7fe700 1 -- 172.21.15.57:0/998602262 learned_addr learned my addr 172.21.15.57:0/998602262 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:47.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbeffd700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc0060390 0x7f0bc00aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bb7fff700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bc00a9e80 0x7f0bc014e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbf7fe700 1 -- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bc00a9e80 msgr2=0x7f0bc014e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbf7fe700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bc00a9e80 0x7f0bc014e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbf7fe700 1 -- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc0060390 msgr2=0x7f0bc00aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbf7fe700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc0060390 0x7f0bc00aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbf7fe700 1 -- 172.21.15.57:0/998602262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb000c2f0 con 0x7f0bc013d180 2021-06-25T04:52:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bb7fff700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bc00a9e80 0x7f0bc014e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:52:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbf7fe700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc013d180 0x7f0bc014e540 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f0bc013e7d0 tx=0x7f0bb80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbcff9700 1 -- 172.21.15.57:0/998602262 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb800c640 con 0x7f0bc013d180 2021-06-25T04:52:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbcff9700 1 -- 172.21.15.57:0/998602262 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb800c7a0 con 0x7f0bc013d180 2021-06-25T04:52:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bc5905700 1 -- 172.21.15.57:0/998602262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc013e8b0 con 0x7f0bc013d180 2021-06-25T04:52:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bbcff9700 1 -- 172.21.15.57:0/998602262 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb800cb00 con 0x7f0bc013d180 2021-06-25T04:52:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bc5905700 1 -- 172.21.15.57:0/998602262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc014eab0 con 0x7f0bc013d180 2021-06-25T04:52:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.551+0000 7f0bc5905700 1 -- 172.21.15.57:0/998602262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc013e540 con 0x7f0bc013d180 2021-06-25T04:52:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.555+0000 7f0bbcff9700 1 -- 172.21.15.57:0/998602262 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0bb8022070 con 0x7f0bc013d180 2021-06-25T04:52:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.555+0000 7f0bbcff9700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ba4055360 0x7f0ba4057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.555+0000 7f0bbcff9700 1 -- 172.21.15.57:0/998602262 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0bb806e300 con 0x7f0bc013d180 2021-06-25T04:52:47.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.555+0000 7f0bbeffd700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ba4055360 0x7f0ba4057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.555+0000 7f0bbeffd700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ba4055360 0x7f0ba4057820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f0bb001d000 tx=0x7f0bb0017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.559+0000 7f0bbcff9700 1 -- 172.21.15.57:0/998602262 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0bb8044450 con 0x7f0bc013d180 2021-06-25T04:52:47.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.683+0000 7f0bc5905700 1 -- 172.21.15.57:0/998602262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0bc014eab0 con 0x7f0bc013d180 2021-06-25T04:52:47.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.683+0000 7f0bbcff9700 1 -- 172.21.15.57:0/998602262 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0bc014eab0 con 0x7f0bc013d180 2021-06-25T04:52:47.689 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:52:47.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 -- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ba4055360 msgr2=0x7f0ba4057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ba4055360 0x7f0ba4057820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f0bb001d000 tx=0x7f0bb0017000).stop 2021-06-25T04:52:47.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 -- 172.21.15.57:0/998602262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc013d180 msgr2=0x7f0bc014e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc013d180 0x7f0bc014e540 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f0bc013e7d0 tx=0x7f0bb80091d0).stop 2021-06-25T04:52:47.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 -- 172.21.15.57:0/998602262 shutdown_connections 2021-06-25T04:52:47.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ba4055360 0x7f0ba4057820 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bc013d180 0x7f0bc014e540 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bc00a9e80 0x7f0bc014e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 --2- 172.21.15.57:0/998602262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc0060390 0x7f0bc00aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 -- 172.21.15.57:0/998602262 >> 172.21.15.57:0/998602262 conn(0x7f0bc00b2930 msgr2=0x7f0bc00b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:47.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 -- 172.21.15.57:0/998602262 shutdown_connections 2021-06-25T04:52:47.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.687+0000 7f0bc5905700 1 -- 172.21.15.57:0/998602262 wait complete. 2021-06-25T04:52:47.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:52:47.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb442acc700 1 Processor -- start 2021-06-25T04:52:47.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb442acc700 1 -- start start 2021-06-25T04:52:47.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb442acc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb43c064600 0x7fb43c0b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb442acc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb43c0649e0 0x7fb43c0664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb442acc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c0b8050 con 0x7fb43c0b4a60 2021-06-25T04:52:47.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb442acc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c142f00 con 0x7fb43c064600 2021-06-25T04:52:47.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb442acc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c1430f0 con 0x7fb43c0649e0 2021-06-25T04:52:47.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb441aca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb43c064600 0x7fb43c0b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb441aca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb43c064600 0x7fb43c0b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38886/0 (socket says 172.21.15.57:38886) 2021-06-25T04:52:47.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb441aca700 1 -- 172.21.15.57:0/3374677932 learned_addr learned my addr 172.21.15.57:0/3374677932 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:47.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb4422cb700 1 --2- 172.21.15.57:0/3374677932 >> v2:172.21.15.87:3300/0 conn(0x7fb43c0649e0 0x7fb43c0664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb441aca700 1 -- 172.21.15.57:0/3374677932 >> v2:172.21.15.87:3300/0 conn(0x7fb43c0649e0 msgr2=0x7fb43c0664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:47.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb441aca700 1 --2- 172.21.15.57:0/3374677932 >> v2:172.21.15.87:3300/0 conn(0x7fb43c0649e0 0x7fb43c0664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb441aca700 1 -- 172.21.15.57:0/3374677932 >> v1:172.21.15.87:6789/0 conn(0x7fb43c0b4a60 legacy=0x7fb43c143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.811+0000 7fb441aca700 1 -- 172.21.15.57:0/3374677932 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c143390 con 0x7fb43c064600 2021-06-25T04:52:47.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb441aca700 1 --2- 172.21.15.57:0/3374677932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c064600 0x7fb43c0b36d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fb42c002f70 tx=0x7fb42c006eb0).ready entity=mon.0 client_cookie=50c907a33905f794 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb440ac8700 1 -- 172.21.15.57:0/3374677932 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb42c00d5c0 con 0x7fb43c064600 2021-06-25T04:52:47.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb440ac8700 1 -- 172.21.15.57:0/3374677932 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c000e90 con 0x7fb43c064600 2021-06-25T04:52:47.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 -- 172.21.15.57:0/3374677932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c064600 msgr2=0x7fb43c0b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb440ac8700 1 -- 172.21.15.57:0/3374677932 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb42c00d950 con 0x7fb43c064600 2021-06-25T04:52:47.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 --2- 172.21.15.57:0/3374677932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c064600 0x7fb43c0b36d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fb42c002f70 tx=0x7fb42c006eb0).stop 2021-06-25T04:52:47.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 -- 172.21.15.57:0/3374677932 shutdown_connections 2021-06-25T04:52:47.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 --2- 172.21.15.57:0/3374677932 >> v2:172.21.15.87:3300/0 conn(0x7fb43c0649e0 0x7fb43c0664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 --2- 172.21.15.57:0/3374677932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c064600 0x7fb43c0b36d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 -- 172.21.15.57:0/3374677932 >> 172.21.15.57:0/3374677932 conn(0x7fb43c05f670 msgr2=0x7fb43c05fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:47.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 -- 172.21.15.57:0/3374677932 shutdown_connections 2021-06-25T04:52:47.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 -- 172.21.15.57:0/3374677932 wait complete. 2021-06-25T04:52:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 Processor -- start 2021-06-25T04:52:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 -- start start 2021-06-25T04:52:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb43c064600 0x7fb43c061a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb43c0649e0 0x7fb43c156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0b4a60 0x7fb43c146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c146c80 con 0x7fb43c0b4a60 2021-06-25T04:52:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c146ea0 con 0x7fb43c0649e0 2021-06-25T04:52:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb442acc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c147140 con 0x7fb43c064600 2021-06-25T04:52:47.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb4422cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0b4a60 0x7fb43c146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb4422cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0b4a60 0x7fb43c146790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38896/0 (socket says 172.21.15.57:38896) 2021-06-25T04:52:47.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.815+0000 7fb4422cb700 1 -- 172.21.15.57:0/1698334941 learned_addr learned my addr 172.21.15.57:0/1698334941 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:47.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb441aca700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb43c064600 0x7fb43c061a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb4412c9700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb43c0649e0 0x7fb43c156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb4422cb700 1 -- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb43c064600 msgr2=0x7fb43c061a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb4422cb700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb43c064600 0x7fb43c061a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb4422cb700 1 -- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb43c0649e0 msgr2=0x7fb43c156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb4422cb700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb43c0649e0 0x7fb43c156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb4422cb700 1 -- 172.21.15.57:0/1698334941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c00b1e0 con 0x7fb43c0b4a60 2021-06-25T04:52:47.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb4412c9700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb43c0649e0 0x7fb43c156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:52:47.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb4422cb700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0b4a60 0x7fb43c146790 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fb434006e00 tx=0x7fb4340091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb43affd700 1 -- 172.21.15.57:0/1698334941 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43400c850 con 0x7fb43c0b4a60 2021-06-25T04:52:47.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb43affd700 1 -- 172.21.15.57:0/1698334941 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400c9b0 con 0x7fb43c0b4a60 2021-06-25T04:52:47.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb442acc700 1 -- 172.21.15.57:0/1698334941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c1525d0 con 0x7fb43c0b4a60 2021-06-25T04:52:47.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb43affd700 1 -- 172.21.15.57:0/1698334941 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43400cd10 con 0x7fb43c0b4a60 2021-06-25T04:52:47.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb442acc700 1 -- 172.21.15.57:0/1698334941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c152d10 con 0x7fb43c0b4a60 2021-06-25T04:52:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb442acc700 1 -- 172.21.15.57:0/1698334941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c057310 con 0x7fb43c0b4a60 2021-06-25T04:52:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.819+0000 7fb43affd700 1 -- 172.21.15.57:0/1698334941 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb434022070 con 0x7fb43c0b4a60 2021-06-25T04:52:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.823+0000 7fb43affd700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb41c055450 0x7fb41c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.823+0000 7fb43affd700 1 -- 172.21.15.57:0/1698334941 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb43406e600 con 0x7fb43c0b4a60 2021-06-25T04:52:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.823+0000 7fb441aca700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb41c055450 0x7fb41c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:47.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.823+0000 7fb441aca700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb41c055450 0x7fb41c057910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fb42c019000 tx=0x7fb42c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:47.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.827+0000 7fb43affd700 1 -- 172.21.15.57:0/1698334941 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb4340447b0 con 0x7fb43c0b4a60 2021-06-25T04:52:47.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.955+0000 7fb442acc700 1 -- 172.21.15.57:0/1698334941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb43c069bc0 con 0x7fb43c0b4a60 2021-06-25T04:52:47.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.959+0000 7fb43affd700 1 -- 172.21.15.57:0/1698334941 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb4340160a0 con 0x7fb43c0b4a60 2021-06-25T04:52:47.962 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:52:47.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.959+0000 7fb442acc700 1 -- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb41c055450 msgr2=0x7fb41c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.959+0000 7fb442acc700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb41c055450 0x7fb41c057910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fb42c019000 tx=0x7fb42c015000).stop 2021-06-25T04:52:47.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.959+0000 7fb442acc700 1 -- 172.21.15.57:0/1698334941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0b4a60 msgr2=0x7fb43c146790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.959+0000 7fb442acc700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0b4a60 0x7fb43c146790 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fb434006e00 tx=0x7fb4340091d0).stop 2021-06-25T04:52:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.963+0000 7fb442acc700 1 -- 172.21.15.57:0/1698334941 shutdown_connections 2021-06-25T04:52:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.963+0000 7fb442acc700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb41c055450 0x7fb41c057910 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.963+0000 7fb442acc700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb43c0b4a60 0x7fb43c146790 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.963+0000 7fb442acc700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb43c0649e0 0x7fb43c156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.963+0000 7fb442acc700 1 --2- 172.21.15.57:0/1698334941 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb43c064600 0x7fb43c061a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.963+0000 7fb442acc700 1 -- 172.21.15.57:0/1698334941 >> 172.21.15.57:0/1698334941 conn(0x7fb43c05f670 msgr2=0x7fb43c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.963+0000 7fb442acc700 1 -- 172.21.15.57:0/1698334941 shutdown_connections 2021-06-25T04:52:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:47.963+0000 7fb442acc700 1 -- 172.21.15.57:0/1698334941 wait complete. 2021-06-25T04:52:47.981 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:52:47.982 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:52:48.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd887fff700 1 Processor -- start 2021-06-25T04:52:48.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd887fff700 1 -- start start 2021-06-25T04:52:48.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd887fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd8880b5460 0x7fd8880af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd887fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8880b05d0 0x7fd888147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd887fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd888067560 0x7fd8880acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd887fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8881452a0 con 0x7fd8880b05d0 2021-06-25T04:52:48.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd887fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8880adfb0 con 0x7fd8880b5460 2021-06-25T04:52:48.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd887fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880b5840 con 0x7fd888067560 2021-06-25T04:52:48.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd8867fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8880b05d0 0x7fd888147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:48.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd8867fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8880b05d0 0x7fd888147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38900/0 (socket says 172.21.15.57:38900) 2021-06-25T04:52:48.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd8867fc700 1 -- 172.21.15.57:0/1725401744 learned_addr learned my addr 172.21.15.57:0/1725401744 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:48.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd886ffd700 1 --2- 172.21.15.57:0/1725401744 >> v2:172.21.15.87:3300/0 conn(0x7fd8880b5460 0x7fd8880af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:48.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd8877fe700 1 --2- 172.21.15.57:0/1725401744 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd888067560 0x7fd8880acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd8867fc700 1 -- 172.21.15.57:0/1725401744 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd888067560 msgr2=0x7fd8880acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd8867fc700 1 --2- 172.21.15.57:0/1725401744 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd888067560 0x7fd8880acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:48.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd8867fc700 1 -- 172.21.15.57:0/1725401744 >> v2:172.21.15.87:3300/0 conn(0x7fd8880b5460 msgr2=0x7fd8880af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:52:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd8867fc700 1 --2- 172.21.15.57:0/1725401744 >> v2:172.21.15.87:3300/0 conn(0x7fd8880b5460 0x7fd8880af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd8867fc700 1 -- 172.21.15.57:0/1725401744 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880ac7c0 con 0x7fd8880b05d0 2021-06-25T04:52:48.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd8877fe700 1 --2- 172.21.15.57:0/1725401744 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd888067560 0x7fd8880acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:52:48.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.083+0000 7fd8867fc700 1 --2- 172.21.15.57:0/1725401744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8880b05d0 0x7fd888147560 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fd878002f70 tx=0x7fd878006eb0).ready entity=mon.0 client_cookie=bc68b8480c96f88 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:48.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd885ffb700 1 -- 172.21.15.57:0/1725401744 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87800d570 con 0x7fd8880b05d0 2021-06-25T04:52:48.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd885ffb700 1 -- 172.21.15.57:0/1725401744 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878000e90 con 0x7fd8880b05d0 2021-06-25T04:52:48.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd885ffb700 1 -- 172.21.15.57:0/1725401744 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd87800d900 con 0x7fd8880b05d0 2021-06-25T04:52:48.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 -- 172.21.15.57:0/1725401744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8880b05d0 msgr2=0x7fd888147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:48.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 --2- 172.21.15.57:0/1725401744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8880b05d0 0x7fd888147560 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fd878002f70 tx=0x7fd878006eb0).stop 2021-06-25T04:52:48.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 -- 172.21.15.57:0/1725401744 shutdown_connections 2021-06-25T04:52:48.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 --2- 172.21.15.57:0/1725401744 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd888067560 0x7fd8880acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:48.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 --2- 172.21.15.57:0/1725401744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8880b05d0 0x7fd888147560 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:48.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 --2- 172.21.15.57:0/1725401744 >> v2:172.21.15.87:3300/0 conn(0x7fd8880b5460 0x7fd8880af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:48.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 -- 172.21.15.57:0/1725401744 >> 172.21.15.57:0/1725401744 conn(0x7fd888062520 msgr2=0x7fd888062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:48.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 -- 172.21.15.57:0/1725401744 shutdown_connections 2021-06-25T04:52:48.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 -- 172.21.15.57:0/1725401744 wait complete. 2021-06-25T04:52:48.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 Processor -- start 2021-06-25T04:52:48.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 -- start start 2021-06-25T04:52:48.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd888067560 0x7fd8881473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:48.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8880b05d0 0x7fd88814b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:48.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8880b5460 0x7fd888156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:48.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd888063530 con 0x7fd8880b05d0 2021-06-25T04:52:48.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880637d0 con 0x7fd8880b5460 2021-06-25T04:52:48.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd887fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd888159cd0 con 0x7fd888067560 2021-06-25T04:52:48.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd8867fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8880b05d0 0x7fd88814b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:48.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd8867fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8880b05d0 0x7fd88814b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38906/0 (socket says 172.21.15.57:38906) 2021-06-25T04:52:48.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd8867fc700 1 -- 172.21.15.57:0/862762257 learned_addr learned my addr 172.21.15.57:0/862762257 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:52:48.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd8877fe700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8880b5460 0x7fd888156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:48.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd886ffd700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd888067560 0x7fd8881473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:48.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.087+0000 7fd8867fc700 1 -- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd888067560 msgr2=0x7fd8881473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:48.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd8867fc700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd888067560 0x7fd8881473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:48.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd8867fc700 1 -- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8880b5460 msgr2=0x7fd888156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:48.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd8867fc700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8880b5460 0x7fd888156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:48.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd8867fc700 1 -- 172.21.15.57:0/862762257 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87800b1e0 con 0x7fd8880b05d0 2021-06-25T04:52:48.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd8877fe700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8880b5460 0x7fd888156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:52:48.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd8867fc700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8880b05d0 0x7fd88814b210 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fd878002f70 tx=0x7fd878015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:48.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd877fff700 1 -- 172.21.15.57:0/862762257 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd878021070 con 0x7fd8880b05d0 2021-06-25T04:52:48.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd877fff700 1 -- 172.21.15.57:0/862762257 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878000e90 con 0x7fd8880b05d0 2021-06-25T04:52:48.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd887fff700 1 -- 172.21.15.57:0/862762257 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd888159f70 con 0x7fd8880b05d0 2021-06-25T04:52:48.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd877fff700 1 -- 172.21.15.57:0/862762257 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd878011a50 con 0x7fd8880b05d0 2021-06-25T04:52:48.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd887fff700 1 -- 172.21.15.57:0/862762257 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8880631b0 con 0x7fd8880b05d0 2021-06-25T04:52:48.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd887fff700 1 -- 172.21.15.57:0/862762257 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd888057310 con 0x7fd8880b05d0 2021-06-25T04:52:48.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd877fff700 1 -- 172.21.15.57:0/862762257 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd87800f070 con 0x7fd8880b05d0 2021-06-25T04:52:48.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd877fff700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd864055340 0x7fd864057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:52:48.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd877fff700 1 -- 172.21.15.57:0/862762257 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd87806f360 con 0x7fd8880b05d0 2021-06-25T04:52:48.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.091+0000 7fd886ffd700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd864055340 0x7fd864057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:52:48.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.095+0000 7fd886ffd700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd864055340 0x7fd864057800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fd87c00c000 tx=0x7fd87c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:52:48.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.099+0000 7fd877fff700 1 -- 172.21.15.57:0/862762257 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd878045510 con 0x7fd8880b05d0 2021-06-25T04:52:48.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.263+0000 7fd887fff700 1 -- 172.21.15.57:0/862762257 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd888060e50 con 0x7fd8880b05d0 2021-06-25T04:52:48.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.263+0000 7fd877fff700 1 -- 172.21.15.57:0/862762257 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fd878048b30 con 0x7fd8880b05d0 2021-06-25T04:52:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:52:48.268 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4117950639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4117950639},{"type":"v1","addr":"172.21.15.87:6835","nonce":4117950639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5477,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3471432498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3471432498},{"type":"v1","addr":"172.21.15.57:6833","nonce":3471432498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:52:43.642049+0000","modified":"2021-06-25T04:52:44.644941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3818355049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3818355049},{"type":"v1","addr":"172.21.15.57:6835","nonce":3818355049}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-06-25T04:52:48.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 -- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd864055340 msgr2=0x7fd864057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:48.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd864055340 0x7fd864057800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fd87c00c000 tx=0x7fd87c008040).stop 2021-06-25T04:52:48.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 -- 172.21.15.57:0/862762257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8880b05d0 msgr2=0x7fd88814b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:52:48.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8880b05d0 0x7fd88814b210 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fd878002f70 tx=0x7fd878015000).stop 2021-06-25T04:52:48.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 -- 172.21.15.57:0/862762257 shutdown_connections 2021-06-25T04:52:48.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd864055340 0x7fd864057800 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:48.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8880b5460 0x7fd888156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:48.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8880b05d0 0x7fd88814b210 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:48.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 --2- 172.21.15.57:0/862762257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd888067560 0x7fd8881473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:52:48.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 -- 172.21.15.57:0/862762257 >> 172.21.15.57:0/862762257 conn(0x7fd888062520 msgr2=0x7fd8880af210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:52:48.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 -- 172.21.15.57:0/862762257 shutdown_connections 2021-06-25T04:52:48.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:52:48.267+0000 7fd887fff700 1 -- 172.21.15.57:0/862762257 wait complete. 2021-06-25T04:52:48.273 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 31 2021-06-25T04:52:48.585 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:52:43.642049+0000', 'modified': '2021-06-25T04:52:44.644941+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5985}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5985': {'gid': 5985, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/3818355049', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 3818355049}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3818355049}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:52:48.585 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:52:48.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:52:48.715 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":5985,"want_state":"up:active","state":"up:active","rank_uptime":5.0600602190000004,"mdsmap_epoch":31,"osdmap_epoch":68,"osdmap_epoch_barrier":66,"uptime":9.6876975309999995} 2021-06-25T04:52:48.716 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 5985, "mdsmap_epoch": 31, "osdmap_epoch": 68, "osdmap_epoch_barrier": 66, "rank_uptime": 5.060060219, "state": "up:active", "uptime": 9.687697531, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:52:48.716 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:52:48.717 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:52:48.717 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:52:48.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:48.718 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:52:48.726 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:52:48.743 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:52:48.743 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:52:48.802 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:52:48.803 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:52:48.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:48.805 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:52:48.809 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:52:48.810 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:52:48.814 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:52:48.830 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:52:48.832 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:52:48.841 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:52:48.842 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:52:48.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:48.844 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:52:48.892 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14890]: starting ceph client 2021-06-25T04:52:48.893 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:52:48.898+0000 7ff72aeb7080 -1 init, newargv = 0x55d09e1fe900 newargc=9 2021-06-25T04:52:48.897 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14890]: starting fuse 2021-06-25T04:52:49.998 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:52:50.016 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:52:50.016 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:52:50.072 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:52:50.073 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:52:50.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:50.075 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:52:50.083 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:52:50.084 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:52:50.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:50.086 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:52:50.087 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:52:50.087 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:52:50.088 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:52:50.089 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:52:50.090 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:52:50.090 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:52:50.091 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:52:50.092 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:52:50.093 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:52:50.093 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:52:50.094 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:52:50.094 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:52:50.095 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:52:50.095 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:52:50.096 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:52:50.096 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:52:50.096 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:52:50.097 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:52:50.097 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:52:50.098 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:52:50.098 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:52:50.098 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:52:50.145 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.14890.asok 2021-06-25T04:52:50.149 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14890.asok 2021-06-25T04:52:50.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:50.150 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14890.asok status 2021-06-25T04:52:50.281 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:52:50.282 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:52:50.282 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:52:50.282 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:52:50.283 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:52:50.284 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:52:50.284 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:52:50.285 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "14890", 2021-06-25T04:52:50.285 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:52:50.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:52:50.285 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:52:50.286 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:52:50.286 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 6043, 2021-06-25T04:52:50.286 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:52:50.286 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:52:50.286 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:52:50.287 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 6043 2021-06-25T04:52:50.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:52:50.287 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:52:50.287 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:52:50.288 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:52:50.288 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1512857972 2021-06-25T04:52:50.288 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:52:50.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:52:50.288 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:52:50.289 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:52:50.289 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:52:50.289 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1512857972 2021-06-25T04:52:50.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:52:50.289 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.6043 172.21.15.102:0/1512857972", 2021-06-25T04:52:50.290 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/1512857972", 2021-06-25T04:52:50.290 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:52:50.290 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 31, 2021-06-25T04:52:50.290 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 68, 2021-06-25T04:52:50.291 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:52:50.291 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:52:50.291 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:52:50.291 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:52:50.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:50.293 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:52:50.294 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:52:50.300 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:52:50.301 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:52:50.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:50.303 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:52:50.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:52:50.363 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:52:50.363 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:52:50.375 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:52:50.376 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:52:50.376 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-06-25T04:52:50.377 DEBUG:teuthology.orchestra.run.smithi102:> import sys 2021-06-25T04:52:50.377 DEBUG:teuthology.orchestra.run.smithi102:> import time 2021-06-25T04:52:50.377 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:52:50.378 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:52:50.378 DEBUG:teuthology.orchestra.run.smithi102:> n = 1000 2021-06-25T04:52:50.379 DEBUG:teuthology.orchestra.run.smithi102:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-06-25T04:52:50.380 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:52:50.380 DEBUG:teuthology.orchestra.run.smithi102:> if not os.path.exists(os.path.dirname(abs_path)): 2021-06-25T04:52:50.381 DEBUG:teuthology.orchestra.run.smithi102:> os.makedirs(os.path.dirname(abs_path)) 2021-06-25T04:52:50.381 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:52:50.382 DEBUG:teuthology.orchestra.run.smithi102:> for i in range(0, n): 2021-06-25T04:52:50.382 DEBUG:teuthology.orchestra.run.smithi102:> fname = "{0}_{1}".format(abs_path, i) 2021-06-25T04:52:50.382 DEBUG:teuthology.orchestra.run.smithi102:> with open(fname, '"'"'w'"'"') as f: 2021-06-25T04:52:50.383 DEBUG:teuthology.orchestra.run.smithi102:> f.write('"'"'content'"'"') 2021-06-25T04:52:50.383 DEBUG:teuthology.orchestra.run.smithi102:> if True: 2021-06-25T04:52:50.384 DEBUG:teuthology.orchestra.run.smithi102:> f.flush() 2021-06-25T04:52:50.384 DEBUG:teuthology.orchestra.run.smithi102:> os.fsync(f.fileno()) 2021-06-25T04:52:50.385 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:53:02.271 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:02.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe0816fd700 1 Processor -- start 2021-06-25T04:53:02.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe0816fd700 1 -- start start 2021-06-25T04:53:02.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe0816fd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe07c0b5460 0x7fe07c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:02.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe0816fd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe07c0b05d0 0x7fe07c147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:02.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe0816fd700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c0b5840 con 0x7fe07c067560 2021-06-25T04:53:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe0816fd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c1452a0 con 0x7fe07c0b5460 2021-06-25T04:53:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe0816fd700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c0adfb0 con 0x7fe07c0b05d0 2021-06-25T04:53:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe07c0b5460 0x7fe07c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe07c0b5460 0x7fe07c0af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38916/0 (socket says 172.21.15.57:38916) 2021-06-25T04:53:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07bfff700 1 -- 172.21.15.57:0/2926074135 learned_addr learned my addr 172.21.15.57:0/2926074135 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07b7fe700 1 --2- 172.21.15.57:0/2926074135 >> v2:172.21.15.87:3300/0 conn(0x7fe07c0b05d0 0x7fe07c147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07bfff700 1 -- 172.21.15.57:0/2926074135 >> v2:172.21.15.87:3300/0 conn(0x7fe07c0b05d0 msgr2=0x7fe07c147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07bfff700 1 --2- 172.21.15.57:0/2926074135 >> v2:172.21.15.87:3300/0 conn(0x7fe07c0b05d0 0x7fe07c147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07bfff700 1 -- 172.21.15.57:0/2926074135 >> v1:172.21.15.87:6789/0 conn(0x7fe07c067560 legacy=0x7fe07c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07bfff700 1 -- 172.21.15.57:0/2926074135 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c0ac7c0 con 0x7fe07c0b5460 2021-06-25T04:53:02.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07bfff700 1 --2- 172.21.15.57:0/2926074135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe07c0b5460 0x7fe07c0af510 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fe070002f70 tx=0x7fe070006eb0).ready entity=mon.0 client_cookie=64f03b151bae82da server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:02.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07affd700 1 -- 172.21.15.57:0/2926074135 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe07000d5c0 con 0x7fe07c0b5460 2021-06-25T04:53:02.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07affd700 1 -- 172.21.15.57:0/2926074135 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe070000e90 con 0x7fe07c0b5460 2021-06-25T04:53:02.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe07affd700 1 -- 172.21.15.57:0/2926074135 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe07000d950 con 0x7fe07c0b5460 2021-06-25T04:53:02.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe0816fd700 1 -- 172.21.15.57:0/2926074135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe07c0b5460 msgr2=0x7fe07c0af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.387+0000 7fe0816fd700 1 --2- 172.21.15.57:0/2926074135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe07c0b5460 0x7fe07c0af510 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fe070002f70 tx=0x7fe070006eb0).stop 2021-06-25T04:53:02.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 -- 172.21.15.57:0/2926074135 shutdown_connections 2021-06-25T04:53:02.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 --2- 172.21.15.57:0/2926074135 >> v2:172.21.15.87:3300/0 conn(0x7fe07c0b05d0 0x7fe07c147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 --2- 172.21.15.57:0/2926074135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe07c0b5460 0x7fe07c0af510 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 -- 172.21.15.57:0/2926074135 >> 172.21.15.57:0/2926074135 conn(0x7fe07c062520 msgr2=0x7fe07c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:02.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 -- 172.21.15.57:0/2926074135 shutdown_connections 2021-06-25T04:53:02.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 -- 172.21.15.57:0/2926074135 wait complete. 2021-06-25T04:53:02.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 Processor -- start 2021-06-25T04:53:02.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 -- start start 2021-06-25T04:53:02.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe07c067560 0x7fe07c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:02.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe07c0b05d0 0x7fe07c1424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe07c0b5460 0x7fe07c1429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c066ff0 con 0x7fe07c067560 2021-06-25T04:53:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c147650 con 0x7fe07c0b05d0 2021-06-25T04:53:02.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe0816fd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c142ed0 con 0x7fe07c0b5460 2021-06-25T04:53:02.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe07bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe07c067560 0x7fe07c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:02.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe07bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe07c067560 0x7fe07c0b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38920/0 (socket says 172.21.15.57:38920) 2021-06-25T04:53:02.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe07bfff700 1 -- 172.21.15.57:0/1022125533 learned_addr learned my addr 172.21.15.57:0/1022125533 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:02.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe080efc700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe07c0b5460 0x7fe07c1429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:02.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.391+0000 7fe07b7fe700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe07c0b05d0 0x7fe07c1424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:02.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe07bfff700 1 -- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe07c0b5460 msgr2=0x7fe07c1429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe07bfff700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe07c0b5460 0x7fe07c1429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe07bfff700 1 -- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe07c0b05d0 msgr2=0x7fe07c1424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe07bfff700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe07c0b05d0 0x7fe07c1424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe07bfff700 1 -- 172.21.15.57:0/1022125533 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07000b1e0 con 0x7fe07c067560 2021-06-25T04:53:02.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe07bfff700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe07c067560 0x7fe07c0b40e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fe070002f70 tx=0x7fe070015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:02.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe0797fa700 1 -- 172.21.15.57:0/1022125533 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0700117e0 con 0x7fe07c067560 2021-06-25T04:53:02.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe0797fa700 1 -- 172.21.15.57:0/1022125533 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe070011940 con 0x7fe07c067560 2021-06-25T04:53:02.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe0816fd700 1 -- 172.21.15.57:0/1022125533 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c066d50 con 0x7fe07c067560 2021-06-25T04:53:02.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe0797fa700 1 -- 172.21.15.57:0/1022125533 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe070011ca0 con 0x7fe07c067560 2021-06-25T04:53:02.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe0816fd700 1 -- 172.21.15.57:0/1022125533 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c146a60 con 0x7fe07c067560 2021-06-25T04:53:02.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe0816fd700 1 -- 172.21.15.57:0/1022125533 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c156c10 con 0x7fe07c067560 2021-06-25T04:53:02.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe0797fa700 1 -- 172.21.15.57:0/1022125533 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe07000f070 con 0x7fe07c067560 2021-06-25T04:53:02.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe0797fa700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe05c055450 0x7fe05c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:02.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe0797fa700 1 -- 172.21.15.57:0/1022125533 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe07006f500 con 0x7fe07c067560 2021-06-25T04:53:02.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.395+0000 7fe07b7fe700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe05c055450 0x7fe05c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:02.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.399+0000 7fe07b7fe700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe05c055450 0x7fe05c057910 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fe06c00b000 tx=0x7fe06c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:02.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.403+0000 7fe0797fa700 1 -- 172.21.15.57:0/1022125533 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe070045610 con 0x7fe07c067560 2021-06-25T04:53:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.567+0000 7fe0816fd700 1 -- 172.21.15.57:0/1022125533 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe07c057310 con 0x7fe07c067560 2021-06-25T04:53:02.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.567+0000 7fe0797fa700 1 -- 172.21.15.57:0/1022125533 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fe070048c30 con 0x7fe07c067560 2021-06-25T04:53:02.572 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:02.572 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4117950639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4117950639},{"type":"v1","addr":"172.21.15.87:6835","nonce":4117950639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5477,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3471432498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3471432498},{"type":"v1","addr":"172.21.15.57:6833","nonce":3471432498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:52:43.642049+0000","modified":"2021-06-25T04:52:44.644941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3818355049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3818355049},{"type":"v1","addr":"172.21.15.57:6835","nonce":3818355049}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-06-25T04:53:02.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 -- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe05c055450 msgr2=0x7fe05c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe05c055450 0x7fe05c057910 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fe06c00b000 tx=0x7fe06c006df0).stop 2021-06-25T04:53:02.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 -- 172.21.15.57:0/1022125533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe07c067560 msgr2=0x7fe07c0b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe07c067560 0x7fe07c0b40e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fe070002f70 tx=0x7fe070015000).stop 2021-06-25T04:53:02.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 -- 172.21.15.57:0/1022125533 shutdown_connections 2021-06-25T04:53:02.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe05c055450 0x7fe05c057910 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe07c0b5460 0x7fe07c1429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe07c0b05d0 0x7fe07c1424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 --2- 172.21.15.57:0/1022125533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe07c067560 0x7fe07c0b40e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 -- 172.21.15.57:0/1022125533 >> 172.21.15.57:0/1022125533 conn(0x7fe07c062520 msgr2=0x7fe07c1446d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 -- 172.21.15.57:0/1022125533 shutdown_connections 2021-06-25T04:53:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.571+0000 7fe0816fd700 1 -- 172.21.15.57:0/1022125533 wait complete. 2021-06-25T04:53:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 31 2021-06-25T04:53:02.585 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-06-25T04:53:02.688 INFO:teuthology.orchestra.run.smithi057.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-06-25T04:53:02.689 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-06-25T04:53:02.689 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:02.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c79d0700 1 Processor -- start 2021-06-25T04:53:02.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c79d0700 1 -- start start 2021-06-25T04:53:02.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c79d0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6c00670e0 0x7fe6c00b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:02.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c79d0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c00b9b90 con 0x7fe6c013ffb0 2021-06-25T04:53:02.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c79d0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c00674c0 con 0x7fe6c0143970 2021-06-25T04:53:02.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c79d0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c0143040 con 0x7fe6c00670e0 2021-06-25T04:53:02.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c5f6d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe6c013ffb0 0x7fe6c0140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56150/0 (socket says 172.21.15.57:56150) 2021-06-25T04:53:02.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c5f6d700 1 -- 172.21.15.57:0/2399705754 learned_addr learned my addr 172.21.15.57:0/2399705754 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:02.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c576c700 1 --2- 172.21.15.57:0/2399705754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6c00670e0 0x7fe6c00b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:02.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6b7fff700 1 -- 172.21.15.57:0/2399705754 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637186599 0 0) 0x7fe6b8001490 con 0x7fe6c013ffb0 2021-06-25T04:53:02.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6b7fff700 1 -- 172.21.15.57:0/2399705754 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6a4003260 con 0x7fe6c013ffb0 2021-06-25T04:53:02.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6b7fff700 1 -- 172.21.15.57:0/2399705754 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709408725 0 0) 0x7fe6c00674c0 con 0x7fe6c0143970 2021-06-25T04:53:02.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6b7fff700 1 -- 172.21.15.57:0/2399705754 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b8001490 con 0x7fe6c0143970 2021-06-25T04:53:02.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c576c700 1 -- 172.21.15.57:0/2399705754 >> v1:172.21.15.87:6789/0 conn(0x7fe6c0143970 legacy=0x7fe6c00aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c576c700 1 -- 172.21.15.57:0/2399705754 >> v1:172.21.15.57:6789/0 conn(0x7fe6c013ffb0 legacy=0x7fe6c0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c576c700 1 -- 172.21.15.57:0/2399705754 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c00af490 con 0x7fe6c00670e0 2021-06-25T04:53:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6c576c700 1 --2- 172.21.15.57:0/2399705754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6c00670e0 0x7fe6c00b96a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe6bc002f70 tx=0x7fe6bc006df0).ready entity=mon.2 client_cookie=b473a68657a7bcab server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6b7fff700 1 -- 172.21.15.57:0/2399705754 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6bc00d5c0 con 0x7fe6c00670e0 2021-06-25T04:53:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.783+0000 7fe6b7fff700 1 -- 172.21.15.57:0/2399705754 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc000e90 con 0x7fe6c00670e0 2021-06-25T04:53:02.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.787+0000 7fe6b7fff700 1 -- 172.21.15.57:0/2399705754 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6bc00d910 con 0x7fe6c00670e0 2021-06-25T04:53:02.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.787+0000 7fe6c79d0700 1 -- 172.21.15.57:0/2399705754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6c00670e0 msgr2=0x7fe6c00b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.787+0000 7fe6c79d0700 1 --2- 172.21.15.57:0/2399705754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6c00670e0 0x7fe6c00b96a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe6bc002f70 tx=0x7fe6bc006df0).stop 2021-06-25T04:53:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.787+0000 7fe6c79d0700 1 -- 172.21.15.57:0/2399705754 shutdown_connections 2021-06-25T04:53:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.787+0000 7fe6c79d0700 1 --2- 172.21.15.57:0/2399705754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6c00670e0 0x7fe6c00b96a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.787+0000 7fe6c79d0700 1 -- 172.21.15.57:0/2399705754 >> 172.21.15.57:0/2399705754 conn(0x7fe6c005f9b0 msgr2=0x7fe6c0061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.787+0000 7fe6c79d0700 1 -- 172.21.15.57:0/2399705754 shutdown_connections 2021-06-25T04:53:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.787+0000 7fe6c79d0700 1 -- 172.21.15.57:0/2399705754 wait complete. 2021-06-25T04:53:02.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.787+0000 7fe6c79d0700 1 Processor -- start 2021-06-25T04:53:02.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.787+0000 7fe6c79d0700 1 -- start start 2021-06-25T04:53:02.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c79d0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c00670e0 0x7fe6c01448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:02.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c79d0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c013ffb0 0x7fe6c00b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c79d0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6c0143970 0x7fe6c00b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c79d0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00b62a0 con 0x7fe6c00670e0 2021-06-25T04:53:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c79d0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00b64c0 con 0x7fe6c013ffb0 2021-06-25T04:53:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c79d0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00b7430 con 0x7fe6c0143970 2021-06-25T04:53:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c576c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c00670e0 0x7fe6c01448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c576c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c00670e0 0x7fe6c01448d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38934/0 (socket says 172.21.15.57:38934) 2021-06-25T04:53:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c576c700 1 -- 172.21.15.57:0/4012341117 learned_addr learned my addr 172.21.15.57:0/4012341117 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c5f6d700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6c0143970 0x7fe6c00b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c4f6b700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c013ffb0 0x7fe6c00b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c576c700 1 -- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6c0143970 msgr2=0x7fe6c00b90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c576c700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6c0143970 0x7fe6c00b90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c576c700 1 -- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c013ffb0 msgr2=0x7fe6c00b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c576c700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c013ffb0 0x7fe6c00b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c576c700 1 -- 172.21.15.57:0/4012341117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc00b180 con 0x7fe6c00670e0 2021-06-25T04:53:02.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c576c700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c00670e0 0x7fe6c01448d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fe6bc002f70 tx=0x7fe6bc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:02.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6b67fc700 1 -- 172.21.15.57:0/4012341117 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6bc012d10 con 0x7fe6c00670e0 2021-06-25T04:53:02.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6b67fc700 1 -- 172.21.15.57:0/4012341117 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc012e70 con 0x7fe6c00670e0 2021-06-25T04:53:02.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6b67fc700 1 -- 172.21.15.57:0/4012341117 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6bc01f630 con 0x7fe6c00670e0 2021-06-25T04:53:02.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c79d0700 1 -- 172.21.15.57:0/4012341117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c00b76d0 con 0x7fe6c00670e0 2021-06-25T04:53:02.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.791+0000 7fe6c79d0700 1 -- 172.21.15.57:0/4012341117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c01450b0 con 0x7fe6c00670e0 2021-06-25T04:53:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.795+0000 7fe6b67fc700 1 -- 172.21.15.57:0/4012341117 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe6bc025020 con 0x7fe6c00670e0 2021-06-25T04:53:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.795+0000 7fe6c79d0700 1 -- 172.21.15.57:0/4012341117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c0057310 con 0x7fe6c00670e0 2021-06-25T04:53:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.795+0000 7fe6b67fc700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe6a80553f0 0x7fe6a80578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.795+0000 7fe6b67fc700 1 -- 172.21.15.57:0/4012341117 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe6bc06ee80 con 0x7fe6c00670e0 2021-06-25T04:53:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.795+0000 7fe6c4f6b700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe6a80553f0 0x7fe6a80578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.795+0000 7fe6c4f6b700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe6a80553f0 0x7fe6a80578b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fe6b000d000 tx=0x7fe6b0007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:02.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.799+0000 7fe6b67fc700 1 -- 172.21.15.57:0/4012341117 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe6bc044ea0 con 0x7fe6c00670e0 2021-06-25T04:53:02.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.959+0000 7fe6c79d0700 1 -- 172.21.15.57:0/4012341117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6c00698a0 con 0x7fe6c00670e0 2021-06-25T04:53:02.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6b67fc700 1 -- 172.21.15.57:0/4012341117 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fe6bc006980 con 0x7fe6c00670e0 2021-06-25T04:53:02.966 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:02.966 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4117950639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4117950639},{"type":"v1","addr":"172.21.15.87:6835","nonce":4117950639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5477,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3471432498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3471432498},{"type":"v1","addr":"172.21.15.57:6833","nonce":3471432498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:52:43.642049+0000","modified":"2021-06-25T04:52:44.644941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3818355049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3818355049},{"type":"v1","addr":"172.21.15.57:6835","nonce":3818355049}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-06-25T04:53:02.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 -- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe6a80553f0 msgr2=0x7fe6a80578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe6a80553f0 0x7fe6a80578b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fe6b000d000 tx=0x7fe6b0007a20).stop 2021-06-25T04:53:02.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 -- 172.21.15.57:0/4012341117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c00670e0 msgr2=0x7fe6c01448d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:02.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c00670e0 0x7fe6c01448d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fe6bc002f70 tx=0x7fe6bc014000).stop 2021-06-25T04:53:02.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 -- 172.21.15.57:0/4012341117 shutdown_connections 2021-06-25T04:53:02.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe6a80553f0 0x7fe6a80578b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6c0143970 0x7fe6c00b90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c013ffb0 0x7fe6c00b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 --2- 172.21.15.57:0/4012341117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c00670e0 0x7fe6c01448d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:02.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 -- 172.21.15.57:0/4012341117 >> 172.21.15.57:0/4012341117 conn(0x7fe6c005f9b0 msgr2=0x7fe6c0141bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:02.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 -- 172.21.15.57:0/4012341117 shutdown_connections 2021-06-25T04:53:02.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:02.963+0000 7fe6c79d0700 1 -- 172.21.15.57:0/4012341117 wait complete. 2021-06-25T04:53:02.971 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 31 2021-06-25T04:53:02.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-06-25T04:53:03.078 INFO:teuthology.orchestra.run.smithi057.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-06-25T04:53:03.079 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-06-25T04:53:03.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:03.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72f131b700 1 Processor -- start 2021-06-25T04:53:03.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72f131b700 1 -- start start 2021-06-25T04:53:03.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72f131b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72ec0a7670 0x7f72ec066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72f131b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f72ec0b1930 0x7f72ec066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72f131b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ec067410 con 0x7f72ec0b0020 2021-06-25T04:53:03.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72f131b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec0a7a50 con 0x7f72ec0a7670 2021-06-25T04:53:03.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72f131b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec1475e0 con 0x7f72ec0b1930 2021-06-25T04:53:03.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72eaffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72ec0a7670 0x7f72ec066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72eaffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72ec0a7670 0x7f72ec066a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38944/0 (socket says 172.21.15.57:38944) 2021-06-25T04:53:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72eaffd700 1 -- 172.21.15.57:0/2173661334 learned_addr learned my addr 172.21.15.57:0/2173661334 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72ea7fc700 1 --2- 172.21.15.57:0/2173661334 >> v2:172.21.15.87:3300/0 conn(0x7f72ec0b1930 0x7f72ec066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72eaffd700 1 -- 172.21.15.57:0/2173661334 >> v2:172.21.15.87:3300/0 conn(0x7f72ec0b1930 msgr2=0x7f72ec066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:03.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72eaffd700 1 --2- 172.21.15.57:0/2173661334 >> v2:172.21.15.87:3300/0 conn(0x7f72ec0b1930 0x7f72ec066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72eaffd700 1 -- 172.21.15.57:0/2173661334 >> v1:172.21.15.87:6789/0 conn(0x7f72ec0b0020 legacy=0x7f72ec05f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72eaffd700 1 -- 172.21.15.57:0/2173661334 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec147880 con 0x7f72ec0a7670 2021-06-25T04:53:03.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72eaffd700 1 --2- 172.21.15.57:0/2173661334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72ec0a7670 0x7f72ec066a30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f72e0002f70 tx=0x7f72e0006eb0).ready entity=mon.0 client_cookie=ec1164fea3b93159 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:03.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72e9ffb700 1 -- 172.21.15.57:0/2173661334 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72e000d5c0 con 0x7f72ec0a7670 2021-06-25T04:53:03.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72e9ffb700 1 -- 172.21.15.57:0/2173661334 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e0000e90 con 0x7f72ec0a7670 2021-06-25T04:53:03.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72e9ffb700 1 -- 172.21.15.57:0/2173661334 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72e000d950 con 0x7f72ec0a7670 2021-06-25T04:53:03.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72f131b700 1 -- 172.21.15.57:0/2173661334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72ec0a7670 msgr2=0x7f72ec066a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72f131b700 1 --2- 172.21.15.57:0/2173661334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72ec0a7670 0x7f72ec066a30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f72e0002f70 tx=0x7f72e0006eb0).stop 2021-06-25T04:53:03.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.179+0000 7f72f131b700 1 -- 172.21.15.57:0/2173661334 shutdown_connections 2021-06-25T04:53:03.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.183+0000 7f72f131b700 1 --2- 172.21.15.57:0/2173661334 >> v2:172.21.15.87:3300/0 conn(0x7f72ec0b1930 0x7f72ec066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.183+0000 7f72f131b700 1 --2- 172.21.15.57:0/2173661334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72ec0a7670 0x7f72ec066a30 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.183+0000 7f72f131b700 1 -- 172.21.15.57:0/2173661334 >> 172.21.15.57:0/2173661334 conn(0x7f72ec0b53a0 msgr2=0x7f72ec0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:03.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.183+0000 7f72f131b700 1 -- 172.21.15.57:0/2173661334 shutdown_connections 2021-06-25T04:53:03.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.183+0000 7f72f131b700 1 -- 172.21.15.57:0/2173661334 wait complete. 2021-06-25T04:53:03.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.183+0000 7f72f131b700 1 Processor -- start 2021-06-25T04:53:03.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.183+0000 7f72f131b700 1 -- start start 2021-06-25T04:53:03.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72f131b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72ec0a7670 0x7f72ec14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72f131b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72ec0b0020 0x7f72ec0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72f131b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72ec0b1930 0x7f72ec0a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72f131b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0abc90 con 0x7f72ec0b1930 2021-06-25T04:53:03.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72f131b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0ae500 con 0x7f72ec0a7670 2021-06-25T04:53:03.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72f131b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec14def0 con 0x7f72ec0b0020 2021-06-25T04:53:03.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72eb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72ec0b1930 0x7f72ec0a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72eaffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72ec0a7670 0x7f72ec14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72eb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72ec0b1930 0x7f72ec0a91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38952/0 (socket says 172.21.15.57:38952) 2021-06-25T04:53:03.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72eb7fe700 1 -- 172.21.15.57:0/2284713251 learned_addr learned my addr 172.21.15.57:0/2284713251 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:03.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72ea7fc700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72ec0b0020 0x7f72ec0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72eb7fe700 1 -- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72ec0b0020 msgr2=0x7f72ec0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72eb7fe700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72ec0b0020 0x7f72ec0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72eb7fe700 1 -- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72ec0a7670 msgr2=0x7f72ec14e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72eb7fe700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72ec0a7670 0x7f72ec14e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72eb7fe700 1 -- 172.21.15.57:0/2284713251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e000b1e0 con 0x7f72ec0b1930 2021-06-25T04:53:03.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72eb7fe700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72ec0b1930 0x7f72ec0a91b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f72ec06a0a0 tx=0x7f72e4007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:03.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72dbfff700 1 -- 172.21.15.57:0/2284713251 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72e4012400 con 0x7f72ec0b1930 2021-06-25T04:53:03.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72dbfff700 1 -- 172.21.15.57:0/2284713251 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e4012560 con 0x7f72ec0b1930 2021-06-25T04:53:03.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72f131b700 1 -- 172.21.15.57:0/2284713251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec0ae270 con 0x7f72ec0b1930 2021-06-25T04:53:03.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72dbfff700 1 -- 172.21.15.57:0/2284713251 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72e40128c0 con 0x7f72ec0b1930 2021-06-25T04:53:03.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72f131b700 1 -- 172.21.15.57:0/2284713251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec14da50 con 0x7f72ec0b1930 2021-06-25T04:53:03.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.187+0000 7f72dbfff700 1 -- 172.21.15.57:0/2284713251 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f72e4019030 con 0x7f72ec0b1930 2021-06-25T04:53:03.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.191+0000 7f72f131b700 1 -- 172.21.15.57:0/2284713251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ec057310 con 0x7f72ec0b1930 2021-06-25T04:53:03.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.191+0000 7f72dbfff700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f72c80553d0 0x7f72c8057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.191+0000 7f72dbfff700 1 -- 172.21.15.57:0/2284713251 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f72e406d150 con 0x7f72ec0b1930 2021-06-25T04:53:03.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.191+0000 7f72eaffd700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f72c80553d0 0x7f72c8057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.191+0000 7f72eaffd700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f72c80553d0 0x7f72c8057890 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f72e001b000 tx=0x7f72e0015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:03.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.195+0000 7f72dbfff700 1 -- 172.21.15.57:0/2284713251 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f72e40432a0 con 0x7f72ec0b1930 2021-06-25T04:53:03.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.367+0000 7f72f131b700 1 -- 172.21.15.57:0/2284713251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72ec14dc10 con 0x7f72ec0b1930 2021-06-25T04:53:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.367+0000 7f72dbfff700 1 -- 172.21.15.57:0/2284713251 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f72e40468c0 con 0x7f72ec0b1930 2021-06-25T04:53:03.372 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:03.372 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4117950639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4117950639},{"type":"v1","addr":"172.21.15.87:6835","nonce":4117950639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5477,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3471432498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3471432498},{"type":"v1","addr":"172.21.15.57:6833","nonce":3471432498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:52:43.642049+0000","modified":"2021-06-25T04:52:44.644941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3818355049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3818355049},{"type":"v1","addr":"172.21.15.57:6835","nonce":3818355049}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-06-25T04:53:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 -- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f72c80553d0 msgr2=0x7f72c8057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f72c80553d0 0x7f72c8057890 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f72e001b000 tx=0x7f72e0015000).stop 2021-06-25T04:53:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 -- 172.21.15.57:0/2284713251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72ec0b1930 msgr2=0x7f72ec0a91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72ec0b1930 0x7f72ec0a91b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f72ec06a0a0 tx=0x7f72e4007bc0).stop 2021-06-25T04:53:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 -- 172.21.15.57:0/2284713251 shutdown_connections 2021-06-25T04:53:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f72c80553d0 0x7f72c8057890 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72ec0b1930 0x7f72ec0a91b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72ec0b0020 0x7f72ec0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 --2- 172.21.15.57:0/2284713251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72ec0a7670 0x7f72ec14e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 -- 172.21.15.57:0/2284713251 >> 172.21.15.57:0/2284713251 conn(0x7f72ec0b53a0 msgr2=0x7f72ec14a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 -- 172.21.15.57:0/2284713251 shutdown_connections 2021-06-25T04:53:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.371+0000 7f72f131b700 1 -- 172.21.15.57:0/2284713251 wait complete. 2021-06-25T04:53:03.377 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 31 2021-06-25T04:53:03.384 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 10 2021-06-25T04:53:03.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.487+0000 7f3d497e7700 1 Processor -- start 2021-06-25T04:53:03.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d497e7700 1 -- start start 2021-06-25T04:53:03.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d497e7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3d440b4650 0x7f3d44140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d497e7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d44143b20 con 0x7f3d44146910 2021-06-25T04:53:03.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d497e7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d44143dc0 con 0x7f3d440b4140 2021-06-25T04:53:03.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d497e7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d441474d0 con 0x7f3d440b4650 2021-06-25T04:53:03.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d42ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3d44146910 0x7f3d441401f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56174/0 (socket says 172.21.15.57:56174) 2021-06-25T04:53:03.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d42ffd700 1 -- 172.21.15.57:0/3319783304 learned_addr learned my addr 172.21.15.57:0/3319783304 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:03.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d437fe700 1 --2- 172.21.15.57:0/3319783304 >> v2:172.21.15.87:3300/0 conn(0x7f3d440b4650 0x7f3d44140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d41ffb700 1 -- 172.21.15.57:0/3319783304 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523239762 0 0) 0x7f3d44143b20 con 0x7f3d44146910 2021-06-25T04:53:03.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d41ffb700 1 -- 172.21.15.57:0/3319783304 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d28003260 con 0x7f3d44146910 2021-06-25T04:53:03.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d437fe700 1 -- 172.21.15.57:0/3319783304 >> v1:172.21.15.87:6789/0 conn(0x7f3d440b4140 legacy=0x7f3d440b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d437fe700 1 -- 172.21.15.57:0/3319783304 >> v1:172.21.15.57:6789/0 conn(0x7f3d44146910 legacy=0x7f3d441401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d41ffb700 1 -- 172.21.15.57:0/3319783304 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861874828 0 0) 0x7f3d28003260 con 0x7f3d44146910 2021-06-25T04:53:03.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d437fe700 1 -- 172.21.15.57:0/3319783304 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d440b0c50 con 0x7f3d440b4650 2021-06-25T04:53:03.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d437fe700 1 --2- 172.21.15.57:0/3319783304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d440b4650 0x7f3d44140900 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f3d38001800 tx=0x7f3d3c0091d0).ready entity=mon.1 client_cookie=34417ea29ebc7b5f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:03.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d41ffb700 1 -- 172.21.15.57:0/3319783304 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d38001660 con 0x7f3d440b4650 2021-06-25T04:53:03.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d41ffb700 1 -- 172.21.15.57:0/3319783304 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c00b580 con 0x7f3d440b4650 2021-06-25T04:53:03.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d41ffb700 1 -- 172.21.15.57:0/3319783304 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3c00b6f0 con 0x7f3d440b4650 2021-06-25T04:53:03.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d497e7700 1 -- 172.21.15.57:0/3319783304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d440b4650 msgr2=0x7f3d44140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.491+0000 7f3d497e7700 1 --2- 172.21.15.57:0/3319783304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d440b4650 0x7f3d44140900 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f3d38001800 tx=0x7f3d3c0091d0).stop 2021-06-25T04:53:03.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 -- 172.21.15.57:0/3319783304 shutdown_connections 2021-06-25T04:53:03.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 --2- 172.21.15.57:0/3319783304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d440b4650 0x7f3d44140900 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 -- 172.21.15.57:0/3319783304 >> 172.21.15.57:0/3319783304 conn(0x7f3d4405c450 msgr2=0x7f3d4405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:03.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 -- 172.21.15.57:0/3319783304 shutdown_connections 2021-06-25T04:53:03.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 -- 172.21.15.57:0/3319783304 wait complete. 2021-06-25T04:53:03.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 Processor -- start 2021-06-25T04:53:03.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 -- start start 2021-06-25T04:53:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d440b4140 0x7f3d440b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d440b4650 0x7f3d440afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d44146910 0x7f3d4413c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4413af70 con 0x7f3d440b4650 2021-06-25T04:53:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d44141010 con 0x7f3d44146910 2021-06-25T04:53:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d497e7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440b6b10 con 0x7f3d440b4140 2021-06-25T04:53:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d427fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d440b4650 0x7f3d440afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d437fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d44146910 0x7f3d4413c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d427fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d440b4650 0x7f3d440afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38962/0 (socket says 172.21.15.57:38962) 2021-06-25T04:53:03.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d42ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d440b4140 0x7f3d440b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.495+0000 7f3d427fc700 1 -- 172.21.15.57:0/3227624987 learned_addr learned my addr 172.21.15.57:0/3227624987 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:03.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d437fe700 1 -- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d440b4140 msgr2=0x7f3d440b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d437fe700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d440b4140 0x7f3d440b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d437fe700 1 -- 172.21.15.57:0/3227624987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d440b4650 msgr2=0x7f3d440afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d437fe700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d440b4650 0x7f3d440afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d437fe700 1 -- 172.21.15.57:0/3227624987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c009470 con 0x7f3d44146910 2021-06-25T04:53:03.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d437fe700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d44146910 0x7f3d4413c6d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f3d44140f30 tx=0x7f3d3c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:03.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d33fff700 1 -- 172.21.15.57:0/3227624987 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3c0032f0 con 0x7f3d44146910 2021-06-25T04:53:03.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d33fff700 1 -- 172.21.15.57:0/3227624987 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c00be80 con 0x7f3d44146910 2021-06-25T04:53:03.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d497e7700 1 -- 172.21.15.57:0/3227624987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d440b74d0 con 0x7f3d44146910 2021-06-25T04:53:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d33fff700 1 -- 172.21.15.57:0/3227624987 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3c011cd0 con 0x7f3d44146910 2021-06-25T04:53:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d497e7700 1 -- 172.21.15.57:0/3227624987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d440ae5c0 con 0x7f3d44146910 2021-06-25T04:53:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d33fff700 1 -- 172.21.15.57:0/3227624987 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3d3c00f070 con 0x7f3d44146910 2021-06-25T04:53:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.499+0000 7f3d33fff700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d20055450 0x7f3d20057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d33fff700 1 -- 172.21.15.57:0/3227624987 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3d3c06efc0 con 0x7f3d44146910 2021-06-25T04:53:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d42ffd700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d20055450 0x7f3d20057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d42ffd700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d20055450 0x7f3d20057910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f3d3800d000 tx=0x7f3d38000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:03.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d53a37740 1 Processor -- start 2021-06-25T04:53:03.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d53a37740 1 -- start start 2021-06-25T04:53:03.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x180b200 0x1806490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1806980 0x1806de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17cc7b0 0x17ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d53a37740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x1740610 con 0x17cc7b0 2021-06-25T04:53:03.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d53a37740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x1740750 con 0x1806980 2021-06-25T04:53:03.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d53a37740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x1741e20 con 0x180b200 2021-06-25T04:53:03.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17cc7b0 0x17ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17cc7b0 0x17ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38974/0 (socket says 172.21.15.57:38974) 2021-06-25T04:53:03.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d437fe700 1 -- 172.21.15.57:0/2678701237 learned_addr learned my addr 172.21.15.57:0/2678701237 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:03.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d427fc700 1 --2- 172.21.15.57:0/2678701237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1806980 0x1806de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d42ffd700 1 --2- 172.21.15.57:0/2678701237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x180b200 0x1806490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d437fe700 1 -- 172.21.15.57:0/2678701237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x180b200 msgr2=0x1806490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:03.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d437fe700 1 --2- 172.21.15.57:0/2678701237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x180b200 0x1806490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d437fe700 1 -- 172.21.15.57:0/2678701237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1806980 msgr2=0x1806de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:03.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d437fe700 1 --2- 172.21.15.57:0/2678701237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1806980 0x1806de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d437fe700 1 -- 172.21.15.57:0/2678701237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1779970 con 0x17cc7b0 2021-06-25T04:53:03.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d42ffd700 1 --2- 172.21.15.57:0/2678701237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x180b200 0x1806490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:03.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d427fc700 1 --2- 172.21.15.57:0/2678701237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1806980 0x1806de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:03.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.503+0000 7f3d437fe700 1 --2- 172.21.15.57:0/2678701237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17cc7b0 0x17ccc30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f3d3c06f1d0 tx=0x7f3d3c012000).ready entity=mon.0 client_cookie=6bab9118ead972ea server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:03.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d497e7700 1 -- 172.21.15.57:0/2678701237 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3c02f070 con 0x17cc7b0 2021-06-25T04:53:03.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d497e7700 1 -- 172.21.15.57:0/2678701237 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c011e30 con 0x17cc7b0 2021-06-25T04:53:03.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d497e7700 1 -- 172.21.15.57:0/2678701237 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3c048cc0 con 0x17cc7b0 2021-06-25T04:53:03.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d53a37740 1 -- 172.21.15.57:0/2678701237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17cc7b0 msgr2=0x17ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d53a37740 1 --2- 172.21.15.57:0/2678701237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17cc7b0 0x17ccc30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f3d3c06f1d0 tx=0x7f3d3c012000).stop 2021-06-25T04:53:03.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d53a37740 1 -- 172.21.15.57:0/2678701237 shutdown_connections 2021-06-25T04:53:03.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d53a37740 1 --2- 172.21.15.57:0/2678701237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17cc7b0 0x17ccc30 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d53a37740 1 --2- 172.21.15.57:0/2678701237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x1806980 0x1806de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d53a37740 1 --2- 172.21.15.57:0/2678701237 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x180b200 0x1806490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d53a37740 1 -- 172.21.15.57:0/2678701237 >> 172.21.15.57:0/2678701237 conn(0x17ce550 msgr2=0x17cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:03.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d53a37740 1 -- 172.21.15.57:0/2678701237 shutdown_connections 2021-06-25T04:53:03.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d53a37740 1 -- 172.21.15.57:0/2678701237 wait complete. 2021-06-25T04:53:03.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d53a37740 1 -- start start 2021-06-25T04:53:03.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.507+0000 7f3d53a37740 1 Processor -- start 2021-06-25T04:53:03.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1806980 0x17cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x180b200 0x17d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x17d2060 0x17ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x1805d30 con 0x180b200 2021-06-25T04:53:03.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x17d3730 con 0x17d2060 2021-06-25T04:53:03.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x17d5020 con 0x1806980 2021-06-25T04:53:03.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 10 client.0 ll_register_callbacks cb 0x178ae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-06-25T04:53:03.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d427fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x180b200 0x17d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d427fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x180b200 0x17d1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38978/0 (socket says 172.21.15.57:38978) 2021-06-25T04:53:03.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d427fc700 1 -- 172.21.15.57:0/2106258612 learned_addr learned my addr 172.21.15.57:0/2106258612 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:03.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d42ffd700 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1806980 0x17cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d437fe700 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x17d2060 0x17ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d427fc700 1 -- 172.21.15.57:0/2106258612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1806980 msgr2=0x17cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:03.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d427fc700 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1806980 0x17cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d427fc700 1 -- 172.21.15.57:0/2106258612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x17d2060 msgr2=0x17ff5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:03.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d427fc700 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x17d2060 0x17ff5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d427fc700 1 -- 172.21.15.57:0/2106258612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d440ae5c0 con 0x180b200 2021-06-25T04:53:03.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d427fc700 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x180b200 0x17d1080 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f3d34003000 tx=0x7f3d34009040).ready entity=mon.0 client_cookie=6bcc00898d403b10 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:03.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2021-06-25T04:53:03.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d1dffb700 1 -- 172.21.15.57:0/2106258612 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d34003040 con 0x180b200 2021-06-25T04:53:03.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 1 -- 172.21.15.57:0/2106258612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x15bac70 con 0x180b200 2021-06-25T04:53:03.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d1dffb700 1 -- 172.21.15.57:0/2106258612 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3d34016e00 con 0x180b200 2021-06-25T04:53:03.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d1dffb700 1 -- 172.21.15.57:0/2106258612 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d34011d60 con 0x180b200 2021-06-25T04:53:03.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 10 client.6159 fetch_fsmap learned FSMap version 31 2021-06-25T04:53:03.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 1 -- 172.21.15.57:0/2106258612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x1730cb0 con 0x180b200 2021-06-25T04:53:03.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d1dffb700 1 -- 172.21.15.57:0/2106258612 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x15bac70 con 0x180b200 2021-06-25T04:53:03.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d1dffb700 1 -- 172.21.15.57:0/2106258612 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f3d34013040 con 0x180b200 2021-06-25T04:53:03.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 10 client.6159 fetch_fsmap finished waiting for FSMap version 31 2021-06-25T04:53:03.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 10 client.6159 resolve_mds: resolved ID 'a' to GID 5985 2021-06-25T04:53:03.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 20 client.6159 populate_metadata read hostname 'smithi057' 2021-06-25T04:53:03.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.57:6834/3818355049,v1:172.21.15.57:6835/3818355049] conn(0x1819610 0x18199f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 4 client.6159 mds_command: new command op to 5985 tid=0[{"prefix": "get_command_descriptions"}] 2021-06-25T04:53:03.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d53a37740 1 -- 172.21.15.57:0/2106258612 --> [v2:172.21.15.57:6834/3818355049,v1:172.21.15.57:6835/3818355049] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x15d04b0 con 0x1819610 2021-06-25T04:53:03.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d42ffd700 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.57:6834/3818355049,v1:172.21.15.57:6835/3818355049] conn(0x1819610 0x18199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d1dffb700 10 client.6159 ms_handle_connect on v2:172.21.15.57:6834/3818355049 2021-06-25T04:53:03.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.511+0000 7f3d42ffd700 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.57:6834/3818355049,v1:172.21.15.57:6835/3818355049] conn(0x1819610 0x18199f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=73d564f92e5c5a09 server_cookie=cbd31c7a729c4c79 in_seq=0 out_seq=0 2021-06-25T04:53:03.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d1dffb700 1 -- 172.21.15.57:0/2106258612 <== mds.0 v2:172.21.15.57:6834/3818355049 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x15d04b0 con 0x1819610 2021-06-25T04:53:03.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d1dffb700 10 client.6159 handle_command_reply: tid=0 2021-06-25T04:53:03.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 1 client.6159 shutdown 2021-06-25T04:53:03.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 1 -- 172.21.15.57:0/2106258612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x180b200 msgr2=0x17d1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x180b200 0x17d1080 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f3d34003000 tx=0x7f3d34009040).stop 2021-06-25T04:53:03.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 1 -- 172.21.15.57:0/2106258612 shutdown_connections 2021-06-25T04:53:03.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.57:6834/3818355049,v1:172.21.15.57:6835/3818355049] conn(0x1819610 0x18199f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x17d2060 0x17ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x180b200 0x17d1080 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 1 --2- 172.21.15.57:0/2106258612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1806980 0x17cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d1dffb700 0 client.6159 ms_handle_reset on v2:172.21.15.57:6834/3818355049 2021-06-25T04:53:03.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 1 -- 172.21.15.57:0/2106258612 >> 172.21.15.57:0/2106258612 conn(0x17cc7b0 msgr2=0x180b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:03.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 1 -- 172.21.15.57:0/2106258612 shutdown_connections 2021-06-25T04:53:03.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 1 -- 172.21.15.57:0/2106258612 wait complete. 2021-06-25T04:53:03.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.515+0000 7f3d53a37740 20 client.6159 trim_cache size 0 max 16384 2021-06-25T04:53:03.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.527+0000 7f3d53a37740 1 Processor -- start 2021-06-25T04:53:03.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.527+0000 7f3d53a37740 1 -- start start 2021-06-25T04:53:03.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x17d2060 0x1806f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1806980 0x17ff370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x180b200 0x1813170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x1801a20 con 0x1806980 2021-06-25T04:53:03.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x17932e0 con 0x180b200 2021-06-25T04:53:03.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x17cf6e0 con 0x17d2060 2021-06-25T04:53:03.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d427fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1806980 0x17ff370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d427fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1806980 0x17ff370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38984/0 (socket says 172.21.15.57:38984) 2021-06-25T04:53:03.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d427fc700 1 -- 172.21.15.57:0/1648684500 learned_addr learned my addr 172.21.15.57:0/1648684500 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:03.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d42ffd700 1 --2- 172.21.15.57:0/1648684500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x17d2060 0x1806f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d437fe700 1 --2- 172.21.15.57:0/1648684500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x180b200 0x1813170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d427fc700 1 -- 172.21.15.57:0/1648684500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x17d2060 msgr2=0x1806f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:03.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d427fc700 1 --2- 172.21.15.57:0/1648684500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x17d2060 0x1806f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d427fc700 1 -- 172.21.15.57:0/1648684500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x180b200 msgr2=0x1813170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:03.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d427fc700 1 --2- 172.21.15.57:0/1648684500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x180b200 0x1813170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d427fc700 1 -- 172.21.15.57:0/1648684500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d44145430 con 0x1806980 2021-06-25T04:53:03.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d427fc700 1 --2- 172.21.15.57:0/1648684500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1806980 0x17ff370 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x17d3570 tx=0x7f3d34018000).ready entity=mon.0 client_cookie=eed76aa245d9c19a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:03.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d1ffff700 1 -- 172.21.15.57:0/1648684500 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d34003040 con 0x1806980 2021-06-25T04:53:03.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d1ffff700 1 -- 172.21.15.57:0/1648684500 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d34014b50 con 0x1806980 2021-06-25T04:53:03.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d1ffff700 1 -- 172.21.15.57:0/1648684500 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d340143d0 con 0x1806980 2021-06-25T04:53:03.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 -- 172.21.15.57:0/1648684500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1806980 msgr2=0x17ff370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:03.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 --2- 172.21.15.57:0/1648684500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1806980 0x17ff370 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x17d3570 tx=0x7f3d34018000).stop 2021-06-25T04:53:03.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 -- 172.21.15.57:0/1648684500 shutdown_connections 2021-06-25T04:53:03.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 --2- 172.21.15.57:0/1648684500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x180b200 0x1813170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 --2- 172.21.15.57:0/1648684500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1806980 0x17ff370 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 --2- 172.21.15.57:0/1648684500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x17d2060 0x1806f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 -- 172.21.15.57:0/1648684500 >> 172.21.15.57:0/1648684500 conn(0x17cc7b0 msgr2=0x180b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:03.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 -- 172.21.15.57:0/1648684500 shutdown_connections 2021-06-25T04:53:03.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 -- 172.21.15.57:0/1648684500 wait complete. 2021-06-25T04:53:03.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 -- start start 2021-06-25T04:53:03.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.531+0000 7f3d53a37740 1 Processor -- start 2021-06-25T04:53:03.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17d2060 0x18072f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1806980 0x1813550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x180b200 0x18690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x1819a80 con 0x17d2060 2021-06-25T04:53:03.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x180a6b0 con 0x180b200 2021-06-25T04:53:03.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x17d2cc0 con 0x1806980 2021-06-25T04:53:03.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 10 client.0 ll_register_callbacks cb 0x17d33f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-06-25T04:53:03.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d42ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17d2060 0x18072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d42ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17d2060 0x18072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38990/0 (socket says 172.21.15.57:38990) 2021-06-25T04:53:03.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d42ffd700 1 -- 172.21.15.57:0/91119123 learned_addr learned my addr 172.21.15.57:0/91119123 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:03.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d437fe700 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x180b200 0x18690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d427fc700 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1806980 0x1813550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d42ffd700 1 -- 172.21.15.57:0/91119123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1806980 msgr2=0x1813550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:03.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d42ffd700 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1806980 0x1813550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d42ffd700 1 -- 172.21.15.57:0/91119123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x180b200 msgr2=0x18690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:03.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d42ffd700 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x180b200 0x18690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:03.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d42ffd700 1 -- 172.21.15.57:0/91119123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1730cb0 con 0x17d2060 2021-06-25T04:53:03.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d1effd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2021-06-25T04:53:03.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d42ffd700 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17d2060 0x18072f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f3d38014000 tx=0x7f3d38019040).ready entity=mon.0 client_cookie=b03fb37c0b4517d2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:03.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d1effd700 1 -- 172.21.15.57:0/91119123 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d38025950 con 0x17d2060 2021-06-25T04:53:03.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 1 -- 172.21.15.57:0/91119123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x164b820 con 0x17d2060 2021-06-25T04:53:03.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d1effd700 1 -- 172.21.15.57:0/91119123 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3d38025ab0 con 0x17d2060 2021-06-25T04:53:03.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d1effd700 1 -- 172.21.15.57:0/91119123 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d38025c70 con 0x17d2060 2021-06-25T04:53:03.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 10 client.6165 fetch_fsmap learned FSMap version 31 2021-06-25T04:53:03.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 1 -- 172.21.15.57:0/91119123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x1736290 con 0x17d2060 2021-06-25T04:53:03.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d1effd700 1 -- 172.21.15.57:0/91119123 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d38034070 con 0x17d2060 2021-06-25T04:53:03.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d1effd700 1 -- 172.21.15.57:0/91119123 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f3d38023030 con 0x17d2060 2021-06-25T04:53:03.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 10 client.6165 fetch_fsmap finished waiting for FSMap version 31 2021-06-25T04:53:03.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 10 client.6165 resolve_mds: resolved ID 'a' to GID 5985 2021-06-25T04:53:03.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 20 client.6165 populate_metadata read hostname 'smithi057' 2021-06-25T04:53:03.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.57:6834/3818355049,v1:172.21.15.57:6835/3818355049] conn(0x180a1c0 0x1866430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:03.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 4 client.6165 mds_command: new command op to 5985 tid=0[{"prefix": "cache drop", "timeout": 10}] 2021-06-25T04:53:03.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d53a37740 1 -- 172.21.15.57:0/91119123 --> [v2:172.21.15.57:6834/3818355049,v1:172.21.15.57:6835/3818355049] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0x1869660 con 0x180a1c0 2021-06-25T04:53:03.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d427fc700 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.57:6834/3818355049,v1:172.21.15.57:6835/3818355049] conn(0x180a1c0 0x1866430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:03.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d1effd700 10 client.6165 ms_handle_connect on v2:172.21.15.57:6834/3818355049 2021-06-25T04:53:03.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:03.535+0000 7f3d427fc700 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.57:6834/3818355049,v1:172.21.15.57:6835/3818355049] conn(0x180a1c0 0x1866430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5d5a4ce7317617c6 server_cookie=a640227f6033ad6e in_seq=0 out_seq=0 2021-06-25T04:53:07.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:53:07.725 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:53:07.729 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:53:07.732 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:53:13.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d1effd700 1 -- 172.21.15.57:0/91119123 <== mds.0 v2:172.21.15.57:6834/3818355049 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+400 (crc 0 0 0) 0x1869660 con 0x180a1c0 2021-06-25T04:53:13.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d1effd700 10 client.6165 handle_command_reply: tid=0 2021-06-25T04:53:13.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 1 client.6165 shutdown 2021-06-25T04:53:13.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 1 -- 172.21.15.57:0/91119123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17d2060 msgr2=0x18072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:13.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17d2060 0x18072f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f3d38014000 tx=0x7f3d38019040).stop 2021-06-25T04:53:13.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 1 -- 172.21.15.57:0/91119123 shutdown_connections 2021-06-25T04:53:13.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.57:6834/3818355049,v1:172.21.15.57:6835/3818355049] conn(0x180a1c0 0x1866430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:13.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x180b200 0x18690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:13.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d1effd700 0 client.6165 ms_handle_reset on v2:172.21.15.57:6834/3818355049 2021-06-25T04:53:13.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x1806980 0x1813550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:13.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 1 --2- 172.21.15.57:0/91119123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x17d2060 0x18072f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:13.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 1 -- 172.21.15.57:0/91119123 >> 172.21.15.57:0/91119123 conn(0x17cc7b0 msgr2=0x180b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:13.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 1 -- 172.21.15.57:0/91119123 shutdown_connections 2021-06-25T04:53:13.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 1 -- 172.21.15.57:0/91119123 wait complete. 2021-06-25T04:53:13.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.782+0000 7f3d53a37740 20 client.6165 trim_cache size 0 max 16384 2021-06-25T04:53:13.793 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:53:13.793 INFO:teuthology.orchestra.run.smithi057.stdout: "client_recall": { 2021-06-25T04:53:13.794 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": -110, 2021-06-25T04:53:13.794 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "(110) Connection timed out", 2021-06-25T04:53:13.794 INFO:teuthology.orchestra.run.smithi057.stdout: "recalled": 240 2021-06-25T04:53:13.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:13.795 INFO:teuthology.orchestra.run.smithi057.stdout: "flush_journal": { 2021-06-25T04:53:13.795 INFO:teuthology.orchestra.run.smithi057.stdout: "return_code": 0, 2021-06-25T04:53:13.795 INFO:teuthology.orchestra.run.smithi057.stdout: "message": "" 2021-06-25T04:53:13.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:13.795 INFO:teuthology.orchestra.run.smithi057.stdout: "trim_cache": { 2021-06-25T04:53:13.796 INFO:teuthology.orchestra.run.smithi057.stdout: "trimmed": 220 2021-06-25T04:53:13.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:13.796 INFO:teuthology.orchestra.run.smithi057.stdout: "cache": { 2021-06-25T04:53:13.796 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": { 2021-06-25T04:53:13.797 INFO:teuthology.orchestra.run.smithi057.stdout: "items": 15424, 2021-06-25T04:53:13.797 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes": 2428272 2021-06-25T04:53:13.797 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:13.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:13.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 10.247011827 2021-06-25T04:53:13.798 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:53:13.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 -- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d20055450 msgr2=0x7f3d20057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:13.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d20055450 0x7f3d20057910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f3d3800d000 tx=0x7f3d38000bc0).stop 2021-06-25T04:53:13.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 -- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d44146910 msgr2=0x7f3d4413c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:13.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d44146910 0x7f3d4413c6d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f3d44140f30 tx=0x7f3d3c016000).stop 2021-06-25T04:53:13.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 -- 172.21.15.57:0/3227624987 shutdown_connections 2021-06-25T04:53:13.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d20055450 0x7f3d20057910 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:13.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d44146910 0x7f3d4413c6d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:13.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d440b4650 0x7f3d440afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:13.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 --2- 172.21.15.57:0/3227624987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d440b4140 0x7f3d440b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:13.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 -- 172.21.15.57:0/3227624987 >> 172.21.15.57:0/3227624987 conn(0x7f3d4405c450 msgr2=0x7f3d4413f250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:13.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 -- 172.21.15.57:0/3227624987 shutdown_connections 2021-06-25T04:53:13.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:13.786+0000 7f3d497e7700 1 -- 172.21.15.57:0/3227624987 wait complete. 2021-06-25T04:53:13.803 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:53:13.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:53:13.822 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:53:13.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:53:13.866 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:53:13.887 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:53:13.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:13.888 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:53:13.889 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:53:13.919 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:53:13.919 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:53:13.920 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:53:13.920 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:53:13.921 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:53:13.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14890]: fuse finished with error 0 and tester_r 0 2021-06-25T04:53:13.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:13.939 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:53:13.939 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:53:13.985 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:53:13.987 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:53:14.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:53:14.104 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:53:14.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:14.110 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:53:14.111 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:53:14.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:53:14.120 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:53:14.121 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:53:14.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:53:14.122 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:53:14.171 INFO:teuthology.orchestra.run.smithi161.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:53:14.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:53:14.173 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:53:14.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a836cb700 1 Processor -- start 2021-06-25T04:53:14.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a836cb700 1 -- start start 2021-06-25T04:53:14.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a836cb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5a7c067140 0x7f5a7c05f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:14.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a836cb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7c0a7a50 con 0x7f5a7c0b1930 2021-06-25T04:53:14.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a836cb700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7c1475e0 con 0x7f5a7c0a7670 2021-06-25T04:53:14.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a836cb700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c147880 con 0x7f5a7c067140 2021-06-25T04:53:14.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a80c66700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5a7c067140 0x7f5a7c05f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:14.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a80c66700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5a7c067140 0x7f5a7c05f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39000/0 (socket says 172.21.15.57:39000) 2021-06-25T04:53:14.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a80c66700 1 -- 172.21.15.57:0/1387266195 learned_addr learned my addr 172.21.15.57:0/1387266195 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:14.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a81c68700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5a7c0b1930 0x7f5a7c05fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56222/0 (socket says 172.21.15.57:56222) 2021-06-25T04:53:14.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a80c66700 1 -- 172.21.15.57:0/1387266195 >> v1:172.21.15.87:6789/0 conn(0x7f5a7c0a7670 legacy=0x7f5a7c066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:14.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a80c66700 1 -- 172.21.15.57:0/1387266195 >> v1:172.21.15.57:6789/0 conn(0x7f5a7c0b1930 legacy=0x7f5a7c05fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a80c66700 1 -- 172.21.15.57:0/1387266195 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c147b20 con 0x7f5a7c067140 2021-06-25T04:53:14.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a80c66700 1 --2- 172.21.15.57:0/1387266195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a7c067140 0x7f5a7c05f670 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f5a7c06a140 tx=0x7f5a6c009290).ready entity=mon.0 client_cookie=672ad2833c1b94ef server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:14.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a7bfff700 1 -- 172.21.15.57:0/1387266195 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a6c00b830 con 0x7f5a7c067140 2021-06-25T04:53:14.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a7bfff700 1 -- 172.21.15.57:0/1387266195 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c00b990 con 0x7f5a7c067140 2021-06-25T04:53:14.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a7bfff700 1 -- 172.21.15.57:0/1387266195 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a6c00bb00 con 0x7f5a7c067140 2021-06-25T04:53:14.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a836cb700 1 -- 172.21.15.57:0/1387266195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a7c067140 msgr2=0x7f5a7c05f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a836cb700 1 --2- 172.21.15.57:0/1387266195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a7c067140 0x7f5a7c05f670 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f5a7c06a140 tx=0x7f5a6c009290).stop 2021-06-25T04:53:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a836cb700 1 -- 172.21.15.57:0/1387266195 shutdown_connections 2021-06-25T04:53:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a836cb700 1 --2- 172.21.15.57:0/1387266195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a7c067140 0x7f5a7c05f670 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.278+0000 7f5a836cb700 1 -- 172.21.15.57:0/1387266195 >> 172.21.15.57:0/1387266195 conn(0x7f5a7c0b53a0 msgr2=0x7f5a7c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:14.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a836cb700 1 -- 172.21.15.57:0/1387266195 shutdown_connections 2021-06-25T04:53:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a836cb700 1 -- 172.21.15.57:0/1387266195 wait complete. 2021-06-25T04:53:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a836cb700 1 Processor -- start 2021-06-25T04:53:14.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a836cb700 1 -- start start 2021-06-25T04:53:14.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a836cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a7c067140 0x7f5a7c0aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:14.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a836cb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a7c0a7670 0x7f5a7c144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:14.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a836cb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b1930 0x7f5a7c144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:14.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a836cb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0ac310 con 0x7f5a7c067140 2021-06-25T04:53:14.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a836cb700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0ad680 con 0x7f5a7c0b1930 2021-06-25T04:53:14.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a836cb700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0ac030 con 0x7f5a7c0a7670 2021-06-25T04:53:14.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a81467700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a7c067140 0x7f5a7c0aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:14.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a81c68700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b1930 0x7f5a7c144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:14.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a81c68700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b1930 0x7f5a7c144b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:47504/0 (socket says 172.21.15.57:47504) 2021-06-25T04:53:14.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a81c68700 1 -- 172.21.15.57:0/1952434075 learned_addr learned my addr 172.21.15.57:0/1952434075 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:14.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a81467700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a7c067140 0x7f5a7c0aaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39006/0 (socket says 172.21.15.57:39006) 2021-06-25T04:53:14.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a80c66700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a7c0a7670 0x7f5a7c144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:14.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a81467700 1 -- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a7c0a7670 msgr2=0x7f5a7c144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a81467700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a7c0a7670 0x7f5a7c144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a81467700 1 -- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b1930 msgr2=0x7f5a7c144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a81467700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b1930 0x7f5a7c144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a81467700 1 -- 172.21.15.57:0/1952434075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c009530 con 0x7f5a7c067140 2021-06-25T04:53:14.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.282+0000 7f5a81467700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a7c067140 0x7f5a7c0aaca0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f5a64001fa0 tx=0x7f5a64007b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:14.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.286+0000 7f5a7a7fc700 1 -- 172.21.15.57:0/1952434075 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a64007030 con 0x7f5a7c067140 2021-06-25T04:53:14.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.286+0000 7f5a7a7fc700 1 -- 172.21.15.57:0/1952434075 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a64007190 con 0x7f5a7c067140 2021-06-25T04:53:14.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.286+0000 7f5a836cb700 1 -- 172.21.15.57:0/1952434075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c0ac620 con 0x7f5a7c067140 2021-06-25T04:53:14.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.286+0000 7f5a7a7fc700 1 -- 172.21.15.57:0/1952434075 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a64006510 con 0x7f5a7c067140 2021-06-25T04:53:14.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.286+0000 7f5a836cb700 1 -- 172.21.15.57:0/1952434075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c0ad170 con 0x7f5a7c067140 2021-06-25T04:53:14.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.286+0000 7f5a836cb700 1 -- 172.21.15.57:0/1952434075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7c0ab4d0 con 0x7f5a7c067140 2021-06-25T04:53:14.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.286+0000 7f5a7a7fc700 1 -- 172.21.15.57:0/1952434075 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5a64010030 con 0x7f5a7c067140 2021-06-25T04:53:14.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.286+0000 7f5a7a7fc700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a60055340 0x7f5a60057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:14.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.286+0000 7f5a7a7fc700 1 -- 172.21.15.57:0/1952434075 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5a6406d9e0 con 0x7f5a7c067140 2021-06-25T04:53:14.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.286+0000 7f5a80c66700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a60055340 0x7f5a60057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:14.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.290+0000 7f5a80c66700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a60055340 0x7f5a60057800 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f5a6c01a000 tx=0x7f5a6c016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:14.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.294+0000 7f5a7a7fc700 1 -- 172.21.15.57:0/1952434075 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5a64043b90 con 0x7f5a7c067140 2021-06-25T04:53:14.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.422+0000 7f5a836cb700 1 -- 172.21.15.57:0/1952434075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5a7c057310 con 0x7f5a7c067140 2021-06-25T04:53:14.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.422+0000 7f5a7a7fc700 1 -- 172.21.15.57:0/1952434075 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v68) v1 ==== 81+0+34040 (secure 0 0 0) 0x7f5a640471b0 con 0x7f5a7c067140 2021-06-25T04:53:14.430 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:14.430 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:53:14.430 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 68, 2021-06-25T04:53:14.430 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:53:14.431 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:53:14.431 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:52:45.658297+0000", 2021-06-25T04:53:14.431 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:53:14.431 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:53:14.432 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:53:14.432 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:53:14.432 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:53:14.433 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:53:14.433 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:53:14.433 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:53:14.434 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:53:14.434 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:53:14.434 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:53:14.434 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:53:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:53:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:53:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:53:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 12, 2021-06-25T04:53:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:53:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:53:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:53:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:53:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:53:14.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.437 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:53:14.437 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:53:14.437 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:53:14.437 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:53:14.438 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:53:14.438 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:53:14.438 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:53:14.438 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:53:14.439 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:53:14.439 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:53:14.439 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:53:14.439 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:53:14.440 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:53:14.440 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:53:14.440 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:53:14.440 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:53:14.440 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:53:14.441 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:53:14.441 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:53:14.441 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:53:14.441 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:53:14.442 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:53:14.442 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:53:14.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.442 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:53:14.443 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:53:14.443 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:53:14.443 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:53:14.443 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:53:14.444 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:53:14.444 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:53:14.444 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:53:14.444 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:53:14.445 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:53:14.445 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:53:14.445 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:53:14.445 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:53:14.446 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:53:14.446 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:53:14.446 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:53:14.446 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:53:14.447 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:53:14.447 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:53:14.447 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:53:14.447 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:53:14.448 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:53:14.448 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:53:14.448 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:53:14.448 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:53:14.449 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:53:14.449 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:53:14.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.449 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:53:14.450 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:53:14.450 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:53:14.450 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:53:14.450 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:53:14.451 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:53:14.451 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:53:14.451 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:53:14.451 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:53:14.452 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:53:14.452 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:53:14.452 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:53:14.452 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:53:14.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.453 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:53:14.453 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:53:14.453 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.454 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:53:14.455 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:53:14.455 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:53:14.455 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:53:14.455 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:53:14.455 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:53:14.456 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:53:14.456 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:53:14.456 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:53:14.456 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:53:14.457 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:53:14.457 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:53:14.457 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:53:14.457 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:53:14.458 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:53:14.458 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:53:14.458 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:53:14.458 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:53:14.459 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:53:14.459 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:53:14.459 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:53:14.459 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:53:14.460 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:53:14.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.460 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:53:14.460 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:53:14.460 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:53:14.461 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:53:14.461 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:53:14.461 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:53:14.461 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:53:14.461 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:53:14.462 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:53:14.462 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:53:14.462 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:53:14.462 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:53:14.463 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:53:14.463 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:53:14.463 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:53:14.463 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:53:14.464 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:53:14.464 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:53:14.464 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:53:14.464 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:53:14.464 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:53:14.465 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:53:14.465 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:53:14.465 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:53:14.465 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:53:14.466 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:53:14.466 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:53:14.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.466 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:53:14.467 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:53:14.467 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:53:14.467 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:53:14.467 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:53:14.468 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:53:14.468 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:53:14.468 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:53:14.468 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:53:14.468 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:53:14.469 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:53:14.469 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:53:14.469 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:53:14.470 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:53:14.470 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.471 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 11, 2021-06-25T04:53:14.471 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:53:14.471 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:52:41.803683+0000", 2021-06-25T04:53:14.471 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:53:14.471 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:53:14.472 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:53:14.472 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:53:14.472 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:53:14.472 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:53:14.473 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:53:14.473 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:53:14.473 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:53:14.473 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:53:14.473 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:53:14.474 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:53:14.474 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:53:14.474 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:53:14.474 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:53:14.475 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:53:14.475 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:53:14.475 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:53:14.475 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:53:14.475 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:53:14.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.476 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "66", 2021-06-25T04:53:14.476 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:53:14.476 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:53:14.477 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:53:14.477 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:53:14.477 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:53:14.477 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:53:14.477 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:53:14.478 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:53:14.478 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:53:14.478 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:53:14.478 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:53:14.479 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:53:14.479 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:53:14.479 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:53:14.479 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:53:14.479 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:53:14.480 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:53:14.480 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:53:14.480 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:53:14.480 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:53:14.480 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:53:14.481 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:53:14.481 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:53:14.481 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:53:14.481 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:53:14.482 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:53:14.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.482 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:53:14.482 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:53:14.483 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:53:14.483 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:53:14.483 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:53:14.483 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:53:14.484 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:53:14.484 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:53:14.484 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:53:14.484 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:53:14.484 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:53:14.485 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:53:14.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:53:14.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:53:14.485 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:53:14.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.486 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:53:14.487 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:53:14.487 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:53:14.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.488 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 12, 2021-06-25T04:53:14.488 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:53:14.489 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:52:42.643832+0000", 2021-06-25T04:53:14.489 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:53:14.489 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:53:14.489 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:53:14.489 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:53:14.490 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:53:14.490 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:53:14.490 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:53:14.490 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:53:14.491 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:53:14.491 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:53:14.491 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:53:14.491 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:53:14.492 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:53:14.492 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:53:14.492 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:53:14.492 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:53:14.492 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:53:14.493 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:53:14.493 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:53:14.493 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:53:14.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.494 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "68", 2021-06-25T04:53:14.494 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:53:14.494 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:53:14.494 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:53:14.495 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:53:14.495 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:53:14.495 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:53:14.495 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:53:14.495 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:53:14.496 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:53:14.496 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:53:14.496 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:53:14.496 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:53:14.497 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:53:14.497 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:53:14.497 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:53:14.497 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:53:14.497 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:53:14.498 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:53:14.498 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:53:14.498 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:53:14.498 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:53:14.499 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:53:14.499 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:53:14.499 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:53:14.499 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:53:14.500 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:53:14.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.500 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:53:14.500 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:53:14.500 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:53:14.501 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:53:14.501 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:53:14.501 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:53:14.501 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:53:14.502 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:53:14.502 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:53:14.502 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:53:14.502 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:53:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:53:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:53:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:53:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:53:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:53:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:53:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:53:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:53:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 65, 2021-06-25T04:53:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:53:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:53:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:53:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:53:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:53:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:53:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:53:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:53:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:53:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:53:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:53:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:53:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:53:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:53:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 65, 2021-06-25T04:53:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:53:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:53:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:53:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:53:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:53:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:53:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:53:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:53:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:53:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:53:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:53:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:53:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:53:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:53:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 64, 2021-06-25T04:53:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:53:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:53:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:53:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:53:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:53:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:53:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:53:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:53:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:53:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:53:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:53:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:53:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:53:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:53:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 52, 2021-06-25T04:53:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:53:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:53:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:53:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:14.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.565 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.565 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:53:14.565 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:14.566 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.566 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.566 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:14.567 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.567 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:53:14.568 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:14.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.568 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.568 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:53:14.569 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:14.569 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.569 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.570 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:14.570 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.570 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.571 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:53:14.571 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:14.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.571 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.572 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:53:14.572 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:14.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.572 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.573 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:53:14.573 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:53:14.573 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:53:14.573 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:53:14.574 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:14.574 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:14.574 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:14.574 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.575 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:53:14.575 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:53:14.575 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:14.576 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:14.576 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:14.576 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:14.576 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:14.577 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:14.577 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:14.577 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 65, 2021-06-25T04:53:14.577 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:14.577 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:14.578 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:14.578 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.579 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:53:14.579 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:14.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.579 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.580 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:53:14.580 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:14.580 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.580 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.581 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:14.581 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.581 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.582 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:53:14.582 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:14.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.582 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.583 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:53:14.583 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:14.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.583 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.584 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:14.584 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.584 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.585 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:53:14.585 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:14.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.586 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.586 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:53:14.586 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:14.586 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.586 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.587 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:14.587 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.588 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.588 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:53:14.588 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:14.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.589 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.589 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:53:14.589 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:14.589 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.590 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.590 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:53:14.590 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:53:14.590 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:53:14.591 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:53:14.591 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:14.591 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:14.591 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:14.591 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.592 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:53:14.592 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:53:14.593 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:14.593 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:14.593 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:14.593 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:14.593 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:14.594 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:14.594 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:14.594 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 64, 2021-06-25T04:53:14.594 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:14.595 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:14.595 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:14.595 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.595 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.596 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:53:14.596 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:14.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.597 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.597 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:53:14.597 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:14.597 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.597 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.598 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:14.598 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.598 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.599 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:53:14.599 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:14.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.600 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.600 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:53:14.600 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:14.600 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.600 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.601 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:14.601 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.602 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.602 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:53:14.602 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:14.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.603 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.603 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:53:14.603 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:14.603 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.604 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.604 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:14.604 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.605 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.605 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:53:14.605 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:14.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.606 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.606 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:53:14.606 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:14.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.607 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.607 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:53:14.607 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:53:14.608 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:53:14.608 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:53:14.608 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:14.608 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:14.609 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:14.609 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.609 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:53:14.610 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:53:14.610 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:14.610 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:14.610 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:14.611 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:14.611 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:14.611 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:14.611 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:14.611 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 65, 2021-06-25T04:53:14.612 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:14.612 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:14.612 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:14.612 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.613 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.613 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:53:14.613 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:14.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.614 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.614 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:53:14.614 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:14.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.615 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:14.615 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.616 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.616 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:53:14.616 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:14.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.617 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.617 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:53:14.617 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:14.618 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.618 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.618 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:14.618 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.619 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.619 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:53:14.619 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:14.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.620 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.620 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:53:14.620 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:14.621 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.621 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.621 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:14.622 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.622 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.622 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:53:14.622 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:14.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.623 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.623 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:53:14.624 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:14.624 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.624 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.624 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:53:14.625 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:53:14.625 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:53:14.625 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:53:14.625 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:14.626 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:14.626 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:14.626 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.627 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:53:14.627 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:53:14.627 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:14.627 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:14.628 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:14.628 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:14.628 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:14.628 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:14.628 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:14.629 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 64, 2021-06-25T04:53:14.629 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:14.629 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:14.629 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:14.630 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.630 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.630 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:53:14.630 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:14.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.631 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:53:14.632 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:14.632 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.632 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.632 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:14.633 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.633 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.633 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:53:14.634 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:14.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.634 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.635 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:53:14.635 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:14.635 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.635 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.636 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:14.636 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.636 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.637 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:53:14.637 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:14.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.637 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.638 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:53:14.638 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:14.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.638 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.639 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:14.639 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:14.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.639 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:14.640 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:53:14.640 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:14.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.641 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:14.641 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:53:14.641 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:14.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.641 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.642 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:53:14.642 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:53:14.642 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:53:14.643 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:53:14.643 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:14.643 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:14.643 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:14.644 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:14.644 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.644 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:53:14.644 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:53:14.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.645 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:53:14.645 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:14.645 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:14.645 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:14.646 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:14.646 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:14.646 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:53:14.646 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:14.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.647 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:53:14.647 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:14.647 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:14.648 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:14.648 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:14.648 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:14.648 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:53:14.648 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:14.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.649 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:53:14.649 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:14.650 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:14.650 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:14.650 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:14.650 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:14.650 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:53:14.651 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:14.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.651 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:53:14.652 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:14.652 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:14.652 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:14.652 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:14.652 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:14.653 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:53:14.653 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:14.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:53:14.654 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:14.654 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:14.654 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:14.654 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:14.655 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:14.655 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:53:14.655 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:14.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.656 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:53:14.656 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:14.656 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:14.656 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:14.657 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:14.657 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:14.657 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:53:14.657 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:14.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:53:14.658 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:14.658 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:14.659 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:14.659 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:14.659 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:14.659 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:53:14.660 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:14.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:14.660 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:53:14.660 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:14.661 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:14.661 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:14.661 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:14.661 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:14.662 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:53:14.662 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:14.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.662 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:53:14.662 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:53:14.663 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:53:14.663 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:53:14.663 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:53:14.663 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": {}, 2021-06-25T04:53:14.664 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:53:14.664 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:53:14.664 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:53:14.664 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:53:14.664 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:53:14.665 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:53:14.665 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:53:14.665 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:53:14.665 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:53:14.666 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:53:14.666 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:53:14.666 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:53:14.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.666 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:53:14.667 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:53:14.667 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:53:14.667 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:53:14.667 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:53:14.668 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:53:14.668 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:53:14.668 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:14.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:14.669 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:53:14.669 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:53:14.669 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:53:14.669 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:53:14.669 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:53:14.670 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:53:14.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 -- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a60055340 msgr2=0x7f5a60057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a60055340 0x7f5a60057800 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f5a6c01a000 tx=0x7f5a6c016000).stop 2021-06-25T04:53:14.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 -- 172.21.15.57:0/1952434075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a7c067140 msgr2=0x7f5a7c0aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a7c067140 0x7f5a7c0aaca0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f5a64001fa0 tx=0x7f5a64007b70).stop 2021-06-25T04:53:14.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 -- 172.21.15.57:0/1952434075 shutdown_connections 2021-06-25T04:53:14.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5a60055340 0x7f5a60057800 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b1930 0x7f5a7c144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a7c0a7670 0x7f5a7c144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 --2- 172.21.15.57:0/1952434075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a7c067140 0x7f5a7c0aaca0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 -- 172.21.15.57:0/1952434075 >> 172.21.15.57:0/1952434075 conn(0x7f5a7c0b53a0 msgr2=0x7f5a7c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:14.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 -- 172.21.15.57:0/1952434075 shutdown_connections 2021-06-25T04:53:14.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.426+0000 7f5a836cb700 1 -- 172.21.15.57:0/1952434075 wait complete. 2021-06-25T04:53:14.675 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:14.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.778+0000 7f16cc8aa700 1 Processor -- start 2021-06-25T04:53:14.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.778+0000 7f16cc8aa700 1 -- start start 2021-06-25T04:53:14.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f16c80b1800 0x7f16c8142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:14.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f16c80b0e30 0x7f16c8142d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:14.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c80b35e0 con 0x7f16c80b3200 2021-06-25T04:53:14.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c81436b0 con 0x7f16c80b0e30 2021-06-25T04:53:14.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c8065c60 con 0x7f16c80b1800 2021-06-25T04:53:14.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c6d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f16c80b0e30 0x7f16c8142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:14.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c6d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f16c80b0e30 0x7f16c8142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39018/0 (socket says 172.21.15.57:39018) 2021-06-25T04:53:14.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c6d9d700 1 -- 172.21.15.57:0/1957765486 learned_addr learned my addr 172.21.15.57:0/1957765486 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:14.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c5d9b700 1 --2- 172.21.15.57:0/1957765486 >> v2:172.21.15.87:3300/0 conn(0x7f16c80b1800 0x7f16c8142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:14.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c6d9d700 1 -- 172.21.15.57:0/1957765486 >> v2:172.21.15.87:3300/0 conn(0x7f16c80b1800 msgr2=0x7f16c8142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:14.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c6d9d700 1 --2- 172.21.15.57:0/1957765486 >> v2:172.21.15.87:3300/0 conn(0x7f16c80b1800 0x7f16c8142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c6d9d700 1 -- 172.21.15.57:0/1957765486 >> v1:172.21.15.87:6789/0 conn(0x7f16c80b3200 legacy=0x7f16c8066640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c6d9d700 1 -- 172.21.15.57:0/1957765486 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8065f00 con 0x7f16c80b0e30 2021-06-25T04:53:14.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c6d9d700 1 --2- 172.21.15.57:0/1957765486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16c80b0e30 0x7f16c8142d40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f16c00032f0 tx=0x7f16c0009290).ready entity=mon.0 client_cookie=475ee70331a69fac server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:14.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c559a700 1 -- 172.21.15.57:0/1957765486 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16c000b870 con 0x7f16c80b0e30 2021-06-25T04:53:14.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c559a700 1 -- 172.21.15.57:0/1957765486 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c000b9d0 con 0x7f16c80b0e30 2021-06-25T04:53:14.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16c559a700 1 -- 172.21.15.57:0/1957765486 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16c000bb40 con 0x7f16c80b0e30 2021-06-25T04:53:14.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1957765486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16c80b0e30 msgr2=0x7f16c8142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 --2- 172.21.15.57:0/1957765486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16c80b0e30 0x7f16c8142d40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f16c00032f0 tx=0x7f16c0009290).stop 2021-06-25T04:53:14.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1957765486 shutdown_connections 2021-06-25T04:53:14.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 --2- 172.21.15.57:0/1957765486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16c80b0e30 0x7f16c8142d40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 --2- 172.21.15.57:0/1957765486 >> v2:172.21.15.87:3300/0 conn(0x7f16c80b1800 0x7f16c8142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1957765486 >> 172.21.15.57:0/1957765486 conn(0x7f16c805c450 msgr2=0x7f16c805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:14.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1957765486 shutdown_connections 2021-06-25T04:53:14.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1957765486 wait complete. 2021-06-25T04:53:14.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.782+0000 7f16cc8aa700 1 Processor -- start 2021-06-25T04:53:14.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16cc8aa700 1 -- start start 2021-06-25T04:53:14.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16cc8aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16c80b0e30 0x7f16c80ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:14.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16cc8aa700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16c80b1800 0x7f16c80af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:14.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16cc8aa700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16c80b3200 0x7f16c813c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:14.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16cc8aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80a9b30 con 0x7f16c80b0e30 2021-06-25T04:53:14.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16cc8aa700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80ad0e0 con 0x7f16c80b1800 2021-06-25T04:53:14.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16cc8aa700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8141290 con 0x7f16c80b3200 2021-06-25T04:53:14.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16c80b0e30 0x7f16c80ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:14.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16c80b0e30 0x7f16c80ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39020/0 (socket says 172.21.15.57:39020) 2021-06-25T04:53:14.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c659c700 1 -- 172.21.15.57:0/1164169268 learned_addr learned my addr 172.21.15.57:0/1164169268 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:14.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c5d9b700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16c80b1800 0x7f16c80af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:14.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c6d9d700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16c80b3200 0x7f16c813c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:14.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c659c700 1 -- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16c80b3200 msgr2=0x7f16c813c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c659c700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16c80b3200 0x7f16c813c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c659c700 1 -- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16c80b1800 msgr2=0x7f16c80af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c659c700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16c80b1800 0x7f16c80af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c659c700 1 -- 172.21.15.57:0/1164169268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0009530 con 0x7f16c80b0e30 2021-06-25T04:53:14.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c6d9d700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16c80b3200 0x7f16c813c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:53:14.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16c659c700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16c80b0e30 0x7f16c80ac890 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f16c8061d50 tx=0x7f16bc007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:14.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16b77fe700 1 -- 172.21.15.57:0/1164169268 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16bc00ce30 con 0x7f16c80b0e30 2021-06-25T04:53:14.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16b77fe700 1 -- 172.21.15.57:0/1164169268 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc007240 con 0x7f16c80b0e30 2021-06-25T04:53:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1164169268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c80ae110 con 0x7f16c80b0e30 2021-06-25T04:53:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16b77fe700 1 -- 172.21.15.57:0/1164169268 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16bc006700 con 0x7f16c80b0e30 2021-06-25T04:53:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1164169268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c80adb90 con 0x7f16c80b0e30 2021-06-25T04:53:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1164169268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c8057310 con 0x7f16c80b0e30 2021-06-25T04:53:14.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.786+0000 7f16b77fe700 1 -- 172.21.15.57:0/1164169268 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f16bc006860 con 0x7f16c80b0e30 2021-06-25T04:53:14.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.790+0000 7f16b77fe700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f16a4055450 0x7f16a4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:14.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.790+0000 7f16b77fe700 1 -- 172.21.15.57:0/1164169268 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f16bc06d890 con 0x7f16c80b0e30 2021-06-25T04:53:14.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.790+0000 7f16c5d9b700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f16a4055450 0x7f16a4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:14.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.790+0000 7f16c5d9b700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f16a4055450 0x7f16a4057910 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f16b800c000 tx=0x7f16b8008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:14.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.794+0000 7f16b77fe700 1 -- 172.21.15.57:0/1164169268 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f16bc043a00 con 0x7f16c80b0e30 2021-06-25T04:53:14.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.962+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1164169268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16c805d720 con 0x7f16c80b0e30 2021-06-25T04:53:14.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.962+0000 7f16b77fe700 1 -- 172.21.15.57:0/1164169268 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f16bc047020 con 0x7f16c80b0e30 2021-06-25T04:53:14.968 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:14.968 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4117950639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4117950639},{"type":"v1","addr":"172.21.15.87:6835","nonce":4117950639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5477,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3471432498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3471432498},{"type":"v1","addr":"172.21.15.57:6833","nonce":3471432498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:52:43.642049+0000","modified":"2021-06-25T04:52:44.644941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3818355049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3818355049},{"type":"v1","addr":"172.21.15.57:6835","nonce":3818355049}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-06-25T04:53:14.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f16a4055450 msgr2=0x7f16a4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f16a4055450 0x7f16a4057910 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f16b800c000 tx=0x7f16b8008040).stop 2021-06-25T04:53:14.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1164169268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16c80b0e30 msgr2=0x7f16c80ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:14.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16c80b0e30 0x7f16c80ac890 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f16c8061d50 tx=0x7f16bc007bd0).stop 2021-06-25T04:53:14.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1164169268 shutdown_connections 2021-06-25T04:53:14.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f16a4055450 0x7f16a4057910 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16c80b3200 0x7f16c813c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16c80b1800 0x7f16c80af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 --2- 172.21.15.57:0/1164169268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16c80b0e30 0x7f16c80ac890 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:14.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1164169268 >> 172.21.15.57:0/1164169268 conn(0x7f16c805c450 msgr2=0x7f16c81437f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:14.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1164169268 shutdown_connections 2021-06-25T04:53:14.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:14.966+0000 7f16cc8aa700 1 -- 172.21.15.57:0/1164169268 wait complete. 2021-06-25T04:53:14.973 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 31 2021-06-25T04:53:14.982 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:53:15.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fbfff700 1 Processor -- start 2021-06-25T04:53:15.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fbfff700 1 -- start start 2021-06-25T04:53:15.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70fc0b3090 0x7f70fc1433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:15.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fbfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70fc0ace30 0x7f70fc13f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:15.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fbfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc1438e0 con 0x7f70fc0b06d0 2021-06-25T04:53:15.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fbfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0b0ab0 con 0x7f70fc0b3090 2021-06-25T04:53:15.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fbfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0ae640 con 0x7f70fc0ace30 2021-06-25T04:53:15.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70faffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f70fc0b06d0 0x7f70fc142ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56246/0 (socket says 172.21.15.57:56246) 2021-06-25T04:53:15.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fa7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70fc0b3090 0x7f70fc1433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:15.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70faffd700 1 -- 172.21.15.57:0/58520013 learned_addr learned my addr 172.21.15.57:0/58520013 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:15.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fb7fe700 1 --2- 172.21.15.57:0/58520013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70fc0ace30 0x7f70fc13f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:15.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70f9ffb700 1 -- 172.21.15.57:0/58520013 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819060121 0 0) 0x7f70fc1438e0 con 0x7f70fc0b06d0 2021-06-25T04:53:15.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70f9ffb700 1 -- 172.21.15.57:0/58520013 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e0003260 con 0x7f70fc0b06d0 2021-06-25T04:53:15.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fa7fc700 1 -- 172.21.15.57:0/58520013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70fc0ace30 msgr2=0x7f70fc13f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:15.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fa7fc700 1 --2- 172.21.15.57:0/58520013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70fc0ace30 0x7f70fc13f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:15.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fa7fc700 1 -- 172.21.15.57:0/58520013 >> v1:172.21.15.57:6789/0 conn(0x7f70fc0b06d0 legacy=0x7f70fc142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:15.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fa7fc700 1 -- 172.21.15.57:0/58520013 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0ae8e0 con 0x7f70fc0b3090 2021-06-25T04:53:15.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fa7fc700 1 --2- 172.21.15.57:0/58520013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70fc0b3090 0x7f70fc1433f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f70ec002f70 tx=0x7f70ec006df0).ready entity=mon.0 client_cookie=e2b5584454b5ff server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:15.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70f9ffb700 1 -- 172.21.15.57:0/58520013 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70ec00d4a0 con 0x7f70fc0b3090 2021-06-25T04:53:15.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70f9ffb700 1 -- 172.21.15.57:0/58520013 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec000e90 con 0x7f70fc0b3090 2021-06-25T04:53:15.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70f9ffb700 1 -- 172.21.15.57:0/58520013 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70ec00d7f0 con 0x7f70fc0b3090 2021-06-25T04:53:15.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fbfff700 1 -- 172.21.15.57:0/58520013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70fc0b3090 msgr2=0x7f70fc1433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:15.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.078+0000 7f70fbfff700 1 --2- 172.21.15.57:0/58520013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70fc0b3090 0x7f70fc1433f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f70ec002f70 tx=0x7f70ec006df0).stop 2021-06-25T04:53:15.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 -- 172.21.15.57:0/58520013 shutdown_connections 2021-06-25T04:53:15.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 --2- 172.21.15.57:0/58520013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70fc0ace30 0x7f70fc13f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:15.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 --2- 172.21.15.57:0/58520013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70fc0b3090 0x7f70fc1433f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:15.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 -- 172.21.15.57:0/58520013 >> 172.21.15.57:0/58520013 conn(0x7f70fc061100 msgr2=0x7f70fc062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:15.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 -- 172.21.15.57:0/58520013 shutdown_connections 2021-06-25T04:53:15.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 -- 172.21.15.57:0/58520013 wait complete. 2021-06-25T04:53:15.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 Processor -- start 2021-06-25T04:53:15.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 -- start start 2021-06-25T04:53:15.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70fc0ace30 0x7f70fc0a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:15.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70fc0b06d0 0x7f70fc065830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:15.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70fc0b3090 0x7f70fc14f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:15.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc09fc90 con 0x7f70fc0b3090 2021-06-25T04:53:15.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc14fb90 con 0x7f70fc0ace30 2021-06-25T04:53:15.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.082+0000 7f70fbfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc09f9f0 con 0x7f70fc0b06d0 2021-06-25T04:53:15.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70fb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70fc0b3090 0x7f70fc14f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:15.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70faffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70fc0ace30 0x7f70fc0a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:15.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70faffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70fc0ace30 0x7f70fc0a0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:47528/0 (socket says 172.21.15.57:47528) 2021-06-25T04:53:15.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70faffd700 1 -- 172.21.15.57:0/3649107355 learned_addr learned my addr 172.21.15.57:0/3649107355 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:15.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70fa7fc700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70fc0b06d0 0x7f70fc065830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:15.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70fb7fe700 1 -- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70fc0b06d0 msgr2=0x7f70fc065830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:15.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70fb7fe700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70fc0b06d0 0x7f70fc065830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:15.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70fb7fe700 1 -- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70fc0ace30 msgr2=0x7f70fc0a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:15.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70fb7fe700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70fc0ace30 0x7f70fc0a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:15.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70fb7fe700 1 -- 172.21.15.57:0/3649107355 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec00b180 con 0x7f70fc0b3090 2021-06-25T04:53:15.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70faffd700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70fc0ace30 0x7f70fc0a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:15.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70fb7fe700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70fc0b3090 0x7f70fc14f6a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f70f400c000 tx=0x7f70f40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:15.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70f3fff700 1 -- 172.21.15.57:0/3649107355 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f4012600 con 0x7f70fc0b3090 2021-06-25T04:53:15.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70f3fff700 1 -- 172.21.15.57:0/3649107355 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f4012760 con 0x7f70fc0b3090 2021-06-25T04:53:15.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70fbfff700 1 -- 172.21.15.57:0/3649107355 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc0a0840 con 0x7f70fc0b3090 2021-06-25T04:53:15.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70f3fff700 1 -- 172.21.15.57:0/3649107355 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f4012ac0 con 0x7f70fc0b3090 2021-06-25T04:53:15.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70fbfff700 1 -- 172.21.15.57:0/3649107355 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc09ed80 con 0x7f70fc0b3090 2021-06-25T04:53:15.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70f3fff700 1 -- 172.21.15.57:0/3649107355 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f70f4022070 con 0x7f70fc0b3090 2021-06-25T04:53:15.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70fbfff700 1 -- 172.21.15.57:0/3649107355 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc067c30 con 0x7f70fc0b3090 2021-06-25T04:53:15.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70f3fff700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70d4055450 0x7f70d4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:15.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.086+0000 7f70f3fff700 1 -- 172.21.15.57:0/3649107355 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f70f406e490 con 0x7f70fc0b3090 2021-06-25T04:53:15.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.090+0000 7f70faffd700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70d4055450 0x7f70d4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:15.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.090+0000 7f70faffd700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70d4055450 0x7f70d4057910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f70e400d000 tx=0x7f70e4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:15.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.090+0000 7f70f3fff700 1 -- 172.21.15.57:0/3649107355 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f70fc067c30 con 0x7f70fc0b3090 2021-06-25T04:53:15.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:15.258+0000 7f70fbfff700 1 -- 172.21.15.57:0/3649107355 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f70fc067c30 con 0x7f70fc0b3090 2021-06-25T04:53:16.222 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:53:16.218+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:53:16.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.226+0000 7f70f3fff700 1 -- 172.21.15.57:0/3649107355 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f70fc067c30 con 0x7f70fc0b3090 2021-06-25T04:53:16.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 -- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70d4055450 msgr2=0x7f70d4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70d4055450 0x7f70d4057910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f70e400d000 tx=0x7f70e4009040).stop 2021-06-25T04:53:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 -- 172.21.15.57:0/3649107355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70fc0b3090 msgr2=0x7f70fc14f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70fc0b3090 0x7f70fc14f6a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f70f400c000 tx=0x7f70f40091d0).stop 2021-06-25T04:53:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 -- 172.21.15.57:0/3649107355 shutdown_connections 2021-06-25T04:53:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70d4055450 0x7f70d4057910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70fc0b3090 0x7f70fc14f6a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70fc0b06d0 0x7f70fc065830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 --2- 172.21.15.57:0/3649107355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70fc0ace30 0x7f70fc0a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 -- 172.21.15.57:0/3649107355 >> 172.21.15.57:0/3649107355 conn(0x7f70fc061100 msgr2=0x7f70fc142ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:16.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 -- 172.21.15.57:0/3649107355 shutdown_connections 2021-06-25T04:53:16.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.230+0000 7f70fbfff700 1 -- 172.21.15.57:0/3649107355 wait complete. 2021-06-25T04:53:16.237 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:53:16.251 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:16.267 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:53:16.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 Processor -- start 2021-06-25T04:53:16.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 -- start start 2021-06-25T04:53:16.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdae80a7670 0x7fdae8066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:16.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae80a7a50 con 0x7fdae80b0020 2021-06-25T04:53:16.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae81475e0 con 0x7fdae80b1930 2021-06-25T04:53:16.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae8147880 con 0x7fdae80a7670 2021-06-25T04:53:16.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaecfc0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdae80a7670 0x7fdae8066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:16.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaecfc0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdae80a7670 0x7fdae8066a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39054/0 (socket says 172.21.15.57:39054) 2021-06-25T04:53:16.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaed7c1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdae80b0020 0x7fdae8151f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56276/0 (socket says 172.21.15.57:56276) 2021-06-25T04:53:16.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaecfc0700 1 -- 172.21.15.57:0/3130396934 learned_addr learned my addr 172.21.15.57:0/3130396934 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:16.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaecfc0700 1 -- 172.21.15.57:0/3130396934 >> v1:172.21.15.87:6789/0 conn(0x7fdae80b1930 legacy=0x7fdae805f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaecfc0700 1 -- 172.21.15.57:0/3130396934 >> v1:172.21.15.57:6789/0 conn(0x7fdae80b0020 legacy=0x7fdae8151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaecfc0700 1 -- 172.21.15.57:0/3130396934 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae8147b20 con 0x7fdae80a7670 2021-06-25T04:53:16.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaecfc0700 1 --2- 172.21.15.57:0/3130396934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae80a7670 0x7fdae8066a30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fdadc002f70 tx=0x7fdadc006eb0).ready entity=mon.0 client_cookie=c47e0a1b4b9e16d8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:16.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdae77fe700 1 -- 172.21.15.57:0/3130396934 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdadc00d660 con 0x7fdae80a7670 2021-06-25T04:53:16.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdae77fe700 1 -- 172.21.15.57:0/3130396934 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc000e90 con 0x7fdae80a7670 2021-06-25T04:53:16.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdae77fe700 1 -- 172.21.15.57:0/3130396934 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdadc00d9f0 con 0x7fdae80a7670 2021-06-25T04:53:16.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 -- 172.21.15.57:0/3130396934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae80a7670 msgr2=0x7fdae8066a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 --2- 172.21.15.57:0/3130396934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae80a7670 0x7fdae8066a30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fdadc002f70 tx=0x7fdadc006eb0).stop 2021-06-25T04:53:16.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 -- 172.21.15.57:0/3130396934 shutdown_connections 2021-06-25T04:53:16.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 --2- 172.21.15.57:0/3130396934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae80a7670 0x7fdae8066a30 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 -- 172.21.15.57:0/3130396934 >> 172.21.15.57:0/3130396934 conn(0x7fdae80b53a0 msgr2=0x7fdae80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:16.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 -- 172.21.15.57:0/3130396934 shutdown_connections 2021-06-25T04:53:16.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.350+0000 7fdaef224700 1 -- 172.21.15.57:0/3130396934 wait complete. 2021-06-25T04:53:16.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.354+0000 7fdaef224700 1 Processor -- start 2021-06-25T04:53:16.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.354+0000 7fdaef224700 1 -- start start 2021-06-25T04:53:16.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.354+0000 7fdaef224700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae80a7670 0x7fdae8066870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:16.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.354+0000 7fdaef224700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdae80b0020 0x7fdae80b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:16.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.354+0000 7fdaef224700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae80b1930 0x7fdae815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:16.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.354+0000 7fdaef224700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80adf20 con 0x7fdae80a7670 2021-06-25T04:53:16.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.354+0000 7fdaef224700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80ab640 con 0x7fdae80b1930 2021-06-25T04:53:16.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.354+0000 7fdaef224700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80ab8e0 con 0x7fdae80b0020 2021-06-25T04:53:16.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.354+0000 7fdaecfc0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae80a7670 0x7fdae8066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:16.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.354+0000 7fdaecfc0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae80a7670 0x7fdae8066870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39060/0 (socket says 172.21.15.57:39060) 2021-06-25T04:53:16.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.354+0000 7fdaecfc0700 1 -- 172.21.15.57:0/3916428235 learned_addr learned my addr 172.21.15.57:0/3916428235 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:16.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdaed7c1700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae80b1930 0x7fdae815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:16.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdae7fff700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdae80b0020 0x7fdae80b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:16.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdaecfc0700 1 -- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdae80b0020 msgr2=0x7fdae80b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdaecfc0700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdae80b0020 0x7fdae80b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdaecfc0700 1 -- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae80b1930 msgr2=0x7fdae815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdaecfc0700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae80b1930 0x7fdae815a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdaecfc0700 1 -- 172.21.15.57:0/3916428235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc00b1e0 con 0x7fdae80a7670 2021-06-25T04:53:16.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdaed7c1700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae80b1930 0x7fdae815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:16.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdaecfc0700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae80a7670 0x7fdae8066870 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fdadc002f70 tx=0x7fdadc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:16.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdae5ffb700 1 -- 172.21.15.57:0/3916428235 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdadc021070 con 0x7fdae80a7670 2021-06-25T04:53:16.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdae5ffb700 1 -- 172.21.15.57:0/3916428235 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc000e90 con 0x7fdae80a7670 2021-06-25T04:53:16.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdaef224700 1 -- 172.21.15.57:0/3916428235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae80ae4e0 con 0x7fdae80a7670 2021-06-25T04:53:16.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdae5ffb700 1 -- 172.21.15.57:0/3916428235 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdadc006be0 con 0x7fdae80a7670 2021-06-25T04:53:16.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdaef224700 1 -- 172.21.15.57:0/3916428235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae80adca0 con 0x7fdae80a7670 2021-06-25T04:53:16.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdaef224700 1 -- 172.21.15.57:0/3916428235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae80ae120 con 0x7fdae80a7670 2021-06-25T04:53:16.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdae5ffb700 1 -- 172.21.15.57:0/3916428235 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdadc00f070 con 0x7fdae80a7670 2021-06-25T04:53:16.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdae5ffb700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad0055340 0x7fdad0057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:16.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdae5ffb700 1 -- 172.21.15.57:0/3916428235 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fdadc06f470 con 0x7fdae80a7670 2021-06-25T04:53:16.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.358+0000 7fdae7fff700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad0055340 0x7fdad0057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:16.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.362+0000 7fdae7fff700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad0055340 0x7fdad0057800 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fdad400b000 tx=0x7fdad4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:16.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.366+0000 7fdae5ffb700 1 -- 172.21.15.57:0/3916428235 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdadc045680 con 0x7fdae80a7670 2021-06-25T04:53:16.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.526+0000 7fdaef224700 1 -- 172.21.15.57:0/3916428235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdae8057310 con 0x7fdae80a7670 2021-06-25T04:53:16.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdae5ffb700 1 -- 172.21.15.57:0/3916428235 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fdadc048ca0 con 0x7fdae80a7670 2021-06-25T04:53:16.536 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:16.536 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4117950639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4117950639},{"type":"v1","addr":"172.21.15.87:6835","nonce":4117950639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5477,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3471432498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3471432498},{"type":"v1","addr":"172.21.15.57:6833","nonce":3471432498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:52:43.642049+0000","modified":"2021-06-25T04:53:16.222081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-06-25T04:53:16.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 -- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad0055340 msgr2=0x7fdad0057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad0055340 0x7fdad0057800 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fdad400b000 tx=0x7fdad4009040).stop 2021-06-25T04:53:16.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 -- 172.21.15.57:0/3916428235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae80a7670 msgr2=0x7fdae8066870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae80a7670 0x7fdae8066870 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fdadc002f70 tx=0x7fdadc015000).stop 2021-06-25T04:53:16.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 -- 172.21.15.57:0/3916428235 shutdown_connections 2021-06-25T04:53:16.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad0055340 0x7fdad0057800 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae80b1930 0x7fdae815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdae80b0020 0x7fdae80b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 --2- 172.21.15.57:0/3916428235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae80a7670 0x7fdae8066870 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 -- 172.21.15.57:0/3916428235 >> 172.21.15.57:0/3916428235 conn(0x7fdae80b53a0 msgr2=0x7fdae8149e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:16.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 -- 172.21.15.57:0/3916428235 shutdown_connections 2021-06-25T04:53:16.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.530+0000 7fdaef224700 1 -- 172.21.15.57:0/3916428235 wait complete. 2021-06-25T04:53:16.541 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 32 2021-06-25T04:53:16.547 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:53:16.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3561ba700 1 Processor -- start 2021-06-25T04:53:16.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3561ba700 1 -- start start 2021-06-25T04:53:16.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3561ba700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3500b5460 0x7fb3500af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:16.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3561ba700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb350147560 0x7fb3500acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:16.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3561ba700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3501479b0 con 0x7fb3500b05d0 2021-06-25T04:53:16.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3561ba700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3501452a0 con 0x7fb3500b5460 2021-06-25T04:53:16.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3561ba700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3500adfb0 con 0x7fb350147560 2021-06-25T04:53:16.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3549b7700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb3500b05d0 0x7fb350067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56286/0 (socket says 172.21.15.57:56286) 2021-06-25T04:53:16.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3549b7700 1 -- 172.21.15.57:0/807966681 learned_addr learned my addr 172.21.15.57:0/807966681 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:16.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3551b8700 1 --2- 172.21.15.57:0/807966681 >> v2:172.21.15.57:3300/0 conn(0x7fb3500b5460 0x7fb3500af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:16.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3559b9700 1 --2- 172.21.15.57:0/807966681 >> v2:172.21.15.87:3300/0 conn(0x7fb350147560 0x7fb3500acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:16.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb34ffff700 1 -- 172.21.15.57:0/807966681 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827501958 0 0) 0x7fb3501479b0 con 0x7fb3500b05d0 2021-06-25T04:53:16.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb34ffff700 1 -- 172.21.15.57:0/807966681 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb330003260 con 0x7fb3500b05d0 2021-06-25T04:53:16.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3559b9700 1 -- 172.21.15.57:0/807966681 >> v2:172.21.15.57:3300/0 conn(0x7fb3500b5460 msgr2=0x7fb3500af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:16.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3559b9700 1 --2- 172.21.15.57:0/807966681 >> v2:172.21.15.57:3300/0 conn(0x7fb3500b5460 0x7fb3500af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3559b9700 1 -- 172.21.15.57:0/807966681 >> v1:172.21.15.57:6789/0 conn(0x7fb3500b05d0 legacy=0x7fb350067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3559b9700 1 -- 172.21.15.57:0/807966681 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500b5840 con 0x7fb350147560 2021-06-25T04:53:16.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3551b8700 1 --2- 172.21.15.57:0/807966681 >> v2:172.21.15.57:3300/0 conn(0x7fb3500b5460 0x7fb3500af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:16.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3559b9700 1 --2- 172.21.15.57:0/807966681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb350147560 0x7fb3500acc20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fb348002f70 tx=0x7fb348006df0).ready entity=mon.1 client_cookie=d78957931586f711 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:16.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb34ffff700 1 -- 172.21.15.57:0/807966681 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34800d4f0 con 0x7fb350147560 2021-06-25T04:53:16.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb34ffff700 1 -- 172.21.15.57:0/807966681 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348000e90 con 0x7fb350147560 2021-06-25T04:53:16.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb34ffff700 1 -- 172.21.15.57:0/807966681 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34800d840 con 0x7fb350147560 2021-06-25T04:53:16.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3561ba700 1 -- 172.21.15.57:0/807966681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb350147560 msgr2=0x7fb3500acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.646+0000 7fb3561ba700 1 --2- 172.21.15.57:0/807966681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb350147560 0x7fb3500acc20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fb348002f70 tx=0x7fb348006df0).stop 2021-06-25T04:53:16.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 -- 172.21.15.57:0/807966681 shutdown_connections 2021-06-25T04:53:16.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 --2- 172.21.15.57:0/807966681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb350147560 0x7fb3500acc20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 --2- 172.21.15.57:0/807966681 >> v2:172.21.15.57:3300/0 conn(0x7fb3500b5460 0x7fb3500af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 -- 172.21.15.57:0/807966681 >> 172.21.15.57:0/807966681 conn(0x7fb350062520 msgr2=0x7fb350062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:16.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 -- 172.21.15.57:0/807966681 shutdown_connections 2021-06-25T04:53:16.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 -- 172.21.15.57:0/807966681 wait complete. 2021-06-25T04:53:16.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 Processor -- start 2021-06-25T04:53:16.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 -- start start 2021-06-25T04:53:16.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3500b05d0 0x7fb350066d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:16.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3500b5460 0x7fb3501495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:16.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb350147560 0x7fb350156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:16.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500b41e0 con 0x7fb3500b5460 2021-06-25T04:53:16.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500b4be0 con 0x7fb3500b05d0 2021-06-25T04:53:16.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3561ba700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500b4e10 con 0x7fb350147560 2021-06-25T04:53:16.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3549b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3500b5460 0x7fb3501495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:16.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3549b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3500b5460 0x7fb3501495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39076/0 (socket says 172.21.15.57:39076) 2021-06-25T04:53:16.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3551b8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3500b05d0 0x7fb350066d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:16.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3549b7700 1 -- 172.21.15.57:0/4190365467 learned_addr learned my addr 172.21.15.57:0/4190365467 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:16.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.650+0000 7fb3559b9700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb350147560 0x7fb350156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:16.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb3549b7700 1 -- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb350147560 msgr2=0x7fb350156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb3549b7700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb350147560 0x7fb350156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb3549b7700 1 -- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3500b05d0 msgr2=0x7fb350066d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:16.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb3549b7700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3500b05d0 0x7fb350066d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:16.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb3549b7700 1 -- 172.21.15.57:0/4190365467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb338009470 con 0x7fb3500b5460 2021-06-25T04:53:16.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb3559b9700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb350147560 0x7fb350156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:16.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb3549b7700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3500b5460 0x7fb3501495a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fb340001110 tx=0x7fb340007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:16.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb34e7fc700 1 -- 172.21.15.57:0/4190365467 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3400070d0 con 0x7fb3500b5460 2021-06-25T04:53:16.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb34e7fc700 1 -- 172.21.15.57:0/4190365467 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340007230 con 0x7fb3500b5460 2021-06-25T04:53:16.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb3561ba700 1 -- 172.21.15.57:0/4190365467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34800b180 con 0x7fb3500b5460 2021-06-25T04:53:16.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb34e7fc700 1 -- 172.21.15.57:0/4190365467 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb340005610 con 0x7fb3500b5460 2021-06-25T04:53:16.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb3561ba700 1 -- 172.21.15.57:0/4190365467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35015a540 con 0x7fb3500b5460 2021-06-25T04:53:16.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb34e7fc700 1 -- 172.21.15.57:0/4190365467 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb340010070 con 0x7fb3500b5460 2021-06-25T04:53:16.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb3561ba700 1 -- 172.21.15.57:0/4190365467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35015aa60 con 0x7fb3500b5460 2021-06-25T04:53:16.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb34e7fc700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb334055450 0x7fb334057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:16.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb34e7fc700 1 -- 172.21.15.57:0/4190365467 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fb34006d500 con 0x7fb3500b5460 2021-06-25T04:53:16.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.654+0000 7fb3551b8700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb334055450 0x7fb334057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:16.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.658+0000 7fb3551b8700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb334055450 0x7fb334057910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fb33800b000 tx=0x7fb3380091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:16.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.658+0000 7fb34e7fc700 1 -- 172.21.15.57:0/4190365467 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb340043660 con 0x7fb3500b5460 2021-06-25T04:53:16.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:16.822+0000 7fb3561ba700 1 -- 172.21.15.57:0/4190365467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb350060e50 con 0x7fb3500b5460 2021-06-25T04:53:17.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.226+0000 7fb34e7fc700 1 -- 172.21.15.57:0/4190365467 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb3400180a0 con 0x7fb3500b5460 2021-06-25T04:53:17.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.230+0000 7fb3561ba700 1 -- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb334055450 msgr2=0x7fb334057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.230+0000 7fb3561ba700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb334055450 0x7fb334057910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fb33800b000 tx=0x7fb3380091d0).stop 2021-06-25T04:53:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.230+0000 7fb3561ba700 1 -- 172.21.15.57:0/4190365467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3500b5460 msgr2=0x7fb3501495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.230+0000 7fb3561ba700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3500b5460 0x7fb3501495a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fb340001110 tx=0x7fb340007ad0).stop 2021-06-25T04:53:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.230+0000 7fb3561ba700 1 -- 172.21.15.57:0/4190365467 shutdown_connections 2021-06-25T04:53:17.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.230+0000 7fb3561ba700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb334055450 0x7fb334057910 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:17.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.230+0000 7fb3561ba700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb350147560 0x7fb350156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:17.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.230+0000 7fb3561ba700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3500b5460 0x7fb3501495a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:17.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.230+0000 7fb3561ba700 1 --2- 172.21.15.57:0/4190365467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3500b05d0 0x7fb350066d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:17.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.230+0000 7fb3561ba700 1 -- 172.21.15.57:0/4190365467 >> 172.21.15.57:0/4190365467 conn(0x7fb350062520 msgr2=0x7fb350146740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:17.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.230+0000 7fb3561ba700 1 -- 172.21.15.57:0/4190365467 shutdown_connections 2021-06-25T04:53:17.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.234+0000 7fb3561ba700 1 -- 172.21.15.57:0/4190365467 wait complete. 2021-06-25T04:53:17.254 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:53:17.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.366+0000 7f74b6f21700 1 Processor -- start 2021-06-25T04:53:17.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.366+0000 7f74b6f21700 1 -- start start 2021-06-25T04:53:17.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74b00b2540 0x7f74b014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:17.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f74b00affd0 0x7f74b014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:17.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f74b00afb90 0x7f74b00a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:17.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b00a7080 con 0x7f74b00afb90 2021-06-25T04:53:17.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b00a72b0 con 0x7f74b00affd0 2021-06-25T04:53:17.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00a7550 con 0x7f74b00b2540 2021-06-25T04:53:17.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6720700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f74b00afb90 0x7f74b00a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:17.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6720700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f74b00afb90 0x7f74b00a8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39088/0 (socket says 172.21.15.57:39088) 2021-06-25T04:53:17.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6720700 1 -- 172.21.15.57:0/3057712365 learned_addr learned my addr 172.21.15.57:0/3057712365 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:17.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b571e700 1 --2- 172.21.15.57:0/3057712365 >> v2:172.21.15.87:3300/0 conn(0x7f74b00affd0 0x7f74b014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:17.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b5f1f700 1 --2- 172.21.15.57:0/3057712365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74b00b2540 0x7f74b014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:17.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6720700 1 -- 172.21.15.57:0/3057712365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74b00b2540 msgr2=0x7f74b014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:17.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6720700 1 --2- 172.21.15.57:0/3057712365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74b00b2540 0x7f74b014ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:17.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6720700 1 -- 172.21.15.57:0/3057712365 >> v2:172.21.15.87:3300/0 conn(0x7f74b00affd0 msgr2=0x7f74b014b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:17.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6720700 1 --2- 172.21.15.57:0/3057712365 >> v2:172.21.15.87:3300/0 conn(0x7f74b00affd0 0x7f74b014b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:17.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6720700 1 -- 172.21.15.57:0/3057712365 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b00a77f0 con 0x7f74b00afb90 2021-06-25T04:53:17.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6720700 1 --2- 172.21.15.57:0/3057712365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74b00afb90 0x7f74b00a8370 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f74a80032f0 tx=0x7f74a8009290).ready entity=mon.0 client_cookie=3d00d71e10538c31 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:17.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b4f1d700 1 -- 172.21.15.57:0/3057712365 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a800b680 con 0x7f74b00afb90 2021-06-25T04:53:17.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b4f1d700 1 -- 172.21.15.57:0/3057712365 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a800b7e0 con 0x7f74b00afb90 2021-06-25T04:53:17.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b4f1d700 1 -- 172.21.15.57:0/3057712365 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a800b950 con 0x7f74b00afb90 2021-06-25T04:53:17.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 -- 172.21.15.57:0/3057712365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74b00afb90 msgr2=0x7f74b00a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:17.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 --2- 172.21.15.57:0/3057712365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74b00afb90 0x7f74b00a8370 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f74a80032f0 tx=0x7f74a8009290).stop 2021-06-25T04:53:17.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 -- 172.21.15.57:0/3057712365 shutdown_connections 2021-06-25T04:53:17.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 --2- 172.21.15.57:0/3057712365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74b00afb90 0x7f74b00a8370 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:17.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 --2- 172.21.15.57:0/3057712365 >> v2:172.21.15.87:3300/0 conn(0x7f74b00affd0 0x7f74b014b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:17.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 --2- 172.21.15.57:0/3057712365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74b00b2540 0x7f74b014ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:17.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 -- 172.21.15.57:0/3057712365 >> 172.21.15.57:0/3057712365 conn(0x7f74b0060140 msgr2=0x7f74b00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:17.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 -- 172.21.15.57:0/3057712365 shutdown_connections 2021-06-25T04:53:17.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.370+0000 7f74b6f21700 1 -- 172.21.15.57:0/3057712365 wait complete. 2021-06-25T04:53:17.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6f21700 1 Processor -- start 2021-06-25T04:53:17.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6f21700 1 -- start start 2021-06-25T04:53:17.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6f21700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74b00afb90 0x7f74b00abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:17.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6f21700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b00affd0 0x7f74b00b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:17.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6f21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74b00b2540 0x7f74b0156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:17.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6f21700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b01541f0 con 0x7f74b00b2540 2021-06-25T04:53:17.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6f21700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00650a0 con 0x7f74b00affd0 2021-06-25T04:53:17.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6f21700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b0065340 con 0x7f74b00afb90 2021-06-25T04:53:17.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6720700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74b00b2540 0x7f74b0156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:17.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6720700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74b00b2540 0x7f74b0156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39094/0 (socket says 172.21.15.57:39094) 2021-06-25T04:53:17.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6720700 1 -- 172.21.15.57:0/2581125253 learned_addr learned my addr 172.21.15.57:0/2581125253 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:17.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b5f1f700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74b00afb90 0x7f74b00abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:17.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b571e700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b00affd0 0x7f74b00b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:17.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6720700 1 -- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74b00afb90 msgr2=0x7f74b00abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:17.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6720700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74b00afb90 0x7f74b00abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:17.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6720700 1 -- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b00affd0 msgr2=0x7f74b00b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:17.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6720700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b00affd0 0x7f74b00b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:17.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6720700 1 -- 172.21.15.57:0/2581125253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8009530 con 0x7f74b00b2540 2021-06-25T04:53:17.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b571e700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b00affd0 0x7f74b00b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:17.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6720700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74b00b2540 0x7f74b0156a40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f74a80032f0 tx=0x7f74a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:17.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f749effd700 1 -- 172.21.15.57:0/2581125253 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a8011ca0 con 0x7f74b00b2540 2021-06-25T04:53:17.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f749effd700 1 -- 172.21.15.57:0/2581125253 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8011e00 con 0x7f74b00b2540 2021-06-25T04:53:17.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6f21700 1 -- 172.21.15.57:0/2581125253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b00655e0 con 0x7f74b00b2540 2021-06-25T04:53:17.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f749effd700 1 -- 172.21.15.57:0/2581125253 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74a801b630 con 0x7f74b00b2540 2021-06-25T04:53:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.374+0000 7f74b6f21700 1 -- 172.21.15.57:0/2581125253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b00ac4f0 con 0x7f74b00b2540 2021-06-25T04:53:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.378+0000 7f74b6f21700 1 -- 172.21.15.57:0/2581125253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b0057310 con 0x7f74b00b2540 2021-06-25T04:53:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.378+0000 7f749effd700 1 -- 172.21.15.57:0/2581125253 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f74a800f070 con 0x7f74b00b2540 2021-06-25T04:53:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.378+0000 7f749effd700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74900554e0 0x7f74900579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:17.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.378+0000 7f749effd700 1 -- 172.21.15.57:0/2581125253 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f74a806ec60 con 0x7f74b00b2540 2021-06-25T04:53:17.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.378+0000 7f74b5f1f700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74900554e0 0x7f74900579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:17.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.378+0000 7f74b5f1f700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74900554e0 0x7f74900579a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f74a000b000 tx=0x7f74a0006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:17.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.390+0000 7f749effd700 1 -- 172.21.15.57:0/2581125253 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f74a8044dc0 con 0x7f74b00b2540 2021-06-25T04:53:17.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:17.514+0000 7f74b6f21700 1 -- 172.21.15.57:0/2581125253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f74b00621e0 con 0x7f74b00b2540 2021-06-25T04:53:18.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.282+0000 7f749effd700 1 -- 172.21.15.57:0/2581125253 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v70) v1 ==== 185+0+0 (secure 0 0 0) 0x7f74a80483e0 con 0x7f74b00b2540 2021-06-25T04:53:18.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.286+0000 7f74b6f21700 1 -- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74900554e0 msgr2=0x7f74900579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:18.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.286+0000 7f74b6f21700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74900554e0 0x7f74900579a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f74a000b000 tx=0x7f74a0006df0).stop 2021-06-25T04:53:18.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.286+0000 7f74b6f21700 1 -- 172.21.15.57:0/2581125253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74b00b2540 msgr2=0x7f74b0156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:18.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.286+0000 7f74b6f21700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74b00b2540 0x7f74b0156a40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f74a80032f0 tx=0x7f74a8017000).stop 2021-06-25T04:53:18.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.286+0000 7f74b6f21700 1 -- 172.21.15.57:0/2581125253 shutdown_connections 2021-06-25T04:53:18.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.286+0000 7f74b6f21700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74900554e0 0x7f74900579a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.286+0000 7f74b6f21700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74b00b2540 0x7f74b0156a40 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.286+0000 7f74b6f21700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74b00affd0 0x7f74b00b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.286+0000 7f74b6f21700 1 --2- 172.21.15.57:0/2581125253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74b00afb90 0x7f74b00abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.286+0000 7f74b6f21700 1 -- 172.21.15.57:0/2581125253 >> 172.21.15.57:0/2581125253 conn(0x7f74b0060140 msgr2=0x7f74b00af040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:18.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.286+0000 7f74b6f21700 1 -- 172.21.15.57:0/2581125253 shutdown_connections 2021-06-25T04:53:18.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.290+0000 7f74b6f21700 1 -- 172.21.15.57:0/2581125253 wait complete. 2021-06-25T04:53:18.297 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:53:18.306 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:53:18.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d56f1a700 1 Processor -- start 2021-06-25T04:53:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d56f1a700 1 -- start start 2021-06-25T04:53:18.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d56f1a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6d500670e0 0x7f6d500b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:18.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d56f1a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6d5013ffb0 0x7f6d50140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:18.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d56f1a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d500b9b90 con 0x7f6d50143970 2021-06-25T04:53:18.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d56f1a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d50143040 con 0x7f6d5013ffb0 2021-06-25T04:53:18.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d56f1a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d500674c0 con 0x7f6d500670e0 2021-06-25T04:53:18.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d554b7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6d5013ffb0 0x7f6d50140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:18.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d4ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6d50143970 0x7f6d500aebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56316/0 (socket says 172.21.15.57:56316) 2021-06-25T04:53:18.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d4ffff700 1 -- 172.21.15.57:0/1069401422 learned_addr learned my addr 172.21.15.57:0/1069401422 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:18.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d54cb6700 1 --2- 172.21.15.57:0/1069401422 >> v2:172.21.15.87:3300/0 conn(0x7f6d500670e0 0x7f6d500b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:18.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d4f7fe700 1 -- 172.21.15.57:0/1069401422 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206197258 0 0) 0x7f6d40001110 con 0x7f6d50143970 2021-06-25T04:53:18.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.406+0000 7f6d4f7fe700 1 -- 172.21.15.57:0/1069401422 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d30003260 con 0x7f6d50143970 2021-06-25T04:53:18.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d54cb6700 1 -- 172.21.15.57:0/1069401422 >> v2:172.21.15.57:3300/0 conn(0x7f6d5013ffb0 msgr2=0x7f6d50140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:18.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d54cb6700 1 --2- 172.21.15.57:0/1069401422 >> v2:172.21.15.57:3300/0 conn(0x7f6d5013ffb0 0x7f6d50140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:18.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d54cb6700 1 -- 172.21.15.57:0/1069401422 >> v1:172.21.15.57:6789/0 conn(0x7f6d50143970 legacy=0x7f6d500aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:18.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d4f7fe700 1 -- 172.21.15.57:0/1069401422 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 611589938 0 0) 0x7f6d30003260 con 0x7f6d50143970 2021-06-25T04:53:18.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d54cb6700 1 -- 172.21.15.57:0/1069401422 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500af490 con 0x7f6d500670e0 2021-06-25T04:53:18.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d554b7700 1 --2- 172.21.15.57:0/1069401422 >> v2:172.21.15.57:3300/0 conn(0x7f6d5013ffb0 0x7f6d50140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:18.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d54cb6700 1 --2- 172.21.15.57:0/1069401422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d500670e0 0x7f6d500b96a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f6d40001990 tx=0x7f6d38006df0).ready entity=mon.1 client_cookie=37ba21c9db18deda server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:18.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d4f7fe700 1 -- 172.21.15.57:0/1069401422 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d400017f0 con 0x7f6d500670e0 2021-06-25T04:53:18.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d4f7fe700 1 -- 172.21.15.57:0/1069401422 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d38000e90 con 0x7f6d500670e0 2021-06-25T04:53:18.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d4f7fe700 1 -- 172.21.15.57:0/1069401422 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d38012460 con 0x7f6d500670e0 2021-06-25T04:53:18.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1069401422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d500670e0 msgr2=0x7f6d500b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:18.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d56f1a700 1 --2- 172.21.15.57:0/1069401422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d500670e0 0x7f6d500b96a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f6d40001990 tx=0x7f6d38006df0).stop 2021-06-25T04:53:18.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1069401422 shutdown_connections 2021-06-25T04:53:18.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d56f1a700 1 --2- 172.21.15.57:0/1069401422 >> v2:172.21.15.57:3300/0 conn(0x7f6d5013ffb0 0x7f6d50140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:18.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d56f1a700 1 --2- 172.21.15.57:0/1069401422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d500670e0 0x7f6d500b96a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:18.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1069401422 >> 172.21.15.57:0/1069401422 conn(0x7f6d5005f9b0 msgr2=0x7f6d50061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:18.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1069401422 shutdown_connections 2021-06-25T04:53:18.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1069401422 wait complete. 2021-06-25T04:53:18.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d56f1a700 1 Processor -- start 2021-06-25T04:53:18.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.410+0000 7f6d56f1a700 1 -- start start 2021-06-25T04:53:18.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d56f1a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d500670e0 0x7f6d50144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:18.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d56f1a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5013ffb0 0x7f6d501529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:18.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d56f1a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d50143970 0x7f6d50152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:18.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d56f1a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50146000 con 0x7f6d50143970 2021-06-25T04:53:18.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d56f1a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d501462a0 con 0x7f6d5013ffb0 2021-06-25T04:53:18.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d56f1a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50152280 con 0x7f6d500670e0 2021-06-25T04:53:18.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d554b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d50143970 0x7f6d50152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:18.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d554b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d50143970 0x7f6d50152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39108/0 (socket says 172.21.15.57:39108) 2021-06-25T04:53:18.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d4ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5013ffb0 0x7f6d501529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:18.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d554b7700 1 -- 172.21.15.57:0/1057645922 learned_addr learned my addr 172.21.15.57:0/1057645922 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:18.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d54cb6700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d500670e0 0x7f6d50144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:18.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d554b7700 1 -- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d500670e0 msgr2=0x7f6d50144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:18.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d554b7700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d500670e0 0x7f6d50144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:18.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d554b7700 1 -- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5013ffb0 msgr2=0x7f6d501529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:18.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d554b7700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5013ffb0 0x7f6d501529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:18.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d554b7700 1 -- 172.21.15.57:0/1057645922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d48009470 con 0x7f6d50143970 2021-06-25T04:53:18.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d554b7700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d50143970 0x7f6d50152eb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f6d4800c000 tx=0x7f6d480091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:18.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d4dffb700 1 -- 172.21.15.57:0/1057645922 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4800c850 con 0x7f6d50143970 2021-06-25T04:53:18.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d4dffb700 1 -- 172.21.15.57:0/1057645922 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4800c9b0 con 0x7f6d50143970 2021-06-25T04:53:18.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1057645922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3800b180 con 0x7f6d50143970 2021-06-25T04:53:18.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d4dffb700 1 -- 172.21.15.57:0/1057645922 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4800cd10 con 0x7f6d50143970 2021-06-25T04:53:18.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1057645922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d500b7e10 con 0x7f6d50143970 2021-06-25T04:53:18.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1057645922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d50057310 con 0x7f6d50143970 2021-06-25T04:53:18.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.414+0000 7f6d4dffb700 1 -- 172.21.15.57:0/1057645922 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6d48022070 con 0x7f6d50143970 2021-06-25T04:53:18.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.418+0000 7f6d4dffb700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d34055340 0x7f6d34057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:18.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.418+0000 7f6d4dffb700 1 -- 172.21.15.57:0/1057645922 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f6d4806e590 con 0x7f6d50143970 2021-06-25T04:53:18.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.418+0000 7f6d54cb6700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d34055340 0x7f6d34057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:18.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.418+0000 7f6d54cb6700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d34055340 0x7f6d34057800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f6d38019000 tx=0x7f6d38014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:18.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.422+0000 7f6d4dffb700 1 -- 172.21.15.57:0/1057645922 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6d480448a0 con 0x7f6d50143970 2021-06-25T04:53:18.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:18.550+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1057645922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d500ae250 con 0x7f6d50143970 2021-06-25T04:53:19.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.294+0000 7f6d4dffb700 1 -- 172.21.15.57:0/1057645922 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6d480160d0 con 0x7f6d50143970 2021-06-25T04:53:19.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.298+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d34055340 msgr2=0x7f6d34057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.298+0000 7f6d56f1a700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d34055340 0x7f6d34057800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f6d38019000 tx=0x7f6d38014000).stop 2021-06-25T04:53:19.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.298+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1057645922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d50143970 msgr2=0x7f6d50152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.298+0000 7f6d56f1a700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d50143970 0x7f6d50152eb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f6d4800c000 tx=0x7f6d480091d0).stop 2021-06-25T04:53:19.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.298+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1057645922 shutdown_connections 2021-06-25T04:53:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.298+0000 7f6d56f1a700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d34055340 0x7f6d34057800 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.298+0000 7f6d56f1a700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d50143970 0x7f6d50152eb0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.298+0000 7f6d56f1a700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5013ffb0 0x7f6d501529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.298+0000 7f6d56f1a700 1 --2- 172.21.15.57:0/1057645922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d500670e0 0x7f6d50144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.298+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1057645922 >> 172.21.15.57:0/1057645922 conn(0x7f6d5005f9b0 msgr2=0x7f6d50141d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:19.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.302+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1057645922 shutdown_connections 2021-06-25T04:53:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.302+0000 7f6d56f1a700 1 -- 172.21.15.57:0/1057645922 wait complete. 2021-06-25T04:53:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:53:19.320 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-06-25T04:53:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3edb39700 1 Processor -- start 2021-06-25T04:53:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3edb39700 1 -- start start 2021-06-25T04:53:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3edb39700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e80600c0 0x7ff3e8064cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3edb39700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3e80b3890 0x7ff3e80651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3edb39700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e80604a0 con 0x7ff3e8144400 2021-06-25T04:53:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3edb39700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e80656b0 con 0x7ff3e80b3890 2021-06-25T04:53:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3edb39700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8065c40 con 0x7ff3e80600c0 2021-06-25T04:53:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3e6ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff3e8144400 0x7ff3e8144930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56330/0 (socket says 172.21.15.57:56330) 2021-06-25T04:53:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3e6ffd700 1 -- 172.21.15.57:0/422074644 learned_addr learned my addr 172.21.15.57:0/422074644 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3e7fff700 1 --2- 172.21.15.57:0/422074644 >> v2:172.21.15.87:3300/0 conn(0x7ff3e80b3890 0x7ff3e80651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3e77fe700 1 --2- 172.21.15.57:0/422074644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e80600c0 0x7ff3e8064cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3e67fc700 1 -- 172.21.15.57:0/422074644 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525061479 0 0) 0x7ff3e80604a0 con 0x7ff3e8144400 2021-06-25T04:53:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3e67fc700 1 -- 172.21.15.57:0/422074644 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3d4003260 con 0x7ff3e8144400 2021-06-25T04:53:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3e7fff700 1 -- 172.21.15.57:0/422074644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e80600c0 msgr2=0x7ff3e8064cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3e7fff700 1 --2- 172.21.15.57:0/422074644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e80600c0 0x7ff3e8064cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3e7fff700 1 -- 172.21.15.57:0/422074644 >> v1:172.21.15.57:6789/0 conn(0x7ff3e8144400 legacy=0x7ff3e8144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3e7fff700 1 -- 172.21.15.57:0/422074644 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e80b2370 con 0x7ff3e80b3890 2021-06-25T04:53:19.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.422+0000 7ff3e77fe700 1 --2- 172.21.15.57:0/422074644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e80600c0 0x7ff3e8064cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:19.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3e7fff700 1 --2- 172.21.15.57:0/422074644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e80b3890 0x7ff3e80651c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ff3e0002f70 tx=0x7ff3e0006df0).ready entity=mon.1 client_cookie=cc2b4a35ab8035e1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:19.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3e67fc700 1 -- 172.21.15.57:0/422074644 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3e000d4a0 con 0x7ff3e80b3890 2021-06-25T04:53:19.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3e67fc700 1 -- 172.21.15.57:0/422074644 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e0000e90 con 0x7ff3e80b3890 2021-06-25T04:53:19.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3e67fc700 1 -- 172.21.15.57:0/422074644 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3e000d7f0 con 0x7ff3e80b3890 2021-06-25T04:53:19.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 -- 172.21.15.57:0/422074644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e80b3890 msgr2=0x7ff3e80651c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 --2- 172.21.15.57:0/422074644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e80b3890 0x7ff3e80651c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ff3e0002f70 tx=0x7ff3e0006df0).stop 2021-06-25T04:53:19.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 -- 172.21.15.57:0/422074644 shutdown_connections 2021-06-25T04:53:19.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 --2- 172.21.15.57:0/422074644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e80b3890 0x7ff3e80651c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 --2- 172.21.15.57:0/422074644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e80600c0 0x7ff3e8064cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 -- 172.21.15.57:0/422074644 >> 172.21.15.57:0/422074644 conn(0x7ff3e805cf20 msgr2=0x7ff3e805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:19.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 -- 172.21.15.57:0/422074644 shutdown_connections 2021-06-25T04:53:19.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 -- 172.21.15.57:0/422074644 wait complete. 2021-06-25T04:53:19.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 Processor -- start 2021-06-25T04:53:19.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 -- start start 2021-06-25T04:53:19.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3e80600c0 0x7ff3e8149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:19.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e80b3890 0x7ff3e8060a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:19.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e8060f30 0x7ff3e813a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:19.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e81435c0 con 0x7ff3e80600c0 2021-06-25T04:53:19.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e81437f0 con 0x7ff3e80b3890 2021-06-25T04:53:19.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3edb39700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8143a90 con 0x7ff3e8060f30 2021-06-25T04:53:19.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3e77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3e80600c0 0x7ff3e8149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:19.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3e77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3e80600c0 0x7ff3e8149f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39118/0 (socket says 172.21.15.57:39118) 2021-06-25T04:53:19.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3e77fe700 1 -- 172.21.15.57:0/1747881462 learned_addr learned my addr 172.21.15.57:0/1747881462 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:19.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.426+0000 7ff3e6ffd700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e80b3890 0x7ff3e8060a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:19.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e7fff700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e8060f30 0x7ff3e813a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:19.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e77fe700 1 -- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e8060f30 msgr2=0x7ff3e813a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e77fe700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e8060f30 0x7ff3e813a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e77fe700 1 -- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e80b3890 msgr2=0x7ff3e8060a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e77fe700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e80b3890 0x7ff3e8060a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e77fe700 1 -- 172.21.15.57:0/1747881462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d8009470 con 0x7ff3e80600c0 2021-06-25T04:53:19.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e7fff700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e8060f30 0x7ff3e813a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:19.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e77fe700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3e80600c0 0x7ff3e8149f80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7ff3d800c000 tx=0x7ff3d80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:19.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e4ff9700 1 -- 172.21.15.57:0/1747881462 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3d800c920 con 0x7ff3e80600c0 2021-06-25T04:53:19.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3edb39700 1 -- 172.21.15.57:0/1747881462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e000b180 con 0x7ff3e80600c0 2021-06-25T04:53:19.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3edb39700 1 -- 172.21.15.57:0/1747881462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e80b6830 con 0x7ff3e80600c0 2021-06-25T04:53:19.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e4ff9700 1 -- 172.21.15.57:0/1747881462 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d800ca80 con 0x7ff3e80600c0 2021-06-25T04:53:19.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e4ff9700 1 -- 172.21.15.57:0/1747881462 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3d800cde0 con 0x7ff3e80600c0 2021-06-25T04:53:19.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3edb39700 1 -- 172.21.15.57:0/1747881462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c4003410 con 0x7ff3e80600c0 2021-06-25T04:53:19.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.430+0000 7ff3e4ff9700 1 -- 172.21.15.57:0/1747881462 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff3d80123f0 con 0x7ff3e80600c0 2021-06-25T04:53:19.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.434+0000 7ff3e4ff9700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff3c8055450 0x7ff3c8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:19.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.434+0000 7ff3e4ff9700 1 -- 172.21.15.57:0/1747881462 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ff3d806e470 con 0x7ff3e80600c0 2021-06-25T04:53:19.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.434+0000 7ff3e6ffd700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff3c8055450 0x7ff3c8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:19.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.434+0000 7ff3e6ffd700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff3c8055450 0x7ff3c8057910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7ff3dc00d000 tx=0x7ff3dc009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:19.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.438+0000 7ff3e4ff9700 1 -- 172.21.15.57:0/1747881462 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff3d8044800 con 0x7ff3e80600c0 2021-06-25T04:53:19.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.566+0000 7ff3edb39700 1 -- 172.21.15.57:0/1747881462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff3c4003c40 con 0x7ff3e80600c0 2021-06-25T04:53:19.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.570+0000 7ff3e4ff9700 1 -- 172.21.15.57:0/1747881462 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff3d80160a0 con 0x7ff3e80600c0 2021-06-25T04:53:19.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 -- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff3c8055450 msgr2=0x7ff3c8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff3c8055450 0x7ff3c8057910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7ff3dc00d000 tx=0x7ff3dc009040).stop 2021-06-25T04:53:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 -- 172.21.15.57:0/1747881462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3e80600c0 msgr2=0x7ff3e8149f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3e80600c0 0x7ff3e8149f80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7ff3d800c000 tx=0x7ff3d80091d0).stop 2021-06-25T04:53:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 -- 172.21.15.57:0/1747881462 shutdown_connections 2021-06-25T04:53:19.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff3c8055450 0x7ff3c8057910 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3e8060f30 0x7ff3e813a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e80b3890 0x7ff3e8060a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 --2- 172.21.15.57:0/1747881462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3e80600c0 0x7ff3e8149f80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 -- 172.21.15.57:0/1747881462 >> 172.21.15.57:0/1747881462 conn(0x7ff3e805cf20 msgr2=0x7ff3e813ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:19.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 -- 172.21.15.57:0/1747881462 shutdown_connections 2021-06-25T04:53:19.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.574+0000 7ff3edb39700 1 -- 172.21.15.57:0/1747881462 wait complete. 2021-06-25T04:53:19.591 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-06-25T04:53:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.690+0000 7f9fb0348700 1 Processor -- start 2021-06-25T04:53:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.690+0000 7f9fb0348700 1 -- start start 2021-06-25T04:53:19.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fb0348700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9fa80b0f90 0x7f9fa81446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:19.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fb0348700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa80b0310 con 0x7f9fa80b1d70 2021-06-25T04:53:19.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fb0348700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa80b05b0 con 0x7f9fa8148360 2021-06-25T04:53:19.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fb0348700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80a9080 con 0x7f9fa80b0f90 2021-06-25T04:53:19.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fae0e4700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9fa80b1d70 0x7f9fa80b2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56346/0 (socket says 172.21.15.57:56346) 2021-06-25T04:53:19.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fae0e4700 1 -- 172.21.15.57:0/1713718998 learned_addr learned my addr 172.21.15.57:0/1713718998 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:19.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fae8e5700 1 --2- 172.21.15.57:0/1713718998 >> v2:172.21.15.87:3300/0 conn(0x7f9fa80b0f90 0x7f9fa81446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:19.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fad0e2700 1 -- 172.21.15.57:0/1713718998 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627466283 0 0) 0x7f9fa80b0310 con 0x7f9fa80b1d70 2021-06-25T04:53:19.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fad0e2700 1 -- 172.21.15.57:0/1713718998 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f90003260 con 0x7f9fa80b1d70 2021-06-25T04:53:19.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fad0e2700 1 -- 172.21.15.57:0/1713718998 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088042964 0 0) 0x7f9fa80b05b0 con 0x7f9fa8148360 2021-06-25T04:53:19.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fad0e2700 1 -- 172.21.15.57:0/1713718998 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fa80b0310 con 0x7f9fa8148360 2021-06-25T04:53:19.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fae8e5700 1 -- 172.21.15.57:0/1713718998 >> v1:172.21.15.87:6789/0 conn(0x7f9fa8148360 legacy=0x7f9fa80a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fae8e5700 1 -- 172.21.15.57:0/1713718998 >> v1:172.21.15.57:6789/0 conn(0x7f9fa80b1d70 legacy=0x7f9fa80b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fae8e5700 1 -- 172.21.15.57:0/1713718998 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80b0850 con 0x7f9fa80b0f90 2021-06-25T04:53:19.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fae8e5700 1 --2- 172.21.15.57:0/1713718998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa80b0f90 0x7f9fa81446e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f9fa81476f0 tx=0x7f9fa0006df0).ready entity=mon.1 client_cookie=254a5421d08a1fbb server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:19.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fad0e2700 1 -- 172.21.15.57:0/1713718998 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa000d610 con 0x7f9fa80b0f90 2021-06-25T04:53:19.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fad0e2700 1 -- 172.21.15.57:0/1713718998 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa0000e90 con 0x7f9fa80b0f90 2021-06-25T04:53:19.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fad0e2700 1 -- 172.21.15.57:0/1713718998 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa000d960 con 0x7f9fa80b0f90 2021-06-25T04:53:19.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fb0348700 1 -- 172.21.15.57:0/1713718998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa80b0f90 msgr2=0x7f9fa81446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fb0348700 1 --2- 172.21.15.57:0/1713718998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa80b0f90 0x7f9fa81446e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f9fa81476f0 tx=0x7f9fa0006df0).stop 2021-06-25T04:53:19.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fb0348700 1 -- 172.21.15.57:0/1713718998 shutdown_connections 2021-06-25T04:53:19.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fb0348700 1 --2- 172.21.15.57:0/1713718998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa80b0f90 0x7f9fa81446e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fb0348700 1 -- 172.21.15.57:0/1713718998 >> 172.21.15.57:0/1713718998 conn(0x7f9fa805f670 msgr2=0x7f9fa805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:19.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fb0348700 1 -- 172.21.15.57:0/1713718998 shutdown_connections 2021-06-25T04:53:19.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.694+0000 7f9fb0348700 1 -- 172.21.15.57:0/1713718998 wait complete. 2021-06-25T04:53:19.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.698+0000 7f9fb0348700 1 Processor -- start 2021-06-25T04:53:19.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.698+0000 7f9fb0348700 1 -- start start 2021-06-25T04:53:19.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.698+0000 7f9fb0348700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa80b0f90 0x7f9fa80ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:19.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.698+0000 7f9fb0348700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa80b1d70 0x7f9fa8062780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:19.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.698+0000 7f9fb0348700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa8148360 0x7f9fa815a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:19.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.698+0000 7f9fb0348700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa814b920 con 0x7f9fa8148360 2021-06-25T04:53:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.698+0000 7f9fb0348700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8062c70 con 0x7f9fa80b0f90 2021-06-25T04:53:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.698+0000 7f9fb0348700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815aaf0 con 0x7f9fa80b1d70 2021-06-25T04:53:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.698+0000 7f9fae8e5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa8148360 0x7f9fa815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.698+0000 7f9fae8e5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa8148360 0x7f9fa815a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39136/0 (socket says 172.21.15.57:39136) 2021-06-25T04:53:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.698+0000 7f9fae8e5700 1 -- 172.21.15.57:0/2366328488 learned_addr learned my addr 172.21.15.57:0/2366328488 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9fae0e4700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa80b0f90 0x7f9fa80ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9fad8e3700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa80b1d70 0x7f9fa8062780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9fae8e5700 1 -- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa80b1d70 msgr2=0x7f9fa8062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9fae8e5700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa80b1d70 0x7f9fa8062780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9fae8e5700 1 -- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa80b0f90 msgr2=0x7f9fa80ab850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9fae8e5700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa80b0f90 0x7f9fa80ab850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9fae8e5700 1 -- 172.21.15.57:0/2366328488 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa000b180 con 0x7f9fa8148360 2021-06-25T04:53:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9fae8e5700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa8148360 0x7f9fa815a600 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f9fa8063490 tx=0x7f9fa0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:19.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9f977fe700 1 -- 172.21.15.57:0/2366328488 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa0012d80 con 0x7f9fa8148360 2021-06-25T04:53:19.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9f977fe700 1 -- 172.21.15.57:0/2366328488 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa000d290 con 0x7f9fa8148360 2021-06-25T04:53:19.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9fb0348700 1 -- 172.21.15.57:0/2366328488 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa8062e90 con 0x7f9fa8148360 2021-06-25T04:53:19.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9f977fe700 1 -- 172.21.15.57:0/2366328488 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa001f630 con 0x7f9fa8148360 2021-06-25T04:53:19.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9fb0348700 1 -- 172.21.15.57:0/2366328488 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa815a160 con 0x7f9fa8148360 2021-06-25T04:53:19.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9fb0348700 1 -- 172.21.15.57:0/2366328488 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa8057310 con 0x7f9fa8148360 2021-06-25T04:53:19.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.702+0000 7f9f977fe700 1 -- 172.21.15.57:0/2366328488 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9fa0025020 con 0x7f9fa8148360 2021-06-25T04:53:19.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.706+0000 7f9f977fe700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f88055340 0x7f9f88057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:19.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.706+0000 7f9f977fe700 1 -- 172.21.15.57:0/2366328488 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f9fa006eaf0 con 0x7f9fa8148360 2021-06-25T04:53:19.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.706+0000 7f9fae0e4700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f88055340 0x7f9f88057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:19.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.706+0000 7f9fae0e4700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f88055340 0x7f9f88057800 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f9f9800d000 tx=0x7f9f98009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:19.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.710+0000 7f9f977fe700 1 -- 172.21.15.57:0/2366328488 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9fa0044f80 con 0x7f9fa8148360 2021-06-25T04:53:19.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:19.878+0000 7f9fb0348700 1 -- 172.21.15.57:0/2366328488 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f9fa8044610 con 0x7f9fa8148360 2021-06-25T04:53:20.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.294+0000 7f9f977fe700 1 -- 172.21.15.57:0/2366328488 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v250) v1 ==== 147+0+0 (secure 0 0 0) 0x7f9fa00485a0 con 0x7f9fa8148360 2021-06-25T04:53:20.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 -- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f88055340 msgr2=0x7f9f88057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:20.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f88055340 0x7f9f88057800 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f9f9800d000 tx=0x7f9f98009040).stop 2021-06-25T04:53:20.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 -- 172.21.15.57:0/2366328488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa8148360 msgr2=0x7f9fa815a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:20.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa8148360 0x7f9fa815a600 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f9fa8063490 tx=0x7f9fa0014000).stop 2021-06-25T04:53:20.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 -- 172.21.15.57:0/2366328488 shutdown_connections 2021-06-25T04:53:20.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f88055340 0x7f9f88057800 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:20.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa8148360 0x7f9fa815a600 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:20.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fa80b1d70 0x7f9fa8062780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:20.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 --2- 172.21.15.57:0/2366328488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa80b0f90 0x7f9fa80ab850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:20.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 -- 172.21.15.57:0/2366328488 >> 172.21.15.57:0/2366328488 conn(0x7f9fa805f670 msgr2=0x7f9fa80af060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:20.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 -- 172.21.15.57:0/2366328488 shutdown_connections 2021-06-25T04:53:20.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.298+0000 7f9fb0348700 1 -- 172.21.15.57:0/2366328488 wait complete. 2021-06-25T04:53:20.324 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-06-25T04:53:20.325 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2021-06-25T04:53:20.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-06-25T04:53:20.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.418+0000 7f009a52f700 1 Processor -- start 2021-06-25T04:53:20.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.418+0000 7f009a52f700 1 -- start start 2021-06-25T04:53:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f009a52f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940acd10 0x7f009414a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f009a52f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00940b6ca0 con 0x7f00940608d0 2021-06-25T04:53:20.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f009a52f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00940611a0 con 0x7f00940b68c0 2021-06-25T04:53:20.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f009a52f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0094061440 con 0x7f00940acd10 2021-06-25T04:53:20.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f008bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f00940608d0 0x7f00940aa590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56360/0 (socket says 172.21.15.57:56360) 2021-06-25T04:53:20.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f008bfff700 1 -- 172.21.15.57:0/2652496532 learned_addr learned my addr 172.21.15.57:0/2652496532 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:20.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f0098acc700 1 --2- 172.21.15.57:0/2652496532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940acd10 0x7f009414a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:20.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f00937fe700 1 -- 172.21.15.57:0/2652496532 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315140335 0 0) 0x7f00940b6ca0 con 0x7f00940608d0 2021-06-25T04:53:20.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f00937fe700 1 -- 172.21.15.57:0/2652496532 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0074003260 con 0x7f00940608d0 2021-06-25T04:53:20.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f00937fe700 1 -- 172.21.15.57:0/2652496532 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120385737 0 0) 0x7f00940611a0 con 0x7f00940b68c0 2021-06-25T04:53:20.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f00937fe700 1 -- 172.21.15.57:0/2652496532 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00940b6ca0 con 0x7f00940b68c0 2021-06-25T04:53:20.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f0098acc700 1 -- 172.21.15.57:0/2652496532 >> v1:172.21.15.87:6789/0 conn(0x7f00940b68c0 legacy=0x7f00940a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:20.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f0098acc700 1 -- 172.21.15.57:0/2652496532 >> v1:172.21.15.57:6789/0 conn(0x7f00940608d0 legacy=0x7f00940aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:20.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f0098acc700 1 -- 172.21.15.57:0/2652496532 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940616e0 con 0x7f00940acd10 2021-06-25T04:53:20.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f0098acc700 1 --2- 172.21.15.57:0/2652496532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940acd10 0x7f009414a200 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f008c0032f0 tx=0x7f008c00a370).ready entity=mon.2 client_cookie=38716bf75b09993d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:20.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f00937fe700 1 -- 172.21.15.57:0/2652496532 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f008c00cba0 con 0x7f00940acd10 2021-06-25T04:53:20.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f00937fe700 1 -- 172.21.15.57:0/2652496532 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c00cd00 con 0x7f00940acd10 2021-06-25T04:53:20.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f009a52f700 1 -- 172.21.15.57:0/2652496532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940acd10 msgr2=0x7f009414a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:20.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f009a52f700 1 --2- 172.21.15.57:0/2652496532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940acd10 0x7f009414a200 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f008c0032f0 tx=0x7f008c00a370).stop 2021-06-25T04:53:20.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f009a52f700 1 -- 172.21.15.57:0/2652496532 shutdown_connections 2021-06-25T04:53:20.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f009a52f700 1 --2- 172.21.15.57:0/2652496532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940acd10 0x7f009414a200 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:20.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f009a52f700 1 -- 172.21.15.57:0/2652496532 >> 172.21.15.57:0/2652496532 conn(0x7f00940b3440 msgr2=0x7f00940b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:20.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f009a52f700 1 -- 172.21.15.57:0/2652496532 shutdown_connections 2021-06-25T04:53:20.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.422+0000 7f009a52f700 1 -- 172.21.15.57:0/2652496532 wait complete. 2021-06-25T04:53:20.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f009a52f700 1 Processor -- start 2021-06-25T04:53:20.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f009a52f700 1 -- start start 2021-06-25T04:53:20.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f009a52f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00940608d0 0x7f00940b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:20.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f009a52f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940acd10 0x7f009413efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:20.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f009a52f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00940b68c0 0x7f009414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:20.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f009a52f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00940af8e0 con 0x7f00940b68c0 2021-06-25T04:53:20.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f009a52f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009413e890 con 0x7f00940608d0 2021-06-25T04:53:20.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f009a52f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009413eb30 con 0x7f00940acd10 2021-06-25T04:53:20.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f0098acc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00940b68c0 0x7f009414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:20.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f0093fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00940608d0 0x7f00940b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:20.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f0098acc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00940b68c0 0x7f009414ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39150/0 (socket says 172.21.15.57:39150) 2021-06-25T04:53:20.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f0098acc700 1 -- 172.21.15.57:0/4014997398 learned_addr learned my addr 172.21.15.57:0/4014997398 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:20.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.426+0000 7f008bfff700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940acd10 0x7f009413efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:20.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0098acc700 1 -- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940acd10 msgr2=0x7f009413efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:20.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0098acc700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940acd10 0x7f009413efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:20.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0098acc700 1 -- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00940608d0 msgr2=0x7f00940b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:20.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0098acc700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00940608d0 0x7f00940b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:20.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0098acc700 1 -- 172.21.15.57:0/4014997398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c00a610 con 0x7f00940b68c0 2021-06-25T04:53:20.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0098acc700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00940b68c0 0x7f009414ffb0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f008c0032f0 tx=0x7f00940abf50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:20.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0091ffb700 1 -- 172.21.15.57:0/4014997398 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f008c0185f0 con 0x7f00940b68c0 2021-06-25T04:53:20.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0091ffb700 1 -- 172.21.15.57:0/4014997398 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c010e90 con 0x7f00940b68c0 2021-06-25T04:53:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f009a52f700 1 -- 172.21.15.57:0/4014997398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009413e520 con 0x7f00940b68c0 2021-06-25T04:53:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0091ffb700 1 -- 172.21.15.57:0/4014997398 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f008c018940 con 0x7f00940b68c0 2021-06-25T04:53:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f009a52f700 1 -- 172.21.15.57:0/4014997398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0094150640 con 0x7f00940b68c0 2021-06-25T04:53:20.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0091ffb700 1 -- 172.21.15.57:0/4014997398 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f008c00e040 con 0x7f00940b68c0 2021-06-25T04:53:20.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f009a52f700 1 -- 172.21.15.57:0/4014997398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00940af6a0 con 0x7f00940b68c0 2021-06-25T04:53:20.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0091ffb700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00780554e0 0x7f00780579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:20.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0091ffb700 1 -- 172.21.15.57:0/4014997398 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f008c06f1f0 con 0x7f00940b68c0 2021-06-25T04:53:20.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.430+0000 7f0093fff700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00780554e0 0x7f00780579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:20.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.434+0000 7f0093fff700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00780554e0 0x7f00780579a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f008400d000 tx=0x7f0084007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:20.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.434+0000 7f0091ffb700 1 -- 172.21.15.57:0/4014997398 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f00940af6a0 con 0x7f00940b68c0 2021-06-25T04:53:20.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:20.606+0000 7f009a52f700 1 -- 172.21.15.57:0/4014997398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f00940af6a0 con 0x7f00940b68c0 2021-06-25T04:53:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.302+0000 7f0091ffb700 1 -- 172.21.15.57:0/4014997398 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v251) v1 ==== 142+0+0 (secure 0 0 0) 0x7f00940af6a0 con 0x7f00940b68c0 2021-06-25T04:53:21.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 -- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00780554e0 msgr2=0x7f00780579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00780554e0 0x7f00780579a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f008400d000 tx=0x7f0084007a20).stop 2021-06-25T04:53:21.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 -- 172.21.15.57:0/4014997398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00940b68c0 msgr2=0x7f009414ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00940b68c0 0x7f009414ffb0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f008c0032f0 tx=0x7f00940abf50).stop 2021-06-25T04:53:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 -- 172.21.15.57:0/4014997398 shutdown_connections 2021-06-25T04:53:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f00780554e0 0x7f00780579a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00940b68c0 0x7f009414ffb0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940acd10 0x7f009413efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 --2- 172.21.15.57:0/4014997398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00940608d0 0x7f00940b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 -- 172.21.15.57:0/4014997398 >> 172.21.15.57:0/4014997398 conn(0x7f00940b3440 msgr2=0x7f00940b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 -- 172.21.15.57:0/4014997398 shutdown_connections 2021-06-25T04:53:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.306+0000 7f009a52f700 1 -- 172.21.15.57:0/4014997398 wait complete. 2021-06-25T04:53:21.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:53:21.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.430+0000 7f8c2152a700 1 Processor -- start 2021-06-25T04:53:21.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.430+0000 7f8c2152a700 1 -- start start 2021-06-25T04:53:21.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c2152a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8c1c0b5460 0x7f8c1c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c2152a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c147560 0x7f8c1c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c2152a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c0b5840 con 0x7f8c1c0b05d0 2021-06-25T04:53:21.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c2152a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c1452a0 con 0x7f8c1c0b5460 2021-06-25T04:53:21.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c2152a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0adfb0 con 0x7f8c1c147560 2021-06-25T04:53:21.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c137fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8c1c0b05d0 0x7f8c1c067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56372/0 (socket says 172.21.15.57:56372) 2021-06-25T04:53:21.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c137fe700 1 -- 172.21.15.57:0/1334862689 learned_addr learned my addr 172.21.15.57:0/1334862689 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:21.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1bfff700 1 --2- 172.21.15.57:0/1334862689 >> v2:172.21.15.87:3300/0 conn(0x7f8c1c0b5460 0x7f8c1c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097545320 0 0) 0x7f8c1c0b5840 con 0x7f8c1c0b05d0 2021-06-25T04:53:21.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c20d29700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c147560 0x7f8c1c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bfc003260 con 0x7f8c1c0b05d0 2021-06-25T04:53:21.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 383722739 0 0) 0x7f8bfc003260 con 0x7f8c1c0b05d0 2021-06-25T04:53:21.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c147560 msgr2=0x7f8c1c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:21.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c147560 0x7f8c1c0acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 >> v2:172.21.15.87:3300/0 conn(0x7f8c1c0b5460 msgr2=0x7f8c1c0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:21.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 --2- 172.21.15.57:0/1334862689 >> v2:172.21.15.87:3300/0 conn(0x7f8c1c0b5460 0x7f8c1c0af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0ac7c0 con 0x7f8c1c0b05d0 2021-06-25T04:53:21.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f8c04001660 con 0x7f8c1c0b05d0 2021-06-25T04:53:21.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 >> v1:172.21.15.57:6789/0 conn(0x7f8c1c0b05d0 legacy=0x7f8c1c067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0037d0 0x7f8bfc003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c147560 0x7f8bfc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bfc0049f0 0x7f8bfc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c1452a0 con 0x7f8bfc0037d0 2021-06-25T04:53:21.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0adfb0 con 0x7f8bfc0049f0 2021-06-25T04:53:21.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc00b750 con 0x7f8c1c147560 2021-06-25T04:53:21.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1bfff700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0037d0 0x7f8bfc003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c137fe700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c147560 0x7f8bfc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c20d29700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bfc0049f0 0x7f8bfc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c20d29700 1 -- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c147560 msgr2=0x7f8bfc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:21.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c20d29700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c147560 0x7f8bfc004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c20d29700 1 -- 172.21.15.57:0/1334862689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0037d0 msgr2=0x7f8bfc003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:21.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c20d29700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0037d0 0x7f8bfc003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c20d29700 1 -- 172.21.15.57:0/1334862689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc003260 con 0x7f8bfc0049f0 2021-06-25T04:53:21.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1bfff700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0037d0 0x7f8bfc003c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:21.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c20d29700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bfc0049f0 0x7f8bfc004e70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f8c1400c000 tx=0x7f8c140091d0).ready entity=mon.1 client_cookie=1ed4c28dc90f4853 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:21.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c1400e7e0 con 0x7f8bfc0049f0 2021-06-25T04:53:21.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1400e940 con 0x7f8bfc0049f0 2021-06-25T04:53:21.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c1b7fe700 1 -- 172.21.15.57:0/1334862689 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c1400eca0 con 0x7f8bfc0049f0 2021-06-25T04:53:21.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c2152a700 1 -- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bfc0049f0 msgr2=0x7f8bfc004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c2152a700 1 --2- 172.21.15.57:0/1334862689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bfc0049f0 0x7f8bfc004e70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f8c1400c000 tx=0x7f8c140091d0).stop 2021-06-25T04:53:21.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.434+0000 7f8c20d29700 1 -- 172.21.15.57:0/1334862689 reap_dead start 2021-06-25T04:53:21.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.438+0000 7f8c2152a700 1 -- 172.21.15.57:0/1334862689 shutdown_connections 2021-06-25T04:53:21.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.438+0000 7f8c2152a700 1 -- 172.21.15.57:0/1334862689 >> 172.21.15.57:0/1334862689 conn(0x7f8c1c062520 msgr2=0x7f8c1c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.438+0000 7f8c2152a700 1 -- 172.21.15.57:0/1334862689 shutdown_connections 2021-06-25T04:53:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.438+0000 7f8c2152a700 1 -- 172.21.15.57:0/1334862689 wait complete. 2021-06-25T04:53:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.438+0000 7f8c2152a700 1 Processor -- start 2021-06-25T04:53:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.438+0000 7f8c2152a700 1 -- start start 2021-06-25T04:53:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c2152a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0677b0 0x7f8c1c0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c2152a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c1c064ca0 0x7f8c1c0abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c2152a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0a7080 0x7f8c1c156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c2152a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c063790 con 0x7f8c1c0a7080 2021-06-25T04:53:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c2152a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c067b90 con 0x7f8c1c064ca0 2021-06-25T04:53:21.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c2152a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c063e60 con 0x7f8c1c0677b0 2021-06-25T04:53:21.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c20d29700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0a7080 0x7f8c1c156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c20d29700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0a7080 0x7f8c1c156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39170/0 (socket says 172.21.15.57:39170) 2021-06-25T04:53:21.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c20d29700 1 -- 172.21.15.57:0/4072305228 learned_addr learned my addr 172.21.15.57:0/4072305228 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c1bfff700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0677b0 0x7f8c1c0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c137fe700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c1c064ca0 0x7f8c1c0abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c20d29700 1 -- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0677b0 msgr2=0x7f8c1c0ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c20d29700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0677b0 0x7f8c1c0ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c20d29700 1 -- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c1c064ca0 msgr2=0x7f8c1c0abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c20d29700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c1c064ca0 0x7f8c1c0abde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c20d29700 1 -- 172.21.15.57:0/4072305228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c065c10 con 0x7f8c1c0a7080 2021-06-25T04:53:21.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c20d29700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0a7080 0x7f8c1c156870 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f8c1c0acb00 tx=0x7f8c1401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:21.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c19ffb700 1 -- 172.21.15.57:0/4072305228 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c14009600 con 0x7f8c1c0a7080 2021-06-25T04:53:21.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c19ffb700 1 -- 172.21.15.57:0/4072305228 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1401dcf0 con 0x7f8c1c0a7080 2021-06-25T04:53:21.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c2152a700 1 -- 172.21.15.57:0/4072305228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c065eb0 con 0x7f8c1c0a7080 2021-06-25T04:53:21.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c19ffb700 1 -- 172.21.15.57:0/4072305228 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c1401b640 con 0x7f8c1c0a7080 2021-06-25T04:53:21.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c2152a700 1 -- 172.21.15.57:0/4072305228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c064230 con 0x7f8c1c0a7080 2021-06-25T04:53:21.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.446+0000 7f8c19ffb700 1 -- 172.21.15.57:0/4072305228 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8c1401b7a0 con 0x7f8c1c0a7080 2021-06-25T04:53:21.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.442+0000 7f8c2152a700 1 -- 172.21.15.57:0/4072305228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c057310 con 0x7f8c1c0a7080 2021-06-25T04:53:21.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.446+0000 7f8c19ffb700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8c00055450 0x7f8c00057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.446+0000 7f8c19ffb700 1 -- 172.21.15.57:0/4072305228 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f8c1406f450 con 0x7f8c1c0a7080 2021-06-25T04:53:21.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.446+0000 7f8c1bfff700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8c00055450 0x7f8c00057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.446+0000 7f8c1bfff700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8c00055450 0x7f8c00057910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f8c0c00b000 tx=0x7f8c0c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:21.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.450+0000 7f8c19ffb700 1 -- 172.21.15.57:0/4072305228 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8c14045930 con 0x7f8c1c0a7080 2021-06-25T04:53:21.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.582+0000 7f8c2152a700 1 -- 172.21.15.57:0/4072305228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8c1c05f200 con 0x7f8c1c0a7080 2021-06-25T04:53:21.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.590+0000 7f8c19ffb700 1 -- 172.21.15.57:0/4072305228 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8c1401de60 con 0x7f8c1c0a7080 2021-06-25T04:53:21.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 -- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8c00055450 msgr2=0x7f8c00057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8c00055450 0x7f8c00057910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f8c0c00b000 tx=0x7f8c0c006df0).stop 2021-06-25T04:53:21.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 -- 172.21.15.57:0/4072305228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0a7080 msgr2=0x7f8c1c156870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0a7080 0x7f8c1c156870 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f8c1c0acb00 tx=0x7f8c1401a000).stop 2021-06-25T04:53:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 -- 172.21.15.57:0/4072305228 shutdown_connections 2021-06-25T04:53:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8c00055450 0x7f8c00057910 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0a7080 0x7f8c1c156870 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c1c064ca0 0x7f8c1c0abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 --2- 172.21.15.57:0/4072305228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0677b0 0x7f8c1c0ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 -- 172.21.15.57:0/4072305228 >> 172.21.15.57:0/4072305228 conn(0x7f8c1c062520 msgr2=0x7f8c1c0b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:21.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 -- 172.21.15.57:0/4072305228 shutdown_connections 2021-06-25T04:53:21.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.594+0000 7f8c2152a700 1 -- 172.21.15.57:0/4072305228 wait complete. 2021-06-25T04:53:21.614 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:53:21.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:53:21.632 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:53:21.653 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:53:21.674 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:53:21.695 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:53:21.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:21.696 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:53:21.697 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:53:21.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:53:21.706 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:53:21.707 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:53:21.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:21.708 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:53:21.708 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:53:21.745 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:53:21.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:53:21.746 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:53:21.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:53:21.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8243fff700 1 Processor -- start 2021-06-25T04:53:21.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8243fff700 1 -- start start 2021-06-25T04:53:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8243fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82440b5460 0x7f82440af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8243fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b05d0 0x7f8244147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8243fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82440b5840 con 0x7f8244067560 2021-06-25T04:53:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8243fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82441452a0 con 0x7f82440b5460 2021-06-25T04:53:21.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8243fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82440adfb0 con 0x7f82440b05d0 2021-06-25T04:53:21.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f82437fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8244067560 0x7f82440acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56392/0 (socket says 172.21.15.57:56392) 2021-06-25T04:53:21.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f82437fe700 1 -- 172.21.15.57:0/4169777947 learned_addr learned my addr 172.21.15.57:0/4169777947 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:21.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f82427fc700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b05d0 0x7f8244147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8242ffd700 1 --2- 172.21.15.57:0/4169777947 >> v2:172.21.15.87:3300/0 conn(0x7f82440b5460 0x7f82440af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134625130 0 0) 0x7f82440b5840 con 0x7f8244067560 2021-06-25T04:53:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8228003260 con 0x7f8244067560 2021-06-25T04:53:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2361525415 0 0) 0x7f8228003260 con 0x7f8244067560 2021-06-25T04:53:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b05d0 msgr2=0x7f8244147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:21.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b05d0 0x7f8244147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 >> v2:172.21.15.87:3300/0 conn(0x7f82440b5460 msgr2=0x7f82440af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:21.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 --2- 172.21.15.57:0/4169777947 >> v2:172.21.15.87:3300/0 conn(0x7f82440b5460 0x7f82440af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82440ac7c0 con 0x7f8244067560 2021-06-25T04:53:21.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f823c0019e0 con 0x7f8244067560 2021-06-25T04:53:21.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 >> v1:172.21.15.57:6789/0 conn(0x7f8244067560 legacy=0x7f82440acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8228003750 0x7f8228003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8228004500 0x7f8228004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b05d0 0x7f8228004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82441452a0 con 0x7f8228003750 2021-06-25T04:53:21.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82440adfb0 con 0x7f8228004500 2021-06-25T04:53:21.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822800b750 con 0x7f82440b05d0 2021-06-25T04:53:21.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f82427fc700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8228004500 0x7f8228004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f82437fe700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b05d0 0x7f8228004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.854+0000 7f8242ffd700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8228003750 0x7f8228003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f82427fc700 1 -- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b05d0 msgr2=0x7f8228004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:21.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f82427fc700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b05d0 0x7f8228004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f82427fc700 1 -- 172.21.15.57:0/4169777947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8228003750 msgr2=0x7f8228003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f82427fc700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8228003750 0x7f8228003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f82427fc700 1 -- 172.21.15.57:0/4169777947 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228003260 con 0x7f8228004500 2021-06-25T04:53:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f82437fe700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b05d0 0x7f8228004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f82427fc700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8228004500 0x7f8228004980 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f823400c000 tx=0x7f8234006df0).ready entity=mon.1 client_cookie=83efa8c5c6a62c77 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f823400e800 con 0x7f8228004500 2021-06-25T04:53:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823400e960 con 0x7f8228004500 2021-06-25T04:53:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f8241ffb700 1 -- 172.21.15.57:0/4169777947 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f823400ecc0 con 0x7f8228004500 2021-06-25T04:53:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f8243fff700 1 -- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8228004500 msgr2=0x7f8228004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f8243fff700 1 --2- 172.21.15.57:0/4169777947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8228004500 0x7f8228004980 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f823400c000 tx=0x7f8234006df0).stop 2021-06-25T04:53:21.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f82437fe700 1 -- 172.21.15.57:0/4169777947 reap_dead start 2021-06-25T04:53:21.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f8243fff700 1 -- 172.21.15.57:0/4169777947 shutdown_connections 2021-06-25T04:53:21.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f8243fff700 1 -- 172.21.15.57:0/4169777947 >> 172.21.15.57:0/4169777947 conn(0x7f8244062520 msgr2=0x7f8244062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:21.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f8243fff700 1 -- 172.21.15.57:0/4169777947 shutdown_connections 2021-06-25T04:53:21.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.858+0000 7f8243fff700 1 -- 172.21.15.57:0/4169777947 wait complete. 2021-06-25T04:53:21.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8243fff700 1 Processor -- start 2021-06-25T04:53:21.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8243fff700 1 -- start start 2021-06-25T04:53:21.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8243fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8244145980 0x7f8244145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8243fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b3680 0x7f824413f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8243fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82440b3b00 0x7f824413fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8243fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82440b4df0 con 0x7f82440b3b00 2021-06-25T04:53:21.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8243fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82440b4280 con 0x7f8244145980 2021-06-25T04:53:21.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8243fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82440b44b0 con 0x7f82440b3680 2021-06-25T04:53:21.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f82437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82440b3b00 0x7f824413fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f82437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82440b3b00 0x7f824413fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39190/0 (socket says 172.21.15.57:39190) 2021-06-25T04:53:21.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f82437fe700 1 -- 172.21.15.57:0/1745948543 learned_addr learned my addr 172.21.15.57:0/1745948543 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:21.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8242ffd700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8244145980 0x7f8244145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f82427fc700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b3680 0x7f824413f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f82437fe700 1 -- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b3680 msgr2=0x7f824413f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f82437fe700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b3680 0x7f824413f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f82437fe700 1 -- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8244145980 msgr2=0x7f8244145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:21.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f82437fe700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8244145980 0x7f8244145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:21.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f82437fe700 1 -- 172.21.15.57:0/1745948543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8244146250 con 0x7f82440b3b00 2021-06-25T04:53:21.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f82437fe700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82440b3b00 0x7f824413fe00 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f823c000b60 tx=0x7f823c0021d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:21.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8233fff700 1 -- 172.21.15.57:0/1745948543 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f823c00f970 con 0x7f82440b3b00 2021-06-25T04:53:21.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8233fff700 1 -- 172.21.15.57:0/1745948543 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c00fad0 con 0x7f82440b3b00 2021-06-25T04:53:21.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8243fff700 1 -- 172.21.15.57:0/1745948543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82440b4b50 con 0x7f82440b3b00 2021-06-25T04:53:21.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8233fff700 1 -- 172.21.15.57:0/1745948543 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f823c00fe30 con 0x7f82440b3b00 2021-06-25T04:53:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.862+0000 7f8243fff700 1 -- 172.21.15.57:0/1745948543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8244143850 con 0x7f82440b3b00 2021-06-25T04:53:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.866+0000 7f8243fff700 1 -- 172.21.15.57:0/1745948543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8244146420 con 0x7f82440b3b00 2021-06-25T04:53:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.866+0000 7f8233fff700 1 -- 172.21.15.57:0/1745948543 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f823c01b030 con 0x7f82440b3b00 2021-06-25T04:53:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.866+0000 7f8233fff700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8220055360 0x7f8220057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:21.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.866+0000 7f8233fff700 1 -- 172.21.15.57:0/1745948543 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f823c06d880 con 0x7f82440b3b00 2021-06-25T04:53:21.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.866+0000 7f8242ffd700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8220055360 0x7f8220057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:21.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.866+0000 7f8242ffd700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8220055360 0x7f8220057820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f823800b000 tx=0x7f8238006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:21.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.870+0000 7f8233fff700 1 -- 172.21.15.57:0/1745948543 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f823c043d10 con 0x7f82440b3b00 2021-06-25T04:53:22.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:21.998+0000 7f8243fff700 1 -- 172.21.15.57:0/1745948543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8244057310 con 0x7f82440b3b00 2021-06-25T04:53:22.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8233fff700 1 -- 172.21.15.57:0/1745948543 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v71) v1 ==== 81+0+29220 (secure 0 0 0) 0x7f823c019030 con 0x7f82440b3b00 2021-06-25T04:53:22.007 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:22.007 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:53:22.007 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 71, 2021-06-25T04:53:22.008 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:53:22.008 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:53:22.008 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:53:19.282399+0000", 2021-06-25T04:53:22.008 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:53:22.009 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:53:22.009 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:53:22.009 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:53:22.009 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:53:22.009 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:53:22.010 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:53:22.010 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:53:22.010 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:53:22.010 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:53:22.011 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:53:22.011 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:53:22.011 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:53:22.011 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:53:22.011 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:53:22.012 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 12, 2021-06-25T04:53:22.012 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:53:22.012 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:53:22.012 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:53:22.013 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:53:22.013 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:53:22.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.013 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:53:22.013 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:53:22.014 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:53:22.014 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:53:22.014 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:53:22.015 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:53:22.015 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:53:22.015 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:53:22.015 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:53:22.016 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:53:22.016 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:53:22.016 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:53:22.016 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:53:22.016 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:53:22.017 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:53:22.017 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:53:22.017 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:53:22.018 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:53:22.018 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:53:22.018 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:53:22.018 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:53:22.019 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:53:22.019 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:53:22.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.019 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:53:22.020 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:53:22.020 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:53:22.020 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:53:22.020 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:53:22.021 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:53:22.021 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:53:22.021 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:53:22.021 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:53:22.021 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:53:22.022 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:53:22.022 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:53:22.022 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:53:22.022 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:53:22.023 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:53:22.023 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:53:22.023 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:53:22.023 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:53:22.024 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:53:22.024 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:53:22.024 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:53:22.024 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:53:22.025 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:53:22.025 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:53:22.025 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:53:22.026 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:53:22.026 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:53:22.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.026 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:53:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:53:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:53:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:53:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:53:22.027 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:53:22.028 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:53:22.028 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:53:22.028 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:53:22.028 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:53:22.029 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:53:22.029 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:53:22.029 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:53:22.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.029 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:53:22.030 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:53:22.030 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.031 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:53:22.031 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:53:22.031 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:53:22.031 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:53:22.031 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:53:22.032 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:53:22.032 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:53:22.032 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:53:22.032 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:53:22.033 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:53:22.033 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:53:22.033 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:53:22.033 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:53:22.034 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:53:22.034 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:53:22.034 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:53:22.034 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:53:22.035 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:53:22.035 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:53:22.035 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:53:22.035 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:53:22.035 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:53:22.036 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:53:22.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.036 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:53:22.036 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:53:22.037 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:53:22.037 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:53:22.037 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:53:22.037 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:53:22.037 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:53:22.038 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:53:22.038 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:53:22.038 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:53:22.038 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:53:22.038 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:53:22.039 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:53:22.039 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:53:22.039 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:53:22.039 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:53:22.040 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:53:22.040 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:53:22.040 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:53:22.040 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:53:22.040 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:53:22.042 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:53:22.042 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:53:22.042 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:53:22.042 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:53:22.043 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:53:22.043 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:53:22.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.043 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:53:22.044 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:53:22.044 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:53:22.044 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:53:22.044 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:53:22.045 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:53:22.045 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:53:22.045 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:53:22.045 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:53:22.045 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:53:22.046 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:53:22.046 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:53:22.046 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:53:22.046 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:53:22.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.047 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:53:22.047 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:53:22.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.048 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:53:22.048 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:53:22.048 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:22.048 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:22.049 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:22.049 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:22.049 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:22.049 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:22.049 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:22.050 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 65, 2021-06-25T04:53:22.050 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:22.050 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:22.050 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:22.051 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.051 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.051 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:53:22.051 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:22.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.052 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.052 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:53:22.053 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:22.053 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.053 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.054 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:22.054 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.055 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.055 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:53:22.055 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:22.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.056 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.056 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:53:22.057 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:22.057 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.057 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.057 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:22.058 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.058 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.058 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:53:22.059 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:22.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.059 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.059 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:53:22.060 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:22.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.060 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.061 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:22.061 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.061 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.061 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:53:22.062 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:22.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.062 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.063 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:53:22.063 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:53:22.063 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.063 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.064 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:53:22.064 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:53:22.064 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:53:22.064 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:53:22.064 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:22.065 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:22.065 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:22.065 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.066 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:53:22.066 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:53:22.066 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:22.066 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:22.067 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:22.067 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:22.067 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:22.067 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:22.068 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:22.068 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 65, 2021-06-25T04:53:22.068 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:22.068 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:22.069 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:22.069 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.069 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.070 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:53:22.070 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:22.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.070 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.071 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:53:22.071 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:22.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.071 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.072 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:22.072 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.072 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.073 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:53:22.073 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:22.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.074 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.074 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:53:22.074 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:22.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.074 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.075 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:22.075 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.076 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.076 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:53:22.076 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:22.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.077 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.077 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:53:22.077 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:22.077 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.077 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.079 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.079 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:53:22.079 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:22.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.080 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.080 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:53:22.080 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:53:22.080 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.081 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.081 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:53:22.081 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:53:22.081 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:53:22.082 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:53:22.082 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:22.082 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:22.082 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:22.083 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.083 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:53:22.083 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:53:22.084 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:22.084 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:22.084 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:22.084 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:22.085 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:22.085 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:22.085 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:22.085 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 64, 2021-06-25T04:53:22.086 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:22.086 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:22.086 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:22.086 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.087 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.087 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:53:22.087 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:22.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.088 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.088 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:53:22.088 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:22.089 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.089 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.089 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:22.090 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.090 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.090 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:53:22.091 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:22.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.091 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.092 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:53:22.092 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:22.092 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.092 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.093 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:22.093 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.093 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.093 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:53:22.094 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:22.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.094 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.095 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:53:22.095 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:22.095 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.095 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.096 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:22.096 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.096 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.097 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:53:22.097 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:22.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.098 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.098 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:53:22.098 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:53:22.098 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.099 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.099 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:53:22.099 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:53:22.099 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:53:22.100 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:53:22.100 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:22.100 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:22.100 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:22.101 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.101 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:53:22.101 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:53:22.102 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:22.102 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:22.102 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:22.102 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:22.103 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:22.103 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:22.103 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:22.103 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 52, 2021-06-25T04:53:22.103 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:22.104 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:22.104 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:22.104 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.104 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.105 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:53:22.105 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:22.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.106 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.106 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:53:22.106 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:22.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.106 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.107 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:22.107 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.108 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.108 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:53:22.108 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:22.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.109 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.109 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:53:22.109 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:22.109 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.109 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.110 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:22.110 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.111 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.111 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:53:22.111 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:22.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.112 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.112 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:53:22.112 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:22.113 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.113 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.113 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:22.113 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.114 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.114 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:53:22.114 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:22.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.115 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.115 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:53:22.116 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:53:22.116 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.116 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.117 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:53:22.117 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:53:22.117 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:53:22.117 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:53:22.117 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:22.118 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:22.118 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:22.118 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.119 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:53:22.119 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:53:22.119 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:22.119 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:22.120 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:22.120 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:22.120 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:22.120 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:22.120 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:22.121 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 65, 2021-06-25T04:53:22.121 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:22.121 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:22.121 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:22.122 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.122 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.122 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:53:22.122 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:22.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.123 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.123 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:53:22.123 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:22.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.124 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.124 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:22.125 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.125 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.125 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:53:22.125 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:22.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.126 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.126 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:53:22.127 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:22.127 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.127 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.127 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:22.128 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.128 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.128 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:53:22.129 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:22.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.129 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.130 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:53:22.130 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:22.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.130 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.131 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:22.131 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.131 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.132 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:53:22.132 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:22.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.133 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.133 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:53:22.133 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:53:22.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.133 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.134 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:53:22.134 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:53:22.134 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:53:22.135 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:53:22.135 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:22.135 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:22.135 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:22.135 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.136 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:53:22.136 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:53:22.137 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:22.137 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:22.137 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:22.137 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:22.137 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:22.138 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:22.138 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:22.138 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 64, 2021-06-25T04:53:22.138 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:22.138 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:22.139 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:22.139 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.139 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.140 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:53:22.140 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:22.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.140 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.141 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:53:22.141 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:22.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.141 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.142 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:22.142 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.142 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.143 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:53:22.143 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:22.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.143 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.144 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:53:22.144 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:22.144 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.144 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.145 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:22.145 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.145 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.146 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:53:22.146 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:22.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.147 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.147 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:53:22.147 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:22.147 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.147 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.148 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:22.148 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.148 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.149 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:53:22.149 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:22.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.150 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.150 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:53:22.150 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:53:22.150 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.150 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.151 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:53:22.151 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:53:22.151 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:53:22.152 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:53:22.152 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:22.152 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:22.152 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:22.152 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.153 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:53:22.153 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:53:22.153 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:22.154 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:22.154 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:22.155 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:22.155 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:22.155 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:22.156 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:22.156 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 65, 2021-06-25T04:53:22.156 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:22.156 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:22.156 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:22.157 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.157 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.157 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:53:22.158 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:22.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.158 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.158 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:53:22.159 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:22.159 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.159 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.160 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:22.160 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.160 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.160 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:53:22.161 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:22.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.161 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.161 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:53:22.162 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:22.162 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.162 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.163 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:22.163 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.163 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.163 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:53:22.164 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:22.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.164 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.165 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:53:22.165 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:22.165 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.165 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.166 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:22.166 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.166 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.167 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:53:22.167 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:22.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.167 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.168 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:53:22.168 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:53:22.168 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.168 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.169 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:53:22.169 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:53:22.169 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:53:22.170 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:53:22.170 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:22.170 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:22.170 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:22.171 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.171 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:53:22.171 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:53:22.172 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:53:22.172 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:53:22.172 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:53:22.172 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:53:22.172 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:53:22.173 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:53:22.173 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:53:22.173 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 64, 2021-06-25T04:53:22.173 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:53:22.174 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:53:22.174 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:53:22.174 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.174 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.175 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:53:22.175 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:22.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.176 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.176 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:53:22.176 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:22.176 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.176 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.177 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:53:22.177 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.177 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.178 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:53:22.178 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:22.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.179 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.179 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:53:22.179 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:22.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.179 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.180 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:53:22.180 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.181 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.181 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:53:22.181 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:22.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.182 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.182 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:53:22.182 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:22.182 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.183 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.183 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:53:22.183 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:53:22.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.184 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:53:22.184 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:53:22.184 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:22.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.185 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:53:22.186 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:53:22.186 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:53:22.187 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.187 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.188 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:53:22.188 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:53:22.188 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:53:22.188 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:53:22.188 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:53:22.189 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:53:22.189 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:53:22.189 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:22.189 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.189 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:53:22.190 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:53:22.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.190 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:53:22.191 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:22.191 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:22.191 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:22.191 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:22.191 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:22.192 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:53:22.192 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:22.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.193 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:53:22.193 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:22.193 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:22.193 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:22.193 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:22.194 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:22.194 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:53:22.194 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:22.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.195 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:53:22.195 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:22.195 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:22.195 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:22.196 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:22.196 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:22.196 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:53:22.196 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:22.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.197 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:53:22.197 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:22.198 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:22.198 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:22.198 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:22.198 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:22.198 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:53:22.199 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:22.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.199 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:53:22.200 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:22.200 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:22.200 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:22.200 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:22.200 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:22.201 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:53:22.201 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:22.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.202 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:53:22.202 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:22.202 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:22.202 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:22.202 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:22.203 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:22.203 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:53:22.203 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:22.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.204 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:53:22.204 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:22.204 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:22.204 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:22.205 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:22.205 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:22.205 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:53:22.205 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:22.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:22.206 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:53:22.206 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:53:22.206 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:53:22.207 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:53:22.207 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:53:22.207 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:53:22.207 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:53:22.207 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:53:22.208 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.208 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:53:22.208 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:53:22.208 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:53:22.208 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:53:22.209 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:53:22.209 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:53:22.209 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6835/3818355049": "2021-06-26T04:53:15.262522+0000", 2021-06-25T04:53:22.209 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6834/3818355049": "2021-06-26T04:53:15.262522+0000" 2021-06-25T04:53:22.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.210 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:53:22.210 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:53:22.210 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:53:22.210 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:53:22.211 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:53:22.211 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:53:22.211 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:53:22.211 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:53:22.212 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:53:22.212 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:53:22.212 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:53:22.212 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:53:22.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.213 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:53:22.213 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:53:22.213 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:53:22.213 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:53:22.213 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:53:22.214 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:53:22.214 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:53:22.214 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:22.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:22.215 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:53:22.215 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:53:22.215 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:53:22.215 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:53:22.216 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:53:22.216 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:53:22.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 -- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8220055360 msgr2=0x7f8220057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8220055360 0x7f8220057820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f823800b000 tx=0x7f8238006df0).stop 2021-06-25T04:53:22.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 -- 172.21.15.57:0/1745948543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82440b3b00 msgr2=0x7f824413fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82440b3b00 0x7f824413fe00 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f823c000b60 tx=0x7f823c0021d0).stop 2021-06-25T04:53:22.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 -- 172.21.15.57:0/1745948543 shutdown_connections 2021-06-25T04:53:22.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8220055360 0x7f8220057820 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82440b3b00 0x7f824413fe00 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82440b3680 0x7f824413f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 --2- 172.21.15.57:0/1745948543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8244145980 0x7f8244145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 -- 172.21.15.57:0/1745948543 >> 172.21.15.57:0/1745948543 conn(0x7f8244062520 msgr2=0x7f824414be10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:22.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 -- 172.21.15.57:0/1745948543 shutdown_connections 2021-06-25T04:53:22.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.002+0000 7f8243fff700 1 -- 172.21.15.57:0/1745948543 wait complete. 2021-06-25T04:53:22.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:22.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.330+0000 7faa563a5700 1 Processor -- start 2021-06-25T04:53:22.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.330+0000 7faa563a5700 1 -- start start 2021-06-25T04:53:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.330+0000 7faa563a5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa500ae1f0 0x7faa50143280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.330+0000 7faa563a5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faa500b0920 0x7faa500b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.330+0000 7faa563a5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5005f7f0 con 0x7faa5005c450 2021-06-25T04:53:22.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.330+0000 7faa563a5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5005fa90 con 0x7faa500b0920 2021-06-25T04:53:22.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.330+0000 7faa563a5700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5005fd30 con 0x7faa500ae1f0 2021-06-25T04:53:22.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.330+0000 7faa4f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faa5005c450 0x7faa50143770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56414/0 (socket says 172.21.15.57:56414) 2021-06-25T04:53:22.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.330+0000 7faa4f7fe700 1 -- 172.21.15.57:0/2070844679 learned_addr learned my addr 172.21.15.57:0/2070844679 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:22.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa4ffff700 1 --2- 172.21.15.57:0/2070844679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa500ae1f0 0x7faa50143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa54942700 1 --2- 172.21.15.57:0/2070844679 >> v2:172.21.15.87:3300/0 conn(0x7faa500b0920 0x7faa500b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa4effd700 1 -- 172.21.15.57:0/2070844679 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202073082 0 0) 0x7faa5005f7f0 con 0x7faa5005c450 2021-06-25T04:53:22.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa4effd700 1 -- 172.21.15.57:0/2070844679 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa3c003260 con 0x7faa5005c450 2021-06-25T04:53:22.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa4ffff700 1 -- 172.21.15.57:0/2070844679 >> v2:172.21.15.87:3300/0 conn(0x7faa500b0920 msgr2=0x7faa500b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:22.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa4ffff700 1 --2- 172.21.15.57:0/2070844679 >> v2:172.21.15.87:3300/0 conn(0x7faa500b0920 0x7faa500b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa4ffff700 1 -- 172.21.15.57:0/2070844679 >> v1:172.21.15.57:6789/0 conn(0x7faa5005c450 legacy=0x7faa50143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa4ffff700 1 -- 172.21.15.57:0/2070844679 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5005ffd0 con 0x7faa500ae1f0 2021-06-25T04:53:22.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa4ffff700 1 --2- 172.21.15.57:0/2070844679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa500ae1f0 0x7faa50143280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7faa40002f70 tx=0x7faa40006df0).ready entity=mon.2 client_cookie=e093c36c07ba79b7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:22.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa4effd700 1 -- 172.21.15.57:0/2070844679 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa4000d4a0 con 0x7faa500ae1f0 2021-06-25T04:53:22.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa4effd700 1 -- 172.21.15.57:0/2070844679 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa40000e90 con 0x7faa500ae1f0 2021-06-25T04:53:22.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa4effd700 1 -- 172.21.15.57:0/2070844679 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa4000d7f0 con 0x7faa500ae1f0 2021-06-25T04:53:22.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 -- 172.21.15.57:0/2070844679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa500ae1f0 msgr2=0x7faa50143280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 --2- 172.21.15.57:0/2070844679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa500ae1f0 0x7faa50143280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7faa40002f70 tx=0x7faa40006df0).stop 2021-06-25T04:53:22.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 -- 172.21.15.57:0/2070844679 shutdown_connections 2021-06-25T04:53:22.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 --2- 172.21.15.57:0/2070844679 >> v2:172.21.15.87:3300/0 conn(0x7faa500b0920 0x7faa500b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 --2- 172.21.15.57:0/2070844679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa500ae1f0 0x7faa50143280 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 -- 172.21.15.57:0/2070844679 >> 172.21.15.57:0/2070844679 conn(0x7faa5005cce0 msgr2=0x7faa50062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:22.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 -- 172.21.15.57:0/2070844679 shutdown_connections 2021-06-25T04:53:22.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 -- 172.21.15.57:0/2070844679 wait complete. 2021-06-25T04:53:22.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 Processor -- start 2021-06-25T04:53:22.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 -- start start 2021-06-25T04:53:22.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa5005c450 0x7faa501529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa500ae1f0 0x7faa500a31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa500b0920 0x7faa50155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa500a5440 con 0x7faa500ae1f0 2021-06-25T04:53:22.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa50152060 con 0x7faa500b0920 2021-06-25T04:53:22.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.334+0000 7faa563a5700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa501472b0 con 0x7faa5005c450 2021-06-25T04:53:22.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa500ae1f0 0x7faa500a31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa500ae1f0 0x7faa500a31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39202/0 (socket says 172.21.15.57:39202) 2021-06-25T04:53:22.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4f7fe700 1 -- 172.21.15.57:0/605115884 learned_addr learned my addr 172.21.15.57:0/605115884 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:22.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4ffff700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa5005c450 0x7faa501529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa54942700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa500b0920 0x7faa50155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4f7fe700 1 -- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa5005c450 msgr2=0x7faa501529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4f7fe700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa5005c450 0x7faa501529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4f7fe700 1 -- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa500b0920 msgr2=0x7faa50155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4f7fe700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa500b0920 0x7faa50155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4f7fe700 1 -- 172.21.15.57:0/605115884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4000b180 con 0x7faa500ae1f0 2021-06-25T04:53:22.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa54942700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa500b0920 0x7faa50155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:22.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4f7fe700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa500ae1f0 0x7faa500a31d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7faa44001110 tx=0x7faa44007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:22.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4d7fa700 1 -- 172.21.15.57:0/605115884 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa440070d0 con 0x7faa500ae1f0 2021-06-25T04:53:22.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4d7fa700 1 -- 172.21.15.57:0/605115884 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44007230 con 0x7faa500ae1f0 2021-06-25T04:53:22.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4d7fa700 1 -- 172.21.15.57:0/605115884 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa44005610 con 0x7faa500ae1f0 2021-06-25T04:53:22.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa563a5700 1 -- 172.21.15.57:0/605115884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa50152290 con 0x7faa500ae1f0 2021-06-25T04:53:22.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa563a5700 1 -- 172.21.15.57:0/605115884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa50146750 con 0x7faa500ae1f0 2021-06-25T04:53:22.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa563a5700 1 -- 172.21.15.57:0/605115884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa50057310 con 0x7faa500ae1f0 2021-06-25T04:53:22.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4d7fa700 1 -- 172.21.15.57:0/605115884 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7faa44010070 con 0x7faa500ae1f0 2021-06-25T04:53:22.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4d7fa700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa30055450 0x7faa30057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4d7fa700 1 -- 172.21.15.57:0/605115884 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7faa4406d260 con 0x7faa500ae1f0 2021-06-25T04:53:22.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4ffff700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa30055450 0x7faa30057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.338+0000 7faa4ffff700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa30055450 0x7faa30057910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7faa40019000 tx=0x7faa40014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:22.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.342+0000 7faa4d7fa700 1 -- 172.21.15.57:0/605115884 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7faa44043700 con 0x7faa500ae1f0 2021-06-25T04:53:22.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 -- 172.21.15.57:0/605115884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa5005d720 con 0x7faa500ae1f0 2021-06-25T04:53:22.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa4d7fa700 1 -- 172.21.15.57:0/605115884 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+1562 (secure 0 0 0) 0x7faa44046d20 con 0x7faa500ae1f0 2021-06-25T04:53:22.515 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:22.515 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4117950639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4117950639},{"type":"v1","addr":"172.21.15.87:6835","nonce":4117950639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5477,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3471432498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3471432498},{"type":"v1","addr":"172.21.15.57:6833","nonce":3471432498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3887221501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3887221501},{"type":"v1","addr":"172.21.15.57:6835","nonce":3887221501}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":33}],"filesystems":[]} 2021-06-25T04:53:22.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 -- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa30055450 msgr2=0x7faa30057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa30055450 0x7faa30057910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7faa40019000 tx=0x7faa40014000).stop 2021-06-25T04:53:22.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 -- 172.21.15.57:0/605115884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa500ae1f0 msgr2=0x7faa500a31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa500ae1f0 0x7faa500a31d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7faa44001110 tx=0x7faa44007aa0).stop 2021-06-25T04:53:22.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 -- 172.21.15.57:0/605115884 shutdown_connections 2021-06-25T04:53:22.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faa30055450 0x7faa30057910 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa500b0920 0x7faa50155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa500ae1f0 0x7faa500a31d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 --2- 172.21.15.57:0/605115884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa5005c450 0x7faa501529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 -- 172.21.15.57:0/605115884 >> 172.21.15.57:0/605115884 conn(0x7faa5005cce0 msgr2=0x7faa500b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:22.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 -- 172.21.15.57:0/605115884 shutdown_connections 2021-06-25T04:53:22.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.510+0000 7faa563a5700 1 -- 172.21.15.57:0/605115884 wait complete. 2021-06-25T04:53:22.520 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 33 2021-06-25T04:53:22.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:22.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbccadad700 1 Processor -- start 2021-06-25T04:53:22.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbccadad700 1 -- start start 2021-06-25T04:53:22.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbccadad700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbcc40b1930 0x7fbcc405fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbccadad700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc40a7a50 con 0x7fbcc40a7670 2021-06-25T04:53:22.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbccadad700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc41475e0 con 0x7fbcc4067140 2021-06-25T04:53:22.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbccadad700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc4147880 con 0x7fbcc40b1930 2021-06-25T04:53:22.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc934a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbcc40b1930 0x7fbcc405fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc934a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbcc40b1930 0x7fbcc405fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39212/0 (socket says 172.21.15.57:39212) 2021-06-25T04:53:22.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc934a700 1 -- 172.21.15.57:0/3194533898 learned_addr learned my addr 172.21.15.57:0/3194533898 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:22.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc8b49700 1 --1- 172.21.15.57:0/3194533898 >> v1:172.21.15.57:6789/0 conn(0x7fbcc40a7670 0x7fbcc4066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56428/0 (socket says 172.21.15.57:56428) 2021-06-25T04:53:22.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc934a700 1 -- 172.21.15.57:0/3194533898 >> v1:172.21.15.87:6789/0 conn(0x7fbcc4067140 legacy=0x7fbcc405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc37fe700 1 -- 172.21.15.57:0/3194533898 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710281853 0 0) 0x7fbcc41475e0 con 0x7fbcc4067140 2021-06-25T04:53:22.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc934a700 1 -- 172.21.15.57:0/3194533898 >> v1:172.21.15.57:6789/0 conn(0x7fbcc40a7670 legacy=0x7fbcc4066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc934a700 1 -- 172.21.15.57:0/3194533898 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc4147b20 con 0x7fbcc40b1930 2021-06-25T04:53:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc934a700 1 --2- 172.21.15.57:0/3194533898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcc40b1930 0x7fbcc405fd80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fbcb4001110 tx=0x7fbcac006eb0).ready entity=mon.0 client_cookie=3a4371415a76d2b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc37fe700 1 -- 172.21.15.57:0/3194533898 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcac00d610 con 0x7fbcc40b1930 2021-06-25T04:53:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc37fe700 1 -- 172.21.15.57:0/3194533898 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac000e90 con 0x7fbcc40b1930 2021-06-25T04:53:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbcc37fe700 1 -- 172.21.15.57:0/3194533898 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcac00d960 con 0x7fbcc40b1930 2021-06-25T04:53:22.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbccadad700 1 -- 172.21.15.57:0/3194533898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcc40b1930 msgr2=0x7fbcc405fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.630+0000 7fbccadad700 1 --2- 172.21.15.57:0/3194533898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcc40b1930 0x7fbcc405fd80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fbcb4001110 tx=0x7fbcac006eb0).stop 2021-06-25T04:53:22.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 -- 172.21.15.57:0/3194533898 shutdown_connections 2021-06-25T04:53:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 --2- 172.21.15.57:0/3194533898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcc40b1930 0x7fbcc405fd80 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 -- 172.21.15.57:0/3194533898 >> 172.21.15.57:0/3194533898 conn(0x7fbcc40b53a0 msgr2=0x7fbcc40b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 -- 172.21.15.57:0/3194533898 shutdown_connections 2021-06-25T04:53:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 -- 172.21.15.57:0/3194533898 wait complete. 2021-06-25T04:53:22.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 Processor -- start 2021-06-25T04:53:22.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 -- start start 2021-06-25T04:53:22.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcc4067140 0x7fbcc40a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcc40a7670 0x7fbcc4140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcc40b1930 0x7fbcc4140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc4140f70 con 0x7fbcc40a7670 2021-06-25T04:53:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc41415c0 con 0x7fbcc40b1930 2021-06-25T04:53:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbccadad700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc41417f0 con 0x7fbcc4067140 2021-06-25T04:53:22.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbcc3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcc40a7670 0x7fbcc4140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbcc3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcc40a7670 0x7fbcc4140590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39216/0 (socket says 172.21.15.57:39216) 2021-06-25T04:53:22.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbcc3fff700 1 -- 172.21.15.57:0/2515906506 learned_addr learned my addr 172.21.15.57:0/2515906506 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:22.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbcc8b49700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcc4067140 0x7fbcc40a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbcc934a700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcc40b1930 0x7fbcc4140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbcc3fff700 1 -- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcc4067140 msgr2=0x7fbcc40a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbcc3fff700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcc4067140 0x7fbcc40a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbcc3fff700 1 -- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcc40b1930 msgr2=0x7fbcc4140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbcc3fff700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcc40b1930 0x7fbcc4140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbcc3fff700 1 -- 172.21.15.57:0/2515906506 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac00b1e0 con 0x7fbcc40a7670 2021-06-25T04:53:22.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.634+0000 7fbcc3fff700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcc40a7670 0x7fbcc4140590 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fbcc413fa30 tx=0x7fbcbc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:22.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.638+0000 7fbcc1ffb700 1 -- 172.21.15.57:0/2515906506 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcbc010510 con 0x7fbcc40a7670 2021-06-25T04:53:22.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.638+0000 7fbcc1ffb700 1 -- 172.21.15.57:0/2515906506 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc010670 con 0x7fbcc40a7670 2021-06-25T04:53:22.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.638+0000 7fbcc1ffb700 1 -- 172.21.15.57:0/2515906506 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcbc0107e0 con 0x7fbcc40a7670 2021-06-25T04:53:22.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.638+0000 7fbccadad700 1 -- 172.21.15.57:0/2515906506 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc40aaf50 con 0x7fbcc40a7670 2021-06-25T04:53:22.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.638+0000 7fbccadad700 1 -- 172.21.15.57:0/2515906506 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc4140200 con 0x7fbcc40a7670 2021-06-25T04:53:22.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.638+0000 7fbccadad700 1 -- 172.21.15.57:0/2515906506 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc4147410 con 0x7fbcc40a7670 2021-06-25T04:53:22.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.638+0000 7fbcc1ffb700 1 -- 172.21.15.57:0/2515906506 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbcbc010070 con 0x7fbcc40a7670 2021-06-25T04:53:22.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.638+0000 7fbcc1ffb700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc9c055340 0x7fbc9c057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.638+0000 7fbcc1ffb700 1 -- 172.21.15.57:0/2515906506 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fbcbc06d830 con 0x7fbcc40a7670 2021-06-25T04:53:22.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.638+0000 7fbcc8b49700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc9c055340 0x7fbc9c057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.638+0000 7fbcc8b49700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc9c055340 0x7fbc9c057800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fbcb400b000 tx=0x7fbcb4000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:22.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.646+0000 7fbcc1ffb700 1 -- 172.21.15.57:0/2515906506 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbcbc043cc0 con 0x7fbcc40a7670 2021-06-25T04:53:22.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.810+0000 7fbccadad700 1 -- 172.21.15.57:0/2515906506 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcc40aad70 con 0x7fbcc40a7670 2021-06-25T04:53:22.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbcc1ffb700 1 -- 172.21.15.57:0/2515906506 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+1562 (secure 0 0 0) 0x7fbcbc0472e0 con 0x7fbcc40a7670 2021-06-25T04:53:22.818 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:22.819 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5471,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4117950639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4117950639},{"type":"v1","addr":"172.21.15.87:6835","nonce":4117950639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":5477,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3471432498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3471432498},{"type":"v1","addr":"172.21.15.57:6833","nonce":3471432498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":29},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3887221501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3887221501},{"type":"v1","addr":"172.21.15.57:6835","nonce":3887221501}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":33}],"filesystems":[]} 2021-06-25T04:53:22.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 -- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc9c055340 msgr2=0x7fbc9c057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc9c055340 0x7fbc9c057800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fbcb400b000 tx=0x7fbcb4000bc0).stop 2021-06-25T04:53:22.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 -- 172.21.15.57:0/2515906506 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcc40a7670 msgr2=0x7fbcc4140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:22.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcc40a7670 0x7fbcc4140590 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fbcc413fa30 tx=0x7fbcbc007e00).stop 2021-06-25T04:53:22.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 -- 172.21.15.57:0/2515906506 shutdown_connections 2021-06-25T04:53:22.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc9c055340 0x7fbc9c057800 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcc40b1930 0x7fbcc4140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcc40a7670 0x7fbcc4140590 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 --2- 172.21.15.57:0/2515906506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcc4067140 0x7fbcc40a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:22.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 -- 172.21.15.57:0/2515906506 >> 172.21.15.57:0/2515906506 conn(0x7fbcc40b53a0 msgr2=0x7fbcc405f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:22.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 -- 172.21.15.57:0/2515906506 shutdown_connections 2021-06-25T04:53:22.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.814+0000 7fbccadad700 1 -- 172.21.15.57:0/2515906506 wait complete. 2021-06-25T04:53:22.825 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 33 2021-06-25T04:53:22.835 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:53:22.836 INFO:tasks.ceph.mds.a:Stopping old one... 2021-06-25T04:53:22.836 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:53:22.836 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:53:22.837 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:53:22.837 INFO:tasks.ceph.mds.c:Stopping old one... 2021-06-25T04:53:22.837 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:53:22.837 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:53:22.838 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:53:22.838 INFO:tasks.ceph.mds.b:Stopping old one... 2021-06-25T04:53:22.839 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:53:22.839 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:53:22.848 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:53:22.849 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:53:22.853 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:53:22.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:53:22.855 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:53:22.856 DEBUG:teuthology.parallel:result is None 2021-06-25T04:53:22.856 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:53:22.857 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:53:22.899 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:53:22.899 DEBUG:teuthology.parallel:result is None 2021-06-25T04:53:22.901 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:53:22.902 DEBUG:teuthology.parallel:result is None 2021-06-25T04:53:22.902 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:53:22.923 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:53:22.970 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:53:22.980 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:53:22.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.986+0000 7f8ebcf89700 1 Processor -- start 2021-06-25T04:53:22.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.986+0000 7f8ebcf89700 1 -- start start 2021-06-25T04:53:22.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.986+0000 7f8ebcf89700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8eb8066fb0 0x7f8eb80ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.986+0000 7f8ebcf89700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eb80aff90 0x7f8eb80ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:22.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.986+0000 7f8ebcf89700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb8067390 con 0x7f8eb80ad170 2021-06-25T04:53:22.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.986+0000 7f8ebcf89700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb80b1610 con 0x7f8eb8066fb0 2021-06-25T04:53:22.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.986+0000 7f8ebcf89700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb80b18b0 con 0x7f8eb80aff90 2021-06-25T04:53:22.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.986+0000 7f8eb6d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eb80aff90 0x7f8eb80ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:22.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.986+0000 7f8eb659c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8eb8066fb0 0x7f8eb80ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:23.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.986+0000 7f8eb5d9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8eb80ad170 0x7f8eb8143870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:57214/0 (socket says 172.21.15.57:57214) 2021-06-25T04:53:23.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb5d9b700 1 -- 172.21.15.57:0/432465846 learned_addr learned my addr 172.21.15.57:0/432465846 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:23.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb659c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8eb8066fb0 0x7f8eb80ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:47740/0 (socket says 172.21.15.57:47740) 2021-06-25T04:53:23.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb559a700 1 -- 172.21.15.57:0/432465846 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830003526 0 0) 0x7f8eb8067390 con 0x7f8eb80ad170 2021-06-25T04:53:23.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb559a700 1 -- 172.21.15.57:0/432465846 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e9c003260 con 0x7f8eb80ad170 2021-06-25T04:53:23.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb6d9d700 1 -- 172.21.15.57:0/432465846 >> v2:172.21.15.87:3300/0 conn(0x7f8eb8066fb0 msgr2=0x7f8eb80ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:23.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb6d9d700 1 --2- 172.21.15.57:0/432465846 >> v2:172.21.15.87:3300/0 conn(0x7f8eb8066fb0 0x7f8eb80ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:23.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb6d9d700 1 -- 172.21.15.57:0/432465846 >> v1:172.21.15.87:6789/0 conn(0x7f8eb80ad170 legacy=0x7f8eb8143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:23.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb6d9d700 1 -- 172.21.15.57:0/432465846 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80b1b50 con 0x7f8eb80aff90 2021-06-25T04:53:23.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb659c700 1 --2- 172.21.15.57:0/432465846 >> v2:172.21.15.87:3300/0 conn(0x7f8eb8066fb0 0x7f8eb80ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:23.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb6d9d700 1 --2- 172.21.15.57:0/432465846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eb80aff90 0x7f8eb80ae9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8eb00032f0 tx=0x7f8eb00091d0).ready entity=mon.2 client_cookie=3521e89435d1f23a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:23.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb559a700 1 -- 172.21.15.57:0/432465846 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb000b600 con 0x7f8eb80aff90 2021-06-25T04:53:23.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb559a700 1 -- 172.21.15.57:0/432465846 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb000b760 con 0x7f8eb80aff90 2021-06-25T04:53:23.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8eb559a700 1 -- 172.21.15.57:0/432465846 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eb000b8d0 con 0x7f8eb80aff90 2021-06-25T04:53:23.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8ebcf89700 1 -- 172.21.15.57:0/432465846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eb80aff90 msgr2=0x7f8eb80ae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:23.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8ebcf89700 1 --2- 172.21.15.57:0/432465846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eb80aff90 0x7f8eb80ae9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8eb00032f0 tx=0x7f8eb00091d0).stop 2021-06-25T04:53:23.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8ebcf89700 1 -- 172.21.15.57:0/432465846 shutdown_connections 2021-06-25T04:53:23.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8ebcf89700 1 --2- 172.21.15.57:0/432465846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eb80aff90 0x7f8eb80ae9d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:23.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8ebcf89700 1 --2- 172.21.15.57:0/432465846 >> v2:172.21.15.87:3300/0 conn(0x7f8eb8066fb0 0x7f8eb80ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:23.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8ebcf89700 1 -- 172.21.15.57:0/432465846 >> 172.21.15.57:0/432465846 conn(0x7f8eb8060890 msgr2=0x7f8eb8060ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:23.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8ebcf89700 1 -- 172.21.15.57:0/432465846 shutdown_connections 2021-06-25T04:53:23.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8ebcf89700 1 -- 172.21.15.57:0/432465846 wait complete. 2021-06-25T04:53:23.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8ebcf89700 1 Processor -- start 2021-06-25T04:53:23.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.990+0000 7f8ebcf89700 1 -- start start 2021-06-25T04:53:23.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8ebcf89700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eb8066fb0 0x7f8eb80a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:23.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8ebcf89700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eb80ad170 0x7f8eb80a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:23.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8ebcf89700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eb80aff90 0x7f8eb809f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:23.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8ebcf89700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb80ab840 con 0x7f8eb80aff90 2021-06-25T04:53:23.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8ebcf89700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb809f030 con 0x7f8eb80ad170 2021-06-25T04:53:23.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8ebcf89700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8153190 con 0x7f8eb8066fb0 2021-06-25T04:53:23.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8eb5d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eb80ad170 0x7f8eb80a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:23.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8eb6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eb80aff90 0x7f8eb809f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:23.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8eb5d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eb80ad170 0x7f8eb80a98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:47748/0 (socket says 172.21.15.57:47748) 2021-06-25T04:53:23.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8eb5d9b700 1 -- 172.21.15.57:0/2324239663 learned_addr learned my addr 172.21.15.57:0/2324239663 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:23.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8eb659c700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eb8066fb0 0x7f8eb80a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:23.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8eb5d9b700 1 -- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eb8066fb0 msgr2=0x7f8eb80a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:23.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8eb5d9b700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eb8066fb0 0x7f8eb80a9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8eb5d9b700 1 -- 172.21.15.57:0/2324239663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eb80aff90 msgr2=0x7f8eb809f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8eb5d9b700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eb80aff90 0x7f8eb809f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8eb5d9b700 1 -- 172.21.15.57:0/2324239663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea800b180 con 0x7f8eb80ad170 2021-06-25T04:53:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8eb5d9b700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eb80ad170 0x7f8eb80a98f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f8eac001110 tx=0x7f8eac007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8ea77fe700 1 -- 172.21.15.57:0/2324239663 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eac0070d0 con 0x7f8eb80ad170 2021-06-25T04:53:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8ea77fe700 1 -- 172.21.15.57:0/2324239663 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac007230 con 0x7f8eb80ad170 2021-06-25T04:53:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8ebcf89700 1 -- 172.21.15.57:0/2324239663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb0009470 con 0x7f8eb80ad170 2021-06-25T04:53:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8ea77fe700 1 -- 172.21.15.57:0/2324239663 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eac005610 con 0x7f8eb80ad170 2021-06-25T04:53:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.994+0000 7f8ebcf89700 1 -- 172.21.15.57:0/2324239663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb80ac150 con 0x7f8eb80ad170 2021-06-25T04:53:23.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.998+0000 7f8ea77fe700 1 -- 172.21.15.57:0/2324239663 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8eac010070 con 0x7f8eb80ad170 2021-06-25T04:53:23.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.998+0000 7f8ea77fe700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e940553f0 0x7f8e940578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:23.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.998+0000 7f8ea77fe700 1 -- 172.21.15.57:0/2324239663 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f8eac06d3d0 con 0x7f8eb80ad170 2021-06-25T04:53:23.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.998+0000 7f8eb659c700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e940553f0 0x7f8e940578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.998+0000 7f8ebcf89700 1 -- 172.21.15.57:0/2324239663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb8057310 con 0x7f8eb80ad170 2021-06-25T04:53:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:22.998+0000 7f8eb659c700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e940553f0 0x7f8e940578b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f8ea800b000 tx=0x7f8ea8006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:23.006+0000 7f8ea77fe700 1 -- 172.21.15.57:0/2324239663 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8eac043760 con 0x7f8eb80ad170 2021-06-25T04:53:23.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:23.146+0000 7f8ebcf89700 1 -- 172.21.15.57:0/2324239663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f8eb80aefa0 con 0x7f8eb80ad170 2021-06-25T04:53:24.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.030+0000 7f8ea77fe700 1 -- 172.21.15.57:0/2324239663 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v73) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8eac046d80 con 0x7f8eb80ad170 2021-06-25T04:53:24.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 -- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e940553f0 msgr2=0x7f8e940578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e940553f0 0x7f8e940578b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f8ea800b000 tx=0x7f8ea8006df0).stop 2021-06-25T04:53:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 -- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eb80ad170 msgr2=0x7f8eb80a98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eb80ad170 0x7f8eb80a98f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f8eac001110 tx=0x7f8eac007ad0).stop 2021-06-25T04:53:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 -- 172.21.15.57:0/2324239663 shutdown_connections 2021-06-25T04:53:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e940553f0 0x7f8e940578b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8eb80aff90 0x7f8eb809f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eb80ad170 0x7f8eb80a98f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 --2- 172.21.15.57:0/2324239663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eb8066fb0 0x7f8eb80a9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 -- 172.21.15.57:0/2324239663 >> 172.21.15.57:0/2324239663 conn(0x7f8eb8060890 msgr2=0x7f8eb80b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:24.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 -- 172.21.15.57:0/2324239663 shutdown_connections 2021-06-25T04:53:24.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.034+0000 7f8ebcf89700 1 -- 172.21.15.57:0/2324239663 wait complete. 2021-06-25T04:53:24.041 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:53:24.053 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:53:24.054 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:53:24.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.202+0000 7f3898d01700 1 Processor -- start 2021-06-25T04:53:24.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.202+0000 7f3898d01700 1 -- start start 2021-06-25T04:53:24.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3894067140 0x7f389405f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38940b1930 0x7f389405fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940a7a50 con 0x7f38940a7670 2021-06-25T04:53:24.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38941475e0 con 0x7f3894067140 2021-06-25T04:53:24.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3894147880 con 0x7f38940b1930 2021-06-25T04:53:24.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3891d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3894067140 0x7f389405f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3891d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3894067140 0x7f389405f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39260/0 (socket says 172.21.15.57:39260) 2021-06-25T04:53:24.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3891d9b700 1 -- 172.21.15.57:0/3793320174 learned_addr learned my addr 172.21.15.57:0/3793320174 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:24.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f389259c700 1 --1- 172.21.15.57:0/3793320174 >> v1:172.21.15.57:6789/0 conn(0x7f38940a7670 0x7f3894066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56480/0 (socket says 172.21.15.57:56480) 2021-06-25T04:53:24.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3892d9d700 1 --2- 172.21.15.57:0/3793320174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38940b1930 0x7f389405fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3891d9b700 1 -- 172.21.15.57:0/3793320174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38940b1930 msgr2=0x7f389405fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:24.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3891d9b700 1 --2- 172.21.15.57:0/3793320174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38940b1930 0x7f389405fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3891d9b700 1 -- 172.21.15.57:0/3793320174 >> v1:172.21.15.57:6789/0 conn(0x7f38940a7670 legacy=0x7f3894066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3891d9b700 1 -- 172.21.15.57:0/3793320174 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894147b20 con 0x7f3894067140 2021-06-25T04:53:24.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3891d9b700 1 --2- 172.21.15.57:0/3793320174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3894067140 0x7f389405f670 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f38840032f0 tx=0x7f3884009290).ready entity=mon.0 client_cookie=e1864a4468d5fd1f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:24.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f389159a700 1 -- 172.21.15.57:0/3793320174 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f388400b8a0 con 0x7f3894067140 2021-06-25T04:53:24.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f389159a700 1 -- 172.21.15.57:0/3793320174 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388400ba00 con 0x7f3894067140 2021-06-25T04:53:24.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f389159a700 1 -- 172.21.15.57:0/3793320174 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f388400bb70 con 0x7f3894067140 2021-06-25T04:53:24.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 -- 172.21.15.57:0/3793320174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3894067140 msgr2=0x7f389405f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 --2- 172.21.15.57:0/3793320174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3894067140 0x7f389405f670 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f38840032f0 tx=0x7f3884009290).stop 2021-06-25T04:53:24.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 -- 172.21.15.57:0/3793320174 shutdown_connections 2021-06-25T04:53:24.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 --2- 172.21.15.57:0/3793320174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38940b1930 0x7f389405fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 --2- 172.21.15.57:0/3793320174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3894067140 0x7f389405f670 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 -- 172.21.15.57:0/3793320174 >> 172.21.15.57:0/3793320174 conn(0x7f38940b53a0 msgr2=0x7f38940b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:24.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 -- 172.21.15.57:0/3793320174 shutdown_connections 2021-06-25T04:53:24.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.206+0000 7f3898d01700 1 -- 172.21.15.57:0/3793320174 wait complete. 2021-06-25T04:53:24.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3898d01700 1 Processor -- start 2021-06-25T04:53:24.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3898d01700 1 -- start start 2021-06-25T04:53:24.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3898d01700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3894067140 0x7f38940abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3898d01700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38940a7670 0x7f389415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3898d01700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38940b1930 0x7f38940ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3898d01700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894156680 con 0x7f38940a7670 2021-06-25T04:53:24.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3898d01700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940aefa0 con 0x7f3894067140 2021-06-25T04:53:24.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3898d01700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3894062710 con 0x7f38940b1930 2021-06-25T04:53:24.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3891d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38940a7670 0x7f389415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3891d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38940a7670 0x7f389415a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39268/0 (socket says 172.21.15.57:39268) 2021-06-25T04:53:24.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3891d9b700 1 -- 172.21.15.57:0/705710820 learned_addr learned my addr 172.21.15.57:0/705710820 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:24.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f389259c700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3894067140 0x7f38940abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3892d9d700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38940b1930 0x7f38940ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3891d9b700 1 -- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38940b1930 msgr2=0x7f38940ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3891d9b700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38940b1930 0x7f38940ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3891d9b700 1 -- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3894067140 msgr2=0x7f38940abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3891d9b700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3894067140 0x7f38940abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3891d9b700 1 -- 172.21.15.57:0/705710820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3884009530 con 0x7f38940a7670 2021-06-25T04:53:24.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f389259c700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3894067140 0x7f38940abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:24.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3891d9b700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38940a7670 0x7f389415a630 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f38840032f0 tx=0x7f3884016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:24.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f38837fe700 1 -- 172.21.15.57:0/705710820 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3884011c40 con 0x7f38940a7670 2021-06-25T04:53:24.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f38837fe700 1 -- 172.21.15.57:0/705710820 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3884011da0 con 0x7f38940a7670 2021-06-25T04:53:24.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3898d01700 1 -- 172.21.15.57:0/705710820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38940629b0 con 0x7f38940a7670 2021-06-25T04:53:24.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f38837fe700 1 -- 172.21.15.57:0/705710820 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f388401f610 con 0x7f38940a7670 2021-06-25T04:53:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.210+0000 7f3898d01700 1 -- 172.21.15.57:0/705710820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38940af3d0 con 0x7f38940a7670 2021-06-25T04:53:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.214+0000 7f3898d01700 1 -- 172.21.15.57:0/705710820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3894057310 con 0x7f38940a7670 2021-06-25T04:53:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.214+0000 7f38837fe700 1 -- 172.21.15.57:0/705710820 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3884026030 con 0x7f38940a7670 2021-06-25T04:53:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.214+0000 7f38837fe700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3870055450 0x7f3870057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.214+0000 7f38837fe700 1 -- 172.21.15.57:0/705710820 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f388406e7a0 con 0x7f38940a7670 2021-06-25T04:53:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.214+0000 7f389259c700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3870055450 0x7f3870057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.214+0000 7f389259c700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3870055450 0x7f3870057910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f388800b000 tx=0x7f38880070e0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:24.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.222+0000 7f38837fe700 1 -- 172.21.15.57:0/705710820 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3884044b80 con 0x7f38940a7670 2021-06-25T04:53:24.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.394+0000 7f3898d01700 1 -- 172.21.15.57:0/705710820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f38940af130 con 0x7f38940a7670 2021-06-25T04:53:24.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f38837fe700 1 -- 172.21.15.57:0/705710820 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f3884024020 con 0x7f38940a7670 2021-06-25T04:53:24.402 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:24.402 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:53:24.403 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:53:24.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.403 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:53:24.403 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:53:24.404 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.404 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:53:24.404 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.404 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.404 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.405 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:53:24.405 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:53:24.406 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.406 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:53:24.406 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.407 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.407 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.408 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:53:24.408 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:53:24.408 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.408 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:53:24.409 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.409 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.409 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.409 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.410 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:53:24.410 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:53:24.410 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.411 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.411 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.411 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.411 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.412 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:53:24.412 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:53:24.412 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.413 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.413 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.413 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.413 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.414 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:53:24.414 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:53:24.415 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.415 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.415 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.415 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.416 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:53:24.417 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:53:24.417 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.417 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.417 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.418 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.418 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.419 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:53:24.419 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:53:24.419 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.419 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.420 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.420 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.421 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:53:24.421 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:53:24.421 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.421 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.422 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.422 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.422 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.423 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:53:24.423 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:53:24.423 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.424 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.424 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.424 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.425 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:53:24.425 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:53:24.425 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.426 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.426 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.426 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.427 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:53:24.427 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:53:24.428 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.428 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:53:24.428 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:53:24.428 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:53:24.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.429 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:53:24.429 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:53:24.430 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.430 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:53:24.430 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:53:24.430 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:53:24.431 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.431 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:53:24.431 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:53:24.432 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.432 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:53:24.432 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:53:24.432 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:53:24.432 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.433 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:53:24.434 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:53:24.434 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.434 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:53:24.434 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:53:24.434 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:24.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:24.435 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:53:24.436 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:53:24.436 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:53:24.436 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:53:24.436 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:53:24.436 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:53:24.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:24.437 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:53:24.438 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:53:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 -- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3870055450 msgr2=0x7f3870057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3870055450 0x7f3870057910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f388800b000 tx=0x7f38880070e0).stop 2021-06-25T04:53:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 -- 172.21.15.57:0/705710820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38940a7670 msgr2=0x7f389415a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38940a7670 0x7f389415a630 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f38840032f0 tx=0x7f3884016000).stop 2021-06-25T04:53:24.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 -- 172.21.15.57:0/705710820 shutdown_connections 2021-06-25T04:53:24.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3870055450 0x7f3870057910 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38940b1930 0x7f38940ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38940a7670 0x7f389415a630 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 --2- 172.21.15.57:0/705710820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3894067140 0x7f38940abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 -- 172.21.15.57:0/705710820 >> 172.21.15.57:0/705710820 conn(0x7f38940b53a0 msgr2=0x7f38941499b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 -- 172.21.15.57:0/705710820 shutdown_connections 2021-06-25T04:53:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.398+0000 7f3898d01700 1 -- 172.21.15.57:0/705710820 wait complete. 2021-06-25T04:53:24.443 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:53:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71ba99c700 1 Processor -- start 2021-06-25T04:53:24.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71ba99c700 1 -- start start 2021-06-25T04:53:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71ba99c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f71b40b05d0 0x7f71b40af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71ba99c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f71b4147560 0x7f71b40acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71ba99c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b41479b0 con 0x7f71b40b5460 2021-06-25T04:53:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71ba99c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b41452a0 con 0x7f71b40b05d0 2021-06-25T04:53:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71ba99c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b40adfb0 con 0x7f71b4147560 2021-06-25T04:53:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71b9199700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f71b40b05d0 0x7f71b40af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71b999a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f71b40b5460 0x7f71b4067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56494/0 (socket says 172.21.15.57:56494) 2021-06-25T04:53:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71b999a700 1 -- 172.21.15.57:0/1857074248 learned_addr learned my addr 172.21.15.57:0/1857074248 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71ba19b700 1 --2- 172.21.15.57:0/1857074248 >> v2:172.21.15.87:3300/0 conn(0x7f71b4147560 0x7f71b40acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71b9199700 1 -- 172.21.15.57:0/1857074248 >> v2:172.21.15.87:3300/0 conn(0x7f71b4147560 msgr2=0x7f71b40acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:24.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71b9199700 1 --2- 172.21.15.57:0/1857074248 >> v2:172.21.15.87:3300/0 conn(0x7f71b4147560 0x7f71b40acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71b9199700 1 -- 172.21.15.57:0/1857074248 >> v1:172.21.15.57:6789/0 conn(0x7f71b40b5460 legacy=0x7f71b4067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.542+0000 7f71b8998700 1 -- 172.21.15.57:0/1857074248 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097691790 0 0) 0x7f71b41479b0 con 0x7f71b40b5460 2021-06-25T04:53:24.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71b9199700 1 -- 172.21.15.57:0/1857074248 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b40b5840 con 0x7f71b40b05d0 2021-06-25T04:53:24.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71b9199700 1 --2- 172.21.15.57:0/1857074248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71b40b05d0 0x7f71b40af510 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f71b0002f70 tx=0x7f71b0006df0).ready entity=mon.0 client_cookie=a7b264f9c33f95d3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71b8998700 1 -- 172.21.15.57:0/1857074248 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b000d5c0 con 0x7f71b40b05d0 2021-06-25T04:53:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71b8998700 1 -- 172.21.15.57:0/1857074248 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b0000e90 con 0x7f71b40b05d0 2021-06-25T04:53:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71b8998700 1 -- 172.21.15.57:0/1857074248 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b000d910 con 0x7f71b40b05d0 2021-06-25T04:53:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71ba99c700 1 -- 172.21.15.57:0/1857074248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71b40b05d0 msgr2=0x7f71b40af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71ba99c700 1 --2- 172.21.15.57:0/1857074248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71b40b05d0 0x7f71b40af510 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f71b0002f70 tx=0x7f71b0006df0).stop 2021-06-25T04:53:24.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71ba99c700 1 -- 172.21.15.57:0/1857074248 shutdown_connections 2021-06-25T04:53:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71ba99c700 1 --2- 172.21.15.57:0/1857074248 >> v2:172.21.15.87:3300/0 conn(0x7f71b4147560 0x7f71b40acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71ba99c700 1 --2- 172.21.15.57:0/1857074248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71b40b05d0 0x7f71b40af510 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71ba99c700 1 -- 172.21.15.57:0/1857074248 >> 172.21.15.57:0/1857074248 conn(0x7f71b4062520 msgr2=0x7f71b4062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71ba99c700 1 -- 172.21.15.57:0/1857074248 shutdown_connections 2021-06-25T04:53:24.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71ba99c700 1 -- 172.21.15.57:0/1857074248 wait complete. 2021-06-25T04:53:24.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71ba99c700 1 Processor -- start 2021-06-25T04:53:24.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.546+0000 7f71ba99c700 1 -- start start 2021-06-25T04:53:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba99c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b40b05d0 0x7f71b41573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba99c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71b40b5460 0x7f71b415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba99c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71b4147560 0x7f71b4140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba99c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4147070 con 0x7f71b4147560 2021-06-25T04:53:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba99c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b415a120 con 0x7f71b40b5460 2021-06-25T04:53:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba99c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b41569d0 con 0x7f71b40b05d0 2021-06-25T04:53:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba19b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71b4147560 0x7f71b4140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba19b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71b4147560 0x7f71b4140150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39284/0 (socket says 172.21.15.57:39284) 2021-06-25T04:53:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71b999a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b40b05d0 0x7f71b41573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba19b700 1 -- 172.21.15.57:0/356609437 learned_addr learned my addr 172.21.15.57:0/356609437 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71b9199700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71b40b5460 0x7f71b415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba19b700 1 -- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b40b05d0 msgr2=0x7f71b41573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba19b700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b40b05d0 0x7f71b41573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba19b700 1 -- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71b40b5460 msgr2=0x7f71b415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba19b700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71b40b5460 0x7f71b415a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba19b700 1 -- 172.21.15.57:0/356609437 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b000b180 con 0x7f71b4147560 2021-06-25T04:53:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba19b700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71b4147560 0x7f71b4140150 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f71ac00a000 tx=0x7f71ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71a2ffd700 1 -- 172.21.15.57:0/356609437 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71ac0127e0 con 0x7f71b4147560 2021-06-25T04:53:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71a2ffd700 1 -- 172.21.15.57:0/356609437 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac012940 con 0x7f71b4147560 2021-06-25T04:53:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71a2ffd700 1 -- 172.21.15.57:0/356609437 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71ac012ca0 con 0x7f71b4147560 2021-06-25T04:53:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba99c700 1 -- 172.21.15.57:0/356609437 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b4156c70 con 0x7f71b4147560 2021-06-25T04:53:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba99c700 1 -- 172.21.15.57:0/356609437 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b4159da0 con 0x7f71b4147560 2021-06-25T04:53:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.550+0000 7f71ba99c700 1 -- 172.21.15.57:0/356609437 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b4057310 con 0x7f71b4147560 2021-06-25T04:53:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.554+0000 7f71a2ffd700 1 -- 172.21.15.57:0/356609437 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f71ac013480 con 0x7f71b4147560 2021-06-25T04:53:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.554+0000 7f71a2ffd700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71940553d0 0x7f7194057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.554+0000 7f71a2ffd700 1 -- 172.21.15.57:0/356609437 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f71ac06def0 con 0x7f71b4147560 2021-06-25T04:53:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.554+0000 7f71b999a700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71940553d0 0x7f7194057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.554+0000 7f71b999a700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71940553d0 0x7f7194057890 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f71a400d000 tx=0x7f71a40011a0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.558+0000 7f71a2ffd700 1 -- 172.21.15.57:0/356609437 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f71ac044380 con 0x7f71b4147560 2021-06-25T04:53:24.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.690+0000 7f71ba99c700 1 -- 172.21.15.57:0/356609437 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71b405f200 con 0x7f71b4147560 2021-06-25T04:53:24.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.690+0000 7f71a2ffd700 1 -- 172.21.15.57:0/356609437 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f71ac0479a0 con 0x7f71b4147560 2021-06-25T04:53:24.697 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:24.697 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":73,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:53:24.023812+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:53:24.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 -- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71940553d0 msgr2=0x7f7194057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71940553d0 0x7f7194057890 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f71a400d000 tx=0x7f71a40011a0).stop 2021-06-25T04:53:24.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 -- 172.21.15.57:0/356609437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71b4147560 msgr2=0x7f71b4140150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71b4147560 0x7f71b4140150 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f71ac00a000 tx=0x7f71ac008040).stop 2021-06-25T04:53:24.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 -- 172.21.15.57:0/356609437 shutdown_connections 2021-06-25T04:53:24.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71940553d0 0x7f7194057890 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71b4147560 0x7f71b4140150 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71b40b5460 0x7f71b415a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 --2- 172.21.15.57:0/356609437 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71b40b05d0 0x7f71b41573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 -- 172.21.15.57:0/356609437 >> 172.21.15.57:0/356609437 conn(0x7f71b4062520 msgr2=0x7f71b414aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:24.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 -- 172.21.15.57:0/356609437 shutdown_connections 2021-06-25T04:53:24.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.694+0000 7f71ba99c700 1 -- 172.21.15.57:0/356609437 wait complete. 2021-06-25T04:53:24.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:53:24.712 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:53:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd83fff700 1 Processor -- start 2021-06-25T04:53:24.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd83fff700 1 -- start start 2021-06-25T04:53:24.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd83fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 0x7fdd8414ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd83fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdd840affd0 0x7fdd8414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd83fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd840a7080 con 0x7fdd840afb90 2021-06-25T04:53:24.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd83fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd840a72b0 con 0x7fdd840affd0 2021-06-25T04:53:24.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd83fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840a7550 con 0x7fdd840b2540 2021-06-25T04:53:24.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd82ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 0x7fdd8414ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd827fc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdd840affd0 0x7fdd8414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd82ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 0x7fdd8414ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:50452/0 (socket says 172.21.15.57:50452) 2021-06-25T04:53:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd82ffd700 1 -- 172.21.15.57:0/1789915431 learned_addr learned my addr 172.21.15.57:0/1789915431 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd82ffd700 1 -- 172.21.15.57:0/1789915431 >> v2:172.21.15.87:3300/0 conn(0x7fdd840affd0 msgr2=0x7fdd8414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd82ffd700 1 --2- 172.21.15.57:0/1789915431 >> v2:172.21.15.87:3300/0 conn(0x7fdd840affd0 0x7fdd8414b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd82ffd700 1 -- 172.21.15.57:0/1789915431 >> v1:172.21.15.87:6789/0 conn(0x7fdd840afb90 legacy=0x7fdd840a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd82ffd700 1 -- 172.21.15.57:0/1789915431 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd840a77f0 con 0x7fdd840b2540 2021-06-25T04:53:24.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd82ffd700 1 --2- 172.21.15.57:0/1789915431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 0x7fdd8414ae00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fdd78002f70 tx=0x7fdd78006eb0).ready entity=mon.2 client_cookie=585be2a10f8946c5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:24.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd81ffb700 1 -- 172.21.15.57:0/1789915431 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd7800d570 con 0x7fdd840b2540 2021-06-25T04:53:24.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd81ffb700 1 -- 172.21.15.57:0/1789915431 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd78000e90 con 0x7fdd840b2540 2021-06-25T04:53:24.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd81ffb700 1 -- 172.21.15.57:0/1789915431 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd7800d900 con 0x7fdd840b2540 2021-06-25T04:53:24.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd83fff700 1 -- 172.21.15.57:0/1789915431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 msgr2=0x7fdd8414ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.818+0000 7fdd83fff700 1 --2- 172.21.15.57:0/1789915431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 0x7fdd8414ae00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fdd78002f70 tx=0x7fdd78006eb0).stop 2021-06-25T04:53:24.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 -- 172.21.15.57:0/1789915431 shutdown_connections 2021-06-25T04:53:24.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 --2- 172.21.15.57:0/1789915431 >> v2:172.21.15.87:3300/0 conn(0x7fdd840affd0 0x7fdd8414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 --2- 172.21.15.57:0/1789915431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 0x7fdd8414ae00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 -- 172.21.15.57:0/1789915431 >> 172.21.15.57:0/1789915431 conn(0x7fdd84060140 msgr2=0x7fdd840b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:24.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 -- 172.21.15.57:0/1789915431 shutdown_connections 2021-06-25T04:53:24.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 -- 172.21.15.57:0/1789915431 wait complete. 2021-06-25T04:53:24.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 Processor -- start 2021-06-25T04:53:24.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 -- start start 2021-06-25T04:53:24.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd840afb90 0x7fdd840a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd840affd0 0x7fdd840aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 0x7fdd84159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840ac5f0 con 0x7fdd840afb90 2021-06-25T04:53:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840abf20 con 0x7fdd840affd0 2021-06-25T04:53:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd83fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840b5470 con 0x7fdd840b2540 2021-06-25T04:53:24.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd82ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd840afb90 0x7fdd840a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd82ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd840afb90 0x7fdd840a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39294/0 (socket says 172.21.15.57:39294) 2021-06-25T04:53:24.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd82ffd700 1 -- 172.21.15.57:0/3025771895 learned_addr learned my addr 172.21.15.57:0/3025771895 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:24.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd827fc700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd840affd0 0x7fdd840aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.822+0000 7fdd837fe700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 0x7fdd84159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd837fe700 1 -- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd840affd0 msgr2=0x7fdd840aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd837fe700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd840affd0 0x7fdd840aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd837fe700 1 -- 172.21.15.57:0/3025771895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd840afb90 msgr2=0x7fdd840a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd837fe700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd840afb90 0x7fdd840a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd837fe700 1 -- 172.21.15.57:0/3025771895 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7800b1e0 con 0x7fdd840b2540 2021-06-25T04:53:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd82ffd700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd840afb90 0x7fdd840a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd837fe700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 0x7fdd84159b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fdd84061a40 tx=0x7fdd7c007eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:24.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd73fff700 1 -- 172.21.15.57:0/3025771895 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd7c00f470 con 0x7fdd840b2540 2021-06-25T04:53:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd73fff700 1 -- 172.21.15.57:0/3025771895 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c00f5d0 con 0x7fdd840b2540 2021-06-25T04:53:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd83fff700 1 -- 172.21.15.57:0/3025771895 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd840ac150 con 0x7fdd840b2540 2021-06-25T04:53:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd73fff700 1 -- 172.21.15.57:0/3025771895 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd7c00f930 con 0x7fdd840b2540 2021-06-25T04:53:24.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd83fff700 1 -- 172.21.15.57:0/3025771895 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd840b50f0 con 0x7fdd840b2540 2021-06-25T04:53:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd83fff700 1 -- 172.21.15.57:0/3025771895 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd84057310 con 0x7fdd840b2540 2021-06-25T04:53:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd73fff700 1 -- 172.21.15.57:0/3025771895 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdd7c010070 con 0x7fdd840b2540 2021-06-25T04:53:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd73fff700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd600554e0 0x7fdd600579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:24.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd73fff700 1 -- 172.21.15.57:0/3025771895 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fdd7c06d190 con 0x7fdd840b2540 2021-06-25T04:53:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.826+0000 7fdd82ffd700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd600554e0 0x7fdd600579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.830+0000 7fdd82ffd700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd600554e0 0x7fdd600579a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fdd7801b000 tx=0x7fdd78015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.838+0000 7fdd73fff700 1 -- 172.21.15.57:0/3025771895 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdd7c0435e0 con 0x7fdd840b2540 2021-06-25T04:53:24.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.966+0000 7fdd83fff700 1 -- 172.21.15.57:0/3025771895 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdd840698a0 con 0x7fdd840b2540 2021-06-25T04:53:24.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.966+0000 7fdd73fff700 1 -- 172.21.15.57:0/3025771895 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v73) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdd7c046c00 con 0x7fdd840b2540 2021-06-25T04:53:24.971 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:53:24.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 -- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd600554e0 msgr2=0x7fdd600579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd600554e0 0x7fdd600579a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fdd7801b000 tx=0x7fdd78015000).stop 2021-06-25T04:53:24.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 -- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 msgr2=0x7fdd84159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:24.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 0x7fdd84159b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fdd84061a40 tx=0x7fdd7c007eb0).stop 2021-06-25T04:53:24.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 -- 172.21.15.57:0/3025771895 shutdown_connections 2021-06-25T04:53:24.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd600554e0 0x7fdd600579a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd840b2540 0x7fdd84159b70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd840affd0 0x7fdd840aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 --2- 172.21.15.57:0/3025771895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd840afb90 0x7fdd840a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:24.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 -- 172.21.15.57:0/3025771895 >> 172.21.15.57:0/3025771895 conn(0x7fdd84060140 msgr2=0x7fdd84144730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:24.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 -- 172.21.15.57:0/3025771895 shutdown_connections 2021-06-25T04:53:24.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:24.970+0000 7fdd83fff700 1 -- 172.21.15.57:0/3025771895 wait complete. 2021-06-25T04:53:24.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:53:25.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c4502700 1 Processor -- start 2021-06-25T04:53:25.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c4502700 1 -- start start 2021-06-25T04:53:25.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c4502700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82bc146910 0x7f82bc1401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c4502700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0b4650 0x7f82bc0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c4502700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc143b20 con 0x7f82bc0b4140 2021-06-25T04:53:25.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c4502700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc1474d0 con 0x7f82bc146910 2021-06-25T04:53:25.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c4502700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc143dc0 con 0x7f82bc0b4650 2021-06-25T04:53:25.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c1a9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f82bc0b4140 0x7f82bc1406e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56520/0 (socket says 172.21.15.57:56520) 2021-06-25T04:53:25.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c1a9d700 1 -- 172.21.15.57:0/3344488740 learned_addr learned my addr 172.21.15.57:0/3344488740 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:25.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c229e700 1 --2- 172.21.15.57:0/3344488740 >> v2:172.21.15.87:3300/0 conn(0x7f82bc146910 0x7f82bc1401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c2a9f700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0b4650 0x7f82bc0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.094+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179840521 0 0) 0x7f82bc143b20 con 0x7f82bc0b4140 2021-06-25T04:53:25.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a4003260 con 0x7f82bc0b4140 2021-06-25T04:53:25.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3433563327 0 0) 0x7f82a4003260 con 0x7f82bc0b4140 2021-06-25T04:53:25.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0b4650 msgr2=0x7f82bc0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:25.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0b4650 0x7f82bc0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 >> v2:172.21.15.87:3300/0 conn(0x7f82bc146910 msgr2=0x7f82bc1401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:25.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 --2- 172.21.15.57:0/3344488740 >> v2:172.21.15.87:3300/0 conn(0x7f82bc146910 0x7f82bc1401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0b0c50 con 0x7f82bc0b4140 2021-06-25T04:53:25.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f82b8001660 con 0x7f82bc0b4140 2021-06-25T04:53:25.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 >> v1:172.21.15.57:6789/0 conn(0x7f82bc0b4140 legacy=0x7f82bc1406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82a4003750 0x7f82a4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0b4650 0x7f82a4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82a40049f0 0x7f82a4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc1474d0 con 0x7f82a40049f0 2021-06-25T04:53:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc143dc0 con 0x7f82a4003750 2021-06-25T04:53:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a400b750 con 0x7f82bc0b4650 2021-06-25T04:53:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c2a9f700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82a40049f0 0x7f82a4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c229e700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82a4003750 0x7f82a4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c1a9d700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0b4650 0x7f82a4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c2a9f700 1 -- 172.21.15.57:0/3344488740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0b4650 msgr2=0x7f82a4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c2a9f700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0b4650 0x7f82a4004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c2a9f700 1 -- 172.21.15.57:0/3344488740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82a4003750 msgr2=0x7f82a4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c2a9f700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82a4003750 0x7f82a4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c2a9f700 1 -- 172.21.15.57:0/3344488740 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a4003260 con 0x7f82a40049f0 2021-06-25T04:53:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c2a9f700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82a40049f0 0x7f82a4004e70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f82b400c000 tx=0x7f82b40091d0).ready entity=mon.0 client_cookie=342a7e7552ff6746 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82b400e7e0 con 0x7f82a40049f0 2021-06-25T04:53:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b400e940 con 0x7f82a40049f0 2021-06-25T04:53:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c4502700 1 -- 172.21.15.57:0/3344488740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82a40049f0 msgr2=0x7f82a4004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c129c700 1 -- 172.21.15.57:0/3344488740 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82b400eca0 con 0x7f82a40049f0 2021-06-25T04:53:25.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c4502700 1 --2- 172.21.15.57:0/3344488740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82a40049f0 0x7f82a4004e70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f82b400c000 tx=0x7f82b40091d0).stop 2021-06-25T04:53:25.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c2a9f700 1 -- 172.21.15.57:0/3344488740 reap_dead start 2021-06-25T04:53:25.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c4502700 1 -- 172.21.15.57:0/3344488740 shutdown_connections 2021-06-25T04:53:25.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c4502700 1 -- 172.21.15.57:0/3344488740 >> 172.21.15.57:0/3344488740 conn(0x7f82bc05c450 msgr2=0x7f82bc05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:25.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c4502700 1 -- 172.21.15.57:0/3344488740 shutdown_connections 2021-06-25T04:53:25.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c4502700 1 -- 172.21.15.57:0/3344488740 wait complete. 2021-06-25T04:53:25.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.098+0000 7f82c4502700 1 Processor -- start 2021-06-25T04:53:25.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c4502700 1 -- start start 2021-06-25T04:53:25.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c4502700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82bc0b51d0 0x7f82bc0ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c4502700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0b55b0 0x7f82bc0adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c4502700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0ae560 0x7f82bc13ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c4502700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc141250 con 0x7f82bc0b55b0 2021-06-25T04:53:25.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c4502700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc1414f0 con 0x7f82bc0b51d0 2021-06-25T04:53:25.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c4502700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc141790 con 0x7f82bc0ae560 2021-06-25T04:53:25.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c1a9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0b55b0 0x7f82bc0adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c1a9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0b55b0 0x7f82bc0adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39316/0 (socket says 172.21.15.57:39316) 2021-06-25T04:53:25.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c1a9d700 1 -- 172.21.15.57:0/3662462681 learned_addr learned my addr 172.21.15.57:0/3662462681 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:25.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c2a9f700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0ae560 0x7f82bc13ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c229e700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82bc0b51d0 0x7f82bc0ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c1a9d700 1 -- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0ae560 msgr2=0x7f82bc13ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c1a9d700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0ae560 0x7f82bc13ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c1a9d700 1 -- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82bc0b51d0 msgr2=0x7f82bc0ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c1a9d700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82bc0b51d0 0x7f82bc0ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c1a9d700 1 -- 172.21.15.57:0/3662462681 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0ad5b0 con 0x7f82bc0b55b0 2021-06-25T04:53:25.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c1a9d700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0b55b0 0x7f82bc0adf40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f82b800b000 tx=0x7f82bc0b2070).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:25.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82af7fe700 1 -- 172.21.15.57:0/3662462681 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82b8015630 con 0x7f82bc0b55b0 2021-06-25T04:53:25.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82af7fe700 1 -- 172.21.15.57:0/3662462681 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8010040 con 0x7f82bc0b55b0 2021-06-25T04:53:25.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c4502700 1 -- 172.21.15.57:0/3662462681 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc155750 con 0x7f82bc0b55b0 2021-06-25T04:53:25.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82af7fe700 1 -- 172.21.15.57:0/3662462681 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82b8015980 con 0x7f82bc0b55b0 2021-06-25T04:53:25.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.102+0000 7f82c4502700 1 -- 172.21.15.57:0/3662462681 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc1422e0 con 0x7f82bc0b55b0 2021-06-25T04:53:25.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.106+0000 7f82af7fe700 1 -- 172.21.15.57:0/3662462681 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f82b8015ae0 con 0x7f82bc0b55b0 2021-06-25T04:53:25.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.106+0000 7f82c4502700 1 -- 172.21.15.57:0/3662462681 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc057310 con 0x7f82bc0b55b0 2021-06-25T04:53:25.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.106+0000 7f82af7fe700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f829c0553d0 0x7f829c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.106+0000 7f82af7fe700 1 -- 172.21.15.57:0/3662462681 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f82b806d730 con 0x7f82bc0b55b0 2021-06-25T04:53:25.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.106+0000 7f82c229e700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f829c0553d0 0x7f829c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.106+0000 7f82c229e700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f829c0553d0 0x7f829c057890 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f82b000b000 tx=0x7f82b0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:25.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.110+0000 7f82af7fe700 1 -- 172.21.15.57:0/3662462681 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f82b8043c20 con 0x7f82bc0b55b0 2021-06-25T04:53:25.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.234+0000 7f82c4502700 1 -- 172.21.15.57:0/3662462681 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f82bc0698a0 con 0x7f82bc0b55b0 2021-06-25T04:53:25.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82af7fe700 1 -- 172.21.15.57:0/3662462681 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v73) v1 ==== 92+0+10 (secure 0 0 0) 0x7f82b801a070 con 0x7f82bc0b55b0 2021-06-25T04:53:25.243 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:53:25.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 -- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f829c0553d0 msgr2=0x7f829c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f829c0553d0 0x7f829c057890 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f82b000b000 tx=0x7f82b0008040).stop 2021-06-25T04:53:25.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 -- 172.21.15.57:0/3662462681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0b55b0 msgr2=0x7f82bc0adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0b55b0 0x7f82bc0adf40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f82b800b000 tx=0x7f82bc0b2070).stop 2021-06-25T04:53:25.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 -- 172.21.15.57:0/3662462681 shutdown_connections 2021-06-25T04:53:25.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f829c0553d0 0x7f829c057890 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0ae560 0x7f82bc13ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82bc0b55b0 0x7f82bc0adf40 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 --2- 172.21.15.57:0/3662462681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82bc0b51d0 0x7f82bc0ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 -- 172.21.15.57:0/3662462681 >> 172.21.15.57:0/3662462681 conn(0x7f82bc05c450 msgr2=0x7f82bc05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:25.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 -- 172.21.15.57:0/3662462681 shutdown_connections 2021-06-25T04:53:25.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.238+0000 7f82c4502700 1 -- 172.21.15.57:0/3662462681 wait complete. 2021-06-25T04:53:25.259 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:53:25.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff5556ec700 1 Processor -- start 2021-06-25T04:53:25.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff5556ec700 1 -- start start 2021-06-25T04:53:25.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff5556ec700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5500b1d10 0x7ff5500b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff5556ec700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5500a58e0 0x7ff5500a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff5556ec700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5500b20f0 con 0x7ff55005c450 2021-06-25T04:53:25.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff5556ec700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5500ade70 con 0x7ff5500a58e0 2021-06-25T04:53:25.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff5556ec700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500b2a40 con 0x7ff5500b1d10 2021-06-25T04:53:25.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5500a58e0 0x7ff5500a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5500a58e0 0x7ff5500a5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39326/0 (socket says 172.21.15.57:39326) 2021-06-25T04:53:25.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54f7fe700 1 -- 172.21.15.57:0/3021771207 learned_addr learned my addr 172.21.15.57:0/3021771207 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:25.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54effd700 1 --2- 172.21.15.57:0/3021771207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5500b1d10 0x7ff5500b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54f7fe700 1 -- 172.21.15.57:0/3021771207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5500b1d10 msgr2=0x7ff5500b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:25.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54f7fe700 1 --2- 172.21.15.57:0/3021771207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5500b1d10 0x7ff5500b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54f7fe700 1 -- 172.21.15.57:0/3021771207 >> v1:172.21.15.87:6789/0 conn(0x7ff55005c450 legacy=0x7ff5500ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54f7fe700 1 -- 172.21.15.57:0/3021771207 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5500b2ce0 con 0x7ff5500a58e0 2021-06-25T04:53:25.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54f7fe700 1 --2- 172.21.15.57:0/3021771207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5500a58e0 0x7ff5500a5ce0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7ff5480032f0 tx=0x7ff548009290).ready entity=mon.0 client_cookie=3f214a8148c091fd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:25.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54dffb700 1 -- 172.21.15.57:0/3021771207 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54800b8a0 con 0x7ff5500a58e0 2021-06-25T04:53:25.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54dffb700 1 -- 172.21.15.57:0/3021771207 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54800ba00 con 0x7ff5500a58e0 2021-06-25T04:53:25.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff54dffb700 1 -- 172.21.15.57:0/3021771207 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff54800bb70 con 0x7ff5500a58e0 2021-06-25T04:53:25.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff5556ec700 1 -- 172.21.15.57:0/3021771207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5500a58e0 msgr2=0x7ff5500a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.358+0000 7ff5556ec700 1 --2- 172.21.15.57:0/3021771207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5500a58e0 0x7ff5500a5ce0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7ff5480032f0 tx=0x7ff548009290).stop 2021-06-25T04:53:25.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 -- 172.21.15.57:0/3021771207 shutdown_connections 2021-06-25T04:53:25.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 --2- 172.21.15.57:0/3021771207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5500a58e0 0x7ff5500a5ce0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 --2- 172.21.15.57:0/3021771207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5500b1d10 0x7ff5500b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 -- 172.21.15.57:0/3021771207 >> 172.21.15.57:0/3021771207 conn(0x7ff55005cce0 msgr2=0x7ff550062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:25.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 -- 172.21.15.57:0/3021771207 shutdown_connections 2021-06-25T04:53:25.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 -- 172.21.15.57:0/3021771207 wait complete. 2021-06-25T04:53:25.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 Processor -- start 2021-06-25T04:53:25.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 -- start start 2021-06-25T04:53:25.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55005c450 0x7ff550152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500a58e0 0x7ff5500a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5500b1d10 0x7ff550064ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500b4c60 con 0x7ff55005c450 2021-06-25T04:53:25.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550152510 con 0x7ff5500a58e0 2021-06-25T04:53:25.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff5556ec700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501527b0 con 0x7ff5500b1d10 2021-06-25T04:53:25.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55005c450 0x7ff550152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55005c450 0x7ff550152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39328/0 (socket says 172.21.15.57:39328) 2021-06-25T04:53:25.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54effd700 1 -- 172.21.15.57:0/329103816 learned_addr learned my addr 172.21.15.57:0/329103816 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:25.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54f7fe700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5500b1d10 0x7ff550064ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54e7fc700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500a58e0 0x7ff5500a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54effd700 1 -- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5500b1d10 msgr2=0x7ff550064ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54effd700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5500b1d10 0x7ff550064ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54effd700 1 -- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500a58e0 msgr2=0x7ff5500a6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54effd700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500a58e0 0x7ff5500a6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54effd700 1 -- 172.21.15.57:0/329103816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff548009530 con 0x7ff55005c450 2021-06-25T04:53:25.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54e7fc700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500a58e0 0x7ff5500a6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:25.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.362+0000 7ff54effd700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55005c450 0x7ff550152ef0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7ff54000c000 tx=0x7ff540006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:25.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.366+0000 7ff53ffff700 1 -- 172.21.15.57:0/329103816 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff540010780 con 0x7ff55005c450 2021-06-25T04:53:25.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.366+0000 7ff53ffff700 1 -- 172.21.15.57:0/329103816 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5400108e0 con 0x7ff55005c450 2021-06-25T04:53:25.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.366+0000 7ff5556ec700 1 -- 172.21.15.57:0/329103816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff550152a50 con 0x7ff55005c450 2021-06-25T04:53:25.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.366+0000 7ff53ffff700 1 -- 172.21.15.57:0/329103816 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff540010c40 con 0x7ff55005c450 2021-06-25T04:53:25.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.366+0000 7ff5556ec700 1 -- 172.21.15.57:0/329103816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff550155960 con 0x7ff55005c450 2021-06-25T04:53:25.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.366+0000 7ff5556ec700 1 -- 172.21.15.57:0/329103816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff550152be0 con 0x7ff55005c450 2021-06-25T04:53:25.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.366+0000 7ff53ffff700 1 -- 172.21.15.57:0/329103816 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff54001c460 con 0x7ff55005c450 2021-06-25T04:53:25.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.366+0000 7ff53ffff700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff52c055340 0x7ff52c057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.366+0000 7ff53ffff700 1 -- 172.21.15.57:0/329103816 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ff54006dfd0 con 0x7ff55005c450 2021-06-25T04:53:25.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.366+0000 7ff54e7fc700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff52c055340 0x7ff52c057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.366+0000 7ff54e7fc700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff52c055340 0x7ff52c057800 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ff54400b000 tx=0x7ff544009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:25.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.374+0000 7ff53ffff700 1 -- 172.21.15.57:0/329103816 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff540044460 con 0x7ff55005c450 2021-06-25T04:53:25.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.498+0000 7ff5556ec700 1 -- 172.21.15.57:0/329103816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff550057310 con 0x7ff55005c450 2021-06-25T04:53:25.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.498+0000 7ff53ffff700 1 -- 172.21.15.57:0/329103816 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff540047a80 con 0x7ff55005c450 2021-06-25T04:53:25.506 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:25.506 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:53:25.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:25.507 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:53:25.507 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:53:25.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:53:25.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:53:25.508 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:53:25.508 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:53:25.509 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:53:25.509 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:53:25.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 -- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff52c055340 msgr2=0x7ff52c057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff52c055340 0x7ff52c057800 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ff54400b000 tx=0x7ff544009040).stop 2021-06-25T04:53:25.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 -- 172.21.15.57:0/329103816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55005c450 msgr2=0x7ff550152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55005c450 0x7ff550152ef0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7ff54000c000 tx=0x7ff540006df0).stop 2021-06-25T04:53:25.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 -- 172.21.15.57:0/329103816 shutdown_connections 2021-06-25T04:53:25.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff52c055340 0x7ff52c057800 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5500b1d10 0x7ff550064ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500a58e0 0x7ff5500a6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 --2- 172.21.15.57:0/329103816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55005c450 0x7ff550152ef0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 -- 172.21.15.57:0/329103816 >> 172.21.15.57:0/329103816 conn(0x7ff55005cce0 msgr2=0x7ff55013e680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:25.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 -- 172.21.15.57:0/329103816 shutdown_connections 2021-06-25T04:53:25.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.502+0000 7ff5556ec700 1 -- 172.21.15.57:0/329103816 wait complete. 2021-06-25T04:53:25.522 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:53:25.522 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:53:25.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.630+0000 7fdd2bfff700 1 Processor -- start 2021-06-25T04:53:25.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.630+0000 7fdd2bfff700 1 -- start start 2021-06-25T04:53:25.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.630+0000 7fdd2bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd2c0612e0 0x7fdd2c0616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.630+0000 7fdd2bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdd2c0ad580 0x7fdd2c0b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.630+0000 7fdd2bfff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c0aecb0 con 0x7fdd2c140400 2021-06-25T04:53:25.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.630+0000 7fdd2bfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c0b6ee0 con 0x7fdd2c0ad580 2021-06-25T04:53:25.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.630+0000 7fdd2bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c0aeee0 con 0x7fdd2c0612e0 2021-06-25T04:53:25.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.630+0000 7fdd2a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdd2c0ad580 0x7fdd2c0b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.630+0000 7fdd2a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdd2c0ad580 0x7fdd2c0b9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39336/0 (socket says 172.21.15.57:39336) 2021-06-25T04:53:25.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.630+0000 7fdd2a7fc700 1 -- 172.21.15.57:0/3813409795 learned_addr learned my addr 172.21.15.57:0/3813409795 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:25.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.630+0000 7fdd2affd700 1 --2- 172.21.15.57:0/3813409795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd2c0612e0 0x7fdd2c0616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2a7fc700 1 -- 172.21.15.57:0/3813409795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd2c0612e0 msgr2=0x7fdd2c0616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:25.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2a7fc700 1 --2- 172.21.15.57:0/3813409795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd2c0612e0 0x7fdd2c0616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2a7fc700 1 -- 172.21.15.57:0/3813409795 >> v1:172.21.15.87:6789/0 conn(0x7fdd2c140400 legacy=0x7fdd2c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2a7fc700 1 -- 172.21.15.57:0/3813409795 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c0af180 con 0x7fdd2c0ad580 2021-06-25T04:53:25.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2a7fc700 1 --2- 172.21.15.57:0/3813409795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd2c0ad580 0x7fdd2c0b9e20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fdd1c002f70 tx=0x7fdd1c006eb0).ready entity=mon.0 client_cookie=20692cb8b049fb60 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:25.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd29ffb700 1 -- 172.21.15.57:0/3813409795 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c00d570 con 0x7fdd2c0ad580 2021-06-25T04:53:25.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd29ffb700 1 -- 172.21.15.57:0/3813409795 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c000e90 con 0x7fdd2c0ad580 2021-06-25T04:53:25.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd29ffb700 1 -- 172.21.15.57:0/3813409795 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c00d900 con 0x7fdd2c0ad580 2021-06-25T04:53:25.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3813409795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd2c0ad580 msgr2=0x7fdd2c0b9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2bfff700 1 --2- 172.21.15.57:0/3813409795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd2c0ad580 0x7fdd2c0b9e20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fdd1c002f70 tx=0x7fdd1c006eb0).stop 2021-06-25T04:53:25.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3813409795 shutdown_connections 2021-06-25T04:53:25.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2bfff700 1 --2- 172.21.15.57:0/3813409795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd2c0ad580 0x7fdd2c0b9e20 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2bfff700 1 --2- 172.21.15.57:0/3813409795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd2c0612e0 0x7fdd2c0616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3813409795 >> 172.21.15.57:0/3813409795 conn(0x7fdd2c066da0 msgr2=0x7fdd2c067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:25.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3813409795 shutdown_connections 2021-06-25T04:53:25.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3813409795 wait complete. 2021-06-25T04:53:25.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2bfff700 1 Processor -- start 2021-06-25T04:53:25.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.634+0000 7fdd2bfff700 1 -- start start 2021-06-25T04:53:25.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd2c0612e0 0x7fdd2c0b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd2c0ad580 0x7fdd2c0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd2c140400 0x7fdd2c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c0b0990 con 0x7fdd2c0ad580 2021-06-25T04:53:25.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c0b1bb0 con 0x7fdd2c0612e0 2021-06-25T04:53:25.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c0b1e50 con 0x7fdd2c140400 2021-06-25T04:53:25.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd2c0ad580 0x7fdd2c0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd2c0ad580 0x7fdd2c0b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39344/0 (socket says 172.21.15.57:39344) 2021-06-25T04:53:25.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2a7fc700 1 -- 172.21.15.57:0/3459913987 learned_addr learned my addr 172.21.15.57:0/3459913987 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:25.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2affd700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd2c0612e0 0x7fdd2c0b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2b7fe700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd2c140400 0x7fdd2c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2a7fc700 1 -- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd2c140400 msgr2=0x7fdd2c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2a7fc700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd2c140400 0x7fdd2c0b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2a7fc700 1 -- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd2c0612e0 msgr2=0x7fdd2c0b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:25.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2a7fc700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd2c0612e0 0x7fdd2c0b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:25.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2a7fc700 1 -- 172.21.15.57:0/3459913987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c00b1e0 con 0x7fdd2c0ad580 2021-06-25T04:53:25.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2a7fc700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd2c0ad580 0x7fdd2c0b1250 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fdd1c002f70 tx=0x7fdd1c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:25.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd1bfff700 1 -- 172.21.15.57:0/3459913987 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c011760 con 0x7fdd2c0ad580 2021-06-25T04:53:25.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd1bfff700 1 -- 172.21.15.57:0/3459913987 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c0118c0 con 0x7fdd2c0ad580 2021-06-25T04:53:25.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3459913987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2c0b20f0 con 0x7fdd2c0ad580 2021-06-25T04:53:25.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd1bfff700 1 -- 172.21.15.57:0/3459913987 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c011c20 con 0x7fdd2c0ad580 2021-06-25T04:53:25.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.638+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3459913987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2c0b2a80 con 0x7fdd2c0ad580 2021-06-25T04:53:25.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.642+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3459913987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2c0b2280 con 0x7fdd2c0ad580 2021-06-25T04:53:25.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.642+0000 7fdd1bfff700 1 -- 172.21.15.57:0/3459913987 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdd1c00f070 con 0x7fdd2c0ad580 2021-06-25T04:53:25.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.642+0000 7fdd1bfff700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd08055450 0x7fdd08057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:25.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.642+0000 7fdd1bfff700 1 -- 172.21.15.57:0/3459913987 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fdd1c06f3e0 con 0x7fdd2c0ad580 2021-06-25T04:53:25.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.642+0000 7fdd2affd700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd08055450 0x7fdd08057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:25.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.642+0000 7fdd2affd700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd08055450 0x7fdd08057910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fdd2000b000 tx=0x7fdd20006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:25.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.646+0000 7fdd1bfff700 1 -- 172.21.15.57:0/3459913987 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdd1c0458d0 con 0x7fdd2c0ad580 2021-06-25T04:53:25.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:25.774+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3459913987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fdd2c142d70 con 0x7fdd2c0ad580 2021-06-25T04:53:26.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.350+0000 7fdd1bfff700 1 -- 172.21.15.57:0/3459913987 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v74) v1 ==== 133+0+0 (secure 0 0 0) 0x7fdd1c048ef0 con 0x7fdd2c0ad580 2021-06-25T04:53:26.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd08055450 msgr2=0x7fdd08057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:26.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd08055450 0x7fdd08057910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fdd2000b000 tx=0x7fdd20006df0).stop 2021-06-25T04:53:26.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3459913987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd2c0ad580 msgr2=0x7fdd2c0b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:26.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd2c0ad580 0x7fdd2c0b1250 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fdd1c002f70 tx=0x7fdd1c015000).stop 2021-06-25T04:53:26.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3459913987 shutdown_connections 2021-06-25T04:53:26.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd08055450 0x7fdd08057910 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:26.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd2c140400 0x7fdd2c0b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:26.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd2c0ad580 0x7fdd2c0b1250 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:26.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 --2- 172.21.15.57:0/3459913987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd2c0612e0 0x7fdd2c0b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:26.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3459913987 >> 172.21.15.57:0/3459913987 conn(0x7fdd2c066da0 msgr2=0x7fdd2c1499b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:26.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3459913987 shutdown_connections 2021-06-25T04:53:26.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.354+0000 7fdd2bfff700 1 -- 172.21.15.57:0/3459913987 wait complete. 2021-06-25T04:53:26.364 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:53:26.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:53:26.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.482+0000 7f1b2d699700 1 Processor -- start 2021-06-25T04:53:26.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.482+0000 7f1b2d699700 1 -- start start 2021-06-25T04:53:26.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.482+0000 7f1b2d699700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b280b4020 0x7f1b28061b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:26.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.482+0000 7f1b2d699700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b280b5f10 con 0x7f1b28142e20 2021-06-25T04:53:26.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.482+0000 7f1b2d699700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b280b1f30 con 0x7f1b280b6250 2021-06-25T04:53:26.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.482+0000 7f1b2d699700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b280b21d0 con 0x7f1b280b4020 2021-06-25T04:53:26.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.482+0000 7f1b277fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b280b4020 0x7f1b28061b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:26.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.482+0000 7f1b2ce98700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1b28142e20 0x7f1b281432b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56572/0 (socket says 172.21.15.57:56572) 2021-06-25T04:53:26.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.482+0000 7f1b2ce98700 1 -- 172.21.15.57:0/2536464241 learned_addr learned my addr 172.21.15.57:0/2536464241 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:26.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b26ffd700 1 -- 172.21.15.57:0/2536464241 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962693944 0 0) 0x7f1b20001490 con 0x7f1b28142e20 2021-06-25T04:53:26.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b26ffd700 1 -- 172.21.15.57:0/2536464241 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b14003260 con 0x7f1b28142e20 2021-06-25T04:53:26.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b277fe700 1 -- 172.21.15.57:0/2536464241 >> v1:172.21.15.87:6789/0 conn(0x7f1b280b6250 legacy=0x7f1b28061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:26.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b277fe700 1 -- 172.21.15.57:0/2536464241 >> v1:172.21.15.57:6789/0 conn(0x7f1b28142e20 legacy=0x7f1b281432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:26.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b277fe700 1 -- 172.21.15.57:0/2536464241 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b280b2470 con 0x7f1b280b4020 2021-06-25T04:53:26.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b277fe700 1 --2- 172.21.15.57:0/2536464241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b280b4020 0x7f1b28061b40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f1b1c002f70 tx=0x7f1b1c006df0).ready entity=mon.0 client_cookie=cb7da7f49f480b65 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b26ffd700 1 -- 172.21.15.57:0/2536464241 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b1c00d610 con 0x7f1b280b4020 2021-06-25T04:53:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b26ffd700 1 -- 172.21.15.57:0/2536464241 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c000e90 con 0x7f1b280b4020 2021-06-25T04:53:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b26ffd700 1 -- 172.21.15.57:0/2536464241 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b1c00d960 con 0x7f1b280b4020 2021-06-25T04:53:26.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b2d699700 1 -- 172.21.15.57:0/2536464241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b280b4020 msgr2=0x7f1b28061b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:26.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b2d699700 1 --2- 172.21.15.57:0/2536464241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b280b4020 0x7f1b28061b40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f1b1c002f70 tx=0x7f1b1c006df0).stop 2021-06-25T04:53:26.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b2d699700 1 -- 172.21.15.57:0/2536464241 shutdown_connections 2021-06-25T04:53:26.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b2d699700 1 --2- 172.21.15.57:0/2536464241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b280b4020 0x7f1b28061b40 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:26.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b2d699700 1 -- 172.21.15.57:0/2536464241 >> 172.21.15.57:0/2536464241 conn(0x7f1b2805c450 msgr2=0x7f1b2805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:26.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b2d699700 1 -- 172.21.15.57:0/2536464241 shutdown_connections 2021-06-25T04:53:26.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.486+0000 7f1b2d699700 1 -- 172.21.15.57:0/2536464241 wait complete. 2021-06-25T04:53:26.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b2d699700 1 Processor -- start 2021-06-25T04:53:26.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b2d699700 1 -- start start 2021-06-25T04:53:26.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b2d699700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b280b4020 0x7f1b2813d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:26.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b2d699700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b280b6250 0x7f1b2813dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:26.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b2d699700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b28142e20 0x7f1b28155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:26.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b2d699700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b280adc60 con 0x7f1b280b4020 2021-06-25T04:53:26.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b2d699700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b280adf00 con 0x7f1b28142e20 2021-06-25T04:53:26.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b2d699700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28153240 con 0x7f1b280b6250 2021-06-25T04:53:26.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b280b4020 0x7f1b2813d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:26.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b280b4020 0x7f1b2813d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39356/0 (socket says 172.21.15.57:39356) 2021-06-25T04:53:26.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b27fff700 1 -- 172.21.15.57:0/1595481453 learned_addr learned my addr 172.21.15.57:0/1595481453 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:26.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b277fe700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b280b6250 0x7f1b2813dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:26.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b2ce98700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b28142e20 0x7f1b28155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:26.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b27fff700 1 -- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b280b6250 msgr2=0x7f1b2813dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:26.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b27fff700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b280b6250 0x7f1b2813dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:26.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b27fff700 1 -- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b28142e20 msgr2=0x7f1b28155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:26.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b27fff700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b28142e20 0x7f1b28155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:26.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b27fff700 1 -- 172.21.15.57:0/1595481453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c00b180 con 0x7f1b280b4020 2021-06-25T04:53:26.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.490+0000 7f1b27fff700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b280b4020 0x7f1b2813d7d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f1b28060150 tx=0x7f1b18007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:26.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.494+0000 7f1b257fa700 1 -- 172.21.15.57:0/1595481453 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b18012400 con 0x7f1b280b4020 2021-06-25T04:53:26.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.494+0000 7f1b257fa700 1 -- 172.21.15.57:0/1595481453 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b18012560 con 0x7f1b280b4020 2021-06-25T04:53:26.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.494+0000 7f1b2d699700 1 -- 172.21.15.57:0/1595481453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b28152f60 con 0x7f1b280b4020 2021-06-25T04:53:26.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.494+0000 7f1b257fa700 1 -- 172.21.15.57:0/1595481453 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b180128c0 con 0x7f1b280b4020 2021-06-25T04:53:26.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.494+0000 7f1b2d699700 1 -- 172.21.15.57:0/1595481453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2813e1b0 con 0x7f1b280b4020 2021-06-25T04:53:26.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.494+0000 7f1b2d699700 1 -- 172.21.15.57:0/1595481453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b280ad8d0 con 0x7f1b280b4020 2021-06-25T04:53:26.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.494+0000 7f1b257fa700 1 -- 172.21.15.57:0/1595481453 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1b18019030 con 0x7f1b280b4020 2021-06-25T04:53:26.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.494+0000 7f1b257fa700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b080553f0 0x7f1b080578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:26.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.494+0000 7f1b257fa700 1 -- 172.21.15.57:0/1595481453 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f1b1806d120 con 0x7f1b280b4020 2021-06-25T04:53:26.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.494+0000 7f1b277fe700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b080553f0 0x7f1b080578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:26.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.494+0000 7f1b277fe700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b080553f0 0x7f1b080578b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f1b1c019000 tx=0x7f1b1c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:26.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.502+0000 7f1b257fa700 1 -- 172.21.15.57:0/1595481453 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1b280ad8d0 con 0x7f1b280b4020 2021-06-25T04:53:26.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.634+0000 7f1b2d699700 1 -- 172.21.15.57:0/1595481453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f1b280ad8d0 con 0x7f1b280b4020 2021-06-25T04:53:26.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.938+0000 7f1b257fa700 1 -- 172.21.15.57:0/1595481453 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v75) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1b280ad8d0 con 0x7f1b280b4020 2021-06-25T04:53:26.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 -- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b080553f0 msgr2=0x7f1b080578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:26.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b080553f0 0x7f1b080578b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f1b1c019000 tx=0x7f1b1c014000).stop 2021-06-25T04:53:26.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 -- 172.21.15.57:0/1595481453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b280b4020 msgr2=0x7f1b2813d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:26.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b280b4020 0x7f1b2813d7d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f1b28060150 tx=0x7f1b18007c50).stop 2021-06-25T04:53:26.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 -- 172.21.15.57:0/1595481453 shutdown_connections 2021-06-25T04:53:26.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b080553f0 0x7f1b080578b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:26.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b28142e20 0x7f1b28155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b280b6250 0x7f1b2813dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 --2- 172.21.15.57:0/1595481453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b280b4020 0x7f1b2813d7d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 -- 172.21.15.57:0/1595481453 >> 172.21.15.57:0/1595481453 conn(0x7f1b2805c450 msgr2=0x7f1b28140fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 -- 172.21.15.57:0/1595481453 shutdown_connections 2021-06-25T04:53:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:26.946+0000 7f1b2d699700 1 -- 172.21.15.57:0/1595481453 wait complete. 2021-06-25T04:53:26.955 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:53:26.965 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:53:27.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.074+0000 7fa4e5cef700 1 Processor -- start 2021-06-25T04:53:27.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.074+0000 7fa4e5cef700 1 -- start start 2021-06-25T04:53:27.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e0063890 0x7fa4e0143d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4e0140940 0x7fa4e0128c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e0063c70 con 0x7fa4e00618e0 2021-06-25T04:53:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e013fd70 con 0x7fa4e0140940 2021-06-25T04:53:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0061fb0 con 0x7fa4e0063890 2021-06-25T04:53:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e54ee700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4e0140940 0x7fa4e0128c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e54ee700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4e0140940 0x7fa4e0128c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39368/0 (socket says 172.21.15.57:39368) 2021-06-25T04:53:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e54ee700 1 -- 172.21.15.57:0/1119848061 learned_addr learned my addr 172.21.15.57:0/1119848061 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e4ced700 1 --2- 172.21.15.57:0/1119848061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e0063890 0x7fa4e0143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e54ee700 1 -- 172.21.15.57:0/1119848061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e0063890 msgr2=0x7fa4e0143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e54ee700 1 --2- 172.21.15.57:0/1119848061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e0063890 0x7fa4e0143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e54ee700 1 -- 172.21.15.57:0/1119848061 >> v1:172.21.15.87:6789/0 conn(0x7fa4e00618e0 legacy=0x7fa4e00b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e54ee700 1 -- 172.21.15.57:0/1119848061 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e013ff60 con 0x7fa4e0140940 2021-06-25T04:53:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e54ee700 1 --2- 172.21.15.57:0/1119848061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e0140940 0x7fa4e0128c40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fa4e00b6280 tx=0x7fa4d8009290).ready entity=mon.0 client_cookie=a2c15bfe7dfa8734 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4df7fe700 1 -- 172.21.15.57:0/1119848061 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d800b830 con 0x7fa4e0140940 2021-06-25T04:53:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4df7fe700 1 -- 172.21.15.57:0/1119848061 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d800b990 con 0x7fa4e0140940 2021-06-25T04:53:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4df7fe700 1 -- 172.21.15.57:0/1119848061 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d800bb00 con 0x7fa4e0140940 2021-06-25T04:53:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 -- 172.21.15.57:0/1119848061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e0140940 msgr2=0x7fa4e0128c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 --2- 172.21.15.57:0/1119848061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e0140940 0x7fa4e0128c40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fa4e00b6280 tx=0x7fa4d8009290).stop 2021-06-25T04:53:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 -- 172.21.15.57:0/1119848061 shutdown_connections 2021-06-25T04:53:27.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 --2- 172.21.15.57:0/1119848061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e0140940 0x7fa4e0128c40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 --2- 172.21.15.57:0/1119848061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e0063890 0x7fa4e0143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 -- 172.21.15.57:0/1119848061 >> 172.21.15.57:0/1119848061 conn(0x7fa4e005c450 msgr2=0x7fa4e005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:27.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 -- 172.21.15.57:0/1119848061 shutdown_connections 2021-06-25T04:53:27.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.078+0000 7fa4e5cef700 1 -- 172.21.15.57:0/1119848061 wait complete. 2021-06-25T04:53:27.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e5cef700 1 Processor -- start 2021-06-25T04:53:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e5cef700 1 -- start start 2021-06-25T04:53:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e5cef700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00618e0 0x7fa4e0128320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e5cef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e0063890 0x7fa4e00642f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e5cef700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e0140940 0x7fa4e00647e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e5cef700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00b34b0 con 0x7fa4e0140940 2021-06-25T04:53:27.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e5cef700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0155cb0 con 0x7fa4e0063890 2021-06-25T04:53:27.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e5cef700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0064cd0 con 0x7fa4e00618e0 2021-06-25T04:53:27.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e54ee700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e0140940 0x7fa4e00647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e4ced700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00618e0 0x7fa4e0128320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4dffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e0063890 0x7fa4e00642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e4ced700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00618e0 0x7fa4e0128320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:50534/0 (socket says 172.21.15.57:50534) 2021-06-25T04:53:27.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e4ced700 1 -- 172.21.15.57:0/3451668487 learned_addr learned my addr 172.21.15.57:0/3451668487 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:27.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4dffff700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e0063890 0x7fa4e00642f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:47866/0 (socket says 172.21.15.57:47866) 2021-06-25T04:53:27.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.082+0000 7fa4e54ee700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e0140940 0x7fa4e00647e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39374/0 (socket says 172.21.15.57:39374) 2021-06-25T04:53:27.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4e54ee700 1 -- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00618e0 msgr2=0x7fa4e0128320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4e54ee700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00618e0 0x7fa4e0128320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4e54ee700 1 -- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e0063890 msgr2=0x7fa4e00642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4e54ee700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e0063890 0x7fa4e00642f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4e54ee700 1 -- 172.21.15.57:0/3451668487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8009530 con 0x7fa4e0140940 2021-06-25T04:53:27.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4e54ee700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e0140940 0x7fa4e00647e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fa4e0065900 tx=0x7fa4d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4ddffb700 1 -- 172.21.15.57:0/3451668487 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d8011b00 con 0x7fa4e0140940 2021-06-25T04:53:27.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4ddffb700 1 -- 172.21.15.57:0/3451668487 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d8011c60 con 0x7fa4e0140940 2021-06-25T04:53:27.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4e5cef700 1 -- 172.21.15.57:0/3451668487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e00670b0 con 0x7fa4e0140940 2021-06-25T04:53:27.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4ddffb700 1 -- 172.21.15.57:0/3451668487 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d80032f0 con 0x7fa4e0140940 2021-06-25T04:53:27.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4e5cef700 1 -- 172.21.15.57:0/3451668487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e00b22e0 con 0x7fa4e0140940 2021-06-25T04:53:27.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.086+0000 7fa4e5cef700 1 -- 172.21.15.57:0/3451668487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e00b3190 con 0x7fa4e0140940 2021-06-25T04:53:27.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.090+0000 7fa4ddffb700 1 -- 172.21.15.57:0/3451668487 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa4d8026020 con 0x7fa4e0140940 2021-06-25T04:53:27.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.090+0000 7fa4ddffb700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4c40554e0 0x7fa4c40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.090+0000 7fa4ddffb700 1 -- 172.21.15.57:0/3451668487 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6304+0+0 (secure 0 0 0) 0x7fa4d806e8d0 con 0x7fa4e0140940 2021-06-25T04:53:27.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.090+0000 7fa4e4ced700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4c40554e0 0x7fa4c40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.090+0000 7fa4e4ced700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4c40554e0 0x7fa4c40579a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fa4d0008000 tx=0x7fa4d0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.094+0000 7fa4ddffb700 1 -- 172.21.15.57:0/3451668487 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa4d8044b00 con 0x7fa4e0140940 2021-06-25T04:53:27.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.262+0000 7fa4e5cef700 1 -- 172.21.15.57:0/3451668487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fa4e0057310 con 0x7fa4e0140940 2021-06-25T04:53:27.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.274+0000 7fa4ddffb700 1 -- 172.21.15.57:0/3451668487 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v35) v1 ==== 189+0+0 (secure 0 0 0) 0x7fa4d80150d0 con 0x7fa4e0140940 2021-06-25T04:53:27.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 -- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4c40554e0 msgr2=0x7fa4c40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4c40554e0 0x7fa4c40579a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fa4d0008000 tx=0x7fa4d0008040).stop 2021-06-25T04:53:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 -- 172.21.15.57:0/3451668487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e0140940 msgr2=0x7fa4e00647e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e0140940 0x7fa4e00647e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fa4e0065900 tx=0x7fa4d8016000).stop 2021-06-25T04:53:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 -- 172.21.15.57:0/3451668487 shutdown_connections 2021-06-25T04:53:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa4c40554e0 0x7fa4c40579a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e0140940 0x7fa4e00647e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e0063890 0x7fa4e00642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 --2- 172.21.15.57:0/3451668487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4e00618e0 0x7fa4e0128320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 -- 172.21.15.57:0/3451668487 >> 172.21.15.57:0/3451668487 conn(0x7fa4e005c450 msgr2=0x7fa4e014a920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:27.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 -- 172.21.15.57:0/3451668487 shutdown_connections 2021-06-25T04:53:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.278+0000 7fa4e5cef700 1 -- 172.21.15.57:0/3451668487 wait complete. 2021-06-25T04:53:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 13 and data pool 14 2021-06-25T04:53:27.299 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:53:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.382+0000 7fbf28b36700 1 Processor -- start 2021-06-25T04:53:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 -- start start 2021-06-25T04:53:27.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbf240af3d0 0x7fbf24060440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf2405f670 0x7fbf241410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf240b3130 con 0x7fbf24144d40 2021-06-25T04:53:27.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf240b33d0 con 0x7fbf240af3d0 2021-06-25T04:53:27.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf24144600 con 0x7fbf2405f670 2021-06-25T04:53:27.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf22d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbf24144d40 0x7fbf240a58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56610/0 (socket says 172.21.15.57:56610) 2021-06-25T04:53:27.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf22d9d700 1 -- 172.21.15.57:0/110107369 learned_addr learned my addr 172.21.15.57:0/110107369 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:27.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141312065 0 0) 0x7fbf240b3130 con 0x7fbf24144d40 2021-06-25T04:53:27.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf04003260 con 0x7fbf24144d40 2021-06-25T04:53:27.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2259c700 1 --2- 172.21.15.57:0/110107369 >> v2:172.21.15.87:3300/0 conn(0x7fbf240af3d0 0x7fbf24060440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf21d9b700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf2405f670 0x7fbf241410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3109485265 0 0) 0x7fbf04003260 con 0x7fbf24144d40 2021-06-25T04:53:27.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf2405f670 msgr2=0x7fbf241410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:27.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf2405f670 0x7fbf241410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 >> v2:172.21.15.87:3300/0 conn(0x7fbf240af3d0 msgr2=0x7fbf24060440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:27.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 --2- 172.21.15.57:0/110107369 >> v2:172.21.15.87:3300/0 conn(0x7fbf240af3d0 0x7fbf24060440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf241448a0 con 0x7fbf24144d40 2021-06-25T04:53:27.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fbf1c0019e0 con 0x7fbf24144d40 2021-06-25T04:53:27.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 >> v1:172.21.15.57:6789/0 conn(0x7fbf24144d40 legacy=0x7fbf240a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf2405f670 0x7fbf04003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf04003d30 0x7fbf04004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf040049f0 0x7fbf04004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240b33d0 con 0x7fbf040049f0 2021-06-25T04:53:27.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf24144600 con 0x7fbf04003d30 2021-06-25T04:53:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0400b800 con 0x7fbf2405f670 2021-06-25T04:53:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf22d9d700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf040049f0 0x7fbf04004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2259c700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf2405f670 0x7fbf04003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf21d9b700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf04003d30 0x7fbf04004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf22d9d700 1 -- 172.21.15.57:0/110107369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf2405f670 msgr2=0x7fbf04003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf22d9d700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf2405f670 0x7fbf04003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf22d9d700 1 -- 172.21.15.57:0/110107369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf04003d30 msgr2=0x7fbf04004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:27.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf22d9d700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf04003d30 0x7fbf04004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf22d9d700 1 -- 172.21.15.57:0/110107369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf04003260 con 0x7fbf040049f0 2021-06-25T04:53:27.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf22d9d700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf040049f0 0x7fbf04004e70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fbf240a9af0 tx=0x7fbf240b32c0).ready entity=mon.0 client_cookie=acc6446d66568e91 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf1c00cca0 con 0x7fbf040049f0 2021-06-25T04:53:27.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c00ce00 con 0x7fbf040049f0 2021-06-25T04:53:27.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf2159a700 1 -- 172.21.15.57:0/110107369 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf1c005b80 con 0x7fbf040049f0 2021-06-25T04:53:27.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 -- 172.21.15.57:0/110107369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf040049f0 msgr2=0x7fbf04004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 --2- 172.21.15.57:0/110107369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf040049f0 0x7fbf04004e70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fbf240a9af0 tx=0x7fbf240b32c0).stop 2021-06-25T04:53:27.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf22d9d700 1 -- 172.21.15.57:0/110107369 reap_dead start 2021-06-25T04:53:27.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 -- 172.21.15.57:0/110107369 shutdown_connections 2021-06-25T04:53:27.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 -- 172.21.15.57:0/110107369 >> 172.21.15.57:0/110107369 conn(0x7fbf2405cce0 msgr2=0x7fbf24062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:27.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 -- 172.21.15.57:0/110107369 shutdown_connections 2021-06-25T04:53:27.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.386+0000 7fbf28b36700 1 -- 172.21.15.57:0/110107369 wait complete. 2021-06-25T04:53:27.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf28b36700 1 Processor -- start 2021-06-25T04:53:27.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf28b36700 1 -- start start 2021-06-25T04:53:27.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf28b36700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf24140850 0x7fbf240a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf28b36700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf240a6e90 0x7fbf2413df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf28b36700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf240a6970 0x7fbf2413e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf28b36700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240ab300 con 0x7fbf240a6e90 2021-06-25T04:53:27.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf28b36700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf24140c30 con 0x7fbf24140850 2021-06-25T04:53:27.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf28b36700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240a9290 con 0x7fbf240a6970 2021-06-25T04:53:27.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf21d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf240a6e90 0x7fbf2413df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf21d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf240a6e90 0x7fbf2413df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39404/0 (socket says 172.21.15.57:39404) 2021-06-25T04:53:27.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf21d9b700 1 -- 172.21.15.57:0/539589216 learned_addr learned my addr 172.21.15.57:0/539589216 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:27.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf22d9d700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf240a6970 0x7fbf2413e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf2259c700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf24140850 0x7fbf240a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf21d9b700 1 -- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf240a6970 msgr2=0x7fbf2413e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf21d9b700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf240a6970 0x7fbf2413e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf21d9b700 1 -- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf24140850 msgr2=0x7fbf240a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf21d9b700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf24140850 0x7fbf240a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf21d9b700 1 -- 172.21.15.57:0/539589216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf240ab530 con 0x7fbf240a6e90 2021-06-25T04:53:27.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf21d9b700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf240a6e90 0x7fbf2413df60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fbf1400c000 tx=0x7fbf14008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf1b7fe700 1 -- 172.21.15.57:0/539589216 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf140135f0 con 0x7fbf240a6e90 2021-06-25T04:53:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf1b7fe700 1 -- 172.21.15.57:0/539589216 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14000e90 con 0x7fbf240a6e90 2021-06-25T04:53:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf28b36700 1 -- 172.21.15.57:0/539589216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf240acb30 con 0x7fbf240a6e90 2021-06-25T04:53:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf1b7fe700 1 -- 172.21.15.57:0/539589216 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf14013940 con 0x7fbf240a6e90 2021-06-25T04:53:27.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf28b36700 1 -- 172.21.15.57:0/539589216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf240a8f60 con 0x7fbf240a6e90 2021-06-25T04:53:27.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.390+0000 7fbf28b36700 1 -- 172.21.15.57:0/539589216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf240abd10 con 0x7fbf240a6e90 2021-06-25T04:53:27.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.394+0000 7fbf1b7fe700 1 -- 172.21.15.57:0/539589216 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbf14013aa0 con 0x7fbf240a6e90 2021-06-25T04:53:27.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.394+0000 7fbf1b7fe700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf080553f0 0x7fbf080578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.394+0000 7fbf1b7fe700 1 -- 172.21.15.57:0/539589216 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbf1406e300 con 0x7fbf240a6e90 2021-06-25T04:53:27.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.394+0000 7fbf2259c700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf080553f0 0x7fbf080578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.394+0000 7fbf2259c700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf080553f0 0x7fbf080578b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fbf0c00c000 tx=0x7fbf0c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.402+0000 7fbf1b7fe700 1 -- 172.21.15.57:0/539589216 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbf14044410 con 0x7fbf240a6e90 2021-06-25T04:53:27.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.530+0000 7fbf28b36700 1 -- 172.21.15.57:0/539589216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf240ab6c0 con 0x7fbf240a6e90 2021-06-25T04:53:27.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf1b7fe700 1 -- 172.21.15.57:0/539589216 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fbf14017090 con 0x7fbf240a6e90 2021-06-25T04:53:27.539 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:27.540 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":77,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:53:27.268860+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:53:25.832629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-06-25T04:53:26.696947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:53:27.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 -- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf080553f0 msgr2=0x7fbf080578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf080553f0 0x7fbf080578b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fbf0c00c000 tx=0x7fbf0c008040).stop 2021-06-25T04:53:27.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 -- 172.21.15.57:0/539589216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf240a6e90 msgr2=0x7fbf2413df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf240a6e90 0x7fbf2413df60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fbf1400c000 tx=0x7fbf14008040).stop 2021-06-25T04:53:27.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 -- 172.21.15.57:0/539589216 shutdown_connections 2021-06-25T04:53:27.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbf080553f0 0x7fbf080578b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf240a6970 0x7fbf2413e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf240a6e90 0x7fbf2413df60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 --2- 172.21.15.57:0/539589216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf24140850 0x7fbf240a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 -- 172.21.15.57:0/539589216 >> 172.21.15.57:0/539589216 conn(0x7fbf2405cce0 msgr2=0x7fbf240b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:27.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 -- 172.21.15.57:0/539589216 shutdown_connections 2021-06-25T04:53:27.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.534+0000 7fbf28b36700 1 -- 172.21.15.57:0/539589216 wait complete. 2021-06-25T04:53:27.552 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:53:27.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.650+0000 7f7d05a01700 1 Processor -- start 2021-06-25T04:53:27.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.650+0000 7f7d05a01700 1 -- start start 2021-06-25T04:53:27.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7d00061850 0x7f7d000b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7d0012b830 0x7f7d001466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d00061c30 con 0x7f7d000b6eb0 2021-06-25T04:53:27.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d000b2c70 con 0x7f7d00061850 2021-06-25T04:53:27.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0012bec0 con 0x7f7d0012b830 2021-06-25T04:53:27.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cfeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7d00061850 0x7f7d000b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cfeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7d00061850 0x7f7d000b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39416/0 (socket says 172.21.15.57:39416) 2021-06-25T04:53:27.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cfeffd700 1 -- 172.21.15.57:0/2199229124 learned_addr learned my addr 172.21.15.57:0/2199229124 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:27.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cff7fe700 1 --2- 172.21.15.57:0/2199229124 >> v2:172.21.15.87:3300/0 conn(0x7f7d0012b830 0x7f7d001466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cfeffd700 1 -- 172.21.15.57:0/2199229124 >> v2:172.21.15.87:3300/0 conn(0x7f7d0012b830 msgr2=0x7f7d001466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:27.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cfeffd700 1 --2- 172.21.15.57:0/2199229124 >> v2:172.21.15.87:3300/0 conn(0x7f7d0012b830 0x7f7d001466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cfeffd700 1 -- 172.21.15.57:0/2199229124 >> v1:172.21.15.87:6789/0 conn(0x7f7d000b6eb0 legacy=0x7f7d0012b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cfeffd700 1 -- 172.21.15.57:0/2199229124 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0012c160 con 0x7f7d00061850 2021-06-25T04:53:27.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cfeffd700 1 --2- 172.21.15.57:0/2199229124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d00061850 0x7f7d000b4130 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f7cf0002f70 tx=0x7f7cf0006eb0).ready entity=mon.0 client_cookie=6622b8cfca9d4b7d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cfdffb700 1 -- 172.21.15.57:0/2199229124 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cf000d5c0 con 0x7f7d00061850 2021-06-25T04:53:27.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cfdffb700 1 -- 172.21.15.57:0/2199229124 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf0000e90 con 0x7f7d00061850 2021-06-25T04:53:27.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7cfdffb700 1 -- 172.21.15.57:0/2199229124 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cf000d950 con 0x7f7d00061850 2021-06-25T04:53:27.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 -- 172.21.15.57:0/2199229124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d00061850 msgr2=0x7f7d000b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 --2- 172.21.15.57:0/2199229124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d00061850 0x7f7d000b4130 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f7cf0002f70 tx=0x7f7cf0006eb0).stop 2021-06-25T04:53:27.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 -- 172.21.15.57:0/2199229124 shutdown_connections 2021-06-25T04:53:27.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 --2- 172.21.15.57:0/2199229124 >> v2:172.21.15.87:3300/0 conn(0x7f7d0012b830 0x7f7d001466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 --2- 172.21.15.57:0/2199229124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d00061850 0x7f7d000b4130 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 -- 172.21.15.57:0/2199229124 >> 172.21.15.57:0/2199229124 conn(0x7f7d00066da0 msgr2=0x7f7d000671b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 -- 172.21.15.57:0/2199229124 shutdown_connections 2021-06-25T04:53:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 -- 172.21.15.57:0/2199229124 wait complete. 2021-06-25T04:53:27.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.654+0000 7f7d05a01700 1 Processor -- start 2021-06-25T04:53:27.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7d05a01700 1 -- start start 2021-06-25T04:53:27.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7d05a01700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d00061850 0x7f7d00143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7d05a01700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d000b6eb0 0x7f7d00141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7d05a01700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0012b830 0x7f7d00143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7d05a01700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d001427a0 con 0x7f7d000b6eb0 2021-06-25T04:53:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7d05a01700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000b9b40 con 0x7f7d0012b830 2021-06-25T04:53:27.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7d05a01700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d00142990 con 0x7f7d00061850 2021-06-25T04:53:27.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cfe7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d000b6eb0 0x7f7d00141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cfe7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d000b6eb0 0x7f7d00141fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39420/0 (socket says 172.21.15.57:39420) 2021-06-25T04:53:27.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cfe7fc700 1 -- 172.21.15.57:0/616518398 learned_addr learned my addr 172.21.15.57:0/616518398 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cfeffd700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d00061850 0x7f7d00143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cff7fe700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0012b830 0x7f7d00143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cfe7fc700 1 -- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d00061850 msgr2=0x7f7d00143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cfe7fc700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d00061850 0x7f7d00143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cfe7fc700 1 -- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0012b830 msgr2=0x7f7d00143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cfe7fc700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0012b830 0x7f7d00143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cfe7fc700 1 -- 172.21.15.57:0/616518398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf000b1e0 con 0x7f7d000b6eb0 2021-06-25T04:53:27.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cff7fe700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0012b830 0x7f7d00143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:27.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cfeffd700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d00061850 0x7f7d00143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:27.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cfe7fc700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d000b6eb0 0x7f7d00141fe0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f7d000b6c70 tx=0x7f7ce8007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cf7fff700 1 -- 172.21.15.57:0/616518398 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ce800ce00 con 0x7f7d000b6eb0 2021-06-25T04:53:27.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cf7fff700 1 -- 172.21.15.57:0/616518398 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce8007240 con 0x7f7d000b6eb0 2021-06-25T04:53:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7d05a01700 1 -- 172.21.15.57:0/616518398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d00142c30 con 0x7f7d000b6eb0 2021-06-25T04:53:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7cf7fff700 1 -- 172.21.15.57:0/616518398 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ce8006700 con 0x7f7d000b6eb0 2021-06-25T04:53:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7d05a01700 1 -- 172.21.15.57:0/616518398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d000b9880 con 0x7f7d000b6eb0 2021-06-25T04:53:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.658+0000 7f7d05a01700 1 -- 172.21.15.57:0/616518398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d00143fd0 con 0x7f7d000b6eb0 2021-06-25T04:53:27.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.662+0000 7f7cf7fff700 1 -- 172.21.15.57:0/616518398 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7ce8006860 con 0x7f7d000b6eb0 2021-06-25T04:53:27.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.662+0000 7f7cf7fff700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ce40554e0 0x7f7ce40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.662+0000 7f7cf7fff700 1 -- 172.21.15.57:0/616518398 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7ce806d9d0 con 0x7f7d000b6eb0 2021-06-25T04:53:27.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.662+0000 7f7cfeffd700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ce40554e0 0x7f7ce40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.662+0000 7f7cfeffd700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ce40554e0 0x7f7ce40579a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f7cf0019000 tx=0x7f7cf0015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.666+0000 7f7cf7fff700 1 -- 172.21.15.57:0/616518398 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7ce8043ae0 con 0x7f7d000b6eb0 2021-06-25T04:53:27.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.790+0000 7f7d05a01700 1 -- 172.21.15.57:0/616518398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d00057310 con 0x7f7d000b6eb0 2021-06-25T04:53:27.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7cf7fff700 1 -- 172.21.15.57:0/616518398 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f7ce8047100 con 0x7f7d000b6eb0 2021-06-25T04:53:27.799 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:27.799 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":77,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:53:27.268860+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:53:25.832629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-06-25T04:53:26.696947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:53:27.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 -- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ce40554e0 msgr2=0x7f7ce40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ce40554e0 0x7f7ce40579a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f7cf0019000 tx=0x7f7cf0015000).stop 2021-06-25T04:53:27.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 -- 172.21.15.57:0/616518398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d000b6eb0 msgr2=0x7f7d00141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d000b6eb0 0x7f7d00141fe0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f7d000b6c70 tx=0x7f7ce8007be0).stop 2021-06-25T04:53:27.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 -- 172.21.15.57:0/616518398 shutdown_connections 2021-06-25T04:53:27.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7ce40554e0 0x7f7ce40579a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0012b830 0x7f7d00143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d000b6eb0 0x7f7d00141fe0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 --2- 172.21.15.57:0/616518398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d00061850 0x7f7d00143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 -- 172.21.15.57:0/616518398 >> 172.21.15.57:0/616518398 conn(0x7f7d00066da0 msgr2=0x7f7d00144480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:27.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 -- 172.21.15.57:0/616518398 shutdown_connections 2021-06-25T04:53:27.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.794+0000 7f7d05a01700 1 -- 172.21.15.57:0/616518398 wait complete. 2021-06-25T04:53:27.815 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:53:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.918+0000 7f8d257a6700 1 Processor -- start 2021-06-25T04:53:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.918+0000 7f8d257a6700 1 -- start start 2021-06-25T04:53:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d257a6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d200b2fc0 0x7f8d20060ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d257a6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d200652f0 con 0x7f8d20060fc0 2021-06-25T04:53:27.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d257a6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d200b33a0 con 0x7f8d200b2560 2021-06-25T04:53:27.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d257a6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d20061fc0 con 0x7f8d200b2fc0 2021-06-25T04:53:27.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d24fa5700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8d20060fc0 0x7f8d20066bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56648/0 (socket says 172.21.15.57:56648) 2021-06-25T04:53:27.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d24fa5700 1 -- 172.21.15.57:0/2533579350 learned_addr learned my addr 172.21.15.57:0/2533579350 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:27.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1ffff700 1 --2- 172.21.15.57:0/2533579350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d200b2fc0 0x7f8d20060ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1effd700 1 -- 172.21.15.57:0/2533579350 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602682048 0 0) 0x7f8d200652f0 con 0x7f8d20060fc0 2021-06-25T04:53:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1effd700 1 -- 172.21.15.57:0/2533579350 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d0c003260 con 0x7f8d20060fc0 2021-06-25T04:53:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1effd700 1 -- 172.21.15.57:0/2533579350 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149992567 0 0) 0x7f8d200b33a0 con 0x7f8d200b2560 2021-06-25T04:53:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1effd700 1 -- 172.21.15.57:0/2533579350 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d200652f0 con 0x7f8d200b2560 2021-06-25T04:53:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1ffff700 1 -- 172.21.15.57:0/2533579350 >> v1:172.21.15.87:6789/0 conn(0x7f8d200b2560 legacy=0x7f8d200664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1ffff700 1 -- 172.21.15.57:0/2533579350 >> v1:172.21.15.57:6789/0 conn(0x7f8d20060fc0 legacy=0x7f8d20066bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1effd700 1 -- 172.21.15.57:0/2533579350 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1061064210 0 0) 0x7f8d0c003260 con 0x7f8d20060fc0 2021-06-25T04:53:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1ffff700 1 -- 172.21.15.57:0/2533579350 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2005fa20 con 0x7f8d200b2fc0 2021-06-25T04:53:27.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1ffff700 1 --2- 172.21.15.57:0/2533579350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d200b2fc0 0x7f8d20060ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8d18001490 tx=0x7f8d10006df0).ready entity=mon.2 client_cookie=8745fecfeba4bd5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1effd700 1 -- 172.21.15.57:0/2533579350 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d180019e0 con 0x7f8d200b2fc0 2021-06-25T04:53:27.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1effd700 1 -- 172.21.15.57:0/2533579350 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d10000e90 con 0x7f8d200b2fc0 2021-06-25T04:53:27.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d257a6700 1 -- 172.21.15.57:0/2533579350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d200b2fc0 msgr2=0x7f8d20060ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d1effd700 1 -- 172.21.15.57:0/2533579350 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d10012460 con 0x7f8d200b2fc0 2021-06-25T04:53:27.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d257a6700 1 --2- 172.21.15.57:0/2533579350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d200b2fc0 0x7f8d20060ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8d18001490 tx=0x7f8d10006df0).stop 2021-06-25T04:53:27.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d257a6700 1 -- 172.21.15.57:0/2533579350 shutdown_connections 2021-06-25T04:53:27.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d257a6700 1 --2- 172.21.15.57:0/2533579350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d200b2fc0 0x7f8d20060ad0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d257a6700 1 -- 172.21.15.57:0/2533579350 >> 172.21.15.57:0/2533579350 conn(0x7f8d200636a0 msgr2=0x7f8d20063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:27.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d257a6700 1 -- 172.21.15.57:0/2533579350 shutdown_connections 2021-06-25T04:53:27.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.922+0000 7f8d257a6700 1 -- 172.21.15.57:0/2533579350 wait complete. 2021-06-25T04:53:27.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.926+0000 7f8d257a6700 1 Processor -- start 2021-06-25T04:53:27.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.926+0000 7f8d257a6700 1 -- start start 2021-06-25T04:53:27.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.926+0000 7f8d257a6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d20060fc0 0x7f8d200acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.926+0000 7f8d257a6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d200b2560 0x7f8d200b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.926+0000 7f8d257a6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d200b2fc0 0x7f8d201523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.926+0000 7f8d257a6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d20151d20 con 0x7f8d200b2fc0 2021-06-25T04:53:27.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.926+0000 7f8d257a6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d200b0840 con 0x7f8d20060fc0 2021-06-25T04:53:27.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.926+0000 7f8d257a6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d200ac050 con 0x7f8d200b2560 2021-06-25T04:53:27.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d24fa5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d200b2fc0 0x7f8d201523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d24fa5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d200b2fc0 0x7f8d201523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39436/0 (socket says 172.21.15.57:39436) 2021-06-25T04:53:27.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d24fa5700 1 -- 172.21.15.57:0/3285222477 learned_addr learned my addr 172.21.15.57:0/3285222477 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:27.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d1f7fe700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d200b2560 0x7f8d200b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d1ffff700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d20060fc0 0x7f8d200acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d24fa5700 1 -- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d200b2560 msgr2=0x7f8d200b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d24fa5700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d200b2560 0x7f8d200b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d24fa5700 1 -- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d20060fc0 msgr2=0x7f8d200acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:27.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d24fa5700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d20060fc0 0x7f8d200acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:27.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d24fa5700 1 -- 172.21.15.57:0/3285222477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1000b180 con 0x7f8d200b2fc0 2021-06-25T04:53:27.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d24fa5700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d200b2fc0 0x7f8d201523b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f8d18001360 tx=0x7f8d18001cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d1d7fa700 1 -- 172.21.15.57:0/3285222477 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d18004ab0 con 0x7f8d200b2fc0 2021-06-25T04:53:27.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d1d7fa700 1 -- 172.21.15.57:0/3285222477 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d18004c10 con 0x7f8d200b2fc0 2021-06-25T04:53:27.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d257a6700 1 -- 172.21.15.57:0/3285222477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d200ac2f0 con 0x7f8d200b2fc0 2021-06-25T04:53:27.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d1d7fa700 1 -- 172.21.15.57:0/3285222477 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d18007170 con 0x7f8d200b2fc0 2021-06-25T04:53:27.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d257a6700 1 -- 172.21.15.57:0/3285222477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d20151f10 con 0x7f8d200b2fc0 2021-06-25T04:53:27.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d257a6700 1 -- 172.21.15.57:0/3285222477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d201520d0 con 0x7f8d200b2fc0 2021-06-25T04:53:27.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d1d7fa700 1 -- 172.21.15.57:0/3285222477 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8d180072d0 con 0x7f8d200b2fc0 2021-06-25T04:53:27.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.930+0000 7f8d1d7fa700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d000554e0 0x7f8d000579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:27.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.934+0000 7f8d1d7fa700 1 -- 172.21.15.57:0/3285222477 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8d1806dc20 con 0x7f8d200b2fc0 2021-06-25T04:53:27.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.934+0000 7f8d1ffff700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d000554e0 0x7f8d000579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:27.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.934+0000 7f8d1ffff700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d000554e0 0x7f8d000579a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f8d10019000 tx=0x7f8d10014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:27.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:27.942+0000 7f8d1d7fa700 1 -- 172.21.15.57:0/3285222477 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8d18043dd0 con 0x7f8d200b2fc0 2021-06-25T04:53:28.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.110+0000 7f8d257a6700 1 -- 172.21.15.57:0/3285222477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8d20057310 con 0x7f8d200b2fc0 2021-06-25T04:53:28.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.274+0000 7f8d1d7fa700 1 -- 172.21.15.57:0/3285222477 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8d180473f0 con 0x7f8d200b2fc0 2021-06-25T04:53:28.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 -- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d000554e0 msgr2=0x7f8d000579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d000554e0 0x7f8d000579a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f8d10019000 tx=0x7f8d10014000).stop 2021-06-25T04:53:28.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 -- 172.21.15.57:0/3285222477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d200b2fc0 msgr2=0x7f8d201523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d200b2fc0 0x7f8d201523b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f8d18001360 tx=0x7f8d18001cf0).stop 2021-06-25T04:53:28.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 -- 172.21.15.57:0/3285222477 shutdown_connections 2021-06-25T04:53:28.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8d000554e0 0x7f8d000579a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d200b2fc0 0x7f8d201523b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d200b2560 0x7f8d200b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 --2- 172.21.15.57:0/3285222477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d20060fc0 0x7f8d200acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 -- 172.21.15.57:0/3285222477 >> 172.21.15.57:0/3285222477 conn(0x7f8d200636a0 msgr2=0x7f8d200646f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:28.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 -- 172.21.15.57:0/3285222477 shutdown_connections 2021-06-25T04:53:28.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.278+0000 7f8d257a6700 1 -- 172.21.15.57:0/3285222477 wait complete. 2021-06-25T04:53:28.299 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:28.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb9af7700 1 Processor -- start 2021-06-25T04:53:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb9af7700 1 -- start start 2021-06-25T04:53:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb9af7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6eb40b96a0 0x7f6eb40aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb9af7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6eb413ffb0 0x7f6eb4140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb9af7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40674c0 con 0x7f6eb40670e0 2021-06-25T04:53:28.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb9af7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb4143040 con 0x7f6eb413ffb0 2021-06-25T04:53:28.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb9af7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40af490 con 0x7f6eb40b96a0 2021-06-25T04:53:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6eb413ffb0 0x7f6eb4140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb37fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6eb40670e0 0x7f6eb4143970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56660/0 (socket says 172.21.15.57:56660) 2021-06-25T04:53:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb37fe700 1 -- 172.21.15.57:0/697331833 learned_addr learned my addr 172.21.15.57:0/697331833 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb2ffd700 1 --2- 172.21.15.57:0/697331833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6eb40b96a0 0x7f6eb40aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb3fff700 1 -- 172.21.15.57:0/697331833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6eb40b96a0 msgr2=0x7f6eb40aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:28.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb3fff700 1 --2- 172.21.15.57:0/697331833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6eb40b96a0 0x7f6eb40aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb3fff700 1 -- 172.21.15.57:0/697331833 >> v1:172.21.15.57:6789/0 conn(0x7f6eb40670e0 legacy=0x7f6eb4143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb3fff700 1 -- 172.21.15.57:0/697331833 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb4143230 con 0x7f6eb413ffb0 2021-06-25T04:53:28.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb27fc700 1 -- 172.21.15.57:0/697331833 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971973667 0 0) 0x7f6eb40674c0 con 0x7f6eb40670e0 2021-06-25T04:53:28.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb3fff700 1 --2- 172.21.15.57:0/697331833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eb413ffb0 0x7f6eb4140440 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f6eac002f70 tx=0x7f6eac006df0).ready entity=mon.0 client_cookie=fa7a61ee0780ebdc server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:28.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb27fc700 1 -- 172.21.15.57:0/697331833 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eac00d570 con 0x7f6eb413ffb0 2021-06-25T04:53:28.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb27fc700 1 -- 172.21.15.57:0/697331833 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac000e90 con 0x7f6eb413ffb0 2021-06-25T04:53:28.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb27fc700 1 -- 172.21.15.57:0/697331833 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eac00d8c0 con 0x7f6eb413ffb0 2021-06-25T04:53:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb9af7700 1 -- 172.21.15.57:0/697331833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eb413ffb0 msgr2=0x7f6eb4140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.406+0000 7f6eb9af7700 1 --2- 172.21.15.57:0/697331833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eb413ffb0 0x7f6eb4140440 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f6eac002f70 tx=0x7f6eac006df0).stop 2021-06-25T04:53:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 -- 172.21.15.57:0/697331833 shutdown_connections 2021-06-25T04:53:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 --2- 172.21.15.57:0/697331833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6eb40b96a0 0x7f6eb40aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 --2- 172.21.15.57:0/697331833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eb413ffb0 0x7f6eb4140440 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 -- 172.21.15.57:0/697331833 >> 172.21.15.57:0/697331833 conn(0x7f6eb405f9b0 msgr2=0x7f6eb4061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 -- 172.21.15.57:0/697331833 shutdown_connections 2021-06-25T04:53:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 -- 172.21.15.57:0/697331833 wait complete. 2021-06-25T04:53:28.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 Processor -- start 2021-06-25T04:53:28.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 -- start start 2021-06-25T04:53:28.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6eb40670e0 0x7f6eb40b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eb40b96a0 0x7f6eb4151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6eb413ffb0 0x7f6eb4152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4145ef0 con 0x7f6eb40b96a0 2021-06-25T04:53:28.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40b2050 con 0x7f6eb40670e0 2021-06-25T04:53:28.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40b0660 con 0x7f6eb413ffb0 2021-06-25T04:53:28.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eb40b96a0 0x7f6eb4151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eb40b96a0 0x7f6eb4151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39448/0 (socket says 172.21.15.57:39448) 2021-06-25T04:53:28.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb2ffd700 1 -- 172.21.15.57:0/2327876878 learned_addr learned my addr 172.21.15.57:0/2327876878 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:28.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb37fe700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6eb40670e0 0x7f6eb40b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb3fff700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6eb413ffb0 0x7f6eb4152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb2ffd700 1 -- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6eb413ffb0 msgr2=0x7f6eb4152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb2ffd700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6eb413ffb0 0x7f6eb4152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb2ffd700 1 -- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6eb40670e0 msgr2=0x7f6eb40b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb2ffd700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6eb40670e0 0x7f6eb40b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb2ffd700 1 -- 172.21.15.57:0/2327876878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac00b180 con 0x7f6eb40b96a0 2021-06-25T04:53:28.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb2ffd700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eb40b96a0 0x7f6eb4151fa0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f6e9c00c000 tx=0x7f6e9c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:28.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb0ff9700 1 -- 172.21.15.57:0/2327876878 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e9c00c6a0 con 0x7f6eb40b96a0 2021-06-25T04:53:28.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb0ff9700 1 -- 172.21.15.57:0/2327876878 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c00c800 con 0x7f6eb40b96a0 2021-06-25T04:53:28.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 -- 172.21.15.57:0/2327876878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb40b1910 con 0x7f6eb40b96a0 2021-06-25T04:53:28.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb0ff9700 1 -- 172.21.15.57:0/2327876878 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e9c00cb60 con 0x7f6eb40b96a0 2021-06-25T04:53:28.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.410+0000 7f6eb9af7700 1 -- 172.21.15.57:0/2327876878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4152980 con 0x7f6eb40b96a0 2021-06-25T04:53:28.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.414+0000 7f6eb9af7700 1 -- 172.21.15.57:0/2327876878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb4057310 con 0x7f6eb40b96a0 2021-06-25T04:53:28.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.414+0000 7f6eb0ff9700 1 -- 172.21.15.57:0/2327876878 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6e9c022070 con 0x7f6eb40b96a0 2021-06-25T04:53:28.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.414+0000 7f6eb0ff9700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e980554e0 0x7f6e980579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.414+0000 7f6eb0ff9700 1 -- 172.21.15.57:0/2327876878 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6e9c06e500 con 0x7f6eb40b96a0 2021-06-25T04:53:28.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.414+0000 7f6eb37fe700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e980554e0 0x7f6e980579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.414+0000 7f6eb37fe700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e980554e0 0x7f6e980579a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f6ea400d000 tx=0x7f6ea4007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:28.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.418+0000 7f6eb0ff9700 1 -- 172.21.15.57:0/2327876878 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6e9c0446b0 con 0x7f6eb40b96a0 2021-06-25T04:53:28.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.586+0000 7f6eb9af7700 1 -- 172.21.15.57:0/2327876878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6eb40698a0 con 0x7f6eb40b96a0 2021-06-25T04:53:28.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.586+0000 7f6eb0ff9700 1 -- 172.21.15.57:0/2327876878 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f6e9c047cd0 con 0x7f6eb40b96a0 2021-06-25T04:53:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:28.593 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2942430957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2942430957},{"type":"v1","addr":"172.21.15.87:6835","nonce":2942430957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34},{"gid":6184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/4012056699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4012056699},{"type":"v1","addr":"172.21.15.57:6833","nonce":4012056699}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:53:27.269151+0000","modified":"2021-06-25T04:53:28.272583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2725183825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2725183825},{"type":"v1","addr":"172.21.15.57:6835","nonce":2725183825}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-06-25T04:53:28.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 -- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e980554e0 msgr2=0x7f6e980579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e980554e0 0x7f6e980579a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f6ea400d000 tx=0x7f6ea4007a00).stop 2021-06-25T04:53:28.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 -- 172.21.15.57:0/2327876878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eb40b96a0 msgr2=0x7f6eb4151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eb40b96a0 0x7f6eb4151fa0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f6e9c00c000 tx=0x7f6e9c0091d0).stop 2021-06-25T04:53:28.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 -- 172.21.15.57:0/2327876878 shutdown_connections 2021-06-25T04:53:28.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6e980554e0 0x7f6e980579a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6eb413ffb0 0x7f6eb4152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eb40b96a0 0x7f6eb4151fa0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 --2- 172.21.15.57:0/2327876878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6eb40670e0 0x7f6eb40b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 -- 172.21.15.57:0/2327876878 >> 172.21.15.57:0/2327876878 conn(0x7f6eb405f9b0 msgr2=0x7f6eb405bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:28.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 -- 172.21.15.57:0/2327876878 shutdown_connections 2021-06-25T04:53:28.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.590+0000 7f6eb9af7700 1 -- 172.21.15.57:0/2327876878 wait complete. 2021-06-25T04:53:28.598 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2021-06-25T04:53:28.613 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:53:28.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.710+0000 7f2939390700 1 Processor -- start 2021-06-25T04:53:28.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.710+0000 7f2939390700 1 -- start start 2021-06-25T04:53:28.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29340af920 0x7f29340b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340b04b0 0x7f29340b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29340ad560 con 0x7f29340b2570 2021-06-25T04:53:28.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29340af420 con 0x7f29340af920 2021-06-25T04:53:28.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29340ad020 con 0x7f29340b04b0 2021-06-25T04:53:28.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2932ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29340af920 0x7f29340b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2932ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29340af920 0x7f29340b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39454/0 (socket says 172.21.15.57:39454) 2021-06-25T04:53:28.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2932ffd700 1 -- 172.21.15.57:0/2632275573 learned_addr learned my addr 172.21.15.57:0/2632275573 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:28.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f29327fc700 1 --2- 172.21.15.57:0/2632275573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340b04b0 0x7f29340b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2932ffd700 1 -- 172.21.15.57:0/2632275573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340b04b0 msgr2=0x7f29340b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:28.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2932ffd700 1 --2- 172.21.15.57:0/2632275573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340b04b0 0x7f29340b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2932ffd700 1 -- 172.21.15.57:0/2632275573 >> v1:172.21.15.87:6789/0 conn(0x7f29340b2570 legacy=0x7f293405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2932ffd700 1 -- 172.21.15.57:0/2632275573 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340ad2c0 con 0x7f29340af920 2021-06-25T04:53:28.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2932ffd700 1 --2- 172.21.15.57:0/2632275573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340af920 0x7f29340b1b90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f29240032f0 tx=0x7f2924009290).ready entity=mon.0 client_cookie=18ca529532bebacc server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:28.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2931ffb700 1 -- 172.21.15.57:0/2632275573 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f292400b8a0 con 0x7f29340af920 2021-06-25T04:53:28.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2931ffb700 1 -- 172.21.15.57:0/2632275573 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292400ba00 con 0x7f29340af920 2021-06-25T04:53:28.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2931ffb700 1 -- 172.21.15.57:0/2632275573 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f292400bb70 con 0x7f29340af920 2021-06-25T04:53:28.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 -- 172.21.15.57:0/2632275573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340af920 msgr2=0x7f29340b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 --2- 172.21.15.57:0/2632275573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340af920 0x7f29340b1b90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f29240032f0 tx=0x7f2924009290).stop 2021-06-25T04:53:28.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 -- 172.21.15.57:0/2632275573 shutdown_connections 2021-06-25T04:53:28.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 --2- 172.21.15.57:0/2632275573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340b04b0 0x7f29340b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 --2- 172.21.15.57:0/2632275573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340af920 0x7f29340b1b90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 -- 172.21.15.57:0/2632275573 >> 172.21.15.57:0/2632275573 conn(0x7f293405cce0 msgr2=0x7f2934062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:28.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 -- 172.21.15.57:0/2632275573 shutdown_connections 2021-06-25T04:53:28.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.714+0000 7f2939390700 1 -- 172.21.15.57:0/2632275573 wait complete. 2021-06-25T04:53:28.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.718+0000 7f2939390700 1 Processor -- start 2021-06-25T04:53:28.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.718+0000 7f2939390700 1 -- start start 2021-06-25T04:53:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.718+0000 7f2939390700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340af920 0x7f293413a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.718+0000 7f2939390700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340b04b0 0x7f29341521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.718+0000 7f2939390700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29340b2570 0x7f2934156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.718+0000 7f2939390700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293414fef0 con 0x7f29340b04b0 2021-06-25T04:53:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.718+0000 7f2939390700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293409e9f0 con 0x7f29340b2570 2021-06-25T04:53:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.718+0000 7f2939390700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2934155910 con 0x7f29340af920 2021-06-25T04:53:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f29327fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340b04b0 0x7f29341521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2932ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340af920 0x7f293413a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2932ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340af920 0x7f293413a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:50624/0 (socket says 172.21.15.57:50624) 2021-06-25T04:53:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f29327fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340b04b0 0x7f29341521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39462/0 (socket says 172.21.15.57:39462) 2021-06-25T04:53:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2932ffd700 1 -- 172.21.15.57:0/1952382136 learned_addr learned my addr 172.21.15.57:0/1952382136 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f29337fe700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29340b2570 0x7f2934156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2932ffd700 1 -- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29340b2570 msgr2=0x7f2934156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2932ffd700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29340b2570 0x7f2934156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2932ffd700 1 -- 172.21.15.57:0/1952382136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340b04b0 msgr2=0x7f29341521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2932ffd700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340b04b0 0x7f29341521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2932ffd700 1 -- 172.21.15.57:0/1952382136 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2924009530 con 0x7f29340af920 2021-06-25T04:53:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f29327fc700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340b04b0 0x7f29341521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2932ffd700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340af920 0x7f293413a650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f29340a2040 tx=0x7f2924016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f292bfff700 1 -- 172.21.15.57:0/1952382136 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2924011bd0 con 0x7f29340af920 2021-06-25T04:53:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f292bfff700 1 -- 172.21.15.57:0/1952382136 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2924011d30 con 0x7f29340af920 2021-06-25T04:53:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2939390700 1 -- 172.21.15.57:0/1952382136 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2934155bb0 con 0x7f29340af920 2021-06-25T04:53:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f292bfff700 1 -- 172.21.15.57:0/1952382136 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2924011ea0 con 0x7f29340af920 2021-06-25T04:53:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2939390700 1 -- 172.21.15.57:0/1952382136 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293413b240 con 0x7f29340af920 2021-06-25T04:53:28.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f2939390700 1 -- 172.21.15.57:0/1952382136 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2934155720 con 0x7f29340af920 2021-06-25T04:53:28.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.722+0000 7f292bfff700 1 -- 172.21.15.57:0/1952382136 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2924026020 con 0x7f29340af920 2021-06-25T04:53:28.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.726+0000 7f292bfff700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29180554e0 0x7f29180579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:28.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.726+0000 7f292bfff700 1 -- 172.21.15.57:0/1952382136 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f292406ec00 con 0x7f29340af920 2021-06-25T04:53:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.726+0000 7f29327fc700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29180554e0 0x7f29180579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.726+0000 7f29327fc700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29180554e0 0x7f29180579a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f291c00b000 tx=0x7f291c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:28.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.734+0000 7f292bfff700 1 -- 172.21.15.57:0/1952382136 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2924044df0 con 0x7f29340af920 2021-06-25T04:53:28.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.862+0000 7f2939390700 1 -- 172.21.15.57:0/1952382136 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2934057310 con 0x7f29340af920 2021-06-25T04:53:28.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f292bfff700 1 -- 172.21.15.57:0/1952382136 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f2924015020 con 0x7f29340af920 2021-06-25T04:53:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:28.874 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":77,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:53:27.268860+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:53:25.832629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-06-25T04:53:26.696947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:53:28.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f2939390700 1 -- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29180554e0 msgr2=0x7f29180579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f2939390700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29180554e0 0x7f29180579a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f291c00b000 tx=0x7f291c006df0).stop 2021-06-25T04:53:28.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f2939390700 1 -- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340af920 msgr2=0x7f293413a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:28.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f2939390700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340af920 0x7f293413a650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f29340a2040 tx=0x7f2924016000).stop 2021-06-25T04:53:28.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f2939390700 1 -- 172.21.15.57:0/1952382136 shutdown_connections 2021-06-25T04:53:28.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f2939390700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f29180554e0 0x7f29180579a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f2939390700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29340b2570 0x7f2934156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f2939390700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340b04b0 0x7f29341521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f2939390700 1 --2- 172.21.15.57:0/1952382136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29340af920 0x7f293413a650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:28.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f2939390700 1 -- 172.21.15.57:0/1952382136 >> 172.21.15.57:0/1952382136 conn(0x7f293405cce0 msgr2=0x7f29340b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:28.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.866+0000 7f2939390700 1 -- 172.21.15.57:0/1952382136 shutdown_connections 2021-06-25T04:53:28.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.870+0000 7f2939390700 1 -- 172.21.15.57:0/1952382136 wait complete. 2021-06-25T04:53:28.888 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:53:29.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.994+0000 7faf7f776700 1 Processor -- start 2021-06-25T04:53:29.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.994+0000 7faf7f776700 1 -- start start 2021-06-25T04:53:29.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.994+0000 7faf7f776700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf780b6540 0x7faf780b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.994+0000 7faf7f776700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf78144070 con 0x7faf780b6920 2021-06-25T04:53:29.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.994+0000 7faf7f776700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf78143b30 con 0x7faf780b4380 2021-06-25T04:53:29.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.994+0000 7faf7f776700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf78143dd0 con 0x7faf780b6540 2021-06-25T04:53:29.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.994+0000 7faf7d512700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf780b6540 0x7faf780b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.994+0000 7faf7dd13700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faf780b6920 0x7faf7812b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56688/0 (socket says 172.21.15.57:56688) 2021-06-25T04:53:29.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.994+0000 7faf7dd13700 1 -- 172.21.15.57:0/2581580655 learned_addr learned my addr 172.21.15.57:0/2581580655 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7d512700 1 -- 172.21.15.57:0/2581580655 >> v1:172.21.15.87:6789/0 conn(0x7faf780b4380 legacy=0x7faf78061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7d512700 1 -- 172.21.15.57:0/2581580655 >> v1:172.21.15.57:6789/0 conn(0x7faf780b6920 legacy=0x7faf7812b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7d512700 1 -- 172.21.15.57:0/2581580655 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf780615b0 con 0x7faf780b6540 2021-06-25T04:53:29.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7d512700 1 --2- 172.21.15.57:0/2581580655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf780b6540 0x7faf780b5bb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7faf781430e0 tx=0x7faf68006df0).ready entity=mon.0 client_cookie=7d2848664ab329c1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:29.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf6ffff700 1 -- 172.21.15.57:0/2581580655 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf6800d610 con 0x7faf780b6540 2021-06-25T04:53:29.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf6ffff700 1 -- 172.21.15.57:0/2581580655 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf68000e90 con 0x7faf780b6540 2021-06-25T04:53:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 -- 172.21.15.57:0/2581580655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf780b6540 msgr2=0x7faf780b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf6ffff700 1 -- 172.21.15.57:0/2581580655 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf6800d960 con 0x7faf780b6540 2021-06-25T04:53:29.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 --2- 172.21.15.57:0/2581580655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf780b6540 0x7faf780b5bb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7faf781430e0 tx=0x7faf68006df0).stop 2021-06-25T04:53:29.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 -- 172.21.15.57:0/2581580655 shutdown_connections 2021-06-25T04:53:29.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 --2- 172.21.15.57:0/2581580655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf780b6540 0x7faf780b5bb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 -- 172.21.15.57:0/2581580655 >> 172.21.15.57:0/2581580655 conn(0x7faf7805c450 msgr2=0x7faf7805c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:29.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 -- 172.21.15.57:0/2581580655 shutdown_connections 2021-06-25T04:53:29.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 -- 172.21.15.57:0/2581580655 wait complete. 2021-06-25T04:53:29.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 Processor -- start 2021-06-25T04:53:29.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 -- start start 2021-06-25T04:53:29.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf780b4380 0x7faf7812a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf780b6540 0x7faf780b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf780b6920 0x7faf7813f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7812abd0 con 0x7faf780b6920 2021-06-25T04:53:29.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7812b560 con 0x7faf780b4380 2021-06-25T04:53:29.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:28.998+0000 7faf7f776700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf780b28e0 con 0x7faf780b6540 2021-06-25T04:53:29.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7dd13700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf780b6920 0x7faf7813f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7dd13700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf780b6920 0x7faf7813f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39478/0 (socket says 172.21.15.57:39478) 2021-06-25T04:53:29.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7dd13700 1 -- 172.21.15.57:0/3326231722 learned_addr learned my addr 172.21.15.57:0/3326231722 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:29.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7d512700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf780b4380 0x7faf7812a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7cd11700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf780b6540 0x7faf780b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7dd13700 1 -- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf780b6540 msgr2=0x7faf780b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7dd13700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf780b6540 0x7faf780b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7dd13700 1 -- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf780b4380 msgr2=0x7faf7812a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7dd13700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf780b4380 0x7faf7812a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7dd13700 1 -- 172.21.15.57:0/3326231722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6800b180 con 0x7faf780b6920 2021-06-25T04:53:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7cd11700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf780b6540 0x7faf780b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7dd13700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf780b6920 0x7faf7813f6d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7faf780b1c40 tx=0x7faf70007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf6e7fc700 1 -- 172.21.15.57:0/3326231722 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf70005ba0 con 0x7faf780b6920 2021-06-25T04:53:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf6e7fc700 1 -- 172.21.15.57:0/3326231722 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf70005d00 con 0x7faf780b6920 2021-06-25T04:53:29.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7f776700 1 -- 172.21.15.57:0/3326231722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf780b3050 con 0x7faf780b6920 2021-06-25T04:53:29.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf6e7fc700 1 -- 172.21.15.57:0/3326231722 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf700072c0 con 0x7faf780b6920 2021-06-25T04:53:29.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7f776700 1 -- 172.21.15.57:0/3326231722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7813fbc0 con 0x7faf780b6920 2021-06-25T04:53:29.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf6e7fc700 1 -- 172.21.15.57:0/3326231722 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7faf70010070 con 0x7faf780b6920 2021-06-25T04:53:29.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7f776700 1 -- 172.21.15.57:0/3326231722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7813fe10 con 0x7faf780b6920 2021-06-25T04:53:29.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf6e7fc700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faf60055340 0x7faf60057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf6e7fc700 1 -- 172.21.15.57:0/3326231722 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7faf7006d850 con 0x7faf780b6920 2021-06-25T04:53:29.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.002+0000 7faf7d512700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faf60055340 0x7faf60057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.006+0000 7faf7d512700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faf60055340 0x7faf60057800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7faf6801b000 tx=0x7faf68015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:29.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.014+0000 7faf6e7fc700 1 -- 172.21.15.57:0/3326231722 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7faf70043930 con 0x7faf780b6920 2021-06-25T04:53:29.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.182+0000 7faf7f776700 1 -- 172.21.15.57:0/3326231722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7faf78057310 con 0x7faf780b6920 2021-06-25T04:53:29.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.190+0000 7faf6e7fc700 1 -- 172.21.15.57:0/3326231722 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7faf7006be60 con 0x7faf780b6920 2021-06-25T04:53:29.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 -- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faf60055340 msgr2=0x7faf60057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faf60055340 0x7faf60057800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7faf6801b000 tx=0x7faf68015000).stop 2021-06-25T04:53:29.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 -- 172.21.15.57:0/3326231722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf780b6920 msgr2=0x7faf7813f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf780b6920 0x7faf7813f6d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7faf780b1c40 tx=0x7faf70007f90).stop 2021-06-25T04:53:29.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 -- 172.21.15.57:0/3326231722 shutdown_connections 2021-06-25T04:53:29.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faf60055340 0x7faf60057800 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf780b6920 0x7faf7813f6d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf780b6540 0x7faf780b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 --2- 172.21.15.57:0/3326231722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf780b4380 0x7faf7812a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 -- 172.21.15.57:0/3326231722 >> 172.21.15.57:0/3326231722 conn(0x7faf7805c450 msgr2=0x7faf781285e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:29.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 -- 172.21.15.57:0/3326231722 shutdown_connections 2021-06-25T04:53:29.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.194+0000 7faf7f776700 1 -- 172.21.15.57:0/3326231722 wait complete. 2021-06-25T04:53:29.203 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:53:29.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:53:29.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe76e198700 1 Processor -- start 2021-06-25T04:53:29.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe76e198700 1 -- start start 2021-06-25T04:53:29.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe76e198700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe7680b6540 0x7fe7680b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe76e198700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7680b6920 0x7fe76812b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe76e198700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe768144070 con 0x7fe7680b4380 2021-06-25T04:53:29.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe76e198700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe768143b30 con 0x7fe7680b6920 2021-06-25T04:53:29.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe76e198700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe768143dd0 con 0x7fe7680b6540 2021-06-25T04:53:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe767fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7680b6920 0x7fe76812b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe767fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7680b6920 0x7fe76812b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39486/0 (socket says 172.21.15.57:39486) 2021-06-25T04:53:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe767fff700 1 -- 172.21.15.57:0/475935748 learned_addr learned my addr 172.21.15.57:0/475935748 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe7677fe700 1 --2- 172.21.15.57:0/475935748 >> v2:172.21.15.87:3300/0 conn(0x7fe7680b6540 0x7fe7680b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe767fff700 1 -- 172.21.15.57:0/475935748 >> v2:172.21.15.87:3300/0 conn(0x7fe7680b6540 msgr2=0x7fe7680b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe767fff700 1 --2- 172.21.15.57:0/475935748 >> v2:172.21.15.87:3300/0 conn(0x7fe7680b6540 0x7fe7680b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe767fff700 1 -- 172.21.15.57:0/475935748 >> v1:172.21.15.87:6789/0 conn(0x7fe7680b4380 legacy=0x7fe768061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe767fff700 1 -- 172.21.15.57:0/475935748 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7680615b0 con 0x7fe7680b6920 2021-06-25T04:53:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe767fff700 1 --2- 172.21.15.57:0/475935748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7680b6920 0x7fe76812b9c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fe7681430e0 tx=0x7fe760009290).ready entity=mon.0 client_cookie=593d2c209944c507 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe766ffd700 1 -- 172.21.15.57:0/475935748 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe76000b860 con 0x7fe7680b6920 2021-06-25T04:53:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe766ffd700 1 -- 172.21.15.57:0/475935748 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76000b9c0 con 0x7fe7680b6920 2021-06-25T04:53:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe766ffd700 1 -- 172.21.15.57:0/475935748 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe76000bb30 con 0x7fe7680b6920 2021-06-25T04:53:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe76e198700 1 -- 172.21.15.57:0/475935748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7680b6920 msgr2=0x7fe76812b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.322+0000 7fe76e198700 1 --2- 172.21.15.57:0/475935748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7680b6920 0x7fe76812b9c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fe7681430e0 tx=0x7fe760009290).stop 2021-06-25T04:53:29.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 -- 172.21.15.57:0/475935748 shutdown_connections 2021-06-25T04:53:29.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 --2- 172.21.15.57:0/475935748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7680b6920 0x7fe76812b9c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 --2- 172.21.15.57:0/475935748 >> v2:172.21.15.87:3300/0 conn(0x7fe7680b6540 0x7fe7680b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 -- 172.21.15.57:0/475935748 >> 172.21.15.57:0/475935748 conn(0x7fe76805c450 msgr2=0x7fe76805c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 -- 172.21.15.57:0/475935748 shutdown_connections 2021-06-25T04:53:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 -- 172.21.15.57:0/475935748 wait complete. 2021-06-25T04:53:29.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 Processor -- start 2021-06-25T04:53:29.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 -- start start 2021-06-25T04:53:29.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b4380 0x7fe768129cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7680b6540 0x7fe76813b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7680b6920 0x7fe76813bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76812b2d0 con 0x7fe7680b6540 2021-06-25T04:53:29.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76812a4b0 con 0x7fe7680b4380 2021-06-25T04:53:29.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe76e198700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76812a750 con 0x7fe7680b6920 2021-06-25T04:53:29.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe75effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7680b6540 0x7fe76813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe75effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7680b6540 0x7fe76813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39490/0 (socket says 172.21.15.57:39490) 2021-06-25T04:53:29.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.326+0000 7fe75effd700 1 -- 172.21.15.57:0/3555418857 learned_addr learned my addr 172.21.15.57:0/3555418857 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:29.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe767fff700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7680b6920 0x7fe76813bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe7677fe700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b4380 0x7fe768129cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe75effd700 1 -- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7680b6920 msgr2=0x7fe76813bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe75effd700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7680b6920 0x7fe76813bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe75effd700 1 -- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b4380 msgr2=0x7fe768129cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe75effd700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b4380 0x7fe768129cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe75effd700 1 -- 172.21.15.57:0/3555418857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760009530 con 0x7fe7680b6540 2021-06-25T04:53:29.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe75effd700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7680b6540 0x7fe76813b660 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fe7680b1c40 tx=0x7fe750007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:29.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe7657fa700 1 -- 172.21.15.57:0/3555418857 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe750007030 con 0x7fe7680b6540 2021-06-25T04:53:29.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe7657fa700 1 -- 172.21.15.57:0/3555418857 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe750007190 con 0x7fe7680b6540 2021-06-25T04:53:29.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe76e198700 1 -- 172.21.15.57:0/3555418857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7680b2cb0 con 0x7fe7680b6540 2021-06-25T04:53:29.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe7657fa700 1 -- 172.21.15.57:0/3555418857 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe750006510 con 0x7fe7680b6540 2021-06-25T04:53:29.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe76e198700 1 -- 172.21.15.57:0/3555418857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76812a1a0 con 0x7fe7680b6540 2021-06-25T04:53:29.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe76e198700 1 -- 172.21.15.57:0/3555418857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7680b2e40 con 0x7fe7680b6540 2021-06-25T04:53:29.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.330+0000 7fe7657fa700 1 -- 172.21.15.57:0/3555418857 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe750010030 con 0x7fe7680b6540 2021-06-25T04:53:29.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.334+0000 7fe7657fa700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe74c0554e0 0x7fe74c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.334+0000 7fe7657fa700 1 -- 172.21.15.57:0/3555418857 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe75006dc20 con 0x7fe7680b6540 2021-06-25T04:53:29.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.334+0000 7fe7677fe700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe74c0554e0 0x7fe74c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.334+0000 7fe7677fe700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe74c0554e0 0x7fe74c0579a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fe75800b000 tx=0x7fe758006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:29.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.338+0000 7fe7657fa700 1 -- 172.21.15.57:0/3555418857 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe750043cc0 con 0x7fe7680b6540 2021-06-25T04:53:29.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.506+0000 7fe76e198700 1 -- 172.21.15.57:0/3555418857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe768057310 con 0x7fe7680b6540 2021-06-25T04:53:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.514+0000 7fe7657fa700 1 -- 172.21.15.57:0/3555418857 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe7500472e0 con 0x7fe7680b6540 2021-06-25T04:53:29.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 -- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe74c0554e0 msgr2=0x7fe74c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe74c0554e0 0x7fe74c0579a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fe75800b000 tx=0x7fe758006df0).stop 2021-06-25T04:53:29.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 -- 172.21.15.57:0/3555418857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7680b6540 msgr2=0x7fe76813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7680b6540 0x7fe76813b660 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fe7680b1c40 tx=0x7fe750007be0).stop 2021-06-25T04:53:29.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 -- 172.21.15.57:0/3555418857 shutdown_connections 2021-06-25T04:53:29.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe74c0554e0 0x7fe74c0579a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7680b6920 0x7fe76813bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7680b6540 0x7fe76813b660 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 --2- 172.21.15.57:0/3555418857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b4380 0x7fe768129cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 -- 172.21.15.57:0/3555418857 >> 172.21.15.57:0/3555418857 conn(0x7fe76805c450 msgr2=0x7fe768061c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:29.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 -- 172.21.15.57:0/3555418857 shutdown_connections 2021-06-25T04:53:29.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.518+0000 7fe76e198700 1 -- 172.21.15.57:0/3555418857 wait complete. 2021-06-25T04:53:29.527 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:53:29.538 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:29.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b71cd5700 1 Processor -- start 2021-06-25T04:53:29.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b71cd5700 1 -- start start 2021-06-25T04:53:29.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b71cd5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6b6c0b2810 0x7f6b6c0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b71cd5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b6c13c6a0 0x7f6b6c13cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b71cd5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b6c05c450 0x7f6b6c0acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b71cd5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c0b2bf0 con 0x7f6b6c05c450 2021-06-25T04:53:29.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b71cd5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c0b1620 con 0x7f6b6c0b2810 2021-06-25T04:53:29.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b71cd5700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0b18c0 con 0x7f6b6c13c6a0 2021-06-25T04:53:29.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b714d4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b6c05c450 0x7f6b6c0acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b714d4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b6c05c450 0x7f6b6c0acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39500/0 (socket says 172.21.15.57:39500) 2021-06-25T04:53:29.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b714d4700 1 -- 172.21.15.57:0/2981885634 learned_addr learned my addr 172.21.15.57:0/2981885634 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:29.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b70cd3700 1 --2- 172.21.15.57:0/2981885634 >> v2:172.21.15.87:3300/0 conn(0x7f6b6c0b2810 0x7f6b6c0b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b6bfff700 1 --2- 172.21.15.57:0/2981885634 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b6c13c6a0 0x7f6b6c13cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b714d4700 1 -- 172.21.15.57:0/2981885634 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b6c13c6a0 msgr2=0x7f6b6c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:29.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b714d4700 1 --2- 172.21.15.57:0/2981885634 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b6c13c6a0 0x7f6b6c13cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b714d4700 1 -- 172.21.15.57:0/2981885634 >> v2:172.21.15.87:3300/0 conn(0x7f6b6c0b2810 msgr2=0x7f6b6c0b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:29.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b714d4700 1 --2- 172.21.15.57:0/2981885634 >> v2:172.21.15.87:3300/0 conn(0x7f6b6c0b2810 0x7f6b6c0b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b714d4700 1 -- 172.21.15.57:0/2981885634 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c0b1b60 con 0x7f6b6c05c450 2021-06-25T04:53:29.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.634+0000 7f6b70cd3700 1 --2- 172.21.15.57:0/2981885634 >> v2:172.21.15.87:3300/0 conn(0x7f6b6c0b2810 0x7f6b6c0b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:29.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b714d4700 1 --2- 172.21.15.57:0/2981885634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6c05c450 0x7f6b6c0acee0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f6b640032f0 tx=0x7f6b64009290).ready entity=mon.0 client_cookie=f30193f20d2d655a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:29.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b6b7fe700 1 -- 172.21.15.57:0/2981885634 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6400b870 con 0x7f6b6c05c450 2021-06-25T04:53:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b6b7fe700 1 -- 172.21.15.57:0/2981885634 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6400b9d0 con 0x7f6b6c05c450 2021-06-25T04:53:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b6b7fe700 1 -- 172.21.15.57:0/2981885634 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6400bb40 con 0x7f6b6c05c450 2021-06-25T04:53:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2981885634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6c05c450 msgr2=0x7f6b6c0acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b71cd5700 1 --2- 172.21.15.57:0/2981885634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6c05c450 0x7f6b6c0acee0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f6b640032f0 tx=0x7f6b64009290).stop 2021-06-25T04:53:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2981885634 shutdown_connections 2021-06-25T04:53:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b71cd5700 1 --2- 172.21.15.57:0/2981885634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6c05c450 0x7f6b6c0acee0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b71cd5700 1 --2- 172.21.15.57:0/2981885634 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b6c13c6a0 0x7f6b6c13cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b71cd5700 1 --2- 172.21.15.57:0/2981885634 >> v2:172.21.15.87:3300/0 conn(0x7f6b6c0b2810 0x7f6b6c0b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2981885634 >> 172.21.15.57:0/2981885634 conn(0x7f6b6c0611f0 msgr2=0x7f6b6c062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2981885634 shutdown_connections 2021-06-25T04:53:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2981885634 wait complete. 2021-06-25T04:53:29.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b71cd5700 1 Processor -- start 2021-06-25T04:53:29.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.638+0000 7f6b71cd5700 1 -- start start 2021-06-25T04:53:29.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b71cd5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b6c05c450 0x7f6b6c13e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b71cd5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6c0b2810 0x7f6b6c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b71cd5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b6c13c6a0 0x7f6b6c144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b71cd5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c1471c0 con 0x7f6b6c0b2810 2021-06-25T04:53:29.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b71cd5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c147420 con 0x7f6b6c05c450 2021-06-25T04:53:29.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b71cd5700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c1562d0 con 0x7f6b6c13c6a0 2021-06-25T04:53:29.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b6bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6c0b2810 0x7f6b6c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b6bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6c0b2810 0x7f6b6c155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39504/0 (socket says 172.21.15.57:39504) 2021-06-25T04:53:29.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b6bfff700 1 -- 172.21.15.57:0/2014497875 learned_addr learned my addr 172.21.15.57:0/2014497875 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:29.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b70cd3700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b6c05c450 0x7f6b6c13e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b714d4700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b6c13c6a0 0x7f6b6c144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b6bfff700 1 -- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b6c13c6a0 msgr2=0x7f6b6c144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b6bfff700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b6c13c6a0 0x7f6b6c144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b6bfff700 1 -- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b6c05c450 msgr2=0x7f6b6c13e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b6bfff700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b6c05c450 0x7f6b6c13e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b6bfff700 1 -- 172.21.15.57:0/2014497875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b64009530 con 0x7f6b6c0b2810 2021-06-25T04:53:29.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b6bfff700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6c0b2810 0x7f6b6c155a90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f6b540030b0 tx=0x7f6b54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:29.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b69ffb700 1 -- 172.21.15.57:0/2014497875 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b54011780 con 0x7f6b6c0b2810 2021-06-25T04:53:29.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b69ffb700 1 -- 172.21.15.57:0/2014497875 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b540118e0 con 0x7f6b6c0b2810 2021-06-25T04:53:29.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b69ffb700 1 -- 172.21.15.57:0/2014497875 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b54011c40 con 0x7f6b6c0b2810 2021-06-25T04:53:29.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2014497875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c156570 con 0x7f6b6c0b2810 2021-06-25T04:53:29.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.642+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2014497875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c13d900 con 0x7f6b6c0b2810 2021-06-25T04:53:29.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.646+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2014497875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c13e5e0 con 0x7f6b6c0b2810 2021-06-25T04:53:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.646+0000 7f6b69ffb700 1 -- 172.21.15.57:0/2014497875 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6b54012420 con 0x7f6b6c0b2810 2021-06-25T04:53:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.646+0000 7f6b69ffb700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6b50055340 0x7f6b50057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.646+0000 7f6b69ffb700 1 -- 172.21.15.57:0/2014497875 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6b5406dc00 con 0x7f6b6c0b2810 2021-06-25T04:53:29.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.646+0000 7f6b70cd3700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6b50055340 0x7f6b50057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.646+0000 7f6b70cd3700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6b50055340 0x7f6b50057800 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f6b5c00c000 tx=0x7f6b5c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:29.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.654+0000 7f6b69ffb700 1 -- 172.21.15.57:0/2014497875 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6b54073020 con 0x7f6b6c0b2810 2021-06-25T04:53:29.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.814+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2014497875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b6c145160 con 0x7f6b6c0b2810 2021-06-25T04:53:29.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.814+0000 7f6b69ffb700 1 -- 172.21.15.57:0/2014497875 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f6b54043d50 con 0x7f6b6c0b2810 2021-06-25T04:53:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:29.821 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2942430957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2942430957},{"type":"v1","addr":"172.21.15.87:6835","nonce":2942430957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34},{"gid":6184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/4012056699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4012056699},{"type":"v1","addr":"172.21.15.57:6833","nonce":4012056699}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:53:27.269151+0000","modified":"2021-06-25T04:53:28.272583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2725183825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2725183825},{"type":"v1","addr":"172.21.15.57:6835","nonce":2725183825}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-06-25T04:53:29.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6b50055340 msgr2=0x7f6b50057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6b50055340 0x7f6b50057800 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f6b5c00c000 tx=0x7f6b5c008040).stop 2021-06-25T04:53:29.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2014497875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6c0b2810 msgr2=0x7f6b6c155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:29.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6c0b2810 0x7f6b6c155a90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f6b540030b0 tx=0x7f6b54008040).stop 2021-06-25T04:53:29.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2014497875 shutdown_connections 2021-06-25T04:53:29.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6b50055340 0x7f6b50057800 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b6c13c6a0 0x7f6b6c144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6c0b2810 0x7f6b6c155a90 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 --2- 172.21.15.57:0/2014497875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b6c05c450 0x7f6b6c13e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2014497875 >> 172.21.15.57:0/2014497875 conn(0x7f6b6c0611f0 msgr2=0x7f6b6c1390a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2014497875 shutdown_connections 2021-06-25T04:53:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:29.818+0000 7f6b71cd5700 1 -- 172.21.15.57:0/2014497875 wait complete. 2021-06-25T04:53:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2021-06-25T04:53:30.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:53:27.269151+0000', 'modified': '2021-06-25T04:53:28.272583+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6285': {'gid': 6285, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2725183825', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2725183825}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2725183825}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:53:30.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:53:30.138 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:53:30.256 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":6285,"want_state":"up:active","state":"up:active","rank_uptime":2.9727560450000001,"mdsmap_epoch":36,"osdmap_epoch":77,"osdmap_epoch_barrier":77,"uptime":7.2743715550000001} 2021-06-25T04:53:30.256 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 6285, "mdsmap_epoch": 36, "osdmap_epoch": 77, "osdmap_epoch_barrier": 77, "rank_uptime": 2.972756045, "state": "up:active", "uptime": 7.274371555, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:53:30.257 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:53:30.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.354+0000 7fb1d903b700 1 Processor -- start 2021-06-25T04:53:30.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.354+0000 7fb1d903b700 1 -- start start 2021-06-25T04:53:30.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.354+0000 7fb1d903b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1d40b77d0 0x7fb1d4144560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.354+0000 7fb1d903b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb1d40b1130 0x7fb1d4144a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.354+0000 7fb1d903b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d40b3190 con 0x7fb1d4064830 2021-06-25T04:53:30.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.354+0000 7fb1d903b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d40b7bb0 con 0x7fb1d40b1130 2021-06-25T04:53:30.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.354+0000 7fb1d903b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4067580 con 0x7fb1d40b77d0 2021-06-25T04:53:30.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb1d40b1130 0x7fb1d4144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb1d40b1130 0x7fb1d4144a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39510/0 (socket says 172.21.15.57:39510) 2021-06-25T04:53:30.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d259c700 1 -- 172.21.15.57:0/1333602880 learned_addr learned my addr 172.21.15.57:0/1333602880 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:30.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d359e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb1d4064830 0x7fb1d4064c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56732/0 (socket says 172.21.15.57:56732) 2021-06-25T04:53:30.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d2d9d700 1 --2- 172.21.15.57:0/1333602880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1d40b77d0 0x7fb1d4144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d259c700 1 -- 172.21.15.57:0/1333602880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1d40b77d0 msgr2=0x7fb1d4144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:30.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d259c700 1 --2- 172.21.15.57:0/1333602880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1d40b77d0 0x7fb1d4144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d259c700 1 -- 172.21.15.57:0/1333602880 >> v1:172.21.15.57:6789/0 conn(0x7fb1d4064830 legacy=0x7fb1d4064c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d259c700 1 -- 172.21.15.57:0/1333602880 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d40aae30 con 0x7fb1d40b1130 2021-06-25T04:53:30.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d259c700 1 --2- 172.21.15.57:0/1333602880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1d40b1130 0x7fb1d4144a50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fb1c4002f70 tx=0x7fb1c4006eb0).ready entity=mon.0 client_cookie=e40dde8a84e6ef99 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:30.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d1d9b700 1 -- 172.21.15.57:0/1333602880 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c400d570 con 0x7fb1d40b1130 2021-06-25T04:53:30.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d1d9b700 1 -- 172.21.15.57:0/1333602880 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c4000e90 con 0x7fb1d40b1130 2021-06-25T04:53:30.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d1d9b700 1 -- 172.21.15.57:0/1333602880 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c400d900 con 0x7fb1d40b1130 2021-06-25T04:53:30.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d903b700 1 -- 172.21.15.57:0/1333602880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1d40b1130 msgr2=0x7fb1d4144a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d903b700 1 --2- 172.21.15.57:0/1333602880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1d40b1130 0x7fb1d4144a50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fb1c4002f70 tx=0x7fb1c4006eb0).stop 2021-06-25T04:53:30.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d903b700 1 -- 172.21.15.57:0/1333602880 shutdown_connections 2021-06-25T04:53:30.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d903b700 1 --2- 172.21.15.57:0/1333602880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1d40b1130 0x7fb1d4144a50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d903b700 1 --2- 172.21.15.57:0/1333602880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1d40b77d0 0x7fb1d4144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d903b700 1 -- 172.21.15.57:0/1333602880 >> 172.21.15.57:0/1333602880 conn(0x7fb1d405f670 msgr2=0x7fb1d405fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:30.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d903b700 1 -- 172.21.15.57:0/1333602880 shutdown_connections 2021-06-25T04:53:30.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d903b700 1 -- 172.21.15.57:0/1333602880 wait complete. 2021-06-25T04:53:30.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d903b700 1 Processor -- start 2021-06-25T04:53:30.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.358+0000 7fb1d903b700 1 -- start start 2021-06-25T04:53:30.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d903b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1d4064830 0x7fb1d40afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d903b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1d40b1130 0x7fb1d409fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d903b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1d40b77d0 0x7fb1d40a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d903b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40a07e0 con 0x7fb1d40b1130 2021-06-25T04:53:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d903b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4150aa0 con 0x7fb1d40b77d0 2021-06-25T04:53:30.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d903b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40af0d0 con 0x7fb1d4064830 2021-06-25T04:53:30.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1d40b1130 0x7fb1d409fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1d40b1130 0x7fb1d409fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39516/0 (socket says 172.21.15.57:39516) 2021-06-25T04:53:30.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d259c700 1 -- 172.21.15.57:0/524307551 learned_addr learned my addr 172.21.15.57:0/524307551 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:30.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d359e700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1d40b77d0 0x7fb1d40a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d2d9d700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1d4064830 0x7fb1d40afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d259c700 1 -- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1d4064830 msgr2=0x7fb1d40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d259c700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1d4064830 0x7fb1d40afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d259c700 1 -- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1d40b77d0 msgr2=0x7fb1d40a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d259c700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1d40b77d0 0x7fb1d40a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d259c700 1 -- 172.21.15.57:0/524307551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c400b1e0 con 0x7fb1d40b1130 2021-06-25T04:53:30.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d259c700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1d40b1130 0x7fb1d409fe00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fb1d40a0920 tx=0x7fb1c4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:30.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1c3fff700 1 -- 172.21.15.57:0/524307551 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c40116e0 con 0x7fb1d40b1130 2021-06-25T04:53:30.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1c3fff700 1 -- 172.21.15.57:0/524307551 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c4011840 con 0x7fb1d40b1130 2021-06-25T04:53:30.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d903b700 1 -- 172.21.15.57:0/524307551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d4150cd0 con 0x7fb1d40b1130 2021-06-25T04:53:30.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1c3fff700 1 -- 172.21.15.57:0/524307551 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c4011ba0 con 0x7fb1d40b1130 2021-06-25T04:53:30.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d903b700 1 -- 172.21.15.57:0/524307551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d40af370 con 0x7fb1d40b1130 2021-06-25T04:53:30.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.362+0000 7fb1d903b700 1 -- 172.21.15.57:0/524307551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d4150e90 con 0x7fb1d40b1130 2021-06-25T04:53:30.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.366+0000 7fb1c3fff700 1 -- 172.21.15.57:0/524307551 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb1c400f070 con 0x7fb1d40b1130 2021-06-25T04:53:30.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.366+0000 7fb1c3fff700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb1b00554e0 0x7fb1b00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.366+0000 7fb1c3fff700 1 -- 172.21.15.57:0/524307551 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb1c406f550 con 0x7fb1d40b1130 2021-06-25T04:53:30.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.366+0000 7fb1d2d9d700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb1b00554e0 0x7fb1b00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.366+0000 7fb1d2d9d700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb1b00554e0 0x7fb1b00579a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fb1c800b000 tx=0x7fb1c8006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:30.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.370+0000 7fb1c3fff700 1 -- 172.21.15.57:0/524307551 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb1c4045700 con 0x7fb1d40b1130 2021-06-25T04:53:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.498+0000 7fb1d903b700 1 -- 172.21.15.57:0/524307551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1d4057310 con 0x7fb1d40b1130 2021-06-25T04:53:30.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.498+0000 7fb1c3fff700 1 -- 172.21.15.57:0/524307551 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fb1c4048d20 con 0x7fb1d40b1130 2021-06-25T04:53:30.504 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:30.505 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":77,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:53:27.268860+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:53:25.832629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-06-25T04:53:26.696947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:53:30.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.498+0000 7fb1d903b700 1 -- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb1b00554e0 msgr2=0x7fb1b00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.498+0000 7fb1d903b700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb1b00554e0 0x7fb1b00579a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fb1c800b000 tx=0x7fb1c8006df0).stop 2021-06-25T04:53:30.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.502+0000 7fb1d903b700 1 -- 172.21.15.57:0/524307551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1d40b1130 msgr2=0x7fb1d409fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.502+0000 7fb1d903b700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1d40b1130 0x7fb1d409fe00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fb1d40a0920 tx=0x7fb1c4015000).stop 2021-06-25T04:53:30.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.502+0000 7fb1d903b700 1 -- 172.21.15.57:0/524307551 shutdown_connections 2021-06-25T04:53:30.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.502+0000 7fb1d903b700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb1b00554e0 0x7fb1b00579a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.502+0000 7fb1d903b700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1d40b77d0 0x7fb1d40a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.502+0000 7fb1d903b700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1d40b1130 0x7fb1d409fe00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.502+0000 7fb1d903b700 1 --2- 172.21.15.57:0/524307551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1d4064830 0x7fb1d40afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.502+0000 7fb1d903b700 1 -- 172.21.15.57:0/524307551 >> 172.21.15.57:0/524307551 conn(0x7fb1d405f670 msgr2=0x7fb1d40b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.502+0000 7fb1d903b700 1 -- 172.21.15.57:0/524307551 shutdown_connections 2021-06-25T04:53:30.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.502+0000 7fb1d903b700 1 -- 172.21.15.57:0/524307551 wait complete. 2021-06-25T04:53:30.519 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:53:25.832629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:53:26.696947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:53:30.520 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:53:30.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d2724c700 1 Processor -- start 2021-06-25T04:53:30.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d2724c700 1 -- start start 2021-06-25T04:53:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d2724c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5d200612e0 0x7f5d200616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d2724c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d200aecb0 con 0x7f5d200ad580 2021-06-25T04:53:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d2724c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d200b6ee0 con 0x7f5d20140400 2021-06-25T04:53:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d2724c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d200aeee0 con 0x7f5d200612e0 2021-06-25T04:53:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d25a49700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5d200ad580 0x7f5d200b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56744/0 (socket says 172.21.15.57:56744) 2021-06-25T04:53:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d25a49700 1 -- 172.21.15.57:0/399725523 learned_addr learned my addr 172.21.15.57:0/399725523 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d2624a700 1 --2- 172.21.15.57:0/399725523 >> v2:172.21.15.87:3300/0 conn(0x7f5d200612e0 0x7f5d200616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d25248700 1 -- 172.21.15.57:0/399725523 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167281068 0 0) 0x7f5d200aecb0 con 0x7f5d200ad580 2021-06-25T04:53:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d25248700 1 -- 172.21.15.57:0/399725523 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d08003260 con 0x7f5d200ad580 2021-06-25T04:53:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d2624a700 1 -- 172.21.15.57:0/399725523 >> v1:172.21.15.87:6789/0 conn(0x7f5d20140400 legacy=0x7f5d201464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d2624a700 1 -- 172.21.15.57:0/399725523 >> v1:172.21.15.57:6789/0 conn(0x7f5d200ad580 legacy=0x7f5d200b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d25248700 1 -- 172.21.15.57:0/399725523 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1012668792 0 0) 0x7f5d08003260 con 0x7f5d200ad580 2021-06-25T04:53:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d2624a700 1 -- 172.21.15.57:0/399725523 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d200af180 con 0x7f5d200612e0 2021-06-25T04:53:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d2624a700 1 --2- 172.21.15.57:0/399725523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d200612e0 0x7f5d200616c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f5d200aeb60 tx=0x7f5d1c006df0).ready entity=mon.1 client_cookie=6cda0d488bd5a85b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.626+0000 7f5d25248700 1 -- 172.21.15.57:0/399725523 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d10001660 con 0x7f5d200612e0 2021-06-25T04:53:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.630+0000 7f5d25248700 1 -- 172.21.15.57:0/399725523 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c000e90 con 0x7f5d200612e0 2021-06-25T04:53:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.630+0000 7f5d25248700 1 -- 172.21.15.57:0/399725523 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d1c00d4f0 con 0x7f5d200612e0 2021-06-25T04:53:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.630+0000 7f5d2724c700 1 -- 172.21.15.57:0/399725523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d200612e0 msgr2=0x7f5d200616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.630+0000 7f5d2724c700 1 --2- 172.21.15.57:0/399725523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d200612e0 0x7f5d200616c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f5d200aeb60 tx=0x7f5d1c006df0).stop 2021-06-25T04:53:30.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.630+0000 7f5d2724c700 1 -- 172.21.15.57:0/399725523 shutdown_connections 2021-06-25T04:53:30.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.630+0000 7f5d2724c700 1 --2- 172.21.15.57:0/399725523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d200612e0 0x7f5d200616c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.630+0000 7f5d2724c700 1 -- 172.21.15.57:0/399725523 >> 172.21.15.57:0/399725523 conn(0x7f5d20066da0 msgr2=0x7f5d20067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:30.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.630+0000 7f5d2724c700 1 -- 172.21.15.57:0/399725523 shutdown_connections 2021-06-25T04:53:30.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.630+0000 7f5d2724c700 1 -- 172.21.15.57:0/399725523 wait complete. 2021-06-25T04:53:30.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.630+0000 7f5d2724c700 1 Processor -- start 2021-06-25T04:53:30.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.630+0000 7f5d2724c700 1 -- start start 2021-06-25T04:53:30.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d2724c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d200612e0 0x7f5d201464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d2724c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d200ad580 0x7f5d20156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d2724c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d20140400 0x7f5d20152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d2724c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d200afb10 con 0x7f5d20140400 2021-06-25T04:53:30.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d2724c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d200b0580 con 0x7f5d200612e0 2021-06-25T04:53:30.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d2724c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2009ef40 con 0x7f5d200ad580 2021-06-25T04:53:30.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d26a4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d20140400 0x7f5d20152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d26a4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d20140400 0x7f5d20152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39534/0 (socket says 172.21.15.57:39534) 2021-06-25T04:53:30.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d26a4b700 1 -- 172.21.15.57:0/1804719163 learned_addr learned my addr 172.21.15.57:0/1804719163 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:30.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d2624a700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d200612e0 0x7f5d201464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d25a49700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d200ad580 0x7f5d20156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d26a4b700 1 -- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d200ad580 msgr2=0x7f5d20156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d26a4b700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d200ad580 0x7f5d20156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d26a4b700 1 -- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d200612e0 msgr2=0x7f5d201464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d26a4b700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d200612e0 0x7f5d201464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d26a4b700 1 -- 172.21.15.57:0/1804719163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c00b180 con 0x7f5d20140400 2021-06-25T04:53:30.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d25a49700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d200ad580 0x7f5d20156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:30.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d26a4b700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d20140400 0x7f5d20152a50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f5d200af7a0 tx=0x7f5d180013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:30.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d0f7fe700 1 -- 172.21.15.57:0/1804719163 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d18006aa0 con 0x7f5d20140400 2021-06-25T04:53:30.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d0f7fe700 1 -- 172.21.15.57:0/1804719163 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d18006c00 con 0x7f5d20140400 2021-06-25T04:53:30.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d2724c700 1 -- 172.21.15.57:0/1804719163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2009f1e0 con 0x7f5d20140400 2021-06-25T04:53:30.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d0f7fe700 1 -- 172.21.15.57:0/1804719163 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d18007030 con 0x7f5d20140400 2021-06-25T04:53:30.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.634+0000 7f5d2724c700 1 -- 172.21.15.57:0/1804719163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d20156970 con 0x7f5d20140400 2021-06-25T04:53:30.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.638+0000 7f5d2724c700 1 -- 172.21.15.57:0/1804719163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d20057310 con 0x7f5d20140400 2021-06-25T04:53:30.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.638+0000 7f5d0f7fe700 1 -- 172.21.15.57:0/1804719163 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5d18010030 con 0x7f5d20140400 2021-06-25T04:53:30.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.638+0000 7f5d0f7fe700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d00055510 0x7f5d000579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.638+0000 7f5d0f7fe700 1 -- 172.21.15.57:0/1804719163 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5d1806deb0 con 0x7f5d20140400 2021-06-25T04:53:30.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.638+0000 7f5d2624a700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d00055510 0x7f5d000579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.638+0000 7f5d2624a700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d00055510 0x7f5d000579d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f5d1c019000 tx=0x7f5d1c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:30.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.646+0000 7f5d0f7fe700 1 -- 172.21.15.57:0/1804719163 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5d18043ed0 con 0x7f5d20140400 2021-06-25T04:53:30.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.770+0000 7f5d2724c700 1 -- 172.21.15.57:0/1804719163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5d201440f0 con 0x7f5d20140400 2021-06-25T04:53:30.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.770+0000 7f5d0f7fe700 1 -- 172.21.15.57:0/1804719163 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v77) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5d180474f0 con 0x7f5d20140400 2021-06-25T04:53:30.777 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:53:30.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 -- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d00055510 msgr2=0x7f5d000579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d00055510 0x7f5d000579d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f5d1c019000 tx=0x7f5d1c014000).stop 2021-06-25T04:53:30.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 -- 172.21.15.57:0/1804719163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d20140400 msgr2=0x7f5d20152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d20140400 0x7f5d20152a50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f5d200af7a0 tx=0x7f5d180013a0).stop 2021-06-25T04:53:30.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 -- 172.21.15.57:0/1804719163 shutdown_connections 2021-06-25T04:53:30.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5d00055510 0x7f5d000579d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d20140400 0x7f5d20152a50 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d200ad580 0x7f5d20156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 --2- 172.21.15.57:0/1804719163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d200612e0 0x7f5d201464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 -- 172.21.15.57:0/1804719163 >> 172.21.15.57:0/1804719163 conn(0x7f5d20066da0 msgr2=0x7f5d201437f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:30.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 -- 172.21.15.57:0/1804719163 shutdown_connections 2021-06-25T04:53:30.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.774+0000 7f5d2724c700 1 -- 172.21.15.57:0/1804719163 wait complete. 2021-06-25T04:53:30.789 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:53:30.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.894+0000 7fb0bb7aa700 1 Processor -- start 2021-06-25T04:53:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.894+0000 7fb0bb7aa700 1 -- start start 2021-06-25T04:53:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.894+0000 7fb0bb7aa700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b4146910 0x7fb0b41401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.894+0000 7fb0bb7aa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b4143b20 con 0x7fb0b40b4140 2021-06-25T04:53:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.894+0000 7fb0bb7aa700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b4143dc0 con 0x7fb0b40b4650 2021-06-25T04:53:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.894+0000 7fb0bb7aa700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b41474d0 con 0x7fb0b4146910 2021-06-25T04:53:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.894+0000 7fb0b8d45700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb0b40b4140 0x7fb0b41406e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56758/0 (socket says 172.21.15.57:56758) 2021-06-25T04:53:30.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b8d45700 1 -- 172.21.15.57:0/3206297436 learned_addr learned my addr 172.21.15.57:0/3206297436 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:30.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9546700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b4146910 0x7fb0b41401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060855646 0 0) 0x7fb0b4143b20 con 0x7fb0b40b4140 2021-06-25T04:53:30.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb098003260 con 0x7fb0b40b4140 2021-06-25T04:53:30.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053252081 0 0) 0x7fb0b4143dc0 con 0x7fb0b40b4650 2021-06-25T04:53:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b4143b20 con 0x7fb0b40b4650 2021-06-25T04:53:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 688541163 0 0) 0x7fb098003260 con 0x7fb0b40b4140 2021-06-25T04:53:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b4146910 msgr2=0x7fb0b41401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b4146910 0x7fb0b41401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 >> v1:172.21.15.87:6789/0 conn(0x7fb0b40b4650 legacy=0x7fb0b40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b40b0c50 con 0x7fb0b40b4140 2021-06-25T04:53:30.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fb0a4001660 con 0x7fb0b40b4140 2021-06-25T04:53:30.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9546700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b4146910 0x7fb0b41401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:30.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 >> v1:172.21.15.57:6789/0 conn(0x7fb0b40b4140 legacy=0x7fb0b41406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb098003910 0x7fb098003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb098004500 0x7fb098004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b4146910 0x7fb098004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b41474d0 con 0x7fb098003910 2021-06-25T04:53:30.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09800b750 con 0x7fb098004500 2021-06-25T04:53:30.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09800b8e0 con 0x7fb0b4146910 2021-06-25T04:53:30.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9546700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb098003910 0x7fb098003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b8d45700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb098004500 0x7fb098004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9d47700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b4146910 0x7fb098004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9546700 1 -- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b4146910 msgr2=0x7fb098004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:30.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9546700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b4146910 0x7fb098004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9546700 1 -- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb098004500 msgr2=0x7fb098004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:30.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9546700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb098004500 0x7fb098004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9546700 1 -- 172.21.15.57:0/3206297436 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b000b180 con 0x7fb098003910 2021-06-25T04:53:30.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9d47700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b4146910 0x7fb098004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:30.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9546700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb098003910 0x7fb098003cf0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fb0b000c000 tx=0x7fb0b0006df0).ready entity=mon.0 client_cookie=f3fea5b0566902ef server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:30.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0b000e830 con 0x7fb098003910 2021-06-25T04:53:30.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b000e990 con 0x7fb098003910 2021-06-25T04:53:30.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0abfff700 1 -- 172.21.15.57:0/3206297436 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0b000ecf0 con 0x7fb098003910 2021-06-25T04:53:30.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/3206297436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb098003910 msgr2=0x7fb098003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0bb7aa700 1 --2- 172.21.15.57:0/3206297436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb098003910 0x7fb098003cf0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fb0b000c000 tx=0x7fb0b0006df0).stop 2021-06-25T04:53:30.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0b9d47700 1 -- 172.21.15.57:0/3206297436 reap_dead start 2021-06-25T04:53:30.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/3206297436 shutdown_connections 2021-06-25T04:53:30.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/3206297436 >> 172.21.15.57:0/3206297436 conn(0x7fb0b405c450 msgr2=0x7fb0b405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:30.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/3206297436 shutdown_connections 2021-06-25T04:53:30.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.898+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/3206297436 wait complete. 2021-06-25T04:53:30.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.902+0000 7fb0bb7aa700 1 Processor -- start 2021-06-25T04:53:30.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.902+0000 7fb0bb7aa700 1 -- start start 2021-06-25T04:53:30.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0bb7aa700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b40ad8f0 0x7fb0b40aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0bb7aa700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0b41419d0 0x7fb0b4152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0bb7aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0b4155b10 0x7fb0b4155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0bb7aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4152540 con 0x7fb0b4155b10 2021-06-25T04:53:30.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0bb7aa700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40af470 con 0x7fb0b41419d0 2021-06-25T04:53:30.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0bb7aa700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40adcd0 con 0x7fb0b40ad8f0 2021-06-25T04:53:30.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b9d47700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0b4155b10 0x7fb0b4155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b9d47700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0b4155b10 0x7fb0b4155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39554/0 (socket says 172.21.15.57:39554) 2021-06-25T04:53:30.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b9d47700 1 -- 172.21.15.57:0/1965104228 learned_addr learned my addr 172.21.15.57:0/1965104228 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:30.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b9546700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b40ad8f0 0x7fb0b40aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b8d45700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0b41419d0 0x7fb0b4152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b9d47700 1 -- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b40ad8f0 msgr2=0x7fb0b40aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b9d47700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b40ad8f0 0x7fb0b40aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b9d47700 1 -- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0b41419d0 msgr2=0x7fb0b4152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:30.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b9d47700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0b41419d0 0x7fb0b4152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:30.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b9d47700 1 -- 172.21.15.57:0/1965104228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b4142290 con 0x7fb0b4155b10 2021-06-25T04:53:30.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b8d45700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0b41419d0 0x7fb0b4152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:30.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0b9d47700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0b4155b10 0x7fb0b4155fc0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fb0ac001210 tx=0x7fb0ac009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:30.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0aa7fc700 1 -- 172.21.15.57:0/1965104228 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0ac0032c0 con 0x7fb0b4155b10 2021-06-25T04:53:30.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0aa7fc700 1 -- 172.21.15.57:0/1965104228 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ac003420 con 0x7fb0b4155b10 2021-06-25T04:53:30.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/1965104228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b4152730 con 0x7fb0b4155b10 2021-06-25T04:53:30.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0aa7fc700 1 -- 172.21.15.57:0/1965104228 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0ac001ae0 con 0x7fb0b4155b10 2021-06-25T04:53:30.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/1965104228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b40b6b90 con 0x7fb0b4155b10 2021-06-25T04:53:30.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0aa7fc700 1 -- 172.21.15.57:0/1965104228 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb0ac01c060 con 0x7fb0b4155b10 2021-06-25T04:53:30.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/1965104228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b4057310 con 0x7fb0b4155b10 2021-06-25T04:53:30.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.906+0000 7fb0aa7fc700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb09c055450 0x7fb09c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:30.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.910+0000 7fb0aa7fc700 1 -- 172.21.15.57:0/1965104228 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb0ac06db60 con 0x7fb0b4155b10 2021-06-25T04:53:30.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.910+0000 7fb0b9546700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb09c055450 0x7fb09c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:30.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.910+0000 7fb0b9546700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb09c055450 0x7fb09c057910 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fb0b001a000 tx=0x7fb0b0019000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:30.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:30.914+0000 7fb0aa7fc700 1 -- 172.21.15.57:0/1965104228 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb0ac043d10 con 0x7fb0b4155b10 2021-06-25T04:53:31.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.042+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/1965104228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb0b4141790 con 0x7fb0b4155b10 2021-06-25T04:53:31.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.042+0000 7fb0aa7fc700 1 -- 172.21.15.57:0/1965104228 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb0ac01a030 con 0x7fb0b4155b10 2021-06-25T04:53:31.049 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:53:31.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb09c055450 msgr2=0x7fb09c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb09c055450 0x7fb09c057910 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fb0b001a000 tx=0x7fb0b0019000).stop 2021-06-25T04:53:31.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/1965104228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0b4155b10 msgr2=0x7fb0b4155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0b4155b10 0x7fb0b4155fc0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fb0ac001210 tx=0x7fb0ac009040).stop 2021-06-25T04:53:31.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/1965104228 shutdown_connections 2021-06-25T04:53:31.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb09c055450 0x7fb09c057910 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0b4155b10 0x7fb0b4155fc0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0b41419d0 0x7fb0b4152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 --2- 172.21.15.57:0/1965104228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b40ad8f0 0x7fb0b40aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/1965104228 >> 172.21.15.57:0/1965104228 conn(0x7fb0b405c450 msgr2=0x7fb0b4145210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:31.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/1965104228 shutdown_connections 2021-06-25T04:53:31.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.046+0000 7fb0bb7aa700 1 -- 172.21.15.57:0/1965104228 wait complete. 2021-06-25T04:53:31.063 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:53:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1bfff700 1 Processor -- start 2021-06-25T04:53:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1bfff700 1 -- start start 2021-06-25T04:53:31.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0ad580 0x7fda1c0616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1bfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1c0aecb0 con 0x7fda1c140400 2021-06-25T04:53:31.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1bfff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1c0b6ee0 con 0x7fda1c0612e0 2021-06-25T04:53:31.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0aeee0 con 0x7fda1c0ad580 2021-06-25T04:53:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fda1c140400 0x7fda1c1464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56778/0 (socket says 172.21.15.57:56778) 2021-06-25T04:53:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1b7fe700 1 -- 172.21.15.57:0/3643148501 learned_addr learned my addr 172.21.15.57:0/3643148501 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1a7fc700 1 --2- 172.21.15.57:0/3643148501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0ad580 0x7fda1c0616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda19ffb700 1 -- 172.21.15.57:0/3643148501 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179347416 0 0) 0x7fda1c0aecb0 con 0x7fda1c140400 2021-06-25T04:53:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda19ffb700 1 -- 172.21.15.57:0/3643148501 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda00003260 con 0x7fda1c140400 2021-06-25T04:53:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda19ffb700 1 -- 172.21.15.57:0/3643148501 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2951848077 0 0) 0x7fda00003260 con 0x7fda1c140400 2021-06-25T04:53:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1a7fc700 1 -- 172.21.15.57:0/3643148501 >> v1:172.21.15.87:6789/0 conn(0x7fda1c0612e0 legacy=0x7fda1c0b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1a7fc700 1 -- 172.21.15.57:0/3643148501 >> v1:172.21.15.57:6789/0 conn(0x7fda1c140400 legacy=0x7fda1c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1a7fc700 1 -- 172.21.15.57:0/3643148501 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0af180 con 0x7fda1c0ad580 2021-06-25T04:53:31.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1a7fc700 1 --2- 172.21.15.57:0/3643148501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0ad580 0x7fda1c0616c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fda14001b80 tx=0x7fda10006df0).ready entity=mon.2 client_cookie=be588c40d5609e3a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:31.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda19ffb700 1 -- 172.21.15.57:0/3643148501 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda140019e0 con 0x7fda1c0ad580 2021-06-25T04:53:31.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda19ffb700 1 -- 172.21.15.57:0/3643148501 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda10000e90 con 0x7fda1c0ad580 2021-06-25T04:53:31.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda19ffb700 1 -- 172.21.15.57:0/3643148501 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda1000d4a0 con 0x7fda1c0ad580 2021-06-25T04:53:31.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1bfff700 1 -- 172.21.15.57:0/3643148501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0ad580 msgr2=0x7fda1c0616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.170+0000 7fda1bfff700 1 --2- 172.21.15.57:0/3643148501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0ad580 0x7fda1c0616c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fda14001b80 tx=0x7fda10006df0).stop 2021-06-25T04:53:31.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 -- 172.21.15.57:0/3643148501 shutdown_connections 2021-06-25T04:53:31.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 --2- 172.21.15.57:0/3643148501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0ad580 0x7fda1c0616c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 -- 172.21.15.57:0/3643148501 >> 172.21.15.57:0/3643148501 conn(0x7fda1c066da0 msgr2=0x7fda1c067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:31.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 -- 172.21.15.57:0/3643148501 shutdown_connections 2021-06-25T04:53:31.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 -- 172.21.15.57:0/3643148501 wait complete. 2021-06-25T04:53:31.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 Processor -- start 2021-06-25T04:53:31.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 -- start start 2021-06-25T04:53:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c0612e0 0x7fda1c09ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c0ad580 0x7fda1c0b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c140400 0x7fda1c0b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c152fd0 con 0x7fda1c0612e0 2021-06-25T04:53:31.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c152d30 con 0x7fda1c0ad580 2021-06-25T04:53:31.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0b08f0 con 0x7fda1c140400 2021-06-25T04:53:31.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c0612e0 0x7fda1c09ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1a7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c0ad580 0x7fda1c0b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1b7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c140400 0x7fda1c0b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1b7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c140400 0x7fda1c0b1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:50732/0 (socket says 172.21.15.57:50732) 2021-06-25T04:53:31.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c0612e0 0x7fda1c09ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39566/0 (socket says 172.21.15.57:39566) 2021-06-25T04:53:31.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1a7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c0ad580 0x7fda1c0b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:48058/0 (socket says 172.21.15.57:48058) 2021-06-25T04:53:31.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.174+0000 7fda1b7fe700 1 -- 172.21.15.57:0/2939530160 learned_addr learned my addr 172.21.15.57:0/2939530160 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:31.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda1affd700 1 -- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c140400 msgr2=0x7fda1c0b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda1affd700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c140400 0x7fda1c0b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda1affd700 1 -- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c0ad580 msgr2=0x7fda1c0b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda1affd700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c0ad580 0x7fda1c0b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda1affd700 1 -- 172.21.15.57:0/2939530160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1000b180 con 0x7fda1c0612e0 2021-06-25T04:53:31.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda1affd700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c0612e0 0x7fda1c09ebb0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fda1c0b9510 tx=0x7fda0c007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:31.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda0bfff700 1 -- 172.21.15.57:0/2939530160 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda0c012400 con 0x7fda1c0612e0 2021-06-25T04:53:31.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda0bfff700 1 -- 172.21.15.57:0/2939530160 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c012560 con 0x7fda1c0612e0 2021-06-25T04:53:31.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda1bfff700 1 -- 172.21.15.57:0/2939530160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c0b1e60 con 0x7fda1c0612e0 2021-06-25T04:53:31.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda0bfff700 1 -- 172.21.15.57:0/2939530160 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda0c0128c0 con 0x7fda1c0612e0 2021-06-25T04:53:31.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda1bfff700 1 -- 172.21.15.57:0/2939530160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c1529e0 con 0x7fda1c0612e0 2021-06-25T04:53:31.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda1bfff700 1 -- 172.21.15.57:0/2939530160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c0b0ab0 con 0x7fda1c0612e0 2021-06-25T04:53:31.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.178+0000 7fda0bfff700 1 -- 172.21.15.57:0/2939530160 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fda0c019030 con 0x7fda1c0612e0 2021-06-25T04:53:31.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.182+0000 7fda0bfff700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9f8055490 0x7fd9f8057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.182+0000 7fda0bfff700 1 -- 172.21.15.57:0/2939530160 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fda0c06d220 con 0x7fda1c0612e0 2021-06-25T04:53:31.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.182+0000 7fda1a7fc700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9f8055490 0x7fd9f8057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.182+0000 7fda1a7fc700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9f8055490 0x7fd9f8057950 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fda10019000 tx=0x7fda10014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:31.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.186+0000 7fda0bfff700 1 -- 172.21.15.57:0/2939530160 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fda0c0432c0 con 0x7fda1c0612e0 2021-06-25T04:53:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.310+0000 7fda1bfff700 1 -- 172.21.15.57:0/2939530160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda1c057310 con 0x7fda1c0612e0 2021-06-25T04:53:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda0bfff700 1 -- 172.21.15.57:0/2939530160 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+10 (secure 0 0 0) 0x7fda0c0468e0 con 0x7fda1c0612e0 2021-06-25T04:53:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:53:31.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 -- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9f8055490 msgr2=0x7fd9f8057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9f8055490 0x7fd9f8057950 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fda10019000 tx=0x7fda10014000).stop 2021-06-25T04:53:31.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 -- 172.21.15.57:0/2939530160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c0612e0 msgr2=0x7fda1c09ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c0612e0 0x7fda1c09ebb0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fda1c0b9510 tx=0x7fda0c007b90).stop 2021-06-25T04:53:31.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 -- 172.21.15.57:0/2939530160 shutdown_connections 2021-06-25T04:53:31.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd9f8055490 0x7fd9f8057950 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c140400 0x7fda1c0b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c0ad580 0x7fda1c0b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 --2- 172.21.15.57:0/2939530160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c0612e0 0x7fda1c09ebb0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 -- 172.21.15.57:0/2939530160 >> 172.21.15.57:0/2939530160 conn(0x7fda1c066da0 msgr2=0x7fda1c0b7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:31.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 -- 172.21.15.57:0/2939530160 shutdown_connections 2021-06-25T04:53:31.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.314+0000 7fda1bfff700 1 -- 172.21.15.57:0/2939530160 wait complete. 2021-06-25T04:53:31.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:53:31.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdfc9b700 1 Processor -- start 2021-06-25T04:53:31.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdfc9b700 1 -- start start 2021-06-25T04:53:31.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdfc9b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fd80b4140 0x7f3fd8140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdfc9b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd8143b20 con 0x7f3fd80b4650 2021-06-25T04:53:31.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdfc9b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd8143dc0 con 0x7f3fd8146910 2021-06-25T04:53:31.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdfc9b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd81474d0 con 0x7f3fd80b4140 2021-06-25T04:53:31.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fde238700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3fd80b4650 0x7f3fd80b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56794/0 (socket says 172.21.15.57:56794) 2021-06-25T04:53:31.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fde238700 1 -- 172.21.15.57:0/1066413440 learned_addr learned my addr 172.21.15.57:0/1066413440 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:31.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdd236700 1 --2- 172.21.15.57:0/1066413440 >> v2:172.21.15.87:3300/0 conn(0x7f3fd80b4140 0x7f3fd8140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908179310 0 0) 0x7f3fd8143b20 con 0x7f3fd80b4650 2021-06-25T04:53:31.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc0003260 con 0x7f3fd80b4650 2021-06-25T04:53:31.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1522811012 0 0) 0x7f3fc0003260 con 0x7f3fd80b4650 2021-06-25T04:53:31.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 >> v2:172.21.15.87:3300/0 conn(0x7f3fd80b4140 msgr2=0x7f3fd8140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:31.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 --2- 172.21.15.57:0/1066413440 >> v2:172.21.15.87:3300/0 conn(0x7f3fd80b4140 0x7f3fd8140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 >> v1:172.21.15.87:6789/0 conn(0x7f3fd8146910 legacy=0x7f3fd81401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd80b0c50 con 0x7f3fd80b4650 2021-06-25T04:53:31.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f3fd00019e0 con 0x7f3fd80b4650 2021-06-25T04:53:31.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdd236700 1 --2- 172.21.15.57:0/1066413440 >> v2:172.21.15.87:3300/0 conn(0x7f3fd80b4140 0x7f3fd8140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:31.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 >> v1:172.21.15.57:6789/0 conn(0x7f3fd80b4650 legacy=0x7f3fd80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0003750 0x7f3fc0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc0004500 0x7f3fc0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc0004e70 0x7f3fc000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd81474d0 con 0x7f3fc0003750 2021-06-25T04:53:31.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc000bd20 con 0x7f3fc0004500 2021-06-25T04:53:31.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc000bee0 con 0x7f3fc0004e70 2021-06-25T04:53:31.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdd236700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc0004500 0x7f3fc0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fde238700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc0004e70 0x7f3fc000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.438+0000 7f3fdda37700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0003750 0x7f3fc0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdd236700 1 -- 172.21.15.57:0/1066413440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc0004e70 msgr2=0x7f3fc000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:31.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdd236700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc0004e70 0x7f3fc000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdd236700 1 -- 172.21.15.57:0/1066413440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0003750 msgr2=0x7f3fc0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:31.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdd236700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0003750 0x7f3fc0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdd236700 1 -- 172.21.15.57:0/1066413440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc0003260 con 0x7f3fc0004500 2021-06-25T04:53:31.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fde238700 1 -- 172.21.15.57:0/1066413440 reap_dead start 2021-06-25T04:53:31.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdda37700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0003750 0x7f3fc0003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:31.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdd236700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc0004500 0x7f3fc0004980 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f3fc800c000 tx=0x7f3fc8006df0).ready entity=mon.1 client_cookie=fa421bbaab5087e5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:31.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fc800e800 con 0x7f3fc0004500 2021-06-25T04:53:31.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc800e960 con 0x7f3fc0004500 2021-06-25T04:53:31.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdca35700 1 -- 172.21.15.57:0/1066413440 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fc800ecc0 con 0x7f3fc0004500 2021-06-25T04:53:31.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/1066413440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc0004500 msgr2=0x7f3fc0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdfc9b700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc0004500 0x7f3fc0004980 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f3fc800c000 tx=0x7f3fc8006df0).stop 2021-06-25T04:53:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/1066413440 shutdown_connections 2021-06-25T04:53:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdfc9b700 1 --2- 172.21.15.57:0/1066413440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc0004500 0x7f3fc0004980 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/1066413440 >> 172.21.15.57:0/1066413440 conn(0x7f3fd805c450 msgr2=0x7f3fd805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:31.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/1066413440 shutdown_connections 2021-06-25T04:53:31.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/1066413440 wait complete. 2021-06-25T04:53:31.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdfc9b700 1 Processor -- start 2021-06-25T04:53:31.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.442+0000 7f3fdfc9b700 1 -- start start 2021-06-25T04:53:31.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdfc9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0004500 0x7f3fd80ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdfc9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fd80b7810 0x7f3fd80aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdfc9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fd80af4e0 0x7f3fd813dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdfc9b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd8152630 con 0x7f3fc0004500 2021-06-25T04:53:31.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdfc9b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd80b8300 con 0x7f3fd80b7810 2021-06-25T04:53:31.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdfc9b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd80b8c60 con 0x7f3fd80af4e0 2021-06-25T04:53:31.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdda37700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0004500 0x7f3fd80ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdda37700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0004500 0x7f3fd80ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39584/0 (socket says 172.21.15.57:39584) 2021-06-25T04:53:31.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdda37700 1 -- 172.21.15.57:0/362298570 learned_addr learned my addr 172.21.15.57:0/362298570 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:31.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fde238700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fd80af4e0 0x7f3fd813dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdd236700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fd80b7810 0x7f3fd80aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdda37700 1 -- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fd80af4e0 msgr2=0x7f3fd813dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdda37700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fd80af4e0 0x7f3fd813dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdda37700 1 -- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fd80b7810 msgr2=0x7f3fd80aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdda37700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fd80b7810 0x7f3fd80aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdda37700 1 -- 172.21.15.57:0/362298570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd805ce90 con 0x7f3fc0004500 2021-06-25T04:53:31.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdd236700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fd80b7810 0x7f3fd80aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:31.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fde238700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fd80af4e0 0x7f3fd813dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:31.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdda37700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0004500 0x7f3fd80ad8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f3fd400b000 tx=0x7f3fd4009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:31.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fc6ffd700 1 -- 172.21.15.57:0/362298570 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fd4014430 con 0x7f3fc0004500 2021-06-25T04:53:31.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fc6ffd700 1 -- 172.21.15.57:0/362298570 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd4014590 con 0x7f3fc0004500 2021-06-25T04:53:31.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fc6ffd700 1 -- 172.21.15.57:0/362298570 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fd40148f0 con 0x7f3fc0004500 2021-06-25T04:53:31.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/362298570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd80b8060 con 0x7f3fc0004500 2021-06-25T04:53:31.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.446+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/362298570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd80af960 con 0x7f3fc0004500 2021-06-25T04:53:31.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.450+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/362298570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd8057310 con 0x7f3fc0004500 2021-06-25T04:53:31.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.450+0000 7f3fc6ffd700 1 -- 172.21.15.57:0/362298570 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3fd4014a50 con 0x7f3fc0004500 2021-06-25T04:53:31.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.450+0000 7f3fc6ffd700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fb8055490 0x7f3fb8057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.450+0000 7f3fc6ffd700 1 -- 172.21.15.57:0/362298570 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3fd406e060 con 0x7f3fc0004500 2021-06-25T04:53:31.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.450+0000 7f3fdd236700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fb8055490 0x7f3fb8057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.450+0000 7f3fdd236700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fb8055490 0x7f3fb8057950 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f3fc801d000 tx=0x7f3fc8019000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:31.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.454+0000 7f3fc6ffd700 1 -- 172.21.15.57:0/362298570 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3fd4044210 con 0x7f3fc0004500 2021-06-25T04:53:31.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.582+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/362298570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3fd80b6fe0 con 0x7f3fc0004500 2021-06-25T04:53:31.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fc6ffd700 1 -- 172.21.15.57:0/362298570 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3fd4047830 con 0x7f3fc0004500 2021-06-25T04:53:31.591 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:53:31.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fb8055490 msgr2=0x7f3fb8057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fb8055490 0x7f3fb8057950 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f3fc801d000 tx=0x7f3fc8019000).stop 2021-06-25T04:53:31.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/362298570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0004500 msgr2=0x7f3fd80ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0004500 0x7f3fd80ad8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f3fd400b000 tx=0x7f3fd4009040).stop 2021-06-25T04:53:31.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/362298570 shutdown_connections 2021-06-25T04:53:31.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fb8055490 0x7f3fb8057950 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fd80af4e0 0x7f3fd813dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fd80b7810 0x7f3fd80aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 --2- 172.21.15.57:0/362298570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc0004500 0x7f3fd80ad8f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/362298570 >> 172.21.15.57:0/362298570 conn(0x7f3fd805c450 msgr2=0x7f3fd8061510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:31.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/362298570 shutdown_connections 2021-06-25T04:53:31.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.586+0000 7f3fdfc9b700 1 -- 172.21.15.57:0/362298570 wait complete. 2021-06-25T04:53:31.604 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:53:31.604 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:31.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 Processor -- start 2021-06-25T04:53:31.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 -- start start 2021-06-25T04:53:31.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcaec0b5460 0x7fcaec0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcaec0b05d0 0x7fcaec147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec067560 0x7fcaec0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec1452a0 con 0x7fcaec0b5460 2021-06-25T04:53:31.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec0adfb0 con 0x7fcaec0b05d0 2021-06-25T04:53:31.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0b5840 con 0x7fcaec067560 2021-06-25T04:53:31.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaea59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcaec0b5460 0x7fcaec0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaea59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcaec0b5460 0x7fcaec0af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39592/0 (socket says 172.21.15.57:39592) 2021-06-25T04:53:31.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaea59c700 1 -- 172.21.15.57:0/3156445357 learned_addr learned my addr 172.21.15.57:0/3156445357 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:31.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcae1d9b700 1 --2- 172.21.15.57:0/3156445357 >> v2:172.21.15.87:3300/0 conn(0x7fcaec0b05d0 0x7fcaec147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaead9d700 1 --2- 172.21.15.57:0/3156445357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec067560 0x7fcaec0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaea59c700 1 -- 172.21.15.57:0/3156445357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec067560 msgr2=0x7fcaec0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:31.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaea59c700 1 --2- 172.21.15.57:0/3156445357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec067560 0x7fcaec0acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaea59c700 1 -- 172.21.15.57:0/3156445357 >> v2:172.21.15.87:3300/0 conn(0x7fcaec0b05d0 msgr2=0x7fcaec147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:31.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaea59c700 1 --2- 172.21.15.57:0/3156445357 >> v2:172.21.15.87:3300/0 conn(0x7fcaec0b05d0 0x7fcaec147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaea59c700 1 -- 172.21.15.57:0/3156445357 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec0ac7c0 con 0x7fcaec0b5460 2021-06-25T04:53:31.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcae1d9b700 1 --2- 172.21.15.57:0/3156445357 >> v2:172.21.15.87:3300/0 conn(0x7fcaec0b05d0 0x7fcaec147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:53:31.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaead9d700 1 --2- 172.21.15.57:0/3156445357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec067560 0x7fcaec0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:53:31.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaea59c700 1 --2- 172.21.15.57:0/3156445357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec0b5460 0x7fcaec0af510 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fcadc002f70 tx=0x7fcadc006eb0).ready entity=mon.0 client_cookie=d1107918dcbe332a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:31.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcae9d9b700 1 -- 172.21.15.57:0/3156445357 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcadc00d570 con 0x7fcaec0b5460 2021-06-25T04:53:31.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcae9d9b700 1 -- 172.21.15.57:0/3156445357 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc000e90 con 0x7fcaec0b5460 2021-06-25T04:53:31.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 -- 172.21.15.57:0/3156445357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec0b5460 msgr2=0x7fcaec0af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 --2- 172.21.15.57:0/3156445357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec0b5460 0x7fcaec0af510 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fcadc002f70 tx=0x7fcadc006eb0).stop 2021-06-25T04:53:31.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcae9d9b700 1 -- 172.21.15.57:0/3156445357 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcadc00d900 con 0x7fcaec0b5460 2021-06-25T04:53:31.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 -- 172.21.15.57:0/3156445357 shutdown_connections 2021-06-25T04:53:31.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 --2- 172.21.15.57:0/3156445357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec067560 0x7fcaec0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 --2- 172.21.15.57:0/3156445357 >> v2:172.21.15.87:3300/0 conn(0x7fcaec0b05d0 0x7fcaec147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 --2- 172.21.15.57:0/3156445357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec0b5460 0x7fcaec0af510 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 -- 172.21.15.57:0/3156445357 >> 172.21.15.57:0/3156445357 conn(0x7fcaec062520 msgr2=0x7fcaec062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:31.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 -- 172.21.15.57:0/3156445357 shutdown_connections 2021-06-25T04:53:31.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.706+0000 7fcaeb59e700 1 -- 172.21.15.57:0/3156445357 wait complete. 2021-06-25T04:53:31.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaeb59e700 1 Processor -- start 2021-06-25T04:53:31.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaeb59e700 1 -- start start 2021-06-25T04:53:31.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaeb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec067560 0x7fcaec1466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaeb59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec0b05d0 0x7fcaec149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaeb59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec0b5460 0x7fcaec14a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaeb59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec14c790 con 0x7fcaec067560 2021-06-25T04:53:31.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaeb59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec14c250 con 0x7fcaec0b5460 2021-06-25T04:53:31.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaeb59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec14c4f0 con 0x7fcaec0b05d0 2021-06-25T04:53:31.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaea59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec067560 0x7fcaec1466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaea59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec067560 0x7fcaec1466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39600/0 (socket says 172.21.15.57:39600) 2021-06-25T04:53:31.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaea59c700 1 -- 172.21.15.57:0/300205234 learned_addr learned my addr 172.21.15.57:0/300205234 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcae1d9b700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec0b05d0 0x7fcaec149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaead9d700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec0b5460 0x7fcaec14a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaea59c700 1 -- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec0b05d0 msgr2=0x7fcaec149ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaea59c700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec0b05d0 0x7fcaec149ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaea59c700 1 -- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec0b5460 msgr2=0x7fcaec14a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaea59c700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec0b5460 0x7fcaec14a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaea59c700 1 -- 172.21.15.57:0/300205234 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc00b1e0 con 0x7fcaec067560 2021-06-25T04:53:31.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcae1d9b700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec0b05d0 0x7fcaec149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:31.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaea59c700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec067560 0x7fcaec1466b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fcadc002f70 tx=0x7fcadc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:31.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcae3fff700 1 -- 172.21.15.57:0/300205234 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcadc021070 con 0x7fcaec067560 2021-06-25T04:53:31.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcae3fff700 1 -- 172.21.15.57:0/300205234 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc000e90 con 0x7fcaec067560 2021-06-25T04:53:31.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaeb59e700 1 -- 172.21.15.57:0/300205234 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec146ba0 con 0x7fcaec067560 2021-06-25T04:53:31.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcae3fff700 1 -- 172.21.15.57:0/300205234 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcadc011bc0 con 0x7fcaec067560 2021-06-25T04:53:31.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaeb59e700 1 -- 172.21.15.57:0/300205234 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec14a8e0 con 0x7fcaec067560 2021-06-25T04:53:31.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.710+0000 7fcaeb59e700 1 -- 172.21.15.57:0/300205234 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec1572d0 con 0x7fcaec067560 2021-06-25T04:53:31.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.714+0000 7fcae3fff700 1 -- 172.21.15.57:0/300205234 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcadc00f070 con 0x7fcaec067560 2021-06-25T04:53:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.714+0000 7fcae3fff700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcad0055450 0x7fcad0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.714+0000 7fcae3fff700 1 -- 172.21.15.57:0/300205234 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcadc06f480 con 0x7fcaec067560 2021-06-25T04:53:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.714+0000 7fcae1d9b700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcad0055450 0x7fcad0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.714+0000 7fcae1d9b700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcad0055450 0x7fcad0057910 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fcad400b000 tx=0x7fcad4008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:31.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.718+0000 7fcae3fff700 1 -- 172.21.15.57:0/300205234 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcadc045520 con 0x7fcaec067560 2021-06-25T04:53:31.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.878+0000 7fcaeb59e700 1 -- 172.21.15.57:0/300205234 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcaec149a20 con 0x7fcaec067560 2021-06-25T04:53:31.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.878+0000 7fcae3fff700 1 -- 172.21.15.57:0/300205234 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fcadc048b40 con 0x7fcaec067560 2021-06-25T04:53:31.890 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:31.890 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2942430957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2942430957},{"type":"v1","addr":"172.21.15.87:6835","nonce":2942430957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34},{"gid":6184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/4012056699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4012056699},{"type":"v1","addr":"172.21.15.57:6833","nonce":4012056699}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:53:27.269151+0000","modified":"2021-06-25T04:53:28.272583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2725183825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2725183825},{"type":"v1","addr":"172.21.15.57:6835","nonce":2725183825}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-06-25T04:53:31.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 -- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcad0055450 msgr2=0x7fcad0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcad0055450 0x7fcad0057910 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fcad400b000 tx=0x7fcad4008040).stop 2021-06-25T04:53:31.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 -- 172.21.15.57:0/300205234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec067560 msgr2=0x7fcaec1466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:31.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec067560 0x7fcaec1466b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fcadc002f70 tx=0x7fcadc015000).stop 2021-06-25T04:53:31.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 -- 172.21.15.57:0/300205234 shutdown_connections 2021-06-25T04:53:31.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcad0055450 0x7fcad0057910 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec0b5460 0x7fcaec14a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcaec0b05d0 0x7fcaec149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 --2- 172.21.15.57:0/300205234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaec067560 0x7fcaec1466b0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:31.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 -- 172.21.15.57:0/300205234 >> 172.21.15.57:0/300205234 conn(0x7fcaec062520 msgr2=0x7fcaec1489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:31.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 -- 172.21.15.57:0/300205234 shutdown_connections 2021-06-25T04:53:31.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:31.882+0000 7fcaeb59e700 1 -- 172.21.15.57:0/300205234 wait complete. 2021-06-25T04:53:31.894 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2021-06-25T04:53:32.202 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:53:27.269151+0000', 'modified': '2021-06-25T04:53:28.272583+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6285': {'gid': 6285, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2725183825', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2725183825}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2725183825}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:53:32.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:53:32.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:53:32.317 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":6285,"want_state":"up:active","state":"up:active","rank_uptime":5.0343404070000002,"mdsmap_epoch":36,"osdmap_epoch":77,"osdmap_epoch_barrier":77,"uptime":9.3359463839999997} 2021-06-25T04:53:32.318 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 6285, "mdsmap_epoch": 36, "osdmap_epoch": 77, "osdmap_epoch_barrier": 77, "rank_uptime": 5.034340407, "state": "up:active", "uptime": 9.335946384, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:53:32.318 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:53:32.319 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:53:32.319 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:53:32.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:32.320 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:53:32.330 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:53:32.347 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:53:32.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:53:32.405 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:53:32.406 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:53:32.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:32.407 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:53:32.413 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:53:32.414 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:53:32.417 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:53:32.433 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:53:32.433 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:53:32.488 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:53:32.489 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:53:32.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:32.491 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:53:32.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:53:32.491+0000 7f12decc0080 -1 init, newargv = 0x56357d8ddfe0 newargc=9ceph-fuse[14985]: starting ceph client 2021-06-25T04:53:32.493 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr: 2021-06-25T04:53:32.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[14985]: starting fuse 2021-06-25T04:53:33.597 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:53:33.616 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:53:33.617 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:53:33.672 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:53:33.673 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:53:33.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:33.674 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:53:33.682 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:53:33.683 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:53:33.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:33.684 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:53:33.684 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:53:33.685 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:53:33.685 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:53:33.685 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:53:33.686 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:53:33.686 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:53:33.687 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:53:33.687 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:53:33.688 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:53:33.689 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:53:33.690 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:53:33.691 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:53:33.691 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:53:33.692 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:53:33.693 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:53:33.694 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:53:33.695 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:53:33.696 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:53:33.696 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:53:33.697 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:53:33.698 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:53:33.699 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:53:33.772 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.14985.asok 2021-06-25T04:53:33.776 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14985.asok 2021-06-25T04:53:33.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:33.777 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14985.asok status 2021-06-25T04:53:33.863 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:53:33.863 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:53:33.863 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:53:33.864 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:53:33.864 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:53:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:53:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:53:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "14985", 2021-06-25T04:53:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:53:33.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:53:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:53:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:53:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 6447, 2021-06-25T04:53:33.866 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:53:33.867 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:53:33.867 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:53:33.867 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 6447 2021-06-25T04:53:33.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:53:33.868 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:53:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:53:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:53:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1630225676 2021-06-25T04:53:33.869 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:53:33.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:53:33.870 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:53:33.870 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:53:33.870 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:53:33.871 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1630225676 2021-06-25T04:53:33.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:53:33.872 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.6447 172.21.15.102:0/1630225676", 2021-06-25T04:53:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/1630225676", 2021-06-25T04:53:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:53:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 36, 2021-06-25T04:53:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 77, 2021-06-25T04:53:33.873 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:53:33.874 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:53:33.874 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:53:33.874 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:53:33.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:33.876 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:53:33.878 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:53:33.886 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:53:33.888 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:53:33.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:33.889 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:53:33.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:53:34.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.054+0000 7f2d6086c700 1 Processor -- start 2021-06-25T04:53:34.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.054+0000 7f2d6086c700 1 -- start start 2021-06-25T04:53:34.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.054+0000 7f2d6086c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d5c0b05d0 0x7f2d5c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2d5c147560 0x7f2d5c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5c1479b0 con 0x7f2d5c0b5460 2021-06-25T04:53:34.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c1452a0 con 0x7f2d5c147560 2021-06-25T04:53:34.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c0adfb0 con 0x7f2d5c0b05d0 2021-06-25T04:53:34.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d5b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2d5c147560 0x7f2d5c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d5ad9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2d5c0b5460 0x7f2d5c067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56826/0 (socket says 172.21.15.57:56826) 2021-06-25T04:53:34.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d5b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2d5c147560 0x7f2d5c0acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39610/0 (socket says 172.21.15.57:39610) 2021-06-25T04:53:34.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d5ad9d700 1 -- 172.21.15.57:0/760798599 learned_addr learned my addr 172.21.15.57:0/760798599 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:34.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d5a59c700 1 --2- 172.21.15.57:0/760798599 >> v2:172.21.15.87:3300/0 conn(0x7f2d5c0b05d0 0x7f2d5c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d59d9b700 1 -- 172.21.15.57:0/760798599 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695633526 0 0) 0x7f2d5c1479b0 con 0x7f2d5c0b5460 2021-06-25T04:53:34.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d5b59e700 1 -- 172.21.15.57:0/760798599 >> v2:172.21.15.87:3300/0 conn(0x7f2d5c0b05d0 msgr2=0x7f2d5c0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:34.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d5b59e700 1 --2- 172.21.15.57:0/760798599 >> v2:172.21.15.87:3300/0 conn(0x7f2d5c0b05d0 0x7f2d5c0af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d5b59e700 1 -- 172.21.15.57:0/760798599 >> v1:172.21.15.57:6789/0 conn(0x7f2d5c0b5460 legacy=0x7f2d5c067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d5b59e700 1 -- 172.21.15.57:0/760798599 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c0b5840 con 0x7f2d5c147560 2021-06-25T04:53:34.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d5b59e700 1 --2- 172.21.15.57:0/760798599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d5c147560 0x7f2d5c0acc20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f2d540032f0 tx=0x7f2d540091d0).ready entity=mon.0 client_cookie=39781cb7936af1ca server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d59d9b700 1 -- 172.21.15.57:0/760798599 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d54009ea0 con 0x7f2d5c147560 2021-06-25T04:53:34.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d59d9b700 1 -- 172.21.15.57:0/760798599 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5400b870 con 0x7f2d5c147560 2021-06-25T04:53:34.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d59d9b700 1 -- 172.21.15.57:0/760798599 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d5400b9e0 con 0x7f2d5c147560 2021-06-25T04:53:34.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 -- 172.21.15.57:0/760798599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d5c147560 msgr2=0x7f2d5c0acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 --2- 172.21.15.57:0/760798599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d5c147560 0x7f2d5c0acc20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f2d540032f0 tx=0x7f2d540091d0).stop 2021-06-25T04:53:34.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 -- 172.21.15.57:0/760798599 shutdown_connections 2021-06-25T04:53:34.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 --2- 172.21.15.57:0/760798599 >> v2:172.21.15.87:3300/0 conn(0x7f2d5c0b05d0 0x7f2d5c0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 --2- 172.21.15.57:0/760798599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d5c147560 0x7f2d5c0acc20 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 -- 172.21.15.57:0/760798599 >> 172.21.15.57:0/760798599 conn(0x7f2d5c062520 msgr2=0x7f2d5c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:34.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 -- 172.21.15.57:0/760798599 shutdown_connections 2021-06-25T04:53:34.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 -- 172.21.15.57:0/760798599 wait complete. 2021-06-25T04:53:34.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 Processor -- start 2021-06-25T04:53:34.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.058+0000 7f2d6086c700 1 -- start start 2021-06-25T04:53:34.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d6086c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d5c0b05d0 0x7f2d5c14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d6086c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d5c0b5460 0x7f2d5c14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d6086c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d5c147560 0x7f2d5c0645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d6086c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c0a7160 con 0x7f2d5c147560 2021-06-25T04:53:34.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d6086c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c063380 con 0x7f2d5c0b05d0 2021-06-25T04:53:34.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d6086c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c063620 con 0x7f2d5c0b5460 2021-06-25T04:53:34.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d5b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d5c147560 0x7f2d5c0645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d5b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d5c147560 0x7f2d5c0645b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39614/0 (socket says 172.21.15.57:39614) 2021-06-25T04:53:34.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d5b59e700 1 -- 172.21.15.57:0/2028191734 learned_addr learned my addr 172.21.15.57:0/2028191734 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:34.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d5ad9d700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d5c0b05d0 0x7f2d5c14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d5a59c700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d5c0b5460 0x7f2d5c14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d5b59e700 1 -- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d5c0b5460 msgr2=0x7f2d5c14ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d5b59e700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d5c0b5460 0x7f2d5c14ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d5b59e700 1 -- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d5c0b05d0 msgr2=0x7f2d5c14e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d5b59e700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d5c0b05d0 0x7f2d5c14e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d5b59e700 1 -- 172.21.15.57:0/2028191734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d54009470 con 0x7f2d5c147560 2021-06-25T04:53:34.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d5b59e700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d5c147560 0x7f2d5c0645b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f2d540032f0 tx=0x7f2d54016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d4bfff700 1 -- 172.21.15.57:0/2028191734 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d54011d30 con 0x7f2d5c147560 2021-06-25T04:53:34.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d4bfff700 1 -- 172.21.15.57:0/2028191734 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d54011e90 con 0x7f2d5c147560 2021-06-25T04:53:34.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d6086c700 1 -- 172.21.15.57:0/2028191734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c0638c0 con 0x7f2d5c147560 2021-06-25T04:53:34.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d4bfff700 1 -- 172.21.15.57:0/2028191734 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d54021670 con 0x7f2d5c147560 2021-06-25T04:53:34.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.062+0000 7f2d6086c700 1 -- 172.21.15.57:0/2028191734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c1567a0 con 0x7f2d5c147560 2021-06-25T04:53:34.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.066+0000 7f2d6086c700 1 -- 172.21.15.57:0/2028191734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c057310 con 0x7f2d5c147560 2021-06-25T04:53:34.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.066+0000 7f2d4bfff700 1 -- 172.21.15.57:0/2028191734 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2d5400f070 con 0x7f2d5c147560 2021-06-25T04:53:34.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.066+0000 7f2d4bfff700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d380553d0 0x7f2d38057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.066+0000 7f2d4bfff700 1 -- 172.21.15.57:0/2028191734 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2d5406f100 con 0x7f2d5c147560 2021-06-25T04:53:34.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.066+0000 7f2d5ad9d700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d380553d0 0x7f2d38057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.066+0000 7f2d5ad9d700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d380553d0 0x7f2d38057890 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f2d5000d000 tx=0x7f2d50007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.074+0000 7f2d4bfff700 1 -- 172.21.15.57:0/2028191734 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2d540451a0 con 0x7f2d5c147560 2021-06-25T04:53:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.202+0000 7f2d6086c700 1 -- 172.21.15.57:0/2028191734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d5c0af880 con 0x7f2d5c147560 2021-06-25T04:53:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.202+0000 7f2d4bfff700 1 -- 172.21.15.57:0/2028191734 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f2d54015090 con 0x7f2d5c147560 2021-06-25T04:53:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:34.209 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":77,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:53:27.268860+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:53:25.832629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-06-25T04:53:26.696947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:53:34.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 -- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d380553d0 msgr2=0x7f2d38057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d380553d0 0x7f2d38057890 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f2d5000d000 tx=0x7f2d50007a00).stop 2021-06-25T04:53:34.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 -- 172.21.15.57:0/2028191734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d5c147560 msgr2=0x7f2d5c0645b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d5c147560 0x7f2d5c0645b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f2d540032f0 tx=0x7f2d54016000).stop 2021-06-25T04:53:34.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 -- 172.21.15.57:0/2028191734 shutdown_connections 2021-06-25T04:53:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2d380553d0 0x7f2d38057890 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d5c147560 0x7f2d5c0645b0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d5c0b5460 0x7f2d5c14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 --2- 172.21.15.57:0/2028191734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d5c0b05d0 0x7f2d5c14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 -- 172.21.15.57:0/2028191734 >> 172.21.15.57:0/2028191734 conn(0x7f2d5c062520 msgr2=0x7f2d5c147970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 -- 172.21.15.57:0/2028191734 shutdown_connections 2021-06-25T04:53:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.206+0000 7f2d6086c700 1 -- 172.21.15.57:0/2028191734 wait complete. 2021-06-25T04:53:34.222 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:53:25.832629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:53:26.696947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:53:34.224 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:53:34.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.326+0000 7fc6e4b8c700 1 Processor -- start 2021-06-25T04:53:34.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.326+0000 7fc6e4b8c700 1 -- start start 2021-06-25T04:53:34.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6e4b8c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc6e00affd0 0x7fc6e00a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6e4b8c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e00a7080 con 0x7fc6e00afb90 2021-06-25T04:53:34.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6e4b8c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e00a72b0 con 0x7fc6e00b2540 2021-06-25T04:53:34.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6e4b8c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e00a7550 con 0x7fc6e00affd0 2021-06-25T04:53:34.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6dffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc6e00afb90 0x7fc6e0151b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56842/0 (socket says 172.21.15.57:56842) 2021-06-25T04:53:34.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6dffff700 1 -- 172.21.15.57:0/327948265 learned_addr learned my addr 172.21.15.57:0/327948265 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:34.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6deffd700 1 --2- 172.21.15.57:0/327948265 >> v2:172.21.15.87:3300/0 conn(0x7fc6e00affd0 0x7fc6e00a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6de7fc700 1 -- 172.21.15.57:0/327948265 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799944371 0 0) 0x7fc6e00a7080 con 0x7fc6e00afb90 2021-06-25T04:53:34.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6de7fc700 1 -- 172.21.15.57:0/327948265 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6cc003260 con 0x7fc6e00afb90 2021-06-25T04:53:34.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6deffd700 1 -- 172.21.15.57:0/327948265 >> v1:172.21.15.87:6789/0 conn(0x7fc6e00b2540 legacy=0x7fc6e014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6deffd700 1 -- 172.21.15.57:0/327948265 >> v1:172.21.15.57:6789/0 conn(0x7fc6e00afb90 legacy=0x7fc6e0151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6de7fc700 1 -- 172.21.15.57:0/327948265 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377692166 0 0) 0x7fc6e00a72b0 con 0x7fc6e00b2540 2021-06-25T04:53:34.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6deffd700 1 -- 172.21.15.57:0/327948265 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e00a77f0 con 0x7fc6e00affd0 2021-06-25T04:53:34.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6deffd700 1 --2- 172.21.15.57:0/327948265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6e00affd0 0x7fc6e00a8370 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fc6d00032f0 tx=0x7fc6d00091d0).ready entity=mon.1 client_cookie=892d9b837dc596c4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6de7fc700 1 -- 172.21.15.57:0/327948265 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6d000b710 con 0x7fc6e00affd0 2021-06-25T04:53:34.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6de7fc700 1 -- 172.21.15.57:0/327948265 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d000b870 con 0x7fc6e00affd0 2021-06-25T04:53:34.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6de7fc700 1 -- 172.21.15.57:0/327948265 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6d000b9e0 con 0x7fc6e00affd0 2021-06-25T04:53:34.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/327948265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6e00affd0 msgr2=0x7fc6e00a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6e4b8c700 1 --2- 172.21.15.57:0/327948265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6e00affd0 0x7fc6e00a8370 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fc6d00032f0 tx=0x7fc6d00091d0).stop 2021-06-25T04:53:34.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/327948265 shutdown_connections 2021-06-25T04:53:34.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6e4b8c700 1 --2- 172.21.15.57:0/327948265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6e00affd0 0x7fc6e00a8370 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/327948265 >> 172.21.15.57:0/327948265 conn(0x7fc6e0060140 msgr2=0x7fc6e00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:34.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/327948265 shutdown_connections 2021-06-25T04:53:34.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.330+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/327948265 wait complete. 2021-06-25T04:53:34.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6e4b8c700 1 Processor -- start 2021-06-25T04:53:34.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6e4b8c700 1 -- start start 2021-06-25T04:53:34.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6e4b8c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6e00afb90 0x7fc6e00a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6e4b8c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6e00affd0 0x7fc6e00b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6e4b8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e00b2540 0x7fc6e00b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6e4b8c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0156ac0 con 0x7fc6e00b2540 2021-06-25T04:53:34.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6e4b8c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0156d60 con 0x7fc6e00afb90 2021-06-25T04:53:34.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6e4b8c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0063ab0 con 0x7fc6e00affd0 2021-06-25T04:53:34.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6dffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e00b2540 0x7fc6e00b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6deffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6e00affd0 0x7fc6e00b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6deffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6e00affd0 0x7fc6e00b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:50792/0 (socket says 172.21.15.57:50792) 2021-06-25T04:53:34.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6df7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6e00afb90 0x7fc6e00a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6deffd700 1 -- 172.21.15.57:0/3566112484 learned_addr learned my addr 172.21.15.57:0/3566112484 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:34.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6dffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e00b2540 0x7fc6e00b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39630/0 (socket says 172.21.15.57:39630) 2021-06-25T04:53:34.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6dffff700 1 -- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6e00affd0 msgr2=0x7fc6e00b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6dffff700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6e00affd0 0x7fc6e00b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6dffff700 1 -- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6e00afb90 msgr2=0x7fc6e00a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6dffff700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6e00afb90 0x7fc6e00a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6dffff700 1 -- 172.21.15.57:0/3566112484 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d0009470 con 0x7fc6e00b2540 2021-06-25T04:53:34.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6deffd700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6e00affd0 0x7fc6e00b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:34.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6df7fe700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6e00afb90 0x7fc6e00a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:34.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6dffff700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e00b2540 0x7fc6e00b4210 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fc6d8001110 tx=0x7fc6d80079a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6dcff9700 1 -- 172.21.15.57:0/3566112484 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6d800cd80 con 0x7fc6e00b2540 2021-06-25T04:53:34.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6dcff9700 1 -- 172.21.15.57:0/3566112484 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d80070d0 con 0x7fc6e00b2540 2021-06-25T04:53:34.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/3566112484 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e0063d50 con 0x7fc6e00b2540 2021-06-25T04:53:34.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6dcff9700 1 -- 172.21.15.57:0/3566112484 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6d8007430 con 0x7fc6e00b2540 2021-06-25T04:53:34.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.334+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/3566112484 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e00a9dd0 con 0x7fc6e00b2540 2021-06-25T04:53:34.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.338+0000 7fc6dcff9700 1 -- 172.21.15.57:0/3566112484 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc6d8010070 con 0x7fc6e00b2540 2021-06-25T04:53:34.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.338+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/3566112484 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e0063ee0 con 0x7fc6e00b2540 2021-06-25T04:53:34.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.338+0000 7fc6dcff9700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6c0055340 0x7fc6c0057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.338+0000 7fc6dcff9700 1 -- 172.21.15.57:0/3566112484 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc6d806d2f0 con 0x7fc6e00b2540 2021-06-25T04:53:34.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.338+0000 7fc6df7fe700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6c0055340 0x7fc6c0057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.338+0000 7fc6df7fe700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6c0055340 0x7fc6c0057800 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fc6d400d000 tx=0x7fc6d4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.346+0000 7fc6dcff9700 1 -- 172.21.15.57:0/3566112484 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc6d8043440 con 0x7fc6e00b2540 2021-06-25T04:53:34.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.474+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/3566112484 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc6e0156f20 con 0x7fc6e00b2540 2021-06-25T04:53:34.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.474+0000 7fc6dcff9700 1 -- 172.21.15.57:0/3566112484 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v77) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc6d8046a60 con 0x7fc6e00b2540 2021-06-25T04:53:34.482 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:53:34.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6c0055340 msgr2=0x7fc6c0057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6c0055340 0x7fc6c0057800 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fc6d400d000 tx=0x7fc6d4009040).stop 2021-06-25T04:53:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/3566112484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e00b2540 msgr2=0x7fc6e00b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e00b2540 0x7fc6e00b4210 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fc6d8001110 tx=0x7fc6d80079a0).stop 2021-06-25T04:53:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/3566112484 shutdown_connections 2021-06-25T04:53:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6c0055340 0x7fc6c0057800 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e00b2540 0x7fc6e00b4210 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc6e00affd0 0x7fc6e00b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 --2- 172.21.15.57:0/3566112484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6e00afb90 0x7fc6e00a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/3566112484 >> 172.21.15.57:0/3566112484 conn(0x7fc6e0060140 msgr2=0x7fc6e0148680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:34.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/3566112484 shutdown_connections 2021-06-25T04:53:34.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.478+0000 7fc6e4b8c700 1 -- 172.21.15.57:0/3566112484 wait complete. 2021-06-25T04:53:34.499 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:53:34.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.602+0000 7f982bfff700 1 Processor -- start 2021-06-25T04:53:34.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.602+0000 7f982bfff700 1 -- start start 2021-06-25T04:53:34.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.602+0000 7f982bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f982c0b7330 0x7f982c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.602+0000 7f982bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0aabe0 0x7f982c064b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.602+0000 7f982bfff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c0b2340 con 0x7f982c0b3020 2021-06-25T04:53:34.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.602+0000 7f982bfff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c144210 con 0x7f982c0b7330 2021-06-25T04:53:34.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.602+0000 7f982bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0b3530 con 0x7f982c0aabe0 2021-06-25T04:53:34.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982affd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f982c0b7330 0x7f982c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982b7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0aabe0 0x7f982c064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982a7fc700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f982c0b3020 0x7f982c13e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:57602/0 (socket says 172.21.15.57:57602) 2021-06-25T04:53:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982a7fc700 1 -- 172.21.15.57:0/2651323502 learned_addr learned my addr 172.21.15.57:0/2651323502 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f9829ffb700 1 -- 172.21.15.57:0/2651323502 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595549199 0 0) 0x7f982c0b2340 con 0x7f982c0b3020 2021-06-25T04:53:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982b7fe700 1 -- 172.21.15.57:0/2651323502 >> v2:172.21.15.87:3300/0 conn(0x7f982c0b7330 msgr2=0x7f982c0b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982b7fe700 1 --2- 172.21.15.57:0/2651323502 >> v2:172.21.15.87:3300/0 conn(0x7f982c0b7330 0x7f982c0b7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982b7fe700 1 -- 172.21.15.57:0/2651323502 >> v1:172.21.15.87:6789/0 conn(0x7f982c0b3020 legacy=0x7f982c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982b7fe700 1 -- 172.21.15.57:0/2651323502 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0b2570 con 0x7f982c0aabe0 2021-06-25T04:53:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982b7fe700 1 --2- 172.21.15.57:0/2651323502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0aabe0 0x7f982c064b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f981c002f70 tx=0x7f981c006df0).ready entity=mon.2 client_cookie=e3ffdab454e31009 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f9829ffb700 1 -- 172.21.15.57:0/2651323502 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f981c00d570 con 0x7f982c0aabe0 2021-06-25T04:53:34.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f9829ffb700 1 -- 172.21.15.57:0/2651323502 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c000e90 con 0x7f982c0aabe0 2021-06-25T04:53:34.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f9829ffb700 1 -- 172.21.15.57:0/2651323502 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f981c00d8c0 con 0x7f982c0aabe0 2021-06-25T04:53:34.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982bfff700 1 -- 172.21.15.57:0/2651323502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0aabe0 msgr2=0x7f982c064b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982bfff700 1 --2- 172.21.15.57:0/2651323502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0aabe0 0x7f982c064b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f981c002f70 tx=0x7f981c006df0).stop 2021-06-25T04:53:34.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982bfff700 1 -- 172.21.15.57:0/2651323502 shutdown_connections 2021-06-25T04:53:34.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982bfff700 1 --2- 172.21.15.57:0/2651323502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0aabe0 0x7f982c064b60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982bfff700 1 --2- 172.21.15.57:0/2651323502 >> v2:172.21.15.87:3300/0 conn(0x7f982c0b7330 0x7f982c0b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982bfff700 1 -- 172.21.15.57:0/2651323502 >> 172.21.15.57:0/2651323502 conn(0x7f982c05f670 msgr2=0x7f982c05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:34.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982bfff700 1 -- 172.21.15.57:0/2651323502 shutdown_connections 2021-06-25T04:53:34.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.606+0000 7f982bfff700 1 -- 172.21.15.57:0/2651323502 wait complete. 2021-06-25T04:53:34.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982bfff700 1 Processor -- start 2021-06-25T04:53:34.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982bfff700 1 -- start start 2021-06-25T04:53:34.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0aabe0 0x7f982c13f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f982c0b3020 0x7f982c1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f982c0b7330 0x7f982c1537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c148510 con 0x7f982c0b3020 2021-06-25T04:53:34.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c146c00 con 0x7f982c0b7330 2021-06-25T04:53:34.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c146ea0 con 0x7f982c0aabe0 2021-06-25T04:53:34.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f982c0b3020 0x7f982c1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f982c0b3020 0x7f982c1532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39642/0 (socket says 172.21.15.57:39642) 2021-06-25T04:53:34.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982a7fc700 1 -- 172.21.15.57:0/3040666348 learned_addr learned my addr 172.21.15.57:0/3040666348 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:34.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982affd700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0aabe0 0x7f982c13f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982b7fe700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f982c0b7330 0x7f982c1537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982a7fc700 1 -- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0aabe0 msgr2=0x7f982c13f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982a7fc700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0aabe0 0x7f982c13f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982a7fc700 1 -- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f982c0b7330 msgr2=0x7f982c1537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982a7fc700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f982c0b7330 0x7f982c1537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982a7fc700 1 -- 172.21.15.57:0/3040666348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c00b180 con 0x7f982c0b3020 2021-06-25T04:53:34.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982a7fc700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f982c0b3020 0x7f982c1532d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f9824001250 tx=0x7f9824007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f9823fff700 1 -- 172.21.15.57:0/3040666348 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9824005bf0 con 0x7f982c0b3020 2021-06-25T04:53:34.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f9823fff700 1 -- 172.21.15.57:0/3040666348 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9824005d50 con 0x7f982c0b3020 2021-06-25T04:53:34.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982bfff700 1 -- 172.21.15.57:0/3040666348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c147140 con 0x7f982c0b3020 2021-06-25T04:53:34.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f9823fff700 1 -- 172.21.15.57:0/3040666348 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98240072c0 con 0x7f982c0b3020 2021-06-25T04:53:34.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.610+0000 7f982bfff700 1 -- 172.21.15.57:0/3040666348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c05fa50 con 0x7f982c0b3020 2021-06-25T04:53:34.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.614+0000 7f982bfff700 1 -- 172.21.15.57:0/3040666348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c1482b0 con 0x7f982c0b3020 2021-06-25T04:53:34.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.614+0000 7f9823fff700 1 -- 172.21.15.57:0/3040666348 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9824010070 con 0x7f982c0b3020 2021-06-25T04:53:34.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.614+0000 7f9823fff700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9810055510 0x7f98100579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.614+0000 7f9823fff700 1 -- 172.21.15.57:0/3040666348 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f982406dc20 con 0x7f982c0b3020 2021-06-25T04:53:34.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.614+0000 7f982affd700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9810055510 0x7f98100579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.614+0000 7f982affd700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9810055510 0x7f98100579d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f9814006000 tx=0x7f9814006d90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.618+0000 7f9823fff700 1 -- 172.21.15.57:0/3040666348 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9824043d30 con 0x7f982c0b3020 2021-06-25T04:53:34.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.746+0000 7f982bfff700 1 -- 172.21.15.57:0/3040666348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f982c1472d0 con 0x7f982c0b3020 2021-06-25T04:53:34.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f9823fff700 1 -- 172.21.15.57:0/3040666348 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7f98240220a0 con 0x7f982c0b3020 2021-06-25T04:53:34.754 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:53:34.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 -- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9810055510 msgr2=0x7f98100579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9810055510 0x7f98100579d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f9814006000 tx=0x7f9814006d90).stop 2021-06-25T04:53:34.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 -- 172.21.15.57:0/3040666348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f982c0b3020 msgr2=0x7f982c1532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f982c0b3020 0x7f982c1532d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f9824001250 tx=0x7f9824007e20).stop 2021-06-25T04:53:34.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 -- 172.21.15.57:0/3040666348 shutdown_connections 2021-06-25T04:53:34.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9810055510 0x7f98100579d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f982c0b7330 0x7f982c1537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f982c0b3020 0x7f982c1532d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 --2- 172.21.15.57:0/3040666348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0aabe0 0x7f982c13f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 -- 172.21.15.57:0/3040666348 >> 172.21.15.57:0/3040666348 conn(0x7f982c05f670 msgr2=0x7f982c13d690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:34.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 -- 172.21.15.57:0/3040666348 shutdown_connections 2021-06-25T04:53:34.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.750+0000 7f982bfff700 1 -- 172.21.15.57:0/3040666348 wait complete. 2021-06-25T04:53:34.767 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:53:34.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.870+0000 7ff05759e700 1 Processor -- start 2021-06-25T04:53:34.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.870+0000 7ff05759e700 1 -- start start 2021-06-25T04:53:34.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff0580affd0 0x7ff0580a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580afb90 0x7ff0580a8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0580a7080 con 0x7ff0580b2540 2021-06-25T04:53:34.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0580a72b0 con 0x7ff0580affd0 2021-06-25T04:53:34.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580a7550 con 0x7ff0580afb90 2021-06-25T04:53:34.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff056d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580afb90 0x7ff0580a8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff055d9b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff0580affd0 0x7ff0580a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff056d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580afb90 0x7ff0580a8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:50816/0 (socket says 172.21.15.57:50816) 2021-06-25T04:53:34.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff056d9d700 1 -- 172.21.15.57:0/2041341423 learned_addr learned my addr 172.21.15.57:0/2041341423 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:34.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff055d9b700 1 -- 172.21.15.57:0/2041341423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580afb90 msgr2=0x7ff0580a8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff055d9b700 1 --2- 172.21.15.57:0/2041341423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580afb90 0x7ff0580a8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff055d9b700 1 -- 172.21.15.57:0/2041341423 >> v1:172.21.15.87:6789/0 conn(0x7ff0580b2540 legacy=0x7ff05814ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff055d9b700 1 -- 172.21.15.57:0/2041341423 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580a77f0 con 0x7ff0580affd0 2021-06-25T04:53:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff056d9d700 1 --2- 172.21.15.57:0/2041341423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580afb90 0x7ff0580a8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff055d9b700 1 --2- 172.21.15.57:0/2041341423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0580affd0 0x7ff0580a8370 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7ff0480032f0 tx=0x7ff0480091d0).ready entity=mon.1 client_cookie=7eab68bbd4264485 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05559a700 1 -- 172.21.15.57:0/2041341423 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04800b6c0 con 0x7ff0580affd0 2021-06-25T04:53:34.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05559a700 1 -- 172.21.15.57:0/2041341423 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04800b820 con 0x7ff0580affd0 2021-06-25T04:53:34.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05559a700 1 -- 172.21.15.57:0/2041341423 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04800b990 con 0x7ff0580affd0 2021-06-25T04:53:34.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 -- 172.21.15.57:0/2041341423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0580affd0 msgr2=0x7ff0580a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 --2- 172.21.15.57:0/2041341423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0580affd0 0x7ff0580a8370 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7ff0480032f0 tx=0x7ff0480091d0).stop 2021-06-25T04:53:34.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 -- 172.21.15.57:0/2041341423 shutdown_connections 2021-06-25T04:53:34.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 --2- 172.21.15.57:0/2041341423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580afb90 0x7ff0580a8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 --2- 172.21.15.57:0/2041341423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0580affd0 0x7ff0580a8370 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 -- 172.21.15.57:0/2041341423 >> 172.21.15.57:0/2041341423 conn(0x7ff058060140 msgr2=0x7ff0580b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:34.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 -- 172.21.15.57:0/2041341423 shutdown_connections 2021-06-25T04:53:34.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 -- 172.21.15.57:0/2041341423 wait complete. 2021-06-25T04:53:34.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.874+0000 7ff05759e700 1 Processor -- start 2021-06-25T04:53:34.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05759e700 1 -- start start 2021-06-25T04:53:34.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0580afb90 0x7ff0580ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0580affd0 0x7ff0580a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580b2540 0x7ff05814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580b59c0 con 0x7ff0580afb90 2021-06-25T04:53:34.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580b4de0 con 0x7ff0580affd0 2021-06-25T04:53:34.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580aef40 con 0x7ff0580b2540 2021-06-25T04:53:34.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0580afb90 0x7ff0580ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff055d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0580affd0 0x7ff0580a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0580afb90 0x7ff0580ae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39656/0 (socket says 172.21.15.57:39656) 2021-06-25T04:53:34.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05659c700 1 -- 172.21.15.57:0/219796411 learned_addr learned my addr 172.21.15.57:0/219796411 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:34.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff056d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580b2540 0x7ff05814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05659c700 1 -- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580b2540 msgr2=0x7ff05814b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05659c700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580b2540 0x7ff05814b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05659c700 1 -- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0580affd0 msgr2=0x7ff0580a94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:34.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05659c700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0580affd0 0x7ff0580a94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:34.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05659c700 1 -- 172.21.15.57:0/219796411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05000b1e0 con 0x7ff0580afb90 2021-06-25T04:53:34.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05659c700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0580afb90 0x7ff0580ae2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7ff05806b780 tx=0x7ff04c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff0477fe700 1 -- 172.21.15.57:0/219796411 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04c007e70 con 0x7ff0580afb90 2021-06-25T04:53:34.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff0477fe700 1 -- 172.21.15.57:0/219796411 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c007030 con 0x7ff0580afb90 2021-06-25T04:53:34.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05759e700 1 -- 172.21.15.57:0/219796411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff048009470 con 0x7ff0580afb90 2021-06-25T04:53:34.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff0477fe700 1 -- 172.21.15.57:0/219796411 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04c007390 con 0x7ff0580afb90 2021-06-25T04:53:34.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.878+0000 7ff05759e700 1 -- 172.21.15.57:0/219796411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0580ae7e0 con 0x7ff0580afb90 2021-06-25T04:53:34.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.882+0000 7ff0477fe700 1 -- 172.21.15.57:0/219796411 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff04c010030 con 0x7ff0580afb90 2021-06-25T04:53:34.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.882+0000 7ff05759e700 1 -- 172.21.15.57:0/219796411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05815aa40 con 0x7ff0580afb90 2021-06-25T04:53:34.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.882+0000 7ff0477fe700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff034055450 0x7ff034057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:34.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.882+0000 7ff0477fe700 1 -- 172.21.15.57:0/219796411 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff04c06d960 con 0x7ff0580afb90 2021-06-25T04:53:34.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.882+0000 7ff055d9b700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff034055450 0x7ff034057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:34.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.882+0000 7ff055d9b700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff034055450 0x7ff034057910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7ff04801b000 tx=0x7ff048016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:34.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:34.886+0000 7ff0477fe700 1 -- 172.21.15.57:0/219796411 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff04c043b10 con 0x7ff0580afb90 2021-06-25T04:53:35.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.018+0000 7ff05759e700 1 -- 172.21.15.57:0/219796411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff058057310 con 0x7ff0580afb90 2021-06-25T04:53:35.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.018+0000 7ff0477fe700 1 -- 172.21.15.57:0/219796411 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff04c047130 con 0x7ff0580afb90 2021-06-25T04:53:35.025 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:53:35.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 -- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff034055450 msgr2=0x7ff034057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff034055450 0x7ff034057910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7ff04801b000 tx=0x7ff048016000).stop 2021-06-25T04:53:35.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 -- 172.21.15.57:0/219796411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0580afb90 msgr2=0x7ff0580ae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0580afb90 0x7ff0580ae2f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7ff05806b780 tx=0x7ff04c007c00).stop 2021-06-25T04:53:35.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 -- 172.21.15.57:0/219796411 shutdown_connections 2021-06-25T04:53:35.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff034055450 0x7ff034057910 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580b2540 0x7ff05814b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0580affd0 0x7ff0580a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 --2- 172.21.15.57:0/219796411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0580afb90 0x7ff0580ae2f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 -- 172.21.15.57:0/219796411 >> 172.21.15.57:0/219796411 conn(0x7ff058060140 msgr2=0x7ff058144d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:35.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 -- 172.21.15.57:0/219796411 shutdown_connections 2021-06-25T04:53:35.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.022+0000 7ff05759e700 1 -- 172.21.15.57:0/219796411 wait complete. 2021-06-25T04:53:35.039 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:53:35.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.146+0000 7f2c43ec3700 1 Processor -- start 2021-06-25T04:53:35.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 -- start start 2021-06-25T04:53:35.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c3c0b26d0 0x7f2c3c1430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:35.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c061190 0x7f2c3c1435c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:35.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3c0648d0 con 0x7f2c3c05ff20 2021-06-25T04:53:35.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c064b70 con 0x7f2c3c0b26d0 2021-06-25T04:53:35.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c064e10 con 0x7f2c3c061190 2021-06-25T04:53:35.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c4145e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c3c0b26d0 0x7f2c3c1430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:35.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c4145e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c3c0b26d0 0x7f2c3c1430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39664/0 (socket says 172.21.15.57:39664) 2021-06-25T04:53:35.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c4145e700 1 -- 172.21.15.57:0/1184245665 learned_addr learned my addr 172.21.15.57:0/1184245665 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:35.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c42460700 1 --2- 172.21.15.57:0/1184245665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c061190 0x7f2c3c1435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:35.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c4145e700 1 -- 172.21.15.57:0/1184245665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c061190 msgr2=0x7f2c3c1435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:35.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c4145e700 1 --2- 172.21.15.57:0/1184245665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c061190 0x7f2c3c1435c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c4145e700 1 -- 172.21.15.57:0/1184245665 >> v1:172.21.15.87:6789/0 conn(0x7f2c3c05ff20 legacy=0x7f2c3c140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c4145e700 1 -- 172.21.15.57:0/1184245665 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c0650b0 con 0x7f2c3c0b26d0 2021-06-25T04:53:35.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c42460700 1 --2- 172.21.15.57:0/1184245665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c061190 0x7f2c3c1435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:35.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c4145e700 1 --2- 172.21.15.57:0/1184245665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0b26d0 0x7f2c3c1430d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f2c38002f70 tx=0x7f2c38006eb0).ready entity=mon.0 client_cookie=e4a9b7b0f21268da server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:35.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c40c5d700 1 -- 172.21.15.57:0/1184245665 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c3800d5c0 con 0x7f2c3c0b26d0 2021-06-25T04:53:35.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c40c5d700 1 -- 172.21.15.57:0/1184245665 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c38000e90 con 0x7f2c3c0b26d0 2021-06-25T04:53:35.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c40c5d700 1 -- 172.21.15.57:0/1184245665 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c3800d950 con 0x7f2c3c0b26d0 2021-06-25T04:53:35.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 -- 172.21.15.57:0/1184245665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0b26d0 msgr2=0x7f2c3c1430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 --2- 172.21.15.57:0/1184245665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0b26d0 0x7f2c3c1430d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f2c38002f70 tx=0x7f2c38006eb0).stop 2021-06-25T04:53:35.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 -- 172.21.15.57:0/1184245665 shutdown_connections 2021-06-25T04:53:35.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 --2- 172.21.15.57:0/1184245665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c061190 0x7f2c3c1435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 --2- 172.21.15.57:0/1184245665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0b26d0 0x7f2c3c1430d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 -- 172.21.15.57:0/1184245665 >> 172.21.15.57:0/1184245665 conn(0x7f2c3c05cf20 msgr2=0x7f2c3c05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:35.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 -- 172.21.15.57:0/1184245665 shutdown_connections 2021-06-25T04:53:35.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.150+0000 7f2c43ec3700 1 -- 172.21.15.57:0/1184245665 wait complete. 2021-06-25T04:53:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c43ec3700 1 Processor -- start 2021-06-25T04:53:35.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c43ec3700 1 -- start start 2021-06-25T04:53:35.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c43ec3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c05ff20 0x7f2c3c13fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:35.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c43ec3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c061190 0x7f2c3c0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:35.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c43ec3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c3c0b26d0 0x7f2c3c0b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:35.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c43ec3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c144c30 con 0x7f2c3c061190 2021-06-25T04:53:35.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c43ec3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c141630 con 0x7f2c3c0b26d0 2021-06-25T04:53:35.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c43ec3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c1418d0 con 0x7f2c3c05ff20 2021-06-25T04:53:35.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c4145e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c061190 0x7f2c3c0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:35.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c41c5f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c05ff20 0x7f2c3c13fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c41c5f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c05ff20 0x7f2c3c13fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:50832/0 (socket says 172.21.15.57:50832) 2021-06-25T04:53:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c4145e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c061190 0x7f2c3c0b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39670/0 (socket says 172.21.15.57:39670) 2021-06-25T04:53:35.174 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c41c5f700 1 -- 172.21.15.57:0/3183364857 learned_addr learned my addr 172.21.15.57:0/3183364857 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:35.174 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c42460700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c3c0b26d0 0x7f2c3c0b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:35.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c4145e700 1 -- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c05ff20 msgr2=0x7f2c3c13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c4145e700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c05ff20 0x7f2c3c13fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c4145e700 1 -- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c3c0b26d0 msgr2=0x7f2c3c0b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c4145e700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c3c0b26d0 0x7f2c3c0b62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c4145e700 1 -- 172.21.15.57:0/3183364857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3800b1e0 con 0x7f2c3c061190 2021-06-25T04:53:35.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c4145e700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c061190 0x7f2c3c0b5e00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f2c38002f70 tx=0x7f2c38015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:35.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c2affd700 1 -- 172.21.15.57:0/3183364857 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c38021070 con 0x7f2c3c061190 2021-06-25T04:53:35.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c2affd700 1 -- 172.21.15.57:0/3183364857 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c38000e90 con 0x7f2c3c061190 2021-06-25T04:53:35.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c43ec3700 1 -- 172.21.15.57:0/3183364857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c1444f0 con 0x7f2c3c061190 2021-06-25T04:53:35.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.154+0000 7f2c2affd700 1 -- 172.21.15.57:0/3183364857 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c380118d0 con 0x7f2c3c061190 2021-06-25T04:53:35.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.158+0000 7f2c43ec3700 1 -- 172.21.15.57:0/3183364857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c0b67e0 con 0x7f2c3c061190 2021-06-25T04:53:35.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.158+0000 7f2c43ec3700 1 -- 172.21.15.57:0/3183364857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c057310 con 0x7f2c3c061190 2021-06-25T04:53:35.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.158+0000 7f2c2affd700 1 -- 172.21.15.57:0/3183364857 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2c3800f070 con 0x7f2c3c061190 2021-06-25T04:53:35.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.158+0000 7f2c2affd700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c1c055510 0x7f2c1c0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:35.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.158+0000 7f2c2affd700 1 -- 172.21.15.57:0/3183364857 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2c3806f230 con 0x7f2c3c061190 2021-06-25T04:53:35.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.158+0000 7f2c41c5f700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c1c055510 0x7f2c1c0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:35.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.158+0000 7f2c41c5f700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c1c055510 0x7f2c1c0579d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f2c2c00d000 tx=0x7f2c2c007c50).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:35.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.166+0000 7f2c2affd700 1 -- 172.21.15.57:0/3183364857 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2c38045340 con 0x7f2c3c061190 2021-06-25T04:53:35.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.294+0000 7f2c43ec3700 1 -- 172.21.15.57:0/3183364857 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c3c0698a0 con 0x7f2c3c061190 2021-06-25T04:53:35.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c2affd700 1 -- 172.21.15.57:0/3183364857 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2c38048960 con 0x7f2c3c061190 2021-06-25T04:53:35.302 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:53:35.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 -- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c1c055510 msgr2=0x7f2c1c0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c1c055510 0x7f2c1c0579d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f2c2c00d000 tx=0x7f2c2c007c50).stop 2021-06-25T04:53:35.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 -- 172.21.15.57:0/3183364857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c061190 msgr2=0x7f2c3c0b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c061190 0x7f2c3c0b5e00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f2c38002f70 tx=0x7f2c38015000).stop 2021-06-25T04:53:35.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 -- 172.21.15.57:0/3183364857 shutdown_connections 2021-06-25T04:53:35.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c1c055510 0x7f2c1c0579d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c3c0b26d0 0x7f2c3c0b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c061190 0x7f2c3c0b5e00 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 --2- 172.21.15.57:0/3183364857 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c3c05ff20 0x7f2c3c13fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 -- 172.21.15.57:0/3183364857 >> 172.21.15.57:0/3183364857 conn(0x7f2c3c05cf20 msgr2=0x7f2c3c1486a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:35.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 -- 172.21.15.57:0/3183364857 shutdown_connections 2021-06-25T04:53:35.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.298+0000 7f2c43ec3700 1 -- 172.21.15.57:0/3183364857 wait complete. 2021-06-25T04:53:35.320 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:53:35.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:35.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff759e700 1 Processor -- start 2021-06-25T04:53:35.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff759e700 1 -- start start 2021-06-25T04:53:35.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ff80aea70 0x7f8ff80aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:35.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff80affc0 con 0x7f8ff80b0440 2021-06-25T04:53:35.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff759e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff80ad060 con 0x7f8ff8146e90 2021-06-25T04:53:35.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80adf00 con 0x7f8ff80aea70 2021-06-25T04:53:35.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff5d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8ff80b0440 0x7f8ff8146780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56894/0 (socket says 172.21.15.57:56894) 2021-06-25T04:53:35.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff5d9b700 1 -- 172.21.15.57:0/3118781863 learned_addr learned my addr 172.21.15.57:0/3118781863 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:53:35.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff659c700 1 --2- 172.21.15.57:0/3118781863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ff80aea70 0x7f8ff80aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:35.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff659c700 1 -- 172.21.15.57:0/3118781863 >> v1:172.21.15.87:6789/0 conn(0x7f8ff8146e90 legacy=0x7f8ff813ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff659c700 1 -- 172.21.15.57:0/3118781863 >> v1:172.21.15.57:6789/0 conn(0x7f8ff80b0440 legacy=0x7f8ff8146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.414+0000 7f8ff659c700 1 -- 172.21.15.57:0/3118781863 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8147300 con 0x7f8ff80aea70 2021-06-25T04:53:35.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.418+0000 7f8ff659c700 1 --2- 172.21.15.57:0/3118781863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ff80aea70 0x7f8ff80aee50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8fe80032f0 tx=0x7f8fe80091d0).ready entity=mon.2 client_cookie=3d8a195bf4e62b04 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:35.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.418+0000 7f8ff559a700 1 -- 172.21.15.57:0/3118781863 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe800b8a0 con 0x7f8ff80aea70 2021-06-25T04:53:35.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.418+0000 7f8ff559a700 1 -- 172.21.15.57:0/3118781863 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe800ba00 con 0x7f8ff80aea70 2021-06-25T04:53:35.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.418+0000 7f8ff559a700 1 -- 172.21.15.57:0/3118781863 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe800bb70 con 0x7f8ff80aea70 2021-06-25T04:53:35.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.418+0000 7f8ff759e700 1 -- 172.21.15.57:0/3118781863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ff80aea70 msgr2=0x7f8ff80aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.418+0000 7f8ff759e700 1 --2- 172.21.15.57:0/3118781863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ff80aea70 0x7f8ff80aee50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8fe80032f0 tx=0x7f8fe80091d0).stop 2021-06-25T04:53:35.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.418+0000 7f8ff759e700 1 -- 172.21.15.57:0/3118781863 shutdown_connections 2021-06-25T04:53:35.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.418+0000 7f8ff759e700 1 --2- 172.21.15.57:0/3118781863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ff80aea70 0x7f8ff80aee50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.418+0000 7f8ff759e700 1 -- 172.21.15.57:0/3118781863 >> 172.21.15.57:0/3118781863 conn(0x7f8ff80611f0 msgr2=0x7f8ff8062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:35.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.418+0000 7f8ff759e700 1 -- 172.21.15.57:0/3118781863 shutdown_connections 2021-06-25T04:53:35.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.418+0000 7f8ff759e700 1 -- 172.21.15.57:0/3118781863 wait complete. 2021-06-25T04:53:35.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff759e700 1 Processor -- start 2021-06-25T04:53:35.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff759e700 1 -- start start 2021-06-25T04:53:35.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff80aea70 0x7f8ff813dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:35.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ff80b0440 0x7f8ff81489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:35.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ff8146e90 0x7f8ff81560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:35.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff8141730 con 0x7f8ff80b0440 2021-06-25T04:53:35.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff805eef0 con 0x7f8ff80aea70 2021-06-25T04:53:35.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff81414d0 con 0x7f8ff8146e90 2021-06-25T04:53:35.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff5d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ff80b0440 0x7f8ff81489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:35.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff5d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ff80b0440 0x7f8ff81489f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39684/0 (socket says 172.21.15.57:39684) 2021-06-25T04:53:35.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff5d9b700 1 -- 172.21.15.57:0/341243146 learned_addr learned my addr 172.21.15.57:0/341243146 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:35.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff6d9d700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ff8146e90 0x7f8ff81560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:35.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff659c700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff80aea70 0x7f8ff813dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:35.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff5d9b700 1 -- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ff8146e90 msgr2=0x7f8ff81560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff5d9b700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ff8146e90 0x7f8ff81560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff5d9b700 1 -- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff80aea70 msgr2=0x7f8ff813dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff5d9b700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff80aea70 0x7f8ff813dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff5d9b700 1 -- 172.21.15.57:0/341243146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8009470 con 0x7f8ff80b0440 2021-06-25T04:53:35.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff659c700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff80aea70 0x7f8ff813dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:53:35.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff5d9b700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ff80b0440 0x7f8ff81489f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f8ff80634c0 tx=0x7f8fe0007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:35.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8fef7fe700 1 -- 172.21.15.57:0/341243146 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe000ce30 con 0x7f8ff80b0440 2021-06-25T04:53:35.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff759e700 1 -- 172.21.15.57:0/341243146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff8148040 con 0x7f8ff80b0440 2021-06-25T04:53:35.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8fef7fe700 1 -- 172.21.15.57:0/341243146 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe00072e0 con 0x7f8ff80b0440 2021-06-25T04:53:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8fef7fe700 1 -- 172.21.15.57:0/341243146 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe0005800 con 0x7f8ff80b0440 2021-06-25T04:53:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff759e700 1 -- 172.21.15.57:0/341243146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff8148550 con 0x7f8ff80b0440 2021-06-25T04:53:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.422+0000 7f8ff759e700 1 -- 172.21.15.57:0/341243146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff8057310 con 0x7f8ff80b0440 2021-06-25T04:53:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.426+0000 7f8fef7fe700 1 -- 172.21.15.57:0/341243146 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8fe0010070 con 0x7f8ff80b0440 2021-06-25T04:53:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.426+0000 7f8fef7fe700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fdc055450 0x7f8fdc057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:35.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.426+0000 7f8fef7fe700 1 -- 172.21.15.57:0/341243146 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8fe006d680 con 0x7f8ff80b0440 2021-06-25T04:53:35.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.426+0000 7f8ff659c700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fdc055450 0x7f8fdc057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:35.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.426+0000 7f8ff659c700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fdc055450 0x7f8fdc057910 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f8fe8019000 tx=0x7f8fe8016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:35.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.430+0000 7f8fef7fe700 1 -- 172.21.15.57:0/341243146 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8fe00436a0 con 0x7f8ff80b0440 2021-06-25T04:53:35.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.590+0000 7f8ff759e700 1 -- 172.21.15.57:0/341243146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ff805f200 con 0x7f8ff80b0440 2021-06-25T04:53:35.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.590+0000 7f8fef7fe700 1 -- 172.21.15.57:0/341243146 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f8fe0018070 con 0x7f8ff80b0440 2021-06-25T04:53:35.597 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:35.597 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2942430957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2942430957},{"type":"v1","addr":"172.21.15.87:6835","nonce":2942430957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34},{"gid":6184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/4012056699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4012056699},{"type":"v1","addr":"172.21.15.57:6833","nonce":4012056699}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:53:27.269151+0000","modified":"2021-06-25T04:53:28.272583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2725183825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2725183825},{"type":"v1","addr":"172.21.15.57:6835","nonce":2725183825}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-06-25T04:53:35.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 -- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fdc055450 msgr2=0x7f8fdc057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fdc055450 0x7f8fdc057910 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f8fe8019000 tx=0x7f8fe8016000).stop 2021-06-25T04:53:35.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 -- 172.21.15.57:0/341243146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ff80b0440 msgr2=0x7f8ff81489f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:35.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ff80b0440 0x7f8ff81489f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f8ff80634c0 tx=0x7f8fe0007c10).stop 2021-06-25T04:53:35.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 -- 172.21.15.57:0/341243146 shutdown_connections 2021-06-25T04:53:35.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fdc055450 0x7f8fdc057910 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ff8146e90 0x7f8ff81560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ff80b0440 0x7f8ff81489f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 --2- 172.21.15.57:0/341243146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff80aea70 0x7f8ff813dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:35.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 -- 172.21.15.57:0/341243146 >> 172.21.15.57:0/341243146 conn(0x7f8ff80611f0 msgr2=0x7f8ff8146760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:35.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 -- 172.21.15.57:0/341243146 shutdown_connections 2021-06-25T04:53:35.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:35.594+0000 7f8ff759e700 1 -- 172.21.15.57:0/341243146 wait complete. 2021-06-25T04:53:35.604 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2021-06-25T04:53:35.918 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:53:27.269151+0000', 'modified': '2021-06-25T04:53:28.272583+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6285': {'gid': 6285, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2725183825', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2725183825}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2725183825}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:53:35.919 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:53:35.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:53:36.039 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":6285,"want_state":"up:active","state":"up:active","rank_uptime":8.7562235180000005,"mdsmap_epoch":36,"osdmap_epoch":77,"osdmap_epoch_barrier":77,"uptime":13.057841338999999} 2021-06-25T04:53:36.039 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 6285, "mdsmap_epoch": 36, "osdmap_epoch": 77, "osdmap_epoch_barrier": 77, "rank_uptime": 8.756223518, "state": "up:active", "uptime": 13.057841339, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:53:36.040 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:53:36.040 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-06-25T04:53:36.041 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi161.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-06-25T04:53:36.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:36.042 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:53:36.050 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:53:36.111 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:53:36.111 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:53:36.122 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:53:36.122 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:53:36.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:36.124 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:53:36.130 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:53:36.130 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:53:36.133 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:53:36.152 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:53:36.153 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:53:36.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:2021-06-25T04:53:36.202+0000 7f60c7abb080 -1 init, newargv = 0x55a23672bb10 newargc=9ceph-fuse[ 2021-06-25T04:53:36.206 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:14534]: starting ceph client 2021-06-25T04:53:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:53:36.215 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:53:36.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:36.216 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:53:36.217 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14534]: starting fuse 2021-06-25T04:53:36.222 INFO:teuthology.orchestra.run.smithi161.stdout:52 2021-06-25T04:53:36.223 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:53:36.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:36.224 DEBUG:teuthology.orchestra.run.smithi161:> sudo python3 -c ' 2021-06-25T04:53:36.224 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2021-06-25T04:53:36.225 DEBUG:teuthology.orchestra.run.smithi161:> import re 2021-06-25T04:53:36.225 DEBUG:teuthology.orchestra.run.smithi161:> import os 2021-06-25T04:53:36.225 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2021-06-25T04:53:36.226 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:53:36.226 DEBUG:teuthology.orchestra.run.smithi161:> def find_socket(client_name): 2021-06-25T04:53:36.227 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-06-25T04:53:36.227 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2021-06-25T04:53:36.228 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:53:36.228 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2021-06-25T04:53:36.228 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2021-06-25T04:53:36.229 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2021-06-25T04:53:36.229 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2021-06-25T04:53:36.230 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:53:36.230 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2021-06-25T04:53:36.230 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:53:36.231 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:53:36.231 DEBUG:teuthology.orchestra.run.smithi161:> return f 2021-06-25T04:53:36.232 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:53:36.232 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:53:36.232 DEBUG:teuthology.orchestra.run.smithi161:> print(find_socket("client.1")) 2021-06-25T04:53:36.233 DEBUG:teuthology.orchestra.run.smithi161:> ' 2021-06-25T04:53:36.274 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.14534.asok 2021-06-25T04:53:36.279 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14534.asok 2021-06-25T04:53:36.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:36.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14534.asok status 2021-06-25T04:53:36.363 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2021-06-25T04:53:36.363 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2021-06-25T04:53:36.364 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:53:36.364 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:53:36.364 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2021-06-25T04:53:36.364 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2021-06-25T04:53:36.365 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-06-25T04:53:36.365 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "14534", 2021-06-25T04:53:36.365 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2021-06-25T04:53:36.365 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:53:36.366 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2021-06-25T04:53:36.366 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2021-06-25T04:53:36.366 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 6397, 2021-06-25T04:53:36.367 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2021-06-25T04:53:36.367 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2021-06-25T04:53:36.368 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2021-06-25T04:53:36.368 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 6397 2021-06-25T04:53:36.368 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:53:36.368 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:53:36.368 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:53:36.369 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:53:36.369 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 2549610586 2021-06-25T04:53:36.369 INFO:teuthology.orchestra.run.smithi161.stdout: } 2021-06-25T04:53:36.369 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:53:36.370 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:53:36.370 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:53:36.370 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:53:36.370 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 2549610586 2021-06-25T04:53:36.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:53:36.371 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.6397 172.21.15.161:0/2549610586", 2021-06-25T04:53:36.371 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "172.21.15.161:0/2549610586", 2021-06-25T04:53:36.371 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2021-06-25T04:53:36.372 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 36, 2021-06-25T04:53:36.372 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 77, 2021-06-25T04:53:36.372 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:53:36.372 INFO:teuthology.orchestra.run.smithi161.stdout: "blacklisted": false, 2021-06-25T04:53:36.372 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2021-06-25T04:53:36.373 INFO:teuthology.orchestra.run.smithi161.stdout:} 2021-06-25T04:53:36.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:36.374 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:53:36.375 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:53:36.383 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:53:36.384 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:53:36.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:36.385 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:53:36.445 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:36.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.550+0000 7f1c3e21b700 1 Processor -- start 2021-06-25T04:53:36.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.550+0000 7f1c3e21b700 1 -- start start 2021-06-25T04:53:36.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1c380aad40 0x7f1c380672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c380b4d10 0x7f1c380b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c38065920 con 0x7f1c380ab120 2021-06-25T04:53:36.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c38064ed0 con 0x7f1c380aad40 2021-06-25T04:53:36.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c380b3ca0 con 0x7f1c380b4d10 2021-06-25T04:53:36.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3d219700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1c380aad40 0x7f1c380672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3d219700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1c380aad40 0x7f1c380672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:48184/0 (socket says 172.21.15.57:48184) 2021-06-25T04:53:36.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3d219700 1 -- 172.21.15.57:0/2915053548 learned_addr learned my addr 172.21.15.57:0/2915053548 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:36.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3ca18700 1 --1- 172.21.15.57:0/2915053548 >> v1:172.21.15.87:6789/0 conn(0x7f1c380ab120 0x7f1c380647c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:57658/0 (socket says 172.21.15.57:57658) 2021-06-25T04:53:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3da1a700 1 --2- 172.21.15.57:0/2915053548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c380b4d10 0x7f1c380b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3d219700 1 -- 172.21.15.57:0/2915053548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c380b4d10 msgr2=0x7f1c380b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3d219700 1 --2- 172.21.15.57:0/2915053548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c380b4d10 0x7f1c380b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3d219700 1 -- 172.21.15.57:0/2915053548 >> v1:172.21.15.87:6789/0 conn(0x7f1c380ab120 legacy=0x7f1c380647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:36.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c2ffff700 1 -- 172.21.15.57:0/2915053548 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191712310 0 0) 0x7f1c38065920 con 0x7f1c380ab120 2021-06-25T04:53:36.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3d219700 1 -- 172.21.15.57:0/2915053548 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c38066e20 con 0x7f1c380aad40 2021-06-25T04:53:36.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3d219700 1 --2- 172.21.15.57:0/2915053548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c380aad40 0x7f1c380672c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f1c34002f70 tx=0x7f1c34006eb0).ready entity=mon.1 client_cookie=40cdc3830687d5f0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:36.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c2ffff700 1 -- 172.21.15.57:0/2915053548 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c3400d570 con 0x7f1c380aad40 2021-06-25T04:53:36.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c2ffff700 1 -- 172.21.15.57:0/2915053548 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c34000e90 con 0x7f1c380aad40 2021-06-25T04:53:36.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c2ffff700 1 -- 172.21.15.57:0/2915053548 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c3400d8c0 con 0x7f1c380aad40 2021-06-25T04:53:36.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 -- 172.21.15.57:0/2915053548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c380aad40 msgr2=0x7f1c380672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:36.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 --2- 172.21.15.57:0/2915053548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c380aad40 0x7f1c380672c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f1c34002f70 tx=0x7f1c34006eb0).stop 2021-06-25T04:53:36.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 -- 172.21.15.57:0/2915053548 shutdown_connections 2021-06-25T04:53:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 --2- 172.21.15.57:0/2915053548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c380b4d10 0x7f1c380b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 --2- 172.21.15.57:0/2915053548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c380aad40 0x7f1c380672c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 -- 172.21.15.57:0/2915053548 >> 172.21.15.57:0/2915053548 conn(0x7f1c38062ba0 msgr2=0x7f1c3805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 -- 172.21.15.57:0/2915053548 shutdown_connections 2021-06-25T04:53:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.554+0000 7f1c3e21b700 1 -- 172.21.15.57:0/2915053548 wait complete. 2021-06-25T04:53:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3e21b700 1 Processor -- start 2021-06-25T04:53:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3e21b700 1 -- start start 2021-06-25T04:53:36.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3e21b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c380aad40 0x7f1c380b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3e21b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c380ab120 0x7f1c38146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3e21b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c380b4d10 0x7f1c380b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3e21b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c380b7360 con 0x7f1c380b4d10 2021-06-25T04:53:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3e21b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c380b7590 con 0x7f1c380aad40 2021-06-25T04:53:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3e21b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c380b7830 con 0x7f1c380ab120 2021-06-25T04:53:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3da1a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c380b4d10 0x7f1c380b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3da1a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c380b4d10 0x7f1c380b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39698/0 (socket says 172.21.15.57:39698) 2021-06-25T04:53:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3ca18700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c380ab120 0x7f1c38146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3da1a700 1 -- 172.21.15.57:0/183607259 learned_addr learned my addr 172.21.15.57:0/183607259 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:36.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3d219700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c380aad40 0x7f1c380b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3da1a700 1 -- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c380ab120 msgr2=0x7f1c38146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:36.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3da1a700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c380ab120 0x7f1c38146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3da1a700 1 -- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c380aad40 msgr2=0x7f1c380b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3da1a700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c380aad40 0x7f1c380b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3da1a700 1 -- 172.21.15.57:0/183607259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3400b1e0 con 0x7f1c380b4d10 2021-06-25T04:53:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c3da1a700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c380b4d10 0x7f1c380b02b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f1c3000c000 tx=0x7f1c30006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:36.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.558+0000 7f1c2e7fc700 1 -- 172.21.15.57:0/183607259 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c30011750 con 0x7f1c380b4d10 2021-06-25T04:53:36.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.562+0000 7f1c2e7fc700 1 -- 172.21.15.57:0/183607259 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c300118b0 con 0x7f1c380b4d10 2021-06-25T04:53:36.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.562+0000 7f1c3e21b700 1 -- 172.21.15.57:0/183607259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c380b7ad0 con 0x7f1c380b4d10 2021-06-25T04:53:36.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.562+0000 7f1c2e7fc700 1 -- 172.21.15.57:0/183607259 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c30011c10 con 0x7f1c380b4d10 2021-06-25T04:53:36.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.562+0000 7f1c3e21b700 1 -- 172.21.15.57:0/183607259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c380b5ed0 con 0x7f1c380b4d10 2021-06-25T04:53:36.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.562+0000 7f1c3e21b700 1 -- 172.21.15.57:0/183607259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c380b7c60 con 0x7f1c380b4d10 2021-06-25T04:53:36.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.562+0000 7f1c2e7fc700 1 -- 172.21.15.57:0/183607259 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1c30011d70 con 0x7f1c380b4d10 2021-06-25T04:53:36.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.562+0000 7f1c2e7fc700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1c180553d0 0x7f1c18057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.562+0000 7f1c2e7fc700 1 -- 172.21.15.57:0/183607259 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1c3006e0b0 con 0x7f1c380b4d10 2021-06-25T04:53:36.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.562+0000 7f1c3d219700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1c180553d0 0x7f1c18057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.566+0000 7f1c3d219700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1c180553d0 0x7f1c18057890 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f1c3401b000 tx=0x7f1c34015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:36.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.570+0000 7f1c2e7fc700 1 -- 172.21.15.57:0/183607259 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1c30044260 con 0x7f1c380b4d10 2021-06-25T04:53:36.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.734+0000 7f1c3e21b700 1 -- 172.21.15.57:0/183607259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c38057310 con 0x7f1c380b4d10 2021-06-25T04:53:36.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c2e7fc700 1 -- 172.21.15.57:0/183607259 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f1c30047880 con 0x7f1c380b4d10 2021-06-25T04:53:36.742 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:36.742 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2942430957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2942430957},{"type":"v1","addr":"172.21.15.87:6835","nonce":2942430957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34},{"gid":6184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/4012056699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4012056699},{"type":"v1","addr":"172.21.15.57:6833","nonce":4012056699}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:53:27.269151+0000","modified":"2021-06-25T04:53:28.272583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2725183825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2725183825},{"type":"v1","addr":"172.21.15.57:6835","nonce":2725183825}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-06-25T04:53:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 -- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1c180553d0 msgr2=0x7f1c18057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:36.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1c180553d0 0x7f1c18057890 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f1c3401b000 tx=0x7f1c34015000).stop 2021-06-25T04:53:36.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 -- 172.21.15.57:0/183607259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c380b4d10 msgr2=0x7f1c380b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:36.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c380b4d10 0x7f1c380b02b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f1c3000c000 tx=0x7f1c30006df0).stop 2021-06-25T04:53:36.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 -- 172.21.15.57:0/183607259 shutdown_connections 2021-06-25T04:53:36.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1c180553d0 0x7f1c18057890 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c380b4d10 0x7f1c380b02b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c380ab120 0x7f1c38146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 --2- 172.21.15.57:0/183607259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c380aad40 0x7f1c380b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 -- 172.21.15.57:0/183607259 >> 172.21.15.57:0/183607259 conn(0x7f1c38062ba0 msgr2=0x7f1c380647c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:36.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 -- 172.21.15.57:0/183607259 shutdown_connections 2021-06-25T04:53:36.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.738+0000 7f1c3e21b700 1 -- 172.21.15.57:0/183607259 wait complete. 2021-06-25T04:53:36.748 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2021-06-25T04:53:36.755 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:53:36.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.854+0000 7f3414c12700 1 Processor -- start 2021-06-25T04:53:36.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.854+0000 7f3414c12700 1 -- start start 2021-06-25T04:53:36.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3410067140 0x7f341005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f34100b1930 0x7f341005fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34100a7a50 con 0x7f34100a7670 2021-06-25T04:53:36.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34101475e0 con 0x7f34100b1930 2021-06-25T04:53:36.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3410147880 con 0x7f3410067140 2021-06-25T04:53:36.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340ed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f34100b1930 0x7f341005fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340ed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f34100b1930 0x7f341005fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39708/0 (socket says 172.21.15.57:39708) 2021-06-25T04:53:36.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340ed9d700 1 -- 172.21.15.57:0/504351382 learned_addr learned my addr 172.21.15.57:0/504351382 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:36.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340dd9b700 1 --2- 172.21.15.57:0/504351382 >> v2:172.21.15.87:3300/0 conn(0x7f3410067140 0x7f341005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340ed9d700 1 -- 172.21.15.57:0/504351382 >> v2:172.21.15.87:3300/0 conn(0x7f3410067140 msgr2=0x7f341005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:36.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340ed9d700 1 --2- 172.21.15.57:0/504351382 >> v2:172.21.15.87:3300/0 conn(0x7f3410067140 0x7f341005f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340ed9d700 1 -- 172.21.15.57:0/504351382 >> v1:172.21.15.87:6789/0 conn(0x7f34100a7670 legacy=0x7f3410066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:53:36.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340ed9d700 1 -- 172.21.15.57:0/504351382 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3410147b20 con 0x7f34100b1930 2021-06-25T04:53:36.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340ed9d700 1 --2- 172.21.15.57:0/504351382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34100b1930 0x7f341005fb60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f341006a0a0 tx=0x7f3408009290).ready entity=mon.0 client_cookie=f8aa493c84b6f231 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:36.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340d59a700 1 -- 172.21.15.57:0/504351382 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f340800b830 con 0x7f34100b1930 2021-06-25T04:53:36.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340d59a700 1 -- 172.21.15.57:0/504351382 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340800b990 con 0x7f34100b1930 2021-06-25T04:53:36.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 -- 172.21.15.57:0/504351382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34100b1930 msgr2=0x7f341005fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:36.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f340d59a700 1 -- 172.21.15.57:0/504351382 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f340800bb00 con 0x7f34100b1930 2021-06-25T04:53:36.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 --2- 172.21.15.57:0/504351382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34100b1930 0x7f341005fb60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f341006a0a0 tx=0x7f3408009290).stop 2021-06-25T04:53:36.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 -- 172.21.15.57:0/504351382 shutdown_connections 2021-06-25T04:53:36.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 --2- 172.21.15.57:0/504351382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34100b1930 0x7f341005fb60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 --2- 172.21.15.57:0/504351382 >> v2:172.21.15.87:3300/0 conn(0x7f3410067140 0x7f341005f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 -- 172.21.15.57:0/504351382 >> 172.21.15.57:0/504351382 conn(0x7f34100b53a0 msgr2=0x7f34100b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:36.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 -- 172.21.15.57:0/504351382 shutdown_connections 2021-06-25T04:53:36.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.858+0000 7f3414c12700 1 -- 172.21.15.57:0/504351382 wait complete. 2021-06-25T04:53:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f3414c12700 1 Processor -- start 2021-06-25T04:53:36.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f3414c12700 1 -- start start 2021-06-25T04:53:36.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f3414c12700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3410067140 0x7f341014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f3414c12700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34100a7670 0x7f3410156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f3414c12700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34100b1930 0x7f34100ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f3414c12700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34100ae300 con 0x7f34100b1930 2021-06-25T04:53:36.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f3414c12700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34100af870 con 0x7f3410067140 2021-06-25T04:53:36.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f3414c12700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34100af330 con 0x7f34100a7670 2021-06-25T04:53:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34100b1930 0x7f34100ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34100b1930 0x7f34100ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39714/0 (socket says 172.21.15.57:39714) 2021-06-25T04:53:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340ed9d700 1 -- 172.21.15.57:0/3688504336 learned_addr learned my addr 172.21.15.57:0/3688504336 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:53:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340e59c700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3410067140 0x7f341014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340dd9b700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34100a7670 0x7f3410156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340ed9d700 1 -- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34100a7670 msgr2=0x7f3410156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340ed9d700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34100a7670 0x7f3410156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340ed9d700 1 -- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3410067140 msgr2=0x7f341014cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:36.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340ed9d700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3410067140 0x7f341014cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:36.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340ed9d700 1 -- 172.21.15.57:0/3688504336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3408009530 con 0x7f34100b1930 2021-06-25T04:53:36.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340e59c700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3410067140 0x7f341014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:53:36.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f340ed9d700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34100b1930 0x7f34100ae760 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f341006a0a0 tx=0x7f3408016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:36.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f33ff7fe700 1 -- 172.21.15.57:0/3688504336 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3408011aa0 con 0x7f34100b1930 2021-06-25T04:53:36.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f33ff7fe700 1 -- 172.21.15.57:0/3688504336 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3408011c00 con 0x7f34100b1930 2021-06-25T04:53:36.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f3414c12700 1 -- 172.21.15.57:0/3688504336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34100af5d0 con 0x7f34100b1930 2021-06-25T04:53:36.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f33ff7fe700 1 -- 172.21.15.57:0/3688504336 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34080032f0 con 0x7f34100b1930 2021-06-25T04:53:36.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.862+0000 7f3414c12700 1 -- 172.21.15.57:0/3688504336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3410156c00 con 0x7f34100b1930 2021-06-25T04:53:36.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.866+0000 7f3414c12700 1 -- 172.21.15.57:0/3688504336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34100ac010 con 0x7f34100b1930 2021-06-25T04:53:36.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.866+0000 7f33ff7fe700 1 -- 172.21.15.57:0/3688504336 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f340800f070 con 0x7f34100b1930 2021-06-25T04:53:36.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.866+0000 7f33ff7fe700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33ec055450 0x7f33ec057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:53:36.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.866+0000 7f33ff7fe700 1 -- 172.21.15.57:0/3688504336 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f340806dcf0 con 0x7f34100b1930 2021-06-25T04:53:36.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.866+0000 7f340e59c700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33ec055450 0x7f33ec057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:53:36.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.866+0000 7f340e59c700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33ec055450 0x7f33ec057910 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f340400d000 tx=0x7f3404007b70).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:53:36.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:36.874+0000 7f33ff7fe700 1 -- 172.21.15.57:0/3688504336 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f34100ac010 con 0x7f34100b1930 2021-06-25T04:53:37.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.038+0000 7f3414c12700 1 -- 172.21.15.57:0/3688504336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34100ac010 con 0x7f34100b1930 2021-06-25T04:53:37.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f33ff7fe700 1 -- 172.21.15.57:0/3688504336 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f34100ac010 con 0x7f34100b1930 2021-06-25T04:53:37.047 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:53:37.047 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2942430957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2942430957},{"type":"v1","addr":"172.21.15.87:6835","nonce":2942430957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34},{"gid":6184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/4012056699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4012056699},{"type":"v1","addr":"172.21.15.57:6833","nonce":4012056699}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:53:27.269151+0000","modified":"2021-06-25T04:53:28.272583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2725183825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2725183825},{"type":"v1","addr":"172.21.15.57:6835","nonce":2725183825}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-06-25T04:53:37.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 -- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33ec055450 msgr2=0x7f33ec057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:37.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33ec055450 0x7f33ec057910 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f340400d000 tx=0x7f3404007b70).stop 2021-06-25T04:53:37.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 -- 172.21.15.57:0/3688504336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34100b1930 msgr2=0x7f34100ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:53:37.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34100b1930 0x7f34100ae760 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f341006a0a0 tx=0x7f3408016000).stop 2021-06-25T04:53:37.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 -- 172.21.15.57:0/3688504336 shutdown_connections 2021-06-25T04:53:37.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f33ec055450 0x7f33ec057910 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:37.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34100b1930 0x7f34100ae760 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:37.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34100a7670 0x7f3410156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:37.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 --2- 172.21.15.57:0/3688504336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3410067140 0x7f341014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:53:37.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 -- 172.21.15.57:0/3688504336 >> 172.21.15.57:0/3688504336 conn(0x7f34100b53a0 msgr2=0x7f3410148950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:53:37.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 -- 172.21.15.57:0/3688504336 shutdown_connections 2021-06-25T04:53:37.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:53:37.042+0000 7f3414c12700 1 -- 172.21.15.57:0/3688504336 wait complete. 2021-06-25T04:53:37.052 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2021-06-25T04:53:37.060 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2021-06-25T04:53:37.168 INFO:teuthology.orchestra.run.smithi057.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2021-06-25T04:53:37.169 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2021-06-25T04:53:37.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:37.170 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:53:37.171 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:53:37.180 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:53:37.181 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:53:37.182 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-06-25T04:53:37.182 DEBUG:teuthology.orchestra.run.smithi102:> import time 2021-06-25T04:53:37.183 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:53:37.183 DEBUG:teuthology.orchestra.run.smithi102:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2021-06-25T04:53:37.184 DEBUG:teuthology.orchestra.run.smithi102:> f.write('"'"'content'"'"') 2021-06-25T04:53:37.184 DEBUG:teuthology.orchestra.run.smithi102:> f.flush() 2021-06-25T04:53:37.184 DEBUG:teuthology.orchestra.run.smithi102:> f.write('"'"'content2'"'"') 2021-06-25T04:53:37.185 DEBUG:teuthology.orchestra.run.smithi102:> while True: 2021-06-25T04:53:37.185 DEBUG:teuthology.orchestra.run.smithi102:> time.sleep(1) 2021-06-25T04:53:37.185 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:53:37.224 DEBUG:teuthology.orchestra.run.smithi102:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-06-25T04:53:37.247 INFO:teuthology.orchestra.run.smithi102.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2021-06-25T04:53:37.248 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-06-25T04:53:37.928 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:53:37.932 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:53:37.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:53:37.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:53:38.250 DEBUG:teuthology.orchestra.run.smithi102:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-06-25T04:53:38.266 INFO:teuthology.orchestra.run.smithi102.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2021-06-25T04:53:38.268 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2021-06-25T04:53:38.268 DEBUG:teuthology.orchestra.run.smithi161:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2021-06-25T04:53:38.309 INFO:teuthology.orchestra.run.smithi161.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2021-06-25T04:53:38.311 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2021-06-25T04:53:38.311 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:53:38.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:53:38.329 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:53:38.330 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:53:38.339 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:53:38.340 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:53:38.342 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-06-25T04:53:38.342 DEBUG:teuthology.orchestra.run.smithi161:> import os 2021-06-25T04:53:38.343 DEBUG:teuthology.orchestra.run.smithi161:> import time 2021-06-25T04:53:38.344 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:53:38.344 DEBUG:teuthology.orchestra.run.smithi161:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2021-06-25T04:53:38.345 DEBUG:teuthology.orchestra.run.smithi161:> try: 2021-06-25T04:53:38.345 DEBUG:teuthology.orchestra.run.smithi161:> while True: 2021-06-25T04:53:38.345 DEBUG:teuthology.orchestra.run.smithi161:> os.write(fd, b'"'"'content'"'"') 2021-06-25T04:53:38.346 DEBUG:teuthology.orchestra.run.smithi161:> time.sleep(1) 2021-06-25T04:53:38.346 DEBUG:teuthology.orchestra.run.smithi161:> if not False: 2021-06-25T04:53:38.347 DEBUG:teuthology.orchestra.run.smithi161:> break 2021-06-25T04:53:38.347 DEBUG:teuthology.orchestra.run.smithi161:> except IOError as e: 2021-06-25T04:53:38.348 DEBUG:teuthology.orchestra.run.smithi161:> pass 2021-06-25T04:53:38.348 DEBUG:teuthology.orchestra.run.smithi161:> os.close(fd) 2021-06-25T04:53:38.349 DEBUG:teuthology.orchestra.run.smithi161:> ' 2021-06-25T04:54:07.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:54:07.991 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:54:07.994 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:54:07.997 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:54:19.079 INFO:tasks.cephfs.test_misc:cap_waiter waited 40.724714279174805s 2021-06-25T04:54:19.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls --format=json 2021-06-25T04:54:19.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.185+0000 7f4e4802b700 1 Processor -- start 2021-06-25T04:54:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.185+0000 7f4e4802b700 1 -- start start 2021-06-25T04:54:19.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.185+0000 7f4e4802b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e40139aa0 0x7f4e40142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.185+0000 7f4e4802b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e400b1c10 0x7f4e400a8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.185+0000 7f4e4802b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e400ac430 con 0x7f4e40143260 2021-06-25T04:54:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.185+0000 7f4e4802b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e400b2fd0 con 0x7f4e40139aa0 2021-06-25T04:54:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.185+0000 7f4e4802b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400af2e0 con 0x7f4e400b1c10 2021-06-25T04:54:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e45dc7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e40139aa0 0x7f4e40142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e455c6700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4e40143260 0x7f4e400ab4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56938/0 (socket says 172.21.15.57:56938) 2021-06-25T04:54:19.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e455c6700 1 -- 172.21.15.57:0/2423013595 learned_addr learned my addr 172.21.15.57:0/2423013595 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:19.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e465c8700 1 --2- 172.21.15.57:0/2423013595 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e400b1c10 0x7f4e400a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e44dc5700 1 -- 172.21.15.57:0/2423013595 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4472150 0 0) 0x7f4e400ac430 con 0x7f4e40143260 2021-06-25T04:54:19.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e44dc5700 1 -- 172.21.15.57:0/2423013595 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e28003260 con 0x7f4e40143260 2021-06-25T04:54:19.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e45dc7700 1 -- 172.21.15.57:0/2423013595 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e400b1c10 msgr2=0x7f4e400a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:19.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e45dc7700 1 --2- 172.21.15.57:0/2423013595 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e400b1c10 0x7f4e400a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e45dc7700 1 -- 172.21.15.57:0/2423013595 >> v1:172.21.15.57:6789/0 conn(0x7f4e40143260 legacy=0x7f4e400ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e45dc7700 1 -- 172.21.15.57:0/2423013595 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e401436f0 con 0x7f4e40139aa0 2021-06-25T04:54:19.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e45dc7700 1 --2- 172.21.15.57:0/2423013595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e40139aa0 0x7f4e40142d70 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f4e30002f70 tx=0x7f4e30006df0).ready entity=mon.0 client_cookie=bec9821843d6c11 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:19.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e44dc5700 1 -- 172.21.15.57:0/2423013595 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e3000d4a0 con 0x7f4e40139aa0 2021-06-25T04:54:19.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e44dc5700 1 -- 172.21.15.57:0/2423013595 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e30000e90 con 0x7f4e40139aa0 2021-06-25T04:54:19.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e44dc5700 1 -- 172.21.15.57:0/2423013595 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e3000d7f0 con 0x7f4e40139aa0 2021-06-25T04:54:19.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e4802b700 1 -- 172.21.15.57:0/2423013595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e40139aa0 msgr2=0x7f4e40142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e4802b700 1 --2- 172.21.15.57:0/2423013595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e40139aa0 0x7f4e40142d70 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f4e30002f70 tx=0x7f4e30006df0).stop 2021-06-25T04:54:19.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e4802b700 1 -- 172.21.15.57:0/2423013595 shutdown_connections 2021-06-25T04:54:19.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e4802b700 1 --2- 172.21.15.57:0/2423013595 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e400b1c10 0x7f4e400a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e4802b700 1 --2- 172.21.15.57:0/2423013595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e40139aa0 0x7f4e40142d70 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e4802b700 1 -- 172.21.15.57:0/2423013595 >> 172.21.15.57:0/2423013595 conn(0x7f4e4005f670 msgr2=0x7f4e4005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:19.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e4802b700 1 -- 172.21.15.57:0/2423013595 shutdown_connections 2021-06-25T04:54:19.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.189+0000 7f4e4802b700 1 -- 172.21.15.57:0/2423013595 wait complete. 2021-06-25T04:54:19.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e4802b700 1 Processor -- start 2021-06-25T04:54:19.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e4802b700 1 -- start start 2021-06-25T04:54:19.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e4802b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e400b1c10 0x7f4e400aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e4802b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e401502f0 0x7f4e40146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e4802b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4013f6e0 0x7f4e401465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e4802b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e40143fa0 con 0x7f4e401502f0 2021-06-25T04:54:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e4802b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4013fe00 con 0x7f4e4013f6e0 2021-06-25T04:54:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e4802b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e401400a0 con 0x7f4e400b1c10 2021-06-25T04:54:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e455c6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e401502f0 0x7f4e40146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e455c6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e401502f0 0x7f4e40146100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39728/0 (socket says 172.21.15.57:39728) 2021-06-25T04:54:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e455c6700 1 -- 172.21.15.57:0/1859945876 learned_addr learned my addr 172.21.15.57:0/1859945876 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e45dc7700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e400b1c10 0x7f4e400aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e465c8700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4013f6e0 0x7f4e401465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e45dc7700 1 -- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4013f6e0 msgr2=0x7f4e401465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e45dc7700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4013f6e0 0x7f4e401465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e45dc7700 1 -- 172.21.15.57:0/1859945876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e401502f0 msgr2=0x7f4e40146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e45dc7700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e401502f0 0x7f4e40146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e45dc7700 1 -- 172.21.15.57:0/1859945876 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3000b180 con 0x7f4e400b1c10 2021-06-25T04:54:19.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e455c6700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e401502f0 0x7f4e40146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e45dc7700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e400b1c10 0x7f4e400aaf70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f4e30002f70 tx=0x7f4e30014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e2effd700 1 -- 172.21.15.57:0/1859945876 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e30012930 con 0x7f4e400b1c10 2021-06-25T04:54:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e2effd700 1 -- 172.21.15.57:0/1859945876 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e30012a90 con 0x7f4e400b1c10 2021-06-25T04:54:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e2effd700 1 -- 172.21.15.57:0/1859945876 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e30012df0 con 0x7f4e400b1c10 2021-06-25T04:54:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e4802b700 1 -- 172.21.15.57:0/1859945876 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e40140340 con 0x7f4e400b1c10 2021-06-25T04:54:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.193+0000 7f4e4802b700 1 -- 172.21.15.57:0/1859945876 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e40143b70 con 0x7f4e400b1c10 2021-06-25T04:54:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.197+0000 7f4e4802b700 1 -- 172.21.15.57:0/1859945876 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e40057310 con 0x7f4e400b1c10 2021-06-25T04:54:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.197+0000 7f4e2effd700 1 -- 172.21.15.57:0/1859945876 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4e30025020 con 0x7f4e400b1c10 2021-06-25T04:54:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.197+0000 7f4e2effd700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e200553d0 0x7f4e20057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.197+0000 7f4e2effd700 1 -- 172.21.15.57:0/1859945876 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f4e3006f2f0 con 0x7f4e400b1c10 2021-06-25T04:54:19.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.197+0000 7f4e455c6700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e200553d0 0x7f4e20057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.201+0000 7f4e455c6700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e200553d0 0x7f4e20057890 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f4e3c00d000 tx=0x7f4e3c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:19.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.205+0000 7f4e2effd700 1 -- 172.21.15.57:0/1859945876 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4e30045370 con 0x7f4e400b1c10 2021-06-25T04:54:19.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.345+0000 7f4e4802b700 1 -- 172.21.15.57:0/1859945876 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7f4e40044610 con 0x7f4e400b1c10 2021-06-25T04:54:19.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e2effd700 1 -- 172.21.15.57:0/1859945876 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 1 entries v78) v1 ==== 98+0+81 (secure 0 0 0) 0x7f4e30048990 con 0x7f4e400b1c10 2021-06-25T04:54:19.350 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:19.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 -- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e200553d0 msgr2=0x7f4e20057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e200553d0 0x7f4e20057890 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f4e3c00d000 tx=0x7f4e3c009040).stop 2021-06-25T04:54:19.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 -- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e400b1c10 msgr2=0x7f4e400aaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e400b1c10 0x7f4e400aaf70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f4e30002f70 tx=0x7f4e30014000).stop 2021-06-25T04:54:19.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 -- 172.21.15.57:0/1859945876 shutdown_connections 2021-06-25T04:54:19.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e200553d0 0x7f4e20057890 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4013f6e0 0x7f4e401465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e401502f0 0x7f4e40146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 --2- 172.21.15.57:0/1859945876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e400b1c10 0x7f4e400aaf70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 -- 172.21.15.57:0/1859945876 >> 172.21.15.57:0/1859945876 conn(0x7f4e4005f670 msgr2=0x7f4e400a8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:19.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 -- 172.21.15.57:0/1859945876 shutdown_connections 2021-06-25T04:54:19.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.349+0000 7f4e4802b700 1 -- 172.21.15.57:0/1859945876 wait complete. 2021-06-25T04:54:19.357 INFO:teuthology.orchestra.run.smithi057.stderr:listed 1 entries 2021-06-25T04:54:19.367 INFO:teuthology.orchestra.run.smithi057.stdout:[{"addr":"172.21.15.102:0/1630225676","until":"2021-06-25T05:54:12.976776+0000"}] 2021-06-25T04:54:19.385 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-06-25T04:54:19.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:19.386 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:19.387 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:19.438 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-06-25T04:54:19.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:54:19.440 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-06-25T04:54:19.441 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:54:19.441 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:54:19.442 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:19.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:19.461 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:19.462 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:19.510 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:54:19.512 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:54:19.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:54:19.514 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:19.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:54:19.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.633+0000 7f2a5ce32700 1 Processor -- start 2021-06-25T04:54:19.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.633+0000 7f2a5ce32700 1 -- start start 2021-06-25T04:54:19.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2a580a7670 0x7f2a58066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2a580b1930 0x7f2a58066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b0020 0x7f2a5805f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a58067410 con 0x7f2a580b1930 2021-06-25T04:54:19.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a580a7a50 con 0x7f2a580a7670 2021-06-25T04:54:19.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a581475e0 con 0x7f2a580b0020 2021-06-25T04:54:19.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a4dd9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2a580b1930 0x7f2a58066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a56d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b0020 0x7f2a5805f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a56d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b0020 0x7f2a5805f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:50900/0 (socket says 172.21.15.57:50900) 2021-06-25T04:54:19.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a56d9d700 1 -- 172.21.15.57:0/2853348674 learned_addr learned my addr 172.21.15.57:0/2853348674 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:19.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5659c700 1 --2- 172.21.15.57:0/2853348674 >> v2:172.21.15.87:3300/0 conn(0x7f2a580a7670 0x7f2a58066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a56d9d700 1 -- 172.21.15.57:0/2853348674 >> v2:172.21.15.87:3300/0 conn(0x7f2a580a7670 msgr2=0x7f2a58066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:19.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a56d9d700 1 --2- 172.21.15.57:0/2853348674 >> v2:172.21.15.87:3300/0 conn(0x7f2a580a7670 0x7f2a58066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a56d9d700 1 -- 172.21.15.57:0/2853348674 >> v2:172.21.15.57:3300/0 conn(0x7f2a580b1930 msgr2=0x7f2a58066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:19.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a56d9d700 1 --2- 172.21.15.57:0/2853348674 >> v2:172.21.15.57:3300/0 conn(0x7f2a580b1930 0x7f2a58066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a56d9d700 1 -- 172.21.15.57:0/2853348674 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58147880 con 0x7f2a580b0020 2021-06-25T04:54:19.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a56d9d700 1 --2- 172.21.15.57:0/2853348674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b0020 0x7f2a5805f670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2a500032f0 tx=0x7f2a50009290).ready entity=mon.2 client_cookie=fe89df1b210967ae server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:19.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a55d9b700 1 -- 172.21.15.57:0/2853348674 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a5000b680 con 0x7f2a580b0020 2021-06-25T04:54:19.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a55d9b700 1 -- 172.21.15.57:0/2853348674 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5000b7e0 con 0x7f2a580b0020 2021-06-25T04:54:19.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a55d9b700 1 -- 172.21.15.57:0/2853348674 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a5000b950 con 0x7f2a580b0020 2021-06-25T04:54:19.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 -- 172.21.15.57:0/2853348674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b0020 msgr2=0x7f2a5805f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 --2- 172.21.15.57:0/2853348674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b0020 0x7f2a5805f670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2a500032f0 tx=0x7f2a50009290).stop 2021-06-25T04:54:19.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 -- 172.21.15.57:0/2853348674 shutdown_connections 2021-06-25T04:54:19.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 --2- 172.21.15.57:0/2853348674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b0020 0x7f2a5805f670 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 --2- 172.21.15.57:0/2853348674 >> v2:172.21.15.57:3300/0 conn(0x7f2a580b1930 0x7f2a58066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 --2- 172.21.15.57:0/2853348674 >> v2:172.21.15.87:3300/0 conn(0x7f2a580a7670 0x7f2a58066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 -- 172.21.15.57:0/2853348674 >> 172.21.15.57:0/2853348674 conn(0x7f2a580b53a0 msgr2=0x7f2a580b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:19.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 -- 172.21.15.57:0/2853348674 shutdown_connections 2021-06-25T04:54:19.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 -- 172.21.15.57:0/2853348674 wait complete. 2021-06-25T04:54:19.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 Processor -- start 2021-06-25T04:54:19.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.637+0000 7f2a5ce32700 1 -- start start 2021-06-25T04:54:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5ce32700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580a7670 0x7f2a580ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5ce32700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a580b0020 0x7f2a581446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5ce32700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b1930 0x7f2a58144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5ce32700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580ab750 con 0x7f2a580a7670 2021-06-25T04:54:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5ce32700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a581450a0 con 0x7f2a580b0020 2021-06-25T04:54:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5ce32700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580ab530 con 0x7f2a580b1930 2021-06-25T04:54:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580a7670 0x7f2a580ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580a7670 0x7f2a580ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39740/0 (socket says 172.21.15.57:39740) 2021-06-25T04:54:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5659c700 1 -- 172.21.15.57:0/1757631605 learned_addr learned my addr 172.21.15.57:0/1757631605 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a56d9d700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b1930 0x7f2a58144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a4dd9b700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a580b0020 0x7f2a581446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5659c700 1 -- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b1930 msgr2=0x7f2a58144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5659c700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b1930 0x7f2a58144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5659c700 1 -- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a580b0020 msgr2=0x7f2a581446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5659c700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a580b0020 0x7f2a581446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5659c700 1 -- 172.21.15.57:0/1757631605 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50009530 con 0x7f2a580a7670 2021-06-25T04:54:19.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5659c700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580a7670 0x7f2a580ad3a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f2a580ab8c0 tx=0x7f2a48006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:19.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1757631605 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a48010780 con 0x7f2a580a7670 2021-06-25T04:54:19.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1757631605 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a480108e0 con 0x7f2a580a7670 2021-06-25T04:54:19.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5ce32700 1 -- 172.21.15.57:0/1757631605 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a580ab9a0 con 0x7f2a580a7670 2021-06-25T04:54:19.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1757631605 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a48010c40 con 0x7f2a580a7670 2021-06-25T04:54:19.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5ce32700 1 -- 172.21.15.57:0/1757631605 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a580abee0 con 0x7f2a580a7670 2021-06-25T04:54:19.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.641+0000 7f2a5ce32700 1 -- 172.21.15.57:0/1757631605 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a580ac680 con 0x7f2a580a7670 2021-06-25T04:54:19.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.645+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1757631605 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2a4801c460 con 0x7f2a580a7670 2021-06-25T04:54:19.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.645+0000 7f2a4ffff700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a3c055360 0x7f2a3c057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.645+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1757631605 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f2a4806e3a0 con 0x7f2a580a7670 2021-06-25T04:54:19.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.645+0000 7f2a4dd9b700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a3c055360 0x7f2a3c057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.645+0000 7f2a4dd9b700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a3c055360 0x7f2a3c057820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f2a4000b000 tx=0x7f2a40006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:19.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.653+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1757631605 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2a48044340 con 0x7f2a580a7670 2021-06-25T04:54:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.777+0000 7f2a5ce32700 1 -- 172.21.15.57:0/1757631605 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a58057310 con 0x7f2a580a7670 2021-06-25T04:54:19.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.777+0000 7f2a4ffff700 1 -- 172.21.15.57:0/1757631605 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16336 (secure 0 0 0) 0x7f2a48047960 con 0x7f2a580a7670 2021-06-25T04:54:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:19.781 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":78,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:13.626814+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:53:25.832629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-06-25T04:53:26.696947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.102:0/1630225676":"2021-06-25T05:54:12.976776+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:54:19.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 -- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a3c055360 msgr2=0x7f2a3c057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a3c055360 0x7f2a3c057820 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f2a4000b000 tx=0x7f2a40006df0).stop 2021-06-25T04:54:19.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 -- 172.21.15.57:0/1757631605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580a7670 msgr2=0x7f2a580ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580a7670 0x7f2a580ad3a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f2a580ab8c0 tx=0x7f2a48006df0).stop 2021-06-25T04:54:19.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 -- 172.21.15.57:0/1757631605 shutdown_connections 2021-06-25T04:54:19.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a3c055360 0x7f2a3c057820 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a580b1930 0x7f2a58144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a580b0020 0x7f2a581446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 --2- 172.21.15.57:0/1757631605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580a7670 0x7f2a580ad3a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 -- 172.21.15.57:0/1757631605 >> 172.21.15.57:0/1757631605 conn(0x7f2a580b53a0 msgr2=0x7f2a58149a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:19.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 -- 172.21.15.57:0/1757631605 shutdown_connections 2021-06-25T04:54:19.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.781+0000 7f2a5ce32700 1 -- 172.21.15.57:0/1757631605 wait complete. 2021-06-25T04:54:19.795 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:53:25.832629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:53:26.696947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:54:19.796 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:54:19.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.901+0000 7fd441993700 1 Processor -- start 2021-06-25T04:54:19.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.901+0000 7fd441993700 1 -- start start 2021-06-25T04:54:19.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd43c0affd0 0x7fd43c0a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd43c0afb90 0x7fd43c0a8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c0a7080 con 0x7fd43c0b2540 2021-06-25T04:54:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0a72b0 con 0x7fd43c0afb90 2021-06-25T04:54:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0a7550 con 0x7fd43c0affd0 2021-06-25T04:54:19.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441192700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd43c0afb90 0x7fd43c0a8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441192700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd43c0afb90 0x7fd43c0a8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39752/0 (socket says 172.21.15.57:39752) 2021-06-25T04:54:19.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441192700 1 -- 172.21.15.57:0/609420648 learned_addr learned my addr 172.21.15.57:0/609420648 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:19.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd43bfff700 1 --2- 172.21.15.57:0/609420648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd43c0affd0 0x7fd43c0a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441192700 1 -- 172.21.15.57:0/609420648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd43c0affd0 msgr2=0x7fd43c0a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:19.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441192700 1 --2- 172.21.15.57:0/609420648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd43c0affd0 0x7fd43c0a8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441192700 1 -- 172.21.15.57:0/609420648 >> v1:172.21.15.87:6789/0 conn(0x7fd43c0b2540 legacy=0x7fd43c14ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441192700 1 -- 172.21.15.57:0/609420648 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0a77f0 con 0x7fd43c0afb90 2021-06-25T04:54:19.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441192700 1 --2- 172.21.15.57:0/609420648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0afb90 0x7fd43c0a8860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7fd4340032f0 tx=0x7fd434009290).ready entity=mon.0 client_cookie=36991f91236b0e37 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:19.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd43b7fe700 1 -- 172.21.15.57:0/609420648 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd43400b8a0 con 0x7fd43c0afb90 2021-06-25T04:54:19.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd43b7fe700 1 -- 172.21.15.57:0/609420648 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400ba00 con 0x7fd43c0afb90 2021-06-25T04:54:19.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd43b7fe700 1 -- 172.21.15.57:0/609420648 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd43400bb70 con 0x7fd43c0afb90 2021-06-25T04:54:19.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 -- 172.21.15.57:0/609420648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0afb90 msgr2=0x7fd43c0a8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 --2- 172.21.15.57:0/609420648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0afb90 0x7fd43c0a8860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7fd4340032f0 tx=0x7fd434009290).stop 2021-06-25T04:54:19.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 -- 172.21.15.57:0/609420648 shutdown_connections 2021-06-25T04:54:19.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 --2- 172.21.15.57:0/609420648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0afb90 0x7fd43c0a8860 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 --2- 172.21.15.57:0/609420648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd43c0affd0 0x7fd43c0a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 -- 172.21.15.57:0/609420648 >> 172.21.15.57:0/609420648 conn(0x7fd43c060140 msgr2=0x7fd43c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:19.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 -- 172.21.15.57:0/609420648 shutdown_connections 2021-06-25T04:54:19.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 -- 172.21.15.57:0/609420648 wait complete. 2021-06-25T04:54:19.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.905+0000 7fd441993700 1 Processor -- start 2021-06-25T04:54:19.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441993700 1 -- start start 2021-06-25T04:54:19.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441993700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c0afb90 0x7fd43c0b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441993700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd43c0affd0 0x7fd43c0ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441993700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0b2540 0x7fd43c0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441993700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0b2e30 con 0x7fd43c0b2540 2021-06-25T04:54:19.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441993700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0b3090 con 0x7fd43c0afb90 2021-06-25T04:54:19.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441993700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0b3330 con 0x7fd43c0affd0 2021-06-25T04:54:19.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441192700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0b2540 0x7fd43c0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441192700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0b2540 0x7fd43c0aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39758/0 (socket says 172.21.15.57:39758) 2021-06-25T04:54:19.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441192700 1 -- 172.21.15.57:0/3903115882 learned_addr learned my addr 172.21.15.57:0/3903115882 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd43bfff700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd43c0affd0 0x7fd43c0ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd440991700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c0afb90 0x7fd43c0b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441192700 1 -- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd43c0affd0 msgr2=0x7fd43c0ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441192700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd43c0affd0 0x7fd43c0ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441192700 1 -- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c0afb90 msgr2=0x7fd43c0b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441192700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c0afb90 0x7fd43c0b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441192700 1 -- 172.21.15.57:0/3903115882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434009530 con 0x7fd43c0b2540 2021-06-25T04:54:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd440991700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c0afb90 0x7fd43c0b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441192700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0b2540 0x7fd43c0aed90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7fd4340032f0 tx=0x7fd434016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd439ffb700 1 -- 172.21.15.57:0/3903115882 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd434011c80 con 0x7fd43c0b2540 2021-06-25T04:54:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd439ffb700 1 -- 172.21.15.57:0/3903115882 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd434011de0 con 0x7fd43c0b2540 2021-06-25T04:54:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd439ffb700 1 -- 172.21.15.57:0/3903115882 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd434020660 con 0x7fd43c0b2540 2021-06-25T04:54:19.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441993700 1 -- 172.21.15.57:0/3903115882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c157080 con 0x7fd43c0b2540 2021-06-25T04:54:19.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441993700 1 -- 172.21.15.57:0/3903115882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c0af280 con 0x7fd43c0b2540 2021-06-25T04:54:19.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.909+0000 7fd441993700 1 -- 172.21.15.57:0/3903115882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c0ab180 con 0x7fd43c0b2540 2021-06-25T04:54:19.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.913+0000 7fd439ffb700 1 -- 172.21.15.57:0/3903115882 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd43400f070 con 0x7fd43c0b2540 2021-06-25T04:54:19.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.913+0000 7fd439ffb700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd41c0554e0 0x7fd41c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:19.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.913+0000 7fd439ffb700 1 -- 172.21.15.57:0/3903115882 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fd43406eb90 con 0x7fd43c0b2540 2021-06-25T04:54:19.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.913+0000 7fd440991700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd41c0554e0 0x7fd41c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:19.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.913+0000 7fd440991700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd41c0554e0 0x7fd41c0579a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fd43000b000 tx=0x7fd430009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:19.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:19.917+0000 7fd439ffb700 1 -- 172.21.15.57:0/3903115882 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd43c0ab180 con 0x7fd43c0b2540 2021-06-25T04:54:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.049+0000 7fd441993700 1 -- 172.21.15.57:0/3903115882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd43c0ab180 con 0x7fd43c0b2540 2021-06-25T04:54:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.049+0000 7fd439ffb700 1 -- 172.21.15.57:0/3903115882 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v78) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd43c0ab180 con 0x7fd43c0b2540 2021-06-25T04:54:20.053 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:54:20.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 -- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd41c0554e0 msgr2=0x7fd41c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd41c0554e0 0x7fd41c0579a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fd43000b000 tx=0x7fd430009040).stop 2021-06-25T04:54:20.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 -- 172.21.15.57:0/3903115882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0b2540 msgr2=0x7fd43c0aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0b2540 0x7fd43c0aed90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7fd4340032f0 tx=0x7fd434016000).stop 2021-06-25T04:54:20.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 -- 172.21.15.57:0/3903115882 shutdown_connections 2021-06-25T04:54:20.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd41c0554e0 0x7fd41c0579a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0b2540 0x7fd43c0aed90 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd43c0affd0 0x7fd43c0ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 --2- 172.21.15.57:0/3903115882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd43c0afb90 0x7fd43c0b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 -- 172.21.15.57:0/3903115882 >> 172.21.15.57:0/3903115882 conn(0x7fd43c060140 msgr2=0x7fd43c148950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:20.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 -- 172.21.15.57:0/3903115882 shutdown_connections 2021-06-25T04:54:20.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.053+0000 7fd441993700 1 -- 172.21.15.57:0/3903115882 wait complete. 2021-06-25T04:54:20.066 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:54:20.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.173+0000 7f153cdac700 1 Processor -- start 2021-06-25T04:54:20.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.173+0000 7f153cdac700 1 -- start start 2021-06-25T04:54:20.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.173+0000 7f153cdac700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15380b2540 0x7f153814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.173+0000 7f153cdac700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15380a7080 con 0x7f15380affd0 2021-06-25T04:54:20.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.173+0000 7f153cdac700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15380a72b0 con 0x7f15380a8a80 2021-06-25T04:54:20.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.173+0000 7f153cdac700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15380a7550 con 0x7f15380b2540 2021-06-25T04:54:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.173+0000 7f1536ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f15380affd0 0x7f15380a8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56982/0 (socket says 172.21.15.57:56982) 2021-06-25T04:54:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.173+0000 7f1536ffd700 1 -- 172.21.15.57:0/4016918116 learned_addr learned my addr 172.21.15.57:0/4016918116 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15377fe700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15380b2540 0x7f153814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957233451 0 0) 0x7f15380a7080 con 0x7f15380affd0 2021-06-25T04:54:20.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1524003260 con 0x7f15380affd0 2021-06-25T04:54:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947322268 0 0) 0x7f15380a72b0 con 0x7f15380a8a80 2021-06-25T04:54:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15380a7080 con 0x7f15380a8a80 2021-06-25T04:54:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 215390160 0 0) 0x7f1524003260 con 0x7f15380affd0 2021-06-25T04:54:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15380b2540 msgr2=0x7f153814ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15380b2540 0x7f153814ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 >> v1:172.21.15.87:6789/0 conn(0x7f15380a8a80 legacy=0x7f1538151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15380a77f0 con 0x7f15380affd0 2021-06-25T04:54:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f1528001660 con 0x7f15380affd0 2021-06-25T04:54:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 >> v1:172.21.15.57:6789/0 conn(0x7f15380affd0 legacy=0x7f15380a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15380b2540 0x7f1524003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1524003e20 0x7f1524004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15240049f0 0x7f1524004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15380a7550 con 0x7f15240049f0 2021-06-25T04:54:20.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152400b800 con 0x7f1524003e20 2021-06-25T04:54:20.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152400b9c0 con 0x7f15380b2540 2021-06-25T04:54:20.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f1537fff700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15240049f0 0x7f1524004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15377fe700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15380b2540 0x7f1524003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f1536ffd700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1524003e20 0x7f1524004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f1537fff700 1 -- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15380b2540 msgr2=0x7f1524003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f1537fff700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15380b2540 0x7f1524003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f1537fff700 1 -- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1524003e20 msgr2=0x7f1524004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f1537fff700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1524003e20 0x7f1524004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f1537fff700 1 -- 172.21.15.57:0/4016918116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1524003260 con 0x7f15240049f0 2021-06-25T04:54:20.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15377fe700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15380b2540 0x7f1524003910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:20.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f1537fff700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15240049f0 0x7f1524004e70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f1530001490 tx=0x7f1530007d80).ready entity=mon.0 client_cookie=7cc926f40115e6c6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:20.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1530001780 con 0x7f15240049f0 2021-06-25T04:54:20.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1530006890 con 0x7f15240049f0 2021-06-25T04:54:20.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f15367fc700 1 -- 172.21.15.57:0/4016918116 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1530006bf0 con 0x7f15240049f0 2021-06-25T04:54:20.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f153cdac700 1 -- 172.21.15.57:0/4016918116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15240049f0 msgr2=0x7f1524004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f153cdac700 1 --2- 172.21.15.57:0/4016918116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15240049f0 0x7f1524004e70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f1530001490 tx=0x7f1530007d80).stop 2021-06-25T04:54:20.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f1537fff700 1 -- 172.21.15.57:0/4016918116 reap_dead start 2021-06-25T04:54:20.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f153cdac700 1 -- 172.21.15.57:0/4016918116 shutdown_connections 2021-06-25T04:54:20.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f153cdac700 1 -- 172.21.15.57:0/4016918116 >> 172.21.15.57:0/4016918116 conn(0x7f1538060140 msgr2=0x7f15380b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:20.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f153cdac700 1 -- 172.21.15.57:0/4016918116 shutdown_connections 2021-06-25T04:54:20.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.177+0000 7f153cdac700 1 -- 172.21.15.57:0/4016918116 wait complete. 2021-06-25T04:54:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f153cdac700 1 Processor -- start 2021-06-25T04:54:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f153cdac700 1 -- start start 2021-06-25T04:54:20.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f153cdac700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15380b4c30 0x7f1538159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f153cdac700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15380aaf80 0x7f153815a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f153cdac700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1538063200 0x7f1538156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f153cdac700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15380aa3c0 con 0x7f15380aaf80 2021-06-25T04:54:20.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f153cdac700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15380b5010 con 0x7f15380b4c30 2021-06-25T04:54:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f153cdac700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15381563d0 con 0x7f1538063200 2021-06-25T04:54:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f1536ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15380aaf80 0x7f153815a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f1536ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15380aaf80 0x7f153815a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39776/0 (socket says 172.21.15.57:39776) 2021-06-25T04:54:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f1536ffd700 1 -- 172.21.15.57:0/2633680998 learned_addr learned my addr 172.21.15.57:0/2633680998 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:20.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f1537fff700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1538063200 0x7f1538156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f15377fe700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15380b4c30 0x7f1538159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.181+0000 7f1537fff700 1 -- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15380b4c30 msgr2=0x7f1538159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1537fff700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15380b4c30 0x7f1538159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1537fff700 1 -- 172.21.15.57:0/2633680998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15380aaf80 msgr2=0x7f153815a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1537fff700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15380aaf80 0x7f153815a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1537fff700 1 -- 172.21.15.57:0/2633680998 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15380aa5f0 con 0x7f1538063200 2021-06-25T04:54:20.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f15377fe700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15380b4c30 0x7f1538159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:20.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1536ffd700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15380aaf80 0x7f153815a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:20.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1537fff700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1538063200 0x7f1538156800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f1538064850 tx=0x7f1530016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:20.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1534ff9700 1 -- 172.21.15.57:0/2633680998 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1530007b60 con 0x7f1538063200 2021-06-25T04:54:20.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1534ff9700 1 -- 172.21.15.57:0/2633680998 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1530006a80 con 0x7f1538063200 2021-06-25T04:54:20.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f153cdac700 1 -- 172.21.15.57:0/2633680998 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15380aa890 con 0x7f1538063200 2021-06-25T04:54:20.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1534ff9700 1 -- 172.21.15.57:0/2633680998 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1530006e00 con 0x7f1538063200 2021-06-25T04:54:20.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f153cdac700 1 -- 172.21.15.57:0/2633680998 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153815a700 con 0x7f1538063200 2021-06-25T04:54:20.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f153cdac700 1 -- 172.21.15.57:0/2633680998 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1538057310 con 0x7f1538063200 2021-06-25T04:54:20.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1534ff9700 1 -- 172.21.15.57:0/2633680998 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1530024030 con 0x7f1538063200 2021-06-25T04:54:20.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1534ff9700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1518055450 0x7f1518057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f1534ff9700 1 -- 172.21.15.57:0/2633680998 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f153006e750 con 0x7f1538063200 2021-06-25T04:54:20.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.185+0000 7f15377fe700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1518055450 0x7f1518057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.189+0000 7f15377fe700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1518055450 0x7f1518057910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f152c00b000 tx=0x7f152c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:20.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.193+0000 7f1534ff9700 1 -- 172.21.15.57:0/2633680998 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f15300447d0 con 0x7f1538063200 2021-06-25T04:54:20.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.325+0000 7f153cdac700 1 -- 172.21.15.57:0/2633680998 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f15380aaa20 con 0x7f1538063200 2021-06-25T04:54:20.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.325+0000 7f1534ff9700 1 -- 172.21.15.57:0/2633680998 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1530047df0 con 0x7f1538063200 2021-06-25T04:54:20.329 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:54:20.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 -- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1518055450 msgr2=0x7f1518057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1518055450 0x7f1518057910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f152c00b000 tx=0x7f152c008040).stop 2021-06-25T04:54:20.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 -- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1538063200 msgr2=0x7f1538156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1538063200 0x7f1538156800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f1538064850 tx=0x7f1530016000).stop 2021-06-25T04:54:20.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 -- 172.21.15.57:0/2633680998 shutdown_connections 2021-06-25T04:54:20.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1518055450 0x7f1518057910 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1538063200 0x7f1538156800 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15380aaf80 0x7f153815a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 --2- 172.21.15.57:0/2633680998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15380b4c30 0x7f1538159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 -- 172.21.15.57:0/2633680998 >> 172.21.15.57:0/2633680998 conn(0x7f1538060140 msgr2=0x7f1538148950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:20.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 -- 172.21.15.57:0/2633680998 shutdown_connections 2021-06-25T04:54:20.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.329+0000 7f153cdac700 1 -- 172.21.15.57:0/2633680998 wait complete. 2021-06-25T04:54:20.342 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:54:20.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.445+0000 7f4b30890700 1 Processor -- start 2021-06-25T04:54:20.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.445+0000 7f4b30890700 1 -- start start 2021-06-25T04:54:20.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.445+0000 7f4b30890700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b2c0b7330 0x7f4b2c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.445+0000 7f4b30890700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4b2c0b3020 0x7f4b2c13e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.445+0000 7f4b30890700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c0b2340 con 0x7f4b2c13e6d0 2021-06-25T04:54:20.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.445+0000 7f4b30890700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c144210 con 0x7f4b2c0b7330 2021-06-25T04:54:20.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.445+0000 7f4b30890700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c0b3530 con 0x7f4b2c0b3020 2021-06-25T04:54:20.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.445+0000 7f4b2bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4b2c13e6d0 0x7f4b2c064b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57004/0 (socket says 172.21.15.57:57004) 2021-06-25T04:54:20.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.445+0000 7f4b2bfff700 1 -- 172.21.15.57:0/3539692558 learned_addr learned my addr 172.21.15.57:0/3539692558 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:20.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.445+0000 7f4b2b7fe700 1 --2- 172.21.15.57:0/3539692558 >> v2:172.21.15.57:3300/0 conn(0x7f4b2c0b7330 0x7f4b2c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757139997 0 0) 0x7f4b2c0b2340 con 0x7f4b2c13e6d0 2021-06-25T04:54:20.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.445+0000 7f4b2affd700 1 --2- 172.21.15.57:0/3539692558 >> v2:172.21.15.87:3300/0 conn(0x7f4b2c0b3020 0x7f4b2c13e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b0c003260 con 0x7f4b2c13e6d0 2021-06-25T04:54:20.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 351391819 0 0) 0x7f4b0c003260 con 0x7f4b2c13e6d0 2021-06-25T04:54:20.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 >> v2:172.21.15.87:3300/0 conn(0x7f4b2c0b3020 msgr2=0x7f4b2c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 --2- 172.21.15.57:0/3539692558 >> v2:172.21.15.87:3300/0 conn(0x7f4b2c0b3020 0x7f4b2c13e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 >> v2:172.21.15.57:3300/0 conn(0x7f4b2c0b7330 msgr2=0x7f4b2c0b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 --2- 172.21.15.57:0/3539692558 >> v2:172.21.15.57:3300/0 conn(0x7f4b2c0b7330 0x7f4b2c0b7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0b2570 con 0x7f4b2c13e6d0 2021-06-25T04:54:20.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f4b240019e0 con 0x7f4b2c13e6d0 2021-06-25T04:54:20.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 >> v1:172.21.15.57:6789/0 conn(0x7f4b2c13e6d0 legacy=0x7f4b2c064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b0c003750 0x7f4b0c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b0c004500 0x7f4b0c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b0c004e70 0x7f4b0c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c144210 con 0x7f4b0c004e70 2021-06-25T04:54:20.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0b3530 con 0x7f4b0c003750 2021-06-25T04:54:20.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c00bc40 con 0x7f4b0c004500 2021-06-25T04:54:20.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2b7fe700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b0c003750 0x7f4b0c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2bfff700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b0c004e70 0x7f4b0c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2affd700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b0c004500 0x7f4b0c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2b7fe700 1 -- 172.21.15.57:0/3539692558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b0c004500 msgr2=0x7f4b0c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2b7fe700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b0c004500 0x7f4b0c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2b7fe700 1 -- 172.21.15.57:0/3539692558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b0c004e70 msgr2=0x7f4b0c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2b7fe700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b0c004e70 0x7f4b0c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2bfff700 1 -- 172.21.15.57:0/3539692558 reap_dead start 2021-06-25T04:54:20.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2b7fe700 1 -- 172.21.15.57:0/3539692558 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c003260 con 0x7f4b0c003750 2021-06-25T04:54:20.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2affd700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b0c004500 0x7f4b0c004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:20.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2b7fe700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b0c003750 0x7f4b0c003b70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f4b1c00c000 tx=0x7f4b1c006d90).ready entity=mon.1 client_cookie=d14328a8db3ba2fe server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:20.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1c013450 con 0x7f4b0c003750 2021-06-25T04:54:20.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0135b0 con 0x7f4b0c003750 2021-06-25T04:54:20.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b2a7fc700 1 -- 172.21.15.57:0/3539692558 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1c013910 con 0x7f4b0c003750 2021-06-25T04:54:20.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b30890700 1 -- 172.21.15.57:0/3539692558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b0c003750 msgr2=0x7f4b0c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b30890700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b0c003750 0x7f4b0c003b70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f4b1c00c000 tx=0x7f4b1c006d90).stop 2021-06-25T04:54:20.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b30890700 1 -- 172.21.15.57:0/3539692558 shutdown_connections 2021-06-25T04:54:20.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b30890700 1 --2- 172.21.15.57:0/3539692558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b0c003750 0x7f4b0c003b70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b30890700 1 -- 172.21.15.57:0/3539692558 >> 172.21.15.57:0/3539692558 conn(0x7f4b2c05f670 msgr2=0x7f4b2c05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:20.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b30890700 1 -- 172.21.15.57:0/3539692558 shutdown_connections 2021-06-25T04:54:20.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.449+0000 7f4b30890700 1 -- 172.21.15.57:0/3539692558 wait complete. 2021-06-25T04:54:20.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.453+0000 7f4b30890700 1 Processor -- start 2021-06-25T04:54:20.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.453+0000 7f4b30890700 1 -- start start 2021-06-25T04:54:20.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.453+0000 7f4b30890700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b0c003750 0x7f4b2c14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.453+0000 7f4b30890700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b2c141380 0x7f4b2c153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.453+0000 7f4b30890700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b2c153fd0 0x7f4b2c0adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b30890700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0b0f50 con 0x7f4b2c141380 2021-06-25T04:54:20.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b30890700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0ab380 con 0x7f4b2c153fd0 2021-06-25T04:54:20.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b30890700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0ae7d0 con 0x7f4b0c003750 2021-06-25T04:54:20.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b2c141380 0x7f4b2c153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b2c141380 0x7f4b2c153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39796/0 (socket says 172.21.15.57:39796) 2021-06-25T04:54:20.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2affd700 1 -- 172.21.15.57:0/387571043 learned_addr learned my addr 172.21.15.57:0/387571043 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:20.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2b7fe700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b0c003750 0x7f4b2c14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2bfff700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b2c153fd0 0x7f4b2c0adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2affd700 1 -- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b0c003750 msgr2=0x7f4b2c14fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2affd700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b0c003750 0x7f4b2c14fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2affd700 1 -- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b2c153fd0 msgr2=0x7f4b2c0adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2affd700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b2c153fd0 0x7f4b2c0adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2affd700 1 -- 172.21.15.57:0/387571043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c1533e0 con 0x7f4b2c141380 2021-06-25T04:54:20.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2affd700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b2c141380 0x7f4b2c153ae0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f4b2c148520 tx=0x7f4b14008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:20.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b28ff9700 1 -- 172.21.15.57:0/387571043 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b14018070 con 0x7f4b2c141380 2021-06-25T04:54:20.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b28ff9700 1 -- 172.21.15.57:0/387571043 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b140135e0 con 0x7f4b2c141380 2021-06-25T04:54:20.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b30890700 1 -- 172.21.15.57:0/387571043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c0aea00 con 0x7f4b2c141380 2021-06-25T04:54:20.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b28ff9700 1 -- 172.21.15.57:0/387571043 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b14013940 con 0x7f4b2c141380 2021-06-25T04:54:20.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b30890700 1 -- 172.21.15.57:0/387571043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c14d9c0 con 0x7f4b2c141380 2021-06-25T04:54:20.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b30890700 1 -- 172.21.15.57:0/387571043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c057310 con 0x7f4b2c141380 2021-06-25T04:54:20.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b28ff9700 1 -- 172.21.15.57:0/387571043 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4b14013aa0 con 0x7f4b2c141380 2021-06-25T04:54:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b28ff9700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4b10055490 0x7f4b10057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b28ff9700 1 -- 172.21.15.57:0/387571043 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f4b1406e2f0 con 0x7f4b2c141380 2021-06-25T04:54:20.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.457+0000 7f4b2b7fe700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4b10055490 0x7f4b10057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.461+0000 7f4b2b7fe700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4b10055490 0x7f4b10057950 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f4b1c01d000 tx=0x7f4b1c017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:20.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.465+0000 7f4b28ff9700 1 -- 172.21.15.57:0/387571043 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4b14044480 con 0x7f4b2c141380 2021-06-25T04:54:20.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.589+0000 7f4b30890700 1 -- 172.21.15.57:0/387571043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b2c060160 con 0x7f4b2c141380 2021-06-25T04:54:20.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b28ff9700 1 -- 172.21.15.57:0/387571043 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4b14047aa0 con 0x7f4b2c141380 2021-06-25T04:54:20.595 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:54:20.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 -- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4b10055490 msgr2=0x7f4b10057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4b10055490 0x7f4b10057950 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f4b1c01d000 tx=0x7f4b1c017000).stop 2021-06-25T04:54:20.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 -- 172.21.15.57:0/387571043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b2c141380 msgr2=0x7f4b2c153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b2c141380 0x7f4b2c153ae0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f4b2c148520 tx=0x7f4b14008040).stop 2021-06-25T04:54:20.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 -- 172.21.15.57:0/387571043 shutdown_connections 2021-06-25T04:54:20.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4b10055490 0x7f4b10057950 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b2c153fd0 0x7f4b2c0adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b2c141380 0x7f4b2c153ae0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 --2- 172.21.15.57:0/387571043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b0c003750 0x7f4b2c14fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 -- 172.21.15.57:0/387571043 >> 172.21.15.57:0/387571043 conn(0x7f4b2c05f670 msgr2=0x7f4b2c13ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:20.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 -- 172.21.15.57:0/387571043 shutdown_connections 2021-06-25T04:54:20.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.593+0000 7f4b30890700 1 -- 172.21.15.57:0/387571043 wait complete. 2021-06-25T04:54:20.608 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:54:20.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb4028ad700 1 Processor -- start 2021-06-25T04:54:20.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb4028ad700 1 -- start start 2021-06-25T04:54:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb4028ad700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3fc0b4140 0x7fb3fc140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb4028ad700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3fc143b20 con 0x7fb3fc146910 2021-06-25T04:54:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb4028ad700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3fc143dc0 con 0x7fb3fc0b4650 2021-06-25T04:54:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb4028ad700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc1474d0 con 0x7fb3fc0b4140 2021-06-25T04:54:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3fbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb3fc146910 0x7fb3fc1401f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57020/0 (socket says 172.21.15.57:57020) 2021-06-25T04:54:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3fbfff700 1 -- 172.21.15.57:0/932792192 learned_addr learned my addr 172.21.15.57:0/932792192 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3fb7fe700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3fc0b4140 0x7fb3fc140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288547315 0 0) 0x7fb3fc143b20 con 0x7fb3fc146910 2021-06-25T04:54:20.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3e8003260 con 0x7fb3fc146910 2021-06-25T04:54:20.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 623776267 0 0) 0x7fb3e8003260 con 0x7fb3fc146910 2021-06-25T04:54:20.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3fc0b4140 msgr2=0x7fb3fc140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3fc0b4140 0x7fb3fc140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 >> v1:172.21.15.87:6789/0 conn(0x7fb3fc0b4650 legacy=0x7fb3fc0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc0b0c50 con 0x7fb3fc146910 2021-06-25T04:54:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fb3ec001660 con 0x7fb3fc146910 2021-06-25T04:54:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 >> v1:172.21.15.57:6789/0 conn(0x7fb3fc146910 legacy=0x7fb3fc1401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3e8003780 0x7fb3e8003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e8004500 0x7fb3e8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3e8004e70 0x7fb3e800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc1474d0 con 0x7fb3e8004500 2021-06-25T04:54:20.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e800bc70 con 0x7fb3e8004e70 2021-06-25T04:54:20.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e800be30 con 0x7fb3e8003780 2021-06-25T04:54:20.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3fb7fe700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e8004500 0x7fb3e8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb3fbfff700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3e8003780 0x7fb3e8003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.717+0000 7fb400e4a700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3e8004e70 0x7fb3e800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb3fbfff700 1 -- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3e8004e70 msgr2=0x7fb3e800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb3fbfff700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3e8004e70 0x7fb3e800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb3fbfff700 1 -- 172.21.15.57:0/932792192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e8004500 msgr2=0x7fb3e8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb3fbfff700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e8004500 0x7fb3e8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb3fbfff700 1 -- 172.21.15.57:0/932792192 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8003260 con 0x7fb3e8003780 2021-06-25T04:54:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb3fb7fe700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e8004500 0x7fb3e8004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb3fbfff700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3e8003780 0x7fb3e8003ba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb3ec001370 tx=0x7fb3fc143000).ready entity=mon.2 client_cookie=e94c170b5fcd4d44 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3ec0070d0 con 0x7fb3e8003780 2021-06-25T04:54:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec007230 con 0x7fb3e8003780 2021-06-25T04:54:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb4028ad700 1 -- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3e8003780 msgr2=0x7fb3e8003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb4028ad700 1 --2- 172.21.15.57:0/932792192 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3e8003780 0x7fb3e8003ba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb3ec001370 tx=0x7fb3fc143000).stop 2021-06-25T04:54:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb3faffd700 1 -- 172.21.15.57:0/932792192 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3ec00c8f0 con 0x7fb3e8003780 2021-06-25T04:54:20.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb400e4a700 1 -- 172.21.15.57:0/932792192 reap_dead start 2021-06-25T04:54:20.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb4028ad700 1 -- 172.21.15.57:0/932792192 shutdown_connections 2021-06-25T04:54:20.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb4028ad700 1 -- 172.21.15.57:0/932792192 >> 172.21.15.57:0/932792192 conn(0x7fb3fc05c450 msgr2=0x7fb3fc05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:20.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb4028ad700 1 -- 172.21.15.57:0/932792192 shutdown_connections 2021-06-25T04:54:20.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb4028ad700 1 -- 172.21.15.57:0/932792192 wait complete. 2021-06-25T04:54:20.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb4028ad700 1 Processor -- start 2021-06-25T04:54:20.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.721+0000 7fb4028ad700 1 -- start start 2021-06-25T04:54:20.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb4028ad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3fc0b0110 0x7fb3fc152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb4028ad700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3fc143450 0x7fb3fc155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb4028ad700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3fc13ac10 0x7fb3fc13b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb4028ad700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0b04f0 con 0x7fb3fc0b0110 2021-06-25T04:54:20.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb4028ad700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc13e910 con 0x7fb3fc13ac10 2021-06-25T04:54:20.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb4028ad700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc142aa0 con 0x7fb3fc143450 2021-06-25T04:54:20.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3fbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3fc0b0110 0x7fb3fc152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3fbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3fc0b0110 0x7fb3fc152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39814/0 (socket says 172.21.15.57:39814) 2021-06-25T04:54:20.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3fbfff700 1 -- 172.21.15.57:0/522996799 learned_addr learned my addr 172.21.15.57:0/522996799 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:20.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3fb7fe700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3fc143450 0x7fb3fc155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb400e4a700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3fc13ac10 0x7fb3fc13b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3fbfff700 1 -- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3fc143450 msgr2=0x7fb3fc155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3fbfff700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3fc143450 0x7fb3fc155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3fbfff700 1 -- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3fc13ac10 msgr2=0x7fb3fc13b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3fbfff700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3fc13ac10 0x7fb3fc13b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3fbfff700 1 -- 172.21.15.57:0/522996799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc152360 con 0x7fb3fc0b0110 2021-06-25T04:54:20.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3fbfff700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3fc0b0110 0x7fb3fc152d40 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fb3ec001370 tx=0x7fb3ec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:20.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3f97fa700 1 -- 172.21.15.57:0/522996799 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3ec00c8f0 con 0x7fb3fc0b0110 2021-06-25T04:54:20.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3f97fa700 1 -- 172.21.15.57:0/522996799 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec00ca50 con 0x7fb3fc0b0110 2021-06-25T04:54:20.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb4028ad700 1 -- 172.21.15.57:0/522996799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3fc152600 con 0x7fb3fc0b0110 2021-06-25T04:54:20.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb3f97fa700 1 -- 172.21.15.57:0/522996799 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3ec00cdb0 con 0x7fb3fc0b0110 2021-06-25T04:54:20.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.725+0000 7fb4028ad700 1 -- 172.21.15.57:0/522996799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3fc142770 con 0x7fb3fc0b0110 2021-06-25T04:54:20.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.729+0000 7fb3f97fa700 1 -- 172.21.15.57:0/522996799 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb3ec026070 con 0x7fb3fc0b0110 2021-06-25T04:54:20.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.729+0000 7fb4028ad700 1 -- 172.21.15.57:0/522996799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3fc142550 con 0x7fb3fc0b0110 2021-06-25T04:54:20.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.729+0000 7fb3f97fa700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3dc0554e0 0x7fb3dc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.729+0000 7fb3f97fa700 1 -- 172.21.15.57:0/522996799 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fb3ec06e1a0 con 0x7fb3fc0b0110 2021-06-25T04:54:20.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.729+0000 7fb3fb7fe700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3dc0554e0 0x7fb3dc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.729+0000 7fb3fb7fe700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3dc0554e0 0x7fb3dc0579a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fb3f000b000 tx=0x7fb3f0006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:20.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.733+0000 7fb3f97fa700 1 -- 172.21.15.57:0/522996799 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb3ec044330 con 0x7fb3fc0b0110 2021-06-25T04:54:20.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.869+0000 7fb4028ad700 1 -- 172.21.15.57:0/522996799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3fc057310 con 0x7fb3fc0b0110 2021-06-25T04:54:20.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.869+0000 7fb3f97fa700 1 -- 172.21.15.57:0/522996799 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb3ec047950 con 0x7fb3fc0b0110 2021-06-25T04:54:20.873 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:54:20.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 -- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3dc0554e0 msgr2=0x7fb3dc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3dc0554e0 0x7fb3dc0579a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fb3f000b000 tx=0x7fb3f0006df0).stop 2021-06-25T04:54:20.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 -- 172.21.15.57:0/522996799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3fc0b0110 msgr2=0x7fb3fc152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3fc0b0110 0x7fb3fc152d40 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fb3ec001370 tx=0x7fb3ec015000).stop 2021-06-25T04:54:20.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 -- 172.21.15.57:0/522996799 shutdown_connections 2021-06-25T04:54:20.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3dc0554e0 0x7fb3dc0579a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3fc13ac10 0x7fb3fc13b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3fc143450 0x7fb3fc155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 --2- 172.21.15.57:0/522996799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3fc0b0110 0x7fb3fc152d40 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 -- 172.21.15.57:0/522996799 >> 172.21.15.57:0/522996799 conn(0x7fb3fc05c450 msgr2=0x7fb3fc0b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:20.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 -- 172.21.15.57:0/522996799 shutdown_connections 2021-06-25T04:54:20.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.873+0000 7fb4028ad700 1 -- 172.21.15.57:0/522996799 wait complete. 2021-06-25T04:54:20.885 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:54:20.886 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:20.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.981+0000 7f5978fd1700 1 Processor -- start 2021-06-25T04:54:20.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.981+0000 7f5978fd1700 1 -- start start 2021-06-25T04:54:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.981+0000 7f5978fd1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f59740af510 0x7f5974147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.981+0000 7f5978fd1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59740b5840 con 0x7f59740b05d0 2021-06-25T04:54:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.981+0000 7f5978fd1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59740ac7c0 con 0x7f59740b5460 2021-06-25T04:54:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.981+0000 7f5978fd1700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59741452a0 con 0x7f59740af510 2021-06-25T04:54:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.981+0000 7f5972ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f59740b05d0 0x7f59740acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57044/0 (socket says 172.21.15.57:57044) 2021-06-25T04:54:20.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.981+0000 7f5972ffd700 1 -- 172.21.15.57:0/175002582 learned_addr learned my addr 172.21.15.57:0/175002582 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:20.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5973fff700 1 --2- 172.21.15.57:0/175002582 >> v2:172.21.15.87:3300/0 conn(0x7f59740af510 0x7f5974147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715191741 0 0) 0x7f59740b5840 con 0x7f59740b05d0 2021-06-25T04:54:20.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5960003260 con 0x7f59740b05d0 2021-06-25T04:54:20.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441440658 0 0) 0x7f59740ac7c0 con 0x7f59740b5460 2021-06-25T04:54:20.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59740b5840 con 0x7f59740b5460 2021-06-25T04:54:20.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2177987560 0 0) 0x7f5960003260 con 0x7f59740b05d0 2021-06-25T04:54:20.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 >> v2:172.21.15.87:3300/0 conn(0x7f59740af510 msgr2=0x7f5974147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 --2- 172.21.15.57:0/175002582 >> v2:172.21.15.87:3300/0 conn(0x7f59740af510 0x7f5974147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 >> v1:172.21.15.87:6789/0 conn(0x7f59740b5460 legacy=0x7f5974067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59740b19f0 con 0x7f59740b05d0 2021-06-25T04:54:20.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f5968001660 con 0x7f59740b05d0 2021-06-25T04:54:20.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 >> v1:172.21.15.57:6789/0 conn(0x7f59740b05d0 legacy=0x7f59740acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:20.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59600038e0 0x7f5960003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5960004500 0x7f5960004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5960004e70 0x7f596000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:20.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59741452a0 con 0x7f59600038e0 2021-06-25T04:54:20.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596000bcf0 con 0x7f5960004e70 2021-06-25T04:54:20.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596000beb0 con 0x7f5960004500 2021-06-25T04:54:20.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59737fe700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59600038e0 0x7f5960003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5972ffd700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5960004500 0x7f5960004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5973fff700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5960004e70 0x7f596000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:20.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5972ffd700 1 -- 172.21.15.57:0/175002582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5960004e70 msgr2=0x7f596000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5972ffd700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5960004e70 0x7f596000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5972ffd700 1 -- 172.21.15.57:0/175002582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59600038e0 msgr2=0x7f5960003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:20.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5972ffd700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59600038e0 0x7f5960003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:20.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5973fff700 1 -- 172.21.15.57:0/175002582 reap_dead start 2021-06-25T04:54:20.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5972ffd700 1 -- 172.21.15.57:0/175002582 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5960003260 con 0x7f5960004500 2021-06-25T04:54:20.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59737fe700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59600038e0 0x7f5960003ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:20.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5972ffd700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5960004500 0x7f5960004980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f59600054d0 tx=0x7f5968001dd0).ready entity=mon.2 client_cookie=5f028b4d440654f5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:20.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59680070d0 con 0x7f5960004500 2021-06-25T04:54:20.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968007230 con 0x7f5960004500 2021-06-25T04:54:20.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f59727fc700 1 -- 172.21.15.57:0/175002582 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596800c870 con 0x7f5960004500 2021-06-25T04:54:20.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5978fd1700 1 -- 172.21.15.57:0/175002582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5960004500 msgr2=0x7f5960004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:21.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5978fd1700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5960004500 0x7f5960004980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f59600054d0 tx=0x7f5968001dd0).stop 2021-06-25T04:54:21.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5978fd1700 1 -- 172.21.15.57:0/175002582 shutdown_connections 2021-06-25T04:54:21.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5978fd1700 1 --2- 172.21.15.57:0/175002582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5960004500 0x7f5960004980 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:21.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5978fd1700 1 -- 172.21.15.57:0/175002582 >> 172.21.15.57:0/175002582 conn(0x7f5974062520 msgr2=0x7f5974062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:21.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5978fd1700 1 -- 172.21.15.57:0/175002582 shutdown_connections 2021-06-25T04:54:21.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.985+0000 7f5978fd1700 1 -- 172.21.15.57:0/175002582 wait complete. 2021-06-25T04:54:21.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5978fd1700 1 Processor -- start 2021-06-25T04:54:21.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5978fd1700 1 -- start start 2021-06-25T04:54:21.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5978fd1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5960004500 0x7f59740aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:21.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5978fd1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974156710 0x7f5974066a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:21.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5978fd1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59740a7080 0x7f5974144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:21.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5978fd1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59740adfb0 con 0x7f5960004500 2021-06-25T04:54:21.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5978fd1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974065680 con 0x7f5974156710 2021-06-25T04:54:21.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5978fd1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59740653e0 con 0x7f59740a7080 2021-06-25T04:54:21.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f59737fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5960004500 0x7f59740aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:21.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5972ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974156710 0x7f5974066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:21.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5972ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974156710 0x7f5974066a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:48330/0 (socket says 172.21.15.57:48330) 2021-06-25T04:54:21.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5972ffd700 1 -- 172.21.15.57:0/3915809278 learned_addr learned my addr 172.21.15.57:0/3915809278 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:21.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5973fff700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59740a7080 0x7f5974144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:21.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5972ffd700 1 -- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59740a7080 msgr2=0x7f5974144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:21.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5972ffd700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59740a7080 0x7f5974144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:21.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5972ffd700 1 -- 172.21.15.57:0/3915809278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5960004500 msgr2=0x7f59740aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:21.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5972ffd700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5960004500 0x7f59740aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:21.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5972ffd700 1 -- 172.21.15.57:0/3915809278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974147460 con 0x7f5974156710 2021-06-25T04:54:21.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f59737fe700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5960004500 0x7f59740aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:21.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5973fff700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59740a7080 0x7f5974144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:21.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5972ffd700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974156710 0x7f5974066a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f59600054d0 tx=0x7f5968015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:21.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5970ff9700 1 -- 172.21.15.57:0/3915809278 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596800ce80 con 0x7f5974156710 2021-06-25T04:54:21.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.989+0000 7f5970ff9700 1 -- 172.21.15.57:0/3915809278 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968000e90 con 0x7f5974156710 2021-06-25T04:54:21.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.993+0000 7f5978fd1700 1 -- 172.21.15.57:0/3915809278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5974063860 con 0x7f5974156710 2021-06-25T04:54:21.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.993+0000 7f5970ff9700 1 -- 172.21.15.57:0/3915809278 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5968004920 con 0x7f5974156710 2021-06-25T04:54:21.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.993+0000 7f5978fd1700 1 -- 172.21.15.57:0/3915809278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5974066ef0 con 0x7f5974156710 2021-06-25T04:54:21.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.993+0000 7f5978fd1700 1 -- 172.21.15.57:0/3915809278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5974057310 con 0x7f5974156710 2021-06-25T04:54:21.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.993+0000 7f5970ff9700 1 -- 172.21.15.57:0/3915809278 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5968010070 con 0x7f5974156710 2021-06-25T04:54:21.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.993+0000 7f5970ff9700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59540553d0 0x7f5954057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.993+0000 7f5970ff9700 1 -- 172.21.15.57:0/3915809278 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f596806eb50 con 0x7f5974156710 2021-06-25T04:54:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.993+0000 7f59737fe700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59540553d0 0x7f5954057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:20.993+0000 7f59737fe700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59540553d0 0x7f5954057890 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f596c00c000 tx=0x7f596c007d60).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.001+0000 7f5970ff9700 1 -- 172.21.15.57:0/3915809278 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5968044be0 con 0x7f5974156710 2021-06-25T04:54:21.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 -- 172.21.15.57:0/3915809278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f597405f200 con 0x7f5974156710 2021-06-25T04:54:21.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5970ff9700 1 -- 172.21.15.57:0/3915809278 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f5968025030 con 0x7f5974156710 2021-06-25T04:54:21.168 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:21.169 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2942430957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2942430957},{"type":"v1","addr":"172.21.15.87:6835","nonce":2942430957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34},{"gid":6184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/4012056699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4012056699},{"type":"v1","addr":"172.21.15.57:6833","nonce":4012056699}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:53:27.269151+0000","modified":"2021-06-25T04:53:28.272583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2725183825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2725183825},{"type":"v1","addr":"172.21.15.57:6835","nonce":2725183825}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-06-25T04:54:21.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 -- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59540553d0 msgr2=0x7f5954057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:21.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59540553d0 0x7f5954057890 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f596c00c000 tx=0x7f596c007d60).stop 2021-06-25T04:54:21.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 -- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974156710 msgr2=0x7f5974066a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:21.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974156710 0x7f5974066a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f59600054d0 tx=0x7f5968015000).stop 2021-06-25T04:54:21.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 -- 172.21.15.57:0/3915809278 shutdown_connections 2021-06-25T04:54:21.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59540553d0 0x7f5954057890 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:21.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59740a7080 0x7f5974144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:21.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974156710 0x7f5974066a00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:21.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 --2- 172.21.15.57:0/3915809278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5960004500 0x7f59740aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:21.174 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 -- 172.21.15.57:0/3915809278 >> 172.21.15.57:0/3915809278 conn(0x7f5974062520 msgr2=0x7f5974067330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:21.174 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 -- 172.21.15.57:0/3915809278 shutdown_connections 2021-06-25T04:54:21.174 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:21.165+0000 7f5978fd1700 1 -- 172.21.15.57:0/3915809278 wait complete. 2021-06-25T04:54:21.175 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2021-06-25T04:54:21.484 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:53:27.269151+0000', 'modified': '2021-06-25T04:53:28.272583+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6285': {'gid': 6285, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2725183825', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2725183825}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2725183825}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:54:21.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:54:21.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:54:21.605 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":6285,"want_state":"up:active","state":"up:active","rank_uptime":54.320518086,"mdsmap_epoch":36,"osdmap_epoch":78,"osdmap_epoch_barrier":78,"uptime":58.622138270000001} 2021-06-25T04:54:21.605 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 6285, "mdsmap_epoch": 36, "osdmap_epoch": 78, "osdmap_epoch_barrier": 78, "rank_uptime": 54.320518086, "state": "up:active", "uptime": 58.62213827, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:54:21.606 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:54:21.606 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:54:21.607 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:54:21.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:21.608 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:21.616 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:54:21.676 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:54:21.677 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:54:21.692 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:54:21.693 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:54:21.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:21.694 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:54:21.701 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:54:21.701 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:21.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:54:21.766 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:54:21.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:54:21.777 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:54:21.778 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:54:21.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:21.779 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:54:21.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:54:21.812+0000 7f385b427080 -1 init, newargv = 0x564b48f792e0 newargc=9 2021-06-25T04:54:21.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15075]: starting ceph client 2021-06-25T04:54:21.830 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15075]: starting fuse 2021-06-25T04:54:22.888 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:54:22.908 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:54:22.908 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:54:22.966 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:54:22.968 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:54:22.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:22.969 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:54:22.974 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:54:22.974 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:54:22.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:22.975 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:54:22.976 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:54:22.976 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:54:22.977 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:54:22.977 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:54:22.977 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:54:22.978 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:54:22.978 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:54:22.979 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:54:22.979 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:54:22.979 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:54:22.980 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:54:22.980 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:54:22.981 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:54:22.981 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:54:22.981 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:54:22.982 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:54:22.982 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:54:22.983 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:54:22.983 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:54:22.983 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:54:22.984 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:54:22.984 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:54:23.029 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.15075.asok 2021-06-25T04:54:23.034 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15075.asok 2021-06-25T04:54:23.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:23.035 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15075.asok status 2021-06-25T04:54:23.122 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:54:23.122 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:54:23.123 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:54:23.123 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:54:23.123 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:54:23.123 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:54:23.124 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:54:23.124 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "15075", 2021-06-25T04:54:23.124 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:54:23.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:54:23.124 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:54:23.125 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:54:23.125 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 6460, 2021-06-25T04:54:23.125 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:54:23.125 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:54:23.126 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:54:23.126 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 6460 2021-06-25T04:54:23.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:54:23.126 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:54:23.127 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:54:23.127 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:54:23.127 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2323716461 2021-06-25T04:54:23.127 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:54:23.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:54:23.128 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:54:23.128 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:54:23.128 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:54:23.128 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2323716461 2021-06-25T04:54:23.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:54:23.129 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.6460 172.21.15.102:0/2323716461", 2021-06-25T04:54:23.129 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/2323716461", 2021-06-25T04:54:23.129 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:54:23.130 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 36, 2021-06-25T04:54:23.130 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 78, 2021-06-25T04:54:23.130 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:54:23.130 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:54:23.130 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:54:23.131 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:54:23.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:23.132 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:23.133 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:23.140 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:54:23.141 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:54:23.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:23.142 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:23.158 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:54:23.158 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:23.180 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:23.200 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:23.221 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:23.243 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:54:23.243 INFO:tasks.cephfs.mount:Terminating background process 2021-06-25T04:54:23.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:23.244 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:23.244 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:23.270 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:54:23.272 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:54:23.272 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:54:23.272 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:54:23.273 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:23.288 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15075]: fuse finished with error 0 and tester_r 0 2021-06-25T04:54:23.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:23.290 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:23.290 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:23.296 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:54:23.298 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:54:23.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:54:23.416 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:23.425 INFO:tasks.cephfs.mount:Terminating background process 2021-06-25T04:54:23.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:23.426 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:23.427 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:23.435 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:54:23.436 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:54:23.437 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2021-06-25T04:54:23.437 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:54:23.438 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:23.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14534]: fuse finished with error 0 and tester_r 0 2021-06-25T04:54:23.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:23.458 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:23.458 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:23.465 INFO:teuthology.orchestra.run.smithi161.stdout:ext2/ext3 2021-06-25T04:54:23.466 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:54:23.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:54:23.584 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:23.592 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:54:23.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9e1749700 1 Processor -- start 2021-06-25T04:54:23.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9e1749700 1 -- start start 2021-06-25T04:54:23.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9e1749700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe9dc0af510 0x7fe9dc147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:23.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9e1749700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc0b5840 con 0x7fe9dc0b5460 2021-06-25T04:54:23.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9e1749700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc0ac7c0 con 0x7fe9dc0b05d0 2021-06-25T04:54:23.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9e1749700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc1452a0 con 0x7fe9dc0af510 2021-06-25T04:54:23.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9dbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe9dc0b5460 0x7fe9dc067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57060/0 (socket says 172.21.15.57:57060) 2021-06-25T04:54:23.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9dbfff700 1 -- 172.21.15.57:0/440294384 learned_addr learned my addr 172.21.15.57:0/440294384 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:23.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9e0f48700 1 --2- 172.21.15.57:0/440294384 >> v2:172.21.15.87:3300/0 conn(0x7fe9dc0af510 0x7fe9dc147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:23.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560366528 0 0) 0x7fe9dc0b5840 con 0x7fe9dc0b5460 2021-06-25T04:54:23.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c0003260 con 0x7fe9dc0b5460 2021-06-25T04:54:23.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4121891766 0 0) 0x7fe9c0003260 con 0x7fe9dc0b5460 2021-06-25T04:54:23.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 >> v2:172.21.15.87:3300/0 conn(0x7fe9dc0af510 msgr2=0x7fe9dc147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:23.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 --2- 172.21.15.57:0/440294384 >> v2:172.21.15.87:3300/0 conn(0x7fe9dc0af510 0x7fe9dc147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:23.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 >> v1:172.21.15.87:6789/0 conn(0x7fe9dc0b05d0 legacy=0x7fe9dc0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:23.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc0b19f0 con 0x7fe9dc0b5460 2021-06-25T04:54:23.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fe9c4001660 con 0x7fe9dc0b5460 2021-06-25T04:54:23.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 >> v1:172.21.15.57:6789/0 conn(0x7fe9dc0b5460 legacy=0x7fe9dc067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:23.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 --2- 172.21.15.57:0/440294384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9c0003750 0x7fe9c0003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:23.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 --2- 172.21.15.57:0/440294384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 0x7fe9c0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 --2- 172.21.15.57:0/440294384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9c0004e70 0x7fe9c000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1452a0 con 0x7fe9c0004500 2021-06-25T04:54:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c000bc70 con 0x7fe9c0004e70 2021-06-25T04:54:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9db7fe700 1 --2- 172.21.15.57:0/440294384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 0x7fe9c0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c000be30 con 0x7fe9c0003750 2021-06-25T04:54:23.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9dbfff700 1 --2- 172.21.15.57:0/440294384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9c0003750 0x7fe9c0003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:23.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9e0f48700 1 --2- 172.21.15.57:0/440294384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9c0004e70 0x7fe9c000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:23.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9db7fe700 1 -- 172.21.15.57:0/440294384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9c0003750 msgr2=0x7fe9c0003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:23.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9db7fe700 1 --2- 172.21.15.57:0/440294384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9c0003750 0x7fe9c0003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:23.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9db7fe700 1 -- 172.21.15.57:0/440294384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9c0004e70 msgr2=0x7fe9c000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:23.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9db7fe700 1 --2- 172.21.15.57:0/440294384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9c0004e70 0x7fe9c000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:23.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9e0f48700 1 -- 172.21.15.57:0/440294384 reap_dead start 2021-06-25T04:54:23.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9db7fe700 1 -- 172.21.15.57:0/440294384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0003260 con 0x7fe9c0004500 2021-06-25T04:54:23.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9db7fe700 1 --2- 172.21.15.57:0/440294384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 0x7fe9c0004980 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fe9dc069df0 tx=0x7fe9cc007d60).ready entity=mon.0 client_cookie=a47905d0f8f85750 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:23.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.701+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9cc006890 con 0x7fe9c0004500 2021-06-25T04:54:23.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc0069f0 con 0x7fe9c0004500 2021-06-25T04:54:23.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9daffd700 1 -- 172.21.15.57:0/440294384 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9cc006d50 con 0x7fe9c0004500 2021-06-25T04:54:23.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 -- 172.21.15.57:0/440294384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 msgr2=0x7fe9c0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:23.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 --2- 172.21.15.57:0/440294384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 0x7fe9c0004980 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fe9dc069df0 tx=0x7fe9cc007d60).stop 2021-06-25T04:54:23.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 -- 172.21.15.57:0/440294384 shutdown_connections 2021-06-25T04:54:23.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 --2- 172.21.15.57:0/440294384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 0x7fe9c0004980 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:23.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 -- 172.21.15.57:0/440294384 >> 172.21.15.57:0/440294384 conn(0x7fe9dc062520 msgr2=0x7fe9dc062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:23.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 -- 172.21.15.57:0/440294384 shutdown_connections 2021-06-25T04:54:23.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 -- 172.21.15.57:0/440294384 wait complete. 2021-06-25T04:54:23.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 Processor -- start 2021-06-25T04:54:23.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 -- start start 2021-06-25T04:54:23.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 0x7fe9dc064440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:23.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9dc063540 0x7fe9dc156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:23.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc156ff0 0x7fe9dc0ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:23.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0adfb0 con 0x7fe9c0004500 2021-06-25T04:54:23.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc067020 con 0x7fe9dc156ff0 2021-06-25T04:54:23.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e1749700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc15abd0 con 0x7fe9dc063540 2021-06-25T04:54:23.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9dbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 0x7fe9dc064440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:23.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9dbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 0x7fe9dc064440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39858/0 (socket says 172.21.15.57:39858) 2021-06-25T04:54:23.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9dbfff700 1 -- 172.21.15.57:0/129094898 learned_addr learned my addr 172.21.15.57:0/129094898 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:23.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9e0f48700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc156ff0 0x7fe9dc0ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:23.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9db7fe700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9dc063540 0x7fe9dc156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:23.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9dbfff700 1 -- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9dc063540 msgr2=0x7fe9dc156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:23.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9dbfff700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9dc063540 0x7fe9dc156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:23.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9dbfff700 1 -- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc156ff0 msgr2=0x7fe9dc0ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:23.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9dbfff700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc156ff0 0x7fe9dc0ab810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:23.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9dbfff700 1 -- 172.21.15.57:0/129094898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc15ae70 con 0x7fe9c0004500 2021-06-25T04:54:23.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9dbfff700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 0x7fe9dc064440 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fe9c400c000 tx=0x7fe9c4005a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:23.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.705+0000 7fe9d97fa700 1 -- 172.21.15.57:0/129094898 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c4010440 con 0x7fe9c0004500 2021-06-25T04:54:23.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.709+0000 7fe9d97fa700 1 -- 172.21.15.57:0/129094898 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c400e030 con 0x7fe9c0004500 2021-06-25T04:54:23.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.709+0000 7fe9e1749700 1 -- 172.21.15.57:0/129094898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc0a7080 con 0x7fe9c0004500 2021-06-25T04:54:23.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.709+0000 7fe9d97fa700 1 -- 172.21.15.57:0/129094898 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c4010790 con 0x7fe9c0004500 2021-06-25T04:54:23.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.709+0000 7fe9e1749700 1 -- 172.21.15.57:0/129094898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc14b770 con 0x7fe9c0004500 2021-06-25T04:54:23.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.709+0000 7fe9e1749700 1 -- 172.21.15.57:0/129094898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc157610 con 0x7fe9c0004500 2021-06-25T04:54:23.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.709+0000 7fe9d97fa700 1 -- 172.21.15.57:0/129094898 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe9c401b020 con 0x7fe9c0004500 2021-06-25T04:54:23.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.709+0000 7fe9d97fa700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b4055490 0x7fe9b4057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:23.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.709+0000 7fe9d97fa700 1 -- 172.21.15.57:0/129094898 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fe9c406de30 con 0x7fe9c0004500 2021-06-25T04:54:23.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.709+0000 7fe9db7fe700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b4055490 0x7fe9b4057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:23.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.713+0000 7fe9db7fe700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b4055490 0x7fe9b4057950 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fe9cc01c000 tx=0x7fe9cc016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:23.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.713+0000 7fe9d97fa700 1 -- 172.21.15.57:0/129094898 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe9dc157610 con 0x7fe9c0004500 2021-06-25T04:54:23.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.841+0000 7fe9e1749700 1 -- 172.21.15.57:0/129094898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe9dc157610 con 0x7fe9c0004500 2021-06-25T04:54:23.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9d97fa700 1 -- 172.21.15.57:0/129094898 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v78) v1 ==== 81+0+34117 (secure 0 0 0) 0x7fe9dc157610 con 0x7fe9c0004500 2021-06-25T04:54:23.848 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:23.848 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:54:23.849 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 78, 2021-06-25T04:54:23.849 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:54:23.849 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:54:23.849 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:54:13.626814+0000", 2021-06-25T04:54:23.850 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:54:23.850 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:54:23.850 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:54:23.850 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:54:23.851 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:54:23.851 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:54:23.851 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:54:23.851 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:54:23.852 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:54:23.852 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:23.852 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:54:23.852 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:54:23.852 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:54:23.853 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:54:23.853 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:54:23.853 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 14, 2021-06-25T04:54:23.854 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:54:23.854 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:54:23.854 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:54:23.855 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:54:23.855 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:54:23.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.855 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:54:23.856 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:54:23.856 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:54:23.856 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:23.856 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:23.857 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:23.857 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:23.857 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:23.857 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:23.858 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:23.858 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:23.858 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:54:23.859 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:54:23.859 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:54:23.859 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:54:23.859 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:54:23.860 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:23.860 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:23.860 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:23.860 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:23.860 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:23.861 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:23.861 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:23.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.861 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:54:23.862 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:23.862 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:23.862 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:23.862 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:23.862 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:23.863 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:23.863 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:23.864 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:23.864 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:23.864 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:23.864 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:23.865 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:23.865 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:23.866 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:23.866 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:23.866 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:23.866 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:23.867 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:23.867 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:23.867 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:23.867 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:23.867 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:23.868 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:23.868 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:23.869 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:23.869 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:23.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.869 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:23.869 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:23.870 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:23.870 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:23.870 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:23.870 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:23.871 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:23.871 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:23.871 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:23.872 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:23.873 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:23.873 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:54:23.873 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:54:23.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.874 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:23.874 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:54:23.874 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.875 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:54:23.877 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:54:23.877 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:54:23.877 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:23.878 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:23.879 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:23.879 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:23.880 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:23.880 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:23.880 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:23.880 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:23.881 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:54:23.881 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:54:23.881 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:54:23.881 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:54:23.882 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:54:23.882 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:23.882 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:23.883 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:23.883 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:23.883 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:23.884 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:23.884 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:23.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.885 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:54:23.885 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:23.885 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:23.886 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:23.886 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:23.887 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:23.887 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:23.887 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:23.887 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:23.888 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:23.888 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:23.888 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:23.888 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:23.889 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:23.889 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:23.890 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:23.890 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:23.890 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:23.890 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:23.890 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:23.891 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:23.891 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:23.891 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:23.891 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:23.892 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:23.892 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:23.892 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:23.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.892 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:23.893 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:23.893 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:23.894 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:23.894 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:23.894 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:23.895 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:23.895 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:23.895 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:23.895 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:23.896 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:23.896 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:54:23.897 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:23.897 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:54:23.897 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.898 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 13, 2021-06-25T04:54:23.898 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:54:23.898 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:53:25.832629+0000", 2021-06-25T04:54:23.898 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:23.899 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:23.899 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:23.899 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:23.900 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:23.900 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:23.900 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:23.900 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:23.901 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:54:23.902 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:54:23.902 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:54:23.903 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:54:23.903 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:54:23.903 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:23.903 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:23.904 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:23.904 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:23.905 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:23.905 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:23.905 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:23.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.906 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "77", 2021-06-25T04:54:23.906 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:23.906 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:23.907 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:23.907 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:23.907 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:23.907 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:23.908 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:23.908 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:23.908 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:23.909 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:23.909 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:23.909 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:23.909 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:23.910 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:23.911 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:23.911 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:23.911 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:23.911 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:23.912 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:23.912 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:23.912 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:23.912 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:23.913 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:23.913 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:23.913 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:23.914 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:23.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.914 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:23.914 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:23.915 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:23.915 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:23.915 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:23.915 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:23.916 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:23.916 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:23.916 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:23.916 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:23.917 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:23.917 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:54:23.917 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:54:23.917 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:54:23.918 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:54:23.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.918 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:23.918 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:54:23.919 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:54:23.919 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.919 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.920 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 14, 2021-06-25T04:54:23.920 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:54:23.921 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:53:26.696947+0000", 2021-06-25T04:54:23.921 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:23.921 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:23.921 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:23.922 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:23.922 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:23.922 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:23.922 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:23.923 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:23.923 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:54:23.924 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:54:23.924 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:54:23.924 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:54:23.924 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:54:23.925 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:23.925 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:23.925 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:23.925 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:23.926 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:23.926 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:23.926 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:23.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.927 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "77", 2021-06-25T04:54:23.927 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:23.927 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:23.927 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:23.929 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:23.929 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:23.929 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:23.929 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:23.930 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:23.930 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:23.930 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:23.930 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:23.931 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:23.931 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:23.931 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:23.932 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:23.932 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:23.932 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:23.933 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:23.933 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:23.933 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:23.933 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:23.934 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:23.934 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:23.934 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:23.934 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:23.935 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:23.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.935 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:23.935 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:23.935 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:23.936 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:23.936 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:23.936 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:23.936 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:23.937 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:23.937 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:23.937 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:23.938 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:23.938 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:54:23.938 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:23.938 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:54:23.938 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:54:23.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.939 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:23.940 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:54:23.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.940 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:54:23.940 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:54:23.940 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:23.941 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:23.941 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:23.942 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:23.942 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:23.942 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:23.942 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:23.943 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 75, 2021-06-25T04:54:23.943 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:23.944 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:23.944 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:23.944 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.945 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.945 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:54:23.945 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:23.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.946 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.946 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:54:23.946 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:23.946 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.947 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.947 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:23.947 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.948 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.948 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:54:23.948 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:23.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.949 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.949 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:54:23.949 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:23.950 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.950 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.950 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:23.950 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.951 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.951 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:54:23.951 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:23.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.952 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.952 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:54:23.960 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:23.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.960 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.961 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:23.961 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.962 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.962 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:54:23.962 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:23.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.963 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.963 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:54:23.964 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:23.964 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.964 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.964 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:54:23.965 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:54:23.965 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:54:23.965 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:54:23.965 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:23.966 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:23.966 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:23.966 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:54:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:54:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 65, 2021-06-25T04:54:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:54:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:54:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:54:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:54:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:54:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:54:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:54:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:54:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:54:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:54:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:54:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:54:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:54:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:54:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 75, 2021-06-25T04:54:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:54:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:54:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:54:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:54:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:54:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:54:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:54:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:54:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:54:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:54:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:54:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:54:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:54:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:54:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 75, 2021-06-25T04:54:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:54:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:54:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:54:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:54:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:54:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:54:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:54:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:54:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:54:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:54:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:54:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:54:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:54:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:54:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 74, 2021-06-25T04:54:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:54:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:54:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:54:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:54:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:54:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:54:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:54:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:54:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:54:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:54:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:54:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:54:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:54:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:54:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 75, 2021-06-25T04:54:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:54:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:54:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:54:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:54:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:54:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:54:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:54:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:54:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:54:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:54:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:54:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:54:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:54:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:54:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 75, 2021-06-25T04:54:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:54:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:54:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:54:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:54:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:54:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:54:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:54:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:54:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:54:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:54:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:54:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:54:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:54:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:54:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 74, 2021-06-25T04:54:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:54:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:54:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:54:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:54:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:24.083 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.083 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.083 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:54:24.084 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:24.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.084 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.084 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:54:24.085 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:24.085 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.085 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.086 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:24.086 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:24.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.086 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:24.087 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:54:24.087 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:24.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.087 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:24.088 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:54:24.088 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:24.088 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.088 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.089 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:54:24.089 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:54:24.089 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:54:24.090 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:54:24.090 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:24.090 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:24.090 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:24.091 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:24.091 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.091 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:24.091 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:54:24.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.092 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:54:24.092 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:24.092 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:24.092 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:24.093 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:24.093 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:24.093 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:54:24.093 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:24.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.094 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:54:24.094 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:24.094 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:24.095 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:24.095 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:24.095 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:24.095 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:54:24.095 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:24.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.096 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:54:24.096 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:24.096 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:24.097 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:24.097 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:24.097 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:24.097 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:54:24.098 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:24.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.098 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:54:24.099 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:24.099 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:24.099 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:24.099 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:24.099 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:24.100 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:54:24.100 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:24.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.101 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:54:24.101 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:24.101 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:24.101 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:24.101 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:24.102 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:24.102 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:54:24.102 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:24.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.103 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:54:24.103 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:24.103 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:24.104 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:24.104 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:24.104 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:24.104 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:54:24.104 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:24.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.105 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:54:24.105 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:24.106 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:24.106 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:24.106 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:24.106 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:24.107 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:54:24.107 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:24.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:24.108 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:54:24.108 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:24.108 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:24.108 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:24.108 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:24.109 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:24.109 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:54:24.109 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:24.110 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.110 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:24.110 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:54:24.110 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:54:24.111 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:54:24.111 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:54:24.111 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:54:24.111 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.102:0/1630225676": "2021-06-25T05:54:12.976776+0000" 2021-06-25T04:54:24.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.112 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:54:24.112 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:54:24.112 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:54:24.112 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:54:24.113 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:54:24.113 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:54:24.113 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:54:24.113 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:54:24.113 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:54:24.114 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:54:24.114 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:54:24.114 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:54:24.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.115 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:54:24.115 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:54:24.115 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:54:24.115 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:54:24.115 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:54:24.116 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:54:24.116 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:54:24.116 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:24.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:24.117 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:54:24.117 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:54:24.117 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:54:24.117 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:54:24.117 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:54:24.118 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:54:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 -- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b4055490 msgr2=0x7fe9b4057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b4055490 0x7fe9b4057950 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fe9cc01c000 tx=0x7fe9cc016000).stop 2021-06-25T04:54:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 -- 172.21.15.57:0/129094898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 msgr2=0x7fe9dc064440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 0x7fe9dc064440 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fe9c400c000 tx=0x7fe9c4005a30).stop 2021-06-25T04:54:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 -- 172.21.15.57:0/129094898 shutdown_connections 2021-06-25T04:54:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9b4055490 0x7fe9b4057950 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc156ff0 0x7fe9dc0ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9dc063540 0x7fe9dc156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 --2- 172.21.15.57:0/129094898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9c0004500 0x7fe9dc064440 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 -- 172.21.15.57:0/129094898 >> 172.21.15.57:0/129094898 conn(0x7fe9dc062520 msgr2=0x7fe9dc0acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 -- 172.21.15.57:0/129094898 shutdown_connections 2021-06-25T04:54:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:23.845+0000 7fe9e1749700 1 -- 172.21.15.57:0/129094898 wait complete. 2021-06-25T04:54:24.123 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:24.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.229+0000 7f4019251700 1 Processor -- start 2021-06-25T04:54:24.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.229+0000 7f4019251700 1 -- start start 2021-06-25T04:54:24.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.229+0000 7f4019251700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40140b96a0 0x7f40140aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.229+0000 7f4019251700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f401413ffb0 0x7f4014140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.229+0000 7f4019251700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40140674c0 con 0x7f40140670e0 2021-06-25T04:54:24.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.229+0000 7f4019251700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4014143040 con 0x7f401413ffb0 2021-06-25T04:54:24.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.229+0000 7f4019251700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40140af490 con 0x7f40140b96a0 2021-06-25T04:54:24.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4012d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f40140670e0 0x7f4014143970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57080/0 (socket says 172.21.15.57:57080) 2021-06-25T04:54:24.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4012d9d700 1 -- 172.21.15.57:0/843881752 learned_addr learned my addr 172.21.15.57:0/843881752 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:24.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f401259c700 1 --2- 172.21.15.57:0/843881752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40140b96a0 0x7f40140aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f401359e700 1 --2- 172.21.15.57:0/843881752 >> v2:172.21.15.87:3300/0 conn(0x7f401413ffb0 0x7f4014140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4011d9b700 1 -- 172.21.15.57:0/843881752 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622190050 0 0) 0x7f40140674c0 con 0x7f40140670e0 2021-06-25T04:54:24.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f401259c700 1 -- 172.21.15.57:0/843881752 >> v2:172.21.15.87:3300/0 conn(0x7f401413ffb0 msgr2=0x7f4014140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f401259c700 1 --2- 172.21.15.57:0/843881752 >> v2:172.21.15.87:3300/0 conn(0x7f401413ffb0 0x7f4014140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f401259c700 1 -- 172.21.15.57:0/843881752 >> v1:172.21.15.57:6789/0 conn(0x7f40140670e0 legacy=0x7f4014143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f401259c700 1 -- 172.21.15.57:0/843881752 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014143230 con 0x7f40140b96a0 2021-06-25T04:54:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f401259c700 1 --2- 172.21.15.57:0/843881752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40140b96a0 0x7f40140aebc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4004002f70 tx=0x7f4004006df0).ready entity=mon.2 client_cookie=8fc6fc28e2903de0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:24.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4011d9b700 1 -- 172.21.15.57:0/843881752 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f400400d570 con 0x7f40140b96a0 2021-06-25T04:54:24.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4011d9b700 1 -- 172.21.15.57:0/843881752 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004000e90 con 0x7f40140b96a0 2021-06-25T04:54:24.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4011d9b700 1 -- 172.21.15.57:0/843881752 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f400400d8c0 con 0x7f40140b96a0 2021-06-25T04:54:24.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4019251700 1 -- 172.21.15.57:0/843881752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40140b96a0 msgr2=0x7f40140aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4019251700 1 --2- 172.21.15.57:0/843881752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40140b96a0 0x7f40140aebc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4004002f70 tx=0x7f4004006df0).stop 2021-06-25T04:54:24.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4019251700 1 -- 172.21.15.57:0/843881752 shutdown_connections 2021-06-25T04:54:24.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4019251700 1 --2- 172.21.15.57:0/843881752 >> v2:172.21.15.87:3300/0 conn(0x7f401413ffb0 0x7f4014140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4019251700 1 --2- 172.21.15.57:0/843881752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40140b96a0 0x7f40140aebc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4019251700 1 -- 172.21.15.57:0/843881752 >> 172.21.15.57:0/843881752 conn(0x7f401405f9b0 msgr2=0x7f4014061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:24.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4019251700 1 -- 172.21.15.57:0/843881752 shutdown_connections 2021-06-25T04:54:24.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.233+0000 7f4019251700 1 -- 172.21.15.57:0/843881752 wait complete. 2021-06-25T04:54:24.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4019251700 1 Processor -- start 2021-06-25T04:54:24.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4019251700 1 -- start start 2021-06-25T04:54:24.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4019251700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40140670e0 0x7f4014144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4019251700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40140b96a0 0x7f40141556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4019251700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f401413ffb0 0x7f4014155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4019251700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401405c0e0 con 0x7f40140b96a0 2021-06-25T04:54:24.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4019251700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40141485f0 con 0x7f40140670e0 2021-06-25T04:54:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4019251700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401405c340 con 0x7f401413ffb0 2021-06-25T04:54:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f401259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40140b96a0 0x7f40141556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f401259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40140b96a0 0x7f40141556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39870/0 (socket says 172.21.15.57:39870) 2021-06-25T04:54:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f401259c700 1 -- 172.21.15.57:0/2821839108 learned_addr learned my addr 172.21.15.57:0/2821839108 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:24.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4012d9d700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40140670e0 0x7f4014144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f401359e700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f401413ffb0 0x7f4014155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f401259c700 1 -- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f401413ffb0 msgr2=0x7f4014155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f401259c700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f401413ffb0 0x7f4014155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f401259c700 1 -- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40140670e0 msgr2=0x7f4014144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f401259c700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40140670e0 0x7f4014144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f401259c700 1 -- 172.21.15.57:0/2821839108 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400400b180 con 0x7f40140b96a0 2021-06-25T04:54:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f401259c700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40140b96a0 0x7f40141556c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f4004002f70 tx=0x7f4004014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4003fff700 1 -- 172.21.15.57:0/2821839108 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4004006b20 con 0x7f40140b96a0 2021-06-25T04:54:24.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4003fff700 1 -- 172.21.15.57:0/2821839108 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004012d90 con 0x7f40140b96a0 2021-06-25T04:54:24.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4003fff700 1 -- 172.21.15.57:0/2821839108 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f400401f630 con 0x7f40140b96a0 2021-06-25T04:54:24.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4019251700 1 -- 172.21.15.57:0/2821839108 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401405c5e0 con 0x7f40140b96a0 2021-06-25T04:54:24.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.237+0000 7f4019251700 1 -- 172.21.15.57:0/2821839108 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40141560a0 con 0x7f40140b96a0 2021-06-25T04:54:24.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.241+0000 7f4019251700 1 -- 172.21.15.57:0/2821839108 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4014057310 con 0x7f40140b96a0 2021-06-25T04:54:24.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.241+0000 7f4003fff700 1 -- 172.21.15.57:0/2821839108 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4004025020 con 0x7f40140b96a0 2021-06-25T04:54:24.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.241+0000 7f4003fff700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3ff00554e0 0x7f3ff00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.241+0000 7f4003fff700 1 -- 172.21.15.57:0/2821839108 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f400406eff0 con 0x7f40140b96a0 2021-06-25T04:54:24.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.241+0000 7f4012d9d700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3ff00554e0 0x7f3ff00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.241+0000 7f4012d9d700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3ff00554e0 0x7f3ff00579a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f400800d000 tx=0x7f40080011a0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:24.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.249+0000 7f4003fff700 1 -- 172.21.15.57:0/2821839108 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f40040450c0 con 0x7f40140b96a0 2021-06-25T04:54:24.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.417+0000 7f4019251700 1 -- 172.21.15.57:0/2821839108 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40140698a0 con 0x7f40140b96a0 2021-06-25T04:54:24.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.417+0000 7f4003fff700 1 -- 172.21.15.57:0/2821839108 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f40040486e0 con 0x7f40140b96a0 2021-06-25T04:54:24.421 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:24.421 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2942430957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2942430957},{"type":"v1","addr":"172.21.15.87:6835","nonce":2942430957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34},{"gid":6184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/4012056699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4012056699},{"type":"v1","addr":"172.21.15.57:6833","nonce":4012056699}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:53:27.269151+0000","modified":"2021-06-25T04:53:28.272583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2725183825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2725183825},{"type":"v1","addr":"172.21.15.57:6835","nonce":2725183825}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-06-25T04:54:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 -- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3ff00554e0 msgr2=0x7f3ff00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3ff00554e0 0x7f3ff00579a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f400800d000 tx=0x7f40080011a0).stop 2021-06-25T04:54:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 -- 172.21.15.57:0/2821839108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40140b96a0 msgr2=0x7f40141556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40140b96a0 0x7f40141556c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f4004002f70 tx=0x7f4004014000).stop 2021-06-25T04:54:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 -- 172.21.15.57:0/2821839108 shutdown_connections 2021-06-25T04:54:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3ff00554e0 0x7f3ff00579a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f401413ffb0 0x7f4014155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40140b96a0 0x7f40141556c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 --2- 172.21.15.57:0/2821839108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40140670e0 0x7f4014144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 -- 172.21.15.57:0/2821839108 >> 172.21.15.57:0/2821839108 conn(0x7f401405f9b0 msgr2=0x7f40140b3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:24.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 -- 172.21.15.57:0/2821839108 shutdown_connections 2021-06-25T04:54:24.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.421+0000 7f4019251700 1 -- 172.21.15.57:0/2821839108 wait complete. 2021-06-25T04:54:24.426 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2021-06-25T04:54:24.434 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:54:24.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.533+0000 7fbd214fe700 1 Processor -- start 2021-06-25T04:54:24.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.533+0000 7fbd214fe700 1 -- start start 2021-06-25T04:54:24.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd214fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbd1c0b3090 0x7fbd1c1433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd214fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd1c0ace30 0x7fbd1c13f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd214fe700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c1438e0 con 0x7fbd1c0b06d0 2021-06-25T04:54:24.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd214fe700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c0b0ab0 con 0x7fbd1c0ace30 2021-06-25T04:54:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd214fe700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c0ae640 con 0x7fbd1c0b3090 2021-06-25T04:54:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1bfff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbd1c0b06d0 0x7fbd1c142ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:57842/0 (socket says 172.21.15.57:57842) 2021-06-25T04:54:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd20cfd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd1c0ace30 0x7fbd1c13f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1bfff700 1 -- 172.21.15.57:0/3103042090 learned_addr learned my addr 172.21.15.57:0/3103042090 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:24.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1b7fe700 1 --2- 172.21.15.57:0/3103042090 >> v2:172.21.15.87:3300/0 conn(0x7fbd1c0b3090 0x7fbd1c1433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1affd700 1 -- 172.21.15.57:0/3103042090 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745773373 0 0) 0x7fbd1c1438e0 con 0x7fbd1c0b06d0 2021-06-25T04:54:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1affd700 1 -- 172.21.15.57:0/3103042090 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd08003260 con 0x7fbd1c0b06d0 2021-06-25T04:54:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1b7fe700 1 -- 172.21.15.57:0/3103042090 >> v2:172.21.15.57:3300/0 conn(0x7fbd1c0ace30 msgr2=0x7fbd1c13f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1b7fe700 1 --2- 172.21.15.57:0/3103042090 >> v2:172.21.15.57:3300/0 conn(0x7fbd1c0ace30 0x7fbd1c13f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1b7fe700 1 -- 172.21.15.57:0/3103042090 >> v1:172.21.15.87:6789/0 conn(0x7fbd1c0b06d0 legacy=0x7fbd1c142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1b7fe700 1 -- 172.21.15.57:0/3103042090 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0ae8e0 con 0x7fbd1c0b3090 2021-06-25T04:54:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1b7fe700 1 --2- 172.21.15.57:0/3103042090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd1c0b3090 0x7fbd1c1433f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fbd10002f70 tx=0x7fbd10006df0).ready entity=mon.1 client_cookie=7586db1cfb1cee2e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1affd700 1 -- 172.21.15.57:0/3103042090 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1000d4f0 con 0x7fbd1c0b3090 2021-06-25T04:54:24.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1affd700 1 -- 172.21.15.57:0/3103042090 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd10000e90 con 0x7fbd1c0b3090 2021-06-25T04:54:24.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd1affd700 1 -- 172.21.15.57:0/3103042090 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1000d840 con 0x7fbd1c0b3090 2021-06-25T04:54:24.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd214fe700 1 -- 172.21.15.57:0/3103042090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd1c0b3090 msgr2=0x7fbd1c1433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd214fe700 1 --2- 172.21.15.57:0/3103042090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd1c0b3090 0x7fbd1c1433f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fbd10002f70 tx=0x7fbd10006df0).stop 2021-06-25T04:54:24.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd214fe700 1 -- 172.21.15.57:0/3103042090 shutdown_connections 2021-06-25T04:54:24.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd214fe700 1 --2- 172.21.15.57:0/3103042090 >> v2:172.21.15.57:3300/0 conn(0x7fbd1c0ace30 0x7fbd1c13f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd214fe700 1 --2- 172.21.15.57:0/3103042090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd1c0b3090 0x7fbd1c1433f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.537+0000 7fbd214fe700 1 -- 172.21.15.57:0/3103042090 >> 172.21.15.57:0/3103042090 conn(0x7fbd1c061100 msgr2=0x7fbd1c062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:24.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd214fe700 1 -- 172.21.15.57:0/3103042090 shutdown_connections 2021-06-25T04:54:24.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd214fe700 1 -- 172.21.15.57:0/3103042090 wait complete. 2021-06-25T04:54:24.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd214fe700 1 Processor -- start 2021-06-25T04:54:24.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd214fe700 1 -- start start 2021-06-25T04:54:24.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd214fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd1c0ace30 0x7fbd1c0abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd214fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd1c0b06d0 0x7fbd1c13ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd214fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd1c0b3090 0x7fbd1c153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd214fe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c13d080 con 0x7fbd1c0ace30 2021-06-25T04:54:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd214fe700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c13b520 con 0x7fbd1c0b06d0 2021-06-25T04:54:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd214fe700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c13ab00 con 0x7fbd1c0b3090 2021-06-25T04:54:24.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd1bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd1c0ace30 0x7fbd1c0abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd1bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd1c0ace30 0x7fbd1c0abd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39882/0 (socket says 172.21.15.57:39882) 2021-06-25T04:54:24.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd1bfff700 1 -- 172.21.15.57:0/2434415622 learned_addr learned my addr 172.21.15.57:0/2434415622 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:24.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd20cfd700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd1c0b3090 0x7fbd1c153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.541+0000 7fbd1b7fe700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd1c0b06d0 0x7fbd1c13ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd1bfff700 1 -- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd1c0b3090 msgr2=0x7fbd1c153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd1bfff700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd1c0b3090 0x7fbd1c153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd1bfff700 1 -- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd1c0b06d0 msgr2=0x7fbd1c13ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd1bfff700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd1c0b06d0 0x7fbd1c13ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd1bfff700 1 -- 172.21.15.57:0/2434415622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1000b180 con 0x7fbd1c0ace30 2021-06-25T04:54:24.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd1b7fe700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd1c0b06d0 0x7fbd1c13ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:54:24.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd1bfff700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd1c0ace30 0x7fbd1c0abd30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fbd0c001110 tx=0x7fbd0c007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd197fa700 1 -- 172.21.15.57:0/2434415622 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd0c00ce20 con 0x7fbd1c0ace30 2021-06-25T04:54:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd197fa700 1 -- 172.21.15.57:0/2434415622 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c0072e0 con 0x7fbd1c0ace30 2021-06-25T04:54:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd214fe700 1 -- 172.21.15.57:0/2434415622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c13e380 con 0x7fbd1c0ace30 2021-06-25T04:54:24.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd197fa700 1 -- 172.21.15.57:0/2434415622 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd0c005800 con 0x7fbd1c0ace30 2021-06-25T04:54:24.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd214fe700 1 -- 172.21.15.57:0/2434415622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c13e5e0 con 0x7fbd1c0ace30 2021-06-25T04:54:24.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd214fe700 1 -- 172.21.15.57:0/2434415622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c067900 con 0x7fbd1c0ace30 2021-06-25T04:54:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd197fa700 1 -- 172.21.15.57:0/2434415622 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbd0c010070 con 0x7fbd1c0ace30 2021-06-25T04:54:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd197fa700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbcfc0553f0 0x7fbcfc0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd197fa700 1 -- 172.21.15.57:0/2434415622 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fbd0c06d690 con 0x7fbd1c0ace30 2021-06-25T04:54:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.545+0000 7fbd1b7fe700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbcfc0553f0 0x7fbcfc0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.549+0000 7fbd1b7fe700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbcfc0553f0 0x7fbcfc0578b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fbd10013000 tx=0x7fbd10014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.553+0000 7fbd197fa700 1 -- 172.21.15.57:0/2434415622 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbd0c043780 con 0x7fbd1c0ace30 2021-06-25T04:54:24.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.717+0000 7fbd214fe700 1 -- 172.21.15.57:0/2434415622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbd1c057310 con 0x7fbd1c0ace30 2021-06-25T04:54:24.901 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:54:24.897+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:54:24.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.913+0000 7fbd197fa700 1 -- 172.21.15.57:0/2434415622 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbd0c046da0 con 0x7fbd1c0ace30 2021-06-25T04:54:24.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.913+0000 7fbd214fe700 1 -- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbcfc0553f0 msgr2=0x7fbcfc0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.913+0000 7fbd214fe700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbcfc0553f0 0x7fbcfc0578b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fbd10013000 tx=0x7fbd10014000).stop 2021-06-25T04:54:24.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.913+0000 7fbd214fe700 1 -- 172.21.15.57:0/2434415622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd1c0ace30 msgr2=0x7fbd1c0abd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:24.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.913+0000 7fbd214fe700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd1c0ace30 0x7fbd1c0abd30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fbd0c001110 tx=0x7fbd0c007ad0).stop 2021-06-25T04:54:24.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.917+0000 7fbd214fe700 1 -- 172.21.15.57:0/2434415622 shutdown_connections 2021-06-25T04:54:24.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.917+0000 7fbd214fe700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbcfc0553f0 0x7fbcfc0578b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.917+0000 7fbd214fe700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd1c0b3090 0x7fbd1c153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.917+0000 7fbd214fe700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd1c0b06d0 0x7fbd1c13ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.917+0000 7fbd214fe700 1 --2- 172.21.15.57:0/2434415622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd1c0ace30 0x7fbd1c0abd30 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.917+0000 7fbd214fe700 1 -- 172.21.15.57:0/2434415622 >> 172.21.15.57:0/2434415622 conn(0x7fbd1c061100 msgr2=0x7fbd1c142c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:24.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.917+0000 7fbd214fe700 1 -- 172.21.15.57:0/2434415622 shutdown_connections 2021-06-25T04:54:24.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:24.917+0000 7fbd214fe700 1 -- 172.21.15.57:0/2434415622 wait complete. 2021-06-25T04:54:24.923 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:54:24.934 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:24.947 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:54:25.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd20759e700 1 Processor -- start 2021-06-25T04:54:25.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd20759e700 1 -- start start 2021-06-25T04:54:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd20759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2080af510 0x7fd208147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd20759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2080b5840 con 0x7fd2080b05d0 2021-06-25T04:54:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd20759e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2080ac7c0 con 0x7fd2080b5460 2021-06-25T04:54:25.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd20759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081452a0 con 0x7fd2080af510 2021-06-25T04:54:25.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd205d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd2080b05d0 0x7fd2080acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57120/0 (socket says 172.21.15.57:57120) 2021-06-25T04:54:25.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd205d9b700 1 -- 172.21.15.57:0/3170257310 learned_addr learned my addr 172.21.15.57:0/3170257310 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:25.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd206d9d700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2080af510 0x7fd208147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012437955 0 0) 0x7fd2080b5840 con 0x7fd2080b05d0 2021-06-25T04:54:25.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ec003260 con 0x7fd2080b05d0 2021-06-25T04:54:25.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.037+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3239986203 0 0) 0x7fd1ec003260 con 0x7fd2080b05d0 2021-06-25T04:54:25.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2080af510 msgr2=0x7fd208147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2080af510 0x7fd208147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 >> v1:172.21.15.87:6789/0 conn(0x7fd2080b5460 legacy=0x7fd208067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080b19f0 con 0x7fd2080b05d0 2021-06-25T04:54:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fd1f8001660 con 0x7fd2080b05d0 2021-06-25T04:54:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 >> v1:172.21.15.57:6789/0 conn(0x7fd2080b05d0 legacy=0x7fd2080acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ec003780 0x7fd1ec003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2080af510 0x7fd1ec004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1ec0049f0 0x7fd1ec004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081452a0 con 0x7fd1ec003780 2021-06-25T04:54:25.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20659c700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ec003780 0x7fd1ec003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec00b780 con 0x7fd1ec0049f0 2021-06-25T04:54:25.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec00b940 con 0x7fd2080af510 2021-06-25T04:54:25.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd205d9b700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2080af510 0x7fd1ec004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20659c700 1 -- 172.21.15.57:0/3170257310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2080af510 msgr2=0x7fd1ec004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:25.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20659c700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2080af510 0x7fd1ec004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20659c700 1 -- 172.21.15.57:0/3170257310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1ec0049f0 msgr2=0x7fd1ec004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:25.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20659c700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1ec0049f0 0x7fd1ec004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-06-25T04:54:25.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20659c700 1 -- 172.21.15.57:0/3170257310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec003260 con 0x7fd1ec003780 2021-06-25T04:54:25.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd205d9b700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2080af510 0x7fd1ec004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:54:25.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20659c700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ec003780 0x7fd1ec003ba0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fd208069df0 tx=0x7fd1fc0079e0).ready entity=mon.0 client_cookie=2792a15ef8f6ee5a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:25.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1fc001ea0 con 0x7fd1ec003780 2021-06-25T04:54:25.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc014410 con 0x7fd1ec003780 2021-06-25T04:54:25.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20559a700 1 -- 172.21.15.57:0/3170257310 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1fc014770 con 0x7fd1ec003780 2021-06-25T04:54:25.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20759e700 1 -- 172.21.15.57:0/3170257310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ec003780 msgr2=0x7fd1ec003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20759e700 1 --2- 172.21.15.57:0/3170257310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ec003780 0x7fd1ec003ba0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fd208069df0 tx=0x7fd1fc0079e0).stop 2021-06-25T04:54:25.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd206d9d700 1 -- 172.21.15.57:0/3170257310 reap_dead start 2021-06-25T04:54:25.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20759e700 1 -- 172.21.15.57:0/3170257310 shutdown_connections 2021-06-25T04:54:25.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20759e700 1 -- 172.21.15.57:0/3170257310 >> 172.21.15.57:0/3170257310 conn(0x7fd208062520 msgr2=0x7fd208062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:25.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20759e700 1 -- 172.21.15.57:0/3170257310 shutdown_connections 2021-06-25T04:54:25.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.041+0000 7fd20759e700 1 -- 172.21.15.57:0/3170257310 wait complete. 2021-06-25T04:54:25.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd20759e700 1 Processor -- start 2021-06-25T04:54:25.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd20759e700 1 -- start start 2021-06-25T04:54:25.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd20759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd20814d1d0 0x7fd20815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd20759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2080636a0 0x7fd20815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd20759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd208147400 0x7fd208142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd20759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2080adfb0 con 0x7fd2080636a0 2021-06-25T04:54:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd20759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2080afeb0 con 0x7fd20814d1d0 2021-06-25T04:54:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd20759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20814d5b0 con 0x7fd208147400 2021-06-25T04:54:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd205d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2080636a0 0x7fd20815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd20659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd20814d1d0 0x7fd20815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd205d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2080636a0 0x7fd20815a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39916/0 (socket says 172.21.15.57:39916) 2021-06-25T04:54:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd205d9b700 1 -- 172.21.15.57:0/1256782228 learned_addr learned my addr 172.21.15.57:0/1256782228 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd20659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd20814d1d0 0x7fd20815a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:48408/0 (socket says 172.21.15.57:48408) 2021-06-25T04:54:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd206d9d700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd208147400 0x7fd208142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd205d9b700 1 -- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd208147400 msgr2=0x7fd208142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd205d9b700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd208147400 0x7fd208142480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd205d9b700 1 -- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd20814d1d0 msgr2=0x7fd20815a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd205d9b700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd20814d1d0 0x7fd20815a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.045+0000 7fd205d9b700 1 -- 172.21.15.57:0/1256782228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd208146b90 con 0x7fd2080636a0 2021-06-25T04:54:25.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.049+0000 7fd205d9b700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2080636a0 0x7fd20815a520 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fd208063580 tx=0x7fd1f8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:25.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.049+0000 7fd1f77fe700 1 -- 172.21.15.57:0/1256782228 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f8007170 con 0x7fd2080636a0 2021-06-25T04:54:25.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.049+0000 7fd1f77fe700 1 -- 172.21.15.57:0/1256782228 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f80072d0 con 0x7fd2080636a0 2021-06-25T04:54:25.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.049+0000 7fd20759e700 1 -- 172.21.15.57:0/1256782228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd208146e30 con 0x7fd2080636a0 2021-06-25T04:54:25.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.049+0000 7fd1f77fe700 1 -- 172.21.15.57:0/1256782228 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f80049e0 con 0x7fd2080636a0 2021-06-25T04:54:25.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.049+0000 7fd20759e700 1 -- 172.21.15.57:0/1256782228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd208063200 con 0x7fd2080636a0 2021-06-25T04:54:25.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.049+0000 7fd20759e700 1 -- 172.21.15.57:0/1256782228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2080633c0 con 0x7fd2080636a0 2021-06-25T04:54:25.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.049+0000 7fd1f77fe700 1 -- 172.21.15.57:0/1256782228 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd1f801b060 con 0x7fd2080636a0 2021-06-25T04:54:25.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.049+0000 7fd1f77fe700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1e4055510 0x7fd1e40579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.049+0000 7fd1f77fe700 1 -- 172.21.15.57:0/1256782228 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6549+0+0 (secure 0 0 0) 0x7fd1f806dbb0 con 0x7fd2080636a0 2021-06-25T04:54:25.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.049+0000 7fd20659c700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1e4055510 0x7fd1e40579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.053+0000 7fd20659c700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1e4055510 0x7fd1e40579d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fd1fc01b000 tx=0x7fd1fc015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:25.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.053+0000 7fd1f77fe700 1 -- 172.21.15.57:0/1256782228 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd1f8074080 con 0x7fd2080636a0 2021-06-25T04:54:25.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.217+0000 7fd20759e700 1 -- 172.21.15.57:0/1256782228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd208057310 con 0x7fd2080636a0 2021-06-25T04:54:25.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd1f77fe700 1 -- 172.21.15.57:0/1256782228 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fd1f8043c80 con 0x7fd2080636a0 2021-06-25T04:54:25.224 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:25.224 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2942430957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2942430957},{"type":"v1","addr":"172.21.15.87:6835","nonce":2942430957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34},{"gid":6184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/4012056699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4012056699},{"type":"v1","addr":"172.21.15.57:6833","nonce":4012056699}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:53:27.269151+0000","modified":"2021-06-25T04:54:24.900291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-06-25T04:54:25.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 -- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1e4055510 msgr2=0x7fd1e40579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1e4055510 0x7fd1e40579d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fd1fc01b000 tx=0x7fd1fc015000).stop 2021-06-25T04:54:25.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 -- 172.21.15.57:0/1256782228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2080636a0 msgr2=0x7fd20815a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2080636a0 0x7fd20815a520 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fd208063580 tx=0x7fd1f8009040).stop 2021-06-25T04:54:25.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 -- 172.21.15.57:0/1256782228 shutdown_connections 2021-06-25T04:54:25.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd1e4055510 0x7fd1e40579d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd208147400 0x7fd208142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2080636a0 0x7fd20815a520 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 --2- 172.21.15.57:0/1256782228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd20814d1d0 0x7fd20815a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 -- 172.21.15.57:0/1256782228 >> 172.21.15.57:0/1256782228 conn(0x7fd208062520 msgr2=0x7fd208149c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:25.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 -- 172.21.15.57:0/1256782228 shutdown_connections 2021-06-25T04:54:25.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.221+0000 7fd20759e700 1 -- 172.21.15.57:0/1256782228 wait complete. 2021-06-25T04:54:25.230 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 37 2021-06-25T04:54:25.240 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:54:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3bcc9f700 1 Processor -- start 2021-06-25T04:54:25.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3bcc9f700 1 -- start start 2021-06-25T04:54:25.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3bcc9f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3b80b5460 0x7fa3b80af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3bcc9f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b81479b0 con 0x7fa3b8147560 2021-06-25T04:54:25.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3bcc9f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b80b5840 con 0x7fa3b80b05d0 2021-06-25T04:54:25.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3bcc9f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b81452a0 con 0x7fa3b80b5460 2021-06-25T04:54:25.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa3b8147560 0x7fa3b80acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57144/0 (socket says 172.21.15.57:57144) 2021-06-25T04:54:25.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b7fff700 1 -- 172.21.15.57:0/230480877 learned_addr learned my addr 172.21.15.57:0/230480877 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:25.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b77fe700 1 --2- 172.21.15.57:0/230480877 >> v2:172.21.15.87:3300/0 conn(0x7fa3b80b5460 0x7fa3b80af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b67fc700 1 -- 172.21.15.57:0/230480877 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872242962 0 0) 0x7fa3b81479b0 con 0x7fa3b8147560 2021-06-25T04:54:25.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b67fc700 1 -- 172.21.15.57:0/230480877 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3a4003260 con 0x7fa3b8147560 2021-06-25T04:54:25.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b77fe700 1 -- 172.21.15.57:0/230480877 >> v1:172.21.15.87:6789/0 conn(0x7fa3b80b05d0 legacy=0x7fa3b8067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b67fc700 1 -- 172.21.15.57:0/230480877 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539170463 0 0) 0x7fa3b80b5840 con 0x7fa3b80b05d0 2021-06-25T04:54:25.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b77fe700 1 -- 172.21.15.57:0/230480877 >> v1:172.21.15.57:6789/0 conn(0x7fa3b8147560 legacy=0x7fa3b80acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b77fe700 1 -- 172.21.15.57:0/230480877 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b80ac7c0 con 0x7fa3b80b5460 2021-06-25T04:54:25.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b77fe700 1 --2- 172.21.15.57:0/230480877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80b5460 0x7fa3b80af510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fa3a8002f70 tx=0x7fa3a8006df0).ready entity=mon.1 client_cookie=9dcc51402aa5eb8d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:25.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b67fc700 1 -- 172.21.15.57:0/230480877 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3a800d5c0 con 0x7fa3b80b5460 2021-06-25T04:54:25.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b67fc700 1 -- 172.21.15.57:0/230480877 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8000e90 con 0x7fa3b80b5460 2021-06-25T04:54:25.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3b67fc700 1 -- 172.21.15.57:0/230480877 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3a800d910 con 0x7fa3b80b5460 2021-06-25T04:54:25.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/230480877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80b5460 msgr2=0x7fa3b80af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.341+0000 7fa3bcc9f700 1 --2- 172.21.15.57:0/230480877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80b5460 0x7fa3b80af510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fa3a8002f70 tx=0x7fa3a8006df0).stop 2021-06-25T04:54:25.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/230480877 shutdown_connections 2021-06-25T04:54:25.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 --2- 172.21.15.57:0/230480877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80b5460 0x7fa3b80af510 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/230480877 >> 172.21.15.57:0/230480877 conn(0x7fa3b8062520 msgr2=0x7fa3b8062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:25.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/230480877 shutdown_connections 2021-06-25T04:54:25.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/230480877 wait complete. 2021-06-25T04:54:25.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 Processor -- start 2021-06-25T04:54:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 -- start start 2021-06-25T04:54:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3b80b05d0 0x7fa3b814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80b5460 0x7fa3b8145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3b8147560 0x7fa3b8145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80adfb0 con 0x7fa3b8147560 2021-06-25T04:54:25.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b814dc40 con 0x7fa3b80b5460 2021-06-25T04:54:25.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.345+0000 7fa3bcc9f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b814de30 con 0x7fa3b80b05d0 2021-06-25T04:54:25.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3b8147560 0x7fa3b8145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3b8147560 0x7fa3b8145b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39932/0 (socket says 172.21.15.57:39932) 2021-06-25T04:54:25.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b7fff700 1 -- 172.21.15.57:0/4276282022 learned_addr learned my addr 172.21.15.57:0/4276282022 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:25.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b77fe700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3b80b05d0 0x7fa3b814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b6ffd700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80b5460 0x7fa3b8145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b7fff700 1 -- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3b80b05d0 msgr2=0x7fa3b814c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b7fff700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3b80b05d0 0x7fa3b814c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b7fff700 1 -- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80b5460 msgr2=0x7fa3b8145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b7fff700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80b5460 0x7fa3b8145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b7fff700 1 -- 172.21.15.57:0/4276282022 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a800b180 con 0x7fa3b8147560 2021-06-25T04:54:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b7fff700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3b8147560 0x7fa3b8145b00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fa3b8063610 tx=0x7fa3b0007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b4ff9700 1 -- 172.21.15.57:0/4276282022 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3b0005c70 con 0x7fa3b8147560 2021-06-25T04:54:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b4ff9700 1 -- 172.21.15.57:0/4276282022 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b0005dd0 con 0x7fa3b8147560 2021-06-25T04:54:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/4276282022 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b8146e80 con 0x7fa3b8147560 2021-06-25T04:54:25.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b4ff9700 1 -- 172.21.15.57:0/4276282022 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3b00072c0 con 0x7fa3b8147560 2021-06-25T04:54:25.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/4276282022 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b8146ba0 con 0x7fa3b8147560 2021-06-25T04:54:25.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b4ff9700 1 -- 172.21.15.57:0/4276282022 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa3b0010070 con 0x7fa3b8147560 2021-06-25T04:54:25.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/4276282022 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b8064110 con 0x7fa3b8147560 2021-06-25T04:54:25.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b4ff9700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3980553f0 0x7fa3980578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:25.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b4ff9700 1 -- 172.21.15.57:0/4276282022 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6549+0+0 (secure 0 0 0) 0x7fa3b006d780 con 0x7fa3b8147560 2021-06-25T04:54:25.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.349+0000 7fa3b77fe700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3980553f0 0x7fa3980578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:25.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.353+0000 7fa3b77fe700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3980553f0 0x7fa3980578b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa3a8017000 tx=0x7fa3a8014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:25.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.353+0000 7fa3b4ff9700 1 -- 172.21.15.57:0/4276282022 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa3b00438b0 con 0x7fa3b8147560 2021-06-25T04:54:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.521+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/4276282022 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa3b81453e0 con 0x7fa3b8147560 2021-06-25T04:54:25.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.921+0000 7fa3b4ff9700 1 -- 172.21.15.57:0/4276282022 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa3b0046ed0 con 0x7fa3b8147560 2021-06-25T04:54:25.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3980553f0 msgr2=0x7fa3980578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3980553f0 0x7fa3980578b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa3a8017000 tx=0x7fa3a8014000).stop 2021-06-25T04:54:25.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/4276282022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3b8147560 msgr2=0x7fa3b8145b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:25.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3b8147560 0x7fa3b8145b00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fa3b8063610 tx=0x7fa3b0007dc0).stop 2021-06-25T04:54:25.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/4276282022 shutdown_connections 2021-06-25T04:54:25.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3980553f0 0x7fa3980578b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3b8147560 0x7fa3b8145b00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80b5460 0x7fa3b8145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 --2- 172.21.15.57:0/4276282022 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3b80b05d0 0x7fa3b814c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:25.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/4276282022 >> 172.21.15.57:0/4276282022 conn(0x7fa3b8062520 msgr2=0x7fa3b80aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:25.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/4276282022 shutdown_connections 2021-06-25T04:54:25.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:25.925+0000 7fa3bcc9f700 1 -- 172.21.15.57:0/4276282022 wait complete. 2021-06-25T04:54:25.945 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:54:26.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.057+0000 7f04ab59e700 1 Processor -- start 2021-06-25T04:54:26.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.057+0000 7f04ab59e700 1 -- start start 2021-06-25T04:54:26.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.057+0000 7f04ab59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f04ac0b6250 0x7f04ac061430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:26.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.057+0000 7f04ab59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04ac142e20 0x7f04ac1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:26.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.057+0000 7f04ab59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac0b5f10 con 0x7f04ac0b4020 2021-06-25T04:54:26.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.057+0000 7f04ab59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac0b1f30 con 0x7f04ac142e20 2021-06-25T04:54:26.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.057+0000 7f04ab59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac0b21d0 con 0x7f04ac0b6250 2021-06-25T04:54:26.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04a9d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f04ac0b4020 0x7f04ac061920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57158/0 (socket says 172.21.15.57:57158) 2021-06-25T04:54:26.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04aad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04ac142e20 0x7f04ac1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:26.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04a9d9b700 1 -- 172.21.15.57:0/946631960 learned_addr learned my addr 172.21.15.57:0/946631960 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:26.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04aa59c700 1 --2- 172.21.15.57:0/946631960 >> v2:172.21.15.87:3300/0 conn(0x7f04ac0b6250 0x7f04ac061430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:26.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04a959a700 1 -- 172.21.15.57:0/946631960 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568396607 0 0) 0x7f0494001490 con 0x7f04ac0b4020 2021-06-25T04:54:26.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04a959a700 1 -- 172.21.15.57:0/946631960 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0490003260 con 0x7f04ac0b4020 2021-06-25T04:54:26.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04aad9d700 1 -- 172.21.15.57:0/946631960 >> v2:172.21.15.87:3300/0 conn(0x7f04ac0b6250 msgr2=0x7f04ac061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:26.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04aad9d700 1 --2- 172.21.15.57:0/946631960 >> v2:172.21.15.87:3300/0 conn(0x7f04ac0b6250 0x7f04ac061430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:26.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04aad9d700 1 -- 172.21.15.57:0/946631960 >> v1:172.21.15.57:6789/0 conn(0x7f04ac0b4020 legacy=0x7f04ac061920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:26.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04a959a700 1 -- 172.21.15.57:0/946631960 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3702287341 0 0) 0x7f0490003260 con 0x7f04ac0b4020 2021-06-25T04:54:26.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04aad9d700 1 -- 172.21.15.57:0/946631960 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0b2470 con 0x7f04ac142e20 2021-06-25T04:54:26.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04aa59c700 1 --2- 172.21.15.57:0/946631960 >> v2:172.21.15.87:3300/0 conn(0x7f04ac0b6250 0x7f04ac061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:26.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04aad9d700 1 --2- 172.21.15.57:0/946631960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04ac142e20 0x7f04ac1432b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f0494001d30 tx=0x7f049c006df0).ready entity=mon.0 client_cookie=3a0d5db31ed0af3c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:26.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04a959a700 1 -- 172.21.15.57:0/946631960 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0494001b90 con 0x7f04ac142e20 2021-06-25T04:54:26.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04a959a700 1 -- 172.21.15.57:0/946631960 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c000e90 con 0x7f04ac142e20 2021-06-25T04:54:26.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04a959a700 1 -- 172.21.15.57:0/946631960 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049c012460 con 0x7f04ac142e20 2021-06-25T04:54:26.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04ab59e700 1 -- 172.21.15.57:0/946631960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04ac142e20 msgr2=0x7f04ac1432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:26.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04ab59e700 1 --2- 172.21.15.57:0/946631960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04ac142e20 0x7f04ac1432b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f0494001d30 tx=0x7f049c006df0).stop 2021-06-25T04:54:26.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04ab59e700 1 -- 172.21.15.57:0/946631960 shutdown_connections 2021-06-25T04:54:26.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04ab59e700 1 --2- 172.21.15.57:0/946631960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04ac142e20 0x7f04ac1432b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:26.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04ab59e700 1 --2- 172.21.15.57:0/946631960 >> v2:172.21.15.87:3300/0 conn(0x7f04ac0b6250 0x7f04ac061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:26.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04ab59e700 1 -- 172.21.15.57:0/946631960 >> 172.21.15.57:0/946631960 conn(0x7f04ac05c450 msgr2=0x7f04ac05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:26.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04ab59e700 1 -- 172.21.15.57:0/946631960 shutdown_connections 2021-06-25T04:54:26.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.061+0000 7f04ab59e700 1 -- 172.21.15.57:0/946631960 wait complete. 2021-06-25T04:54:26.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04ab59e700 1 Processor -- start 2021-06-25T04:54:26.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04ab59e700 1 -- start start 2021-06-25T04:54:26.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04ab59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04ac0b4020 0x7f04ac13d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:26.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04ab59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04ac0b6250 0x7f04ac0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:26.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04ab59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04ac142e20 0x7f04ac0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:26.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04ab59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac1521c0 con 0x7f04ac0b4020 2021-06-25T04:54:26.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04ab59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0b0210 con 0x7f04ac0b6250 2021-06-25T04:54:26.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04ab59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac1531a0 con 0x7f04ac142e20 2021-06-25T04:54:26.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04aa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04ac0b4020 0x7f04ac13d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:26.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04aa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04ac0b4020 0x7f04ac13d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39944/0 (socket says 172.21.15.57:39944) 2021-06-25T04:54:26.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04aa59c700 1 -- 172.21.15.57:0/816710546 learned_addr learned my addr 172.21.15.57:0/816710546 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:26.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04a9d9b700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04ac0b6250 0x7f04ac0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:26.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04aad9d700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04ac142e20 0x7f04ac0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:26.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04aa59c700 1 -- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04ac142e20 msgr2=0x7f04ac0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:26.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04aa59c700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04ac142e20 0x7f04ac0af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:26.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04aa59c700 1 -- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04ac0b6250 msgr2=0x7f04ac0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:26.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04aa59c700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04ac0b6250 0x7f04ac0aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:26.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04aa59c700 1 -- 172.21.15.57:0/816710546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a400b180 con 0x7f04ac0b4020 2021-06-25T04:54:26.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04aa59c700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04ac0b4020 0x7f04ac13d8e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f04ac1464c0 tx=0x7f04a4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:26.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04a37fe700 1 -- 172.21.15.57:0/816710546 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04a400c7e0 con 0x7f04ac0b4020 2021-06-25T04:54:26.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04a37fe700 1 -- 172.21.15.57:0/816710546 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a400c940 con 0x7f04ac0b4020 2021-06-25T04:54:26.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04ab59e700 1 -- 172.21.15.57:0/816710546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c00b180 con 0x7f04ac0b4020 2021-06-25T04:54:26.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04a37fe700 1 -- 172.21.15.57:0/816710546 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04a400cca0 con 0x7f04ac0b4020 2021-06-25T04:54:26.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.065+0000 7f04ab59e700 1 -- 172.21.15.57:0/816710546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac146f40 con 0x7f04ac0b4020 2021-06-25T04:54:26.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.069+0000 7f04ab59e700 1 -- 172.21.15.57:0/816710546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac057310 con 0x7f04ac0b4020 2021-06-25T04:54:26.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.069+0000 7f04a37fe700 1 -- 172.21.15.57:0/816710546 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f04a401c460 con 0x7f04ac0b4020 2021-06-25T04:54:26.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.069+0000 7f04a37fe700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f04840553f0 0x7f04840578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:26.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.069+0000 7f04a37fe700 1 -- 172.21.15.57:0/816710546 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6549+0+0 (secure 0 0 0) 0x7f04a406e630 con 0x7f04ac0b4020 2021-06-25T04:54:26.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.069+0000 7f04a9d9b700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f04840553f0 0x7f04840578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:26.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.069+0000 7f04a9d9b700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f04840553f0 0x7f04840578b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f049400d000 tx=0x7f0494000f40).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:26.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.077+0000 7f04a37fe700 1 -- 172.21.15.57:0/816710546 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f04a4044570 con 0x7f04ac0b4020 2021-06-25T04:54:26.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.205+0000 7f04ab59e700 1 -- 172.21.15.57:0/816710546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f04ac144280 con 0x7f04ac0b4020 2021-06-25T04:54:26.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.937+0000 7f04a37fe700 1 -- 172.21.15.57:0/816710546 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) v1 ==== 185+0+0 (secure 0 0 0) 0x7f04a4047b90 con 0x7f04ac0b4020 2021-06-25T04:54:26.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.937+0000 7f04ab59e700 1 -- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f04840553f0 msgr2=0x7f04840578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:26.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.937+0000 7f04ab59e700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f04840553f0 0x7f04840578b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f049400d000 tx=0x7f0494000f40).stop 2021-06-25T04:54:26.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.937+0000 7f04ab59e700 1 -- 172.21.15.57:0/816710546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04ac0b4020 msgr2=0x7f04ac13d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:26.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.937+0000 7f04ab59e700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04ac0b4020 0x7f04ac13d8e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f04ac1464c0 tx=0x7f04a4006df0).stop 2021-06-25T04:54:26.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.941+0000 7f04ab59e700 1 -- 172.21.15.57:0/816710546 shutdown_connections 2021-06-25T04:54:26.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.941+0000 7f04ab59e700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f04840553f0 0x7f04840578b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.941+0000 7f04ab59e700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04ac142e20 0x7f04ac0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.941+0000 7f04ab59e700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04ac0b6250 0x7f04ac0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.941+0000 7f04ab59e700 1 --2- 172.21.15.57:0/816710546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04ac0b4020 0x7f04ac13d8e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.941+0000 7f04ab59e700 1 -- 172.21.15.57:0/816710546 >> 172.21.15.57:0/816710546 conn(0x7f04ac05c450 msgr2=0x7f04ac061a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.941+0000 7f04ab59e700 1 -- 172.21.15.57:0/816710546 shutdown_connections 2021-06-25T04:54:26.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:26.941+0000 7f04ab59e700 1 -- 172.21.15.57:0/816710546 wait complete. 2021-06-25T04:54:26.945 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:54:26.958 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:54:27.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.073+0000 7f704107f700 1 Processor -- start 2021-06-25T04:54:27.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.073+0000 7f704107f700 1 -- start start 2021-06-25T04:54:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.073+0000 7f704107f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f703c0670e0 0x7f703c0b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.073+0000 7f704107f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f703c143970 0x7f703c0aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.073+0000 7f704107f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f703c13ffb0 0x7f703c140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.073+0000 7f704107f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c143040 con 0x7f703c143970 2021-06-25T04:54:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f704107f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c0b9b90 con 0x7f703c13ffb0 2021-06-25T04:54:27.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f704107f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0674c0 con 0x7f703c0670e0 2021-06-25T04:54:27.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f703a59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f703c143970 0x7f703c0aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:27.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f703a59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f703c143970 0x7f703c0aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39952/0 (socket says 172.21.15.57:39952) 2021-06-25T04:54:27.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f703a59c700 1 -- 172.21.15.57:0/3375004787 learned_addr learned my addr 172.21.15.57:0/3375004787 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:27.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f703ad9d700 1 --2- 172.21.15.57:0/3375004787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f703c0670e0 0x7f703c0b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f703b59e700 1 --2- 172.21.15.57:0/3375004787 >> v2:172.21.15.87:3300/0 conn(0x7f703c13ffb0 0x7f703c140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f703a59c700 1 -- 172.21.15.57:0/3375004787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f703c0670e0 msgr2=0x7f703c0b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f703a59c700 1 --2- 172.21.15.57:0/3375004787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f703c0670e0 0x7f703c0b96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f703a59c700 1 -- 172.21.15.57:0/3375004787 >> v2:172.21.15.87:3300/0 conn(0x7f703c13ffb0 msgr2=0x7f703c140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f703a59c700 1 --2- 172.21.15.57:0/3375004787 >> v2:172.21.15.87:3300/0 conn(0x7f703c13ffb0 0x7f703c140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f703a59c700 1 -- 172.21.15.57:0/3375004787 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0af490 con 0x7f703c143970 2021-06-25T04:54:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f703a59c700 1 --2- 172.21.15.57:0/3375004787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f703c143970 0x7f703c0aebc0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f702c002f70 tx=0x7f702c006eb0).ready entity=mon.0 client_cookie=9c8ff7996d538b02 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f7039d9b700 1 -- 172.21.15.57:0/3375004787 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f702c00d570 con 0x7f703c143970 2021-06-25T04:54:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f7039d9b700 1 -- 172.21.15.57:0/3375004787 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c000e90 con 0x7f703c143970 2021-06-25T04:54:27.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f7039d9b700 1 -- 172.21.15.57:0/3375004787 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f702c00d900 con 0x7f703c143970 2021-06-25T04:54:27.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f704107f700 1 -- 172.21.15.57:0/3375004787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f703c143970 msgr2=0x7f703c0aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:27.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f704107f700 1 --2- 172.21.15.57:0/3375004787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f703c143970 0x7f703c0aebc0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f702c002f70 tx=0x7f702c006eb0).stop 2021-06-25T04:54:27.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f704107f700 1 -- 172.21.15.57:0/3375004787 shutdown_connections 2021-06-25T04:54:27.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f704107f700 1 --2- 172.21.15.57:0/3375004787 >> v2:172.21.15.87:3300/0 conn(0x7f703c13ffb0 0x7f703c140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:27.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f704107f700 1 --2- 172.21.15.57:0/3375004787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f703c143970 0x7f703c0aebc0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:27.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f704107f700 1 --2- 172.21.15.57:0/3375004787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f703c0670e0 0x7f703c0b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:27.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f704107f700 1 -- 172.21.15.57:0/3375004787 >> 172.21.15.57:0/3375004787 conn(0x7f703c05f9b0 msgr2=0x7f703c061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:27.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f704107f700 1 -- 172.21.15.57:0/3375004787 shutdown_connections 2021-06-25T04:54:27.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.077+0000 7f704107f700 1 -- 172.21.15.57:0/3375004787 wait complete. 2021-06-25T04:54:27.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f704107f700 1 Processor -- start 2021-06-25T04:54:27.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f704107f700 1 -- start start 2021-06-25T04:54:27.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f704107f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f703c0670e0 0x7f703c145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:27.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f704107f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f703c13ffb0 0x7f703c152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:27.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f704107f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f703c143970 0x7f703c1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:27.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f704107f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c130070 con 0x7f703c0670e0 2021-06-25T04:54:27.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f704107f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c152be0 con 0x7f703c143970 2021-06-25T04:54:27.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f704107f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0b8dd0 con 0x7f703c13ffb0 2021-06-25T04:54:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f703c0670e0 0x7f703c145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f703c0670e0 0x7f703c145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39958/0 (socket says 172.21.15.57:39958) 2021-06-25T04:54:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703ad9d700 1 -- 172.21.15.57:0/1196797238 learned_addr learned my addr 172.21.15.57:0/1196797238 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703b59e700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f703c143970 0x7f703c1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:27.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703a59c700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f703c13ffb0 0x7f703c152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:27.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703ad9d700 1 -- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f703c13ffb0 msgr2=0x7f703c152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:27.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703ad9d700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f703c13ffb0 0x7f703c152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:27.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703ad9d700 1 -- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f703c143970 msgr2=0x7f703c1526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:27.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703ad9d700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f703c143970 0x7f703c1526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:27.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703ad9d700 1 -- 172.21.15.57:0/1196797238 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c00b1e0 con 0x7f703c0670e0 2021-06-25T04:54:27.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703b59e700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f703c143970 0x7f703c1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:27.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.081+0000 7f703ad9d700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f703c0670e0 0x7f703c145710 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f702400c000 tx=0x7f7024006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:27.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.085+0000 7f7033fff700 1 -- 172.21.15.57:0/1196797238 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7024010780 con 0x7f703c0670e0 2021-06-25T04:54:27.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.085+0000 7f7033fff700 1 -- 172.21.15.57:0/1196797238 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70240108e0 con 0x7f703c0670e0 2021-06-25T04:54:27.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.085+0000 7f704107f700 1 -- 172.21.15.57:0/1196797238 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c0b3790 con 0x7f703c0670e0 2021-06-25T04:54:27.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.085+0000 7f7033fff700 1 -- 172.21.15.57:0/1196797238 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7024010c40 con 0x7f703c0670e0 2021-06-25T04:54:27.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.085+0000 7f704107f700 1 -- 172.21.15.57:0/1196797238 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c145f50 con 0x7f703c0670e0 2021-06-25T04:54:27.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.085+0000 7f704107f700 1 -- 172.21.15.57:0/1196797238 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c0b8f90 con 0x7f703c0670e0 2021-06-25T04:54:27.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.085+0000 7f7033fff700 1 -- 172.21.15.57:0/1196797238 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f702401c460 con 0x7f703c0670e0 2021-06-25T04:54:27.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.085+0000 7f7033fff700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70200553d0 0x7f7020057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:27.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.085+0000 7f7033fff700 1 -- 172.21.15.57:0/1196797238 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6111+0+0 (secure 0 0 0) 0x7f702406e110 con 0x7f703c0670e0 2021-06-25T04:54:27.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.085+0000 7f703a59c700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70200553d0 0x7f7020057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:27.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.085+0000 7f703a59c700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70200553d0 0x7f7020057890 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f702c01b000 tx=0x7f702c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:27.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.089+0000 7f7033fff700 1 -- 172.21.15.57:0/1196797238 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f70240443a0 con 0x7f703c0670e0 2021-06-25T04:54:27.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.213+0000 7f704107f700 1 -- 172.21.15.57:0/1196797238 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f703c057310 con 0x7f703c0670e0 2021-06-25T04:54:27.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.937+0000 7f7033fff700 1 -- 172.21.15.57:0/1196797238 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) v1 ==== 173+0+0 (secure 0 0 0) 0x7f70240479c0 con 0x7f703c0670e0 2021-06-25T04:54:27.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 -- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70200553d0 msgr2=0x7f7020057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:27.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70200553d0 0x7f7020057890 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f702c01b000 tx=0x7f702c015000).stop 2021-06-25T04:54:27.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 -- 172.21.15.57:0/1196797238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f703c0670e0 msgr2=0x7f703c145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:27.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f703c0670e0 0x7f703c145710 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f702400c000 tx=0x7f7024006df0).stop 2021-06-25T04:54:27.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 -- 172.21.15.57:0/1196797238 shutdown_connections 2021-06-25T04:54:27.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70200553d0 0x7f7020057890 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:27.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f703c143970 0x7f703c1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:27.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f703c13ffb0 0x7f703c152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:27.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 --2- 172.21.15.57:0/1196797238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f703c0670e0 0x7f703c145710 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:27.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 -- 172.21.15.57:0/1196797238 >> 172.21.15.57:0/1196797238 conn(0x7f703c05f9b0 msgr2=0x7f703c061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:27.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 -- 172.21.15.57:0/1196797238 shutdown_connections 2021-06-25T04:54:27.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:27.945+0000 7f704107f700 1 -- 172.21.15.57:0/1196797238 wait complete. 2021-06-25T04:54:27.950 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:54:27.960 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-06-25T04:54:28.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.069+0000 7fdf74948700 1 Processor -- start 2021-06-25T04:54:28.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.069+0000 7fdf74948700 1 -- start start 2021-06-25T04:54:28.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.069+0000 7fdf74948700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf700b0570 0x7fdf700b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:28.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.069+0000 7fdf74948700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdf700a9bd0 0x7fdf700b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:28.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.069+0000 7fdf74948700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf701438e0 con 0x7fdf700b36d0 2021-06-25T04:54:28.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.069+0000 7fdf74948700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf70143b80 con 0x7fdf700b0570 2021-06-25T04:54:28.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.069+0000 7fdf74948700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf70143e20 con 0x7fdf700a9bd0 2021-06-25T04:54:28.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.069+0000 7fdf6e59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf700b0570 0x7fdf700b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:28.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.069+0000 7fdf6dd9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdf700b36d0 0x7fdf7013d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57186/0 (socket says 172.21.15.57:57186) 2021-06-25T04:54:28.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.069+0000 7fdf6dd9b700 1 -- 172.21.15.57:0/250982353 learned_addr learned my addr 172.21.15.57:0/250982353 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf6ed9d700 1 --2- 172.21.15.57:0/250982353 >> v2:172.21.15.87:3300/0 conn(0x7fdf700a9bd0 0x7fdf700b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:28.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf6d59a700 1 -- 172.21.15.57:0/250982353 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641306927 0 0) 0x7fdf701438e0 con 0x7fdf700b36d0 2021-06-25T04:54:28.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf6d59a700 1 -- 172.21.15.57:0/250982353 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf54003260 con 0x7fdf700b36d0 2021-06-25T04:54:28.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf6e59c700 1 -- 172.21.15.57:0/250982353 >> v2:172.21.15.87:3300/0 conn(0x7fdf700a9bd0 msgr2=0x7fdf700b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:28.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf6e59c700 1 --2- 172.21.15.57:0/250982353 >> v2:172.21.15.87:3300/0 conn(0x7fdf700a9bd0 0x7fdf700b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf6e59c700 1 -- 172.21.15.57:0/250982353 >> v1:172.21.15.57:6789/0 conn(0x7fdf700b36d0 legacy=0x7fdf7013d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf6e59c700 1 -- 172.21.15.57:0/250982353 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf701440c0 con 0x7fdf700b0570 2021-06-25T04:54:28.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf6e59c700 1 --2- 172.21.15.57:0/250982353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf700b0570 0x7fdf700b0950 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7fdf60002f70 tx=0x7fdf60006df0).ready entity=mon.0 client_cookie=22f59590468692c8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:28.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf6d59a700 1 -- 172.21.15.57:0/250982353 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf6000d4f0 con 0x7fdf700b0570 2021-06-25T04:54:28.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf6d59a700 1 -- 172.21.15.57:0/250982353 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf60000e90 con 0x7fdf700b0570 2021-06-25T04:54:28.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf6d59a700 1 -- 172.21.15.57:0/250982353 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf6000d840 con 0x7fdf700b0570 2021-06-25T04:54:28.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf74948700 1 -- 172.21.15.57:0/250982353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf700b0570 msgr2=0x7fdf700b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf74948700 1 --2- 172.21.15.57:0/250982353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf700b0570 0x7fdf700b0950 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7fdf60002f70 tx=0x7fdf60006df0).stop 2021-06-25T04:54:28.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf74948700 1 -- 172.21.15.57:0/250982353 shutdown_connections 2021-06-25T04:54:28.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf74948700 1 --2- 172.21.15.57:0/250982353 >> v2:172.21.15.87:3300/0 conn(0x7fdf700a9bd0 0x7fdf700b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf74948700 1 --2- 172.21.15.57:0/250982353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf700b0570 0x7fdf700b0950 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf74948700 1 -- 172.21.15.57:0/250982353 >> 172.21.15.57:0/250982353 conn(0x7fdf70060780 msgr2=0x7fdf70060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:28.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf74948700 1 -- 172.21.15.57:0/250982353 shutdown_connections 2021-06-25T04:54:28.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf74948700 1 -- 172.21.15.57:0/250982353 wait complete. 2021-06-25T04:54:28.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf74948700 1 Processor -- start 2021-06-25T04:54:28.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.073+0000 7fdf74948700 1 -- start start 2021-06-25T04:54:28.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf74948700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf700a9bd0 0x7fdf70140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:28.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf74948700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf700b0570 0x7fdf70132a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:28.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf74948700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf700b36d0 0x7fdf70132f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:28.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf74948700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70137ba0 con 0x7fdf700a9bd0 2021-06-25T04:54:28.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf74948700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70144e50 con 0x7fdf700b0570 2021-06-25T04:54:28.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf74948700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf701450f0 con 0x7fdf700b36d0 2021-06-25T04:54:28.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf700a9bd0 0x7fdf70140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:28.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6dd9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf700b0570 0x7fdf70132a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:28.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf700a9bd0 0x7fdf70140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39972/0 (socket says 172.21.15.57:39972) 2021-06-25T04:54:28.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6ed9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf700b36d0 0x7fdf70132f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:28.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6e59c700 1 -- 172.21.15.57:0/3998429165 learned_addr learned my addr 172.21.15.57:0/3998429165 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:28.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6e59c700 1 -- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf700b36d0 msgr2=0x7fdf70132f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6e59c700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf700b36d0 0x7fdf70132f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6e59c700 1 -- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf700b0570 msgr2=0x7fdf70132a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6e59c700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf700b0570 0x7fdf70132a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6e59c700 1 -- 172.21.15.57:0/3998429165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6000b180 con 0x7fdf700a9bd0 2021-06-25T04:54:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6dd9b700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf700b0570 0x7fdf70132a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf6e59c700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf700a9bd0 0x7fdf70140290 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fdf60002f70 tx=0x7fdf60014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf5f7fe700 1 -- 172.21.15.57:0/3998429165 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf60006b20 con 0x7fdf700a9bd0 2021-06-25T04:54:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf5f7fe700 1 -- 172.21.15.57:0/3998429165 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf60000e90 con 0x7fdf700a9bd0 2021-06-25T04:54:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf74948700 1 -- 172.21.15.57:0/3998429165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf70137460 con 0x7fdf700a9bd0 2021-06-25T04:54:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf5f7fe700 1 -- 172.21.15.57:0/3998429165 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf6000de40 con 0x7fdf700a9bd0 2021-06-25T04:54:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.077+0000 7fdf74948700 1 -- 172.21.15.57:0/3998429165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf701409a0 con 0x7fdf700a9bd0 2021-06-25T04:54:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.081+0000 7fdf5f7fe700 1 -- 172.21.15.57:0/3998429165 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdf60024020 con 0x7fdf700a9bd0 2021-06-25T04:54:28.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.081+0000 7fdf74948700 1 -- 172.21.15.57:0/3998429165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf70057310 con 0x7fdf700a9bd0 2021-06-25T04:54:28.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.081+0000 7fdf5f7fe700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdf4c055450 0x7fdf4c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:28.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.081+0000 7fdf5f7fe700 1 -- 172.21.15.57:0/3998429165 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fdf6006e530 con 0x7fdf700a9bd0 2021-06-25T04:54:28.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.081+0000 7fdf6dd9b700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdf4c055450 0x7fdf4c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:28.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.081+0000 7fdf6dd9b700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdf4c055450 0x7fdf4c057910 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fdf6400d000 tx=0x7fdf64009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:28.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.089+0000 7fdf5f7fe700 1 -- 172.21.15.57:0/3998429165 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdf600483c0 con 0x7fdf700a9bd0 2021-06-25T04:54:28.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.213+0000 7fdf74948700 1 -- 172.21.15.57:0/3998429165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdf70142250 con 0x7fdf700a9bd0 2021-06-25T04:54:28.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.221+0000 7fdf5f7fe700 1 -- 172.21.15.57:0/3998429165 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdf60047fb0 con 0x7fdf700a9bd0 2021-06-25T04:54:28.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.221+0000 7fdf74948700 1 -- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdf4c055450 msgr2=0x7fdf4c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.221+0000 7fdf74948700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdf4c055450 0x7fdf4c057910 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fdf6400d000 tx=0x7fdf64009040).stop 2021-06-25T04:54:28.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.221+0000 7fdf74948700 1 -- 172.21.15.57:0/3998429165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf700a9bd0 msgr2=0x7fdf70140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.221+0000 7fdf74948700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf700a9bd0 0x7fdf70140290 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fdf60002f70 tx=0x7fdf60014000).stop 2021-06-25T04:54:28.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.225+0000 7fdf74948700 1 -- 172.21.15.57:0/3998429165 shutdown_connections 2021-06-25T04:54:28.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.225+0000 7fdf74948700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdf4c055450 0x7fdf4c057910 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.225+0000 7fdf74948700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf700b36d0 0x7fdf70132f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.225+0000 7fdf74948700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf700b0570 0x7fdf70132a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.225+0000 7fdf74948700 1 --2- 172.21.15.57:0/3998429165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf700a9bd0 0x7fdf70140290 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.225+0000 7fdf74948700 1 -- 172.21.15.57:0/3998429165 >> 172.21.15.57:0/3998429165 conn(0x7fdf70060780 msgr2=0x7fdf7013b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:28.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.225+0000 7fdf74948700 1 -- 172.21.15.57:0/3998429165 shutdown_connections 2021-06-25T04:54:28.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.225+0000 7fdf74948700 1 -- 172.21.15.57:0/3998429165 wait complete. 2021-06-25T04:54:28.239 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-06-25T04:54:28.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.337+0000 7fee3cc57700 1 Processor -- start 2021-06-25T04:54:28.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.337+0000 7fee3cc57700 1 -- start start 2021-06-25T04:54:28.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.337+0000 7fee3cc57700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b5bb0 0x7fee380b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:28.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.337+0000 7fee3cc57700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee38144070 con 0x7fee380b4380 2021-06-25T04:54:28.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.337+0000 7fee3cc57700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee380b6e10 con 0x7fee380b6540 2021-06-25T04:54:28.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.337+0000 7fee3cc57700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee38143b30 con 0x7fee380b5bb0 2021-06-25T04:54:28.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.337+0000 7fee35d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fee380b4380 0x7fee3812b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57200/0 (socket says 172.21.15.57:57200) 2021-06-25T04:54:28.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.337+0000 7fee35d9b700 1 -- 172.21.15.57:0/3833467384 learned_addr learned my addr 172.21.15.57:0/3833467384 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:28.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.337+0000 7fee36d9d700 1 --2- 172.21.15.57:0/3833467384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b5bb0 0x7fee380b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:28.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.337+0000 7fee3559a700 1 -- 172.21.15.57:0/3833467384 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017961502 0 0) 0x7fee38144070 con 0x7fee380b4380 2021-06-25T04:54:28.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.337+0000 7fee3559a700 1 -- 172.21.15.57:0/3833467384 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee18003260 con 0x7fee380b4380 2021-06-25T04:54:28.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3559a700 1 -- 172.21.15.57:0/3833467384 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695809494 0 0) 0x7fee380b6e10 con 0x7fee380b6540 2021-06-25T04:54:28.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3559a700 1 -- 172.21.15.57:0/3833467384 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee38144070 con 0x7fee380b6540 2021-06-25T04:54:28.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee36d9d700 1 -- 172.21.15.57:0/3833467384 >> v1:172.21.15.87:6789/0 conn(0x7fee380b6540 legacy=0x7fee38061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee36d9d700 1 -- 172.21.15.57:0/3833467384 >> v1:172.21.15.57:6789/0 conn(0x7fee380b4380 legacy=0x7fee3812b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee36d9d700 1 -- 172.21.15.57:0/3833467384 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee38143dd0 con 0x7fee380b5bb0 2021-06-25T04:54:28.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee36d9d700 1 --2- 172.21.15.57:0/3833467384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b5bb0 0x7fee380b6920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fee300032f0 tx=0x7fee300091d0).ready entity=mon.2 client_cookie=8222a3e6d7e4a528 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:28.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3559a700 1 -- 172.21.15.57:0/3833467384 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee3000b640 con 0x7fee380b5bb0 2021-06-25T04:54:28.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3559a700 1 -- 172.21.15.57:0/3833467384 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3000b7a0 con 0x7fee380b5bb0 2021-06-25T04:54:28.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3559a700 1 -- 172.21.15.57:0/3833467384 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee3000b910 con 0x7fee380b5bb0 2021-06-25T04:54:28.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3cc57700 1 -- 172.21.15.57:0/3833467384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b5bb0 msgr2=0x7fee380b6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3cc57700 1 --2- 172.21.15.57:0/3833467384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b5bb0 0x7fee380b6920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fee300032f0 tx=0x7fee300091d0).stop 2021-06-25T04:54:28.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3cc57700 1 -- 172.21.15.57:0/3833467384 shutdown_connections 2021-06-25T04:54:28.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3cc57700 1 --2- 172.21.15.57:0/3833467384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b5bb0 0x7fee380b6920 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3cc57700 1 -- 172.21.15.57:0/3833467384 >> 172.21.15.57:0/3833467384 conn(0x7fee3805c450 msgr2=0x7fee3805c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:28.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3cc57700 1 -- 172.21.15.57:0/3833467384 shutdown_connections 2021-06-25T04:54:28.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3cc57700 1 -- 172.21.15.57:0/3833467384 wait complete. 2021-06-25T04:54:28.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3cc57700 1 Processor -- start 2021-06-25T04:54:28.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.341+0000 7fee3cc57700 1 -- start start 2021-06-25T04:54:28.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3cc57700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee380b4380 0x7fee38122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:28.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3cc57700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee380b5bb0 0x7fee38125eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:28.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3cc57700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b6540 0x7fee380b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:28.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3cc57700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee380b30a0 con 0x7fee380b4380 2021-06-25T04:54:28.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3cc57700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee38124050 con 0x7fee380b5bb0 2021-06-25T04:54:28.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3cc57700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee381242b0 con 0x7fee380b6540 2021-06-25T04:54:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee380b4380 0x7fee38122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee380b4380 0x7fee38122a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39986/0 (socket says 172.21.15.57:39986) 2021-06-25T04:54:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3659c700 1 -- 172.21.15.57:0/3317121778 learned_addr learned my addr 172.21.15.57:0/3317121778 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee35d9b700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee380b5bb0 0x7fee38125eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee36d9d700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b6540 0x7fee380b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:28.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3659c700 1 -- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b6540 msgr2=0x7fee380b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3659c700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b6540 0x7fee380b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3659c700 1 -- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee380b5bb0 msgr2=0x7fee38125eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3659c700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee380b5bb0 0x7fee38125eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3659c700 1 -- 172.21.15.57:0/3317121778 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee30009470 con 0x7fee380b4380 2021-06-25T04:54:28.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee36d9d700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b6540 0x7fee380b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:28.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3659c700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee380b4380 0x7fee38122a20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7fee28001110 tx=0x7fee28007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:28.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee2f7fe700 1 -- 172.21.15.57:0/3317121778 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee28012400 con 0x7fee380b4380 2021-06-25T04:54:28.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee2f7fe700 1 -- 172.21.15.57:0/3317121778 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee28012560 con 0x7fee380b4380 2021-06-25T04:54:28.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3cc57700 1 -- 172.21.15.57:0/3317121778 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee381222e0 con 0x7fee380b4380 2021-06-25T04:54:28.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee2f7fe700 1 -- 172.21.15.57:0/3317121778 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee280128c0 con 0x7fee380b4380 2021-06-25T04:54:28.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.345+0000 7fee3cc57700 1 -- 172.21.15.57:0/3317121778 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee38121900 con 0x7fee380b4380 2021-06-25T04:54:28.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.349+0000 7fee2f7fe700 1 -- 172.21.15.57:0/3317121778 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fee28019030 con 0x7fee380b4380 2021-06-25T04:54:28.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.349+0000 7fee3cc57700 1 -- 172.21.15.57:0/3317121778 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee38057310 con 0x7fee380b4380 2021-06-25T04:54:28.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.349+0000 7fee2f7fe700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fee1c0553d0 0x7fee1c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:28.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.349+0000 7fee2f7fe700 1 -- 172.21.15.57:0/3317121778 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fee2806cff0 con 0x7fee380b4380 2021-06-25T04:54:28.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.349+0000 7fee35d9b700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fee1c0553d0 0x7fee1c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:28.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.349+0000 7fee35d9b700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fee1c0553d0 0x7fee1c057890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fee2000d000 tx=0x7fee20009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:28.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.353+0000 7fee2f7fe700 1 -- 172.21.15.57:0/3317121778 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fee28043450 con 0x7fee380b4380 2021-06-25T04:54:28.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.517+0000 7fee3cc57700 1 -- 172.21.15.57:0/3317121778 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7fee380b5fc0 con 0x7fee380b4380 2021-06-25T04:54:28.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.949+0000 7fee2f7fe700 1 -- 172.21.15.57:0/3317121778 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v298) v1 ==== 139+0+0 (secure 0 0 0) 0x7fee28046a70 con 0x7fee380b4380 2021-06-25T04:54:28.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 -- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fee1c0553d0 msgr2=0x7fee1c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fee1c0553d0 0x7fee1c057890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fee2000d000 tx=0x7fee20009040).stop 2021-06-25T04:54:28.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 -- 172.21.15.57:0/3317121778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee380b4380 msgr2=0x7fee38122a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:28.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee380b4380 0x7fee38122a20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7fee28001110 tx=0x7fee28007ae0).stop 2021-06-25T04:54:28.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 -- 172.21.15.57:0/3317121778 shutdown_connections 2021-06-25T04:54:28.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fee1c0553d0 0x7fee1c057890 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fee380b6540 0x7fee380b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee380b5bb0 0x7fee38125eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 --2- 172.21.15.57:0/3317121778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee380b4380 0x7fee38122a20 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:28.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 -- 172.21.15.57:0/3317121778 >> 172.21.15.57:0/3317121778 conn(0x7fee3805c450 msgr2=0x7fee381444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:28.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 -- 172.21.15.57:0/3317121778 shutdown_connections 2021-06-25T04:54:28.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:28.953+0000 7fee3cc57700 1 -- 172.21.15.57:0/3317121778 wait complete. 2021-06-25T04:54:28.972 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2021-06-25T04:54:28.973 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2021-06-25T04:54:28.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-06-25T04:54:29.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6ee4e700 1 Processor -- start 2021-06-25T04:54:29.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6ee4e700 1 -- start start 2021-06-25T04:54:29.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6ee4e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e680b1d70 0x7f2e680b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:29.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6ee4e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e680b0310 con 0x7f2e68148360 2021-06-25T04:54:29.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6ee4e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e680b05b0 con 0x7f2e680a7080 2021-06-25T04:54:29.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6ee4e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680a9080 con 0x7f2e680b1d70 2021-06-25T04:54:29.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e5ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2e68148360 0x7f2e680b2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57214/0 (socket says 172.21.15.57:57214) 2021-06-25T04:54:29.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e5ffff700 1 -- 172.21.15.57:0/1601986016 learned_addr learned my addr 172.21.15.57:0/1601986016 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:29.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6cbea700 1 --2- 172.21.15.57:0/1601986016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e680b1d70 0x7f2e680b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:29.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e5f7fe700 1 -- 172.21.15.57:0/1601986016 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625821833 0 0) 0x7f2e680b0310 con 0x7f2e68148360 2021-06-25T04:54:29.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e5f7fe700 1 -- 172.21.15.57:0/1601986016 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e54003260 con 0x7f2e68148360 2021-06-25T04:54:29.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e5f7fe700 1 -- 172.21.15.57:0/1601986016 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581920660 0 0) 0x7f2e680b05b0 con 0x7f2e680a7080 2021-06-25T04:54:29.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6cbea700 1 -- 172.21.15.57:0/1601986016 >> v1:172.21.15.87:6789/0 conn(0x7f2e680a7080 legacy=0x7f2e681446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:29.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6cbea700 1 -- 172.21.15.57:0/1601986016 >> v1:172.21.15.57:6789/0 conn(0x7f2e68148360 legacy=0x7f2e680b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:29.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6cbea700 1 -- 172.21.15.57:0/1601986016 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e680b0850 con 0x7f2e680b1d70 2021-06-25T04:54:29.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6cbea700 1 --2- 172.21.15.57:0/1601986016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e680b1d70 0x7f2e680b0f90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f2e64002f70 tx=0x7f2e64006df0).ready entity=mon.2 client_cookie=64a9205724718da5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:29.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e5f7fe700 1 -- 172.21.15.57:0/1601986016 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e6400d570 con 0x7f2e680b1d70 2021-06-25T04:54:29.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e5f7fe700 1 -- 172.21.15.57:0/1601986016 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e64000e90 con 0x7f2e680b1d70 2021-06-25T04:54:29.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e5f7fe700 1 -- 172.21.15.57:0/1601986016 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e6400d8c0 con 0x7f2e680b1d70 2021-06-25T04:54:29.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/1601986016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e680b1d70 msgr2=0x7f2e680b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:29.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.081+0000 7f2e6ee4e700 1 --2- 172.21.15.57:0/1601986016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e680b1d70 0x7f2e680b0f90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f2e64002f70 tx=0x7f2e64006df0).stop 2021-06-25T04:54:29.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.085+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/1601986016 shutdown_connections 2021-06-25T04:54:29.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.085+0000 7f2e6ee4e700 1 --2- 172.21.15.57:0/1601986016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e680b1d70 0x7f2e680b0f90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:29.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.085+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/1601986016 >> 172.21.15.57:0/1601986016 conn(0x7f2e6805f670 msgr2=0x7f2e6805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:29.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.085+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/1601986016 shutdown_connections 2021-06-25T04:54:29.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.085+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/1601986016 wait complete. 2021-06-25T04:54:29.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.085+0000 7f2e6ee4e700 1 Processor -- start 2021-06-25T04:54:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.085+0000 7f2e6ee4e700 1 -- start start 2021-06-25T04:54:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6ee4e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e680a7080 0x7f2e680abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6ee4e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e680b1d70 0x7f2e68159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6ee4e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e68148360 0x7f2e680addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:29.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6ee4e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6815aa90 con 0x7f2e68148360 2021-06-25T04:54:29.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6ee4e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680aa060 con 0x7f2e680b1d70 2021-06-25T04:54:29.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6ee4e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680aa2c0 con 0x7f2e680a7080 2021-06-25T04:54:29.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6d3eb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e68148360 0x7f2e680addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:29.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e680b1d70 0x7f2e68159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:29.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6cbea700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e680a7080 0x7f2e680abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:29.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e680b1d70 0x7f2e68159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:48496/0 (socket says 172.21.15.57:48496) 2021-06-25T04:54:29.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6d3eb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e68148360 0x7f2e680addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40004/0 (socket says 172.21.15.57:40004) 2021-06-25T04:54:29.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5ffff700 1 -- 172.21.15.57:0/3231537032 learned_addr learned my addr 172.21.15.57:0/3231537032 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:29.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5ffff700 1 -- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e680a7080 msgr2=0x7f2e680abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:29.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5ffff700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e680a7080 0x7f2e680abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:29.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5ffff700 1 -- 172.21.15.57:0/3231537032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e68148360 msgr2=0x7f2e680addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:29.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5ffff700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e68148360 0x7f2e680addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5ffff700 1 -- 172.21.15.57:0/3231537032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6400b180 con 0x7f2e680b1d70 2021-06-25T04:54:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6d3eb700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e68148360 0x7f2e680addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5ffff700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e680b1d70 0x7f2e68159f00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f2e58001110 tx=0x7f2e58007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5dffb700 1 -- 172.21.15.57:0/3231537032 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5800cdb0 con 0x7f2e680b1d70 2021-06-25T04:54:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5dffb700 1 -- 172.21.15.57:0/3231537032 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e580070d0 con 0x7f2e680b1d70 2021-06-25T04:54:29.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/3231537032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e680aa560 con 0x7f2e680b1d70 2021-06-25T04:54:29.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e5dffb700 1 -- 172.21.15.57:0/3231537032 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e58007430 con 0x7f2e680b1d70 2021-06-25T04:54:29.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.089+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/3231537032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6815a7f0 con 0x7f2e680b1d70 2021-06-25T04:54:29.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.093+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/3231537032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6815a540 con 0x7f2e680b1d70 2021-06-25T04:54:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.093+0000 7f2e5dffb700 1 -- 172.21.15.57:0/3231537032 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2e58010070 con 0x7f2e680b1d70 2021-06-25T04:54:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.093+0000 7f2e5dffb700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e480554e0 0x7f2e480579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.093+0000 7f2e5dffb700 1 -- 172.21.15.57:0/3231537032 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2e5806d1b0 con 0x7f2e680b1d70 2021-06-25T04:54:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.093+0000 7f2e6cbea700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e480554e0 0x7f2e480579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:29.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.093+0000 7f2e6cbea700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e480554e0 0x7f2e480579a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f2e64017000 tx=0x7f2e64014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:29.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.101+0000 7f2e5dffb700 1 -- 172.21.15.57:0/3231537032 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2e58043500 con 0x7f2e680b1d70 2021-06-25T04:54:29.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.277+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/3231537032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f2e680a9850 con 0x7f2e680b1d70 2021-06-25T04:54:29.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.953+0000 7f2e5dffb700 1 -- 172.21.15.57:0/3231537032 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v299) v1 ==== 129+0+0 (secure 0 0 0) 0x7f2e58046b20 con 0x7f2e680b1d70 2021-06-25T04:54:29.962 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e480554e0 msgr2=0x7f2e480579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:29.962 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e480554e0 0x7f2e480579a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f2e64017000 tx=0x7f2e64014000).stop 2021-06-25T04:54:29.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e680b1d70 msgr2=0x7f2e68159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:29.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e680b1d70 0x7f2e68159f00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f2e58001110 tx=0x7f2e58007a60).stop 2021-06-25T04:54:29.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/3231537032 shutdown_connections 2021-06-25T04:54:29.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e480554e0 0x7f2e480579a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:29.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e68148360 0x7f2e680addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:29.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e680b1d70 0x7f2e68159f00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:29.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 --2- 172.21.15.57:0/3231537032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e680a7080 0x7f2e680abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:29.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/3231537032 >> 172.21.15.57:0/3231537032 conn(0x7f2e6805f670 msgr2=0x7f2e680b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:29.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/3231537032 shutdown_connections 2021-06-25T04:54:29.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:29.957+0000 7f2e6ee4e700 1 -- 172.21.15.57:0/3231537032 wait complete. 2021-06-25T04:54:29.980 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:54:30.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.097+0000 7f3fbffff700 1 Processor -- start 2021-06-25T04:54:30.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.097+0000 7f3fbffff700 1 -- start start 2021-06-25T04:54:30.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3fc00aad40 0x7f3fc00672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fc00b4d10 0x7f3fc00b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc0065920 con 0x7f3fc00ab120 2021-06-25T04:54:30.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc0064ed0 con 0x7f3fc00aad40 2021-06-25T04:54:30.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00b3ca0 con 0x7f3fc00b4d10 2021-06-25T04:54:30.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3fc00aad40 0x7f3fc00672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbe7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3fc00ab120 0x7f3fc00647c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57228/0 (socket says 172.21.15.57:57228) 2021-06-25T04:54:30.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbe7fc700 1 -- 172.21.15.57:0/191226125 learned_addr learned my addr 172.21.15.57:0/191226125 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:30.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbf7fe700 1 --2- 172.21.15.57:0/191226125 >> v2:172.21.15.87:3300/0 conn(0x7f3fc00b4d10 0x7f3fc00b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbdffb700 1 -- 172.21.15.57:0/191226125 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181072970 0 0) 0x7f3fc0065920 con 0x7f3fc00ab120 2021-06-25T04:54:30.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbdffb700 1 -- 172.21.15.57:0/191226125 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fa0003260 con 0x7f3fc00ab120 2021-06-25T04:54:30.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbeffd700 1 -- 172.21.15.57:0/191226125 >> v2:172.21.15.87:3300/0 conn(0x7f3fc00b4d10 msgr2=0x7f3fc00b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:30.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbeffd700 1 --2- 172.21.15.57:0/191226125 >> v2:172.21.15.87:3300/0 conn(0x7f3fc00b4d10 0x7f3fc00b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbeffd700 1 -- 172.21.15.57:0/191226125 >> v1:172.21.15.57:6789/0 conn(0x7f3fc00ab120 legacy=0x7f3fc00647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbeffd700 1 -- 172.21.15.57:0/191226125 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc0066e20 con 0x7f3fc00aad40 2021-06-25T04:54:30.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbeffd700 1 --2- 172.21.15.57:0/191226125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00aad40 0x7f3fc00672c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f3fb0002f70 tx=0x7f3fb0006df0).ready entity=mon.0 client_cookie=cccd21912b7c497a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:30.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbdffb700 1 -- 172.21.15.57:0/191226125 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb000d4f0 con 0x7f3fc00aad40 2021-06-25T04:54:30.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbdffb700 1 -- 172.21.15.57:0/191226125 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb0000e90 con 0x7f3fc00aad40 2021-06-25T04:54:30.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbdffb700 1 -- 172.21.15.57:0/191226125 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb000d840 con 0x7f3fc00aad40 2021-06-25T04:54:30.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 -- 172.21.15.57:0/191226125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00aad40 msgr2=0x7f3fc00672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 --2- 172.21.15.57:0/191226125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00aad40 0x7f3fc00672c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f3fb0002f70 tx=0x7f3fb0006df0).stop 2021-06-25T04:54:30.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 -- 172.21.15.57:0/191226125 shutdown_connections 2021-06-25T04:54:30.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 --2- 172.21.15.57:0/191226125 >> v2:172.21.15.87:3300/0 conn(0x7f3fc00b4d10 0x7f3fc00b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 --2- 172.21.15.57:0/191226125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00aad40 0x7f3fc00672c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 -- 172.21.15.57:0/191226125 >> 172.21.15.57:0/191226125 conn(0x7f3fc0062ba0 msgr2=0x7f3fc005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:30.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 -- 172.21.15.57:0/191226125 shutdown_connections 2021-06-25T04:54:30.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.101+0000 7f3fbffff700 1 -- 172.21.15.57:0/191226125 wait complete. 2021-06-25T04:54:30.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbffff700 1 Processor -- start 2021-06-25T04:54:30.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbffff700 1 -- start start 2021-06-25T04:54:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00aad40 0x7f3fc0143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00ab120 0x7f3fc00ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00b4d10 0x7f3fc00aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00b1cb0 con 0x7f3fc00b4d10 2021-06-25T04:54:30.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00b07f0 con 0x7f3fc00aad40 2021-06-25T04:54:30.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00b0cc0 con 0x7f3fc00ab120 2021-06-25T04:54:30.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00b4d10 0x7f3fc00aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00b4d10 0x7f3fc00aec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40018/0 (socket says 172.21.15.57:40018) 2021-06-25T04:54:30.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbf7fe700 1 -- 172.21.15.57:0/79730443 learned_addr learned my addr 172.21.15.57:0/79730443 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:30.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbeffd700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00aad40 0x7f3fc0143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbe7fc700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00ab120 0x7f3fc00ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbf7fe700 1 -- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00ab120 msgr2=0x7f3fc00ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbf7fe700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00ab120 0x7f3fc00ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbf7fe700 1 -- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00aad40 msgr2=0x7f3fc0143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbf7fe700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00aad40 0x7f3fc0143870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbf7fe700 1 -- 172.21.15.57:0/79730443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb000b180 con 0x7f3fc00b4d10 2021-06-25T04:54:30.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbf7fe700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00b4d10 0x7f3fc00aec80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f3fc00b1df0 tx=0x7f3fb80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:30.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fb7fff700 1 -- 172.21.15.57:0/79730443 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb800c6a0 con 0x7f3fc00b4d10 2021-06-25T04:54:30.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fb7fff700 1 -- 172.21.15.57:0/79730443 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb800c800 con 0x7f3fc00b4d10 2021-06-25T04:54:30.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fbffff700 1 -- 172.21.15.57:0/79730443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc00b0a20 con 0x7f3fc00b4d10 2021-06-25T04:54:30.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.105+0000 7f3fb7fff700 1 -- 172.21.15.57:0/79730443 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb800cb60 con 0x7f3fc00b4d10 2021-06-25T04:54:30.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.109+0000 7f3fbffff700 1 -- 172.21.15.57:0/79730443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc00b1380 con 0x7f3fc00b4d10 2021-06-25T04:54:30.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.109+0000 7f3fbffff700 1 -- 172.21.15.57:0/79730443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc0057310 con 0x7f3fc00b4d10 2021-06-25T04:54:30.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.109+0000 7f3fb7fff700 1 -- 172.21.15.57:0/79730443 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3fb8022070 con 0x7f3fc00b4d10 2021-06-25T04:54:30.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.109+0000 7f3fb7fff700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fa4055340 0x7f3fa4057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.109+0000 7f3fb7fff700 1 -- 172.21.15.57:0/79730443 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3fb806e330 con 0x7f3fc00b4d10 2021-06-25T04:54:30.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.109+0000 7f3fbeffd700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fa4055340 0x7f3fa4057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.113+0000 7f3fbeffd700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fa4055340 0x7f3fa4057800 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f3fb0017000 tx=0x7f3fb0014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:30.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.113+0000 7f3fb7fff700 1 -- 172.21.15.57:0/79730443 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3fb8044680 con 0x7f3fc00b4d10 2021-06-25T04:54:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.245+0000 7f3fbffff700 1 -- 172.21.15.57:0/79730443 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3fc005d990 con 0x7f3fc00b4d10 2021-06-25T04:54:30.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.257+0000 7f3fb7fff700 1 -- 172.21.15.57:0/79730443 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3fb80160c0 con 0x7f3fc00b4d10 2021-06-25T04:54:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 -- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fa4055340 msgr2=0x7f3fa4057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fa4055340 0x7f3fa4057800 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f3fb0017000 tx=0x7f3fb0014000).stop 2021-06-25T04:54:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 -- 172.21.15.57:0/79730443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00b4d10 msgr2=0x7f3fc00aec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00b4d10 0x7f3fc00aec80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f3fc00b1df0 tx=0x7f3fb80091d0).stop 2021-06-25T04:54:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 -- 172.21.15.57:0/79730443 shutdown_connections 2021-06-25T04:54:30.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3fa4055340 0x7f3fa4057800 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc00b4d10 0x7f3fc00aec80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fc00ab120 0x7f3fc00ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 --2- 172.21.15.57:0/79730443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fc00aad40 0x7f3fc0143870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 -- 172.21.15.57:0/79730443 >> 172.21.15.57:0/79730443 conn(0x7f3fc0062ba0 msgr2=0x7f3fc01413e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:30.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 -- 172.21.15.57:0/79730443 shutdown_connections 2021-06-25T04:54:30.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.261+0000 7f3fbffff700 1 -- 172.21.15.57:0/79730443 wait complete. 2021-06-25T04:54:30.280 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:54:30.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:30.297 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:30.312 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:30.333 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:30.354 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:54:30.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:30.355 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:30.355 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:30.362 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:54:30.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:54:30.364 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:54:30.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:30.365 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:30.365 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:30.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:54:30.404 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:54:30.404 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:54:30.405 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:54:30.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.513+0000 7fda6d94d700 1 Processor -- start 2021-06-25T04:54:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.513+0000 7fda6d94d700 1 -- start start 2021-06-25T04:54:30.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.513+0000 7fda6d94d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda680af3d0 0x7fda68060440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.513+0000 7fda6d94d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda681410b0 0x7fda680a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.513+0000 7fda6d94d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda68145450 con 0x7fda6805f670 2021-06-25T04:54:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.513+0000 7fda6d94d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda680b3130 con 0x7fda681410b0 2021-06-25T04:54:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.513+0000 7fda6d94d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda680b33d0 con 0x7fda680af3d0 2021-06-25T04:54:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.513+0000 7fda667fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fda6805f670 0x7fda68144d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57242/0 (socket says 172.21.15.57:57242) 2021-06-25T04:54:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.513+0000 7fda667fc700 1 -- 172.21.15.57:0/600887855 learned_addr learned my addr 172.21.15.57:0/600887855 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:30.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.513+0000 7fda66ffd700 1 --2- 172.21.15.57:0/600887855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda680af3d0 0x7fda68060440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.513+0000 7fda677fe700 1 --2- 172.21.15.57:0/600887855 >> v2:172.21.15.57:3300/0 conn(0x7fda681410b0 0x7fda680a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda65ffb700 1 -- 172.21.15.57:0/600887855 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82730491 0 0) 0x7fda68145450 con 0x7fda6805f670 2021-06-25T04:54:30.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda65ffb700 1 -- 172.21.15.57:0/600887855 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda4c003260 con 0x7fda6805f670 2021-06-25T04:54:30.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda66ffd700 1 -- 172.21.15.57:0/600887855 >> v2:172.21.15.57:3300/0 conn(0x7fda681410b0 msgr2=0x7fda680a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:30.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda66ffd700 1 --2- 172.21.15.57:0/600887855 >> v2:172.21.15.57:3300/0 conn(0x7fda681410b0 0x7fda680a58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda66ffd700 1 -- 172.21.15.57:0/600887855 >> v1:172.21.15.57:6789/0 conn(0x7fda6805f670 legacy=0x7fda68144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda66ffd700 1 -- 172.21.15.57:0/600887855 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda68144600 con 0x7fda680af3d0 2021-06-25T04:54:30.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda66ffd700 1 --2- 172.21.15.57:0/600887855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda680af3d0 0x7fda68060440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fda680a9af0 tx=0x7fda58006df0).ready entity=mon.2 client_cookie=9fdd4087edfcaed6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:30.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda65ffb700 1 -- 172.21.15.57:0/600887855 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda5800d570 con 0x7fda680af3d0 2021-06-25T04:54:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda65ffb700 1 -- 172.21.15.57:0/600887855 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda58000e90 con 0x7fda680af3d0 2021-06-25T04:54:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda65ffb700 1 -- 172.21.15.57:0/600887855 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda5800d8c0 con 0x7fda680af3d0 2021-06-25T04:54:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda6d94d700 1 -- 172.21.15.57:0/600887855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda680af3d0 msgr2=0x7fda68060440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda6d94d700 1 --2- 172.21.15.57:0/600887855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda680af3d0 0x7fda68060440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fda680a9af0 tx=0x7fda58006df0).stop 2021-06-25T04:54:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda6d94d700 1 -- 172.21.15.57:0/600887855 shutdown_connections 2021-06-25T04:54:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda6d94d700 1 --2- 172.21.15.57:0/600887855 >> v2:172.21.15.57:3300/0 conn(0x7fda681410b0 0x7fda680a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda6d94d700 1 --2- 172.21.15.57:0/600887855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda680af3d0 0x7fda68060440 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda6d94d700 1 -- 172.21.15.57:0/600887855 >> 172.21.15.57:0/600887855 conn(0x7fda6805cce0 msgr2=0x7fda68062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:30.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda6d94d700 1 -- 172.21.15.57:0/600887855 shutdown_connections 2021-06-25T04:54:30.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.517+0000 7fda6d94d700 1 -- 172.21.15.57:0/600887855 wait complete. 2021-06-25T04:54:30.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda6d94d700 1 Processor -- start 2021-06-25T04:54:30.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda6d94d700 1 -- start start 2021-06-25T04:54:30.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda6d94d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda6805f670 0x7fda680a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda6d94d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda680af3d0 0x7fda68151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda6d94d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681410b0 0x7fda68152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda6d94d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680aeb20 con 0x7fda681410b0 2021-06-25T04:54:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda6d94d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680a7970 con 0x7fda680af3d0 2021-06-25T04:54:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda6d94d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda680aed50 con 0x7fda6805f670 2021-06-25T04:54:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda677fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681410b0 0x7fda68152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda677fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681410b0 0x7fda68152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40032/0 (socket says 172.21.15.57:40032) 2021-06-25T04:54:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda677fe700 1 -- 172.21.15.57:0/3799213758 learned_addr learned my addr 172.21.15.57:0/3799213758 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda66ffd700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda6805f670 0x7fda680a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda667fc700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda680af3d0 0x7fda68151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda677fe700 1 -- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda6805f670 msgr2=0x7fda680a90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda677fe700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda6805f670 0x7fda680a90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda677fe700 1 -- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda680af3d0 msgr2=0x7fda68151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda677fe700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda680af3d0 0x7fda68151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda677fe700 1 -- 172.21.15.57:0/3799213758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5800b180 con 0x7fda681410b0 2021-06-25T04:54:30.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda667fc700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda680af3d0 0x7fda68151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:30.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.521+0000 7fda677fe700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681410b0 0x7fda68152450 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fda60006e00 tx=0x7fda600091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:30.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.525+0000 7fda57fff700 1 -- 172.21.15.57:0/3799213758 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6000c6a0 con 0x7fda681410b0 2021-06-25T04:54:30.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.525+0000 7fda6d94d700 1 -- 172.21.15.57:0/3799213758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda680a95a0 con 0x7fda681410b0 2021-06-25T04:54:30.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.525+0000 7fda6d94d700 1 -- 172.21.15.57:0/3799213758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda680ae460 con 0x7fda681410b0 2021-06-25T04:54:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.525+0000 7fda57fff700 1 -- 172.21.15.57:0/3799213758 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6000c800 con 0x7fda681410b0 2021-06-25T04:54:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.525+0000 7fda57fff700 1 -- 172.21.15.57:0/3799213758 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6000cb60 con 0x7fda681410b0 2021-06-25T04:54:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.525+0000 7fda6d94d700 1 -- 172.21.15.57:0/3799213758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda48003410 con 0x7fda681410b0 2021-06-25T04:54:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.525+0000 7fda57fff700 1 -- 172.21.15.57:0/3799213758 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fda60022070 con 0x7fda681410b0 2021-06-25T04:54:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.525+0000 7fda57fff700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda44055450 0x7fda44057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.525+0000 7fda57fff700 1 -- 172.21.15.57:0/3799213758 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fda6006e3a0 con 0x7fda681410b0 2021-06-25T04:54:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.525+0000 7fda66ffd700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda44055450 0x7fda44057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:30.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.525+0000 7fda66ffd700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda44055450 0x7fda44057910 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fda58019000 tx=0x7fda58014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:30.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.533+0000 7fda57fff700 1 -- 172.21.15.57:0/3799213758 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fda600446f0 con 0x7fda681410b0 2021-06-25T04:54:30.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.665+0000 7fda6d94d700 1 -- 172.21.15.57:0/3799213758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fda480036c0 con 0x7fda681410b0 2021-06-25T04:54:30.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda57fff700 1 -- 172.21.15.57:0/3799213758 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v81) v1 ==== 81+0+29293 (secure 0 0 0) 0x7fda60016020 con 0x7fda681410b0 2021-06-25T04:54:30.671 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:30.672 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:54:30.672 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 81, 2021-06-25T04:54:30.672 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:54:30.673 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:54:30.673 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:54:27.930806+0000", 2021-06-25T04:54:30.673 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:54:30.673 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:54:30.673 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:54:30.674 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:54:30.674 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:54:30.674 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:54:30.674 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:54:30.675 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:54:30.675 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:54:30.675 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:30.675 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:54:30.676 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:54:30.676 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:54:30.676 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:54:30.676 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:54:30.677 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 14, 2021-06-25T04:54:30.677 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:54:30.677 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:54:30.677 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:54:30.677 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:54:30.678 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:54:30.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.678 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:54:30.678 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:54:30.679 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:54:30.679 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:30.679 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:30.679 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:30.680 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:30.680 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:30.680 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:30.680 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:30.681 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:30.681 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:54:30.681 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:54:30.681 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:54:30.681 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:54:30.682 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:54:30.682 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:30.682 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:30.682 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:30.683 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:30.683 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:30.683 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:30.683 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:30.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.684 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:54:30.684 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:30.684 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:30.684 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:30.685 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:30.685 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:30.685 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:30.685 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:30.686 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:30.686 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:30.686 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:30.686 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:30.686 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:30.687 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:30.687 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:30.687 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:30.687 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:30.688 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:30.688 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:30.688 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:30.688 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:30.689 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:30.689 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:30.689 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:30.689 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:30.689 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:30.690 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:30.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.690 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:30.690 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:30.691 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:30.691 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:30.691 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:30.691 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:30.692 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:30.692 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:30.692 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:30.692 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:30.693 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:30.693 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:54:30.693 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:54:30.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.693 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:30.694 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:54:30.694 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.695 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:54:30.695 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:54:30.695 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:54:30.695 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:30.696 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:30.696 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:30.696 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:30.696 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:30.696 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:30.697 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:30.697 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:30.697 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:54:30.697 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:54:30.698 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:54:30.698 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:54:30.698 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:54:30.698 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:30.699 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:30.699 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:30.699 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:30.699 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:30.699 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:30.700 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:30.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.700 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:54:30.700 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:30.701 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:30.701 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:30.701 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:30.701 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:30.702 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:30.702 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:30.702 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:30.702 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:30.702 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:30.703 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:30.703 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:30.703 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:30.703 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:30.704 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:30.704 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:30.704 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:30.704 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:30.704 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:30.705 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:30.705 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:30.705 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:30.705 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:30.706 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:30.706 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:30.706 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:30.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.707 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:30.707 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:30.707 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:30.707 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:30.707 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:30.708 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:30.708 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:30.708 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:30.708 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:30.709 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:30.709 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:30.709 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:54:30.709 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:30.710 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:54:30.710 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.710 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.710 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:30.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:54:30.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.711 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:54:30.711 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:54:30.711 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:30.712 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:30.712 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:30.712 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:30.712 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:30.712 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:30.713 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:30.713 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 75, 2021-06-25T04:54:30.713 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:30.713 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:30.714 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:30.715 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.715 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.715 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:54:30.716 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:30.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.716 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.717 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:54:30.717 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:30.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.717 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.718 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:30.718 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.718 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.719 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:54:30.719 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:30.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.720 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.720 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:54:30.720 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:30.720 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.721 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.721 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:30.721 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.722 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.722 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:54:30.722 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:30.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.723 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.723 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:54:30.723 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:30.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.724 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.724 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:30.724 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.725 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.725 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:54:30.725 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:30.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.726 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.726 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:54:30.726 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:30.727 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.727 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.727 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:54:30.727 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:54:30.728 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:54:30.728 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:54:30.728 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:30.728 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:30.729 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:30.729 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.729 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:54:30.730 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:54:30.730 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:30.730 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:30.730 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:30.731 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:30.731 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:30.731 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:30.731 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:30.732 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 65, 2021-06-25T04:54:30.732 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:30.732 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:30.732 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:30.732 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.733 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.733 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:54:30.733 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:30.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.734 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.734 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:54:30.734 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:30.735 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.735 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.735 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:30.736 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.736 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.736 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:54:30.737 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:30.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.737 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.737 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:54:30.738 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:30.738 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.738 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.739 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:30.739 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.739 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.739 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:54:30.740 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:30.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.740 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.741 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:54:30.741 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:30.741 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.741 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.742 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:30.742 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.743 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.743 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:54:30.743 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:30.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.744 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.744 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:54:30.744 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:30.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.745 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.745 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:54:30.745 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:54:30.746 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:54:30.746 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:54:30.746 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:30.746 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:30.747 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:30.747 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.747 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:54:30.748 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:54:30.748 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:30.748 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:30.748 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:30.749 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:30.749 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:30.749 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:30.749 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:30.749 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 75, 2021-06-25T04:54:30.750 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:30.750 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:30.750 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:30.750 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.751 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.751 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:54:30.751 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:30.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.752 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.752 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:54:30.752 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:30.753 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.753 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.753 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:30.753 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.754 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.754 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:54:30.754 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:30.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.755 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.755 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:54:30.755 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:30.756 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.756 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.756 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:30.757 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.757 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.757 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:54:30.757 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:30.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.758 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.758 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:54:30.759 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:30.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.759 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.759 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:30.760 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.760 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.760 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:54:30.761 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:30.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.761 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.762 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:54:30.762 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:30.762 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.762 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.763 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:54:30.763 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:54:30.763 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:54:30.763 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:54:30.764 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:30.764 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:30.764 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:30.764 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.765 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:54:30.765 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:54:30.765 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:30.766 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:30.766 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:30.766 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:30.766 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:30.766 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:30.767 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:30.767 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 75, 2021-06-25T04:54:30.767 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:30.767 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:30.768 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:30.768 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.768 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.768 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:54:30.769 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:30.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.769 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.770 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:54:30.770 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:30.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.770 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.771 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:30.771 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.772 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.772 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:54:30.772 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:30.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.773 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.773 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:54:30.773 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:30.773 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.774 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.774 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:30.774 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.775 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.775 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:54:30.775 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:30.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.776 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.776 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:54:30.776 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:30.777 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.777 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.777 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:30.777 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.778 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.778 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:54:30.778 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:30.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.779 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.779 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:54:30.779 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:30.780 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.780 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.780 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:54:30.781 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:54:30.781 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:54:30.781 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:54:30.781 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:30.781 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:30.782 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:30.782 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.783 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:54:30.783 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:54:30.783 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:30.783 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:30.783 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:30.784 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:30.784 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:30.784 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:30.784 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:30.785 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 74, 2021-06-25T04:54:30.785 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:30.785 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:30.785 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:30.785 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.786 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.786 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:54:30.786 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:30.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.787 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.787 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:54:30.787 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:30.788 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.788 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.788 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:30.789 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.789 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.789 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:54:30.789 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:30.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.790 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.790 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:54:30.791 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:30.791 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.791 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.791 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:30.792 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.792 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.792 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:54:30.793 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:30.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.793 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.793 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:54:30.794 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:30.794 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.794 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.795 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:30.795 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.795 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.795 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:54:30.796 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:30.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.796 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.797 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:54:30.797 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:30.797 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.797 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.798 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:54:30.798 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:54:30.798 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:54:30.798 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:54:30.799 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:30.799 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:30.799 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:30.799 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.800 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:54:30.800 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:54:30.800 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:30.801 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:30.801 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:30.801 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:30.801 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:30.802 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:30.802 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:30.802 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 75, 2021-06-25T04:54:30.802 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:30.802 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:30.803 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:30.803 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.803 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.804 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:54:30.804 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:30.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.804 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.805 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:54:30.805 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:30.805 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.805 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.806 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:30.806 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.807 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.807 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:54:30.807 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:30.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.808 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.808 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:54:30.808 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:30.808 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.809 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.809 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:30.809 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.810 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.810 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:54:30.810 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:30.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.811 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.811 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:54:30.811 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:30.812 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.812 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.812 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:30.812 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.813 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.813 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:54:30.813 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:30.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.814 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.814 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:54:30.814 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:30.815 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.815 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.815 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:54:30.815 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:54:30.816 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:54:30.816 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:54:30.816 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:30.816 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:30.817 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:30.817 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.817 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:54:30.818 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:54:30.818 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:30.818 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:30.818 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:30.819 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:30.819 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:30.819 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:30.819 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:30.820 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 75, 2021-06-25T04:54:30.820 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:30.820 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:30.820 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:30.820 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.821 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.821 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:54:30.821 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:30.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.822 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.822 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:54:30.822 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:30.823 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.823 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.823 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:30.824 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.824 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.824 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:54:30.824 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:30.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.825 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.825 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:54:30.826 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:30.826 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.826 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.826 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:30.827 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.827 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.827 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:54:30.828 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:30.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.828 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.829 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:54:30.829 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:30.829 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.829 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.830 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:30.830 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.830 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.831 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:54:30.831 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:30.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.831 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.832 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:54:30.832 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:30.832 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.832 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.833 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:54:30.833 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:54:30.833 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:54:30.834 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:54:30.834 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:30.834 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:30.834 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:30.834 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.835 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:54:30.835 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:54:30.836 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:30.836 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:30.836 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:30.836 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:30.836 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:30.837 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:30.837 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:30.837 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 74, 2021-06-25T04:54:30.837 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:30.838 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:30.838 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:30.838 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.839 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.839 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:54:30.839 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:30.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.840 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.840 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:54:30.840 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:30.840 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.841 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.841 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:30.841 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.842 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.842 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:54:30.842 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:30.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.843 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.843 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:54:30.844 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:30.844 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.844 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.845 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:30.845 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.845 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.846 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:54:30.846 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:30.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.846 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.847 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:54:30.847 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:30.847 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.847 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.848 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:30.848 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:30.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.849 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:30.849 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:54:30.849 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:30.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.850 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:30.850 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:54:30.850 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:30.850 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.851 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.851 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:54:30.851 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:54:30.851 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:54:30.852 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:54:30.852 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:30.852 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:30.852 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:30.853 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:30.853 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.853 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:30.853 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:54:30.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.854 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:54:30.854 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:30.854 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:30.854 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:30.855 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:30.855 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:30.855 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:54:30.855 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:30.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.856 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:54:30.856 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:30.857 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:30.857 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:30.857 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:30.857 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:30.857 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:54:30.858 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:30.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.858 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:54:30.859 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:30.859 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:30.859 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:30.859 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:30.860 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:30.860 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:54:30.860 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:30.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.861 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:54:30.861 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:30.861 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:30.861 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:30.861 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:30.862 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:30.862 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:54:30.862 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:30.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.863 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:54:30.863 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:30.863 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:30.864 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:30.864 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:30.864 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:30.864 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:54:30.865 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:30.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.865 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:54:30.865 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:30.866 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:30.866 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:30.866 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:30.866 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:30.866 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:54:30.867 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:30.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.867 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:54:30.868 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:30.868 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:30.868 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:30.868 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:30.868 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:30.869 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:54:30.869 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:30.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:30.870 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:54:30.870 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:30.870 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:30.870 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:30.870 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:30.871 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:30.871 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:54:30.871 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:30.871 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.872 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:30.872 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:54:30.872 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:54:30.872 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:54:30.872 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:54:30.873 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:54:30.873 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6835/2725183825": "2021-06-26T04:54:24.718830+0000", 2021-06-25T04:54:30.873 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6834/2725183825": "2021-06-26T04:54:24.718830+0000", 2021-06-25T04:54:30.873 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.102:0/1630225676": "2021-06-25T05:54:12.976776+0000" 2021-06-25T04:54:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:54:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:54:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:54:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:54:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:54:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:54:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:54:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:54:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:54:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:54:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:54:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:54:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:54:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:54:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:54:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:54:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:54:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:54:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:54:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:54:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:54:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:54:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:54:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:54:30.880 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:54:30.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 -- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda44055450 msgr2=0x7fda44057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda44055450 0x7fda44057910 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fda58019000 tx=0x7fda58014000).stop 2021-06-25T04:54:30.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 -- 172.21.15.57:0/3799213758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681410b0 msgr2=0x7fda68152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:30.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681410b0 0x7fda68152450 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fda60006e00 tx=0x7fda600091d0).stop 2021-06-25T04:54:30.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 -- 172.21.15.57:0/3799213758 shutdown_connections 2021-06-25T04:54:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda44055450 0x7fda44057910 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681410b0 0x7fda68152450 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda680af3d0 0x7fda68151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 --2- 172.21.15.57:0/3799213758 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda6805f670 0x7fda680a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:30.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 -- 172.21.15.57:0/3799213758 >> 172.21.15.57:0/3799213758 conn(0x7fda6805cce0 msgr2=0x7fda680af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:30.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 -- 172.21.15.57:0/3799213758 shutdown_connections 2021-06-25T04:54:30.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.669+0000 7fda6d94d700 1 -- 172.21.15.57:0/3799213758 wait complete. 2021-06-25T04:54:30.886 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.997+0000 7f57da65c700 1 Processor -- start 2021-06-25T04:54:31.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.997+0000 7f57da65c700 1 -- start start 2021-06-25T04:54:31.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.997+0000 7f57da65c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f57d413c6a0 0x7f57d413cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.997+0000 7f57da65c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f57d40acee0 0x7f57d40ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.997+0000 7f57da65c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d40b2bf0 con 0x7f57d40b2810 2021-06-25T04:54:31.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.997+0000 7f57da65c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d40b1170 con 0x7f57d40acee0 2021-06-25T04:54:31.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:30.997+0000 7f57da65c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d40b1620 con 0x7f57d413c6a0 2021-06-25T04:54:31.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57d9e5b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f57d40acee0 0x7f57d40ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57d8e59700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f57d413c6a0 0x7f57d413cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57d9e5b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f57d40acee0 0x7f57d40ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40040/0 (socket says 172.21.15.57:40040) 2021-06-25T04:54:31.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57d9e5b700 1 -- 172.21.15.57:0/3265819766 learned_addr learned my addr 172.21.15.57:0/3265819766 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:31.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57d9e5b700 1 -- 172.21.15.57:0/3265819766 >> v2:172.21.15.87:3300/0 conn(0x7f57d413c6a0 msgr2=0x7f57d413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:31.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57d9e5b700 1 --2- 172.21.15.57:0/3265819766 >> v2:172.21.15.87:3300/0 conn(0x7f57d413c6a0 0x7f57d413cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57c7fff700 1 -- 172.21.15.57:0/3265819766 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891985606 0 0) 0x7f57d40b2bf0 con 0x7f57d40b2810 2021-06-25T04:54:31.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57d9e5b700 1 -- 172.21.15.57:0/3265819766 >> v1:172.21.15.87:6789/0 conn(0x7f57d40b2810 legacy=0x7f57d40b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57d9e5b700 1 -- 172.21.15.57:0/3265819766 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d40b18c0 con 0x7f57d40acee0 2021-06-25T04:54:31.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57d9e5b700 1 --2- 172.21.15.57:0/3265819766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57d40acee0 0x7f57d40ad300 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f57cc002f70 tx=0x7f57cc006eb0).ready entity=mon.0 client_cookie=9f2cd3cb7358ca24 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:31.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57c7fff700 1 -- 172.21.15.57:0/3265819766 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57cc00d5c0 con 0x7f57d40acee0 2021-06-25T04:54:31.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57c7fff700 1 -- 172.21.15.57:0/3265819766 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc000e90 con 0x7f57d40acee0 2021-06-25T04:54:31.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57c7fff700 1 -- 172.21.15.57:0/3265819766 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57cc00d910 con 0x7f57d40acee0 2021-06-25T04:54:31.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57da65c700 1 -- 172.21.15.57:0/3265819766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57d40acee0 msgr2=0x7f57d40ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57da65c700 1 --2- 172.21.15.57:0/3265819766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57d40acee0 0x7f57d40ad300 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f57cc002f70 tx=0x7f57cc006eb0).stop 2021-06-25T04:54:31.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57da65c700 1 -- 172.21.15.57:0/3265819766 shutdown_connections 2021-06-25T04:54:31.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57da65c700 1 --2- 172.21.15.57:0/3265819766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57d40acee0 0x7f57d40ad300 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57da65c700 1 --2- 172.21.15.57:0/3265819766 >> v2:172.21.15.87:3300/0 conn(0x7f57d413c6a0 0x7f57d413cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57da65c700 1 -- 172.21.15.57:0/3265819766 >> 172.21.15.57:0/3265819766 conn(0x7f57d40611f0 msgr2=0x7f57d4062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:31.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57da65c700 1 -- 172.21.15.57:0/3265819766 shutdown_connections 2021-06-25T04:54:31.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57da65c700 1 -- 172.21.15.57:0/3265819766 wait complete. 2021-06-25T04:54:31.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57da65c700 1 Processor -- start 2021-06-25T04:54:31.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.001+0000 7f57da65c700 1 -- start start 2021-06-25T04:54:31.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57da65c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d40acee0 0x7f57d40644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57da65c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57d40b2810 0x7f57d4152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57da65c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d413c6a0 0x7f57d4152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57da65c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d413ff60 con 0x7f57d40b2810 2021-06-25T04:54:31.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57da65c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d41410f0 con 0x7f57d40acee0 2021-06-25T04:54:31.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57da65c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d4141390 con 0x7f57d413c6a0 2021-06-25T04:54:31.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d8e59700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57d40b2810 0x7f57d4152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d8e59700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57d40b2810 0x7f57d4152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40044/0 (socket says 172.21.15.57:40044) 2021-06-25T04:54:31.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d8e59700 1 -- 172.21.15.57:0/542286982 learned_addr learned my addr 172.21.15.57:0/542286982 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:31.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d965a700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d40acee0 0x7f57d40644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d9e5b700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d413c6a0 0x7f57d4152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d8e59700 1 -- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d413c6a0 msgr2=0x7f57d4152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d8e59700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d413c6a0 0x7f57d4152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d8e59700 1 -- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d40acee0 msgr2=0x7f57d40644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d8e59700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d40acee0 0x7f57d40644a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d8e59700 1 -- 172.21.15.57:0/542286982 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc00b1e0 con 0x7f57d40b2810 2021-06-25T04:54:31.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d9e5b700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d413c6a0 0x7f57d4152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:31.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57d8e59700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57d40b2810 0x7f57d4152490 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f57c800c000 tx=0x7f57c8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:31.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57c67fc700 1 -- 172.21.15.57:0/542286982 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57c8011920 con 0x7f57d40b2810 2021-06-25T04:54:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57c67fc700 1 -- 172.21.15.57:0/542286982 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8011a80 con 0x7f57d40b2810 2021-06-25T04:54:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57da65c700 1 -- 172.21.15.57:0/542286982 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d4141630 con 0x7f57d40b2810 2021-06-25T04:54:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57c67fc700 1 -- 172.21.15.57:0/542286982 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57c8011de0 con 0x7f57d40b2810 2021-06-25T04:54:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57da65c700 1 -- 172.21.15.57:0/542286982 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d4142ef0 con 0x7f57d40b2810 2021-06-25T04:54:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.005+0000 7f57da65c700 1 -- 172.21.15.57:0/542286982 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d4064cd0 con 0x7f57d40b2810 2021-06-25T04:54:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.009+0000 7f57c67fc700 1 -- 172.21.15.57:0/542286982 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f57c8021070 con 0x7f57d40b2810 2021-06-25T04:54:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.009+0000 7f57c67fc700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57b4055380 0x7f57b4057840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.009+0000 7f57c67fc700 1 -- 172.21.15.57:0/542286982 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f57c806f9b0 con 0x7f57d40b2810 2021-06-25T04:54:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.009+0000 7f57d965a700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57b4055380 0x7f57b4057840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.009+0000 7f57d965a700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57b4055380 0x7f57b4057840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f57d000d000 tx=0x7f57d0007da0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.013+0000 7f57c67fc700 1 -- 172.21.15.57:0/542286982 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f57c8045e10 con 0x7f57d40b2810 2021-06-25T04:54:31.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.177+0000 7f57da65c700 1 -- 172.21.15.57:0/542286982 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57d4057310 con 0x7f57d40b2810 2021-06-25T04:54:31.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.177+0000 7f57c67fc700 1 -- 172.21.15.57:0/542286982 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f57c8049430 con 0x7f57d40b2810 2021-06-25T04:54:31.182 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2942430957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2942430957},{"type":"v1","addr":"172.21.15.87:6835","nonce":2942430957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34},{"gid":6184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/4012056699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4012056699},{"type":"v1","addr":"172.21.15.57:6833","nonce":4012056699}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35},{"gid":6576,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/1081424967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1081424967},{"type":"v1","addr":"172.21.15.57:6835","nonce":1081424967}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38}],"filesystems":[]} 2021-06-25T04:54:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 -- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57b4055380 msgr2=0x7f57b4057840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57b4055380 0x7f57b4057840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f57d000d000 tx=0x7f57d0007da0).stop 2021-06-25T04:54:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 -- 172.21.15.57:0/542286982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57d40b2810 msgr2=0x7f57d4152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57d40b2810 0x7f57d4152490 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f57c800c000 tx=0x7f57c8006df0).stop 2021-06-25T04:54:31.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 -- 172.21.15.57:0/542286982 shutdown_connections 2021-06-25T04:54:31.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57b4055380 0x7f57b4057840 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57d413c6a0 0x7f57d4152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57d40b2810 0x7f57d4152490 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 --2- 172.21.15.57:0/542286982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d40acee0 0x7f57d40644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 -- 172.21.15.57:0/542286982 >> 172.21.15.57:0/542286982 conn(0x7f57d40611f0 msgr2=0x7f57d40ad2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:31.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 -- 172.21.15.57:0/542286982 shutdown_connections 2021-06-25T04:54:31.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.181+0000 7f57da65c700 1 -- 172.21.15.57:0/542286982 wait complete. 2021-06-25T04:54:31.188 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2021-06-25T04:54:31.194 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:31.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f47ae4700 1 Processor -- start 2021-06-25T04:54:31.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f47ae4700 1 -- start start 2021-06-25T04:54:31.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f47ae4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3f40066a00 0x7f3f4013e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f47ae4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f401445c0 con 0x7f3f40140ee0 2021-06-25T04:54:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f47ae4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f400b42a0 con 0x7f3f400b1f10 2021-06-25T04:54:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f47ae4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f40141f30 con 0x7f3f40066a00 2021-06-25T04:54:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4507f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3f40140ee0 0x7f3f40066de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57272/0 (socket says 172.21.15.57:57272) 2021-06-25T04:54:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4507f700 1 -- 172.21.15.57:0/368550175 learned_addr learned my addr 172.21.15.57:0/368550175 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:31.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f45880700 1 --2- 172.21.15.57:0/368550175 >> v2:172.21.15.87:3300/0 conn(0x7f3f40066a00 0x7f3f4013e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278407924 0 0) 0x7f3f401445c0 con 0x7f3f40140ee0 2021-06-25T04:54:31.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f20003260 con 0x7f3f40140ee0 2021-06-25T04:54:31.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1470880999 0 0) 0x7f3f20003260 con 0x7f3f40140ee0 2021-06-25T04:54:31.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 >> v2:172.21.15.87:3300/0 conn(0x7f3f40066a00 msgr2=0x7f3f4013e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 --2- 172.21.15.57:0/368550175 >> v2:172.21.15.87:3300/0 conn(0x7f3f40066a00 0x7f3f4013e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 >> v1:172.21.15.87:6789/0 conn(0x7f3f400b1f10 legacy=0x7f3f40144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f400aaf10 con 0x7f3f40140ee0 2021-06-25T04:54:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f3f28001660 con 0x7f3f40140ee0 2021-06-25T04:54:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 >> v1:172.21.15.57:6789/0 conn(0x7f3f40140ee0 legacy=0x7f3f40066de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f20003750 0x7f3f20003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f20004500 0x7f3f20004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f20004e70 0x7f3f2000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40141f30 con 0x7f3f20004e70 2021-06-25T04:54:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2000bd20 con 0x7f3f20004500 2021-06-25T04:54:31.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2000bee0 con 0x7f3f20003750 2021-06-25T04:54:31.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f46081700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f20004e70 0x7f3f2000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f45880700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f20003750 0x7f3f20003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4507f700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f20004500 0x7f3f20004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f46081700 1 -- 172.21.15.57:0/368550175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f20003750 msgr2=0x7f3f20003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:31.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f46081700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f20003750 0x7f3f20003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f46081700 1 -- 172.21.15.57:0/368550175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f20004500 msgr2=0x7f3f20004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:31.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f46081700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f20004500 0x7f3f20004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f46081700 1 -- 172.21.15.57:0/368550175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f20003260 con 0x7f3f20004e70 2021-06-25T04:54:31.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.293+0000 7f3f4507f700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f20004500 0x7f3f20004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:31.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f46081700 1 -- 172.21.15.57:0/368550175 reap_dead start 2021-06-25T04:54:31.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f46081700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f20004e70 0x7f3f2000b750 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f3f40063e30 tx=0x7f3f38007a00).ready entity=mon.0 client_cookie=8ed077e2759ded02 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:31.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f38007d10 con 0x7f3f20004e70 2021-06-25T04:54:31.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f38007030 con 0x7f3f20004e70 2021-06-25T04:54:31.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f4487e700 1 -- 172.21.15.57:0/368550175 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f38007390 con 0x7f3f20004e70 2021-06-25T04:54:31.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f47ae4700 1 -- 172.21.15.57:0/368550175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f20004e70 msgr2=0x7f3f2000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f47ae4700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f20004e70 0x7f3f2000b750 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f3f40063e30 tx=0x7f3f38007a00).stop 2021-06-25T04:54:31.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f47ae4700 1 -- 172.21.15.57:0/368550175 shutdown_connections 2021-06-25T04:54:31.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f47ae4700 1 --2- 172.21.15.57:0/368550175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f20004e70 0x7f3f2000b750 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f47ae4700 1 -- 172.21.15.57:0/368550175 >> 172.21.15.57:0/368550175 conn(0x7f3f4005c450 msgr2=0x7f3f4005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:31.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f47ae4700 1 -- 172.21.15.57:0/368550175 shutdown_connections 2021-06-25T04:54:31.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f47ae4700 1 -- 172.21.15.57:0/368550175 wait complete. 2021-06-25T04:54:31.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f47ae4700 1 Processor -- start 2021-06-25T04:54:31.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.297+0000 7f3f47ae4700 1 -- start start 2021-06-25T04:54:31.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f47ae4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f20004e70 0x7f3f40138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f47ae4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f401374a0 0x7f3f40061ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f47ae4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f400623c0 0x7f3f40060e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f47ae4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40142370 con 0x7f3f401374a0 2021-06-25T04:54:31.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f47ae4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401371e0 con 0x7f3f400623c0 2021-06-25T04:54:31.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f47ae4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401420d0 con 0x7f3f20004e70 2021-06-25T04:54:31.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f4507f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f401374a0 0x7f3f40061ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f4507f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f401374a0 0x7f3f40061ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40064/0 (socket says 172.21.15.57:40064) 2021-06-25T04:54:31.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f4507f700 1 -- 172.21.15.57:0/4183049622 learned_addr learned my addr 172.21.15.57:0/4183049622 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:31.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f45880700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f20004e70 0x7f3f40138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f46081700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f400623c0 0x7f3f40060e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f4507f700 1 -- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f20004e70 msgr2=0x7f3f40138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f4507f700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f20004e70 0x7f3f40138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f4507f700 1 -- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f400623c0 msgr2=0x7f3f40060e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f4507f700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f400623c0 0x7f3f40060e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f4507f700 1 -- 172.21.15.57:0/4183049622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f40136ca0 con 0x7f3f401374a0 2021-06-25T04:54:31.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f46081700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f400623c0 0x7f3f40060e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:31.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f4507f700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f401374a0 0x7f3f40061ed0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f3f2800b000 tx=0x7f3f400ab0a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:31.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f3effd700 1 -- 172.21.15.57:0/4183049622 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f28015630 con 0x7f3f401374a0 2021-06-25T04:54:31.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f3effd700 1 -- 172.21.15.57:0/4183049622 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f28010040 con 0x7f3f401374a0 2021-06-25T04:54:31.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f47ae4700 1 -- 172.21.15.57:0/4183049622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f40136f40 con 0x7f3f401374a0 2021-06-25T04:54:31.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f3effd700 1 -- 172.21.15.57:0/4183049622 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f28015980 con 0x7f3f401374a0 2021-06-25T04:54:31.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f47ae4700 1 -- 172.21.15.57:0/4183049622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f401441a0 con 0x7f3f401374a0 2021-06-25T04:54:31.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.301+0000 7f3f47ae4700 1 -- 172.21.15.57:0/4183049622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f40061bc0 con 0x7f3f401374a0 2021-06-25T04:54:31.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.305+0000 7f3f3effd700 1 -- 172.21.15.57:0/4183049622 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3f2801f3f0 con 0x7f3f401374a0 2021-06-25T04:54:31.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.305+0000 7f3f3effd700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f24055450 0x7f3f24057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.305+0000 7f3f3effd700 1 -- 172.21.15.57:0/4183049622 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3f2806d6f0 con 0x7f3f401374a0 2021-06-25T04:54:31.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.305+0000 7f3f45880700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f24055450 0x7f3f24057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.305+0000 7f3f45880700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f24055450 0x7f3f24057910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f3f3000b000 tx=0x7f3f300091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:31.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.309+0000 7f3f3effd700 1 -- 172.21.15.57:0/4183049622 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3f28043a50 con 0x7f3f401374a0 2021-06-25T04:54:31.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 -- 172.21.15.57:0/4183049622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f40057310 con 0x7f3f401374a0 2021-06-25T04:54:31.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f3effd700 1 -- 172.21.15.57:0/4183049622 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f3f2801a630 con 0x7f3f401374a0 2021-06-25T04:54:31.480 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:31.481 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2942430957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2942430957},{"type":"v1","addr":"172.21.15.87:6835","nonce":2942430957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34},{"gid":6184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/4012056699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4012056699},{"type":"v1","addr":"172.21.15.57:6833","nonce":4012056699}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":35},{"gid":6576,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/1081424967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1081424967},{"type":"v1","addr":"172.21.15.57:6835","nonce":1081424967}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38}],"filesystems":[]} 2021-06-25T04:54:31.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 -- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f24055450 msgr2=0x7f3f24057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f24055450 0x7f3f24057910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f3f3000b000 tx=0x7f3f300091d0).stop 2021-06-25T04:54:31.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 -- 172.21.15.57:0/4183049622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f401374a0 msgr2=0x7f3f40061ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f401374a0 0x7f3f40061ed0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f3f2800b000 tx=0x7f3f400ab0a0).stop 2021-06-25T04:54:31.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 -- 172.21.15.57:0/4183049622 shutdown_connections 2021-06-25T04:54:31.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f24055450 0x7f3f24057910 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f400623c0 0x7f3f40060e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f401374a0 0x7f3f40061ed0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 --2- 172.21.15.57:0/4183049622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f20004e70 0x7f3f40138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 -- 172.21.15.57:0/4183049622 >> 172.21.15.57:0/4183049622 conn(0x7f3f4005c450 msgr2=0x7f3f4013eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:31.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 -- 172.21.15.57:0/4183049622 shutdown_connections 2021-06-25T04:54:31.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.477+0000 7f3f47ae4700 1 -- 172.21.15.57:0/4183049622 wait complete. 2021-06-25T04:54:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2021-06-25T04:54:31.493 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:54:31.494 INFO:tasks.ceph.mds.a:Stopping old one... 2021-06-25T04:54:31.494 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:54:31.494 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:54:31.495 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:54:31.495 INFO:tasks.ceph.mds.c:Stopping old one... 2021-06-25T04:54:31.495 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:54:31.496 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:54:31.496 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:54:31.496 INFO:tasks.ceph.mds.b:Stopping old one... 2021-06-25T04:54:31.496 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:54:31.497 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:54:31.506 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:54:31.507 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:54:31.508 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:54:31.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:54:31.510 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:54:31.510 DEBUG:teuthology.parallel:result is None 2021-06-25T04:54:31.511 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:54:31.512 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:54:31.514 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:54:31.515 DEBUG:teuthology.parallel:result is None 2021-06-25T04:54:31.551 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:54:31.552 DEBUG:teuthology.parallel:result is None 2021-06-25T04:54:31.553 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:54:31.579 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:54:31.595 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:54:31.619 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:54:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f33c2a700 1 Processor -- start 2021-06-25T04:54:31.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f33c2a700 1 -- start start 2021-06-25T04:54:31.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f33c2a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5f2c0b6580 0x7f5f2c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f33c2a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f2c060d30 0x7f5f2c145080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f33c2a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2c0acc50 con 0x7f5f2c0ac5b0 2021-06-25T04:54:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f33c2a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c0aca40 con 0x7f5f2c0b6580 2021-06-25T04:54:31.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f33c2a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c0ae520 con 0x7f5f2c060d30 2021-06-25T04:54:31.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f321c7700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5f2c0ac5b0 0x7f5f2c140fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57316/0 (socket says 172.21.15.57:57316) 2021-06-25T04:54:31.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f321c7700 1 -- 172.21.15.57:0/1075524360 learned_addr learned my addr 172.21.15.57:0/1075524360 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:31.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f311c5700 1 --2- 172.21.15.57:0/1075524360 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f2c060d30 0x7f5f2c145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f319c6700 1 --2- 172.21.15.57:0/1075524360 >> v2:172.21.15.87:3300/0 conn(0x7f5f2c0b6580 0x7f5f2c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f309c4700 1 -- 172.21.15.57:0/1075524360 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117709327 0 0) 0x7f5f2c0acc50 con 0x7f5f2c0ac5b0 2021-06-25T04:54:31.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.653+0000 7f5f309c4700 1 -- 172.21.15.57:0/1075524360 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f14003260 con 0x7f5f2c0ac5b0 2021-06-25T04:54:31.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f311c5700 1 -- 172.21.15.57:0/1075524360 >> v2:172.21.15.87:3300/0 conn(0x7f5f2c0b6580 msgr2=0x7f5f2c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:31.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f311c5700 1 --2- 172.21.15.57:0/1075524360 >> v2:172.21.15.87:3300/0 conn(0x7f5f2c0b6580 0x7f5f2c0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f311c5700 1 -- 172.21.15.57:0/1075524360 >> v1:172.21.15.57:6789/0 conn(0x7f5f2c0ac5b0 legacy=0x7f5f2c140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f311c5700 1 -- 172.21.15.57:0/1075524360 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c1446a0 con 0x7f5f2c060d30 2021-06-25T04:54:31.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f311c5700 1 --2- 172.21.15.57:0/1075524360 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f2c060d30 0x7f5f2c145080 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f5f2c0ad9a0 tx=0x7f5f28006df0).ready entity=mon.2 client_cookie=8c67785888806ea5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:31.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f309c4700 1 -- 172.21.15.57:0/1075524360 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f2800d570 con 0x7f5f2c060d30 2021-06-25T04:54:31.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f309c4700 1 -- 172.21.15.57:0/1075524360 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f28000e90 con 0x7f5f2c060d30 2021-06-25T04:54:31.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f309c4700 1 -- 172.21.15.57:0/1075524360 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f2800d8c0 con 0x7f5f2c060d30 2021-06-25T04:54:31.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f33c2a700 1 -- 172.21.15.57:0/1075524360 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f2c060d30 msgr2=0x7f5f2c145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f33c2a700 1 --2- 172.21.15.57:0/1075524360 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f2c060d30 0x7f5f2c145080 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f5f2c0ad9a0 tx=0x7f5f28006df0).stop 2021-06-25T04:54:31.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f33c2a700 1 -- 172.21.15.57:0/1075524360 shutdown_connections 2021-06-25T04:54:31.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f33c2a700 1 --2- 172.21.15.57:0/1075524360 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f2c060d30 0x7f5f2c145080 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f33c2a700 1 --2- 172.21.15.57:0/1075524360 >> v2:172.21.15.87:3300/0 conn(0x7f5f2c0b6580 0x7f5f2c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f33c2a700 1 -- 172.21.15.57:0/1075524360 >> 172.21.15.57:0/1075524360 conn(0x7f5f2c0b3440 msgr2=0x7f5f2c0b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:31.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f33c2a700 1 -- 172.21.15.57:0/1075524360 shutdown_connections 2021-06-25T04:54:31.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.657+0000 7f5f33c2a700 1 -- 172.21.15.57:0/1075524360 wait complete. 2021-06-25T04:54:31.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f33c2a700 1 Processor -- start 2021-06-25T04:54:31.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f33c2a700 1 -- start start 2021-06-25T04:54:31.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f33c2a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f2c060d30 0x7f5f2c0b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f33c2a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f2c0ac5b0 0x7f5f2c1501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f33c2a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f2c0b6580 0x7f5f2c1506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f33c2a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c141bd0 con 0x7f5f2c060d30 2021-06-25T04:54:31.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f33c2a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c154250 con 0x7f5f2c0b6580 2021-06-25T04:54:31.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f33c2a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c1544f0 con 0x7f5f2c0ac5b0 2021-06-25T04:54:31.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f319c6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f2c060d30 0x7f5f2c0b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f319c6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f2c060d30 0x7f5f2c0b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40100/0 (socket says 172.21.15.57:40100) 2021-06-25T04:54:31.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f319c6700 1 -- 172.21.15.57:0/681441006 learned_addr learned my addr 172.21.15.57:0/681441006 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:31.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f311c5700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f2c0ac5b0 0x7f5f2c1501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f321c7700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f2c0b6580 0x7f5f2c1506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f319c6700 1 -- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f2c0ac5b0 msgr2=0x7f5f2c1501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f319c6700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f2c0ac5b0 0x7f5f2c1501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f319c6700 1 -- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f2c0b6580 msgr2=0x7f5f2c1506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:31.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f319c6700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f2c0b6580 0x7f5f2c1506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:31.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f319c6700 1 -- 172.21.15.57:0/681441006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2800b180 con 0x7f5f2c060d30 2021-06-25T04:54:31.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f319c6700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f2c060d30 0x7f5f2c0b54d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f5f1c00c000 tx=0x7f5f1c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:31.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f1affd700 1 -- 172.21.15.57:0/681441006 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f1c011750 con 0x7f5f2c060d30 2021-06-25T04:54:31.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f1affd700 1 -- 172.21.15.57:0/681441006 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c0118b0 con 0x7f5f2c060d30 2021-06-25T04:54:31.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f33c2a700 1 -- 172.21.15.57:0/681441006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c0ae750 con 0x7f5f2c060d30 2021-06-25T04:54:31.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f1affd700 1 -- 172.21.15.57:0/681441006 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f1c011c10 con 0x7f5f2c060d30 2021-06-25T04:54:31.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.661+0000 7f5f33c2a700 1 -- 172.21.15.57:0/681441006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c150bc0 con 0x7f5f2c060d30 2021-06-25T04:54:31.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.665+0000 7f5f33c2a700 1 -- 172.21.15.57:0/681441006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c057310 con 0x7f5f2c060d30 2021-06-25T04:54:31.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.665+0000 7f5f1affd700 1 -- 172.21.15.57:0/681441006 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5f1c011d70 con 0x7f5f2c060d30 2021-06-25T04:54:31.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.665+0000 7f5f1affd700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f0c0554e0 0x7f5f0c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:31.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.665+0000 7f5f1affd700 1 -- 172.21.15.57:0/681441006 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f5f1c06e0f0 con 0x7f5f2c060d30 2021-06-25T04:54:31.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.665+0000 7f5f311c5700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f0c0554e0 0x7f5f0c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:31.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.665+0000 7f5f311c5700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f0c0554e0 0x7f5f0c0579a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f5f28019000 tx=0x7f5f28014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:31.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.669+0000 7f5f1affd700 1 -- 172.21.15.57:0/681441006 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5f1c0444b0 con 0x7f5f2c060d30 2021-06-25T04:54:31.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:31.805+0000 7f5f33c2a700 1 -- 172.21.15.57:0/681441006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f5f2c0b6360 con 0x7f5f2c060d30 2021-06-25T04:54:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.641+0000 7f5f1affd700 1 -- 172.21.15.57:0/681441006 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v84) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5f1c047ad0 con 0x7f5f2c060d30 2021-06-25T04:54:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 -- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f0c0554e0 msgr2=0x7f5f0c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f0c0554e0 0x7f5f0c0579a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f5f28019000 tx=0x7f5f28014000).stop 2021-06-25T04:54:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 -- 172.21.15.57:0/681441006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f2c060d30 msgr2=0x7f5f2c0b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f2c060d30 0x7f5f2c0b54d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f5f1c00c000 tx=0x7f5f1c006df0).stop 2021-06-25T04:54:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 -- 172.21.15.57:0/681441006 shutdown_connections 2021-06-25T04:54:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f0c0554e0 0x7f5f0c0579a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f2c0b6580 0x7f5f2c1506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f2c0ac5b0 0x7f5f2c1501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:32.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 --2- 172.21.15.57:0/681441006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f2c060d30 0x7f5f2c0b54d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:32.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 -- 172.21.15.57:0/681441006 >> 172.21.15.57:0/681441006 conn(0x7f5f2c0b3440 msgr2=0x7f5f2c13aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:32.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 -- 172.21.15.57:0/681441006 shutdown_connections 2021-06-25T04:54:32.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.645+0000 7f5f33c2a700 1 -- 172.21.15.57:0/681441006 wait complete. 2021-06-25T04:54:32.651 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:54:32.663 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:54:32.664 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:54:32.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.769+0000 7f71cbb34700 1 Processor -- start 2021-06-25T04:54:32.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.769+0000 7f71cbb34700 1 -- start start 2021-06-25T04:54:32.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.769+0000 7f71cbb34700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4141b00 0x7f71c414cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:32.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.769+0000 7f71cbb34700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40b3190 con 0x7f71c40b1130 2021-06-25T04:54:32.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.769+0000 7f71cbb34700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40b7bb0 con 0x7f71c40b77d0 2021-06-25T04:54:32.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.769+0000 7f71cbb34700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4067580 con 0x7f71c4141b00 2021-06-25T04:54:32.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.769+0000 7f71c90cf700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f71c40b1130 0x7f71c41413f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57332/0 (socket says 172.21.15.57:57332) 2021-06-25T04:54:32.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.769+0000 7f71c90cf700 1 -- 172.21.15.57:0/3620115138 learned_addr learned my addr 172.21.15.57:0/3620115138 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:32.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.769+0000 7f71ca0d1700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4141b00 0x7f71c414cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:32.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508338105 0 0) 0x7f71c40b3190 con 0x7f71c40b1130 2021-06-25T04:54:32.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71ac003260 con 0x7f71c40b1130 2021-06-25T04:54:32.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193282523 0 0) 0x7f71c40b7bb0 con 0x7f71c40b77d0 2021-06-25T04:54:32.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c40b3190 con 0x7f71c40b77d0 2021-06-25T04:54:32.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718757310 0 0) 0x7f71ac003260 con 0x7f71c40b1130 2021-06-25T04:54:32.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4141b00 msgr2=0x7f71c414cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:32.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4141b00 0x7f71c414cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:32.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 >> v1:172.21.15.87:6789/0 conn(0x7f71c40b77d0 legacy=0x7f71c4144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:32.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40aae30 con 0x7f71c40b1130 2021-06-25T04:54:32.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f71c0001660 con 0x7f71c40b1130 2021-06-25T04:54:32.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71ca0d1700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4141b00 0x7f71c414cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:32.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 >> v1:172.21.15.57:6789/0 conn(0x7f71c40b1130 legacy=0x7f71c41413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:32.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71ac003910 0x7f71ac003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:32.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4141b00 0x7f71ac004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:32.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac0049f0 0x7f71ac004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:32.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4067580 con 0x7f71ac003910 2021-06-25T04:54:32.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac00b750 con 0x7f71ac0049f0 2021-06-25T04:54:32.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac00b910 con 0x7f71c4141b00 2021-06-25T04:54:32.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c98d0700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71ac003910 0x7f71ac003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:32.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c90cf700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4141b00 0x7f71ac004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:32.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71ca0d1700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac0049f0 0x7f71ac004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:32.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c90cf700 1 -- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac0049f0 msgr2=0x7f71ac004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:32.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c90cf700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac0049f0 0x7f71ac004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:32.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c90cf700 1 -- 172.21.15.57:0/3620115138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71ac003910 msgr2=0x7f71ac003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:32.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c90cf700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71ac003910 0x7f71ac003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:32.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c90cf700 1 -- 172.21.15.57:0/3620115138 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc009470 con 0x7f71c4141b00 2021-06-25T04:54:32.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c90cf700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4141b00 0x7f71ac004500 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f71ac004470 tx=0x7f71c4066a20).ready entity=mon.2 client_cookie=b96fcbc3cf98fe0f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:32.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c00070d0 con 0x7f71c4141b00 2021-06-25T04:54:32.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c0007230 con 0x7f71c4141b00 2021-06-25T04:54:32.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71c88ce700 1 -- 172.21.15.57:0/3620115138 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c000c8b0 con 0x7f71c4141b00 2021-06-25T04:54:32.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71cbb34700 1 -- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4141b00 msgr2=0x7f71ac004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:32.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71cbb34700 1 --2- 172.21.15.57:0/3620115138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4141b00 0x7f71ac004500 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f71ac004470 tx=0x7f71c4066a20).stop 2021-06-25T04:54:32.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71ca0d1700 1 -- 172.21.15.57:0/3620115138 reap_dead start 2021-06-25T04:54:32.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71cbb34700 1 -- 172.21.15.57:0/3620115138 shutdown_connections 2021-06-25T04:54:32.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.773+0000 7f71cbb34700 1 -- 172.21.15.57:0/3620115138 >> 172.21.15.57:0/3620115138 conn(0x7f71c405f670 msgr2=0x7f71c405fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:32.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71cbb34700 1 -- 172.21.15.57:0/3620115138 shutdown_connections 2021-06-25T04:54:32.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71cbb34700 1 -- 172.21.15.57:0/3620115138 wait complete. 2021-06-25T04:54:32.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71cbb34700 1 Processor -- start 2021-06-25T04:54:32.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71cbb34700 1 -- start start 2021-06-25T04:54:32.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71cbb34700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4144550 0x7f71c409f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71cbb34700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c40a0590 0x7f71c409fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71cbb34700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c40623f0 0x7f71c40a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71cbb34700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40a0370 con 0x7f71c40a0590 2021-06-25T04:54:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71cbb34700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4144930 con 0x7f71c40623f0 2021-06-25T04:54:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71cbb34700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40a1cc0 con 0x7f71c4144550 2021-06-25T04:54:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71c90cf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c40a0590 0x7f71c409fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71ca0d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c40623f0 0x7f71c40a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71c98d0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4144550 0x7f71c409f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71ca0d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c40623f0 0x7f71c40a9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:48620/0 (socket says 172.21.15.57:48620) 2021-06-25T04:54:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71ca0d1700 1 -- 172.21.15.57:0/304775228 learned_addr learned my addr 172.21.15.57:0/304775228 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.777+0000 7f71c90cf700 1 -- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4144550 msgr2=0x7f71c409f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71c90cf700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4144550 0x7f71c409f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71c90cf700 1 -- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c40623f0 msgr2=0x7f71c40a9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71c90cf700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c40623f0 0x7f71c40a9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:32.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71c90cf700 1 -- 172.21.15.57:0/304775228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40a1f60 con 0x7f71c40a0590 2021-06-25T04:54:32.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71c98d0700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4144550 0x7f71c409f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:32.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71ca0d1700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c40623f0 0x7f71c40a9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71c90cf700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c40a0590 0x7f71c409fe80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f71ac004470 tx=0x7f71c0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71b2ffd700 1 -- 172.21.15.57:0/304775228 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c000caa0 con 0x7f71c40a0590 2021-06-25T04:54:32.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71b2ffd700 1 -- 172.21.15.57:0/304775228 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c000cc00 con 0x7f71c40a0590 2021-06-25T04:54:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71cbb34700 1 -- 172.21.15.57:0/304775228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c40a2200 con 0x7f71c40a0590 2021-06-25T04:54:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71b2ffd700 1 -- 172.21.15.57:0/304775228 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c0001bb0 con 0x7f71c40a0590 2021-06-25T04:54:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71cbb34700 1 -- 172.21.15.57:0/304775228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c40a2740 con 0x7f71c40a0590 2021-06-25T04:54:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71cbb34700 1 -- 172.21.15.57:0/304775228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c4057310 con 0x7f71c40a0590 2021-06-25T04:54:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.781+0000 7f71b2ffd700 1 -- 172.21.15.57:0/304775228 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f71c0026070 con 0x7f71c40a0590 2021-06-25T04:54:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.785+0000 7f71b2ffd700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71a4055340 0x7f71a4057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.785+0000 7f71b2ffd700 1 -- 172.21.15.57:0/304775228 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f71c006dce0 con 0x7f71c40a0590 2021-06-25T04:54:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.785+0000 7f71c98d0700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71a4055340 0x7f71a4057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.785+0000 7f71c98d0700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71a4055340 0x7f71a4057800 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f71b4003000 tx=0x7f71b4007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:32.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.789+0000 7f71b2ffd700 1 -- 172.21.15.57:0/304775228 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f71c00441d0 con 0x7f71c40a0590 2021-06-25T04:54:32.962 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 -- 172.21.15.57:0/304775228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f71c40698a0 con 0x7f71c40a0590 2021-06-25T04:54:32.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71b2ffd700 1 -- 172.21.15.57:0/304775228 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f71c00477f0 con 0x7f71c40a0590 2021-06-25T04:54:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:32.964 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:54:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:54:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:54:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:54:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:54:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:54:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:54:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:54:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:54:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:54:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:54:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:54:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:54:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:54:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:54:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:54:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:54:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:54:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:54:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:54:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:54:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:54:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:54:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:54:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:54:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:54:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:54:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:54:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:54:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:54:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:54:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:54:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:54:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:54:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:54:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:54:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:54:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:54:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:54:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:54:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:54:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:54:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:54:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:54:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:54:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:54:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:54:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:54:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:32.997 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:54:33.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 -- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71a4055340 msgr2=0x7f71a4057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71a4055340 0x7f71a4057800 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f71b4003000 tx=0x7f71b4007a00).stop 2021-06-25T04:54:33.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 -- 172.21.15.57:0/304775228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c40a0590 msgr2=0x7f71c409fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c40a0590 0x7f71c409fe80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f71ac004470 tx=0x7f71c0015000).stop 2021-06-25T04:54:33.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 -- 172.21.15.57:0/304775228 shutdown_connections 2021-06-25T04:54:33.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71a4055340 0x7f71a4057800 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c40623f0 0x7f71c40a9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c40a0590 0x7f71c409fe80 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 --2- 172.21.15.57:0/304775228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c4144550 0x7f71c409f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 -- 172.21.15.57:0/304775228 >> 172.21.15.57:0/304775228 conn(0x7f71c405f670 msgr2=0x7f71c40b6020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:33.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 -- 172.21.15.57:0/304775228 shutdown_connections 2021-06-25T04:54:33.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:32.961+0000 7f71cbb34700 1 -- 172.21.15.57:0/304775228 wait complete. 2021-06-25T04:54:33.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:54:33.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104e677700 1 Processor -- start 2021-06-25T04:54:33.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104e677700 1 -- start start 2021-06-25T04:54:33.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104e677700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 0x7f104814b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104e677700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10480b35e0 con 0x7f10480b1800 2021-06-25T04:54:33.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104e677700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10481436b0 con 0x7f10480b3200 2021-06-25T04:54:33.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104e677700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1048065c60 con 0x7f10480b0e30 2021-06-25T04:54:33.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f10477fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f10480b1800 0x7f1048142850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57352/0 (socket says 172.21.15.57:57352) 2021-06-25T04:54:33.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f10477fe700 1 -- 172.21.15.57:0/970416824 learned_addr learned my addr 172.21.15.57:0/970416824 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:33.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104cc14700 1 --2- 172.21.15.57:0/970416824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 0x7f104814b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f1046ffd700 1 -- 172.21.15.57:0/970416824 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372004740 0 0) 0x7f10480b35e0 con 0x7f10480b1800 2021-06-25T04:54:33.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f1046ffd700 1 -- 172.21.15.57:0/970416824 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1034003260 con 0x7f10480b1800 2021-06-25T04:54:33.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f1046ffd700 1 -- 172.21.15.57:0/970416824 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787868514 0 0) 0x7f10481436b0 con 0x7f10480b3200 2021-06-25T04:54:33.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f1046ffd700 1 -- 172.21.15.57:0/970416824 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10480b35e0 con 0x7f10480b3200 2021-06-25T04:54:33.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104cc14700 1 -- 172.21.15.57:0/970416824 >> v1:172.21.15.87:6789/0 conn(0x7f10480b3200 legacy=0x7f1048066640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104cc14700 1 -- 172.21.15.57:0/970416824 >> v1:172.21.15.57:6789/0 conn(0x7f10480b1800 legacy=0x7f1048142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104cc14700 1 -- 172.21.15.57:0/970416824 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1048065f00 con 0x7f10480b0e30 2021-06-25T04:54:33.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104cc14700 1 --2- 172.21.15.57:0/970416824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 0x7f104814b6f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f10400032f0 tx=0x7f10400091d0).ready entity=mon.2 client_cookie=e1ad6c68fa9ecafa server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f1046ffd700 1 -- 172.21.15.57:0/970416824 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f104000b640 con 0x7f10480b0e30 2021-06-25T04:54:33.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f1046ffd700 1 -- 172.21.15.57:0/970416824 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104000b7a0 con 0x7f10480b0e30 2021-06-25T04:54:33.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f1046ffd700 1 -- 172.21.15.57:0/970416824 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f104000b910 con 0x7f10480b0e30 2021-06-25T04:54:33.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104e677700 1 -- 172.21.15.57:0/970416824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 msgr2=0x7f104814b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.109+0000 7f104e677700 1 --2- 172.21.15.57:0/970416824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 0x7f104814b6f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f10400032f0 tx=0x7f10400091d0).stop 2021-06-25T04:54:33.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 -- 172.21.15.57:0/970416824 shutdown_connections 2021-06-25T04:54:33.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 --2- 172.21.15.57:0/970416824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 0x7f104814b6f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 -- 172.21.15.57:0/970416824 >> 172.21.15.57:0/970416824 conn(0x7f104805c450 msgr2=0x7f104805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:33.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 -- 172.21.15.57:0/970416824 shutdown_connections 2021-06-25T04:54:33.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 -- 172.21.15.57:0/970416824 wait complete. 2021-06-25T04:54:33.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 Processor -- start 2021-06-25T04:54:33.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 -- start start 2021-06-25T04:54:33.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 0x7f1048060eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10480b1800 0x7f10480a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10480b3200 0x7f1048152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1048155db0 con 0x7f10480b1800 2021-06-25T04:54:33.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10480b0360 con 0x7f10480b3200 2021-06-25T04:54:33.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104e677700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10480ab710 con 0x7f10480b0e30 2021-06-25T04:54:33.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f10477fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10480b1800 0x7f10480a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f10477fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10480b1800 0x7f10480a2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40140/0 (socket says 172.21.15.57:40140) 2021-06-25T04:54:33.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f1047fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 0x7f1048060eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f104cc14700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10480b3200 0x7f1048152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.113+0000 7f10477fe700 1 -- 172.21.15.57:0/1396599482 learned_addr learned my addr 172.21.15.57:0/1396599482 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:33.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f1047fff700 1 -- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10480b3200 msgr2=0x7f1048152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f1047fff700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10480b3200 0x7f1048152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f1047fff700 1 -- 172.21.15.57:0/1396599482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10480b1800 msgr2=0x7f10480a2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f1047fff700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10480b1800 0x7f10480a2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f1047fff700 1 -- 172.21.15.57:0/1396599482 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1040009470 con 0x7f10480b0e30 2021-06-25T04:54:33.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f1047fff700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 0x7f1048060eb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f10480aba20 tx=0x7f103c007a20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f10457fa700 1 -- 172.21.15.57:0/1396599482 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f103c00cd40 con 0x7f10480b0e30 2021-06-25T04:54:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f10457fa700 1 -- 172.21.15.57:0/1396599482 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103c012400 con 0x7f10480b0e30 2021-06-25T04:54:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f104e677700 1 -- 172.21.15.57:0/1396599482 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10480a9dc0 con 0x7f10480b0e30 2021-06-25T04:54:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f10457fa700 1 -- 172.21.15.57:0/1396599482 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f103c00cea0 con 0x7f10480b0e30 2021-06-25T04:54:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f104e677700 1 -- 172.21.15.57:0/1396599482 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10480a3170 con 0x7f10480b0e30 2021-06-25T04:54:33.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f104e677700 1 -- 172.21.15.57:0/1396599482 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1048057310 con 0x7f10480b0e30 2021-06-25T04:54:33.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f10457fa700 1 -- 172.21.15.57:0/1396599482 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f103c019030 con 0x7f10480b0e30 2021-06-25T04:54:33.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f10457fa700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1028055340 0x7f1028057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.117+0000 7f10457fa700 1 -- 172.21.15.57:0/1396599482 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f103c06ce90 con 0x7f10480b0e30 2021-06-25T04:54:33.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.121+0000 7f10477fe700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1028055340 0x7f1028057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.121+0000 7f10477fe700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1028055340 0x7f1028057800 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f103800d000 tx=0x7f1038009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.129+0000 7f10457fa700 1 -- 172.21.15.57:0/1396599482 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f103c043270 con 0x7f10480b0e30 2021-06-25T04:54:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.261+0000 7f104e677700 1 -- 172.21.15.57:0/1396599482 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f104805d720 con 0x7f10480b0e30 2021-06-25T04:54:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f10457fa700 1 -- 172.21.15.57:0/1396599482 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f103c06e090 con 0x7f10480b0e30 2021-06-25T04:54:33.267 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:33.267 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":84,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:32.634258+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:54:33.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 -- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1028055340 msgr2=0x7f1028057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1028055340 0x7f1028057800 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f103800d000 tx=0x7f1038009040).stop 2021-06-25T04:54:33.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 -- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 msgr2=0x7f1048060eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 0x7f1048060eb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f10480aba20 tx=0x7f103c007a20).stop 2021-06-25T04:54:33.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 -- 172.21.15.57:0/1396599482 shutdown_connections 2021-06-25T04:54:33.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1028055340 0x7f1028057800 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10480b3200 0x7f1048152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10480b1800 0x7f10480a2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 --2- 172.21.15.57:0/1396599482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10480b0e30 0x7f1048060eb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 -- 172.21.15.57:0/1396599482 >> 172.21.15.57:0/1396599482 conn(0x7f104805c450 msgr2=0x7f1048066560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 -- 172.21.15.57:0/1396599482 shutdown_connections 2021-06-25T04:54:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.265+0000 7f104e677700 1 -- 172.21.15.57:0/1396599482 wait complete. 2021-06-25T04:54:33.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:54:33.288 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:54:33.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461b445700 1 Processor -- start 2021-06-25T04:54:33.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461b445700 1 -- start start 2021-06-25T04:54:33.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461b445700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f46140b3000 0x7f4614065e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461b445700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4614066e60 con 0x7f46140a9bd0 2021-06-25T04:54:33.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461b445700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46140b33e0 con 0x7f4614140100 2021-06-25T04:54:33.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461b445700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46140648a0 con 0x7f46140b3000 2021-06-25T04:54:33.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f4619c42700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f46140a9bd0 0x7f4614060780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57364/0 (socket says 172.21.15.57:57364) 2021-06-25T04:54:33.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f4619c42700 1 -- 172.21.15.57:0/2210818702 learned_addr learned my addr 172.21.15.57:0/2210818702 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:33.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461a443700 1 --2- 172.21.15.57:0/2210818702 >> v2:172.21.15.57:3300/0 conn(0x7f46140b3000 0x7f4614065e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f4619441700 1 -- 172.21.15.57:0/2210818702 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284815011 0 0) 0x7f4614066e60 con 0x7f46140a9bd0 2021-06-25T04:54:33.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f4619441700 1 -- 172.21.15.57:0/2210818702 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45fc003260 con 0x7f46140a9bd0 2021-06-25T04:54:33.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461a443700 1 -- 172.21.15.57:0/2210818702 >> v1:172.21.15.87:6789/0 conn(0x7f4614140100 legacy=0x7f4614140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461a443700 1 -- 172.21.15.57:0/2210818702 >> v1:172.21.15.57:6789/0 conn(0x7f46140a9bd0 legacy=0x7f4614060780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461a443700 1 -- 172.21.15.57:0/2210818702 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614066920 con 0x7f46140b3000 2021-06-25T04:54:33.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461a443700 1 --2- 172.21.15.57:0/2210818702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46140b3000 0x7f4614065e50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f4610002f70 tx=0x7f4610006df0).ready entity=mon.0 client_cookie=d142f3f640350fe5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f4619441700 1 -- 172.21.15.57:0/2210818702 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f461000d610 con 0x7f46140b3000 2021-06-25T04:54:33.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f4619441700 1 -- 172.21.15.57:0/2210818702 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610000e90 con 0x7f46140b3000 2021-06-25T04:54:33.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f4619441700 1 -- 172.21.15.57:0/2210818702 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f461000d960 con 0x7f46140b3000 2021-06-25T04:54:33.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461b445700 1 -- 172.21.15.57:0/2210818702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46140b3000 msgr2=0x7f4614065e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.385+0000 7f461b445700 1 --2- 172.21.15.57:0/2210818702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46140b3000 0x7f4614065e50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f4610002f70 tx=0x7f4610006df0).stop 2021-06-25T04:54:33.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.389+0000 7f461b445700 1 -- 172.21.15.57:0/2210818702 shutdown_connections 2021-06-25T04:54:33.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.389+0000 7f461b445700 1 --2- 172.21.15.57:0/2210818702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46140b3000 0x7f4614065e50 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.389+0000 7f461b445700 1 -- 172.21.15.57:0/2210818702 >> 172.21.15.57:0/2210818702 conn(0x7f46140636a0 msgr2=0x7f4614063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:33.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.389+0000 7f461b445700 1 -- 172.21.15.57:0/2210818702 shutdown_connections 2021-06-25T04:54:33.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.389+0000 7f461b445700 1 -- 172.21.15.57:0/2210818702 wait complete. 2021-06-25T04:54:33.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.389+0000 7f461b445700 1 Processor -- start 2021-06-25T04:54:33.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.389+0000 7f461b445700 1 -- start start 2021-06-25T04:54:33.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461b445700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46140a9bd0 0x7f46141468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461b445700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46140b3000 0x7f4614141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461b445700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4614140100 0x7f4614141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461b445700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4614138620 con 0x7f46140a9bd0 2021-06-25T04:54:33.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461b445700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4614138bc0 con 0x7f46140b3000 2021-06-25T04:54:33.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461b445700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4614138e60 con 0x7f4614140100 2021-06-25T04:54:33.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461a443700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46140a9bd0 0x7f46141468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461a443700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46140a9bd0 0x7f46141468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40152/0 (socket says 172.21.15.57:40152) 2021-06-25T04:54:33.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461a443700 1 -- 172.21.15.57:0/1228900289 learned_addr learned my addr 172.21.15.57:0/1228900289 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:33.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f4619c42700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46140b3000 0x7f4614141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461ac44700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4614140100 0x7f4614141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461a443700 1 -- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4614140100 msgr2=0x7f4614141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461a443700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4614140100 0x7f4614141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461a443700 1 -- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46140b3000 msgr2=0x7f4614141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461a443700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46140b3000 0x7f4614141130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461a443700 1 -- 172.21.15.57:0/1228900289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461000b180 con 0x7f46140a9bd0 2021-06-25T04:54:33.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461a443700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46140a9bd0 0x7f46141468b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f4610002f70 tx=0x7f4610014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f46037fe700 1 -- 172.21.15.57:0/1228900289 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f461000d290 con 0x7f46140a9bd0 2021-06-25T04:54:33.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f46037fe700 1 -- 172.21.15.57:0/1228900289 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461000de90 con 0x7f46140a9bd0 2021-06-25T04:54:33.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461b445700 1 -- 172.21.15.57:0/1228900289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46141399d0 con 0x7f46140a9bd0 2021-06-25T04:54:33.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f46037fe700 1 -- 172.21.15.57:0/1228900289 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f461001f670 con 0x7f46140a9bd0 2021-06-25T04:54:33.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461b445700 1 -- 172.21.15.57:0/1228900289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4614144000 con 0x7f46140a9bd0 2021-06-25T04:54:33.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f461b445700 1 -- 172.21.15.57:0/1228900289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4614139020 con 0x7f46140a9bd0 2021-06-25T04:54:33.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.393+0000 7f46037fe700 1 -- 172.21.15.57:0/1228900289 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f461000f030 con 0x7f46140a9bd0 2021-06-25T04:54:33.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.397+0000 7f46037fe700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45f4055450 0x7f45f4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.397+0000 7f46037fe700 1 -- 172.21.15.57:0/1228900289 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f461006eaa0 con 0x7f46140a9bd0 2021-06-25T04:54:33.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.397+0000 7f4619c42700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45f4055450 0x7f45f4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.397+0000 7f4619c42700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45f4055450 0x7f45f4057910 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f460400d000 tx=0x7f4604009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.401+0000 7f46037fe700 1 -- 172.21.15.57:0/1228900289 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4610045040 con 0x7f46140a9bd0 2021-06-25T04:54:33.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f461b445700 1 -- 172.21.15.57:0/1228900289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4614057310 con 0x7f46140a9bd0 2021-06-25T04:54:33.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f46037fe700 1 -- 172.21.15.57:0/1228900289 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v84) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4610048660 con 0x7f46140a9bd0 2021-06-25T04:54:33.532 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:54:33.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f461b445700 1 -- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45f4055450 msgr2=0x7f45f4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f461b445700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45f4055450 0x7f45f4057910 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f460400d000 tx=0x7f4604009040).stop 2021-06-25T04:54:33.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f461b445700 1 -- 172.21.15.57:0/1228900289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46140a9bd0 msgr2=0x7f46141468b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f461b445700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46140a9bd0 0x7f46141468b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f4610002f70 tx=0x7f4610014000).stop 2021-06-25T04:54:33.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f461b445700 1 -- 172.21.15.57:0/1228900289 shutdown_connections 2021-06-25T04:54:33.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f461b445700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45f4055450 0x7f45f4057910 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f461b445700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4614140100 0x7f4614141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f461b445700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46140b3000 0x7f4614141130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f461b445700 1 --2- 172.21.15.57:0/1228900289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46140a9bd0 0x7f46141468b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.529+0000 7f461b445700 1 -- 172.21.15.57:0/1228900289 >> 172.21.15.57:0/1228900289 conn(0x7f46140636a0 msgr2=0x7f4614063a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:33.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.533+0000 7f461b445700 1 -- 172.21.15.57:0/1228900289 shutdown_connections 2021-06-25T04:54:33.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.533+0000 7f461b445700 1 -- 172.21.15.57:0/1228900289 wait complete. 2021-06-25T04:54:33.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:54:33.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a9a19700 1 Processor -- start 2021-06-25T04:54:33.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a9a19700 1 -- start start 2021-06-25T04:54:33.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a9a19700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f30a40b1e80 0x7f30a40b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a9a19700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30a40aff70 0x7f30a40b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a9a19700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f30a40a7080 0x7f30a4141210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a9a19700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40b03e0 con 0x7f30a40a7080 2021-06-25T04:54:33.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a9a19700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40b2750 con 0x7f30a40b1e80 2021-06-25T04:54:33.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a9a19700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40b0610 con 0x7f30a40aff70 2021-06-25T04:54:33.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a37fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f30a40a7080 0x7f30a4141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a37fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f30a40a7080 0x7f30a4141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40164/0 (socket says 172.21.15.57:40164) 2021-06-25T04:54:33.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a37fe700 1 -- 172.21.15.57:0/1864212513 learned_addr learned my addr 172.21.15.57:0/1864212513 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:33.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a27fc700 1 --2- 172.21.15.57:0/1864212513 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30a40aff70 0x7f30a40b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a2ffd700 1 --2- 172.21.15.57:0/1864212513 >> v2:172.21.15.87:3300/0 conn(0x7f30a40b1e80 0x7f30a40b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a37fe700 1 -- 172.21.15.57:0/1864212513 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30a40aff70 msgr2=0x7f30a40b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a37fe700 1 --2- 172.21.15.57:0/1864212513 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30a40aff70 0x7f30a40b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a37fe700 1 -- 172.21.15.57:0/1864212513 >> v2:172.21.15.87:3300/0 conn(0x7f30a40b1e80 msgr2=0x7f30a40b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a37fe700 1 --2- 172.21.15.57:0/1864212513 >> v2:172.21.15.87:3300/0 conn(0x7f30a40b1e80 0x7f30a40b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a37fe700 1 -- 172.21.15.57:0/1864212513 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a40b08b0 con 0x7f30a40a7080 2021-06-25T04:54:33.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a37fe700 1 --2- 172.21.15.57:0/1864212513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30a40a7080 0x7f30a4141210 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f309c002f70 tx=0x7f309c006eb0).ready entity=mon.0 client_cookie=f948331301054e54 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a1ffb700 1 -- 172.21.15.57:0/1864212513 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f309c00d570 con 0x7f30a40a7080 2021-06-25T04:54:33.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a1ffb700 1 -- 172.21.15.57:0/1864212513 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c000e90 con 0x7f30a40a7080 2021-06-25T04:54:33.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a1ffb700 1 -- 172.21.15.57:0/1864212513 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f309c00d900 con 0x7f30a40a7080 2021-06-25T04:54:33.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a9a19700 1 -- 172.21.15.57:0/1864212513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30a40a7080 msgr2=0x7f30a4141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.653+0000 7f30a9a19700 1 --2- 172.21.15.57:0/1864212513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30a40a7080 0x7f30a4141210 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f309c002f70 tx=0x7f309c006eb0).stop 2021-06-25T04:54:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.657+0000 7f30a9a19700 1 -- 172.21.15.57:0/1864212513 shutdown_connections 2021-06-25T04:54:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.657+0000 7f30a9a19700 1 --2- 172.21.15.57:0/1864212513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30a40a7080 0x7f30a4141210 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.657+0000 7f30a9a19700 1 --2- 172.21.15.57:0/1864212513 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30a40aff70 0x7f30a40b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.657+0000 7f30a9a19700 1 --2- 172.21.15.57:0/1864212513 >> v2:172.21.15.87:3300/0 conn(0x7f30a40b1e80 0x7f30a40b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.657+0000 7f30a9a19700 1 -- 172.21.15.57:0/1864212513 >> 172.21.15.57:0/1864212513 conn(0x7f30a405f670 msgr2=0x7f30a405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.657+0000 7f30a9a19700 1 -- 172.21.15.57:0/1864212513 shutdown_connections 2021-06-25T04:54:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.657+0000 7f30a9a19700 1 -- 172.21.15.57:0/1864212513 wait complete. 2021-06-25T04:54:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.657+0000 7f30a9a19700 1 Processor -- start 2021-06-25T04:54:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.657+0000 7f30a9a19700 1 -- start start 2021-06-25T04:54:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a9a19700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30a40a7080 0x7f30a414a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a9a19700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a40aff70 0x7f30a40b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a9a19700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30a40b1e80 0x7f30a40b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a9a19700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a414b850 con 0x7f30a40a7080 2021-06-25T04:54:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a9a19700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a414ba50 con 0x7f30a40aff70 2021-06-25T04:54:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a9a19700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4149940 con 0x7f30a40b1e80 2021-06-25T04:54:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30a40a7080 0x7f30a414a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30a40a7080 0x7f30a414a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40168/0 (socket says 172.21.15.57:40168) 2021-06-25T04:54:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a2ffd700 1 -- 172.21.15.57:0/2033458835 learned_addr learned my addr 172.21.15.57:0/2033458835 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a27fc700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a40aff70 0x7f30a40b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a37fe700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30a40b1e80 0x7f30a40b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a2ffd700 1 -- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30a40b1e80 msgr2=0x7f30a40b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a2ffd700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30a40b1e80 0x7f30a40b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a2ffd700 1 -- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a40aff70 msgr2=0x7f30a40b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a2ffd700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a40aff70 0x7f30a40b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a2ffd700 1 -- 172.21.15.57:0/2033458835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c00b1e0 con 0x7f30a40a7080 2021-06-25T04:54:33.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a2ffd700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30a40a7080 0x7f30a414a350 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f309400c000 tx=0x7f3094006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f3093fff700 1 -- 172.21.15.57:0/2033458835 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3094011750 con 0x7f30a40a7080 2021-06-25T04:54:33.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f3093fff700 1 -- 172.21.15.57:0/2033458835 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30940118b0 con 0x7f30a40a7080 2021-06-25T04:54:33.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a9a19700 1 -- 172.21.15.57:0/2033458835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a4149be0 con 0x7f30a40a7080 2021-06-25T04:54:33.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f3093fff700 1 -- 172.21.15.57:0/2033458835 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3094011c10 con 0x7f30a40a7080 2021-06-25T04:54:33.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a9a19700 1 -- 172.21.15.57:0/2033458835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a40b59a0 con 0x7f30a40a7080 2021-06-25T04:54:33.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.661+0000 7f30a9a19700 1 -- 172.21.15.57:0/2033458835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a4148c90 con 0x7f30a40a7080 2021-06-25T04:54:33.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.665+0000 7f3093fff700 1 -- 172.21.15.57:0/2033458835 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3094011d70 con 0x7f30a40a7080 2021-06-25T04:54:33.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.665+0000 7f3093fff700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3080055340 0x7f3080057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.665+0000 7f3093fff700 1 -- 172.21.15.57:0/2033458835 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f309406dfb0 con 0x7f30a40a7080 2021-06-25T04:54:33.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.665+0000 7f30a27fc700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3080055340 0x7f3080057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.665+0000 7f30a27fc700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3080055340 0x7f3080057800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f309800b000 tx=0x7f30980091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.669+0000 7f3093fff700 1 -- 172.21.15.57:0/2033458835 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3094044440 con 0x7f30a40a7080 2021-06-25T04:54:33.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.793+0000 7f30a9a19700 1 -- 172.21.15.57:0/2033458835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30a414a120 con 0x7f30a40a7080 2021-06-25T04:54:33.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.793+0000 7f3093fff700 1 -- 172.21.15.57:0/2033458835 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3094047a60 con 0x7f30a40a7080 2021-06-25T04:54:33.797 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:54:33.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 -- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3080055340 msgr2=0x7f3080057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3080055340 0x7f3080057800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f309800b000 tx=0x7f30980091d0).stop 2021-06-25T04:54:33.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 -- 172.21.15.57:0/2033458835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30a40a7080 msgr2=0x7f30a414a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30a40a7080 0x7f30a414a350 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f309400c000 tx=0x7f3094006df0).stop 2021-06-25T04:54:33.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 -- 172.21.15.57:0/2033458835 shutdown_connections 2021-06-25T04:54:33.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3080055340 0x7f3080057800 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30a40b1e80 0x7f30a40b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a40aff70 0x7f30a40b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 --2- 172.21.15.57:0/2033458835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30a40a7080 0x7f30a414a350 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 -- 172.21.15.57:0/2033458835 >> 172.21.15.57:0/2033458835 conn(0x7f30a405f670 msgr2=0x7f30a4146f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:33.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 -- 172.21.15.57:0/2033458835 shutdown_connections 2021-06-25T04:54:33.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.797+0000 7f30a9a19700 1 -- 172.21.15.57:0/2033458835 wait complete. 2021-06-25T04:54:33.817 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:54:33.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 Processor -- start 2021-06-25T04:54:33.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 -- start start 2021-06-25T04:54:33.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdadc063890 0x7fdadc143d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdadc0618e0 0x7fdadc140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc063c70 con 0x7fdadc0b1290 2021-06-25T04:54:33.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc13fd70 con 0x7fdadc063890 2021-06-25T04:54:33.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc061fb0 con 0x7fdadc0618e0 2021-06-25T04:54:33.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae202c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdadc063890 0x7fdadc143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae202c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdadc063890 0x7fdadc143d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40174/0 (socket says 172.21.15.57:40174) 2021-06-25T04:54:33.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae202c700 1 -- 172.21.15.57:0/2386335242 learned_addr learned my addr 172.21.15.57:0/2386335242 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:33.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae182b700 1 --2- 172.21.15.57:0/2386335242 >> v2:172.21.15.87:3300/0 conn(0x7fdadc0618e0 0x7fdadc140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae182b700 1 -- 172.21.15.57:0/2386335242 >> v2:172.21.15.57:3300/0 conn(0x7fdadc063890 msgr2=0x7fdadc143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:33.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae182b700 1 --2- 172.21.15.57:0/2386335242 >> v2:172.21.15.57:3300/0 conn(0x7fdadc063890 0x7fdadc143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae182b700 1 -- 172.21.15.57:0/2386335242 >> v1:172.21.15.87:6789/0 conn(0x7fdadc0b1290 legacy=0x7fdadc128c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae182b700 1 -- 172.21.15.57:0/2386335242 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc13ff60 con 0x7fdadc0618e0 2021-06-25T04:54:33.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae202c700 1 --2- 172.21.15.57:0/2386335242 >> v2:172.21.15.57:3300/0 conn(0x7fdadc063890 0x7fdadc143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:33.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae182b700 1 --2- 172.21.15.57:0/2386335242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc0618e0 0x7fdadc140940 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fdad40032f0 tx=0x7fdad40091d0).ready entity=mon.1 client_cookie=80bd47921258b5cd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae102a700 1 -- 172.21.15.57:0/2386335242 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdad400b680 con 0x7fdadc0618e0 2021-06-25T04:54:33.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae102a700 1 -- 172.21.15.57:0/2386335242 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad400b7e0 con 0x7fdadc0618e0 2021-06-25T04:54:33.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae102a700 1 -- 172.21.15.57:0/2386335242 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdad400b950 con 0x7fdadc0618e0 2021-06-25T04:54:33.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 -- 172.21.15.57:0/2386335242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc0618e0 msgr2=0x7fdadc140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 --2- 172.21.15.57:0/2386335242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc0618e0 0x7fdadc140940 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fdad40032f0 tx=0x7fdad40091d0).stop 2021-06-25T04:54:33.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 -- 172.21.15.57:0/2386335242 shutdown_connections 2021-06-25T04:54:33.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 --2- 172.21.15.57:0/2386335242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc0618e0 0x7fdadc140940 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 --2- 172.21.15.57:0/2386335242 >> v2:172.21.15.57:3300/0 conn(0x7fdadc063890 0x7fdadc143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 -- 172.21.15.57:0/2386335242 >> 172.21.15.57:0/2386335242 conn(0x7fdadc05c450 msgr2=0x7fdadc05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:33.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 -- 172.21.15.57:0/2386335242 shutdown_connections 2021-06-25T04:54:33.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.917+0000 7fdae302e700 1 -- 172.21.15.57:0/2386335242 wait complete. 2021-06-25T04:54:33.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae302e700 1 Processor -- start 2021-06-25T04:54:33.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae302e700 1 -- start start 2021-06-25T04:54:33.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae302e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdadc0618e0 0x7fdadc0b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae302e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdadc063890 0x7fdadc127590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae302e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc0b1290 0x7fdadc127a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae302e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc13e1f0 con 0x7fdadc0618e0 2021-06-25T04:54:33.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae302e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0642f0 con 0x7fdadc0b1290 2021-06-25T04:54:33.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae302e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc064590 con 0x7fdadc063890 2021-06-25T04:54:33.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae202c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdadc0618e0 0x7fdadc0b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae202c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdadc0618e0 0x7fdadc0b5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40182/0 (socket says 172.21.15.57:40182) 2021-06-25T04:54:33.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae182b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdadc063890 0x7fdadc127590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae202c700 1 -- 172.21.15.57:0/2378414020 learned_addr learned my addr 172.21.15.57:0/2378414020 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:33.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae282d700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc0b1290 0x7fdadc127a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae202c700 1 -- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdadc063890 msgr2=0x7fdadc127590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae202c700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdadc063890 0x7fdadc127590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae202c700 1 -- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc0b1290 msgr2=0x7fdadc127a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:33.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae202c700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc0b1290 0x7fdadc127a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:33.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae202c700 1 -- 172.21.15.57:0/2378414020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad000b1e0 con 0x7fdadc0618e0 2021-06-25T04:54:33.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae202c700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdadc0618e0 0x7fdadc0b5bd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fdad000c000 tx=0x7fdad0006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdacf7fe700 1 -- 172.21.15.57:0/2378414020 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdad0012600 con 0x7fdadc0618e0 2021-06-25T04:54:33.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae302e700 1 -- 172.21.15.57:0/2378414020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad4009470 con 0x7fdadc0618e0 2021-06-25T04:54:33.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdacf7fe700 1 -- 172.21.15.57:0/2378414020 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad0012760 con 0x7fdadc0618e0 2021-06-25T04:54:33.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdacf7fe700 1 -- 172.21.15.57:0/2378414020 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdad0012ac0 con 0x7fdadc0618e0 2021-06-25T04:54:33.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.921+0000 7fdae302e700 1 -- 172.21.15.57:0/2378414020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc0659e0 con 0x7fdadc0618e0 2021-06-25T04:54:33.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.925+0000 7fdae302e700 1 -- 172.21.15.57:0/2378414020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc065820 con 0x7fdadc0618e0 2021-06-25T04:54:33.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.925+0000 7fdacf7fe700 1 -- 172.21.15.57:0/2378414020 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdad0022070 con 0x7fdadc0618e0 2021-06-25T04:54:33.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.925+0000 7fdacf7fe700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdabc0554e0 0x7fdabc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:33.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.925+0000 7fdacf7fe700 1 -- 172.21.15.57:0/2378414020 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fdad006e040 con 0x7fdadc0618e0 2021-06-25T04:54:33.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.925+0000 7fdae182b700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdabc0554e0 0x7fdabc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:33.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.925+0000 7fdae182b700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdabc0554e0 0x7fdabc0579a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fdad401b000 tx=0x7fdad4016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:33.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:33.929+0000 7fdacf7fe700 1 -- 172.21.15.57:0/2378414020 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdad0044490 con 0x7fdadc0618e0 2021-06-25T04:54:34.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 -- 172.21.15.57:0/2378414020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdadc057310 con 0x7fdadc0618e0 2021-06-25T04:54:34.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdacf7fe700 1 -- 172.21.15.57:0/2378414020 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) v1 ==== 84+0+143 (secure 0 0 0) 0x7fdad0047ab0 con 0x7fdadc0618e0 2021-06-25T04:54:34.064 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:34.065 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:54:34.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:34.065 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:54:34.065 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:54:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:54:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:54:34.067 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:34.067 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:54:34.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 -- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdabc0554e0 msgr2=0x7fdabc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:34.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdabc0554e0 0x7fdabc0579a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fdad401b000 tx=0x7fdad4016000).stop 2021-06-25T04:54:34.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 -- 172.21.15.57:0/2378414020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdadc0618e0 msgr2=0x7fdadc0b5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:34.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdadc0618e0 0x7fdadc0b5bd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fdad000c000 tx=0x7fdad0006eb0).stop 2021-06-25T04:54:34.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 -- 172.21.15.57:0/2378414020 shutdown_connections 2021-06-25T04:54:34.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdabc0554e0 0x7fdabc0579a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:34.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc0b1290 0x7fdadc127a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:34.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdadc063890 0x7fdadc127590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:34.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 --2- 172.21.15.57:0/2378414020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdadc0618e0 0x7fdadc0b5bd0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:34.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 -- 172.21.15.57:0/2378414020 >> 172.21.15.57:0/2378414020 conn(0x7fdadc05c450 msgr2=0x7fdadc13f070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:34.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 -- 172.21.15.57:0/2378414020 shutdown_connections 2021-06-25T04:54:34.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.061+0000 7fdae302e700 1 -- 172.21.15.57:0/2378414020 wait complete. 2021-06-25T04:54:34.077 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:54:34.078 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:54:34.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f246b28a700 1 Processor -- start 2021-06-25T04:54:34.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f246b28a700 1 -- start start 2021-06-25T04:54:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f246b28a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246405c520 0x7f24640b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f246b28a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24640aa460 con 0x7f24640af380 2021-06-25T04:54:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f246b28a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246405fb40 con 0x7f2464060160 2021-06-25T04:54:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f246b28a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24640b1410 con 0x7f246405c520 2021-06-25T04:54:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f246a288700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f24640af380 0x7f2464144410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57406/0 (socket says 172.21.15.57:57406) 2021-06-25T04:54:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f246a288700 1 -- 172.21.15.57:0/3145705191 learned_addr learned my addr 172.21.15.57:0/3145705191 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f246aa89700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246405c520 0x7f24640b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:34.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551411755 0 0) 0x7f24640aa460 con 0x7f24640af380 2021-06-25T04:54:34.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f244c003260 con 0x7f24640af380 2021-06-25T04:54:34.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170015765 0 0) 0x7f246405fb40 con 0x7f2464060160 2021-06-25T04:54:34.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24640aa460 con 0x7f2464060160 2021-06-25T04:54:34.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2960656255 0 0) 0x7f244c003260 con 0x7f24640af380 2021-06-25T04:54:34.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246405c520 msgr2=0x7f24640b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:34.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246405c520 0x7f24640b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:34.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 >> v1:172.21.15.87:6789/0 conn(0x7f2464060160 legacy=0x7f24640a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:34.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246405f670 con 0x7f24640af380 2021-06-25T04:54:34.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f2460001680 con 0x7f24640af380 2021-06-25T04:54:34.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 >> v1:172.21.15.57:6789/0 conn(0x7f24640af380 legacy=0x7f2464144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:34.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f244c003910 0x7f244c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:34.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f244c004500 0x7f244c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:34.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246405c520 0x7f244c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:34.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640b1410 con 0x7f244c004500 2021-06-25T04:54:34.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c00b7b0 con 0x7f244c003910 2021-06-25T04:54:34.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244c00b970 con 0x7f246405c520 2021-06-25T04:54:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.185+0000 7f2469a87700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f244c004500 0x7f244c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246a288700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f244c003910 0x7f244c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246aa89700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246405c520 0x7f244c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f2469a87700 1 -- 172.21.15.57:0/3145705191 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246405c520 msgr2=0x7f244c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:34.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f2469a87700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246405c520 0x7f244c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:34.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f2469a87700 1 -- 172.21.15.57:0/3145705191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f244c003910 msgr2=0x7f244c003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:34.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f2469a87700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f244c003910 0x7f244c003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:34.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f2469a87700 1 -- 172.21.15.57:0/3145705191 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c003260 con 0x7f244c004500 2021-06-25T04:54:34.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f2469a87700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f244c004500 0x7f244c004980 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f2458001490 tx=0x7f2458007d80).ready entity=mon.0 client_cookie=3acc14cf6da8cae server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2458001780 con 0x7f244c004500 2021-06-25T04:54:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458006890 con 0x7f244c004500 2021-06-25T04:54:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f2469286700 1 -- 172.21.15.57:0/3145705191 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2458006bf0 con 0x7f244c004500 2021-06-25T04:54:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 -- 172.21.15.57:0/3145705191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f244c004500 msgr2=0x7f244c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:34.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 --2- 172.21.15.57:0/3145705191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f244c004500 0x7f244c004980 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f2458001490 tx=0x7f2458007d80).stop 2021-06-25T04:54:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246aa89700 1 -- 172.21.15.57:0/3145705191 reap_dead start 2021-06-25T04:54:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 -- 172.21.15.57:0/3145705191 shutdown_connections 2021-06-25T04:54:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 -- 172.21.15.57:0/3145705191 >> 172.21.15.57:0/3145705191 conn(0x7f2464061100 msgr2=0x7f2464062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 -- 172.21.15.57:0/3145705191 shutdown_connections 2021-06-25T04:54:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 -- 172.21.15.57:0/3145705191 wait complete. 2021-06-25T04:54:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 Processor -- start 2021-06-25T04:54:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 -- start start 2021-06-25T04:54:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2464146780 0x7f246413dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:34.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2464067610 0x7f246413e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:34.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24640ae410 0x7f2464152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:34.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2464146b60 con 0x7f24640ae410 2021-06-25T04:54:34.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2464066120 con 0x7f2464067610 2021-06-25T04:54:34.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.189+0000 7f246b28a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2464064d70 con 0x7f2464146780 2021-06-25T04:54:34.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246aa89700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24640ae410 0x7f2464152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:34.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246aa89700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24640ae410 0x7f2464152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40204/0 (socket says 172.21.15.57:40204) 2021-06-25T04:54:34.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246aa89700 1 -- 172.21.15.57:0/759612754 learned_addr learned my addr 172.21.15.57:0/759612754 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:34.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f2469a87700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2464067610 0x7f246413e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:34.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246a288700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2464146780 0x7f246413dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:34.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246aa89700 1 -- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2464146780 msgr2=0x7f246413dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:34.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246aa89700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2464146780 0x7f246413dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:34.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246aa89700 1 -- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2464067610 msgr2=0x7f246413e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:34.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246aa89700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2464067610 0x7f246413e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:34.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246aa89700 1 -- 172.21.15.57:0/759612754 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2464065e20 con 0x7f24640ae410 2021-06-25T04:54:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f2469a87700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2464067610 0x7f246413e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246aa89700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24640ae410 0x7f2464152190 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f245c00b000 tx=0x7f245c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f24577fe700 1 -- 172.21.15.57:0/759612754 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f245c019070 con 0x7f24640ae410 2021-06-25T04:54:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f24577fe700 1 -- 172.21.15.57:0/759612754 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c000e90 con 0x7f24640ae410 2021-06-25T04:54:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246b28a700 1 -- 172.21.15.57:0/759612754 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24640ae0b0 con 0x7f24640ae410 2021-06-25T04:54:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f24577fe700 1 -- 172.21.15.57:0/759612754 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f245c00faa0 con 0x7f24640ae410 2021-06-25T04:54:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246b28a700 1 -- 172.21.15.57:0/759612754 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246413e720 con 0x7f24640ae410 2021-06-25T04:54:34.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f246b28a700 1 -- 172.21.15.57:0/759612754 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2464057310 con 0x7f24640ae410 2021-06-25T04:54:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f24577fe700 1 -- 172.21.15.57:0/759612754 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f245c00fc00 con 0x7f24640ae410 2021-06-25T04:54:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.193+0000 7f24577fe700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2444055340 0x7f2444057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.197+0000 7f24577fe700 1 -- 172.21.15.57:0/759612754 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f245c06d7d0 con 0x7f24640ae410 2021-06-25T04:54:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.197+0000 7f246a288700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2444055340 0x7f2444057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:34.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.197+0000 7f246a288700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2444055340 0x7f2444057800 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f2460005000 tx=0x7f2460009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:34.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.201+0000 7f24577fe700 1 -- 172.21.15.57:0/759612754 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f245c043c40 con 0x7f24640ae410 2021-06-25T04:54:34.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:34.337+0000 7f246b28a700 1 -- 172.21.15.57:0/759612754 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f246413e720 con 0x7f24640ae410 2021-06-25T04:54:35.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.305+0000 7f24577fe700 1 -- 172.21.15.57:0/759612754 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v85) v1 ==== 133+0+0 (secure 0 0 0) 0x7f246413e720 con 0x7f24640ae410 2021-06-25T04:54:35.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 -- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2444055340 msgr2=0x7f2444057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2444055340 0x7f2444057800 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f2460005000 tx=0x7f2460009040).stop 2021-06-25T04:54:35.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 -- 172.21.15.57:0/759612754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24640ae410 msgr2=0x7f2464152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24640ae410 0x7f2464152190 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f245c00b000 tx=0x7f245c006df0).stop 2021-06-25T04:54:35.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 -- 172.21.15.57:0/759612754 shutdown_connections 2021-06-25T04:54:35.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2444055340 0x7f2444057800 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24640ae410 0x7f2464152190 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2464067610 0x7f246413e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 --2- 172.21.15.57:0/759612754 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2464146780 0x7f246413dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 -- 172.21.15.57:0/759612754 >> 172.21.15.57:0/759612754 conn(0x7f2464061100 msgr2=0x7f24641403f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:35.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 -- 172.21.15.57:0/759612754 shutdown_connections 2021-06-25T04:54:35.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.309+0000 7f246b28a700 1 -- 172.21.15.57:0/759612754 wait complete. 2021-06-25T04:54:35.316 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:54:35.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:54:35.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.437+0000 7f44aae96700 1 Processor -- start 2021-06-25T04:54:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.437+0000 7f44aae96700 1 -- start start 2021-06-25T04:54:35.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aae96700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44a40aabe0 0x7f44a40b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aae96700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a40b2340 con 0x7f44a40b7330 2021-06-25T04:54:35.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aae96700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a4144210 con 0x7f44a40b3020 2021-06-25T04:54:35.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aae96700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a40b3530 con 0x7f44a40aabe0 2021-06-25T04:54:35.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aa695700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44a40aabe0 0x7f44a40b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44a9e94700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f44a40b7330 0x7f44a413e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57426/0 (socket says 172.21.15.57:57426) 2021-06-25T04:54:35.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44a9e94700 1 -- 172.21.15.57:0/1170610854 learned_addr learned my addr 172.21.15.57:0/1170610854 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:35.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44a8e92700 1 -- 172.21.15.57:0/1170610854 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409819952 0 0) 0x7f44a4144210 con 0x7f44a40b3020 2021-06-25T04:54:35.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aa695700 1 -- 172.21.15.57:0/1170610854 >> v1:172.21.15.87:6789/0 conn(0x7f44a40b3020 legacy=0x7f44a4064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aa695700 1 -- 172.21.15.57:0/1170610854 >> v1:172.21.15.57:6789/0 conn(0x7f44a40b7330 legacy=0x7f44a413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aa695700 1 -- 172.21.15.57:0/1170610854 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a40b2570 con 0x7f44a40aabe0 2021-06-25T04:54:35.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aa695700 1 --2- 172.21.15.57:0/1170610854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a40aabe0 0x7f44a40b7710 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f44a0001290 tx=0x7f449c0091d0).ready entity=mon.0 client_cookie=792af678828cacdd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:35.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44a8e92700 1 -- 172.21.15.57:0/1170610854 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449c009ea0 con 0x7f44a40aabe0 2021-06-25T04:54:35.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44a8e92700 1 -- 172.21.15.57:0/1170610854 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c00b760 con 0x7f44a40aabe0 2021-06-25T04:54:35.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44a8e92700 1 -- 172.21.15.57:0/1170610854 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449c00b8d0 con 0x7f44a40aabe0 2021-06-25T04:54:35.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aae96700 1 -- 172.21.15.57:0/1170610854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a40aabe0 msgr2=0x7f44a40b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aae96700 1 --2- 172.21.15.57:0/1170610854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a40aabe0 0x7f44a40b7710 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f44a0001290 tx=0x7f449c0091d0).stop 2021-06-25T04:54:35.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aae96700 1 -- 172.21.15.57:0/1170610854 shutdown_connections 2021-06-25T04:54:35.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aae96700 1 --2- 172.21.15.57:0/1170610854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a40aabe0 0x7f44a40b7710 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aae96700 1 -- 172.21.15.57:0/1170610854 >> 172.21.15.57:0/1170610854 conn(0x7f44a405f670 msgr2=0x7f44a405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aae96700 1 -- 172.21.15.57:0/1170610854 shutdown_connections 2021-06-25T04:54:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.441+0000 7f44aae96700 1 -- 172.21.15.57:0/1170610854 wait complete. 2021-06-25T04:54:35.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44aae96700 1 Processor -- start 2021-06-25T04:54:35.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44aae96700 1 -- start start 2021-06-25T04:54:35.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44aae96700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a40aabe0 0x7f44a40afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44aae96700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44a40b3020 0x7f44a40ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44aae96700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44a40b7330 0x7f44a40ad610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44aae96700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40b1f20 con 0x7f44a40aabe0 2021-06-25T04:54:35.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44aae96700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40ac4a0 con 0x7f44a40b3020 2021-06-25T04:54:35.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44aae96700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40ab810 con 0x7f44a40b7330 2021-06-25T04:54:35.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44a9e94700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a40aabe0 0x7f44a40afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44a9e94700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a40aabe0 0x7f44a40afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40214/0 (socket says 172.21.15.57:40214) 2021-06-25T04:54:35.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44a9e94700 1 -- 172.21.15.57:0/3749651792 learned_addr learned my addr 172.21.15.57:0/3749651792 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:35.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.445+0000 7f44a9693700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44a40b3020 0x7f44a40ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f44aa695700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44a40b7330 0x7f44a40ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f44a9693700 1 -- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44a40b7330 msgr2=0x7f44a40ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f44a9693700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44a40b7330 0x7f44a40ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f44a9693700 1 -- 172.21.15.57:0/3749651792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a40aabe0 msgr2=0x7f44a40afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f44a9693700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a40aabe0 0x7f44a40afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f44a9693700 1 -- 172.21.15.57:0/3749651792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c009470 con 0x7f44a40b3020 2021-06-25T04:54:35.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f44a9693700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44a40b3020 0x7f44a40ad120 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f44a40b2060 tx=0x7f4498007a00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:35.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f4496ffd700 1 -- 172.21.15.57:0/3749651792 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4498012400 con 0x7f44a40b3020 2021-06-25T04:54:35.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f4496ffd700 1 -- 172.21.15.57:0/3749651792 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4498012560 con 0x7f44a40b3020 2021-06-25T04:54:35.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f44aae96700 1 -- 172.21.15.57:0/3749651792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a41407a0 con 0x7f44a40b3020 2021-06-25T04:54:35.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f4496ffd700 1 -- 172.21.15.57:0/3749651792 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44980128c0 con 0x7f44a40b3020 2021-06-25T04:54:35.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f44aae96700 1 -- 172.21.15.57:0/3749651792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a4147f30 con 0x7f44a40b3020 2021-06-25T04:54:35.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f44aae96700 1 -- 172.21.15.57:0/3749651792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a40ab950 con 0x7f44a40b3020 2021-06-25T04:54:35.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.449+0000 7f4496ffd700 1 -- 172.21.15.57:0/3749651792 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4498019030 con 0x7f44a40b3020 2021-06-25T04:54:35.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.453+0000 7f4496ffd700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4484055490 0x7f4484057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.453+0000 7f4496ffd700 1 -- 172.21.15.57:0/3749651792 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f449806ce80 con 0x7f44a40b3020 2021-06-25T04:54:35.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.453+0000 7f44a9e94700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4484055490 0x7f4484057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.453+0000 7f44a9e94700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4484055490 0x7f4484057950 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f44a000d000 tx=0x7f44a0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:35.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.461+0000 7f4496ffd700 1 -- 172.21.15.57:0/3749651792 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f44980432b0 con 0x7f44a40b3020 2021-06-25T04:54:35.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.593+0000 7f44aae96700 1 -- 172.21.15.57:0/3749651792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f44a4057310 con 0x7f44a40b3020 2021-06-25T04:54:35.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.657+0000 7f4496ffd700 1 -- 172.21.15.57:0/3749651792 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v86) v1 ==== 125+0+0 (secure 0 0 0) 0x7f44980468d0 con 0x7f44a40b3020 2021-06-25T04:54:35.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.661+0000 7f44aae96700 1 -- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4484055490 msgr2=0x7f4484057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.661+0000 7f44aae96700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4484055490 0x7f4484057950 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f44a000d000 tx=0x7f44a0009040).stop 2021-06-25T04:54:35.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.661+0000 7f44aae96700 1 -- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44a40b3020 msgr2=0x7f44a40ad120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.661+0000 7f44aae96700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44a40b3020 0x7f44a40ad120 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f44a40b2060 tx=0x7f4498007a00).stop 2021-06-25T04:54:35.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.665+0000 7f44aae96700 1 -- 172.21.15.57:0/3749651792 shutdown_connections 2021-06-25T04:54:35.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.665+0000 7f44aae96700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4484055490 0x7f4484057950 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.665+0000 7f44aae96700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44a40b7330 0x7f44a40ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.665+0000 7f44aae96700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44a40b3020 0x7f44a40ad120 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.665+0000 7f44aae96700 1 --2- 172.21.15.57:0/3749651792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44a40aabe0 0x7f44a40afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.665+0000 7f44aae96700 1 -- 172.21.15.57:0/3749651792 >> 172.21.15.57:0/3749651792 conn(0x7f44a405f670 msgr2=0x7f44a4143ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:35.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.665+0000 7f44aae96700 1 -- 172.21.15.57:0/3749651792 shutdown_connections 2021-06-25T04:54:35.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.665+0000 7f44aae96700 1 -- 172.21.15.57:0/3749651792 wait complete. 2021-06-25T04:54:35.669 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:54:35.679 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:54:35.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.781+0000 7f9a7e18d700 1 Processor -- start 2021-06-25T04:54:35.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.781+0000 7f9a7e18d700 1 -- start start 2021-06-25T04:54:35.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7e18d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a780aea00 0x7f9a78143770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7e18d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9a780acfc0 0x7f9a78143c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7e18d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a780b0950 con 0x7f9a780b0440 2021-06-25T04:54:35.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7e18d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a780adc10 con 0x7f9a780acfc0 2021-06-25T04:54:35.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7e18d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780aede0 con 0x7f9a780aea00 2021-06-25T04:54:35.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7d98c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9a780b0440 0x7f9a78146af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57444/0 (socket says 172.21.15.57:57444) 2021-06-25T04:54:35.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7d98c700 1 -- 172.21.15.57:0/1454732471 learned_addr learned my addr 172.21.15.57:0/1454732471 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:35.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7d18b700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a780aea00 0x7f9a78143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7c98a700 1 --2- 172.21.15.57:0/1454732471 >> v2:172.21.15.87:3300/0 conn(0x7f9a780acfc0 0x7f9a78143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221659383 0 0) 0x7f9a780b0950 con 0x7f9a780b0440 2021-06-25T04:54:35.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a60003260 con 0x7f9a780b0440 2021-06-25T04:54:35.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2686312878 0 0) 0x7f9a60003260 con 0x7f9a780b0440 2021-06-25T04:54:35.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a780aea00 msgr2=0x7f9a78143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:35.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a780aea00 0x7f9a78143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 >> v2:172.21.15.87:3300/0 conn(0x7f9a780acfc0 msgr2=0x7f9a78143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:35.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 --2- 172.21.15.57:0/1454732471 >> v2:172.21.15.87:3300/0 conn(0x7f9a780acfc0 0x7f9a78143c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a781466c0 con 0x7f9a780b0440 2021-06-25T04:54:35.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f9a700019e0 con 0x7f9a780b0440 2021-06-25T04:54:35.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7c98a700 1 --2- 172.21.15.57:0/1454732471 >> v2:172.21.15.87:3300/0 conn(0x7f9a780acfc0 0x7f9a78143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:35.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 >> v1:172.21.15.57:6789/0 conn(0x7f9a780b0440 legacy=0x7f9a78146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a60003750 0x7f9a60003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a60004500 0x7f9a60004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a60004e70 0x7f9a6000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780adc10 con 0x7f9a60003750 2021-06-25T04:54:35.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780aede0 con 0x7f9a60004e70 2021-06-25T04:54:35.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6000bc40 con 0x7f9a60004500 2021-06-25T04:54:35.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7d18b700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a780aea00 0x7f9a78143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:35.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7d98c700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a60004e70 0x7f9a6000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7c98a700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a60004500 0x7f9a60004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7d18b700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a60003750 0x7f9a60003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7d98c700 1 -- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a60004500 msgr2=0x7f9a60004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:35.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7d98c700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a60004500 0x7f9a60004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7d98c700 1 -- 172.21.15.57:0/1454732471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a60003750 msgr2=0x7f9a60003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:35.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7d98c700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a60003750 0x7f9a60003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.785+0000 7f9a7d98c700 1 -- 172.21.15.57:0/1454732471 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a60003260 con 0x7f9a60004e70 2021-06-25T04:54:35.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a7d98c700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a60004e70 0x7f9a6000b750 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f9a700016f0 tx=0x7f9a780ae5e0).ready entity=mon.1 client_cookie=99e708bb3642e21c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:35.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a7000cc50 con 0x7f9a60004e70 2021-06-25T04:54:35.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7000cdb0 con 0x7f9a60004e70 2021-06-25T04:54:35.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a67fff700 1 -- 172.21.15.57:0/1454732471 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a70005b80 con 0x7f9a60004e70 2021-06-25T04:54:35.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a7e18d700 1 -- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a60004e70 msgr2=0x7f9a6000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a7e18d700 1 --2- 172.21.15.57:0/1454732471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a60004e70 0x7f9a6000b750 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f9a700016f0 tx=0x7f9a780ae5e0).stop 2021-06-25T04:54:35.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a7d98c700 1 -- 172.21.15.57:0/1454732471 reap_dead start 2021-06-25T04:54:35.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a7e18d700 1 -- 172.21.15.57:0/1454732471 shutdown_connections 2021-06-25T04:54:35.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a7e18d700 1 -- 172.21.15.57:0/1454732471 >> 172.21.15.57:0/1454732471 conn(0x7f9a780611f0 msgr2=0x7f9a78062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:35.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a7e18d700 1 -- 172.21.15.57:0/1454732471 shutdown_connections 2021-06-25T04:54:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a7e18d700 1 -- 172.21.15.57:0/1454732471 wait complete. 2021-06-25T04:54:35.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a7e18d700 1 Processor -- start 2021-06-25T04:54:35.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.789+0000 7f9a7e18d700 1 -- start start 2021-06-25T04:54:35.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7e18d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a78148c60 0x7f9a78066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7e18d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a780671d0 0x7f9a7813de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7e18d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a7813e310 0x7f9a780b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7e18d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7813e7a0 con 0x7f9a78148c60 2021-06-25T04:54:35.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7e18d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78149040 con 0x7f9a780671d0 2021-06-25T04:54:35.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7e18d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780b5fc0 con 0x7f9a7813e310 2021-06-25T04:54:35.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7d18b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a78148c60 0x7f9a78066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7d98c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a7813e310 0x7f9a780b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7d18b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a78148c60 0x7f9a78066ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40234/0 (socket says 172.21.15.57:40234) 2021-06-25T04:54:35.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7d18b700 1 -- 172.21.15.57:0/2047718948 learned_addr learned my addr 172.21.15.57:0/2047718948 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:35.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7c98a700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a780671d0 0x7f9a7813de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7d18b700 1 -- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a7813e310 msgr2=0x7f9a780b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7d18b700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a7813e310 0x7f9a780b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7d18b700 1 -- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a780671d0 msgr2=0x7f9a7813de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7d18b700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a780671d0 0x7f9a7813de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7d18b700 1 -- 172.21.15.57:0/2047718948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780b54e0 con 0x7f9a78148c60 2021-06-25T04:54:35.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7d18b700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a78148c60 0x7f9a78066ce0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f9a7400b000 tx=0x7f9a74006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:35.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a667fc700 1 -- 172.21.15.57:0/2047718948 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a74013680 con 0x7f9a78148c60 2021-06-25T04:54:35.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a667fc700 1 -- 172.21.15.57:0/2047718948 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74000e90 con 0x7f9a78148c60 2021-06-25T04:54:35.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7e18d700 1 -- 172.21.15.57:0/2047718948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a780b5980 con 0x7f9a78148c60 2021-06-25T04:54:35.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a667fc700 1 -- 172.21.15.57:0/2047718948 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a740139d0 con 0x7f9a78148c60 2021-06-25T04:54:35.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.793+0000 7f9a7e18d700 1 -- 172.21.15.57:0/2047718948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a78065d40 con 0x7f9a78148c60 2021-06-25T04:54:35.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.797+0000 7f9a7e18d700 1 -- 172.21.15.57:0/2047718948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a780b5320 con 0x7f9a78148c60 2021-06-25T04:54:35.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.797+0000 7f9a667fc700 1 -- 172.21.15.57:0/2047718948 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9a74013b30 con 0x7f9a78148c60 2021-06-25T04:54:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.797+0000 7f9a667fc700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a58055360 0x7f9a58057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.797+0000 7f9a667fc700 1 -- 172.21.15.57:0/2047718948 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f9a7406e540 con 0x7f9a78148c60 2021-06-25T04:54:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.797+0000 7f9a7c98a700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a58055360 0x7f9a58057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.797+0000 7f9a7c98a700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a58055360 0x7f9a58057820 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f9a6800b000 tx=0x7f9a68006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:35.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.801+0000 7f9a667fc700 1 -- 172.21.15.57:0/2047718948 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9a74044770 con 0x7f9a78148c60 2021-06-25T04:54:35.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.961+0000 7f9a7e18d700 1 -- 172.21.15.57:0/2047718948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f9a780b5670 con 0x7f9a78148c60 2021-06-25T04:54:35.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.973+0000 7f9a667fc700 1 -- 172.21.15.57:0/2047718948 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v40) v1 ==== 189+0+0 (secure 0 0 0) 0x7f9a740180d0 con 0x7f9a78148c60 2021-06-25T04:54:35.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.977+0000 7f9a7e18d700 1 -- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a58055360 msgr2=0x7f9a58057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.977+0000 7f9a7e18d700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a58055360 0x7f9a58057820 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f9a6800b000 tx=0x7f9a68006df0).stop 2021-06-25T04:54:35.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.977+0000 7f9a7e18d700 1 -- 172.21.15.57:0/2047718948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a78148c60 msgr2=0x7f9a78066ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:35.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.977+0000 7f9a7e18d700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a78148c60 0x7f9a78066ce0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f9a7400b000 tx=0x7f9a74006df0).stop 2021-06-25T04:54:35.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.981+0000 7f9a7e18d700 1 -- 172.21.15.57:0/2047718948 shutdown_connections 2021-06-25T04:54:35.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.981+0000 7f9a7e18d700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a58055360 0x7f9a58057820 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.981+0000 7f9a7e18d700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a7813e310 0x7f9a780b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.981+0000 7f9a7e18d700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a780671d0 0x7f9a7813de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.981+0000 7f9a7e18d700 1 --2- 172.21.15.57:0/2047718948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a78148c60 0x7f9a78066ce0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:35.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.981+0000 7f9a7e18d700 1 -- 172.21.15.57:0/2047718948 >> 172.21.15.57:0/2047718948 conn(0x7f9a780611f0 msgr2=0x7f9a78142f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:35.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.981+0000 7f9a7e18d700 1 -- 172.21.15.57:0/2047718948 shutdown_connections 2021-06-25T04:54:35.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:35.981+0000 7f9a7e18d700 1 -- 172.21.15.57:0/2047718948 wait complete. 2021-06-25T04:54:35.988 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 15 and data pool 16 2021-06-25T04:54:36.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:54:36.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.085+0000 7f7f1c8cb700 1 Processor -- start 2021-06-25T04:54:36.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.085+0000 7f7f1c8cb700 1 -- start start 2021-06-25T04:54:36.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1c8cb700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7f180670e0 0x7f7f180b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1c8cb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f180b9b90 con 0x7f7f18143970 2021-06-25T04:54:36.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1c8cb700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f180674c0 con 0x7f7f1813ffb0 2021-06-25T04:54:36.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1c8cb700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f18143040 con 0x7f7f180670e0 2021-06-25T04:54:36.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f15d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7f18143970 0x7f7f180aebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57474/0 (socket says 172.21.15.57:57474) 2021-06-25T04:54:36.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f15d9b700 1 -- 172.21.15.57:0/815579109 learned_addr learned my addr 172.21.15.57:0/815579109 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:36.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1659c700 1 --2- 172.21.15.57:0/815579109 >> v2:172.21.15.87:3300/0 conn(0x7f7f180670e0 0x7f7f180b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1559a700 1 -- 172.21.15.57:0/815579109 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751319255 0 0) 0x7f7f00001110 con 0x7f7f18143970 2021-06-25T04:54:36.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1559a700 1 -- 172.21.15.57:0/815579109 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef8003260 con 0x7f7f18143970 2021-06-25T04:54:36.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1659c700 1 -- 172.21.15.57:0/815579109 >> v1:172.21.15.87:6789/0 conn(0x7f7f1813ffb0 legacy=0x7f7f18140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1659c700 1 -- 172.21.15.57:0/815579109 >> v1:172.21.15.57:6789/0 conn(0x7f7f18143970 legacy=0x7f7f180aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1659c700 1 -- 172.21.15.57:0/815579109 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f180af490 con 0x7f7f180670e0 2021-06-25T04:54:36.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1659c700 1 --2- 172.21.15.57:0/815579109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f180670e0 0x7f7f180b96a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f7f080032f0 tx=0x7f7f080091d0).ready entity=mon.1 client_cookie=afd91101e875b225 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:36.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1559a700 1 -- 172.21.15.57:0/815579109 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f0800b6c0 con 0x7f7f180670e0 2021-06-25T04:54:36.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1559a700 1 -- 172.21.15.57:0/815579109 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0800b820 con 0x7f7f180670e0 2021-06-25T04:54:36.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1559a700 1 -- 172.21.15.57:0/815579109 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f0800b990 con 0x7f7f180670e0 2021-06-25T04:54:36.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/815579109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f180670e0 msgr2=0x7f7f180b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1c8cb700 1 --2- 172.21.15.57:0/815579109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f180670e0 0x7f7f180b96a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f7f080032f0 tx=0x7f7f080091d0).stop 2021-06-25T04:54:36.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/815579109 shutdown_connections 2021-06-25T04:54:36.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1c8cb700 1 --2- 172.21.15.57:0/815579109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f180670e0 0x7f7f180b96a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/815579109 >> 172.21.15.57:0/815579109 conn(0x7f7f1805f9b0 msgr2=0x7f7f18061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:36.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/815579109 shutdown_connections 2021-06-25T04:54:36.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.089+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/815579109 wait complete. 2021-06-25T04:54:36.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f1c8cb700 1 Processor -- start 2021-06-25T04:54:36.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f1c8cb700 1 -- start start 2021-06-25T04:54:36.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f1c8cb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f180670e0 0x7f7f18144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f1c8cb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f1813ffb0 0x7f7f180b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f1c8cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f18143970 0x7f7f1813f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f1c8cb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f180b87b0 con 0x7f7f18143970 2021-06-25T04:54:36.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f1c8cb700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f181459c0 con 0x7f7f1813ffb0 2021-06-25T04:54:36.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f1c8cb700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f180b89e0 con 0x7f7f180670e0 2021-06-25T04:54:36.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f16d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f18143970 0x7f7f1813f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f15d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f1813ffb0 0x7f7f180b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f1659c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f180670e0 0x7f7f18144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f15d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f1813ffb0 0x7f7f180b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:48752/0 (socket says 172.21.15.57:48752) 2021-06-25T04:54:36.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f15d9b700 1 -- 172.21.15.57:0/4009425742 learned_addr learned my addr 172.21.15.57:0/4009425742 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:36.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f1659c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f180670e0 0x7f7f18144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:51424/0 (socket says 172.21.15.57:51424) 2021-06-25T04:54:36.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.093+0000 7f7f16d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f18143970 0x7f7f1813f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40262/0 (socket says 172.21.15.57:40262) 2021-06-25T04:54:36.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f16d9d700 1 -- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f180670e0 msgr2=0x7f7f18144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f16d9d700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f180670e0 0x7f7f18144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f16d9d700 1 -- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f1813ffb0 msgr2=0x7f7f180b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f16d9d700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f1813ffb0 0x7f7f180b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f16d9d700 1 -- 172.21.15.57:0/4009425742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08009470 con 0x7f7f18143970 2021-06-25T04:54:36.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f15d9b700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f1813ffb0 0x7f7f180b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:36.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f16d9d700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f18143970 0x7f7f1813f170 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f7f180602e0 tx=0x7f7f10007b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:36.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f0f7fe700 1 -- 172.21.15.57:0/4009425742 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f1000cd50 con 0x7f7f18143970 2021-06-25T04:54:36.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f0f7fe700 1 -- 172.21.15.57:0/4009425742 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f10012400 con 0x7f7f18143970 2021-06-25T04:54:36.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/4009425742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f180b8f70 con 0x7f7f18143970 2021-06-25T04:54:36.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f0f7fe700 1 -- 172.21.15.57:0/4009425742 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f10012760 con 0x7f7f18143970 2021-06-25T04:54:36.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/4009425742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f180b8450 con 0x7f7f18143970 2021-06-25T04:54:36.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/4009425742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f18057310 con 0x7f7f18143970 2021-06-25T04:54:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.097+0000 7f7f0f7fe700 1 -- 172.21.15.57:0/4009425742 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7f10019030 con 0x7f7f18143970 2021-06-25T04:54:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.101+0000 7f7f0f7fe700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7efc055340 0x7f7efc057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.101+0000 7f7f0f7fe700 1 -- 172.21.15.57:0/4009425742 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7f1006d680 con 0x7f7f18143970 2021-06-25T04:54:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.101+0000 7f7f1659c700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7efc055340 0x7f7efc057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.101+0000 7f7f1659c700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7efc055340 0x7f7efc057800 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f7f0801b000 tx=0x7f7f08016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.105+0000 7f7f0f7fe700 1 -- 172.21.15.57:0/4009425742 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7f10043720 con 0x7f7f18143970 2021-06-25T04:54:36.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.233+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/4009425742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f180b1250 con 0x7f7f18143970 2021-06-25T04:54:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f0f7fe700 1 -- 172.21.15.57:0/4009425742 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16300 (secure 0 0 0) 0x7f7f10017070 con 0x7f7f18143970 2021-06-25T04:54:36.240 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:36.240 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":87,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:35.964671+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:54:34.391112+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-06-25T04:54:35.648616+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:54:36.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7efc055340 msgr2=0x7f7efc057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f1c8cb700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7efc055340 0x7f7efc057800 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f7f0801b000 tx=0x7f7f08016000).stop 2021-06-25T04:54:36.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/4009425742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f18143970 msgr2=0x7f7f1813f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f1c8cb700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f18143970 0x7f7f1813f170 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f7f180602e0 tx=0x7f7f10007b30).stop 2021-06-25T04:54:36.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/4009425742 shutdown_connections 2021-06-25T04:54:36.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f1c8cb700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7efc055340 0x7f7efc057800 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f1c8cb700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f18143970 0x7f7f1813f170 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f1c8cb700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f1813ffb0 0x7f7f180b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f1c8cb700 1 --2- 172.21.15.57:0/4009425742 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f180670e0 0x7f7f18144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/4009425742 >> 172.21.15.57:0/4009425742 conn(0x7f7f1805f9b0 msgr2=0x7f7f18061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:36.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.237+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/4009425742 shutdown_connections 2021-06-25T04:54:36.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.241+0000 7f7f1c8cb700 1 -- 172.21.15.57:0/4009425742 wait complete. 2021-06-25T04:54:36.253 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:54:36.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bffff700 1 Processor -- start 2021-06-25T04:54:36.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bffff700 1 -- start start 2021-06-25T04:54:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c00b5460 0x7fa0c00af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa0c0147560 0x7fa0c00acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00b5840 con 0x7fa0c00b05d0 2021-06-25T04:54:36.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bffff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c01452a0 con 0x7fa0c0147560 2021-06-25T04:54:36.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00adfb0 con 0x7fa0c00b5460 2021-06-25T04:54:36.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0be7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa0c00b05d0 0x7fa0c0067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57484/0 (socket says 172.21.15.57:57484) 2021-06-25T04:54:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0be7fc700 1 -- 172.21.15.57:0/1476572438 learned_addr learned my addr 172.21.15.57:0/1476572438 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0beffd700 1 --2- 172.21.15.57:0/1476572438 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c00b5460 0x7fa0c00af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bf7fe700 1 --2- 172.21.15.57:0/1476572438 >> v2:172.21.15.87:3300/0 conn(0x7fa0c0147560 0x7fa0c00acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bdffb700 1 -- 172.21.15.57:0/1476572438 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656107080 0 0) 0x7fa0c00b5840 con 0x7fa0c00b05d0 2021-06-25T04:54:36.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bdffb700 1 -- 172.21.15.57:0/1476572438 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a4003260 con 0x7fa0c00b05d0 2021-06-25T04:54:36.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0beffd700 1 -- 172.21.15.57:0/1476572438 >> v2:172.21.15.87:3300/0 conn(0x7fa0c0147560 msgr2=0x7fa0c00acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:36.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bdffb700 1 -- 172.21.15.57:0/1476572438 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 224622308 0 0) 0x7fa0a4003260 con 0x7fa0c00b05d0 2021-06-25T04:54:36.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0beffd700 1 --2- 172.21.15.57:0/1476572438 >> v2:172.21.15.87:3300/0 conn(0x7fa0c0147560 0x7fa0c00acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0beffd700 1 -- 172.21.15.57:0/1476572438 >> v1:172.21.15.57:6789/0 conn(0x7fa0c00b05d0 legacy=0x7fa0c0067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0beffd700 1 -- 172.21.15.57:0/1476572438 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00ac7c0 con 0x7fa0c00b5460 2021-06-25T04:54:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0beffd700 1 --2- 172.21.15.57:0/1476572438 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c00b5460 0x7fa0c00af510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fa0b0001b80 tx=0x7fa0b4006df0).ready entity=mon.2 client_cookie=7ee2784791056736 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.357+0000 7fa0bdffb700 1 -- 172.21.15.57:0/1476572438 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b00019e0 con 0x7fa0c00b5460 2021-06-25T04:54:36.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bdffb700 1 -- 172.21.15.57:0/1476572438 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4000e90 con 0x7fa0c00b5460 2021-06-25T04:54:36.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bdffb700 1 -- 172.21.15.57:0/1476572438 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b4012460 con 0x7fa0c00b5460 2021-06-25T04:54:36.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 -- 172.21.15.57:0/1476572438 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c00b5460 msgr2=0x7fa0c00af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 --2- 172.21.15.57:0/1476572438 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c00b5460 0x7fa0c00af510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fa0b0001b80 tx=0x7fa0b4006df0).stop 2021-06-25T04:54:36.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 -- 172.21.15.57:0/1476572438 shutdown_connections 2021-06-25T04:54:36.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 --2- 172.21.15.57:0/1476572438 >> v2:172.21.15.87:3300/0 conn(0x7fa0c0147560 0x7fa0c00acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 --2- 172.21.15.57:0/1476572438 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c00b5460 0x7fa0c00af510 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 -- 172.21.15.57:0/1476572438 >> 172.21.15.57:0/1476572438 conn(0x7fa0c0062520 msgr2=0x7fa0c0062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:36.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 -- 172.21.15.57:0/1476572438 shutdown_connections 2021-06-25T04:54:36.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 -- 172.21.15.57:0/1476572438 wait complete. 2021-06-25T04:54:36.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 Processor -- start 2021-06-25T04:54:36.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 -- start start 2021-06-25T04:54:36.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c00b05d0 0x7fa0c00aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c00b5460 0x7fa0c015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0c0147560 0x7fa0c0140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c01567c0 con 0x7fa0c00b5460 2021-06-25T04:54:36.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0145df0 con 0x7fa0c0147560 2021-06-25T04:54:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0bffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c015ac50 con 0x7fa0c00b05d0 2021-06-25T04:54:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.361+0000 7fa0be7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c00b5460 0x7fa0c015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0be7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c00b5460 0x7fa0c015a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40274/0 (socket says 172.21.15.57:40274) 2021-06-25T04:54:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0be7fc700 1 -- 172.21.15.57:0/3205075879 learned_addr learned my addr 172.21.15.57:0/3205075879 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:36.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0beffd700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c00b05d0 0x7fa0c00aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0bf7fe700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0c0147560 0x7fa0c0140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0be7fc700 1 -- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c00b05d0 msgr2=0x7fa0c00aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0be7fc700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c00b05d0 0x7fa0c00aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0be7fc700 1 -- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0c0147560 msgr2=0x7fa0c0140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0be7fc700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0c0147560 0x7fa0c0140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0be7fc700 1 -- 172.21.15.57:0/3205075879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b400b180 con 0x7fa0c00b5460 2021-06-25T04:54:36.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0be7fc700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c00b5460 0x7fa0c015a760 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fa0c00b3fe0 tx=0x7fa0b0002140).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:36.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0affff700 1 -- 172.21.15.57:0/3205075879 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b0005ba0 con 0x7fa0c00b5460 2021-06-25T04:54:36.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0affff700 1 -- 172.21.15.57:0/3205075879 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b0005d00 con 0x7fa0c00b5460 2021-06-25T04:54:36.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0bffff700 1 -- 172.21.15.57:0/3205075879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c0146ce0 con 0x7fa0c00b5460 2021-06-25T04:54:36.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0affff700 1 -- 172.21.15.57:0/3205075879 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b0004a90 con 0x7fa0c00b5460 2021-06-25T04:54:36.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0bffff700 1 -- 172.21.15.57:0/3205075879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c0147220 con 0x7fa0c00b5460 2021-06-25T04:54:36.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0bffff700 1 -- 172.21.15.57:0/3205075879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c0057310 con 0x7fa0c00b5460 2021-06-25T04:54:36.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0affff700 1 -- 172.21.15.57:0/3205075879 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa0b0010070 con 0x7fa0c00b5460 2021-06-25T04:54:36.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0affff700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa09c055450 0x7fa09c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.365+0000 7fa0affff700 1 -- 172.21.15.57:0/3205075879 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa0b006dcb0 con 0x7fa0c00b5460 2021-06-25T04:54:36.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.369+0000 7fa0beffd700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa09c055450 0x7fa09c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.369+0000 7fa0beffd700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa09c055450 0x7fa09c057910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa0b4019000 tx=0x7fa0b4014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:36.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.377+0000 7fa0affff700 1 -- 172.21.15.57:0/3205075879 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa0b0043dc0 con 0x7fa0c00b5460 2021-06-25T04:54:36.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.501+0000 7fa0bffff700 1 -- 172.21.15.57:0/3205075879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0c014a810 con 0x7fa0c00b5460 2021-06-25T04:54:36.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.501+0000 7fa0affff700 1 -- 172.21.15.57:0/3205075879 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16300 (secure 0 0 0) 0x7fa0b0019020 con 0x7fa0c00b5460 2021-06-25T04:54:36.506 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:36.509 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":87,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:35.964671+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:54:34.391112+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-06-25T04:54:35.648616+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:54:36.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 -- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa09c055450 msgr2=0x7fa09c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa09c055450 0x7fa09c057910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa0b4019000 tx=0x7fa0b4014000).stop 2021-06-25T04:54:36.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 -- 172.21.15.57:0/3205075879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c00b5460 msgr2=0x7fa0c015a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c00b5460 0x7fa0c015a760 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fa0c00b3fe0 tx=0x7fa0b0002140).stop 2021-06-25T04:54:36.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 -- 172.21.15.57:0/3205075879 shutdown_connections 2021-06-25T04:54:36.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa09c055450 0x7fa09c057910 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0c0147560 0x7fa0c0140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c00b5460 0x7fa0c015a760 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 --2- 172.21.15.57:0/3205075879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c00b05d0 0x7fa0c00aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 -- 172.21.15.57:0/3205075879 >> 172.21.15.57:0/3205075879 conn(0x7fa0c0062520 msgr2=0x7fa0c0067330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:36.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 -- 172.21.15.57:0/3205075879 shutdown_connections 2021-06-25T04:54:36.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.505+0000 7fa0bffff700 1 -- 172.21.15.57:0/3205075879 wait complete. 2021-06-25T04:54:36.520 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:54:36.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.625+0000 7f2e673a6700 1 Processor -- start 2021-06-25T04:54:36.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e673a6700 1 -- start start 2021-06-25T04:54:36.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e673a6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e6005ff20 0x7f2e60140400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e673a6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e600648d0 con 0x7f2e600b26d0 2021-06-25T04:54:36.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e673a6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e60064b70 con 0x7f2e60061190 2021-06-25T04:54:36.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e673a6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e60064e10 con 0x7f2e6005ff20 2021-06-25T04:54:36.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e65142700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e6005ff20 0x7f2e60140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e64941700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2e600b26d0 0x7f2e601430d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57502/0 (socket says 172.21.15.57:57502) 2021-06-25T04:54:36.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e64941700 1 -- 172.21.15.57:0/1487587991 learned_addr learned my addr 172.21.15.57:0/1487587991 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:36.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e4bfff700 1 -- 172.21.15.57:0/1487587991 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110949905 0 0) 0x7f2e600648d0 con 0x7f2e600b26d0 2021-06-25T04:54:36.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e4bfff700 1 -- 172.21.15.57:0/1487587991 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e44003260 con 0x7f2e600b26d0 2021-06-25T04:54:36.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e4bfff700 1 -- 172.21.15.57:0/1487587991 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708417780 0 0) 0x7f2e60064b70 con 0x7f2e60061190 2021-06-25T04:54:36.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e4bfff700 1 -- 172.21.15.57:0/1487587991 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e600648d0 con 0x7f2e60061190 2021-06-25T04:54:36.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e65142700 1 -- 172.21.15.57:0/1487587991 >> v1:172.21.15.87:6789/0 conn(0x7f2e60061190 legacy=0x7f2e601437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e65142700 1 -- 172.21.15.57:0/1487587991 >> v1:172.21.15.57:6789/0 conn(0x7f2e600b26d0 legacy=0x7f2e601430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e65142700 1 -- 172.21.15.57:0/1487587991 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600650b0 con 0x7f2e6005ff20 2021-06-25T04:54:36.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e65142700 1 --2- 172.21.15.57:0/1487587991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e6005ff20 0x7f2e60140400 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f2e54002f70 tx=0x7f2e54006df0).ready entity=mon.0 client_cookie=52269f3782a4c768 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:36.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e4bfff700 1 -- 172.21.15.57:0/1487587991 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5400d540 con 0x7f2e6005ff20 2021-06-25T04:54:36.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e4bfff700 1 -- 172.21.15.57:0/1487587991 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e54000e90 con 0x7f2e6005ff20 2021-06-25T04:54:36.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e4bfff700 1 -- 172.21.15.57:0/1487587991 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5400d890 con 0x7f2e6005ff20 2021-06-25T04:54:36.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e673a6700 1 -- 172.21.15.57:0/1487587991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e6005ff20 msgr2=0x7f2e60140400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.629+0000 7f2e673a6700 1 --2- 172.21.15.57:0/1487587991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e6005ff20 0x7f2e60140400 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f2e54002f70 tx=0x7f2e54006df0).stop 2021-06-25T04:54:36.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.633+0000 7f2e673a6700 1 -- 172.21.15.57:0/1487587991 shutdown_connections 2021-06-25T04:54:36.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.633+0000 7f2e673a6700 1 --2- 172.21.15.57:0/1487587991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e6005ff20 0x7f2e60140400 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.633+0000 7f2e673a6700 1 -- 172.21.15.57:0/1487587991 >> 172.21.15.57:0/1487587991 conn(0x7f2e6005cf20 msgr2=0x7f2e6005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:36.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.633+0000 7f2e673a6700 1 -- 172.21.15.57:0/1487587991 shutdown_connections 2021-06-25T04:54:36.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.633+0000 7f2e673a6700 1 -- 172.21.15.57:0/1487587991 wait complete. 2021-06-25T04:54:36.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.633+0000 7f2e673a6700 1 Processor -- start 2021-06-25T04:54:36.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.633+0000 7f2e673a6700 1 -- start start 2021-06-25T04:54:36.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e673a6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e6005ff20 0x7f2e600ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e673a6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e60061190 0x7f2e60152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e673a6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e600b26d0 0x7f2e600b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e673a6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600ae4b0 con 0x7f2e600b26d0 2021-06-25T04:54:36.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e673a6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e601532b0 con 0x7f2e60061190 2021-06-25T04:54:36.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e673a6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e60152d70 con 0x7f2e6005ff20 2021-06-25T04:54:36.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e65943700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e600b26d0 0x7f2e600b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e65943700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e600b26d0 0x7f2e600b07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40290/0 (socket says 172.21.15.57:40290) 2021-06-25T04:54:36.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e65943700 1 -- 172.21.15.57:0/4126086273 learned_addr learned my addr 172.21.15.57:0/4126086273 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:36.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e64941700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e60061190 0x7f2e60152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e65142700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e6005ff20 0x7f2e600ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e65943700 1 -- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e6005ff20 msgr2=0x7f2e600ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e65943700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e6005ff20 0x7f2e600ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e65943700 1 -- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e60061190 msgr2=0x7f2e60152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e65943700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e60061190 0x7f2e60152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:36.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e65943700 1 -- 172.21.15.57:0/4126086273 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5400b180 con 0x7f2e600b26d0 2021-06-25T04:54:36.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e65943700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e600b26d0 0x7f2e600b07d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f2e58001490 tx=0x7f2e58007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:36.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e52ffd700 1 -- 172.21.15.57:0/4126086273 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e58002310 con 0x7f2e600b26d0 2021-06-25T04:54:36.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e52ffd700 1 -- 172.21.15.57:0/4126086273 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58002470 con 0x7f2e600b26d0 2021-06-25T04:54:36.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e673a6700 1 -- 172.21.15.57:0/4126086273 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e60153010 con 0x7f2e600b26d0 2021-06-25T04:54:36.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e52ffd700 1 -- 172.21.15.57:0/4126086273 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e58001840 con 0x7f2e600b26d0 2021-06-25T04:54:36.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.637+0000 7f2e673a6700 1 -- 172.21.15.57:0/4126086273 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e600b0cc0 con 0x7f2e600b26d0 2021-06-25T04:54:36.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.641+0000 7f2e673a6700 1 -- 172.21.15.57:0/4126086273 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e600ac530 con 0x7f2e600b26d0 2021-06-25T04:54:36.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.641+0000 7f2e52ffd700 1 -- 172.21.15.57:0/4126086273 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2e58010030 con 0x7f2e600b26d0 2021-06-25T04:54:36.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.641+0000 7f2e52ffd700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e3c055450 0x7f2e3c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:36.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.641+0000 7f2e52ffd700 1 -- 172.21.15.57:0/4126086273 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2e5806dda0 con 0x7f2e600b26d0 2021-06-25T04:54:36.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.641+0000 7f2e65142700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e3c055450 0x7f2e3c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:36.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.641+0000 7f2e65142700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e3c055450 0x7f2e3c057910 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f2e54017000 tx=0x7f2e54014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:36.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.645+0000 7f2e52ffd700 1 -- 172.21.15.57:0/4126086273 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2e58043e40 con 0x7f2e600b26d0 2021-06-25T04:54:36.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.809+0000 7f2e673a6700 1 -- 172.21.15.57:0/4126086273 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2e60057310 con 0x7f2e600b26d0 2021-06-25T04:54:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.989+0000 7f2e52ffd700 1 -- 172.21.15.57:0/4126086273 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2e58047460 con 0x7f2e600b26d0 2021-06-25T04:54:36.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 -- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e3c055450 msgr2=0x7f2e3c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e3c055450 0x7f2e3c057910 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f2e54017000 tx=0x7f2e54014000).stop 2021-06-25T04:54:36.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 -- 172.21.15.57:0/4126086273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e600b26d0 msgr2=0x7f2e600b07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:36.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e600b26d0 0x7f2e600b07d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f2e58001490 tx=0x7f2e58007dd0).stop 2021-06-25T04:54:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 -- 172.21.15.57:0/4126086273 shutdown_connections 2021-06-25T04:54:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2e3c055450 0x7f2e3c057910 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e600b26d0 0x7f2e600b07d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e60061190 0x7f2e60152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 --2- 172.21.15.57:0/4126086273 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e6005ff20 0x7f2e600ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 -- 172.21.15.57:0/4126086273 >> 172.21.15.57:0/4126086273 conn(0x7f2e6005cf20 msgr2=0x7f2e6013f790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:37.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 -- 172.21.15.57:0/4126086273 shutdown_connections 2021-06-25T04:54:37.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:36.993+0000 7f2e673a6700 1 -- 172.21.15.57:0/4126086273 wait complete. 2021-06-25T04:54:37.010 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:37.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.113+0000 7efce5228700 1 Processor -- start 2021-06-25T04:54:37.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.113+0000 7efce5228700 1 -- start start 2021-06-25T04:54:37.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.113+0000 7efce5228700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efce00670e0 0x7efce00b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efce5228700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce00b9b90 con 0x7efce0143970 2021-06-25T04:54:37.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efce5228700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce00674c0 con 0x7efce013ffb0 2021-06-25T04:54:37.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efce5228700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce0143040 con 0x7efce00670e0 2021-06-25T04:54:37.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcde59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efce0143970 0x7efce00aebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57514/0 (socket says 172.21.15.57:57514) 2021-06-25T04:54:37.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcde59c700 1 -- 172.21.15.57:0/3378698740 learned_addr learned my addr 172.21.15.57:0/3378698740 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:37.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcded9d700 1 --2- 172.21.15.57:0/3378698740 >> v2:172.21.15.87:3300/0 conn(0x7efce00670e0 0x7efce00b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcddd9b700 1 -- 172.21.15.57:0/3378698740 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682725800 0 0) 0x7efcd4001110 con 0x7efce0143970 2021-06-25T04:54:37.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcddd9b700 1 -- 172.21.15.57:0/3378698740 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc4003260 con 0x7efce0143970 2021-06-25T04:54:37.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcddd9b700 1 -- 172.21.15.57:0/3378698740 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509264957 0 0) 0x7efce00674c0 con 0x7efce013ffb0 2021-06-25T04:54:37.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcddd9b700 1 -- 172.21.15.57:0/3378698740 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd4001110 con 0x7efce013ffb0 2021-06-25T04:54:37.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcddd9b700 1 -- 172.21.15.57:0/3378698740 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4126409723 0 0) 0x7efcc4003260 con 0x7efce0143970 2021-06-25T04:54:37.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcded9d700 1 -- 172.21.15.57:0/3378698740 >> v1:172.21.15.87:6789/0 conn(0x7efce013ffb0 legacy=0x7efce0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcded9d700 1 -- 172.21.15.57:0/3378698740 >> v1:172.21.15.57:6789/0 conn(0x7efce0143970 legacy=0x7efce00aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcded9d700 1 -- 172.21.15.57:0/3378698740 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce00af490 con 0x7efce00670e0 2021-06-25T04:54:37.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcded9d700 1 --2- 172.21.15.57:0/3378698740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efce00670e0 0x7efce00b96a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7efcd40012a0 tx=0x7efcd0006df0).ready entity=mon.1 client_cookie=70ad89ca5fae2fdc server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:37.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcddd9b700 1 -- 172.21.15.57:0/3378698740 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcd40017f0 con 0x7efce00670e0 2021-06-25T04:54:37.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcddd9b700 1 -- 172.21.15.57:0/3378698740 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd0000e90 con 0x7efce00670e0 2021-06-25T04:54:37.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efcddd9b700 1 -- 172.21.15.57:0/3378698740 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcd0012460 con 0x7efce00670e0 2021-06-25T04:54:37.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efce5228700 1 -- 172.21.15.57:0/3378698740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efce00670e0 msgr2=0x7efce00b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efce5228700 1 --2- 172.21.15.57:0/3378698740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efce00670e0 0x7efce00b96a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7efcd40012a0 tx=0x7efcd0006df0).stop 2021-06-25T04:54:37.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efce5228700 1 -- 172.21.15.57:0/3378698740 shutdown_connections 2021-06-25T04:54:37.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efce5228700 1 --2- 172.21.15.57:0/3378698740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efce00670e0 0x7efce00b96a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efce5228700 1 -- 172.21.15.57:0/3378698740 >> 172.21.15.57:0/3378698740 conn(0x7efce005f9b0 msgr2=0x7efce0061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:37.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efce5228700 1 -- 172.21.15.57:0/3378698740 shutdown_connections 2021-06-25T04:54:37.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.117+0000 7efce5228700 1 -- 172.21.15.57:0/3378698740 wait complete. 2021-06-25T04:54:37.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.121+0000 7efce5228700 1 Processor -- start 2021-06-25T04:54:37.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.121+0000 7efce5228700 1 -- start start 2021-06-25T04:54:37.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.121+0000 7efce5228700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce00670e0 0x7efce01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.121+0000 7efce5228700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efce013ffb0 0x7efce0144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.121+0000 7efce5228700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efce0143970 0x7efce01451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.121+0000 7efce5228700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00b40c0 con 0x7efce00670e0 2021-06-25T04:54:37.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.121+0000 7efce5228700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce01456e0 con 0x7efce0143970 2021-06-25T04:54:37.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.121+0000 7efce5228700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce00b3e20 con 0x7efce013ffb0 2021-06-25T04:54:37.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efcded9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce00670e0 0x7efce01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efcded9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce00670e0 0x7efce01393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40300/0 (socket says 172.21.15.57:40300) 2021-06-25T04:54:37.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efcded9d700 1 -- 172.21.15.57:0/986077875 learned_addr learned my addr 172.21.15.57:0/986077875 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:37.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efcde59c700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efce013ffb0 0x7efce0144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efcdf59e700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efce0143970 0x7efce01451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efcded9d700 1 -- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efce013ffb0 msgr2=0x7efce0144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efcded9d700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efce013ffb0 0x7efce0144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efcded9d700 1 -- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efce0143970 msgr2=0x7efce01451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efcded9d700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efce0143970 0x7efce01451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efcded9d700 1 -- 172.21.15.57:0/986077875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd000b180 con 0x7efce00670e0 2021-06-25T04:54:37.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efcded9d700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce00670e0 0x7efce01393c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7efcd40012a0 tx=0x7efcd0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:37.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efccffff700 1 -- 172.21.15.57:0/986077875 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcd0012460 con 0x7efce00670e0 2021-06-25T04:54:37.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efce5228700 1 -- 172.21.15.57:0/986077875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce00ad730 con 0x7efce00670e0 2021-06-25T04:54:37.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efccffff700 1 -- 172.21.15.57:0/986077875 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd000dd00 con 0x7efce00670e0 2021-06-25T04:54:37.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efccffff700 1 -- 172.21.15.57:0/986077875 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcd0006b20 con 0x7efce00670e0 2021-06-25T04:54:37.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efce5228700 1 -- 172.21.15.57:0/986077875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce013a030 con 0x7efce00670e0 2021-06-25T04:54:37.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efce5228700 1 -- 172.21.15.57:0/986077875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce0057310 con 0x7efce00670e0 2021-06-25T04:54:37.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efccffff700 1 -- 172.21.15.57:0/986077875 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7efcd000f030 con 0x7efce00670e0 2021-06-25T04:54:37.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.125+0000 7efccffff700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efcbc055360 0x7efcbc057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.129+0000 7efccffff700 1 -- 172.21.15.57:0/986077875 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efcd006ec10 con 0x7efce00670e0 2021-06-25T04:54:37.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.129+0000 7efcde59c700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efcbc055360 0x7efcbc057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.129+0000 7efcde59c700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efcbc055360 0x7efcbc057820 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7efcd400d000 tx=0x7efcd4000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:37.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.133+0000 7efccffff700 1 -- 172.21.15.57:0/986077875 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7efcd0044d60 con 0x7efce00670e0 2021-06-25T04:54:37.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 -- 172.21.15.57:0/986077875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efce00ae1e0 con 0x7efce00670e0 2021-06-25T04:54:37.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efccffff700 1 -- 172.21.15.57:0/986077875 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7efcd0048340 con 0x7efce00670e0 2021-06-25T04:54:37.304 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:37.304 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/2314323791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2314323791},{"type":"v1","addr":"172.21.15.87:6835","nonce":2314323791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3937527303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3937527303},{"type":"v1","addr":"172.21.15.57:6833","nonce":3937527303}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:35.964849+0000","modified":"2021-06-25T04:54:36.968582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2701177693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2701177693},{"type":"v1","addr":"172.21.15.57:6835","nonce":2701177693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-06-25T04:54:37.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 -- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efcbc055360 msgr2=0x7efcbc057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efcbc055360 0x7efcbc057820 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7efcd400d000 tx=0x7efcd4000bc0).stop 2021-06-25T04:54:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 -- 172.21.15.57:0/986077875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce00670e0 msgr2=0x7efce01393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce00670e0 0x7efce01393c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7efcd40012a0 tx=0x7efcd0014000).stop 2021-06-25T04:54:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 -- 172.21.15.57:0/986077875 shutdown_connections 2021-06-25T04:54:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efcbc055360 0x7efcbc057820 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efce0143970 0x7efce01451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efce013ffb0 0x7efce0144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 --2- 172.21.15.57:0/986077875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce00670e0 0x7efce01393c0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 -- 172.21.15.57:0/986077875 >> 172.21.15.57:0/986077875 conn(0x7efce005f9b0 msgr2=0x7efce00b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:37.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 -- 172.21.15.57:0/986077875 shutdown_connections 2021-06-25T04:54:37.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.301+0000 7efce5228700 1 -- 172.21.15.57:0/986077875 wait complete. 2021-06-25T04:54:37.309 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 41 2021-06-25T04:54:37.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:54:37.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.417+0000 7fcd4759e700 1 Processor -- start 2021-06-25T04:54:37.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.417+0000 7fcd4759e700 1 -- start start 2021-06-25T04:54:37.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.417+0000 7fcd4759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd480ac9f0 0x7fcd480b5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.417+0000 7fcd4759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd480ad830 0x7fcd48143480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.417+0000 7fcd4759e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcd48143970 0x7fcd48066fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.417+0000 7fcd4759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd480acdd0 con 0x7fcd480ad830 2021-06-25T04:54:37.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.417+0000 7fcd4759e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd480b5120 con 0x7fcd48143970 2021-06-25T04:54:37.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.417+0000 7fcd4759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480adea0 con 0x7fcd480ac9f0 2021-06-25T04:54:37.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.417+0000 7fcd3ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd480ad830 0x7fcd48143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4659c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd480ac9f0 0x7fcd480b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd3ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd480ad830 0x7fcd48143480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40312/0 (socket says 172.21.15.57:40312) 2021-06-25T04:54:37.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd46d9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcd48143970 0x7fcd48066fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd3ffff700 1 -- 172.21.15.57:0/1770390313 learned_addr learned my addr 172.21.15.57:0/1770390313 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:37.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd3ffff700 1 -- 172.21.15.57:0/1770390313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd480ac9f0 msgr2=0x7fcd480b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:37.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd3ffff700 1 --2- 172.21.15.57:0/1770390313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd480ac9f0 0x7fcd480b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd3ffff700 1 -- 172.21.15.57:0/1770390313 >> v2:172.21.15.87:3300/0 conn(0x7fcd48143970 msgr2=0x7fcd48066fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:37.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd3ffff700 1 --2- 172.21.15.57:0/1770390313 >> v2:172.21.15.87:3300/0 conn(0x7fcd48143970 0x7fcd48066fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd3ffff700 1 -- 172.21.15.57:0/1770390313 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd480ae140 con 0x7fcd480ad830 2021-06-25T04:54:37.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd3ffff700 1 --2- 172.21.15.57:0/1770390313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd480ad830 0x7fcd48143480 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fcd30002f70 tx=0x7fcd30006eb0).ready entity=mon.0 client_cookie=c3f5e310f848af69 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:37.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd45d9b700 1 -- 172.21.15.57:0/1770390313 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd3000d570 con 0x7fcd480ad830 2021-06-25T04:54:37.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd45d9b700 1 -- 172.21.15.57:0/1770390313 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd30000e90 con 0x7fcd480ad830 2021-06-25T04:54:37.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd45d9b700 1 -- 172.21.15.57:0/1770390313 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd3000d900 con 0x7fcd480ad830 2021-06-25T04:54:37.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4759e700 1 -- 172.21.15.57:0/1770390313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd480ad830 msgr2=0x7fcd48143480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4759e700 1 --2- 172.21.15.57:0/1770390313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd480ad830 0x7fcd48143480 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fcd30002f70 tx=0x7fcd30006eb0).stop 2021-06-25T04:54:37.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4759e700 1 -- 172.21.15.57:0/1770390313 shutdown_connections 2021-06-25T04:54:37.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4759e700 1 --2- 172.21.15.57:0/1770390313 >> v2:172.21.15.87:3300/0 conn(0x7fcd48143970 0x7fcd48066fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4759e700 1 --2- 172.21.15.57:0/1770390313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd480ad830 0x7fcd48143480 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4759e700 1 --2- 172.21.15.57:0/1770390313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd480ac9f0 0x7fcd480b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4759e700 1 -- 172.21.15.57:0/1770390313 >> 172.21.15.57:0/1770390313 conn(0x7fcd48062520 msgr2=0x7fcd48062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:37.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4759e700 1 -- 172.21.15.57:0/1770390313 shutdown_connections 2021-06-25T04:54:37.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4759e700 1 -- 172.21.15.57:0/1770390313 wait complete. 2021-06-25T04:54:37.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4759e700 1 Processor -- start 2021-06-25T04:54:37.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.421+0000 7fcd4759e700 1 -- start start 2021-06-25T04:54:37.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd4759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd480ac9f0 0x7fcd48148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd4759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd480ad830 0x7fcd4813ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd4759e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd48143970 0x7fcd4813b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd4759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480665b0 con 0x7fcd480ad830 2021-06-25T04:54:37.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd4759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd481387d0 con 0x7fcd480ac9f0 2021-06-25T04:54:37.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd4759e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd48066e00 con 0x7fcd48143970 2021-06-25T04:54:37.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd480ad830 0x7fcd4813ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd480ad830 0x7fcd4813ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40316/0 (socket says 172.21.15.57:40316) 2021-06-25T04:54:37.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3ffff700 1 -- 172.21.15.57:0/1285300656 learned_addr learned my addr 172.21.15.57:0/1285300656 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:37.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd4659c700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd480ac9f0 0x7fcd48148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd46d9d700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd48143970 0x7fcd4813b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3ffff700 1 -- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd48143970 msgr2=0x7fcd4813b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3ffff700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd48143970 0x7fcd4813b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3ffff700 1 -- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd480ac9f0 msgr2=0x7fcd48148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3ffff700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd480ac9f0 0x7fcd48148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3ffff700 1 -- 172.21.15.57:0/1285300656 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3000b1e0 con 0x7fcd480ad830 2021-06-25T04:54:37.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd4659c700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd480ac9f0 0x7fcd48148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:37.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3ffff700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd480ad830 0x7fcd4813ae30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fcd30002f70 tx=0x7fcd30015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:37.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3f7fe700 1 -- 172.21.15.57:0/1285300656 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd30011860 con 0x7fcd480ad830 2021-06-25T04:54:37.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3f7fe700 1 -- 172.21.15.57:0/1285300656 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd300119c0 con 0x7fcd480ad830 2021-06-25T04:54:37.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd4759e700 1 -- 172.21.15.57:0/1285300656 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd480667e0 con 0x7fcd480ad830 2021-06-25T04:54:37.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd3f7fe700 1 -- 172.21.15.57:0/1285300656 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd30011d20 con 0x7fcd480ad830 2021-06-25T04:54:37.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd4759e700 1 -- 172.21.15.57:0/1285300656 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd480661b0 con 0x7fcd480ad830 2021-06-25T04:54:37.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.425+0000 7fcd4759e700 1 -- 172.21.15.57:0/1285300656 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd48057310 con 0x7fcd480ad830 2021-06-25T04:54:37.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.429+0000 7fcd3f7fe700 1 -- 172.21.15.57:0/1285300656 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcd3000f070 con 0x7fcd480ad830 2021-06-25T04:54:37.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.429+0000 7fcd3f7fe700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcd200553d0 0x7fcd20057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.429+0000 7fcd3f7fe700 1 -- 172.21.15.57:0/1285300656 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcd3006f760 con 0x7fcd480ad830 2021-06-25T04:54:37.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.429+0000 7fcd4659c700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcd200553d0 0x7fcd20057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.429+0000 7fcd4659c700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcd200553d0 0x7fcd20057890 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fcd3800b000 tx=0x7fcd38008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:37.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.433+0000 7fcd3f7fe700 1 -- 172.21.15.57:0/1285300656 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcd30045800 con 0x7fcd480ad830 2021-06-25T04:54:37.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.561+0000 7fcd4759e700 1 -- 172.21.15.57:0/1285300656 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd48138940 con 0x7fcd480ad830 2021-06-25T04:54:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.565+0000 7fcd3f7fe700 1 -- 172.21.15.57:0/1285300656 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fcd30048e20 con 0x7fcd480ad830 2021-06-25T04:54:37.568 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:37.568 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":88,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:36.967424+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:54:34.391112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-06-25T04:54:35.648616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:54:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 -- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcd200553d0 msgr2=0x7fcd20057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcd200553d0 0x7fcd20057890 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fcd3800b000 tx=0x7fcd38008040).stop 2021-06-25T04:54:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 -- 172.21.15.57:0/1285300656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd480ad830 msgr2=0x7fcd4813ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd480ad830 0x7fcd4813ae30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fcd30002f70 tx=0x7fcd30015000).stop 2021-06-25T04:54:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 -- 172.21.15.57:0/1285300656 shutdown_connections 2021-06-25T04:54:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcd200553d0 0x7fcd20057890 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd48143970 0x7fcd4813b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd480ad830 0x7fcd4813ae30 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 --2- 172.21.15.57:0/1285300656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd480ac9f0 0x7fcd48148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 -- 172.21.15.57:0/1285300656 >> 172.21.15.57:0/1285300656 conn(0x7fcd48062520 msgr2=0x7fcd48149910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 -- 172.21.15.57:0/1285300656 shutdown_connections 2021-06-25T04:54:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.569+0000 7fcd4759e700 1 -- 172.21.15.57:0/1285300656 wait complete. 2021-06-25T04:54:37.587 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:54:37.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec09f11700 1 Processor -- start 2021-06-25T04:54:37.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec09f11700 1 -- start start 2021-06-25T04:54:37.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec09f11700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fec040b6540 0x7fec040b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec09f11700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec040b6920 0x7fec0412b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec09f11700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec04144070 con 0x7fec040b4380 2021-06-25T04:54:37.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec09f11700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec04143b30 con 0x7fec040b6920 2021-06-25T04:54:37.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec09f11700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec04143dd0 con 0x7fec040b6540 2021-06-25T04:54:37.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec03fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec040b6920 0x7fec0412b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec03fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec040b6920 0x7fec0412b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40324/0 (socket says 172.21.15.57:40324) 2021-06-25T04:54:37.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec03fff700 1 -- 172.21.15.57:0/981064267 learned_addr learned my addr 172.21.15.57:0/981064267 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:37.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec037fe700 1 --2- 172.21.15.57:0/981064267 >> v2:172.21.15.87:3300/0 conn(0x7fec040b6540 0x7fec040b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec03fff700 1 -- 172.21.15.57:0/981064267 >> v2:172.21.15.87:3300/0 conn(0x7fec040b6540 msgr2=0x7fec040b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:37.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec03fff700 1 --2- 172.21.15.57:0/981064267 >> v2:172.21.15.87:3300/0 conn(0x7fec040b6540 0x7fec040b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec03fff700 1 -- 172.21.15.57:0/981064267 >> v1:172.21.15.87:6789/0 conn(0x7fec040b4380 legacy=0x7fec04061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:37.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec03fff700 1 -- 172.21.15.57:0/981064267 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec040615b0 con 0x7fec040b6920 2021-06-25T04:54:37.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec037fe700 1 --2- 172.21.15.57:0/981064267 >> v2:172.21.15.87:3300/0 conn(0x7fec040b6540 0x7fec040b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:54:37.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec03fff700 1 --2- 172.21.15.57:0/981064267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec040b6920 0x7fec0412b9c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fec041430e0 tx=0x7febfc009290).ready entity=mon.0 client_cookie=17b368d72882eec2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:37.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec02ffd700 1 -- 172.21.15.57:0/981064267 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febfc00b820 con 0x7fec040b6920 2021-06-25T04:54:37.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec02ffd700 1 -- 172.21.15.57:0/981064267 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc00b980 con 0x7fec040b6920 2021-06-25T04:54:37.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec02ffd700 1 -- 172.21.15.57:0/981064267 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febfc00bb30 con 0x7fec040b6920 2021-06-25T04:54:37.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec09f11700 1 -- 172.21.15.57:0/981064267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec040b6920 msgr2=0x7fec0412b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.697+0000 7fec09f11700 1 --2- 172.21.15.57:0/981064267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec040b6920 0x7fec0412b9c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fec041430e0 tx=0x7febfc009290).stop 2021-06-25T04:54:37.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.701+0000 7fec09f11700 1 -- 172.21.15.57:0/981064267 shutdown_connections 2021-06-25T04:54:37.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.701+0000 7fec09f11700 1 --2- 172.21.15.57:0/981064267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec040b6920 0x7fec0412b9c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.701+0000 7fec09f11700 1 --2- 172.21.15.57:0/981064267 >> v2:172.21.15.87:3300/0 conn(0x7fec040b6540 0x7fec040b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.701+0000 7fec09f11700 1 -- 172.21.15.57:0/981064267 >> 172.21.15.57:0/981064267 conn(0x7fec0405c450 msgr2=0x7fec0405c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:37.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.701+0000 7fec09f11700 1 -- 172.21.15.57:0/981064267 shutdown_connections 2021-06-25T04:54:37.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.701+0000 7fec09f11700 1 -- 172.21.15.57:0/981064267 wait complete. 2021-06-25T04:54:37.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.701+0000 7fec09f11700 1 Processor -- start 2021-06-25T04:54:37.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.701+0000 7fec09f11700 1 -- start start 2021-06-25T04:54:37.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.701+0000 7fec09f11700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec040b4380 0x7fec04125d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.701+0000 7fec09f11700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec040b6540 0x7fec04151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec09f11700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec040b6920 0x7fec041557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec09f11700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec04152e80 con 0x7fec040b4380 2021-06-25T04:54:37.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec09f11700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec04152410 con 0x7fec040b6920 2021-06-25T04:54:37.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec09f11700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec041526a0 con 0x7fec040b6540 2021-06-25T04:54:37.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec040b4380 0x7fec04125d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec040b4380 0x7fec04125d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40328/0 (socket says 172.21.15.57:40328) 2021-06-25T04:54:37.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec037fe700 1 -- 172.21.15.57:0/1706483820 learned_addr learned my addr 172.21.15.57:0/1706483820 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:37.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec03fff700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec040b6920 0x7fec041557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7febfaffd700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec040b6540 0x7fec04151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec037fe700 1 -- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec040b6540 msgr2=0x7fec04151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec037fe700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec040b6540 0x7fec04151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec037fe700 1 -- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec040b6920 msgr2=0x7fec041557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec037fe700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec040b6920 0x7fec041557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec037fe700 1 -- 172.21.15.57:0/1706483820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc009530 con 0x7fec040b4380 2021-06-25T04:54:37.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec037fe700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec040b4380 0x7fec04125d90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7febf4007000 tx=0x7febf4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:37.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec017fa700 1 -- 172.21.15.57:0/1706483820 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febf4010580 con 0x7fec040b4380 2021-06-25T04:54:37.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec017fa700 1 -- 172.21.15.57:0/1706483820 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf40106e0 con 0x7fec040b4380 2021-06-25T04:54:37.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec09f11700 1 -- 172.21.15.57:0/1706483820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec04152940 con 0x7fec040b4380 2021-06-25T04:54:37.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec017fa700 1 -- 172.21.15.57:0/1706483820 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febf4010a40 con 0x7fec040b4380 2021-06-25T04:54:37.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec09f11700 1 -- 172.21.15.57:0/1706483820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0412a310 con 0x7fec040b4380 2021-06-25T04:54:37.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.705+0000 7fec09f11700 1 -- 172.21.15.57:0/1706483820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec04057310 con 0x7fec040b4380 2021-06-25T04:54:37.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.709+0000 7fec017fa700 1 -- 172.21.15.57:0/1706483820 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7febf4010ba0 con 0x7fec040b4380 2021-06-25T04:54:37.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.709+0000 7fec017fa700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7febe8055450 0x7febe8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:37.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.709+0000 7fec017fa700 1 -- 172.21.15.57:0/1706483820 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7febf406dfa0 con 0x7fec040b4380 2021-06-25T04:54:37.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.709+0000 7febfaffd700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7febe8055450 0x7febe8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:37.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.709+0000 7febfaffd700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7febe8055450 0x7febe8057910 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7febec00d000 tx=0x7febec007b70).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:37.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.717+0000 7fec017fa700 1 -- 172.21.15.57:0/1706483820 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7febf40440f0 con 0x7fec040b4380 2021-06-25T04:54:37.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.881+0000 7fec09f11700 1 -- 172.21.15.57:0/1706483820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fec040698a0 con 0x7fec040b4380 2021-06-25T04:54:37.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.889+0000 7fec017fa700 1 -- 172.21.15.57:0/1706483820 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7febf4047710 con 0x7fec040b4380 2021-06-25T04:54:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 -- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7febe8055450 msgr2=0x7febe8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7febe8055450 0x7febe8057910 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7febec00d000 tx=0x7febec007b70).stop 2021-06-25T04:54:37.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 -- 172.21.15.57:0/1706483820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec040b4380 msgr2=0x7fec04125d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:37.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec040b4380 0x7fec04125d90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7febf4007000 tx=0x7febf4008040).stop 2021-06-25T04:54:37.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 -- 172.21.15.57:0/1706483820 shutdown_connections 2021-06-25T04:54:37.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7febe8055450 0x7febe8057910 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec040b6920 0x7fec041557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec040b6540 0x7fec04151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 --2- 172.21.15.57:0/1706483820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec040b4380 0x7fec04125d90 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:37.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 -- 172.21.15.57:0/1706483820 >> 172.21.15.57:0/1706483820 conn(0x7fec0405c450 msgr2=0x7fec04143120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:37.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 -- 172.21.15.57:0/1706483820 shutdown_connections 2021-06-25T04:54:37.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:37.893+0000 7fec09f11700 1 -- 172.21.15.57:0/1706483820 wait complete. 2021-06-25T04:54:37.898 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:54:37.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:54:38.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d6236e700 1 Processor -- start 2021-06-25T04:54:38.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d6236e700 1 -- start start 2021-06-25T04:54:38.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d6236e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d5c0b2540 0x7f7d5c0abad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d6236e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7d5c0b1220 0x7f7d5c0abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d6236e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c0add40 con 0x7f7d5c0b1750 2021-06-25T04:54:38.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d6236e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c0adfe0 con 0x7f7d5c0b1220 2021-06-25T04:54:38.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d6236e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0a9350 con 0x7f7d5c0b2540 2021-06-25T04:54:38.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d60b6b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7d5c0b1220 0x7f7d5c0abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d6136c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d5c0b2540 0x7f7d5c0abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d61b6d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7d5c0b1750 0x7f7d5c0afb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:58304/0 (socket says 172.21.15.57:58304) 2021-06-25T04:54:38.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d60b6b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7d5c0b1220 0x7f7d5c0abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:48832/0 (socket says 172.21.15.57:48832) 2021-06-25T04:54:38.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d61b6d700 1 -- 172.21.15.57:0/1115620963 learned_addr learned my addr 172.21.15.57:0/1115620963 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:38.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d6136c700 1 --2- 172.21.15.57:0/1115620963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d5c0b2540 0x7f7d5c0abad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:51500/0 (socket says 172.21.15.57:51500) 2021-06-25T04:54:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d60b6b700 1 -- 172.21.15.57:0/1115620963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d5c0b2540 msgr2=0x7f7d5c0abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d60b6b700 1 --2- 172.21.15.57:0/1115620963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d5c0b2540 0x7f7d5c0abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d60b6b700 1 -- 172.21.15.57:0/1115620963 >> v1:172.21.15.87:6789/0 conn(0x7f7d5c0b1750 legacy=0x7f7d5c0afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.025+0000 7f7d60b6b700 1 -- 172.21.15.57:0/1115620963 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c0a97f0 con 0x7f7d5c0b1220 2021-06-25T04:54:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d60b6b700 1 --2- 172.21.15.57:0/1115620963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d5c0b1220 0x7f7d5c0abfc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f7d5c0679f0 tx=0x7f7d4c006df0).ready entity=mon.1 client_cookie=574b0cee23512895 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d4bfff700 1 -- 172.21.15.57:0/1115620963 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d4c00d570 con 0x7f7d5c0b1220 2021-06-25T04:54:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d4bfff700 1 -- 172.21.15.57:0/1115620963 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c000e90 con 0x7f7d5c0b1220 2021-06-25T04:54:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d4bfff700 1 -- 172.21.15.57:0/1115620963 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d4c00d8c0 con 0x7f7d5c0b1220 2021-06-25T04:54:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d6236e700 1 -- 172.21.15.57:0/1115620963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d5c0b1220 msgr2=0x7f7d5c0abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d6236e700 1 --2- 172.21.15.57:0/1115620963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d5c0b1220 0x7f7d5c0abfc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f7d5c0679f0 tx=0x7f7d4c006df0).stop 2021-06-25T04:54:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d6236e700 1 -- 172.21.15.57:0/1115620963 shutdown_connections 2021-06-25T04:54:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d6236e700 1 --2- 172.21.15.57:0/1115620963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d5c0b1220 0x7f7d5c0abfc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d6236e700 1 --2- 172.21.15.57:0/1115620963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d5c0b2540 0x7f7d5c0abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d6236e700 1 -- 172.21.15.57:0/1115620963 >> 172.21.15.57:0/1115620963 conn(0x7f7d5c060140 msgr2=0x7f7d5c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d6236e700 1 -- 172.21.15.57:0/1115620963 shutdown_connections 2021-06-25T04:54:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d6236e700 1 -- 172.21.15.57:0/1115620963 wait complete. 2021-06-25T04:54:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d6236e700 1 Processor -- start 2021-06-25T04:54:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.029+0000 7f7d6236e700 1 -- start start 2021-06-25T04:54:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6236e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0b1220 0x7f7d5c05c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6236e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d5c0b1750 0x7f7d5c0634d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6236e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d5c0b2540 0x7f7d5c140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6236e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0a3030 con 0x7f7d5c0b1220 2021-06-25T04:54:38.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6236e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c066ab0 con 0x7f7d5c0b2540 2021-06-25T04:54:38.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6236e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0aabb0 con 0x7f7d5c0b1750 2021-06-25T04:54:38.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6136c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0b1220 0x7f7d5c05c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d60b6b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d5c0b1750 0x7f7d5c0634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d61b6d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d5c0b2540 0x7f7d5c140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6136c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0b1220 0x7f7d5c05c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40342/0 (socket says 172.21.15.57:40342) 2021-06-25T04:54:38.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6136c700 1 -- 172.21.15.57:0/3471780405 learned_addr learned my addr 172.21.15.57:0/3471780405 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:38.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6136c700 1 -- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d5c0b1750 msgr2=0x7f7d5c0634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6136c700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d5c0b1750 0x7f7d5c0634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6136c700 1 -- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d5c0b2540 msgr2=0x7f7d5c140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6136c700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d5c0b2540 0x7f7d5c140450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6136c700 1 -- 172.21.15.57:0/3471780405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c00b180 con 0x7f7d5c0b1220 2021-06-25T04:54:38.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6136c700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0b1220 0x7f7d5c05c790 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f7d5800c000 tx=0x7f7d58006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:38.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d4a7fc700 1 -- 172.21.15.57:0/3471780405 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d58011750 con 0x7f7d5c0b1220 2021-06-25T04:54:38.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d4a7fc700 1 -- 172.21.15.57:0/3471780405 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d580118b0 con 0x7f7d5c0b1220 2021-06-25T04:54:38.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d4a7fc700 1 -- 172.21.15.57:0/3471780405 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d58011c10 con 0x7f7d5c0b1220 2021-06-25T04:54:38.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6236e700 1 -- 172.21.15.57:0/3471780405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c0a2d90 con 0x7f7d5c0b1220 2021-06-25T04:54:38.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.033+0000 7f7d6236e700 1 -- 172.21.15.57:0/3471780405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c05ced0 con 0x7f7d5c0b1220 2021-06-25T04:54:38.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.037+0000 7f7d6236e700 1 -- 172.21.15.57:0/3471780405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c152c90 con 0x7f7d5c0b1220 2021-06-25T04:54:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.037+0000 7f7d4a7fc700 1 -- 172.21.15.57:0/3471780405 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7d58011d70 con 0x7f7d5c0b1220 2021-06-25T04:54:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.037+0000 7f7d4a7fc700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7d3c0554e0 0x7f7d3c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.037+0000 7f7d4a7fc700 1 -- 172.21.15.57:0/3471780405 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7d5806e370 con 0x7f7d5c0b1220 2021-06-25T04:54:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.037+0000 7f7d60b6b700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7d3c0554e0 0x7f7d3c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.037+0000 7f7d60b6b700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7d3c0554e0 0x7f7d3c0579a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f7d4c019000 tx=0x7f7d4c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.041+0000 7f7d4a7fc700 1 -- 172.21.15.57:0/3471780405 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7d58044480 con 0x7f7d5c0b1220 2021-06-25T04:54:38.077 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:54:38.080 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:54:38.082 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:54:38.085 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:54:38.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.213+0000 7f7d6236e700 1 -- 172.21.15.57:0/3471780405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7d5c057310 con 0x7f7d5c0b1220 2021-06-25T04:54:38.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d4a7fc700 1 -- 172.21.15.57:0/3471780405 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7d58047aa0 con 0x7f7d5c0b1220 2021-06-25T04:54:38.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 -- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7d3c0554e0 msgr2=0x7f7d3c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7d3c0554e0 0x7f7d3c0579a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f7d4c019000 tx=0x7f7d4c014000).stop 2021-06-25T04:54:38.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 -- 172.21.15.57:0/3471780405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0b1220 msgr2=0x7f7d5c05c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0b1220 0x7f7d5c05c790 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f7d5800c000 tx=0x7f7d58006df0).stop 2021-06-25T04:54:38.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 -- 172.21.15.57:0/3471780405 shutdown_connections 2021-06-25T04:54:38.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7d3c0554e0 0x7f7d3c0579a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d5c0b2540 0x7f7d5c140450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d5c0b1750 0x7f7d5c0634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 --2- 172.21.15.57:0/3471780405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0b1220 0x7f7d5c05c790 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 -- 172.21.15.57:0/3471780405 >> 172.21.15.57:0/3471780405 conn(0x7f7d5c060140 msgr2=0x7f7d5c146450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:38.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 -- 172.21.15.57:0/3471780405 shutdown_connections 2021-06-25T04:54:38.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.225+0000 7f7d6236e700 1 -- 172.21.15.57:0/3471780405 wait complete. 2021-06-25T04:54:38.233 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:54:38.243 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:38.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 Processor -- start 2021-06-25T04:54:38.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 -- start start 2021-06-25T04:54:38.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8694067140 0x7f869405f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86940b1930 0x7f869405fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86940a7a50 con 0x7f86940a7670 2021-06-25T04:54:38.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86941475e0 con 0x7f86940b1930 2021-06-25T04:54:38.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8694147880 con 0x7f8694067140 2021-06-25T04:54:38.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8699b3f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86940b1930 0x7f869405fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869933e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f86940a7670 0x7f8694066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57568/0 (socket says 172.21.15.57:57568) 2021-06-25T04:54:38.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8699b3f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86940b1930 0x7f869405fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40354/0 (socket says 172.21.15.57:40354) 2021-06-25T04:54:38.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869933e700 1 -- 172.21.15.57:0/3136985612 learned_addr learned my addr 172.21.15.57:0/3136985612 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:38.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8698b3d700 1 --2- 172.21.15.57:0/3136985612 >> v2:172.21.15.87:3300/0 conn(0x7f8694067140 0x7f869405f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8699b3f700 1 -- 172.21.15.57:0/3136985612 >> v2:172.21.15.87:3300/0 conn(0x7f8694067140 msgr2=0x7f869405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:38.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8699b3f700 1 --2- 172.21.15.57:0/3136985612 >> v2:172.21.15.87:3300/0 conn(0x7f8694067140 0x7f869405f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8699b3f700 1 -- 172.21.15.57:0/3136985612 >> v1:172.21.15.57:6789/0 conn(0x7f86940a7670 legacy=0x7f8694066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8687fff700 1 -- 172.21.15.57:0/3136985612 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088201069 0 0) 0x7f86940a7a50 con 0x7f86940a7670 2021-06-25T04:54:38.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8699b3f700 1 -- 172.21.15.57:0/3136985612 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8694147b20 con 0x7f86940b1930 2021-06-25T04:54:38.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8699b3f700 1 --2- 172.21.15.57:0/3136985612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86940b1930 0x7f869405fb60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f868c0032f0 tx=0x7f868c0091d0).ready entity=mon.0 client_cookie=e8bc051afcfa0bab server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:38.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8687fff700 1 -- 172.21.15.57:0/3136985612 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f868c00b680 con 0x7f86940b1930 2021-06-25T04:54:38.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8687fff700 1 -- 172.21.15.57:0/3136985612 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c00b7e0 con 0x7f86940b1930 2021-06-25T04:54:38.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f8687fff700 1 -- 172.21.15.57:0/3136985612 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f868c00b950 con 0x7f86940b1930 2021-06-25T04:54:38.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 -- 172.21.15.57:0/3136985612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86940b1930 msgr2=0x7f869405fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 --2- 172.21.15.57:0/3136985612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86940b1930 0x7f869405fb60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f868c0032f0 tx=0x7f868c0091d0).stop 2021-06-25T04:54:38.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 -- 172.21.15.57:0/3136985612 shutdown_connections 2021-06-25T04:54:38.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 --2- 172.21.15.57:0/3136985612 >> v2:172.21.15.87:3300/0 conn(0x7f8694067140 0x7f869405f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 --2- 172.21.15.57:0/3136985612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86940b1930 0x7f869405fb60 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 -- 172.21.15.57:0/3136985612 >> 172.21.15.57:0/3136985612 conn(0x7f86940b53a0 msgr2=0x7f86940b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:38.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.345+0000 7f869b5a2700 1 -- 172.21.15.57:0/3136985612 shutdown_connections 2021-06-25T04:54:38.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.349+0000 7f869b5a2700 1 -- 172.21.15.57:0/3136985612 wait complete. 2021-06-25T04:54:38.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.349+0000 7f869b5a2700 1 Processor -- start 2021-06-25T04:54:38.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.349+0000 7f869b5a2700 1 -- start start 2021-06-25T04:54:38.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.349+0000 7f869b5a2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8694067140 0x7f869414d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.349+0000 7f869b5a2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86940a7670 0x7f86940ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.349+0000 7f869b5a2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86940b1930 0x7f8694144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.349+0000 7f869b5a2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86940ab0a0 con 0x7f86940a7670 2021-06-25T04:54:38.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.349+0000 7f869b5a2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86940aa750 con 0x7f8694067140 2021-06-25T04:54:38.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.349+0000 7f869b5a2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86940af780 con 0x7f86940b1930 2021-06-25T04:54:38.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f8698b3d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86940a7670 0x7f86940ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f8698b3d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86940a7670 0x7f86940ac820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40358/0 (socket says 172.21.15.57:40358) 2021-06-25T04:54:38.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f8698b3d700 1 -- 172.21.15.57:0/2263495459 learned_addr learned my addr 172.21.15.57:0/2263495459 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:38.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f869933e700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8694067140 0x7f869414d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f8699b3f700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86940b1930 0x7f8694144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f8698b3d700 1 -- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86940b1930 msgr2=0x7f8694144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f8698b3d700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86940b1930 0x7f8694144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f8698b3d700 1 -- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8694067140 msgr2=0x7f869414d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f8698b3d700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8694067140 0x7f869414d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f8698b3d700 1 -- 172.21.15.57:0/2263495459 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c009470 con 0x7f86940a7670 2021-06-25T04:54:38.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f8698b3d700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86940a7670 0x7f86940ac820 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f869000c000 tx=0x7f8690006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:38.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f86867fc700 1 -- 172.21.15.57:0/2263495459 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8690010780 con 0x7f86940a7670 2021-06-25T04:54:38.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f86867fc700 1 -- 172.21.15.57:0/2263495459 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86900108e0 con 0x7f86940a7670 2021-06-25T04:54:38.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f869b5a2700 1 -- 172.21.15.57:0/2263495459 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869414e1b0 con 0x7f86940a7670 2021-06-25T04:54:38.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f86867fc700 1 -- 172.21.15.57:0/2263495459 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8690010c40 con 0x7f86940a7670 2021-06-25T04:54:38.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f869b5a2700 1 -- 172.21.15.57:0/2263495459 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86940acd10 con 0x7f86940a7670 2021-06-25T04:54:38.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f869b5a2700 1 -- 172.21.15.57:0/2263495459 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86940aa950 con 0x7f86940a7670 2021-06-25T04:54:38.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f86867fc700 1 -- 172.21.15.57:0/2263495459 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f869001c460 con 0x7f86940a7670 2021-06-25T04:54:38.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f86867fc700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f867c055340 0x7f867c057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:38.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f86867fc700 1 -- 172.21.15.57:0/2263495459 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f869006e350 con 0x7f86940a7670 2021-06-25T04:54:38.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.353+0000 7f869933e700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f867c055340 0x7f867c057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:38.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.357+0000 7f869933e700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f867c055340 0x7f867c057800 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f868800d000 tx=0x7f86880011a0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:38.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.361+0000 7f86867fc700 1 -- 172.21.15.57:0/2263495459 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8690044400 con 0x7f86940a7670 2021-06-25T04:54:38.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.529+0000 7f869b5a2700 1 -- 172.21.15.57:0/2263495459 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8694057310 con 0x7f86940a7670 2021-06-25T04:54:38.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.529+0000 7f86867fc700 1 -- 172.21.15.57:0/2263495459 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f8690047a20 con 0x7f86940a7670 2021-06-25T04:54:38.533 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:38.534 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/2314323791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2314323791},{"type":"v1","addr":"172.21.15.87:6835","nonce":2314323791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3937527303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3937527303},{"type":"v1","addr":"172.21.15.57:6833","nonce":3937527303}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:35.964849+0000","modified":"2021-06-25T04:54:36.968582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2701177693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2701177693},{"type":"v1","addr":"172.21.15.57:6835","nonce":2701177693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-06-25T04:54:38.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 -- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f867c055340 msgr2=0x7f867c057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f867c055340 0x7f867c057800 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f868800d000 tx=0x7f86880011a0).stop 2021-06-25T04:54:38.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 -- 172.21.15.57:0/2263495459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86940a7670 msgr2=0x7f86940ac820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:38.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86940a7670 0x7f86940ac820 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f869000c000 tx=0x7f8690006df0).stop 2021-06-25T04:54:38.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 -- 172.21.15.57:0/2263495459 shutdown_connections 2021-06-25T04:54:38.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f867c055340 0x7f867c057800 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86940b1930 0x7f8694144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86940a7670 0x7f86940ac820 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 --2- 172.21.15.57:0/2263495459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8694067140 0x7f869414d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:38.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 -- 172.21.15.57:0/2263495459 >> 172.21.15.57:0/2263495459 conn(0x7f86940b53a0 msgr2=0x7f86940b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:38.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 -- 172.21.15.57:0/2263495459 shutdown_connections 2021-06-25T04:54:38.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:38.533+0000 7f869b5a2700 1 -- 172.21.15.57:0/2263495459 wait complete. 2021-06-25T04:54:38.540 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 41 2021-06-25T04:54:38.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:54:35.964849+0000', 'modified': '2021-06-25T04:54:36.968582+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6678}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6678': {'gid': 6678, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2701177693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2701177693}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2701177693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:54:38.858 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:54:38.858 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:54:38.978 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":6678,"want_state":"up:active","state":"up:active","rank_uptime":2.9999528569999998,"mdsmap_epoch":41,"osdmap_epoch":88,"osdmap_epoch_barrier":88,"uptime":7.3468653249999996} 2021-06-25T04:54:38.979 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 6678, "mdsmap_epoch": 41, "osdmap_epoch": 88, "osdmap_epoch_barrier": 88, "rank_uptime": 2.999952857, "state": "up:active", "uptime": 7.346865325, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:54:38.979 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:54:39.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709f807700 1 Processor -- start 2021-06-25T04:54:39.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709f807700 1 -- start start 2021-06-25T04:54:39.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709f807700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7098067140 0x7f709805f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709f807700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70980a7a50 con 0x7f70980a7670 2021-06-25T04:54:39.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709f807700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70981475e0 con 0x7f70980b1930 2021-06-25T04:54:39.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709f807700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7098147880 con 0x7f7098067140 2021-06-25T04:54:39.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709d5a3700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f70980a7670 0x7f7098066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57582/0 (socket says 172.21.15.57:57582) 2021-06-25T04:54:39.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709d5a3700 1 -- 172.21.15.57:0/101953288 learned_addr learned my addr 172.21.15.57:0/101953288 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:39.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709cda2700 1 --2- 172.21.15.57:0/101953288 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7098067140 0x7f709805f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f708bfff700 1 -- 172.21.15.57:0/101953288 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283493947 0 0) 0x7f70980a7a50 con 0x7f70980a7670 2021-06-25T04:54:39.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f708bfff700 1 -- 172.21.15.57:0/101953288 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f707c003260 con 0x7f70980a7670 2021-06-25T04:54:39.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f708bfff700 1 -- 172.21.15.57:0/101953288 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211181399 0 0) 0x7f70981475e0 con 0x7f70980b1930 2021-06-25T04:54:39.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709cda2700 1 -- 172.21.15.57:0/101953288 >> v1:172.21.15.87:6789/0 conn(0x7f70980b1930 legacy=0x7f709805fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709cda2700 1 -- 172.21.15.57:0/101953288 >> v1:172.21.15.57:6789/0 conn(0x7f70980a7670 legacy=0x7f7098066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709cda2700 1 -- 172.21.15.57:0/101953288 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7098147b20 con 0x7f7098067140 2021-06-25T04:54:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709cda2700 1 --2- 172.21.15.57:0/101953288 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7098067140 0x7f709805f670 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f70900032f0 tx=0x7f70900091d0).ready entity=mon.2 client_cookie=771512b334ab04c8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f708bfff700 1 -- 172.21.15.57:0/101953288 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709000b6c0 con 0x7f7098067140 2021-06-25T04:54:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f708bfff700 1 -- 172.21.15.57:0/101953288 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709000b820 con 0x7f7098067140 2021-06-25T04:54:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709f807700 1 -- 172.21.15.57:0/101953288 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7098067140 msgr2=0x7f709805f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f708bfff700 1 -- 172.21.15.57:0/101953288 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709000b990 con 0x7f7098067140 2021-06-25T04:54:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.085+0000 7f709f807700 1 --2- 172.21.15.57:0/101953288 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7098067140 0x7f709805f670 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f70900032f0 tx=0x7f70900091d0).stop 2021-06-25T04:54:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 -- 172.21.15.57:0/101953288 shutdown_connections 2021-06-25T04:54:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 --2- 172.21.15.57:0/101953288 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7098067140 0x7f709805f670 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 -- 172.21.15.57:0/101953288 >> 172.21.15.57:0/101953288 conn(0x7f70980b53a0 msgr2=0x7f70980b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 -- 172.21.15.57:0/101953288 shutdown_connections 2021-06-25T04:54:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 -- 172.21.15.57:0/101953288 wait complete. 2021-06-25T04:54:39.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 Processor -- start 2021-06-25T04:54:39.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 -- start start 2021-06-25T04:54:39.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7098067140 0x7f70980a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70980a7670 0x7f70980ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70980b1930 0x7f70980aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70980aa180 con 0x7f7098067140 2021-06-25T04:54:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709814d3c0 con 0x7f70980b1930 2021-06-25T04:54:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709f807700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709814d660 con 0x7f70980a7670 2021-06-25T04:54:39.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709d5a3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7098067140 0x7f70980a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709d5a3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7098067140 0x7f70980a9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40370/0 (socket says 172.21.15.57:40370) 2021-06-25T04:54:39.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709d5a3700 1 -- 172.21.15.57:0/3161159912 learned_addr learned my addr 172.21.15.57:0/3161159912 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:39.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709cda2700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70980a7670 0x7f70980ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709dda4700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70980b1930 0x7f70980aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709d5a3700 1 -- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70980a7670 msgr2=0x7f70980ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709d5a3700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70980a7670 0x7f70980ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709d5a3700 1 -- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70980b1930 msgr2=0x7f70980aaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709d5a3700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70980b1930 0x7f70980aaca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709d5a3700 1 -- 172.21.15.57:0/3161159912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090009470 con 0x7f7098067140 2021-06-25T04:54:39.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.089+0000 7f709dda4700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70980b1930 0x7f70980aaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:39.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.093+0000 7f709d5a3700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7098067140 0x7f70980a9530 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f708c001110 tx=0x7f708c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.093+0000 7f708a7fc700 1 -- 172.21.15.57:0/3161159912 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f708c007110 con 0x7f7098067140 2021-06-25T04:54:39.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.093+0000 7f708a7fc700 1 -- 172.21.15.57:0/3161159912 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c007270 con 0x7f7098067140 2021-06-25T04:54:39.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.093+0000 7f709f807700 1 -- 172.21.15.57:0/3161159912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709814d900 con 0x7f7098067140 2021-06-25T04:54:39.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.093+0000 7f708a7fc700 1 -- 172.21.15.57:0/3161159912 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f708c005030 con 0x7f7098067140 2021-06-25T04:54:39.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.093+0000 7f709f807700 1 -- 172.21.15.57:0/3161159912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70980aece0 con 0x7f7098067140 2021-06-25T04:54:39.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.093+0000 7f708a7fc700 1 -- 172.21.15.57:0/3161159912 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f708c01b070 con 0x7f7098067140 2021-06-25T04:54:39.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.093+0000 7f709f807700 1 -- 172.21.15.57:0/3161159912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7098057310 con 0x7f7098067140 2021-06-25T04:54:39.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.093+0000 7f708a7fc700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7080055450 0x7f7080057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.093+0000 7f708a7fc700 1 -- 172.21.15.57:0/3161159912 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f708c06d5b0 con 0x7f7098067140 2021-06-25T04:54:39.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.093+0000 7f709cda2700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7080055450 0x7f7080057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.097+0000 7f709cda2700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7080055450 0x7f7080057910 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f709001b000 tx=0x7f7090016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.105+0000 7f708a7fc700 1 -- 172.21.15.57:0/3161159912 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f708c043650 con 0x7f7098067140 2021-06-25T04:54:39.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.229+0000 7f709f807700 1 -- 172.21.15.57:0/3161159912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7098060a00 con 0x7f7098067140 2021-06-25T04:54:39.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.233+0000 7f708a7fc700 1 -- 172.21.15.57:0/3161159912 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f708c046c70 con 0x7f7098067140 2021-06-25T04:54:39.236 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:39.237 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":88,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:36.967424+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:54:34.391112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-06-25T04:54:35.648616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:54:39.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 -- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7080055450 msgr2=0x7f7080057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7080055450 0x7f7080057910 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f709001b000 tx=0x7f7090016000).stop 2021-06-25T04:54:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 -- 172.21.15.57:0/3161159912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7098067140 msgr2=0x7f70980a9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7098067140 0x7f70980a9530 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f708c001110 tx=0x7f708c007a80).stop 2021-06-25T04:54:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 -- 172.21.15.57:0/3161159912 shutdown_connections 2021-06-25T04:54:39.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7080055450 0x7f7080057910 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70980b1930 0x7f70980aaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70980a7670 0x7f70980ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 --2- 172.21.15.57:0/3161159912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7098067140 0x7f70980a9530 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 -- 172.21.15.57:0/3161159912 >> 172.21.15.57:0/3161159912 conn(0x7f70980b53a0 msgr2=0x7f7098148df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:39.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 -- 172.21.15.57:0/3161159912 shutdown_connections 2021-06-25T04:54:39.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.237+0000 7f709f807700 1 -- 172.21.15.57:0/3161159912 wait complete. 2021-06-25T04:54:39.254 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:54:34.391112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:54:35.648616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:54:39.255 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:54:39.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41bc225700 1 Processor -- start 2021-06-25T04:54:39.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41bc225700 1 -- start start 2021-06-25T04:54:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41bc225700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41b40b3040 0x7f41b414df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41bc225700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b40ae610 con 0x7f41b40b13b0 2021-06-25T04:54:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41bc225700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b40b1790 con 0x7f41b40b1d20 2021-06-25T04:54:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41bc225700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40b22a0 con 0x7f41b40b3040 2021-06-25T04:54:39.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b9fc1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f41b40b13b0 0x7f41b4146b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57596/0 (socket says 172.21.15.57:57596) 2021-06-25T04:54:39.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b9fc1700 1 -- 172.21.15.57:0/3659648027 learned_addr learned my addr 172.21.15.57:0/3659648027 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:39.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41ba7c2700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41b40b3040 0x7f41b414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874086183 0 0) 0x7f41b40ae610 con 0x7f41b40b13b0 2021-06-25T04:54:39.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f419c003260 con 0x7f41b40b13b0 2021-06-25T04:54:39.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290666668 0 0) 0x7f41b40b1790 con 0x7f41b40b1d20 2021-06-25T04:54:39.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41b40ae610 con 0x7f41b40b1d20 2021-06-25T04:54:39.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 704739747 0 0) 0x7f419c003260 con 0x7f41b40b13b0 2021-06-25T04:54:39.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41b40b3040 msgr2=0x7f41b414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:39.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41b40b3040 0x7f41b414df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 >> v1:172.21.15.87:6789/0 conn(0x7f41b40b1d20 legacy=0x7f41b4147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b40b2540 con 0x7f41b40b13b0 2021-06-25T04:54:39.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f41b00019e0 con 0x7f41b40b13b0 2021-06-25T04:54:39.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 >> v1:172.21.15.57:6789/0 conn(0x7f41b40b13b0 legacy=0x7f41b4146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f419c004970 0x7f419c004d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f419c0034a0 0x7f419c003920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f419c003e10 0x7f419c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40b22a0 con 0x7f419c004970 2021-06-25T04:54:39.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c00bcf0 con 0x7f419c003e10 2021-06-25T04:54:39.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c00beb0 con 0x7f419c0034a0 2021-06-25T04:54:39.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b9fc1700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f419c004970 0x7f419c004d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41ba7c2700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41b40b3040 0x7f41b414df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:39.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.365+0000 7f41b97c0700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f419c0034a0 0x7f419c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41b9fc1700 1 -- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f419c0034a0 msgr2=0x7f419c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:39.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41ba7c2700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f419c003e10 0x7f419c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41b9fc1700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f419c0034a0 0x7f419c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41b9fc1700 1 -- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f419c003e10 msgr2=0x7f419c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:39.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41b9fc1700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f419c003e10 0x7f419c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41b9fc1700 1 -- 172.21.15.57:0/3659648027 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c003260 con 0x7f419c004970 2021-06-25T04:54:39.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41ba7c2700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f419c003e10 0x7f419c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:54:39.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41b9fc1700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f419c004970 0x7f419c004d70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f41b00017b0 tx=0x7f41b40b3ec0).ready entity=mon.0 client_cookie=396c2d29746208b2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41b000cca0 con 0x7f419c004970 2021-06-25T04:54:39.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b000ce00 con 0x7f419c004970 2021-06-25T04:54:39.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41b8fbf700 1 -- 172.21.15.57:0/3659648027 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41b0005b80 con 0x7f419c004970 2021-06-25T04:54:39.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41bc225700 1 -- 172.21.15.57:0/3659648027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f419c004970 msgr2=0x7f419c004d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41bc225700 1 --2- 172.21.15.57:0/3659648027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f419c004970 0x7f419c004d70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f41b00017b0 tx=0x7f41b40b3ec0).stop 2021-06-25T04:54:39.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41ba7c2700 1 -- 172.21.15.57:0/3659648027 reap_dead start 2021-06-25T04:54:39.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41bc225700 1 -- 172.21.15.57:0/3659648027 shutdown_connections 2021-06-25T04:54:39.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41bc225700 1 -- 172.21.15.57:0/3659648027 >> 172.21.15.57:0/3659648027 conn(0x7f41b4060780 msgr2=0x7f41b4060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:39.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41bc225700 1 -- 172.21.15.57:0/3659648027 shutdown_connections 2021-06-25T04:54:39.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41bc225700 1 -- 172.21.15.57:0/3659648027 wait complete. 2021-06-25T04:54:39.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41bc225700 1 Processor -- start 2021-06-25T04:54:39.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.369+0000 7f41bc225700 1 -- start start 2021-06-25T04:54:39.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41bc225700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41b4063bd0 0x7f41b4064670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41bc225700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b4063fb0 0x7f41b4064b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41bc225700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4065800 0x7f41b40a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41bc225700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b4066f30 con 0x7f41b4065800 2021-06-25T04:54:39.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41bc225700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40678a0 con 0x7f41b4063fb0 2021-06-25T04:54:39.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41bc225700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b4153330 con 0x7f41b4063bd0 2021-06-25T04:54:39.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41ba7c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4065800 0x7f41b40a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41ba7c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4065800 0x7f41b40a90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40394/0 (socket says 172.21.15.57:40394) 2021-06-25T04:54:39.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41b97c0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b4063fb0 0x7f41b4064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41ba7c2700 1 -- 172.21.15.57:0/1061906598 learned_addr learned my addr 172.21.15.57:0/1061906598 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:39.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41b9fc1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41b4063bd0 0x7f41b4064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41ba7c2700 1 -- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41b4063bd0 msgr2=0x7f41b4064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41ba7c2700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41b4063bd0 0x7f41b4064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41ba7c2700 1 -- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b4063fb0 msgr2=0x7f41b4064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41ba7c2700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b4063fb0 0x7f41b4064b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41ba7c2700 1 -- 172.21.15.57:0/1061906598 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b4067160 con 0x7f41b4065800 2021-06-25T04:54:39.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41ba7c2700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4065800 0x7f41b40a90b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f41ac000b60 tx=0x7f41ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41a2ffd700 1 -- 172.21.15.57:0/1061906598 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41ac0114d0 con 0x7f41b4065800 2021-06-25T04:54:39.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41a2ffd700 1 -- 172.21.15.57:0/1061906598 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac011630 con 0x7f41b4065800 2021-06-25T04:54:39.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41bc225700 1 -- 172.21.15.57:0/1061906598 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b40ad760 con 0x7f41b4065800 2021-06-25T04:54:39.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41a2ffd700 1 -- 172.21.15.57:0/1061906598 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41ac011990 con 0x7f41b4065800 2021-06-25T04:54:39.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41bc225700 1 -- 172.21.15.57:0/1061906598 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b4152fe0 con 0x7f41b4065800 2021-06-25T04:54:39.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.373+0000 7f41bc225700 1 -- 172.21.15.57:0/1061906598 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b41534c0 con 0x7f41b4065800 2021-06-25T04:54:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.377+0000 7f41a2ffd700 1 -- 172.21.15.57:0/1061906598 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f41ac01b030 con 0x7f41b4065800 2021-06-25T04:54:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.377+0000 7f41a2ffd700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4194055360 0x7f4194057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.377+0000 7f41a2ffd700 1 -- 172.21.15.57:0/1061906598 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f41ac06db70 con 0x7f41b4065800 2021-06-25T04:54:39.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.377+0000 7f41b9fc1700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4194055360 0x7f4194057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.377+0000 7f41b9fc1700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4194055360 0x7f4194057820 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f41b0018000 tx=0x7f41b0013000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.385+0000 7f41a2ffd700 1 -- 172.21.15.57:0/1061906598 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f41ac043c10 con 0x7f41b4065800 2021-06-25T04:54:39.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 -- 172.21.15.57:0/1061906598 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f41b4057310 con 0x7f41b4065800 2021-06-25T04:54:39.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41a2ffd700 1 -- 172.21.15.57:0/1061906598 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v88) v1 ==== 110+0+10 (secure 0 0 0) 0x7f41ac047230 con 0x7f41b4065800 2021-06-25T04:54:39.516 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:54:39.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 -- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4194055360 msgr2=0x7f4194057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4194055360 0x7f4194057820 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f41b0018000 tx=0x7f41b0013000).stop 2021-06-25T04:54:39.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 -- 172.21.15.57:0/1061906598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4065800 msgr2=0x7f41b40a90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4065800 0x7f41b40a90b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f41ac000b60 tx=0x7f41ac008040).stop 2021-06-25T04:54:39.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 -- 172.21.15.57:0/1061906598 shutdown_connections 2021-06-25T04:54:39.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4194055360 0x7f4194057820 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4065800 0x7f41b40a90b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b4063fb0 0x7f41b4064b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 --2- 172.21.15.57:0/1061906598 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41b4063bd0 0x7f41b4064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 -- 172.21.15.57:0/1061906598 >> 172.21.15.57:0/1061906598 conn(0x7f41b4060780 msgr2=0x7f41b4146a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:39.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 -- 172.21.15.57:0/1061906598 shutdown_connections 2021-06-25T04:54:39.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.513+0000 7f41bc225700 1 -- 172.21.15.57:0/1061906598 wait complete. 2021-06-25T04:54:39.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:54:39.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa9581700 1 Processor -- start 2021-06-25T04:54:39.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa9581700 1 -- start start 2021-06-25T04:54:39.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa9581700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8aa40b7330 0x7f8aa40b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa9581700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aa40b3020 0x7f8aa413e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa9581700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8aa413e6d0 0x7f8aa4064b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa9581700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa40b2340 con 0x7f8aa413e6d0 2021-06-25T04:54:39.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa9581700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa4144210 con 0x7f8aa40b7330 2021-06-25T04:54:39.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa9581700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40b3530 con 0x7f8aa40b3020 2021-06-25T04:54:39.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa8d80700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8aa413e6d0 0x7f8aa4064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa8d80700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8aa413e6d0 0x7f8aa4064b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40402/0 (socket says 172.21.15.57:40402) 2021-06-25T04:54:39.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa8d80700 1 -- 172.21.15.57:0/2653296430 learned_addr learned my addr 172.21.15.57:0/2653296430 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:39.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa3fff700 1 --2- 172.21.15.57:0/2653296430 >> v2:172.21.15.87:3300/0 conn(0x7f8aa40b7330 0x7f8aa40b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa37fe700 1 --2- 172.21.15.57:0/2653296430 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aa40b3020 0x7f8aa413e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa8d80700 1 -- 172.21.15.57:0/2653296430 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aa40b3020 msgr2=0x7f8aa413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:39.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.641+0000 7f8aa8d80700 1 --2- 172.21.15.57:0/2653296430 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aa40b3020 0x7f8aa413e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa8d80700 1 -- 172.21.15.57:0/2653296430 >> v2:172.21.15.87:3300/0 conn(0x7f8aa40b7330 msgr2=0x7f8aa40b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:39.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa8d80700 1 --2- 172.21.15.57:0/2653296430 >> v2:172.21.15.87:3300/0 conn(0x7f8aa40b7330 0x7f8aa40b7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa8d80700 1 -- 172.21.15.57:0/2653296430 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa40b2570 con 0x7f8aa413e6d0 2021-06-25T04:54:39.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa3fff700 1 --2- 172.21.15.57:0/2653296430 >> v2:172.21.15.87:3300/0 conn(0x7f8aa40b7330 0x7f8aa40b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:39.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa8d80700 1 --2- 172.21.15.57:0/2653296430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa413e6d0 0x7f8aa4064b60 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f8a9c0032f0 tx=0x7f8a9c009290).ready entity=mon.0 client_cookie=4a6be2df38490465 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa2ffd700 1 -- 172.21.15.57:0/2653296430 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a9c00b680 con 0x7f8aa413e6d0 2021-06-25T04:54:39.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa2ffd700 1 -- 172.21.15.57:0/2653296430 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c00b7e0 con 0x7f8aa413e6d0 2021-06-25T04:54:39.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa2ffd700 1 -- 172.21.15.57:0/2653296430 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a9c00b950 con 0x7f8aa413e6d0 2021-06-25T04:54:39.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 -- 172.21.15.57:0/2653296430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa413e6d0 msgr2=0x7f8aa4064b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 --2- 172.21.15.57:0/2653296430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa413e6d0 0x7f8aa4064b60 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f8a9c0032f0 tx=0x7f8a9c009290).stop 2021-06-25T04:54:39.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 -- 172.21.15.57:0/2653296430 shutdown_connections 2021-06-25T04:54:39.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 --2- 172.21.15.57:0/2653296430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa413e6d0 0x7f8aa4064b60 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 --2- 172.21.15.57:0/2653296430 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aa40b3020 0x7f8aa413e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 --2- 172.21.15.57:0/2653296430 >> v2:172.21.15.87:3300/0 conn(0x7f8aa40b7330 0x7f8aa40b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 -- 172.21.15.57:0/2653296430 >> 172.21.15.57:0/2653296430 conn(0x7f8aa405f670 msgr2=0x7f8aa405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 -- 172.21.15.57:0/2653296430 shutdown_connections 2021-06-25T04:54:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 -- 172.21.15.57:0/2653296430 wait complete. 2021-06-25T04:54:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 Processor -- start 2021-06-25T04:54:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 -- start start 2021-06-25T04:54:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aa40b3020 0x7f8aa40acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aa40b7330 0x7f8aa414fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa413e6d0 0x7f8aa41502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40ab9d0 con 0x7f8aa413e6d0 2021-06-25T04:54:39.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40ad7d0 con 0x7f8aa40b7330 2021-06-25T04:54:39.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa9581700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40ada70 con 0x7f8aa40b3020 2021-06-25T04:54:39.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa8d80700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa413e6d0 0x7f8aa41502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa8d80700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa413e6d0 0x7f8aa41502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40408/0 (socket says 172.21.15.57:40408) 2021-06-25T04:54:39.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.645+0000 7f8aa8d80700 1 -- 172.21.15.57:0/1293355226 learned_addr learned my addr 172.21.15.57:0/1293355226 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:39.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa37fe700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aa40b7330 0x7f8aa414fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa3fff700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aa40b3020 0x7f8aa40acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa8d80700 1 -- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aa40b3020 msgr2=0x7f8aa40acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa8d80700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aa40b3020 0x7f8aa40acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa8d80700 1 -- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aa40b7330 msgr2=0x7f8aa414fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa8d80700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aa40b7330 0x7f8aa414fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa8d80700 1 -- 172.21.15.57:0/1293355226 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9400b120 con 0x7f8aa413e6d0 2021-06-25T04:54:39.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa8d80700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa413e6d0 0x7f8aa41502a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f8a9c0032f0 tx=0x7f8a9c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa17fa700 1 -- 172.21.15.57:0/1293355226 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a9c01e070 con 0x7f8aa413e6d0 2021-06-25T04:54:39.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa17fa700 1 -- 172.21.15.57:0/1293355226 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c011c30 con 0x7f8aa413e6d0 2021-06-25T04:54:39.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa9581700 1 -- 172.21.15.57:0/1293355226 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c009530 con 0x7f8aa413e6d0 2021-06-25T04:54:39.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa17fa700 1 -- 172.21.15.57:0/1293355226 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a9c01a430 con 0x7f8aa413e6d0 2021-06-25T04:54:39.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa9581700 1 -- 172.21.15.57:0/1293355226 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa4150790 con 0x7f8aa413e6d0 2021-06-25T04:54:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa9581700 1 -- 172.21.15.57:0/1293355226 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa40ad630 con 0x7f8aa413e6d0 2021-06-25T04:54:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.649+0000 7f8aa17fa700 1 -- 172.21.15.57:0/1293355226 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8a9c00f070 con 0x7f8aa413e6d0 2021-06-25T04:54:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.653+0000 7f8aa17fa700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a840553f0 0x7f8a840578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.653+0000 7f8aa17fa700 1 -- 172.21.15.57:0/1293355226 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8a9c06e820 con 0x7f8aa413e6d0 2021-06-25T04:54:39.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.653+0000 7f8aa3fff700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a840553f0 0x7f8a840578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.653+0000 7f8aa3fff700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a840553f0 0x7f8a840578b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f8a94008000 tx=0x7f8a94008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.657+0000 7f8aa17fa700 1 -- 172.21.15.57:0/1293355226 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8aa40ad630 con 0x7f8aa413e6d0 2021-06-25T04:54:39.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.785+0000 7f8aa9581700 1 -- 172.21.15.57:0/1293355226 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8aa40ad630 con 0x7f8aa413e6d0 2021-06-25T04:54:39.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.785+0000 7f8aa17fa700 1 -- 172.21.15.57:0/1293355226 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v88) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8aa40ad630 con 0x7f8aa413e6d0 2021-06-25T04:54:39.790 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:54:39.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 -- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a840553f0 msgr2=0x7f8a840578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a840553f0 0x7f8a840578b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f8a94008000 tx=0x7f8a94008040).stop 2021-06-25T04:54:39.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 -- 172.21.15.57:0/1293355226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa413e6d0 msgr2=0x7f8aa41502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa413e6d0 0x7f8aa41502a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f8a9c0032f0 tx=0x7f8a9c017000).stop 2021-06-25T04:54:39.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 -- 172.21.15.57:0/1293355226 shutdown_connections 2021-06-25T04:54:39.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8a840553f0 0x7f8a840578b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8aa413e6d0 0x7f8aa41502a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aa40b7330 0x7f8aa414fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 --2- 172.21.15.57:0/1293355226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aa40b3020 0x7f8aa40acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 -- 172.21.15.57:0/1293355226 >> 172.21.15.57:0/1293355226 conn(0x7f8aa405f670 msgr2=0x7f8aa40b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:39.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 -- 172.21.15.57:0/1293355226 shutdown_connections 2021-06-25T04:54:39.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.789+0000 7f8aa9581700 1 -- 172.21.15.57:0/1293355226 wait complete. 2021-06-25T04:54:39.803 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:54:39.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.909+0000 7fcb4e283700 1 Processor -- start 2021-06-25T04:54:39.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.909+0000 7fcb4e283700 1 -- start start 2021-06-25T04:54:39.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb48060160 0x7fcb480b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb4805c520 0x7fcb480a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb480aa460 con 0x7fcb480af380 2021-06-25T04:54:39.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb480b1410 con 0x7fcb4805c520 2021-06-25T04:54:39.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb480af760 con 0x7fcb48060160 2021-06-25T04:54:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4da82700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb4805c520 0x7fcb480a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4da82700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb4805c520 0x7fcb480a8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40414/0 (socket says 172.21.15.57:40414) 2021-06-25T04:54:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4da82700 1 -- 172.21.15.57:0/4219884635 learned_addr learned my addr 172.21.15.57:0/4219884635 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4ca80700 1 --2- 172.21.15.57:0/4219884635 >> v2:172.21.15.87:3300/0 conn(0x7fcb48060160 0x7fcb480b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4da82700 1 -- 172.21.15.57:0/4219884635 >> v2:172.21.15.87:3300/0 conn(0x7fcb48060160 msgr2=0x7fcb480b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4da82700 1 --2- 172.21.15.57:0/4219884635 >> v2:172.21.15.87:3300/0 conn(0x7fcb48060160 0x7fcb480b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4da82700 1 -- 172.21.15.57:0/4219884635 >> v1:172.21.15.87:6789/0 conn(0x7fcb480af380 legacy=0x7fcb48144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4da82700 1 -- 172.21.15.57:0/4219884635 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4805fb40 con 0x7fcb4805c520 2021-06-25T04:54:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4da82700 1 --2- 172.21.15.57:0/4219884635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4805c520 0x7fcb480a8bb0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fcb400032f0 tx=0x7fcb40009290).ready entity=mon.0 client_cookie=811c5e90d699973f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb3ffff700 1 -- 172.21.15.57:0/4219884635 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb4000b870 con 0x7fcb4805c520 2021-06-25T04:54:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb3ffff700 1 -- 172.21.15.57:0/4219884635 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4000b9d0 con 0x7fcb4805c520 2021-06-25T04:54:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb3ffff700 1 -- 172.21.15.57:0/4219884635 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb4000bb40 con 0x7fcb4805c520 2021-06-25T04:54:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 -- 172.21.15.57:0/4219884635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4805c520 msgr2=0x7fcb480a8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 --2- 172.21.15.57:0/4219884635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4805c520 0x7fcb480a8bb0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fcb400032f0 tx=0x7fcb40009290).stop 2021-06-25T04:54:39.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 -- 172.21.15.57:0/4219884635 shutdown_connections 2021-06-25T04:54:39.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 --2- 172.21.15.57:0/4219884635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4805c520 0x7fcb480a8bb0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 --2- 172.21.15.57:0/4219884635 >> v2:172.21.15.87:3300/0 conn(0x7fcb48060160 0x7fcb480b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 -- 172.21.15.57:0/4219884635 >> 172.21.15.57:0/4219884635 conn(0x7fcb48061100 msgr2=0x7fcb48062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:39.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 -- 172.21.15.57:0/4219884635 shutdown_connections 2021-06-25T04:54:39.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.913+0000 7fcb4e283700 1 -- 172.21.15.57:0/4219884635 wait complete. 2021-06-25T04:54:39.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4e283700 1 Processor -- start 2021-06-25T04:54:39.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4e283700 1 -- start start 2021-06-25T04:54:39.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4e283700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4805c520 0x7fcb480ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4e283700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb48060160 0x7fcb481526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4e283700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb480af380 0x7fcb48152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4e283700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48153080 con 0x7fcb4805c520 2021-06-25T04:54:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4e283700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48144de0 con 0x7fcb480af380 2021-06-25T04:54:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4e283700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48145080 con 0x7fcb48060160 2021-06-25T04:54:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4d281700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4805c520 0x7fcb480ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4d281700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4805c520 0x7fcb480ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40418/0 (socket says 172.21.15.57:40418) 2021-06-25T04:54:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4d281700 1 -- 172.21.15.57:0/1704679420 learned_addr learned my addr 172.21.15.57:0/1704679420 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4da82700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb480af380 0x7fcb48152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4ca80700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb48060160 0x7fcb481526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4d281700 1 -- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb48060160 msgr2=0x7fcb481526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4d281700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb48060160 0x7fcb481526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4d281700 1 -- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb480af380 msgr2=0x7fcb48152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4d281700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb480af380 0x7fcb48152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:39.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4d281700 1 -- 172.21.15.57:0/1704679420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40009530 con 0x7fcb4805c520 2021-06-25T04:54:39.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4da82700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb480af380 0x7fcb48152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:39.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.917+0000 7fcb4d281700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4805c520 0x7fcb480ad4b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fcb480b0280 tx=0x7fcb44007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.921+0000 7fcb3e7fc700 1 -- 172.21.15.57:0/1704679420 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb44012400 con 0x7fcb4805c520 2021-06-25T04:54:39.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.921+0000 7fcb3e7fc700 1 -- 172.21.15.57:0/1704679420 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb44012560 con 0x7fcb4805c520 2021-06-25T04:54:39.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.921+0000 7fcb4e283700 1 -- 172.21.15.57:0/1704679420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4805f670 con 0x7fcb4805c520 2021-06-25T04:54:39.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.921+0000 7fcb3e7fc700 1 -- 172.21.15.57:0/1704679420 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb440128c0 con 0x7fcb4805c520 2021-06-25T04:54:39.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.921+0000 7fcb4e283700 1 -- 172.21.15.57:0/1704679420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb48152190 con 0x7fcb4805c520 2021-06-25T04:54:39.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.921+0000 7fcb4e283700 1 -- 172.21.15.57:0/1704679420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb48057310 con 0x7fcb4805c520 2021-06-25T04:54:39.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.921+0000 7fcb3e7fc700 1 -- 172.21.15.57:0/1704679420 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcb44019030 con 0x7fcb4805c520 2021-06-25T04:54:39.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.921+0000 7fcb3e7fc700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb30055340 0x7fcb30057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:39.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.921+0000 7fcb3e7fc700 1 -- 172.21.15.57:0/1704679420 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcb4406d130 con 0x7fcb4805c520 2021-06-25T04:54:39.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.921+0000 7fcb4ca80700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb30055340 0x7fcb30057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:39.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.925+0000 7fcb4ca80700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb30055340 0x7fcb30057800 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fcb3800c000 tx=0x7fcb38008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:39.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:39.929+0000 7fcb3e7fc700 1 -- 172.21.15.57:0/1704679420 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcb440432e0 con 0x7fcb4805c520 2021-06-25T04:54:40.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.057+0000 7fcb4e283700 1 -- 172.21.15.57:0/1704679420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb481523b0 con 0x7fcb4805c520 2021-06-25T04:54:40.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb3e7fc700 1 -- 172.21.15.57:0/1704679420 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+10 (secure 0 0 0) 0x7fcb44046900 con 0x7fcb4805c520 2021-06-25T04:54:40.063 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:54:40.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 -- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb30055340 msgr2=0x7fcb30057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb30055340 0x7fcb30057800 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fcb3800c000 tx=0x7fcb38008040).stop 2021-06-25T04:54:40.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 -- 172.21.15.57:0/1704679420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4805c520 msgr2=0x7fcb480ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4805c520 0x7fcb480ad4b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fcb480b0280 tx=0x7fcb44007c50).stop 2021-06-25T04:54:40.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 -- 172.21.15.57:0/1704679420 shutdown_connections 2021-06-25T04:54:40.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb30055340 0x7fcb30057800 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb480af380 0x7fcb48152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb48060160 0x7fcb481526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 --2- 172.21.15.57:0/1704679420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4805c520 0x7fcb480ad4b0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 -- 172.21.15.57:0/1704679420 >> 172.21.15.57:0/1704679420 conn(0x7fcb48061100 msgr2=0x7fcb48140440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:40.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 -- 172.21.15.57:0/1704679420 shutdown_connections 2021-06-25T04:54:40.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.061+0000 7fcb4e283700 1 -- 172.21.15.57:0/1704679420 wait complete. 2021-06-25T04:54:40.076 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:54:40.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f911b7700 1 Processor -- start 2021-06-25T04:54:40.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f911b7700 1 -- start start 2021-06-25T04:54:40.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f911b7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f8c0b0570 0x7f1f8c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f911b7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f8c0b36d0 0x7f1f8c13d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f911b7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c1438e0 con 0x7f1f8c13da00 2021-06-25T04:54:40.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f911b7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8c143b80 con 0x7f1f8c0b0570 2021-06-25T04:54:40.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f911b7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c143e20 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8b59e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1f8c13da00 0x7f1f8c0b1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57648/0 (socket says 172.21.15.57:57648) 2021-06-25T04:54:40.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f8c0b0570 0x7f1f8c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8b59e700 1 -- 172.21.15.57:0/3919860575 learned_addr learned my addr 172.21.15.57:0/3919860575 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:40.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f83fff700 1 --2- 172.21.15.57:0/3919860575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f8c0b36d0 0x7f1f8c13d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8a59c700 1 -- 172.21.15.57:0/3919860575 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224313750 0 0) 0x7f1f8c1438e0 con 0x7f1f8c13da00 2021-06-25T04:54:40.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8a59c700 1 -- 172.21.15.57:0/3919860575 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f6c003260 con 0x7f1f8c13da00 2021-06-25T04:54:40.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8ad9d700 1 -- 172.21.15.57:0/3919860575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f8c0b36d0 msgr2=0x7f1f8c13d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:40.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8ad9d700 1 --2- 172.21.15.57:0/3919860575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f8c0b36d0 0x7f1f8c13d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8ad9d700 1 -- 172.21.15.57:0/3919860575 >> v1:172.21.15.57:6789/0 conn(0x7f1f8c13da00 legacy=0x7f1f8c0b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8a59c700 1 -- 172.21.15.57:0/3919860575 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3355391727 0 0) 0x7f1f6c003260 con 0x7f1f8c13da00 2021-06-25T04:54:40.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8ad9d700 1 -- 172.21.15.57:0/3919860575 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c1440c0 con 0x7f1f8c0b0570 2021-06-25T04:54:40.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8ad9d700 1 --2- 172.21.15.57:0/3919860575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8c0b0570 0x7f1f8c0b0950 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f1f84001b80 tx=0x7f1f7c006df0).ready entity=mon.0 client_cookie=7afba0b24ffb1b7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:40.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8a59c700 1 -- 172.21.15.57:0/3919860575 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f840019e0 con 0x7f1f8c0b0570 2021-06-25T04:54:40.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8a59c700 1 -- 172.21.15.57:0/3919860575 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c000e90 con 0x7f1f8c0b0570 2021-06-25T04:54:40.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f8a59c700 1 -- 172.21.15.57:0/3919860575 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f7c012460 con 0x7f1f8c0b0570 2021-06-25T04:54:40.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f911b7700 1 -- 172.21.15.57:0/3919860575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8c0b0570 msgr2=0x7f1f8c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.185+0000 7f1f911b7700 1 --2- 172.21.15.57:0/3919860575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8c0b0570 0x7f1f8c0b0950 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f1f84001b80 tx=0x7f1f7c006df0).stop 2021-06-25T04:54:40.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.189+0000 7f1f911b7700 1 -- 172.21.15.57:0/3919860575 shutdown_connections 2021-06-25T04:54:40.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.189+0000 7f1f911b7700 1 --2- 172.21.15.57:0/3919860575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f8c0b36d0 0x7f1f8c13d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.189+0000 7f1f911b7700 1 --2- 172.21.15.57:0/3919860575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8c0b0570 0x7f1f8c0b0950 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.189+0000 7f1f911b7700 1 -- 172.21.15.57:0/3919860575 >> 172.21.15.57:0/3919860575 conn(0x7f1f8c060780 msgr2=0x7f1f8c060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:40.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.189+0000 7f1f911b7700 1 -- 172.21.15.57:0/3919860575 shutdown_connections 2021-06-25T04:54:40.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.189+0000 7f1f911b7700 1 -- 172.21.15.57:0/3919860575 wait complete. 2021-06-25T04:54:40.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.189+0000 7f1f911b7700 1 Processor -- start 2021-06-25T04:54:40.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.189+0000 7f1f911b7700 1 -- start start 2021-06-25T04:54:40.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f911b7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8c0b0570 0x7f1f8c13c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f911b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8c0b36d0 0x7f1f8c135c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f911b7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f8c13da00 0x7f1f8c136180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f911b7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c136670 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f911b7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c13f280 con 0x7f1f8c0b0570 2021-06-25T04:54:40.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f911b7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c139840 con 0x7f1f8c13da00 2021-06-25T04:54:40.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f83fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8c0b36d0 0x7f1f8c135c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f83fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8c0b36d0 0x7f1f8c135c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40434/0 (socket says 172.21.15.57:40434) 2021-06-25T04:54:40.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f83fff700 1 -- 172.21.15.57:0/1524846375 learned_addr learned my addr 172.21.15.57:0/1524846375 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:40.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f8ad9d700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8c0b0570 0x7f1f8c13c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f8b59e700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f8c13da00 0x7f1f8c136180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f83fff700 1 -- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f8c13da00 msgr2=0x7f1f8c136180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f83fff700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f8c13da00 0x7f1f8c136180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f83fff700 1 -- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8c0b0570 msgr2=0x7f1f8c13c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f83fff700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8c0b0570 0x7f1f8c13c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f83fff700 1 -- 172.21.15.57:0/1524846375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c00b180 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f83fff700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8c0b36d0 0x7f1f8c135c90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f1f7400c000 tx=0x7f1f74006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f88d99700 1 -- 172.21.15.57:0/1524846375 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f74015660 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f88d99700 1 -- 172.21.15.57:0/1524846375 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f740157c0 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f88d99700 1 -- 172.21.15.57:0/1524846375 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f74015b20 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f911b7700 1 -- 172.21.15.57:0/1524846375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c13f8b0 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f911b7700 1 -- 172.21.15.57:0/1524846375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c13fb10 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.193+0000 7f1f911b7700 1 -- 172.21.15.57:0/1524846375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8c13de70 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.197+0000 7f1f88d99700 1 -- 172.21.15.57:0/1524846375 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1f7401c030 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.197+0000 7f1f88d99700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1f700553d0 0x7f1f70057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.197+0000 7f1f88d99700 1 -- 172.21.15.57:0/1524846375 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1f7406fe40 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.197+0000 7f1f8ad9d700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1f700553d0 0x7f1f70057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.197+0000 7f1f8ad9d700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1f700553d0 0x7f1f70057890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f1f7c01a000 tx=0x7f1f7c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.205+0000 7f1f88d99700 1 -- 172.21.15.57:0/1524846375 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1f740460a0 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.329+0000 7f1f911b7700 1 -- 172.21.15.57:0/1524846375 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f8c139bd0 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f88d99700 1 -- 172.21.15.57:0/1524846375 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1f740496c0 con 0x7f1f8c0b36d0 2021-06-25T04:54:40.334 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:54:40.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 -- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1f700553d0 msgr2=0x7f1f70057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1f700553d0 0x7f1f70057890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f1f7c01a000 tx=0x7f1f7c014000).stop 2021-06-25T04:54:40.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 -- 172.21.15.57:0/1524846375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8c0b36d0 msgr2=0x7f1f8c135c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8c0b36d0 0x7f1f8c135c90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f1f7400c000 tx=0x7f1f74006df0).stop 2021-06-25T04:54:40.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 -- 172.21.15.57:0/1524846375 shutdown_connections 2021-06-25T04:54:40.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1f700553d0 0x7f1f70057890 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1f8c13da00 0x7f1f8c136180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8c0b36d0 0x7f1f8c135c90 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 --2- 172.21.15.57:0/1524846375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f8c0b0570 0x7f1f8c13c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 -- 172.21.15.57:0/1524846375 >> 172.21.15.57:0/1524846375 conn(0x7f1f8c060780 msgr2=0x7f1f8c1418f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:40.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 -- 172.21.15.57:0/1524846375 shutdown_connections 2021-06-25T04:54:40.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.333+0000 7f1f911b7700 1 -- 172.21.15.57:0/1524846375 wait complete. 2021-06-25T04:54:40.349 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:54:40.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:40.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.444+0000 7f60a9cb8700 1 Processor -- start 2021-06-25T04:54:40.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.444+0000 7f60a9cb8700 1 -- start start 2021-06-25T04:54:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.444+0000 7f60a9cb8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60a40b5460 0x7f60a40af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.444+0000 7f60a9cb8700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60a4147560 0x7f60a40acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.444+0000 7f60a9cb8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a41479b0 con 0x7f60a40b05d0 2021-06-25T04:54:40.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.444+0000 7f60a9cb8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a41452a0 con 0x7f60a40b5460 2021-06-25T04:54:40.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.444+0000 7f60a9cb8700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a40adfb0 con 0x7f60a4147560 2021-06-25T04:54:40.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a8cb6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60a40b5460 0x7f60a40af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a8cb6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60a40b5460 0x7f60a40af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40440/0 (socket says 172.21.15.57:40440) 2021-06-25T04:54:40.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a8cb6700 1 -- 172.21.15.57:0/1061183533 learned_addr learned my addr 172.21.15.57:0/1061183533 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:40.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a94b7700 1 --2- 172.21.15.57:0/1061183533 >> v2:172.21.15.87:3300/0 conn(0x7f60a4147560 0x7f60a40acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a8cb6700 1 -- 172.21.15.57:0/1061183533 >> v2:172.21.15.87:3300/0 conn(0x7f60a4147560 msgr2=0x7f60a40acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:40.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a8cb6700 1 --2- 172.21.15.57:0/1061183533 >> v2:172.21.15.87:3300/0 conn(0x7f60a4147560 0x7f60a40acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a8cb6700 1 -- 172.21.15.57:0/1061183533 >> v1:172.21.15.87:6789/0 conn(0x7f60a40b05d0 legacy=0x7f60a4067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a8cb6700 1 -- 172.21.15.57:0/1061183533 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a40b5840 con 0x7f60a40b5460 2021-06-25T04:54:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a94b7700 1 --2- 172.21.15.57:0/1061183533 >> v2:172.21.15.87:3300/0 conn(0x7f60a4147560 0x7f60a40acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:54:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a8cb6700 1 --2- 172.21.15.57:0/1061183533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60a40b5460 0x7f60a40af510 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f60a4069d50 tx=0x7f609c009290).ready entity=mon.0 client_cookie=e77663ca7d4d3798 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:40.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a37fe700 1 -- 172.21.15.57:0/1061183533 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609c00b830 con 0x7f60a40b5460 2021-06-25T04:54:40.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a37fe700 1 -- 172.21.15.57:0/1061183533 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c00b990 con 0x7f60a40b5460 2021-06-25T04:54:40.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a37fe700 1 -- 172.21.15.57:0/1061183533 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609c00bb40 con 0x7f60a40b5460 2021-06-25T04:54:40.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a9cb8700 1 -- 172.21.15.57:0/1061183533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60a40b5460 msgr2=0x7f60a40af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a9cb8700 1 --2- 172.21.15.57:0/1061183533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60a40b5460 0x7f60a40af510 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f60a4069d50 tx=0x7f609c009290).stop 2021-06-25T04:54:40.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a9cb8700 1 -- 172.21.15.57:0/1061183533 shutdown_connections 2021-06-25T04:54:40.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a9cb8700 1 --2- 172.21.15.57:0/1061183533 >> v2:172.21.15.87:3300/0 conn(0x7f60a4147560 0x7f60a40acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a9cb8700 1 --2- 172.21.15.57:0/1061183533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60a40b5460 0x7f60a40af510 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a9cb8700 1 -- 172.21.15.57:0/1061183533 >> 172.21.15.57:0/1061183533 conn(0x7f60a4062520 msgr2=0x7f60a4062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:40.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a9cb8700 1 -- 172.21.15.57:0/1061183533 shutdown_connections 2021-06-25T04:54:40.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a9cb8700 1 -- 172.21.15.57:0/1061183533 wait complete. 2021-06-25T04:54:40.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a9cb8700 1 Processor -- start 2021-06-25T04:54:40.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a9cb8700 1 -- start start 2021-06-25T04:54:40.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.448+0000 7f60a9cb8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a40b05d0 0x7f60a405fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a9cb8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60a40b5460 0x7f60a415a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a9cb8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60a4147560 0x7f60a4156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a9cb8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40a8690 con 0x7f60a4147560 2021-06-25T04:54:40.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a9cb8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a4064330 con 0x7f60a40b05d0 2021-06-25T04:54:40.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a9cb8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a415a000 con 0x7f60a40b5460 2021-06-25T04:54:40.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a94b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60a4147560 0x7f60a4156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a94b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60a4147560 0x7f60a4156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40450/0 (socket says 172.21.15.57:40450) 2021-06-25T04:54:40.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a8cb6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a40b05d0 0x7f60a405fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a94b7700 1 -- 172.21.15.57:0/3875081534 learned_addr learned my addr 172.21.15.57:0/3875081534 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:40.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a3fff700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60a40b5460 0x7f60a415a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a8cb6700 1 -- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60a40b5460 msgr2=0x7f60a415a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a8cb6700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60a40b5460 0x7f60a415a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a8cb6700 1 -- 172.21.15.57:0/3875081534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60a4147560 msgr2=0x7f60a4156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a8cb6700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60a4147560 0x7f60a4156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a8cb6700 1 -- 172.21.15.57:0/3875081534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c009530 con 0x7f60a40b05d0 2021-06-25T04:54:40.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a8cb6700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a40b05d0 0x7f60a405fee0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f60a4069d50 tx=0x7f609c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:40.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a1ffb700 1 -- 172.21.15.57:0/3875081534 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609c011b20 con 0x7f60a40b05d0 2021-06-25T04:54:40.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a1ffb700 1 -- 172.21.15.57:0/3875081534 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c011c80 con 0x7f60a40b05d0 2021-06-25T04:54:40.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a9cb8700 1 -- 172.21.15.57:0/3875081534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a415a2a0 con 0x7f60a40b05d0 2021-06-25T04:54:40.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a1ffb700 1 -- 172.21.15.57:0/3875081534 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609c020430 con 0x7f60a40b05d0 2021-06-25T04:54:40.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a9cb8700 1 -- 172.21.15.57:0/3875081534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a4063fb0 con 0x7f60a40b05d0 2021-06-25T04:54:40.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a9cb8700 1 -- 172.21.15.57:0/3875081534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a4057310 con 0x7f60a40b05d0 2021-06-25T04:54:40.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.452+0000 7f60a1ffb700 1 -- 172.21.15.57:0/3875081534 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f609c026020 con 0x7f60a40b05d0 2021-06-25T04:54:40.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.456+0000 7f60a1ffb700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6084055490 0x7f6084057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:40.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.456+0000 7f60a1ffb700 1 -- 172.21.15.57:0/3875081534 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f609c06ead0 con 0x7f60a40b05d0 2021-06-25T04:54:40.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.456+0000 7f60a3fff700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6084055490 0x7f6084057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:40.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.456+0000 7f60a3fff700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6084055490 0x7f6084057950 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f609800d000 tx=0x7f6098007b70).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:40.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.464+0000 7f60a1ffb700 1 -- 172.21.15.57:0/3875081534 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f609c044c80 con 0x7f60a40b05d0 2021-06-25T04:54:40.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.632+0000 7f60a9cb8700 1 -- 172.21.15.57:0/3875081534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60a405f200 con 0x7f60a40b05d0 2021-06-25T04:54:40.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.632+0000 7f60a1ffb700 1 -- 172.21.15.57:0/3875081534 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f609c015020 con 0x7f60a40b05d0 2021-06-25T04:54:40.639 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:40.639 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/2314323791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2314323791},{"type":"v1","addr":"172.21.15.87:6835","nonce":2314323791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3937527303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3937527303},{"type":"v1","addr":"172.21.15.57:6833","nonce":3937527303}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:35.964849+0000","modified":"2021-06-25T04:54:36.968582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2701177693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2701177693},{"type":"v1","addr":"172.21.15.57:6835","nonce":2701177693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-06-25T04:54:40.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 -- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6084055490 msgr2=0x7f6084057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6084055490 0x7f6084057950 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f609800d000 tx=0x7f6098007b70).stop 2021-06-25T04:54:40.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 -- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a40b05d0 msgr2=0x7f60a405fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:40.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a40b05d0 0x7f60a405fee0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f60a4069d50 tx=0x7f609c016000).stop 2021-06-25T04:54:40.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 -- 172.21.15.57:0/3875081534 shutdown_connections 2021-06-25T04:54:40.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6084055490 0x7f6084057950 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60a4147560 0x7f60a4156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60a40b5460 0x7f60a415a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 --2- 172.21.15.57:0/3875081534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a40b05d0 0x7f60a405fee0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:40.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 -- 172.21.15.57:0/3875081534 >> 172.21.15.57:0/3875081534 conn(0x7f60a4062520 msgr2=0x7f60a40ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:40.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 -- 172.21.15.57:0/3875081534 shutdown_connections 2021-06-25T04:54:40.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:40.636+0000 7f60a9cb8700 1 -- 172.21.15.57:0/3875081534 wait complete. 2021-06-25T04:54:40.644 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 41 2021-06-25T04:54:40.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:54:35.964849+0000', 'modified': '2021-06-25T04:54:36.968582+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6678}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6678': {'gid': 6678, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2701177693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2701177693}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2701177693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:54:40.955 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:54:40.956 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:54:41.071 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":6678,"want_state":"up:active","state":"up:active","rank_uptime":5.093243513,"mdsmap_epoch":41,"osdmap_epoch":88,"osdmap_epoch_barrier":88,"uptime":9.4401559299999995} 2021-06-25T04:54:41.072 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 6678, "mdsmap_epoch": 41, "osdmap_epoch": 88, "osdmap_epoch_barrier": 88, "rank_uptime": 5.093243513, "state": "up:active", "uptime": 9.44015593, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:54:41.073 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:54:41.074 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:54:41.074 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:54:41.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:41.076 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:41.086 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:54:41.103 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:54:41.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:54:41.120 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:54:41.123 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:54:41.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:41.124 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:54:41.174 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:54:41.175 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:41.177 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:54:41.197 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:54:41.198 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:54:41.250 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:54:41.243+0000 7fa761497080 -1 init, newargv = 0x55709783aa70 newargc=9 2021-06-25T04:54:41.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15169]: starting ceph client 2021-06-25T04:54:41.253 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:54:41.254 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:54:41.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:41.256 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:54:41.261 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15169]: starting fuse 2021-06-25T04:54:41.262 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:54:41.263 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:54:41.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:41.264 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:54:41.264 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:54:41.264 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:54:41.265 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:54:41.265 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:54:41.266 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:54:41.266 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:54:41.266 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:54:41.267 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:54:41.267 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:54:41.268 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:54:41.268 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:54:41.268 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:54:41.269 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:54:41.269 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:54:41.270 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:54:41.270 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:54:41.270 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:54:41.271 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:54:41.271 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:54:41.272 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:54:41.272 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:54:41.272 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:54:41.350 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.15169.asok 2021-06-25T04:54:41.355 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15169.asok 2021-06-25T04:54:41.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:41.356 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15169.asok status 2021-06-25T04:54:41.447 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:54:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:54:41.447 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:54:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:54:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:54:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:54:41.448 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:54:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "15169", 2021-06-25T04:54:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:54:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:54:41.449 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:54:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:54:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 6834, 2021-06-25T04:54:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:54:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:54:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:54:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 6834 2021-06-25T04:54:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:54:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:54:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:54:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:54:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1399635766 2021-06-25T04:54:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:54:41.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:54:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:54:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:54:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:54:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1399635766 2021-06-25T04:54:41.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:54:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.6834 172.21.15.102:0/1399635766", 2021-06-25T04:54:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/1399635766", 2021-06-25T04:54:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:54:41.455 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 41, 2021-06-25T04:54:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 88, 2021-06-25T04:54:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:54:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:54:41.456 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:54:41.456 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:54:41.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:41.459 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:41.460 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:41.467 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:54:41.468 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:54:41.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:41.470 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:41.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:54:41.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be9bb0700 1 Processor -- start 2021-06-25T04:54:41.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be9bb0700 1 -- start start 2021-06-25T04:54:41.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be9bb0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7be40b3200 0x7f7be4147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:41.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be9bb0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be40b35e0 con 0x7f7be40b2770 2021-06-25T04:54:41.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be9bb0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be405fa80 con 0x7f7be405f670 2021-06-25T04:54:41.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be9bb0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be4146830 con 0x7f7be40b3200 2021-06-25T04:54:41.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7bdbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7be40b2770 0x7f7be4060120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57672/0 (socket says 172.21.15.57:57672) 2021-06-25T04:54:41.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7bdbfff700 1 -- 172.21.15.57:0/242534460 learned_addr learned my addr 172.21.15.57:0/242534460 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:41.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be37fe700 1 --2- 172.21.15.57:0/242534460 >> v2:172.21.15.57:3300/0 conn(0x7f7be40b3200 0x7f7be4147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:41.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be2ffd700 1 -- 172.21.15.57:0/242534460 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933762326 0 0) 0x7f7be40b35e0 con 0x7f7be40b2770 2021-06-25T04:54:41.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be2ffd700 1 -- 172.21.15.57:0/242534460 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc4003260 con 0x7f7be40b2770 2021-06-25T04:54:41.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be2ffd700 1 -- 172.21.15.57:0/242534460 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200762468 0 0) 0x7f7be405fa80 con 0x7f7be405f670 2021-06-25T04:54:41.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be2ffd700 1 -- 172.21.15.57:0/242534460 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be40b35e0 con 0x7f7be405f670 2021-06-25T04:54:41.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be37fe700 1 -- 172.21.15.57:0/242534460 >> v1:172.21.15.87:6789/0 conn(0x7f7be405f670 legacy=0x7f7be4060c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:41.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be2ffd700 1 -- 172.21.15.57:0/242534460 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3015577844 0 0) 0x7f7bc4003260 con 0x7f7be40b2770 2021-06-25T04:54:41.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be37fe700 1 -- 172.21.15.57:0/242534460 >> v1:172.21.15.57:6789/0 conn(0x7f7be40b2770 legacy=0x7f7be4060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:41.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be37fe700 1 -- 172.21.15.57:0/242534460 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4146ad0 con 0x7f7be40b3200 2021-06-25T04:54:41.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be37fe700 1 --2- 172.21.15.57:0/242534460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b3200 0x7f7be4147210 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f7bcc001110 tx=0x7f7bd4006df0).ready entity=mon.0 client_cookie=c394d1793038d115 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:41.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be2ffd700 1 -- 172.21.15.57:0/242534460 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bcc001680 con 0x7f7be40b3200 2021-06-25T04:54:41.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be2ffd700 1 -- 172.21.15.57:0/242534460 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd4000e90 con 0x7f7be40b3200 2021-06-25T04:54:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be2ffd700 1 -- 172.21.15.57:0/242534460 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd4012460 con 0x7f7be40b3200 2021-06-25T04:54:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be9bb0700 1 -- 172.21.15.57:0/242534460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b3200 msgr2=0x7f7be4147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.644+0000 7f7be9bb0700 1 --2- 172.21.15.57:0/242534460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b3200 0x7f7be4147210 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f7bcc001110 tx=0x7f7bd4006df0).stop 2021-06-25T04:54:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 -- 172.21.15.57:0/242534460 shutdown_connections 2021-06-25T04:54:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 --2- 172.21.15.57:0/242534460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b3200 0x7f7be4147210 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 -- 172.21.15.57:0/242534460 >> 172.21.15.57:0/242534460 conn(0x7f7be405c450 msgr2=0x7f7be405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:41.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 -- 172.21.15.57:0/242534460 shutdown_connections 2021-06-25T04:54:41.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 -- 172.21.15.57:0/242534460 wait complete. 2021-06-25T04:54:41.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 Processor -- start 2021-06-25T04:54:41.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 -- start start 2021-06-25T04:54:41.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be405f670 0x7f7be4140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:41.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7be40b2770 0x7f7be41522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:41.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7be40b3200 0x7f7be41527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:41.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be414a0a0 con 0x7f7be405f670 2021-06-25T04:54:41.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4152cd0 con 0x7f7be40b3200 2021-06-25T04:54:41.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be9bb0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4147a70 con 0x7f7be40b2770 2021-06-25T04:54:41.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be405f670 0x7f7be4140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:41.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be405f670 0x7f7be4140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40460/0 (socket says 172.21.15.57:40460) 2021-06-25T04:54:41.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be37fe700 1 -- 172.21.15.57:0/2080544891 learned_addr learned my addr 172.21.15.57:0/2080544891 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:41.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7bdbfff700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7be40b2770 0x7f7be41522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:41.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.648+0000 7f7be3fff700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7be40b3200 0x7f7be41527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be37fe700 1 -- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7be40b2770 msgr2=0x7f7be41522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be37fe700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7be40b2770 0x7f7be41522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be37fe700 1 -- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7be40b3200 msgr2=0x7f7be41527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be37fe700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7be40b3200 0x7f7be41527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be37fe700 1 -- 172.21.15.57:0/2080544891 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd400b180 con 0x7f7be405f670 2021-06-25T04:54:41.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7bdbfff700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7be40b2770 0x7f7be41522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:41.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be37fe700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be405f670 0x7f7be4140300 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f7bcc001110 tx=0x7f7bd4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:41.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be17fa700 1 -- 172.21.15.57:0/2080544891 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd4006b20 con 0x7f7be405f670 2021-06-25T04:54:41.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be17fa700 1 -- 172.21.15.57:0/2080544891 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd400ddd0 con 0x7f7be405f670 2021-06-25T04:54:41.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be9bb0700 1 -- 172.21.15.57:0/2080544891 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be40ace50 con 0x7f7be405f670 2021-06-25T04:54:41.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be17fa700 1 -- 172.21.15.57:0/2080544891 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd4012460 con 0x7f7be405f670 2021-06-25T04:54:41.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be9bb0700 1 -- 172.21.15.57:0/2080544891 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be4149820 con 0x7f7be405f670 2021-06-25T04:54:41.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be9bb0700 1 -- 172.21.15.57:0/2080544891 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be4057310 con 0x7f7be405f670 2021-06-25T04:54:41.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.652+0000 7f7be17fa700 1 -- 172.21.15.57:0/2080544891 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7bd400f030 con 0x7f7be405f670 2021-06-25T04:54:41.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.656+0000 7f7be17fa700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7bc8055510 0x7f7bc80579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:41.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.656+0000 7f7be17fa700 1 -- 172.21.15.57:0/2080544891 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7bd406ece0 con 0x7f7be405f670 2021-06-25T04:54:41.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.656+0000 7f7bdbfff700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7bc8055510 0x7f7bc80579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:41.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.656+0000 7f7bdbfff700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7bc8055510 0x7f7bc80579d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f7bcc00b000 tx=0x7f7bcc000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:41.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.660+0000 7f7be17fa700 1 -- 172.21.15.57:0/2080544891 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7bd4044f40 con 0x7f7be405f670 2021-06-25T04:54:41.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.788+0000 7f7be9bb0700 1 -- 172.21.15.57:0/2080544891 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7be40611f0 con 0x7f7be405f670 2021-06-25T04:54:41.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.788+0000 7f7be17fa700 1 -- 172.21.15.57:0/2080544891 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f7bd4048560 con 0x7f7be405f670 2021-06-25T04:54:41.795 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:41.795 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":88,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:36.967424+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:54:34.391112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-06-25T04:54:35.648616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:54:41.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 -- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7bc8055510 msgr2=0x7f7bc80579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:41.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7bc8055510 0x7f7bc80579d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f7bcc00b000 tx=0x7f7bcc000bc0).stop 2021-06-25T04:54:41.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 -- 172.21.15.57:0/2080544891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be405f670 msgr2=0x7f7be4140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:41.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be405f670 0x7f7be4140300 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f7bcc001110 tx=0x7f7bd4014000).stop 2021-06-25T04:54:41.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 -- 172.21.15.57:0/2080544891 shutdown_connections 2021-06-25T04:54:41.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7bc8055510 0x7f7bc80579d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7be40b3200 0x7f7be41527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7be40b2770 0x7f7be41522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 --2- 172.21.15.57:0/2080544891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be405f670 0x7f7be4140300 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 -- 172.21.15.57:0/2080544891 >> 172.21.15.57:0/2080544891 conn(0x7f7be405c450 msgr2=0x7f7be4066d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 -- 172.21.15.57:0/2080544891 shutdown_connections 2021-06-25T04:54:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.792+0000 7f7be9bb0700 1 -- 172.21.15.57:0/2080544891 wait complete. 2021-06-25T04:54:41.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:54:34.391112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:54:35.648616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:54:41.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:54:41.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161b59e700 1 Processor -- start 2021-06-25T04:54:41.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161b59e700 1 -- start start 2021-06-25T04:54:41.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f161c0612e0 0x7f161c0616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:41.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c140400 0x7f161c140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:41.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161b59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161c0aecb0 con 0x7f161c0ad580 2021-06-25T04:54:41.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161c0b6ee0 con 0x7f161c0612e0 2021-06-25T04:54:41.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0aeee0 con 0x7f161c140400 2021-06-25T04:54:41.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161ad9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c140400 0x7f161c140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:41.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161a59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f161c0612e0 0x7f161c0616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:41.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f1619d9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f161c0ad580 0x7f161c0b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:58434/0 (socket says 172.21.15.57:58434) 2021-06-25T04:54:41.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f1619d9b700 1 -- 172.21.15.57:0/3622961523 learned_addr learned my addr 172.21.15.57:0/3622961523 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:41.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161ad9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c140400 0x7f161c140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:51634/0 (socket says 172.21.15.57:51634) 2021-06-25T04:54:41.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161ad9d700 1 -- 172.21.15.57:0/3622961523 >> v2:172.21.15.87:3300/0 conn(0x7f161c0612e0 msgr2=0x7f161c0616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:41.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161959a700 1 -- 172.21.15.57:0/3622961523 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010907328 0 0) 0x7f161c0aecb0 con 0x7f161c0ad580 2021-06-25T04:54:41.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161ad9d700 1 --2- 172.21.15.57:0/3622961523 >> v2:172.21.15.87:3300/0 conn(0x7f161c0612e0 0x7f161c0616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.912+0000 7f161ad9d700 1 -- 172.21.15.57:0/3622961523 >> v1:172.21.15.87:6789/0 conn(0x7f161c0ad580 legacy=0x7f161c0b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:41.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161ad9d700 1 -- 172.21.15.57:0/3622961523 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c0af180 con 0x7f161c140400 2021-06-25T04:54:41.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161ad9d700 1 --2- 172.21.15.57:0/3622961523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c140400 0x7f161c140890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f161c0aeb60 tx=0x7f16140091d0).ready entity=mon.2 client_cookie=2a4033dd911a052a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:41.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161959a700 1 -- 172.21.15.57:0/3622961523 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f161400b680 con 0x7f161c140400 2021-06-25T04:54:41.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161959a700 1 -- 172.21.15.57:0/3622961523 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161400b7e0 con 0x7f161c140400 2021-06-25T04:54:41.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161959a700 1 -- 172.21.15.57:0/3622961523 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f161400b950 con 0x7f161c140400 2021-06-25T04:54:41.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161b59e700 1 -- 172.21.15.57:0/3622961523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c140400 msgr2=0x7f161c140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:41.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161b59e700 1 --2- 172.21.15.57:0/3622961523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c140400 0x7f161c140890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f161c0aeb60 tx=0x7f16140091d0).stop 2021-06-25T04:54:41.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161b59e700 1 -- 172.21.15.57:0/3622961523 shutdown_connections 2021-06-25T04:54:41.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161b59e700 1 --2- 172.21.15.57:0/3622961523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c140400 0x7f161c140890 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161b59e700 1 --2- 172.21.15.57:0/3622961523 >> v2:172.21.15.87:3300/0 conn(0x7f161c0612e0 0x7f161c0616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161b59e700 1 -- 172.21.15.57:0/3622961523 >> 172.21.15.57:0/3622961523 conn(0x7f161c066da0 msgr2=0x7f161c067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:41.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161b59e700 1 -- 172.21.15.57:0/3622961523 shutdown_connections 2021-06-25T04:54:41.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161b59e700 1 -- 172.21.15.57:0/3622961523 wait complete. 2021-06-25T04:54:41.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161b59e700 1 Processor -- start 2021-06-25T04:54:41.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.916+0000 7f161b59e700 1 -- start start 2021-06-25T04:54:41.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c0612e0 0x7f161c0acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:41.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f161c0ad580 0x7f161c1522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:41.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f161c140400 0x7f161c0b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:41.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0ac220 con 0x7f161c140400 2021-06-25T04:54:41.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0ac4c0 con 0x7f161c0ad580 2021-06-25T04:54:41.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0ac760 con 0x7f161c0612e0 2021-06-25T04:54:41.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f161c140400 0x7f161c0b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:41.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f1619d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f161c0ad580 0x7f161c1522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:41.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f161c140400 0x7f161c0b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40476/0 (socket says 172.21.15.57:40476) 2021-06-25T04:54:41.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161a59c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c0612e0 0x7f161c0acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:41.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f1619d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f161c0ad580 0x7f161c1522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:48968/0 (socket says 172.21.15.57:48968) 2021-06-25T04:54:41.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161ad9d700 1 -- 172.21.15.57:0/758043163 learned_addr learned my addr 172.21.15.57:0/758043163 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:41.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161ad9d700 1 -- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c0612e0 msgr2=0x7f161c0acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:41.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161ad9d700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c0612e0 0x7f161c0acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161ad9d700 1 -- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f161c0ad580 msgr2=0x7f161c1522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:41.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161ad9d700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f161c0ad580 0x7f161c1522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:41.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161ad9d700 1 -- 172.21.15.57:0/758043163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614009470 con 0x7f161c140400 2021-06-25T04:54:41.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161ad9d700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f161c140400 0x7f161c0b0cd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f161c0aeb60 tx=0x7f1614016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:41.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f16137fe700 1 -- 172.21.15.57:0/758043163 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1614011e20 con 0x7f161c140400 2021-06-25T04:54:41.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f16137fe700 1 -- 172.21.15.57:0/758043163 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161400bed0 con 0x7f161c140400 2021-06-25T04:54:41.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161b59e700 1 -- 172.21.15.57:0/758043163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c0aca00 con 0x7f161c140400 2021-06-25T04:54:41.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f16137fe700 1 -- 172.21.15.57:0/758043163 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1614021670 con 0x7f161c140400 2021-06-25T04:54:41.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161b59e700 1 -- 172.21.15.57:0/758043163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c0b3c80 con 0x7f161c140400 2021-06-25T04:54:41.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f161b59e700 1 -- 172.21.15.57:0/758043163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161c057310 con 0x7f161c140400 2021-06-25T04:54:41.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.920+0000 7f16137fe700 1 -- 172.21.15.57:0/758043163 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f161400f070 con 0x7f161c140400 2021-06-25T04:54:41.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.924+0000 7f16137fe700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 0x7f1600057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:41.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.924+0000 7f16137fe700 1 -- 172.21.15.57:0/758043163 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f161406f280 con 0x7f161c140400 2021-06-25T04:54:41.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.924+0000 7f161a59c700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 0x7f1600057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:41.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.924+0000 7f161a59c700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 0x7f1600057800 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f160400b000 tx=0x7f1604006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:41.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:41.928+0000 7f16137fe700 1 -- 172.21.15.57:0/758043163 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1614045390 con 0x7f161c140400 2021-06-25T04:54:42.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.056+0000 7f161b59e700 1 -- 172.21.15.57:0/758043163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f161c0acb90 con 0x7f161c140400 2021-06-25T04:54:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f16137fe700 1 -- 172.21.15.57:0/758043163 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v88) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1614015020 con 0x7f161c140400 2021-06-25T04:54:42.063 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:54:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 -- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 msgr2=0x7f1600057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 0x7f1600057800 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f160400b000 tx=0x7f1604006df0).stop 2021-06-25T04:54:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 -- 172.21.15.57:0/758043163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f161c140400 msgr2=0x7f161c0b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f161c140400 0x7f161c0b0cd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f161c0aeb60 tx=0x7f1614016000).stop 2021-06-25T04:54:42.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 -- 172.21.15.57:0/758043163 shutdown_connections 2021-06-25T04:54:42.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 0x7f1600057800 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f161c140400 0x7f161c0b0cd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f161c0ad580 0x7f161c1522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 --2- 172.21.15.57:0/758043163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f161c0612e0 0x7f161c0acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 -- 172.21.15.57:0/758043163 >> 172.21.15.57:0/758043163 conn(0x7f161c066da0 msgr2=0x7f161c0b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:42.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 -- 172.21.15.57:0/758043163 shutdown_connections 2021-06-25T04:54:42.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.060+0000 7f161b59e700 1 -- 172.21.15.57:0/758043163 wait complete. 2021-06-25T04:54:42.076 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:54:42.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.180+0000 7f735ebd2700 1 Processor -- start 2021-06-25T04:54:42.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.180+0000 7f735ebd2700 1 -- start start 2021-06-25T04:54:42.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7358146910 0x7f73581401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73580b4140 0x7f73581406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7358143b20 con 0x7f73580b4650 2021-06-25T04:54:42.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73581474d0 con 0x7f7358146910 2021-06-25T04:54:42.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7358143dc0 con 0x7f73580b4140 2021-06-25T04:54:42.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f7357fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73580b4140 0x7f73581406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f7357fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73580b4140 0x7f73581406e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:51646/0 (socket says 172.21.15.57:51646) 2021-06-25T04:54:42.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f7357fff700 1 -- 172.21.15.57:0/1036805951 learned_addr learned my addr 172.21.15.57:0/1036805951 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:42.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735c96e700 1 --2- 172.21.15.57:0/1036805951 >> v2:172.21.15.87:3300/0 conn(0x7f7358146910 0x7f73581401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f7357fff700 1 -- 172.21.15.57:0/1036805951 >> v2:172.21.15.87:3300/0 conn(0x7f7358146910 msgr2=0x7f73581401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:42.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f7357fff700 1 --2- 172.21.15.57:0/1036805951 >> v2:172.21.15.87:3300/0 conn(0x7f7358146910 0x7f73581401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f7357fff700 1 -- 172.21.15.57:0/1036805951 >> v1:172.21.15.87:6789/0 conn(0x7f73580b4650 legacy=0x7f73580b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f7357fff700 1 -- 172.21.15.57:0/1036805951 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73580b0c50 con 0x7f73580b4140 2021-06-25T04:54:42.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f7357fff700 1 --2- 172.21.15.57:0/1036805951 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73580b4140 0x7f73581406e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f734c002f70 tx=0x7f734c006eb0).ready entity=mon.2 client_cookie=5b63d0b1fea6cdcb server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:42.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f73577fe700 1 -- 172.21.15.57:0/1036805951 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f734c00d570 con 0x7f73580b4140 2021-06-25T04:54:42.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f73577fe700 1 -- 172.21.15.57:0/1036805951 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c000e90 con 0x7f73580b4140 2021-06-25T04:54:42.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 -- 172.21.15.57:0/1036805951 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73580b4140 msgr2=0x7f73581406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f73577fe700 1 -- 172.21.15.57:0/1036805951 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f734c00d900 con 0x7f73580b4140 2021-06-25T04:54:42.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 --2- 172.21.15.57:0/1036805951 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73580b4140 0x7f73581406e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f734c002f70 tx=0x7f734c006eb0).stop 2021-06-25T04:54:42.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 -- 172.21.15.57:0/1036805951 shutdown_connections 2021-06-25T04:54:42.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 --2- 172.21.15.57:0/1036805951 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73580b4140 0x7f73581406e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 --2- 172.21.15.57:0/1036805951 >> v2:172.21.15.87:3300/0 conn(0x7f7358146910 0x7f73581401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 -- 172.21.15.57:0/1036805951 >> 172.21.15.57:0/1036805951 conn(0x7f735805c450 msgr2=0x7f735805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:42.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 -- 172.21.15.57:0/1036805951 shutdown_connections 2021-06-25T04:54:42.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.184+0000 7f735ebd2700 1 -- 172.21.15.57:0/1036805951 wait complete. 2021-06-25T04:54:42.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735ebd2700 1 Processor -- start 2021-06-25T04:54:42.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735ebd2700 1 -- start start 2021-06-25T04:54:42.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735ebd2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73580b4140 0x7f7358155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735ebd2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73580b4650 0x7f735813f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735ebd2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7358146910 0x7f73580aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735ebd2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73580ae180 con 0x7f73580b4140 2021-06-25T04:54:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735ebd2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73580ad8c0 con 0x7f73580b4650 2021-06-25T04:54:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735ebd2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7358141020 con 0x7f7358146910 2021-06-25T04:54:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735c96e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73580b4140 0x7f7358155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735c96e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73580b4140 0x7f7358155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40486/0 (socket says 172.21.15.57:40486) 2021-06-25T04:54:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735c96e700 1 -- 172.21.15.57:0/3991388132 learned_addr learned my addr 172.21.15.57:0/3991388132 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735d16f700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7358146910 0x7f73580aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f7357fff700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73580b4650 0x7f735813f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735c96e700 1 -- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7358146910 msgr2=0x7f73580aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735c96e700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7358146910 0x7f73580aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735c96e700 1 -- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73580b4650 msgr2=0x7f735813f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735c96e700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73580b4650 0x7f735813f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735c96e700 1 -- 172.21.15.57:0/3991388132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c00b1e0 con 0x7f73580b4140 2021-06-25T04:54:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735d16f700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7358146910 0x7f73580aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735c96e700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73580b4140 0x7f7358155750 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f734800c000 tx=0x7f7348006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f7355ffb700 1 -- 172.21.15.57:0/3991388132 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7348010780 con 0x7f73580b4140 2021-06-25T04:54:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f7355ffb700 1 -- 172.21.15.57:0/3991388132 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73480108e0 con 0x7f73580b4140 2021-06-25T04:54:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735ebd2700 1 -- 172.21.15.57:0/3991388132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73580afac0 con 0x7f73580b4140 2021-06-25T04:54:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f7355ffb700 1 -- 172.21.15.57:0/3991388132 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7348010c40 con 0x7f73580b4140 2021-06-25T04:54:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.188+0000 7f735ebd2700 1 -- 172.21.15.57:0/3991388132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73580af650 con 0x7f73580b4140 2021-06-25T04:54:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.192+0000 7f735ebd2700 1 -- 172.21.15.57:0/3991388132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7358057310 con 0x7f73580b4140 2021-06-25T04:54:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.192+0000 7f7355ffb700 1 -- 172.21.15.57:0/3991388132 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f734801c460 con 0x7f73580b4140 2021-06-25T04:54:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.192+0000 7f7355ffb700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73380553f0 0x7f73380578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.192+0000 7f7355ffb700 1 -- 172.21.15.57:0/3991388132 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f734806e310 con 0x7f73580b4140 2021-06-25T04:54:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.192+0000 7f7357fff700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73380553f0 0x7f73380578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.192+0000 7f7357fff700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73380553f0 0x7f73380578b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f734c019000 tx=0x7f734c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.196+0000 7f7355ffb700 1 -- 172.21.15.57:0/3991388132 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7348044460 con 0x7f73580b4140 2021-06-25T04:54:42.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.324+0000 7f735ebd2700 1 -- 172.21.15.57:0/3991388132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f73580698a0 con 0x7f73580b4140 2021-06-25T04:54:42.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.324+0000 7f7355ffb700 1 -- 172.21.15.57:0/3991388132 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v88) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7348047a80 con 0x7f73580b4140 2021-06-25T04:54:42.330 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:54:42.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 -- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73380553f0 msgr2=0x7f73380578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73380553f0 0x7f73380578b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f734c019000 tx=0x7f734c015000).stop 2021-06-25T04:54:42.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 -- 172.21.15.57:0/3991388132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73580b4140 msgr2=0x7f7358155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73580b4140 0x7f7358155750 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f734800c000 tx=0x7f7348006df0).stop 2021-06-25T04:54:42.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 -- 172.21.15.57:0/3991388132 shutdown_connections 2021-06-25T04:54:42.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f73380553f0 0x7f73380578b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7358146910 0x7f73580aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73580b4650 0x7f735813f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 --2- 172.21.15.57:0/3991388132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73580b4140 0x7f7358155750 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 -- 172.21.15.57:0/3991388132 >> 172.21.15.57:0/3991388132 conn(0x7f735805c450 msgr2=0x7f73580b8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:42.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 -- 172.21.15.57:0/3991388132 shutdown_connections 2021-06-25T04:54:42.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.328+0000 7f735ebd2700 1 -- 172.21.15.57:0/3991388132 wait complete. 2021-06-25T04:54:42.346 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:54:42.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 Processor -- start 2021-06-25T04:54:42.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 -- start start 2021-06-25T04:54:42.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab980b2540 0x7fab9814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fab980affd0 0x7fab9814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980a7080 con 0x7fab980afb90 2021-06-25T04:54:42.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab980a72b0 con 0x7fab980affd0 2021-06-25T04:54:42.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab980a7550 con 0x7fab980b2540 2021-06-25T04:54:42.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab977fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fab980affd0 0x7fab9814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab977fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fab980affd0 0x7fab9814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40494/0 (socket says 172.21.15.57:40494) 2021-06-25T04:54:42.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab977fe700 1 -- 172.21.15.57:0/2414683242 learned_addr learned my addr 172.21.15.57:0/2414683242 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:42.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab97fff700 1 --2- 172.21.15.57:0/2414683242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab980b2540 0x7fab9814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab977fe700 1 -- 172.21.15.57:0/2414683242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab980b2540 msgr2=0x7fab9814ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:42.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab977fe700 1 --2- 172.21.15.57:0/2414683242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab980b2540 0x7fab9814ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab977fe700 1 -- 172.21.15.57:0/2414683242 >> v1:172.21.15.87:6789/0 conn(0x7fab980afb90 legacy=0x7fab980a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab977fe700 1 -- 172.21.15.57:0/2414683242 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980a77f0 con 0x7fab980affd0 2021-06-25T04:54:42.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab977fe700 1 --2- 172.21.15.57:0/2414683242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab980affd0 0x7fab9814b2f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fab8c002f70 tx=0x7fab8c006eb0).ready entity=mon.0 client_cookie=3f5278c401a3f8e8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:42.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab96ffd700 1 -- 172.21.15.57:0/2414683242 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab8c00d570 con 0x7fab980affd0 2021-06-25T04:54:42.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab96ffd700 1 -- 172.21.15.57:0/2414683242 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c000e90 con 0x7fab980affd0 2021-06-25T04:54:42.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab96ffd700 1 -- 172.21.15.57:0/2414683242 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab8c00d900 con 0x7fab980affd0 2021-06-25T04:54:42.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 -- 172.21.15.57:0/2414683242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab980affd0 msgr2=0x7fab9814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 --2- 172.21.15.57:0/2414683242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab980affd0 0x7fab9814b2f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7fab8c002f70 tx=0x7fab8c006eb0).stop 2021-06-25T04:54:42.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 -- 172.21.15.57:0/2414683242 shutdown_connections 2021-06-25T04:54:42.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 --2- 172.21.15.57:0/2414683242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab980affd0 0x7fab9814b2f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 --2- 172.21.15.57:0/2414683242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab980b2540 0x7fab9814ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 -- 172.21.15.57:0/2414683242 >> 172.21.15.57:0/2414683242 conn(0x7fab98060140 msgr2=0x7fab980b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:42.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 -- 172.21.15.57:0/2414683242 shutdown_connections 2021-06-25T04:54:42.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.456+0000 7fab9d697700 1 -- 172.21.15.57:0/2414683242 wait complete. 2021-06-25T04:54:42.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab9d697700 1 Processor -- start 2021-06-25T04:54:42.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab9d697700 1 -- start start 2021-06-25T04:54:42.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab9d697700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab980afb90 0x7fab9805ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab9d697700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab980affd0 0x7fab98146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab9d697700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab980b2540 0x7fab98146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab9d697700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980ac0c0 con 0x7fab980affd0 2021-06-25T04:54:42.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab9d697700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980aab70 con 0x7fab980b2540 2021-06-25T04:54:42.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab9d697700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab980ac310 con 0x7fab980afb90 2021-06-25T04:54:42.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab977fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab980affd0 0x7fab98146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab977fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab980affd0 0x7fab98146460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40502/0 (socket says 172.21.15.57:40502) 2021-06-25T04:54:42.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab977fe700 1 -- 172.21.15.57:0/554710668 learned_addr learned my addr 172.21.15.57:0/554710668 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:42.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab97fff700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab980afb90 0x7fab9805ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab9ce96700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab980b2540 0x7fab98146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab977fe700 1 -- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab980afb90 msgr2=0x7fab9805ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab977fe700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab980afb90 0x7fab9805ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab977fe700 1 -- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab980b2540 msgr2=0x7fab98146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab977fe700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab980b2540 0x7fab98146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.460+0000 7fab977fe700 1 -- 172.21.15.57:0/554710668 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c00b1e0 con 0x7fab980affd0 2021-06-25T04:54:42.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.464+0000 7fab977fe700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab980affd0 0x7fab98146460 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fab8c002f70 tx=0x7fab8c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.464+0000 7fab957fa700 1 -- 172.21.15.57:0/554710668 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab8c0118a0 con 0x7fab980affd0 2021-06-25T04:54:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.464+0000 7fab957fa700 1 -- 172.21.15.57:0/554710668 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c011a00 con 0x7fab980affd0 2021-06-25T04:54:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.464+0000 7fab9d697700 1 -- 172.21.15.57:0/554710668 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab980aadd0 con 0x7fab980affd0 2021-06-25T04:54:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.464+0000 7fab957fa700 1 -- 172.21.15.57:0/554710668 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab8c011d60 con 0x7fab980affd0 2021-06-25T04:54:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.464+0000 7fab9d697700 1 -- 172.21.15.57:0/554710668 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9814d4a0 con 0x7fab980affd0 2021-06-25T04:54:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.464+0000 7fab9d697700 1 -- 172.21.15.57:0/554710668 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab980aa940 con 0x7fab980affd0 2021-06-25T04:54:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.464+0000 7fab957fa700 1 -- 172.21.15.57:0/554710668 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fab8c00f070 con 0x7fab980affd0 2021-06-25T04:54:42.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.464+0000 7fab957fa700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab780554e0 0x7fab780579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.464+0000 7fab957fa700 1 -- 172.21.15.57:0/554710668 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fab8c06f6f0 con 0x7fab980affd0 2021-06-25T04:54:42.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.464+0000 7fab97fff700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab780554e0 0x7fab780579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.468+0000 7fab97fff700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab780554e0 0x7fab780579a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fab8800b000 tx=0x7fab88008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:42.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.472+0000 7fab957fa700 1 -- 172.21.15.57:0/554710668 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fab8c0458a0 con 0x7fab980affd0 2021-06-25T04:54:42.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.596+0000 7fab9d697700 1 -- 172.21.15.57:0/554710668 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab98057310 con 0x7fab980affd0 2021-06-25T04:54:42.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.596+0000 7fab957fa700 1 -- 172.21.15.57:0/554710668 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+10 (secure 0 0 0) 0x7fab8c048ec0 con 0x7fab980affd0 2021-06-25T04:54:42.602 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:54:42.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 -- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab780554e0 msgr2=0x7fab780579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab780554e0 0x7fab780579a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fab8800b000 tx=0x7fab88008040).stop 2021-06-25T04:54:42.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 -- 172.21.15.57:0/554710668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab980affd0 msgr2=0x7fab98146460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab980affd0 0x7fab98146460 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fab8c002f70 tx=0x7fab8c015000).stop 2021-06-25T04:54:42.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 -- 172.21.15.57:0/554710668 shutdown_connections 2021-06-25T04:54:42.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab780554e0 0x7fab780579a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab980b2540 0x7fab98146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab980affd0 0x7fab98146460 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 --2- 172.21.15.57:0/554710668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab980afb90 0x7fab9805ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 -- 172.21.15.57:0/554710668 >> 172.21.15.57:0/554710668 conn(0x7fab98060140 msgr2=0x7fab981489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:42.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 -- 172.21.15.57:0/554710668 shutdown_connections 2021-06-25T04:54:42.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.600+0000 7fab9d697700 1 -- 172.21.15.57:0/554710668 wait complete. 2021-06-25T04:54:42.616 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:54:42.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3c4c98700 1 Processor -- start 2021-06-25T04:54:42.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3c4c98700 1 -- start start 2021-06-25T04:54:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3c4c98700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00b2540 0x7fd3c014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3c4c98700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3c00affd0 0x7fd3c014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3c4c98700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00a7080 con 0x7fd3c00afb90 2021-06-25T04:54:42.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3c4c98700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c00a72b0 con 0x7fd3c00affd0 2021-06-25T04:54:42.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3c4c98700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00a7550 con 0x7fd3c00b2540 2021-06-25T04:54:42.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3bf7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00b2540 0x7fd3c014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3beffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3c00affd0 0x7fd3c014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3bf7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00b2540 0x7fd3c014ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:51672/0 (socket says 172.21.15.57:51672) 2021-06-25T04:54:42.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3bf7fe700 1 -- 172.21.15.57:0/3146315006 learned_addr learned my addr 172.21.15.57:0/3146315006 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:42.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3bf7fe700 1 -- 172.21.15.57:0/3146315006 >> v2:172.21.15.87:3300/0 conn(0x7fd3c00affd0 msgr2=0x7fd3c014b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:42.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3bf7fe700 1 --2- 172.21.15.57:0/3146315006 >> v2:172.21.15.87:3300/0 conn(0x7fd3c00affd0 0x7fd3c014b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3bf7fe700 1 -- 172.21.15.57:0/3146315006 >> v1:172.21.15.87:6789/0 conn(0x7fd3c00afb90 legacy=0x7fd3c00a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3bf7fe700 1 -- 172.21.15.57:0/3146315006 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c00a77f0 con 0x7fd3c00b2540 2021-06-25T04:54:42.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3bf7fe700 1 --2- 172.21.15.57:0/3146315006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00b2540 0x7fd3c014ae00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd3b0002f70 tx=0x7fd3b0006eb0).ready entity=mon.2 client_cookie=46b6f721915ae351 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:42.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3be7fc700 1 -- 172.21.15.57:0/3146315006 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3b000d570 con 0x7fd3c00b2540 2021-06-25T04:54:42.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3be7fc700 1 -- 172.21.15.57:0/3146315006 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b0000e90 con 0x7fd3c00b2540 2021-06-25T04:54:42.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3be7fc700 1 -- 172.21.15.57:0/3146315006 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3b000d900 con 0x7fd3c00b2540 2021-06-25T04:54:42.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3c4c98700 1 -- 172.21.15.57:0/3146315006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00b2540 msgr2=0x7fd3c014ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3c4c98700 1 --2- 172.21.15.57:0/3146315006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00b2540 0x7fd3c014ae00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd3b0002f70 tx=0x7fd3b0006eb0).stop 2021-06-25T04:54:42.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.728+0000 7fd3c4c98700 1 -- 172.21.15.57:0/3146315006 shutdown_connections 2021-06-25T04:54:42.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 --2- 172.21.15.57:0/3146315006 >> v2:172.21.15.87:3300/0 conn(0x7fd3c00affd0 0x7fd3c014b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 --2- 172.21.15.57:0/3146315006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00b2540 0x7fd3c014ae00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 -- 172.21.15.57:0/3146315006 >> 172.21.15.57:0/3146315006 conn(0x7fd3c0060140 msgr2=0x7fd3c00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:42.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 -- 172.21.15.57:0/3146315006 shutdown_connections 2021-06-25T04:54:42.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 -- 172.21.15.57:0/3146315006 wait complete. 2021-06-25T04:54:42.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 Processor -- start 2021-06-25T04:54:42.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 -- start start 2021-06-25T04:54:42.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3c00afb90 0x7fd3c00a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00affd0 0x7fd3c00aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3c00b2540 0x7fd3c0159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00ac5f0 con 0x7fd3c00afb90 2021-06-25T04:54:42.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00abf20 con 0x7fd3c00b2540 2021-06-25T04:54:42.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00b5470 con 0x7fd3c00affd0 2021-06-25T04:54:42.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3c00afb90 0x7fd3c00a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3c00afb90 0x7fd3c00a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40514/0 (socket says 172.21.15.57:40514) 2021-06-25T04:54:42.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bf7fe700 1 -- 172.21.15.57:0/1221664662 learned_addr learned my addr 172.21.15.57:0/1221664662 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:42.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3beffd700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00affd0 0x7fd3c00aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bffff700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3c00b2540 0x7fd3c0159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bf7fe700 1 -- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00affd0 msgr2=0x7fd3c00aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bf7fe700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00affd0 0x7fd3c00aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bf7fe700 1 -- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3c00b2540 msgr2=0x7fd3c0159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bf7fe700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3c00b2540 0x7fd3c0159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bf7fe700 1 -- 172.21.15.57:0/1221664662 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b000b1e0 con 0x7fd3c00afb90 2021-06-25T04:54:42.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bf7fe700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3c00afb90 0x7fd3c00a9eb0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fd3b0002f70 tx=0x7fd3b0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:42.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bcff9700 1 -- 172.21.15.57:0/1221664662 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3b00118a0 con 0x7fd3c00afb90 2021-06-25T04:54:42.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 -- 172.21.15.57:0/1221664662 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c00ac150 con 0x7fd3c00afb90 2021-06-25T04:54:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bcff9700 1 -- 172.21.15.57:0/1221664662 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b0011a00 con 0x7fd3c00afb90 2021-06-25T04:54:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3c4c98700 1 -- 172.21.15.57:0/1221664662 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c00b50f0 con 0x7fd3c00afb90 2021-06-25T04:54:42.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.732+0000 7fd3bcff9700 1 -- 172.21.15.57:0/1221664662 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3b0011d60 con 0x7fd3c00afb90 2021-06-25T04:54:42.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.736+0000 7fd3bcff9700 1 -- 172.21.15.57:0/1221664662 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd3b000f070 con 0x7fd3c00afb90 2021-06-25T04:54:42.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.736+0000 7fd3c4c98700 1 -- 172.21.15.57:0/1221664662 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c0057310 con 0x7fd3c00afb90 2021-06-25T04:54:42.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.736+0000 7fd3bcff9700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3a00554e0 0x7fd3a00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:42.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.736+0000 7fd3bcff9700 1 -- 172.21.15.57:0/1221664662 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd3b006f950 con 0x7fd3c00afb90 2021-06-25T04:54:42.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.736+0000 7fd3beffd700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3a00554e0 0x7fd3a00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:42.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.736+0000 7fd3beffd700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3a00554e0 0x7fd3a00579a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fd3b400b000 tx=0x7fd3b4006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.744+0000 7fd3bcff9700 1 -- 172.21.15.57:0/1221664662 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd3b0045970 con 0x7fd3c00afb90 2021-06-25T04:54:42.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.872+0000 7fd3c4c98700 1 -- 172.21.15.57:0/1221664662 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd3c00698a0 con 0x7fd3c00afb90 2021-06-25T04:54:42.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.872+0000 7fd3bcff9700 1 -- 172.21.15.57:0/1221664662 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd3b0048f90 con 0x7fd3c00afb90 2021-06-25T04:54:42.877 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:54:42.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 -- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3a00554e0 msgr2=0x7fd3a00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3a00554e0 0x7fd3a00579a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fd3b400b000 tx=0x7fd3b4006df0).stop 2021-06-25T04:54:42.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 -- 172.21.15.57:0/1221664662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3c00afb90 msgr2=0x7fd3c00a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:42.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3c00afb90 0x7fd3c00a9eb0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fd3b0002f70 tx=0x7fd3b0015000).stop 2021-06-25T04:54:42.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 -- 172.21.15.57:0/1221664662 shutdown_connections 2021-06-25T04:54:42.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3a00554e0 0x7fd3a00579a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3c00b2540 0x7fd3c0159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3c00affd0 0x7fd3c00aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 --2- 172.21.15.57:0/1221664662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3c00afb90 0x7fd3c00a9eb0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:42.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 -- 172.21.15.57:0/1221664662 >> 172.21.15.57:0/1221664662 conn(0x7fd3c0060140 msgr2=0x7fd3c0144730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:42.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 -- 172.21.15.57:0/1221664662 shutdown_connections 2021-06-25T04:54:42.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:42.876+0000 7fd3c4c98700 1 -- 172.21.15.57:0/1221664662 wait complete. 2021-06-25T04:54:42.897 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:54:42.898 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:43.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 Processor -- start 2021-06-25T04:54:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 -- start start 2021-06-25T04:54:43.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fb00a7670 0x7f3fb0066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:43.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3fb00b1930 0x7f3fb0066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:43.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fb00b0020 0x7f3fb005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:43.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb0067410 con 0x7f3fb00b1930 2021-06-25T04:54:43.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb00a7a50 con 0x7f3fb00b0020 2021-06-25T04:54:43.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb01475e0 con 0x7f3fb00a7670 2021-06-25T04:54:43.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3faeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3fb00b1930 0x7f3fb0066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:43.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3faeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3fb00b1930 0x7f3fb0066f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40522/0 (socket says 172.21.15.57:40522) 2021-06-25T04:54:43.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3faeffd700 1 -- 172.21.15.57:0/1152330586 learned_addr learned my addr 172.21.15.57:0/1152330586 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:43.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3faf7fe700 1 --2- 172.21.15.57:0/1152330586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fb00a7670 0x7f3fb0066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:43.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3faffff700 1 --2- 172.21.15.57:0/1152330586 >> v2:172.21.15.87:3300/0 conn(0x7f3fb00b0020 0x7f3fb005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:43.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3faeffd700 1 -- 172.21.15.57:0/1152330586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fb00a7670 msgr2=0x7f3fb0066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:43.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3faeffd700 1 --2- 172.21.15.57:0/1152330586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fb00a7670 0x7f3fb0066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:43.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3faeffd700 1 -- 172.21.15.57:0/1152330586 >> v2:172.21.15.87:3300/0 conn(0x7f3fb00b0020 msgr2=0x7f3fb005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:43.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3faeffd700 1 --2- 172.21.15.57:0/1152330586 >> v2:172.21.15.87:3300/0 conn(0x7f3fb00b0020 0x7f3fb005f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:43.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3faeffd700 1 -- 172.21.15.57:0/1152330586 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0147880 con 0x7f3fb00b1930 2021-06-25T04:54:43.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3faeffd700 1 --2- 172.21.15.57:0/1152330586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb00b1930 0x7f3fb0066f20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f3fa4002f70 tx=0x7f3fa4006eb0).ready entity=mon.0 client_cookie=bb32e63e288b56c7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:43.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fae7fc700 1 -- 172.21.15.57:0/1152330586 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa400d570 con 0x7f3fb00b1930 2021-06-25T04:54:43.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fae7fc700 1 -- 172.21.15.57:0/1152330586 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa4000e90 con 0x7f3fb00b1930 2021-06-25T04:54:43.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fae7fc700 1 -- 172.21.15.57:0/1152330586 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa400d900 con 0x7f3fb00b1930 2021-06-25T04:54:43.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 -- 172.21.15.57:0/1152330586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb00b1930 msgr2=0x7f3fb0066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:43.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 --2- 172.21.15.57:0/1152330586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb00b1930 0x7f3fb0066f20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f3fa4002f70 tx=0x7f3fa4006eb0).stop 2021-06-25T04:54:43.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 -- 172.21.15.57:0/1152330586 shutdown_connections 2021-06-25T04:54:43.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 --2- 172.21.15.57:0/1152330586 >> v2:172.21.15.87:3300/0 conn(0x7f3fb00b0020 0x7f3fb005f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:43.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 --2- 172.21.15.57:0/1152330586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb00b1930 0x7f3fb0066f20 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:43.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 --2- 172.21.15.57:0/1152330586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fb00a7670 0x7f3fb0066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:43.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 -- 172.21.15.57:0/1152330586 >> 172.21.15.57:0/1152330586 conn(0x7f3fb00b53a0 msgr2=0x7f3fb00b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:43.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 -- 172.21.15.57:0/1152330586 shutdown_connections 2021-06-25T04:54:43.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.000+0000 7f3fb607c700 1 -- 172.21.15.57:0/1152330586 wait complete. 2021-06-25T04:54:43.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3fb607c700 1 Processor -- start 2021-06-25T04:54:43.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3fb607c700 1 -- start start 2021-06-25T04:54:43.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3fb607c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb00a7670 0x7f3fb00b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:43.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3fb607c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fb00b0020 0x7f3fb0156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:43.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3fb607c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb00b1930 0x7f3fb00aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:43.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3fb607c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00ab4d0 con 0x7f3fb00a7670 2021-06-25T04:54:43.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3fb607c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00ae430 con 0x7f3fb00b1930 2021-06-25T04:54:43.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3fb607c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00ad470 con 0x7f3fb00b0020 2021-06-25T04:54:43.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3faf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb00a7670 0x7f3fb00b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:43.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3faf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb00a7670 0x7f3fb00b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40528/0 (socket says 172.21.15.57:40528) 2021-06-25T04:54:43.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3faf7fe700 1 -- 172.21.15.57:0/2573782347 learned_addr learned my addr 172.21.15.57:0/2573782347 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:43.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3faffff700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb00b1930 0x7f3fb00aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:43.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3faeffd700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fb00b0020 0x7f3fb0156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:43.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3faf7fe700 1 -- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fb00b0020 msgr2=0x7f3fb0156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:43.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3faf7fe700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fb00b0020 0x7f3fb0156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:43.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3faf7fe700 1 -- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb00b1930 msgr2=0x7f3fb00aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:43.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3faf7fe700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb00b1930 0x7f3fb00aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:43.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3faf7fe700 1 -- 172.21.15.57:0/2573782347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa400b1e0 con 0x7f3fb00a7670 2021-06-25T04:54:43.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3faf7fe700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb00a7670 0x7f3fb00b46c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f3fa00030b0 tx=0x7f3fa0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:43.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3facff9700 1 -- 172.21.15.57:0/2573782347 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa0011780 con 0x7f3fb00a7670 2021-06-25T04:54:43.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.004+0000 7f3facff9700 1 -- 172.21.15.57:0/2573782347 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa00118e0 con 0x7f3fb00a7670 2021-06-25T04:54:43.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.008+0000 7f3fb607c700 1 -- 172.21.15.57:0/2573782347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb00ab8c0 con 0x7f3fb00a7670 2021-06-25T04:54:43.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.008+0000 7f3facff9700 1 -- 172.21.15.57:0/2573782347 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa0011c40 con 0x7f3fb00a7670 2021-06-25T04:54:43.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.008+0000 7f3fb607c700 1 -- 172.21.15.57:0/2573782347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb00ad670 con 0x7f3fb00a7670 2021-06-25T04:54:43.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.008+0000 7f3fb607c700 1 -- 172.21.15.57:0/2573782347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb00af2d0 con 0x7f3fb00a7670 2021-06-25T04:54:43.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.008+0000 7f3facff9700 1 -- 172.21.15.57:0/2573782347 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3fa0012420 con 0x7f3fb00a7670 2021-06-25T04:54:43.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.008+0000 7f3facff9700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f90055340 0x7f3f90057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:43.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.008+0000 7f3facff9700 1 -- 172.21.15.57:0/2573782347 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3fa006dc70 con 0x7f3fb00a7670 2021-06-25T04:54:43.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.008+0000 7f3faeffd700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f90055340 0x7f3f90057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:43.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.008+0000 7f3faeffd700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f90055340 0x7f3f90057800 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f3fa401b000 tx=0x7f3fa4015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:43.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.016+0000 7f3facff9700 1 -- 172.21.15.57:0/2573782347 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3fa0043dc0 con 0x7f3fb00a7670 2021-06-25T04:54:43.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.184+0000 7f3fb607c700 1 -- 172.21.15.57:0/2573782347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fb00ab1f0 con 0x7f3fb00a7670 2021-06-25T04:54:43.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.184+0000 7f3facff9700 1 -- 172.21.15.57:0/2573782347 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f3fa00473e0 con 0x7f3fb00a7670 2021-06-25T04:54:43.188 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:43.189 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/2314323791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2314323791},{"type":"v1","addr":"172.21.15.87:6835","nonce":2314323791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3937527303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3937527303},{"type":"v1","addr":"172.21.15.57:6833","nonce":3937527303}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:35.964849+0000","modified":"2021-06-25T04:54:36.968582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2701177693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2701177693},{"type":"v1","addr":"172.21.15.57:6835","nonce":2701177693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-06-25T04:54:43.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 -- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f90055340 msgr2=0x7f3f90057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:43.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f90055340 0x7f3f90057800 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f3fa401b000 tx=0x7f3fa4015000).stop 2021-06-25T04:54:43.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 -- 172.21.15.57:0/2573782347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb00a7670 msgr2=0x7f3fb00b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:43.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb00a7670 0x7f3fb00b46c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f3fa00030b0 tx=0x7f3fa0008040).stop 2021-06-25T04:54:43.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 -- 172.21.15.57:0/2573782347 shutdown_connections 2021-06-25T04:54:43.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f90055340 0x7f3f90057800 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:43.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb00b1930 0x7f3fb00aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fb00b0020 0x7f3fb0156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 --2- 172.21.15.57:0/2573782347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb00a7670 0x7f3fb00b46c0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 -- 172.21.15.57:0/2573782347 >> 172.21.15.57:0/2573782347 conn(0x7f3fb00b53a0 msgr2=0x7f3fb0149bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 -- 172.21.15.57:0/2573782347 shutdown_connections 2021-06-25T04:54:43.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:43.188+0000 7f3fb607c700 1 -- 172.21.15.57:0/2573782347 wait complete. 2021-06-25T04:54:43.194 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 41 2021-06-25T04:54:43.504 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:54:35.964849+0000', 'modified': '2021-06-25T04:54:36.968582+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6678}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6678': {'gid': 6678, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2701177693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2701177693}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2701177693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:54:43.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:54:43.506 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:54:43.624 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":6678,"want_state":"up:active","state":"up:active","rank_uptime":7.6458141670000002,"mdsmap_epoch":41,"osdmap_epoch":88,"osdmap_epoch_barrier":88,"uptime":11.992716952} 2021-06-25T04:54:43.624 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 6678, "mdsmap_epoch": 41, "osdmap_epoch": 88, "osdmap_epoch_barrier": 88, "rank_uptime": 7.645814167, "state": "up:active", "uptime": 11.992716952, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:54:43.625 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:54:43.625 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-06-25T04:54:43.626 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi161.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-06-25T04:54:43.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:43.627 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:43.636 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:54:43.696 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:54:43.697 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:54:43.711 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:54:43.712 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:54:43.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:43.714 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:54:43.767 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:54:43.767 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:43.771 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:54:43.787 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:54:43.788 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:54:43.845 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:54:43.845 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:54:43.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:43.847 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:54:43.848 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:2021-06-25T04:54:43.842+0000 7fa359670080 -1 init, newargv = 0x5651720f2920 newargc=9 2021-06-25T04:54:43.848 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14628]: starting ceph client 2021-06-25T04:54:43.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14628]: starting fuse 2021-06-25T04:54:44.954 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:54:44.973 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:54:44.973 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:54:45.034 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:54:45.035 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:54:45.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:45.036 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:54:45.043 INFO:teuthology.orchestra.run.smithi161.stdout:52 2021-06-25T04:54:45.043 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:54:45.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:45.044 DEBUG:teuthology.orchestra.run.smithi161:> sudo python3 -c ' 2021-06-25T04:54:45.044 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2021-06-25T04:54:45.045 DEBUG:teuthology.orchestra.run.smithi161:> import re 2021-06-25T04:54:45.045 DEBUG:teuthology.orchestra.run.smithi161:> import os 2021-06-25T04:54:45.046 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2021-06-25T04:54:45.046 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:54:45.047 DEBUG:teuthology.orchestra.run.smithi161:> def find_socket(client_name): 2021-06-25T04:54:45.047 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-06-25T04:54:45.047 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2021-06-25T04:54:45.048 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:54:45.048 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2021-06-25T04:54:45.049 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2021-06-25T04:54:45.049 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2021-06-25T04:54:45.049 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2021-06-25T04:54:45.050 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:54:45.050 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2021-06-25T04:54:45.051 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:54:45.051 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:54:45.051 DEBUG:teuthology.orchestra.run.smithi161:> return f 2021-06-25T04:54:45.052 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:54:45.052 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:54:45.053 DEBUG:teuthology.orchestra.run.smithi161:> print(find_socket("client.1")) 2021-06-25T04:54:45.053 DEBUG:teuthology.orchestra.run.smithi161:> ' 2021-06-25T04:54:45.099 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.14628.asok 2021-06-25T04:54:45.103 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14628.asok 2021-06-25T04:54:45.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:45.105 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14628.asok status 2021-06-25T04:54:45.234 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2021-06-25T04:54:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2021-06-25T04:54:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:54:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:54:45.235 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2021-06-25T04:54:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2021-06-25T04:54:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-06-25T04:54:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "14628", 2021-06-25T04:54:45.236 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2021-06-25T04:54:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:54:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2021-06-25T04:54:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2021-06-25T04:54:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 6128, 2021-06-25T04:54:45.237 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2021-06-25T04:54:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2021-06-25T04:54:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2021-06-25T04:54:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 6128 2021-06-25T04:54:45.238 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:54:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:54:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:54:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:54:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 938222718 2021-06-25T04:54:45.239 INFO:teuthology.orchestra.run.smithi161.stdout: } 2021-06-25T04:54:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:54:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:54:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:54:45.240 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:54:45.241 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 938222718 2021-06-25T04:54:45.244 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:54:45.244 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.6128 172.21.15.161:0/938222718", 2021-06-25T04:54:45.245 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "172.21.15.161:0/938222718", 2021-06-25T04:54:45.245 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2021-06-25T04:54:45.245 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 41, 2021-06-25T04:54:45.246 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 88, 2021-06-25T04:54:45.246 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:54:45.246 INFO:teuthology.orchestra.run.smithi161.stdout: "blacklisted": false, 2021-06-25T04:54:45.247 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2021-06-25T04:54:45.247 INFO:teuthology.orchestra.run.smithi161.stdout:} 2021-06-25T04:54:45.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:45.249 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:45.249 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:45.265 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:54:45.266 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:54:45.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:45.267 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:45.328 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:45.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.428+0000 7feb48319700 1 Processor -- start 2021-06-25T04:54:45.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.428+0000 7feb48319700 1 -- start start 2021-06-25T04:54:45.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.428+0000 7feb48319700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feb40060cc0 0x7feb400aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:45.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.428+0000 7feb48319700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb400afd40 0x7feb40143420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:45.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.428+0000 7feb48319700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb400671a0 con 0x7feb40066dc0 2021-06-25T04:54:45.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.428+0000 7feb48319700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb400b0150 con 0x7feb40060cc0 2021-06-25T04:54:45.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.428+0000 7feb48319700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb400a9410 con 0x7feb400afd40 2021-06-25T04:54:45.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb458b4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feb40060cc0 0x7feb400aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:45.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb468b6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb400afd40 0x7feb40143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:45.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb458b4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feb40060cc0 0x7feb400aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:49030/0 (socket says 172.21.15.57:49030) 2021-06-25T04:54:45.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb458b4700 1 -- 172.21.15.57:0/105461156 learned_addr learned my addr 172.21.15.57:0/105461156 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:45.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb460b5700 1 --1- 172.21.15.57:0/105461156 >> v1:172.21.15.87:6789/0 conn(0x7feb40066dc0 0x7feb400aa7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:58502/0 (socket says 172.21.15.57:58502) 2021-06-25T04:54:45.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb458b4700 1 -- 172.21.15.57:0/105461156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb400afd40 msgr2=0x7feb40143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:45.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb458b4700 1 --2- 172.21.15.57:0/105461156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb400afd40 0x7feb40143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:45.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb458b4700 1 -- 172.21.15.57:0/105461156 >> v1:172.21.15.87:6789/0 conn(0x7feb40066dc0 legacy=0x7feb400aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:45.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb458b4700 1 -- 172.21.15.57:0/105461156 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb400b0370 con 0x7feb40060cc0 2021-06-25T04:54:45.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb458b4700 1 --2- 172.21.15.57:0/105461156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb40060cc0 0x7feb400aaed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7feb380032f0 tx=0x7feb38009290).ready entity=mon.1 client_cookie=c9e821d2266b9c4c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:45.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb450b3700 1 -- 172.21.15.57:0/105461156 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb3800b8a0 con 0x7feb40060cc0 2021-06-25T04:54:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb450b3700 1 -- 172.21.15.57:0/105461156 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3800ba00 con 0x7feb40060cc0 2021-06-25T04:54:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb48319700 1 -- 172.21.15.57:0/105461156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb40060cc0 msgr2=0x7feb400aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb48319700 1 --2- 172.21.15.57:0/105461156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb40060cc0 0x7feb400aaed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7feb380032f0 tx=0x7feb38009290).stop 2021-06-25T04:54:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb48319700 1 -- 172.21.15.57:0/105461156 shutdown_connections 2021-06-25T04:54:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb48319700 1 --2- 172.21.15.57:0/105461156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb400afd40 0x7feb40143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb48319700 1 --2- 172.21.15.57:0/105461156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb40060cc0 0x7feb400aaed0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb48319700 1 -- 172.21.15.57:0/105461156 >> 172.21.15.57:0/105461156 conn(0x7feb400b53a0 msgr2=0x7feb400b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb48319700 1 -- 172.21.15.57:0/105461156 shutdown_connections 2021-06-25T04:54:45.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.432+0000 7feb48319700 1 -- 172.21.15.57:0/105461156 wait complete. 2021-06-25T04:54:45.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb48319700 1 Processor -- start 2021-06-25T04:54:45.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb48319700 1 -- start start 2021-06-25T04:54:45.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb48319700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb40060cc0 0x7feb4013ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:45.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb48319700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb40066dc0 0x7feb40155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:45.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb48319700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb400afd40 0x7feb40155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:45.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb48319700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb400ad730 con 0x7feb40066dc0 2021-06-25T04:54:45.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb48319700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb400adc90 con 0x7feb400afd40 2021-06-25T04:54:45.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb48319700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb400ad9d0 con 0x7feb40060cc0 2021-06-25T04:54:45.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb458b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb40066dc0 0x7feb40155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:45.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb460b5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb40060cc0 0x7feb4013ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:45.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb458b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb40066dc0 0x7feb40155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40544/0 (socket says 172.21.15.57:40544) 2021-06-25T04:54:45.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb458b4700 1 -- 172.21.15.57:0/530922420 learned_addr learned my addr 172.21.15.57:0/530922420 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:45.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb468b6700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb400afd40 0x7feb40155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:45.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb458b4700 1 -- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb40060cc0 msgr2=0x7feb4013ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:45.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb458b4700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb40060cc0 0x7feb4013ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:45.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb458b4700 1 -- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb400afd40 msgr2=0x7feb40155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:45.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb458b4700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb400afd40 0x7feb40155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:45.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb458b4700 1 -- 172.21.15.57:0/530922420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb38009530 con 0x7feb40066dc0 2021-06-25T04:54:45.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb460b5700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb40060cc0 0x7feb4013ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:45.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb468b6700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb400afd40 0x7feb40155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:45.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.436+0000 7feb458b4700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb40066dc0 0x7feb40155a30 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7feb380032f0 tx=0x7feb38016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:45.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.440+0000 7feb3f7fe700 1 -- 172.21.15.57:0/530922420 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb38011a00 con 0x7feb40066dc0 2021-06-25T04:54:45.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.440+0000 7feb3f7fe700 1 -- 172.21.15.57:0/530922420 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb38011b60 con 0x7feb40066dc0 2021-06-25T04:54:45.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.440+0000 7feb48319700 1 -- 172.21.15.57:0/530922420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb40143a70 con 0x7feb40066dc0 2021-06-25T04:54:45.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.440+0000 7feb3f7fe700 1 -- 172.21.15.57:0/530922420 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb38020430 con 0x7feb40066dc0 2021-06-25T04:54:45.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.440+0000 7feb48319700 1 -- 172.21.15.57:0/530922420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb40144d90 con 0x7feb40066dc0 2021-06-25T04:54:45.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.440+0000 7feb48319700 1 -- 172.21.15.57:0/530922420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb40144770 con 0x7feb40066dc0 2021-06-25T04:54:45.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.440+0000 7feb3f7fe700 1 -- 172.21.15.57:0/530922420 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7feb3800f070 con 0x7feb40066dc0 2021-06-25T04:54:45.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.440+0000 7feb3f7fe700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb20055360 0x7feb20057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:45.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.440+0000 7feb3f7fe700 1 -- 172.21.15.57:0/530922420 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7feb3806eae0 con 0x7feb40066dc0 2021-06-25T04:54:45.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.440+0000 7feb460b5700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb20055360 0x7feb20057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:45.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.444+0000 7feb460b5700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb20055360 0x7feb20057820 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7feb3400d000 tx=0x7feb34009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:45.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.448+0000 7feb3f7fe700 1 -- 172.21.15.57:0/530922420 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7feb38044d40 con 0x7feb40066dc0 2021-06-25T04:54:45.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.616+0000 7feb48319700 1 -- 172.21.15.57:0/530922420 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb40057310 con 0x7feb40066dc0 2021-06-25T04:54:45.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.616+0000 7feb3f7fe700 1 -- 172.21.15.57:0/530922420 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7feb38015070 con 0x7feb40066dc0 2021-06-25T04:54:45.620 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:45.620 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/2314323791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2314323791},{"type":"v1","addr":"172.21.15.87:6835","nonce":2314323791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3937527303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3937527303},{"type":"v1","addr":"172.21.15.57:6833","nonce":3937527303}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:35.964849+0000","modified":"2021-06-25T04:54:36.968582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2701177693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2701177693},{"type":"v1","addr":"172.21.15.57:6835","nonce":2701177693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-06-25T04:54:45.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.616+0000 7feb48319700 1 -- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb20055360 msgr2=0x7feb20057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:45.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.616+0000 7feb48319700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb20055360 0x7feb20057820 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7feb3400d000 tx=0x7feb34009040).stop 2021-06-25T04:54:45.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.616+0000 7feb48319700 1 -- 172.21.15.57:0/530922420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb40066dc0 msgr2=0x7feb40155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:45.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.616+0000 7feb48319700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb40066dc0 0x7feb40155a30 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7feb380032f0 tx=0x7feb38016000).stop 2021-06-25T04:54:45.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.620+0000 7feb48319700 1 -- 172.21.15.57:0/530922420 shutdown_connections 2021-06-25T04:54:45.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.620+0000 7feb48319700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb20055360 0x7feb20057820 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:45.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.620+0000 7feb48319700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb400afd40 0x7feb40155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:45.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.620+0000 7feb48319700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb40066dc0 0x7feb40155a30 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:45.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.620+0000 7feb48319700 1 --2- 172.21.15.57:0/530922420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb40060cc0 0x7feb4013ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:45.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.620+0000 7feb48319700 1 -- 172.21.15.57:0/530922420 >> 172.21.15.57:0/530922420 conn(0x7feb400b53a0 msgr2=0x7feb400aac80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:45.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.620+0000 7feb48319700 1 -- 172.21.15.57:0/530922420 shutdown_connections 2021-06-25T04:54:45.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:45.620+0000 7feb48319700 1 -- 172.21.15.57:0/530922420 wait complete. 2021-06-25T04:54:45.625 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 41 2021-06-25T04:54:45.634 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1 2021-06-25T04:54:45.735 INFO:teuthology.orchestra.run.smithi057.stdout:{"path":"/","ino":1,"rdev":0,"ctime":"2021-06-25T04:54:41.525448+0000","btime":"2021-06-25T04:54:35.968639+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":16,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":0,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-06-25T04:54:35.968639+0000","atime":"0.000000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-06-25T04:54:41.525448+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-06-25T04:54:35.968639+0000"},"version":3,"file_data_version":0,"xattr_version":1,"backtrace_version":3,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"request":1,"lock":3,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":1},"nref":9,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"xlockdone","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{"gather_set":[],"state":"sync","is_leased":false,"num_rdlocks":1,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent"],"client_caps":[{"client_id":6128,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2},{"client_id":6834,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[]} 2021-06-25T04:54:45.735 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "2021-06-25T04:54:35.968639+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "0.000000", "auth_pins": 2, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "xlockdone", "xlock_by": {} }, "backtrace_version": 3, "btime": "2021-06-25T04:54:35.968639+0000", "change_attr": 1, "client_caps": [ { "client_id": 6128, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" }, { "client_id": 6834, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-06-25T04:54:41.525448+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 16, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2021-06-25T04:54:35.968639+0000", "nestlock": {}, "nlink": 1, "nref": 9, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/", "pins": { "authpin": 1, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 3, "request": 1 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2021-06-25T04:54:41.525448+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": { "gather_set": [], "is_leased": false, "num_rdlocks": 1, "num_wrlocks": 0, "num_xlocks": 0, "state": "sync", "xlock_by": {} }, "states": [ "auth", "dirty", "dirtyparent" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "uid": 0, "version": 3, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2021-06-25T04:54:45.736 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:54:45.736 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:45.756 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:45.778 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:45.798 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:45.820 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:54:45.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:45.821 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:45.821 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:45.847 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:54:45.848 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:54:45.849 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:54:45.850 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:54:45.850 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:45.866 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15169]: fuse finished with error 0 and tester_r 0 2021-06-25T04:54:45.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:45.869 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:45.869 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:45.874 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:54:45.876 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:54:45.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:54:45.992 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:46.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:46.000 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:46.001 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:46.009 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:54:46.010 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:54:46.011 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2021-06-25T04:54:46.011 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:54:46.012 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:46.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14628]: fuse finished with error 0 and tester_r 0 2021-06-25T04:54:46.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:46.030 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:46.030 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:46.037 INFO:teuthology.orchestra.run.smithi161.stdout:ext2/ext3 2021-06-25T04:54:46.038 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:54:46.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:54:46.154 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:46.162 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:54:46.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f3fff700 1 Processor -- start 2021-06-25T04:54:46.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f3fff700 1 -- start start 2021-06-25T04:54:46.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe9f4061640 0x7fe9f40b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:46.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f3fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f40b68d0 con 0x7fe9f40b46d0 2021-06-25T04:54:46.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f3fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f40b6b70 con 0x7fe9f4143960 2021-06-25T04:54:46.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f3fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f40b9640 con 0x7fe9f4061640 2021-06-25T04:54:46.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f2ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe9f4061640 0x7fe9f40b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:46.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f27fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe9f40b46d0 0x7fe9f413fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57768/0 (socket says 172.21.15.57:57768) 2021-06-25T04:54:46.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f27fc700 1 -- 172.21.15.57:0/4011733078 learned_addr learned my addr 172.21.15.57:0/4011733078 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:46.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f1ffb700 1 -- 172.21.15.57:0/4011733078 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394822584 0 0) 0x7fe9f40b68d0 con 0x7fe9f40b46d0 2021-06-25T04:54:46.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f1ffb700 1 -- 172.21.15.57:0/4011733078 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d8003260 con 0x7fe9f40b46d0 2021-06-25T04:54:46.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f1ffb700 1 -- 172.21.15.57:0/4011733078 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918714135 0 0) 0x7fe9f40b6b70 con 0x7fe9f4143960 2021-06-25T04:54:46.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f1ffb700 1 -- 172.21.15.57:0/4011733078 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f40b68d0 con 0x7fe9f4143960 2021-06-25T04:54:46.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f2ffd700 1 -- 172.21.15.57:0/4011733078 >> v1:172.21.15.87:6789/0 conn(0x7fe9f4143960 legacy=0x7fe9f414d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f2ffd700 1 -- 172.21.15.57:0/4011733078 >> v1:172.21.15.57:6789/0 conn(0x7fe9f40b46d0 legacy=0x7fe9f413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.272+0000 7fe9f2ffd700 1 -- 172.21.15.57:0/4011733078 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f40b6e10 con 0x7fe9f4061640 2021-06-25T04:54:46.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.276+0000 7fe9f2ffd700 1 --2- 172.21.15.57:0/4011733078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9f4061640 0x7fe9f40b9cd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fe9e8002f70 tx=0x7fe9e8006df0).ready entity=mon.0 client_cookie=fa740541c43e1e1e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:46.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.276+0000 7fe9f1ffb700 1 -- 172.21.15.57:0/4011733078 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e800d540 con 0x7fe9f4061640 2021-06-25T04:54:46.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.276+0000 7fe9f1ffb700 1 -- 172.21.15.57:0/4011733078 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e8000e90 con 0x7fe9f4061640 2021-06-25T04:54:46.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.276+0000 7fe9f1ffb700 1 -- 172.21.15.57:0/4011733078 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e800d890 con 0x7fe9f4061640 2021-06-25T04:54:46.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.276+0000 7fe9f3fff700 1 -- 172.21.15.57:0/4011733078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9f4061640 msgr2=0x7fe9f40b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.276+0000 7fe9f3fff700 1 --2- 172.21.15.57:0/4011733078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9f4061640 0x7fe9f40b9cd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fe9e8002f70 tx=0x7fe9e8006df0).stop 2021-06-25T04:54:46.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.276+0000 7fe9f3fff700 1 -- 172.21.15.57:0/4011733078 shutdown_connections 2021-06-25T04:54:46.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.276+0000 7fe9f3fff700 1 --2- 172.21.15.57:0/4011733078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9f4061640 0x7fe9f40b9cd0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.276+0000 7fe9f3fff700 1 -- 172.21.15.57:0/4011733078 >> 172.21.15.57:0/4011733078 conn(0x7fe9f406adb0 msgr2=0x7fe9f405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:46.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.276+0000 7fe9f3fff700 1 -- 172.21.15.57:0/4011733078 shutdown_connections 2021-06-25T04:54:46.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.276+0000 7fe9f3fff700 1 -- 172.21.15.57:0/4011733078 wait complete. 2021-06-25T04:54:46.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f3fff700 1 Processor -- start 2021-06-25T04:54:46.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f3fff700 1 -- start start 2021-06-25T04:54:46.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f4061640 0x7fe9f4149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:46.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9f4143960 0x7fe9f4152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:46.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f3fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9f41560b0 0x7fe9f41463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:46.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f3fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f40b76a0 con 0x7fe9f4143960 2021-06-25T04:54:46.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f3fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f4152750 con 0x7fe9f4061640 2021-06-25T04:54:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f3fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f41559b0 con 0x7fe9f41560b0 2021-06-25T04:54:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9f4143960 0x7fe9f4152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9f4143960 0x7fe9f4152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40558/0 (socket says 172.21.15.57:40558) 2021-06-25T04:54:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f27fc700 1 -- 172.21.15.57:0/1349870722 learned_addr learned my addr 172.21.15.57:0/1349870722 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:46.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f2ffd700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f4061640 0x7fe9f4149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:46.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f37fe700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9f41560b0 0x7fe9f41463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:46.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f27fc700 1 -- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9f41560b0 msgr2=0x7fe9f41463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f27fc700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9f41560b0 0x7fe9f41463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f27fc700 1 -- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f4061640 msgr2=0x7fe9f4149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f27fc700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f4061640 0x7fe9f4149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f27fc700 1 -- 172.21.15.57:0/1349870722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e800b180 con 0x7fe9f4143960 2021-06-25T04:54:46.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f27fc700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9f4143960 0x7fe9f4152260 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fe9e40011d0 tx=0x7fe9e4007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:46.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9e3fff700 1 -- 172.21.15.57:0/1349870722 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e40070d0 con 0x7fe9f4143960 2021-06-25T04:54:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9e3fff700 1 -- 172.21.15.57:0/1349870722 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e4007230 con 0x7fe9f4143960 2021-06-25T04:54:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1349870722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f40b7400 con 0x7fe9f4143960 2021-06-25T04:54:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9e3fff700 1 -- 172.21.15.57:0/1349870722 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e4005610 con 0x7fe9f4143960 2021-06-25T04:54:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.280+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1349870722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f4156560 con 0x7fe9f4143960 2021-06-25T04:54:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.284+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1349870722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f4057310 con 0x7fe9f4143960 2021-06-25T04:54:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.284+0000 7fe9e3fff700 1 -- 172.21.15.57:0/1349870722 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe9e401a060 con 0x7fe9f4143960 2021-06-25T04:54:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.284+0000 7fe9e3fff700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9d00553d0 0x7fe9d0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.284+0000 7fe9e3fff700 1 -- 172.21.15.57:0/1349870722 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe9e406d5a0 con 0x7fe9f4143960 2021-06-25T04:54:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.284+0000 7fe9f2ffd700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9d00553d0 0x7fe9d0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.284+0000 7fe9f2ffd700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9d00553d0 0x7fe9d0057890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fe9e8017000 tx=0x7fe9e8014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.292+0000 7fe9e3fff700 1 -- 172.21.15.57:0/1349870722 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe9e4043750 con 0x7fe9f4143960 2021-06-25T04:54:46.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.424+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1349870722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe9f413dc80 con 0x7fe9f4143960 2021-06-25T04:54:46.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9e3fff700 1 -- 172.21.15.57:0/1349870722 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v88) v1 ==== 81+0+34040 (secure 0 0 0) 0x7fe9e4018020 con 0x7fe9f4143960 2021-06-25T04:54:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:46.432 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:54:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 88, 2021-06-25T04:54:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:54:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:54:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:54:36.967424+0000", 2021-06-25T04:54:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:54:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:54:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:54:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:54:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:54:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:54:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:54:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:54:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:54:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:54:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:54:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:54:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:54:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:54:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 16, 2021-06-25T04:54:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:54:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:54:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:54:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:54:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:54:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:54:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:54:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:54:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:54:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:54:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:54:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:54:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:54:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:54:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:54:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:54:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:54:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:54:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:54:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:54:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:54:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:54:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:54:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:54:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:54:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:54:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:54:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:54:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 15, 2021-06-25T04:54:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:54:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:54:34.391112+0000", 2021-06-25T04:54:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:54:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:54:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:54:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:54:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:54:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "88", 2021-06-25T04:54:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:54:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:54:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:54:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:54:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:54:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:54:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 16, 2021-06-25T04:54:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:54:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:54:35.648616+0000", 2021-06-25T04:54:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:54:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:54:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:54:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:54:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:54:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "88", 2021-06-25T04:54:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:54:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:54:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:54:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:54:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:54:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:54:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:54:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:54:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:54:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:54:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:54:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:54:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:54:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:54:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:54:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:54:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:54:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:54:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:54:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:54:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 85, 2021-06-25T04:54:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:54:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:54:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.525 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:46.525 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.525 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.526 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:54:46.526 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:46.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.527 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.527 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:54:46.527 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:46.527 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.527 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.528 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:46.528 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.528 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.529 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:54:46.529 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:46.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.530 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.530 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:54:46.530 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:46.530 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.530 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.531 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:46.531 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.531 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.532 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:54:46.532 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:46.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.533 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.533 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:54:46.533 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:46.533 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.533 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.534 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:54:46.534 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:54:46.534 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:54:46.535 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:54:46.535 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:46.535 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:46.535 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:46.535 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.536 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:54:46.536 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:54:46.536 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:46.537 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:46.537 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:46.537 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:46.537 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:46.538 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:46.538 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:46.538 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:46.538 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:46.538 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:46.539 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:46.539 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.539 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.539 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:54:46.540 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:46.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.540 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.541 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:54:46.541 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:46.541 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.541 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.542 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:46.542 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.542 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.543 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:54:46.543 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:46.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.544 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.544 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:54:46.544 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:46.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.544 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.545 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:46.545 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.545 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.546 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:54:46.546 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:46.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.549 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.549 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:54:46.550 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:46.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.550 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.551 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:46.551 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.551 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.552 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:54:46.552 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:46.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.552 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.553 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:54:46.553 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:46.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.554 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.554 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:54:46.555 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:54:46.555 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:54:46.555 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:54:46.555 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:46.556 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:46.556 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:46.556 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.557 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:54:46.557 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:54:46.557 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:46.557 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:46.557 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:46.558 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:46.558 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:46.559 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:46.559 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:46.559 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:46.559 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:46.560 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:46.560 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:46.561 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.561 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.561 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:54:46.561 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:46.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.562 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.562 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:54:46.563 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:46.563 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.563 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.564 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:46.565 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.565 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.566 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:54:46.566 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:46.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.570 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:54:46.571 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:46.571 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.571 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.572 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:46.572 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.572 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.573 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:54:46.573 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:46.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.574 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.574 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:54:46.574 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:46.575 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.575 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.576 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:46.576 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.576 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.576 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:54:46.577 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:46.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.577 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.578 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:54:46.578 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:46.579 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.579 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.580 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:54:46.580 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:54:46.581 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:54:46.581 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:54:46.581 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:46.581 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:46.582 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:46.582 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.583 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:54:46.583 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:54:46.583 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:46.583 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:46.583 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:46.584 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:46.584 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:46.585 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:46.585 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:46.585 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:46.585 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:46.586 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:46.586 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:46.586 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.587 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.587 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:54:46.587 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:46.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.588 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.588 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:54:46.588 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:46.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.589 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.589 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:46.589 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.590 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.590 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:54:46.590 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:46.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.591 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.591 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:54:46.591 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:46.591 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.592 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.592 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:46.592 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.593 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.593 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:54:46.593 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:46.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.594 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.594 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:54:46.594 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:46.595 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.595 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.595 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:46.595 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.596 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.596 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:54:46.596 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:46.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.597 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.597 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:54:46.597 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:46.598 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.598 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.598 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:54:46.598 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:54:46.599 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:54:46.599 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:54:46.599 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:46.599 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:46.600 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:46.600 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.600 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:54:46.601 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:54:46.601 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:46.601 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:46.601 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:46.601 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:46.602 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:46.602 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:46.602 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:46.602 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:46.603 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:46.603 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:46.603 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:46.603 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.604 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.604 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:54:46.604 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:46.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.605 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.605 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:54:46.605 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:46.605 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.606 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.606 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:46.606 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.607 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.607 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:54:46.607 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:46.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.608 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.608 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:54:46.608 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:46.608 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.609 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.609 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:46.609 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.610 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.610 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:54:46.610 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:46.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.611 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.611 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:54:46.611 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:46.612 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.612 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.612 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:46.612 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.613 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.613 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:54:46.613 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:46.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.614 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.614 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:54:46.614 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:46.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.615 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:54:46.615 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:54:46.616 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:54:46.616 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:54:46.616 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:46.616 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:46.617 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:46.617 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.617 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:54:46.618 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:54:46.618 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:46.618 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:46.618 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:46.619 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:46.619 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:46.619 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:46.619 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:46.619 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:46.620 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:46.620 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:46.620 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:46.620 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.621 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.621 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:54:46.621 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:46.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.622 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.622 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:54:46.622 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:46.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.623 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.623 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:46.623 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.624 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.624 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:54:46.624 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:46.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.625 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.625 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:54:46.625 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:46.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.626 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.626 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:46.626 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.627 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.627 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:54:46.627 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:46.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.628 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.628 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:54:46.628 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:46.629 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.629 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.629 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:46.629 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.630 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.630 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:54:46.630 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:46.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.631 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:54:46.631 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:46.632 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.632 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.632 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:54:46.632 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:54:46.633 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:54:46.633 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:54:46.633 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:46.633 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:46.634 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:46.634 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.634 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:54:46.635 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:54:46.635 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:46.635 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:46.636 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:46.636 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:46.636 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:46.636 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:46.636 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:46.637 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 74, 2021-06-25T04:54:46.637 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:46.637 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:46.637 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:46.638 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.638 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.638 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:54:46.638 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:46.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.639 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.639 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:54:46.640 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:46.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.640 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.640 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:46.641 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.641 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.641 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:54:46.641 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:46.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.642 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.642 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:54:46.643 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:46.643 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.643 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.643 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:46.644 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.644 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.644 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:54:46.644 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:46.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.645 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.645 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:54:46.646 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:46.646 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.646 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.647 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:46.647 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:46.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.647 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:46.647 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:54:46.648 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:46.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.648 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:46.648 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:54:46.649 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:46.649 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.649 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.650 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:54:46.650 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:54:46.650 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:54:46.650 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:54:46.650 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:46.651 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:46.651 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:46.651 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:46.651 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.651 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:46.652 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:54:46.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.652 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:54:46.652 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:46.653 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:46.653 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:46.653 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:46.654 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:46.654 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:54:46.654 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:46.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.655 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:54:46.655 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:46.655 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:46.655 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:46.656 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:46.656 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:46.656 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:54:46.656 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:46.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:54:46.657 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:46.658 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:46.658 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:46.658 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:46.658 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:46.658 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:54:46.659 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:46.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.659 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:54:46.660 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:46.660 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:46.660 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:46.660 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:46.660 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:46.661 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:54:46.661 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:46.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:54:46.662 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:46.662 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:46.662 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:46.662 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:46.663 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:46.663 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:54:46.663 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:46.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.664 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:54:46.664 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:46.664 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:46.664 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:46.665 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:46.665 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:46.665 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:54:46.665 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:46.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.666 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:54:46.666 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:46.666 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:46.666 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:46.667 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:46.667 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:46.667 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:54:46.667 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:46.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:46.668 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:54:46.668 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:46.668 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:46.669 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:46.669 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:46.669 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:46.669 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:54:46.670 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:46.670 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.670 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:46.670 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:54:46.670 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:54:46.671 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:54:46.671 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:54:46.671 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": {}, 2021-06-25T04:54:46.671 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:54:46.672 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:54:46.672 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:54:46.672 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:54:46.672 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:54:46.672 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:54:46.673 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:54:46.673 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:54:46.673 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:54:46.673 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:54:46.673 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:54:46.674 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:54:46.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.674 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:54:46.674 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:54:46.675 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:54:46.675 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:54:46.675 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:54:46.675 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:54:46.675 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:54:46.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:46.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:46.676 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:54:46.676 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:54:46.676 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:54:46.677 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:54:46.677 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:54:46.677 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:54:46.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9d00553d0 msgr2=0x7fe9d0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9d00553d0 0x7fe9d0057890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fe9e8017000 tx=0x7fe9e8014000).stop 2021-06-25T04:54:46.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1349870722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9f4143960 msgr2=0x7fe9f4152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9f4143960 0x7fe9f4152260 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fe9e40011d0 tx=0x7fe9e4007b50).stop 2021-06-25T04:54:46.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1349870722 shutdown_connections 2021-06-25T04:54:46.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9d00553d0 0x7fe9d0057890 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9f41560b0 0x7fe9f41463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9f4143960 0x7fe9f4152260 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 --2- 172.21.15.57:0/1349870722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f4061640 0x7fe9f4149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1349870722 >> 172.21.15.57:0/1349870722 conn(0x7fe9f406adb0 msgr2=0x7fe9f4140e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:46.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1349870722 shutdown_connections 2021-06-25T04:54:46.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.428+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1349870722 wait complete. 2021-06-25T04:54:46.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:46.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.788+0000 7f39ebf04700 1 Processor -- start 2021-06-25T04:54:46.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.788+0000 7f39ebf04700 1 -- start start 2021-06-25T04:54:46.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39e4066d40 0x7f39e414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:46.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f39e414a5b0 0x7f39e4147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:46.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e414b970 con 0x7f39e4067120 2021-06-25T04:54:46.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e40b4ed0 con 0x7f39e414a5b0 2021-06-25T04:54:46.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e40aabe0 con 0x7f39e4066d40 2021-06-25T04:54:46.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ea4a1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f39e414a5b0 0x7f39e4147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:46.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ea4a1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f39e414a5b0 0x7f39e4147aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40568/0 (socket says 172.21.15.57:40568) 2021-06-25T04:54:46.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39e949f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f39e4067120 0x7f39e4149ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57784/0 (socket says 172.21.15.57:57784) 2021-06-25T04:54:46.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ea4a1700 1 -- 172.21.15.57:0/2714713181 learned_addr learned my addr 172.21.15.57:0/2714713181 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:46.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39e9ca0700 1 --2- 172.21.15.57:0/2714713181 >> v2:172.21.15.87:3300/0 conn(0x7f39e4066d40 0x7f39e414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:46.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39e8c9e700 1 -- 172.21.15.57:0/2714713181 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042277544 0 0) 0x7f39e414b970 con 0x7f39e4067120 2021-06-25T04:54:46.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39e8c9e700 1 -- 172.21.15.57:0/2714713181 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39cc003260 con 0x7f39e4067120 2021-06-25T04:54:46.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ea4a1700 1 -- 172.21.15.57:0/2714713181 >> v2:172.21.15.87:3300/0 conn(0x7f39e4066d40 msgr2=0x7f39e414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:46.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ea4a1700 1 --2- 172.21.15.57:0/2714713181 >> v2:172.21.15.87:3300/0 conn(0x7f39e4066d40 0x7f39e414b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ea4a1700 1 -- 172.21.15.57:0/2714713181 >> v1:172.21.15.57:6789/0 conn(0x7f39e4067120 legacy=0x7f39e4149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ea4a1700 1 -- 172.21.15.57:0/2714713181 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e40aae80 con 0x7f39e414a5b0 2021-06-25T04:54:46.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ea4a1700 1 --2- 172.21.15.57:0/2714713181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e414a5b0 0x7f39e4147aa0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f39e4147980 tx=0x7f39dc009290).ready entity=mon.0 client_cookie=43b21f2c3771d2c1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:46.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39e8c9e700 1 -- 172.21.15.57:0/2714713181 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39dc00b680 con 0x7f39e414a5b0 2021-06-25T04:54:46.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39e8c9e700 1 -- 172.21.15.57:0/2714713181 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc00b7e0 con 0x7f39e414a5b0 2021-06-25T04:54:46.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39e8c9e700 1 -- 172.21.15.57:0/2714713181 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39dc00b950 con 0x7f39e414a5b0 2021-06-25T04:54:46.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 -- 172.21.15.57:0/2714713181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e414a5b0 msgr2=0x7f39e4147aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 --2- 172.21.15.57:0/2714713181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e414a5b0 0x7f39e4147aa0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f39e4147980 tx=0x7f39dc009290).stop 2021-06-25T04:54:46.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 -- 172.21.15.57:0/2714713181 shutdown_connections 2021-06-25T04:54:46.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 --2- 172.21.15.57:0/2714713181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e414a5b0 0x7f39e4147aa0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 --2- 172.21.15.57:0/2714713181 >> v2:172.21.15.87:3300/0 conn(0x7f39e4066d40 0x7f39e414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 -- 172.21.15.57:0/2714713181 >> 172.21.15.57:0/2714713181 conn(0x7f39e405c450 msgr2=0x7f39e405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:46.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 -- 172.21.15.57:0/2714713181 shutdown_connections 2021-06-25T04:54:46.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.792+0000 7f39ebf04700 1 -- 172.21.15.57:0/2714713181 wait complete. 2021-06-25T04:54:46.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ebf04700 1 Processor -- start 2021-06-25T04:54:46.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ebf04700 1 -- start start 2021-06-25T04:54:46.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ebf04700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39e4066d40 0x7f39e414dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:46.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ebf04700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e4067120 0x7f39e40af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:46.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ebf04700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e414a5b0 0x7f39e4159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:46.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ebf04700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e415a930 con 0x7f39e414a5b0 2021-06-25T04:54:46.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ebf04700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e414e490 con 0x7f39e4067120 2021-06-25T04:54:46.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ebf04700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e415a650 con 0x7f39e4066d40 2021-06-25T04:54:46.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ea4a1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e414a5b0 0x7f39e4159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:46.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ea4a1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e414a5b0 0x7f39e4159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40574/0 (socket says 172.21.15.57:40574) 2021-06-25T04:54:46.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ea4a1700 1 -- 172.21.15.57:0/1089571583 learned_addr learned my addr 172.21.15.57:0/1089571583 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:46.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39e9ca0700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39e4066d40 0x7f39e414dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:46.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39e949f700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e4067120 0x7f39e40af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:46.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ea4a1700 1 -- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39e4066d40 msgr2=0x7f39e414dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ea4a1700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39e4066d40 0x7f39e414dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ea4a1700 1 -- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e4067120 msgr2=0x7f39e40af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ea4a1700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e4067120 0x7f39e40af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ea4a1700 1 -- 172.21.15.57:0/1089571583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc009530 con 0x7f39e414a5b0 2021-06-25T04:54:46.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.796+0000 7f39ea4a1700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e414a5b0 0x7f39e4159da0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f39e40ae750 tx=0x7f39dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:46.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.800+0000 7f39d2ffd700 1 -- 172.21.15.57:0/1089571583 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39dc011c00 con 0x7f39e414a5b0 2021-06-25T04:54:46.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.800+0000 7f39d2ffd700 1 -- 172.21.15.57:0/1089571583 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc00ba00 con 0x7f39e414a5b0 2021-06-25T04:54:46.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.800+0000 7f39ebf04700 1 -- 172.21.15.57:0/1089571583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e414d5c0 con 0x7f39e414a5b0 2021-06-25T04:54:46.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.800+0000 7f39d2ffd700 1 -- 172.21.15.57:0/1089571583 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39dc0032f0 con 0x7f39e414a5b0 2021-06-25T04:54:46.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.800+0000 7f39ebf04700 1 -- 172.21.15.57:0/1089571583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e40afba0 con 0x7f39e414a5b0 2021-06-25T04:54:46.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.800+0000 7f39ebf04700 1 -- 172.21.15.57:0/1089571583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e414d8f0 con 0x7f39e414a5b0 2021-06-25T04:54:46.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.800+0000 7f39d2ffd700 1 -- 172.21.15.57:0/1089571583 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f39dc00f070 con 0x7f39e414a5b0 2021-06-25T04:54:46.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.800+0000 7f39d2ffd700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f39c4055450 0x7f39c4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:46.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.800+0000 7f39d2ffd700 1 -- 172.21.15.57:0/1089571583 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f39dc06e5e0 con 0x7f39e414a5b0 2021-06-25T04:54:46.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.800+0000 7f39e9ca0700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f39c4055450 0x7f39c4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:46.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.804+0000 7f39e9ca0700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f39c4055450 0x7f39c4057910 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f39e000b000 tx=0x7f39e0006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:46.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.804+0000 7f39d2ffd700 1 -- 172.21.15.57:0/1089571583 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f39dc044840 con 0x7f39e414a5b0 2021-06-25T04:54:46.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.968+0000 7f39ebf04700 1 -- 172.21.15.57:0/1089571583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39e4057310 con 0x7f39e414a5b0 2021-06-25T04:54:46.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.968+0000 7f39d2ffd700 1 -- 172.21.15.57:0/1089571583 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f39dc015070 con 0x7f39e414a5b0 2021-06-25T04:54:46.975 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:46.976 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/2314323791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2314323791},{"type":"v1","addr":"172.21.15.87:6835","nonce":2314323791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3937527303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3937527303},{"type":"v1","addr":"172.21.15.57:6833","nonce":3937527303}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:35.964849+0000","modified":"2021-06-25T04:54:36.968582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2701177693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2701177693},{"type":"v1","addr":"172.21.15.57:6835","nonce":2701177693}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-06-25T04:54:46.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 -- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f39c4055450 msgr2=0x7f39c4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f39c4055450 0x7f39c4057910 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f39e000b000 tx=0x7f39e0006df0).stop 2021-06-25T04:54:46.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 -- 172.21.15.57:0/1089571583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e414a5b0 msgr2=0x7f39e4159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:46.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e414a5b0 0x7f39e4159da0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f39e40ae750 tx=0x7f39dc016000).stop 2021-06-25T04:54:46.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 -- 172.21.15.57:0/1089571583 shutdown_connections 2021-06-25T04:54:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f39c4055450 0x7f39c4057910 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39e414a5b0 0x7f39e4159da0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e4067120 0x7f39e40af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 --2- 172.21.15.57:0/1089571583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39e4066d40 0x7f39e414dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:46.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 -- 172.21.15.57:0/1089571583 >> 172.21.15.57:0/1089571583 conn(0x7f39e405c450 msgr2=0x7f39e41479c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:46.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 -- 172.21.15.57:0/1089571583 shutdown_connections 2021-06-25T04:54:46.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:46.972+0000 7f39ebf04700 1 -- 172.21.15.57:0/1089571583 wait complete. 2021-06-25T04:54:46.981 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 41 2021-06-25T04:54:46.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:54:47.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed6fcf700 1 Processor -- start 2021-06-25T04:54:47.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed6fcf700 1 -- start start 2021-06-25T04:54:47.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed6fcf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efed00b63f0 0x7efed0061430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed6fcf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efed00b4020 0x7efed0061920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed6fcf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed00b1f30 con 0x7efed0147bb0 2021-06-25T04:54:47.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed6fcf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed00b1460 con 0x7efed00b63f0 2021-06-25T04:54:47.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed6fcf700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed0061e10 con 0x7efed00b4020 2021-06-25T04:54:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed5fcd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efed00b63f0 0x7efed0061430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed57cc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efed00b4020 0x7efed0061920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed5fcd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efed00b63f0 0x7efed0061430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40580/0 (socket says 172.21.15.57:40580) 2021-06-25T04:54:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed57cc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efed00b4020 0x7efed0061920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:49072/0 (socket says 172.21.15.57:49072) 2021-06-25T04:54:47.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed67ce700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efed0147bb0 0x7efed0144460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:58548/0 (socket says 172.21.15.57:58548) 2021-06-25T04:54:47.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed5fcd700 1 -- 172.21.15.57:0/1363197741 learned_addr learned my addr 172.21.15.57:0/1363197741 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:47.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed5fcd700 1 -- 172.21.15.57:0/1363197741 >> v2:172.21.15.87:3300/0 conn(0x7efed00b4020 msgr2=0x7efed0061920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:47.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed5fcd700 1 --2- 172.21.15.57:0/1363197741 >> v2:172.21.15.87:3300/0 conn(0x7efed00b4020 0x7efed0061920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed5fcd700 1 -- 172.21.15.57:0/1363197741 >> v1:172.21.15.87:6789/0 conn(0x7efed0147bb0 legacy=0x7efed0144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed5fcd700 1 -- 172.21.15.57:0/1363197741 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed00b67d0 con 0x7efed00b63f0 2021-06-25T04:54:47.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed57cc700 1 --2- 172.21.15.57:0/1363197741 >> v2:172.21.15.87:3300/0 conn(0x7efed00b4020 0x7efed0061920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:47.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.084+0000 7efed5fcd700 1 --2- 172.21.15.57:0/1363197741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed00b63f0 0x7efed0061430 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7efed0061f50 tx=0x7efecc006eb0).ready entity=mon.0 client_cookie=54c641ecf50cb310 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed4fcb700 1 -- 172.21.15.57:0/1363197741 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efecc00d610 con 0x7efed00b63f0 2021-06-25T04:54:47.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed4fcb700 1 -- 172.21.15.57:0/1363197741 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc000e90 con 0x7efed00b63f0 2021-06-25T04:54:47.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed4fcb700 1 -- 172.21.15.57:0/1363197741 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efecc00d9a0 con 0x7efed00b63f0 2021-06-25T04:54:47.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 -- 172.21.15.57:0/1363197741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed00b63f0 msgr2=0x7efed0061430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 --2- 172.21.15.57:0/1363197741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed00b63f0 0x7efed0061430 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7efed0061f50 tx=0x7efecc006eb0).stop 2021-06-25T04:54:47.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 -- 172.21.15.57:0/1363197741 shutdown_connections 2021-06-25T04:54:47.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 --2- 172.21.15.57:0/1363197741 >> v2:172.21.15.87:3300/0 conn(0x7efed00b4020 0x7efed0061920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 --2- 172.21.15.57:0/1363197741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed00b63f0 0x7efed0061430 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 -- 172.21.15.57:0/1363197741 >> 172.21.15.57:0/1363197741 conn(0x7efed005c450 msgr2=0x7efed005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:47.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 -- 172.21.15.57:0/1363197741 shutdown_connections 2021-06-25T04:54:47.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 -- 172.21.15.57:0/1363197741 wait complete. 2021-06-25T04:54:47.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 Processor -- start 2021-06-25T04:54:47.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 -- start start 2021-06-25T04:54:47.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efed00b4020 0x7efed014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.088+0000 7efed6fcf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed00b63f0 0x7efed0065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed6fcf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed0147bb0 0x7efed0063880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed6fcf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed0066670 con 0x7efed0147bb0 2021-06-25T04:54:47.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed6fcf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed0157560 con 0x7efed00b4020 2021-06-25T04:54:47.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed6fcf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed014b2d0 con 0x7efed00b63f0 2021-06-25T04:54:47.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed67ce700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed0147bb0 0x7efed0063880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed67ce700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed0147bb0 0x7efed0063880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40588/0 (socket says 172.21.15.57:40588) 2021-06-25T04:54:47.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed67ce700 1 -- 172.21.15.57:0/4278190972 learned_addr learned my addr 172.21.15.57:0/4278190972 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:47.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed57cc700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed00b63f0 0x7efed0065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed5fcd700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efed00b4020 0x7efed014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed67ce700 1 -- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed00b63f0 msgr2=0x7efed0065950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed67ce700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed00b63f0 0x7efed0065950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed67ce700 1 -- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efed00b4020 msgr2=0x7efed014a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed67ce700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efed00b4020 0x7efed014a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed67ce700 1 -- 172.21.15.57:0/4278190972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec400b180 con 0x7efed0147bb0 2021-06-25T04:54:47.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed67ce700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed0147bb0 0x7efed0063880 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7efed00ba610 tx=0x7efec8007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:47.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efec2ffd700 1 -- 172.21.15.57:0/4278190972 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec8005ae0 con 0x7efed0147bb0 2021-06-25T04:54:47.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efec2ffd700 1 -- 172.21.15.57:0/4278190972 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec8005c40 con 0x7efed0147bb0 2021-06-25T04:54:47.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed6fcf700 1 -- 172.21.15.57:0/4278190972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc00b1e0 con 0x7efed0147bb0 2021-06-25T04:54:47.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efec2ffd700 1 -- 172.21.15.57:0/4278190972 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efec80070d0 con 0x7efed0147bb0 2021-06-25T04:54:47.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed6fcf700 1 -- 172.21.15.57:0/4278190972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed01570c0 con 0x7efed0147bb0 2021-06-25T04:54:47.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efed6fcf700 1 -- 172.21.15.57:0/4278190972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed0057310 con 0x7efed0147bb0 2021-06-25T04:54:47.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.092+0000 7efec2ffd700 1 -- 172.21.15.57:0/4278190972 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7efec801a060 con 0x7efed0147bb0 2021-06-25T04:54:47.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.096+0000 7efec2ffd700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efeb0055490 0x7efeb0057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.096+0000 7efec2ffd700 1 -- 172.21.15.57:0/4278190972 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efec806d500 con 0x7efed0147bb0 2021-06-25T04:54:47.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.096+0000 7efed5fcd700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efeb0055490 0x7efeb0057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.096+0000 7efed5fcd700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efeb0055490 0x7efeb0057950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7efecc018000 tx=0x7efecc015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:47.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.100+0000 7efec2ffd700 1 -- 172.21.15.57:0/4278190972 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7efec80436b0 con 0x7efed0147bb0 2021-06-25T04:54:47.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.268+0000 7efed6fcf700 1 -- 172.21.15.57:0/4278190972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efed0066b20 con 0x7efed0147bb0 2021-06-25T04:54:47.657 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:54:47.652+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:54:47.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.668+0000 7efec2ffd700 1 -- 172.21.15.57:0/4278190972 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7efec8018020 con 0x7efed0147bb0 2021-06-25T04:54:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 -- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efeb0055490 msgr2=0x7efeb0057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efeb0055490 0x7efeb0057950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7efecc018000 tx=0x7efecc015000).stop 2021-06-25T04:54:47.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 -- 172.21.15.57:0/4278190972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed0147bb0 msgr2=0x7efed0063880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed0147bb0 0x7efed0063880 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7efed00ba610 tx=0x7efec8007f70).stop 2021-06-25T04:54:47.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 -- 172.21.15.57:0/4278190972 shutdown_connections 2021-06-25T04:54:47.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efeb0055490 0x7efeb0057950 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed0147bb0 0x7efed0063880 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed00b63f0 0x7efed0065950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 --2- 172.21.15.57:0/4278190972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efed00b4020 0x7efed014a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 -- 172.21.15.57:0/4278190972 >> 172.21.15.57:0/4278190972 conn(0x7efed005c450 msgr2=0x7efed01447a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:47.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 -- 172.21.15.57:0/4278190972 shutdown_connections 2021-06-25T04:54:47.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.672+0000 7efed6fcf700 1 -- 172.21.15.57:0/4278190972 wait complete. 2021-06-25T04:54:47.679 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:54:47.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:47.699 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:54:47.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.784+0000 7ff0174da700 1 Processor -- start 2021-06-25T04:54:47.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.784+0000 7ff0174da700 1 -- start start 2021-06-25T04:54:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff0100b2580 0x7ff0100ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0100b2960 0x7ff010146e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff010144100 con 0x7ff01005c450 2021-06-25T04:54:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff010143e60 con 0x7ff0100b2580 2021-06-25T04:54:47.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100ae190 con 0x7ff0100b2960 2021-06-25T04:54:47.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff014a75700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff01005c450 0x7ff0101466f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57824/0 (socket says 172.21.15.57:57824) 2021-06-25T04:54:47.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff014a75700 1 -- 172.21.15.57:0/3572464789 learned_addr learned my addr 172.21.15.57:0/3572464789 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:47.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff015276700 1 --2- 172.21.15.57:0/3572464789 >> v2:172.21.15.87:3300/0 conn(0x7ff0100b2580 0x7ff0100ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff015a77700 1 --2- 172.21.15.57:0/3572464789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0100b2960 0x7ff010146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff007fff700 1 -- 172.21.15.57:0/3572464789 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011346554 0 0) 0x7ff010144100 con 0x7ff01005c450 2021-06-25T04:54:47.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff007fff700 1 -- 172.21.15.57:0/3572464789 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff4003260 con 0x7ff01005c450 2021-06-25T04:54:47.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff015a77700 1 -- 172.21.15.57:0/3572464789 >> v2:172.21.15.87:3300/0 conn(0x7ff0100b2580 msgr2=0x7ff0100ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:47.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff015a77700 1 --2- 172.21.15.57:0/3572464789 >> v2:172.21.15.87:3300/0 conn(0x7ff0100b2580 0x7ff0100ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff015a77700 1 -- 172.21.15.57:0/3572464789 >> v1:172.21.15.57:6789/0 conn(0x7ff01005c450 legacy=0x7ff0101466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff015a77700 1 -- 172.21.15.57:0/3572464789 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100aeb20 con 0x7ff0100b2960 2021-06-25T04:54:47.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff015a77700 1 --2- 172.21.15.57:0/3572464789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0100b2960 0x7ff010146e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff0080032f0 tx=0x7ff0080091d0).ready entity=mon.2 client_cookie=7990fa4353faa6f4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:47.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff007fff700 1 -- 172.21.15.57:0/3572464789 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00800b600 con 0x7ff0100b2960 2021-06-25T04:54:47.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff007fff700 1 -- 172.21.15.57:0/3572464789 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00800b760 con 0x7ff0100b2960 2021-06-25T04:54:47.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff007fff700 1 -- 172.21.15.57:0/3572464789 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00800b8d0 con 0x7ff0100b2960 2021-06-25T04:54:47.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 -- 172.21.15.57:0/3572464789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0100b2960 msgr2=0x7ff010146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 --2- 172.21.15.57:0/3572464789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0100b2960 0x7ff010146e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff0080032f0 tx=0x7ff0080091d0).stop 2021-06-25T04:54:47.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 -- 172.21.15.57:0/3572464789 shutdown_connections 2021-06-25T04:54:47.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 --2- 172.21.15.57:0/3572464789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0100b2960 0x7ff010146e00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 --2- 172.21.15.57:0/3572464789 >> v2:172.21.15.87:3300/0 conn(0x7ff0100b2580 0x7ff0100ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 -- 172.21.15.57:0/3572464789 >> 172.21.15.57:0/3572464789 conn(0x7ff01005cce0 msgr2=0x7ff010062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:47.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 -- 172.21.15.57:0/3572464789 shutdown_connections 2021-06-25T04:54:47.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.788+0000 7ff0174da700 1 -- 172.21.15.57:0/3572464789 wait complete. 2021-06-25T04:54:47.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.792+0000 7ff0174da700 1 Processor -- start 2021-06-25T04:54:47.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.792+0000 7ff0174da700 1 -- start start 2021-06-25T04:54:47.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0174da700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff01005c450 0x7ff010141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0174da700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100b2580 0x7ff0100a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0174da700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0100b2960 0x7ff010144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0174da700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100a8fa0 con 0x7ff0100b2580 2021-06-25T04:54:47.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0174da700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100a91d0 con 0x7ff0100b2960 2021-06-25T04:54:47.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0174da700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100a7840 con 0x7ff01005c450 2021-06-25T04:54:47.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff014a75700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100b2580 0x7ff0100a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff014a75700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100b2580 0x7ff0100a5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40612/0 (socket says 172.21.15.57:40612) 2021-06-25T04:54:47.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff014a75700 1 -- 172.21.15.57:0/1312322655 learned_addr learned my addr 172.21.15.57:0/1312322655 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:47.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff015276700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff01005c450 0x7ff010141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff015a77700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0100b2960 0x7ff010144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff014a75700 1 -- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff01005c450 msgr2=0x7ff010141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff014a75700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff01005c450 0x7ff010141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff014a75700 1 -- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0100b2960 msgr2=0x7ff010144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff014a75700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0100b2960 0x7ff010144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff014a75700 1 -- 172.21.15.57:0/1312322655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008009470 con 0x7ff0100b2580 2021-06-25T04:54:47.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff014a75700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100b2580 0x7ff0100a5820 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7ff000001110 tx=0x7ff000007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:47.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0067fc700 1 -- 172.21.15.57:0/1312322655 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00000ce20 con 0x7ff0100b2580 2021-06-25T04:54:47.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0067fc700 1 -- 172.21.15.57:0/1312322655 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0000072e0 con 0x7ff0100b2580 2021-06-25T04:54:47.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0067fc700 1 -- 172.21.15.57:0/1312322655 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff000005800 con 0x7ff0100b2580 2021-06-25T04:54:47.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0174da700 1 -- 172.21.15.57:0/1312322655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff010144950 con 0x7ff0100b2580 2021-06-25T04:54:47.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0174da700 1 -- 172.21.15.57:0/1312322655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0100a4bd0 con 0x7ff0100b2580 2021-06-25T04:54:47.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0174da700 1 -- 172.21.15.57:0/1312322655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff010057310 con 0x7ff0100b2580 2021-06-25T04:54:47.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.796+0000 7ff0067fc700 1 -- 172.21.15.57:0/1312322655 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff000010070 con 0x7ff0100b2580 2021-06-25T04:54:47.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.800+0000 7ff0067fc700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feff8055450 0x7feff8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:47.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.800+0000 7ff0067fc700 1 -- 172.21.15.57:0/1312322655 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6506+0+0 (secure 0 0 0) 0x7ff00006d5c0 con 0x7ff0100b2580 2021-06-25T04:54:47.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.800+0000 7ff015276700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feff8055450 0x7feff8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:47.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.800+0000 7ff015276700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feff8055450 0x7feff8057910 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7ff00c00b000 tx=0x7ff00c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:47.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.804+0000 7ff0067fc700 1 -- 172.21.15.57:0/1312322655 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff000043720 con 0x7ff0100b2580 2021-06-25T04:54:47.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.968+0000 7ff0174da700 1 -- 172.21.15.57:0/1312322655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0100a7a00 con 0x7ff0100b2580 2021-06-25T04:54:47.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.968+0000 7ff0067fc700 1 -- 172.21.15.57:0/1312322655 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+2132 (secure 0 0 0) 0x7ff000018870 con 0x7ff0100b2580 2021-06-25T04:54:47.973 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:47.973 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":42,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/2314323791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2314323791},{"type":"v1","addr":"172.21.15.87:6835","nonce":2314323791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3937527303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3937527303},{"type":"v1","addr":"172.21.15.57:6833","nonce":3937527303}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:35.964849+0000","modified":"2021-06-25T04:54:47.655704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-06-25T04:54:47.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 -- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feff8055450 msgr2=0x7feff8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feff8055450 0x7feff8057910 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7ff00c00b000 tx=0x7ff00c006df0).stop 2021-06-25T04:54:47.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 -- 172.21.15.57:0/1312322655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100b2580 msgr2=0x7ff0100a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:47.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100b2580 0x7ff0100a5820 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7ff000001110 tx=0x7ff000007ad0).stop 2021-06-25T04:54:47.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 -- 172.21.15.57:0/1312322655 shutdown_connections 2021-06-25T04:54:47.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feff8055450 0x7feff8057910 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0100b2960 0x7ff010144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100b2580 0x7ff0100a5820 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 --2- 172.21.15.57:0/1312322655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff01005c450 0x7ff010141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:47.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 -- 172.21.15.57:0/1312322655 >> 172.21.15.57:0/1312322655 conn(0x7ff01005cce0 msgr2=0x7ff010062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:47.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 -- 172.21.15.57:0/1312322655 shutdown_connections 2021-06-25T04:54:47.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:47.972+0000 7ff0174da700 1 -- 172.21.15.57:0/1312322655 wait complete. 2021-06-25T04:54:47.979 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 42 2021-06-25T04:54:47.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:54:48.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.088+0000 7fa7b3ce4700 1 Processor -- start 2021-06-25T04:54:48.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.088+0000 7fa7b3ce4700 1 -- start start 2021-06-25T04:54:48.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.088+0000 7fa7b3ce4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7ac060ff0 0x7fa7ac0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.088+0000 7fa7b3ce4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac140ac0 0x7fa7ac0b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.088+0000 7fa7b3ce4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac0abf40 con 0x7fa7ac143590 2021-06-25T04:54:48.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.088+0000 7fa7b3ce4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac0ac170 con 0x7fa7ac060ff0 2021-06-25T04:54:48.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.088+0000 7fa7b3ce4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac143c40 con 0x7fa7ac140ac0 2021-06-25T04:54:48.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.088+0000 7fa7b127f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7ac060ff0 0x7fa7ac0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.088+0000 7fa7b127f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7ac060ff0 0x7fa7ac0afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40618/0 (socket says 172.21.15.57:40618) 2021-06-25T04:54:48.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.088+0000 7fa7b127f700 1 -- 172.21.15.57:0/2935653213 learned_addr learned my addr 172.21.15.57:0/2935653213 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:48.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b2281700 1 --2- 172.21.15.57:0/2935653213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac140ac0 0x7fa7ac0b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b127f700 1 -- 172.21.15.57:0/2935653213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac140ac0 msgr2=0x7fa7ac0b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b127f700 1 --2- 172.21.15.57:0/2935653213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac140ac0 0x7fa7ac0b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b127f700 1 -- 172.21.15.57:0/2935653213 >> v1:172.21.15.87:6789/0 conn(0x7fa7ac143590 legacy=0x7fa7ac1403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b0a7e700 1 -- 172.21.15.57:0/2935653213 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072504804 0 0) 0x7fa7ac0abf40 con 0x7fa7ac143590 2021-06-25T04:54:48.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b127f700 1 -- 172.21.15.57:0/2935653213 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac143ee0 con 0x7fa7ac060ff0 2021-06-25T04:54:48.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b127f700 1 --2- 172.21.15.57:0/2935653213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac060ff0 0x7fa7ac0afed0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fa79c002f70 tx=0x7fa79c006eb0).ready entity=mon.0 client_cookie=b15918875b5130c6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:48.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b0a7e700 1 -- 172.21.15.57:0/2935653213 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c00d570 con 0x7fa7ac060ff0 2021-06-25T04:54:48.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b0a7e700 1 -- 172.21.15.57:0/2935653213 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c000e90 con 0x7fa7ac060ff0 2021-06-25T04:54:48.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b0a7e700 1 -- 172.21.15.57:0/2935653213 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c00d8c0 con 0x7fa7ac060ff0 2021-06-25T04:54:48.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/2935653213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac060ff0 msgr2=0x7fa7ac0afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:48.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b3ce4700 1 --2- 172.21.15.57:0/2935653213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac060ff0 0x7fa7ac0afed0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fa79c002f70 tx=0x7fa79c006eb0).stop 2021-06-25T04:54:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/2935653213 shutdown_connections 2021-06-25T04:54:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b3ce4700 1 --2- 172.21.15.57:0/2935653213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac140ac0 0x7fa7ac0b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b3ce4700 1 --2- 172.21.15.57:0/2935653213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac060ff0 0x7fa7ac0afed0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/2935653213 >> 172.21.15.57:0/2935653213 conn(0x7fa7ac0b5530 msgr2=0x7fa7ac0b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:48.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/2935653213 shutdown_connections 2021-06-25T04:54:48.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.092+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/2935653213 wait complete. 2021-06-25T04:54:48.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b3ce4700 1 Processor -- start 2021-06-25T04:54:48.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b3ce4700 1 -- start start 2021-06-25T04:54:48.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b3ce4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac060ff0 0x7fa7ac1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b3ce4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac140ac0 0x7fa7ac152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b3ce4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac143590 0x7fa7ac13cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b3ce4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac147560 con 0x7fa7ac143590 2021-06-25T04:54:48.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b3ce4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac13b520 con 0x7fa7ac140ac0 2021-06-25T04:54:48.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b3ce4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac1530c0 con 0x7fa7ac060ff0 2021-06-25T04:54:48.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b2281700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac143590 0x7fa7ac13cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b127f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac140ac0 0x7fa7ac152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b2281700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac143590 0x7fa7ac13cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40628/0 (socket says 172.21.15.57:40628) 2021-06-25T04:54:48.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b1a80700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac060ff0 0x7fa7ac1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b2281700 1 -- 172.21.15.57:0/3901777925 learned_addr learned my addr 172.21.15.57:0/3901777925 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:48.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b2281700 1 -- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac060ff0 msgr2=0x7fa7ac1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:48.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b2281700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac060ff0 0x7fa7ac1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b2281700 1 -- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac140ac0 msgr2=0x7fa7ac152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:48.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b2281700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac140ac0 0x7fa7ac152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b2281700 1 -- 172.21.15.57:0/3901777925 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c00b1e0 con 0x7fa7ac143590 2021-06-25T04:54:48.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b2281700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac143590 0x7fa7ac13cac0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fa7ac145540 tx=0x7fa7a40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:48.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa79affd700 1 -- 172.21.15.57:0/3901777925 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a400ee60 con 0x7fa7ac143590 2021-06-25T04:54:48.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa79affd700 1 -- 172.21.15.57:0/3901777925 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a400c850 con 0x7fa7ac143590 2021-06-25T04:54:48.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/3901777925 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac147090 con 0x7fa7ac143590 2021-06-25T04:54:48.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa79affd700 1 -- 172.21.15.57:0/3901777925 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a400cbb0 con 0x7fa7ac143590 2021-06-25T04:54:48.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.096+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/3901777925 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac144c70 con 0x7fa7ac143590 2021-06-25T04:54:48.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.100+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/3901777925 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac153480 con 0x7fa7ac143590 2021-06-25T04:54:48.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.100+0000 7fa79affd700 1 -- 172.21.15.57:0/3901777925 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa7a400cd10 con 0x7fa7ac143590 2021-06-25T04:54:48.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.100+0000 7fa79affd700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c055510 0x7fa78c0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.100+0000 7fa79affd700 1 -- 172.21.15.57:0/3901777925 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fa7a406e0d0 con 0x7fa7ac143590 2021-06-25T04:54:48.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.100+0000 7fa7b1a80700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c055510 0x7fa78c0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.100+0000 7fa7b1a80700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c055510 0x7fa78c0579d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fa7a800d000 tx=0x7fa7a8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:48.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.104+0000 7fa79affd700 1 -- 172.21.15.57:0/3901777925 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa7ac153480 con 0x7fa7ac143590 2021-06-25T04:54:48.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.268+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/3901777925 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa7ac153480 con 0x7fa7ac143590 2021-06-25T04:54:48.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.680+0000 7fa79affd700 1 -- 172.21.15.57:0/3901777925 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa7ac153480 con 0x7fa7ac143590 2021-06-25T04:54:48.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c055510 msgr2=0x7fa78c0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:48.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c055510 0x7fa78c0579d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fa7a800d000 tx=0x7fa7a8009040).stop 2021-06-25T04:54:48.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/3901777925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac143590 msgr2=0x7fa7ac13cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:48.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac143590 0x7fa7ac13cac0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fa7ac145540 tx=0x7fa7a40091d0).stop 2021-06-25T04:54:48.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/3901777925 shutdown_connections 2021-06-25T04:54:48.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c055510 0x7fa78c0579d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac143590 0x7fa7ac13cac0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac140ac0 0x7fa7ac152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 --2- 172.21.15.57:0/3901777925 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac060ff0 0x7fa7ac1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/3901777925 >> 172.21.15.57:0/3901777925 conn(0x7fa7ac0b5530 msgr2=0x7fa7ac0ae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:48.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/3901777925 shutdown_connections 2021-06-25T04:54:48.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.684+0000 7fa7b3ce4700 1 -- 172.21.15.57:0/3901777925 wait complete. 2021-06-25T04:54:48.703 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:54:48.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.812+0000 7f4efea49700 1 Processor -- start 2021-06-25T04:54:48.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efea49700 1 -- start start 2021-06-25T04:54:48.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efea49700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ef80b06d0 0x7f4ef8142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efea49700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4ef80b3090 0x7f4ef81431d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efea49700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef80b0ab0 con 0x7f4ef80ace30 2021-06-25T04:54:48.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efea49700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80ae640 con 0x7f4ef80b06d0 2021-06-25T04:54:48.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efea49700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80ae8e0 con 0x7f4ef80b3090 2021-06-25T04:54:48.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efda47700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ef80b06d0 0x7f4ef8142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efda47700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ef80b06d0 0x7f4ef8142ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40632/0 (socket says 172.21.15.57:40632) 2021-06-25T04:54:48.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efda47700 1 -- 172.21.15.57:0/3107213128 learned_addr learned my addr 172.21.15.57:0/3107213128 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:48.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efd246700 1 --2- 172.21.15.57:0/3107213128 >> v2:172.21.15.87:3300/0 conn(0x7f4ef80b3090 0x7f4ef81431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efda47700 1 -- 172.21.15.57:0/3107213128 >> v2:172.21.15.87:3300/0 conn(0x7f4ef80b3090 msgr2=0x7f4ef81431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:48.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efda47700 1 --2- 172.21.15.57:0/3107213128 >> v2:172.21.15.87:3300/0 conn(0x7f4ef80b3090 0x7f4ef81431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efda47700 1 -- 172.21.15.57:0/3107213128 >> v1:172.21.15.87:6789/0 conn(0x7f4ef80ace30 legacy=0x7f4ef805f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:48.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efda47700 1 -- 172.21.15.57:0/3107213128 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80aeb80 con 0x7f4ef80b06d0 2021-06-25T04:54:48.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efda47700 1 --2- 172.21.15.57:0/3107213128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ef80b06d0 0x7f4ef8142ce0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f4ef80b6a00 tx=0x7f4ef4006f40).ready entity=mon.0 client_cookie=64357d61d6a0d1b7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:48.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efca45700 1 -- 172.21.15.57:0/3107213128 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef400dc30 con 0x7f4ef80b06d0 2021-06-25T04:54:48.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efca45700 1 -- 172.21.15.57:0/3107213128 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef4000e90 con 0x7f4ef80b06d0 2021-06-25T04:54:48.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efca45700 1 -- 172.21.15.57:0/3107213128 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef400be90 con 0x7f4ef80b06d0 2021-06-25T04:54:48.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efea49700 1 -- 172.21.15.57:0/3107213128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ef80b06d0 msgr2=0x7f4ef8142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:48.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.816+0000 7f4efea49700 1 --2- 172.21.15.57:0/3107213128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ef80b06d0 0x7f4ef8142ce0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f4ef80b6a00 tx=0x7f4ef4006f40).stop 2021-06-25T04:54:48.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 -- 172.21.15.57:0/3107213128 shutdown_connections 2021-06-25T04:54:48.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 --2- 172.21.15.57:0/3107213128 >> v2:172.21.15.87:3300/0 conn(0x7f4ef80b3090 0x7f4ef81431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 --2- 172.21.15.57:0/3107213128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ef80b06d0 0x7f4ef8142ce0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 -- 172.21.15.57:0/3107213128 >> 172.21.15.57:0/3107213128 conn(0x7f4ef8061100 msgr2=0x7f4ef8062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:48.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 -- 172.21.15.57:0/3107213128 shutdown_connections 2021-06-25T04:54:48.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 -- 172.21.15.57:0/3107213128 wait complete. 2021-06-25T04:54:48.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 Processor -- start 2021-06-25T04:54:48.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 -- start start 2021-06-25T04:54:48.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ef80ace30 0x7f4ef80abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ef80b06d0 0x7f4ef8063830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ef80b3090 0x7f4ef8063d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef8064210 con 0x7f4ef80b3090 2021-06-25T04:54:48.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef8155bd0 con 0x7f4ef80b06d0 2021-06-25T04:54:48.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efea49700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef8155e70 con 0x7f4ef80ace30 2021-06-25T04:54:48.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efe248700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ef80b3090 0x7f4ef8063d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efe248700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ef80b3090 0x7f4ef8063d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40642/0 (socket says 172.21.15.57:40642) 2021-06-25T04:54:48.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efe248700 1 -- 172.21.15.57:0/2528544075 learned_addr learned my addr 172.21.15.57:0/2528544075 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:48.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efda47700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ef80ace30 0x7f4ef80abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.820+0000 7f4efd246700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ef80b06d0 0x7f4ef8063830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4efe248700 1 -- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ef80ace30 msgr2=0x7f4ef80abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:48.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4efe248700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ef80ace30 0x7f4ef80abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4efe248700 1 -- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ef80b06d0 msgr2=0x7f4ef8063830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:48.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4efe248700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ef80b06d0 0x7f4ef8063830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:48.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4efe248700 1 -- 172.21.15.57:0/2528544075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef400b460 con 0x7f4ef80b3090 2021-06-25T04:54:48.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4efe248700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ef80b3090 0x7f4ef8063d20 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f4ef0001250 tx=0x7f4ef0003220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:48.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4ee6ffd700 1 -- 172.21.15.57:0/2528544075 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef0006aa0 con 0x7f4ef80b3090 2021-06-25T04:54:48.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4ee6ffd700 1 -- 172.21.15.57:0/2528544075 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0006c00 con 0x7f4ef80b3090 2021-06-25T04:54:48.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4efea49700 1 -- 172.21.15.57:0/2528544075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef8156110 con 0x7f4ef80b3090 2021-06-25T04:54:48.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4ee6ffd700 1 -- 172.21.15.57:0/2528544075 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef0007030 con 0x7f4ef80b3090 2021-06-25T04:54:48.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4efea49700 1 -- 172.21.15.57:0/2528544075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef80abfa0 con 0x7f4ef80b3090 2021-06-25T04:54:48.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4efea49700 1 -- 172.21.15.57:0/2528544075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef8057310 con 0x7f4ef80b3090 2021-06-25T04:54:48.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.824+0000 7f4ee6ffd700 1 -- 172.21.15.57:0/2528544075 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4ef0010030 con 0x7f4ef80b3090 2021-06-25T04:54:48.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.828+0000 7f4ee6ffd700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ed8055450 0x7f4ed8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:48.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.828+0000 7f4ee6ffd700 1 -- 172.21.15.57:0/2528544075 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f4ef006de30 con 0x7f4ef80b3090 2021-06-25T04:54:48.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.828+0000 7f4efda47700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ed8055450 0x7f4ed8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:48.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.828+0000 7f4efda47700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ed8055450 0x7f4ed8057910 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f4ef401a000 tx=0x7f4ef80ae560).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:48.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.832+0000 7f4ee6ffd700 1 -- 172.21.15.57:0/2528544075 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4ef0043f90 con 0x7f4ef80b3090 2021-06-25T04:54:48.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:48.964+0000 7f4efea49700 1 -- 172.21.15.57:0/2528544075 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4ef81438a0 con 0x7f4ef80b3090 2021-06-25T04:54:49.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.684+0000 7f4ee6ffd700 1 -- 172.21.15.57:0/2528544075 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) v1 ==== 185+0+0 (secure 0 0 0) 0x7f4ef00475b0 con 0x7f4ef80b3090 2021-06-25T04:54:49.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 -- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ed8055450 msgr2=0x7f4ed8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:49.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ed8055450 0x7f4ed8057910 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f4ef401a000 tx=0x7f4ef80ae560).stop 2021-06-25T04:54:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 -- 172.21.15.57:0/2528544075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ef80b3090 msgr2=0x7f4ef8063d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ef80b3090 0x7f4ef8063d20 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f4ef0001250 tx=0x7f4ef0003220).stop 2021-06-25T04:54:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 -- 172.21.15.57:0/2528544075 shutdown_connections 2021-06-25T04:54:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ed8055450 0x7f4ed8057910 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ef80b3090 0x7f4ef8063d20 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ef80b06d0 0x7f4ef8063830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 --2- 172.21.15.57:0/2528544075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ef80ace30 0x7f4ef80abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 -- 172.21.15.57:0/2528544075 >> 172.21.15.57:0/2528544075 conn(0x7f4ef8061100 msgr2=0x7f4ef8142c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 -- 172.21.15.57:0/2528544075 shutdown_connections 2021-06-25T04:54:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.692+0000 7f4efea49700 1 -- 172.21.15.57:0/2528544075 wait complete. 2021-06-25T04:54:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:54:49.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:54:49.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9eb5c700 1 Processor -- start 2021-06-25T04:54:49.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9eb5c700 1 -- start start 2021-06-25T04:54:49.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9eb5c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c980af920 0x7f7c980b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:49.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9eb5c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7c980afd00 0x7f7c9813fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:49.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9eb5c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c980ad560 con 0x7f7c980b04b0 2021-06-25T04:54:49.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9eb5c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c980af420 con 0x7f7c980afd00 2021-06-25T04:54:49.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9eb5c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980ad020 con 0x7f7c980af920 2021-06-25T04:54:49.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c97fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7c980b04b0 0x7f7c980b2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57866/0 (socket says 172.21.15.57:57866) 2021-06-25T04:54:49.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c97fff700 1 -- 172.21.15.57:0/3355836460 learned_addr learned my addr 172.21.15.57:0/3355836460 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:49.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9c8f8700 1 --2- 172.21.15.57:0/3355836460 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c980af920 0x7f7c980b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:49.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9d0f9700 1 --2- 172.21.15.57:0/3355836460 >> v2:172.21.15.87:3300/0 conn(0x7f7c980afd00 0x7f7c9813fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c977fe700 1 -- 172.21.15.57:0/3355836460 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125040539 0 0) 0x7f7c980ad560 con 0x7f7c980b04b0 2021-06-25T04:54:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c977fe700 1 -- 172.21.15.57:0/3355836460 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c7c003260 con 0x7f7c980b04b0 2021-06-25T04:54:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9c8f8700 1 -- 172.21.15.57:0/3355836460 >> v2:172.21.15.87:3300/0 conn(0x7f7c980afd00 msgr2=0x7f7c9813fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9c8f8700 1 --2- 172.21.15.57:0/3355836460 >> v2:172.21.15.87:3300/0 conn(0x7f7c980afd00 0x7f7c9813fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9c8f8700 1 -- 172.21.15.57:0/3355836460 >> v1:172.21.15.57:6789/0 conn(0x7f7c980b04b0 legacy=0x7f7c980b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:49.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9c8f8700 1 -- 172.21.15.57:0/3355836460 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980ad2c0 con 0x7f7c980af920 2021-06-25T04:54:49.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.816+0000 7f7c9c8f8700 1 --2- 172.21.15.57:0/3355836460 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c980af920 0x7f7c980b1b90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7c8c002f70 tx=0x7f7c8c006df0).ready entity=mon.2 client_cookie=b0fe9b497312427d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:49.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c977fe700 1 -- 172.21.15.57:0/3355836460 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c8c00d4a0 con 0x7f7c980af920 2021-06-25T04:54:49.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c977fe700 1 -- 172.21.15.57:0/3355836460 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c000e90 con 0x7f7c980af920 2021-06-25T04:54:49.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c977fe700 1 -- 172.21.15.57:0/3355836460 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c8c00d7f0 con 0x7f7c980af920 2021-06-25T04:54:49.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/3355836460 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c980af920 msgr2=0x7f7c980b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:49.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c9eb5c700 1 --2- 172.21.15.57:0/3355836460 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c980af920 0x7f7c980b1b90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7c8c002f70 tx=0x7f7c8c006df0).stop 2021-06-25T04:54:49.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/3355836460 shutdown_connections 2021-06-25T04:54:49.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c9eb5c700 1 --2- 172.21.15.57:0/3355836460 >> v2:172.21.15.87:3300/0 conn(0x7f7c980afd00 0x7f7c9813fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:49.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c9eb5c700 1 --2- 172.21.15.57:0/3355836460 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c980af920 0x7f7c980b1b90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:49.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/3355836460 >> 172.21.15.57:0/3355836460 conn(0x7f7c9805cce0 msgr2=0x7f7c98062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:49.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/3355836460 shutdown_connections 2021-06-25T04:54:49.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/3355836460 wait complete. 2021-06-25T04:54:49.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.820+0000 7f7c9eb5c700 1 Processor -- start 2021-06-25T04:54:49.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9eb5c700 1 -- start start 2021-06-25T04:54:49.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9eb5c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c980af920 0x7f7c98067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:49.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9eb5c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c980afd00 0x7f7c980a8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:49.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9eb5c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c980b04b0 0x7f7c980a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:49.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9eb5c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980abfb0 con 0x7f7c980b04b0 2021-06-25T04:54:49.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9eb5c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980ac250 con 0x7f7c980af920 2021-06-25T04:54:49.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9eb5c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980ac4f0 con 0x7f7c980afd00 2021-06-25T04:54:49.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9d0f9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c980b04b0 0x7f7c980a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:49.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9d0f9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c980b04b0 0x7f7c980a8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40656/0 (socket says 172.21.15.57:40656) 2021-06-25T04:54:49.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c97fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c980afd00 0x7f7c980a8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:49.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9d0f9700 1 -- 172.21.15.57:0/29345855 learned_addr learned my addr 172.21.15.57:0/29345855 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:49.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9c8f8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c980af920 0x7f7c98067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:49.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9d0f9700 1 -- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c980afd00 msgr2=0x7f7c980a8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:49.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9d0f9700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c980afd00 0x7f7c980a8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:49.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9d0f9700 1 -- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c980af920 msgr2=0x7f7c98067530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:49.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9d0f9700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c980af920 0x7f7c98067530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:49.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9d0f9700 1 -- 172.21.15.57:0/29345855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c00b180 con 0x7f7c980b04b0 2021-06-25T04:54:49.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9d0f9700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c980b04b0 0x7f7c980a8830 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f7c9000e000 tx=0x7f7c9000b470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:49.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c95ffb700 1 -- 172.21.15.57:0/29345855 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9001a470 con 0x7f7c980b04b0 2021-06-25T04:54:49.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/29345855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c980ac790 con 0x7f7c980b04b0 2021-06-25T04:54:49.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c95ffb700 1 -- 172.21.15.57:0/29345855 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9001a5d0 con 0x7f7c980b04b0 2021-06-25T04:54:49.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c95ffb700 1 -- 172.21.15.57:0/29345855 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9001a930 con 0x7f7c980b04b0 2021-06-25T04:54:49.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.824+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/29345855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c980a73e0 con 0x7f7c980b04b0 2021-06-25T04:54:49.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.828+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/29345855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c98057310 con 0x7f7c980b04b0 2021-06-25T04:54:49.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.828+0000 7f7c95ffb700 1 -- 172.21.15.57:0/29345855 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7c9001aa90 con 0x7f7c980b04b0 2021-06-25T04:54:49.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.828+0000 7f7c95ffb700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c800554e0 0x7f7c800579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:49.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.828+0000 7f7c95ffb700 1 -- 172.21.15.57:0/29345855 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f7c90071760 con 0x7f7c980b04b0 2021-06-25T04:54:49.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.828+0000 7f7c9c8f8700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c800554e0 0x7f7c800579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:49.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.828+0000 7f7c9c8f8700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c800554e0 0x7f7c800579a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f7c8c019000 tx=0x7f7c8c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:49.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.836+0000 7f7c95ffb700 1 -- 172.21.15.57:0/29345855 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7c900479f0 con 0x7f7c980b04b0 2021-06-25T04:54:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:49.964+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/29345855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c9805d720 con 0x7f7c980b04b0 2021-06-25T04:54:50.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.688+0000 7f7c95ffb700 1 -- 172.21.15.57:0/29345855 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7c9004b010 con 0x7f7c980b04b0 2021-06-25T04:54:50.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c800554e0 msgr2=0x7f7c800579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:50.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c800554e0 0x7f7c800579a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f7c8c019000 tx=0x7f7c8c014000).stop 2021-06-25T04:54:50.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/29345855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c980b04b0 msgr2=0x7f7c980a8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:50.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c980b04b0 0x7f7c980a8830 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f7c9000e000 tx=0x7f7c9000b470).stop 2021-06-25T04:54:50.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/29345855 shutdown_connections 2021-06-25T04:54:50.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c800554e0 0x7f7c800579a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c980b04b0 0x7f7c980a8830 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c980afd00 0x7f7c980a8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 --2- 172.21.15.57:0/29345855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c980af920 0x7f7c98067530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/29345855 >> 172.21.15.57:0/29345855 conn(0x7f7c9805cce0 msgr2=0x7f7c98141f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:50.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/29345855 shutdown_connections 2021-06-25T04:54:50.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.696+0000 7f7c9eb5c700 1 -- 172.21.15.57:0/29345855 wait complete. 2021-06-25T04:54:50.704 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:54:50.715 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-06-25T04:54:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.824+0000 7f148e631700 1 Processor -- start 2021-06-25T04:54:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.824+0000 7f148e631700 1 -- start start 2021-06-25T04:54:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f148e631700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1488144900 0x7f14880abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f148e631700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880a9e80 0x7f14880b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f148e631700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1488144ce0 con 0x7f14880b0d20 2021-06-25T04:54:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f148e631700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14880ac1c0 con 0x7f1488144900 2021-06-25T04:54:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f148e631700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1488144f40 con 0x7f14880a9e80 2021-06-25T04:54:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f147ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880a9e80 0x7f14880b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f147ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880a9e80 0x7f14880b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:51826/0 (socket says 172.21.15.57:51826) 2021-06-25T04:54:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f147ffff700 1 -- 172.21.15.57:0/2871230409 learned_addr learned my addr 172.21.15.57:0/2871230409 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f1487fff700 1 --2- 172.21.15.57:0/2871230409 >> v2:172.21.15.87:3300/0 conn(0x7f1488144900 0x7f14880abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f147ffff700 1 -- 172.21.15.57:0/2871230409 >> v2:172.21.15.87:3300/0 conn(0x7f1488144900 msgr2=0x7f14880abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f147ffff700 1 --2- 172.21.15.57:0/2871230409 >> v2:172.21.15.87:3300/0 conn(0x7f1488144900 0x7f14880abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f14877fe700 1 -- 172.21.15.57:0/2871230409 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387304529 0 0) 0x7f1488144ce0 con 0x7f14880b0d20 2021-06-25T04:54:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f147ffff700 1 -- 172.21.15.57:0/2871230409 >> v1:172.21.15.87:6789/0 conn(0x7f14880b0d20 legacy=0x7f148813e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f147ffff700 1 -- 172.21.15.57:0/2871230409 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14881451e0 con 0x7f14880a9e80 2021-06-25T04:54:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f147ffff700 1 --2- 172.21.15.57:0/2871230409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880a9e80 0x7f14880b0830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f1470002f70 tx=0x7f1470006eb0).ready entity=mon.2 client_cookie=658ecad4ed1350fd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:50.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f14877fe700 1 -- 172.21.15.57:0/2871230409 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147000d570 con 0x7f14880a9e80 2021-06-25T04:54:50.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f14877fe700 1 -- 172.21.15.57:0/2871230409 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470000e90 con 0x7f14880a9e80 2021-06-25T04:54:50.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f14877fe700 1 -- 172.21.15.57:0/2871230409 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147000d8c0 con 0x7f14880a9e80 2021-06-25T04:54:50.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f148e631700 1 -- 172.21.15.57:0/2871230409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880a9e80 msgr2=0x7f14880b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:50.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.828+0000 7f148e631700 1 --2- 172.21.15.57:0/2871230409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880a9e80 0x7f14880b0830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f1470002f70 tx=0x7f1470006eb0).stop 2021-06-25T04:54:50.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 -- 172.21.15.57:0/2871230409 shutdown_connections 2021-06-25T04:54:50.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 --2- 172.21.15.57:0/2871230409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880a9e80 0x7f14880b0830 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 --2- 172.21.15.57:0/2871230409 >> v2:172.21.15.87:3300/0 conn(0x7f1488144900 0x7f14880abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 -- 172.21.15.57:0/2871230409 >> 172.21.15.57:0/2871230409 conn(0x7f14880b2930 msgr2=0x7f14880b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:50.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 -- 172.21.15.57:0/2871230409 shutdown_connections 2021-06-25T04:54:50.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 -- 172.21.15.57:0/2871230409 wait complete. 2021-06-25T04:54:50.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 Processor -- start 2021-06-25T04:54:50.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 -- start start 2021-06-25T04:54:50.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14880a9e80 0x7f1488142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:50.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880b0d20 0x7f14880b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:50.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1488144900 0x7f14880b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:50.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1488060c50 con 0x7f14880a9e80 2021-06-25T04:54:50.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148805ffd0 con 0x7f1488144900 2021-06-25T04:54:50.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1488060270 con 0x7f14880b0d20 2021-06-25T04:54:50.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1487fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14880a9e80 0x7f1488142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:50.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1487fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14880a9e80 0x7f1488142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40666/0 (socket says 172.21.15.57:40666) 2021-06-25T04:54:50.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1487fff700 1 -- 172.21.15.57:0/2098013117 learned_addr learned my addr 172.21.15.57:0/2098013117 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:50.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f147ffff700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880b0d20 0x7f14880b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:50.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148cbce700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1488144900 0x7f14880b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:50.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1487fff700 1 -- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880b0d20 msgr2=0x7f14880b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:50.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1487fff700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880b0d20 0x7f14880b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1487fff700 1 -- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1488144900 msgr2=0x7f14880b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:50.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1487fff700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1488144900 0x7f14880b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1487fff700 1 -- 172.21.15.57:0/2098013117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147000b1e0 con 0x7f14880a9e80 2021-06-25T04:54:50.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1487fff700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14880a9e80 0x7f1488142b70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f147800c000 tx=0x7f1478006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:50.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1485ffb700 1 -- 172.21.15.57:0/2098013117 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1478011750 con 0x7f14880a9e80 2021-06-25T04:54:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1485ffb700 1 -- 172.21.15.57:0/2098013117 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14780118b0 con 0x7f14880a9e80 2021-06-25T04:54:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 -- 172.21.15.57:0/2098013117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1488060510 con 0x7f14880a9e80 2021-06-25T04:54:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f1485ffb700 1 -- 172.21.15.57:0/2098013117 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1478011c10 con 0x7f14880a9e80 2021-06-25T04:54:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.832+0000 7f148e631700 1 -- 172.21.15.57:0/2098013117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14880b4c80 con 0x7f14880a9e80 2021-06-25T04:54:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.836+0000 7f148e631700 1 -- 172.21.15.57:0/2098013117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1488057310 con 0x7f14880a9e80 2021-06-25T04:54:50.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.836+0000 7f1485ffb700 1 -- 172.21.15.57:0/2098013117 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1478011d70 con 0x7f14880a9e80 2021-06-25T04:54:50.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.836+0000 7f1485ffb700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f146c0554e0 0x7f146c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.836+0000 7f1485ffb700 1 -- 172.21.15.57:0/2098013117 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f147806e010 con 0x7f14880a9e80 2021-06-25T04:54:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.836+0000 7f147ffff700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f146c0554e0 0x7f146c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.836+0000 7f147ffff700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f146c0554e0 0x7f146c0579a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f147001b000 tx=0x7f1470015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:50.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.844+0000 7f1485ffb700 1 -- 172.21.15.57:0/2098013117 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1478044440 con 0x7f14880a9e80 2021-06-25T04:54:50.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.972+0000 7f148e631700 1 -- 172.21.15.57:0/2098013117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1488044610 con 0x7f14880a9e80 2021-06-25T04:54:50.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.976+0000 7f1485ffb700 1 -- 172.21.15.57:0/2098013117 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1478047a60 con 0x7f14880a9e80 2021-06-25T04:54:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 -- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f146c0554e0 msgr2=0x7f146c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f146c0554e0 0x7f146c0579a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f147001b000 tx=0x7f1470015000).stop 2021-06-25T04:54:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 -- 172.21.15.57:0/2098013117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14880a9e80 msgr2=0x7f1488142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14880a9e80 0x7f1488142b70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f147800c000 tx=0x7f1478006df0).stop 2021-06-25T04:54:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 -- 172.21.15.57:0/2098013117 shutdown_connections 2021-06-25T04:54:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f146c0554e0 0x7f146c0579a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1488144900 0x7f14880b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14880b0d20 0x7f14880b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 --2- 172.21.15.57:0/2098013117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14880a9e80 0x7f1488142b70 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 -- 172.21.15.57:0/2098013117 >> 172.21.15.57:0/2098013117 conn(0x7f14880b2930 msgr2=0x7f1488143680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 -- 172.21.15.57:0/2098013117 shutdown_connections 2021-06-25T04:54:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:50.980+0000 7f148e631700 1 -- 172.21.15.57:0/2098013117 wait complete. 2021-06-25T04:54:50.996 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-06-25T04:54:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f2999ddf700 1 Processor -- start 2021-06-25T04:54:51.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f2999ddf700 1 -- start start 2021-06-25T04:54:51.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f2999ddf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29940a8a80 0x7f2994152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:51.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f2999ddf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29940a7080 con 0x7f29940b2540 2021-06-25T04:54:51.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f2999ddf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29940a72b0 con 0x7f29940affd0 2021-06-25T04:54:51.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f2999ddf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29940a7550 con 0x7f29940a8a80 2021-06-25T04:54:51.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f29995de700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29940a8a80 0x7f2994152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:51.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f29995de700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29940a8a80 0x7f2994152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40678/0 (socket says 172.21.15.57:40678) 2021-06-25T04:54:51.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f29995de700 1 -- 172.21.15.57:0/612076038 learned_addr learned my addr 172.21.15.57:0/612076038 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:51.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f29995de700 1 -- 172.21.15.57:0/612076038 >> v1:172.21.15.87:6789/0 conn(0x7f29940affd0 legacy=0x7f29940a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:51.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f29995de700 1 -- 172.21.15.57:0/612076038 >> v1:172.21.15.57:6789/0 conn(0x7f29940b2540 legacy=0x7f299414ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:51.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f29995de700 1 -- 172.21.15.57:0/612076038 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940a77f0 con 0x7f29940a8a80 2021-06-25T04:54:51.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f29995de700 1 --2- 172.21.15.57:0/612076038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29940a8a80 0x7f2994152ba0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f298c002f70 tx=0x7f298c006eb0).ready entity=mon.0 client_cookie=aa6d8ba452220569 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:51.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f29937fe700 1 -- 172.21.15.57:0/612076038 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f298c00d660 con 0x7f29940a8a80 2021-06-25T04:54:51.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f29937fe700 1 -- 172.21.15.57:0/612076038 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c000e90 con 0x7f29940a8a80 2021-06-25T04:54:51.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f29937fe700 1 -- 172.21.15.57:0/612076038 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f298c00d9f0 con 0x7f29940a8a80 2021-06-25T04:54:51.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f2999ddf700 1 -- 172.21.15.57:0/612076038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29940a8a80 msgr2=0x7f2994152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:51.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.092+0000 7f2999ddf700 1 --2- 172.21.15.57:0/612076038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29940a8a80 0x7f2994152ba0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f298c002f70 tx=0x7f298c006eb0).stop 2021-06-25T04:54:51.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.096+0000 7f2999ddf700 1 -- 172.21.15.57:0/612076038 shutdown_connections 2021-06-25T04:54:51.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.096+0000 7f2999ddf700 1 --2- 172.21.15.57:0/612076038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29940a8a80 0x7f2994152ba0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.096+0000 7f2999ddf700 1 -- 172.21.15.57:0/612076038 >> 172.21.15.57:0/612076038 conn(0x7f2994060140 msgr2=0x7f29940b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:51.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.096+0000 7f2999ddf700 1 -- 172.21.15.57:0/612076038 shutdown_connections 2021-06-25T04:54:51.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.096+0000 7f2999ddf700 1 -- 172.21.15.57:0/612076038 wait complete. 2021-06-25T04:54:51.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.096+0000 7f2999ddf700 1 Processor -- start 2021-06-25T04:54:51.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.096+0000 7f2999ddf700 1 -- start start 2021-06-25T04:54:51.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2999ddf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29940a8a80 0x7f299414aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:51.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2999ddf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29940affd0 0x7f29940a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:51.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2999ddf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29940b2540 0x7f2994159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:51.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2999ddf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29940aa440 con 0x7f29940b2540 2021-06-25T04:54:51.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2999ddf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29940b3400 con 0x7f29940affd0 2021-06-25T04:54:51.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2999ddf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29940aa600 con 0x7f29940a8a80 2021-06-25T04:54:51.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f29995de700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29940b2540 0x7f2994159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:51.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f29995de700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29940b2540 0x7f2994159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40684/0 (socket says 172.21.15.57:40684) 2021-06-25T04:54:51.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f29995de700 1 -- 172.21.15.57:0/1687731965 learned_addr learned my addr 172.21.15.57:0/1687731965 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:51.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2993fff700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29940affd0 0x7f29940a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:51.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2998ddd700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29940a8a80 0x7f299414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:51.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f29995de700 1 -- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29940a8a80 msgr2=0x7f299414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:51.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f29995de700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29940a8a80 0x7f299414aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f29995de700 1 -- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29940affd0 msgr2=0x7f29940a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:51.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f29995de700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29940affd0 0x7f29940a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f29995de700 1 -- 172.21.15.57:0/1687731965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c00b1e0 con 0x7f29940b2540 2021-06-25T04:54:51.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f29995de700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29940b2540 0x7f2994159a90 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f29940af5b0 tx=0x7f298c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:51.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2991ffb700 1 -- 172.21.15.57:0/1687731965 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f298c006be0 con 0x7f29940b2540 2021-06-25T04:54:51.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2999ddf700 1 -- 172.21.15.57:0/1687731965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29940aee70 con 0x7f29940b2540 2021-06-25T04:54:51.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2991ffb700 1 -- 172.21.15.57:0/1687731965 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c011bd0 con 0x7f29940b2540 2021-06-25T04:54:51.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2991ffb700 1 -- 172.21.15.57:0/1687731965 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f298c01d450 con 0x7f29940b2540 2021-06-25T04:54:51.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2999ddf700 1 -- 172.21.15.57:0/1687731965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29940aa850 con 0x7f29940b2540 2021-06-25T04:54:51.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2999ddf700 1 -- 172.21.15.57:0/1687731965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29940b2d90 con 0x7f29940b2540 2021-06-25T04:54:51.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.100+0000 7f2991ffb700 1 -- 172.21.15.57:0/1687731965 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f298c00f070 con 0x7f29940b2540 2021-06-25T04:54:51.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.104+0000 7f2991ffb700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2974055340 0x7f2974057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:51.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.104+0000 7f2991ffb700 1 -- 172.21.15.57:0/1687731965 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f298c06f390 con 0x7f29940b2540 2021-06-25T04:54:51.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.104+0000 7f2998ddd700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2974055340 0x7f2974057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:51.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.104+0000 7f2998ddd700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2974055340 0x7f2974057800 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f298800b000 tx=0x7f2988009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:51.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.108+0000 7f2991ffb700 1 -- 172.21.15.57:0/1687731965 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f29940b2d90 con 0x7f29940b2540 2021-06-25T04:54:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.284+0000 7f2999ddf700 1 -- 172.21.15.57:0/1687731965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f29940b2d90 con 0x7f29940b2540 2021-06-25T04:54:51.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.700+0000 7f2991ffb700 1 -- 172.21.15.57:0/1687731965 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v319) v1 ==== 126+0+0 (secure 0 0 0) 0x7f29940b2d90 con 0x7f29940b2540 2021-06-25T04:54:51.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 -- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2974055340 msgr2=0x7f2974057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:51.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2974055340 0x7f2974057800 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f298800b000 tx=0x7f2988009040).stop 2021-06-25T04:54:51.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 -- 172.21.15.57:0/1687731965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29940b2540 msgr2=0x7f2994159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:51.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29940b2540 0x7f2994159a90 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f29940af5b0 tx=0x7f298c015000).stop 2021-06-25T04:54:51.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 -- 172.21.15.57:0/1687731965 shutdown_connections 2021-06-25T04:54:51.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2974055340 0x7f2974057800 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29940b2540 0x7f2994159a90 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29940affd0 0x7f29940a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 --2- 172.21.15.57:0/1687731965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29940a8a80 0x7f299414aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 -- 172.21.15.57:0/1687731965 >> 172.21.15.57:0/1687731965 conn(0x7f2994060140 msgr2=0x7f2994144a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:51.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 -- 172.21.15.57:0/1687731965 shutdown_connections 2021-06-25T04:54:51.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.704+0000 7f2999ddf700 1 -- 172.21.15.57:0/1687731965 wait complete. 2021-06-25T04:54:51.728 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2021-06-25T04:54:51.728 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2021-06-25T04:54:51.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-06-25T04:54:51.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70da146700 1 Processor -- start 2021-06-25T04:54:51.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70da146700 1 -- start start 2021-06-25T04:54:51.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70da146700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70d40b00a0 0x7f70d4142e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:51.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70da146700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70d40ac6b0 0x7f70d4143320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:51.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70da146700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d4067840 con 0x7f70d40b2540 2021-06-25T04:54:51.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70da146700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d40ad570 con 0x7f70d40b00a0 2021-06-25T04:54:51.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70da146700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d4067ae0 con 0x7f70d40ac6b0 2021-06-25T04:54:51.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70d8943700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70d40b00a0 0x7f70d4142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:51.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70d8943700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70d40b00a0 0x7f70d4142e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40688/0 (socket says 172.21.15.57:40688) 2021-06-25T04:54:51.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70d8943700 1 -- 172.21.15.57:0/1167741512 learned_addr learned my addr 172.21.15.57:0/1167741512 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:51.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70d9945700 1 --2- 172.21.15.57:0/1167741512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70d40ac6b0 0x7f70d4143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:51.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70d8943700 1 -- 172.21.15.57:0/1167741512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70d40ac6b0 msgr2=0x7f70d4143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:51.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70d8943700 1 --2- 172.21.15.57:0/1167741512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70d40ac6b0 0x7f70d4143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70d8943700 1 -- 172.21.15.57:0/1167741512 >> v1:172.21.15.87:6789/0 conn(0x7f70d40b2540 legacy=0x7f70d4140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:51.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.836+0000 7f70d8943700 1 -- 172.21.15.57:0/1167741512 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d4146f90 con 0x7f70d40b00a0 2021-06-25T04:54:51.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70d8943700 1 --2- 172.21.15.57:0/1167741512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d40b00a0 0x7f70d4142e30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f70c4002f70 tx=0x7f70c4006eb0).ready entity=mon.0 client_cookie=8b3b72ac2adf8414 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:51.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70c3fff700 1 -- 172.21.15.57:0/1167741512 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c400d570 con 0x7f70d40b00a0 2021-06-25T04:54:51.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70c3fff700 1 -- 172.21.15.57:0/1167741512 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4000e90 con 0x7f70d40b00a0 2021-06-25T04:54:51.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70c3fff700 1 -- 172.21.15.57:0/1167741512 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c400d900 con 0x7f70d40b00a0 2021-06-25T04:54:51.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 -- 172.21.15.57:0/1167741512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d40b00a0 msgr2=0x7f70d4142e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:51.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 --2- 172.21.15.57:0/1167741512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d40b00a0 0x7f70d4142e30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f70c4002f70 tx=0x7f70c4006eb0).stop 2021-06-25T04:54:51.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 -- 172.21.15.57:0/1167741512 shutdown_connections 2021-06-25T04:54:51.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 --2- 172.21.15.57:0/1167741512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70d40ac6b0 0x7f70d4143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 --2- 172.21.15.57:0/1167741512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d40b00a0 0x7f70d4142e30 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 -- 172.21.15.57:0/1167741512 >> 172.21.15.57:0/1167741512 conn(0x7f70d4060140 msgr2=0x7f70d40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:51.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 -- 172.21.15.57:0/1167741512 shutdown_connections 2021-06-25T04:54:51.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 -- 172.21.15.57:0/1167741512 wait complete. 2021-06-25T04:54:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 Processor -- start 2021-06-25T04:54:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 -- start start 2021-06-25T04:54:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70d40ac6b0 0x7f70d4141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d40b00a0 0x7f70d413e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70d40b2540 0x7f70d413ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d4142fb0 con 0x7f70d40b00a0 2021-06-25T04:54:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d413f150 con 0x7f70d40b2540 2021-06-25T04:54:51.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70da146700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d413f890 con 0x7f70d40ac6b0 2021-06-25T04:54:51.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70d8943700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d40b00a0 0x7f70d413e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:51.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70d8943700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d40b00a0 0x7f70d413e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40694/0 (socket says 172.21.15.57:40694) 2021-06-25T04:54:51.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.840+0000 7f70d8943700 1 -- 172.21.15.57:0/2369998852 learned_addr learned my addr 172.21.15.57:0/2369998852 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:51.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70d9945700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70d40b2540 0x7f70d413ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:51.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70d9144700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70d40ac6b0 0x7f70d4141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:51.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70d8943700 1 -- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70d40ac6b0 msgr2=0x7f70d4141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:51.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70d8943700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70d40ac6b0 0x7f70d4141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70d8943700 1 -- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70d40b2540 msgr2=0x7f70d413ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:51.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70d8943700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70d40b2540 0x7f70d413ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:51.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70d8943700 1 -- 172.21.15.57:0/2369998852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c400b1e0 con 0x7f70d40b00a0 2021-06-25T04:54:51.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70d9144700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70d40ac6b0 0x7f70d4141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:51.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70d8943700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d40b00a0 0x7f70d413e770 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f70c4002f70 tx=0x7f70c4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:51.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70c27fc700 1 -- 172.21.15.57:0/2369998852 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c4011760 con 0x7f70d40b00a0 2021-06-25T04:54:51.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70c27fc700 1 -- 172.21.15.57:0/2369998852 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c40118c0 con 0x7f70d40b00a0 2021-06-25T04:54:51.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70da146700 1 -- 172.21.15.57:0/2369998852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d41427d0 con 0x7f70d40b00a0 2021-06-25T04:54:51.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70c27fc700 1 -- 172.21.15.57:0/2369998852 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c4011c20 con 0x7f70d40b00a0 2021-06-25T04:54:51.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70da146700 1 -- 172.21.15.57:0/2369998852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d4140fc0 con 0x7f70d40b00a0 2021-06-25T04:54:51.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70da146700 1 -- 172.21.15.57:0/2369998852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d4143170 con 0x7f70d40b00a0 2021-06-25T04:54:51.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70c27fc700 1 -- 172.21.15.57:0/2369998852 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f70c400f070 con 0x7f70d40b00a0 2021-06-25T04:54:51.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70c27fc700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70b40553f0 0x7f70b40578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:51.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70c27fc700 1 -- 172.21.15.57:0/2369998852 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f70c406f240 con 0x7f70d40b00a0 2021-06-25T04:54:51.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.844+0000 7f70d9144700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70b40553f0 0x7f70b40578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:51.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.848+0000 7f70d9144700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70b40553f0 0x7f70b40578b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f70d000b000 tx=0x7f70d0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:51.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:51.852+0000 7f70c27fc700 1 -- 172.21.15.57:0/2369998852 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f70c40456d0 con 0x7f70d40b00a0 2021-06-25T04:54:52.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.024+0000 7f70da146700 1 -- 172.21.15.57:0/2369998852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f70d4057310 con 0x7f70d40b00a0 2021-06-25T04:54:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.704+0000 7f70c27fc700 1 -- 172.21.15.57:0/2369998852 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v320) v1 ==== 141+0+0 (secure 0 0 0) 0x7f70c4048cf0 con 0x7f70d40b00a0 2021-06-25T04:54:52.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 -- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70b40553f0 msgr2=0x7f70b40578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:52.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70b40553f0 0x7f70b40578b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f70d000b000 tx=0x7f70d0009040).stop 2021-06-25T04:54:52.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 -- 172.21.15.57:0/2369998852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d40b00a0 msgr2=0x7f70d413e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:52.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d40b00a0 0x7f70d413e770 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f70c4002f70 tx=0x7f70c4015000).stop 2021-06-25T04:54:52.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 -- 172.21.15.57:0/2369998852 shutdown_connections 2021-06-25T04:54:52.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f70b40553f0 0x7f70b40578b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:52.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70d40b2540 0x7f70d413ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:52.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d40b00a0 0x7f70d413e770 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:52.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 --2- 172.21.15.57:0/2369998852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f70d40ac6b0 0x7f70d4141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:52.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 -- 172.21.15.57:0/2369998852 >> 172.21.15.57:0/2369998852 conn(0x7f70d4060140 msgr2=0x7f70d405bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:52.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 -- 172.21.15.57:0/2369998852 shutdown_connections 2021-06-25T04:54:52.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.708+0000 7f70da146700 1 -- 172.21.15.57:0/2369998852 wait complete. 2021-06-25T04:54:52.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:54:52.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.840+0000 7f0b3b59e700 1 Processor -- start 2021-06-25T04:54:52.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.840+0000 7f0b3b59e700 1 -- start start 2021-06-25T04:54:52.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.840+0000 7f0b3b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b3c063890 0x7f0b3c143d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:52.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.840+0000 7f0b3b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0b3c140940 0x7f0b3c128c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:52.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.840+0000 7f0b3b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c063c70 con 0x7f0b3c0618e0 2021-06-25T04:54:52.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.840+0000 7f0b3b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3c13fd70 con 0x7f0b3c140940 2021-06-25T04:54:52.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.840+0000 7f0b3b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c061fb0 con 0x7f0b3c063890 2021-06-25T04:54:52.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.840+0000 7f0b39d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0b3c0618e0 0x7f0b3c0b1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57922/0 (socket says 172.21.15.57:57922) 2021-06-25T04:54:52.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.840+0000 7f0b39d9b700 1 -- 172.21.15.57:0/3611578344 learned_addr learned my addr 172.21.15.57:0/3611578344 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:52.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3a59c700 1 --2- 172.21.15.57:0/3611578344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b3c063890 0x7f0b3c143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3ad9d700 1 --2- 172.21.15.57:0/3611578344 >> v2:172.21.15.87:3300/0 conn(0x7f0b3c140940 0x7f0b3c128c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3959a700 1 -- 172.21.15.57:0/3611578344 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268243860 0 0) 0x7f0b3c063c70 con 0x7f0b3c0618e0 2021-06-25T04:54:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3959a700 1 -- 172.21.15.57:0/3611578344 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b1c003260 con 0x7f0b3c0618e0 2021-06-25T04:54:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3ad9d700 1 -- 172.21.15.57:0/3611578344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b3c063890 msgr2=0x7f0b3c143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:52.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3ad9d700 1 --2- 172.21.15.57:0/3611578344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b3c063890 0x7f0b3c143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:52.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3ad9d700 1 -- 172.21.15.57:0/3611578344 >> v1:172.21.15.57:6789/0 conn(0x7f0b3c0618e0 legacy=0x7f0b3c0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:52.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3ad9d700 1 -- 172.21.15.57:0/3611578344 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c13ff60 con 0x7f0b3c140940 2021-06-25T04:54:52.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3a59c700 1 --2- 172.21.15.57:0/3611578344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b3c063890 0x7f0b3c143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:52.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3ad9d700 1 --2- 172.21.15.57:0/3611578344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b3c140940 0x7f0b3c128c40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f0b340032f0 tx=0x7f0b340091d0).ready entity=mon.1 client_cookie=4ed8871717b9291f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:52.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3959a700 1 -- 172.21.15.57:0/3611578344 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b3400b600 con 0x7f0b3c140940 2021-06-25T04:54:52.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3959a700 1 -- 172.21.15.57:0/3611578344 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3400b760 con 0x7f0b3c140940 2021-06-25T04:54:52.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3959a700 1 -- 172.21.15.57:0/3611578344 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b3400b8d0 con 0x7f0b3c140940 2021-06-25T04:54:52.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3611578344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b3c140940 msgr2=0x7f0b3c128c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:52.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3b59e700 1 --2- 172.21.15.57:0/3611578344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b3c140940 0x7f0b3c128c40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f0b340032f0 tx=0x7f0b340091d0).stop 2021-06-25T04:54:52.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3611578344 shutdown_connections 2021-06-25T04:54:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3b59e700 1 --2- 172.21.15.57:0/3611578344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b3c140940 0x7f0b3c128c40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3b59e700 1 --2- 172.21.15.57:0/3611578344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b3c063890 0x7f0b3c143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3611578344 >> 172.21.15.57:0/3611578344 conn(0x7f0b3c05c450 msgr2=0x7f0b3c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:52.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3611578344 shutdown_connections 2021-06-25T04:54:52.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.844+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3611578344 wait complete. 2021-06-25T04:54:52.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3b59e700 1 Processor -- start 2021-06-25T04:54:52.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3b59e700 1 -- start start 2021-06-25T04:54:52.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b3c0618e0 0x7f0b3c066c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:52.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b3c063890 0x7f0b3c0b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:52.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b3c140940 0x7f0b3c0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:52.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0b5b00 con 0x7f0b3c0618e0 2021-06-25T04:54:52.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0b1b20 con 0x7f0b3c063890 2021-06-25T04:54:52.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0b1dc0 con 0x7f0b3c140940 2021-06-25T04:54:52.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b3c0618e0 0x7f0b3c066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:52.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b39d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b3c063890 0x7f0b3c0b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:52.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b3c0618e0 0x7f0b3c066c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40710/0 (socket says 172.21.15.57:40710) 2021-06-25T04:54:52.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3a59c700 1 -- 172.21.15.57:0/3142637726 learned_addr learned my addr 172.21.15.57:0/3142637726 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:52.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3ad9d700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b3c140940 0x7f0b3c0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:52.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3a59c700 1 -- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b3c140940 msgr2=0x7f0b3c0b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:52.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3a59c700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b3c140940 0x7f0b3c0b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:52.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3a59c700 1 -- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b3c063890 msgr2=0x7f0b3c0b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:52.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3a59c700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b3c063890 0x7f0b3c0b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:52.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3a59c700 1 -- 172.21.15.57:0/3142637726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c00b180 con 0x7f0b3c0618e0 2021-06-25T04:54:52.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3a59c700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b3c0618e0 0x7f0b3c066c20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f0b2c00c000 tx=0x7f0b2c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:52.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b337fe700 1 -- 172.21.15.57:0/3142637726 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b2c0133f0 con 0x7f0b3c0618e0 2021-06-25T04:54:52.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b337fe700 1 -- 172.21.15.57:0/3142637726 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c013550 con 0x7f0b3c0618e0 2021-06-25T04:54:52.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b337fe700 1 -- 172.21.15.57:0/3142637726 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b2c0138b0 con 0x7f0b3c0618e0 2021-06-25T04:54:52.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3142637726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b34009470 con 0x7f0b3c0618e0 2021-06-25T04:54:52.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.848+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3142637726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3c1293b0 con 0x7f0b3c0618e0 2021-06-25T04:54:52.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.852+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3142637726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3c0b2980 con 0x7f0b3c0618e0 2021-06-25T04:54:52.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.852+0000 7f0b337fe700 1 -- 172.21.15.57:0/3142637726 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0b2c013a10 con 0x7f0b3c0618e0 2021-06-25T04:54:52.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.852+0000 7f0b337fe700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b20055360 0x7f0b20057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:52.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.852+0000 7f0b337fe700 1 -- 172.21.15.57:0/3142637726 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f0b2c06dab0 con 0x7f0b3c0618e0 2021-06-25T04:54:52.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.852+0000 7f0b39d9b700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b20055360 0x7f0b20057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.852+0000 7f0b39d9b700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b20055360 0x7f0b20057820 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f0b24011000 tx=0x7f0b24007ab0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.860+0000 7f0b337fe700 1 -- 172.21.15.57:0/3142637726 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0b3c0b2980 con 0x7f0b3c0618e0 2021-06-25T04:54:52.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:52.992+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3142637726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0b3c0b2980 con 0x7f0b3c0618e0 2021-06-25T04:54:53.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.000+0000 7f0b337fe700 1 -- 172.21.15.57:0/3142637726 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0b3c0b2980 con 0x7f0b3c0618e0 2021-06-25T04:54:53.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.000+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b20055360 msgr2=0x7f0b20057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.004+0000 7f0b3b59e700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b20055360 0x7f0b20057820 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f0b24011000 tx=0x7f0b24007ab0).stop 2021-06-25T04:54:53.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.004+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3142637726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b3c0618e0 msgr2=0x7f0b3c066c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.004+0000 7f0b3b59e700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b3c0618e0 0x7f0b3c066c20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f0b2c00c000 tx=0x7f0b2c006df0).stop 2021-06-25T04:54:53.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.004+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3142637726 shutdown_connections 2021-06-25T04:54:53.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.004+0000 7f0b3b59e700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0b20055360 0x7f0b20057820 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.004+0000 7f0b3b59e700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b3c140940 0x7f0b3c0b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.004+0000 7f0b3b59e700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b3c063890 0x7f0b3c0b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.004+0000 7f0b3b59e700 1 --2- 172.21.15.57:0/3142637726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b3c0618e0 0x7f0b3c066c20 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.004+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3142637726 >> 172.21.15.57:0/3142637726 conn(0x7f0b3c05c450 msgr2=0x7f0b3c13dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:53.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.004+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3142637726 shutdown_connections 2021-06-25T04:54:53.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.004+0000 7f0b3b59e700 1 -- 172.21.15.57:0/3142637726 wait complete. 2021-06-25T04:54:53.019 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:54:53.020 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:53.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:53.061 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:53.083 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:54:53.104 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:54:53.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:53.105 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:53.106 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:54:53.130 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:54:53.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:54:53.132 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:54:53.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:54:53.133 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:54:53.133 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:54:53.141 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:54:53.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:54:53.143 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:54:53.143 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:54:53.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f6d738700 1 Processor -- start 2021-06-25T04:54:53.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f6d738700 1 -- start start 2021-06-25T04:54:53.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f6d738700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9f680b2810 0x7f9f680b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f6d738700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f6805c890 0x7f9f6813cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f6d738700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f680b2bf0 con 0x7f9f6805c450 2021-06-25T04:54:53.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f6d738700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f680b1620 con 0x7f9f680b2810 2021-06-25T04:54:53.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f6d738700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f680b18c0 con 0x7f9f6805c890 2021-06-25T04:54:53.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f67fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9f680b2810 0x7f9f680b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f67fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9f680b2810 0x7f9f680b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40718/0 (socket says 172.21.15.57:40718) 2021-06-25T04:54:53.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f67fff700 1 -- 172.21.15.57:0/796126556 learned_addr learned my addr 172.21.15.57:0/796126556 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:53.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f6cf37700 1 --2- 172.21.15.57:0/796126556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f6805c890 0x7f9f6813cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f67fff700 1 -- 172.21.15.57:0/796126556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f6805c890 msgr2=0x7f9f6813cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:53.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f67fff700 1 --2- 172.21.15.57:0/796126556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f6805c890 0x7f9f6813cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f67fff700 1 -- 172.21.15.57:0/796126556 >> v1:172.21.15.87:6789/0 conn(0x7f9f6805c450 legacy=0x7f9f6813c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f66ffd700 1 -- 172.21.15.57:0/796126556 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956143031 0 0) 0x7f9f680b2bf0 con 0x7f9f6805c450 2021-06-25T04:54:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.252+0000 7f9f67fff700 1 -- 172.21.15.57:0/796126556 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f680b1b60 con 0x7f9f680b2810 2021-06-25T04:54:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f67fff700 1 --2- 172.21.15.57:0/796126556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f680b2810 0x7f9f680b0a60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f9f580032f0 tx=0x7f9f58009290).ready entity=mon.0 client_cookie=64b6e34f3330d163 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f66ffd700 1 -- 172.21.15.57:0/796126556 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f5800ba90 con 0x7f9f680b2810 2021-06-25T04:54:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f66ffd700 1 -- 172.21.15.57:0/796126556 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5800bbf0 con 0x7f9f680b2810 2021-06-25T04:54:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f66ffd700 1 -- 172.21.15.57:0/796126556 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f58010470 con 0x7f9f680b2810 2021-06-25T04:54:53.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f6d738700 1 -- 172.21.15.57:0/796126556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f680b2810 msgr2=0x7f9f680b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f6d738700 1 --2- 172.21.15.57:0/796126556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f680b2810 0x7f9f680b0a60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f9f580032f0 tx=0x7f9f58009290).stop 2021-06-25T04:54:53.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f6d738700 1 -- 172.21.15.57:0/796126556 shutdown_connections 2021-06-25T04:54:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f6d738700 1 --2- 172.21.15.57:0/796126556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f6805c890 0x7f9f6813cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f6d738700 1 --2- 172.21.15.57:0/796126556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f680b2810 0x7f9f680b0a60 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f6d738700 1 -- 172.21.15.57:0/796126556 >> 172.21.15.57:0/796126556 conn(0x7f9f680611f0 msgr2=0x7f9f68062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f6d738700 1 -- 172.21.15.57:0/796126556 shutdown_connections 2021-06-25T04:54:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.256+0000 7f9f6d738700 1 -- 172.21.15.57:0/796126556 wait complete. 2021-06-25T04:54:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f6d738700 1 Processor -- start 2021-06-25T04:54:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f6d738700 1 -- start start 2021-06-25T04:54:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f6d738700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f6805c450 0x7f9f68140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f6d738700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f6805c890 0x7f9f6813e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f6d738700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f680b2810 0x7f9f68151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f6d738700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f68141800 con 0x7f9f6805c890 2021-06-25T04:54:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f6d738700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6814eed0 con 0x7f9f6805c450 2021-06-25T04:54:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f6d738700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f681520f0 con 0x7f9f680b2810 2021-06-25T04:54:53.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f677fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f6805c890 0x7f9f6813e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f677fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f6805c890 0x7f9f6813e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40726/0 (socket says 172.21.15.57:40726) 2021-06-25T04:54:53.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f677fe700 1 -- 172.21.15.57:0/640699487 learned_addr learned my addr 172.21.15.57:0/640699487 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:53.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f67fff700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f6805c450 0x7f9f68140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f6cf37700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f680b2810 0x7f9f68151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f677fe700 1 -- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f680b2810 msgr2=0x7f9f68151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f677fe700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f680b2810 0x7f9f68151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f677fe700 1 -- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f6805c450 msgr2=0x7f9f68140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f677fe700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f6805c450 0x7f9f68140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f677fe700 1 -- 172.21.15.57:0/640699487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f58009530 con 0x7f9f6805c890 2021-06-25T04:54:53.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f677fe700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f6805c890 0x7f9f6813e2e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f9f50000ed0 tx=0x7f9f50007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:53.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f657fa700 1 -- 172.21.15.57:0/640699487 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f50012400 con 0x7f9f6805c890 2021-06-25T04:54:53.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f657fa700 1 -- 172.21.15.57:0/640699487 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50012560 con 0x7f9f6805c890 2021-06-25T04:54:53.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f6d738700 1 -- 172.21.15.57:0/640699487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f68152390 con 0x7f9f6805c890 2021-06-25T04:54:53.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f657fa700 1 -- 172.21.15.57:0/640699487 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f500128c0 con 0x7f9f6805c890 2021-06-25T04:54:53.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.260+0000 7f9f6d738700 1 -- 172.21.15.57:0/640699487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6813e7d0 con 0x7f9f6805c890 2021-06-25T04:54:53.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.264+0000 7f9f6d738700 1 -- 172.21.15.57:0/640699487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f68057310 con 0x7f9f6805c890 2021-06-25T04:54:53.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.264+0000 7f9f657fa700 1 -- 172.21.15.57:0/640699487 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9f50019030 con 0x7f9f6805c890 2021-06-25T04:54:53.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.264+0000 7f9f657fa700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f4c0554e0 0x7f9f4c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.264+0000 7f9f657fa700 1 -- 172.21.15.57:0/640699487 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f9f5006d030 con 0x7f9f6805c890 2021-06-25T04:54:53.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.264+0000 7f9f67fff700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f4c0554e0 0x7f9f4c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.264+0000 7f9f67fff700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f4c0554e0 0x7f9f4c0579a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f9f5801c000 tx=0x7f9f58018000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:53.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.272+0000 7f9f657fa700 1 -- 172.21.15.57:0/640699487 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9f50042c50 con 0x7f9f6805c890 2021-06-25T04:54:53.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.404+0000 7f9f6d738700 1 -- 172.21.15.57:0/640699487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9f68139f10 con 0x7f9f6805c890 2021-06-25T04:54:53.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.404+0000 7f9f657fa700 1 -- 172.21.15.57:0/640699487 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v91) v1 ==== 81+0+29220 (secure 0 0 0) 0x7f9f50028240 con 0x7f9f6805c890 2021-06-25T04:54:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:53.411 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:54:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 91, 2021-06-25T04:54:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:54:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:54:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:54:50.681285+0000", 2021-06-25T04:54:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:54:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:54:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:54:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:54:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:54:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:54:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:54:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:54:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:54:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:54:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:54:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:54:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:54:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:54:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 16, 2021-06-25T04:54:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:54:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:54:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:54:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:54:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:54:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:54:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:54:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:54:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:54:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:54:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:54:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:54:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:54:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:54:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:54:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:54:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:54:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:54:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:54:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:54:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:54:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:54:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:54:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:54:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:54:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:54:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:54:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:54:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:54:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:54:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:54:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:54:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:54:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:54:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:54:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:54:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:54:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:54:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:54:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:54:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:54:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:54:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:54:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:54:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:54:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:54:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:54:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:54:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:54:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:54:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:54:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:54:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:54:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:54:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:54:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:54:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:54:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:54:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:54:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:54:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:54:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:54:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:54:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:54:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:54:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:54:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:54:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.454 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:54:53.454 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:54:53.454 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:54:53.454 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:54:53.454 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:54:53.455 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:54:53.455 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:54:53.455 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:54:53.455 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:54:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:54:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:54:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:54:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:54:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:54:53.457 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.457 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.457 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:53.458 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:54:53.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.458 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:54:53.459 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:54:53.459 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:53.459 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:53.460 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:53.460 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:53.462 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:53.463 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:53.463 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:53.463 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:53.463 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:53.464 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:53.464 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:53.464 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:54:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.466 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.466 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:54:53.466 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:53.466 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.467 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.467 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:53.467 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.468 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.468 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:54:53.468 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:53.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.469 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.469 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:54:53.470 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:53.470 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.470 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.471 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:53.471 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.472 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.472 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:54:53.472 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:53.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.473 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.473 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:54:53.474 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:53.474 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.475 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.476 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:53.476 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.476 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.477 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:54:53.477 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:53.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.478 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.478 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:54:53.478 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:54:53.478 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.478 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.479 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:54:53.479 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:54:53.479 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:54:53.480 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:54:53.480 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:53.480 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:53.480 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:53.480 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.481 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:54:53.481 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:54:53.482 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:53.482 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:53.482 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:53.482 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:53.483 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:53.483 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:53.483 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:53.483 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 85, 2021-06-25T04:54:53.483 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:53.484 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:53.484 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:53.484 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.485 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.485 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:54:53.485 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:53.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.487 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.487 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:54:53.487 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:53.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.487 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.488 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:53.488 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.489 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.489 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:54:53.489 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:53.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.490 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.490 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:54:53.490 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:53.490 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.491 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.491 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:53.491 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.492 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.492 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:54:53.492 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:53.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.493 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.493 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:54:53.493 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:53.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.494 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.494 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:53.494 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.495 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.495 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:54:53.495 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:53.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:54:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:54:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:54:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:54:53.499 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:54:53.499 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:54:53.499 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:53.499 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:54:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:54:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.504 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.504 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:54:53.504 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:53.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.505 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.505 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:54:53.505 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:53.506 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.506 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.506 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:53.507 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.507 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.508 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:54:53.508 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:53.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.508 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.509 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:54:53.509 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:53.509 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.509 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.510 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:53.510 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.511 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.511 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:54:53.511 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:53.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.512 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.512 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:54:53.512 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:53.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.512 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.513 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:53.513 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.514 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.514 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:54:53.514 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:53.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.515 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.515 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:54:53.515 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:54:53.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.516 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.516 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:54:53.516 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:54:53.516 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:54:53.517 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:54:53.517 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:53.517 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:53.517 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:53.518 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:54:53.519 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:54:53.519 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:53.519 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:53.519 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:53.519 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:53.520 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:53.520 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:53.520 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:53.520 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:53.521 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:53.521 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:53.521 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:53.521 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.522 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.522 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:54:53.522 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:53.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.523 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.523 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:54:53.523 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:53.523 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.524 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.524 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:53.524 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.525 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.525 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:54:53.525 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:53.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.526 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.526 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:54:53.526 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:53.526 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.527 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.527 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:53.527 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.528 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.528 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:54:53.528 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:53.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.529 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.529 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:54:53.529 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:53.530 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.530 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.530 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:53.530 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.531 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.531 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:54:53.531 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:53.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.532 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.532 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:54:53.532 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:54:53.533 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.533 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.533 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:54:53.534 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:54:53.534 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:54:53.534 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:54:53.534 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:53.535 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:53.535 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:53.535 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.536 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:54:53.536 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:54:53.536 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:53.536 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:53.537 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:53.537 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:53.537 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:53.537 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:53.537 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:53.538 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:53.538 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:53.538 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:53.538 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:53.539 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.539 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.539 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:54:53.539 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:53.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.540 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.540 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:54:53.541 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:53.541 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.541 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.541 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:53.542 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.542 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.542 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:54:53.543 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:53.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.543 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.544 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:54:53.544 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:53.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.544 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.545 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:53.545 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.545 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.546 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:54:53.546 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:53.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.546 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.547 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:54:53.547 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:53.547 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.547 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.548 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:53.548 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.548 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.549 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:54:53.549 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:53.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.550 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.550 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:54:53.550 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:54:53.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.550 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.551 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:54:53.551 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:54:53.551 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:54:53.552 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:54:53.552 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:53.552 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:53.552 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:53.552 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.553 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:54:53.553 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:54:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:53.555 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:53.555 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:53.555 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:53.555 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:53.556 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:53.556 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:53.556 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.556 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.557 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:54:53.557 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:53.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.558 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.558 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:54:53.558 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:53.558 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.558 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.559 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:53.559 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.560 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.560 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:54:53.560 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:53.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.561 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.561 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:54:53.561 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:53.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.561 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.562 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:53.562 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.563 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.563 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:54:53.563 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:53.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.564 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.564 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:54:53.565 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:53.565 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.565 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.565 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:53.566 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.566 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.566 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:54:53.567 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:53.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.568 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:54:53.568 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:54:53.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.568 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.569 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:54:53.569 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:54:53.569 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:54:53.569 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:54:53.570 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:53.570 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:53.570 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:53.570 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.571 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:54:53.571 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:54:53.571 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:53.572 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:53.572 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:53.572 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:53.572 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:53.573 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:53.573 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:53.573 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:54:53.573 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:53.574 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:53.574 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:53.574 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.574 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.575 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:54:53.575 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:53.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.576 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.576 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:54:53.576 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:53.576 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.576 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.577 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:53.577 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.578 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:54:53.578 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:53.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.579 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.579 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:54:53.579 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:53.579 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.580 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.580 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:53.580 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.581 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.581 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:54:53.581 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:53.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.582 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.582 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:54:53.583 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:53.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.583 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.583 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:53.584 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.584 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.584 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:54:53.585 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:53.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.585 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.585 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:54:53.586 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:54:53.586 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.586 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.587 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:54:53.587 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:54:53.587 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:54:53.587 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:54:53.588 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:53.588 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:53.588 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:53.588 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.589 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:54:53.589 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:54:53.589 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:54:53.589 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:54:53.590 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:54:53.590 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:54:53.590 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:54:53.590 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:54:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:54:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 74, 2021-06-25T04:54:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:54:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:54:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:54:53.592 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.592 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.592 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:54:53.593 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:53.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.593 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.593 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:54:53.594 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:53.595 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.595 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.595 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:54:53.596 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.596 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.597 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:54:53.597 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:53.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.597 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.598 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:54:53.598 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:53.598 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.598 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.599 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:54:53.599 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.599 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.600 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:54:53.600 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:53.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.601 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.601 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:54:53.601 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:53.601 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.602 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.602 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:54:53.602 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:54:53.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.603 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:54:53.603 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:54:53.603 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:53.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.604 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:54:53.604 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:54:53.604 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:54:53.604 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.605 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.605 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:54:53.605 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:54:53.606 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:54:53.606 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:54:53.606 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:54:53.606 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:54:53.606 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:54:53.607 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:53.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.607 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:53.607 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:54:53.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.608 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:54:53.608 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:53.608 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:53.608 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:53.609 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:53.609 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:53.609 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:54:53.609 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:53.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.610 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:54:53.610 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:53.610 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:53.611 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:53.611 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:53.611 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:53.611 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:54:53.612 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:53.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.612 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:54:53.612 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:53.613 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:53.613 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:53.613 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:53.613 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:53.614 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:54:53.614 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:53.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.614 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:54:53.615 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:53.615 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:53.615 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:53.615 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:53.616 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:53.616 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:54:53.616 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:53.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.617 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:54:53.617 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:53.617 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:53.617 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:53.618 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:53.618 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:53.618 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:54:53.618 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:53.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.619 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:54:53.619 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:53.619 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:53.619 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:53.620 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:53.620 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:53.620 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:54:53.620 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:53.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.621 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:54:53.621 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:53.621 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:53.622 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:53.622 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:53.622 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:53.622 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:54:53.623 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:53.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:53.623 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:54:53.624 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:54:53.624 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:54:53.624 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:54:53.624 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:54:53.624 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:54:53.625 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:54:53.625 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:54:53.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.625 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:54:53.626 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:54:53.626 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:54:53.626 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:54:53.626 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:54:53.626 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:54:53.627 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6835/2701177693": "2021-06-26T04:54:47.271035+0000", 2021-06-25T04:54:53.627 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6834/2701177693": "2021-06-26T04:54:47.271035+0000" 2021-06-25T04:54:53.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.627 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:54:53.628 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:54:53.628 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:54:53.628 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:54:53.628 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:54:53.628 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:54:53.629 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:54:53.629 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:54:53.629 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:54:53.629 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:54:53.629 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:54:53.630 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:54:53.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.630 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:54:53.630 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:54:53.631 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:54:53.631 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:54:53.631 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:54:53.631 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:54:53.631 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:54:53.632 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:53.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:53.632 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:54:53.632 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:54:53.633 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:54:53.633 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:54:53.633 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:54:53.633 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:54:53.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 -- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f4c0554e0 msgr2=0x7f9f4c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f4c0554e0 0x7f9f4c0579a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f9f5801c000 tx=0x7f9f58018000).stop 2021-06-25T04:54:53.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 -- 172.21.15.57:0/640699487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f6805c890 msgr2=0x7f9f6813e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f6805c890 0x7f9f6813e2e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f9f50000ed0 tx=0x7f9f50007ab0).stop 2021-06-25T04:54:53.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 -- 172.21.15.57:0/640699487 shutdown_connections 2021-06-25T04:54:53.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9f4c0554e0 0x7f9f4c0579a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f680b2810 0x7f9f68151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f6805c890 0x7f9f6813e2e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 --2- 172.21.15.57:0/640699487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f6805c450 0x7f9f68140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 -- 172.21.15.57:0/640699487 >> 172.21.15.57:0/640699487 conn(0x7f9f680611f0 msgr2=0x7f9f68139390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:53.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 -- 172.21.15.57:0/640699487 shutdown_connections 2021-06-25T04:54:53.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.408+0000 7f9f6d738700 1 -- 172.21.15.57:0/640699487 wait complete. 2021-06-25T04:54:53.639 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f263d966700 1 Processor -- start 2021-06-25T04:54:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f263d966700 1 -- start start 2021-06-25T04:54:53.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f263d966700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26380b40f0 0x7f26380614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f263d966700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2638061990 0x7f26380b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f263d966700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26380b1ff0 con 0x7f2638147550 2021-06-25T04:54:53.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f263d966700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26380b2290 con 0x7f26380b40f0 2021-06-25T04:54:53.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f263d966700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26380b2530 con 0x7f2638061990 2021-06-25T04:54:53.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f2637fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26380b40f0 0x7f26380614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f2637fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26380b40f0 0x7f26380614a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40734/0 (socket says 172.21.15.57:40734) 2021-06-25T04:54:53.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f2637fff700 1 -- 172.21.15.57:0/3161282869 learned_addr learned my addr 172.21.15.57:0/3161282869 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:53.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f263d165700 1 --2- 172.21.15.57:0/3161282869 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2638061990 0x7f26380b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f2637fff700 1 -- 172.21.15.57:0/3161282869 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2638061990 msgr2=0x7f26380b95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:53.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f2637fff700 1 --2- 172.21.15.57:0/3161282869 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2638061990 0x7f26380b95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f2637fff700 1 -- 172.21.15.57:0/3161282869 >> v1:172.21.15.87:6789/0 conn(0x7f2638147550 legacy=0x7f2638147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f2637fff700 1 -- 172.21.15.57:0/3161282869 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2638148120 con 0x7f26380b40f0 2021-06-25T04:54:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f263d165700 1 --2- 172.21.15.57:0/3161282869 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2638061990 0x7f26380b95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f2637fff700 1 --2- 172.21.15.57:0/3161282869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26380b40f0 0x7f26380614a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f2620002f70 tx=0x7f2620006eb0).ready entity=mon.0 client_cookie=d663d4918ea552f5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f26377fe700 1 -- 172.21.15.57:0/3161282869 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262000d5c0 con 0x7f26380b40f0 2021-06-25T04:54:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f26377fe700 1 -- 172.21.15.57:0/3161282869 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620000e90 con 0x7f26380b40f0 2021-06-25T04:54:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f26377fe700 1 -- 172.21.15.57:0/3161282869 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262000d950 con 0x7f26380b40f0 2021-06-25T04:54:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f263d966700 1 -- 172.21.15.57:0/3161282869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26380b40f0 msgr2=0x7f26380614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.744+0000 7f263d966700 1 --2- 172.21.15.57:0/3161282869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26380b40f0 0x7f26380614a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f2620002f70 tx=0x7f2620006eb0).stop 2021-06-25T04:54:53.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.748+0000 7f263d966700 1 -- 172.21.15.57:0/3161282869 shutdown_connections 2021-06-25T04:54:53.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.748+0000 7f263d966700 1 --2- 172.21.15.57:0/3161282869 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2638061990 0x7f26380b95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.748+0000 7f263d966700 1 --2- 172.21.15.57:0/3161282869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26380b40f0 0x7f26380614a0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.748+0000 7f263d966700 1 -- 172.21.15.57:0/3161282869 >> 172.21.15.57:0/3161282869 conn(0x7f263806adb0 msgr2=0x7f263805f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.748+0000 7f263d966700 1 -- 172.21.15.57:0/3161282869 shutdown_connections 2021-06-25T04:54:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.748+0000 7f263d966700 1 -- 172.21.15.57:0/3161282869 wait complete. 2021-06-25T04:54:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.748+0000 7f263d966700 1 Processor -- start 2021-06-25T04:54:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.748+0000 7f263d966700 1 -- start start 2021-06-25T04:54:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d966700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26380b40f0 0x7f26380b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d966700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2638147550 0x7f26380ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d966700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26380b9eb0 0x7f26380add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d966700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26381418f0 con 0x7f26380b9eb0 2021-06-25T04:54:53.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d966700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2638141b20 con 0x7f26380b40f0 2021-06-25T04:54:53.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d966700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2638143750 con 0x7f2638147550 2021-06-25T04:54:53.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d165700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26380b9eb0 0x7f26380add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d165700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26380b9eb0 0x7f26380add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40742/0 (socket says 172.21.15.57:40742) 2021-06-25T04:54:53.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d165700 1 -- 172.21.15.57:0/4155610304 learned_addr learned my addr 172.21.15.57:0/4155610304 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:53.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f2637fff700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2638147550 0x7f26380ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263c964700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26380b40f0 0x7f26380b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d165700 1 -- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2638147550 msgr2=0x7f26380ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d165700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2638147550 0x7f26380ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d165700 1 -- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26380b40f0 msgr2=0x7f26380b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d165700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26380b40f0 0x7f26380b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d165700 1 -- 172.21.15.57:0/4155610304 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262000b1e0 con 0x7f26380b9eb0 2021-06-25T04:54:53.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263c964700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26380b40f0 0x7f26380b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:53.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d165700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26380b9eb0 0x7f26380add40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f263000a000 tx=0x7f2630008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:53.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f2635ffb700 1 -- 172.21.15.57:0/4155610304 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2630013620 con 0x7f26380b9eb0 2021-06-25T04:54:53.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f2635ffb700 1 -- 172.21.15.57:0/4155610304 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2630013780 con 0x7f26380b9eb0 2021-06-25T04:54:53.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d966700 1 -- 172.21.15.57:0/4155610304 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2638141f10 con 0x7f26380b9eb0 2021-06-25T04:54:53.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f2635ffb700 1 -- 172.21.15.57:0/4155610304 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2630013ae0 con 0x7f26380b9eb0 2021-06-25T04:54:53.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.752+0000 7f263d966700 1 -- 172.21.15.57:0/4155610304 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26381431d0 con 0x7f26380b9eb0 2021-06-25T04:54:53.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.756+0000 7f263d966700 1 -- 172.21.15.57:0/4155610304 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26381420a0 con 0x7f26380b9eb0 2021-06-25T04:54:53.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.756+0000 7f2635ffb700 1 -- 172.21.15.57:0/4155610304 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2630013c40 con 0x7f26380b9eb0 2021-06-25T04:54:53.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.756+0000 7f2635ffb700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f261c055490 0x7f261c057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:53.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.756+0000 7f2635ffb700 1 -- 172.21.15.57:0/4155610304 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f263006e280 con 0x7f26380b9eb0 2021-06-25T04:54:53.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.756+0000 7f263c964700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f261c055490 0x7f261c057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:53.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.756+0000 7f263c964700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f261c055490 0x7f261c057950 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f262800b000 tx=0x7f2628009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:53.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.764+0000 7f2635ffb700 1 -- 172.21.15.57:0/4155610304 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2630044580 con 0x7f26380b9eb0 2021-06-25T04:54:53.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.928+0000 7f263d966700 1 -- 172.21.15.57:0/4155610304 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2638143910 con 0x7f26380b9eb0 2021-06-25T04:54:53.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f2635ffb700 1 -- 172.21.15.57:0/4155610304 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f2630047ba0 con 0x7f26380b9eb0 2021-06-25T04:54:53.935 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:53.935 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/2314323791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2314323791},{"type":"v1","addr":"172.21.15.87:6835","nonce":2314323791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3937527303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3937527303},{"type":"v1","addr":"172.21.15.57:6833","nonce":3937527303}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39},{"gid":6903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6835/4171936113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4171936113},{"type":"v1","addr":"172.21.15.57:6835","nonce":4171936113}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[]} 2021-06-25T04:54:53.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 -- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f261c055490 msgr2=0x7f261c057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f261c055490 0x7f261c057950 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f262800b000 tx=0x7f2628009040).stop 2021-06-25T04:54:53.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 -- 172.21.15.57:0/4155610304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26380b9eb0 msgr2=0x7f26380add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:53.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26380b9eb0 0x7f26380add40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f263000a000 tx=0x7f2630008040).stop 2021-06-25T04:54:53.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 -- 172.21.15.57:0/4155610304 shutdown_connections 2021-06-25T04:54:53.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f261c055490 0x7f261c057950 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26380b9eb0 0x7f26380add40 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2638147550 0x7f26380ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 --2- 172.21.15.57:0/4155610304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26380b40f0 0x7f26380b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:53.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 -- 172.21.15.57:0/4155610304 >> 172.21.15.57:0/4155610304 conn(0x7f263806adb0 msgr2=0x7f2638146460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:53.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 -- 172.21.15.57:0/4155610304 shutdown_connections 2021-06-25T04:54:53.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:53.932+0000 7f263d966700 1 -- 172.21.15.57:0/4155610304 wait complete. 2021-06-25T04:54:53.943 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 44 2021-06-25T04:54:53.954 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:54.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7359e700 1 Processor -- start 2021-06-25T04:54:54.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7359e700 1 -- start start 2021-06-25T04:54:54.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4a74061640 0x7f4a740b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a740b46d0 0x7f4a740ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a740b68d0 con 0x7f4a74143960 2021-06-25T04:54:54.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a740b9640 con 0x7f4a74061640 2021-06-25T04:54:54.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740b6b70 con 0x7f4a740b46d0 2021-06-25T04:54:54.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a71d9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a740b46d0 0x7f4a740ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a71d9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a740b46d0 0x7f4a740ba1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:51912/0 (socket says 172.21.15.57:51912) 2021-06-25T04:54:54.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a71d9b700 1 -- 172.21.15.57:0/1483145357 learned_addr learned my addr 172.21.15.57:0/1483145357 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:54.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7259c700 1 --2- 172.21.15.57:0/1483145357 >> v2:172.21.15.87:3300/0 conn(0x7f4a74061640 0x7f4a740b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a71d9b700 1 -- 172.21.15.57:0/1483145357 >> v2:172.21.15.87:3300/0 conn(0x7f4a74061640 msgr2=0x7f4a740b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:54.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a71d9b700 1 --2- 172.21.15.57:0/1483145357 >> v2:172.21.15.87:3300/0 conn(0x7f4a74061640 0x7f4a740b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a71d9b700 1 -- 172.21.15.57:0/1483145357 >> v1:172.21.15.87:6789/0 conn(0x7f4a74143960 legacy=0x7f4a7413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:54.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a71d9b700 1 -- 172.21.15.57:0/1483145357 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740b6e10 con 0x7f4a740b46d0 2021-06-25T04:54:54.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a71d9b700 1 --2- 172.21.15.57:0/1483145357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a740b46d0 0x7f4a740ba1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f4a64002f70 tx=0x7f4a64006eb0).ready entity=mon.2 client_cookie=b67ed60a283406ec server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:54.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7159a700 1 -- 172.21.15.57:0/1483145357 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6400d570 con 0x7f4a740b46d0 2021-06-25T04:54:54.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7159a700 1 -- 172.21.15.57:0/1483145357 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64000e90 con 0x7f4a740b46d0 2021-06-25T04:54:54.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7159a700 1 -- 172.21.15.57:0/1483145357 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6400d900 con 0x7f4a740b46d0 2021-06-25T04:54:54.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7359e700 1 -- 172.21.15.57:0/1483145357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a740b46d0 msgr2=0x7f4a740ba1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:54.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.056+0000 7f4a7359e700 1 --2- 172.21.15.57:0/1483145357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a740b46d0 0x7f4a740ba1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f4a64002f70 tx=0x7f4a64006eb0).stop 2021-06-25T04:54:54.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 -- 172.21.15.57:0/1483145357 shutdown_connections 2021-06-25T04:54:54.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 --2- 172.21.15.57:0/1483145357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a740b46d0 0x7f4a740ba1c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 --2- 172.21.15.57:0/1483145357 >> v2:172.21.15.87:3300/0 conn(0x7f4a74061640 0x7f4a740b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 -- 172.21.15.57:0/1483145357 >> 172.21.15.57:0/1483145357 conn(0x7f4a7406adb0 msgr2=0x7f4a7405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 -- 172.21.15.57:0/1483145357 shutdown_connections 2021-06-25T04:54:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 -- 172.21.15.57:0/1483145357 wait complete. 2021-06-25T04:54:54.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 Processor -- start 2021-06-25T04:54:54.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 -- start start 2021-06-25T04:54:54.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a74061640 0x7f4a74136550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a74143960 0x7f4a74138be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a74137080 0x7f4a74137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74147c90 con 0x7f4a74137080 2021-06-25T04:54:54.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74060170 con 0x7f4a74143960 2021-06-25T04:54:54.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a741375a0 con 0x7f4a74061640 2021-06-25T04:54:54.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a72d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a74137080 0x7f4a74137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a72d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a74137080 0x7f4a74137ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40756/0 (socket says 172.21.15.57:40756) 2021-06-25T04:54:54.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a72d9d700 1 -- 172.21.15.57:0/1631181495 learned_addr learned my addr 172.21.15.57:0/1631181495 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:54.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a7259c700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a74061640 0x7f4a74136550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.060+0000 7f4a71d9b700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a74143960 0x7f4a74138be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a7259c700 1 -- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a74143960 msgr2=0x7f4a74138be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a7259c700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a74143960 0x7f4a74138be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a7259c700 1 -- 172.21.15.57:0/1631181495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a74137080 msgr2=0x7f4a74137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a7259c700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a74137080 0x7f4a74137ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a7259c700 1 -- 172.21.15.57:0/1631181495 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6400b1e0 con 0x7f4a74061640 2021-06-25T04:54:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a71d9b700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a74143960 0x7f4a74138be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a7259c700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a74061640 0x7f4a74136550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f4a5c00c000 tx=0x7f4a5c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a6b7fe700 1 -- 172.21.15.57:0/1631181495 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a5c010780 con 0x7f4a74061640 2021-06-25T04:54:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a6b7fe700 1 -- 172.21.15.57:0/1631181495 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5c0108e0 con 0x7f4a74061640 2021-06-25T04:54:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a7359e700 1 -- 172.21.15.57:0/1631181495 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7413ba70 con 0x7f4a74061640 2021-06-25T04:54:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a6b7fe700 1 -- 172.21.15.57:0/1631181495 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a5c010c40 con 0x7f4a74061640 2021-06-25T04:54:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a7359e700 1 -- 172.21.15.57:0/1631181495 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a741377d0 con 0x7f4a74061640 2021-06-25T04:54:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a7359e700 1 -- 172.21.15.57:0/1631181495 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a74057310 con 0x7f4a74061640 2021-06-25T04:54:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a6b7fe700 1 -- 172.21.15.57:0/1631181495 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4a5c01b400 con 0x7f4a74061640 2021-06-25T04:54:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a6b7fe700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a580554e0 0x7f4a580579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.064+0000 7f4a6b7fe700 1 -- 172.21.15.57:0/1631181495 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f4a5c06dc50 con 0x7f4a74061640 2021-06-25T04:54:54.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.068+0000 7f4a71d9b700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a580554e0 0x7f4a580579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.068+0000 7f4a71d9b700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a580554e0 0x7f4a580579a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f4a6401b000 tx=0x7f4a64015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:54.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.076+0000 7f4a6b7fe700 1 -- 172.21.15.57:0/1631181495 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4a5c044080 con 0x7f4a74061640 2021-06-25T04:54:54.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.240+0000 7f4a7359e700 1 -- 172.21.15.57:0/1631181495 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a740b0ad0 con 0x7f4a74061640 2021-06-25T04:54:54.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.240+0000 7f4a6b7fe700 1 -- 172.21.15.57:0/1631181495 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f4a5c0476a0 con 0x7f4a74061640 2021-06-25T04:54:54.246 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:54.246 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/2314323791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2314323791},{"type":"v1","addr":"172.21.15.87:6835","nonce":2314323791}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":40},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3937527303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3937527303},{"type":"v1","addr":"172.21.15.57:6833","nonce":3937527303}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39},{"gid":6903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6835/4171936113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4171936113},{"type":"v1","addr":"172.21.15.57:6835","nonce":4171936113}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[]} 2021-06-25T04:54:54.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 -- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a580554e0 msgr2=0x7f4a580579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:54.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a580554e0 0x7f4a580579a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f4a6401b000 tx=0x7f4a64015000).stop 2021-06-25T04:54:54.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 -- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a74061640 msgr2=0x7f4a74136550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a74061640 0x7f4a74136550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f4a5c00c000 tx=0x7f4a5c006df0).stop 2021-06-25T04:54:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 -- 172.21.15.57:0/1631181495 shutdown_connections 2021-06-25T04:54:54.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a580554e0 0x7f4a580579a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a74137080 0x7f4a74137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a74143960 0x7f4a74138be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 --2- 172.21.15.57:0/1631181495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a74061640 0x7f4a74136550 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 -- 172.21.15.57:0/1631181495 >> 172.21.15.57:0/1631181495 conn(0x7f4a7406adb0 msgr2=0x7f4a74142e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:54.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 -- 172.21.15.57:0/1631181495 shutdown_connections 2021-06-25T04:54:54.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.244+0000 7f4a7359e700 1 -- 172.21.15.57:0/1631181495 wait complete. 2021-06-25T04:54:54.254 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 44 2021-06-25T04:54:54.264 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:54:54.264 INFO:tasks.ceph.mds.a:Stopping old one... 2021-06-25T04:54:54.265 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:54:54.265 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:54:54.266 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:54:54.266 INFO:tasks.ceph.mds.c:Stopping old one... 2021-06-25T04:54:54.268 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:54:54.268 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:54:54.269 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:54:54.269 INFO:tasks.ceph.mds.b:Stopping old one... 2021-06-25T04:54:54.270 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:54:54.270 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:54:54.275 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:54:54.276 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:54:54.282 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:54:54.283 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:54:54.285 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:54:54.286 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:54:54.289 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:54:54.290 DEBUG:teuthology.parallel:result is None 2021-06-25T04:54:54.328 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:54:54.329 DEBUG:teuthology.parallel:result is None 2021-06-25T04:54:54.331 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:54:54.331 DEBUG:teuthology.parallel:result is None 2021-06-25T04:54:54.332 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:54:54.357 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:54:54.397 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:54:54.401 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:54:54.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29e82f700 1 Processor -- start 2021-06-25T04:54:54.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29e82f700 1 -- start start 2021-06-25T04:54:54.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29e82f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2980b0f50 0x7ff2980b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29e82f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2980b1730 0x7ff29814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29e82f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff2981480b0 0x7ff2981448a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29e82f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980b1330 con 0x7ff2980b1730 2021-06-25T04:54:54.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29e82f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff298147710 con 0x7ff2981480b0 2021-06-25T04:54:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29e82f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980b5c00 con 0x7ff2980b0f50 2021-06-25T04:54:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff2977fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2980b1730 0x7ff29814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff2977fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2980b1730 0x7ff29814acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40786/0 (socket says 172.21.15.57:40786) 2021-06-25T04:54:54.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff2977fe700 1 -- 172.21.15.57:0/1817009124 learned_addr learned my addr 172.21.15.57:0/1817009124 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff297fff700 1 --2- 172.21.15.57:0/1817009124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2980b0f50 0x7ff2980b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29cdcc700 1 --2- 172.21.15.57:0/1817009124 >> v2:172.21.15.87:3300/0 conn(0x7ff2981480b0 0x7ff2981448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff2977fe700 1 -- 172.21.15.57:0/1817009124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2980b0f50 msgr2=0x7ff2980b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff2977fe700 1 --2- 172.21.15.57:0/1817009124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2980b0f50 0x7ff2980b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff2977fe700 1 -- 172.21.15.57:0/1817009124 >> v2:172.21.15.87:3300/0 conn(0x7ff2981480b0 msgr2=0x7ff2981448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff2977fe700 1 --2- 172.21.15.57:0/1817009124 >> v2:172.21.15.87:3300/0 conn(0x7ff2981480b0 0x7ff2981448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff2977fe700 1 -- 172.21.15.57:0/1817009124 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff298147970 con 0x7ff2980b1730 2021-06-25T04:54:54.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29cdcc700 1 --2- 172.21.15.57:0/1817009124 >> v2:172.21.15.87:3300/0 conn(0x7ff2981480b0 0x7ff2981448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:54.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff2977fe700 1 --2- 172.21.15.57:0/1817009124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2980b1730 0x7ff29814acc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7ff28c002f70 tx=0x7ff28c006eb0).ready entity=mon.0 client_cookie=cc92fb655924fe2c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:54.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff296ffd700 1 -- 172.21.15.57:0/1817009124 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff28c00d570 con 0x7ff2980b1730 2021-06-25T04:54:54.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff296ffd700 1 -- 172.21.15.57:0/1817009124 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c000e90 con 0x7ff2980b1730 2021-06-25T04:54:54.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff296ffd700 1 -- 172.21.15.57:0/1817009124 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff28c00d900 con 0x7ff2980b1730 2021-06-25T04:54:54.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29e82f700 1 -- 172.21.15.57:0/1817009124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2980b1730 msgr2=0x7ff29814acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:54.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.432+0000 7ff29e82f700 1 --2- 172.21.15.57:0/1817009124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2980b1730 0x7ff29814acc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7ff28c002f70 tx=0x7ff28c006eb0).stop 2021-06-25T04:54:54.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 -- 172.21.15.57:0/1817009124 shutdown_connections 2021-06-25T04:54:54.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 --2- 172.21.15.57:0/1817009124 >> v2:172.21.15.87:3300/0 conn(0x7ff2981480b0 0x7ff2981448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 --2- 172.21.15.57:0/1817009124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2980b1730 0x7ff29814acc0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 --2- 172.21.15.57:0/1817009124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2980b0f50 0x7ff2980b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 -- 172.21.15.57:0/1817009124 >> 172.21.15.57:0/1817009124 conn(0x7ff298060890 msgr2=0x7ff298060ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:54.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 -- 172.21.15.57:0/1817009124 shutdown_connections 2021-06-25T04:54:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 -- 172.21.15.57:0/1817009124 wait complete. 2021-06-25T04:54:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 Processor -- start 2021-06-25T04:54:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 -- start start 2021-06-25T04:54:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2980b0f50 0x7ff2981564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2980b1730 0x7ff2981569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2981480b0 0x7ff298156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980aa3f0 con 0x7ff2981480b0 2021-06-25T04:54:54.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2981573c0 con 0x7ff2980b0f50 2021-06-25T04:54:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.436+0000 7ff29e82f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29814bae0 con 0x7ff2980b1730 2021-06-25T04:54:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29cdcc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2981480b0 0x7ff298156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff2977fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2980b1730 0x7ff2981569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29cdcc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2981480b0 0x7ff298156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40794/0 (socket says 172.21.15.57:40794) 2021-06-25T04:54:54.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff297fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2980b0f50 0x7ff2981564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29cdcc700 1 -- 172.21.15.57:0/3190615268 learned_addr learned my addr 172.21.15.57:0/3190615268 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29cdcc700 1 -- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2980b1730 msgr2=0x7ff2981569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:54.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29cdcc700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2980b1730 0x7ff2981569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29cdcc700 1 -- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2980b0f50 msgr2=0x7ff2981564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:54.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29cdcc700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2980b0f50 0x7ff2981564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:54.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29cdcc700 1 -- 172.21.15.57:0/3190615268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c00b1e0 con 0x7ff2981480b0 2021-06-25T04:54:54.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff2977fe700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2980b1730 0x7ff2981569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:54.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29cdcc700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2981480b0 0x7ff298156ed0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7ff29000a000 tx=0x7ff290008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:54.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff2957fa700 1 -- 172.21.15.57:0/3190615268 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff290011780 con 0x7ff2981480b0 2021-06-25T04:54:54.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff2957fa700 1 -- 172.21.15.57:0/3190615268 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2900118e0 con 0x7ff2981480b0 2021-06-25T04:54:54.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29e82f700 1 -- 172.21.15.57:0/3190615268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff298149c40 con 0x7ff2981480b0 2021-06-25T04:54:54.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff2957fa700 1 -- 172.21.15.57:0/3190615268 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff290011c40 con 0x7ff2981480b0 2021-06-25T04:54:54.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29e82f700 1 -- 172.21.15.57:0/3190615268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29814a180 con 0x7ff2981480b0 2021-06-25T04:54:54.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff29e82f700 1 -- 172.21.15.57:0/3190615268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29814a380 con 0x7ff2981480b0 2021-06-25T04:54:54.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.440+0000 7ff2957fa700 1 -- 172.21.15.57:0/3190615268 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff29001c460 con 0x7ff2981480b0 2021-06-25T04:54:54.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.444+0000 7ff2957fa700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff278055450 0x7ff278057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:54.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.444+0000 7ff2957fa700 1 -- 172.21.15.57:0/3190615268 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ff29006e3d0 con 0x7ff2981480b0 2021-06-25T04:54:54.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.444+0000 7ff297fff700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff278055450 0x7ff278057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:54.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.444+0000 7ff297fff700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff278055450 0x7ff278057910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7ff28800b000 tx=0x7ff288006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:54.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.448+0000 7ff2957fa700 1 -- 172.21.15.57:0/3190615268 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff29814a380 con 0x7ff2981480b0 2021-06-25T04:54:54.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2021-06-25T04:54:54.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2021-06-25T04:54:54.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:54.588+0000 7ff29e82f700 1 -- 172.21.15.57:0/3190615268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7ff29814a380 con 0x7ff2981480b0 2021-06-25T04:54:55.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.448+0000 7ff2957fa700 1 -- 172.21.15.57:0/3190615268 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v94) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff29814a380 con 0x7ff2981480b0 2021-06-25T04:54:55.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 -- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff278055450 msgr2=0x7ff278057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff278055450 0x7ff278057910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7ff28800b000 tx=0x7ff288006df0).stop 2021-06-25T04:54:55.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 -- 172.21.15.57:0/3190615268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2981480b0 msgr2=0x7ff298156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2981480b0 0x7ff298156ed0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7ff29000a000 tx=0x7ff290008040).stop 2021-06-25T04:54:55.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 -- 172.21.15.57:0/3190615268 shutdown_connections 2021-06-25T04:54:55.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff278055450 0x7ff278057910 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2981480b0 0x7ff298156ed0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2980b1730 0x7ff2981569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 --2- 172.21.15.57:0/3190615268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2980b0f50 0x7ff2981564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 -- 172.21.15.57:0/3190615268 >> 172.21.15.57:0/3190615268 conn(0x7ff298060890 msgr2=0x7ff2980adbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:55.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 -- 172.21.15.57:0/3190615268 shutdown_connections 2021-06-25T04:54:55.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.452+0000 7ff29e82f700 1 -- 172.21.15.57:0/3190615268 wait complete. 2021-06-25T04:54:55.463 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:54:55.473 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:54:55.473 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:54:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e9d2b7700 1 Processor -- start 2021-06-25T04:54:55.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e9d2b7700 1 -- start start 2021-06-25T04:54:55.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e9d2b7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e980670e0 0x7f5e980b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e9d2b7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e980b9b90 con 0x7f5e9813ffb0 2021-06-25T04:54:55.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e9d2b7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e980674c0 con 0x7f5e98143970 2021-06-25T04:54:55.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e9d2b7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e98143040 con 0x7f5e980670e0 2021-06-25T04:54:55.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e96ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e980670e0 0x7f5e980b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e977fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5e9813ffb0 0x7f5e98140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58024/0 (socket says 172.21.15.57:58024) 2021-06-25T04:54:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e977fe700 1 -- 172.21.15.57:0/3110782979 learned_addr learned my addr 172.21.15.57:0/3110782979 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e95ffb700 1 -- 172.21.15.57:0/3110782979 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896687717 0 0) 0x7f5e90001110 con 0x7f5e9813ffb0 2021-06-25T04:54:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e95ffb700 1 -- 172.21.15.57:0/3110782979 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e78003260 con 0x7f5e9813ffb0 2021-06-25T04:54:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e95ffb700 1 -- 172.21.15.57:0/3110782979 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631188002 0 0) 0x7f5e980674c0 con 0x7f5e98143970 2021-06-25T04:54:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e95ffb700 1 -- 172.21.15.57:0/3110782979 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e90001110 con 0x7f5e98143970 2021-06-25T04:54:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e96ffd700 1 -- 172.21.15.57:0/3110782979 >> v1:172.21.15.87:6789/0 conn(0x7f5e98143970 legacy=0x7f5e980aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e96ffd700 1 -- 172.21.15.57:0/3110782979 >> v1:172.21.15.57:6789/0 conn(0x7f5e9813ffb0 legacy=0x7f5e98140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e96ffd700 1 -- 172.21.15.57:0/3110782979 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e980af490 con 0x7f5e980670e0 2021-06-25T04:54:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e96ffd700 1 --2- 172.21.15.57:0/3110782979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e980670e0 0x7f5e980b96a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f5e88002f70 tx=0x7f5e88006df0).ready entity=mon.0 client_cookie=8c7b61893e95a83e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:55.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e95ffb700 1 -- 172.21.15.57:0/3110782979 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e8800d540 con 0x7f5e980670e0 2021-06-25T04:54:55.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e95ffb700 1 -- 172.21.15.57:0/3110782979 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e88000e90 con 0x7f5e980670e0 2021-06-25T04:54:55.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e95ffb700 1 -- 172.21.15.57:0/3110782979 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e8800d890 con 0x7f5e980670e0 2021-06-25T04:54:55.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/3110782979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e980670e0 msgr2=0x7f5e980b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.584+0000 7f5e9d2b7700 1 --2- 172.21.15.57:0/3110782979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e980670e0 0x7f5e980b96a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f5e88002f70 tx=0x7f5e88006df0).stop 2021-06-25T04:54:55.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/3110782979 shutdown_connections 2021-06-25T04:54:55.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 --2- 172.21.15.57:0/3110782979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e980670e0 0x7f5e980b96a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/3110782979 >> 172.21.15.57:0/3110782979 conn(0x7f5e9805f9b0 msgr2=0x7f5e98061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/3110782979 shutdown_connections 2021-06-25T04:54:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/3110782979 wait complete. 2021-06-25T04:54:55.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 Processor -- start 2021-06-25T04:54:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 -- start start 2021-06-25T04:54:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e980670e0 0x7f5e980b7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e9813ffb0 0x7f5e98142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e98143970 0x7f5e980b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98156100 con 0x7f5e9813ffb0 2021-06-25T04:54:55.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98156620 con 0x7f5e980670e0 2021-06-25T04:54:55.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98156380 con 0x7f5e98143970 2021-06-25T04:54:55.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e967fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e9813ffb0 0x7f5e98142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e967fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e9813ffb0 0x7f5e98142480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40810/0 (socket says 172.21.15.57:40810) 2021-06-25T04:54:55.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e967fc700 1 -- 172.21.15.57:0/1814824577 learned_addr learned my addr 172.21.15.57:0/1814824577 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:55.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e96ffd700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e980670e0 0x7f5e980b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e977fe700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e98143970 0x7f5e980b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e967fc700 1 -- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e98143970 msgr2=0x7f5e980b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e967fc700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e98143970 0x7f5e980b7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e967fc700 1 -- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e980670e0 msgr2=0x7f5e980b7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e967fc700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e980670e0 0x7f5e980b7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e967fc700 1 -- 172.21.15.57:0/1814824577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8800b180 con 0x7f5e9813ffb0 2021-06-25T04:54:55.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e96ffd700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e980670e0 0x7f5e980b7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:55.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e967fc700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e9813ffb0 0x7f5e98142480 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f5e98145940 tx=0x7f5e80007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:55.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e8ffff700 1 -- 172.21.15.57:0/1814824577 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e80002310 con 0x7f5e9813ffb0 2021-06-25T04:54:55.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e8ffff700 1 -- 172.21.15.57:0/1814824577 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e80002470 con 0x7f5e9813ffb0 2021-06-25T04:54:55.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/1814824577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e981522f0 con 0x7f5e9813ffb0 2021-06-25T04:54:55.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e8ffff700 1 -- 172.21.15.57:0/1814824577 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e800017a0 con 0x7f5e9813ffb0 2021-06-25T04:54:55.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.588+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/1814824577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e98146180 con 0x7f5e9813ffb0 2021-06-25T04:54:55.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.592+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/1814824577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e98057310 con 0x7f5e9813ffb0 2021-06-25T04:54:55.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.592+0000 7f5e8ffff700 1 -- 172.21.15.57:0/1814824577 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5e80010030 con 0x7f5e9813ffb0 2021-06-25T04:54:55.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.592+0000 7f5e8ffff700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e7c055340 0x7f5e7c057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.592+0000 7f5e8ffff700 1 -- 172.21.15.57:0/1814824577 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f5e8006dc70 con 0x7f5e9813ffb0 2021-06-25T04:54:55.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.592+0000 7f5e96ffd700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e7c055340 0x7f5e7c057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.592+0000 7f5e96ffd700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e7c055340 0x7f5e7c057800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f5e88017000 tx=0x7f5e88014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:55.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.600+0000 7f5e8ffff700 1 -- 172.21.15.57:0/1814824577 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5e800440c0 con 0x7f5e9813ffb0 2021-06-25T04:54:55.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.768+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/1814824577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5e980698a0 con 0x7f5e9813ffb0 2021-06-25T04:54:55.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.768+0000 7f5e8ffff700 1 -- 172.21.15.57:0/1814824577 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f5e800476e0 con 0x7f5e9813ffb0 2021-06-25T04:54:55.773 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:55.774 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:54:55.774 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:54:55.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.774 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:54:55.775 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:54:55.775 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.775 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:54:55.775 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.776 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.776 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.776 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.777 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:54:55.777 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:54:55.777 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.777 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:54:55.778 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.778 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.778 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.778 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.779 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:54:55.779 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:54:55.779 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.780 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:54:55.780 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.780 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.780 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.781 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.781 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:54:55.781 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:54:55.782 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.782 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.782 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.782 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.783 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.783 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:54:55.784 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:54:55.784 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.784 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.784 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.785 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.785 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.786 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:54:55.786 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:54:55.786 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.787 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.787 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.787 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.787 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.788 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:54:55.788 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:54:55.788 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.789 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.789 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.789 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.789 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.790 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:54:55.790 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:54:55.791 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.791 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.791 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.791 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.792 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.793 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:54:55.793 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:54:55.793 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.793 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.794 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.794 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.794 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.795 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:54:55.795 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:54:55.796 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.796 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.796 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.796 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.797 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.797 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:54:55.798 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:54:55.798 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.798 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.798 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.799 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.799 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.800 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:54:55.800 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:54:55.800 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.800 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:54:55.801 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:54:55.801 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:54:55.801 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.802 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:54:55.802 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:54:55.802 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.802 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:54:55.803 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:54:55.803 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:54:55.803 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.804 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:54:55.804 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:54:55.804 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.805 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:54:55.805 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:54:55.805 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:54:55.805 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.805 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.806 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:54:55.806 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:54:55.806 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.807 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:54:55.807 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:54:55.807 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.807 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:55.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:55.808 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:54:55.808 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:54:55.808 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:54:55.809 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:54:55.809 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:54:55.809 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:54:55.809 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:55.810 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:54:55.810 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:54:55.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e7c055340 msgr2=0x7f5e7c057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e7c055340 0x7f5e7c057800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f5e88017000 tx=0x7f5e88014000).stop 2021-06-25T04:54:55.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/1814824577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e9813ffb0 msgr2=0x7f5e98142480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e9813ffb0 0x7f5e98142480 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f5e98145940 tx=0x7f5e80007e10).stop 2021-06-25T04:54:55.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/1814824577 shutdown_connections 2021-06-25T04:54:55.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e7c055340 0x7f5e7c057800 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e98143970 0x7f5e980b7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e9813ffb0 0x7f5e98142480 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 --2- 172.21.15.57:0/1814824577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e980670e0 0x7f5e980b7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/1814824577 >> 172.21.15.57:0/1814824577 conn(0x7f5e9805f9b0 msgr2=0x7f5e9813ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:55.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/1814824577 shutdown_connections 2021-06-25T04:54:55.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.772+0000 7f5e9d2b7700 1 -- 172.21.15.57:0/1814824577 wait complete. 2021-06-25T04:54:55.815 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:54:55.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.916+0000 7f0e68ce7700 1 Processor -- start 2021-06-25T04:54:55.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 -- start start 2021-06-25T04:54:55.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0e640a7670 0x7f0e64066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e640b1930 0x7f0e64066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e640b0020 0x7f0e6405f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e64067410 con 0x7f0e640b1930 2021-06-25T04:54:55.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e640a7a50 con 0x7f0e640a7670 2021-06-25T04:54:55.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e641475e0 con 0x7f0e640b0020 2021-06-25T04:54:55.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e61d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e640b1930 0x7f0e64066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e61d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e640b1930 0x7f0e64066f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40816/0 (socket says 172.21.15.57:40816) 2021-06-25T04:54:55.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e61d9b700 1 -- 172.21.15.57:0/3233488444 learned_addr learned my addr 172.21.15.57:0/3233488444 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:55.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e62d9d700 1 --2- 172.21.15.57:0/3233488444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e640b0020 0x7f0e6405f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e6259c700 1 --2- 172.21.15.57:0/3233488444 >> v2:172.21.15.87:3300/0 conn(0x7f0e640a7670 0x7f0e64066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e61d9b700 1 -- 172.21.15.57:0/3233488444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e640b0020 msgr2=0x7f0e6405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:55.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e61d9b700 1 --2- 172.21.15.57:0/3233488444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e640b0020 0x7f0e6405f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e61d9b700 1 -- 172.21.15.57:0/3233488444 >> v2:172.21.15.87:3300/0 conn(0x7f0e640a7670 msgr2=0x7f0e64066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:55.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e61d9b700 1 --2- 172.21.15.57:0/3233488444 >> v2:172.21.15.87:3300/0 conn(0x7f0e640a7670 0x7f0e64066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e61d9b700 1 -- 172.21.15.57:0/3233488444 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e64147880 con 0x7f0e640b1930 2021-06-25T04:54:55.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e61d9b700 1 --2- 172.21.15.57:0/3233488444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640b1930 0x7f0e64066f20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f0e540032f0 tx=0x7f0e54009290).ready entity=mon.0 client_cookie=68b09a0921e0d53b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:55.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e6159a700 1 -- 172.21.15.57:0/3233488444 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e5400b870 con 0x7f0e640b1930 2021-06-25T04:54:55.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e6159a700 1 -- 172.21.15.57:0/3233488444 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5400b9d0 con 0x7f0e640b1930 2021-06-25T04:54:55.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e6159a700 1 -- 172.21.15.57:0/3233488444 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e5400bb40 con 0x7f0e640b1930 2021-06-25T04:54:55.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 -- 172.21.15.57:0/3233488444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640b1930 msgr2=0x7f0e64066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 --2- 172.21.15.57:0/3233488444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640b1930 0x7f0e64066f20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f0e540032f0 tx=0x7f0e54009290).stop 2021-06-25T04:54:55.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 -- 172.21.15.57:0/3233488444 shutdown_connections 2021-06-25T04:54:55.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 --2- 172.21.15.57:0/3233488444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e640b0020 0x7f0e6405f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 --2- 172.21.15.57:0/3233488444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640b1930 0x7f0e64066f20 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 --2- 172.21.15.57:0/3233488444 >> v2:172.21.15.87:3300/0 conn(0x7f0e640a7670 0x7f0e64066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 -- 172.21.15.57:0/3233488444 >> 172.21.15.57:0/3233488444 conn(0x7f0e640b53a0 msgr2=0x7f0e640b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:55.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 -- 172.21.15.57:0/3233488444 shutdown_connections 2021-06-25T04:54:55.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.920+0000 7f0e68ce7700 1 -- 172.21.15.57:0/3233488444 wait complete. 2021-06-25T04:54:55.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.924+0000 7f0e68ce7700 1 Processor -- start 2021-06-25T04:54:55.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.924+0000 7f0e68ce7700 1 -- start start 2021-06-25T04:54:55.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.924+0000 7f0e68ce7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e640a7670 0x7f0e640a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.924+0000 7f0e68ce7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e640b0020 0x7f0e6405fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.924+0000 7f0e68ce7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640b1930 0x7f0e640aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.924+0000 7f0e68ce7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640acf10 con 0x7f0e640b1930 2021-06-25T04:54:55.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.924+0000 7f0e68ce7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640ad8e0 con 0x7f0e640b0020 2021-06-25T04:54:55.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.924+0000 7f0e68ce7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640ad140 con 0x7f0e640a7670 2021-06-25T04:54:55.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e62d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640b1930 0x7f0e640aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e62d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640b1930 0x7f0e640aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40826/0 (socket says 172.21.15.57:40826) 2021-06-25T04:54:55.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e62d9d700 1 -- 172.21.15.57:0/2643290623 learned_addr learned my addr 172.21.15.57:0/2643290623 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:55.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e6259c700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e640a7670 0x7f0e640a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e61d9b700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e640b0020 0x7f0e6405fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e62d9d700 1 -- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e640a7670 msgr2=0x7f0e640a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e62d9d700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e640a7670 0x7f0e640a91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e62d9d700 1 -- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e640b0020 msgr2=0x7f0e6405fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:55.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e62d9d700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e640b0020 0x7f0e6405fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:55.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e62d9d700 1 -- 172.21.15.57:0/2643290623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e54009530 con 0x7f0e640b1930 2021-06-25T04:54:55.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e6259c700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e640a7670 0x7f0e640a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:55.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e61d9b700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e640b0020 0x7f0e6405fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:55.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e62d9d700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640b1930 0x7f0e640aaa80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f0e5c00a000 tx=0x7f0e5c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:55.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e5b7fe700 1 -- 172.21.15.57:0/2643290623 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e5c011780 con 0x7f0e640b1930 2021-06-25T04:54:55.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e5b7fe700 1 -- 172.21.15.57:0/2643290623 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c0118e0 con 0x7f0e640b1930 2021-06-25T04:54:55.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e68ce7700 1 -- 172.21.15.57:0/2643290623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e640ac200 con 0x7f0e640b1930 2021-06-25T04:54:55.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e5b7fe700 1 -- 172.21.15.57:0/2643290623 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e5c011c40 con 0x7f0e640b1930 2021-06-25T04:54:55.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e68ce7700 1 -- 172.21.15.57:0/2643290623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e640af470 con 0x7f0e640b1930 2021-06-25T04:54:55.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e68ce7700 1 -- 172.21.15.57:0/2643290623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e640ad4c0 con 0x7f0e640b1930 2021-06-25T04:54:55.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e5b7fe700 1 -- 172.21.15.57:0/2643290623 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0e5c01c460 con 0x7f0e640b1930 2021-06-25T04:54:55.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e5b7fe700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e48055490 0x7f0e48057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:55.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e5b7fe700 1 -- 172.21.15.57:0/2643290623 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f0e5c06df20 con 0x7f0e640b1930 2021-06-25T04:54:55.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.928+0000 7f0e6259c700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e48055490 0x7f0e48057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:55.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.932+0000 7f0e6259c700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e48055490 0x7f0e48057950 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f0e4c00c000 tx=0x7f0e4c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:55.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:55.932+0000 7f0e5b7fe700 1 -- 172.21.15.57:0/2643290623 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0e5c0442a0 con 0x7f0e640b1930 2021-06-25T04:54:56.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.060+0000 7f0e68ce7700 1 -- 172.21.15.57:0/2643290623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e64057310 con 0x7f0e640b1930 2021-06-25T04:54:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e5b7fe700 1 -- 172.21.15.57:0/2643290623 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f0e5c0478c0 con 0x7f0e640b1930 2021-06-25T04:54:56.068 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:56.068 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":94,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:55.431973+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:54:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 -- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e48055490 msgr2=0x7f0e48057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e48055490 0x7f0e48057950 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f0e4c00c000 tx=0x7f0e4c008040).stop 2021-06-25T04:54:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 -- 172.21.15.57:0/2643290623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640b1930 msgr2=0x7f0e640aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640b1930 0x7f0e640aaa80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f0e5c00a000 tx=0x7f0e5c008040).stop 2021-06-25T04:54:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 -- 172.21.15.57:0/2643290623 shutdown_connections 2021-06-25T04:54:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0e48055490 0x7f0e48057950 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640b1930 0x7f0e640aaa80 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e640b0020 0x7f0e6405fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 --2- 172.21.15.57:0/2643290623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e640a7670 0x7f0e640a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 -- 172.21.15.57:0/2643290623 >> 172.21.15.57:0/2643290623 conn(0x7f0e640b53a0 msgr2=0x7f0e64145860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:56.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 -- 172.21.15.57:0/2643290623 shutdown_connections 2021-06-25T04:54:56.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.064+0000 7f0e68ce7700 1 -- 172.21.15.57:0/2643290623 wait complete. 2021-06-25T04:54:56.082 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:54:56.083 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:54:56.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.184+0000 7fa3919b2700 1 Processor -- start 2021-06-25T04:54:56.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.184+0000 7fa3919b2700 1 -- start start 2021-06-25T04:54:56.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa38c0a9590 0x7fa38c0a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa38c0b2bc0 0x7fa38c0b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c139b80 con 0x7fa38c0aca10 2021-06-25T04:54:56.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c1404c0 con 0x7fa38c0a9590 2021-06-25T04:54:56.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0b00f0 con 0x7fa38c0b2bc0 2021-06-25T04:54:56.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa38affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa38c0a9590 0x7fa38c0a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa38affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa38c0a9590 0x7fa38c0a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40832/0 (socket says 172.21.15.57:40832) 2021-06-25T04:54:56.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa38affd700 1 -- 172.21.15.57:0/3103262008 learned_addr learned my addr 172.21.15.57:0/3103262008 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:56.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa38b7fe700 1 --2- 172.21.15.57:0/3103262008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa38c0b2bc0 0x7fa38c0b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa389ffb700 1 -- 172.21.15.57:0/3103262008 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275866210 0 0) 0x7fa38c139b80 con 0x7fa38c0aca10 2021-06-25T04:54:56.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa38affd700 1 -- 172.21.15.57:0/3103262008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa38c0b2bc0 msgr2=0x7fa38c0b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:56.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa38affd700 1 --2- 172.21.15.57:0/3103262008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa38c0b2bc0 0x7fa38c0b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa38affd700 1 -- 172.21.15.57:0/3103262008 >> v1:172.21.15.87:6789/0 conn(0x7fa38c0aca10 legacy=0x7fa38c0a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa38affd700 1 -- 172.21.15.57:0/3103262008 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c0b0390 con 0x7fa38c0a9590 2021-06-25T04:54:56.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa38affd700 1 --2- 172.21.15.57:0/3103262008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa38c0a9590 0x7fa38c0a9970 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fa380002f70 tx=0x7fa380006eb0).ready entity=mon.0 client_cookie=dd5f6a50d0ffa1fa server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:56.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa389ffb700 1 -- 172.21.15.57:0/3103262008 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa38000d570 con 0x7fa38c0a9590 2021-06-25T04:54:56.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa389ffb700 1 -- 172.21.15.57:0/3103262008 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa380000e90 con 0x7fa38c0a9590 2021-06-25T04:54:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa389ffb700 1 -- 172.21.15.57:0/3103262008 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa38000d8c0 con 0x7fa38c0a9590 2021-06-25T04:54:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 -- 172.21.15.57:0/3103262008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa38c0a9590 msgr2=0x7fa38c0a9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 --2- 172.21.15.57:0/3103262008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa38c0a9590 0x7fa38c0a9970 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fa380002f70 tx=0x7fa380006eb0).stop 2021-06-25T04:54:56.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 -- 172.21.15.57:0/3103262008 shutdown_connections 2021-06-25T04:54:56.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 --2- 172.21.15.57:0/3103262008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa38c0b2bc0 0x7fa38c0b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 --2- 172.21.15.57:0/3103262008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa38c0a9590 0x7fa38c0a9970 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 -- 172.21.15.57:0/3103262008 >> 172.21.15.57:0/3103262008 conn(0x7fa38c05f670 msgr2=0x7fa38c05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:56.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 -- 172.21.15.57:0/3103262008 shutdown_connections 2021-06-25T04:54:56.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.188+0000 7fa3919b2700 1 -- 172.21.15.57:0/3103262008 wait complete. 2021-06-25T04:54:56.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa3919b2700 1 Processor -- start 2021-06-25T04:54:56.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa3919b2700 1 -- start start 2021-06-25T04:54:56.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa3919b2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa38c0a9590 0x7fa38c0adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa3919b2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa38c0aca10 0x7fa38c066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa3919b2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa38c0b2bc0 0x7fa38c13c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa3919b2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0ad4e0 con 0x7fa38c0aca10 2021-06-25T04:54:56.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa3919b2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0ad780 con 0x7fa38c0b2bc0 2021-06-25T04:54:56.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa3919b2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0ada20 con 0x7fa38c0a9590 2021-06-25T04:54:56.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa38c0aca10 0x7fa38c066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa38c0aca10 0x7fa38c066ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40836/0 (socket says 172.21.15.57:40836) 2021-06-25T04:54:56.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38a7fc700 1 -- 172.21.15.57:0/2942051024 learned_addr learned my addr 172.21.15.57:0/2942051024 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38b7fe700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa38c0b2bc0 0x7fa38c13c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38affd700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa38c0a9590 0x7fa38c0adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38a7fc700 1 -- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa38c0a9590 msgr2=0x7fa38c0adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38a7fc700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa38c0a9590 0x7fa38c0adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38a7fc700 1 -- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa38c0b2bc0 msgr2=0x7fa38c13c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38a7fc700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa38c0b2bc0 0x7fa38c13c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38a7fc700 1 -- 172.21.15.57:0/2942051024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38000b1e0 con 0x7fa38c0aca10 2021-06-25T04:54:56.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38b7fe700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa38c0b2bc0 0x7fa38c13c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:56.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38affd700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa38c0a9590 0x7fa38c0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:54:56.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa38a7fc700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa38c0aca10 0x7fa38c066ed0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fa37c000f40 tx=0x7fa37c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:56.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa37bfff700 1 -- 172.21.15.57:0/2942051024 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa37c00e4a0 con 0x7fa38c0aca10 2021-06-25T04:54:56.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa37bfff700 1 -- 172.21.15.57:0/2942051024 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c00e600 con 0x7fa38c0aca10 2021-06-25T04:54:56.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa3919b2700 1 -- 172.21.15.57:0/2942051024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c13c4d0 con 0x7fa38c0aca10 2021-06-25T04:54:56.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa37bfff700 1 -- 172.21.15.57:0/2942051024 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa37c00e9a0 con 0x7fa38c0aca10 2021-06-25T04:54:56.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.192+0000 7fa3919b2700 1 -- 172.21.15.57:0/2942051024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c13ce80 con 0x7fa38c0aca10 2021-06-25T04:54:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.196+0000 7fa3919b2700 1 -- 172.21.15.57:0/2942051024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c057310 con 0x7fa38c0aca10 2021-06-25T04:54:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.196+0000 7fa37bfff700 1 -- 172.21.15.57:0/2942051024 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa37c019030 con 0x7fa38c0aca10 2021-06-25T04:54:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.196+0000 7fa37bfff700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa368055510 0x7fa3680579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.196+0000 7fa37bfff700 1 -- 172.21.15.57:0/2942051024 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa37c06d3c0 con 0x7fa38c0aca10 2021-06-25T04:54:56.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.196+0000 7fa38affd700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa368055510 0x7fa3680579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.196+0000 7fa38affd700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa368055510 0x7fa3680579d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fa380016000 tx=0x7fa380015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:56.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.200+0000 7fa37bfff700 1 -- 172.21.15.57:0/2942051024 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa37c042c50 con 0x7fa38c0aca10 2021-06-25T04:54:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.332+0000 7fa3919b2700 1 -- 172.21.15.57:0/2942051024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa38c143af0 con 0x7fa38c0aca10 2021-06-25T04:54:56.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.332+0000 7fa37bfff700 1 -- 172.21.15.57:0/2942051024 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v94) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa37c043850 con 0x7fa38c0aca10 2021-06-25T04:54:56.337 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:54:56.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 -- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa368055510 msgr2=0x7fa3680579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa368055510 0x7fa3680579d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fa380016000 tx=0x7fa380015000).stop 2021-06-25T04:54:56.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 -- 172.21.15.57:0/2942051024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa38c0aca10 msgr2=0x7fa38c066ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa38c0aca10 0x7fa38c066ed0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fa37c000f40 tx=0x7fa37c007dc0).stop 2021-06-25T04:54:56.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 -- 172.21.15.57:0/2942051024 shutdown_connections 2021-06-25T04:54:56.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa368055510 0x7fa3680579d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa38c0b2bc0 0x7fa38c13c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa38c0aca10 0x7fa38c066ed0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 --2- 172.21.15.57:0/2942051024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa38c0a9590 0x7fa38c0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 -- 172.21.15.57:0/2942051024 >> 172.21.15.57:0/2942051024 conn(0x7fa38c05f670 msgr2=0x7fa38c0a8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 -- 172.21.15.57:0/2942051024 shutdown_connections 2021-06-25T04:54:56.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.336+0000 7fa3919b2700 1 -- 172.21.15.57:0/2942051024 wait complete. 2021-06-25T04:54:56.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:54:56.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.452+0000 7fec65a5a700 1 Processor -- start 2021-06-25T04:54:56.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.452+0000 7fec65a5a700 1 -- start start 2021-06-25T04:54:56.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec60146910 0x7fec601401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fec600b4140 0x7fec601406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec600b4650 0x7fec600b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec601474d0 con 0x7fec600b4650 2021-06-25T04:54:56.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec60143b20 con 0x7fec600b4140 2021-06-25T04:54:56.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60143dc0 con 0x7fec60146910 2021-06-25T04:54:56.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec600b4650 0x7fec600b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec600b4650 0x7fec600b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40846/0 (socket says 172.21.15.57:40846) 2021-06-25T04:54:56.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5f7fe700 1 -- 172.21.15.57:0/3255478515 learned_addr learned my addr 172.21.15.57:0/3255478515 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:56.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5e7fc700 1 --2- 172.21.15.57:0/3255478515 >> v2:172.21.15.87:3300/0 conn(0x7fec600b4140 0x7fec601406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5effd700 1 --2- 172.21.15.57:0/3255478515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec60146910 0x7fec601401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5f7fe700 1 -- 172.21.15.57:0/3255478515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec60146910 msgr2=0x7fec601401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:56.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5f7fe700 1 --2- 172.21.15.57:0/3255478515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec60146910 0x7fec601401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5f7fe700 1 -- 172.21.15.57:0/3255478515 >> v2:172.21.15.87:3300/0 conn(0x7fec600b4140 msgr2=0x7fec601406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:56.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5f7fe700 1 --2- 172.21.15.57:0/3255478515 >> v2:172.21.15.87:3300/0 conn(0x7fec600b4140 0x7fec601406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5f7fe700 1 -- 172.21.15.57:0/3255478515 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec600b0c50 con 0x7fec600b4650 2021-06-25T04:54:56.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5f7fe700 1 --2- 172.21.15.57:0/3255478515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec600b4650 0x7fec600b4e90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fec580032f0 tx=0x7fec58009290).ready entity=mon.0 client_cookie=ee5f693a3a70df69 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:56.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5dffb700 1 -- 172.21.15.57:0/3255478515 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5800b680 con 0x7fec600b4650 2021-06-25T04:54:56.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5dffb700 1 -- 172.21.15.57:0/3255478515 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5800b7e0 con 0x7fec600b4650 2021-06-25T04:54:56.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec5dffb700 1 -- 172.21.15.57:0/3255478515 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5800b950 con 0x7fec600b4650 2021-06-25T04:54:56.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 -- 172.21.15.57:0/3255478515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec600b4650 msgr2=0x7fec600b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 --2- 172.21.15.57:0/3255478515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec600b4650 0x7fec600b4e90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fec580032f0 tx=0x7fec58009290).stop 2021-06-25T04:54:56.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 -- 172.21.15.57:0/3255478515 shutdown_connections 2021-06-25T04:54:56.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 --2- 172.21.15.57:0/3255478515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec600b4650 0x7fec600b4e90 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 --2- 172.21.15.57:0/3255478515 >> v2:172.21.15.87:3300/0 conn(0x7fec600b4140 0x7fec601406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 --2- 172.21.15.57:0/3255478515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec60146910 0x7fec601401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 -- 172.21.15.57:0/3255478515 >> 172.21.15.57:0/3255478515 conn(0x7fec6005c450 msgr2=0x7fec6005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:56.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 -- 172.21.15.57:0/3255478515 shutdown_connections 2021-06-25T04:54:56.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.456+0000 7fec65a5a700 1 -- 172.21.15.57:0/3255478515 wait complete. 2021-06-25T04:54:56.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec65a5a700 1 Processor -- start 2021-06-25T04:54:56.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec65a5a700 1 -- start start 2021-06-25T04:54:56.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec65a5a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec600b4140 0x7fec60143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec65a5a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600b4650 0x7fec600b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec65a5a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec60146910 0x7fec600b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec65a5a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600b8070 con 0x7fec60146910 2021-06-25T04:54:56.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec65a5a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec60141d80 con 0x7fec600b4140 2021-06-25T04:54:56.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec65a5a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec601561f0 con 0x7fec600b4650 2021-06-25T04:54:56.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec5f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec60146910 0x7fec600b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec5f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec60146910 0x7fec600b7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40854/0 (socket says 172.21.15.57:40854) 2021-06-25T04:54:56.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec5f7fe700 1 -- 172.21.15.57:0/2935492682 learned_addr learned my addr 172.21.15.57:0/2935492682 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:56.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec5effd700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec600b4140 0x7fec60143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec5e7fc700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600b4650 0x7fec600b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec5f7fe700 1 -- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600b4650 msgr2=0x7fec600b7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec5f7fe700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600b4650 0x7fec600b7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec5f7fe700 1 -- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec600b4140 msgr2=0x7fec60143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec5f7fe700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec600b4140 0x7fec60143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec5f7fe700 1 -- 172.21.15.57:0/2935492682 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58009530 con 0x7fec60146910 2021-06-25T04:54:56.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec5f7fe700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec60146910 0x7fec600b7b80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fec580032f0 tx=0x7fec58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:56.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec4ffff700 1 -- 172.21.15.57:0/2935492682 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec58011bf0 con 0x7fec60146910 2021-06-25T04:54:56.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec65a5a700 1 -- 172.21.15.57:0/2935492682 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec60156490 con 0x7fec60146910 2021-06-25T04:54:56.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec4ffff700 1 -- 172.21.15.57:0/2935492682 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec58011d50 con 0x7fec60146910 2021-06-25T04:54:56.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec4ffff700 1 -- 172.21.15.57:0/2935492682 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5801b630 con 0x7fec60146910 2021-06-25T04:54:56.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.460+0000 7fec65a5a700 1 -- 172.21.15.57:0/2935492682 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec601411c0 con 0x7fec60146910 2021-06-25T04:54:56.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.464+0000 7fec65a5a700 1 -- 172.21.15.57:0/2935492682 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec60141ef0 con 0x7fec60146910 2021-06-25T04:54:56.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.464+0000 7fec4ffff700 1 -- 172.21.15.57:0/2935492682 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fec5800f070 con 0x7fec60146910 2021-06-25T04:54:56.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.464+0000 7fec4ffff700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fec3c055490 0x7fec3c057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.464+0000 7fec4ffff700 1 -- 172.21.15.57:0/2935492682 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fec5806e770 con 0x7fec60146910 2021-06-25T04:54:56.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.464+0000 7fec5effd700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fec3c055490 0x7fec3c057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.464+0000 7fec5effd700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fec3c055490 0x7fec3c057950 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fec5400b000 tx=0x7fec54006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:56.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.472+0000 7fec4ffff700 1 -- 172.21.15.57:0/2935492682 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fec60141ef0 con 0x7fec60146910 2021-06-25T04:54:56.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.600+0000 7fec65a5a700 1 -- 172.21.15.57:0/2935492682 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec60141ef0 con 0x7fec60146910 2021-06-25T04:54:56.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.600+0000 7fec4ffff700 1 -- 172.21.15.57:0/2935492682 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec60141ef0 con 0x7fec60146910 2021-06-25T04:54:56.606 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:54:56.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 -- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fec3c055490 msgr2=0x7fec3c057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fec3c055490 0x7fec3c057950 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fec5400b000 tx=0x7fec54006df0).stop 2021-06-25T04:54:56.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 -- 172.21.15.57:0/2935492682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec60146910 msgr2=0x7fec600b7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec60146910 0x7fec600b7b80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fec580032f0 tx=0x7fec58017000).stop 2021-06-25T04:54:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 -- 172.21.15.57:0/2935492682 shutdown_connections 2021-06-25T04:54:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fec3c055490 0x7fec3c057950 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec60146910 0x7fec600b7b80 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600b4650 0x7fec600b7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 --2- 172.21.15.57:0/2935492682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec600b4140 0x7fec60143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 -- 172.21.15.57:0/2935492682 >> 172.21.15.57:0/2935492682 conn(0x7fec6005c450 msgr2=0x7fec600ba060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:56.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 -- 172.21.15.57:0/2935492682 shutdown_connections 2021-06-25T04:54:56.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.604+0000 7fec65a5a700 1 -- 172.21.15.57:0/2935492682 wait complete. 2021-06-25T04:54:56.620 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:54:56.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.716+0000 7fe069a30700 1 Processor -- start 2021-06-25T04:54:56.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.716+0000 7fe069a30700 1 -- start start 2021-06-25T04:54:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.716+0000 7fe069a30700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe0640acee0 0x7fe0640ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.716+0000 7fe069a30700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0640b2bf0 con 0x7fe06413c6a0 2021-06-25T04:54:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.716+0000 7fe069a30700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0640b1620 con 0x7fe0640b2810 2021-06-25T04:54:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.716+0000 7fe069a30700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0640b1170 con 0x7fe0640acee0 2021-06-25T04:54:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.716+0000 7fe06922f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe0640acee0 0x7fe0640ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe06922f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe0640acee0 0x7fe0640ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40862/0 (socket says 172.21.15.57:40862) 2021-06-25T04:54:56.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe063fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe06413c6a0 0x7fe06413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58078/0 (socket says 172.21.15.57:58078) 2021-06-25T04:54:56.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe06922f700 1 -- 172.21.15.57:0/141199151 learned_addr learned my addr 172.21.15.57:0/141199151 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:56.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe06922f700 1 -- 172.21.15.57:0/141199151 >> v1:172.21.15.87:6789/0 conn(0x7fe0640b2810 legacy=0x7fe0640b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe0637fe700 1 -- 172.21.15.57:0/141199151 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348412230 0 0) 0x7fe0640b2bf0 con 0x7fe06413c6a0 2021-06-25T04:54:56.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe06922f700 1 -- 172.21.15.57:0/141199151 >> v1:172.21.15.57:6789/0 conn(0x7fe06413c6a0 legacy=0x7fe06413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe06922f700 1 -- 172.21.15.57:0/141199151 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640b18c0 con 0x7fe0640acee0 2021-06-25T04:54:56.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe06922f700 1 --2- 172.21.15.57:0/141199151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0640acee0 0x7fe0640ad300 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fe058001110 tx=0x7fe05c00b530).ready entity=mon.0 client_cookie=442c4b10df3870cb server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:56.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe0637fe700 1 -- 172.21.15.57:0/141199151 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe05c00dd60 con 0x7fe0640acee0 2021-06-25T04:54:56.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe0637fe700 1 -- 172.21.15.57:0/141199151 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c010470 con 0x7fe0640acee0 2021-06-25T04:54:56.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe0637fe700 1 -- 172.21.15.57:0/141199151 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe05c0107d0 con 0x7fe0640acee0 2021-06-25T04:54:56.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe069a30700 1 -- 172.21.15.57:0/141199151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0640acee0 msgr2=0x7fe0640ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe069a30700 1 --2- 172.21.15.57:0/141199151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0640acee0 0x7fe0640ad300 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fe058001110 tx=0x7fe05c00b530).stop 2021-06-25T04:54:56.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe069a30700 1 -- 172.21.15.57:0/141199151 shutdown_connections 2021-06-25T04:54:56.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe069a30700 1 --2- 172.21.15.57:0/141199151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0640acee0 0x7fe0640ad300 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe069a30700 1 -- 172.21.15.57:0/141199151 >> 172.21.15.57:0/141199151 conn(0x7fe0640611f0 msgr2=0x7fe064062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe069a30700 1 -- 172.21.15.57:0/141199151 shutdown_connections 2021-06-25T04:54:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.720+0000 7fe069a30700 1 -- 172.21.15.57:0/141199151 wait complete. 2021-06-25T04:54:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe069a30700 1 Processor -- start 2021-06-25T04:54:56.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe069a30700 1 -- start start 2021-06-25T04:54:56.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe069a30700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0640acee0 0x7fe06413b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe069a30700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0640b2810 0x7fe0640b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe069a30700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe06413c6a0 0x7fe064134b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe069a30700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0641369b0 con 0x7fe0640b2810 2021-06-25T04:54:56.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe069a30700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe064137470 con 0x7fe06413c6a0 2021-06-25T04:54:56.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe069a30700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe064137710 con 0x7fe0640acee0 2021-06-25T04:54:56.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe063fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0640b2810 0x7fe0640b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe063fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0640b2810 0x7fe0640b4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40866/0 (socket says 172.21.15.57:40866) 2021-06-25T04:54:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe063fff700 1 -- 172.21.15.57:0/348216543 learned_addr learned my addr 172.21.15.57:0/348216543 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe06922f700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe06413c6a0 0x7fe064134b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe068a2e700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0640acee0 0x7fe06413b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe063fff700 1 -- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0640acee0 msgr2=0x7fe06413b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe063fff700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0640acee0 0x7fe06413b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe063fff700 1 -- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe06413c6a0 msgr2=0x7fe064134b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe063fff700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe06413c6a0 0x7fe064134b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe063fff700 1 -- 172.21.15.57:0/348216543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c00b7d0 con 0x7fe0640b2810 2021-06-25T04:54:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe063fff700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0640b2810 0x7fe0640b4730 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7fe054000bc0 tx=0x7fe054007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe061ffb700 1 -- 172.21.15.57:0/348216543 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe05400ce80 con 0x7fe0640b2810 2021-06-25T04:54:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe061ffb700 1 -- 172.21.15.57:0/348216543 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe054007170 con 0x7fe0640b2810 2021-06-25T04:54:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe069a30700 1 -- 172.21.15.57:0/348216543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe064138c10 con 0x7fe0640b2810 2021-06-25T04:54:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe061ffb700 1 -- 172.21.15.57:0/348216543 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe054004520 con 0x7fe0640b2810 2021-06-25T04:54:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe069a30700 1 -- 172.21.15.57:0/348216543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0640b3e20 con 0x7fe0640b2810 2021-06-25T04:54:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.724+0000 7fe069a30700 1 -- 172.21.15.57:0/348216543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe064057310 con 0x7fe0640b2810 2021-06-25T04:54:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.728+0000 7fe061ffb700 1 -- 172.21.15.57:0/348216543 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe054004680 con 0x7fe0640b2810 2021-06-25T04:54:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.728+0000 7fe061ffb700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0440553d0 0x7fe044057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.728+0000 7fe068a2e700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0440553d0 0x7fe044057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:56.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.728+0000 7fe061ffb700 1 -- 172.21.15.57:0/348216543 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fe0540475e0 con 0x7fe0640b2810 2021-06-25T04:54:56.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.728+0000 7fe068a2e700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0440553d0 0x7fe044057890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fe05800b000 tx=0x7fe058009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:56.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.740+0000 7fe061ffb700 1 -- 172.21.15.57:0/348216543 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe054043980 con 0x7fe0640b2810 2021-06-25T04:54:56.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.864+0000 7fe069a30700 1 -- 172.21.15.57:0/348216543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe06405f200 con 0x7fe0640b2810 2021-06-25T04:54:56.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.868+0000 7fe061ffb700 1 -- 172.21.15.57:0/348216543 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe054046fa0 con 0x7fe0640b2810 2021-06-25T04:54:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:56.873 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:54:56.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:54:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:54:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:54:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:54:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:54:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:54:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:54:56.877 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:54:56.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.868+0000 7fe069a30700 1 -- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0440553d0 msgr2=0x7fe044057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.868+0000 7fe069a30700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0440553d0 0x7fe044057890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fe05800b000 tx=0x7fe058009040).stop 2021-06-25T04:54:56.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.868+0000 7fe069a30700 1 -- 172.21.15.57:0/348216543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0640b2810 msgr2=0x7fe0640b4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:56.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.868+0000 7fe069a30700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0640b2810 0x7fe0640b4730 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7fe054000bc0 tx=0x7fe054007c00).stop 2021-06-25T04:54:56.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.872+0000 7fe069a30700 1 -- 172.21.15.57:0/348216543 shutdown_connections 2021-06-25T04:54:56.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.872+0000 7fe069a30700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe0440553d0 0x7fe044057890 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.872+0000 7fe069a30700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe06413c6a0 0x7fe064134b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.872+0000 7fe069a30700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0640b2810 0x7fe0640b4730 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.872+0000 7fe069a30700 1 --2- 172.21.15.57:0/348216543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0640acee0 0x7fe06413b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:56.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.872+0000 7fe069a30700 1 -- 172.21.15.57:0/348216543 >> 172.21.15.57:0/348216543 conn(0x7fe0640611f0 msgr2=0x7fe0640aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:56.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.872+0000 7fe069a30700 1 -- 172.21.15.57:0/348216543 shutdown_connections 2021-06-25T04:54:56.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.872+0000 7fe069a30700 1 -- 172.21.15.57:0/348216543 wait complete. 2021-06-25T04:54:56.892 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:54:56.892 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:54:57.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.996+0000 7f1625774700 1 Processor -- start 2021-06-25T04:54:57.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.996+0000 7f1625774700 1 -- start start 2021-06-25T04:54:57.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.996+0000 7f1625774700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f16200ad580 0x7f16200616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:57.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.996+0000 7f1625774700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1620140400 0x7f16201408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:57.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:56.996+0000 7f1625774700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16200aecb0 con 0x7f16200612e0 2021-06-25T04:54:57.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1625774700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16200b6ee0 con 0x7f16200ad580 2021-06-25T04:54:57.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1625774700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16200aeee0 con 0x7f1620140400 2021-06-25T04:54:57.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f161f7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f16200ad580 0x7f16200616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:57.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1624f73700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1620140400 0x7f16201408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:57.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f161f7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f16200ad580 0x7f16200616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:49368/0 (socket says 172.21.15.57:49368) 2021-06-25T04:54:57.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f161f7fe700 1 -- 172.21.15.57:0/173384946 learned_addr learned my addr 172.21.15.57:0/173384946 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:57.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f161ffff700 1 --1- 172.21.15.57:0/173384946 >> v1:172.21.15.87:6789/0 conn(0x7f16200612e0 0x7f16200b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:58838/0 (socket says 172.21.15.57:58838) 2021-06-25T04:54:57.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1624f73700 1 -- 172.21.15.57:0/173384946 >> v2:172.21.15.87:3300/0 conn(0x7f16200ad580 msgr2=0x7f16200616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:57.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1624f73700 1 --2- 172.21.15.57:0/173384946 >> v2:172.21.15.87:3300/0 conn(0x7f16200ad580 0x7f16200616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1624f73700 1 -- 172.21.15.57:0/173384946 >> v1:172.21.15.87:6789/0 conn(0x7f16200612e0 legacy=0x7f16200b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:57.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1624f73700 1 -- 172.21.15.57:0/173384946 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200af180 con 0x7f1620140400 2021-06-25T04:54:57.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f161f7fe700 1 --2- 172.21.15.57:0/173384946 >> v2:172.21.15.87:3300/0 conn(0x7f16200ad580 0x7f16200616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:57.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1624f73700 1 --2- 172.21.15.57:0/173384946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1620140400 0x7f16201408b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f16180032f0 tx=0x7f16180091d0).ready entity=mon.2 client_cookie=bfe8253c442b8b07 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:57.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f161effd700 1 -- 172.21.15.57:0/173384946 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f161800b6c0 con 0x7f1620140400 2021-06-25T04:54:57.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f161effd700 1 -- 172.21.15.57:0/173384946 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161800b820 con 0x7f1620140400 2021-06-25T04:54:57.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f161effd700 1 -- 172.21.15.57:0/173384946 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f161800b990 con 0x7f1620140400 2021-06-25T04:54:57.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1625774700 1 -- 172.21.15.57:0/173384946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1620140400 msgr2=0x7f16201408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:57.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1625774700 1 --2- 172.21.15.57:0/173384946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1620140400 0x7f16201408b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f16180032f0 tx=0x7f16180091d0).stop 2021-06-25T04:54:57.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1625774700 1 -- 172.21.15.57:0/173384946 shutdown_connections 2021-06-25T04:54:57.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1625774700 1 --2- 172.21.15.57:0/173384946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1620140400 0x7f16201408b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1625774700 1 --2- 172.21.15.57:0/173384946 >> v2:172.21.15.87:3300/0 conn(0x7f16200ad580 0x7f16200616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1625774700 1 -- 172.21.15.57:0/173384946 >> 172.21.15.57:0/173384946 conn(0x7f1620066da0 msgr2=0x7f1620067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:57.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1625774700 1 -- 172.21.15.57:0/173384946 shutdown_connections 2021-06-25T04:54:57.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.000+0000 7f1625774700 1 -- 172.21.15.57:0/173384946 wait complete. 2021-06-25T04:54:57.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1625774700 1 Processor -- start 2021-06-25T04:54:57.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1625774700 1 -- start start 2021-06-25T04:54:57.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1625774700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16200612e0 0x7f162014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:57.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1625774700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16200ad580 0x7f1620143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:57.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1625774700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1620140400 0x7f1620144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:57.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1625774700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200abf00 con 0x7f1620140400 2021-06-25T04:54:57.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1625774700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16201521d0 con 0x7f16200612e0 2021-06-25T04:54:57.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1625774700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1620152470 con 0x7f16200ad580 2021-06-25T04:54:57.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1624f73700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1620140400 0x7f1620144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:57.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1624f73700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1620140400 0x7f1620144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40882/0 (socket says 172.21.15.57:40882) 2021-06-25T04:54:57.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f161f7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16200ad580 0x7f1620143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:57.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f161ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16200612e0 0x7f162014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:57.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1624f73700 1 -- 172.21.15.57:0/875365722 learned_addr learned my addr 172.21.15.57:0/875365722 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:57.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1624f73700 1 -- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16200ad580 msgr2=0x7f1620143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:57.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1624f73700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16200ad580 0x7f1620143da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1624f73700 1 -- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16200612e0 msgr2=0x7f162014a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:57.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1624f73700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16200612e0 0x7f162014a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1624f73700 1 -- 172.21.15.57:0/875365722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161000b1e0 con 0x7f1620140400 2021-06-25T04:54:57.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1624f73700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1620140400 0x7f1620144290 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f16180032f0 tx=0x7f1618016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:57.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f161d7fa700 1 -- 172.21.15.57:0/875365722 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1618011e20 con 0x7f1620140400 2021-06-25T04:54:57.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f161d7fa700 1 -- 172.21.15.57:0/875365722 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161800b030 con 0x7f1620140400 2021-06-25T04:54:57.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f1625774700 1 -- 172.21.15.57:0/875365722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1618009470 con 0x7f1620140400 2021-06-25T04:54:57.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.004+0000 7f161d7fa700 1 -- 172.21.15.57:0/875365722 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1618021670 con 0x7f1620140400 2021-06-25T04:54:57.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.008+0000 7f1625774700 1 -- 172.21.15.57:0/875365722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16201529b0 con 0x7f1620140400 2021-06-25T04:54:57.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.008+0000 7f161d7fa700 1 -- 172.21.15.57:0/875365722 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1618028070 con 0x7f1620140400 2021-06-25T04:54:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.008+0000 7f1625774700 1 -- 172.21.15.57:0/875365722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1620057310 con 0x7f1620140400 2021-06-25T04:54:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.008+0000 7f161d7fa700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 0x7f1600057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.008+0000 7f161d7fa700 1 -- 172.21.15.57:0/875365722 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f161806ea30 con 0x7f1620140400 2021-06-25T04:54:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.008+0000 7f161ffff700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 0x7f1600057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.008+0000 7f161ffff700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 0x7f1600057800 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f161400d000 tx=0x7f1614007b80).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:57.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.016+0000 7f161d7fa700 1 -- 172.21.15.57:0/875365722 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1618044e80 con 0x7f1620140400 2021-06-25T04:54:57.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.140+0000 7f1625774700 1 -- 172.21.15.57:0/875365722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f16200a9d70 con 0x7f1620140400 2021-06-25T04:54:57.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.752+0000 7f161d7fa700 1 -- 172.21.15.57:0/875365722 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v95) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1618015020 con 0x7f1620140400 2021-06-25T04:54:57.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 -- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 msgr2=0x7f1600057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:57.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 0x7f1600057800 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f161400d000 tx=0x7f1614007b80).stop 2021-06-25T04:54:57.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 -- 172.21.15.57:0/875365722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1620140400 msgr2=0x7f1620144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:57.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1620140400 0x7f1620144290 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f16180032f0 tx=0x7f1618016000).stop 2021-06-25T04:54:57.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 -- 172.21.15.57:0/875365722 shutdown_connections 2021-06-25T04:54:57.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1600055340 0x7f1600057800 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1620140400 0x7f1620144290 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16200ad580 0x7f1620143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 --2- 172.21.15.57:0/875365722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16200612e0 0x7f162014a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 -- 172.21.15.57:0/875365722 >> 172.21.15.57:0/875365722 conn(0x7f1620066da0 msgr2=0x7f162005cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:57.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 -- 172.21.15.57:0/875365722 shutdown_connections 2021-06-25T04:54:57.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.756+0000 7f1625774700 1 -- 172.21.15.57:0/875365722 wait complete. 2021-06-25T04:54:57.765 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:54:57.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:54:57.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.888+0000 7fb5ad3e0700 1 Processor -- start 2021-06-25T04:54:57.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.888+0000 7fb5ad3e0700 1 -- start start 2021-06-25T04:54:57.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.888+0000 7fb5ad3e0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb5a80b4020 0x7fb5a8061b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:57.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.888+0000 7fb5ad3e0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a80b5f10 con 0x7fb5a8142e20 2021-06-25T04:54:57.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.888+0000 7fb5ad3e0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a80b1f30 con 0x7fb5a80b6250 2021-06-25T04:54:57.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.888+0000 7fb5ad3e0700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a80b21d0 con 0x7fb5a80b4020 2021-06-25T04:54:57.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.888+0000 7fb5acbdf700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb5a8142e20 0x7fb5a81432b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58108/0 (socket says 172.21.15.57:58108) 2021-06-25T04:54:57.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.888+0000 7fb5acbdf700 1 -- 172.21.15.57:0/3044156801 learned_addr learned my addr 172.21.15.57:0/3044156801 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:57.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.888+0000 7fb5a77fe700 1 --2- 172.21.15.57:0/3044156801 >> v2:172.21.15.87:3300/0 conn(0x7fb5a80b4020 0x7fb5a8061b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:57.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5a6ffd700 1 -- 172.21.15.57:0/3044156801 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385787616 0 0) 0x7fb5a0001490 con 0x7fb5a8142e20 2021-06-25T04:54:57.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5a6ffd700 1 -- 172.21.15.57:0/3044156801 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb594003260 con 0x7fb5a8142e20 2021-06-25T04:54:57.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5a6ffd700 1 -- 172.21.15.57:0/3044156801 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261183306 0 0) 0x7fb5a80b1f30 con 0x7fb5a80b6250 2021-06-25T04:54:57.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5a6ffd700 1 -- 172.21.15.57:0/3044156801 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5a0001490 con 0x7fb5a80b6250 2021-06-25T04:54:57.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5a77fe700 1 -- 172.21.15.57:0/3044156801 >> v1:172.21.15.87:6789/0 conn(0x7fb5a80b6250 legacy=0x7fb5a8061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:57.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5a77fe700 1 -- 172.21.15.57:0/3044156801 >> v1:172.21.15.57:6789/0 conn(0x7fb5a8142e20 legacy=0x7fb5a81432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:57.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5a77fe700 1 -- 172.21.15.57:0/3044156801 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a80b2470 con 0x7fb5a80b4020 2021-06-25T04:54:57.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5a77fe700 1 --2- 172.21.15.57:0/3044156801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a80b4020 0x7fb5a8061b40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fb59c002f70 tx=0x7fb59c006df0).ready entity=mon.1 client_cookie=fe26ca15d0a38331 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:57.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5a6ffd700 1 -- 172.21.15.57:0/3044156801 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c00d540 con 0x7fb5a80b4020 2021-06-25T04:54:57.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5a6ffd700 1 -- 172.21.15.57:0/3044156801 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c000e90 con 0x7fb5a80b4020 2021-06-25T04:54:57.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5a6ffd700 1 -- 172.21.15.57:0/3044156801 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c00d890 con 0x7fb5a80b4020 2021-06-25T04:54:57.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/3044156801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a80b4020 msgr2=0x7fb5a8061b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:57.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5ad3e0700 1 --2- 172.21.15.57:0/3044156801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a80b4020 0x7fb5a8061b40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fb59c002f70 tx=0x7fb59c006df0).stop 2021-06-25T04:54:57.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/3044156801 shutdown_connections 2021-06-25T04:54:57.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5ad3e0700 1 --2- 172.21.15.57:0/3044156801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a80b4020 0x7fb5a8061b40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/3044156801 >> 172.21.15.57:0/3044156801 conn(0x7fb5a805c450 msgr2=0x7fb5a805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:57.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/3044156801 shutdown_connections 2021-06-25T04:54:57.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.892+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/3044156801 wait complete. 2021-06-25T04:54:57.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5ad3e0700 1 Processor -- start 2021-06-25T04:54:57.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5ad3e0700 1 -- start start 2021-06-25T04:54:57.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5ad3e0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a80b4020 0x7fb5a813fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:57.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5ad3e0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80b6250 0x7fb5a8156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:57.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5ad3e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5a8142e20 0x7fb5a81447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:57.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5ad3e0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a8145a90 con 0x7fb5a8142e20 2021-06-25T04:54:57.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5ad3e0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a8144630 con 0x7fb5a80b4020 2021-06-25T04:54:57.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5ad3e0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a8155840 con 0x7fb5a80b6250 2021-06-25T04:54:57.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5acbdf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5a8142e20 0x7fb5a81447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:57.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5a7fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a80b4020 0x7fb5a813fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:57.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5a77fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80b6250 0x7fb5a8156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:57.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5acbdf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5a8142e20 0x7fb5a81447e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40896/0 (socket says 172.21.15.57:40896) 2021-06-25T04:54:57.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.896+0000 7fb5acbdf700 1 -- 172.21.15.57:0/1832516818 learned_addr learned my addr 172.21.15.57:0/1832516818 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:57.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5a77fe700 1 -- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a80b4020 msgr2=0x7fb5a813fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:57.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5a77fe700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a80b4020 0x7fb5a813fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5a77fe700 1 -- 172.21.15.57:0/1832516818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5a8142e20 msgr2=0x7fb5a81447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:57.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5a77fe700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5a8142e20 0x7fb5a81447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:57.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5a77fe700 1 -- 172.21.15.57:0/1832516818 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c00b180 con 0x7fb5a80b6250 2021-06-25T04:54:57.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5acbdf700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5a8142e20 0x7fb5a81447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:54:57.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5a77fe700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80b6250 0x7fb5a8156220 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb5a81465a0 tx=0x7fb59c014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:57.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5a57fa700 1 -- 172.21.15.57:0/1832516818 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c006b20 con 0x7fb5a80b6250 2021-06-25T04:54:57.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5a57fa700 1 -- 172.21.15.57:0/1832516818 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c00d1c0 con 0x7fb5a80b6250 2021-06-25T04:54:57.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/1832516818 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a8155ae0 con 0x7fb5a80b6250 2021-06-25T04:54:57.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5a57fa700 1 -- 172.21.15.57:0/1832516818 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c01f440 con 0x7fb5a80b6250 2021-06-25T04:54:57.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/1832516818 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a813ef90 con 0x7fb5a80b6250 2021-06-25T04:54:57.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/1832516818 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a8057310 con 0x7fb5a80b6250 2021-06-25T04:54:57.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5a57fa700 1 -- 172.21.15.57:0/1832516818 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb59c025020 con 0x7fb5a80b6250 2021-06-25T04:54:57.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.900+0000 7fb5a57fa700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb588055340 0x7fb588057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:57.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.904+0000 7fb5a57fa700 1 -- 172.21.15.57:0/1832516818 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5954+0+0 (secure 0 0 0) 0x7fb59c06ebd0 con 0x7fb5a80b6250 2021-06-25T04:54:57.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.904+0000 7fb5a7fff700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb588055340 0x7fb588057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:57.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.904+0000 7fb5a7fff700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb588055340 0x7fb588057800 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fb59800d000 tx=0x7fb598007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:57.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:57.912+0000 7fb5a57fa700 1 -- 172.21.15.57:0/1832516818 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb59c044dc0 con 0x7fb5a80b6250 2021-06-25T04:54:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.036+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/1832516818 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fb5a806afd0 con 0x7fb5a80b6250 2021-06-25T04:54:58.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.416+0000 7fb5a57fa700 1 -- 172.21.15.57:0/1832516818 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v96) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb59c0483e0 con 0x7fb5a80b6250 2021-06-25T04:54:58.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb588055340 msgr2=0x7fb588057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb588055340 0x7fb588057800 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fb59800d000 tx=0x7fb598007a20).stop 2021-06-25T04:54:58.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80b6250 msgr2=0x7fb5a8156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80b6250 0x7fb5a8156220 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb5a81465a0 tx=0x7fb59c014000).stop 2021-06-25T04:54:58.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/1832516818 shutdown_connections 2021-06-25T04:54:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb588055340 0x7fb588057800 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5a8142e20 0x7fb5a81447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80b6250 0x7fb5a8156220 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 --2- 172.21.15.57:0/1832516818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a80b4020 0x7fb5a813fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/1832516818 >> 172.21.15.57:0/1832516818 conn(0x7fb5a805c450 msgr2=0x7fb5a8061f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:58.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/1832516818 shutdown_connections 2021-06-25T04:54:58.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.424+0000 7fb5ad3e0700 1 -- 172.21.15.57:0/1832516818 wait complete. 2021-06-25T04:54:58.431 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:54:58.441 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:54:58.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 Processor -- start 2021-06-25T04:54:58.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 -- start start 2021-06-25T04:54:58.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8fdc061640 0x7f8fdc0b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8fdc0b46d0 0x7f8fdc0ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fdc0b68d0 con 0x7f8fdc143960 2021-06-25T04:54:58.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc0b9640 con 0x7f8fdc061640 2021-06-25T04:54:58.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc0b6b70 con 0x7f8fdc0b46d0 2021-06-25T04:54:58.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8fdc061640 0x7f8fdc0b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe0a74700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8fdc143960 0x7f8fdc13fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58122/0 (socket says 172.21.15.57:58122) 2021-06-25T04:54:58.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8fdc061640 0x7f8fdc0b9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40900/0 (socket says 172.21.15.57:40900) 2021-06-25T04:54:58.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe0a74700 1 -- 172.21.15.57:0/1822568236 learned_addr learned my addr 172.21.15.57:0/1822568236 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:58.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdb7fe700 1 --2- 172.21.15.57:0/1822568236 >> v2:172.21.15.87:3300/0 conn(0x7f8fdc0b46d0 0x7f8fdc0ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdbfff700 1 -- 172.21.15.57:0/1822568236 >> v2:172.21.15.87:3300/0 conn(0x7f8fdc0b46d0 msgr2=0x7f8fdc0ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:58.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdbfff700 1 --2- 172.21.15.57:0/1822568236 >> v2:172.21.15.87:3300/0 conn(0x7f8fdc0b46d0 0x7f8fdc0ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdaffd700 1 -- 172.21.15.57:0/1822568236 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525953562 0 0) 0x7f8fdc0b68d0 con 0x7f8fdc143960 2021-06-25T04:54:58.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdbfff700 1 -- 172.21.15.57:0/1822568236 >> v1:172.21.15.57:6789/0 conn(0x7f8fdc143960 legacy=0x7f8fdc13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdbfff700 1 -- 172.21.15.57:0/1822568236 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc0b6e10 con 0x7f8fdc061640 2021-06-25T04:54:58.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdbfff700 1 --2- 172.21.15.57:0/1822568236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc061640 0x7f8fdc0b9cd0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f8fc4002f70 tx=0x7f8fc4006df0).ready entity=mon.0 client_cookie=b404c35d795c175f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:58.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdaffd700 1 -- 172.21.15.57:0/1822568236 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fc400d570 con 0x7f8fdc061640 2021-06-25T04:54:58.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdaffd700 1 -- 172.21.15.57:0/1822568236 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc4000e90 con 0x7f8fdc061640 2021-06-25T04:54:58.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fdaffd700 1 -- 172.21.15.57:0/1822568236 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fc400d8c0 con 0x7f8fdc061640 2021-06-25T04:54:58.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 -- 172.21.15.57:0/1822568236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc061640 msgr2=0x7f8fdc0b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 --2- 172.21.15.57:0/1822568236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc061640 0x7f8fdc0b9cd0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f8fc4002f70 tx=0x7f8fc4006df0).stop 2021-06-25T04:54:58.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 -- 172.21.15.57:0/1822568236 shutdown_connections 2021-06-25T04:54:58.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 --2- 172.21.15.57:0/1822568236 >> v2:172.21.15.87:3300/0 conn(0x7f8fdc0b46d0 0x7f8fdc0ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 --2- 172.21.15.57:0/1822568236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc061640 0x7f8fdc0b9cd0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 -- 172.21.15.57:0/1822568236 >> 172.21.15.57:0/1822568236 conn(0x7f8fdc06adb0 msgr2=0x7f8fdc05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:58.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.544+0000 7f8fe1275700 1 -- 172.21.15.57:0/1822568236 shutdown_connections 2021-06-25T04:54:58.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fe1275700 1 -- 172.21.15.57:0/1822568236 wait complete. 2021-06-25T04:54:58.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fe1275700 1 Processor -- start 2021-06-25T04:54:58.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fe1275700 1 -- start start 2021-06-25T04:54:58.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fe1275700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fdc061640 0x7f8fdc1444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fe1275700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc143960 0x7f8fdc0b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fe1275700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fdc0b77e0 0x7f8fdc13e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fe1275700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc0b34e0 con 0x7f8fdc143960 2021-06-25T04:54:58.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fe1275700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc13d180 con 0x7f8fdc0b77e0 2021-06-25T04:54:58.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fe1275700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc061a20 con 0x7f8fdc061640 2021-06-25T04:54:58.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fdb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc143960 0x7f8fdc0b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fdb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc143960 0x7f8fdc0b72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40908/0 (socket says 172.21.15.57:40908) 2021-06-25T04:54:58.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fdb7fe700 1 -- 172.21.15.57:0/1399260462 learned_addr learned my addr 172.21.15.57:0/1399260462 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:58.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fdbfff700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fdc061640 0x7f8fdc1444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fe0a74700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fdc0b77e0 0x7f8fdc13e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fdb7fe700 1 -- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fdc061640 msgr2=0x7f8fdc1444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fdb7fe700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fdc061640 0x7f8fdc1444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fdb7fe700 1 -- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fdc0b77e0 msgr2=0x7f8fdc13e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fdb7fe700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fdc0b77e0 0x7f8fdc13e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.548+0000 7f8fdb7fe700 1 -- 172.21.15.57:0/1399260462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc400b180 con 0x7f8fdc143960 2021-06-25T04:54:58.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.552+0000 7f8fdb7fe700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc143960 0x7f8fdc0b72f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f8fcc00c000 tx=0x7f8fcc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:58.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.552+0000 7f8fd97fa700 1 -- 172.21.15.57:0/1399260462 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fcc010780 con 0x7f8fdc143960 2021-06-25T04:54:58.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.552+0000 7f8fd97fa700 1 -- 172.21.15.57:0/1399260462 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0108e0 con 0x7f8fdc143960 2021-06-25T04:54:58.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.552+0000 7f8fe1275700 1 -- 172.21.15.57:0/1399260462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc0b7c90 con 0x7f8fdc143960 2021-06-25T04:54:58.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.552+0000 7f8fd97fa700 1 -- 172.21.15.57:0/1399260462 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fcc010c40 con 0x7f8fdc143960 2021-06-25T04:54:58.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.552+0000 7f8fe1275700 1 -- 172.21.15.57:0/1399260462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc13d370 con 0x7f8fdc143960 2021-06-25T04:54:58.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.552+0000 7f8fe1275700 1 -- 172.21.15.57:0/1399260462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc13d530 con 0x7f8fdc143960 2021-06-25T04:54:58.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.552+0000 7f8fd97fa700 1 -- 172.21.15.57:0/1399260462 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8fcc0123f0 con 0x7f8fdc143960 2021-06-25T04:54:58.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.552+0000 7f8fd97fa700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fc0055490 0x7f8fc0057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.556+0000 7f8fd97fa700 1 -- 172.21.15.57:0/1399260462 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f8fcc06ef80 con 0x7f8fdc143960 2021-06-25T04:54:58.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.556+0000 7f8fdbfff700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fc0055490 0x7f8fc0057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.556+0000 7f8fdbfff700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fc0055490 0x7f8fc0057950 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f8fc4019000 tx=0x7f8fc4014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:58.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.560+0000 7f8fd97fa700 1 -- 172.21.15.57:0/1399260462 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8fcc045150 con 0x7f8fdc143960 2021-06-25T04:54:58.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.724+0000 7f8fe1275700 1 -- 172.21.15.57:0/1399260462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f8fdc057310 con 0x7f8fdc143960 2021-06-25T04:54:58.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.740+0000 7f8fd97fa700 1 -- 172.21.15.57:0/1399260462 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v46) v1 ==== 189+0+0 (secure 0 0 0) 0x7f8fcc048770 con 0x7f8fdc143960 2021-06-25T04:54:58.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 -- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fc0055490 msgr2=0x7f8fc0057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fc0055490 0x7f8fc0057950 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f8fc4019000 tx=0x7f8fc4014000).stop 2021-06-25T04:54:58.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 -- 172.21.15.57:0/1399260462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc143960 msgr2=0x7f8fdc0b72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc143960 0x7f8fdc0b72f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f8fcc00c000 tx=0x7f8fcc006df0).stop 2021-06-25T04:54:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 -- 172.21.15.57:0/1399260462 shutdown_connections 2021-06-25T04:54:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8fc0055490 0x7f8fc0057950 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fdc0b77e0 0x7f8fdc13e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fdc143960 0x7f8fdc0b72f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 --2- 172.21.15.57:0/1399260462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fdc061640 0x7f8fdc1444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 -- 172.21.15.57:0/1399260462 >> 172.21.15.57:0/1399260462 conn(0x7f8fdc06adb0 msgr2=0x7f8fdc0b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:58.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 -- 172.21.15.57:0/1399260462 shutdown_connections 2021-06-25T04:54:58.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.748+0000 7f8fe1275700 1 -- 172.21.15.57:0/1399260462 wait complete. 2021-06-25T04:54:58.754 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 17 and data pool 18 2021-06-25T04:54:58.766 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:54:58.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.852+0000 7f06cfbe6700 1 Processor -- start 2021-06-25T04:54:58.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.852+0000 7f06cfbe6700 1 -- start start 2021-06-25T04:54:58.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f06c80b1800 0x7f06c8142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f06c80b0e30 0x7f06c8142d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c80b35e0 con 0x7f06c80b3200 2021-06-25T04:54:58.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c81436b0 con 0x7f06c80b0e30 2021-06-25T04:54:58.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c8065c60 con 0x7f06c80b1800 2021-06-25T04:54:58.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cd982700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f06c80b3200 0x7f06c8066640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58140/0 (socket says 172.21.15.57:58140) 2021-06-25T04:54:58.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cd982700 1 -- 172.21.15.57:0/1028652394 learned_addr learned my addr 172.21.15.57:0/1028652394 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:58.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06ce183700 1 --2- 172.21.15.57:0/1028652394 >> v2:172.21.15.57:3300/0 conn(0x7f06c80b0e30 0x7f06c8142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cd181700 1 --2- 172.21.15.57:0/1028652394 >> v2:172.21.15.87:3300/0 conn(0x7f06c80b1800 0x7f06c8142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cc980700 1 -- 172.21.15.57:0/1028652394 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017100350 0 0) 0x7f06c80b35e0 con 0x7f06c80b3200 2021-06-25T04:54:58.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06ce183700 1 -- 172.21.15.57:0/1028652394 >> v2:172.21.15.87:3300/0 conn(0x7f06c80b1800 msgr2=0x7f06c8142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:58.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06ce183700 1 --2- 172.21.15.57:0/1028652394 >> v2:172.21.15.87:3300/0 conn(0x7f06c80b1800 0x7f06c8142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06ce183700 1 -- 172.21.15.57:0/1028652394 >> v1:172.21.15.57:6789/0 conn(0x7f06c80b3200 legacy=0x7f06c8066640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06ce183700 1 -- 172.21.15.57:0/1028652394 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c8065f00 con 0x7f06c80b0e30 2021-06-25T04:54:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06ce183700 1 --2- 172.21.15.57:0/1028652394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c80b0e30 0x7f06c8142d40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f06c00032f0 tx=0x7f06c00091d0).ready entity=mon.0 client_cookie=4a1337abbf0c2ca7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cc980700 1 -- 172.21.15.57:0/1028652394 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06c0009ea0 con 0x7f06c80b0e30 2021-06-25T04:54:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cc980700 1 -- 172.21.15.57:0/1028652394 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c000b870 con 0x7f06c80b0e30 2021-06-25T04:54:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cc980700 1 -- 172.21.15.57:0/1028652394 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06c000b9e0 con 0x7f06c80b0e30 2021-06-25T04:54:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 -- 172.21.15.57:0/1028652394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c80b0e30 msgr2=0x7f06c8142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 --2- 172.21.15.57:0/1028652394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c80b0e30 0x7f06c8142d40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f06c00032f0 tx=0x7f06c00091d0).stop 2021-06-25T04:54:58.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 -- 172.21.15.57:0/1028652394 shutdown_connections 2021-06-25T04:54:58.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 --2- 172.21.15.57:0/1028652394 >> v2:172.21.15.87:3300/0 conn(0x7f06c80b1800 0x7f06c8142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 --2- 172.21.15.57:0/1028652394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c80b0e30 0x7f06c8142d40 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 -- 172.21.15.57:0/1028652394 >> 172.21.15.57:0/1028652394 conn(0x7f06c805c450 msgr2=0x7f06c805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:58.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 -- 172.21.15.57:0/1028652394 shutdown_connections 2021-06-25T04:54:58.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.856+0000 7f06cfbe6700 1 -- 172.21.15.57:0/1028652394 wait complete. 2021-06-25T04:54:58.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cfbe6700 1 Processor -- start 2021-06-25T04:54:58.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cfbe6700 1 -- start start 2021-06-25T04:54:58.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cfbe6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06c80b0e30 0x7f06c805f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cfbe6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c80b1800 0x7f06c813f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cfbe6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c80b3200 0x7f06c813fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cfbe6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80ad3c0 con 0x7f06c80b1800 2021-06-25T04:54:58.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cfbe6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8140200 con 0x7f06c80b3200 2021-06-25T04:54:58.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cfbe6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80ac4f0 con 0x7f06c80b0e30 2021-06-25T04:54:58.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cd181700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c80b1800 0x7f06c813f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cd181700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c80b1800 0x7f06c813f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40930/0 (socket says 172.21.15.57:40930) 2021-06-25T04:54:58.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cd181700 1 -- 172.21.15.57:0/2231254937 learned_addr learned my addr 172.21.15.57:0/2231254937 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:58.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cd982700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06c80b0e30 0x7f06c805f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06ce183700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c80b3200 0x7f06c813fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cd181700 1 -- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06c80b0e30 msgr2=0x7f06c805f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cd181700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06c80b0e30 0x7f06c805f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cd181700 1 -- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c80b3200 msgr2=0x7f06c813fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:58.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cd181700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c80b3200 0x7f06c813fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:58.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cd181700 1 -- 172.21.15.57:0/2231254937 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0009470 con 0x7f06c80b1800 2021-06-25T04:54:58.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cd982700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06c80b0e30 0x7f06c805f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:54:58.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cd181700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c80b1800 0x7f06c813f820 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f06b800a000 tx=0x7f06b8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:58.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06b6ffd700 1 -- 172.21.15.57:0/2231254937 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06b8011780 con 0x7f06c80b1800 2021-06-25T04:54:58.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06b6ffd700 1 -- 172.21.15.57:0/2231254937 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b80118e0 con 0x7f06c80b1800 2021-06-25T04:54:58.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cfbe6700 1 -- 172.21.15.57:0/2231254937 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c80ac790 con 0x7f06c80b1800 2021-06-25T04:54:58.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06b6ffd700 1 -- 172.21.15.57:0/2231254937 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06b8011c40 con 0x7f06c80b1800 2021-06-25T04:54:58.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.860+0000 7f06cfbe6700 1 -- 172.21.15.57:0/2231254937 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c80accd0 con 0x7f06c80b1800 2021-06-25T04:54:58.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.864+0000 7f06cfbe6700 1 -- 172.21.15.57:0/2231254937 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c80ace90 con 0x7f06c80b1800 2021-06-25T04:54:58.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.864+0000 7f06b6ffd700 1 -- 172.21.15.57:0/2231254937 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f06b8012420 con 0x7f06c80b1800 2021-06-25T04:54:58.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.864+0000 7f06b6ffd700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f06a8055490 0x7f06a8057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:58.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.864+0000 7f06b6ffd700 1 -- 172.21.15.57:0/2231254937 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f06b806dd00 con 0x7f06c80b1800 2021-06-25T04:54:58.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.864+0000 7f06cd982700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f06a8055490 0x7f06a8057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:58.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.864+0000 7f06cd982700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f06a8055490 0x7f06a8057950 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f06c400b000 tx=0x7f06c4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:58.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:58.872+0000 7f06b6ffd700 1 -- 172.21.15.57:0/2231254937 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f06b8071030 con 0x7f06c80b1800 2021-06-25T04:54:59.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.000+0000 7f06cfbe6700 1 -- 172.21.15.57:0/2231254937 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06c80a9f90 con 0x7f06c80b1800 2021-06-25T04:54:59.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06b6ffd700 1 -- 172.21.15.57:0/2231254937 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f06b8043db0 con 0x7f06c80b1800 2021-06-25T04:54:59.007 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:59.007 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":97,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:58.729987+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:54:57.196707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-06-25T04:54:58.096573+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:54:59.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 -- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f06a8055490 msgr2=0x7f06a8057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f06a8055490 0x7f06a8057950 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f06c400b000 tx=0x7f06c4009040).stop 2021-06-25T04:54:59.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 -- 172.21.15.57:0/2231254937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c80b1800 msgr2=0x7f06c813f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c80b1800 0x7f06c813f820 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f06b800a000 tx=0x7f06b8008040).stop 2021-06-25T04:54:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 -- 172.21.15.57:0/2231254937 shutdown_connections 2021-06-25T04:54:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f06a8055490 0x7f06a8057950 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c80b3200 0x7f06c813fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06c80b1800 0x7f06c813f820 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 --2- 172.21.15.57:0/2231254937 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06c80b0e30 0x7f06c805f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 -- 172.21.15.57:0/2231254937 >> 172.21.15.57:0/2231254937 conn(0x7f06c805c450 msgr2=0x7f06c81412f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 -- 172.21.15.57:0/2231254937 shutdown_connections 2021-06-25T04:54:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.004+0000 7f06cfbe6700 1 -- 172.21.15.57:0/2231254937 wait complete. 2021-06-25T04:54:59.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:54:59.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.124+0000 7f52f3fff700 1 Processor -- start 2021-06-25T04:54:59.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.124+0000 7f52f3fff700 1 -- start start 2021-06-25T04:54:59.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.124+0000 7f52f3fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f52f40b05d0 0x7f52f40af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.124+0000 7f52f3fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f4147560 0x7f52f40acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.124+0000 7f52f3fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f40b5840 con 0x7f52f40b5460 2021-06-25T04:54:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.124+0000 7f52f3fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f41452a0 con 0x7f52f40b05d0 2021-06-25T04:54:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.124+0000 7f52f3fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40adfb0 con 0x7f52f4147560 2021-06-25T04:54:59.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.124+0000 7f52f37fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f4147560 0x7f52f40acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.124+0000 7f52f37fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f4147560 0x7f52f40acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:52104/0 (socket says 172.21.15.57:52104) 2021-06-25T04:54:59.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.124+0000 7f52f37fe700 1 -- 172.21.15.57:0/2534090178 learned_addr learned my addr 172.21.15.57:0/2534090178 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:59.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.124+0000 7f52f27fc700 1 --2- 172.21.15.57:0/2534090178 >> v2:172.21.15.87:3300/0 conn(0x7f52f40b05d0 0x7f52f40af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f37fe700 1 -- 172.21.15.57:0/2534090178 >> v2:172.21.15.87:3300/0 conn(0x7f52f40b05d0 msgr2=0x7f52f40af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f37fe700 1 --2- 172.21.15.57:0/2534090178 >> v2:172.21.15.87:3300/0 conn(0x7f52f40b05d0 0x7f52f40af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f37fe700 1 -- 172.21.15.57:0/2534090178 >> v1:172.21.15.87:6789/0 conn(0x7f52f40b5460 legacy=0x7f52f4067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f37fe700 1 -- 172.21.15.57:0/2534090178 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40ac7c0 con 0x7f52f4147560 2021-06-25T04:54:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f37fe700 1 --2- 172.21.15.57:0/2534090178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f4147560 0x7f52f40acc20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f52ec0032f0 tx=0x7f52ec009290).ready entity=mon.2 client_cookie=780ca8092da93fe server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:59.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f1ffb700 1 -- 172.21.15.57:0/2534090178 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52ec00b870 con 0x7f52f4147560 2021-06-25T04:54:59.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f1ffb700 1 -- 172.21.15.57:0/2534090178 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00b9d0 con 0x7f52f4147560 2021-06-25T04:54:59.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f1ffb700 1 -- 172.21.15.57:0/2534090178 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52ec00bb80 con 0x7f52f4147560 2021-06-25T04:54:59.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f3fff700 1 -- 172.21.15.57:0/2534090178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f4147560 msgr2=0x7f52f40acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f3fff700 1 --2- 172.21.15.57:0/2534090178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f4147560 0x7f52f40acc20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f52ec0032f0 tx=0x7f52ec009290).stop 2021-06-25T04:54:59.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f3fff700 1 -- 172.21.15.57:0/2534090178 shutdown_connections 2021-06-25T04:54:59.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f3fff700 1 --2- 172.21.15.57:0/2534090178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f4147560 0x7f52f40acc20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f3fff700 1 --2- 172.21.15.57:0/2534090178 >> v2:172.21.15.87:3300/0 conn(0x7f52f40b05d0 0x7f52f40af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f3fff700 1 -- 172.21.15.57:0/2534090178 >> 172.21.15.57:0/2534090178 conn(0x7f52f4062520 msgr2=0x7f52f4062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:59.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f3fff700 1 -- 172.21.15.57:0/2534090178 shutdown_connections 2021-06-25T04:54:59.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f3fff700 1 -- 172.21.15.57:0/2534090178 wait complete. 2021-06-25T04:54:59.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f3fff700 1 Processor -- start 2021-06-25T04:54:59.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.128+0000 7f52f3fff700 1 -- start start 2021-06-25T04:54:59.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f3fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f40b05d0 0x7f52f4142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f40b5460 0x7f52f413fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f4147560 0x7f52f40b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f3fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4159de0 con 0x7f52f4147560 2021-06-25T04:54:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f3fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f415a080 con 0x7f52f40b5460 2021-06-25T04:54:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f3fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f415a320 con 0x7f52f40b05d0 2021-06-25T04:54:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f4147560 0x7f52f40b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f27fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f40b5460 0x7f52f413fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f4147560 0x7f52f40b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40946/0 (socket says 172.21.15.57:40946) 2021-06-25T04:54:59.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f37fe700 1 -- 172.21.15.57:0/2377909853 learned_addr learned my addr 172.21.15.57:0/2377909853 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:59.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f2ffd700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f40b05d0 0x7f52f4142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f37fe700 1 -- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f40b05d0 msgr2=0x7f52f4142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f37fe700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f40b05d0 0x7f52f4142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f37fe700 1 -- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f40b5460 msgr2=0x7f52f413fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f37fe700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f40b5460 0x7f52f413fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f37fe700 1 -- 172.21.15.57:0/2377909853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec009530 con 0x7f52f4147560 2021-06-25T04:54:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f37fe700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f4147560 0x7f52f40b4120 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f52ec0032f0 tx=0x7f52ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52e3fff700 1 -- 172.21.15.57:0/2377909853 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52ec011c80 con 0x7f52f4147560 2021-06-25T04:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52e3fff700 1 -- 172.21.15.57:0/2377909853 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec011de0 con 0x7f52f4147560 2021-06-25T04:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f3fff700 1 -- 172.21.15.57:0/2377909853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f415a5c0 con 0x7f52f4147560 2021-06-25T04:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52e3fff700 1 -- 172.21.15.57:0/2377909853 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52ec01f610 con 0x7f52f4147560 2021-06-25T04:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f3fff700 1 -- 172.21.15.57:0/2377909853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f415aa60 con 0x7f52f4147560 2021-06-25T04:54:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52f3fff700 1 -- 172.21.15.57:0/2377909853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f4057310 con 0x7f52f4147560 2021-06-25T04:54:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.132+0000 7f52e3fff700 1 -- 172.21.15.57:0/2377909853 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f52ec026030 con 0x7f52f4147560 2021-06-25T04:54:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.136+0000 7f52e3fff700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d00553d0 0x7f52d0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.136+0000 7f52e3fff700 1 -- 172.21.15.57:0/2377909853 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f52ec06ed50 con 0x7f52f4147560 2021-06-25T04:54:59.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.136+0000 7f52f2ffd700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d00553d0 0x7f52d0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.136+0000 7f52f2ffd700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d00553d0 0x7f52d0057890 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f52e800b000 tx=0x7f52e8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:59.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.144+0000 7f52e3fff700 1 -- 172.21.15.57:0/2377909853 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f52ec044db0 con 0x7f52f4147560 2021-06-25T04:54:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.276+0000 7f52f3fff700 1 -- 172.21.15.57:0/2377909853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52f405f200 con 0x7f52f4147560 2021-06-25T04:54:59.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.276+0000 7f52e3fff700 1 -- 172.21.15.57:0/2377909853 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f52ec024020 con 0x7f52f4147560 2021-06-25T04:54:59.281 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:54:59.281 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":97,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:58.729987+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:54:57.196707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-06-25T04:54:58.096573+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:54:59.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 -- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d00553d0 msgr2=0x7f52d0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d00553d0 0x7f52d0057890 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f52e800b000 tx=0x7f52e8009040).stop 2021-06-25T04:54:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 -- 172.21.15.57:0/2377909853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f4147560 msgr2=0x7f52f40b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f4147560 0x7f52f40b4120 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f52ec0032f0 tx=0x7f52ec016000).stop 2021-06-25T04:54:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 -- 172.21.15.57:0/2377909853 shutdown_connections 2021-06-25T04:54:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d00553d0 0x7f52d0057890 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f4147560 0x7f52f40b4120 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f40b5460 0x7f52f413fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 --2- 172.21.15.57:0/2377909853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f40b05d0 0x7f52f4142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 -- 172.21.15.57:0/2377909853 >> 172.21.15.57:0/2377909853 conn(0x7f52f4062520 msgr2=0x7f52f40acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 -- 172.21.15.57:0/2377909853 shutdown_connections 2021-06-25T04:54:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.280+0000 7f52f3fff700 1 -- 172.21.15.57:0/2377909853 wait complete. 2021-06-25T04:54:59.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:54:59.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.404+0000 7f93b13d0700 1 Processor -- start 2021-06-25T04:54:59.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.404+0000 7f93b13d0700 1 -- start start 2021-06-25T04:54:59.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.404+0000 7f93b13d0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f93ac0b26e0 0x7f93ac13dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.404+0000 7f93b13d0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f93ac0b0fb0 0x7f93ac13e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.404+0000 7f93b13d0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0aaa50 con 0x7f93ac141040 2021-06-25T04:54:59.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.404+0000 7f93b13d0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac141be0 con 0x7f93ac0b26e0 2021-06-25T04:54:59.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.404+0000 7f93b13d0700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac140c50 con 0x7f93ac0b0fb0 2021-06-25T04:54:59.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.404+0000 7f93abfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f93ac0b26e0 0x7f93ac13dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.404+0000 7f93b0bcf700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f93ac141040 0x7f93ac1414d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58170/0 (socket says 172.21.15.57:58170) 2021-06-25T04:54:59.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.404+0000 7f93b0bcf700 1 -- 172.21.15.57:0/2928426725 learned_addr learned my addr 172.21.15.57:0/2928426725 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:54:59.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93a37fe700 1 --2- 172.21.15.57:0/2928426725 >> v2:172.21.15.87:3300/0 conn(0x7f93ac0b0fb0 0x7f93ac13e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93ab7fe700 1 -- 172.21.15.57:0/2928426725 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539509356 0 0) 0x7f93a4001490 con 0x7f93ac141040 2021-06-25T04:54:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93ab7fe700 1 -- 172.21.15.57:0/2928426725 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f938c003260 con 0x7f93ac141040 2021-06-25T04:54:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93abfff700 1 -- 172.21.15.57:0/2928426725 >> v2:172.21.15.87:3300/0 conn(0x7f93ac0b0fb0 msgr2=0x7f93ac13e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93abfff700 1 --2- 172.21.15.57:0/2928426725 >> v2:172.21.15.87:3300/0 conn(0x7f93ac0b0fb0 0x7f93ac13e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93abfff700 1 -- 172.21.15.57:0/2928426725 >> v1:172.21.15.57:6789/0 conn(0x7f93ac141040 legacy=0x7f93ac1414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93abfff700 1 -- 172.21.15.57:0/2928426725 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0b2ac0 con 0x7f93ac0b26e0 2021-06-25T04:54:59.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93abfff700 1 --2- 172.21.15.57:0/2928426725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93ac0b26e0 0x7f93ac13dff0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f939c002f70 tx=0x7f939c006df0).ready entity=mon.0 client_cookie=193f8b6e50b834fe server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:59.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93ab7fe700 1 -- 172.21.15.57:0/2928426725 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f939c00d4f0 con 0x7f93ac0b26e0 2021-06-25T04:54:59.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93ab7fe700 1 -- 172.21.15.57:0/2928426725 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c000e90 con 0x7f93ac0b26e0 2021-06-25T04:54:59.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93ab7fe700 1 -- 172.21.15.57:0/2928426725 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f939c00d840 con 0x7f93ac0b26e0 2021-06-25T04:54:59.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93b13d0700 1 -- 172.21.15.57:0/2928426725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93ac0b26e0 msgr2=0x7f93ac13dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93b13d0700 1 --2- 172.21.15.57:0/2928426725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93ac0b26e0 0x7f93ac13dff0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f939c002f70 tx=0x7f939c006df0).stop 2021-06-25T04:54:59.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93b13d0700 1 -- 172.21.15.57:0/2928426725 shutdown_connections 2021-06-25T04:54:59.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93b13d0700 1 --2- 172.21.15.57:0/2928426725 >> v2:172.21.15.87:3300/0 conn(0x7f93ac0b0fb0 0x7f93ac13e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93b13d0700 1 --2- 172.21.15.57:0/2928426725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93ac0b26e0 0x7f93ac13dff0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93b13d0700 1 -- 172.21.15.57:0/2928426725 >> 172.21.15.57:0/2928426725 conn(0x7f93ac060140 msgr2=0x7f93ac0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:59.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93b13d0700 1 -- 172.21.15.57:0/2928426725 shutdown_connections 2021-06-25T04:54:59.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.408+0000 7f93b13d0700 1 -- 172.21.15.57:0/2928426725 wait complete. 2021-06-25T04:54:59.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b13d0700 1 Processor -- start 2021-06-25T04:54:59.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b13d0700 1 -- start start 2021-06-25T04:54:59.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b13d0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0b0fb0 0x7f93ac05bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b13d0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac0b26e0 0x7f93ac1372e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b13d0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93ac141040 0x7f93ac1377d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b13d0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0adfc0 con 0x7f93ac141040 2021-06-25T04:54:59.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b13d0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0ae730 con 0x7f93ac0b26e0 2021-06-25T04:54:59.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b13d0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0ae1f0 con 0x7f93ac0b0fb0 2021-06-25T04:54:59.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b0bcf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93ac141040 0x7f93ac1377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b0bcf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93ac141040 0x7f93ac1377d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40960/0 (socket says 172.21.15.57:40960) 2021-06-25T04:54:59.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b0bcf700 1 -- 172.21.15.57:0/3723932359 learned_addr learned my addr 172.21.15.57:0/3723932359 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:59.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93a37fe700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac0b26e0 0x7f93ac1372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93abfff700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0b0fb0 0x7f93ac05bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b0bcf700 1 -- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0b0fb0 msgr2=0x7f93ac05bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b0bcf700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0b0fb0 0x7f93ac05bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b0bcf700 1 -- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac0b26e0 msgr2=0x7f93ac1372e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b0bcf700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac0b26e0 0x7f93ac1372e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b0bcf700 1 -- 172.21.15.57:0/3723932359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c00b180 con 0x7f93ac141040 2021-06-25T04:54:59.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b0bcf700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93ac141040 0x7f93ac1377d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f93a4001620 tx=0x7f93a4007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:59.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93a9ffb700 1 -- 172.21.15.57:0/3723932359 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93a4005ba0 con 0x7f93ac141040 2021-06-25T04:54:59.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93a9ffb700 1 -- 172.21.15.57:0/3723932359 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4005d00 con 0x7f93ac141040 2021-06-25T04:54:59.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b13d0700 1 -- 172.21.15.57:0/3723932359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac0ae490 con 0x7f93ac141040 2021-06-25T04:54:59.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93a9ffb700 1 -- 172.21.15.57:0/3723932359 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93a40072c0 con 0x7f93ac141040 2021-06-25T04:54:59.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.412+0000 7f93b13d0700 1 -- 172.21.15.57:0/3723932359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac1408c0 con 0x7f93ac141040 2021-06-25T04:54:59.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.416+0000 7f93b13d0700 1 -- 172.21.15.57:0/3723932359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac057310 con 0x7f93ac141040 2021-06-25T04:54:59.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.416+0000 7f93a9ffb700 1 -- 172.21.15.57:0/3723932359 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f93a4010070 con 0x7f93ac141040 2021-06-25T04:54:59.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.416+0000 7f93a9ffb700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93900553d0 0x7f9390057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.416+0000 7f93a9ffb700 1 -- 172.21.15.57:0/3723932359 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f93a406d710 con 0x7f93ac141040 2021-06-25T04:54:59.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.416+0000 7f93abfff700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93900553d0 0x7f9390057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.416+0000 7f93abfff700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93900553d0 0x7f9390057890 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f939c019000 tx=0x7f939c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:59.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.420+0000 7f93a9ffb700 1 -- 172.21.15.57:0/3723932359 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f93a4043820 con 0x7f93ac141040 2021-06-25T04:54:59.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.584+0000 7f93b13d0700 1 -- 172.21.15.57:0/3723932359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f93ac0aaa50 con 0x7f93ac141040 2021-06-25T04:54:59.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.748+0000 7f93a9ffb700 1 -- 172.21.15.57:0/3723932359 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7f93ac0aaa50 con 0x7f93ac141040 2021-06-25T04:54:59.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.748+0000 7f93b13d0700 1 -- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93900553d0 msgr2=0x7f9390057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.748+0000 7f93b13d0700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93900553d0 0x7f9390057890 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f939c019000 tx=0x7f939c014000).stop 2021-06-25T04:54:59.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.748+0000 7f93b13d0700 1 -- 172.21.15.57:0/3723932359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93ac141040 msgr2=0x7f93ac1377d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.748+0000 7f93b13d0700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93ac141040 0x7f93ac1377d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f93a4001620 tx=0x7f93a4007c60).stop 2021-06-25T04:54:59.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.752+0000 7f93b13d0700 1 -- 172.21.15.57:0/3723932359 shutdown_connections 2021-06-25T04:54:59.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.752+0000 7f93b13d0700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f93900553d0 0x7f9390057890 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.752+0000 7f93b13d0700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93ac141040 0x7f93ac1377d0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.752+0000 7f93b13d0700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac0b26e0 0x7f93ac1372e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.752+0000 7f93b13d0700 1 --2- 172.21.15.57:0/3723932359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0b0fb0 0x7f93ac05bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.752+0000 7f93b13d0700 1 -- 172.21.15.57:0/3723932359 >> 172.21.15.57:0/3723932359 conn(0x7f93ac060140 msgr2=0x7f93ac0ab6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:59.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.752+0000 7f93b13d0700 1 -- 172.21.15.57:0/3723932359 shutdown_connections 2021-06-25T04:54:59.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.752+0000 7f93b13d0700 1 -- 172.21.15.57:0/3723932359 wait complete. 2021-06-25T04:54:59.770 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:54:59.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 Processor -- start 2021-06-25T04:54:59.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 -- start start 2021-06-25T04:54:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91280b3200 0x7f9128066640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91280b1800 0x7f9128066b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91280b35e0 con 0x7f91280b0e30 2021-06-25T04:54:59.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91281436b0 con 0x7f91280b1800 2021-06-25T04:54:59.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9128065c60 con 0x7f91280b3200 2021-06-25T04:54:59.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91280b1800 0x7f9128066b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91280b1800 0x7f9128066b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40966/0 (socket says 172.21.15.57:40966) 2021-06-25T04:54:59.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912659c700 1 -- 172.21.15.57:0/460753258 learned_addr learned my addr 172.21.15.57:0/460753258 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:59.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f9126d9d700 1 --2- 172.21.15.57:0/460753258 >> v2:172.21.15.87:3300/0 conn(0x7f91280b3200 0x7f9128066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912659c700 1 -- 172.21.15.57:0/460753258 >> v2:172.21.15.87:3300/0 conn(0x7f91280b3200 msgr2=0x7f9128066640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:54:59.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912659c700 1 --2- 172.21.15.57:0/460753258 >> v2:172.21.15.87:3300/0 conn(0x7f91280b3200 0x7f9128066640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912659c700 1 -- 172.21.15.57:0/460753258 >> v1:172.21.15.87:6789/0 conn(0x7f91280b0e30 legacy=0x7f9128142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912659c700 1 -- 172.21.15.57:0/460753258 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9128065f00 con 0x7f91280b1800 2021-06-25T04:54:59.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912659c700 1 --2- 172.21.15.57:0/460753258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280b1800 0x7f9128066b30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f911c002f70 tx=0x7f911c006eb0).ready entity=mon.0 client_cookie=4889a331664cd1d0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:59.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f9125d9b700 1 -- 172.21.15.57:0/460753258 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f911c00d5c0 con 0x7f91280b1800 2021-06-25T04:54:59.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f9125d9b700 1 -- 172.21.15.57:0/460753258 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c000e90 con 0x7f91280b1800 2021-06-25T04:54:59.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f9125d9b700 1 -- 172.21.15.57:0/460753258 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f911c00d950 con 0x7f91280b1800 2021-06-25T04:54:59.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 -- 172.21.15.57:0/460753258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280b1800 msgr2=0x7f9128066b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 --2- 172.21.15.57:0/460753258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280b1800 0x7f9128066b30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f911c002f70 tx=0x7f911c006eb0).stop 2021-06-25T04:54:59.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 -- 172.21.15.57:0/460753258 shutdown_connections 2021-06-25T04:54:59.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 --2- 172.21.15.57:0/460753258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280b1800 0x7f9128066b30 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 --2- 172.21.15.57:0/460753258 >> v2:172.21.15.87:3300/0 conn(0x7f91280b3200 0x7f9128066640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.876+0000 7f912d09a700 1 -- 172.21.15.57:0/460753258 >> 172.21.15.57:0/460753258 conn(0x7f912805c450 msgr2=0x7f912805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:54:59.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912d09a700 1 -- 172.21.15.57:0/460753258 shutdown_connections 2021-06-25T04:54:59.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912d09a700 1 -- 172.21.15.57:0/460753258 wait complete. 2021-06-25T04:54:59.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912d09a700 1 Processor -- start 2021-06-25T04:54:59.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912d09a700 1 -- start start 2021-06-25T04:54:59.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912d09a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280b0e30 0x7f9128152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912d09a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91280b1800 0x7f912813fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912d09a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91280b3200 0x7f9128153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912d09a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91280b0170 con 0x7f91280b0e30 2021-06-25T04:54:59.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912d09a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91281521c0 con 0x7f91280b3200 2021-06-25T04:54:59.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912d09a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9128152460 con 0x7f91280b1800 2021-06-25T04:54:59.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f9126d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280b0e30 0x7f9128152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f9126d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280b0e30 0x7f9128152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40970/0 (socket says 172.21.15.57:40970) 2021-06-25T04:54:59.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f9126d9d700 1 -- 172.21.15.57:0/3022471676 learned_addr learned my addr 172.21.15.57:0/3022471676 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:54:59.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912659c700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91280b1800 0x7f912813fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.880+0000 7f912759e700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91280b3200 0x7f9128153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f912659c700 1 -- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91280b3200 msgr2=0x7f9128153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f912659c700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91280b3200 0x7f9128153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f912659c700 1 -- 172.21.15.57:0/3022471676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280b0e30 msgr2=0x7f9128152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:54:59.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f912659c700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280b0e30 0x7f9128152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:54:59.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f912659c700 1 -- 172.21.15.57:0/3022471676 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c00b1e0 con 0x7f91280b1800 2021-06-25T04:54:59.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f912659c700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91280b1800 0x7f912813fa70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f911c002f70 tx=0x7f911c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:59.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f9117fff700 1 -- 172.21.15.57:0/3022471676 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f911c021070 con 0x7f91280b1800 2021-06-25T04:54:59.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f9117fff700 1 -- 172.21.15.57:0/3022471676 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c011760 con 0x7f91280b1800 2021-06-25T04:54:59.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f912d09a700 1 -- 172.21.15.57:0/3022471676 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9128152700 con 0x7f91280b1800 2021-06-25T04:54:59.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f9117fff700 1 -- 172.21.15.57:0/3022471676 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f911c011ac0 con 0x7f91280b1800 2021-06-25T04:54:59.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f912d09a700 1 -- 172.21.15.57:0/3022471676 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91280afe60 con 0x7f91280b1800 2021-06-25T04:54:59.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f912d09a700 1 -- 172.21.15.57:0/3022471676 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9128152890 con 0x7f91280b1800 2021-06-25T04:54:59.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f9117fff700 1 -- 172.21.15.57:0/3022471676 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f911c00f070 con 0x7f91280b1800 2021-06-25T04:54:59.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.884+0000 7f9117fff700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9104055450 0x7f9104057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:54:59.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.888+0000 7f9117fff700 1 -- 172.21.15.57:0/3022471676 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f911c06f550 con 0x7f91280b1800 2021-06-25T04:54:59.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.888+0000 7f9126d9d700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9104055450 0x7f9104057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:54:59.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.888+0000 7f9126d9d700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9104055450 0x7f9104057910 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f911800b000 tx=0x7f9118006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:54:59.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:54:59.892+0000 7f9117fff700 1 -- 172.21.15.57:0/3022471676 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f911c0455f0 con 0x7f91280b1800 2021-06-25T04:55:00.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.056+0000 7f912d09a700 1 -- 172.21.15.57:0/3022471676 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9128057310 con 0x7f91280b1800 2021-06-25T04:55:00.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f9117fff700 1 -- 172.21.15.57:0/3022471676 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f911c048c10 con 0x7f91280b1800 2021-06-25T04:55:00.063 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:00.063 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3853681312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3853681312},{"type":"v1","addr":"172.21.15.87:6835","nonce":3853681312}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6981,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2200404668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2200404668},{"type":"v1","addr":"172.21.15.57:6833","nonce":2200404668}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:58.730365+0000","modified":"2021-06-25T04:54:59.734569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3959946984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3959946984},{"type":"v1","addr":"172.21.15.57:6835","nonce":3959946984}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-06-25T04:55:00.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 -- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9104055450 msgr2=0x7f9104057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9104055450 0x7f9104057910 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f911800b000 tx=0x7f9118006df0).stop 2021-06-25T04:55:00.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 -- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91280b1800 msgr2=0x7f912813fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91280b1800 0x7f912813fa70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f911c002f70 tx=0x7f911c015000).stop 2021-06-25T04:55:00.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 -- 172.21.15.57:0/3022471676 shutdown_connections 2021-06-25T04:55:00.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9104055450 0x7f9104057910 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91280b3200 0x7f9128153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91280b1800 0x7f912813fa70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 --2- 172.21.15.57:0/3022471676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280b0e30 0x7f9128152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 -- 172.21.15.57:0/3022471676 >> 172.21.15.57:0/3022471676 conn(0x7f912805c450 msgr2=0x7f91281437f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:00.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 -- 172.21.15.57:0/3022471676 shutdown_connections 2021-06-25T04:55:00.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.060+0000 7f912d09a700 1 -- 172.21.15.57:0/3022471676 wait complete. 2021-06-25T04:55:00.069 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 47 2021-06-25T04:55:00.082 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:00.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.180+0000 7f0d6a116700 1 Processor -- start 2021-06-25T04:55:00.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.180+0000 7f0d6a116700 1 -- start start 2021-06-25T04:55:00.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.180+0000 7f0d6a116700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d640aad40 0x7f0d640672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.180+0000 7f0d6a116700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0d640ab120 0x7f0d640647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.180+0000 7f0d6a116700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d64065920 con 0x7f0d64064cb0 2021-06-25T04:55:00.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.180+0000 7f0d6a116700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d640b3ca0 con 0x7f0d640aad40 2021-06-25T04:55:00.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.180+0000 7f0d6a116700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d64066e20 con 0x7f0d640ab120 2021-06-25T04:55:00.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.180+0000 7f0d69114700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d640aad40 0x7f0d640672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.180+0000 7f0d69114700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d640aad40 0x7f0d640672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40978/0 (socket says 172.21.15.57:40978) 2021-06-25T04:55:00.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.180+0000 7f0d69114700 1 -- 172.21.15.57:0/1627149222 learned_addr learned my addr 172.21.15.57:0/1627149222 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:00.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d68913700 1 --2- 172.21.15.57:0/1627149222 >> v2:172.21.15.87:3300/0 conn(0x7f0d640ab120 0x7f0d640647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d69114700 1 -- 172.21.15.57:0/1627149222 >> v2:172.21.15.87:3300/0 conn(0x7f0d640ab120 msgr2=0x7f0d640647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:00.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d69114700 1 --2- 172.21.15.57:0/1627149222 >> v2:172.21.15.87:3300/0 conn(0x7f0d640ab120 0x7f0d640647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d69114700 1 -- 172.21.15.57:0/1627149222 >> v1:172.21.15.87:6789/0 conn(0x7f0d64064cb0 legacy=0x7f0d640b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d69114700 1 -- 172.21.15.57:0/1627149222 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640b7bf0 con 0x7f0d640aad40 2021-06-25T04:55:00.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d68913700 1 --2- 172.21.15.57:0/1627149222 >> v2:172.21.15.87:3300/0 conn(0x7f0d640ab120 0x7f0d640647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:00.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d69114700 1 --2- 172.21.15.57:0/1627149222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d640aad40 0x7f0d640672c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f0d5c002f70 tx=0x7f0d5c006eb0).ready entity=mon.0 client_cookie=7571035d4765923d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:00.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d5bfff700 1 -- 172.21.15.57:0/1627149222 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d5c00d610 con 0x7f0d640aad40 2021-06-25T04:55:00.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d5bfff700 1 -- 172.21.15.57:0/1627149222 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c000e90 con 0x7f0d640aad40 2021-06-25T04:55:00.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d6a116700 1 -- 172.21.15.57:0/1627149222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d640aad40 msgr2=0x7f0d640672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d6a116700 1 --2- 172.21.15.57:0/1627149222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d640aad40 0x7f0d640672c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f0d5c002f70 tx=0x7f0d5c006eb0).stop 2021-06-25T04:55:00.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d5bfff700 1 -- 172.21.15.57:0/1627149222 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 0 0 0) 0x7f0d5c00d9a0 con 0x7f0d640aad40 2021-06-25T04:55:00.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d6a116700 1 -- 172.21.15.57:0/1627149222 shutdown_connections 2021-06-25T04:55:00.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d6a116700 1 --2- 172.21.15.57:0/1627149222 >> v2:172.21.15.87:3300/0 conn(0x7f0d640ab120 0x7f0d640647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d6a116700 1 --2- 172.21.15.57:0/1627149222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d640aad40 0x7f0d640672c0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d6a116700 1 -- 172.21.15.57:0/1627149222 >> 172.21.15.57:0/1627149222 conn(0x7f0d64062ba0 msgr2=0x7f0d6405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:00.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d6a116700 1 -- 172.21.15.57:0/1627149222 shutdown_connections 2021-06-25T04:55:00.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.184+0000 7f0d6a116700 1 -- 172.21.15.57:0/1627149222 wait complete. 2021-06-25T04:55:00.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d6a116700 1 Processor -- start 2021-06-25T04:55:00.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d6a116700 1 -- start start 2021-06-25T04:55:00.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d6a116700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d640aad40 0x7f0d640ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d6a116700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d640ab120 0x7f0d641503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d6a116700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d641532c0 0x7f0d641508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d6a116700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6414fd70 con 0x7f0d641532c0 2021-06-25T04:55:00.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d6a116700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640ae830 con 0x7f0d640aad40 2021-06-25T04:55:00.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d6a116700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6414ff60 con 0x7f0d640ab120 2021-06-25T04:55:00.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d69915700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d641532c0 0x7f0d641508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d68913700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d640ab120 0x7f0d641503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d69915700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d641532c0 0x7f0d641508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40988/0 (socket says 172.21.15.57:40988) 2021-06-25T04:55:00.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d69915700 1 -- 172.21.15.57:0/3896883569 learned_addr learned my addr 172.21.15.57:0/3896883569 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:00.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d69114700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d640aad40 0x7f0d640ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d69915700 1 -- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d640ab120 msgr2=0x7f0d641503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d69915700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d640ab120 0x7f0d641503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d69915700 1 -- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d640aad40 msgr2=0x7f0d640ab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d69915700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d640aad40 0x7f0d640ab840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d69915700 1 -- 172.21.15.57:0/3896883569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c00b1e0 con 0x7f0d641532c0 2021-06-25T04:55:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d69915700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d641532c0 0x7f0d641508b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f0d64150e20 tx=0x7f0d54007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d5a7fc700 1 -- 172.21.15.57:0/3896883569 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d54013450 con 0x7f0d641532c0 2021-06-25T04:55:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d5a7fc700 1 -- 172.21.15.57:0/3896883569 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d540135b0 con 0x7f0d641532c0 2021-06-25T04:55:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d6a116700 1 -- 172.21.15.57:0/3896883569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d640ae2f0 con 0x7f0d641532c0 2021-06-25T04:55:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d5a7fc700 1 -- 172.21.15.57:0/3896883569 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d54013910 con 0x7f0d641532c0 2021-06-25T04:55:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d6a116700 1 -- 172.21.15.57:0/3896883569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d641452f0 con 0x7f0d641532c0 2021-06-25T04:55:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.188+0000 7f0d6a116700 1 -- 172.21.15.57:0/3896883569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d64057310 con 0x7f0d641532c0 2021-06-25T04:55:00.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.192+0000 7f0d5a7fc700 1 -- 172.21.15.57:0/3896883569 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0d5401a060 con 0x7f0d641532c0 2021-06-25T04:55:00.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.192+0000 7f0d5a7fc700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d44055450 0x7f0d44057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.192+0000 7f0d5a7fc700 1 -- 172.21.15.57:0/3896883569 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0d5406d630 con 0x7f0d641532c0 2021-06-25T04:55:00.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.192+0000 7f0d69114700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d44055450 0x7f0d44057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.192+0000 7f0d69114700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d44055450 0x7f0d44057910 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f0d5c01b000 tx=0x7f0d5c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:00.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.196+0000 7f0d5a7fc700 1 -- 172.21.15.57:0/3896883569 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0d540436d0 con 0x7f0d641532c0 2021-06-25T04:55:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.324+0000 7f0d6a116700 1 -- 172.21.15.57:0/3896883569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d64150120 con 0x7f0d641532c0 2021-06-25T04:55:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.324+0000 7f0d5a7fc700 1 -- 172.21.15.57:0/3896883569 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f0d54018070 con 0x7f0d641532c0 2021-06-25T04:55:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:00.330 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":98,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:59.733440+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:54:57.196707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-06-25T04:54:58.096573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:00.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 -- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d44055450 msgr2=0x7f0d44057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d44055450 0x7f0d44057910 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f0d5c01b000 tx=0x7f0d5c015000).stop 2021-06-25T04:55:00.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 -- 172.21.15.57:0/3896883569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d641532c0 msgr2=0x7f0d641508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d641532c0 0x7f0d641508b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f0d64150e20 tx=0x7f0d54007b90).stop 2021-06-25T04:55:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 -- 172.21.15.57:0/3896883569 shutdown_connections 2021-06-25T04:55:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d44055450 0x7f0d44057910 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d641532c0 0x7f0d641508b0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d640ab120 0x7f0d641503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 --2- 172.21.15.57:0/3896883569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d640aad40 0x7f0d640ab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 -- 172.21.15.57:0/3896883569 >> 172.21.15.57:0/3896883569 conn(0x7f0d64062ba0 msgr2=0x7f0d6405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 -- 172.21.15.57:0/3896883569 shutdown_connections 2021-06-25T04:55:00.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.328+0000 7f0d6a116700 1 -- 172.21.15.57:0/3896883569 wait complete. 2021-06-25T04:55:00.349 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:55:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a359e700 1 Processor -- start 2021-06-25T04:55:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a359e700 1 -- start start 2021-06-25T04:55:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f67a40b00a0 0x7f67a4142e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a4067840 con 0x7f67a40ac6b0 2021-06-25T04:55:00.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a4067ae0 con 0x7f67a40b2540 2021-06-25T04:55:00.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a40ad570 con 0x7f67a40b00a0 2021-06-25T04:55:00.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a1d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f67a40b00a0 0x7f67a4142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a1d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f67a40b00a0 0x7f67a4142e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40994/0 (socket says 172.21.15.57:40994) 2021-06-25T04:55:00.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a1d9b700 1 -- 172.21.15.57:0/714139847 learned_addr learned my addr 172.21.15.57:0/714139847 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:00.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a2d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f67a40ac6b0 0x7f67a4143320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58214/0 (socket says 172.21.15.57:58214) 2021-06-25T04:55:00.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a159a700 1 -- 172.21.15.57:0/714139847 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387894973 0 0) 0x7f67a4067840 con 0x7f67a40ac6b0 2021-06-25T04:55:00.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a159a700 1 -- 172.21.15.57:0/714139847 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6788003260 con 0x7f67a40ac6b0 2021-06-25T04:55:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a159a700 1 -- 172.21.15.57:0/714139847 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958144373 0 0) 0x7f67a4067ae0 con 0x7f67a40b2540 2021-06-25T04:55:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a1d9b700 1 -- 172.21.15.57:0/714139847 >> v1:172.21.15.87:6789/0 conn(0x7f67a40b2540 legacy=0x7f67a4140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a1d9b700 1 -- 172.21.15.57:0/714139847 >> v1:172.21.15.57:6789/0 conn(0x7f67a40ac6b0 legacy=0x7f67a4143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a1d9b700 1 -- 172.21.15.57:0/714139847 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a4146f90 con 0x7f67a40b00a0 2021-06-25T04:55:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.460+0000 7f67a1d9b700 1 --2- 172.21.15.57:0/714139847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67a40b00a0 0x7f67a4142e30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f6794002f70 tx=0x7f6794006eb0).ready entity=mon.0 client_cookie=254b7736e5d202ce server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:00.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a159a700 1 -- 172.21.15.57:0/714139847 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f679400d610 con 0x7f67a40b00a0 2021-06-25T04:55:00.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a159a700 1 -- 172.21.15.57:0/714139847 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6794000e90 con 0x7f67a40b00a0 2021-06-25T04:55:00.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a159a700 1 -- 172.21.15.57:0/714139847 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f679400d960 con 0x7f67a40b00a0 2021-06-25T04:55:00.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 -- 172.21.15.57:0/714139847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67a40b00a0 msgr2=0x7f67a4142e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 --2- 172.21.15.57:0/714139847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67a40b00a0 0x7f67a4142e30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f6794002f70 tx=0x7f6794006eb0).stop 2021-06-25T04:55:00.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 -- 172.21.15.57:0/714139847 shutdown_connections 2021-06-25T04:55:00.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 --2- 172.21.15.57:0/714139847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67a40b00a0 0x7f67a4142e30 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 -- 172.21.15.57:0/714139847 >> 172.21.15.57:0/714139847 conn(0x7f67a4060140 msgr2=0x7f67a40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:00.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 -- 172.21.15.57:0/714139847 shutdown_connections 2021-06-25T04:55:00.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 -- 172.21.15.57:0/714139847 wait complete. 2021-06-25T04:55:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 Processor -- start 2021-06-25T04:55:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 -- start start 2021-06-25T04:55:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67a40ac6b0 0x7f67a4146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67a40b00a0 0x7f67a4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67a40b2540 0x7f67a4141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a41553b0 con 0x7f67a40b2540 2021-06-25T04:55:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a4141020 con 0x7f67a40b00a0 2021-06-25T04:55:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a41412c0 con 0x7f67a40ac6b0 2021-06-25T04:55:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67a40b2540 0x7f67a4141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67a40b2540 0x7f67a4141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41002/0 (socket says 172.21.15.57:41002) 2021-06-25T04:55:00.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a2d9d700 1 -- 172.21.15.57:0/1350109044 learned_addr learned my addr 172.21.15.57:0/1350109044 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:00.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a259c700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67a40ac6b0 0x7f67a4146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a1d9b700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67a40b00a0 0x7f67a4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a2d9d700 1 -- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67a40ac6b0 msgr2=0x7f67a4146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a2d9d700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67a40ac6b0 0x7f67a4146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a2d9d700 1 -- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67a40b00a0 msgr2=0x7f67a4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a2d9d700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67a40b00a0 0x7f67a4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.464+0000 7f67a2d9d700 1 -- 172.21.15.57:0/1350109044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679400b1e0 con 0x7f67a40b2540 2021-06-25T04:55:00.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.468+0000 7f67a2d9d700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67a40b2540 0x7f67a4141620 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f679c001490 tx=0x7f679c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:00.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.468+0000 7f67937fe700 1 -- 172.21.15.57:0/1350109044 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f679c005ae0 con 0x7f67a40b2540 2021-06-25T04:55:00.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.468+0000 7f67937fe700 1 -- 172.21.15.57:0/1350109044 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c005c40 con 0x7f67a40b2540 2021-06-25T04:55:00.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.468+0000 7f67a359e700 1 -- 172.21.15.57:0/1350109044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a4155610 con 0x7f67a40b2540 2021-06-25T04:55:00.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.468+0000 7f67937fe700 1 -- 172.21.15.57:0/1350109044 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f679c0070d0 con 0x7f67a40b2540 2021-06-25T04:55:00.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.468+0000 7f67a359e700 1 -- 172.21.15.57:0/1350109044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a4141b10 con 0x7f67a40b2540 2021-06-25T04:55:00.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.468+0000 7f67a359e700 1 -- 172.21.15.57:0/1350109044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a4141d00 con 0x7f67a40b2540 2021-06-25T04:55:00.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.468+0000 7f67937fe700 1 -- 172.21.15.57:0/1350109044 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f679c010070 con 0x7f67a40b2540 2021-06-25T04:55:00.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.472+0000 7f67937fe700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6780055450 0x7f6780057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.472+0000 7f67937fe700 1 -- 172.21.15.57:0/1350109044 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f679c06d870 con 0x7f67a40b2540 2021-06-25T04:55:00.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.472+0000 7f67a259c700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6780055450 0x7f6780057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.472+0000 7f67a259c700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6780055450 0x7f6780057910 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f679800d000 tx=0x7f6798007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:00.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.476+0000 7f67937fe700 1 -- 172.21.15.57:0/1350109044 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f679c043980 con 0x7f67a40b2540 2021-06-25T04:55:00.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.644+0000 7f67a359e700 1 -- 172.21.15.57:0/1350109044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f67a41557a0 con 0x7f67a40b2540 2021-06-25T04:55:00.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.652+0000 7f67937fe700 1 -- 172.21.15.57:0/1350109044 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7f679c046fa0 con 0x7f67a40b2540 2021-06-25T04:55:00.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 -- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6780055450 msgr2=0x7f6780057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6780055450 0x7f6780057910 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f679800d000 tx=0x7f6798007b90).stop 2021-06-25T04:55:00.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 -- 172.21.15.57:0/1350109044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67a40b2540 msgr2=0x7f67a4141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67a40b2540 0x7f67a4141620 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f679c001490 tx=0x7f679c007dc0).stop 2021-06-25T04:55:00.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 -- 172.21.15.57:0/1350109044 shutdown_connections 2021-06-25T04:55:00.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6780055450 0x7f6780057910 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67a40b2540 0x7f67a4141620 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67a40b00a0 0x7f67a4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 --2- 172.21.15.57:0/1350109044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67a40ac6b0 0x7f67a4146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 -- 172.21.15.57:0/1350109044 >> 172.21.15.57:0/1350109044 conn(0x7f67a4060140 msgr2=0x7f67a413f530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:00.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 -- 172.21.15.57:0/1350109044 shutdown_connections 2021-06-25T04:55:00.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.656+0000 7f67a359e700 1 -- 172.21.15.57:0/1350109044 wait complete. 2021-06-25T04:55:00.665 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:55:00.674 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:55:00.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc980bd7700 1 Processor -- start 2021-06-25T04:55:00.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc980bd7700 1 -- start start 2021-06-25T04:55:00.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc980bd7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc97c0b6540 0x7fc97c0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc980bd7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc97c0b4380 0x7fc97c0b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc980bd7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c144070 con 0x7fc97c061cf0 2021-06-25T04:55:00.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc980bd7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c0b6e10 con 0x7fc97c0b4380 2021-06-25T04:55:00.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc980bd7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c143b30 con 0x7fc97c0b6540 2021-06-25T04:55:00.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc979d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc97c0b4380 0x7fc97c0b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc979d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc97c0b4380 0x7fc97c0b6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41006/0 (socket says 172.21.15.57:41006) 2021-06-25T04:55:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc979d9b700 1 -- 172.21.15.57:0/2407463485 learned_addr learned my addr 172.21.15.57:0/2407463485 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:00.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc97a59c700 1 --2- 172.21.15.57:0/2407463485 >> v2:172.21.15.87:3300/0 conn(0x7fc97c0b6540 0x7fc97c0b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc979d9b700 1 -- 172.21.15.57:0/2407463485 >> v2:172.21.15.87:3300/0 conn(0x7fc97c0b6540 msgr2=0x7fc97c0b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:00.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc979d9b700 1 --2- 172.21.15.57:0/2407463485 >> v2:172.21.15.87:3300/0 conn(0x7fc97c0b6540 0x7fc97c0b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc979d9b700 1 -- 172.21.15.57:0/2407463485 >> v1:172.21.15.57:6789/0 conn(0x7fc97c061cf0 legacy=0x7fc97c146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc979d9b700 1 -- 172.21.15.57:0/2407463485 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c143dd0 con 0x7fc97c0b4380 2021-06-25T04:55:00.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc979d9b700 1 --2- 172.21.15.57:0/2407463485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b4380 0x7fc97c0b6920 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fc97c1430e0 tx=0x7fc970006eb0).ready entity=mon.0 client_cookie=72c8d0aaf0d5906a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc97959a700 1 -- 172.21.15.57:0/2407463485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc97000d610 con 0x7fc97c0b4380 2021-06-25T04:55:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc97959a700 1 -- 172.21.15.57:0/2407463485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc970000e90 con 0x7fc97c0b4380 2021-06-25T04:55:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc97959a700 1 -- 172.21.15.57:0/2407463485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc97000d960 con 0x7fc97c0b4380 2021-06-25T04:55:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc980bd7700 1 -- 172.21.15.57:0/2407463485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b4380 msgr2=0x7fc97c0b6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.788+0000 7fc980bd7700 1 --2- 172.21.15.57:0/2407463485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b4380 0x7fc97c0b6920 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fc97c1430e0 tx=0x7fc970006eb0).stop 2021-06-25T04:55:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 -- 172.21.15.57:0/2407463485 shutdown_connections 2021-06-25T04:55:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 --2- 172.21.15.57:0/2407463485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b4380 0x7fc97c0b6920 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 --2- 172.21.15.57:0/2407463485 >> v2:172.21.15.87:3300/0 conn(0x7fc97c0b6540 0x7fc97c0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 -- 172.21.15.57:0/2407463485 >> 172.21.15.57:0/2407463485 conn(0x7fc97c05c450 msgr2=0x7fc97c05c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:00.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 -- 172.21.15.57:0/2407463485 shutdown_connections 2021-06-25T04:55:00.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 -- 172.21.15.57:0/2407463485 wait complete. 2021-06-25T04:55:00.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 Processor -- start 2021-06-25T04:55:00.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 -- start start 2021-06-25T04:55:00.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc97c061cf0 0x7fc97c0af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b4380 0x7fc97c0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b6540 0x7fc97c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c146c50 con 0x7fc97c0b4380 2021-06-25T04:55:00.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c148b00 con 0x7fc97c0b6540 2021-06-25T04:55:00.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c148da0 con 0x7fc97c061cf0 2021-06-25T04:55:00.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc979d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b4380 0x7fc97c0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc979d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b4380 0x7fc97c0afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41014/0 (socket says 172.21.15.57:41014) 2021-06-25T04:55:00.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc979d9b700 1 -- 172.21.15.57:0/3699192230 learned_addr learned my addr 172.21.15.57:0/3699192230 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:00.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc97a59c700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc97c061cf0 0x7fc97c0af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc97ad9d700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b6540 0x7fc97c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc979d9b700 1 -- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc97c061cf0 msgr2=0x7fc97c0af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc979d9b700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc97c061cf0 0x7fc97c0af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc979d9b700 1 -- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b6540 msgr2=0x7fc97c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc979d9b700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b6540 0x7fc97c1470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc979d9b700 1 -- 172.21.15.57:0/3699192230 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97000b1e0 con 0x7fc97c0b4380 2021-06-25T04:55:00.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc97ad9d700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b6540 0x7fc97c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:00.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc979d9b700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b4380 0x7fc97c0afcd0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fc97c1430e0 tx=0x7fc970015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:00.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc96b7fe700 1 -- 172.21.15.57:0/3699192230 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc97000d290 con 0x7fc97c0b4380 2021-06-25T04:55:00.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc96b7fe700 1 -- 172.21.15.57:0/3699192230 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc970002f50 con 0x7fc97c0b4380 2021-06-25T04:55:00.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 -- 172.21.15.57:0/3699192230 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c149040 con 0x7fc97c0b4380 2021-06-25T04:55:00.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc96b7fe700 1 -- 172.21.15.57:0/3699192230 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc970011c30 con 0x7fc97c0b4380 2021-06-25T04:55:00.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.792+0000 7fc980bd7700 1 -- 172.21.15.57:0/3699192230 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c1475a0 con 0x7fc97c0b4380 2021-06-25T04:55:00.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.796+0000 7fc96b7fe700 1 -- 172.21.15.57:0/3699192230 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc97000f070 con 0x7fc97c0b4380 2021-06-25T04:55:00.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.796+0000 7fc980bd7700 1 -- 172.21.15.57:0/3699192230 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c057310 con 0x7fc97c0b4380 2021-06-25T04:55:00.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.796+0000 7fc96b7fe700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc958055360 0x7fc958057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:00.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.796+0000 7fc96b7fe700 1 -- 172.21.15.57:0/3699192230 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc97006f600 con 0x7fc97c0b4380 2021-06-25T04:55:00.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.796+0000 7fc97a59c700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc958055360 0x7fc958057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:00.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.796+0000 7fc97a59c700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc958055360 0x7fc958057820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fc96c00c000 tx=0x7fc96c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:00.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.804+0000 7fc96b7fe700 1 -- 172.21.15.57:0/3699192230 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc970045710 con 0x7fc97c0b4380 2021-06-25T04:55:00.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.976+0000 7fc980bd7700 1 -- 172.21.15.57:0/3699192230 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc97c146e10 con 0x7fc97c0b4380 2021-06-25T04:55:00.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.984+0000 7fc96b7fe700 1 -- 172.21.15.57:0/3699192230 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc970048d30 con 0x7fc97c0b4380 2021-06-25T04:55:00.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 -- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc958055360 msgr2=0x7fc958057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc958055360 0x7fc958057820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fc96c00c000 tx=0x7fc96c008040).stop 2021-06-25T04:55:00.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 -- 172.21.15.57:0/3699192230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b4380 msgr2=0x7fc97c0afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:00.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b4380 0x7fc97c0afcd0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7fc97c1430e0 tx=0x7fc970015000).stop 2021-06-25T04:55:00.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 -- 172.21.15.57:0/3699192230 shutdown_connections 2021-06-25T04:55:00.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc958055360 0x7fc958057820 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b6540 0x7fc97c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b4380 0x7fc97c0afcd0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 --2- 172.21.15.57:0/3699192230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc97c061cf0 0x7fc97c0af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:00.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 -- 172.21.15.57:0/3699192230 >> 172.21.15.57:0/3699192230 conn(0x7fc97c05c450 msgr2=0x7fc97c141380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:00.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 -- 172.21.15.57:0/3699192230 shutdown_connections 2021-06-25T04:55:00.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:00.988+0000 7fc980bd7700 1 -- 172.21.15.57:0/3699192230 wait complete. 2021-06-25T04:55:00.994 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:55:01.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:01.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.100+0000 7f9e0f59e700 1 Processor -- start 2021-06-25T04:55:01.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.100+0000 7f9e0f59e700 1 -- start start 2021-06-25T04:55:01.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.100+0000 7f9e0f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e100ac9f0 0x7f9e100b5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.100+0000 7f9e0f59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9e100b13f0 0x7f9e10066fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.100+0000 7f9e0f59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e100acdd0 con 0x7f9e100ad830 2021-06-25T04:55:01.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.100+0000 7f9e0f59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e100b5120 con 0x7f9e100b13f0 2021-06-25T04:55:01.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.100+0000 7f9e0f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e100adea0 con 0x7f9e100ac9f0 2021-06-25T04:55:01.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.100+0000 7f9e0ed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9e100b13f0 0x7f9e10066fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e05d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9e100ad830 0x7f9e10143480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58238/0 (socket says 172.21.15.57:58238) 2021-06-25T04:55:01.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e05d9b700 1 -- 172.21.15.57:0/2658408837 learned_addr learned my addr 172.21.15.57:0/2658408837 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:01.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0e59c700 1 --2- 172.21.15.57:0/2658408837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e100ac9f0 0x7f9e100b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0dd9b700 1 -- 172.21.15.57:0/2658408837 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399598173 0 0) 0x7f9e100acdd0 con 0x7f9e100ad830 2021-06-25T04:55:01.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0dd9b700 1 -- 172.21.15.57:0/2658408837 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df0003260 con 0x7f9e100ad830 2021-06-25T04:55:01.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0ed9d700 1 -- 172.21.15.57:0/2658408837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e100ac9f0 msgr2=0x7f9e100b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:01.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0ed9d700 1 --2- 172.21.15.57:0/2658408837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e100ac9f0 0x7f9e100b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0ed9d700 1 -- 172.21.15.57:0/2658408837 >> v1:172.21.15.57:6789/0 conn(0x7f9e100ad830 legacy=0x7f9e10143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0ed9d700 1 -- 172.21.15.57:0/2658408837 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e100ae140 con 0x7f9e100b13f0 2021-06-25T04:55:01.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0ed9d700 1 --2- 172.21.15.57:0/2658408837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e100b13f0 0x7f9e10066fc0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f9e080032f0 tx=0x7f9e080091d0).ready entity=mon.0 client_cookie=6394d901f4146ef8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:01.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0dd9b700 1 -- 172.21.15.57:0/2658408837 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0800b600 con 0x7f9e100b13f0 2021-06-25T04:55:01.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0dd9b700 1 -- 172.21.15.57:0/2658408837 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0800b760 con 0x7f9e100b13f0 2021-06-25T04:55:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2658408837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e100b13f0 msgr2=0x7f9e10066fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0f59e700 1 --2- 172.21.15.57:0/2658408837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e100b13f0 0x7f9e10066fc0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f9e080032f0 tx=0x7f9e080091d0).stop 2021-06-25T04:55:01.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0dd9b700 1 -- 172.21.15.57:0/2658408837 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0800b8d0 con 0x7f9e100b13f0 2021-06-25T04:55:01.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2021-06-25T04:55:01.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2021-06-25T04:55:01.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2658408837 shutdown_connections 2021-06-25T04:55:01.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0f59e700 1 --2- 172.21.15.57:0/2658408837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e100b13f0 0x7f9e10066fc0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0f59e700 1 --2- 172.21.15.57:0/2658408837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e100ac9f0 0x7f9e100b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2658408837 >> 172.21.15.57:0/2658408837 conn(0x7f9e10062520 msgr2=0x7f9e10062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:01.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2658408837 shutdown_connections 2021-06-25T04:55:01.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.104+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2658408837 wait complete. 2021-06-25T04:55:01.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0f59e700 1 Processor -- start 2021-06-25T04:55:01.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0f59e700 1 -- start start 2021-06-25T04:55:01.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e100ac9f0 0x7f9e1013d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e100ad830 0x7f9e1013c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e100b13f0 0x7f9e10140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0f59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e100ad440 con 0x7f9e100ac9f0 2021-06-25T04:55:01.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e101407a0 con 0x7f9e100ad830 2021-06-25T04:55:01.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10067590 con 0x7f9e100b13f0 2021-06-25T04:55:01.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e100ac9f0 0x7f9e1013d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e100ac9f0 0x7f9e1013d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41026/0 (socket says 172.21.15.57:41026) 2021-06-25T04:55:01.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0e59c700 1 -- 172.21.15.57:0/2735629254 learned_addr learned my addr 172.21.15.57:0/2735629254 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:01.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0ed9d700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e100b13f0 0x7f9e10140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e05d9b700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e100ad830 0x7f9e1013c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0e59c700 1 -- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e100b13f0 msgr2=0x7f9e10140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0e59c700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e100b13f0 0x7f9e10140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0e59c700 1 -- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e100ad830 msgr2=0x7f9e1013c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0e59c700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e100ad830 0x7f9e1013c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0e59c700 1 -- 172.21.15.57:0/2735629254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e08009470 con 0x7f9e100ac9f0 2021-06-25T04:55:01.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0ed9d700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e100b13f0 0x7f9e10140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:01.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0e59c700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e100ac9f0 0x7f9e1013d8d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f9e1013f7c0 tx=0x7f9e00006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:01.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e07fff700 1 -- 172.21.15.57:0/2735629254 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e00010780 con 0x7f9e100ac9f0 2021-06-25T04:55:01.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e07fff700 1 -- 172.21.15.57:0/2735629254 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e000108e0 con 0x7f9e100ac9f0 2021-06-25T04:55:01.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2735629254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1013fed0 con 0x7f9e100ac9f0 2021-06-25T04:55:01.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e07fff700 1 -- 172.21.15.57:0/2735629254 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e00010c40 con 0x7f9e100ac9f0 2021-06-25T04:55:01.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.108+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2735629254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e10140410 con 0x7f9e100ac9f0 2021-06-25T04:55:01.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.112+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2735629254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e10057310 con 0x7f9e100ac9f0 2021-06-25T04:55:01.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.112+0000 7f9e07fff700 1 -- 172.21.15.57:0/2735629254 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9e0001c460 con 0x7f9e100ac9f0 2021-06-25T04:55:01.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.112+0000 7f9e07fff700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9df4055450 0x7f9df4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.112+0000 7f9e07fff700 1 -- 172.21.15.57:0/2735629254 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9e0006e2c0 con 0x7f9e100ac9f0 2021-06-25T04:55:01.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.112+0000 7f9e05d9b700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9df4055450 0x7f9df4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.112+0000 7f9e05d9b700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9df4055450 0x7f9df4057910 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f9df800d000 tx=0x7f9df8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:01.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.116+0000 7f9e07fff700 1 -- 172.21.15.57:0/2735629254 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9e00044370 con 0x7f9e100ac9f0 2021-06-25T04:55:01.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.284+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2735629254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e1005f200 con 0x7f9e100ac9f0 2021-06-25T04:55:01.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e07fff700 1 -- 172.21.15.57:0/2735629254 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f9e00047990 con 0x7f9e100ac9f0 2021-06-25T04:55:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:01.291 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3853681312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3853681312},{"type":"v1","addr":"172.21.15.87:6835","nonce":3853681312}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6981,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2200404668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2200404668},{"type":"v1","addr":"172.21.15.57:6833","nonce":2200404668}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:58.730365+0000","modified":"2021-06-25T04:54:59.734569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3959946984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3959946984},{"type":"v1","addr":"172.21.15.57:6835","nonce":3959946984}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-06-25T04:55:01.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9df4055450 msgr2=0x7f9df4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9df4055450 0x7f9df4057910 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f9df800d000 tx=0x7f9df8009040).stop 2021-06-25T04:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2735629254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e100ac9f0 msgr2=0x7f9e1013d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e100ac9f0 0x7f9e1013d8d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f9e1013f7c0 tx=0x7f9e00006df0).stop 2021-06-25T04:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2735629254 shutdown_connections 2021-06-25T04:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9df4055450 0x7f9df4057910 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e100b13f0 0x7f9e10140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e100ad830 0x7f9e1013c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 --2- 172.21.15.57:0/2735629254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e100ac9f0 0x7f9e1013d8d0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2735629254 >> 172.21.15.57:0/2735629254 conn(0x7f9e10062520 msgr2=0x7f9e100b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:01.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2735629254 shutdown_connections 2021-06-25T04:55:01.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.288+0000 7f9e0f59e700 1 -- 172.21.15.57:0/2735629254 wait complete. 2021-06-25T04:55:01.296 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 47 2021-06-25T04:55:01.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:54:58.730365+0000', 'modified': '2021-06-25T04:54:59.734569+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6984}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6984': {'gid': 6984, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/3959946984', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 3959946984}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3959946984}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:55:01.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:55:01.609 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:55:01.726 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":6984,"want_state":"up:active","state":"up:active","rank_uptime":2.9824052999999999,"mdsmap_epoch":47,"osdmap_epoch":98,"osdmap_epoch_barrier":98,"uptime":7.3139022630000001} 2021-06-25T04:55:01.727 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 6984, "mdsmap_epoch": 47, "osdmap_epoch": 98, "osdmap_epoch_barrier": 98, "rank_uptime": 2.9824053, "state": "up:active", "uptime": 7.313902263, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:55:01.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:01.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.828+0000 7fdb3359e700 1 Processor -- start 2021-06-25T04:55:01.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.828+0000 7fdb3359e700 1 -- start start 2021-06-25T04:55:01.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdb340b52c0 0x7fdb3413e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb340b1420 0x7fdb3413e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb340aeee0 con 0x7fdb34141000 2021-06-25T04:55:01.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb340ac2c0 con 0x7fdb340b1420 2021-06-25T04:55:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340af110 con 0x7fdb340b52c0 2021-06-25T04:55:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb31d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb340b1420 0x7fdb3413e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb32d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdb34141000 0x7fdb341414b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58254/0 (socket says 172.21.15.57:58254) 2021-06-25T04:55:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb32d9d700 1 -- 172.21.15.57:0/2976264325 learned_addr learned my addr 172.21.15.57:0/2976264325 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3259c700 1 --2- 172.21.15.57:0/2976264325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdb340b52c0 0x7fdb3413e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb31d9b700 1 -- 172.21.15.57:0/2976264325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdb340b52c0 msgr2=0x7fdb3413e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:01.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb31d9b700 1 --2- 172.21.15.57:0/2976264325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdb340b52c0 0x7fdb3413e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb31d9b700 1 -- 172.21.15.57:0/2976264325 >> v1:172.21.15.57:6789/0 conn(0x7fdb34141000 legacy=0x7fdb341414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb31d9b700 1 -- 172.21.15.57:0/2976264325 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb340af3b0 con 0x7fdb340b1420 2021-06-25T04:55:01.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb31d9b700 1 --2- 172.21.15.57:0/2976264325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb340b1420 0x7fdb3413e560 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fdb240032f0 tx=0x7fdb240091d0).ready entity=mon.0 client_cookie=83a02a5901fa1b49 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:01.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3159a700 1 -- 172.21.15.57:0/2976264325 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb24009ea0 con 0x7fdb340b1420 2021-06-25T04:55:01.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3159a700 1 -- 172.21.15.57:0/2976264325 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2400b8a0 con 0x7fdb340b1420 2021-06-25T04:55:01.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3159a700 1 -- 172.21.15.57:0/2976264325 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb2400ba10 con 0x7fdb340b1420 2021-06-25T04:55:01.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 -- 172.21.15.57:0/2976264325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb340b1420 msgr2=0x7fdb3413e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 --2- 172.21.15.57:0/2976264325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb340b1420 0x7fdb3413e560 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fdb240032f0 tx=0x7fdb240091d0).stop 2021-06-25T04:55:01.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 -- 172.21.15.57:0/2976264325 shutdown_connections 2021-06-25T04:55:01.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 --2- 172.21.15.57:0/2976264325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb340b1420 0x7fdb3413e560 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 --2- 172.21.15.57:0/2976264325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdb340b52c0 0x7fdb3413e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 -- 172.21.15.57:0/2976264325 >> 172.21.15.57:0/2976264325 conn(0x7fdb34062520 msgr2=0x7fdb34062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:01.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 -- 172.21.15.57:0/2976264325 shutdown_connections 2021-06-25T04:55:01.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 -- 172.21.15.57:0/2976264325 wait complete. 2021-06-25T04:55:01.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.832+0000 7fdb3359e700 1 Processor -- start 2021-06-25T04:55:01.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb3359e700 1 -- start start 2021-06-25T04:55:01.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb3359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb340b1420 0x7fdb34146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb3359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb340b52c0 0x7fdb34150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb3359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdb34141000 0x7fdb34150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb3359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb34066f80 con 0x7fdb340b52c0 2021-06-25T04:55:01.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb3359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb34150230 con 0x7fdb340b1420 2021-06-25T04:55:01.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb3359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb34065410 con 0x7fdb34141000 2021-06-25T04:55:01.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb31d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb340b52c0 0x7fdb34150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb31d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb340b52c0 0x7fdb34150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41042/0 (socket says 172.21.15.57:41042) 2021-06-25T04:55:01.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb31d9b700 1 -- 172.21.15.57:0/2018571998 learned_addr learned my addr 172.21.15.57:0/2018571998 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:01.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb3259c700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb340b1420 0x7fdb34146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb32d9d700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdb34141000 0x7fdb34150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb31d9b700 1 -- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdb34141000 msgr2=0x7fdb34150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb31d9b700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdb34141000 0x7fdb34150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb31d9b700 1 -- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb340b1420 msgr2=0x7fdb34146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb31d9b700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb340b1420 0x7fdb34146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb31d9b700 1 -- 172.21.15.57:0/2018571998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb24009470 con 0x7fdb340b52c0 2021-06-25T04:55:01.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb3259c700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb340b1420 0x7fdb34146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:01.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb31d9b700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb340b52c0 0x7fdb34150620 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fdb240032f0 tx=0x7fdb24016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:01.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb2b7fe700 1 -- 172.21.15.57:0/2018571998 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb24011d70 con 0x7fdb340b52c0 2021-06-25T04:55:01.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb2b7fe700 1 -- 172.21.15.57:0/2018571998 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb24021440 con 0x7fdb340b52c0 2021-06-25T04:55:01.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb3359e700 1 -- 172.21.15.57:0/2018571998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb340663e0 con 0x7fdb340b52c0 2021-06-25T04:55:01.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb2b7fe700 1 -- 172.21.15.57:0/2018571998 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb240217a0 con 0x7fdb340b52c0 2021-06-25T04:55:01.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.836+0000 7fdb3359e700 1 -- 172.21.15.57:0/2018571998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb340b4020 con 0x7fdb340b52c0 2021-06-25T04:55:01.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.840+0000 7fdb3359e700 1 -- 172.21.15.57:0/2018571998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb340655d0 con 0x7fdb340b52c0 2021-06-25T04:55:01.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.840+0000 7fdb2b7fe700 1 -- 172.21.15.57:0/2018571998 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdb24027020 con 0x7fdb340b52c0 2021-06-25T04:55:01.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.840+0000 7fdb2b7fe700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdb18055510 0x7fdb180579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:01.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.840+0000 7fdb2b7fe700 1 -- 172.21.15.57:0/2018571998 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdb2406f230 con 0x7fdb340b52c0 2021-06-25T04:55:01.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.840+0000 7fdb3259c700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdb18055510 0x7fdb180579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:01.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.840+0000 7fdb3259c700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdb18055510 0x7fdb180579d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fdb1c00c000 tx=0x7fdb1c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:01.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.848+0000 7fdb2b7fe700 1 -- 172.21.15.57:0/2018571998 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdb240453e0 con 0x7fdb340b52c0 2021-06-25T04:55:01.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.972+0000 7fdb3359e700 1 -- 172.21.15.57:0/2018571998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb34057310 con 0x7fdb340b52c0 2021-06-25T04:55:01.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.972+0000 7fdb2b7fe700 1 -- 172.21.15.57:0/2018571998 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fdb24048a00 con 0x7fdb340b52c0 2021-06-25T04:55:01.978 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:01.978 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":98,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:59.733440+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:54:57.196707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-06-25T04:54:58.096573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:01.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 -- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdb18055510 msgr2=0x7fdb180579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdb18055510 0x7fdb180579d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fdb1c00c000 tx=0x7fdb1c008040).stop 2021-06-25T04:55:01.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 -- 172.21.15.57:0/2018571998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb340b52c0 msgr2=0x7fdb34150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:01.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb340b52c0 0x7fdb34150620 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fdb240032f0 tx=0x7fdb24016000).stop 2021-06-25T04:55:01.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 -- 172.21.15.57:0/2018571998 shutdown_connections 2021-06-25T04:55:01.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdb18055510 0x7fdb180579d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdb34141000 0x7fdb34150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb340b52c0 0x7fdb34150620 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 --2- 172.21.15.57:0/2018571998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb340b1420 0x7fdb34146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:01.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 -- 172.21.15.57:0/2018571998 >> 172.21.15.57:0/2018571998 conn(0x7fdb34062520 msgr2=0x7fdb3413d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:01.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 -- 172.21.15.57:0/2018571998 shutdown_connections 2021-06-25T04:55:01.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:01.976+0000 7fdb3359e700 1 -- 172.21.15.57:0/2018571998 wait complete. 2021-06-25T04:55:01.998 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:54:57.196707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:54:58.096573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:55:01.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:55:02.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a846700 1 Processor -- start 2021-06-25T04:55:02.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a846700 1 -- start start 2021-06-25T04:55:02.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a846700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69040a8a80 0x7f6904152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a846700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69040a7080 con 0x7f69040b2540 2021-06-25T04:55:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a846700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69040a72b0 con 0x7f69040affd0 2021-06-25T04:55:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a846700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69040a7550 con 0x7f69040a8a80 2021-06-25T04:55:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f6909844700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f69040b2540 0x7f690414ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58266/0 (socket says 172.21.15.57:58266) 2021-06-25T04:55:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f6909844700 1 -- 172.21.15.57:0/3265541930 learned_addr learned my addr 172.21.15.57:0/3265541930 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a045700 1 --2- 172.21.15.57:0/3265541930 >> v2:172.21.15.57:3300/0 conn(0x7f69040a8a80 0x7f6904152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f6908842700 1 -- 172.21.15.57:0/3265541930 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462514236 0 0) 0x7f69040a7080 con 0x7f69040b2540 2021-06-25T04:55:02.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f6908842700 1 -- 172.21.15.57:0/3265541930 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e8003260 con 0x7f69040b2540 2021-06-25T04:55:02.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a045700 1 -- 172.21.15.57:0/3265541930 >> v1:172.21.15.87:6789/0 conn(0x7f69040affd0 legacy=0x7f69040a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a045700 1 -- 172.21.15.57:0/3265541930 >> v1:172.21.15.57:6789/0 conn(0x7f69040b2540 legacy=0x7f690414ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a045700 1 -- 172.21.15.57:0/3265541930 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69040a77f0 con 0x7f69040a8a80 2021-06-25T04:55:02.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a045700 1 --2- 172.21.15.57:0/3265541930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69040a8a80 0x7f6904152ba0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f68fc0032f0 tx=0x7f68fc0091d0).ready entity=mon.0 client_cookie=7ff1ab0e2665a92d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f6908842700 1 -- 172.21.15.57:0/3265541930 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68fc00b6c0 con 0x7f69040a8a80 2021-06-25T04:55:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f6908842700 1 -- 172.21.15.57:0/3265541930 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc00b820 con 0x7f69040a8a80 2021-06-25T04:55:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f6908842700 1 -- 172.21.15.57:0/3265541930 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68fc00b990 con 0x7f69040a8a80 2021-06-25T04:55:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a846700 1 -- 172.21.15.57:0/3265541930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69040a8a80 msgr2=0x7f6904152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a846700 1 --2- 172.21.15.57:0/3265541930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69040a8a80 0x7f6904152ba0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f68fc0032f0 tx=0x7f68fc0091d0).stop 2021-06-25T04:55:02.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a846700 1 -- 172.21.15.57:0/3265541930 shutdown_connections 2021-06-25T04:55:02.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a846700 1 --2- 172.21.15.57:0/3265541930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69040a8a80 0x7f6904152ba0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.108+0000 7f690a846700 1 -- 172.21.15.57:0/3265541930 >> 172.21.15.57:0/3265541930 conn(0x7f6904060140 msgr2=0x7f69040b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f690a846700 1 -- 172.21.15.57:0/3265541930 shutdown_connections 2021-06-25T04:55:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f690a846700 1 -- 172.21.15.57:0/3265541930 wait complete. 2021-06-25T04:55:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f690a846700 1 Processor -- start 2021-06-25T04:55:02.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f690a846700 1 -- start start 2021-06-25T04:55:02.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f690a846700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69040a8a80 0x7f690414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f690a846700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69040affd0 0x7f69040b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f690a846700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69040b2540 0x7f69040674c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f690a846700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69040b3280 con 0x7f69040affd0 2021-06-25T04:55:02.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f690a846700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69040b4ed0 con 0x7f69040b2540 2021-06-25T04:55:02.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f690a846700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69040b5170 con 0x7f69040a8a80 2021-06-25T04:55:02.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f6909043700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69040affd0 0x7f69040b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f6909043700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69040affd0 0x7f69040b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41056/0 (socket says 172.21.15.57:41056) 2021-06-25T04:55:02.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f6909043700 1 -- 172.21.15.57:0/2365241863 learned_addr learned my addr 172.21.15.57:0/2365241863 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:02.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f6909844700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69040a8a80 0x7f690414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f690a045700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69040b2540 0x7f69040674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f6909043700 1 -- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69040a8a80 msgr2=0x7f690414d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f6909043700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69040a8a80 0x7f690414d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f6909043700 1 -- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69040b2540 msgr2=0x7f69040674c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f6909043700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69040b2540 0x7f69040674c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f6909043700 1 -- 172.21.15.57:0/2365241863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc009470 con 0x7f69040affd0 2021-06-25T04:55:02.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f6909043700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69040affd0 0x7f69040b2d90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f6904061a40 tx=0x7f6900007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.112+0000 7f68f6ffd700 1 -- 172.21.15.57:0/2365241863 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6900012400 con 0x7f69040affd0 2021-06-25T04:55:02.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.116+0000 7f68f6ffd700 1 -- 172.21.15.57:0/2365241863 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6900012560 con 0x7f69040affd0 2021-06-25T04:55:02.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.116+0000 7f690a846700 1 -- 172.21.15.57:0/2365241863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69040b5410 con 0x7f69040affd0 2021-06-25T04:55:02.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.116+0000 7f68f6ffd700 1 -- 172.21.15.57:0/2365241863 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69000128c0 con 0x7f69040affd0 2021-06-25T04:55:02.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.116+0000 7f690a846700 1 -- 172.21.15.57:0/2365241863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69040aba20 con 0x7f69040affd0 2021-06-25T04:55:02.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.116+0000 7f690a846700 1 -- 172.21.15.57:0/2365241863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6904057310 con 0x7f69040affd0 2021-06-25T04:55:02.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.116+0000 7f68f6ffd700 1 -- 172.21.15.57:0/2365241863 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6900019030 con 0x7f69040affd0 2021-06-25T04:55:02.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.116+0000 7f68f6ffd700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68ec0554e0 0x7f68ec0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.116+0000 7f68f6ffd700 1 -- 172.21.15.57:0/2365241863 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f690006d120 con 0x7f69040affd0 2021-06-25T04:55:02.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.116+0000 7f6909844700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68ec0554e0 0x7f68ec0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.116+0000 7f6909844700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68ec0554e0 0x7f68ec0579a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f68f800d000 tx=0x7f68f8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.120+0000 7f68f6ffd700 1 -- 172.21.15.57:0/2365241863 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f69000432d0 con 0x7f69040affd0 2021-06-25T04:55:02.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.248+0000 7f690a846700 1 -- 172.21.15.57:0/2365241863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f69040b3980 con 0x7f69040affd0 2021-06-25T04:55:02.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.248+0000 7f68f6ffd700 1 -- 172.21.15.57:0/2365241863 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v98) v1 ==== 110+0+10 (secure 0 0 0) 0x7f69000468f0 con 0x7f69040affd0 2021-06-25T04:55:02.255 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:55:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 -- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68ec0554e0 msgr2=0x7f68ec0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68ec0554e0 0x7f68ec0579a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f68f800d000 tx=0x7f68f8009040).stop 2021-06-25T04:55:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 -- 172.21.15.57:0/2365241863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69040affd0 msgr2=0x7f69040b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69040affd0 0x7f69040b2d90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f6904061a40 tx=0x7f6900007bf0).stop 2021-06-25T04:55:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 -- 172.21.15.57:0/2365241863 shutdown_connections 2021-06-25T04:55:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68ec0554e0 0x7f68ec0579a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69040b2540 0x7f69040674c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69040affd0 0x7f69040b2d90 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 --2- 172.21.15.57:0/2365241863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69040a8a80 0x7f690414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 -- 172.21.15.57:0/2365241863 >> 172.21.15.57:0/2365241863 conn(0x7f6904060140 msgr2=0x7f69041489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:02.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 -- 172.21.15.57:0/2365241863 shutdown_connections 2021-06-25T04:55:02.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.252+0000 7f690a846700 1 -- 172.21.15.57:0/2365241863 wait complete. 2021-06-25T04:55:02.267 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:55:02.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b7804700 1 Processor -- start 2021-06-25T04:55:02.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b7804700 1 -- start start 2021-06-25T04:55:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b7804700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b0146910 0x7f09b01401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b7804700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f09b00b4140 0x7f09b01406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b7804700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b0143b20 con 0x7f09b00b4650 2021-06-25T04:55:02.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b7804700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b01474d0 con 0x7f09b00b4140 2021-06-25T04:55:02.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b7804700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0143dc0 con 0x7f09b0146910 2021-06-25T04:55:02.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b55a0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b0146910 0x7f09b01401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b4d9f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f09b00b4140 0x7f09b01406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b55a0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b0146910 0x7f09b01401f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:52226/0 (socket says 172.21.15.57:52226) 2021-06-25T04:55:02.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b55a0700 1 -- 172.21.15.57:0/1234003343 learned_addr learned my addr 172.21.15.57:0/1234003343 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:02.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b5da1700 1 --1- 172.21.15.57:0/1234003343 >> v1:172.21.15.87:6789/0 conn(0x7f09b00b4650 0x7f09b00b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:59032/0 (socket says 172.21.15.57:59032) 2021-06-25T04:55:02.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b55a0700 1 -- 172.21.15.57:0/1234003343 >> v2:172.21.15.87:3300/0 conn(0x7f09b00b4140 msgr2=0x7f09b01406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b55a0700 1 --2- 172.21.15.57:0/1234003343 >> v2:172.21.15.87:3300/0 conn(0x7f09b00b4140 0x7f09b01406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b55a0700 1 -- 172.21.15.57:0/1234003343 >> v1:172.21.15.87:6789/0 conn(0x7f09b00b4650 legacy=0x7f09b00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b55a0700 1 -- 172.21.15.57:0/1234003343 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b00b0c50 con 0x7f09b0146910 2021-06-25T04:55:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b4d9f700 1 --2- 172.21.15.57:0/1234003343 >> v2:172.21.15.87:3300/0 conn(0x7f09b00b4140 0x7f09b01406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:02.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b55a0700 1 --2- 172.21.15.57:0/1234003343 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b0146910 0x7f09b01401f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f09ac002f70 tx=0x7f09ac006eb0).ready entity=mon.2 client_cookie=af6c25e70caaeae7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09a7fff700 1 -- 172.21.15.57:0/1234003343 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ac00d570 con 0x7f09b0146910 2021-06-25T04:55:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09a7fff700 1 -- 172.21.15.57:0/1234003343 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac000e90 con 0x7f09b0146910 2021-06-25T04:55:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09a7fff700 1 -- 172.21.15.57:0/1234003343 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ac00d900 con 0x7f09b0146910 2021-06-25T04:55:02.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b7804700 1 -- 172.21.15.57:0/1234003343 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b0146910 msgr2=0x7f09b01401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.376+0000 7f09b7804700 1 --2- 172.21.15.57:0/1234003343 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b0146910 0x7f09b01401f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f09ac002f70 tx=0x7f09ac006eb0).stop 2021-06-25T04:55:02.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.380+0000 7f09b7804700 1 -- 172.21.15.57:0/1234003343 shutdown_connections 2021-06-25T04:55:02.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.380+0000 7f09b7804700 1 --2- 172.21.15.57:0/1234003343 >> v2:172.21.15.87:3300/0 conn(0x7f09b00b4140 0x7f09b01406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.380+0000 7f09b7804700 1 --2- 172.21.15.57:0/1234003343 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b0146910 0x7f09b01401f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.380+0000 7f09b7804700 1 -- 172.21.15.57:0/1234003343 >> 172.21.15.57:0/1234003343 conn(0x7f09b005c450 msgr2=0x7f09b005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:02.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.380+0000 7f09b7804700 1 -- 172.21.15.57:0/1234003343 shutdown_connections 2021-06-25T04:55:02.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.380+0000 7f09b7804700 1 -- 172.21.15.57:0/1234003343 wait complete. 2021-06-25T04:55:02.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.380+0000 7f09b7804700 1 Processor -- start 2021-06-25T04:55:02.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.380+0000 7f09b7804700 1 -- start start 2021-06-25T04:55:02.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.380+0000 7f09b7804700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b00b4140 0x7f09b00b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.380+0000 7f09b7804700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00b4650 0x7f09b013dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.380+0000 7f09b7804700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09b0146910 0x7f09b013e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b7804700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0142140 con 0x7f09b00b4650 2021-06-25T04:55:02.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b7804700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00b5cc0 con 0x7f09b0146910 2021-06-25T04:55:02.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b7804700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0156250 con 0x7f09b00b4140 2021-06-25T04:55:02.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b4d9f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00b4650 0x7f09b013dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b55a0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b00b4140 0x7f09b00b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b5da1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09b0146910 0x7f09b013e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b4d9f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00b4650 0x7f09b013dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41070/0 (socket says 172.21.15.57:41070) 2021-06-25T04:55:02.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b4d9f700 1 -- 172.21.15.57:0/2241180879 learned_addr learned my addr 172.21.15.57:0/2241180879 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:02.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b55a0700 1 -- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09b0146910 msgr2=0x7f09b013e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b55a0700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09b0146910 0x7f09b013e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b55a0700 1 -- 172.21.15.57:0/2241180879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00b4650 msgr2=0x7f09b013dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b55a0700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00b4650 0x7f09b013dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b55a0700 1 -- 172.21.15.57:0/2241180879 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a000b180 con 0x7f09b00b4140 2021-06-25T04:55:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b55a0700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b00b4140 0x7f09b00b8c00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f09ac002f70 tx=0x7f09ac015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09a67fc700 1 -- 172.21.15.57:0/2241180879 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ac021070 con 0x7f09b00b4140 2021-06-25T04:55:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09a67fc700 1 -- 172.21.15.57:0/2241180879 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac0116e0 con 0x7f09b00b4140 2021-06-25T04:55:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b7804700 1 -- 172.21.15.57:0/2241180879 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ac00b1e0 con 0x7f09b00b4140 2021-06-25T04:55:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09a67fc700 1 -- 172.21.15.57:0/2241180879 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ac011a40 con 0x7f09b00b4140 2021-06-25T04:55:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b7804700 1 -- 172.21.15.57:0/2241180879 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b013e980 con 0x7f09b00b4140 2021-06-25T04:55:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09b7804700 1 -- 172.21.15.57:0/2241180879 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b01521c0 con 0x7f09b00b4140 2021-06-25T04:55:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.384+0000 7f09a67fc700 1 -- 172.21.15.57:0/2241180879 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f09ac00f070 con 0x7f09b00b4140 2021-06-25T04:55:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.388+0000 7f09a67fc700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0998055450 0x7f0998057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.388+0000 7f09a67fc700 1 -- 172.21.15.57:0/2241180879 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f09ac06ebb0 con 0x7f09b00b4140 2021-06-25T04:55:02.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.388+0000 7f09b4d9f700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0998055450 0x7f0998057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.388+0000 7f09b4d9f700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0998055450 0x7f0998057910 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f09a000b000 tx=0x7f09a0006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.396+0000 7f09a67fc700 1 -- 172.21.15.57:0/2241180879 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f09b01521c0 con 0x7f09b00b4140 2021-06-25T04:55:02.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.524+0000 7f09b7804700 1 -- 172.21.15.57:0/2241180879 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09b01521c0 con 0x7f09b00b4140 2021-06-25T04:55:02.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.524+0000 7f09a67fc700 1 -- 172.21.15.57:0/2241180879 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f09b01521c0 con 0x7f09b00b4140 2021-06-25T04:55:02.530 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 -- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0998055450 msgr2=0x7f0998057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0998055450 0x7f0998057910 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f09a000b000 tx=0x7f09a0006df0).stop 2021-06-25T04:55:02.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 -- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b00b4140 msgr2=0x7f09b00b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b00b4140 0x7f09b00b8c00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f09ac002f70 tx=0x7f09ac015000).stop 2021-06-25T04:55:02.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 -- 172.21.15.57:0/2241180879 shutdown_connections 2021-06-25T04:55:02.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0998055450 0x7f0998057910 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09b0146910 0x7f09b013e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00b4650 0x7f09b013dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 --2- 172.21.15.57:0/2241180879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09b00b4140 0x7f09b00b8c00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 -- 172.21.15.57:0/2241180879 >> 172.21.15.57:0/2241180879 conn(0x7f09b005c450 msgr2=0x7f09b013f720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:02.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 -- 172.21.15.57:0/2241180879 shutdown_connections 2021-06-25T04:55:02.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.528+0000 7f09b7804700 1 -- 172.21.15.57:0/2241180879 wait complete. 2021-06-25T04:55:02.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:55:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.656+0000 7f8b0ffff700 1 Processor -- start 2021-06-25T04:55:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.656+0000 7f8b0ffff700 1 -- start start 2021-06-25T04:55:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.656+0000 7f8b0ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b100b63f0 0x7f8b10061430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.656+0000 7f8b0ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b100b4020 0x7f8b10061920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.656+0000 7f8b0ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8b10147bb0 0x7f8b10144460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.656+0000 7f8b0ffff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b100b1460 con 0x7f8b10147bb0 2021-06-25T04:55:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.656+0000 7f8b0ffff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b10061e10 con 0x7f8b100b4020 2021-06-25T04:55:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.656+0000 7f8b0ffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100b1f30 con 0x7f8b100b63f0 2021-06-25T04:55:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8b10147bb0 0x7f8b10144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0e7fc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b100b4020 0x7f8b10061920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0effd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b100b63f0 0x7f8b10061430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0e7fc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b100b4020 0x7f8b10061920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:49570/0 (socket says 172.21.15.57:49570) 2021-06-25T04:55:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8b10147bb0 0x7f8b10144460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41080/0 (socket says 172.21.15.57:41080) 2021-06-25T04:55:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0e7fc700 1 -- 172.21.15.57:0/171324813 learned_addr learned my addr 172.21.15.57:0/171324813 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0e7fc700 1 -- 172.21.15.57:0/171324813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b100b63f0 msgr2=0x7f8b10061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0e7fc700 1 --2- 172.21.15.57:0/171324813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b100b63f0 0x7f8b10061430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0e7fc700 1 -- 172.21.15.57:0/171324813 >> v2:172.21.15.57:3300/0 conn(0x7f8b10147bb0 msgr2=0x7f8b10144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0e7fc700 1 --2- 172.21.15.57:0/171324813 >> v2:172.21.15.57:3300/0 conn(0x7f8b10147bb0 0x7f8b10144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0e7fc700 1 -- 172.21.15.57:0/171324813 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100b67d0 con 0x7f8b100b4020 2021-06-25T04:55:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0e7fc700 1 --2- 172.21.15.57:0/171324813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b100b4020 0x7f8b10061920 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f8b04002f70 tx=0x7f8b04006eb0).ready entity=mon.1 client_cookie=f89115af980ce455 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0dffb700 1 -- 172.21.15.57:0/171324813 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0400d570 con 0x7f8b100b4020 2021-06-25T04:55:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0dffb700 1 -- 172.21.15.57:0/171324813 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b04000e90 con 0x7f8b100b4020 2021-06-25T04:55:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0dffb700 1 -- 172.21.15.57:0/171324813 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0400d8c0 con 0x7f8b100b4020 2021-06-25T04:55:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0ffff700 1 -- 172.21.15.57:0/171324813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b100b4020 msgr2=0x7f8b10061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0ffff700 1 --2- 172.21.15.57:0/171324813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b100b4020 0x7f8b10061920 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f8b04002f70 tx=0x7f8b04006eb0).stop 2021-06-25T04:55:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0ffff700 1 -- 172.21.15.57:0/171324813 shutdown_connections 2021-06-25T04:55:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0ffff700 1 --2- 172.21.15.57:0/171324813 >> v2:172.21.15.57:3300/0 conn(0x7f8b10147bb0 0x7f8b10144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0ffff700 1 --2- 172.21.15.57:0/171324813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b100b4020 0x7f8b10061920 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0ffff700 1 --2- 172.21.15.57:0/171324813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b100b63f0 0x7f8b10061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0ffff700 1 -- 172.21.15.57:0/171324813 >> 172.21.15.57:0/171324813 conn(0x7f8b1005c450 msgr2=0x7f8b1005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0ffff700 1 -- 172.21.15.57:0/171324813 shutdown_connections 2021-06-25T04:55:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.660+0000 7f8b0ffff700 1 -- 172.21.15.57:0/171324813 wait complete. 2021-06-25T04:55:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0ffff700 1 Processor -- start 2021-06-25T04:55:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0ffff700 1 -- start start 2021-06-25T04:55:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b100b4020 0x7f8b10144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b100b63f0 0x7f8b10143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b10147bb0 0x7f8b10143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0ffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100b03e0 con 0x7f8b10147bb0 2021-06-25T04:55:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0ffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1015a470 con 0x7f8b100b63f0 2021-06-25T04:55:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0ffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1015a710 con 0x7f8b100b4020 2021-06-25T04:55:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b10147bb0 0x7f8b10143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b10147bb0 0x7f8b10143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41086/0 (socket says 172.21.15.57:41086) 2021-06-25T04:55:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0f7fe700 1 -- 172.21.15.57:0/3707460700 learned_addr learned my addr 172.21.15.57:0/3707460700 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0e7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b100b63f0 0x7f8b10143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0effd700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b100b4020 0x7f8b10144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0f7fe700 1 -- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b100b4020 msgr2=0x7f8b10144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0f7fe700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b100b4020 0x7f8b10144ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0f7fe700 1 -- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b100b63f0 msgr2=0x7f8b10143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0f7fe700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b100b63f0 0x7f8b10143580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0f7fe700 1 -- 172.21.15.57:0/3707460700 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0400b1e0 con 0x7f8b10147bb0 2021-06-25T04:55:02.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0f7fe700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b10147bb0 0x7f8b10143a70 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f8b0800c000 tx=0x7f8b080091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8afffff700 1 -- 172.21.15.57:0/3707460700 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b08012600 con 0x7f8b10147bb0 2021-06-25T04:55:02.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8afffff700 1 -- 172.21.15.57:0/3707460700 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b08012760 con 0x7f8b10147bb0 2021-06-25T04:55:02.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0ffff700 1 -- 172.21.15.57:0/3707460700 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b10143f60 con 0x7f8b10147bb0 2021-06-25T04:55:02.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8afffff700 1 -- 172.21.15.57:0/3707460700 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b08012ac0 con 0x7f8b10147bb0 2021-06-25T04:55:02.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.664+0000 7f8b0ffff700 1 -- 172.21.15.57:0/3707460700 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b100af710 con 0x7f8b10147bb0 2021-06-25T04:55:02.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.668+0000 7f8afffff700 1 -- 172.21.15.57:0/3707460700 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8b08022070 con 0x7f8b10147bb0 2021-06-25T04:55:02.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.668+0000 7f8afffff700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8aec055450 0x7f8aec057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.668+0000 7f8afffff700 1 -- 172.21.15.57:0/3707460700 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8b0806e430 con 0x7f8b10147bb0 2021-06-25T04:55:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.668+0000 7f8b0ffff700 1 -- 172.21.15.57:0/3707460700 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b100b05a0 con 0x7f8b10147bb0 2021-06-25T04:55:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.668+0000 7f8b0effd700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8aec055450 0x7f8aec057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.668+0000 7f8b0effd700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8aec055450 0x7f8aec057910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f8b0000b000 tx=0x7f8b00006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.672+0000 7f8afffff700 1 -- 172.21.15.57:0/3707460700 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8b08044580 con 0x7f8b10147bb0 2021-06-25T04:55:02.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.804+0000 7f8b0ffff700 1 -- 172.21.15.57:0/3707460700 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b10057310 con 0x7f8b10147bb0 2021-06-25T04:55:02.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.804+0000 7f8afffff700 1 -- 172.21.15.57:0/3707460700 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8b08016030 con 0x7f8b10147bb0 2021-06-25T04:55:02.809 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:02.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 -- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8aec055450 msgr2=0x7f8aec057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8aec055450 0x7f8aec057910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f8b0000b000 tx=0x7f8b00006df0).stop 2021-06-25T04:55:02.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 -- 172.21.15.57:0/3707460700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b10147bb0 msgr2=0x7f8b10143a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b10147bb0 0x7f8b10143a70 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f8b0800c000 tx=0x7f8b080091d0).stop 2021-06-25T04:55:02.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 -- 172.21.15.57:0/3707460700 shutdown_connections 2021-06-25T04:55:02.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8aec055450 0x7f8aec057910 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b10147bb0 0x7f8b10143a70 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b100b63f0 0x7f8b10143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 --2- 172.21.15.57:0/3707460700 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b100b4020 0x7f8b10144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 -- 172.21.15.57:0/3707460700 >> 172.21.15.57:0/3707460700 conn(0x7f8b1005c450 msgr2=0x7f8b10061620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:02.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 -- 172.21.15.57:0/3707460700 shutdown_connections 2021-06-25T04:55:02.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.808+0000 7f8b0ffff700 1 -- 172.21.15.57:0/3707460700 wait complete. 2021-06-25T04:55:02.824 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:55:02.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.928+0000 7f2c94f44700 1 Processor -- start 2021-06-25T04:55:02.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.928+0000 7f2c94f44700 1 -- start start 2021-06-25T04:55:02.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.928+0000 7f2c94f44700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900ad580 0x7f2c900616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.928+0000 7f2c94f44700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2c90140400 0x7f2c901408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.928+0000 7f2c94f44700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c900aecb0 con 0x7f2c900612e0 2021-06-25T04:55:02.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.928+0000 7f2c94f44700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c900b6ee0 con 0x7f2c90140400 2021-06-25T04:55:02.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.928+0000 7f2c94f44700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c900aeee0 con 0x7f2c900ad580 2021-06-25T04:55:02.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.928+0000 7f2c8f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2c900612e0 0x7f2c900b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58308/0 (socket says 172.21.15.57:58308) 2021-06-25T04:55:02.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.928+0000 7f2c8f7fe700 1 -- 172.21.15.57:0/901957029 learned_addr learned my addr 172.21.15.57:0/901957029 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:02.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.928+0000 7f2c8ffff700 1 --2- 172.21.15.57:0/901957029 >> v2:172.21.15.87:3300/0 conn(0x7f2c90140400 0x7f2c901408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.928+0000 7f2c8effd700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900ad580 0x7f2c900616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999067971 0 0) 0x7f2c900aecb0 con 0x7f2c900612e0 2021-06-25T04:55:02.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c7c003260 con 0x7f2c900612e0 2021-06-25T04:55:02.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2210967505 0 0) 0x7f2c7c003260 con 0x7f2c900612e0 2021-06-25T04:55:02.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900ad580 msgr2=0x7f2c900616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:02.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900ad580 0x7f2c900616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 >> v2:172.21.15.87:3300/0 conn(0x7f2c90140400 msgr2=0x7f2c901408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:02.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 --2- 172.21.15.57:0/901957029 >> v2:172.21.15.87:3300/0 conn(0x7f2c90140400 0x7f2c901408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c900af180 con 0x7f2c900612e0 2021-06-25T04:55:02.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f2c80001660 con 0x7f2c900612e0 2021-06-25T04:55:02.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8ffff700 1 --2- 172.21.15.57:0/901957029 >> v2:172.21.15.87:3300/0 conn(0x7f2c90140400 0x7f2c901408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:02.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 >> v1:172.21.15.57:6789/0 conn(0x7f2c900612e0 legacy=0x7f2c900b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900ad580 0x7f2c7c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7c003c80 0x7f2c7c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c7c0049f0 0x7f2c7c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c900b6ee0 con 0x7f2c7c003c80 2021-06-25T04:55:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c900aeee0 con 0x7f2c7c0049f0 2021-06-25T04:55:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c00b750 con 0x7f2c900ad580 2021-06-25T04:55:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8effd700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7c003c80 0x7f2c7c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8f7fe700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900ad580 0x7f2c7c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8ffff700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c7c0049f0 0x7f2c7c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8effd700 1 -- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900ad580 msgr2=0x7f2c7c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8effd700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900ad580 0x7f2c7c003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8effd700 1 -- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c7c0049f0 msgr2=0x7f2c7c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8effd700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c7c0049f0 0x7f2c7c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8effd700 1 -- 172.21.15.57:0/901957029 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c003260 con 0x7f2c7c003c80 2021-06-25T04:55:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8ffff700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c7c0049f0 0x7f2c7c004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8effd700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7c003c80 0x7f2c7c004500 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f2c7c0054d0 tx=0x7f2c84006df0).ready entity=mon.0 client_cookie=dbb12d3bab60392f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c8400e830 con 0x7f2c7c003c80 2021-06-25T04:55:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8400be90 con 0x7f2c7c003c80 2021-06-25T04:55:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8e7fc700 1 -- 172.21.15.57:0/901957029 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c8400eb80 con 0x7f2c7c003c80 2021-06-25T04:55:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c94f44700 1 -- 172.21.15.57:0/901957029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7c003c80 msgr2=0x7f2c7c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c94f44700 1 --2- 172.21.15.57:0/901957029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7c003c80 0x7f2c7c004500 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f2c7c0054d0 tx=0x7f2c84006df0).stop 2021-06-25T04:55:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c8ffff700 1 -- 172.21.15.57:0/901957029 reap_dead start 2021-06-25T04:55:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c94f44700 1 -- 172.21.15.57:0/901957029 shutdown_connections 2021-06-25T04:55:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c94f44700 1 -- 172.21.15.57:0/901957029 >> 172.21.15.57:0/901957029 conn(0x7f2c90066da0 msgr2=0x7f2c90067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c94f44700 1 -- 172.21.15.57:0/901957029 shutdown_connections 2021-06-25T04:55:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.932+0000 7f2c94f44700 1 -- 172.21.15.57:0/901957029 wait complete. 2021-06-25T04:55:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c94f44700 1 Processor -- start 2021-06-25T04:55:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c94f44700 1 -- start start 2021-06-25T04:55:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c94f44700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900b8a20 0x7f2c900afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c94f44700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c900b0170 0x7f2c90155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c94f44700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c900b0b20 0x7f2c90156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c94f44700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c900b8e00 con 0x7f2c900b0b20 2021-06-25T04:55:02.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c94f44700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9009e9f0 con 0x7f2c900b0170 2021-06-25T04:55:02.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c94f44700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9009ec90 con 0x7f2c900b8a20 2021-06-25T04:55:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c900b0b20 0x7f2c90156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c900b0b20 0x7f2c90156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41106/0 (socket says 172.21.15.57:41106) 2021-06-25T04:55:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8ffff700 1 -- 172.21.15.57:0/2131182714 learned_addr learned my addr 172.21.15.57:0/2131182714 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:02.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8f7fe700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900b8a20 0x7f2c900afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8effd700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c900b0170 0x7f2c90155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8ffff700 1 -- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900b8a20 msgr2=0x7f2c900afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8ffff700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900b8a20 0x7f2c900afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8ffff700 1 -- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c900b0170 msgr2=0x7f2c90155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:02.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8ffff700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c900b0170 0x7f2c90155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:02.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8ffff700 1 -- 172.21.15.57:0/2131182714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c900b1ef0 con 0x7f2c900b0b20 2021-06-25T04:55:02.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8ffff700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c900b0b20 0x7f2c90156230 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f2c8800b000 tx=0x7f2c88008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8cff9700 1 -- 172.21.15.57:0/2131182714 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c88013620 con 0x7f2c900b0b20 2021-06-25T04:55:02.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8cff9700 1 -- 172.21.15.57:0/2131182714 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88013780 con 0x7f2c900b0b20 2021-06-25T04:55:02.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c8cff9700 1 -- 172.21.15.57:0/2131182714 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c880138f0 con 0x7f2c900b0b20 2021-06-25T04:55:02.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c94f44700 1 -- 172.21.15.57:0/2131182714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c900b39b0 con 0x7f2c900b0b20 2021-06-25T04:55:02.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.936+0000 7f2c94f44700 1 -- 172.21.15.57:0/2131182714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c901568c0 con 0x7f2c900b0b20 2021-06-25T04:55:02.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.940+0000 7f2c94f44700 1 -- 172.21.15.57:0/2131182714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9009ee50 con 0x7f2c900b0b20 2021-06-25T04:55:02.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.940+0000 7f2c8cff9700 1 -- 172.21.15.57:0/2131182714 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2c8800f070 con 0x7f2c900b0b20 2021-06-25T04:55:02.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.940+0000 7f2c8cff9700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c700553f0 0x7f2c700578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:02.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.940+0000 7f2c8cff9700 1 -- 172.21.15.57:0/2131182714 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2c8806e510 con 0x7f2c900b0b20 2021-06-25T04:55:02.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.940+0000 7f2c8f7fe700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c700553f0 0x7f2c700578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:02.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.940+0000 7f2c8f7fe700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c700553f0 0x7f2c700578b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f2c80005000 tx=0x7f2c900af310).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:02.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:02.948+0000 7f2c8cff9700 1 -- 172.21.15.57:0/2131182714 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2c88044530 con 0x7f2c900b0b20 2021-06-25T04:55:03.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 -- 172.21.15.57:0/2131182714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c90057310 con 0x7f2c900b0b20 2021-06-25T04:55:03.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c8cff9700 1 -- 172.21.15.57:0/2131182714 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2c88047b50 con 0x7f2c900b0b20 2021-06-25T04:55:03.088 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:03.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 -- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c700553f0 msgr2=0x7f2c700578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:03.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c700553f0 0x7f2c700578b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f2c80005000 tx=0x7f2c900af310).stop 2021-06-25T04:55:03.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 -- 172.21.15.57:0/2131182714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c900b0b20 msgr2=0x7f2c90156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:03.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c900b0b20 0x7f2c90156230 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f2c8800b000 tx=0x7f2c88008040).stop 2021-06-25T04:55:03.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 -- 172.21.15.57:0/2131182714 shutdown_connections 2021-06-25T04:55:03.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c700553f0 0x7f2c700578b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c900b0b20 0x7f2c90156230 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c900b0170 0x7f2c90155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 --2- 172.21.15.57:0/2131182714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c900b8a20 0x7f2c900afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 -- 172.21.15.57:0/2131182714 >> 172.21.15.57:0/2131182714 conn(0x7f2c90066da0 msgr2=0x7f2c900b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:03.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 -- 172.21.15.57:0/2131182714 shutdown_connections 2021-06-25T04:55:03.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.084+0000 7f2c94f44700 1 -- 172.21.15.57:0/2131182714 wait complete. 2021-06-25T04:55:03.101 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:55:03.101 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:03.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.196+0000 7fd8a60cf700 1 Processor -- start 2021-06-25T04:55:03.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.196+0000 7fd8a60cf700 1 -- start start 2021-06-25T04:55:03.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a00b05d0 0x7fd8a00af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:03.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8a0147560 0x7fd8a00acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:03.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a00b5840 con 0x7fd8a00b5460 2021-06-25T04:55:03.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a01452a0 con 0x7fd8a0147560 2021-06-25T04:55:03.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00adfb0 con 0x7fd8a00b05d0 2021-06-25T04:55:03.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a58ce700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8a0147560 0x7fd8a00acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:03.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a58ce700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8a0147560 0x7fd8a00acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41114/0 (socket says 172.21.15.57:41114) 2021-06-25T04:55:03.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a58ce700 1 -- 172.21.15.57:0/1719252323 learned_addr learned my addr 172.21.15.57:0/1719252323 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:03.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a48cc700 1 --2- 172.21.15.57:0/1719252323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a00b05d0 0x7fd8a00af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:03.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a58ce700 1 -- 172.21.15.57:0/1719252323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a00b05d0 msgr2=0x7fd8a00af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:03.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a58ce700 1 --2- 172.21.15.57:0/1719252323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a00b05d0 0x7fd8a00af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a58ce700 1 -- 172.21.15.57:0/1719252323 >> v1:172.21.15.87:6789/0 conn(0x7fd8a00b5460 legacy=0x7fd8a0067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:03.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a58ce700 1 -- 172.21.15.57:0/1719252323 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00ac7c0 con 0x7fd8a0147560 2021-06-25T04:55:03.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a58ce700 1 --2- 172.21.15.57:0/1719252323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8a0147560 0x7fd8a00acc20 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7fd898002f70 tx=0x7fd898006eb0).ready entity=mon.0 client_cookie=24ce81524fdf00c1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:03.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd897fff700 1 -- 172.21.15.57:0/1719252323 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd89800d570 con 0x7fd8a0147560 2021-06-25T04:55:03.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd897fff700 1 -- 172.21.15.57:0/1719252323 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898000e90 con 0x7fd8a0147560 2021-06-25T04:55:03.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd897fff700 1 -- 172.21.15.57:0/1719252323 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd89800d900 con 0x7fd8a0147560 2021-06-25T04:55:03.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1719252323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8a0147560 msgr2=0x7fd8a00acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:03.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 --2- 172.21.15.57:0/1719252323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8a0147560 0x7fd8a00acc20 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7fd898002f70 tx=0x7fd898006eb0).stop 2021-06-25T04:55:03.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1719252323 shutdown_connections 2021-06-25T04:55:03.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 --2- 172.21.15.57:0/1719252323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8a0147560 0x7fd8a00acc20 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 --2- 172.21.15.57:0/1719252323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a00b05d0 0x7fd8a00af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1719252323 >> 172.21.15.57:0/1719252323 conn(0x7fd8a0062520 msgr2=0x7fd8a0062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:03.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1719252323 shutdown_connections 2021-06-25T04:55:03.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.200+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1719252323 wait complete. 2021-06-25T04:55:03.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a60cf700 1 Processor -- start 2021-06-25T04:55:03.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a60cf700 1 -- start start 2021-06-25T04:55:03.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a60cf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8a00b05d0 0x7fd8a00b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:03.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a60cf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a00b5460 0x7fd8a0065410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:03.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a60cf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a0147560 0x7fd8a0065900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:03.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a60cf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0064630 con 0x7fd8a00b05d0 2021-06-25T04:55:03.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a60cf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a014d830 con 0x7fd8a0147560 2021-06-25T04:55:03.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a60cf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a014dfe0 con 0x7fd8a00b5460 2021-06-25T04:55:03.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a50cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8a00b05d0 0x7fd8a00b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:03.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a50cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8a00b05d0 0x7fd8a00b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41116/0 (socket says 172.21.15.57:41116) 2021-06-25T04:55:03.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a50cd700 1 -- 172.21.15.57:0/1405584821 learned_addr learned my addr 172.21.15.57:0/1405584821 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:03.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a48cc700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a00b5460 0x7fd8a0065410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:03.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a58ce700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a0147560 0x7fd8a0065900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a50cd700 1 -- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a00b5460 msgr2=0x7fd8a0065410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a50cd700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a00b5460 0x7fd8a0065410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a50cd700 1 -- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a0147560 msgr2=0x7fd8a0065900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a50cd700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a0147560 0x7fd8a0065900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a50cd700 1 -- 172.21.15.57:0/1405584821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89800b1e0 con 0x7fd8a00b05d0 2021-06-25T04:55:03.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a48cc700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a00b5460 0x7fd8a0065410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:03.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a50cd700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8a00b05d0 0x7fd8a00b42d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7fd8a00ac5a0 tx=0x7fd890007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:03.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8967fc700 1 -- 172.21.15.57:0/1405584821 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd89000ce00 con 0x7fd8a00b05d0 2021-06-25T04:55:03.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8967fc700 1 -- 172.21.15.57:0/1405584821 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd890007240 con 0x7fd8a00b05d0 2021-06-25T04:55:03.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1405584821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a0065df0 con 0x7fd8a00b05d0 2021-06-25T04:55:03.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8967fc700 1 -- 172.21.15.57:0/1405584821 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd890006700 con 0x7fd8a00b05d0 2021-06-25T04:55:03.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.204+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1405584821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a0063f40 con 0x7fd8a00b05d0 2021-06-25T04:55:03.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.208+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1405584821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a014d9f0 con 0x7fd8a00b05d0 2021-06-25T04:55:03.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.208+0000 7fd8967fc700 1 -- 172.21.15.57:0/1405584821 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd890010030 con 0x7fd8a00b05d0 2021-06-25T04:55:03.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.208+0000 7fd8967fc700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8880554e0 0x7fd8880579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:03.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.208+0000 7fd8967fc700 1 -- 172.21.15.57:0/1405584821 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd89006dd70 con 0x7fd8a00b05d0 2021-06-25T04:55:03.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.208+0000 7fd8a48cc700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8880554e0 0x7fd8880579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:03.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.208+0000 7fd8a48cc700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8880554e0 0x7fd8880579a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fd89c00b000 tx=0x7fd89c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:03.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.212+0000 7fd8967fc700 1 -- 172.21.15.57:0/1405584821 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd890043e10 con 0x7fd8a00b05d0 2021-06-25T04:55:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.372+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1405584821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8a0057310 con 0x7fd8a00b05d0 2021-06-25T04:55:03.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.372+0000 7fd8967fc700 1 -- 172.21.15.57:0/1405584821 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fd890047430 con 0x7fd8a00b05d0 2021-06-25T04:55:03.377 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:03.378 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3853681312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3853681312},{"type":"v1","addr":"172.21.15.87:6835","nonce":3853681312}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6981,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2200404668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2200404668},{"type":"v1","addr":"172.21.15.57:6833","nonce":2200404668}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:58.730365+0000","modified":"2021-06-25T04:54:59.734569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3959946984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3959946984},{"type":"v1","addr":"172.21.15.57:6835","nonce":3959946984}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-06-25T04:55:03.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8880554e0 msgr2=0x7fd8880579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:03.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8880554e0 0x7fd8880579a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fd89c00b000 tx=0x7fd89c008040).stop 2021-06-25T04:55:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1405584821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8a00b05d0 msgr2=0x7fd8a00b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8a00b05d0 0x7fd8a00b42d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7fd8a00ac5a0 tx=0x7fd890007c10).stop 2021-06-25T04:55:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1405584821 shutdown_connections 2021-06-25T04:55:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8880554e0 0x7fd8880579a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8a0147560 0x7fd8a0065900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8a00b5460 0x7fd8a0065410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 --2- 172.21.15.57:0/1405584821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8a00b05d0 0x7fd8a00b42d0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:03.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1405584821 >> 172.21.15.57:0/1405584821 conn(0x7fd8a0062520 msgr2=0x7fd8a00ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:03.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1405584821 shutdown_connections 2021-06-25T04:55:03.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:03.376+0000 7fd8a60cf700 1 -- 172.21.15.57:0/1405584821 wait complete. 2021-06-25T04:55:03.382 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 47 2021-06-25T04:55:03.694 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:54:58.730365+0000', 'modified': '2021-06-25T04:54:59.734569+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6984}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6984': {'gid': 6984, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/3959946984', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 3959946984}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3959946984}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:55:03.694 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:55:03.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:55:03.815 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":6984,"want_state":"up:active","state":"up:active","rank_uptime":5.0711987289999998,"mdsmap_epoch":47,"osdmap_epoch":98,"osdmap_epoch_barrier":98,"uptime":9.4027023009999997} 2021-06-25T04:55:03.816 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 6984, "mdsmap_epoch": 47, "osdmap_epoch": 98, "osdmap_epoch_barrier": 98, "rank_uptime": 5.071198729, "state": "up:active", "uptime": 9.402702301, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:55:03.817 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:55:03.818 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:55:03.818 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:55:03.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:03.819 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:03.834 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:55:03.851 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:03.851 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:03.907 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:03.908 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:03.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:03.909 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:55:03.916 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:55:03.917 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:03.962 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:55:03.980 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:03.980 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:03.991 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:03.992 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:03.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:03.993 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:55:04.038 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:55:04.030+0000 7f0406978080 -1 init, newargv = 0x5575bf6917f0 newargc=9ceph-fuse[15253]: starting ceph client 2021-06-25T04:55:04.039 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr: 2021-06-25T04:55:04.049 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15253]: starting fuse 2021-06-25T04:55:05.146 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:55:05.164 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:05.165 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:05.221 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:05.222 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:05.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:05.224 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:55:05.231 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:55:05.232 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:55:05.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:05.232 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:55:05.233 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:55:05.233 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:55:05.234 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:55:05.234 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:55:05.234 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:05.235 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:55:05.235 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:55:05.236 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:55:05.236 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:05.236 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:55:05.237 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:55:05.238 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:55:05.238 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:55:05.239 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:05.239 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:55:05.240 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:55:05.240 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:55:05.240 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:55:05.241 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:55:05.242 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:05.242 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:55:05.243 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:55:05.286 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.15253.asok 2021-06-25T04:55:05.291 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15253.asok 2021-06-25T04:55:05.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:05.292 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15253.asok status 2021-06-25T04:55:05.422 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:55:05.423 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:55:05.423 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:55:05.423 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:55:05.424 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:55:05.424 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:55:05.424 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:55:05.425 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "15253", 2021-06-25T04:55:05.425 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:55:05.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:05.425 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:55:05.426 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:55:05.426 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 6332, 2021-06-25T04:55:05.426 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:55:05.426 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:55:05.427 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:55:05.427 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 6332 2021-06-25T04:55:05.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:05.427 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:55:05.427 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:55:05.428 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:55:05.428 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1714104545 2021-06-25T04:55:05.428 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:55:05.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:05.429 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:55:05.429 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:55:05.429 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:55:05.430 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1714104545 2021-06-25T04:55:05.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:05.430 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.6332 172.21.15.102:0/1714104545", 2021-06-25T04:55:05.430 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/1714104545", 2021-06-25T04:55:05.431 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:55:05.431 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 47, 2021-06-25T04:55:05.431 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 98, 2021-06-25T04:55:05.431 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:55:05.432 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:55:05.432 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:55:05.432 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:55:05.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:05.434 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:05.435 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:05.441 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:55:05.442 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:55:05.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:05.443 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:05.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:05.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.568+0000 7fc7d359e700 1 Processor -- start 2021-06-25T04:55:05.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.568+0000 7fc7d359e700 1 -- start start 2021-06-25T04:55:05.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.568+0000 7fc7d359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 0x7fc7d40672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:05.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.568+0000 7fc7d359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d4065920 con 0x7fc7d40b4d10 2021-06-25T04:55:05.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.568+0000 7fc7d359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d4064ed0 con 0x7fc7d40aad40 2021-06-25T04:55:05.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.568+0000 7fc7d359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d40b3ca0 con 0x7fc7d40ab120 2021-06-25T04:55:05.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d2d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc7d40b4d10 0x7fc7d40b74e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58346/0 (socket says 172.21.15.57:58346) 2021-06-25T04:55:05.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d2d9d700 1 -- 172.21.15.57:0/4231057059 learned_addr learned my addr 172.21.15.57:0/4231057059 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:05.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d1d9b700 1 --2- 172.21.15.57:0/4231057059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 0x7fc7d40672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:05.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d159a700 1 -- 172.21.15.57:0/4231057059 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289650755 0 0) 0x7fc7d4065920 con 0x7fc7d40b4d10 2021-06-25T04:55:05.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d159a700 1 -- 172.21.15.57:0/4231057059 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b8003260 con 0x7fc7d40b4d10 2021-06-25T04:55:05.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d159a700 1 -- 172.21.15.57:0/4231057059 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342598637 0 0) 0x7fc7d4064ed0 con 0x7fc7d40aad40 2021-06-25T04:55:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d159a700 1 -- 172.21.15.57:0/4231057059 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7d4065920 con 0x7fc7d40aad40 2021-06-25T04:55:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d1d9b700 1 -- 172.21.15.57:0/4231057059 >> v1:172.21.15.87:6789/0 conn(0x7fc7d40aad40 legacy=0x7fc7d40647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d1d9b700 1 -- 172.21.15.57:0/4231057059 >> v1:172.21.15.57:6789/0 conn(0x7fc7d40b4d10 legacy=0x7fc7d40b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d1d9b700 1 -- 172.21.15.57:0/4231057059 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d4066e20 con 0x7fc7d40ab120 2021-06-25T04:55:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d1d9b700 1 --2- 172.21.15.57:0/4231057059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 0x7fc7d40672c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fc7c4002f70 tx=0x7fc7c4006d90).ready entity=mon.2 client_cookie=da673399713fe763 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:05.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d159a700 1 -- 172.21.15.57:0/4231057059 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c400d4a0 con 0x7fc7d40ab120 2021-06-25T04:55:05.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d159a700 1 -- 172.21.15.57:0/4231057059 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c4000e90 con 0x7fc7d40ab120 2021-06-25T04:55:05.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d159a700 1 -- 172.21.15.57:0/4231057059 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c400d7f0 con 0x7fc7d40ab120 2021-06-25T04:55:05.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d359e700 1 -- 172.21.15.57:0/4231057059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 msgr2=0x7fc7d40672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:05.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d359e700 1 --2- 172.21.15.57:0/4231057059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 0x7fc7d40672c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fc7c4002f70 tx=0x7fc7c4006d90).stop 2021-06-25T04:55:05.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d359e700 1 -- 172.21.15.57:0/4231057059 shutdown_connections 2021-06-25T04:55:05.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d359e700 1 --2- 172.21.15.57:0/4231057059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 0x7fc7d40672c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d359e700 1 -- 172.21.15.57:0/4231057059 >> 172.21.15.57:0/4231057059 conn(0x7fc7d4062ba0 msgr2=0x7fc7d405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d359e700 1 -- 172.21.15.57:0/4231057059 shutdown_connections 2021-06-25T04:55:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d359e700 1 -- 172.21.15.57:0/4231057059 wait complete. 2021-06-25T04:55:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d359e700 1 Processor -- start 2021-06-25T04:55:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.572+0000 7fc7d359e700 1 -- start start 2021-06-25T04:55:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7d40aad40 0x7fc7d413f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 0x7fc7d4141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b4d10 0x7fc7d40abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d41415f0 con 0x7fc7d40b4d10 2021-06-25T04:55:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d4140720 con 0x7fc7d40aad40 2021-06-25T04:55:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d41409c0 con 0x7fc7d40ab120 2021-06-25T04:55:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b4d10 0x7fc7d40abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b4d10 0x7fc7d40abd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41134/0 (socket says 172.21.15.57:41134) 2021-06-25T04:55:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d1d9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 0x7fc7d4141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:05.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d2d9d700 1 -- 172.21.15.57:0/3276240842 learned_addr learned my addr 172.21.15.57:0/3276240842 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:05.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7d40aad40 0x7fc7d413f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:05.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d2d9d700 1 -- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 msgr2=0x7fc7d4141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:05.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d2d9d700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 0x7fc7d4141100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d2d9d700 1 -- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7d40aad40 msgr2=0x7fc7d413f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:05.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d2d9d700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7d40aad40 0x7fc7d413f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d2d9d700 1 -- 172.21.15.57:0/3276240842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c400b120 con 0x7fc7d40b4d10 2021-06-25T04:55:05.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d1d9b700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 0x7fc7d4141100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:05.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d259c700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7d40aad40 0x7fc7d413f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d2d9d700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b4d10 0x7fc7d40abd10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7fc7cc001490 tx=0x7fc7cc007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7c37fe700 1 -- 172.21.15.57:0/3276240842 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7cc005ba0 con 0x7fc7d40b4d10 2021-06-25T04:55:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7c37fe700 1 -- 172.21.15.57:0/3276240842 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc005d00 con 0x7fc7d40b4d10 2021-06-25T04:55:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7c37fe700 1 -- 172.21.15.57:0/3276240842 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7cc0072c0 con 0x7fc7d40b4d10 2021-06-25T04:55:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d359e700 1 -- 172.21.15.57:0/3276240842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d4140c60 con 0x7fc7d40b4d10 2021-06-25T04:55:05.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d359e700 1 -- 172.21.15.57:0/3276240842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d40ac200 con 0x7fc7d40b4d10 2021-06-25T04:55:05.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.576+0000 7fc7d359e700 1 -- 172.21.15.57:0/3276240842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d4140580 con 0x7fc7d40b4d10 2021-06-25T04:55:05.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.580+0000 7fc7c37fe700 1 -- 172.21.15.57:0/3276240842 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc7cc010070 con 0x7fc7d40b4d10 2021-06-25T04:55:05.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.580+0000 7fc7c37fe700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b00553d0 0x7fc7b0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:05.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.580+0000 7fc7c37fe700 1 -- 172.21.15.57:0/3276240842 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc7cc06d6c0 con 0x7fc7d40b4d10 2021-06-25T04:55:05.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.580+0000 7fc7d259c700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b00553d0 0x7fc7b0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:05.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.580+0000 7fc7d259c700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b00553d0 0x7fc7b0057890 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc7c800d000 tx=0x7fc7c8007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:05.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.588+0000 7fc7c37fe700 1 -- 172.21.15.57:0/3276240842 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc7d4140580 con 0x7fc7d40b4d10 2021-06-25T04:55:05.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.716+0000 7fc7d359e700 1 -- 172.21.15.57:0/3276240842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7d4140580 con 0x7fc7d40b4d10 2021-06-25T04:55:05.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7c37fe700 1 -- 172.21.15.57:0/3276240842 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fc7d4140580 con 0x7fc7d40b4d10 2021-06-25T04:55:05.722 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:05.723 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":98,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:54:59.733440+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:54:57.196707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-06-25T04:54:58.096573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 -- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b00553d0 msgr2=0x7fc7b0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b00553d0 0x7fc7b0057890 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc7c800d000 tx=0x7fc7c8007a00).stop 2021-06-25T04:55:05.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 -- 172.21.15.57:0/3276240842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b4d10 msgr2=0x7fc7d40abd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:05.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b4d10 0x7fc7d40abd10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7fc7cc001490 tx=0x7fc7cc007da0).stop 2021-06-25T04:55:05.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 -- 172.21.15.57:0/3276240842 shutdown_connections 2021-06-25T04:55:05.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7b00553d0 0x7fc7b0057890 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b4d10 0x7fc7d40abd10 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40ab120 0x7fc7d4141100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 --2- 172.21.15.57:0/3276240842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7d40aad40 0x7fc7d413f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 -- 172.21.15.57:0/3276240842 >> 172.21.15.57:0/3276240842 conn(0x7fc7d4062ba0 msgr2=0x7fc7d40b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:05.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 -- 172.21.15.57:0/3276240842 shutdown_connections 2021-06-25T04:55:05.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.720+0000 7fc7d359e700 1 -- 172.21.15.57:0/3276240842 wait complete. 2021-06-25T04:55:05.739 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:54:57.196707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:54:58.096573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:55:05.748 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:55:05.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.864+0000 7fb93d1ba700 1 Processor -- start 2021-06-25T04:55:05.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.864+0000 7fb93d1ba700 1 -- start start 2021-06-25T04:55:05.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9380b0570 0x7fb9380b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:05.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9380a9bd0 0x7fb9380b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:05.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9381438e0 con 0x7fb9380b36d0 2021-06-25T04:55:05.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb938143b80 con 0x7fb9380a9bd0 2021-06-25T04:55:05.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb938143e20 con 0x7fb9380b0570 2021-06-25T04:55:05.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9380a9bd0 0x7fb9380b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:05.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9380a9bd0 0x7fb9380b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41142/0 (socket says 172.21.15.57:41142) 2021-06-25T04:55:05.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93759e700 1 -- 172.21.15.57:0/490754292 learned_addr learned my addr 172.21.15.57:0/490754292 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:05.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb936d9d700 1 --2- 172.21.15.57:0/490754292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9380b0570 0x7fb9380b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:05.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93759e700 1 -- 172.21.15.57:0/490754292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9380b0570 msgr2=0x7fb9380b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:05.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93759e700 1 --2- 172.21.15.57:0/490754292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9380b0570 0x7fb9380b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93759e700 1 -- 172.21.15.57:0/490754292 >> v1:172.21.15.87:6789/0 conn(0x7fb9380b36d0 legacy=0x7fb93813d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:05.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93759e700 1 -- 172.21.15.57:0/490754292 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9381440c0 con 0x7fb9380a9bd0 2021-06-25T04:55:05.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb935d9b700 1 -- 172.21.15.57:0/490754292 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167472488 0 0) 0x7fb9381438e0 con 0x7fb9380b36d0 2021-06-25T04:55:05.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93759e700 1 --2- 172.21.15.57:0/490754292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9380a9bd0 0x7fb9380b1070 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fb9300032f0 tx=0x7fb930009290).ready entity=mon.0 client_cookie=1c46458aa1e699d6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:05.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb935d9b700 1 -- 172.21.15.57:0/490754292 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb93000b8a0 con 0x7fb9380a9bd0 2021-06-25T04:55:05.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb935d9b700 1 -- 172.21.15.57:0/490754292 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93000ba00 con 0x7fb9380a9bd0 2021-06-25T04:55:05.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb935d9b700 1 -- 172.21.15.57:0/490754292 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb93000bb70 con 0x7fb9380a9bd0 2021-06-25T04:55:05.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 -- 172.21.15.57:0/490754292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9380a9bd0 msgr2=0x7fb9380b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:05.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 --2- 172.21.15.57:0/490754292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9380a9bd0 0x7fb9380b1070 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fb9300032f0 tx=0x7fb930009290).stop 2021-06-25T04:55:05.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 -- 172.21.15.57:0/490754292 shutdown_connections 2021-06-25T04:55:05.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 --2- 172.21.15.57:0/490754292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9380a9bd0 0x7fb9380b1070 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 --2- 172.21.15.57:0/490754292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9380b0570 0x7fb9380b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 -- 172.21.15.57:0/490754292 >> 172.21.15.57:0/490754292 conn(0x7fb938060780 msgr2=0x7fb938060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:05.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 -- 172.21.15.57:0/490754292 shutdown_connections 2021-06-25T04:55:05.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.868+0000 7fb93d1ba700 1 -- 172.21.15.57:0/490754292 wait complete. 2021-06-25T04:55:05.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93d1ba700 1 Processor -- start 2021-06-25T04:55:05.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93d1ba700 1 -- start start 2021-06-25T04:55:05.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93d1ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9380a9bd0 0x7fb9381479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:05.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93d1ba700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9380b0570 0x7fb938067090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:05.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93d1ba700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9380b36d0 0x7fb938067580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:05.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93d1ba700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380af5f0 con 0x7fb9380a9bd0 2021-06-25T04:55:05.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93d1ba700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380ac6a0 con 0x7fb9380b36d0 2021-06-25T04:55:05.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93d1ba700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb938065cc0 con 0x7fb9380b0570 2021-06-25T04:55:05.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb936d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9380a9bd0 0x7fb9381479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:05.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb936d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9380a9bd0 0x7fb9381479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41146/0 (socket says 172.21.15.57:41146) 2021-06-25T04:55:05.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb936d9d700 1 -- 172.21.15.57:0/792855678 learned_addr learned my addr 172.21.15.57:0/792855678 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:05.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93659c700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9380b0570 0x7fb938067090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:05.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93759e700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9380b36d0 0x7fb938067580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:05.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93659c700 1 -- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9380b36d0 msgr2=0x7fb938067580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:05.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93659c700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9380b36d0 0x7fb938067580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93659c700 1 -- 172.21.15.57:0/792855678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9380a9bd0 msgr2=0x7fb9381479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:05.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93659c700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9380a9bd0 0x7fb9381479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:05.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93659c700 1 -- 172.21.15.57:0/792855678 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb930009530 con 0x7fb9380b0570 2021-06-25T04:55:05.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb936d9d700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9380a9bd0 0x7fb9381479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:05.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93659c700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9380b0570 0x7fb938067090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb92c000ed0 tx=0x7fb92c007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:05.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb927fff700 1 -- 172.21.15.57:0/792855678 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb92c012400 con 0x7fb9380b0570 2021-06-25T04:55:05.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb927fff700 1 -- 172.21.15.57:0/792855678 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c012560 con 0x7fb9380b0570 2021-06-25T04:55:05.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93d1ba700 1 -- 172.21.15.57:0/792855678 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb938066770 con 0x7fb9380b0570 2021-06-25T04:55:05.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb927fff700 1 -- 172.21.15.57:0/792855678 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb92c0128c0 con 0x7fb9380b0570 2021-06-25T04:55:05.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.872+0000 7fb93d1ba700 1 -- 172.21.15.57:0/792855678 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb938066230 con 0x7fb9380b0570 2021-06-25T04:55:05.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.876+0000 7fb93d1ba700 1 -- 172.21.15.57:0/792855678 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb938066e30 con 0x7fb9380b0570 2021-06-25T04:55:05.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.876+0000 7fb927fff700 1 -- 172.21.15.57:0/792855678 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb92c019030 con 0x7fb9380b0570 2021-06-25T04:55:05.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.876+0000 7fb927fff700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb9140553f0 0x7fb9140578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:05.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.876+0000 7fb927fff700 1 -- 172.21.15.57:0/792855678 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb92c06d100 con 0x7fb9380b0570 2021-06-25T04:55:05.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.876+0000 7fb936d9d700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb9140553f0 0x7fb9140578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:05.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.876+0000 7fb936d9d700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb9140553f0 0x7fb9140578b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fb92800b000 tx=0x7fb928006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:05.895 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:05.884+0000 7fb927fff700 1 -- 172.21.15.57:0/792855678 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb92c0432b0 con 0x7fb9380b0570 2021-06-25T04:55:06.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.012+0000 7fb93d1ba700 1 -- 172.21.15.57:0/792855678 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb938057310 con 0x7fb9380b0570 2021-06-25T04:55:06.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.016+0000 7fb927fff700 1 -- 172.21.15.57:0/792855678 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v98) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb92c0468d0 con 0x7fb9380b0570 2021-06-25T04:55:06.023 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:55:06.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.016+0000 7fb93d1ba700 1 -- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb9140553f0 msgr2=0x7fb9140578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.016+0000 7fb93d1ba700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb9140553f0 0x7fb9140578b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fb92800b000 tx=0x7fb928006df0).stop 2021-06-25T04:55:06.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.016+0000 7fb93d1ba700 1 -- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9380b0570 msgr2=0x7fb938067090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.016+0000 7fb93d1ba700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9380b0570 0x7fb938067090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb92c000ed0 tx=0x7fb92c007b90).stop 2021-06-25T04:55:06.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.020+0000 7fb93d1ba700 1 -- 172.21.15.57:0/792855678 shutdown_connections 2021-06-25T04:55:06.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.020+0000 7fb93d1ba700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb9140553f0 0x7fb9140578b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.020+0000 7fb93d1ba700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9380b36d0 0x7fb938067580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.020+0000 7fb93d1ba700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9380b0570 0x7fb938067090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.020+0000 7fb93d1ba700 1 --2- 172.21.15.57:0/792855678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9380a9bd0 0x7fb9381479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.020+0000 7fb93d1ba700 1 -- 172.21.15.57:0/792855678 >> 172.21.15.57:0/792855678 conn(0x7fb938060780 msgr2=0x7fb9380b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:06.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.020+0000 7fb93d1ba700 1 -- 172.21.15.57:0/792855678 shutdown_connections 2021-06-25T04:55:06.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.020+0000 7fb93d1ba700 1 -- 172.21.15.57:0/792855678 wait complete. 2021-06-25T04:55:06.040 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:55:06.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.176+0000 7f67579e9700 1 Processor -- start 2021-06-25T04:55:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.176+0000 7f67579e9700 1 -- start start 2021-06-25T04:55:06.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.176+0000 7f67579e9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67500b4650 0x7f6750140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.176+0000 7f67579e9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6750143b20 con 0x7f67500b4140 2021-06-25T04:55:06.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.176+0000 7f67579e9700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6750143dc0 con 0x7f6750146910 2021-06-25T04:55:06.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.176+0000 7f67579e9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67501474d0 con 0x7f67500b4650 2021-06-25T04:55:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.176+0000 7f6754f84700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f67500b4140 0x7f67500b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58370/0 (socket says 172.21.15.57:58370) 2021-06-25T04:55:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.176+0000 7f6754f84700 1 -- 172.21.15.57:0/509923124 learned_addr learned my addr 172.21.15.57:0/509923124 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f6755f86700 1 --2- 172.21.15.57:0/509923124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67500b4650 0x7f6750140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f673ffff700 1 -- 172.21.15.57:0/509923124 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365799375 0 0) 0x7f6750143b20 con 0x7f67500b4140 2021-06-25T04:55:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f673ffff700 1 -- 172.21.15.57:0/509923124 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6738003260 con 0x7f67500b4140 2021-06-25T04:55:06.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f673ffff700 1 -- 172.21.15.57:0/509923124 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963635351 0 0) 0x7f6750143dc0 con 0x7f6750146910 2021-06-25T04:55:06.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f673ffff700 1 -- 172.21.15.57:0/509923124 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6750143b20 con 0x7f6750146910 2021-06-25T04:55:06.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f6755f86700 1 -- 172.21.15.57:0/509923124 >> v1:172.21.15.87:6789/0 conn(0x7f6750146910 legacy=0x7f67501401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f6755f86700 1 -- 172.21.15.57:0/509923124 >> v1:172.21.15.57:6789/0 conn(0x7f67500b4140 legacy=0x7f67500b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f6755f86700 1 -- 172.21.15.57:0/509923124 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500b0c50 con 0x7f67500b4650 2021-06-25T04:55:06.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f6755f86700 1 --2- 172.21.15.57:0/509923124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67500b4650 0x7f6750140900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f67480032f0 tx=0x7f67480091d0).ready entity=mon.2 client_cookie=431b184f4346bf44 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:06.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f673ffff700 1 -- 172.21.15.57:0/509923124 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674800b640 con 0x7f67500b4650 2021-06-25T04:55:06.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f673ffff700 1 -- 172.21.15.57:0/509923124 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674800b7a0 con 0x7f67500b4650 2021-06-25T04:55:06.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f673ffff700 1 -- 172.21.15.57:0/509923124 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674800b910 con 0x7f67500b4650 2021-06-25T04:55:06.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f67579e9700 1 -- 172.21.15.57:0/509923124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67500b4650 msgr2=0x7f6750140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f67579e9700 1 --2- 172.21.15.57:0/509923124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67500b4650 0x7f6750140900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f67480032f0 tx=0x7f67480091d0).stop 2021-06-25T04:55:06.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f67579e9700 1 -- 172.21.15.57:0/509923124 shutdown_connections 2021-06-25T04:55:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f67579e9700 1 --2- 172.21.15.57:0/509923124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67500b4650 0x7f6750140900 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f67579e9700 1 -- 172.21.15.57:0/509923124 >> 172.21.15.57:0/509923124 conn(0x7f675005c450 msgr2=0x7f675005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f67579e9700 1 -- 172.21.15.57:0/509923124 shutdown_connections 2021-06-25T04:55:06.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.180+0000 7f67579e9700 1 -- 172.21.15.57:0/509923124 wait complete. 2021-06-25T04:55:06.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f67579e9700 1 Processor -- start 2021-06-25T04:55:06.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f67579e9700 1 -- start start 2021-06-25T04:55:06.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f67579e9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67500b4140 0x7f67500b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f67579e9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500b4650 0x7f67500ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f67579e9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6750146910 0x7f6750152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f67579e9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67500aea50 con 0x7f6750146910 2021-06-25T04:55:06.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f67579e9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67500aecf0 con 0x7f67500b4650 2021-06-25T04:55:06.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f67579e9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67500af230 con 0x7f67500b4140 2021-06-25T04:55:06.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f6755f86700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6750146910 0x7f6750152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f6755785700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67500b4140 0x7f67500b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f6755f86700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6750146910 0x7f6750152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41162/0 (socket says 172.21.15.57:41162) 2021-06-25T04:55:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f6754f84700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500b4650 0x7f67500ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f6755f86700 1 -- 172.21.15.57:0/1304213381 learned_addr learned my addr 172.21.15.57:0/1304213381 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f6755f86700 1 -- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67500b4140 msgr2=0x7f67500b79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f6755f86700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67500b4140 0x7f67500b79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f6755f86700 1 -- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500b4650 msgr2=0x7f67500ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f6755f86700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500b4650 0x7f67500ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f6755f86700 1 -- 172.21.15.57:0/1304213381 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6748009470 con 0x7f6750146910 2021-06-25T04:55:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.184+0000 7f6754f84700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500b4650 0x7f67500ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:06.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.188+0000 7f6755f86700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6750146910 0x7f6750152ce0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f67480032f0 tx=0x7f6748016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:06.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.188+0000 7f673e7fc700 1 -- 172.21.15.57:0/1304213381 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6748006ea0 con 0x7f6750146910 2021-06-25T04:55:06.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.188+0000 7f673e7fc700 1 -- 172.21.15.57:0/1304213381 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6748011d20 con 0x7f6750146910 2021-06-25T04:55:06.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.188+0000 7f67579e9700 1 -- 172.21.15.57:0/1304213381 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67500b9430 con 0x7f6750146910 2021-06-25T04:55:06.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.188+0000 7f673e7fc700 1 -- 172.21.15.57:0/1304213381 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6748021630 con 0x7f6750146910 2021-06-25T04:55:06.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.188+0000 7f67579e9700 1 -- 172.21.15.57:0/1304213381 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67500b9930 con 0x7f6750146910 2021-06-25T04:55:06.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.188+0000 7f67579e9700 1 -- 172.21.15.57:0/1304213381 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67500af090 con 0x7f6750146910 2021-06-25T04:55:06.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.188+0000 7f673e7fc700 1 -- 172.21.15.57:0/1304213381 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6748027020 con 0x7f6750146910 2021-06-25T04:55:06.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.188+0000 7f673e7fc700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f67300553d0 0x7f6730057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.188+0000 7f673e7fc700 1 -- 172.21.15.57:0/1304213381 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f674806f000 con 0x7f6750146910 2021-06-25T04:55:06.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.188+0000 7f6755785700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f67300553d0 0x7f6730057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.192+0000 7f6755785700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f67300553d0 0x7f6730057890 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f674000d000 tx=0x7f6740007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:06.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.196+0000 7f673e7fc700 1 -- 172.21.15.57:0/1304213381 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f67500af090 con 0x7f6750146910 2021-06-25T04:55:06.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.320+0000 7f67579e9700 1 -- 172.21.15.57:0/1304213381 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f67500af090 con 0x7f6750146910 2021-06-25T04:55:06.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.320+0000 7f673e7fc700 1 -- 172.21.15.57:0/1304213381 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f67500af090 con 0x7f6750146910 2021-06-25T04:55:06.325 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:06.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 -- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f67300553d0 msgr2=0x7f6730057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f67300553d0 0x7f6730057890 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f674000d000 tx=0x7f6740007a00).stop 2021-06-25T04:55:06.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 -- 172.21.15.57:0/1304213381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6750146910 msgr2=0x7f6750152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6750146910 0x7f6750152ce0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f67480032f0 tx=0x7f6748016000).stop 2021-06-25T04:55:06.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 -- 172.21.15.57:0/1304213381 shutdown_connections 2021-06-25T04:55:06.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f67300553d0 0x7f6730057890 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6750146910 0x7f6750152ce0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500b4650 0x7f67500ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 --2- 172.21.15.57:0/1304213381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67500b4140 0x7f67500b79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 -- 172.21.15.57:0/1304213381 >> 172.21.15.57:0/1304213381 conn(0x7f675005c450 msgr2=0x7f6750141ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:06.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 -- 172.21.15.57:0/1304213381 shutdown_connections 2021-06-25T04:55:06.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.324+0000 7f67579e9700 1 -- 172.21.15.57:0/1304213381 wait complete. 2021-06-25T04:55:06.348 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:55:06.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 Processor -- start 2021-06-25T04:55:06.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 -- start start 2021-06-25T04:55:06.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbba4146910 0x7fbba41401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbba40b4140 0x7fbba41406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba4143b20 con 0x7fbba40b4650 2021-06-25T04:55:06.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba41474d0 con 0x7fbba4146910 2021-06-25T04:55:06.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba4143dc0 con 0x7fbba40b4140 2021-06-25T04:55:06.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbba4146910 0x7fbba41401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba2d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbba40b4650 0x7fbba40b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58386/0 (socket says 172.21.15.57:58386) 2021-06-25T04:55:06.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba2d9d700 1 -- 172.21.15.57:0/1248459024 learned_addr learned my addr 172.21.15.57:0/1248459024 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:06.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba1d9b700 1 --2- 172.21.15.57:0/1248459024 >> v2:172.21.15.87:3300/0 conn(0x7fbba40b4140 0x7fbba41406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba159a700 1 -- 172.21.15.57:0/1248459024 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063544843 0 0) 0x7fbba4143b20 con 0x7fbba40b4650 2021-06-25T04:55:06.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba159a700 1 -- 172.21.15.57:0/1248459024 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb88003260 con 0x7fbba40b4650 2021-06-25T04:55:06.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba259c700 1 -- 172.21.15.57:0/1248459024 >> v2:172.21.15.87:3300/0 conn(0x7fbba40b4140 msgr2=0x7fbba41406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:06.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba259c700 1 --2- 172.21.15.57:0/1248459024 >> v2:172.21.15.87:3300/0 conn(0x7fbba40b4140 0x7fbba41406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba259c700 1 -- 172.21.15.57:0/1248459024 >> v1:172.21.15.57:6789/0 conn(0x7fbba40b4650 legacy=0x7fbba40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba259c700 1 -- 172.21.15.57:0/1248459024 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba40b0c50 con 0x7fbba4146910 2021-06-25T04:55:06.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba259c700 1 --2- 172.21.15.57:0/1248459024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba4146910 0x7fbba41401f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fbb98002f70 tx=0x7fbb98006df0).ready entity=mon.0 client_cookie=2659065423f97aea server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:06.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba159a700 1 -- 172.21.15.57:0/1248459024 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9800d4f0 con 0x7fbba4146910 2021-06-25T04:55:06.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba159a700 1 -- 172.21.15.57:0/1248459024 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb98000e90 con 0x7fbba4146910 2021-06-25T04:55:06.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba159a700 1 -- 172.21.15.57:0/1248459024 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9800d840 con 0x7fbba4146910 2021-06-25T04:55:06.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 -- 172.21.15.57:0/1248459024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba4146910 msgr2=0x7fbba41401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 --2- 172.21.15.57:0/1248459024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba4146910 0x7fbba41401f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fbb98002f70 tx=0x7fbb98006df0).stop 2021-06-25T04:55:06.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 -- 172.21.15.57:0/1248459024 shutdown_connections 2021-06-25T04:55:06.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 --2- 172.21.15.57:0/1248459024 >> v2:172.21.15.87:3300/0 conn(0x7fbba40b4140 0x7fbba41406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 --2- 172.21.15.57:0/1248459024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba4146910 0x7fbba41401f0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.460+0000 7fbba880b700 1 -- 172.21.15.57:0/1248459024 >> 172.21.15.57:0/1248459024 conn(0x7fbba405c450 msgr2=0x7fbba405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:06.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba880b700 1 -- 172.21.15.57:0/1248459024 shutdown_connections 2021-06-25T04:55:06.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba880b700 1 -- 172.21.15.57:0/1248459024 wait complete. 2021-06-25T04:55:06.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba880b700 1 Processor -- start 2021-06-25T04:55:06.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba880b700 1 -- start start 2021-06-25T04:55:06.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba880b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbba40b4140 0x7fbba4142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba880b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba40b4650 0x7fbba413c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba880b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbba4146910 0x7fbba4155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba880b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba413cbd0 con 0x7fbba40b4650 2021-06-25T04:55:06.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba880b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba413ce70 con 0x7fbba4146910 2021-06-25T04:55:06.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba880b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba4155690 con 0x7fbba40b4140 2021-06-25T04:55:06.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba1d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba40b4650 0x7fbba413c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba1d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba40b4650 0x7fbba413c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41174/0 (socket says 172.21.15.57:41174) 2021-06-25T04:55:06.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba1d9b700 1 -- 172.21.15.57:0/545348185 learned_addr learned my addr 172.21.15.57:0/545348185 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:06.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba259c700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbba40b4140 0x7fbba4142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba2d9d700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbba4146910 0x7fbba4155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba1d9b700 1 -- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbba40b4140 msgr2=0x7fbba4142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba1d9b700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbba40b4140 0x7fbba4142470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba1d9b700 1 -- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbba4146910 msgr2=0x7fbba4155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba1d9b700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbba4146910 0x7fbba4155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba1d9b700 1 -- 172.21.15.57:0/545348185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9800b180 con 0x7fbba40b4650 2021-06-25T04:55:06.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba2d9d700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbba4146910 0x7fbba4155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:06.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.464+0000 7fbba259c700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbba40b4140 0x7fbba4142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:06.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.468+0000 7fbba1d9b700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba40b4650 0x7fbba413c530 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fbb9400c000 tx=0x7fbb94006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:06.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.468+0000 7fbb937fe700 1 -- 172.21.15.57:0/545348185 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9400c830 con 0x7fbba40b4650 2021-06-25T04:55:06.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.468+0000 7fbb937fe700 1 -- 172.21.15.57:0/545348185 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9400c990 con 0x7fbba40b4650 2021-06-25T04:55:06.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.468+0000 7fbba880b700 1 -- 172.21.15.57:0/545348185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba40b05b0 con 0x7fbba40b4650 2021-06-25T04:55:06.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.468+0000 7fbb937fe700 1 -- 172.21.15.57:0/545348185 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9400ccf0 con 0x7fbba40b4650 2021-06-25T04:55:06.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.468+0000 7fbba880b700 1 -- 172.21.15.57:0/545348185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba4151f40 con 0x7fbba40b4650 2021-06-25T04:55:06.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.468+0000 7fbba880b700 1 -- 172.21.15.57:0/545348185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba4155850 con 0x7fbba40b4650 2021-06-25T04:55:06.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.468+0000 7fbb937fe700 1 -- 172.21.15.57:0/545348185 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbb9401c460 con 0x7fbba40b4650 2021-06-25T04:55:06.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.468+0000 7fbb937fe700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbb80055490 0x7fbb80057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.468+0000 7fbb937fe700 1 -- 172.21.15.57:0/545348185 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbb9406e4a0 con 0x7fbba40b4650 2021-06-25T04:55:06.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.468+0000 7fbba259c700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbb80055490 0x7fbb80057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.472+0000 7fbba259c700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbb80055490 0x7fbb80057950 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fbb98017000 tx=0x7fbb98014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:06.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.472+0000 7fbb937fe700 1 -- 172.21.15.57:0/545348185 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbb94044590 con 0x7fbba40b4650 2021-06-25T04:55:06.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.600+0000 7fbba880b700 1 -- 172.21.15.57:0/545348185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbba4057310 con 0x7fbba40b4650 2021-06-25T04:55:06.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.600+0000 7fbb937fe700 1 -- 172.21.15.57:0/545348185 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbb94047bb0 con 0x7fbba40b4650 2021-06-25T04:55:06.605 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:06.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 -- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbb80055490 msgr2=0x7fbb80057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbb80055490 0x7fbb80057950 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fbb98017000 tx=0x7fbb98014000).stop 2021-06-25T04:55:06.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 -- 172.21.15.57:0/545348185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba40b4650 msgr2=0x7fbba413c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba40b4650 0x7fbba413c530 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fbb9400c000 tx=0x7fbb94006df0).stop 2021-06-25T04:55:06.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 -- 172.21.15.57:0/545348185 shutdown_connections 2021-06-25T04:55:06.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbb80055490 0x7fbb80057950 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbba4146910 0x7fbba4155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba40b4650 0x7fbba413c530 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 --2- 172.21.15.57:0/545348185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbba40b4140 0x7fbba4142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 -- 172.21.15.57:0/545348185 >> 172.21.15.57:0/545348185 conn(0x7fbba405c450 msgr2=0x7fbba413ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:06.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 -- 172.21.15.57:0/545348185 shutdown_connections 2021-06-25T04:55:06.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.604+0000 7fbba880b700 1 -- 172.21.15.57:0/545348185 wait complete. 2021-06-25T04:55:06.623 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:55:06.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa230d700 1 Processor -- start 2021-06-25T04:55:06.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa230d700 1 -- start start 2021-06-25T04:55:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa230d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fca9c0b26e0 0x7fca9c13dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa230d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0b0fb0 0x7fca9c13e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa230d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fca9c141040 0x7fca9c1414d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa230d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c140c50 con 0x7fca9c0b26e0 2021-06-25T04:55:06.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa230d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c0aaa50 con 0x7fca9c141040 2021-06-25T04:55:06.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa230d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b2ac0 con 0x7fca9c0b0fb0 2021-06-25T04:55:06.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa130b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fca9c0b26e0 0x7fca9c13dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa130b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fca9c0b26e0 0x7fca9c13dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41180/0 (socket says 172.21.15.57:41180) 2021-06-25T04:55:06.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa130b700 1 -- 172.21.15.57:0/895871773 learned_addr learned my addr 172.21.15.57:0/895871773 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:06.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa0b0a700 1 --2- 172.21.15.57:0/895871773 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0b0fb0 0x7fca9c13e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa1b0c700 1 --2- 172.21.15.57:0/895871773 >> v2:172.21.15.87:3300/0 conn(0x7fca9c141040 0x7fca9c1414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa130b700 1 -- 172.21.15.57:0/895871773 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0b0fb0 msgr2=0x7fca9c13e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa130b700 1 --2- 172.21.15.57:0/895871773 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0b0fb0 0x7fca9c13e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa130b700 1 -- 172.21.15.57:0/895871773 >> v2:172.21.15.87:3300/0 conn(0x7fca9c141040 msgr2=0x7fca9c1414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa130b700 1 --2- 172.21.15.57:0/895871773 >> v2:172.21.15.87:3300/0 conn(0x7fca9c141040 0x7fca9c1414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa130b700 1 -- 172.21.15.57:0/895871773 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c0aa270 con 0x7fca9c0b26e0 2021-06-25T04:55:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.736+0000 7fcaa1b0c700 1 --2- 172.21.15.57:0/895871773 >> v2:172.21.15.87:3300/0 conn(0x7fca9c141040 0x7fca9c1414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fcaa130b700 1 --2- 172.21.15.57:0/895871773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0b26e0 0x7fca9c13dff0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fca8c002f70 tx=0x7fca8c006eb0).ready entity=mon.0 client_cookie=7f42040611264829 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:06.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fca93fff700 1 -- 172.21.15.57:0/895871773 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca8c00d570 con 0x7fca9c0b26e0 2021-06-25T04:55:06.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fca93fff700 1 -- 172.21.15.57:0/895871773 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c000e90 con 0x7fca9c0b26e0 2021-06-25T04:55:06.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fca93fff700 1 -- 172.21.15.57:0/895871773 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca8c00d900 con 0x7fca9c0b26e0 2021-06-25T04:55:06.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fcaa230d700 1 -- 172.21.15.57:0/895871773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0b26e0 msgr2=0x7fca9c13dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fcaa230d700 1 --2- 172.21.15.57:0/895871773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0b26e0 0x7fca9c13dff0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fca8c002f70 tx=0x7fca8c006eb0).stop 2021-06-25T04:55:06.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fcaa230d700 1 -- 172.21.15.57:0/895871773 shutdown_connections 2021-06-25T04:55:06.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fcaa230d700 1 --2- 172.21.15.57:0/895871773 >> v2:172.21.15.87:3300/0 conn(0x7fca9c141040 0x7fca9c1414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fcaa230d700 1 --2- 172.21.15.57:0/895871773 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c0b0fb0 0x7fca9c13e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fcaa230d700 1 --2- 172.21.15.57:0/895871773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0b26e0 0x7fca9c13dff0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fcaa230d700 1 -- 172.21.15.57:0/895871773 >> 172.21.15.57:0/895871773 conn(0x7fca9c060140 msgr2=0x7fca9c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:06.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fcaa230d700 1 -- 172.21.15.57:0/895871773 shutdown_connections 2021-06-25T04:55:06.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.740+0000 7fcaa230d700 1 -- 172.21.15.57:0/895871773 wait complete. 2021-06-25T04:55:06.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa230d700 1 Processor -- start 2021-06-25T04:55:06.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa230d700 1 -- start start 2021-06-25T04:55:06.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa230d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c0b0fb0 0x7fca9c13ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa230d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0b26e0 0x7fca9c14fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa230d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c141040 0x7fca9c142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa230d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b40c0 con 0x7fca9c0b26e0 2021-06-25T04:55:06.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa230d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c13b950 con 0x7fca9c0b0fb0 2021-06-25T04:55:06.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa230d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b3d70 con 0x7fca9c141040 2021-06-25T04:55:06.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa0b0a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0b26e0 0x7fca9c14fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa0b0a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0b26e0 0x7fca9c14fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41188/0 (socket says 172.21.15.57:41188) 2021-06-25T04:55:06.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa0b0a700 1 -- 172.21.15.57:0/2823457146 learned_addr learned my addr 172.21.15.57:0/2823457146 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:06.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa130b700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c0b0fb0 0x7fca9c13ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa1b0c700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c141040 0x7fca9c142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa0b0a700 1 -- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c141040 msgr2=0x7fca9c142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa0b0a700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c141040 0x7fca9c142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa0b0a700 1 -- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c0b0fb0 msgr2=0x7fca9c13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa0b0a700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c0b0fb0 0x7fca9c13ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa0b0a700 1 -- 172.21.15.57:0/2823457146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca94009470 con 0x7fca9c0b26e0 2021-06-25T04:55:06.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa0b0a700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0b26e0 0x7fca9c14fd30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7fca9800c000 tx=0x7fca98006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:06.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fca927fc700 1 -- 172.21.15.57:0/2823457146 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca98010780 con 0x7fca9c0b26e0 2021-06-25T04:55:06.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fca927fc700 1 -- 172.21.15.57:0/2823457146 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca980108e0 con 0x7fca9c0b26e0 2021-06-25T04:55:06.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fca927fc700 1 -- 172.21.15.57:0/2823457146 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca98010c40 con 0x7fca9c0b26e0 2021-06-25T04:55:06.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa230d700 1 -- 172.21.15.57:0/2823457146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c00b1e0 con 0x7fca9c0b26e0 2021-06-25T04:55:06.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.744+0000 7fcaa230d700 1 -- 172.21.15.57:0/2823457146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c13bbb0 con 0x7fca9c0b26e0 2021-06-25T04:55:06.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.748+0000 7fcaa230d700 1 -- 172.21.15.57:0/2823457146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c13bd70 con 0x7fca9c0b26e0 2021-06-25T04:55:06.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.748+0000 7fca927fc700 1 -- 172.21.15.57:0/2823457146 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fca9801c460 con 0x7fca9c0b26e0 2021-06-25T04:55:06.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.748+0000 7fca927fc700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca840553f0 0x7fca840578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:06.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.748+0000 7fca927fc700 1 -- 172.21.15.57:0/2823457146 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fca9806e2c0 con 0x7fca9c0b26e0 2021-06-25T04:55:06.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.748+0000 7fcaa130b700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca840553f0 0x7fca840578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:06.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.752+0000 7fcaa130b700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca840553f0 0x7fca840578b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fca8c01b000 tx=0x7fca8c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:06.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.756+0000 7fca927fc700 1 -- 172.21.15.57:0/2823457146 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fca98044370 con 0x7fca9c0b26e0 2021-06-25T04:55:06.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.884+0000 7fcaa230d700 1 -- 172.21.15.57:0/2823457146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca9c057310 con 0x7fca9c0b26e0 2021-06-25T04:55:06.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.884+0000 7fca927fc700 1 -- 172.21.15.57:0/2823457146 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+10 (secure 0 0 0) 0x7fca98047990 con 0x7fca9c0b26e0 2021-06-25T04:55:06.889 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:06.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 -- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca840553f0 msgr2=0x7fca840578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca840553f0 0x7fca840578b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fca8c01b000 tx=0x7fca8c015000).stop 2021-06-25T04:55:06.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 -- 172.21.15.57:0/2823457146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0b26e0 msgr2=0x7fca9c14fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:06.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0b26e0 0x7fca9c14fd30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7fca9800c000 tx=0x7fca98006df0).stop 2021-06-25T04:55:06.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 -- 172.21.15.57:0/2823457146 shutdown_connections 2021-06-25T04:55:06.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fca840553f0 0x7fca840578b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c141040 0x7fca9c142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0b26e0 0x7fca9c14fd30 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 --2- 172.21.15.57:0/2823457146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c0b0fb0 0x7fca9c13ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:06.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 -- 172.21.15.57:0/2823457146 >> 172.21.15.57:0/2823457146 conn(0x7fca9c060140 msgr2=0x7fca9c0af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:06.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 -- 172.21.15.57:0/2823457146 shutdown_connections 2021-06-25T04:55:06.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:06.888+0000 7fcaa230d700 1 -- 172.21.15.57:0/2823457146 wait complete. 2021-06-25T04:55:06.902 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:55:06.903 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:07.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.000+0000 7f09f9d5a700 1 Processor -- start 2021-06-25T04:55:07.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.000+0000 7f09f9d5a700 1 -- start start 2021-06-25T04:55:07.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f9d5a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09f4064b00 0x7f09f4143860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:07.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f9d5a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f40b2230 con 0x7f09f40b2cb0 2021-06-25T04:55:07.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f9d5a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f4064ee0 con 0x7f09f40b3900 2021-06-25T04:55:07.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f9d5a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f40621f0 con 0x7f09f4064b00 2021-06-25T04:55:07.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f8d58700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09f4064b00 0x7f09f4143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:07.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f09f40b2cb0 0x7f09f40b31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58416/0 (socket says 172.21.15.57:58416) 2021-06-25T04:55:07.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f3fff700 1 -- 172.21.15.57:0/3907643689 learned_addr learned my addr 172.21.15.57:0/3907643689 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:07.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f37fe700 1 -- 172.21.15.57:0/3907643689 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242998270 0 0) 0x7f09f40b2230 con 0x7f09f40b2cb0 2021-06-25T04:55:07.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f37fe700 1 -- 172.21.15.57:0/3907643689 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d8003260 con 0x7f09f40b2cb0 2021-06-25T04:55:07.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f37fe700 1 -- 172.21.15.57:0/3907643689 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886821037 0 0) 0x7f09f4064ee0 con 0x7f09f40b3900 2021-06-25T04:55:07.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f37fe700 1 -- 172.21.15.57:0/3907643689 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f40b2230 con 0x7f09f40b3900 2021-06-25T04:55:07.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f8d58700 1 -- 172.21.15.57:0/3907643689 >> v1:172.21.15.87:6789/0 conn(0x7f09f40b3900 legacy=0x7f09f414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:07.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f8d58700 1 -- 172.21.15.57:0/3907643689 >> v1:172.21.15.57:6789/0 conn(0x7f09f40b2cb0 legacy=0x7f09f40b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:07.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f8d58700 1 -- 172.21.15.57:0/3907643689 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40b3d10 con 0x7f09f4064b00 2021-06-25T04:55:07.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f8d58700 1 --2- 172.21.15.57:0/3907643689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f4064b00 0x7f09f4143860 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f09e8002f70 tx=0x7f09e8006df0).ready entity=mon.0 client_cookie=d82e19a09473f821 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:07.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f37fe700 1 -- 172.21.15.57:0/3907643689 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e800d540 con 0x7f09f4064b00 2021-06-25T04:55:07.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f37fe700 1 -- 172.21.15.57:0/3907643689 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8000e90 con 0x7f09f4064b00 2021-06-25T04:55:07.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f37fe700 1 -- 172.21.15.57:0/3907643689 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e800d890 con 0x7f09f4064b00 2021-06-25T04:55:07.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f9d5a700 1 -- 172.21.15.57:0/3907643689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f4064b00 msgr2=0x7f09f4143860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:07.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f9d5a700 1 --2- 172.21.15.57:0/3907643689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f4064b00 0x7f09f4143860 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f09e8002f70 tx=0x7f09e8006df0).stop 2021-06-25T04:55:07.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f9d5a700 1 -- 172.21.15.57:0/3907643689 shutdown_connections 2021-06-25T04:55:07.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f9d5a700 1 --2- 172.21.15.57:0/3907643689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f4064b00 0x7f09f4143860 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:07.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f9d5a700 1 -- 172.21.15.57:0/3907643689 >> 172.21.15.57:0/3907643689 conn(0x7f09f4062ba0 msgr2=0x7f09f405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:07.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f9d5a700 1 -- 172.21.15.57:0/3907643689 shutdown_connections 2021-06-25T04:55:07.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.004+0000 7f09f9d5a700 1 -- 172.21.15.57:0/3907643689 wait complete. 2021-06-25T04:55:07.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f9d5a700 1 Processor -- start 2021-06-25T04:55:07.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f9d5a700 1 -- start start 2021-06-25T04:55:07.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f9d5a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f4064b00 0x7f09f41560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:07.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f9d5a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09f40b2cb0 0x7f09f40b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:07.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f9d5a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09f40b3900 0x7f09f40b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:07.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f9d5a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f41565b0 con 0x7f09f4064b00 2021-06-25T04:55:07.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f9d5a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40b8300 con 0x7f09f40b3900 2021-06-25T04:55:07.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f9d5a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40b7dc0 con 0x7f09f40b2cb0 2021-06-25T04:55:07.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f8d58700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f4064b00 0x7f09f41560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:07.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f8d58700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f4064b00 0x7f09f41560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41200/0 (socket says 172.21.15.57:41200) 2021-06-25T04:55:07.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f8d58700 1 -- 172.21.15.57:0/678934233 learned_addr learned my addr 172.21.15.57:0/678934233 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:07.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f3fff700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09f40b2cb0 0x7f09f40b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:07.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f9559700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09f40b3900 0x7f09f40b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:07.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f8d58700 1 -- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09f40b2cb0 msgr2=0x7f09f40b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:07.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f8d58700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09f40b2cb0 0x7f09f40b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:07.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f8d58700 1 -- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09f40b3900 msgr2=0x7f09f40b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:07.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f8d58700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09f40b3900 0x7f09f40b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:07.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f8d58700 1 -- 172.21.15.57:0/678934233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e800b180 con 0x7f09f4064b00 2021-06-25T04:55:07.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.008+0000 7f09f8d58700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f4064b00 0x7f09f41560c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f09e8002f70 tx=0x7f09e8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:07.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.012+0000 7f09f1ffb700 1 -- 172.21.15.57:0/678934233 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e8006b20 con 0x7f09f4064b00 2021-06-25T04:55:07.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.012+0000 7f09f1ffb700 1 -- 172.21.15.57:0/678934233 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e800d1c0 con 0x7f09f4064b00 2021-06-25T04:55:07.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.012+0000 7f09f9d5a700 1 -- 172.21.15.57:0/678934233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f40b8060 con 0x7f09f4064b00 2021-06-25T04:55:07.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.012+0000 7f09f1ffb700 1 -- 172.21.15.57:0/678934233 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e801f440 con 0x7f09f4064b00 2021-06-25T04:55:07.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.012+0000 7f09f9d5a700 1 -- 172.21.15.57:0/678934233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f40ab800 con 0x7f09f4064b00 2021-06-25T04:55:07.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.012+0000 7f09f9d5a700 1 -- 172.21.15.57:0/678934233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f4057310 con 0x7f09f4064b00 2021-06-25T04:55:07.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.012+0000 7f09f1ffb700 1 -- 172.21.15.57:0/678934233 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f09e8025020 con 0x7f09f4064b00 2021-06-25T04:55:07.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.012+0000 7f09f1ffb700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09dc0553d0 0x7f09dc057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:07.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.012+0000 7f09f1ffb700 1 -- 172.21.15.57:0/678934233 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f09e806eee0 con 0x7f09f4064b00 2021-06-25T04:55:07.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.016+0000 7f09f3fff700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09dc0553d0 0x7f09dc057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:07.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.016+0000 7f09f3fff700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09dc0553d0 0x7f09dc057890 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f09e000d000 tx=0x7f09e0002810).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:07.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.016+0000 7f09f1ffb700 1 -- 172.21.15.57:0/678934233 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f09e8044f80 con 0x7f09f4064b00 2021-06-25T04:55:07.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.180+0000 7f09f9d5a700 1 -- 172.21.15.57:0/678934233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09f40ab560 con 0x7f09f4064b00 2021-06-25T04:55:07.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f1ffb700 1 -- 172.21.15.57:0/678934233 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f09e8006980 con 0x7f09f4064b00 2021-06-25T04:55:07.188 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:07.189 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3853681312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3853681312},{"type":"v1","addr":"172.21.15.87:6835","nonce":3853681312}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6981,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2200404668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2200404668},{"type":"v1","addr":"172.21.15.57:6833","nonce":2200404668}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:58.730365+0000","modified":"2021-06-25T04:54:59.734569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3959946984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3959946984},{"type":"v1","addr":"172.21.15.57:6835","nonce":3959946984}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-06-25T04:55:07.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 -- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09dc0553d0 msgr2=0x7f09dc057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:07.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09dc0553d0 0x7f09dc057890 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f09e000d000 tx=0x7f09e0002810).stop 2021-06-25T04:55:07.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 -- 172.21.15.57:0/678934233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f4064b00 msgr2=0x7f09f41560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:07.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f4064b00 0x7f09f41560c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f09e8002f70 tx=0x7f09e8014000).stop 2021-06-25T04:55:07.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 -- 172.21.15.57:0/678934233 shutdown_connections 2021-06-25T04:55:07.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09dc0553d0 0x7f09dc057890 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:07.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09f40b3900 0x7f09f40b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:07.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09f40b2cb0 0x7f09f40b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:07.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 --2- 172.21.15.57:0/678934233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f4064b00 0x7f09f41560c0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:07.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 -- 172.21.15.57:0/678934233 >> 172.21.15.57:0/678934233 conn(0x7f09f4062ba0 msgr2=0x7f09f4066bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:07.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 -- 172.21.15.57:0/678934233 shutdown_connections 2021-06-25T04:55:07.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:07.184+0000 7f09f9d5a700 1 -- 172.21.15.57:0/678934233 wait complete. 2021-06-25T04:55:07.193 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 47 2021-06-25T04:55:07.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:54:58.730365+0000', 'modified': '2021-06-25T04:54:59.734569+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6984}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6984': {'gid': 6984, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/3959946984', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 3959946984}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3959946984}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:55:07.509 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:55:07.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:55:07.628 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":6984,"want_state":"up:active","state":"up:active","rank_uptime":8.8838553860000005,"mdsmap_epoch":47,"osdmap_epoch":98,"osdmap_epoch_barrier":98,"uptime":13.215360252} 2021-06-25T04:55:07.628 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 6984, "mdsmap_epoch": 47, "osdmap_epoch": 98, "osdmap_epoch_barrier": 98, "rank_uptime": 8.883855386, "state": "up:active", "uptime": 13.215360252, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:55:07.629 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:55:07.629 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-06-25T04:55:07.630 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi161.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-06-25T04:55:07.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:07.631 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:07.640 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:55:07.657 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:07.658 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:07.715 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:07.716 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:07.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:07.717 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:55:07.726 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:55:07.726 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:07.775 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:55:07.794 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:07.795 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:07.852 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:2021-06-25T04:55:07.845+0000 7fe518654080 -1 init, newargv = 0x55d5e59dc8e0 newargc=9ceph-fuse[14726]: starting ceph client 2021-06-25T04:55:07.852 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr: 2021-06-25T04:55:07.853 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:07.854 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:07.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:07.855 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:55:07.862 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14726]: starting fuse 2021-06-25T04:55:08.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:55:08.140 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:55:08.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:55:08.146 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:55:08.963 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:55:08.981 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:08.982 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:08.991 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:08.992 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:08.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:08.995 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:55:09.000 INFO:teuthology.orchestra.run.smithi161.stdout:52 2021-06-25T04:55:09.000 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:55:09.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:09.001 DEBUG:teuthology.orchestra.run.smithi161:> sudo python3 -c ' 2021-06-25T04:55:09.002 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2021-06-25T04:55:09.002 DEBUG:teuthology.orchestra.run.smithi161:> import re 2021-06-25T04:55:09.006 DEBUG:teuthology.orchestra.run.smithi161:> import os 2021-06-25T04:55:09.007 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2021-06-25T04:55:09.008 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:09.009 DEBUG:teuthology.orchestra.run.smithi161:> def find_socket(client_name): 2021-06-25T04:55:09.009 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-06-25T04:55:09.010 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2021-06-25T04:55:09.011 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:09.012 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2021-06-25T04:55:09.013 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2021-06-25T04:55:09.014 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2021-06-25T04:55:09.015 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2021-06-25T04:55:09.015 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:09.016 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2021-06-25T04:55:09.017 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:55:09.017 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:55:09.018 DEBUG:teuthology.orchestra.run.smithi161:> return f 2021-06-25T04:55:09.019 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:55:09.020 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:09.021 DEBUG:teuthology.orchestra.run.smithi161:> print(find_socket("client.1")) 2021-06-25T04:55:09.021 DEBUG:teuthology.orchestra.run.smithi161:> ' 2021-06-25T04:55:09.068 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.14726.asok 2021-06-25T04:55:09.071 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14726.asok 2021-06-25T04:55:09.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:09.072 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14726.asok status 2021-06-25T04:55:09.206 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2021-06-25T04:55:09.207 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2021-06-25T04:55:09.207 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:55:09.207 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:55:09.207 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2021-06-25T04:55:09.207 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2021-06-25T04:55:09.208 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-06-25T04:55:09.208 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "14726", 2021-06-25T04:55:09.208 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2021-06-25T04:55:09.209 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:09.209 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2021-06-25T04:55:09.209 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2021-06-25T04:55:09.210 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 7108, 2021-06-25T04:55:09.210 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2021-06-25T04:55:09.210 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2021-06-25T04:55:09.210 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2021-06-25T04:55:09.211 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 7108 2021-06-25T04:55:09.211 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:09.211 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:55:09.211 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:55:09.211 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:55:09.212 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 10394315 2021-06-25T04:55:09.212 INFO:teuthology.orchestra.run.smithi161.stdout: } 2021-06-25T04:55:09.212 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:09.212 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:55:09.213 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:55:09.213 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:55:09.213 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 10394315 2021-06-25T04:55:09.213 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:09.213 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.7108 172.21.15.161:0/10394315", 2021-06-25T04:55:09.214 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "172.21.15.161:0/10394315", 2021-06-25T04:55:09.214 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2021-06-25T04:55:09.214 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 47, 2021-06-25T04:55:09.214 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 98, 2021-06-25T04:55:09.215 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:55:09.215 INFO:teuthology.orchestra.run.smithi161.stdout: "blacklisted": false, 2021-06-25T04:55:09.215 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2021-06-25T04:55:09.215 INFO:teuthology.orchestra.run.smithi161.stdout:} 2021-06-25T04:55:09.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:09.217 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:09.218 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:09.227 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:55:09.227 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:55:09.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:09.228 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:09.289 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-06-25T04:55:09.290 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2021-06-25T04:55:09.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-06-25T04:55:09.322 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:55:09.322 DEBUG:teuthology.orchestra.run.smithi102:> import stat 2021-06-25T04:55:09.323 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:09.323 DEBUG:teuthology.orchestra.run.smithi102:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2021-06-25T04:55:09.323 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:55:09.400 INFO:teuthology.orchestra.run.smithi102.stdout:1099511627776 2021-06-25T04:55:09.593 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.704+0000 7facb60e1700 1 Processor -- start 2021-06-25T04:55:09.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 -- start start 2021-06-25T04:55:09.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7facb00670e0 0x7facb00b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb0143970 0x7facb00aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb00b9b90 con 0x7facb013ffb0 2021-06-25T04:55:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb0143040 con 0x7facb00670e0 2021-06-25T04:55:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb00674c0 con 0x7facb0143970 2021-06-25T04:55:09.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facaf7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7facb00670e0 0x7facb00b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:09.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facaeffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb0143970 0x7facb00aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:09.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facaf7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7facb00670e0 0x7facb00b96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41210/0 (socket says 172.21.15.57:41210) 2021-06-25T04:55:09.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facaf7fe700 1 -- 172.21.15.57:0/2994243883 learned_addr learned my addr 172.21.15.57:0/2994243883 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:09.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facaffff700 1 --1- 172.21.15.57:0/2994243883 >> v1:172.21.15.87:6789/0 conn(0x7facb013ffb0 0x7facb0140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:59178/0 (socket says 172.21.15.57:59178) 2021-06-25T04:55:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facae7fc700 1 -- 172.21.15.57:0/2994243883 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408917696 0 0) 0x7faca8001490 con 0x7facb013ffb0 2021-06-25T04:55:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facae7fc700 1 -- 172.21.15.57:0/2994243883 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac9c003260 con 0x7facb013ffb0 2021-06-25T04:55:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facaf7fe700 1 -- 172.21.15.57:0/2994243883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb0143970 msgr2=0x7facb00aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facaf7fe700 1 --2- 172.21.15.57:0/2994243883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb0143970 0x7facb00aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facaf7fe700 1 -- 172.21.15.57:0/2994243883 >> v1:172.21.15.87:6789/0 conn(0x7facb013ffb0 legacy=0x7facb0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facaf7fe700 1 -- 172.21.15.57:0/2994243883 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb00af490 con 0x7facb00670e0 2021-06-25T04:55:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facaeffd700 1 --2- 172.21.15.57:0/2994243883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb0143970 0x7facb00aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facaf7fe700 1 --2- 172.21.15.57:0/2994243883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00670e0 0x7facb00b96a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7faca4002f70 tx=0x7faca4006eb0).ready entity=mon.0 client_cookie=8e17b7a035d4518b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facae7fc700 1 -- 172.21.15.57:0/2994243883 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faca400d5c0 con 0x7facb00670e0 2021-06-25T04:55:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facae7fc700 1 -- 172.21.15.57:0/2994243883 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca4000e90 con 0x7facb00670e0 2021-06-25T04:55:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facae7fc700 1 -- 172.21.15.57:0/2994243883 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faca400d950 con 0x7facb00670e0 2021-06-25T04:55:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 -- 172.21.15.57:0/2994243883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00670e0 msgr2=0x7facb00b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 --2- 172.21.15.57:0/2994243883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00670e0 0x7facb00b96a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7faca4002f70 tx=0x7faca4006eb0).stop 2021-06-25T04:55:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 -- 172.21.15.57:0/2994243883 shutdown_connections 2021-06-25T04:55:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 --2- 172.21.15.57:0/2994243883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb0143970 0x7facb00aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 --2- 172.21.15.57:0/2994243883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00670e0 0x7facb00b96a0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 -- 172.21.15.57:0/2994243883 >> 172.21.15.57:0/2994243883 conn(0x7facb005f9b0 msgr2=0x7facb0061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:09.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 -- 172.21.15.57:0/2994243883 shutdown_connections 2021-06-25T04:55:09.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.708+0000 7facb60e1700 1 -- 172.21.15.57:0/2994243883 wait complete. 2021-06-25T04:55:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facb60e1700 1 Processor -- start 2021-06-25T04:55:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facb60e1700 1 -- start start 2021-06-25T04:55:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facb60e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00670e0 0x7facb0142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facb60e1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb013ffb0 0x7facb0145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facb60e1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facb0143970 0x7facb0155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facb60e1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb0144bb0 con 0x7facb00670e0 2021-06-25T04:55:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facb60e1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb01455a0 con 0x7facb0143970 2021-06-25T04:55:09.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facb60e1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb0145840 con 0x7facb013ffb0 2021-06-25T04:55:09.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00670e0 0x7facb0142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:09.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaeffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb013ffb0 0x7facb0145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:09.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00670e0 0x7facb0142930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41216/0 (socket says 172.21.15.57:41216) 2021-06-25T04:55:09.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaf7fe700 1 -- 172.21.15.57:0/2933994954 learned_addr learned my addr 172.21.15.57:0/2933994954 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:09.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaffff700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facb0143970 0x7facb0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaeffd700 1 -- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facb0143970 msgr2=0x7facb0155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaeffd700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facb0143970 0x7facb0155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaeffd700 1 -- 172.21.15.57:0/2933994954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00670e0 msgr2=0x7facb0142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaeffd700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00670e0 0x7facb0142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaeffd700 1 -- 172.21.15.57:0/2933994954 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca000b180 con 0x7facb013ffb0 2021-06-25T04:55:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaf7fe700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00670e0 0x7facb0142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facaeffd700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb013ffb0 0x7facb0145f80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7faca000c000 tx=0x7faca0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facacff9700 1 -- 172.21.15.57:0/2933994954 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faca0010780 con 0x7facb013ffb0 2021-06-25T04:55:09.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facacff9700 1 -- 172.21.15.57:0/2933994954 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca00108e0 con 0x7facb013ffb0 2021-06-25T04:55:09.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facb60e1700 1 -- 172.21.15.57:0/2933994954 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca400b1e0 con 0x7facb013ffb0 2021-06-25T04:55:09.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facacff9700 1 -- 172.21.15.57:0/2933994954 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faca0010c40 con 0x7facb013ffb0 2021-06-25T04:55:09.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.712+0000 7facb60e1700 1 -- 172.21.15.57:0/2933994954 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb0144750 con 0x7facb013ffb0 2021-06-25T04:55:09.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.716+0000 7facb60e1700 1 -- 172.21.15.57:0/2933994954 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb01495a0 con 0x7facb013ffb0 2021-06-25T04:55:09.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.716+0000 7facacff9700 1 -- 172.21.15.57:0/2933994954 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7faca001c460 con 0x7facb013ffb0 2021-06-25T04:55:09.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.716+0000 7facacff9700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac90055450 0x7fac90057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:09.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.716+0000 7facacff9700 1 -- 172.21.15.57:0/2933994954 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7faca006e460 con 0x7facb013ffb0 2021-06-25T04:55:09.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.716+0000 7facaf7fe700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac90055450 0x7fac90057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:09.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.716+0000 7facaf7fe700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac90055450 0x7fac90057910 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7faca401b000 tx=0x7faca4015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:09.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.724+0000 7facacff9700 1 -- 172.21.15.57:0/2933994954 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7faca00444a0 con 0x7facb013ffb0 2021-06-25T04:55:09.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.888+0000 7facb60e1700 1 -- 172.21.15.57:0/2933994954 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facb0057310 con 0x7facb013ffb0 2021-06-25T04:55:09.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.888+0000 7facacff9700 1 -- 172.21.15.57:0/2933994954 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2493 (secure 0 0 0) 0x7faca0047ac0 con 0x7facb013ffb0 2021-06-25T04:55:09.893 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:09.894 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3853681312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3853681312},{"type":"v1","addr":"172.21.15.87:6835","nonce":3853681312}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6981,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2200404668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2200404668},{"type":"v1","addr":"172.21.15.57:6833","nonce":2200404668}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:58.730365+0000","modified":"2021-06-25T04:54:59.734569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3959946984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3959946984},{"type":"v1","addr":"172.21.15.57:6835","nonce":3959946984}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-06-25T04:55:09.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 -- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac90055450 msgr2=0x7fac90057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:09.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac90055450 0x7fac90057910 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7faca401b000 tx=0x7faca4015000).stop 2021-06-25T04:55:09.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 -- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb013ffb0 msgr2=0x7facb0145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:09.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb013ffb0 0x7facb0145f80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7faca000c000 tx=0x7faca0006df0).stop 2021-06-25T04:55:09.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 -- 172.21.15.57:0/2933994954 shutdown_connections 2021-06-25T04:55:09.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac90055450 0x7fac90057910 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:09.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facb0143970 0x7facb0155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:09.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facb013ffb0 0x7facb0145f80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:09.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 --2- 172.21.15.57:0/2933994954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00670e0 0x7facb0142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:09.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 -- 172.21.15.57:0/2933994954 >> 172.21.15.57:0/2933994954 conn(0x7facb005f9b0 msgr2=0x7facb00b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:09.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 -- 172.21.15.57:0/2933994954 shutdown_connections 2021-06-25T04:55:09.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:09.892+0000 7facb60e1700 1 -- 172.21.15.57:0/2933994954 wait complete. 2021-06-25T04:55:09.900 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 47 2021-06-25T04:55:09.907 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 0x10000000000 2021-06-25T04:55:10.011 INFO:teuthology.orchestra.run.smithi057.stdout:{"path":"/foo","ino":1099511627776,"rdev":0,"ctime":"2021-06-25T04:55:09.309482+0000","btime":"2021-06-25T04:55:09.309482+0000","mode":16877,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-06-25T04:55:09.309482+0000","atime":"2021-06-25T04:55:09.309482+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6332,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6332,"want_loner":6332,"mds_caps_wanted":[]} 2021-06-25T04:55:10.012 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2021-06-25T04:55:09.309482+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2021-06-25T04:55:09.309482+0000", "change_attr": 0, "client_caps": [ { "client_id": 6332, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-06-25T04:55:09.309482+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 0, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6332, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2021-06-25T04:55:09.309482+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/foo", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 6332, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [] } 2021-06-25T04:55:10.012 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:55:10.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:10.035 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:10.056 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:10.078 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:10.100 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:55:10.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:10.101 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:10.102 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:10.110 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:55:10.111 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:55:10.112 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:55:10.112 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:55:10.113 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:10.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15253]: fuse finished with error 0 and tester_r 0 2021-06-25T04:55:10.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:10.169 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:10.170 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:10.178 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:55:10.179 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:55:10.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:55:10.240 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:10.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:10.249 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:10.249 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:10.258 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:55:10.260 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:55:10.260 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2021-06-25T04:55:10.261 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:55:10.261 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:10.277 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14726]: fuse finished with error 0 and tester_r 0 2021-06-25T04:55:10.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:10.280 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:10.280 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:10.327 INFO:teuthology.orchestra.run.smithi161.stdout:ext2/ext3 2021-06-25T04:55:10.328 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:55:10.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:55:10.447 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:10.456 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:55:10.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.564+0000 7fd38c9b6700 1 Processor -- start 2021-06-25T04:55:10.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.564+0000 7fd38c9b6700 1 -- start start 2021-06-25T04:55:10.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.564+0000 7fd38c9b6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd38813c6a0 0x7fd38813cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:10.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.564+0000 7fd38c9b6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3880acee0 0x7fd3880ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:10.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.564+0000 7fd38c9b6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3880b2bf0 con 0x7fd3880b2810 2021-06-25T04:55:10.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.564+0000 7fd38c9b6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3880b1170 con 0x7fd3880acee0 2021-06-25T04:55:10.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.564+0000 7fd38c9b6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3880b1620 con 0x7fd38813c6a0 2021-06-25T04:55:10.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3880acee0 0x7fd3880ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:10.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3880acee0 0x7fd3880ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41224/0 (socket says 172.21.15.57:41224) 2021-06-25T04:55:10.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38759e700 1 -- 172.21.15.57:0/1036650433 learned_addr learned my addr 172.21.15.57:0/1036650433 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:10.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38659c700 1 --2- 172.21.15.57:0/1036650433 >> v2:172.21.15.87:3300/0 conn(0x7fd38813c6a0 0x7fd38813cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:10.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38759e700 1 -- 172.21.15.57:0/1036650433 >> v2:172.21.15.87:3300/0 conn(0x7fd38813c6a0 msgr2=0x7fd38813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:10.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38759e700 1 --2- 172.21.15.57:0/1036650433 >> v2:172.21.15.87:3300/0 conn(0x7fd38813c6a0 0x7fd38813cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:10.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38759e700 1 -- 172.21.15.57:0/1036650433 >> v1:172.21.15.87:6789/0 conn(0x7fd3880b2810 legacy=0x7fd3880b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:10.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38759e700 1 -- 172.21.15.57:0/1036650433 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3880b18c0 con 0x7fd3880acee0 2021-06-25T04:55:10.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38759e700 1 --2- 172.21.15.57:0/1036650433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3880acee0 0x7fd3880ad300 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fd3800032f0 tx=0x7fd380009290).ready entity=mon.0 client_cookie=e73825839170e1d2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:10.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd385d9b700 1 -- 172.21.15.57:0/1036650433 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd38000b870 con 0x7fd3880acee0 2021-06-25T04:55:10.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd385d9b700 1 -- 172.21.15.57:0/1036650433 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38000b9d0 con 0x7fd3880acee0 2021-06-25T04:55:10.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd385d9b700 1 -- 172.21.15.57:0/1036650433 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd38000bb40 con 0x7fd3880acee0 2021-06-25T04:55:10.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1036650433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3880acee0 msgr2=0x7fd3880ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:10.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38c9b6700 1 --2- 172.21.15.57:0/1036650433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3880acee0 0x7fd3880ad300 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fd3800032f0 tx=0x7fd380009290).stop 2021-06-25T04:55:10.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1036650433 shutdown_connections 2021-06-25T04:55:10.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38c9b6700 1 --2- 172.21.15.57:0/1036650433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3880acee0 0x7fd3880ad300 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:10.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38c9b6700 1 --2- 172.21.15.57:0/1036650433 >> v2:172.21.15.87:3300/0 conn(0x7fd38813c6a0 0x7fd38813cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:10.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1036650433 >> 172.21.15.57:0/1036650433 conn(0x7fd3880611f0 msgr2=0x7fd388062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:10.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1036650433 shutdown_connections 2021-06-25T04:55:10.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1036650433 wait complete. 2021-06-25T04:55:10.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38c9b6700 1 Processor -- start 2021-06-25T04:55:10.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.568+0000 7fd38c9b6700 1 -- start start 2021-06-25T04:55:10.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38c9b6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3880acee0 0x7fd388065600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:10.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38c9b6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3880b2810 0x7fd38812e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:10.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38c9b6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd38813c6a0 0x7fd3880b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:10.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38c9b6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd388064250 con 0x7fd3880b2810 2021-06-25T04:55:10.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38c9b6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880644f0 con 0x7fd38813c6a0 2021-06-25T04:55:10.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38c9b6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd388064790 con 0x7fd3880acee0 2021-06-25T04:55:10.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3880b2810 0x7fd38812e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:10.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3880b2810 0x7fd38812e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41228/0 (socket says 172.21.15.57:41228) 2021-06-25T04:55:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd38813c6a0 0x7fd3880b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38659c700 1 -- 172.21.15.57:0/1917268467 learned_addr learned my addr 172.21.15.57:0/1917268467 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd386d9d700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3880acee0 0x7fd388065600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38659c700 1 -- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3880acee0 msgr2=0x7fd388065600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:10.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38659c700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3880acee0 0x7fd388065600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:10.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38659c700 1 -- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd38813c6a0 msgr2=0x7fd3880b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:10.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38659c700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd38813c6a0 0x7fd3880b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:10.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38659c700 1 -- 172.21.15.57:0/1917268467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380009530 con 0x7fd3880b2810 2021-06-25T04:55:10.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38659c700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3880b2810 0x7fd38812e440 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fd37800c000 tx=0x7fd378006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:10.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd377fff700 1 -- 172.21.15.57:0/1917268467 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd378011750 con 0x7fd3880b2810 2021-06-25T04:55:10.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd377fff700 1 -- 172.21.15.57:0/1917268467 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3780118b0 con 0x7fd3880b2810 2021-06-25T04:55:10.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1917268467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd388063890 con 0x7fd3880b2810 2021-06-25T04:55:10.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd377fff700 1 -- 172.21.15.57:0/1917268467 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd378011c10 con 0x7fd3880b2810 2021-06-25T04:55:10.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1917268467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd388066dd0 con 0x7fd3880b2810 2021-06-25T04:55:10.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.572+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1917268467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd388063a20 con 0x7fd3880b2810 2021-06-25T04:55:10.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.576+0000 7fd377fff700 1 -- 172.21.15.57:0/1917268467 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd378011d70 con 0x7fd3880b2810 2021-06-25T04:55:10.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.576+0000 7fd377fff700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd364055450 0x7fd364057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:10.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.576+0000 7fd377fff700 1 -- 172.21.15.57:0/1917268467 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd37806e300 con 0x7fd3880b2810 2021-06-25T04:55:10.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.576+0000 7fd386d9d700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd364055450 0x7fd364057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:10.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.576+0000 7fd386d9d700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd364055450 0x7fd364057910 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fd37c00d000 tx=0x7fd37c000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:10.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.584+0000 7fd377fff700 1 -- 172.21.15.57:0/1917268467 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd3780444b0 con 0x7fd3880b2810 2021-06-25T04:55:10.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.712+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1917268467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd38805f200 con 0x7fd3880b2810 2021-06-25T04:55:10.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.712+0000 7fd377fff700 1 -- 172.21.15.57:0/1917268467 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v98) v1 ==== 81+0+34040 (secure 0 0 0) 0x7fd378047ad0 con 0x7fd3880b2810 2021-06-25T04:55:10.719 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:10.719 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:55:10.719 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 98, 2021-06-25T04:55:10.719 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:55:10.720 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:55:10.720 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:54:59.733440+0000", 2021-06-25T04:55:10.720 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:55:10.720 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:55:10.720 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:55:10.721 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:55:10.721 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:55:10.721 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:55:10.721 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:55:10.722 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:55:10.722 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:55:10.722 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:10.722 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:55:10.723 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:55:10.723 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:55:10.723 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:55:10.723 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:55:10.724 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 18, 2021-06-25T04:55:10.724 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:55:10.724 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:55:10.724 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:55:10.724 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:55:10.725 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:55:10.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.725 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:55:10.725 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:55:10.726 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:55:10.726 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:10.726 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:10.726 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:10.727 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:10.728 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:10.728 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:10.729 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:10.729 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:10.729 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:55:10.729 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:55:10.730 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:55:10.730 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:55:10.730 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:55:10.730 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:10.731 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:10.731 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:10.731 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:10.731 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:10.731 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:10.732 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:10.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.732 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:55:10.732 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:10.733 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:10.733 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:10.733 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:10.733 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:10.733 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:10.734 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:10.734 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:10.735 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:10.735 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:10.736 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:10.736 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:10.736 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:10.736 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:10.737 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:10.737 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:10.737 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:10.738 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:10.738 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:10.738 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:10.738 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:10.739 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:10.739 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:10.739 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:10.739 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:10.739 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:10.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.740 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:10.740 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:10.742 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:10.742 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:10.742 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:10.743 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:10.743 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:10.743 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:10.743 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:10.744 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:10.744 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:10.744 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:55:10.744 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:55:10.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.745 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:10.745 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:55:10.745 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.746 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:55:10.746 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:55:10.746 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:55:10.747 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:10.747 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:10.747 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:10.747 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:10.748 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:10.748 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:10.748 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:10.748 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:10.748 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:55:10.749 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:55:10.749 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:55:10.749 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:55:10.749 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:55:10.750 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:10.750 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:10.750 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:10.750 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:10.751 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:10.751 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:10.751 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:10.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.752 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:55:10.752 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:10.752 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:10.752 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:10.752 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:10.753 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:10.753 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:10.753 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:10.753 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:10.754 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:10.754 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:10.754 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:10.754 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:10.755 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:10.755 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:10.755 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:10.755 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:10.755 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:10.756 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:10.756 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:10.756 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:10.756 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:10.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.758 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:10.758 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:10.758 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:10.759 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:10.759 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:10.759 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:10.759 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:10.759 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:10.760 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:10.760 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:10.760 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:10.760 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:55:10.761 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:10.761 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:55:10.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.762 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 17, 2021-06-25T04:55:10.762 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:55:10.762 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:54:57.196707+0000", 2021-06-25T04:55:10.762 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:10.763 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:10.763 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:10.764 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:10.764 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:10.765 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:10.765 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:10.765 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:10.765 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:55:10.766 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:55:10.766 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:55:10.766 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:55:10.766 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:55:10.767 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:10.767 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:10.767 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:10.767 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:10.768 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:10.768 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:10.768 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:10.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.768 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "97", 2021-06-25T04:55:10.769 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:10.769 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:10.769 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:10.769 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:10.770 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:10.770 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:10.770 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:10.770 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:10.771 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:10.771 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:10.771 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:10.771 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:10.772 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:10.772 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:10.772 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:10.772 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:10.772 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:10.773 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:10.773 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:10.773 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:10.773 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:10.774 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:10.774 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:10.774 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:10.774 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:10.774 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:10.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.775 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:10.775 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:10.776 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:10.776 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:10.776 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:10.776 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:10.776 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:10.777 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:10.777 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:10.777 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:10.777 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:55:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:55:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:55:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:55:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.779 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:10.779 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:55:10.779 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:55:10.779 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.780 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.780 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 18, 2021-06-25T04:55:10.781 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:55:10.781 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:54:58.096573+0000", 2021-06-25T04:55:10.781 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:10.781 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:10.781 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:10.782 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:10.782 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:10.782 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:10.782 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:10.783 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:10.783 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:55:10.783 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:55:10.783 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:55:10.784 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:55:10.784 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:55:10.784 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:10.784 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:10.785 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:10.785 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:10.785 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:10.785 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:10.785 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:10.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.786 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "98", 2021-06-25T04:55:10.786 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:10.786 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:10.787 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:10.787 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:10.787 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:10.787 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:10.788 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:10.788 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:10.788 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:10.788 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:10.788 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:10.789 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:10.789 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:10.789 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:10.789 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:10.790 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:10.790 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:10.790 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:10.790 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:10.790 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:10.791 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:10.791 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:10.791 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:10.791 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:10.792 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:10.792 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:10.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.792 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:10.793 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:10.793 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:10.793 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:10.793 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:10.793 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:10.794 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:10.794 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:10.794 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:10.794 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:10.795 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:10.795 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:55:10.795 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:10.795 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:55:10.796 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:55:10.796 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.796 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.796 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.797 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:10.797 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:55:10.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.797 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:55:10.798 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:55:10.798 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:10.798 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:10.798 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:10.799 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:10.799 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:10.799 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:10.799 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:10.799 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 96, 2021-06-25T04:55:10.800 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:10.800 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:10.800 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:10.801 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.801 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.801 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:55:10.802 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:10.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.802 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.803 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:55:10.803 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:10.803 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.803 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.804 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:10.804 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.805 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.805 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:55:10.805 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:10.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.806 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.806 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:55:10.806 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:10.806 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.807 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.807 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:10.807 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.808 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.808 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:55:10.808 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:10.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.809 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.809 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:55:10.810 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:10.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.810 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.811 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:10.811 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.812 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.812 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:55:10.812 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:10.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.813 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.813 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:55:10.814 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:10.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.814 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.815 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:55:10.815 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:55:10.815 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:55:10.815 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:55:10.816 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:10.819 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:10.820 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:10.821 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.822 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:55:10.823 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:55:10.823 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:10.824 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:10.824 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:10.824 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:10.825 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:10.825 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:10.826 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:10.826 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 96, 2021-06-25T04:55:10.827 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:10.827 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:10.827 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:10.828 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.829 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.830 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:55:10.830 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:10.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.831 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.832 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:55:10.832 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:10.833 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.833 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.834 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:10.834 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.835 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.836 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:55:10.836 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:10.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.837 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.838 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:55:10.838 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:10.839 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.839 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.840 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:10.841 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.841 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.842 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:55:10.842 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:10.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.844 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.844 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:55:10.845 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:10.845 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.845 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.846 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:10.847 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.848 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.848 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:55:10.848 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:10.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.850 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.850 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:55:10.851 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:10.851 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.851 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.852 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:55:10.853 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:55:10.853 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:55:10.853 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:55:10.853 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:10.854 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:10.854 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:10.854 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.855 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:55:10.855 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:55:10.855 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:10.855 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:10.856 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:10.856 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:10.856 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:10.856 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:10.857 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:10.857 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 96, 2021-06-25T04:55:10.857 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:10.857 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:10.858 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:10.858 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.858 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.859 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:55:10.859 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:10.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.860 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.860 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:55:10.860 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:10.861 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.861 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.861 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:10.862 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.862 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.864 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:55:10.865 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:10.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.865 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.866 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:55:10.866 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:10.866 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.867 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.867 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:10.867 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.868 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.868 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:55:10.868 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:10.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.869 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.869 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:55:10.870 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:10.870 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.870 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.871 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:10.871 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.872 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.872 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:55:10.872 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:10.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.873 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.874 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:55:10.874 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:10.874 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.874 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.875 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:55:10.875 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:55:10.875 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:55:10.876 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:55:10.876 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:10.876 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:10.876 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:10.877 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.877 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:55:10.878 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:55:10.878 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:10.878 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:10.878 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:10.879 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:10.879 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:10.879 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:10.879 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:10.880 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 96, 2021-06-25T04:55:10.880 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:10.880 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:10.880 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:10.881 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.881 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.881 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:55:10.882 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:10.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.883 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.883 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:55:10.883 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:10.884 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.884 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.885 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:10.886 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.886 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.887 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:55:10.887 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:10.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:55:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.889 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.889 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:10.889 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.890 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.890 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:55:10.890 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:10.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.891 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.891 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:55:10.892 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:10.892 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.892 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.892 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:10.893 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.893 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.893 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:55:10.894 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:10.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.894 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.895 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:55:10.895 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:10.895 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.895 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.896 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:55:10.896 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:55:10.896 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:55:10.897 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:55:10.897 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:10.897 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:10.897 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:10.898 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.898 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:55:10.899 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:55:10.899 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:10.899 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:10.899 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:10.899 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:10.900 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:10.900 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:10.900 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:10.900 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 95, 2021-06-25T04:55:10.901 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:10.901 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:10.901 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:10.901 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.902 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.902 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:55:10.902 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:10.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.903 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.903 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:55:10.904 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:10.904 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.904 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.905 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:10.905 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.905 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.906 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:55:10.906 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:10.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.907 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.907 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:55:10.907 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:10.907 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.908 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.908 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:10.908 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.909 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.909 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:55:10.909 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:10.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:55:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:55:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:55:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:55:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:55:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:55:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:55:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:55:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:55:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:55:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:55:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.922 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:55:10.922 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:10.922 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.923 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.923 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:10.923 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.924 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.924 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:55:10.924 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:10.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.925 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.925 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:55:10.925 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:10.926 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.926 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.926 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:10.927 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.927 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.927 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:55:10.928 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:10.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.928 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.928 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:55:10.929 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:10.929 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.929 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.930 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:10.930 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.930 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.931 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:55:10.931 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:10.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.932 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.932 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:55:10.932 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:10.932 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.933 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.933 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:55:10.933 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:55:10.934 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:55:10.934 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:55:10.934 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:10.934 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:10.935 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:10.935 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.935 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:55:10.936 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:55:10.936 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:10.936 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:10.936 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:10.937 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:10.937 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:10.937 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:10.937 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:10.938 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 95, 2021-06-25T04:55:10.938 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:10.938 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:10.938 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:10.939 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.939 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.939 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:55:10.940 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:10.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.940 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:55:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.942 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:10.942 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.942 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.943 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:55:10.943 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:10.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.944 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.944 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:55:10.944 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:10.944 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.945 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.945 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:10.945 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.946 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.946 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:55:10.946 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:10.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.947 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.947 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:55:10.947 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:10.948 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.948 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.948 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:10.949 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.949 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.949 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:55:10.950 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:10.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.950 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.951 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:55:10.951 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:10.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.951 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.952 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:55:10.952 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:55:10.952 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:55:10.952 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:55:10.953 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:10.953 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:10.953 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:10.953 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.954 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:55:10.954 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:55:10.955 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:10.955 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:10.955 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:10.955 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:10.956 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:10.956 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:10.956 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:10.956 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 96, 2021-06-25T04:55:10.956 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:10.957 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:10.957 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:10.957 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.958 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.958 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:55:10.958 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:10.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.959 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.959 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:55:10.959 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:10.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.960 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.960 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:10.960 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.961 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.961 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:55:10.961 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:10.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.962 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.962 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:55:10.963 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:10.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.963 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.964 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:10.964 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.964 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.964 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:55:10.965 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:10.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.965 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.966 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:55:10.966 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:10.966 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.966 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.967 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:10.967 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:10.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.968 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:10.968 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:55:10.968 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:10.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.969 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:10.969 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:55:10.969 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:10.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.970 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.970 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:55:10.970 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:55:10.971 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:55:10.971 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:55:10.971 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:10.971 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:10.972 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:10.972 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:10.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.972 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:10.973 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:55:10.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.973 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:55:10.973 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:10.973 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:10.974 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:10.974 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:10.974 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:10.974 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:55:10.975 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:10.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.975 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:55:10.976 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:10.976 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:10.976 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:10.976 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:10.977 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:10.977 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:55:10.977 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:10.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.978 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:55:10.978 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:10.978 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:10.978 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:10.979 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:10.979 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:10.979 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:55:10.979 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:10.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.980 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:55:10.980 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:10.981 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:10.981 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:10.981 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:10.981 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:10.981 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:55:10.982 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:10.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.982 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:55:10.983 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:10.983 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:10.983 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:10.983 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:10.984 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:10.984 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:55:10.984 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:10.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.985 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:55:10.985 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:10.985 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:10.985 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:10.986 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:10.986 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:10.986 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:55:10.986 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:10.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.987 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:55:10.987 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:10.988 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:10.988 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:10.988 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:10.988 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:10.989 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:55:10.989 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:10.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:10.989 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:55:10.990 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:10.990 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:10.990 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:10.990 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:10.991 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:10.991 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:55:10.991 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:10.991 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.992 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:10.992 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:55:10.992 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:55:10.992 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:55:10.993 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:55:10.993 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": {}, 2021-06-25T04:55:10.993 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:55:10.993 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:55:10.993 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:55:10.994 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:55:10.994 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:55:10.994 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:55:10.994 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:55:10.995 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:55:10.995 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:55:10.995 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:55:10.995 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:55:10.996 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:55:10.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.996 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:55:10.996 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:55:10.997 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:55:10.997 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:55:10.997 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:55:10.997 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:55:10.997 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:55:10.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:10.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:10.998 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:55:10.998 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:55:10.999 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:55:10.999 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:55:10.999 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:55:10.999 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:55:11.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd364055450 msgr2=0x7fd364057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd364055450 0x7fd364057910 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fd37c00d000 tx=0x7fd37c000bc0).stop 2021-06-25T04:55:11.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1917268467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3880b2810 msgr2=0x7fd38812e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3880b2810 0x7fd38812e440 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fd37800c000 tx=0x7fd378006df0).stop 2021-06-25T04:55:11.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1917268467 shutdown_connections 2021-06-25T04:55:11.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd364055450 0x7fd364057910 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd38813c6a0 0x7fd3880b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3880b2810 0x7fd38812e440 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 --2- 172.21.15.57:0/1917268467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3880acee0 0x7fd388065600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1917268467 >> 172.21.15.57:0/1917268467 conn(0x7fd3880611f0 msgr2=0x7fd38813ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:11.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1917268467 shutdown_connections 2021-06-25T04:55:11.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:10.716+0000 7fd38c9b6700 1 -- 172.21.15.57:0/1917268467 wait complete. 2021-06-25T04:55:11.006 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:11.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.116+0000 7f3f42e59700 1 Processor -- start 2021-06-25T04:55:11.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.116+0000 7f3f42e59700 1 -- start start 2021-06-25T04:55:11.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.116+0000 7f3f42e59700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f3c0ac9f0 0x7f3f3c0b5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.116+0000 7f3f42e59700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3f3c0ad830 0x7f3f3c143480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.116+0000 7f3f42e59700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3c0acdd0 con 0x7f3f3c143970 2021-06-25T04:55:11.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.116+0000 7f3f42e59700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c0b5120 con 0x7f3f3c0ad830 2021-06-25T04:55:11.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.116+0000 7f3f42e59700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0adea0 con 0x7f3f3c0ac9f0 2021-06-25T04:55:11.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f42658700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3f3c143970 0x7f3f3c066fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58456/0 (socket says 172.21.15.57:58456) 2021-06-25T04:55:11.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f42658700 1 -- 172.21.15.57:0/2232872720 learned_addr learned my addr 172.21.15.57:0/2232872720 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:11.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f41e57700 1 --2- 172.21.15.57:0/2232872720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f3c0ac9f0 0x7f3f3c0b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f41656700 1 --2- 172.21.15.57:0/2232872720 >> v2:172.21.15.87:3300/0 conn(0x7f3f3c0ad830 0x7f3f3c143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f40e55700 1 -- 172.21.15.57:0/2232872720 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633079292 0 0) 0x7f3f3c0acdd0 con 0x7f3f3c143970 2021-06-25T04:55:11.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f40e55700 1 -- 172.21.15.57:0/2232872720 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f24003260 con 0x7f3f3c143970 2021-06-25T04:55:11.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f41e57700 1 -- 172.21.15.57:0/2232872720 >> v2:172.21.15.87:3300/0 conn(0x7f3f3c0ad830 msgr2=0x7f3f3c143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:11.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f41e57700 1 --2- 172.21.15.57:0/2232872720 >> v2:172.21.15.87:3300/0 conn(0x7f3f3c0ad830 0x7f3f3c143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f41e57700 1 -- 172.21.15.57:0/2232872720 >> v1:172.21.15.57:6789/0 conn(0x7f3f3c143970 legacy=0x7f3f3c066fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f41e57700 1 -- 172.21.15.57:0/2232872720 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c0ae140 con 0x7f3f3c0ac9f0 2021-06-25T04:55:11.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f41e57700 1 --2- 172.21.15.57:0/2232872720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f3c0ac9f0 0x7f3f3c0b5580 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f3f340032f0 tx=0x7f3f340091d0).ready entity=mon.2 client_cookie=5389214351aa844c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:11.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f40e55700 1 -- 172.21.15.57:0/2232872720 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3400b600 con 0x7f3f3c0ac9f0 2021-06-25T04:55:11.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f40e55700 1 -- 172.21.15.57:0/2232872720 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3400b760 con 0x7f3f3c0ac9f0 2021-06-25T04:55:11.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f40e55700 1 -- 172.21.15.57:0/2232872720 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3400b8d0 con 0x7f3f3c0ac9f0 2021-06-25T04:55:11.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f42e59700 1 -- 172.21.15.57:0/2232872720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f3c0ac9f0 msgr2=0x7f3f3c0b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f42e59700 1 --2- 172.21.15.57:0/2232872720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f3c0ac9f0 0x7f3f3c0b5580 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f3f340032f0 tx=0x7f3f340091d0).stop 2021-06-25T04:55:11.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f42e59700 1 -- 172.21.15.57:0/2232872720 shutdown_connections 2021-06-25T04:55:11.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f42e59700 1 --2- 172.21.15.57:0/2232872720 >> v2:172.21.15.87:3300/0 conn(0x7f3f3c0ad830 0x7f3f3c143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f42e59700 1 --2- 172.21.15.57:0/2232872720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f3c0ac9f0 0x7f3f3c0b5580 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f42e59700 1 -- 172.21.15.57:0/2232872720 >> 172.21.15.57:0/2232872720 conn(0x7f3f3c062520 msgr2=0x7f3f3c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:11.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f42e59700 1 -- 172.21.15.57:0/2232872720 shutdown_connections 2021-06-25T04:55:11.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.120+0000 7f3f42e59700 1 -- 172.21.15.57:0/2232872720 wait complete. 2021-06-25T04:55:11.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42e59700 1 Processor -- start 2021-06-25T04:55:11.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42e59700 1 -- start start 2021-06-25T04:55:11.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42e59700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f3c0ac9f0 0x7f3f3c0a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42e59700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f3c0ad830 0x7f3f3c142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42e59700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3c143970 0x7f3f3c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42e59700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0a08c0 con 0x7f3f3c143970 2021-06-25T04:55:11.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42e59700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0a0380 con 0x7f3f3c0ad830 2021-06-25T04:55:11.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42e59700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0a0620 con 0x7f3f3c0ac9f0 2021-06-25T04:55:11.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42658700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3c143970 0x7f3f3c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42658700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3c143970 0x7f3f3c1561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41246/0 (socket says 172.21.15.57:41246) 2021-06-25T04:55:11.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42658700 1 -- 172.21.15.57:0/3708409965 learned_addr learned my addr 172.21.15.57:0/3708409965 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:11.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f41e57700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f3c0ac9f0 0x7f3f3c0a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f41656700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f3c0ad830 0x7f3f3c142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42658700 1 -- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f3c0ac9f0 msgr2=0x7f3f3c0a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42658700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f3c0ac9f0 0x7f3f3c0a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42658700 1 -- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f3c0ad830 msgr2=0x7f3f3c142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42658700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f3c0ad830 0x7f3f3c142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42658700 1 -- 172.21.15.57:0/3708409965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f34009470 con 0x7f3f3c143970 2021-06-25T04:55:11.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42658700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3c143970 0x7f3f3c1561c0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f3f38001110 tx=0x7f3f38007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:11.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f2affd700 1 -- 172.21.15.57:0/3708409965 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3800ce30 con 0x7f3f3c143970 2021-06-25T04:55:11.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f2affd700 1 -- 172.21.15.57:0/3708409965 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f380070d0 con 0x7f3f3c143970 2021-06-25T04:55:11.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42e59700 1 -- 172.21.15.57:0/3708409965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3c152570 con 0x7f3f3c143970 2021-06-25T04:55:11.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f2affd700 1 -- 172.21.15.57:0/3708409965 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f38007430 con 0x7f3f3c143970 2021-06-25T04:55:11.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.124+0000 7f3f42e59700 1 -- 172.21.15.57:0/3708409965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c152aa0 con 0x7f3f3c143970 2021-06-25T04:55:11.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.128+0000 7f3f42e59700 1 -- 172.21.15.57:0/3708409965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c057310 con 0x7f3f3c143970 2021-06-25T04:55:11.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.128+0000 7f3f2affd700 1 -- 172.21.15.57:0/3708409965 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3f3801a060 con 0x7f3f3c143970 2021-06-25T04:55:11.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.128+0000 7f3f2affd700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f1c0554e0 0x7f3f1c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.128+0000 7f3f2affd700 1 -- 172.21.15.57:0/3708409965 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3f3806d5b0 con 0x7f3f3c143970 2021-06-25T04:55:11.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.128+0000 7f3f41e57700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f1c0554e0 0x7f3f1c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.132+0000 7f3f41e57700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f1c0554e0 0x7f3f1c0579a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f3f3401b000 tx=0x7f3f34016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:11.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.136+0000 7f3f2affd700 1 -- 172.21.15.57:0/3708409965 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3f38043760 con 0x7f3f3c143970 2021-06-25T04:55:11.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.300+0000 7f3f42e59700 1 -- 172.21.15.57:0/3708409965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f3c05f200 con 0x7f3f3c143970 2021-06-25T04:55:11.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.300+0000 7f3f2affd700 1 -- 172.21.15.57:0/3708409965 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f3f38018020 con 0x7f3f3c143970 2021-06-25T04:55:11.304 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:11.304 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3853681312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3853681312},{"type":"v1","addr":"172.21.15.87:6835","nonce":3853681312}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6981,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2200404668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2200404668},{"type":"v1","addr":"172.21.15.57:6833","nonce":2200404668}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:58.730365+0000","modified":"2021-06-25T04:54:59.734569+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3959946984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3959946984},{"type":"v1","addr":"172.21.15.57:6835","nonce":3959946984}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-06-25T04:55:11.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 -- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f1c0554e0 msgr2=0x7f3f1c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f1c0554e0 0x7f3f1c0579a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f3f3401b000 tx=0x7f3f34016000).stop 2021-06-25T04:55:11.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 -- 172.21.15.57:0/3708409965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3c143970 msgr2=0x7f3f3c1561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3c143970 0x7f3f3c1561c0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f3f38001110 tx=0x7f3f38007a40).stop 2021-06-25T04:55:11.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 -- 172.21.15.57:0/3708409965 shutdown_connections 2021-06-25T04:55:11.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f1c0554e0 0x7f3f1c0579a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3c143970 0x7f3f3c1561c0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f3c0ad830 0x7f3f3c142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 --2- 172.21.15.57:0/3708409965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f3c0ac9f0 0x7f3f3c0a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 -- 172.21.15.57:0/3708409965 >> 172.21.15.57:0/3708409965 conn(0x7f3f3c062520 msgr2=0x7f3f3c0b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:11.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 -- 172.21.15.57:0/3708409965 shutdown_connections 2021-06-25T04:55:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.304+0000 7f3f42e59700 1 -- 172.21.15.57:0/3708409965 wait complete. 2021-06-25T04:55:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 47 2021-06-25T04:55:11.322 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:55:11.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.424+0000 7f3c0f1df700 1 Processor -- start 2021-06-25T04:55:11.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.424+0000 7f3c0f1df700 1 -- start start 2021-06-25T04:55:11.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3c080612e0 0x7f3c080616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3c080ad580 0x7f3c080b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c080aecb0 con 0x7f3c08140400 2021-06-25T04:55:11.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c080b6ee0 con 0x7f3c080ad580 2021-06-25T04:55:11.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080aeee0 con 0x7f3c080612e0 2021-06-25T04:55:11.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0d9dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3c080ad580 0x7f3c080b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0e9de700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3c08140400 0x7f3c081464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58472/0 (socket says 172.21.15.57:58472) 2021-06-25T04:55:11.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0e9de700 1 -- 172.21.15.57:0/4046870802 learned_addr learned my addr 172.21.15.57:0/4046870802 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:11.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0e1dd700 1 --2- 172.21.15.57:0/4046870802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3c080612e0 0x7f3c080616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0d1db700 1 -- 172.21.15.57:0/4046870802 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196184353 0 0) 0x7f3c080aecb0 con 0x7f3c08140400 2021-06-25T04:55:11.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0d1db700 1 -- 172.21.15.57:0/4046870802 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bf0003260 con 0x7f3c08140400 2021-06-25T04:55:11.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0d9dc700 1 -- 172.21.15.57:0/4046870802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3c080612e0 msgr2=0x7f3c080616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:11.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0d9dc700 1 --2- 172.21.15.57:0/4046870802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3c080612e0 0x7f3c080616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0d9dc700 1 -- 172.21.15.57:0/4046870802 >> v1:172.21.15.57:6789/0 conn(0x7f3c08140400 legacy=0x7f3c081464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0d9dc700 1 -- 172.21.15.57:0/4046870802 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c080af180 con 0x7f3c080ad580 2021-06-25T04:55:11.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0e1dd700 1 --2- 172.21.15.57:0/4046870802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3c080612e0 0x7f3c080616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:11.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0d9dc700 1 --2- 172.21.15.57:0/4046870802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c080ad580 0x7f3c080b9e20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f3c04002f70 tx=0x7f3c04006df0).ready entity=mon.0 client_cookie=6e085bee9577578d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:11.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0d1db700 1 -- 172.21.15.57:0/4046870802 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c0400d4a0 con 0x7f3c080ad580 2021-06-25T04:55:11.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0d1db700 1 -- 172.21.15.57:0/4046870802 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c04000e90 con 0x7f3c080ad580 2021-06-25T04:55:11.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0d1db700 1 -- 172.21.15.57:0/4046870802 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c0400d7f0 con 0x7f3c080ad580 2021-06-25T04:55:11.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 -- 172.21.15.57:0/4046870802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c080ad580 msgr2=0x7f3c080b9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 --2- 172.21.15.57:0/4046870802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c080ad580 0x7f3c080b9e20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f3c04002f70 tx=0x7f3c04006df0).stop 2021-06-25T04:55:11.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 -- 172.21.15.57:0/4046870802 shutdown_connections 2021-06-25T04:55:11.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 --2- 172.21.15.57:0/4046870802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c080ad580 0x7f3c080b9e20 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 --2- 172.21.15.57:0/4046870802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3c080612e0 0x7f3c080616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 -- 172.21.15.57:0/4046870802 >> 172.21.15.57:0/4046870802 conn(0x7f3c08066da0 msgr2=0x7f3c08067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:11.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 -- 172.21.15.57:0/4046870802 shutdown_connections 2021-06-25T04:55:11.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.428+0000 7f3c0f1df700 1 -- 172.21.15.57:0/4046870802 wait complete. 2021-06-25T04:55:11.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0f1df700 1 Processor -- start 2021-06-25T04:55:11.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0f1df700 1 -- start start 2021-06-25T04:55:11.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0f1df700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c080612e0 0x7f3c08155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0f1df700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c080ad580 0x7f3c080b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0f1df700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3c08140400 0x7f3c080b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0f1df700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c081452a0 con 0x7f3c080612e0 2021-06-25T04:55:11.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0f1df700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080b3b80 con 0x7f3c080ad580 2021-06-25T04:55:11.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0f1df700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080b0a60 con 0x7f3c08140400 2021-06-25T04:55:11.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0e1dd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c080612e0 0x7f3c08155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0e1dd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c080612e0 0x7f3c08155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41256/0 (socket says 172.21.15.57:41256) 2021-06-25T04:55:11.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0e1dd700 1 -- 172.21.15.57:0/1917279173 learned_addr learned my addr 172.21.15.57:0/1917279173 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:11.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0e9de700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3c08140400 0x7f3c080b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0d9dc700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c080ad580 0x7f3c080b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0e1dd700 1 -- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3c08140400 msgr2=0x7f3c080b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0e1dd700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3c08140400 0x7f3c080b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0e1dd700 1 -- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c080ad580 msgr2=0x7f3c080b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:11.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0e1dd700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c080ad580 0x7f3c080b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:11.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0e1dd700 1 -- 172.21.15.57:0/1917279173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf800b180 con 0x7f3c080612e0 2021-06-25T04:55:11.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0d9dc700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c080ad580 0x7f3c080b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:11.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0e1dd700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c080612e0 0x7f3c08155850 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f3bf800c000 tx=0x7f3bf8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:11.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3bf77fe700 1 -- 172.21.15.57:0/1917279173 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf800ca40 con 0x7f3c080612e0 2021-06-25T04:55:11.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3bf77fe700 1 -- 172.21.15.57:0/1917279173 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf800cba0 con 0x7f3c080612e0 2021-06-25T04:55:11.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0f1df700 1 -- 172.21.15.57:0/1917279173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0400b180 con 0x7f3c080612e0 2021-06-25T04:55:11.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3bf77fe700 1 -- 172.21.15.57:0/1917279173 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf80123f0 con 0x7f3c080612e0 2021-06-25T04:55:11.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.432+0000 7f3c0f1df700 1 -- 172.21.15.57:0/1917279173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c08156090 con 0x7f3c080612e0 2021-06-25T04:55:11.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.436+0000 7f3c0f1df700 1 -- 172.21.15.57:0/1917279173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c080b0bd0 con 0x7f3c080612e0 2021-06-25T04:55:11.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.436+0000 7f3bf77fe700 1 -- 172.21.15.57:0/1917279173 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3bf8012550 con 0x7f3c080612e0 2021-06-25T04:55:11.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.436+0000 7f3bf77fe700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3be8055490 0x7f3be8057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:11.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.436+0000 7f3bf77fe700 1 -- 172.21.15.57:0/1917279173 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3bf806e5e0 con 0x7f3c080612e0 2021-06-25T04:55:11.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.436+0000 7f3c0d9dc700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3be8055490 0x7f3be8057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:11.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.436+0000 7f3c0d9dc700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3be8055490 0x7f3be8057950 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f3c04013000 tx=0x7f3c04014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:11.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.444+0000 7f3bf77fe700 1 -- 172.21.15.57:0/1917279173 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3c080b0bd0 con 0x7f3c080612e0 2021-06-25T04:55:11.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:11.604+0000 7f3c0f1df700 1 -- 172.21.15.57:0/1917279173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3c080b0bd0 con 0x7f3c080612e0 2021-06-25T04:55:12.267 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:55:12.264+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:55:12.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.268+0000 7f3bf77fe700 1 -- 172.21.15.57:0/1917279173 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3c080b0bd0 con 0x7f3c080612e0 2021-06-25T04:55:12.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.272+0000 7f3c0f1df700 1 -- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3be8055490 msgr2=0x7f3be8057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.272+0000 7f3c0f1df700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3be8055490 0x7f3be8057950 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f3c04013000 tx=0x7f3c04014000).stop 2021-06-25T04:55:12.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.272+0000 7f3c0f1df700 1 -- 172.21.15.57:0/1917279173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c080612e0 msgr2=0x7f3c08155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.272+0000 7f3c0f1df700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c080612e0 0x7f3c08155850 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f3bf800c000 tx=0x7f3bf8006df0).stop 2021-06-25T04:55:12.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.272+0000 7f3c0f1df700 1 -- 172.21.15.57:0/1917279173 shutdown_connections 2021-06-25T04:55:12.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.272+0000 7f3c0f1df700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3be8055490 0x7f3be8057950 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.272+0000 7f3c0f1df700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3c08140400 0x7f3c080b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.272+0000 7f3c0f1df700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c080ad580 0x7f3c080b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.272+0000 7f3c0f1df700 1 --2- 172.21.15.57:0/1917279173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c080612e0 0x7f3c08155850 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.272+0000 7f3c0f1df700 1 -- 172.21.15.57:0/1917279173 >> 172.21.15.57:0/1917279173 conn(0x7f3c08066da0 msgr2=0x7f3c080b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:12.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.276+0000 7f3c0f1df700 1 -- 172.21.15.57:0/1917279173 shutdown_connections 2021-06-25T04:55:12.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.276+0000 7f3c0f1df700 1 -- 172.21.15.57:0/1917279173 wait complete. 2021-06-25T04:55:12.283 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:55:12.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:12.302 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:55:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.396+0000 7f6f2359e700 1 Processor -- start 2021-06-25T04:55:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.396+0000 7f6f2359e700 1 -- start start 2021-06-25T04:55:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f2359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f2413c6a0 0x7f6f2413cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f2359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f240b2bf0 con 0x7f6f240b2810 2021-06-25T04:55:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f2359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f240b1620 con 0x7f6f240acee0 2021-06-25T04:55:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f2359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240b1170 con 0x7f6f2413c6a0 2021-06-25T04:55:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f2259c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6f240b2810 0x7f6f240b0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58500/0 (socket says 172.21.15.57:58500) 2021-06-25T04:55:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f2259c700 1 -- 172.21.15.57:0/3471795066 learned_addr learned my addr 172.21.15.57:0/3471795066 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f1bfff700 1 --2- 172.21.15.57:0/3471795066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f2413c6a0 0x7f6f2413cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f21d9b700 1 -- 172.21.15.57:0/3471795066 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997214207 0 0) 0x7f6f240b2bf0 con 0x7f6f240b2810 2021-06-25T04:55:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f21d9b700 1 -- 172.21.15.57:0/3471795066 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f04004370 con 0x7f6f240b2810 2021-06-25T04:55:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f21d9b700 1 -- 172.21.15.57:0/3471795066 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497616997 0 0) 0x7f6f240b1620 con 0x7f6f240acee0 2021-06-25T04:55:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f21d9b700 1 -- 172.21.15.57:0/3471795066 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f240b2bf0 con 0x7f6f240acee0 2021-06-25T04:55:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f1bfff700 1 -- 172.21.15.57:0/3471795066 >> v1:172.21.15.87:6789/0 conn(0x7f6f240acee0 legacy=0x7f6f240ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f1bfff700 1 -- 172.21.15.57:0/3471795066 >> v1:172.21.15.57:6789/0 conn(0x7f6f240b2810 legacy=0x7f6f240b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f1bfff700 1 -- 172.21.15.57:0/3471795066 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f240b18c0 con 0x7f6f2413c6a0 2021-06-25T04:55:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f1bfff700 1 --2- 172.21.15.57:0/3471795066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f2413c6a0 0x7f6f2413cae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6f0c002f70 tx=0x7f6f0c006df0).ready entity=mon.2 client_cookie=2c3e0e8d8b634e15 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f21d9b700 1 -- 172.21.15.57:0/3471795066 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f0c00d5c0 con 0x7f6f2413c6a0 2021-06-25T04:55:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f21d9b700 1 -- 172.21.15.57:0/3471795066 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c000e90 con 0x7f6f2413c6a0 2021-06-25T04:55:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f21d9b700 1 -- 172.21.15.57:0/3471795066 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f0c00d910 con 0x7f6f2413c6a0 2021-06-25T04:55:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f2359e700 1 -- 172.21.15.57:0/3471795066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f2413c6a0 msgr2=0x7f6f2413cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.400+0000 7f6f2359e700 1 --2- 172.21.15.57:0/3471795066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f2413c6a0 0x7f6f2413cae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6f0c002f70 tx=0x7f6f0c006df0).stop 2021-06-25T04:55:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.404+0000 7f6f2359e700 1 -- 172.21.15.57:0/3471795066 shutdown_connections 2021-06-25T04:55:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.404+0000 7f6f2359e700 1 --2- 172.21.15.57:0/3471795066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f2413c6a0 0x7f6f2413cae0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.404+0000 7f6f2359e700 1 -- 172.21.15.57:0/3471795066 >> 172.21.15.57:0/3471795066 conn(0x7f6f240611f0 msgr2=0x7f6f24062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.404+0000 7f6f2359e700 1 -- 172.21.15.57:0/3471795066 shutdown_connections 2021-06-25T04:55:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.404+0000 7f6f2359e700 1 -- 172.21.15.57:0/3471795066 wait complete. 2021-06-25T04:55:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.404+0000 7f6f2359e700 1 Processor -- start 2021-06-25T04:55:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.404+0000 7f6f2359e700 1 -- start start 2021-06-25T04:55:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f240acee0 0x7f6f2413ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f240b2810 0x7f6f24134ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f2413c6a0 0x7f6f241353c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240b5950 con 0x7f6f240acee0 2021-06-25T04:55:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240b5bf0 con 0x7f6f2413c6a0 2021-06-25T04:55:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240b5e90 con 0x7f6f240b2810 2021-06-25T04:55:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f240acee0 0x7f6f2413ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f240acee0 0x7f6f2413ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41288/0 (socket says 172.21.15.57:41288) 2021-06-25T04:55:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2259c700 1 -- 172.21.15.57:0/4105734936 learned_addr learned my addr 172.21.15.57:0/4105734936 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f1bfff700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f240b2810 0x7f6f24134ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f22d9d700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f2413c6a0 0x7f6f241353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2259c700 1 -- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f240b2810 msgr2=0x7f6f24134ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2259c700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f240b2810 0x7f6f24134ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2259c700 1 -- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f2413c6a0 msgr2=0x7f6f241353c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2259c700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f2413c6a0 0x7f6f241353c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2259c700 1 -- 172.21.15.57:0/4105734936 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c00b180 con 0x7f6f240acee0 2021-06-25T04:55:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2259c700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f240acee0 0x7f6f2413ea30 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f6f140010d0 tx=0x7f6f14007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f1b7fe700 1 -- 172.21.15.57:0/4105734936 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f1400ce90 con 0x7f6f240acee0 2021-06-25T04:55:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f1b7fe700 1 -- 172.21.15.57:0/4105734936 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f140072e0 con 0x7f6f240acee0 2021-06-25T04:55:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2359e700 1 -- 172.21.15.57:0/4105734936 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f240b6130 con 0x7f6f240acee0 2021-06-25T04:55:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f1b7fe700 1 -- 172.21.15.57:0/4105734936 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f14005800 con 0x7f6f240acee0 2021-06-25T04:55:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2359e700 1 -- 172.21.15.57:0/4105734936 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f24140480 con 0x7f6f240acee0 2021-06-25T04:55:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f2359e700 1 -- 172.21.15.57:0/4105734936 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f24057310 con 0x7f6f240acee0 2021-06-25T04:55:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.408+0000 7f6f1b7fe700 1 -- 172.21.15.57:0/4105734936 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6f14010070 con 0x7f6f240acee0 2021-06-25T04:55:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.412+0000 7f6f1b7fe700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f080554e0 0x7f6f080579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.412+0000 7f6f1b7fe700 1 -- 172.21.15.57:0/4105734936 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f6f1406d720 con 0x7f6f240acee0 2021-06-25T04:55:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.412+0000 7f6f1bfff700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f080554e0 0x7f6f080579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.412+0000 7f6f1bfff700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f080554e0 0x7f6f080579a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f6f0c017000 tx=0x7f6f0c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.416+0000 7f6f1b7fe700 1 -- 172.21.15.57:0/4105734936 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6f14043820 con 0x7f6f240acee0 2021-06-25T04:55:12.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.580+0000 7f6f2359e700 1 -- 172.21.15.57:0/4105734936 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f24150020 con 0x7f6f240acee0 2021-06-25T04:55:12.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.580+0000 7f6f1b7fe700 1 -- 172.21.15.57:0/4105734936 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f6f14046e40 con 0x7f6f240acee0 2021-06-25T04:55:12.585 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:12.585 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":48,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3853681312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3853681312},{"type":"v1","addr":"172.21.15.87:6835","nonce":3853681312}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6981,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2200404668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2200404668},{"type":"v1","addr":"172.21.15.57:6833","nonce":2200404668}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:54:58.730365+0000","modified":"2021-06-25T04:55:12.265916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-06-25T04:55:12.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 -- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f080554e0 msgr2=0x7f6f080579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f080554e0 0x7f6f080579a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f6f0c017000 tx=0x7f6f0c014000).stop 2021-06-25T04:55:12.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 -- 172.21.15.57:0/4105734936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f240acee0 msgr2=0x7f6f2413ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f240acee0 0x7f6f2413ea30 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f6f140010d0 tx=0x7f6f14007b00).stop 2021-06-25T04:55:12.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 -- 172.21.15.57:0/4105734936 shutdown_connections 2021-06-25T04:55:12.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f080554e0 0x7f6f080579a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f2413c6a0 0x7f6f241353c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f240b2810 0x7f6f24134ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 --2- 172.21.15.57:0/4105734936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f240acee0 0x7f6f2413ea30 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 -- 172.21.15.57:0/4105734936 >> 172.21.15.57:0/4105734936 conn(0x7f6f240611f0 msgr2=0x7f6f2413ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:12.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 -- 172.21.15.57:0/4105734936 shutdown_connections 2021-06-25T04:55:12.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.584+0000 7f6f2359e700 1 -- 172.21.15.57:0/4105734936 wait complete. 2021-06-25T04:55:12.592 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 48 2021-06-25T04:55:12.602 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:55:12.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.760+0000 7f0f34cca700 1 Processor -- start 2021-06-25T04:55:12.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.760+0000 7f0f34cca700 1 -- start start 2021-06-25T04:55:12.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f34cca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f30063890 0x7f0f30061e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:12.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f34cca700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f300b0f00 con 0x7f0f300b1770 2021-06-25T04:55:12.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f34cca700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f30063c70 con 0x7f0f3013e600 2021-06-25T04:55:12.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f2f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f30063890 0x7f0f30061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:12.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f34cca700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f30060030 con 0x7f0f30063890 2021-06-25T04:55:12.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f27fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0f300b1770 0x7f0f3013def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58516/0 (socket says 172.21.15.57:58516) 2021-06-25T04:55:12.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f2f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f30063890 0x7f0f30061e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41296/0 (socket says 172.21.15.57:41296) 2021-06-25T04:55:12.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f27fff700 1 -- 172.21.15.57:0/3828360711 learned_addr learned my addr 172.21.15.57:0/3828360711 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:12.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f2f7fe700 1 -- 172.21.15.57:0/3828360711 >> v1:172.21.15.87:6789/0 conn(0x7f0f3013e600 legacy=0x7f0f301412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f2f7fe700 1 -- 172.21.15.57:0/3828360711 >> v1:172.21.15.57:6789/0 conn(0x7f0f300b1770 legacy=0x7f0f3013def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f2effd700 1 -- 172.21.15.57:0/3828360711 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278229003 0 0) 0x7f0f300b0f00 con 0x7f0f300b1770 2021-06-25T04:55:12.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f2f7fe700 1 -- 172.21.15.57:0/3828360711 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f300b1130 con 0x7f0f30063890 2021-06-25T04:55:12.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f2f7fe700 1 --2- 172.21.15.57:0/3828360711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f30063890 0x7f0f30061e80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f0f20002f70 tx=0x7f0f20006df0).ready entity=mon.0 client_cookie=673e30cbaaf3ef78 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:12.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f2effd700 1 -- 172.21.15.57:0/3828360711 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2000d610 con 0x7f0f30063890 2021-06-25T04:55:12.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f2effd700 1 -- 172.21.15.57:0/3828360711 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f20000e90 con 0x7f0f30063890 2021-06-25T04:55:12.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f2effd700 1 -- 172.21.15.57:0/3828360711 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2000d960 con 0x7f0f30063890 2021-06-25T04:55:12.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f34cca700 1 -- 172.21.15.57:0/3828360711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f30063890 msgr2=0x7f0f30061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f34cca700 1 --2- 172.21.15.57:0/3828360711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f30063890 0x7f0f30061e80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f0f20002f70 tx=0x7f0f20006df0).stop 2021-06-25T04:55:12.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f34cca700 1 -- 172.21.15.57:0/3828360711 shutdown_connections 2021-06-25T04:55:12.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f34cca700 1 --2- 172.21.15.57:0/3828360711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f30063890 0x7f0f30061e80 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f34cca700 1 -- 172.21.15.57:0/3828360711 >> 172.21.15.57:0/3828360711 conn(0x7f0f3005c450 msgr2=0x7f0f3005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:12.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f34cca700 1 -- 172.21.15.57:0/3828360711 shutdown_connections 2021-06-25T04:55:12.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.764+0000 7f0f34cca700 1 -- 172.21.15.57:0/3828360711 wait complete. 2021-06-25T04:55:12.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f34cca700 1 Processor -- start 2021-06-25T04:55:12.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f34cca700 1 -- start start 2021-06-25T04:55:12.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f34cca700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f30063890 0x7f0f30133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:12.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f34cca700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f300b1770 0x7f0f300b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:12.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f34cca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3013e600 0x7f0f30145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:12.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f34cca700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30137390 con 0x7f0f3013e600 2021-06-25T04:55:12.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f34cca700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30134260 con 0x7f0f300b1770 2021-06-25T04:55:12.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f34cca700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30138c60 con 0x7f0f30063890 2021-06-25T04:55:12.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f2ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3013e600 0x7f0f30145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:12.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f2f7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f30063890 0x7f0f30133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:12.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f2ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3013e600 0x7f0f30145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41306/0 (socket says 172.21.15.57:41306) 2021-06-25T04:55:12.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f2ffff700 1 -- 172.21.15.57:0/1007425187 learned_addr learned my addr 172.21.15.57:0/1007425187 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:12.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f27fff700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f300b1770 0x7f0f300b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f2ffff700 1 -- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f30063890 msgr2=0x7f0f30133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f2ffff700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f30063890 0x7f0f30133ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f2ffff700 1 -- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f300b1770 msgr2=0x7f0f300b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f2ffff700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f300b1770 0x7f0f300b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.768+0000 7f0f2ffff700 1 -- 172.21.15.57:0/1007425187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2000b180 con 0x7f0f3013e600 2021-06-25T04:55:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.772+0000 7f0f2ffff700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3013e600 0x7f0f30145790 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f0f300af9c0 tx=0x7f0f28007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.772+0000 7f0f2d7fa700 1 -- 172.21.15.57:0/1007425187 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2800ce80 con 0x7f0f3013e600 2021-06-25T04:55:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.772+0000 7f0f2d7fa700 1 -- 172.21.15.57:0/1007425187 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2800f470 con 0x7f0f3013e600 2021-06-25T04:55:12.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.772+0000 7f0f2d7fa700 1 -- 172.21.15.57:0/1007425187 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2800f7d0 con 0x7f0f3013e600 2021-06-25T04:55:12.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.772+0000 7f0f34cca700 1 -- 172.21.15.57:0/1007425187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f30138f00 con 0x7f0f3013e600 2021-06-25T04:55:12.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.772+0000 7f0f34cca700 1 -- 172.21.15.57:0/1007425187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3013a0e0 con 0x7f0f3013e600 2021-06-25T04:55:12.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.772+0000 7f0f34cca700 1 -- 172.21.15.57:0/1007425187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f30057310 con 0x7f0f3013e600 2021-06-25T04:55:12.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.772+0000 7f0f2d7fa700 1 -- 172.21.15.57:0/1007425187 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0f28010070 con 0x7f0f3013e600 2021-06-25T04:55:12.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.772+0000 7f0f2d7fa700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0f08055450 0x7f0f08057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:12.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.772+0000 7f0f2d7fa700 1 -- 172.21.15.57:0/1007425187 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f0f2806d360 con 0x7f0f3013e600 2021-06-25T04:55:12.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.772+0000 7f0f2f7fe700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0f08055450 0x7f0f08057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:12.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.776+0000 7f0f2f7fe700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0f08055450 0x7f0f08057910 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f0f20019000 tx=0x7f0f20014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:12.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.780+0000 7f0f2d7fa700 1 -- 172.21.15.57:0/1007425187 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0f280434c0 con 0x7f0f3013e600 2021-06-25T04:55:12.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:12.948+0000 7f0f34cca700 1 -- 172.21.15.57:0/1007425187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0f30067360 con 0x7f0f3013e600 2021-06-25T04:55:13.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.272+0000 7f0f2d7fa700 1 -- 172.21.15.57:0/1007425187 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f28046ae0 con 0x7f0f3013e600 2021-06-25T04:55:13.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 -- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0f08055450 msgr2=0x7f0f08057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:13.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0f08055450 0x7f0f08057910 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f0f20019000 tx=0x7f0f20014000).stop 2021-06-25T04:55:13.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 -- 172.21.15.57:0/1007425187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3013e600 msgr2=0x7f0f30145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:13.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3013e600 0x7f0f30145790 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f0f300af9c0 tx=0x7f0f28007f50).stop 2021-06-25T04:55:13.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 -- 172.21.15.57:0/1007425187 shutdown_connections 2021-06-25T04:55:13.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0f08055450 0x7f0f08057910 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:13.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3013e600 0x7f0f30145790 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:13.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f300b1770 0x7f0f300b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:13.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 --2- 172.21.15.57:0/1007425187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f30063890 0x7f0f30133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:13.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 -- 172.21.15.57:0/1007425187 >> 172.21.15.57:0/1007425187 conn(0x7f0f3005c450 msgr2=0x7f0f3013ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:13.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 -- 172.21.15.57:0/1007425187 shutdown_connections 2021-06-25T04:55:13.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.276+0000 7f0f34cca700 1 -- 172.21.15.57:0/1007425187 wait complete. 2021-06-25T04:55:13.300 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:55:13.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52ce61700 1 Processor -- start 2021-06-25T04:55:13.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52ce61700 1 -- start start 2021-06-25T04:55:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52ce61700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5280600c0 0x7fd5280b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:13.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52ce61700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5280672c0 0x7fd5281438b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:13.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52ce61700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd5280b4c00 0x7fd528143da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:13.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52ce61700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5280aab70 con 0x7fd5280b4c00 2021-06-25T04:55:13.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52ce61700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5280604a0 con 0x7fd5280672c0 2021-06-25T04:55:13.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52ce61700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd528066e60 con 0x7fd5280600c0 2021-06-25T04:55:13.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd526d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd5280b4c00 0x7fd528143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:13.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd526d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd5280b4c00 0x7fd528143da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41316/0 (socket says 172.21.15.57:41316) 2021-06-25T04:55:13.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd526d9d700 1 -- 172.21.15.57:0/2615103045 learned_addr learned my addr 172.21.15.57:0/2615103045 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:13.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd525d9b700 1 --2- 172.21.15.57:0/2615103045 >> v2:172.21.15.87:3300/0 conn(0x7fd5280672c0 0x7fd5281438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:13.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52659c700 1 --2- 172.21.15.57:0/2615103045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5280600c0 0x7fd5280b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:13.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd526d9d700 1 -- 172.21.15.57:0/2615103045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5280600c0 msgr2=0x7fd5280b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:13.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd526d9d700 1 --2- 172.21.15.57:0/2615103045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5280600c0 0x7fd5280b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:13.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd526d9d700 1 -- 172.21.15.57:0/2615103045 >> v2:172.21.15.87:3300/0 conn(0x7fd5280672c0 msgr2=0x7fd5281438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:13.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd526d9d700 1 --2- 172.21.15.57:0/2615103045 >> v2:172.21.15.87:3300/0 conn(0x7fd5280672c0 0x7fd5281438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:13.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd526d9d700 1 -- 172.21.15.57:0/2615103045 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528144290 con 0x7fd5280b4c00 2021-06-25T04:55:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd525d9b700 1 --2- 172.21.15.57:0/2615103045 >> v2:172.21.15.87:3300/0 conn(0x7fd5280672c0 0x7fd5281438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52659c700 1 --2- 172.21.15.57:0/2615103045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5280600c0 0x7fd5280b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd526d9d700 1 --2- 172.21.15.57:0/2615103045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5280b4c00 0x7fd528143da0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fd5200032f0 tx=0x7fd520009290).ready entity=mon.0 client_cookie=71e2b2666cd3c231 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52559a700 1 -- 172.21.15.57:0/2615103045 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd52000b680 con 0x7fd5280b4c00 2021-06-25T04:55:13.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52559a700 1 -- 172.21.15.57:0/2615103045 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52000b7e0 con 0x7fd5280b4c00 2021-06-25T04:55:13.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52559a700 1 -- 172.21.15.57:0/2615103045 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd52000b950 con 0x7fd5280b4c00 2021-06-25T04:55:13.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52ce61700 1 -- 172.21.15.57:0/2615103045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5280b4c00 msgr2=0x7fd528143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:13.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.412+0000 7fd52ce61700 1 --2- 172.21.15.57:0/2615103045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5280b4c00 0x7fd528143da0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fd5200032f0 tx=0x7fd520009290).stop 2021-06-25T04:55:13.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 -- 172.21.15.57:0/2615103045 shutdown_connections 2021-06-25T04:55:13.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 --2- 172.21.15.57:0/2615103045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5280b4c00 0x7fd528143da0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:13.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 --2- 172.21.15.57:0/2615103045 >> v2:172.21.15.87:3300/0 conn(0x7fd5280672c0 0x7fd5281438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:13.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 --2- 172.21.15.57:0/2615103045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5280600c0 0x7fd5280b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:13.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 -- 172.21.15.57:0/2615103045 >> 172.21.15.57:0/2615103045 conn(0x7fd52805cef0 msgr2=0x7fd52805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:13.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 -- 172.21.15.57:0/2615103045 shutdown_connections 2021-06-25T04:55:13.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 -- 172.21.15.57:0/2615103045 wait complete. 2021-06-25T04:55:13.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 Processor -- start 2021-06-25T04:55:13.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 -- start start 2021-06-25T04:55:13.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5280600c0 0x7fd528156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:13.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5280672c0 0x7fd5280b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:13.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5280b4c00 0x7fd528061c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:13.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52813da90 con 0x7fd5280672c0 2021-06-25T04:55:13.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd528146fe0 con 0x7fd5280600c0 2021-06-25T04:55:13.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52ce61700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd528146600 con 0x7fd5280b4c00 2021-06-25T04:55:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5280600c0 0x7fd528156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5280600c0 0x7fd528156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:49812/0 (socket says 172.21.15.57:49812) 2021-06-25T04:55:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52659c700 1 -- 172.21.15.57:0/2913717727 learned_addr learned my addr 172.21.15.57:0/2913717727 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd525d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5280672c0 0x7fd5280b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd526d9d700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5280b4c00 0x7fd528061c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:13.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52659c700 1 -- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5280b4c00 msgr2=0x7fd528061c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:13.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52659c700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5280b4c00 0x7fd528061c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:13.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52659c700 1 -- 172.21.15.57:0/2913717727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5280672c0 msgr2=0x7fd5280b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:13.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52659c700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5280672c0 0x7fd5280b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:13.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52659c700 1 -- 172.21.15.57:0/2913717727 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51800b180 con 0x7fd5280600c0 2021-06-25T04:55:13.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd525d9b700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5280672c0 0x7fd5280b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:13.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.416+0000 7fd52659c700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5280600c0 0x7fd528156210 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fd51800c000 tx=0x7fd518006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:13.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.420+0000 7fd5177fe700 1 -- 172.21.15.57:0/2913717727 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd51800c7e0 con 0x7fd5280600c0 2021-06-25T04:55:13.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.420+0000 7fd5177fe700 1 -- 172.21.15.57:0/2913717727 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51800c940 con 0x7fd5280600c0 2021-06-25T04:55:13.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.420+0000 7fd52ce61700 1 -- 172.21.15.57:0/2913717727 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c00b180 con 0x7fd5280600c0 2021-06-25T04:55:13.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.420+0000 7fd5177fe700 1 -- 172.21.15.57:0/2913717727 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd51800cca0 con 0x7fd5280600c0 2021-06-25T04:55:13.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.420+0000 7fd52ce61700 1 -- 172.21.15.57:0/2913717727 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd520009530 con 0x7fd5280600c0 2021-06-25T04:55:13.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.420+0000 7fd52ce61700 1 -- 172.21.15.57:0/2913717727 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd528057310 con 0x7fd5280600c0 2021-06-25T04:55:13.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.420+0000 7fd5177fe700 1 -- 172.21.15.57:0/2913717727 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd51801c460 con 0x7fd5280600c0 2021-06-25T04:55:13.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.420+0000 7fd5177fe700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd5040553f0 0x7fd5040578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:13.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.420+0000 7fd5177fe700 1 -- 172.21.15.57:0/2913717727 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fd51806e410 con 0x7fd5280600c0 2021-06-25T04:55:13.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.420+0000 7fd525d9b700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd5040553f0 0x7fd5040578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:13.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.424+0000 7fd525d9b700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd5040553f0 0x7fd5040578b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd51c00b000 tx=0x7fd51c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:13.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.432+0000 7fd5177fe700 1 -- 172.21.15.57:0/2913717727 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd518044510 con 0x7fd5280600c0 2021-06-25T04:55:13.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:13.564+0000 7fd52ce61700 1 -- 172.21.15.57:0/2913717727 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd528146d40 con 0x7fd5280600c0 2021-06-25T04:55:14.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.340+0000 7fd5177fe700 1 -- 172.21.15.57:0/2913717727 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 185+0+0 (secure 0 0 0) 0x7fd518047b30 con 0x7fd5280600c0 2021-06-25T04:55:14.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 -- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd5040553f0 msgr2=0x7fd5040578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:14.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd5040553f0 0x7fd5040578b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd51c00b000 tx=0x7fd51c006df0).stop 2021-06-25T04:55:14.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 -- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5280600c0 msgr2=0x7fd528156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:14.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5280600c0 0x7fd528156210 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fd51800c000 tx=0x7fd518006df0).stop 2021-06-25T04:55:14.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 -- 172.21.15.57:0/2913717727 shutdown_connections 2021-06-25T04:55:14.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd5040553f0 0x7fd5040578b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:14.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd5280b4c00 0x7fd528061c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:14.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5280672c0 0x7fd5280b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:14.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 --2- 172.21.15.57:0/2913717727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5280600c0 0x7fd528156210 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:14.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 -- 172.21.15.57:0/2913717727 >> 172.21.15.57:0/2913717727 conn(0x7fd52805cef0 msgr2=0x7fd5280b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:14.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 -- 172.21.15.57:0/2913717727 shutdown_connections 2021-06-25T04:55:14.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.344+0000 7fd52ce61700 1 -- 172.21.15.57:0/2913717727 wait complete. 2021-06-25T04:55:14.352 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:55:14.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:55:14.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.464+0000 7fd4f4f05700 1 Processor -- start 2021-06-25T04:55:14.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.464+0000 7fd4f4f05700 1 -- start start 2021-06-25T04:55:14.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4f4f05700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd4f00b96a0 0x7fd4f00aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:14.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4f4f05700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f00674c0 con 0x7fd4f013ffb0 2021-06-25T04:55:14.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4f4f05700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f00af490 con 0x7fd4f00670e0 2021-06-25T04:55:14.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4f4f05700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f0143040 con 0x7fd4f00b96a0 2021-06-25T04:55:14.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4edd9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd4f00b96a0 0x7fd4f00aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:14.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4eed9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd4f013ffb0 0x7fd4f0140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58548/0 (socket says 172.21.15.57:58548) 2021-06-25T04:55:14.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4eed9d700 1 -- 172.21.15.57:0/2916777238 learned_addr learned my addr 172.21.15.57:0/2916777238 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:14.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4edd9b700 1 -- 172.21.15.57:0/2916777238 >> v1:172.21.15.87:6789/0 conn(0x7fd4f00670e0 legacy=0x7fd4f0143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:14.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4ed59a700 1 -- 172.21.15.57:0/2916777238 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791232619 0 0) 0x7fd4f00af490 con 0x7fd4f00670e0 2021-06-25T04:55:14.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4edd9b700 1 -- 172.21.15.57:0/2916777238 >> v1:172.21.15.57:6789/0 conn(0x7fd4f013ffb0 legacy=0x7fd4f0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:14.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4edd9b700 1 -- 172.21.15.57:0/2916777238 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f0143230 con 0x7fd4f00b96a0 2021-06-25T04:55:14.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4edd9b700 1 --2- 172.21.15.57:0/2916777238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4f00b96a0 0x7fd4f00aebc0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7fd4e8001490 tx=0x7fd4e0006df0).ready entity=mon.0 client_cookie=d822ceb4c9d9cd83 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:14.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4ed59a700 1 -- 172.21.15.57:0/2916777238 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4e000d5c0 con 0x7fd4f00b96a0 2021-06-25T04:55:14.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4ed59a700 1 -- 172.21.15.57:0/2916777238 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e0000e90 con 0x7fd4f00b96a0 2021-06-25T04:55:14.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4f4f05700 1 -- 172.21.15.57:0/2916777238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4f00b96a0 msgr2=0x7fd4f00aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:14.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4ed59a700 1 -- 172.21.15.57:0/2916777238 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4e000d910 con 0x7fd4f00b96a0 2021-06-25T04:55:14.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4f4f05700 1 --2- 172.21.15.57:0/2916777238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4f00b96a0 0x7fd4f00aebc0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7fd4e8001490 tx=0x7fd4e0006df0).stop 2021-06-25T04:55:14.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4f4f05700 1 -- 172.21.15.57:0/2916777238 shutdown_connections 2021-06-25T04:55:14.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4f4f05700 1 --2- 172.21.15.57:0/2916777238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4f00b96a0 0x7fd4f00aebc0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:14.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4f4f05700 1 -- 172.21.15.57:0/2916777238 >> 172.21.15.57:0/2916777238 conn(0x7fd4f005f9b0 msgr2=0x7fd4f0061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:14.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4f4f05700 1 -- 172.21.15.57:0/2916777238 shutdown_connections 2021-06-25T04:55:14.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.468+0000 7fd4f4f05700 1 -- 172.21.15.57:0/2916777238 wait complete. 2021-06-25T04:55:14.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4f4f05700 1 Processor -- start 2021-06-25T04:55:14.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4f4f05700 1 -- start start 2021-06-25T04:55:14.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4f4f05700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4f00670e0 0x7fd4f00afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:14.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4f4f05700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4f00b96a0 0x7fd4f00b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:14.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4f4f05700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4f013ffb0 0x7fd4f0152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:14.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4f4f05700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f00b2b70 con 0x7fd4f013ffb0 2021-06-25T04:55:14.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4f4f05700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f00b0ae0 con 0x7fd4f00670e0 2021-06-25T04:55:14.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4f4f05700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f00b37b0 con 0x7fd4f00b96a0 2021-06-25T04:55:14.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4eed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4f013ffb0 0x7fd4f0152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:14.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4eed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4f013ffb0 0x7fd4f0152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41336/0 (socket says 172.21.15.57:41336) 2021-06-25T04:55:14.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4ee59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4f00670e0 0x7fd4f00afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:14.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4eed9d700 1 -- 172.21.15.57:0/909058062 learned_addr learned my addr 172.21.15.57:0/909058062 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:14.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4edd9b700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4f00b96a0 0x7fd4f00b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:14.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4eed9d700 1 -- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4f00b96a0 msgr2=0x7fd4f00b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:14.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4eed9d700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4f00b96a0 0x7fd4f00b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:14.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4eed9d700 1 -- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4f00670e0 msgr2=0x7fd4f00afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:14.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4eed9d700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4f00670e0 0x7fd4f00afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:14.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4eed9d700 1 -- 172.21.15.57:0/909058062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e000b180 con 0x7fd4f013ffb0 2021-06-25T04:55:14.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4eed9d700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4f013ffb0 0x7fd4f0152030 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7fd4e8001380 tx=0x7fd4e8007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:14.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4e77fe700 1 -- 172.21.15.57:0/909058062 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4e8005b80 con 0x7fd4f013ffb0 2021-06-25T04:55:14.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4e77fe700 1 -- 172.21.15.57:0/909058062 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e8005ce0 con 0x7fd4f013ffb0 2021-06-25T04:55:14.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4f4f05700 1 -- 172.21.15.57:0/909058062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f014a230 con 0x7fd4f013ffb0 2021-06-25T04:55:14.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4e77fe700 1 -- 172.21.15.57:0/909058062 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4e80072c0 con 0x7fd4f013ffb0 2021-06-25T04:55:14.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.472+0000 7fd4f4f05700 1 -- 172.21.15.57:0/909058062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f00b0840 con 0x7fd4f013ffb0 2021-06-25T04:55:14.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.476+0000 7fd4f4f05700 1 -- 172.21.15.57:0/909058062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f0057310 con 0x7fd4f013ffb0 2021-06-25T04:55:14.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.476+0000 7fd4e77fe700 1 -- 172.21.15.57:0/909058062 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd4e8010070 con 0x7fd4f013ffb0 2021-06-25T04:55:14.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.476+0000 7fd4e77fe700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4d40553d0 0x7fd4d4057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:14.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.476+0000 7fd4e77fe700 1 -- 172.21.15.57:0/909058062 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fd4e806d8f0 con 0x7fd4f013ffb0 2021-06-25T04:55:14.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.476+0000 7fd4ee59c700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4d40553d0 0x7fd4d4057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:14.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.476+0000 7fd4ee59c700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4d40553d0 0x7fd4d4057890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fd4d800d000 tx=0x7fd4d80079b0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:14.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.484+0000 7fd4e77fe700 1 -- 172.21.15.57:0/909058062 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd4e8043b20 con 0x7fd4f013ffb0 2021-06-25T04:55:14.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:14.612+0000 7fd4f4f05700 1 -- 172.21.15.57:0/909058062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd4f01526c0 con 0x7fd4f013ffb0 2021-06-25T04:55:15.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.352+0000 7fd4e77fe700 1 -- 172.21.15.57:0/909058062 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd4e8047140 con 0x7fd4f013ffb0 2021-06-25T04:55:15.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 -- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4d40553d0 msgr2=0x7fd4d4057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4d40553d0 0x7fd4d4057890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fd4d800d000 tx=0x7fd4d80079b0).stop 2021-06-25T04:55:15.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 -- 172.21.15.57:0/909058062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4f013ffb0 msgr2=0x7fd4f0152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4f013ffb0 0x7fd4f0152030 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7fd4e8001380 tx=0x7fd4e8007f30).stop 2021-06-25T04:55:15.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 -- 172.21.15.57:0/909058062 shutdown_connections 2021-06-25T04:55:15.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4d40553d0 0x7fd4d4057890 secure :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0x7fd4d800d000 tx=0x7fd4d80079b0).stop 2021-06-25T04:55:15.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4f013ffb0 0x7fd4f0152030 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4f00b96a0 0x7fd4f00b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 --2- 172.21.15.57:0/909058062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4f00670e0 0x7fd4f00afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 -- 172.21.15.57:0/909058062 >> 172.21.15.57:0/909058062 conn(0x7fd4f005f9b0 msgr2=0x7fd4f00aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:15.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 -- 172.21.15.57:0/909058062 shutdown_connections 2021-06-25T04:55:15.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.356+0000 7fd4f4f05700 1 -- 172.21.15.57:0/909058062 wait complete. 2021-06-25T04:55:15.365 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:55:15.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-06-25T04:55:15.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.484+0000 7fab8e68d700 1 Processor -- start 2021-06-25T04:55:15.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.484+0000 7fab8e68d700 1 -- start start 2021-06-25T04:55:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab88061690 0x7fab880b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fab88060b30 0x7fab8805f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab88140050 con 0x7fab880b1940 2021-06-25T04:55:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab88060f60 con 0x7fab88060b30 2021-06-25T04:55:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab881402f0 con 0x7fab88061690 2021-06-25T04:55:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab87fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fab880b1940 0x7fab88139c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58558/0 (socket says 172.21.15.57:58558) 2021-06-25T04:55:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab87fff700 1 -- 172.21.15.57:0/4026004682 learned_addr learned my addr 172.21.15.57:0/4026004682 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8cc2a700 1 --2- 172.21.15.57:0/4026004682 >> v2:172.21.15.57:3300/0 conn(0x7fab88060b30 0x7fab8805f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab877fe700 1 --2- 172.21.15.57:0/4026004682 >> v2:172.21.15.87:3300/0 conn(0x7fab88061690 0x7fab880b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab86ffd700 1 -- 172.21.15.57:0/4026004682 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411573446 0 0) 0x7fab88140050 con 0x7fab880b1940 2021-06-25T04:55:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab86ffd700 1 -- 172.21.15.57:0/4026004682 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab74003260 con 0x7fab880b1940 2021-06-25T04:55:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8cc2a700 1 -- 172.21.15.57:0/4026004682 >> v2:172.21.15.87:3300/0 conn(0x7fab88061690 msgr2=0x7fab880b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8cc2a700 1 --2- 172.21.15.57:0/4026004682 >> v2:172.21.15.87:3300/0 conn(0x7fab88061690 0x7fab880b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8cc2a700 1 -- 172.21.15.57:0/4026004682 >> v1:172.21.15.57:6789/0 conn(0x7fab880b1940 legacy=0x7fab88139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8cc2a700 1 -- 172.21.15.57:0/4026004682 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab88140590 con 0x7fab88060b30 2021-06-25T04:55:15.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8cc2a700 1 --2- 172.21.15.57:0/4026004682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab88060b30 0x7fab8805f670 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fab800032f0 tx=0x7fab800091d0).ready entity=mon.0 client_cookie=b24ef29cf0fb3c79 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:15.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab86ffd700 1 -- 172.21.15.57:0/4026004682 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab8000f8a0 con 0x7fab88060b30 2021-06-25T04:55:15.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab86ffd700 1 -- 172.21.15.57:0/4026004682 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8000fa00 con 0x7fab88060b30 2021-06-25T04:55:15.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab86ffd700 1 -- 172.21.15.57:0/4026004682 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab8000fd60 con 0x7fab88060b30 2021-06-25T04:55:15.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 -- 172.21.15.57:0/4026004682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab88060b30 msgr2=0x7fab8805f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 --2- 172.21.15.57:0/4026004682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab88060b30 0x7fab8805f670 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7fab800032f0 tx=0x7fab800091d0).stop 2021-06-25T04:55:15.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 -- 172.21.15.57:0/4026004682 shutdown_connections 2021-06-25T04:55:15.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 --2- 172.21.15.57:0/4026004682 >> v2:172.21.15.87:3300/0 conn(0x7fab88061690 0x7fab880b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 --2- 172.21.15.57:0/4026004682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab88060b30 0x7fab8805f670 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 -- 172.21.15.57:0/4026004682 >> 172.21.15.57:0/4026004682 conn(0x7fab880b2930 msgr2=0x7fab880b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:15.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 -- 172.21.15.57:0/4026004682 shutdown_connections 2021-06-25T04:55:15.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.488+0000 7fab8e68d700 1 -- 172.21.15.57:0/4026004682 wait complete. 2021-06-25T04:55:15.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8e68d700 1 Processor -- start 2021-06-25T04:55:15.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8e68d700 1 -- start start 2021-06-25T04:55:15.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8e68d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab88060b30 0x7fab88139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:15.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8e68d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab88061690 0x7fab8813bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:15.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8e68d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab880b1940 0x7fab8813c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:15.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8e68d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab881532a0 con 0x7fab88061690 2021-06-25T04:55:15.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8e68d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8813f3f0 con 0x7fab880b1940 2021-06-25T04:55:15.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8e68d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab88152d80 con 0x7fab88060b30 2021-06-25T04:55:15.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab877fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab88061690 0x7fab8813bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:15.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab877fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab88061690 0x7fab8813bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41346/0 (socket says 172.21.15.57:41346) 2021-06-25T04:55:15.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab877fe700 1 -- 172.21.15.57:0/1791126831 learned_addr learned my addr 172.21.15.57:0/1791126831 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:15.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab87fff700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab88060b30 0x7fab88139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:15.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8cc2a700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab880b1940 0x7fab8813c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:15.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab877fe700 1 -- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab88060b30 msgr2=0x7fab88139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab877fe700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab88060b30 0x7fab88139910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab877fe700 1 -- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab880b1940 msgr2=0x7fab8813c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab877fe700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab880b1940 0x7fab8813c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab877fe700 1 -- 172.21.15.57:0/1791126831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80009470 con 0x7fab88061690 2021-06-25T04:55:15.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8cc2a700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab880b1940 0x7fab8813c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:15.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab877fe700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab88061690 0x7fab8813bb20 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fab7c00c000 tx=0x7fab7c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:15.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab857fa700 1 -- 172.21.15.57:0/1791126831 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7c010780 con 0x7fab88061690 2021-06-25T04:55:15.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8e68d700 1 -- 172.21.15.57:0/1791126831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab88153000 con 0x7fab88061690 2021-06-25T04:55:15.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab857fa700 1 -- 172.21.15.57:0/1791126831 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c0108e0 con 0x7fab88061690 2021-06-25T04:55:15.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab8e68d700 1 -- 172.21.15.57:0/1791126831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8813c500 con 0x7fab88061690 2021-06-25T04:55:15.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.492+0000 7fab857fa700 1 -- 172.21.15.57:0/1791126831 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7c010c40 con 0x7fab88061690 2021-06-25T04:55:15.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.496+0000 7fab8e68d700 1 -- 172.21.15.57:0/1791126831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab88144260 con 0x7fab88061690 2021-06-25T04:55:15.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.496+0000 7fab857fa700 1 -- 172.21.15.57:0/1791126831 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fab7c0123f0 con 0x7fab88061690 2021-06-25T04:55:15.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.496+0000 7fab857fa700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab68055490 0x7fab68057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:15.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.496+0000 7fab857fa700 1 -- 172.21.15.57:0/1791126831 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fab7c06e370 con 0x7fab88061690 2021-06-25T04:55:15.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.496+0000 7fab87fff700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab68055490 0x7fab68057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.496+0000 7fab87fff700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab68055490 0x7fab68057950 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fab7800b000 tx=0x7fab78009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.500+0000 7fab857fa700 1 -- 172.21.15.57:0/1791126831 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fab88144260 con 0x7fab88061690 2021-06-25T04:55:15.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.632+0000 7fab8e68d700 1 -- 172.21.15.57:0/1791126831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fab88144260 con 0x7fab88061690 2021-06-25T04:55:15.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab857fa700 1 -- 172.21.15.57:0/1791126831 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fab88144260 con 0x7fab88061690 2021-06-25T04:55:15.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 -- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab68055490 msgr2=0x7fab68057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab68055490 0x7fab68057950 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fab7800b000 tx=0x7fab78009040).stop 2021-06-25T04:55:15.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 -- 172.21.15.57:0/1791126831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab88061690 msgr2=0x7fab8813bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab88061690 0x7fab8813bb20 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fab7c00c000 tx=0x7fab7c006df0).stop 2021-06-25T04:55:15.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 -- 172.21.15.57:0/1791126831 shutdown_connections 2021-06-25T04:55:15.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fab68055490 0x7fab68057950 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab880b1940 0x7fab8813c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab88061690 0x7fab8813bb20 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 --2- 172.21.15.57:0/1791126831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab88060b30 0x7fab88139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 -- 172.21.15.57:0/1791126831 >> 172.21.15.57:0/1791126831 conn(0x7fab880b2930 msgr2=0x7fab880b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:15.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 -- 172.21.15.57:0/1791126831 shutdown_connections 2021-06-25T04:55:15.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.640+0000 7fab8e68d700 1 -- 172.21.15.57:0/1791126831 wait complete. 2021-06-25T04:55:15.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-06-25T04:55:15.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.756+0000 7f37c573e700 1 Processor -- start 2021-06-25T04:55:15.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.756+0000 7f37c573e700 1 -- start start 2021-06-25T04:55:15.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.756+0000 7f37c573e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f37c0139aa0 0x7f37c0142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:15.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.756+0000 7f37c573e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00ac430 con 0x7f37c0143260 2021-06-25T04:55:15.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.756+0000 7f37c573e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c01436f0 con 0x7f37c00b1c10 2021-06-25T04:55:15.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.756+0000 7f37c573e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c00b2fd0 con 0x7f37c0139aa0 2021-06-25T04:55:15.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.756+0000 7f37beffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f37c0139aa0 0x7f37c0142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:15.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.756+0000 7f37beffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f37c0139aa0 0x7f37c0142d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41354/0 (socket says 172.21.15.57:41354) 2021-06-25T04:55:15.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.756+0000 7f37beffd700 1 -- 172.21.15.57:0/1513714841 learned_addr learned my addr 172.21.15.57:0/1513714841 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:15.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.756+0000 7f37be7fc700 1 --1- 172.21.15.57:0/1513714841 >> v1:172.21.15.57:6789/0 conn(0x7f37c0143260 0x7f37c00ab4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58572/0 (socket says 172.21.15.57:58572) 2021-06-25T04:55:15.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37beffd700 1 -- 172.21.15.57:0/1513714841 >> v1:172.21.15.87:6789/0 conn(0x7f37c00b1c10 legacy=0x7f37c00a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37beffd700 1 -- 172.21.15.57:0/1513714841 >> v1:172.21.15.57:6789/0 conn(0x7f37c0143260 legacy=0x7f37c00ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37beffd700 1 -- 172.21.15.57:0/1513714841 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c0143990 con 0x7f37c0139aa0 2021-06-25T04:55:15.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37beffd700 1 --2- 172.21.15.57:0/1513714841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c0139aa0 0x7f37c0142d70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f37b0002f70 tx=0x7f37b0006f40).ready entity=mon.0 client_cookie=b6d95fe316e9a95d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:15.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37bdffb700 1 -- 172.21.15.57:0/1513714841 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b000c900 con 0x7f37c0139aa0 2021-06-25T04:55:15.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37bdffb700 1 -- 172.21.15.57:0/1513714841 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b0000e90 con 0x7f37c0139aa0 2021-06-25T04:55:15.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37bdffb700 1 -- 172.21.15.57:0/1513714841 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b000cc90 con 0x7f37c0139aa0 2021-06-25T04:55:15.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37c573e700 1 -- 172.21.15.57:0/1513714841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c0139aa0 msgr2=0x7f37c0142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37c573e700 1 --2- 172.21.15.57:0/1513714841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c0139aa0 0x7f37c0142d70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f37b0002f70 tx=0x7f37b0006f40).stop 2021-06-25T04:55:15.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37c573e700 1 -- 172.21.15.57:0/1513714841 shutdown_connections 2021-06-25T04:55:15.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37c573e700 1 --2- 172.21.15.57:0/1513714841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c0139aa0 0x7f37c0142d70 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37c573e700 1 -- 172.21.15.57:0/1513714841 >> 172.21.15.57:0/1513714841 conn(0x7f37c005f670 msgr2=0x7f37c005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:15.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37c573e700 1 -- 172.21.15.57:0/1513714841 shutdown_connections 2021-06-25T04:55:15.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37c573e700 1 -- 172.21.15.57:0/1513714841 wait complete. 2021-06-25T04:55:15.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37c573e700 1 Processor -- start 2021-06-25T04:55:15.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.760+0000 7f37c573e700 1 -- start start 2021-06-25T04:55:15.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37c573e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b1c10 0x7f37c0146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:15.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37c573e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c0064820 0x7f37c0139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:15.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37c573e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37c013b280 0x7f37c013a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:15.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37c573e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0151130 con 0x7f37c00b1c10 2021-06-25T04:55:15.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37c573e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00640e0 con 0x7f37c0064820 2021-06-25T04:55:15.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37c573e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0064380 con 0x7f37c013b280 2021-06-25T04:55:15.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37beffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b1c10 0x7f37c0146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:15.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37beffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b1c10 0x7f37c0146140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41360/0 (socket says 172.21.15.57:41360) 2021-06-25T04:55:15.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37beffd700 1 -- 172.21.15.57:0/202705839 learned_addr learned my addr 172.21.15.57:0/202705839 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:15.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37be7fc700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c0064820 0x7f37c0139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:15.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37bf7fe700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37c013b280 0x7f37c013a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:15.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37beffd700 1 -- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37c013b280 msgr2=0x7f37c013a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37beffd700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37c013b280 0x7f37c013a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37beffd700 1 -- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c0064820 msgr2=0x7f37c0139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37beffd700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c0064820 0x7f37c0139eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37beffd700 1 -- 172.21.15.57:0/202705839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b000a360 con 0x7f37c00b1c10 2021-06-25T04:55:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37beffd700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b1c10 0x7f37c0146140 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f37b0002f70 tx=0x7f37c00ac5c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37b7fff700 1 -- 172.21.15.57:0/202705839 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b0010df0 con 0x7f37c00b1c10 2021-06-25T04:55:15.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37b7fff700 1 -- 172.21.15.57:0/202705839 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b001a450 con 0x7f37c00b1c10 2021-06-25T04:55:15.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37b7fff700 1 -- 172.21.15.57:0/202705839 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37b001a7b0 con 0x7f37c00b1c10 2021-06-25T04:55:15.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37c573e700 1 -- 172.21.15.57:0/202705839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c0146630 con 0x7f37c00b1c10 2021-06-25T04:55:15.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37c573e700 1 -- 172.21.15.57:0/202705839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c0062860 con 0x7f37c00b1c10 2021-06-25T04:55:15.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.764+0000 7f37c573e700 1 -- 172.21.15.57:0/202705839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c0151330 con 0x7f37c00b1c10 2021-06-25T04:55:15.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.768+0000 7f37b7fff700 1 -- 172.21.15.57:0/202705839 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f37b000e040 con 0x7f37c00b1c10 2021-06-25T04:55:15.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.768+0000 7f37b7fff700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37a40553d0 0x7f37a4057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:15.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.768+0000 7f37b7fff700 1 -- 172.21.15.57:0/202705839 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f37b006f1c0 con 0x7f37c00b1c10 2021-06-25T04:55:15.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.768+0000 7f37be7fc700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37a40553d0 0x7f37a4057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.768+0000 7f37be7fc700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37a40553d0 0x7f37a4057890 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f37a800d000 tx=0x7f37a8000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:15.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.772+0000 7f37b7fff700 1 -- 172.21.15.57:0/202705839 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f37b0045650 con 0x7f37c00b1c10 2021-06-25T04:55:15.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:15.948+0000 7f37c573e700 1 -- 172.21.15.57:0/202705839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f37c0064540 con 0x7f37c00b1c10 2021-06-25T04:55:16.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.356+0000 7f37b7fff700 1 -- 172.21.15.57:0/202705839 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v341) v1 ==== 138+0+0 (secure 0 0 0) 0x7f37b0048c70 con 0x7f37c00b1c10 2021-06-25T04:55:16.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 -- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37a40553d0 msgr2=0x7f37a4057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:16.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37a40553d0 0x7f37a4057890 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f37a800d000 tx=0x7f37a8000bc0).stop 2021-06-25T04:55:16.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 -- 172.21.15.57:0/202705839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b1c10 msgr2=0x7f37c0146140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:16.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b1c10 0x7f37c0146140 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f37b0002f70 tx=0x7f37c00ac5c0).stop 2021-06-25T04:55:16.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 -- 172.21.15.57:0/202705839 shutdown_connections 2021-06-25T04:55:16.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f37a40553d0 0x7f37a4057890 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:16.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37c013b280 0x7f37c013a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:16.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c0064820 0x7f37c0139eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:16.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 --2- 172.21.15.57:0/202705839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b1c10 0x7f37c0146140 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:16.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 -- 172.21.15.57:0/202705839 >> 172.21.15.57:0/202705839 conn(0x7f37c005f670 msgr2=0x7f37c00ab700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:16.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 -- 172.21.15.57:0/202705839 shutdown_connections 2021-06-25T04:55:16.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.360+0000 7f37c573e700 1 -- 172.21.15.57:0/202705839 wait complete. 2021-06-25T04:55:16.381 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2021-06-25T04:55:16.381 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2021-06-25T04:55:16.382 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-06-25T04:55:16.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 Processor -- start 2021-06-25T04:55:16.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 -- start start 2021-06-25T04:55:16.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f427c0b7330 0x7f427c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:16.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c0b2340 con 0x7f427c0aabe0 2021-06-25T04:55:16.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c144210 con 0x7f427c0b3020 2021-06-25T04:55:16.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c0b3530 con 0x7f427c0b7330 2021-06-25T04:55:16.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f428193e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f427c0b7330 0x7f427c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:16.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f428193e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f427c0b7330 0x7f427c0b7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41368/0 (socket says 172.21.15.57:41368) 2021-06-25T04:55:16.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f428193e700 1 -- 172.21.15.57:0/1103735565 learned_addr learned my addr 172.21.15.57:0/1103735565 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:16.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f428193e700 1 -- 172.21.15.57:0/1103735565 >> v1:172.21.15.87:6789/0 conn(0x7f427c0b3020 legacy=0x7f427c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:16.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f428193e700 1 -- 172.21.15.57:0/1103735565 >> v1:172.21.15.57:6789/0 conn(0x7f427c0aabe0 legacy=0x7f427c064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:16.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f428193e700 1 -- 172.21.15.57:0/1103735565 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c0b2570 con 0x7f427c0b7330 2021-06-25T04:55:16.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f428193e700 1 --2- 172.21.15.57:0/1103735565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f427c0b7330 0x7f427c0b7710 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f427c0641f0 tx=0x7f4278006e50).ready entity=mon.0 client_cookie=daab4538d9f19e44 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:16.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f428093c700 1 -- 172.21.15.57:0/1103735565 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f427800d5c0 con 0x7f427c0b7330 2021-06-25T04:55:16.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f428093c700 1 -- 172.21.15.57:0/1103735565 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278000e90 con 0x7f427c0b7330 2021-06-25T04:55:16.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f428093c700 1 -- 172.21.15.57:0/1103735565 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f427800d950 con 0x7f427c0b7330 2021-06-25T04:55:16.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 -- 172.21.15.57:0/1103735565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f427c0b7330 msgr2=0x7f427c0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:16.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 --2- 172.21.15.57:0/1103735565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f427c0b7330 0x7f427c0b7710 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f427c0641f0 tx=0x7f4278006e50).stop 2021-06-25T04:55:16.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 -- 172.21.15.57:0/1103735565 shutdown_connections 2021-06-25T04:55:16.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 --2- 172.21.15.57:0/1103735565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f427c0b7330 0x7f427c0b7710 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:16.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 -- 172.21.15.57:0/1103735565 >> 172.21.15.57:0/1103735565 conn(0x7f427c05f670 msgr2=0x7f427c05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:16.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 -- 172.21.15.57:0/1103735565 shutdown_connections 2021-06-25T04:55:16.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.488+0000 7f4282940700 1 -- 172.21.15.57:0/1103735565 wait complete. 2021-06-25T04:55:16.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f4282940700 1 Processor -- start 2021-06-25T04:55:16.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f4282940700 1 -- start start 2021-06-25T04:55:16.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f4282940700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f427c0aabe0 0x7f427c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:16.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f4282940700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f427c0b3020 0x7f427c150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:16.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f4282940700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0b7330 0x7f427c150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:16.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f4282940700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0ada80 con 0x7f427c0aabe0 2021-06-25T04:55:16.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f4282940700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0ac040 con 0x7f427c0b7330 2021-06-25T04:55:16.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f4282940700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0ac4e0 con 0x7f427c0b3020 2021-06-25T04:55:16.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428193e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f427c0aabe0 0x7f427c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:16.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428193e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f427c0aabe0 0x7f427c0ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41374/0 (socket says 172.21.15.57:41374) 2021-06-25T04:55:16.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428193e700 1 -- 172.21.15.57:0/3551699200 learned_addr learned my addr 172.21.15.57:0/3551699200 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:16.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428113d700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f427c0b3020 0x7f427c150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:16.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428213f700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0b7330 0x7f427c150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:16.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428193e700 1 -- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f427c0b3020 msgr2=0x7f427c150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:16.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428193e700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f427c0b3020 0x7f427c150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:16.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428193e700 1 -- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0b7330 msgr2=0x7f427c150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:16.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428193e700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0b7330 0x7f427c150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:16.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428193e700 1 -- 172.21.15.57:0/3551699200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427800b1e0 con 0x7f427c0aabe0 2021-06-25T04:55:16.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428113d700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f427c0b3020 0x7f427c150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:16.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f428193e700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f427c0aabe0 0x7f427c0ad060 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f427c0641f0 tx=0x7f4278015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:16.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f426affd700 1 -- 172.21.15.57:0/3551699200 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4278021070 con 0x7f427c0aabe0 2021-06-25T04:55:16.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f426affd700 1 -- 172.21.15.57:0/3551699200 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278000e90 con 0x7f427c0aabe0 2021-06-25T04:55:16.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f4282940700 1 -- 172.21.15.57:0/3551699200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c0ab7a0 con 0x7f427c0aabe0 2021-06-25T04:55:16.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f426affd700 1 -- 172.21.15.57:0/3551699200 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4278011ab0 con 0x7f427c0aabe0 2021-06-25T04:55:16.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.492+0000 7f4282940700 1 -- 172.21.15.57:0/3551699200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c0653f0 con 0x7f427c0aabe0 2021-06-25T04:55:16.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.496+0000 7f4282940700 1 -- 172.21.15.57:0/3551699200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427c0ac200 con 0x7f427c0aabe0 2021-06-25T04:55:16.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.496+0000 7f426affd700 1 -- 172.21.15.57:0/3551699200 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f427800f070 con 0x7f427c0aabe0 2021-06-25T04:55:16.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.496+0000 7f426affd700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f425c055450 0x7f425c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:16.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.496+0000 7f426affd700 1 -- 172.21.15.57:0/3551699200 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f427806f190 con 0x7f427c0aabe0 2021-06-25T04:55:16.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.496+0000 7f428113d700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f425c055450 0x7f425c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:16.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.496+0000 7f428113d700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f425c055450 0x7f425c057910 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f426c00b000 tx=0x7f426c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:16.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.504+0000 7f426affd700 1 -- 172.21.15.57:0/3551699200 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4278045620 con 0x7f427c0aabe0 2021-06-25T04:55:16.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:16.672+0000 7f4282940700 1 -- 172.21.15.57:0/3551699200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f427c0ac200 con 0x7f427c0aabe0 2021-06-25T04:55:17.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.368+0000 7f426affd700 1 -- 172.21.15.57:0/3551699200 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v342) v1 ==== 130+0+0 (secure 0 0 0) 0x7f4278048c40 con 0x7f427c0aabe0 2021-06-25T04:55:17.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.368+0000 7f4282940700 1 -- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f425c055450 msgr2=0x7f425c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.368+0000 7f4282940700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f425c055450 0x7f425c057910 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f426c00b000 tx=0x7f426c009040).stop 2021-06-25T04:55:17.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.368+0000 7f4282940700 1 -- 172.21.15.57:0/3551699200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f427c0aabe0 msgr2=0x7f427c0ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.368+0000 7f4282940700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f427c0aabe0 0x7f427c0ad060 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f427c0641f0 tx=0x7f4278015000).stop 2021-06-25T04:55:17.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.368+0000 7f4282940700 1 -- 172.21.15.57:0/3551699200 shutdown_connections 2021-06-25T04:55:17.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.372+0000 7f4282940700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f425c055450 0x7f425c057910 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.372+0000 7f4282940700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0b7330 0x7f427c150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.372+0000 7f4282940700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f427c0b3020 0x7f427c150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.372+0000 7f4282940700 1 --2- 172.21.15.57:0/3551699200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f427c0aabe0 0x7f427c0ad060 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.372+0000 7f4282940700 1 -- 172.21.15.57:0/3551699200 >> 172.21.15.57:0/3551699200 conn(0x7f427c05f670 msgr2=0x7f427c0b5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:17.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.372+0000 7f4282940700 1 -- 172.21.15.57:0/3551699200 shutdown_connections 2021-06-25T04:55:17.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.372+0000 7f4282940700 1 -- 172.21.15.57:0/3551699200 wait complete. 2021-06-25T04:55:17.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:55:17.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.500+0000 7fc98139e700 1 Processor -- start 2021-06-25T04:55:17.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.500+0000 7fc98139e700 1 -- start start 2021-06-25T04:55:17.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.500+0000 7fc98139e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc97c0b5950 0x7fc97c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:17.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.500+0000 7fc98139e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c143f20 con 0x7fc97c0b6520 2021-06-25T04:55:17.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.500+0000 7fc98139e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c05ffa0 con 0x7fc97c05fbc0 2021-06-25T04:55:17.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.500+0000 7fc98139e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c0ba670 con 0x7fc97c0b5950 2021-06-25T04:55:17.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.500+0000 7fc97a7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc97c0b6520 0x7fc97c0b49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58602/0 (socket says 172.21.15.57:58602) 2021-06-25T04:55:17.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.500+0000 7fc97a7fc700 1 -- 172.21.15.57:0/3141943350 learned_addr learned my addr 172.21.15.57:0/3141943350 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:17.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.500+0000 7fc97b7fe700 1 --2- 172.21.15.57:0/3141943350 >> v2:172.21.15.87:3300/0 conn(0x7fc97c0b5950 0x7fc97c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:17.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc979ffb700 1 -- 172.21.15.57:0/3141943350 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853868365 0 0) 0x7fc97c143f20 con 0x7fc97c0b6520 2021-06-25T04:55:17.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc979ffb700 1 -- 172.21.15.57:0/3141943350 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc95c003260 con 0x7fc97c0b6520 2021-06-25T04:55:17.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc97b7fe700 1 -- 172.21.15.57:0/3141943350 >> v1:172.21.15.87:6789/0 conn(0x7fc97c05fbc0 legacy=0x7fc97c0b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc97b7fe700 1 -- 172.21.15.57:0/3141943350 >> v1:172.21.15.57:6789/0 conn(0x7fc97c0b6520 legacy=0x7fc97c0b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc979ffb700 1 -- 172.21.15.57:0/3141943350 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3545570071 0 0) 0x7fc95c003260 con 0x7fc97c0b6520 2021-06-25T04:55:17.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc97b7fe700 1 -- 172.21.15.57:0/3141943350 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c143a10 con 0x7fc97c0b5950 2021-06-25T04:55:17.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc97b7fe700 1 --2- 172.21.15.57:0/3141943350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b5950 0x7fc97c0b4170 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fc964001800 tx=0x7fc9740091d0).ready entity=mon.1 client_cookie=9f13ab868c7818be server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:17.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc979ffb700 1 -- 172.21.15.57:0/3141943350 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc964001660 con 0x7fc97c0b5950 2021-06-25T04:55:17.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc979ffb700 1 -- 172.21.15.57:0/3141943350 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97400b580 con 0x7fc97c0b5950 2021-06-25T04:55:17.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc979ffb700 1 -- 172.21.15.57:0/3141943350 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc97400b6f0 con 0x7fc97c0b5950 2021-06-25T04:55:17.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc98139e700 1 -- 172.21.15.57:0/3141943350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b5950 msgr2=0x7fc97c0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc98139e700 1 --2- 172.21.15.57:0/3141943350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b5950 0x7fc97c0b4170 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fc964001800 tx=0x7fc9740091d0).stop 2021-06-25T04:55:17.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc98139e700 1 -- 172.21.15.57:0/3141943350 shutdown_connections 2021-06-25T04:55:17.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc98139e700 1 --2- 172.21.15.57:0/3141943350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b5950 0x7fc97c0b4170 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc98139e700 1 -- 172.21.15.57:0/3141943350 >> 172.21.15.57:0/3141943350 conn(0x7fc97c062360 msgr2=0x7fc97c066da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:17.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc98139e700 1 -- 172.21.15.57:0/3141943350 shutdown_connections 2021-06-25T04:55:17.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.504+0000 7fc98139e700 1 -- 172.21.15.57:0/3141943350 wait complete. 2021-06-25T04:55:17.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc98139e700 1 Processor -- start 2021-06-25T04:55:17.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc98139e700 1 -- start start 2021-06-25T04:55:17.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc98139e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc97c05fbc0 0x7fc97c13d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:17.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc98139e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b5950 0x7fc97c152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:17.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc98139e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b6520 0x7fc97c152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:17.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc98139e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0af3b0 con 0x7fc97c0b5950 2021-06-25T04:55:17.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc98139e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c156280 con 0x7fc97c0b6520 2021-06-25T04:55:17.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc98139e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c156520 con 0x7fc97c05fbc0 2021-06-25T04:55:17.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc97a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b5950 0x7fc97c152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:17.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc97a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b5950 0x7fc97c152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41390/0 (socket says 172.21.15.57:41390) 2021-06-25T04:55:17.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc97a7fc700 1 -- 172.21.15.57:0/3330566927 learned_addr learned my addr 172.21.15.57:0/3330566927 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:17.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc97b7fe700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b6520 0x7fc97c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:17.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.508+0000 7fc97affd700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc97c05fbc0 0x7fc97c13d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:17.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc97a7fc700 1 -- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc97c05fbc0 msgr2=0x7fc97c13d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc97a7fc700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc97c05fbc0 0x7fc97c13d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc97a7fc700 1 -- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b6520 msgr2=0x7fc97c152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc97a7fc700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b6520 0x7fc97c152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc97a7fc700 1 -- 172.21.15.57:0/3330566927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974009470 con 0x7fc97c0b5950 2021-06-25T04:55:17.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc97a7fc700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b5950 0x7fc97c152140 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fc9640018c0 tx=0x7fc9640019e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:17.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc973fff700 1 -- 172.21.15.57:0/3330566927 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96400ce70 con 0x7fc97c0b5950 2021-06-25T04:55:17.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc973fff700 1 -- 172.21.15.57:0/3330566927 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc964007170 con 0x7fc97c0b5950 2021-06-25T04:55:17.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc98139e700 1 -- 172.21.15.57:0/3330566927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c146ed0 con 0x7fc97c0b5950 2021-06-25T04:55:17.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc973fff700 1 -- 172.21.15.57:0/3330566927 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc964004730 con 0x7fc97c0b5950 2021-06-25T04:55:17.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc98139e700 1 -- 172.21.15.57:0/3330566927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c146a30 con 0x7fc97c0b5950 2021-06-25T04:55:17.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc98139e700 1 -- 172.21.15.57:0/3330566927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c057310 con 0x7fc97c0b5950 2021-06-25T04:55:17.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc973fff700 1 -- 172.21.15.57:0/3330566927 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc96401b070 con 0x7fc97c0b5950 2021-06-25T04:55:17.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc973fff700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9600553f0 0x7fc9600578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:17.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.512+0000 7fc973fff700 1 -- 172.21.15.57:0/3330566927 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc96406d410 con 0x7fc97c0b5950 2021-06-25T04:55:17.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.516+0000 7fc97affd700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9600553f0 0x7fc9600578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:17.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.516+0000 7fc97affd700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9600553f0 0x7fc9600578b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fc96c00d000 tx=0x7fc96c007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.520+0000 7fc973fff700 1 -- 172.21.15.57:0/3330566927 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc964043790 con 0x7fc97c0b5950 2021-06-25T04:55:17.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.652+0000 7fc98139e700 1 -- 172.21.15.57:0/3330566927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc97c0698a0 con 0x7fc97c0b5950 2021-06-25T04:55:17.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.664+0000 7fc973fff700 1 -- 172.21.15.57:0/3330566927 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc964046db0 con 0x7fc97c0b5950 2021-06-25T04:55:17.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.664+0000 7fc98139e700 1 -- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9600553f0 msgr2=0x7fc9600578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.664+0000 7fc98139e700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9600553f0 0x7fc9600578b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fc96c00d000 tx=0x7fc96c007b90).stop 2021-06-25T04:55:17.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.664+0000 7fc98139e700 1 -- 172.21.15.57:0/3330566927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b5950 msgr2=0x7fc97c152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.664+0000 7fc98139e700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b5950 0x7fc97c152140 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fc9640018c0 tx=0x7fc9640019e0).stop 2021-06-25T04:55:17.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.664+0000 7fc98139e700 1 -- 172.21.15.57:0/3330566927 shutdown_connections 2021-06-25T04:55:17.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.664+0000 7fc98139e700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9600553f0 0x7fc9600578b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.664+0000 7fc98139e700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97c0b6520 0x7fc97c152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.664+0000 7fc98139e700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc97c0b5950 0x7fc97c152140 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.664+0000 7fc98139e700 1 --2- 172.21.15.57:0/3330566927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc97c05fbc0 0x7fc97c13d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.664+0000 7fc98139e700 1 -- 172.21.15.57:0/3330566927 >> 172.21.15.57:0/3330566927 conn(0x7fc97c062360 msgr2=0x7fc97c0b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:17.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.668+0000 7fc98139e700 1 -- 172.21.15.57:0/3330566927 shutdown_connections 2021-06-25T04:55:17.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.668+0000 7fc98139e700 1 -- 172.21.15.57:0/3330566927 wait complete. 2021-06-25T04:55:17.683 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:55:17.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:17.701 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:17.720 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:17.742 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:17.765 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:55:17.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:17.766 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:17.767 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:17.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:55:17.794 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:55:17.795 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:55:17.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:17.797 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:17.798 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:17.806 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:55:17.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:55:17.808 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:55:17.809 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:55:17.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.916+0000 7ff09359e700 1 Processor -- start 2021-06-25T04:55:17.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.916+0000 7ff09359e700 1 -- start start 2021-06-25T04:55:17.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.916+0000 7ff09359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0940b5460 0x7ff0940af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:17.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.916+0000 7ff09359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0940b05d0 0x7ff094147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:17.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.916+0000 7ff09359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0940b5840 con 0x7ff094067560 2021-06-25T04:55:17.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.916+0000 7ff09359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0941452a0 con 0x7ff0940b5460 2021-06-25T04:55:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.916+0000 7ff09359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940adfb0 con 0x7ff0940b05d0 2021-06-25T04:55:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.916+0000 7ff09259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0940b5460 0x7ff0940af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.916+0000 7ff092d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff094067560 0x7ff0940acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58618/0 (socket says 172.21.15.57:58618) 2021-06-25T04:55:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.916+0000 7ff092d9d700 1 -- 172.21.15.57:0/3632789922 learned_addr learned my addr 172.21.15.57:0/3632789922 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.916+0000 7ff091d9b700 1 --2- 172.21.15.57:0/3632789922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0940b05d0 0x7ff094147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:17.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09259c700 1 -- 172.21.15.57:0/3632789922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0940b05d0 msgr2=0x7ff094147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:17.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09259c700 1 --2- 172.21.15.57:0/3632789922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0940b05d0 0x7ff094147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09259c700 1 -- 172.21.15.57:0/3632789922 >> v1:172.21.15.57:6789/0 conn(0x7ff094067560 legacy=0x7ff0940acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09259c700 1 -- 172.21.15.57:0/3632789922 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0940ac7c0 con 0x7ff0940b5460 2021-06-25T04:55:17.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09259c700 1 --2- 172.21.15.57:0/3632789922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940b5460 0x7ff0940af510 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7ff088002f70 tx=0x7ff088006df0).ready entity=mon.0 client_cookie=b46d08dbf30fe9db server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:17.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09159a700 1 -- 172.21.15.57:0/3632789922 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff08800d570 con 0x7ff0940b5460 2021-06-25T04:55:17.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09159a700 1 -- 172.21.15.57:0/3632789922 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff088000e90 con 0x7ff0940b5460 2021-06-25T04:55:17.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09159a700 1 -- 172.21.15.57:0/3632789922 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff08800d8c0 con 0x7ff0940b5460 2021-06-25T04:55:17.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09359e700 1 -- 172.21.15.57:0/3632789922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940b5460 msgr2=0x7ff0940af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09359e700 1 --2- 172.21.15.57:0/3632789922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940b5460 0x7ff0940af510 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7ff088002f70 tx=0x7ff088006df0).stop 2021-06-25T04:55:17.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09359e700 1 -- 172.21.15.57:0/3632789922 shutdown_connections 2021-06-25T04:55:17.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09359e700 1 --2- 172.21.15.57:0/3632789922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0940b05d0 0x7ff094147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09359e700 1 --2- 172.21.15.57:0/3632789922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940b5460 0x7ff0940af510 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09359e700 1 -- 172.21.15.57:0/3632789922 >> 172.21.15.57:0/3632789922 conn(0x7ff094062520 msgr2=0x7ff094062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:17.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09359e700 1 -- 172.21.15.57:0/3632789922 shutdown_connections 2021-06-25T04:55:17.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09359e700 1 -- 172.21.15.57:0/3632789922 wait complete. 2021-06-25T04:55:17.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09359e700 1 Processor -- start 2021-06-25T04:55:17.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.920+0000 7ff09359e700 1 -- start start 2021-06-25T04:55:17.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff09359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff094067560 0x7ff094063d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:17.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff09359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940b05d0 0x7ff094147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:17.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff09359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940b5460 0x7ff094156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:17.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff09359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940633e0 con 0x7ff0940b5460 2021-06-25T04:55:17.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff09359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff094066b70 con 0x7ff0940b05d0 2021-06-25T04:55:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff09359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff094066e10 con 0x7ff094067560 2021-06-25T04:55:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff092d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940b5460 0x7ff094156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:17.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff092d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940b5460 0x7ff094156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41406/0 (socket says 172.21.15.57:41406) 2021-06-25T04:55:17.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff092d9d700 1 -- 172.21.15.57:0/1246768465 learned_addr learned my addr 172.21.15.57:0/1246768465 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:17.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff09259c700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff094067560 0x7ff094063d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:17.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff091d9b700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940b05d0 0x7ff094147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:17.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff092d9d700 1 -- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff094067560 msgr2=0x7ff094063d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff092d9d700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff094067560 0x7ff094063d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff092d9d700 1 -- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940b05d0 msgr2=0x7ff094147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:17.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff092d9d700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940b05d0 0x7ff094147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:17.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff092d9d700 1 -- 172.21.15.57:0/1246768465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08800b180 con 0x7ff0940b5460 2021-06-25T04:55:17.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff091d9b700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940b05d0 0x7ff094147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:17.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff092d9d700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940b5460 0x7ff094156d30 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7ff0940ac5a0 tx=0x7ff08c007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:17.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff0837fe700 1 -- 172.21.15.57:0/1246768465 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff08c0070d0 con 0x7ff0940b5460 2021-06-25T04:55:17.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff0837fe700 1 -- 172.21.15.57:0/1246768465 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c007230 con 0x7ff0940b5460 2021-06-25T04:55:17.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff0837fe700 1 -- 172.21.15.57:0/1246768465 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff08c005610 con 0x7ff0940b5460 2021-06-25T04:55:17.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff09359e700 1 -- 172.21.15.57:0/1246768465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0940670b0 con 0x7ff0940b5460 2021-06-25T04:55:17.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff09359e700 1 -- 172.21.15.57:0/1246768465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff094159d30 con 0x7ff0940b5460 2021-06-25T04:55:17.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff09359e700 1 -- 172.21.15.57:0/1246768465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff094066930 con 0x7ff0940b5460 2021-06-25T04:55:17.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.924+0000 7ff0837fe700 1 -- 172.21.15.57:0/1246768465 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff08c01a070 con 0x7ff0940b5460 2021-06-25T04:55:17.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.928+0000 7ff0837fe700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0700554e0 0x7ff0700579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:17.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.928+0000 7ff0837fe700 1 -- 172.21.15.57:0/1246768465 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ff08c06ce40 con 0x7ff0940b5460 2021-06-25T04:55:17.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.928+0000 7ff09259c700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0700554e0 0x7ff0700579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:17.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.928+0000 7ff09259c700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0700554e0 0x7ff0700579a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7ff088019000 tx=0x7ff088014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:17.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:17.932+0000 7ff0837fe700 1 -- 172.21.15.57:0/1246768465 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff094066930 con 0x7ff0940b5460 2021-06-25T04:55:18.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.060+0000 7ff09359e700 1 -- 172.21.15.57:0/1246768465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff094066930 con 0x7ff0940b5460 2021-06-25T04:55:18.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff0837fe700 1 -- 172.21.15.57:0/1246768465 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v101) v1 ==== 81+0+29221 (secure 0 0 0) 0x7ff094066930 con 0x7ff0940b5460 2021-06-25T04:55:18.067 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:18.068 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:55:18.068 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 101, 2021-06-25T04:55:18.068 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:55:18.068 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:55:18.069 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:55:15.335562+0000", 2021-06-25T04:55:18.069 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:55:18.069 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:55:18.069 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:55:18.070 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:55:18.070 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:55:18.070 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:55:18.070 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:55:18.071 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:55:18.071 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:55:18.071 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:18.071 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:55:18.072 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:55:18.072 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:55:18.072 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:55:18.072 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:55:18.072 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 18, 2021-06-25T04:55:18.073 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:55:18.073 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:55:18.073 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:55:18.073 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:55:18.074 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:55:18.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.074 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:55:18.074 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:55:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:55:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:55:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:55:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:55:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:55:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:55:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:55:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:55:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:55:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:55:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:55:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:55:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:55:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:55:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:55:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:55:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:55:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:55:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:55:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:55:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:55:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:55:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:55:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:55:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 96, 2021-06-25T04:55:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:55:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:55:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:55:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:55:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:55:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:55:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:55:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:55:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:55:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:55:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:55:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:55:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:55:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:55:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 96, 2021-06-25T04:55:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:55:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:55:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:55:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:55:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:55:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:55:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:55:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:55:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:55:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:55:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:55:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:55:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:55:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:55:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 96, 2021-06-25T04:55:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:55:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:55:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:55:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:55:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:55:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:55:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:55:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:55:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:55:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:55:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:55:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:55:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:55:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:55:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 96, 2021-06-25T04:55:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:55:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:55:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:55:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:55:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:55:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:55:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:55:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:55:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:55:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:55:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:55:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:55:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:55:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:55:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 95, 2021-06-25T04:55:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:55:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:55:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:55:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:55:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:55:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:55:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:55:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.192 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:55:18.192 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:18.192 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.192 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.193 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:55:18.193 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:55:18.193 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:55:18.194 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:55:18.194 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:18.194 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:18.194 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:18.194 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.195 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:55:18.195 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:55:18.196 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:18.196 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:18.196 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:18.196 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:18.196 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:18.197 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:18.197 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:18.197 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 86, 2021-06-25T04:55:18.197 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:18.197 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:18.198 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:18.198 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.198 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.199 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:55:18.199 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:18.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.200 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.200 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:55:18.200 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:18.200 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.200 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.201 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:18.201 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.201 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.202 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:55:18.202 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:18.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.203 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.203 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:55:18.203 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:18.203 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.204 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.204 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:18.204 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.205 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.205 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:55:18.205 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:18.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.206 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.206 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:55:18.206 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:18.206 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.207 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.207 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:18.207 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.208 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.208 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:55:18.208 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:18.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.209 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.209 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:55:18.209 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:18.210 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.210 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.210 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:55:18.211 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:55:18.211 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:55:18.211 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:55:18.211 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:18.211 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:18.212 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:18.212 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.213 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:55:18.213 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:55:18.213 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:18.213 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:18.213 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:18.214 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:18.214 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:18.214 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:18.214 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:18.215 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 95, 2021-06-25T04:55:18.215 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:18.215 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:18.215 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:18.215 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.216 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.216 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:55:18.216 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:18.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.217 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.217 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:55:18.217 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:18.218 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.218 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.218 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:18.218 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.219 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.219 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:55:18.219 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:18.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.220 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.221 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:55:18.221 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:18.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.221 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.222 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:18.222 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.222 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.223 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:55:18.223 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:18.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.223 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.224 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:55:18.224 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:18.224 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.224 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.225 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:18.225 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.225 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.226 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:55:18.226 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:18.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.227 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.227 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:55:18.227 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:18.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.227 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.228 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:55:18.228 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:55:18.228 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:55:18.229 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:55:18.229 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:18.229 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:18.229 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:18.229 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.230 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:55:18.230 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:55:18.231 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:18.231 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:18.231 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:18.231 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:18.232 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:18.232 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:18.232 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:18.232 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 96, 2021-06-25T04:55:18.233 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:18.233 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:18.233 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:18.233 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.234 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.234 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:55:18.234 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:18.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.235 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.235 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:55:18.235 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:18.235 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.236 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.236 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:18.236 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.237 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.237 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:55:18.237 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:18.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.238 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.238 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:55:18.238 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:18.238 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.239 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.239 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:18.239 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.240 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.240 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:55:18.240 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:18.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.241 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.241 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:55:18.242 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:18.242 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.242 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.243 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:18.243 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:18.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.243 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:18.243 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:55:18.244 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:18.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.244 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:18.245 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:55:18.245 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:18.245 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.245 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.246 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:55:18.246 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:55:18.246 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:55:18.246 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:55:18.247 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:18.247 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:18.247 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:18.247 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:18.247 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.248 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:18.248 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:55:18.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.248 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:55:18.249 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:18.249 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:18.249 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:18.249 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:18.249 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:18.250 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:55:18.250 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:18.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.251 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:55:18.251 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:18.251 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:18.251 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:18.251 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:18.252 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:18.252 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:55:18.252 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:18.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.253 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:55:18.253 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:18.253 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:18.253 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:18.254 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:18.254 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:18.254 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:55:18.254 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:18.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.255 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:55:18.255 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:18.255 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:18.256 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:18.256 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:18.256 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:18.256 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:55:18.257 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:18.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.257 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:55:18.258 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:18.258 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:18.258 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:18.258 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:18.258 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:18.259 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:55:18.259 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:18.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.260 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:55:18.260 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:18.260 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:18.260 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:18.260 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:18.261 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:18.261 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:55:18.261 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:18.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.262 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:55:18.262 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:18.262 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:18.262 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:18.263 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:18.263 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:18.263 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:55:18.263 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:18.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:18.264 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:55:18.264 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:18.264 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:18.265 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:18.265 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:18.265 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:18.265 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:55:18.266 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:18.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.266 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:18.266 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:55:18.266 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:55:18.267 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:55:18.267 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:55:18.267 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:55:18.267 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6835/3959946984": "2021-06-26T04:55:11.609664+0000", 2021-06-25T04:55:18.267 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6834/3959946984": "2021-06-26T04:55:11.609664+0000" 2021-06-25T04:55:18.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.268 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:55:18.268 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:55:18.268 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:55:18.269 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:55:18.269 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:55:18.269 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:55:18.269 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:55:18.269 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:55:18.270 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:55:18.270 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:55:18.270 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:55:18.270 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:55:18.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.271 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:55:18.271 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:55:18.271 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:55:18.271 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:55:18.272 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:55:18.272 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:55:18.272 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:55:18.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:18.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:18.273 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:55:18.273 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:55:18.273 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:55:18.273 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:55:18.274 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:55:18.274 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:55:18.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 -- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0700554e0 msgr2=0x7ff0700579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0700554e0 0x7ff0700579a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7ff088019000 tx=0x7ff088014000).stop 2021-06-25T04:55:18.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 -- 172.21.15.57:0/1246768465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940b5460 msgr2=0x7ff094156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940b5460 0x7ff094156d30 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7ff0940ac5a0 tx=0x7ff08c007bc0).stop 2021-06-25T04:55:18.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 -- 172.21.15.57:0/1246768465 shutdown_connections 2021-06-25T04:55:18.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0700554e0 0x7ff0700579a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940b5460 0x7ff094156d30 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940b05d0 0x7ff094147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 --2- 172.21.15.57:0/1246768465 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff094067560 0x7ff094063d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 -- 172.21.15.57:0/1246768465 >> 172.21.15.57:0/1246768465 conn(0x7ff094062520 msgr2=0x7ff0940ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:18.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 -- 172.21.15.57:0/1246768465 shutdown_connections 2021-06-25T04:55:18.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.064+0000 7ff09359e700 1 -- 172.21.15.57:0/1246768465 wait complete. 2021-06-25T04:55:18.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:18.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e25b94700 1 Processor -- start 2021-06-25T04:55:18.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e25b94700 1 -- start start 2021-06-25T04:55:18.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e25b94700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e20066dc0 0x7f8e200afd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e25b94700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e200aaed0 0x7f8e20143420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e25b94700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e200671a0 con 0x7f8e20060cc0 2021-06-25T04:55:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e25b94700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e200ab2e0 con 0x7f8e20066dc0 2021-06-25T04:55:18.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e25b94700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200a9410 con 0x7f8e200aaed0 2021-06-25T04:55:18.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e1f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e20066dc0 0x7f8e200afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e1effd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8e20060cc0 0x7f8e200aa7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:59376/0 (socket says 172.21.15.57:59376) 2021-06-25T04:55:18.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e1effd700 1 -- 172.21.15.57:0/3599009088 learned_addr learned my addr 172.21.15.57:0/3599009088 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:18.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e1f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e20066dc0 0x7f8e200afd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41412/0 (socket says 172.21.15.57:41412) 2021-06-25T04:55:18.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.388+0000 7f8e1ffff700 1 --2- 172.21.15.57:0/3599009088 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e200aaed0 0x7f8e20143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e1f7fe700 1 -- 172.21.15.57:0/3599009088 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e200aaed0 msgr2=0x7f8e20143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e1f7fe700 1 --2- 172.21.15.57:0/3599009088 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e200aaed0 0x7f8e20143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e1f7fe700 1 -- 172.21.15.57:0/3599009088 >> v1:172.21.15.87:6789/0 conn(0x7f8e20060cc0 legacy=0x7f8e200aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e1e7fc700 1 -- 172.21.15.57:0/3599009088 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549993167 0 0) 0x7f8e200671a0 con 0x7f8e20060cc0 2021-06-25T04:55:18.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e1f7fe700 1 -- 172.21.15.57:0/3599009088 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200b0370 con 0x7f8e20066dc0 2021-06-25T04:55:18.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e1f7fe700 1 --2- 172.21.15.57:0/3599009088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e20066dc0 0x7f8e200afd40 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f8e08002f70 tx=0x7f8e08006df0).ready entity=mon.0 client_cookie=d2f1e9ce4495aa0f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:18.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e1e7fc700 1 -- 172.21.15.57:0/3599009088 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e0800d570 con 0x7f8e20066dc0 2021-06-25T04:55:18.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e1e7fc700 1 -- 172.21.15.57:0/3599009088 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e08000e90 con 0x7f8e20066dc0 2021-06-25T04:55:18.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e25b94700 1 -- 172.21.15.57:0/3599009088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e20066dc0 msgr2=0x7f8e200afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e1e7fc700 1 -- 172.21.15.57:0/3599009088 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e0800d8c0 con 0x7f8e20066dc0 2021-06-25T04:55:18.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e25b94700 1 --2- 172.21.15.57:0/3599009088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e20066dc0 0x7f8e200afd40 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f8e08002f70 tx=0x7f8e08006df0).stop 2021-06-25T04:55:18.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e25b94700 1 -- 172.21.15.57:0/3599009088 shutdown_connections 2021-06-25T04:55:18.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e25b94700 1 --2- 172.21.15.57:0/3599009088 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e200aaed0 0x7f8e20143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e25b94700 1 --2- 172.21.15.57:0/3599009088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e20066dc0 0x7f8e200afd40 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e25b94700 1 -- 172.21.15.57:0/3599009088 >> 172.21.15.57:0/3599009088 conn(0x7f8e200b53a0 msgr2=0x7f8e200b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:18.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e25b94700 1 -- 172.21.15.57:0/3599009088 shutdown_connections 2021-06-25T04:55:18.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.392+0000 7f8e25b94700 1 -- 172.21.15.57:0/3599009088 wait complete. 2021-06-25T04:55:18.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e25b94700 1 Processor -- start 2021-06-25T04:55:18.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e25b94700 1 -- start start 2021-06-25T04:55:18.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e25b94700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e20060cc0 0x7f8e20141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e25b94700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e20066dc0 0x7f8e201479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e25b94700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e200aaed0 0x7f8e20147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e25b94700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200b4f10 con 0x7f8e20060cc0 2021-06-25T04:55:18.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e25b94700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200b32b0 con 0x7f8e20066dc0 2021-06-25T04:55:18.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e25b94700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200b3790 con 0x7f8e200aaed0 2021-06-25T04:55:18.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e20060cc0 0x7f8e20141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e200aaed0 0x7f8e20147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e20066dc0 0x7f8e201479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e20060cc0 0x7f8e20141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41416/0 (socket says 172.21.15.57:41416) 2021-06-25T04:55:18.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1f7fe700 1 -- 172.21.15.57:0/2951954691 learned_addr learned my addr 172.21.15.57:0/2951954691 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1ffff700 1 -- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e20066dc0 msgr2=0x7f8e201479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1ffff700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e20066dc0 0x7f8e201479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1ffff700 1 -- 172.21.15.57:0/2951954691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e20060cc0 msgr2=0x7f8e20141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1ffff700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e20060cc0 0x7f8e20141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1ffff700 1 -- 172.21.15.57:0/2951954691 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0800b180 con 0x7f8e200aaed0 2021-06-25T04:55:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1effd700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e20066dc0 0x7f8e201479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.396+0000 7f8e1f7fe700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e20060cc0 0x7f8e20141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.400+0000 7f8e1ffff700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e200aaed0 0x7f8e20147eb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f8e200ac510 tx=0x7f8e18006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.400+0000 7f8e1cff9700 1 -- 172.21.15.57:0/2951954691 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e18016070 con 0x7f8e200aaed0 2021-06-25T04:55:18.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.400+0000 7f8e1cff9700 1 -- 172.21.15.57:0/2951954691 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e18011750 con 0x7f8e200aaed0 2021-06-25T04:55:18.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.400+0000 7f8e25b94700 1 -- 172.21.15.57:0/2951954691 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e200ac5f0 con 0x7f8e200aaed0 2021-06-25T04:55:18.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.400+0000 7f8e1cff9700 1 -- 172.21.15.57:0/2951954691 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e18011ab0 con 0x7f8e200aaed0 2021-06-25T04:55:18.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.400+0000 7f8e25b94700 1 -- 172.21.15.57:0/2951954691 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e200b3020 con 0x7f8e200aaed0 2021-06-25T04:55:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.400+0000 7f8e25b94700 1 -- 172.21.15.57:0/2951954691 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e200b3900 con 0x7f8e200aaed0 2021-06-25T04:55:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.400+0000 7f8e1cff9700 1 -- 172.21.15.57:0/2951954691 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8e18011c10 con 0x7f8e200aaed0 2021-06-25T04:55:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.404+0000 7f8e1cff9700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 0x7f8e040579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.404+0000 7f8e1cff9700 1 -- 172.21.15.57:0/2951954691 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f8e1806db60 con 0x7f8e200aaed0 2021-06-25T04:55:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.404+0000 7f8e1f7fe700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 0x7f8e040579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.404+0000 7f8e1f7fe700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 0x7f8e040579a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f8e08019000 tx=0x7f8e08014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:18.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.412+0000 7f8e1cff9700 1 -- 172.21.15.57:0/2951954691 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8e18043ee0 con 0x7f8e200aaed0 2021-06-25T04:55:18.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.576+0000 7f8e25b94700 1 -- 172.21.15.57:0/2951954691 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e20057310 con 0x7f8e200aaed0 2021-06-25T04:55:18.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.576+0000 7f8e1cff9700 1 -- 172.21.15.57:0/2951954691 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f8e18047500 con 0x7f8e200aaed0 2021-06-25T04:55:18.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:18.584 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3853681312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3853681312},{"type":"v1","addr":"172.21.15.87:6835","nonce":3853681312}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6981,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2200404668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2200404668},{"type":"v1","addr":"172.21.15.57:6833","nonce":2200404668}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45},{"gid":7236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4080135118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4080135118},{"type":"v1","addr":"172.21.15.57:6835","nonce":4080135118}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[]} 2021-06-25T04:55:18.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 -- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 msgr2=0x7f8e040579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 0x7f8e040579a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f8e08019000 tx=0x7f8e08014000).stop 2021-06-25T04:55:18.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 -- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e200aaed0 msgr2=0x7f8e20147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e200aaed0 0x7f8e20147eb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f8e200ac510 tx=0x7f8e18006df0).stop 2021-06-25T04:55:18.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 -- 172.21.15.57:0/2951954691 shutdown_connections 2021-06-25T04:55:18.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 0x7f8e040579a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e200aaed0 0x7f8e20147eb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e20066dc0 0x7f8e201479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 --2- 172.21.15.57:0/2951954691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e20060cc0 0x7f8e20141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 -- 172.21.15.57:0/2951954691 >> 172.21.15.57:0/2951954691 conn(0x7f8e200b53a0 msgr2=0x7f8e200b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:18.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 -- 172.21.15.57:0/2951954691 shutdown_connections 2021-06-25T04:55:18.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.580+0000 7f8e25b94700 1 -- 172.21.15.57:0/2951954691 wait complete. 2021-06-25T04:55:18.589 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 49 2021-06-25T04:55:18.596 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:18.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.692+0000 7f26055b6700 1 Processor -- start 2021-06-25T04:55:18.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.692+0000 7f26055b6700 1 -- start start 2021-06-25T04:55:18.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.692+0000 7f26055b6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f26000ad8d0 0x7f2600063760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.692+0000 7f26055b6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26000b1650 0x7f2600066fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.692+0000 7f26055b6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2600143cf0 con 0x7f26000b52c0 2021-06-25T04:55:18.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.692+0000 7f26055b6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26000b1ae0 con 0x7f26000b1650 2021-06-25T04:55:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.692+0000 7f26055b6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26000adf50 con 0x7f26000ad8d0 2021-06-25T04:55:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f2604db5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26000b1650 0x7f2600066fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f2604db5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26000b1650 0x7f2600066fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41428/0 (socket says 172.21.15.57:41428) 2021-06-25T04:55:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f2604db5700 1 -- 172.21.15.57:0/2759010654 learned_addr learned my addr 172.21.15.57:0/2759010654 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:18.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f25f7fff700 1 --2- 172.21.15.57:0/2759010654 >> v2:172.21.15.87:3300/0 conn(0x7f26000ad8d0 0x7f2600063760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f2604db5700 1 -- 172.21.15.57:0/2759010654 >> v2:172.21.15.87:3300/0 conn(0x7f26000ad8d0 msgr2=0x7f2600063760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f2604db5700 1 --2- 172.21.15.57:0/2759010654 >> v2:172.21.15.87:3300/0 conn(0x7f26000ad8d0 0x7f2600063760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f2604db5700 1 -- 172.21.15.57:0/2759010654 >> v1:172.21.15.87:6789/0 conn(0x7f26000b52c0 legacy=0x7f26001435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:18.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f2604db5700 1 -- 172.21.15.57:0/2759010654 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26000ae1f0 con 0x7f26000b1650 2021-06-25T04:55:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f25f7fff700 1 --2- 172.21.15.57:0/2759010654 >> v2:172.21.15.87:3300/0 conn(0x7f26000ad8d0 0x7f2600063760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f2604db5700 1 --2- 172.21.15.57:0/2759010654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26000b1650 0x7f2600066fc0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f2600069e40 tx=0x7f25f8009290).ready entity=mon.0 client_cookie=fb80ce639cdbe42 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f25ff7fe700 1 -- 172.21.15.57:0/2759010654 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25f800b830 con 0x7f26000b1650 2021-06-25T04:55:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f25ff7fe700 1 -- 172.21.15.57:0/2759010654 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f800b990 con 0x7f26000b1650 2021-06-25T04:55:18.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f25ff7fe700 1 -- 172.21.15.57:0/2759010654 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25f800bb40 con 0x7f26000b1650 2021-06-25T04:55:18.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f26055b6700 1 -- 172.21.15.57:0/2759010654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26000b1650 msgr2=0x7f2600066fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f26055b6700 1 --2- 172.21.15.57:0/2759010654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26000b1650 0x7f2600066fc0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f2600069e40 tx=0x7f25f8009290).stop 2021-06-25T04:55:18.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f26055b6700 1 -- 172.21.15.57:0/2759010654 shutdown_connections 2021-06-25T04:55:18.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f26055b6700 1 --2- 172.21.15.57:0/2759010654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26000b1650 0x7f2600066fc0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f26055b6700 1 --2- 172.21.15.57:0/2759010654 >> v2:172.21.15.87:3300/0 conn(0x7f26000ad8d0 0x7f2600063760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f26055b6700 1 -- 172.21.15.57:0/2759010654 >> 172.21.15.57:0/2759010654 conn(0x7f2600062520 msgr2=0x7f2600062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f26055b6700 1 -- 172.21.15.57:0/2759010654 shutdown_connections 2021-06-25T04:55:18.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f26055b6700 1 -- 172.21.15.57:0/2759010654 wait complete. 2021-06-25T04:55:18.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.696+0000 7f26055b6700 1 Processor -- start 2021-06-25T04:55:18.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f26055b6700 1 -- start start 2021-06-25T04:55:18.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f26055b6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26000ad8d0 0x7f260013d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f26055b6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26000b1650 0x7f26000667c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f26055b6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26000b52c0 0x7f26001448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f26055b6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260013e8d0 con 0x7f26000ad8d0 2021-06-25T04:55:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f26055b6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260013d5b0 con 0x7f26000b52c0 2021-06-25T04:55:18.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f26055b6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260013eb30 con 0x7f26000b1650 2021-06-25T04:55:18.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26000ad8d0 0x7f260013d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26000ad8d0 0x7f260013d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41430/0 (socket says 172.21.15.57:41430) 2021-06-25T04:55:18.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f2604db5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26000b52c0 0x7f26001448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fffff700 1 -- 172.21.15.57:0/2432622351 learned_addr learned my addr 172.21.15.57:0/2432622351 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:18.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25f7fff700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26000b1650 0x7f26000667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fffff700 1 -- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26000b1650 msgr2=0x7f26000667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fffff700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26000b1650 0x7f26000667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fffff700 1 -- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26000b52c0 msgr2=0x7f26001448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fffff700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26000b52c0 0x7f26001448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fffff700 1 -- 172.21.15.57:0/2432622351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8009530 con 0x7f26000ad8d0 2021-06-25T04:55:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fffff700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26000ad8d0 0x7f260013d9d0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f25f0002f30 tx=0x7f25f0006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fdffb700 1 -- 172.21.15.57:0/2432622351 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25f0012410 con 0x7f26000ad8d0 2021-06-25T04:55:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fdffb700 1 -- 172.21.15.57:0/2432622351 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f0012570 con 0x7f26000ad8d0 2021-06-25T04:55:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f26055b6700 1 -- 172.21.15.57:0/2432622351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2600140c80 con 0x7f26000ad8d0 2021-06-25T04:55:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f25fdffb700 1 -- 172.21.15.57:0/2432622351 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25f00128d0 con 0x7f26000ad8d0 2021-06-25T04:55:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.700+0000 7f26055b6700 1 -- 172.21.15.57:0/2432622351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2600066cb0 con 0x7f26000ad8d0 2021-06-25T04:55:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.704+0000 7f26055b6700 1 -- 172.21.15.57:0/2432622351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2600140e10 con 0x7f26000ad8d0 2021-06-25T04:55:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.704+0000 7f25fdffb700 1 -- 172.21.15.57:0/2432622351 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f25f000f030 con 0x7f26000ad8d0 2021-06-25T04:55:18.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.704+0000 7f25fdffb700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25e40554e0 0x7f25e40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:18.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.704+0000 7f25fdffb700 1 -- 172.21.15.57:0/2432622351 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f25f006d800 con 0x7f26000ad8d0 2021-06-25T04:55:18.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.704+0000 7f25f7fff700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25e40554e0 0x7f25e40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:18.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.704+0000 7f25f7fff700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25e40554e0 0x7f25e40579a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f25e800d000 tx=0x7f25e8008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:18.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.708+0000 7f25fdffb700 1 -- 172.21.15.57:0/2432622351 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f25f0043b80 con 0x7f26000ad8d0 2021-06-25T04:55:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.872+0000 7f26055b6700 1 -- 172.21.15.57:0/2432622351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2600057310 con 0x7f26000ad8d0 2021-06-25T04:55:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.872+0000 7f25fdffb700 1 -- 172.21.15.57:0/2432622351 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f25f00471a0 con 0x7f26000ad8d0 2021-06-25T04:55:18.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:18.877 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3853681312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3853681312},{"type":"v1","addr":"172.21.15.87:6835","nonce":3853681312}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":46},{"gid":6981,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2200404668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2200404668},{"type":"v1","addr":"172.21.15.57:6833","nonce":2200404668}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45},{"gid":7236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4080135118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4080135118},{"type":"v1","addr":"172.21.15.57:6835","nonce":4080135118}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[]} 2021-06-25T04:55:18.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 -- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25e40554e0 msgr2=0x7f25e40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25e40554e0 0x7f25e40579a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f25e800d000 tx=0x7f25e8008040).stop 2021-06-25T04:55:18.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 -- 172.21.15.57:0/2432622351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26000ad8d0 msgr2=0x7f260013d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:18.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26000ad8d0 0x7f260013d9d0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f25f0002f30 tx=0x7f25f0006d70).stop 2021-06-25T04:55:18.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 -- 172.21.15.57:0/2432622351 shutdown_connections 2021-06-25T04:55:18.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25e40554e0 0x7f25e40579a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26000b52c0 0x7f26001448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26000b1650 0x7f26000667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 --2- 172.21.15.57:0/2432622351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26000ad8d0 0x7f260013d9d0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:18.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 -- 172.21.15.57:0/2432622351 >> 172.21.15.57:0/2432622351 conn(0x7f2600062520 msgr2=0x7f26000b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:18.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 -- 172.21.15.57:0/2432622351 shutdown_connections 2021-06-25T04:55:18.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:18.876+0000 7f26055b6700 1 -- 172.21.15.57:0/2432622351 wait complete. 2021-06-25T04:55:18.884 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 49 2021-06-25T04:55:18.895 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:55:18.895 INFO:tasks.ceph.mds.a:Stopping old one... 2021-06-25T04:55:18.895 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:55:18.896 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:55:18.896 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:55:18.896 INFO:tasks.ceph.mds.c:Stopping old one... 2021-06-25T04:55:18.897 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:55:18.897 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:55:18.897 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:55:18.898 INFO:tasks.ceph.mds.b:Stopping old one... 2021-06-25T04:55:18.898 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:55:18.898 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:55:18.905 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:55:18.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:55:18.908 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:55:18.909 DEBUG:teuthology.parallel:result is None 2021-06-25T04:55:18.910 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:55:18.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:55:18.913 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:55:18.913 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:55:18.959 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:55:18.960 DEBUG:teuthology.parallel:result is None 2021-06-25T04:55:18.961 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:55:18.961 DEBUG:teuthology.parallel:result is None 2021-06-25T04:55:18.962 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:55:18.974 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:55:19.023 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:55:19.040 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:55:19.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 Processor -- start 2021-06-25T04:55:19.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 -- start start 2021-06-25T04:55:19.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa0440b6540 0x7fa0440b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:19.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0440b6920 0x7fa04412b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:19.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa044144070 con 0x7fa0440b4380 2021-06-25T04:55:19.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa044143b30 con 0x7fa0440b6540 2021-06-25T04:55:19.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa044143dd0 con 0x7fa0440b6920 2021-06-25T04:55:19.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa039d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa0440b4380 0x7fa044061cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58682/0 (socket says 172.21.15.57:58682) 2021-06-25T04:55:19.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa039d9b700 1 -- 172.21.15.57:0/2333918320 learned_addr learned my addr 172.21.15.57:0/2333918320 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:19.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa04259c700 1 --2- 172.21.15.57:0/2333918320 >> v2:172.21.15.87:3300/0 conn(0x7fa0440b6540 0x7fa0440b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:19.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa042d9d700 1 --2- 172.21.15.57:0/2333918320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0440b6920 0x7fa04412b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:19.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa041d9b700 1 -- 172.21.15.57:0/2333918320 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892881864 0 0) 0x7fa044144070 con 0x7fa0440b4380 2021-06-25T04:55:19.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa041d9b700 1 -- 172.21.15.57:0/2333918320 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa024003260 con 0x7fa0440b4380 2021-06-25T04:55:19.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa04259c700 1 -- 172.21.15.57:0/2333918320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0440b6920 msgr2=0x7fa04412b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:19.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa04259c700 1 --2- 172.21.15.57:0/2333918320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0440b6920 0x7fa04412b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:19.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa04259c700 1 -- 172.21.15.57:0/2333918320 >> v1:172.21.15.57:6789/0 conn(0x7fa0440b4380 legacy=0x7fa044061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:19.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa04259c700 1 -- 172.21.15.57:0/2333918320 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0440615b0 con 0x7fa0440b6540 2021-06-25T04:55:19.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa04259c700 1 --2- 172.21.15.57:0/2333918320 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0440b6540 0x7fa0440b5bb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fa0441430e0 tx=0x7fa034006df0).ready entity=mon.1 client_cookie=d1bc88cc1a835698 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:19.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa041d9b700 1 -- 172.21.15.57:0/2333918320 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa03400d570 con 0x7fa0440b6540 2021-06-25T04:55:19.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa041d9b700 1 -- 172.21.15.57:0/2333918320 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa034000e90 con 0x7fa0440b6540 2021-06-25T04:55:19.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa041d9b700 1 -- 172.21.15.57:0/2333918320 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa03400d8c0 con 0x7fa0440b6540 2021-06-25T04:55:19.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 -- 172.21.15.57:0/2333918320 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0440b6540 msgr2=0x7fa0440b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:19.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 --2- 172.21.15.57:0/2333918320 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0440b6540 0x7fa0440b5bb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fa0441430e0 tx=0x7fa034006df0).stop 2021-06-25T04:55:19.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 -- 172.21.15.57:0/2333918320 shutdown_connections 2021-06-25T04:55:19.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 --2- 172.21.15.57:0/2333918320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0440b6920 0x7fa04412b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:19.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 --2- 172.21.15.57:0/2333918320 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0440b6540 0x7fa0440b5bb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:19.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 -- 172.21.15.57:0/2333918320 >> 172.21.15.57:0/2333918320 conn(0x7fa04405c450 msgr2=0x7fa04405c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:19.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 -- 172.21.15.57:0/2333918320 shutdown_connections 2021-06-25T04:55:19.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.060+0000 7fa0488c4700 1 -- 172.21.15.57:0/2333918320 wait complete. 2021-06-25T04:55:19.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa0488c4700 1 Processor -- start 2021-06-25T04:55:19.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa0488c4700 1 -- start start 2021-06-25T04:55:19.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa0488c4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0440b4380 0x7fa04412be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:19.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa0488c4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0440b6540 0x7fa0440b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:19.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa0488c4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0440b6920 0x7fa0440afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:19.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa0488c4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0440b0270 con 0x7fa0440b6920 2021-06-25T04:55:19.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa0488c4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa044152180 con 0x7fa0440b4380 2021-06-25T04:55:19.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa0488c4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa044152420 con 0x7fa0440b6540 2021-06-25T04:55:19.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa042d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0440b6920 0x7fa0440afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:19.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa042d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0440b6920 0x7fa0440afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41472/0 (socket says 172.21.15.57:41472) 2021-06-25T04:55:19.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa039d9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0440b6540 0x7fa0440b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:19.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa042d9d700 1 -- 172.21.15.57:0/1822853099 learned_addr learned my addr 172.21.15.57:0/1822853099 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:19.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa04259c700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0440b4380 0x7fa04412be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:19.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa039d9b700 1 -- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0440b4380 msgr2=0x7fa04412be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:19.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa039d9b700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0440b4380 0x7fa04412be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:19.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa039d9b700 1 -- 172.21.15.57:0/1822853099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0440b6920 msgr2=0x7fa0440afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:19.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa039d9b700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0440b6920 0x7fa0440afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:19.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa039d9b700 1 -- 172.21.15.57:0/1822853099 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03400b180 con 0x7fa0440b6540 2021-06-25T04:55:19.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa042d9d700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0440b6920 0x7fa0440afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:19.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa039d9b700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0440b6540 0x7fa0440b3040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fa02c001110 tx=0x7fa02c0079e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:19.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa03bfff700 1 -- 172.21.15.57:0/1822853099 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa02c00cd80 con 0x7fa0440b6540 2021-06-25T04:55:19.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa03bfff700 1 -- 172.21.15.57:0/1822853099 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c0070d0 con 0x7fa0440b6540 2021-06-25T04:55:19.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa0488c4700 1 -- 172.21.15.57:0/1822853099 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0440b0510 con 0x7fa0440b6540 2021-06-25T04:55:19.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.064+0000 7fa03bfff700 1 -- 172.21.15.57:0/1822853099 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa02c007430 con 0x7fa0440b6540 2021-06-25T04:55:19.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.068+0000 7fa0488c4700 1 -- 172.21.15.57:0/1822853099 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa044152a60 con 0x7fa0440b6540 2021-06-25T04:55:19.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.068+0000 7fa0488c4700 1 -- 172.21.15.57:0/1822853099 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0441525e0 con 0x7fa0440b6540 2021-06-25T04:55:19.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.068+0000 7fa03bfff700 1 -- 172.21.15.57:0/1822853099 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa02c010070 con 0x7fa0440b6540 2021-06-25T04:55:19.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.068+0000 7fa03bfff700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa028055490 0x7fa028057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:19.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.068+0000 7fa03bfff700 1 -- 172.21.15.57:0/1822853099 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fa02c06d040 con 0x7fa0440b6540 2021-06-25T04:55:19.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.068+0000 7fa04259c700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa028055490 0x7fa028057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:19.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.068+0000 7fa04259c700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa028055490 0x7fa028057950 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fa034019000 tx=0x7fa034014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:19.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.080+0000 7fa03bfff700 1 -- 172.21.15.57:0/1822853099 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa02c0434d0 con 0x7fa0440b6540 2021-06-25T04:55:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:19.216+0000 7fa0488c4700 1 -- 172.21.15.57:0/1822853099 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fa044057310 con 0x7fa0440b6540 2021-06-25T04:55:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.044+0000 7fa03bfff700 1 -- 172.21.15.57:0/1822853099 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v104) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa02c046af0 con 0x7fa0440b6540 2021-06-25T04:55:20.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 -- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa028055490 msgr2=0x7fa028057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa028055490 0x7fa028057950 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fa034019000 tx=0x7fa034014000).stop 2021-06-25T04:55:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 -- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0440b6540 msgr2=0x7fa0440b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0440b6540 0x7fa0440b3040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fa02c001110 tx=0x7fa02c0079e0).stop 2021-06-25T04:55:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 -- 172.21.15.57:0/1822853099 shutdown_connections 2021-06-25T04:55:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa028055490 0x7fa028057950 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0440b6920 0x7fa0440afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0440b6540 0x7fa0440b3040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 --2- 172.21.15.57:0/1822853099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0440b4380 0x7fa04412be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 -- 172.21.15.57:0/1822853099 >> 172.21.15.57:0/1822853099 conn(0x7fa04405c450 msgr2=0x7fa044128170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:20.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 -- 172.21.15.57:0/1822853099 shutdown_connections 2021-06-25T04:55:20.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.048+0000 7fa0488c4700 1 -- 172.21.15.57:0/1822853099 wait complete. 2021-06-25T04:55:20.059 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:55:20.066 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:55:20.066 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:55:20.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.168+0000 7f8e29b58700 1 Processor -- start 2021-06-25T04:55:20.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.168+0000 7f8e29b58700 1 -- start start 2021-06-25T04:55:20.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.168+0000 7f8e29b58700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e240af920 0x7f8e240b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.168+0000 7f8e29b58700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e240b04b0 0x7f8e240b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.168+0000 7f8e29b58700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e240ad560 con 0x7f8e240b2570 2021-06-25T04:55:20.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.168+0000 7f8e29b58700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e240af420 con 0x7f8e240af920 2021-06-25T04:55:20.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.168+0000 7f8e29b58700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240ad020 con 0x7f8e240b04b0 2021-06-25T04:55:20.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.168+0000 7f8e237fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e240af920 0x7f8e240b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.168+0000 7f8e237fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e240af920 0x7f8e240b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41480/0 (socket says 172.21.15.57:41480) 2021-06-25T04:55:20.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.168+0000 7f8e237fe700 1 -- 172.21.15.57:0/3900879942 learned_addr learned my addr 172.21.15.57:0/3900879942 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:20.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e22ffd700 1 --2- 172.21.15.57:0/3900879942 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e240b04b0 0x7f8e240b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e237fe700 1 -- 172.21.15.57:0/3900879942 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e240b04b0 msgr2=0x7f8e240b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:20.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e237fe700 1 --2- 172.21.15.57:0/3900879942 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e240b04b0 0x7f8e240b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e237fe700 1 -- 172.21.15.57:0/3900879942 >> v1:172.21.15.87:6789/0 conn(0x7f8e240b2570 legacy=0x7f8e2405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e237fe700 1 -- 172.21.15.57:0/3900879942 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240ad2c0 con 0x7f8e240af920 2021-06-25T04:55:20.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e237fe700 1 --2- 172.21.15.57:0/3900879942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240af920 0x7f8e240b1b90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f8e14002f70 tx=0x7f8e14006eb0).ready entity=mon.0 client_cookie=c0523de3ad74a406 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e227fc700 1 -- 172.21.15.57:0/3900879942 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e1400d570 con 0x7f8e240af920 2021-06-25T04:55:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e227fc700 1 -- 172.21.15.57:0/3900879942 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e14000e90 con 0x7f8e240af920 2021-06-25T04:55:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e227fc700 1 -- 172.21.15.57:0/3900879942 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e1400d900 con 0x7f8e240af920 2021-06-25T04:55:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e29b58700 1 -- 172.21.15.57:0/3900879942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240af920 msgr2=0x7f8e240b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e29b58700 1 --2- 172.21.15.57:0/3900879942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240af920 0x7f8e240b1b90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f8e14002f70 tx=0x7f8e14006eb0).stop 2021-06-25T04:55:20.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e29b58700 1 -- 172.21.15.57:0/3900879942 shutdown_connections 2021-06-25T04:55:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e29b58700 1 --2- 172.21.15.57:0/3900879942 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e240b04b0 0x7f8e240b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e29b58700 1 --2- 172.21.15.57:0/3900879942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240af920 0x7f8e240b1b90 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e29b58700 1 -- 172.21.15.57:0/3900879942 >> 172.21.15.57:0/3900879942 conn(0x7f8e2405cce0 msgr2=0x7f8e24062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:20.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e29b58700 1 -- 172.21.15.57:0/3900879942 shutdown_connections 2021-06-25T04:55:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e29b58700 1 -- 172.21.15.57:0/3900879942 wait complete. 2021-06-25T04:55:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.172+0000 7f8e29b58700 1 Processor -- start 2021-06-25T04:55:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e29b58700 1 -- start start 2021-06-25T04:55:20.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e29b58700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e240af920 0x7f8e240b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e29b58700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b04b0 0x7f8e240a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e29b58700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e240b2570 0x7f8e24140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e29b58700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240b49b0 con 0x7f8e240b04b0 2021-06-25T04:55:20.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e29b58700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240a5800 con 0x7f8e240af920 2021-06-25T04:55:20.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e29b58700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240a47a0 con 0x7f8e240b2570 2021-06-25T04:55:20.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e22ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b04b0 0x7f8e240a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e22ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b04b0 0x7f8e240a7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41488/0 (socket says 172.21.15.57:41488) 2021-06-25T04:55:20.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e22ffd700 1 -- 172.21.15.57:0/2474409175 learned_addr learned my addr 172.21.15.57:0/2474409175 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:20.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e237fe700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e240af920 0x7f8e240b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e23fff700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e240b2570 0x7f8e24140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e22ffd700 1 -- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e240b2570 msgr2=0x7f8e24140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e22ffd700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e240b2570 0x7f8e24140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e22ffd700 1 -- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e240af920 msgr2=0x7f8e240b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e22ffd700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e240af920 0x7f8e240b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e22ffd700 1 -- 172.21.15.57:0/2474409175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1400b1e0 con 0x7f8e240b04b0 2021-06-25T04:55:20.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e22ffd700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b04b0 0x7f8e240a7e60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f8e1800c000 tx=0x7f8e18006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:20.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e20ff9700 1 -- 172.21.15.57:0/2474409175 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e18010780 con 0x7f8e240b04b0 2021-06-25T04:55:20.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e20ff9700 1 -- 172.21.15.57:0/2474409175 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e180108e0 con 0x7f8e240b04b0 2021-06-25T04:55:20.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e29b58700 1 -- 172.21.15.57:0/2474409175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e240a4020 con 0x7f8e240b04b0 2021-06-25T04:55:20.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e20ff9700 1 -- 172.21.15.57:0/2474409175 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e18010c40 con 0x7f8e240b04b0 2021-06-25T04:55:20.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e29b58700 1 -- 172.21.15.57:0/2474409175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e240a52c0 con 0x7f8e240b04b0 2021-06-25T04:55:20.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.176+0000 7f8e29b58700 1 -- 172.21.15.57:0/2474409175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e24057310 con 0x7f8e240b04b0 2021-06-25T04:55:20.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.180+0000 7f8e20ff9700 1 -- 172.21.15.57:0/2474409175 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8e1801c460 con 0x7f8e240b04b0 2021-06-25T04:55:20.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.180+0000 7f8e20ff9700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 0x7f8e040579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.180+0000 7f8e20ff9700 1 -- 172.21.15.57:0/2474409175 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f8e1806e060 con 0x7f8e240b04b0 2021-06-25T04:55:20.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.180+0000 7f8e237fe700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 0x7f8e040579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.180+0000 7f8e237fe700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 0x7f8e040579a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f8e1401b000 tx=0x7f8e14015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:20.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.184+0000 7f8e20ff9700 1 -- 172.21.15.57:0/2474409175 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8e180443e0 con 0x7f8e240b04b0 2021-06-25T04:55:20.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.356+0000 7f8e29b58700 1 -- 172.21.15.57:0/2474409175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8e2405d720 con 0x7f8e240b04b0 2021-06-25T04:55:20.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.360+0000 7f8e20ff9700 1 -- 172.21.15.57:0/2474409175 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f8e18047a00 con 0x7f8e240b04b0 2021-06-25T04:55:20.363 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:20.364 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:55:20.364 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:55:20.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.364 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:55:20.365 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:55:20.365 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.365 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:55:20.365 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.366 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.366 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.367 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:55:20.367 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:55:20.367 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.368 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:55:20.368 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.368 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.368 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.369 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.369 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:55:20.369 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:55:20.370 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.370 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:55:20.370 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.370 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.371 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.372 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:55:20.372 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:55:20.372 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.372 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.372 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.373 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.373 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.373 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:55:20.374 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:55:20.374 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.374 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.374 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.375 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.375 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.376 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:55:20.376 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:55:20.376 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.376 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.377 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.377 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.377 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.378 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:55:20.378 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:55:20.378 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.378 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.379 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.379 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.379 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.380 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:55:20.380 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:55:20.380 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.380 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.380 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.381 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.381 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.382 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:55:20.382 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:55:20.382 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.382 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.382 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.383 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.384 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:55:20.384 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:55:20.384 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.384 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.384 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.385 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.385 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.386 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:55:20.386 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:55:20.386 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.386 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.386 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.387 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.387 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.388 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:55:20.388 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:55:20.388 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.388 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:55:20.388 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:55:20.389 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:55:20.389 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.389 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:55:20.390 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:55:20.390 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.390 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:55:20.390 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:55:20.391 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:55:20.391 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.391 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:55:20.392 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:55:20.392 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.392 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:55:20.392 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:20.393 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:20.393 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.394 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:55:20.394 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:55:20.394 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.394 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:55:20.395 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:55:20.395 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:20.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:20.396 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:55:20.396 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:55:20.396 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:20.396 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:55:20.397 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:55:20.397 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:20.397 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.397 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:20.397 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:20.398 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:55:20.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 -- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 msgr2=0x7f8e040579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 0x7f8e040579a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f8e1401b000 tx=0x7f8e14015000).stop 2021-06-25T04:55:20.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 -- 172.21.15.57:0/2474409175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b04b0 msgr2=0x7f8e240a7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b04b0 0x7f8e240a7e60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f8e1800c000 tx=0x7f8e18006df0).stop 2021-06-25T04:55:20.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 -- 172.21.15.57:0/2474409175 shutdown_connections 2021-06-25T04:55:20.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e040554e0 0x7f8e040579a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e240b2570 0x7f8e24140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b04b0 0x7f8e240a7e60 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 --2- 172.21.15.57:0/2474409175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e240af920 0x7f8e240b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 -- 172.21.15.57:0/2474409175 >> 172.21.15.57:0/2474409175 conn(0x7f8e2405cce0 msgr2=0x7f8e240b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:20.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 -- 172.21.15.57:0/2474409175 shutdown_connections 2021-06-25T04:55:20.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.364+0000 7f8e29b58700 1 -- 172.21.15.57:0/2474409175 wait complete. 2021-06-25T04:55:20.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:20.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d20135700 1 Processor -- start 2021-06-25T04:55:20.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d20135700 1 -- start start 2021-06-25T04:55:20.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d20135700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1d1814a5b0 0x7f1d1814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d20135700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1814b970 con 0x7f1d18066d40 2021-06-25T04:55:20.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d20135700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d180aabe0 con 0x7f1d18067120 2021-06-25T04:55:20.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d20135700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d180b4ed0 con 0x7f1d1814a5b0 2021-06-25T04:55:20.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1ded1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1d18066d40 0x7f1d18149ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58712/0 (socket says 172.21.15.57:58712) 2021-06-25T04:55:20.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1ded1700 1 -- 172.21.15.57:0/980278010 learned_addr learned my addr 172.21.15.57:0/980278010 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:20.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1d6d0700 1 --2- 172.21.15.57:0/980278010 >> v2:172.21.15.87:3300/0 conn(0x7f1d1814a5b0 0x7f1d1814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155799494 0 0) 0x7f1d1814b970 con 0x7f1d18066d40 2021-06-25T04:55:20.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d04003260 con 0x7f1d18066d40 2021-06-25T04:55:20.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195927326 0 0) 0x7f1d180aabe0 con 0x7f1d18067120 2021-06-25T04:55:20.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d1814b970 con 0x7f1d18067120 2021-06-25T04:55:20.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 940886555 0 0) 0x7f1d04003260 con 0x7f1d18066d40 2021-06-25T04:55:20.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 >> v2:172.21.15.87:3300/0 conn(0x7f1d1814a5b0 msgr2=0x7f1d1814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:20.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 --2- 172.21.15.57:0/980278010 >> v2:172.21.15.87:3300/0 conn(0x7f1d1814a5b0 0x7f1d1814b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 >> v1:172.21.15.87:6789/0 conn(0x7f1d18067120 legacy=0x7f1d18147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d180aae80 con 0x7f1d18066d40 2021-06-25T04:55:20.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f1d080019e0 con 0x7f1d18066d40 2021-06-25T04:55:20.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 >> v1:172.21.15.57:6789/0 conn(0x7f1d18066d40 legacy=0x7f1d18149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d04003910 0x7f1d04003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d04004500 0x7f1d04004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d04004e70 0x7f1d0400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0400bcf0 con 0x7f1d04003910 2021-06-25T04:55:20.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0400be60 con 0x7f1d04004e70 2021-06-25T04:55:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0400c020 con 0x7f1d04004500 2021-06-25T04:55:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1ded1700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d04003910 0x7f1d04003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1e6d2700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d04004e70 0x7f1d0400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1d6d0700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d04004500 0x7f1d04004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1ded1700 1 -- 172.21.15.57:0/980278010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d04004500 msgr2=0x7f1d04004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:20.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1ded1700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d04004500 0x7f1d04004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1ded1700 1 -- 172.21.15.57:0/980278010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d04004e70 msgr2=0x7f1d0400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:20.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1ded1700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d04004e70 0x7f1d0400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1ded1700 1 -- 172.21.15.57:0/980278010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04003260 con 0x7f1d04003910 2021-06-25T04:55:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1e6d2700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d04004e70 0x7f1d0400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1e6d2700 1 -- 172.21.15.57:0/980278010 reap_dead start 2021-06-25T04:55:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1ded1700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d04003910 0x7f1d04003d10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f1d080017b0 tx=0x7f1d180654d0).ready entity=mon.0 client_cookie=9743c34d6689839b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.508+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d0800cca0 con 0x7f1d04003910 2021-06-25T04:55:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.512+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0800ce00 con 0x7f1d04003910 2021-06-25T04:55:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.512+0000 7f1d1cecf700 1 -- 172.21.15.57:0/980278010 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d08005b80 con 0x7f1d04003910 2021-06-25T04:55:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.512+0000 7f1d20135700 1 -- 172.21.15.57:0/980278010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d04003910 msgr2=0x7f1d04003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.512+0000 7f1d20135700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d04003910 0x7f1d04003d10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f1d080017b0 tx=0x7f1d180654d0).stop 2021-06-25T04:55:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.512+0000 7f1d20135700 1 -- 172.21.15.57:0/980278010 shutdown_connections 2021-06-25T04:55:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.512+0000 7f1d20135700 1 --2- 172.21.15.57:0/980278010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d04003910 0x7f1d04003d10 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.512+0000 7f1d20135700 1 -- 172.21.15.57:0/980278010 >> 172.21.15.57:0/980278010 conn(0x7f1d1805c450 msgr2=0x7f1d1805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.512+0000 7f1d20135700 1 -- 172.21.15.57:0/980278010 shutdown_connections 2021-06-25T04:55:20.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.512+0000 7f1d20135700 1 -- 172.21.15.57:0/980278010 wait complete. 2021-06-25T04:55:20.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.512+0000 7f1d20135700 1 Processor -- start 2021-06-25T04:55:20.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d20135700 1 -- start start 2021-06-25T04:55:20.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d20135700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d04003910 0x7f1d180b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d20135700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d180b1390 0x7f1d18140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d20135700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d181413b0 0x7f1d180ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d20135700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180aca80 con 0x7f1d180b1390 2021-06-25T04:55:20.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d20135700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180ac1e0 con 0x7f1d04003910 2021-06-25T04:55:20.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d20135700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180ab8b0 con 0x7f1d181413b0 2021-06-25T04:55:20.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d1d6d0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d180b1390 0x7f1d18140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d1d6d0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d180b1390 0x7f1d18140ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41508/0 (socket says 172.21.15.57:41508) 2021-06-25T04:55:20.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d1d6d0700 1 -- 172.21.15.57:0/2165268025 learned_addr learned my addr 172.21.15.57:0/2165268025 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:20.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d1e6d2700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d181413b0 0x7f1d180ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d1ded1700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d04003910 0x7f1d180b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d1d6d0700 1 -- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d181413b0 msgr2=0x7f1d180ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d1d6d0700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d181413b0 0x7f1d180ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d1d6d0700 1 -- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d04003910 msgr2=0x7f1d180b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d1d6d0700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d04003910 0x7f1d180b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d1d6d0700 1 -- 172.21.15.57:0/2165268025 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d180accb0 con 0x7f1d180b1390 2021-06-25T04:55:20.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d1d6d0700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d180b1390 0x7f1d18140ec0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f1d0c00b000 tx=0x7f1d0c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:20.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d16ffd700 1 -- 172.21.15.57:0/2165268025 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d0c014680 con 0x7f1d180b1390 2021-06-25T04:55:20.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d16ffd700 1 -- 172.21.15.57:0/2165268025 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c0147e0 con 0x7f1d180b1390 2021-06-25T04:55:20.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d20135700 1 -- 172.21.15.57:0/2165268025 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d180ae6f0 con 0x7f1d180b1390 2021-06-25T04:55:20.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d16ffd700 1 -- 172.21.15.57:0/2165268025 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d0c014b40 con 0x7f1d180b1390 2021-06-25T04:55:20.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.516+0000 7f1d20135700 1 -- 172.21.15.57:0/2165268025 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d180ac750 con 0x7f1d180b1390 2021-06-25T04:55:20.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.520+0000 7f1d16ffd700 1 -- 172.21.15.57:0/2165268025 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1d0c024070 con 0x7f1d180b1390 2021-06-25T04:55:20.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.520+0000 7f1d20135700 1 -- 172.21.15.57:0/2165268025 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d180ac350 con 0x7f1d180b1390 2021-06-25T04:55:20.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.520+0000 7f1d16ffd700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cf8055450 0x7f1cf8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.520+0000 7f1d16ffd700 1 -- 172.21.15.57:0/2165268025 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f1d0c06e570 con 0x7f1d180b1390 2021-06-25T04:55:20.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.520+0000 7f1d1ded1700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cf8055450 0x7f1cf8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.520+0000 7f1d1ded1700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cf8055450 0x7f1cf8057910 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f1d08014000 tx=0x7f1d08013000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:20.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.528+0000 7f1d16ffd700 1 -- 172.21.15.57:0/2165268025 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1d180ac350 con 0x7f1d180b1390 2021-06-25T04:55:20.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.660+0000 7f1d20135700 1 -- 172.21.15.57:0/2165268025 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d180ac350 con 0x7f1d180b1390 2021-06-25T04:55:20.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.660+0000 7f1d16ffd700 1 -- 172.21.15.57:0/2165268025 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+13416 (secure 0 0 0) 0x7f1d180ac350 con 0x7f1d180b1390 2021-06-25T04:55:20.665 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:20.665 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":104,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:20.035633+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:20.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 -- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cf8055450 msgr2=0x7f1cf8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cf8055450 0x7f1cf8057910 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f1d08014000 tx=0x7f1d08013000).stop 2021-06-25T04:55:20.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 -- 172.21.15.57:0/2165268025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d180b1390 msgr2=0x7f1d18140ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d180b1390 0x7f1d18140ec0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f1d0c00b000 tx=0x7f1d0c008040).stop 2021-06-25T04:55:20.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 -- 172.21.15.57:0/2165268025 shutdown_connections 2021-06-25T04:55:20.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cf8055450 0x7f1cf8057910 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d181413b0 0x7f1d180ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d180b1390 0x7f1d18140ec0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 --2- 172.21.15.57:0/2165268025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d04003910 0x7f1d180b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 -- 172.21.15.57:0/2165268025 >> 172.21.15.57:0/2165268025 conn(0x7f1d1805c450 msgr2=0x7f1d1805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:20.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 -- 172.21.15.57:0/2165268025 shutdown_connections 2021-06-25T04:55:20.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.664+0000 7f1d20135700 1 -- 172.21.15.57:0/2165268025 wait complete. 2021-06-25T04:55:20.682 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:55:20.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:55:20.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.788+0000 7f187280b700 1 Processor -- start 2021-06-25T04:55:20.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.788+0000 7f187280b700 1 -- start start 2021-06-25T04:55:20.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.788+0000 7f187280b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f186c05c790 0x7f186c0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.788+0000 7f187280b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f186c13f350 0x7f186c0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.788+0000 7f187280b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c05cb70 con 0x7f186c05d070 2021-06-25T04:55:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.788+0000 7f187280b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c0ad500 con 0x7f186c05c790 2021-06-25T04:55:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.788+0000 7f187280b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c067d30 con 0x7f186c13f350 2021-06-25T04:55:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.788+0000 7f1871008700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f186c05d070 0x7f186c0acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58734/0 (socket says 172.21.15.57:58734) 2021-06-25T04:55:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.788+0000 7f1871809700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f186c05c790 0x7f186c0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.788+0000 7f1871008700 1 -- 172.21.15.57:0/2619115731 learned_addr learned my addr 172.21.15.57:0/2619115731 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.788+0000 7f187200a700 1 --2- 172.21.15.57:0/2619115731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f186c13f350 0x7f186c0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f1870807700 1 -- 172.21.15.57:0/2619115731 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290097508 0 0) 0x7f186c05cb70 con 0x7f186c05d070 2021-06-25T04:55:20.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f1870807700 1 -- 172.21.15.57:0/2619115731 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1854003260 con 0x7f186c05d070 2021-06-25T04:55:20.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187200a700 1 -- 172.21.15.57:0/2619115731 >> v2:172.21.15.57:3300/0 conn(0x7f186c05c790 msgr2=0x7f186c0b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:20.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187200a700 1 --2- 172.21.15.57:0/2619115731 >> v2:172.21.15.57:3300/0 conn(0x7f186c05c790 0x7f186c0b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187200a700 1 -- 172.21.15.57:0/2619115731 >> v1:172.21.15.57:6789/0 conn(0x7f186c05d070 legacy=0x7f186c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187200a700 1 -- 172.21.15.57:0/2619115731 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c0b1750 con 0x7f186c13f350 2021-06-25T04:55:20.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187200a700 1 --2- 172.21.15.57:0/2619115731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f186c13f350 0x7f186c0aeca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f18640032f0 tx=0x7f18640091d0).ready entity=mon.2 client_cookie=8e1e9664bbcf43df server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:20.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f1870807700 1 -- 172.21.15.57:0/2619115731 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f186400b600 con 0x7f186c13f350 2021-06-25T04:55:20.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f1870807700 1 -- 172.21.15.57:0/2619115731 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400b760 con 0x7f186c13f350 2021-06-25T04:55:20.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f1870807700 1 -- 172.21.15.57:0/2619115731 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f186400b8d0 con 0x7f186c13f350 2021-06-25T04:55:20.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187280b700 1 -- 172.21.15.57:0/2619115731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f186c13f350 msgr2=0x7f186c0aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187280b700 1 --2- 172.21.15.57:0/2619115731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f186c13f350 0x7f186c0aeca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f18640032f0 tx=0x7f18640091d0).stop 2021-06-25T04:55:20.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187280b700 1 -- 172.21.15.57:0/2619115731 shutdown_connections 2021-06-25T04:55:20.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187280b700 1 --2- 172.21.15.57:0/2619115731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f186c13f350 0x7f186c0aeca0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187280b700 1 --2- 172.21.15.57:0/2619115731 >> v2:172.21.15.57:3300/0 conn(0x7f186c05c790 0x7f186c0b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187280b700 1 -- 172.21.15.57:0/2619115731 >> 172.21.15.57:0/2619115731 conn(0x7f186c060140 msgr2=0x7f186c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:20.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187280b700 1 -- 172.21.15.57:0/2619115731 shutdown_connections 2021-06-25T04:55:20.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.792+0000 7f187280b700 1 -- 172.21.15.57:0/2619115731 wait complete. 2021-06-25T04:55:20.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187280b700 1 Processor -- start 2021-06-25T04:55:20.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187280b700 1 -- start start 2021-06-25T04:55:20.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187280b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f186c05c790 0x7f186c13bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187280b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f186c05d070 0x7f186c143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187280b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f186c13f350 0x7f186c152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187280b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c141df0 con 0x7f186c13f350 2021-06-25T04:55:20.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187280b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c1428d0 con 0x7f186c05d070 2021-06-25T04:55:20.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187280b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c142b70 con 0x7f186c05c790 2021-06-25T04:55:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187200a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f186c13f350 0x7f186c152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187200a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f186c13f350 0x7f186c152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41524/0 (socket says 172.21.15.57:41524) 2021-06-25T04:55:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187200a700 1 -- 172.21.15.57:0/975505492 learned_addr learned my addr 172.21.15.57:0/975505492 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f1871809700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f186c05c790 0x7f186c13bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f1871008700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f186c05d070 0x7f186c143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187200a700 1 -- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f186c05c790 msgr2=0x7f186c13bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187200a700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f186c05c790 0x7f186c13bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187200a700 1 -- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f186c05d070 msgr2=0x7f186c143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187200a700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f186c05d070 0x7f186c143010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187200a700 1 -- 172.21.15.57:0/975505492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864009470 con 0x7f186c13f350 2021-06-25T04:55:20.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187200a700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f186c13f350 0x7f186c152090 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f18640032f0 tx=0x7f1864016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:20.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f185effd700 1 -- 172.21.15.57:0/975505492 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1864006ea0 con 0x7f186c13f350 2021-06-25T04:55:20.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f185effd700 1 -- 172.21.15.57:0/975505492 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1864011d30 con 0x7f186c13f350 2021-06-25T04:55:20.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187280b700 1 -- 172.21.15.57:0/975505492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c0ab210 con 0x7f186c13f350 2021-06-25T04:55:20.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f185effd700 1 -- 172.21.15.57:0/975505492 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1864011ea0 con 0x7f186c13f350 2021-06-25T04:55:20.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.796+0000 7f187280b700 1 -- 172.21.15.57:0/975505492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c0a0830 con 0x7f186c13f350 2021-06-25T04:55:20.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.800+0000 7f187280b700 1 -- 172.21.15.57:0/975505492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c142d30 con 0x7f186c13f350 2021-06-25T04:55:20.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.800+0000 7f185effd700 1 -- 172.21.15.57:0/975505492 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f186400f070 con 0x7f186c13f350 2021-06-25T04:55:20.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.800+0000 7f185effd700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f184c0553d0 0x7f184c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:20.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.800+0000 7f185effd700 1 -- 172.21.15.57:0/975505492 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f186406ee70 con 0x7f186c13f350 2021-06-25T04:55:20.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.800+0000 7f1871809700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f184c0553d0 0x7f184c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:20.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.800+0000 7f1871809700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f184c0553d0 0x7f184c057890 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f1860008000 tx=0x7f1860008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:20.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.808+0000 7f185effd700 1 -- 172.21.15.57:0/975505492 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1864045360 con 0x7f186c13f350 2021-06-25T04:55:20.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.932+0000 7f187280b700 1 -- 172.21.15.57:0/975505492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f186c057310 con 0x7f186c13f350 2021-06-25T04:55:20.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.932+0000 7f185effd700 1 -- 172.21.15.57:0/975505492 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v104) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1864048980 con 0x7f186c13f350 2021-06-25T04:55:20.938 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:55:20.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 -- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f184c0553d0 msgr2=0x7f184c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f184c0553d0 0x7f184c057890 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f1860008000 tx=0x7f1860008040).stop 2021-06-25T04:55:20.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 -- 172.21.15.57:0/975505492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f186c13f350 msgr2=0x7f186c152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:20.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f186c13f350 0x7f186c152090 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f18640032f0 tx=0x7f1864016000).stop 2021-06-25T04:55:20.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 -- 172.21.15.57:0/975505492 shutdown_connections 2021-06-25T04:55:20.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f184c0553d0 0x7f184c057890 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f186c13f350 0x7f186c152090 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f186c05d070 0x7f186c143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 --2- 172.21.15.57:0/975505492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f186c05c790 0x7f186c13bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:20.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 -- 172.21.15.57:0/975505492 >> 172.21.15.57:0/975505492 conn(0x7f186c060140 msgr2=0x7f186c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:20.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 -- 172.21.15.57:0/975505492 shutdown_connections 2021-06-25T04:55:20.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:20.936+0000 7f187280b700 1 -- 172.21.15.57:0/975505492 wait complete. 2021-06-25T04:55:20.956 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:55:21.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.056+0000 7f10e176b700 1 Processor -- start 2021-06-25T04:55:21.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.056+0000 7f10e176b700 1 -- start start 2021-06-25T04:55:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.056+0000 7f10e176b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10dc0b26e0 0x7f10dc13dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.056+0000 7f10e176b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f10dc0b0fb0 0x7f10dc13e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.056+0000 7f10e176b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc0aaa50 con 0x7f10dc141040 2021-06-25T04:55:21.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.056+0000 7f10e176b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc141be0 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.056+0000 7f10e176b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc140c50 con 0x7f10dc0b26e0 2021-06-25T04:55:21.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10db7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f10dc0b0fb0 0x7f10dc13e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10dbfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10dc0b26e0 0x7f10dc13dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10db7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f10dc0b0fb0 0x7f10dc13e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:50024/0 (socket says 172.21.15.57:50024) 2021-06-25T04:55:21.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10db7fe700 1 -- 172.21.15.57:0/1632129827 learned_addr learned my addr 172.21.15.57:0/1632129827 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:21.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10e0f6a700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f10dc141040 0x7f10dc1414d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:59496/0 (socket says 172.21.15.57:59496) 2021-06-25T04:55:21.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10dbfff700 1 -- 172.21.15.57:0/1632129827 >> v2:172.21.15.87:3300/0 conn(0x7f10dc0b0fb0 msgr2=0x7f10dc13e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:21.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10dbfff700 1 --2- 172.21.15.57:0/1632129827 >> v2:172.21.15.87:3300/0 conn(0x7f10dc0b0fb0 0x7f10dc13e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10dbfff700 1 -- 172.21.15.57:0/1632129827 >> v1:172.21.15.87:6789/0 conn(0x7f10dc141040 legacy=0x7f10dc1414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10dbfff700 1 -- 172.21.15.57:0/1632129827 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0b2ac0 con 0x7f10dc0b26e0 2021-06-25T04:55:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10dbfff700 1 --2- 172.21.15.57:0/1632129827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10dc0b26e0 0x7f10dc13dff0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f10d0002f70 tx=0x7f10d0006df0).ready entity=mon.2 client_cookie=edb7c69641c1ef55 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10daffd700 1 -- 172.21.15.57:0/1632129827 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d000d570 con 0x7f10dc0b26e0 2021-06-25T04:55:21.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10daffd700 1 -- 172.21.15.57:0/1632129827 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0000e90 con 0x7f10dc0b26e0 2021-06-25T04:55:21.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10daffd700 1 -- 172.21.15.57:0/1632129827 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d000d8c0 con 0x7f10dc0b26e0 2021-06-25T04:55:21.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10e176b700 1 -- 172.21.15.57:0/1632129827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10dc0b26e0 msgr2=0x7f10dc13dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10e176b700 1 --2- 172.21.15.57:0/1632129827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10dc0b26e0 0x7f10dc13dff0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f10d0002f70 tx=0x7f10d0006df0).stop 2021-06-25T04:55:21.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10e176b700 1 -- 172.21.15.57:0/1632129827 shutdown_connections 2021-06-25T04:55:21.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10e176b700 1 --2- 172.21.15.57:0/1632129827 >> v2:172.21.15.87:3300/0 conn(0x7f10dc0b0fb0 0x7f10dc13e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10e176b700 1 --2- 172.21.15.57:0/1632129827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10dc0b26e0 0x7f10dc13dff0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10e176b700 1 -- 172.21.15.57:0/1632129827 >> 172.21.15.57:0/1632129827 conn(0x7f10dc060140 msgr2=0x7f10dc0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:21.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10e176b700 1 -- 172.21.15.57:0/1632129827 shutdown_connections 2021-06-25T04:55:21.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.060+0000 7f10e176b700 1 -- 172.21.15.57:0/1632129827 wait complete. 2021-06-25T04:55:21.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10e176b700 1 Processor -- start 2021-06-25T04:55:21.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10e176b700 1 -- start start 2021-06-25T04:55:21.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10e176b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10dc0b0fb0 0x7f10dc0b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10e176b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10dc0b26e0 0x7f10dc137370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10e176b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10dc141040 0x7f10dc137860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10e176b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0b36e0 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10e176b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0adc60 con 0x7f10dc141040 2021-06-25T04:55:21.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10e176b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0ade90 con 0x7f10dc0b26e0 2021-06-25T04:55:21.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10dbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10dc0b0fb0 0x7f10dc0b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10dbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10dc0b0fb0 0x7f10dc0b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41538/0 (socket says 172.21.15.57:41538) 2021-06-25T04:55:21.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10e0f6a700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10dc141040 0x7f10dc137860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10dbfff700 1 -- 172.21.15.57:0/80064897 learned_addr learned my addr 172.21.15.57:0/80064897 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:21.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10db7fe700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10dc0b26e0 0x7f10dc137370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10dbfff700 1 -- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10dc0b26e0 msgr2=0x7f10dc137370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10dbfff700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10dc0b26e0 0x7f10dc137370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10dbfff700 1 -- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10dc141040 msgr2=0x7f10dc137860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10dbfff700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10dc141040 0x7f10dc137860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10dbfff700 1 -- 172.21.15.57:0/80064897 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d000b180 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10dbfff700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10dc0b0fb0 0x7f10dc0b3130 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f10dc155590 tx=0x7f10d0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10d97fa700 1 -- 172.21.15.57:0/80064897 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d00129b0 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10d97fa700 1 -- 172.21.15.57:0/80064897 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0000e90 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10e176b700 1 -- 172.21.15.57:0/80064897 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc0ae130 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10d97fa700 1 -- 172.21.15.57:0/80064897 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d0012d00 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.064+0000 7f10e176b700 1 -- 172.21.15.57:0/80064897 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc137d50 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.068+0000 7f10e176b700 1 -- 172.21.15.57:0/80064897 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc0b4ee0 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.068+0000 7f10d97fa700 1 -- 172.21.15.57:0/80064897 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f10d0024020 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.068+0000 7f10d97fa700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10bc055360 0x7f10bc057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.068+0000 7f10d97fa700 1 -- 172.21.15.57:0/80064897 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f10d006e820 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.068+0000 7f10db7fe700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10bc055360 0x7f10bc057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.068+0000 7f10db7fe700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10bc055360 0x7f10bc057820 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f10cc00b000 tx=0x7f10cc009290).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.076+0000 7f10d97fa700 1 -- 172.21.15.57:0/80064897 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f10dc0b4ee0 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 -- 172.21.15.57:0/80064897 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f10dc0b4ee0 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10d97fa700 1 -- 172.21.15.57:0/80064897 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v104) v1 ==== 92+0+10 (secure 0 0 0) 0x7f10dc0b4ee0 con 0x7f10dc0b0fb0 2021-06-25T04:55:21.207 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:21.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 -- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10bc055360 msgr2=0x7f10bc057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10bc055360 0x7f10bc057820 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f10cc00b000 tx=0x7f10cc009290).stop 2021-06-25T04:55:21.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 -- 172.21.15.57:0/80064897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10dc0b0fb0 msgr2=0x7f10dc0b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10dc0b0fb0 0x7f10dc0b3130 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f10dc155590 tx=0x7f10d0014000).stop 2021-06-25T04:55:21.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 -- 172.21.15.57:0/80064897 shutdown_connections 2021-06-25T04:55:21.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f10bc055360 0x7f10bc057820 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10dc141040 0x7f10dc137860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10dc0b26e0 0x7f10dc137370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 --2- 172.21.15.57:0/80064897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10dc0b0fb0 0x7f10dc0b3130 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 -- 172.21.15.57:0/80064897 >> 172.21.15.57:0/80064897 conn(0x7f10dc060140 msgr2=0x7f10dc0aabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:21.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 -- 172.21.15.57:0/80064897 shutdown_connections 2021-06-25T04:55:21.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.204+0000 7f10e176b700 1 -- 172.21.15.57:0/80064897 wait complete. 2021-06-25T04:55:21.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:55:21.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.316+0000 7f46856da700 1 Processor -- start 2021-06-25T04:55:21.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.316+0000 7f46856da700 1 -- start start 2021-06-25T04:55:21.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f46856da700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4680061640 0x7f46800b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f46856da700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46800b68d0 con 0x7f4680143960 2021-06-25T04:55:21.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f46856da700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46800b6b70 con 0x7f46800b46d0 2021-06-25T04:55:21.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f46856da700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46800b9640 con 0x7f4680061640 2021-06-25T04:55:21.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f4684ed9700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4680143960 0x7f468014d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58764/0 (socket says 172.21.15.57:58764) 2021-06-25T04:55:21.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f4684ed9700 1 -- 172.21.15.57:0/3695808123 learned_addr learned my addr 172.21.15.57:0/3695808123 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:21.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467ffff700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4680061640 0x7f46800b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315363406 0 0) 0x7f46800b68d0 con 0x7f4680143960 2021-06-25T04:55:21.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466c003260 con 0x7f4680143960 2021-06-25T04:55:21.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291761389 0 0) 0x7f46800b6b70 con 0x7f46800b46d0 2021-06-25T04:55:21.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46800b68d0 con 0x7f46800b46d0 2021-06-25T04:55:21.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2548961746 0 0) 0x7f466c003260 con 0x7f4680143960 2021-06-25T04:55:21.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4680061640 msgr2=0x7f46800b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:21.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4680061640 0x7f46800b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 >> v1:172.21.15.87:6789/0 conn(0x7f46800b46d0 legacy=0x7f468013fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46800b6e10 con 0x7f4680143960 2021-06-25T04:55:21.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f46780019e0 con 0x7f4680143960 2021-06-25T04:55:21.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 >> v1:172.21.15.57:6789/0 conn(0x7f4680143960 legacy=0x7f468014d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f466c003910 0x7f466c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f466c004500 0x7f466c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f466c004e70 0x7f466c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c00bc40 con 0x7f466c004e70 2021-06-25T04:55:21.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c00bd80 con 0x7f466c004500 2021-06-25T04:55:21.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c00bf40 con 0x7f466c003910 2021-06-25T04:55:21.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f4684ed9700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f466c004e70 0x7f466c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467ffff700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f466c003910 0x7f466c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467f7fe700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f466c004500 0x7f466c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467ffff700 1 -- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f466c004500 msgr2=0x7f466c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:21.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467ffff700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f466c004500 0x7f466c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467ffff700 1 -- 172.21.15.57:0/3695808123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f466c004e70 msgr2=0x7f466c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:21.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467ffff700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f466c004e70 0x7f466c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467ffff700 1 -- 172.21.15.57:0/3695808123 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c003260 con 0x7f466c003910 2021-06-25T04:55:21.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f4684ed9700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f466c004e70 0x7f466c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:21.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467ffff700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f466c003910 0x7f466c003d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f466c0054d0 tx=0x7f4674006df0).ready entity=mon.2 client_cookie=fb3b2ca566f76c2d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:21.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4674013450 con 0x7f466c003910 2021-06-25T04:55:21.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46740135b0 con 0x7f466c003910 2021-06-25T04:55:21.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f467effd700 1 -- 172.21.15.57:0/3695808123 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4674013910 con 0x7f466c003910 2021-06-25T04:55:21.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f46856da700 1 -- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f466c003910 msgr2=0x7f466c003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f46856da700 1 --2- 172.21.15.57:0/3695808123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f466c003910 0x7f466c003d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f466c0054d0 tx=0x7f4674006df0).stop 2021-06-25T04:55:21.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f4684ed9700 1 -- 172.21.15.57:0/3695808123 reap_dead start 2021-06-25T04:55:21.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f46856da700 1 -- 172.21.15.57:0/3695808123 shutdown_connections 2021-06-25T04:55:21.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f46856da700 1 -- 172.21.15.57:0/3695808123 >> 172.21.15.57:0/3695808123 conn(0x7f468006adb0 msgr2=0x7f468005f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:21.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.320+0000 7f46856da700 1 -- 172.21.15.57:0/3695808123 shutdown_connections 2021-06-25T04:55:21.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f46856da700 1 -- 172.21.15.57:0/3695808123 wait complete. 2021-06-25T04:55:21.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f46856da700 1 Processor -- start 2021-06-25T04:55:21.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f46856da700 1 -- start start 2021-06-25T04:55:21.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f46856da700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46800ae610 0x7f4680146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f46856da700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4680144b10 0x7f468013e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f46856da700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468013e920 0x7f4680155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f46856da700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468013f360 con 0x7f4680144b10 2021-06-25T04:55:21.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f46856da700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46800ae9f0 con 0x7f46800ae610 2021-06-25T04:55:21.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f46856da700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468013f0c0 con 0x7f468013e920 2021-06-25T04:55:21.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f467f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4680144b10 0x7f468013e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f467f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4680144b10 0x7f468013e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41556/0 (socket says 172.21.15.57:41556) 2021-06-25T04:55:21.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f467f7fe700 1 -- 172.21.15.57:0/2708403671 learned_addr learned my addr 172.21.15.57:0/2708403671 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:21.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f467ffff700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46800ae610 0x7f4680146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f4684ed9700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468013e920 0x7f4680155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f467f7fe700 1 -- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468013e920 msgr2=0x7f4680155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f467f7fe700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468013e920 0x7f4680155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f467f7fe700 1 -- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46800ae610 msgr2=0x7f4680146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f467f7fe700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46800ae610 0x7f4680146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f467f7fe700 1 -- 172.21.15.57:0/2708403671 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46800aef10 con 0x7f4680144b10 2021-06-25T04:55:21.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.324+0000 7f467f7fe700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4680144b10 0x7f468013e430 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f467000d000 tx=0x7f4670009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:21.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.328+0000 7f467d7fa700 1 -- 172.21.15.57:0/2708403671 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46700116b0 con 0x7f4680144b10 2021-06-25T04:55:21.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.328+0000 7f467d7fa700 1 -- 172.21.15.57:0/2708403671 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4670011810 con 0x7f4680144b10 2021-06-25T04:55:21.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.328+0000 7f46856da700 1 -- 172.21.15.57:0/2708403671 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4680147220 con 0x7f4680144b10 2021-06-25T04:55:21.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.328+0000 7f467d7fa700 1 -- 172.21.15.57:0/2708403671 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4670011b70 con 0x7f4680144b10 2021-06-25T04:55:21.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.328+0000 7f46856da700 1 -- 172.21.15.57:0/2708403671 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46800ad660 con 0x7f4680144b10 2021-06-25T04:55:21.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.328+0000 7f46856da700 1 -- 172.21.15.57:0/2708403671 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46800af110 con 0x7f4680144b10 2021-06-25T04:55:21.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.328+0000 7f467d7fa700 1 -- 172.21.15.57:0/2708403671 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f467001a030 con 0x7f4680144b10 2021-06-25T04:55:21.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.328+0000 7f467d7fa700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46600553f0 0x7f46600578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.328+0000 7f467d7fa700 1 -- 172.21.15.57:0/2708403671 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f467006d750 con 0x7f4680144b10 2021-06-25T04:55:21.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.328+0000 7f467ffff700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46600553f0 0x7f46600578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.332+0000 7f467ffff700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46600553f0 0x7f46600578b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f467401c000 tx=0x7f4674018000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:21.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.336+0000 7f467d7fa700 1 -- 172.21.15.57:0/2708403671 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4670043b30 con 0x7f4680144b10 2021-06-25T04:55:21.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.468+0000 7f46856da700 1 -- 172.21.15.57:0/2708403671 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4680057310 con 0x7f4680144b10 2021-06-25T04:55:21.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.468+0000 7f467d7fa700 1 -- 172.21.15.57:0/2708403671 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v104) v1 ==== 84+0+143 (secure 0 0 0) 0x7f4670047150 con 0x7f4680144b10 2021-06-25T04:55:21.473 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:21.473 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:55:21.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:21.473 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:55:21.474 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:55:21.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:21.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:21.474 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:55:21.475 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:55:21.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:21.475 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:55:21.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 -- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46600553f0 msgr2=0x7f46600578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46600553f0 0x7f46600578b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f467401c000 tx=0x7f4674018000).stop 2021-06-25T04:55:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 -- 172.21.15.57:0/2708403671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4680144b10 msgr2=0x7f468013e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4680144b10 0x7f468013e430 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f467000d000 tx=0x7f4670009040).stop 2021-06-25T04:55:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 -- 172.21.15.57:0/2708403671 shutdown_connections 2021-06-25T04:55:21.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46600553f0 0x7f46600578b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468013e920 0x7f4680155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4680144b10 0x7f468013e430 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 --2- 172.21.15.57:0/2708403671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46800ae610 0x7f4680146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 -- 172.21.15.57:0/2708403671 >> 172.21.15.57:0/2708403671 conn(0x7f468006adb0 msgr2=0x7f4680140c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:21.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 -- 172.21.15.57:0/2708403671 shutdown_connections 2021-06-25T04:55:21.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.472+0000 7f46856da700 1 -- 172.21.15.57:0/2708403671 wait complete. 2021-06-25T04:55:21.493 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:55:21.493 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:55:21.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc70a529700 1 Processor -- start 2021-06-25T04:55:21.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc70a529700 1 -- start start 2021-06-25T04:55:21.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc70a529700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7040a9e80 0x7fc7040aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc70a529700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc704060390 0x7fc70413cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc70a529700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc704061950 con 0x7fc70413d180 2021-06-25T04:55:21.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc70a529700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc704061bf0 con 0x7fc704060390 2021-06-25T04:55:21.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc70a529700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc704060b50 con 0x7fc7040a9e80 2021-06-25T04:55:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc703fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7040a9e80 0x7fc7040aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc7037fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc704060390 0x7fc70413cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc703fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7040a9e80 0x7fc7040aa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:52726/0 (socket says 172.21.15.57:52726) 2021-06-25T04:55:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc7037fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc704060390 0x7fc70413cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:50058/0 (socket says 172.21.15.57:50058) 2021-06-25T04:55:21.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc703fff700 1 -- 172.21.15.57:0/2308541972 learned_addr learned my addr 172.21.15.57:0/2308541972 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:21.609 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.600+0000 7fc708ac6700 1 --1- 172.21.15.57:0/2308541972 >> v1:172.21.15.87:6789/0 conn(0x7fc70413d180 0x7fc70413f750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:59532/0 (socket says 172.21.15.57:59532) 2021-06-25T04:55:21.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc703fff700 1 -- 172.21.15.57:0/2308541972 >> v2:172.21.15.87:3300/0 conn(0x7fc704060390 msgr2=0x7fc70413cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:21.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc703fff700 1 --2- 172.21.15.57:0/2308541972 >> v2:172.21.15.87:3300/0 conn(0x7fc704060390 0x7fc70413cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc703fff700 1 -- 172.21.15.57:0/2308541972 >> v1:172.21.15.87:6789/0 conn(0x7fc70413d180 legacy=0x7fc70413f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc703fff700 1 -- 172.21.15.57:0/2308541972 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc704060df0 con 0x7fc7040a9e80 2021-06-25T04:55:21.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc703fff700 1 --2- 172.21.15.57:0/2308541972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7040a9e80 0x7fc7040aa260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc70405f830 tx=0x7fc6f4006eb0).ready entity=mon.2 client_cookie=ac8936f816cd89db server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:21.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc702ffd700 1 -- 172.21.15.57:0/2308541972 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f400d5c0 con 0x7fc7040a9e80 2021-06-25T04:55:21.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc702ffd700 1 -- 172.21.15.57:0/2308541972 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4000e90 con 0x7fc7040a9e80 2021-06-25T04:55:21.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc702ffd700 1 -- 172.21.15.57:0/2308541972 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f400d950 con 0x7fc7040a9e80 2021-06-25T04:55:21.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc70a529700 1 -- 172.21.15.57:0/2308541972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7040a9e80 msgr2=0x7fc7040aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc70a529700 1 --2- 172.21.15.57:0/2308541972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7040a9e80 0x7fc7040aa260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc70405f830 tx=0x7fc6f4006eb0).stop 2021-06-25T04:55:21.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc70a529700 1 -- 172.21.15.57:0/2308541972 shutdown_connections 2021-06-25T04:55:21.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc70a529700 1 --2- 172.21.15.57:0/2308541972 >> v2:172.21.15.87:3300/0 conn(0x7fc704060390 0x7fc70413cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc70a529700 1 --2- 172.21.15.57:0/2308541972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7040a9e80 0x7fc7040aa260 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc70a529700 1 -- 172.21.15.57:0/2308541972 >> 172.21.15.57:0/2308541972 conn(0x7fc7040b2930 msgr2=0x7fc7040b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:21.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc70a529700 1 -- 172.21.15.57:0/2308541972 shutdown_connections 2021-06-25T04:55:21.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.604+0000 7fc70a529700 1 -- 172.21.15.57:0/2308541972 wait complete. 2021-06-25T04:55:21.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc70a529700 1 Processor -- start 2021-06-25T04:55:21.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc70a529700 1 -- start start 2021-06-25T04:55:21.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc70a529700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc704060390 0x7fc7040afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc70a529700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040a9e80 0x7fc7041518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc70a529700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc70413d180 0x7fc704151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc70a529700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7041539a0 con 0x7fc7040a9e80 2021-06-25T04:55:21.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc70a529700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc704153b90 con 0x7fc70413d180 2021-06-25T04:55:21.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc70a529700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc704153e30 con 0x7fc704060390 2021-06-25T04:55:21.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc7037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040a9e80 0x7fc7041518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc7037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040a9e80 0x7fc7041518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41570/0 (socket says 172.21.15.57:41570) 2021-06-25T04:55:21.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc7037fe700 1 -- 172.21.15.57:0/520032131 learned_addr learned my addr 172.21.15.57:0/520032131 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:21.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc703fff700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc704060390 0x7fc7040afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc708ac6700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc70413d180 0x7fc704151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc7037fe700 1 -- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc704060390 msgr2=0x7fc7040afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc7037fe700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc704060390 0x7fc7040afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc7037fe700 1 -- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc70413d180 msgr2=0x7fc704151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:21.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc7037fe700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc70413d180 0x7fc704151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:21.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc7037fe700 1 -- 172.21.15.57:0/520032131 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f400b1e0 con 0x7fc7040a9e80 2021-06-25T04:55:21.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.608+0000 7fc7037fe700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040a9e80 0x7fc7041518a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fc6f800c000 tx=0x7fc6f8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:21.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.612+0000 7fc7017fa700 1 -- 172.21.15.57:0/520032131 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f8010780 con 0x7fc7040a9e80 2021-06-25T04:55:21.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.612+0000 7fc7017fa700 1 -- 172.21.15.57:0/520032131 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f80108e0 con 0x7fc7040a9e80 2021-06-25T04:55:21.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.612+0000 7fc7017fa700 1 -- 172.21.15.57:0/520032131 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f8010c40 con 0x7fc7040a9e80 2021-06-25T04:55:21.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.612+0000 7fc70a529700 1 -- 172.21.15.57:0/520032131 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7041540d0 con 0x7fc7040a9e80 2021-06-25T04:55:21.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.612+0000 7fc70a529700 1 -- 172.21.15.57:0/520032131 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc704150410 con 0x7fc7040a9e80 2021-06-25T04:55:21.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.612+0000 7fc70a529700 1 -- 172.21.15.57:0/520032131 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc704057310 con 0x7fc7040a9e80 2021-06-25T04:55:21.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.612+0000 7fc7017fa700 1 -- 172.21.15.57:0/520032131 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc6f801c460 con 0x7fc7040a9e80 2021-06-25T04:55:21.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.612+0000 7fc7017fa700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6e4055340 0x7fc6e4057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:21.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.612+0000 7fc7017fa700 1 -- 172.21.15.57:0/520032131 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fc6f806df30 con 0x7fc7040a9e80 2021-06-25T04:55:21.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.612+0000 7fc703fff700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6e4055340 0x7fc6e4057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:21.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.612+0000 7fc703fff700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6e4055340 0x7fc6e4057800 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fc6f401b000 tx=0x7fc6f4015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:21.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.620+0000 7fc7017fa700 1 -- 172.21.15.57:0/520032131 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc6f80443c0 con 0x7fc7040a9e80 2021-06-25T04:55:21.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:21.748+0000 7fc70a529700 1 -- 172.21.15.57:0/520032131 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fc7040ac9b0 con 0x7fc7040a9e80 2021-06-25T04:55:22.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.404+0000 7fc7017fa700 1 -- 172.21.15.57:0/520032131 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v105) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc6f80479e0 con 0x7fc7040a9e80 2021-06-25T04:55:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 -- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6e4055340 msgr2=0x7fc6e4057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6e4055340 0x7fc6e4057800 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fc6f401b000 tx=0x7fc6f4015000).stop 2021-06-25T04:55:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 -- 172.21.15.57:0/520032131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040a9e80 msgr2=0x7fc7041518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040a9e80 0x7fc7041518a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fc6f800c000 tx=0x7fc6f8006df0).stop 2021-06-25T04:55:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 -- 172.21.15.57:0/520032131 shutdown_connections 2021-06-25T04:55:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc6e4055340 0x7fc6e4057800 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc70413d180 0x7fc704151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040a9e80 0x7fc7041518a0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 --2- 172.21.15.57:0/520032131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc704060390 0x7fc7040afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 -- 172.21.15.57:0/520032131 >> 172.21.15.57:0/520032131 conn(0x7fc7040b2930 msgr2=0x7fc7040b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 -- 172.21.15.57:0/520032131 shutdown_connections 2021-06-25T04:55:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.408+0000 7fc70a529700 1 -- 172.21.15.57:0/520032131 wait complete. 2021-06-25T04:55:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:55:22.425 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:55:22.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.532+0000 7f8b9302f700 1 Processor -- start 2021-06-25T04:55:22.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.532+0000 7f8b9302f700 1 -- start start 2021-06-25T04:55:22.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9302f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b8c0a9150 0x7f8b8c146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:22.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9302f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8c0b1100 con 0x7f8b8c0b0390 2021-06-25T04:55:22.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9302f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8c0a9530 con 0x7f8b8c0b0b40 2021-06-25T04:55:22.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9302f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b8c0b1330 con 0x7f8b8c0a9150 2021-06-25T04:55:22.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9282e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8b8c0b0390 0x7f8b8c140180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58798/0 (socket says 172.21.15.57:58798) 2021-06-25T04:55:22.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9282e700 1 -- 172.21.15.57:0/1867673752 learned_addr learned my addr 172.21.15.57:0/1867673752 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:22.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9202d700 1 --2- 172.21.15.57:0/1867673752 >> v2:172.21.15.87:3300/0 conn(0x7f8b8c0a9150 0x7f8b8c146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:22.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045064741 0 0) 0x7f8b8c0b1100 con 0x7f8b8c0b0390 2021-06-25T04:55:22.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b74003260 con 0x7f8b8c0b0390 2021-06-25T04:55:22.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2938327077 0 0) 0x7f8b74003260 con 0x7f8b8c0b0390 2021-06-25T04:55:22.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 >> v2:172.21.15.87:3300/0 conn(0x7f8b8c0a9150 msgr2=0x7f8b8c146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:22.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 --2- 172.21.15.57:0/1867673752 >> v2:172.21.15.87:3300/0 conn(0x7f8b8c0a9150 0x7f8b8c146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:22.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 >> v1:172.21.15.87:6789/0 conn(0x7f8b8c0b0b40 legacy=0x7f8b8c146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:22.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c0b15d0 con 0x7f8b8c0b0390 2021-06-25T04:55:22.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f8b840019e0 con 0x7f8b8c0b0390 2021-06-25T04:55:22.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 >> v1:172.21.15.57:6789/0 conn(0x7f8b8c0b0390 legacy=0x7f8b8c140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:22.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 --2- 172.21.15.57:0/1867673752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b74003750 0x7f8b74003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:22.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 --2- 172.21.15.57:0/1867673752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 0x7f8b74004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:22.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 --2- 172.21.15.57:0/1867673752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b74004e70 0x7f8b7400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:22.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c0b1330 con 0x7f8b74004500 2021-06-25T04:55:22.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7400bca0 con 0x7f8b74004e70 2021-06-25T04:55:22.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7400be60 con 0x7f8b74003750 2021-06-25T04:55:22.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9182c700 1 --2- 172.21.15.57:0/1867673752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 0x7f8b74004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:22.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9202d700 1 --2- 172.21.15.57:0/1867673752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b74003750 0x7f8b74003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9282e700 1 --2- 172.21.15.57:0/1867673752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b74004e70 0x7f8b7400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9182c700 1 -- 172.21.15.57:0/1867673752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b74003750 msgr2=0x7f8b74003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9182c700 1 --2- 172.21.15.57:0/1867673752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b74003750 0x7f8b74003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9182c700 1 -- 172.21.15.57:0/1867673752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b74004e70 msgr2=0x7f8b7400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9182c700 1 --2- 172.21.15.57:0/1867673752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b74004e70 0x7f8b7400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9282e700 1 -- 172.21.15.57:0/1867673752 reap_dead start 2021-06-25T04:55:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9182c700 1 -- 172.21.15.57:0/1867673752 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b74003260 con 0x7f8b74004500 2021-06-25T04:55:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9182c700 1 --2- 172.21.15.57:0/1867673752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 0x7f8b74004980 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f8b7c001020 tx=0x7f8b7c0079e0).ready entity=mon.0 client_cookie=decf17e36119c74c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:22.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b7c007cf0 con 0x7f8b74004500 2021-06-25T04:55:22.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c007030 con 0x7f8b74004500 2021-06-25T04:55:22.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9102b700 1 -- 172.21.15.57:0/1867673752 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b7c007390 con 0x7f8b74004500 2021-06-25T04:55:22.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9302f700 1 -- 172.21.15.57:0/1867673752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 msgr2=0x7f8b74004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:22.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.536+0000 7f8b9302f700 1 --2- 172.21.15.57:0/1867673752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 0x7f8b74004980 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f8b7c001020 tx=0x7f8b7c0079e0).stop 2021-06-25T04:55:22.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.540+0000 7f8b9302f700 1 -- 172.21.15.57:0/1867673752 shutdown_connections 2021-06-25T04:55:22.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.540+0000 7f8b9302f700 1 --2- 172.21.15.57:0/1867673752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 0x7f8b74004980 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:22.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.540+0000 7f8b9302f700 1 -- 172.21.15.57:0/1867673752 >> 172.21.15.57:0/1867673752 conn(0x7f8b8c061100 msgr2=0x7f8b8c062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:22.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.540+0000 7f8b9302f700 1 -- 172.21.15.57:0/1867673752 shutdown_connections 2021-06-25T04:55:22.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.540+0000 7f8b9302f700 1 -- 172.21.15.57:0/1867673752 wait complete. 2021-06-25T04:55:22.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.540+0000 7f8b9302f700 1 Processor -- start 2021-06-25T04:55:22.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.540+0000 7f8b9302f700 1 -- start start 2021-06-25T04:55:22.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9302f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 0x7f8b8c13f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:22.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9302f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b8c144680 0x7f8b8c144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:22.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9302f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b8c145150 0x7f8b8c13bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:22.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9302f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c13f6d0 con 0x7f8b74004500 2021-06-25T04:55:22.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9302f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c1471c0 con 0x7f8b8c145150 2021-06-25T04:55:22.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9302f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c13f8c0 con 0x7f8b8c144680 2021-06-25T04:55:22.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9202d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 0x7f8b8c13f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:22.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9202d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 0x7f8b8c13f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41588/0 (socket says 172.21.15.57:41588) 2021-06-25T04:55:22.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9202d700 1 -- 172.21.15.57:0/3867804359 learned_addr learned my addr 172.21.15.57:0/3867804359 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:22.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9182c700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b8c144680 0x7f8b8c144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:22.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9282e700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b8c145150 0x7f8b8c13bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:22.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9202d700 1 -- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b8c144680 msgr2=0x7f8b8c144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:22.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9202d700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b8c144680 0x7f8b8c144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:22.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9202d700 1 -- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b8c145150 msgr2=0x7f8b8c13bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:22.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9202d700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b8c145150 0x7f8b8c13bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:22.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9202d700 1 -- 172.21.15.57:0/3867804359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c146a80 con 0x7f8b74004500 2021-06-25T04:55:22.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9282e700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b8c145150 0x7f8b8c13bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:22.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9202d700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 0x7f8b8c13f000 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f8b8800b000 tx=0x7f8b88006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:22.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b7b7fe700 1 -- 172.21.15.57:0/3867804359 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b8800f730 con 0x7f8b74004500 2021-06-25T04:55:22.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b7b7fe700 1 -- 172.21.15.57:0/3867804359 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88000e90 con 0x7f8b74004500 2021-06-25T04:55:22.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b7b7fe700 1 -- 172.21.15.57:0/3867804359 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b8800fa80 con 0x7f8b74004500 2021-06-25T04:55:22.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9302f700 1 -- 172.21.15.57:0/3867804359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8c146d20 con 0x7f8b74004500 2021-06-25T04:55:22.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.544+0000 7f8b9302f700 1 -- 172.21.15.57:0/3867804359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8c13fb60 con 0x7f8b74004500 2021-06-25T04:55:22.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.548+0000 7f8b9302f700 1 -- 172.21.15.57:0/3867804359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8c144a60 con 0x7f8b74004500 2021-06-25T04:55:22.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.548+0000 7f8b7b7fe700 1 -- 172.21.15.57:0/3867804359 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8b8800fbe0 con 0x7f8b74004500 2021-06-25T04:55:22.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.548+0000 7f8b7b7fe700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8b6c0554e0 0x7f8b6c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:22.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.548+0000 7f8b7b7fe700 1 -- 172.21.15.57:0/3867804359 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f8b8806e620 con 0x7f8b74004500 2021-06-25T04:55:22.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.548+0000 7f8b9182c700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8b6c0554e0 0x7f8b6c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:22.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.548+0000 7f8b9182c700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8b6c0554e0 0x7f8b6c0579a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f8b7c01c000 tx=0x7f8b7c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:22.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.556+0000 7f8b7b7fe700 1 -- 172.21.15.57:0/3867804359 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8b88044830 con 0x7f8b74004500 2021-06-25T04:55:22.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:22.684+0000 7f8b9302f700 1 -- 172.21.15.57:0/3867804359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f8b8c146eb0 con 0x7f8b74004500 2021-06-25T04:55:23.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.052+0000 7f8b7b7fe700 1 -- 172.21.15.57:0/3867804359 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v106) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8b88018070 con 0x7f8b74004500 2021-06-25T04:55:23.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 -- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8b6c0554e0 msgr2=0x7f8b6c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8b6c0554e0 0x7f8b6c0579a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f8b7c01c000 tx=0x7f8b7c015000).stop 2021-06-25T04:55:23.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 -- 172.21.15.57:0/3867804359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 msgr2=0x7f8b8c13f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 0x7f8b8c13f000 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f8b8800b000 tx=0x7f8b88006df0).stop 2021-06-25T04:55:23.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 -- 172.21.15.57:0/3867804359 shutdown_connections 2021-06-25T04:55:23.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8b6c0554e0 0x7f8b6c0579a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b8c145150 0x7f8b8c13bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b8c144680 0x7f8b8c144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 --2- 172.21.15.57:0/3867804359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b74004500 0x7f8b8c13f000 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 -- 172.21.15.57:0/3867804359 >> 172.21.15.57:0/3867804359 conn(0x7f8b8c061100 msgr2=0x7f8b8c142740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:23.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 -- 172.21.15.57:0/3867804359 shutdown_connections 2021-06-25T04:55:23.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.060+0000 7f8b9302f700 1 -- 172.21.15.57:0/3867804359 wait complete. 2021-06-25T04:55:23.069 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:55:23.078 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:55:23.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.184+0000 7f6f40cbf700 1 Processor -- start 2021-06-25T04:55:23.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.184+0000 7f6f40cbf700 1 -- start start 2021-06-25T04:55:23.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f40cbf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f3c063890 0x7f6f3c061e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f40cbf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f3c13e600 0x7f6f3c1412f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f40cbf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c0b0f00 con 0x7f6f3c0b1770 2021-06-25T04:55:23.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f40cbf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c063c70 con 0x7f6f3c063890 2021-06-25T04:55:23.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f40cbf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c060030 con 0x7f6f3c13e600 2021-06-25T04:55:23.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f3c063890 0x7f6f3c061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f3c063890 0x7f6f3c061e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41596/0 (socket says 172.21.15.57:41596) 2021-06-25T04:55:23.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3b7fe700 1 -- 172.21.15.57:0/2780841225 learned_addr learned my addr 172.21.15.57:0/2780841225 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:23.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3bfff700 1 --2- 172.21.15.57:0/2780841225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f3c13e600 0x7f6f3c1412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3b7fe700 1 -- 172.21.15.57:0/2780841225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f3c13e600 msgr2=0x7f6f3c1412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:23.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3b7fe700 1 --2- 172.21.15.57:0/2780841225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f3c13e600 0x7f6f3c1412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3affd700 1 -- 172.21.15.57:0/2780841225 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580216930 0 0) 0x7f6f3c0b0f00 con 0x7f6f3c0b1770 2021-06-25T04:55:23.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3b7fe700 1 -- 172.21.15.57:0/2780841225 >> v1:172.21.15.87:6789/0 conn(0x7f6f3c0b1770 legacy=0x7f6f3c13def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3b7fe700 1 -- 172.21.15.57:0/2780841225 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0b1130 con 0x7f6f3c063890 2021-06-25T04:55:23.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3b7fe700 1 --2- 172.21.15.57:0/2780841225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f3c063890 0x7f6f3c061e80 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f6f2c002f70 tx=0x7f6f2c006eb0).ready entity=mon.0 client_cookie=bdd90afc715f326a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:23.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3affd700 1 -- 172.21.15.57:0/2780841225 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2c00d570 con 0x7f6f3c063890 2021-06-25T04:55:23.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3affd700 1 -- 172.21.15.57:0/2780841225 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c000e90 con 0x7f6f3c063890 2021-06-25T04:55:23.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f3affd700 1 -- 172.21.15.57:0/2780841225 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2c00d8c0 con 0x7f6f3c063890 2021-06-25T04:55:23.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f40cbf700 1 -- 172.21.15.57:0/2780841225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f3c063890 msgr2=0x7f6f3c061e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.188+0000 7f6f40cbf700 1 --2- 172.21.15.57:0/2780841225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f3c063890 0x7f6f3c061e80 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f6f2c002f70 tx=0x7f6f2c006eb0).stop 2021-06-25T04:55:23.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.192+0000 7f6f40cbf700 1 -- 172.21.15.57:0/2780841225 shutdown_connections 2021-06-25T04:55:23.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.192+0000 7f6f40cbf700 1 --2- 172.21.15.57:0/2780841225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f3c13e600 0x7f6f3c1412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.192+0000 7f6f40cbf700 1 --2- 172.21.15.57:0/2780841225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f3c063890 0x7f6f3c061e80 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.192+0000 7f6f40cbf700 1 -- 172.21.15.57:0/2780841225 >> 172.21.15.57:0/2780841225 conn(0x7f6f3c05c450 msgr2=0x7f6f3c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:23.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.192+0000 7f6f40cbf700 1 -- 172.21.15.57:0/2780841225 shutdown_connections 2021-06-25T04:55:23.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.192+0000 7f6f40cbf700 1 -- 172.21.15.57:0/2780841225 wait complete. 2021-06-25T04:55:23.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.192+0000 7f6f40cbf700 1 Processor -- start 2021-06-25T04:55:23.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.192+0000 7f6f40cbf700 1 -- start start 2021-06-25T04:55:23.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f40cbf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f3c063890 0x7f6f3c147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f40cbf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f3c0b1770 0x7f6f3c1368d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f40cbf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f3c13e600 0x7f6f3c153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f40cbf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c136dc0 con 0x7f6f3c063890 2021-06-25T04:55:23.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f40cbf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1487d0 con 0x7f6f3c13e600 2021-06-25T04:55:23.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f40cbf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c134740 con 0x7f6f3c0b1770 2021-06-25T04:55:23.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f3b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f3c063890 0x7f6f3c147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f3b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f3c063890 0x7f6f3c147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41602/0 (socket says 172.21.15.57:41602) 2021-06-25T04:55:23.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f3b7fe700 1 -- 172.21.15.57:0/3221480240 learned_addr learned my addr 172.21.15.57:0/3221480240 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:23.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f33fff700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f3c0b1770 0x7f6f3c1368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f3bfff700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f3c13e600 0x7f6f3c153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f3b7fe700 1 -- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f3c0b1770 msgr2=0x7f6f3c1368d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f3b7fe700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f3c0b1770 0x7f6f3c1368d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f3b7fe700 1 -- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f3c13e600 msgr2=0x7f6f3c153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f3b7fe700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f3c13e600 0x7f6f3c153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f3b7fe700 1 -- 172.21.15.57:0/3221480240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c00b1e0 con 0x7f6f3c063890 2021-06-25T04:55:23.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f3b7fe700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f3c063890 0x7f6f3c147d00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f6f2c002f70 tx=0x7f6f2c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:23.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f397fa700 1 -- 172.21.15.57:0/3221480240 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2c021070 con 0x7f6f3c063890 2021-06-25T04:55:23.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f397fa700 1 -- 172.21.15.57:0/3221480240 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c000e90 con 0x7f6f3c063890 2021-06-25T04:55:23.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f40cbf700 1 -- 172.21.15.57:0/3221480240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c138810 con 0x7f6f3c063890 2021-06-25T04:55:23.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f397fa700 1 -- 172.21.15.57:0/3221480240 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2c006b40 con 0x7f6f3c063890 2021-06-25T04:55:23.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.196+0000 7f6f40cbf700 1 -- 172.21.15.57:0/3221480240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c134070 con 0x7f6f3c063890 2021-06-25T04:55:23.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.200+0000 7f6f40cbf700 1 -- 172.21.15.57:0/3221480240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c134940 con 0x7f6f3c063890 2021-06-25T04:55:23.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.200+0000 7f6f397fa700 1 -- 172.21.15.57:0/3221480240 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6f2c00f070 con 0x7f6f3c063890 2021-06-25T04:55:23.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.200+0000 7f6f397fa700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f20055340 0x7f6f20057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.200+0000 7f6f397fa700 1 -- 172.21.15.57:0/3221480240 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f6f2c06f1a0 con 0x7f6f3c063890 2021-06-25T04:55:23.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.200+0000 7f6f33fff700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f20055340 0x7f6f20057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.200+0000 7f6f33fff700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f20055340 0x7f6f20057800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f6f2400d000 tx=0x7f6f240079b0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:23.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.204+0000 7f6f397fa700 1 -- 172.21.15.57:0/3221480240 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6f2c045370 con 0x7f6f3c063890 2021-06-25T04:55:23.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.376+0000 7f6f40cbf700 1 -- 172.21.15.57:0/3221480240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f6f3c133e50 con 0x7f6f3c063890 2021-06-25T04:55:23.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.388+0000 7f6f397fa700 1 -- 172.21.15.57:0/3221480240 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v51) v1 ==== 189+0+0 (secure 0 0 0) 0x7f6f2c048990 con 0x7f6f3c063890 2021-06-25T04:55:23.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.392+0000 7f6f40cbf700 1 -- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f20055340 msgr2=0x7f6f20057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.392+0000 7f6f40cbf700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f20055340 0x7f6f20057800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f6f2400d000 tx=0x7f6f240079b0).stop 2021-06-25T04:55:23.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.392+0000 7f6f40cbf700 1 -- 172.21.15.57:0/3221480240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f3c063890 msgr2=0x7f6f3c147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.392+0000 7f6f40cbf700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f3c063890 0x7f6f3c147d00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f6f2c002f70 tx=0x7f6f2c015000).stop 2021-06-25T04:55:23.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.392+0000 7f6f40cbf700 1 -- 172.21.15.57:0/3221480240 shutdown_connections 2021-06-25T04:55:23.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.392+0000 7f6f40cbf700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6f20055340 0x7f6f20057800 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.392+0000 7f6f40cbf700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f3c13e600 0x7f6f3c153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.392+0000 7f6f40cbf700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f3c0b1770 0x7f6f3c1368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.392+0000 7f6f40cbf700 1 --2- 172.21.15.57:0/3221480240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f3c063890 0x7f6f3c147d00 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.392+0000 7f6f40cbf700 1 -- 172.21.15.57:0/3221480240 >> 172.21.15.57:0/3221480240 conn(0x7f6f3c05c450 msgr2=0x7f6f3c0b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:23.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.392+0000 7f6f40cbf700 1 -- 172.21.15.57:0/3221480240 shutdown_connections 2021-06-25T04:55:23.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.396+0000 7f6f40cbf700 1 -- 172.21.15.57:0/3221480240 wait complete. 2021-06-25T04:55:23.400 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 19 and data pool 20 2021-06-25T04:55:23.414 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:23.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.500+0000 7f8f36457700 1 Processor -- start 2021-06-25T04:55:23.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 -- start start 2021-06-25T04:55:23.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8f300a7670 0x7f8f30066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f300b1930 0x7f8f30066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f300b0020 0x7f8f3005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f30067410 con 0x7f8f300a7670 2021-06-25T04:55:23.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f300a7a50 con 0x7f8f300b0020 2021-06-25T04:55:23.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f301475e0 con 0x7f8f300b1930 2021-06-25T04:55:23.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8f300a7670 0x7f8f30066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8f300a7670 0x7f8f30066a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41622/0 (socket says 172.21.15.57:41622) 2021-06-25T04:55:23.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2ffff700 1 -- 172.21.15.57:0/4236447705 learned_addr learned my addr 172.21.15.57:0/4236447705 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:23.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f349f4700 1 --2- 172.21.15.57:0/4236447705 >> v2:172.21.15.87:3300/0 conn(0x7f8f300b0020 0x7f8f3005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2f7fe700 1 --2- 172.21.15.57:0/4236447705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f300b1930 0x7f8f30066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2ffff700 1 -- 172.21.15.57:0/4236447705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f300b1930 msgr2=0x7f8f30066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:23.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2ffff700 1 --2- 172.21.15.57:0/4236447705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f300b1930 0x7f8f30066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2ffff700 1 -- 172.21.15.57:0/4236447705 >> v2:172.21.15.87:3300/0 conn(0x7f8f300b0020 msgr2=0x7f8f3005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:23.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2ffff700 1 --2- 172.21.15.57:0/4236447705 >> v2:172.21.15.87:3300/0 conn(0x7f8f300b0020 0x7f8f3005f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2ffff700 1 -- 172.21.15.57:0/4236447705 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30147880 con 0x7f8f300a7670 2021-06-25T04:55:23.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2f7fe700 1 --2- 172.21.15.57:0/4236447705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f300b1930 0x7f8f30066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:23.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2ffff700 1 --2- 172.21.15.57:0/4236447705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f300a7670 0x7f8f30066a30 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f8f200032f0 tx=0x7f8f20009290).ready entity=mon.0 client_cookie=c01ca9c4332bb434 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:23.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2effd700 1 -- 172.21.15.57:0/4236447705 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f2000b870 con 0x7f8f300a7670 2021-06-25T04:55:23.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f2effd700 1 -- 172.21.15.57:0/4236447705 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2000b9d0 con 0x7f8f300a7670 2021-06-25T04:55:23.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 -- 172.21.15.57:0/4236447705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f300a7670 msgr2=0x7f8f30066a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 --2- 172.21.15.57:0/4236447705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f300a7670 0x7f8f30066a30 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f8f200032f0 tx=0x7f8f20009290).stop 2021-06-25T04:55:23.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 -- 172.21.15.57:0/4236447705 shutdown_connections 2021-06-25T04:55:23.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 --2- 172.21.15.57:0/4236447705 >> v2:172.21.15.87:3300/0 conn(0x7f8f300b0020 0x7f8f3005f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 --2- 172.21.15.57:0/4236447705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f300b1930 0x7f8f30066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 --2- 172.21.15.57:0/4236447705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f300a7670 0x7f8f30066a30 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 -- 172.21.15.57:0/4236447705 >> 172.21.15.57:0/4236447705 conn(0x7f8f300b53a0 msgr2=0x7f8f300b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:23.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 -- 172.21.15.57:0/4236447705 shutdown_connections 2021-06-25T04:55:23.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.504+0000 7f8f36457700 1 -- 172.21.15.57:0/4236447705 wait complete. 2021-06-25T04:55:23.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f36457700 1 Processor -- start 2021-06-25T04:55:23.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f36457700 1 -- start start 2021-06-25T04:55:23.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f36457700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f300a7670 0x7f8f300b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f36457700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f300b0020 0x7f8f300ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f36457700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f300b1930 0x7f8f300aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f36457700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300ab1b0 con 0x7f8f300a7670 2021-06-25T04:55:23.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f36457700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300af020 con 0x7f8f300b1930 2021-06-25T04:55:23.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f36457700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300acdf0 con 0x7f8f300b0020 2021-06-25T04:55:23.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f300a7670 0x7f8f300b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f300a7670 0x7f8f300b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41628/0 (socket says 172.21.15.57:41628) 2021-06-25T04:55:23.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2ffff700 1 -- 172.21.15.57:0/68011271 learned_addr learned my addr 172.21.15.57:0/68011271 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:23.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2f7fe700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f300b0020 0x7f8f300ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f349f4700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f300b1930 0x7f8f300aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2ffff700 1 -- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f300b0020 msgr2=0x7f8f300ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2ffff700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f300b0020 0x7f8f300ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2ffff700 1 -- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f300b1930 msgr2=0x7f8f300aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2ffff700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f300b1930 0x7f8f300aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2ffff700 1 -- 172.21.15.57:0/68011271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20009530 con 0x7f8f300a7670 2021-06-25T04:55:23.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2ffff700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f300a7670 0x7f8f300b32e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f8f300af160 tx=0x7f8f20016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:23.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2d7fa700 1 -- 172.21.15.57:0/68011271 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f20011940 con 0x7f8f300a7670 2021-06-25T04:55:23.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f36457700 1 -- 172.21.15.57:0/68011271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f300ad090 con 0x7f8f300a7670 2021-06-25T04:55:23.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2d7fa700 1 -- 172.21.15.57:0/68011271 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f20011aa0 con 0x7f8f300a7670 2021-06-25T04:55:23.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f2d7fa700 1 -- 172.21.15.57:0/68011271 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f20011e00 con 0x7f8f300a7670 2021-06-25T04:55:23.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.508+0000 7f8f36457700 1 -- 172.21.15.57:0/68011271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f300b3ca0 con 0x7f8f300a7670 2021-06-25T04:55:23.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.512+0000 7f8f36457700 1 -- 172.21.15.57:0/68011271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f30057310 con 0x7f8f300a7670 2021-06-25T04:55:23.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.512+0000 7f8f2d7fa700 1 -- 172.21.15.57:0/68011271 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8f2000f070 con 0x7f8f300a7670 2021-06-25T04:55:23.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.512+0000 7f8f2d7fa700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8f14055450 0x7f8f14057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.512+0000 7f8f2d7fa700 1 -- 172.21.15.57:0/68011271 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8f2006e440 con 0x7f8f300a7670 2021-06-25T04:55:23.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.512+0000 7f8f2f7fe700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8f14055450 0x7f8f14057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.512+0000 7f8f2f7fe700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8f14055450 0x7f8f14057910 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f8f1800d000 tx=0x7f8f18008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:23.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.520+0000 7f8f2d7fa700 1 -- 172.21.15.57:0/68011271 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8f20044550 con 0x7f8f300a7670 2021-06-25T04:55:23.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.648+0000 7f8f36457700 1 -- 172.21.15.57:0/68011271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f300ae380 con 0x7f8f300a7670 2021-06-25T04:55:23.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.648+0000 7f8f2d7fa700 1 -- 172.21.15.57:0/68011271 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f8f20015020 con 0x7f8f300a7670 2021-06-25T04:55:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:23.653 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":107,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:23.380762+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:55:21.803828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-06-25T04:55:22.740631+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 -- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8f14055450 msgr2=0x7f8f14057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8f14055450 0x7f8f14057910 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f8f1800d000 tx=0x7f8f18008040).stop 2021-06-25T04:55:23.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 -- 172.21.15.57:0/68011271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f300a7670 msgr2=0x7f8f300b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f300a7670 0x7f8f300b32e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f8f300af160 tx=0x7f8f20016000).stop 2021-06-25T04:55:23.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 -- 172.21.15.57:0/68011271 shutdown_connections 2021-06-25T04:55:23.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8f14055450 0x7f8f14057910 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f300b1930 0x7f8f300aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f300b0020 0x7f8f300ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 --2- 172.21.15.57:0/68011271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f300a7670 0x7f8f300b32e0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 -- 172.21.15.57:0/68011271 >> 172.21.15.57:0/68011271 conn(0x7f8f300b53a0 msgr2=0x7f8f3005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:23.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 -- 172.21.15.57:0/68011271 shutdown_connections 2021-06-25T04:55:23.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.652+0000 7f8f36457700 1 -- 172.21.15.57:0/68011271 wait complete. 2021-06-25T04:55:23.667 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:23.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.764+0000 7fad4c81d700 1 Processor -- start 2021-06-25T04:55:23.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.764+0000 7fad4c81d700 1 -- start start 2021-06-25T04:55:23.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4c81d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad480b1f90 0x7fad480619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4c81d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad48066bc0 con 0x7fad48064b60 2021-06-25T04:55:23.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4c81d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad48066e60 con 0x7fad48061eb0 2021-06-25T04:55:23.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4c81d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad48066110 con 0x7fad480b1f90 2021-06-25T04:55:23.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad46d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fad48064b60 0x7fad480b7de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58856/0 (socket says 172.21.15.57:58856) 2021-06-25T04:55:23.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad46d9d700 1 -- 172.21.15.57:0/3383045539 learned_addr learned my addr 172.21.15.57:0/3383045539 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:23.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4659c700 1 --2- 172.21.15.57:0/3383045539 >> v2:172.21.15.87:3300/0 conn(0x7fad480b1f90 0x7fad480619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad45d9b700 1 -- 172.21.15.57:0/3383045539 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495936788 0 0) 0x7fad48066bc0 con 0x7fad48064b60 2021-06-25T04:55:23.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4659c700 1 -- 172.21.15.57:0/3383045539 >> v1:172.21.15.87:6789/0 conn(0x7fad48061eb0 legacy=0x7fad480b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4659c700 1 -- 172.21.15.57:0/3383045539 >> v1:172.21.15.57:6789/0 conn(0x7fad48064b60 legacy=0x7fad480b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4659c700 1 -- 172.21.15.57:0/3383045539 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48067100 con 0x7fad480b1f90 2021-06-25T04:55:23.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4659c700 1 --2- 172.21.15.57:0/3383045539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad480b1f90 0x7fad480619c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fad480628a0 tx=0x7fad300091a0).ready entity=mon.1 client_cookie=9d7acd195c75c2f3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:23.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad45d9b700 1 -- 172.21.15.57:0/3383045539 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad30009ea0 con 0x7fad480b1f90 2021-06-25T04:55:23.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad45d9b700 1 -- 172.21.15.57:0/3383045539 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3000b860 con 0x7fad480b1f90 2021-06-25T04:55:23.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad45d9b700 1 -- 172.21.15.57:0/3383045539 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3000b9d0 con 0x7fad480b1f90 2021-06-25T04:55:23.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4c81d700 1 -- 172.21.15.57:0/3383045539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad480b1f90 msgr2=0x7fad480619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4c81d700 1 --2- 172.21.15.57:0/3383045539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad480b1f90 0x7fad480619c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fad480628a0 tx=0x7fad300091a0).stop 2021-06-25T04:55:23.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4c81d700 1 -- 172.21.15.57:0/3383045539 shutdown_connections 2021-06-25T04:55:23.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4c81d700 1 --2- 172.21.15.57:0/3383045539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad480b1f90 0x7fad480619c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4c81d700 1 -- 172.21.15.57:0/3383045539 >> 172.21.15.57:0/3383045539 conn(0x7fad48062ba0 msgr2=0x7fad4805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:23.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4c81d700 1 -- 172.21.15.57:0/3383045539 shutdown_connections 2021-06-25T04:55:23.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.768+0000 7fad4c81d700 1 -- 172.21.15.57:0/3383045539 wait complete. 2021-06-25T04:55:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4c81d700 1 Processor -- start 2021-06-25T04:55:23.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4c81d700 1 -- start start 2021-06-25T04:55:23.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4c81d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48061eb0 0x7fad480b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4c81d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad48064b60 0x7fad4814c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4c81d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad480b1f90 0x7fad480af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4c81d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48156520 con 0x7fad48064b60 2021-06-25T04:55:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4c81d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480adbc0 con 0x7fad48061eb0 2021-06-25T04:55:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4c81d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad480addf0 con 0x7fad480b1f90 2021-06-25T04:55:23.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad48064b60 0x7fad4814c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad48064b60 0x7fad4814c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41644/0 (socket says 172.21.15.57:41644) 2021-06-25T04:55:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4659c700 1 -- 172.21.15.57:0/397083268 learned_addr learned my addr 172.21.15.57:0/397083268 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad46d9d700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48061eb0 0x7fad480b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4759e700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad480b1f90 0x7fad480af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4659c700 1 -- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad480b1f90 msgr2=0x7fad480af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4659c700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad480b1f90 0x7fad480af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4659c700 1 -- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48061eb0 msgr2=0x7fad480b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4659c700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48061eb0 0x7fad480b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4659c700 1 -- 172.21.15.57:0/397083268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30009420 con 0x7fad48064b60 2021-06-25T04:55:23.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4659c700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad48064b60 0x7fad4814c360 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fad480628a0 tx=0x7fad30016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:23.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad3ffff700 1 -- 172.21.15.57:0/397083268 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad30011b40 con 0x7fad48064b60 2021-06-25T04:55:23.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad3ffff700 1 -- 172.21.15.57:0/397083268 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad30011ca0 con 0x7fad48064b60 2021-06-25T04:55:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad3ffff700 1 -- 172.21.15.57:0/397083268 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3001f3f0 con 0x7fad48064b60 2021-06-25T04:55:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4c81d700 1 -- 172.21.15.57:0/397083268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad480ae350 con 0x7fad48064b60 2021-06-25T04:55:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.772+0000 7fad4c81d700 1 -- 172.21.15.57:0/397083268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad480aea30 con 0x7fad48064b60 2021-06-25T04:55:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.776+0000 7fad3ffff700 1 -- 172.21.15.57:0/397083268 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fad3000f070 con 0x7fad48064b60 2021-06-25T04:55:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.776+0000 7fad4c81d700 1 -- 172.21.15.57:0/397083268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad480ad9d0 con 0x7fad48064b60 2021-06-25T04:55:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.776+0000 7fad3ffff700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad2c055360 0x7fad2c057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.776+0000 7fad3ffff700 1 -- 172.21.15.57:0/397083268 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fad3006e490 con 0x7fad48064b60 2021-06-25T04:55:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.776+0000 7fad46d9d700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad2c055360 0x7fad2c057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.776+0000 7fad46d9d700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad2c055360 0x7fad2c057820 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fad3800d000 tx=0x7fad380011a0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:23.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.784+0000 7fad3ffff700 1 -- 172.21.15.57:0/397083268 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fad30044640 con 0x7fad48064b60 2021-06-25T04:55:23.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.912+0000 7fad4c81d700 1 -- 172.21.15.57:0/397083268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad48057310 con 0x7fad48064b60 2021-06-25T04:55:23.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.912+0000 7fad3ffff700 1 -- 172.21.15.57:0/397083268 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fad30015090 con 0x7fad48064b60 2021-06-25T04:55:23.917 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:23.917 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":107,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:23.380762+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:55:21.803828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-06-25T04:55:22.740631+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:23.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 -- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad2c055360 msgr2=0x7fad2c057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad2c055360 0x7fad2c057820 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fad3800d000 tx=0x7fad380011a0).stop 2021-06-25T04:55:23.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 -- 172.21.15.57:0/397083268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad48064b60 msgr2=0x7fad4814c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:23.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad48064b60 0x7fad4814c360 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fad480628a0 tx=0x7fad30016000).stop 2021-06-25T04:55:23.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 -- 172.21.15.57:0/397083268 shutdown_connections 2021-06-25T04:55:23.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fad2c055360 0x7fad2c057820 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad480b1f90 0x7fad480af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad48064b60 0x7fad4814c360 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 --2- 172.21.15.57:0/397083268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48061eb0 0x7fad480b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:23.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 -- 172.21.15.57:0/397083268 >> 172.21.15.57:0/397083268 conn(0x7fad48062ba0 msgr2=0x7fad4805bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:23.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 -- 172.21.15.57:0/397083268 shutdown_connections 2021-06-25T04:55:23.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:23.916+0000 7fad4c81d700 1 -- 172.21.15.57:0/397083268 wait complete. 2021-06-25T04:55:23.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:55:24.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.036+0000 7f5e88932700 1 Processor -- start 2021-06-25T04:55:24.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.036+0000 7f5e88932700 1 -- start start 2021-06-25T04:55:24.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.036+0000 7f5e88932700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5e840612e0 0x7f5e840616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.036+0000 7f5e88932700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e84140400 0x7f5e84140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.036+0000 7f5e88932700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e840aecb0 con 0x7f5e840ad580 2021-06-25T04:55:24.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.036+0000 7f5e88932700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840b6ee0 con 0x7f5e84140400 2021-06-25T04:55:24.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.036+0000 7f5e88932700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840aeee0 con 0x7f5e840612e0 2021-06-25T04:55:24.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.036+0000 7f5e8359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e84140400 0x7f5e84140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e8359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e84140400 0x7f5e84140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41654/0 (socket says 172.21.15.57:41654) 2021-06-25T04:55:24.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e8359e700 1 -- 172.21.15.57:0/2756924584 learned_addr learned my addr 172.21.15.57:0/2756924584 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:24.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e82d9d700 1 --2- 172.21.15.57:0/2756924584 >> v2:172.21.15.87:3300/0 conn(0x7f5e840612e0 0x7f5e840616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e8359e700 1 -- 172.21.15.57:0/2756924584 >> v2:172.21.15.87:3300/0 conn(0x7f5e840612e0 msgr2=0x7f5e840616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:24.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e8359e700 1 --2- 172.21.15.57:0/2756924584 >> v2:172.21.15.87:3300/0 conn(0x7f5e840612e0 0x7f5e840616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e8359e700 1 -- 172.21.15.57:0/2756924584 >> v1:172.21.15.87:6789/0 conn(0x7f5e840ad580 legacy=0x7f5e840b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e8359e700 1 -- 172.21.15.57:0/2756924584 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840af180 con 0x7f5e84140400 2021-06-25T04:55:24.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e8359e700 1 --2- 172.21.15.57:0/2756924584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e84140400 0x7f5e84140890 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f5e840aeb60 tx=0x7f5e7c009290).ready entity=mon.0 client_cookie=82e23f7a1be41910 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:24.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e81d9b700 1 -- 172.21.15.57:0/2756924584 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e7c00b860 con 0x7f5e84140400 2021-06-25T04:55:24.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e81d9b700 1 -- 172.21.15.57:0/2756924584 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c00b9c0 con 0x7f5e84140400 2021-06-25T04:55:24.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e81d9b700 1 -- 172.21.15.57:0/2756924584 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e7c00bb30 con 0x7f5e84140400 2021-06-25T04:55:24.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 -- 172.21.15.57:0/2756924584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e84140400 msgr2=0x7f5e84140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 --2- 172.21.15.57:0/2756924584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e84140400 0x7f5e84140890 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f5e840aeb60 tx=0x7f5e7c009290).stop 2021-06-25T04:55:24.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 -- 172.21.15.57:0/2756924584 shutdown_connections 2021-06-25T04:55:24.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 --2- 172.21.15.57:0/2756924584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e84140400 0x7f5e84140890 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 --2- 172.21.15.57:0/2756924584 >> v2:172.21.15.87:3300/0 conn(0x7f5e840612e0 0x7f5e840616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 -- 172.21.15.57:0/2756924584 >> 172.21.15.57:0/2756924584 conn(0x7f5e84066da0 msgr2=0x7f5e84067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:24.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 -- 172.21.15.57:0/2756924584 shutdown_connections 2021-06-25T04:55:24.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 -- 172.21.15.57:0/2756924584 wait complete. 2021-06-25T04:55:24.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 Processor -- start 2021-06-25T04:55:24.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 -- start start 2021-06-25T04:55:24.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e840612e0 0x7f5e841426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e840ad580 0x7f5e841544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e84140400 0x7f5e841549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840616c0 con 0x7f5e840ad580 2021-06-25T04:55:24.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84153830 con 0x7f5e840612e0 2021-06-25T04:55:24.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e88932700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84153ad0 con 0x7f5e84140400 2021-06-25T04:55:24.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e8259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e840ad580 0x7f5e841544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e8259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e840ad580 0x7f5e841544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41658/0 (socket says 172.21.15.57:41658) 2021-06-25T04:55:24.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e8259c700 1 -- 172.21.15.57:0/2778654832 learned_addr learned my addr 172.21.15.57:0/2778654832 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:24.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e82d9d700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e840612e0 0x7f5e841426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.040+0000 7f5e8359e700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e84140400 0x7f5e841549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e8259c700 1 -- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e84140400 msgr2=0x7f5e841549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e8259c700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e84140400 0x7f5e841549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e8259c700 1 -- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e840612e0 msgr2=0x7f5e841426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e8259c700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e840612e0 0x7f5e841426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e8259c700 1 -- 172.21.15.57:0/2778654832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c009530 con 0x7f5e840ad580 2021-06-25T04:55:24.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e82d9d700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e840612e0 0x7f5e841426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:24.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e8259c700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e840ad580 0x7f5e841544b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f5e840ae0e0 tx=0x7f5e6c007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:24.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e7bfff700 1 -- 172.21.15.57:0/2778654832 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e6c00ce30 con 0x7f5e840ad580 2021-06-25T04:55:24.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e7bfff700 1 -- 172.21.15.57:0/2778654832 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c007240 con 0x7f5e840ad580 2021-06-25T04:55:24.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e88932700 1 -- 172.21.15.57:0/2778654832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e84153d70 con 0x7f5e840ad580 2021-06-25T04:55:24.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e7bfff700 1 -- 172.21.15.57:0/2778654832 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e6c006700 con 0x7f5e840ad580 2021-06-25T04:55:24.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e88932700 1 -- 172.21.15.57:0/2778654832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e84143290 con 0x7f5e840ad580 2021-06-25T04:55:24.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e7bfff700 1 -- 172.21.15.57:0/2778654832 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5e6c010030 con 0x7f5e840ad580 2021-06-25T04:55:24.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e88932700 1 -- 172.21.15.57:0/2778654832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e84057310 con 0x7f5e840ad580 2021-06-25T04:55:24.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e7bfff700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e68055450 0x7f5e68057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e7bfff700 1 -- 172.21.15.57:0/2778654832 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5e6c06db50 con 0x7f5e840ad580 2021-06-25T04:55:24.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.044+0000 7f5e82d9d700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e68055450 0x7f5e68057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.048+0000 7f5e82d9d700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e68055450 0x7f5e68057910 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f5e7400b000 tx=0x7f5e74008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:24.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.052+0000 7f5e7bfff700 1 -- 172.21.15.57:0/2778654832 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5e6c043d00 con 0x7f5e840ad580 2021-06-25T04:55:24.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.220+0000 7f5e88932700 1 -- 172.21.15.57:0/2778654832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5e8405f1b0 con 0x7f5e840ad580 2021-06-25T04:55:24.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.416+0000 7f5e7bfff700 1 -- 172.21.15.57:0/2778654832 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v52) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5e6c047320 con 0x7f5e840ad580 2021-06-25T04:55:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 -- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e68055450 msgr2=0x7f5e68057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e68055450 0x7f5e68057910 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f5e7400b000 tx=0x7f5e74008040).stop 2021-06-25T04:55:24.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 -- 172.21.15.57:0/2778654832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e840ad580 msgr2=0x7f5e841544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e840ad580 0x7f5e841544b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f5e840ae0e0 tx=0x7f5e6c007bb0).stop 2021-06-25T04:55:24.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 -- 172.21.15.57:0/2778654832 shutdown_connections 2021-06-25T04:55:24.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5e68055450 0x7f5e68057910 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e84140400 0x7f5e841549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e840ad580 0x7f5e841544b0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 --2- 172.21.15.57:0/2778654832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e840612e0 0x7f5e841426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 -- 172.21.15.57:0/2778654832 >> 172.21.15.57:0/2778654832 conn(0x7f5e84066da0 msgr2=0x7f5e840b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:24.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 -- 172.21.15.57:0/2778654832 shutdown_connections 2021-06-25T04:55:24.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.420+0000 7f5e88932700 1 -- 172.21.15.57:0/2778654832 wait complete. 2021-06-25T04:55:24.439 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fe0012e7700 1 Processor -- start 2021-06-25T04:55:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fe0012e7700 1 -- start start 2021-06-25T04:55:24.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fe0012e7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0af920 0x7fdffc0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fe0012e7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdffc0afd00 0x7fdffc13fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fe0012e7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc0ad560 con 0x7fdffc0b04b0 2021-06-25T04:55:24.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fe0012e7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc0af420 con 0x7fdffc0afd00 2021-06-25T04:55:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fe0012e7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0ad020 con 0x7fdffc0af920 2021-06-25T04:55:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fdffaffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0af920 0x7fdffc0b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fdffaffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0af920 0x7fdffc0b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:52828/0 (socket says 172.21.15.57:52828) 2021-06-25T04:55:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fdffaffd700 1 -- 172.21.15.57:0/1603081125 learned_addr learned my addr 172.21.15.57:0/1603081125 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:24.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fdff27fc700 1 --1- 172.21.15.57:0/1603081125 >> v1:172.21.15.87:6789/0 conn(0x7fdffc0b04b0 0x7fdffc0b2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:59632/0 (socket says 172.21.15.57:59632) 2021-06-25T04:55:24.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.544+0000 7fdffb7fe700 1 --2- 172.21.15.57:0/1603081125 >> v2:172.21.15.87:3300/0 conn(0x7fdffc0afd00 0x7fdffc13fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fdffaffd700 1 -- 172.21.15.57:0/1603081125 >> v2:172.21.15.87:3300/0 conn(0x7fdffc0afd00 msgr2=0x7fdffc13fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fdffaffd700 1 --2- 172.21.15.57:0/1603081125 >> v2:172.21.15.87:3300/0 conn(0x7fdffc0afd00 0x7fdffc13fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fdffaffd700 1 -- 172.21.15.57:0/1603081125 >> v1:172.21.15.87:6789/0 conn(0x7fdffc0b04b0 legacy=0x7fdffc0b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fdffaffd700 1 -- 172.21.15.57:0/1603081125 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0ad2c0 con 0x7fdffc0af920 2021-06-25T04:55:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fdffaffd700 1 --2- 172.21.15.57:0/1603081125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0af920 0x7fdffc0b1b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fdfec002f70 tx=0x7fdfec006eb0).ready entity=mon.2 client_cookie=7fbea10af984f975 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:24.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fdffa7fc700 1 -- 172.21.15.57:0/1603081125 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfec00d570 con 0x7fdffc0af920 2021-06-25T04:55:24.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fdffa7fc700 1 -- 172.21.15.57:0/1603081125 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec000e90 con 0x7fdffc0af920 2021-06-25T04:55:24.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fdffa7fc700 1 -- 172.21.15.57:0/1603081125 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfec00d900 con 0x7fdffc0af920 2021-06-25T04:55:24.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fe0012e7700 1 -- 172.21.15.57:0/1603081125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0af920 msgr2=0x7fdffc0b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fe0012e7700 1 --2- 172.21.15.57:0/1603081125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0af920 0x7fdffc0b1b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fdfec002f70 tx=0x7fdfec006eb0).stop 2021-06-25T04:55:24.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fe0012e7700 1 -- 172.21.15.57:0/1603081125 shutdown_connections 2021-06-25T04:55:24.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fe0012e7700 1 --2- 172.21.15.57:0/1603081125 >> v2:172.21.15.87:3300/0 conn(0x7fdffc0afd00 0x7fdffc13fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fe0012e7700 1 --2- 172.21.15.57:0/1603081125 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0af920 0x7fdffc0b1b90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fe0012e7700 1 -- 172.21.15.57:0/1603081125 >> 172.21.15.57:0/1603081125 conn(0x7fdffc05cce0 msgr2=0x7fdffc062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:24.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fe0012e7700 1 -- 172.21.15.57:0/1603081125 shutdown_connections 2021-06-25T04:55:24.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.548+0000 7fe0012e7700 1 -- 172.21.15.57:0/1603081125 wait complete. 2021-06-25T04:55:24.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fe0012e7700 1 Processor -- start 2021-06-25T04:55:24.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fe0012e7700 1 -- start start 2021-06-25T04:55:24.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fe0012e7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc0af920 0x7fdffc0a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fe0012e7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0afd00 0x7fdffc066490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fe0012e7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b04b0 0x7fdffc139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fe0012e7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc142570 con 0x7fdffc0af920 2021-06-25T04:55:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fe0012e7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc13f5f0 con 0x7fdffc0b04b0 2021-06-25T04:55:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fe0012e7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc13f890 con 0x7fdffc0afd00 2021-06-25T04:55:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdffaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc0af920 0x7fdffc0a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdffaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc0af920 0x7fdffc0a67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41670/0 (socket says 172.21.15.57:41670) 2021-06-25T04:55:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdffaffd700 1 -- 172.21.15.57:0/3492498837 learned_addr learned my addr 172.21.15.57:0/3492498837 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdffb7fe700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b04b0 0x7fdffc139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdff27fc700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0afd00 0x7fdffc066490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdffaffd700 1 -- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0afd00 msgr2=0x7fdffc066490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdffaffd700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0afd00 0x7fdffc066490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdffaffd700 1 -- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b04b0 msgr2=0x7fdffc139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdffaffd700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b04b0 0x7fdffc139eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdffaffd700 1 -- 172.21.15.57:0/3492498837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec00b1e0 con 0x7fdffc0af920 2021-06-25T04:55:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdff27fc700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0afd00 0x7fdffc066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.552+0000 7fdffaffd700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc0af920 0x7fdffc0a67f0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fdfec002f70 tx=0x7fdfec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.556+0000 7fdff8ff9700 1 -- 172.21.15.57:0/3492498837 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfec011760 con 0x7fdffc0af920 2021-06-25T04:55:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.556+0000 7fdff8ff9700 1 -- 172.21.15.57:0/3492498837 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec0118c0 con 0x7fdffc0af920 2021-06-25T04:55:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.556+0000 7fdff8ff9700 1 -- 172.21.15.57:0/3492498837 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfec011c20 con 0x7fdffc0af920 2021-06-25T04:55:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.556+0000 7fe0012e7700 1 -- 172.21.15.57:0/3492498837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc13fb30 con 0x7fdffc0af920 2021-06-25T04:55:24.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.556+0000 7fe0012e7700 1 -- 172.21.15.57:0/3492498837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc13e590 con 0x7fdffc0af920 2021-06-25T04:55:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.556+0000 7fdff8ff9700 1 -- 172.21.15.57:0/3492498837 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdfec00f070 con 0x7fdffc0af920 2021-06-25T04:55:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.556+0000 7fe0012e7700 1 -- 172.21.15.57:0/3492498837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdffc057310 con 0x7fdffc0af920 2021-06-25T04:55:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.556+0000 7fdff8ff9700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfe0055450 0x7fdfe0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.556+0000 7fdff8ff9700 1 -- 172.21.15.57:0/3492498837 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdfec06f5a0 con 0x7fdffc0af920 2021-06-25T04:55:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.556+0000 7fdff27fc700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfe0055450 0x7fdfe0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.560+0000 7fdff27fc700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfe0055450 0x7fdfe0057910 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fdfe400b000 tx=0x7fdfe40070e0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.564+0000 7fdff8ff9700 1 -- 172.21.15.57:0/3492498837 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdfec045750 con 0x7fdffc0af920 2021-06-25T04:55:24.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.732+0000 7fe0012e7700 1 -- 172.21.15.57:0/3492498837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdffc05d720 con 0x7fdffc0af920 2021-06-25T04:55:24.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.732+0000 7fdff8ff9700 1 -- 172.21.15.57:0/3492498837 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fdfec006a40 con 0x7fdffc0af920 2021-06-25T04:55:24.737 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:24.738 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":52,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3265820466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3265820466},{"type":"v1","addr":"172.21.15.87:6835","nonce":3265820466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51},{"gid":7323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/994003328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":994003328},{"type":"v1","addr":"172.21.15.57:6833","nonce":994003328}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:55:23.381147+0000","modified":"2021-06-25T04:55:24.413073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7326":{"gid":7326,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/4260642378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4260642378},{"type":"v1","addr":"172.21.15.57:6835","nonce":4260642378}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-06-25T04:55:24.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 -- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfe0055450 msgr2=0x7fdfe0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfe0055450 0x7fdfe0057910 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fdfe400b000 tx=0x7fdfe40070e0).stop 2021-06-25T04:55:24.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 -- 172.21.15.57:0/3492498837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc0af920 msgr2=0x7fdffc0a67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc0af920 0x7fdffc0a67f0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fdfec002f70 tx=0x7fdfec015000).stop 2021-06-25T04:55:24.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 -- 172.21.15.57:0/3492498837 shutdown_connections 2021-06-25T04:55:24.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdfe0055450 0x7fdfe0057910 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdffc0b04b0 0x7fdffc139eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdffc0afd00 0x7fdffc066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 --2- 172.21.15.57:0/3492498837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc0af920 0x7fdffc0a67f0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 -- 172.21.15.57:0/3492498837 >> 172.21.15.57:0/3492498837 conn(0x7fdffc05cce0 msgr2=0x7fdffc05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:24.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 -- 172.21.15.57:0/3492498837 shutdown_connections 2021-06-25T04:55:24.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.736+0000 7fe0012e7700 1 -- 172.21.15.57:0/3492498837 wait complete. 2021-06-25T04:55:24.743 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 52 2021-06-25T04:55:24.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:24.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 Processor -- start 2021-06-25T04:55:24.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 -- start start 2021-06-25T04:55:24.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79980b5460 0x7f79980af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7998147560 0x7f79980acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79980b5840 con 0x7f79980b05d0 2021-06-25T04:55:24.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79981452a0 con 0x7f7998147560 2021-06-25T04:55:24.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79980adfb0 con 0x7f79980b5460 2021-06-25T04:55:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f79967fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f79980b05d0 0x7f7998067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58896/0 (socket says 172.21.15.57:58896) 2021-06-25T04:55:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f79967fc700 1 -- 172.21.15.57:0/225859535 learned_addr learned my addr 172.21.15.57:0/225859535 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f79977fe700 1 --2- 172.21.15.57:0/225859535 >> v2:172.21.15.87:3300/0 conn(0x7f7998147560 0x7f79980acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7996ffd700 1 --2- 172.21.15.57:0/225859535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79980b5460 0x7f79980af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7995ffb700 1 -- 172.21.15.57:0/225859535 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234327132 0 0) 0x7f79980b5840 con 0x7f79980b05d0 2021-06-25T04:55:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7995ffb700 1 -- 172.21.15.57:0/225859535 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f797c003260 con 0x7f79980b05d0 2021-06-25T04:55:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f79977fe700 1 -- 172.21.15.57:0/225859535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79980b5460 msgr2=0x7f79980af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f79977fe700 1 --2- 172.21.15.57:0/225859535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79980b5460 0x7f79980af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f79977fe700 1 -- 172.21.15.57:0/225859535 >> v1:172.21.15.57:6789/0 conn(0x7f79980b05d0 legacy=0x7f7998067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f79977fe700 1 -- 172.21.15.57:0/225859535 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79980ac7c0 con 0x7f7998147560 2021-06-25T04:55:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7995ffb700 1 -- 172.21.15.57:0/225859535 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 7033681 0 0) 0x7f797c003260 con 0x7f79980b05d0 2021-06-25T04:55:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f79977fe700 1 --2- 172.21.15.57:0/225859535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7998147560 0x7f79980acc20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f798c001800 tx=0x7f7990006df0).ready entity=mon.1 client_cookie=b31c7169544489e9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7995ffb700 1 -- 172.21.15.57:0/225859535 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f798c001660 con 0x7f7998147560 2021-06-25T04:55:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7995ffb700 1 -- 172.21.15.57:0/225859535 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7990000e90 con 0x7f7998147560 2021-06-25T04:55:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7995ffb700 1 -- 172.21.15.57:0/225859535 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7990012460 con 0x7f7998147560 2021-06-25T04:55:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 -- 172.21.15.57:0/225859535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7998147560 msgr2=0x7f79980acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 --2- 172.21.15.57:0/225859535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7998147560 0x7f79980acc20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f798c001800 tx=0x7f7990006df0).stop 2021-06-25T04:55:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 -- 172.21.15.57:0/225859535 shutdown_connections 2021-06-25T04:55:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 --2- 172.21.15.57:0/225859535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7998147560 0x7f79980acc20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 --2- 172.21.15.57:0/225859535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79980b5460 0x7f79980af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 -- 172.21.15.57:0/225859535 >> 172.21.15.57:0/225859535 conn(0x7f7998062520 msgr2=0x7f7998062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 -- 172.21.15.57:0/225859535 shutdown_connections 2021-06-25T04:55:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.848+0000 7f7997fff700 1 -- 172.21.15.57:0/225859535 wait complete. 2021-06-25T04:55:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7997fff700 1 Processor -- start 2021-06-25T04:55:24.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7997fff700 1 -- start start 2021-06-25T04:55:24.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7997fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79980b05d0 0x7f79980b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7997fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79980b5460 0x7f79980b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7997fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7998147560 0x7f79980b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7997fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79981566b0 con 0x7f79980b05d0 2021-06-25T04:55:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7997fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7998146db0 con 0x7f7998147560 2021-06-25T04:55:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7997fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79980b35d0 con 0x7f79980b5460 2021-06-25T04:55:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7996ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79980b05d0 0x7f79980b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7996ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79980b05d0 0x7f79980b3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41684/0 (socket says 172.21.15.57:41684) 2021-06-25T04:55:24.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7996ffd700 1 -- 172.21.15.57:0/2011051383 learned_addr learned my addr 172.21.15.57:0/2011051383 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:24.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f79977fe700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7998147560 0x7f79980b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7996ffd700 1 -- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79980b5460 msgr2=0x7f79980b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f79967fc700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79980b5460 0x7f79980b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7996ffd700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79980b5460 0x7f79980b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7996ffd700 1 -- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7998147560 msgr2=0x7f79980b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7996ffd700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7998147560 0x7f79980b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7996ffd700 1 -- 172.21.15.57:0/2011051383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799000b180 con 0x7f79980b05d0 2021-06-25T04:55:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f79977fe700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7998147560 0x7f79980b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f79967fc700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79980b5460 0x7f79980b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7996ffd700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79980b05d0 0x7f79980b3b80 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f799814be40 tx=0x7f79880091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7987fff700 1 -- 172.21.15.57:0/2011051383 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f798800c9d0 con 0x7f79980b05d0 2021-06-25T04:55:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7987fff700 1 -- 172.21.15.57:0/2011051383 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798800cb30 con 0x7f79980b05d0 2021-06-25T04:55:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7997fff700 1 -- 172.21.15.57:0/2011051383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799814bf20 con 0x7f79980b05d0 2021-06-25T04:55:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7987fff700 1 -- 172.21.15.57:0/2011051383 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f798800ce90 con 0x7f79980b05d0 2021-06-25T04:55:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.852+0000 7f7997fff700 1 -- 172.21.15.57:0/2011051383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799814e380 con 0x7f79980b05d0 2021-06-25T04:55:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.856+0000 7f7997fff700 1 -- 172.21.15.57:0/2011051383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7998057310 con 0x7f79980b05d0 2021-06-25T04:55:24.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.856+0000 7f7987fff700 1 -- 172.21.15.57:0/2011051383 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7988022070 con 0x7f79980b05d0 2021-06-25T04:55:24.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.856+0000 7f7987fff700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f79740554e0 0x7f79740579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:24.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.856+0000 7f7987fff700 1 -- 172.21.15.57:0/2011051383 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f798806e650 con 0x7f79980b05d0 2021-06-25T04:55:24.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.856+0000 7f79967fc700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f79740554e0 0x7f79740579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:24.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.856+0000 7f79967fc700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f79740554e0 0x7f79740579a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f798c008000 tx=0x7f798c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:24.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.864+0000 7f7987fff700 1 -- 172.21.15.57:0/2011051383 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7988044800 con 0x7f79980b05d0 2021-06-25T04:55:24.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.992+0000 7f7997fff700 1 -- 172.21.15.57:0/2011051383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7998060e50 con 0x7f79980b05d0 2021-06-25T04:55:24.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.992+0000 7f7987fff700 1 -- 172.21.15.57:0/2011051383 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f7988047e20 con 0x7f79980b05d0 2021-06-25T04:55:24.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:24.999 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":108,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:24.383836+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:55:21.803828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-06-25T04:55:22.740631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 -- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f79740554e0 msgr2=0x7f79740579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f79740554e0 0x7f79740579a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f798c008000 tx=0x7f798c009040).stop 2021-06-25T04:55:25.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 -- 172.21.15.57:0/2011051383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79980b05d0 msgr2=0x7f79980b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79980b05d0 0x7f79980b3b80 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f799814be40 tx=0x7f79880091d0).stop 2021-06-25T04:55:25.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 -- 172.21.15.57:0/2011051383 shutdown_connections 2021-06-25T04:55:25.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f79740554e0 0x7f79740579a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7998147560 0x7f79980b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79980b5460 0x7f79980b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 --2- 172.21.15.57:0/2011051383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79980b05d0 0x7f79980b3b80 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 -- 172.21.15.57:0/2011051383 >> 172.21.15.57:0/2011051383 conn(0x7f7998062520 msgr2=0x7f79980acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:25.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 -- 172.21.15.57:0/2011051383 shutdown_connections 2021-06-25T04:55:25.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:24.996+0000 7f7997fff700 1 -- 172.21.15.57:0/2011051383 wait complete. 2021-06-25T04:55:25.014 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:55:25.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259c5dd700 1 Processor -- start 2021-06-25T04:55:25.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259c5dd700 1 -- start start 2021-06-25T04:55:25.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259c5dd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f25940b3460 0x7f2594143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259c5dd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25940af740 0x7f25941400d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259c5dd700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25940b3840 con 0x7f25940a9f00 2021-06-25T04:55:25.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259c5dd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2594144220 con 0x7f25940b3460 2021-06-25T04:55:25.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259c5dd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2594146970 con 0x7f25940af740 2021-06-25T04:55:25.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259a379700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f25940b3460 0x7f2594143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259a379700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f25940b3460 0x7f2594143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41692/0 (socket says 172.21.15.57:41692) 2021-06-25T04:55:25.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259a379700 1 -- 172.21.15.57:0/3863531246 learned_addr learned my addr 172.21.15.57:0/3863531246 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:25.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259ab7a700 1 --2- 172.21.15.57:0/3863531246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25940af740 0x7f25941400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259a379700 1 -- 172.21.15.57:0/3863531246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25940af740 msgr2=0x7f25941400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:25.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259a379700 1 --2- 172.21.15.57:0/3863531246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25940af740 0x7f25941400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259a379700 1 -- 172.21.15.57:0/3863531246 >> v1:172.21.15.87:6789/0 conn(0x7f25940a9f00 legacy=0x7f25940af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259a379700 1 -- 172.21.15.57:0/3863531246 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2594146c10 con 0x7f25940b3460 2021-06-25T04:55:25.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.128+0000 7f259a379700 1 --2- 172.21.15.57:0/3863531246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25940b3460 0x7f2594143d30 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f2590002f70 tx=0x7f2590006eb0).ready entity=mon.0 client_cookie=12baa1ce6abfc60e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:25.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.132+0000 7f2599377700 1 -- 172.21.15.57:0/3863531246 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f259000d570 con 0x7f25940b3460 2021-06-25T04:55:25.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.132+0000 7f2599377700 1 -- 172.21.15.57:0/3863531246 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590000e90 con 0x7f25940b3460 2021-06-25T04:55:25.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.132+0000 7f2599377700 1 -- 172.21.15.57:0/3863531246 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f259000d900 con 0x7f25940b3460 2021-06-25T04:55:25.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.132+0000 7f259c5dd700 1 -- 172.21.15.57:0/3863531246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25940b3460 msgr2=0x7f2594143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.132+0000 7f259c5dd700 1 --2- 172.21.15.57:0/3863531246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25940b3460 0x7f2594143d30 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f2590002f70 tx=0x7f2590006eb0).stop 2021-06-25T04:55:25.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.132+0000 7f259c5dd700 1 -- 172.21.15.57:0/3863531246 shutdown_connections 2021-06-25T04:55:25.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.132+0000 7f259c5dd700 1 --2- 172.21.15.57:0/3863531246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25940af740 0x7f25941400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.132+0000 7f259c5dd700 1 --2- 172.21.15.57:0/3863531246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25940b3460 0x7f2594143d30 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.132+0000 7f259c5dd700 1 -- 172.21.15.57:0/3863531246 >> 172.21.15.57:0/3863531246 conn(0x7f2594060780 msgr2=0x7f2594060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:25.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.132+0000 7f259c5dd700 1 -- 172.21.15.57:0/3863531246 shutdown_connections 2021-06-25T04:55:25.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.132+0000 7f259c5dd700 1 -- 172.21.15.57:0/3863531246 wait complete. 2021-06-25T04:55:25.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259c5dd700 1 Processor -- start 2021-06-25T04:55:25.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259c5dd700 1 -- start start 2021-06-25T04:55:25.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259c5dd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25940a9f00 0x7f2594143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259c5dd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25940af740 0x7f2594145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259c5dd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25940b3460 0x7f2594152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259c5dd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25940acf30 con 0x7f25940a9f00 2021-06-25T04:55:25.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259c5dd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25940aaa80 con 0x7f25940af740 2021-06-25T04:55:25.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259c5dd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25940aad20 con 0x7f25940b3460 2021-06-25T04:55:25.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259a379700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25940a9f00 0x7f2594143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259a379700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25940a9f00 0x7f2594143cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41698/0 (socket says 172.21.15.57:41698) 2021-06-25T04:55:25.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259a379700 1 -- 172.21.15.57:0/3554452503 learned_addr learned my addr 172.21.15.57:0/3554452503 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:25.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259ab7a700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25940b3460 0x7f2594152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f2599b78700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25940af740 0x7f2594145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259a379700 1 -- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25940b3460 msgr2=0x7f2594152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259a379700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25940b3460 0x7f2594152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259a379700 1 -- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25940af740 msgr2=0x7f2594145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259a379700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25940af740 0x7f2594145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259a379700 1 -- 172.21.15.57:0/3554452503 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259000b1e0 con 0x7f25940a9f00 2021-06-25T04:55:25.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f2599b78700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25940af740 0x7f2594145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:25.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259a379700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25940a9f00 0x7f2594143cb0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f2590002f70 tx=0x7f2590015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:25.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f25877fe700 1 -- 172.21.15.57:0/3554452503 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2590021070 con 0x7f25940a9f00 2021-06-25T04:55:25.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f25877fe700 1 -- 172.21.15.57:0/3554452503 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590000e90 con 0x7f25940a9f00 2021-06-25T04:55:25.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f25877fe700 1 -- 172.21.15.57:0/3554452503 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2590011880 con 0x7f25940a9f00 2021-06-25T04:55:25.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259c5dd700 1 -- 172.21.15.57:0/3554452503 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25940aafc0 con 0x7f25940a9f00 2021-06-25T04:55:25.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.136+0000 7f259c5dd700 1 -- 172.21.15.57:0/3554452503 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25940aa500 con 0x7f25940a9f00 2021-06-25T04:55:25.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.140+0000 7f259c5dd700 1 -- 172.21.15.57:0/3554452503 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2594057310 con 0x7f25940a9f00 2021-06-25T04:55:25.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.140+0000 7f25877fe700 1 -- 172.21.15.57:0/3554452503 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f259000f070 con 0x7f25940a9f00 2021-06-25T04:55:25.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.140+0000 7f25877fe700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2574055450 0x7f2574057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.140+0000 7f25877fe700 1 -- 172.21.15.57:0/3554452503 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f259006f1f0 con 0x7f25940a9f00 2021-06-25T04:55:25.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.140+0000 7f2599b78700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2574055450 0x7f2574057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.140+0000 7f2599b78700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2574055450 0x7f2574057910 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f258800b000 tx=0x7f2588009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:25.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.148+0000 7f25877fe700 1 -- 172.21.15.57:0/3554452503 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2590045290 con 0x7f25940a9f00 2021-06-25T04:55:25.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.316+0000 7f259c5dd700 1 -- 172.21.15.57:0/3554452503 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f25940b0a10 con 0x7f25940a9f00 2021-06-25T04:55:25.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.324+0000 7f25877fe700 1 -- 172.21.15.57:0/3554452503 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7f25900488b0 con 0x7f25940a9f00 2021-06-25T04:55:25.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 -- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2574055450 msgr2=0x7f2574057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2574055450 0x7f2574057910 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f258800b000 tx=0x7f2588009040).stop 2021-06-25T04:55:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 -- 172.21.15.57:0/3554452503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25940a9f00 msgr2=0x7f2594143cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25940a9f00 0x7f2594143cb0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f2590002f70 tx=0x7f2590015000).stop 2021-06-25T04:55:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 -- 172.21.15.57:0/3554452503 shutdown_connections 2021-06-25T04:55:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2574055450 0x7f2574057910 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25940b3460 0x7f2594152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25940af740 0x7f2594145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 --2- 172.21.15.57:0/3554452503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25940a9f00 0x7f2594143cb0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 -- 172.21.15.57:0/3554452503 >> 172.21.15.57:0/3554452503 conn(0x7f2594060780 msgr2=0x7f25941408b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 -- 172.21.15.57:0/3554452503 shutdown_connections 2021-06-25T04:55:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.328+0000 7f259c5dd700 1 -- 172.21.15.57:0/3554452503 wait complete. 2021-06-25T04:55:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:55:25.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:55:25.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 Processor -- start 2021-06-25T04:55:25.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 -- start start 2021-06-25T04:55:25.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d380ad580 0x7f0d380616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d380aecb0 con 0x7f0d380612e0 2021-06-25T04:55:25.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d380b6ee0 con 0x7f0d38140400 2021-06-25T04:55:25.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d380aeee0 con 0x7f0d380ad580 2021-06-25T04:55:25.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d36d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0d380612e0 0x7f0d380b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58924/0 (socket says 172.21.15.57:58924) 2021-06-25T04:55:25.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d36d9d700 1 -- 172.21.15.57:0/1150406717 learned_addr learned my addr 172.21.15.57:0/1150406717 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:25.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3659c700 1 --2- 172.21.15.57:0/1150406717 >> v2:172.21.15.57:3300/0 conn(0x7f0d380ad580 0x7f0d380616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d35d9b700 1 -- 172.21.15.57:0/1150406717 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093449036 0 0) 0x7f0d380aecb0 con 0x7f0d380612e0 2021-06-25T04:55:25.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d35d9b700 1 -- 172.21.15.57:0/1150406717 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d1c003260 con 0x7f0d380612e0 2021-06-25T04:55:25.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3659c700 1 -- 172.21.15.57:0/1150406717 >> v1:172.21.15.87:6789/0 conn(0x7f0d38140400 legacy=0x7f0d381464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3659c700 1 -- 172.21.15.57:0/1150406717 >> v1:172.21.15.57:6789/0 conn(0x7f0d380612e0 legacy=0x7f0d380b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3659c700 1 -- 172.21.15.57:0/1150406717 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380af180 con 0x7f0d380ad580 2021-06-25T04:55:25.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3659c700 1 --2- 172.21.15.57:0/1150406717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d380ad580 0x7f0d380616c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f0d2c002f70 tx=0x7f0d2c006df0).ready entity=mon.0 client_cookie=468e2a9324e2d676 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:25.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d35d9b700 1 -- 172.21.15.57:0/1150406717 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d2c00d610 con 0x7f0d380ad580 2021-06-25T04:55:25.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d35d9b700 1 -- 172.21.15.57:0/1150406717 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c000e90 con 0x7f0d380ad580 2021-06-25T04:55:25.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d35d9b700 1 -- 172.21.15.57:0/1150406717 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d2c00d960 con 0x7f0d380ad580 2021-06-25T04:55:25.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1150406717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d380ad580 msgr2=0x7f0d380616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 --2- 172.21.15.57:0/1150406717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d380ad580 0x7f0d380616c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f0d2c002f70 tx=0x7f0d2c006df0).stop 2021-06-25T04:55:25.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1150406717 shutdown_connections 2021-06-25T04:55:25.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 --2- 172.21.15.57:0/1150406717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d380ad580 0x7f0d380616c0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1150406717 >> 172.21.15.57:0/1150406717 conn(0x7f0d38066da0 msgr2=0x7f0d38067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:25.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1150406717 shutdown_connections 2021-06-25T04:55:25.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.452+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1150406717 wait complete. 2021-06-25T04:55:25.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3c82f700 1 Processor -- start 2021-06-25T04:55:25.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3c82f700 1 -- start start 2021-06-25T04:55:25.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3c82f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d380612e0 0x7f0d38152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3c82f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d380ad580 0x7f0d381465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3c82f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d38140400 0x7f0d38146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3c82f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380aa230 con 0x7f0d380ad580 2021-06-25T04:55:25.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3c82f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38146fa0 con 0x7f0d380612e0 2021-06-25T04:55:25.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3c82f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38145710 con 0x7f0d38140400 2021-06-25T04:55:25.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d380ad580 0x7f0d381465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d380ad580 0x7f0d381465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41714/0 (socket says 172.21.15.57:41714) 2021-06-25T04:55:25.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3659c700 1 -- 172.21.15.57:0/1021431052 learned_addr learned my addr 172.21.15.57:0/1021431052 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:25.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d36d9d700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d380612e0 0x7f0d38152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3759e700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d38140400 0x7f0d38146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3659c700 1 -- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d38140400 msgr2=0x7f0d38146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3659c700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d38140400 0x7f0d38146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3659c700 1 -- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d380612e0 msgr2=0x7f0d38152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3659c700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d380612e0 0x7f0d38152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.456+0000 7f0d3659c700 1 -- 172.21.15.57:0/1021431052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c00b180 con 0x7f0d380ad580 2021-06-25T04:55:25.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.460+0000 7f0d3659c700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d380ad580 0x7f0d381465c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f0d2c002f70 tx=0x7f0d2c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:25.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.460+0000 7f0d27fff700 1 -- 172.21.15.57:0/1021431052 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d2c006b20 con 0x7f0d380ad580 2021-06-25T04:55:25.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.460+0000 7f0d27fff700 1 -- 172.21.15.57:0/1021431052 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c00d290 con 0x7f0d380ad580 2021-06-25T04:55:25.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.460+0000 7f0d27fff700 1 -- 172.21.15.57:0/1021431052 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d2c01f440 con 0x7f0d380ad580 2021-06-25T04:55:25.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.460+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1021431052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d38145be0 con 0x7f0d380ad580 2021-06-25T04:55:25.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.460+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1021431052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d38153830 con 0x7f0d380ad580 2021-06-25T04:55:25.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.460+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1021431052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d38057310 con 0x7f0d380ad580 2021-06-25T04:55:25.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.460+0000 7f0d27fff700 1 -- 172.21.15.57:0/1021431052 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0d2c025020 con 0x7f0d380ad580 2021-06-25T04:55:25.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.460+0000 7f0d27fff700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d140554e0 0x7f0d140579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.460+0000 7f0d27fff700 1 -- 172.21.15.57:0/1021431052 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0d2c06eda0 con 0x7f0d380ad580 2021-06-25T04:55:25.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.464+0000 7f0d36d9d700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d140554e0 0x7f0d140579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.464+0000 7f0d36d9d700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d140554e0 0x7f0d140579a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f0d2800d000 tx=0x7f0d28009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:25.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.468+0000 7f0d27fff700 1 -- 172.21.15.57:0/1021431052 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0d2c044f50 con 0x7f0d380ad580 2021-06-25T04:55:25.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.636+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1021431052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0d380620c0 con 0x7f0d380ad580 2021-06-25T04:55:25.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d27fff700 1 -- 172.21.15.57:0/1021431052 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0d2c048570 con 0x7f0d380ad580 2021-06-25T04:55:25.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d140554e0 msgr2=0x7f0d140579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d140554e0 0x7f0d140579a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f0d2800d000 tx=0x7f0d28009040).stop 2021-06-25T04:55:25.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1021431052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d380ad580 msgr2=0x7f0d381465c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d380ad580 0x7f0d381465c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f0d2c002f70 tx=0x7f0d2c014000).stop 2021-06-25T04:55:25.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1021431052 shutdown_connections 2021-06-25T04:55:25.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d140554e0 0x7f0d140579a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d38140400 0x7f0d38146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d380ad580 0x7f0d381465c0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 --2- 172.21.15.57:0/1021431052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d380612e0 0x7f0d38152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1021431052 >> 172.21.15.57:0/1021431052 conn(0x7f0d38066da0 msgr2=0x7f0d3805bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:25.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1021431052 shutdown_connections 2021-06-25T04:55:25.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.648+0000 7f0d3c82f700 1 -- 172.21.15.57:0/1021431052 wait complete. 2021-06-25T04:55:25.657 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:55:25.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:25.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.768+0000 7f881208e700 1 Processor -- start 2021-06-25T04:55:25.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.768+0000 7f881208e700 1 -- start start 2021-06-25T04:55:25.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.768+0000 7f881208e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f880c0b5460 0x7f880c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.768+0000 7f881208e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f880c147560 0x7f880c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.768+0000 7f881208e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c1479b0 con 0x7f880c0b05d0 2021-06-25T04:55:25.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.768+0000 7f881208e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880c1452a0 con 0x7f880c147560 2021-06-25T04:55:25.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.768+0000 7f881208e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880c0adfb0 con 0x7f880c0b5460 2021-06-25T04:55:25.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881088b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f880c0b05d0 0x7f880c067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58938/0 (socket says 172.21.15.57:58938) 2021-06-25T04:55:25.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881088b700 1 -- 172.21.15.57:0/2617940443 learned_addr learned my addr 172.21.15.57:0/2617940443 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:25.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881188d700 1 --2- 172.21.15.57:0/2617940443 >> v2:172.21.15.57:3300/0 conn(0x7f880c147560 0x7f880c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f8803fff700 1 -- 172.21.15.57:0/2617940443 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830886485 0 0) 0x7f880c1479b0 con 0x7f880c0b05d0 2021-06-25T04:55:25.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881108c700 1 --2- 172.21.15.57:0/2617940443 >> v2:172.21.15.87:3300/0 conn(0x7f880c0b5460 0x7f880c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f8803fff700 1 -- 172.21.15.57:0/2617940443 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f0003260 con 0x7f880c0b05d0 2021-06-25T04:55:25.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f8803fff700 1 -- 172.21.15.57:0/2617940443 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1296345770 0 0) 0x7f87f0003260 con 0x7f880c0b05d0 2021-06-25T04:55:25.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881188d700 1 -- 172.21.15.57:0/2617940443 >> v2:172.21.15.87:3300/0 conn(0x7f880c0b5460 msgr2=0x7f880c0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:25.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881188d700 1 --2- 172.21.15.57:0/2617940443 >> v2:172.21.15.87:3300/0 conn(0x7f880c0b5460 0x7f880c0af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881188d700 1 -- 172.21.15.57:0/2617940443 >> v1:172.21.15.57:6789/0 conn(0x7f880c0b05d0 legacy=0x7f880c067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881188d700 1 -- 172.21.15.57:0/2617940443 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c0b5840 con 0x7f880c147560 2021-06-25T04:55:25.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881108c700 1 --2- 172.21.15.57:0/2617940443 >> v2:172.21.15.87:3300/0 conn(0x7f880c0b5460 0x7f880c0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:25.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881188d700 1 --2- 172.21.15.57:0/2617940443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f880c147560 0x7f880c0acc20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f8808001b80 tx=0x7f8804006df0).ready entity=mon.0 client_cookie=a93a8292dbbdb245 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:25.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f8803fff700 1 -- 172.21.15.57:0/2617940443 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88080019e0 con 0x7f880c147560 2021-06-25T04:55:25.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f8803fff700 1 -- 172.21.15.57:0/2617940443 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8804000e90 con 0x7f880c147560 2021-06-25T04:55:25.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881208e700 1 -- 172.21.15.57:0/2617940443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f880c147560 msgr2=0x7f880c0acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f8803fff700 1 -- 172.21.15.57:0/2617940443 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f880400d4a0 con 0x7f880c147560 2021-06-25T04:55:25.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881208e700 1 --2- 172.21.15.57:0/2617940443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f880c147560 0x7f880c0acc20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f8808001b80 tx=0x7f8804006df0).stop 2021-06-25T04:55:25.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881208e700 1 -- 172.21.15.57:0/2617940443 shutdown_connections 2021-06-25T04:55:25.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881208e700 1 --2- 172.21.15.57:0/2617940443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f880c147560 0x7f880c0acc20 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881208e700 1 --2- 172.21.15.57:0/2617940443 >> v2:172.21.15.87:3300/0 conn(0x7f880c0b5460 0x7f880c0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881208e700 1 -- 172.21.15.57:0/2617940443 >> 172.21.15.57:0/2617940443 conn(0x7f880c062520 msgr2=0x7f880c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:25.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881208e700 1 -- 172.21.15.57:0/2617940443 shutdown_connections 2021-06-25T04:55:25.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881208e700 1 -- 172.21.15.57:0/2617940443 wait complete. 2021-06-25T04:55:25.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881208e700 1 Processor -- start 2021-06-25T04:55:25.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.772+0000 7f881208e700 1 -- start start 2021-06-25T04:55:25.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881208e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f880c0b05d0 0x7f880c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881208e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880c0b5460 0x7f880c13f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881208e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f880c147560 0x7f880c13fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881208e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c140fc0 con 0x7f880c0b05d0 2021-06-25T04:55:25.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881208e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c145a80 con 0x7f880c147560 2021-06-25T04:55:25.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881208e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c145f20 con 0x7f880c0b5460 2021-06-25T04:55:25.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881108c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f880c0b05d0 0x7f880c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881108c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f880c0b05d0 0x7f880c1438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41728/0 (socket says 172.21.15.57:41728) 2021-06-25T04:55:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881108c700 1 -- 172.21.15.57:0/830627535 learned_addr learned my addr 172.21.15.57:0/830627535 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881088b700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880c0b5460 0x7f880c13f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881188d700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f880c147560 0x7f880c13fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881108c700 1 -- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880c0b5460 msgr2=0x7f880c13f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881108c700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880c0b5460 0x7f880c13f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881108c700 1 -- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f880c147560 msgr2=0x7f880c13fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881108c700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f880c147560 0x7f880c13fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881108c700 1 -- 172.21.15.57:0/830627535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880400b180 con 0x7f880c0b05d0 2021-06-25T04:55:25.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881108c700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f880c0b05d0 0x7f880c1438f0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f87fc006940 tx=0x7f87fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:25.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f88027fc700 1 -- 172.21.15.57:0/830627535 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87fc011780 con 0x7f880c0b05d0 2021-06-25T04:55:25.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f88027fc700 1 -- 172.21.15.57:0/830627535 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc0118e0 con 0x7f880c0b05d0 2021-06-25T04:55:25.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f88027fc700 1 -- 172.21.15.57:0/830627535 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87fc011c40 con 0x7f880c0b05d0 2021-06-25T04:55:25.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881208e700 1 -- 172.21.15.57:0/830627535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880c140060 con 0x7f880c0b05d0 2021-06-25T04:55:25.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881208e700 1 -- 172.21.15.57:0/830627535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c0b4b40 con 0x7f880c0b05d0 2021-06-25T04:55:25.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.776+0000 7f881208e700 1 -- 172.21.15.57:0/830627535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880c1411c0 con 0x7f880c0b05d0 2021-06-25T04:55:25.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.780+0000 7f88027fc700 1 -- 172.21.15.57:0/830627535 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f87fc01c460 con 0x7f880c0b05d0 2021-06-25T04:55:25.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.780+0000 7f88027fc700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87f4055450 0x7f87f4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:25.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.780+0000 7f88027fc700 1 -- 172.21.15.57:0/830627535 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f87fc06e170 con 0x7f880c0b05d0 2021-06-25T04:55:25.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.780+0000 7f881088b700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87f4055450 0x7f87f4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:25.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.780+0000 7f881088b700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87f4055450 0x7f87f4057910 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f880800d000 tx=0x7f8808002210).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:25.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.784+0000 7f88027fc700 1 -- 172.21.15.57:0/830627535 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f87fc0441b0 con 0x7f880c0b05d0 2021-06-25T04:55:25.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 -- 172.21.15.57:0/830627535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f880c057310 con 0x7f880c0b05d0 2021-06-25T04:55:25.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f88027fc700 1 -- 172.21.15.57:0/830627535 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f87fc0477d0 con 0x7f880c0b05d0 2021-06-25T04:55:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:25.956 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":52,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3265820466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3265820466},{"type":"v1","addr":"172.21.15.87:6835","nonce":3265820466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51},{"gid":7323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/994003328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":994003328},{"type":"v1","addr":"172.21.15.57:6833","nonce":994003328}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:55:23.381147+0000","modified":"2021-06-25T04:55:24.413073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7326":{"gid":7326,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/4260642378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4260642378},{"type":"v1","addr":"172.21.15.57:6835","nonce":4260642378}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-06-25T04:55:25.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 -- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87f4055450 msgr2=0x7f87f4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87f4055450 0x7f87f4057910 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f880800d000 tx=0x7f8808002210).stop 2021-06-25T04:55:25.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 -- 172.21.15.57:0/830627535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f880c0b05d0 msgr2=0x7f880c1438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:25.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f880c0b05d0 0x7f880c1438f0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f87fc006940 tx=0x7f87fc008040).stop 2021-06-25T04:55:25.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 -- 172.21.15.57:0/830627535 shutdown_connections 2021-06-25T04:55:25.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87f4055450 0x7f87f4057910 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f880c147560 0x7f880c13fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880c0b5460 0x7f880c13f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 --2- 172.21.15.57:0/830627535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f880c0b05d0 0x7f880c1438f0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:25.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 -- 172.21.15.57:0/830627535 >> 172.21.15.57:0/830627535 conn(0x7f880c062520 msgr2=0x7f880c147a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:25.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 -- 172.21.15.57:0/830627535 shutdown_connections 2021-06-25T04:55:25.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:25.952+0000 7f881208e700 1 -- 172.21.15.57:0/830627535 wait complete. 2021-06-25T04:55:25.962 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 52 2021-06-25T04:55:26.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:55:23.381147+0000', 'modified': '2021-06-25T04:55:24.413073+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7326}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7326': {'gid': 7326, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/4260642378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 4260642378}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 4260642378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:55:26.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:55:26.273 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-06-25T04:55:26.388 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":7326,"want_state":"up:active","state":"up:active","rank_uptime":2.993932101,"mdsmap_epoch":52,"osdmap_epoch":108,"osdmap_epoch_barrier":108,"uptime":7.3545821719999998} 2021-06-25T04:55:26.389 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 7326, "mdsmap_epoch": 52, "osdmap_epoch": 108, "osdmap_epoch_barrier": 108, "rank_uptime": 2.993932101, "state": "up:active", "uptime": 7.354582172, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:55:26.389 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:26.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.488+0000 7fed517f7700 1 Processor -- start 2021-06-25T04:55:26.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.488+0000 7fed517f7700 1 -- start start 2021-06-25T04:55:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.488+0000 7fed517f7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fed4c0acee0 0x7fed4c0ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.488+0000 7fed517f7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0b2bf0 con 0x7fed4c13c6a0 2021-06-25T04:55:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.488+0000 7fed517f7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0b1620 con 0x7fed4c0b2810 2021-06-25T04:55:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.488+0000 7fed517f7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c0b1170 con 0x7fed4c0acee0 2021-06-25T04:55:26.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.488+0000 7fed4b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fed4c13c6a0 0x7fed4c13cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58952/0 (socket says 172.21.15.57:58952) 2021-06-25T04:55:26.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.488+0000 7fed4b7fe700 1 -- 172.21.15.57:0/129849145 learned_addr learned my addr 172.21.15.57:0/129849145 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:26.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.488+0000 7fed50ff6700 1 --2- 172.21.15.57:0/129849145 >> v2:172.21.15.57:3300/0 conn(0x7fed4c0acee0 0x7fed4c0ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed4affd700 1 -- 172.21.15.57:0/129849145 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331679427 0 0) 0x7fed4c0b2bf0 con 0x7fed4c13c6a0 2021-06-25T04:55:26.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed4affd700 1 -- 172.21.15.57:0/129849145 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed2c004370 con 0x7fed4c13c6a0 2021-06-25T04:55:26.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed4affd700 1 -- 172.21.15.57:0/129849145 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909620936 0 0) 0x7fed4c0b1620 con 0x7fed4c0b2810 2021-06-25T04:55:26.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed50ff6700 1 -- 172.21.15.57:0/129849145 >> v1:172.21.15.87:6789/0 conn(0x7fed4c0b2810 legacy=0x7fed4c0b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed50ff6700 1 -- 172.21.15.57:0/129849145 >> v1:172.21.15.57:6789/0 conn(0x7fed4c13c6a0 legacy=0x7fed4c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed50ff6700 1 -- 172.21.15.57:0/129849145 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0b18c0 con 0x7fed4c0acee0 2021-06-25T04:55:26.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed50ff6700 1 --2- 172.21.15.57:0/129849145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed4c0acee0 0x7fed4c0ad300 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fed3c001ba0 tx=0x7fed44006df0).ready entity=mon.0 client_cookie=4bc8fdb941f056cf server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:26.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed4affd700 1 -- 172.21.15.57:0/129849145 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed3c001a00 con 0x7fed4c0acee0 2021-06-25T04:55:26.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed4affd700 1 -- 172.21.15.57:0/129849145 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44000e90 con 0x7fed4c0acee0 2021-06-25T04:55:26.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed517f7700 1 -- 172.21.15.57:0/129849145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed4c0acee0 msgr2=0x7fed4c0ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed4affd700 1 -- 172.21.15.57:0/129849145 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed44010960 con 0x7fed4c0acee0 2021-06-25T04:55:26.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed517f7700 1 --2- 172.21.15.57:0/129849145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed4c0acee0 0x7fed4c0ad300 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fed3c001ba0 tx=0x7fed44006df0).stop 2021-06-25T04:55:26.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed517f7700 1 -- 172.21.15.57:0/129849145 shutdown_connections 2021-06-25T04:55:26.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed517f7700 1 --2- 172.21.15.57:0/129849145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed4c0acee0 0x7fed4c0ad300 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed517f7700 1 -- 172.21.15.57:0/129849145 >> 172.21.15.57:0/129849145 conn(0x7fed4c0611f0 msgr2=0x7fed4c062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:26.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed517f7700 1 -- 172.21.15.57:0/129849145 shutdown_connections 2021-06-25T04:55:26.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.492+0000 7fed517f7700 1 -- 172.21.15.57:0/129849145 wait complete. 2021-06-25T04:55:26.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed517f7700 1 Processor -- start 2021-06-25T04:55:26.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed517f7700 1 -- start start 2021-06-25T04:55:26.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed517f7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed4c0acee0 0x7fed4c14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed517f7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c0b2810 0x7fed4c1369b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed517f7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed4c13c6a0 0x7fed4c0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed517f7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b36c0 con 0x7fed4c0acee0 2021-06-25T04:55:26.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed517f7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b47f0 con 0x7fed4c0b2810 2021-06-25T04:55:26.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed517f7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b38f0 con 0x7fed4c13c6a0 2021-06-25T04:55:26.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed4bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed4c0acee0 0x7fed4c14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed4bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed4c0acee0 0x7fed4c14e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41740/0 (socket says 172.21.15.57:41740) 2021-06-25T04:55:26.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed4bfff700 1 -- 172.21.15.57:0/620342038 learned_addr learned my addr 172.21.15.57:0/620342038 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:26.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed4b7fe700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c0b2810 0x7fed4c1369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed50ff6700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed4c13c6a0 0x7fed4c0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed4bfff700 1 -- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed4c13c6a0 msgr2=0x7fed4c0b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed4bfff700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed4c13c6a0 0x7fed4c0b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed4bfff700 1 -- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c0b2810 msgr2=0x7fed4c1369b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed4bfff700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c0b2810 0x7fed4c1369b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed4bfff700 1 -- 172.21.15.57:0/620342038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4400b180 con 0x7fed4c0acee0 2021-06-25T04:55:26.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed4b7fe700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c0b2810 0x7fed4c1369b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:26.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed4bfff700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed4c0acee0 0x7fed4c14e7c0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fed34000bc0 tx=0x7fed34007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:26.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed497fa700 1 -- 172.21.15.57:0/620342038 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed3400ce30 con 0x7fed4c0acee0 2021-06-25T04:55:26.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed497fa700 1 -- 172.21.15.57:0/620342038 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3400f470 con 0x7fed4c0acee0 2021-06-25T04:55:26.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed517f7700 1 -- 172.21.15.57:0/620342038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c140610 con 0x7fed4c0acee0 2021-06-25T04:55:26.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed497fa700 1 -- 172.21.15.57:0/620342038 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed3400f7d0 con 0x7fed4c0acee0 2021-06-25T04:55:26.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.496+0000 7fed517f7700 1 -- 172.21.15.57:0/620342038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c0b44c0 con 0x7fed4c0acee0 2021-06-25T04:55:26.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.500+0000 7fed517f7700 1 -- 172.21.15.57:0/620342038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c0b3ab0 con 0x7fed4c0acee0 2021-06-25T04:55:26.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.500+0000 7fed497fa700 1 -- 172.21.15.57:0/620342038 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fed34019030 con 0x7fed4c0acee0 2021-06-25T04:55:26.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.500+0000 7fed497fa700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed30055490 0x7fed30057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.500+0000 7fed497fa700 1 -- 172.21.15.57:0/620342038 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fed3406d240 con 0x7fed4c0acee0 2021-06-25T04:55:26.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.500+0000 7fed4b7fe700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed30055490 0x7fed30057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.500+0000 7fed4b7fe700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed30055490 0x7fed30057950 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fed3c00b000 tx=0x7fed3c000f40).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:26.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.508+0000 7fed497fa700 1 -- 172.21.15.57:0/620342038 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fed34042c50 con 0x7fed4c0acee0 2021-06-25T04:55:26.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.636+0000 7fed517f7700 1 -- 172.21.15.57:0/620342038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed4c0b42a0 con 0x7fed4c0acee0 2021-06-25T04:55:26.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.636+0000 7fed497fa700 1 -- 172.21.15.57:0/620342038 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fed34024fb0 con 0x7fed4c0acee0 2021-06-25T04:55:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:26.642 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":108,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:24.383836+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:55:21.803828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-06-25T04:55:22.740631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:26.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 -- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed30055490 msgr2=0x7fed30057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed30055490 0x7fed30057950 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fed3c00b000 tx=0x7fed3c000f40).stop 2021-06-25T04:55:26.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 -- 172.21.15.57:0/620342038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed4c0acee0 msgr2=0x7fed4c14e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed4c0acee0 0x7fed4c14e7c0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fed34000bc0 tx=0x7fed34007a90).stop 2021-06-25T04:55:26.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 -- 172.21.15.57:0/620342038 shutdown_connections 2021-06-25T04:55:26.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed30055490 0x7fed30057950 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed4c13c6a0 0x7fed4c0b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c0b2810 0x7fed4c1369b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 --2- 172.21.15.57:0/620342038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed4c0acee0 0x7fed4c14e7c0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 -- 172.21.15.57:0/620342038 >> 172.21.15.57:0/620342038 conn(0x7fed4c0611f0 msgr2=0x7fed4c1361e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:26.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 -- 172.21.15.57:0/620342038 shutdown_connections 2021-06-25T04:55:26.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.640+0000 7fed517f7700 1 -- 172.21.15.57:0/620342038 wait complete. 2021-06-25T04:55:26.656 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:55:21.803828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:55:22.740631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:55:26.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:55:26.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.764+0000 7fc7abfff700 1 Processor -- start 2021-06-25T04:55:26.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.764+0000 7fc7abfff700 1 -- start start 2021-06-25T04:55:26.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc7ac0b3000 0x7fc7ac065e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0a9bd0 0x7fc7ac060780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc7ac1432e0 0x7fc7ac143770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ac0648a0 con 0x7fc7ac1432e0 2021-06-25T04:55:26.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ac061d90 con 0x7fc7ac0b3000 2021-06-25T04:55:26.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac066e60 con 0x7fc7ac0a9bd0 2021-06-25T04:55:26.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7ab7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc7ac1432e0 0x7fc7ac143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7ab7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc7ac1432e0 0x7fc7ac143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41750/0 (socket says 172.21.15.57:41750) 2021-06-25T04:55:26.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7ab7fe700 1 -- 172.21.15.57:0/1763704591 learned_addr learned my addr 172.21.15.57:0/1763704591 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:26.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7aaffd700 1 --2- 172.21.15.57:0/1763704591 >> v2:172.21.15.87:3300/0 conn(0x7fc7ac0b3000 0x7fc7ac065e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7a3fff700 1 --2- 172.21.15.57:0/1763704591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0a9bd0 0x7fc7ac060780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7ab7fe700 1 -- 172.21.15.57:0/1763704591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0a9bd0 msgr2=0x7fc7ac060780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:26.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7ab7fe700 1 --2- 172.21.15.57:0/1763704591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0a9bd0 0x7fc7ac060780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7ab7fe700 1 -- 172.21.15.57:0/1763704591 >> v2:172.21.15.87:3300/0 conn(0x7fc7ac0b3000 msgr2=0x7fc7ac065e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:26.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7ab7fe700 1 --2- 172.21.15.57:0/1763704591 >> v2:172.21.15.87:3300/0 conn(0x7fc7ac0b3000 0x7fc7ac065e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7ab7fe700 1 -- 172.21.15.57:0/1763704591 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac0b33e0 con 0x7fc7ac1432e0 2021-06-25T04:55:26.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7aaffd700 1 --2- 172.21.15.57:0/1763704591 >> v2:172.21.15.87:3300/0 conn(0x7fc7ac0b3000 0x7fc7ac065e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:26.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7a3fff700 1 --2- 172.21.15.57:0/1763704591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0a9bd0 0x7fc7ac060780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:26.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7ab7fe700 1 --2- 172.21.15.57:0/1763704591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7ac1432e0 0x7fc7ac143770 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fc7a40032f0 tx=0x7fc7a4009290).ready entity=mon.0 client_cookie=1833b229731d16f9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:26.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7aa7fc700 1 -- 172.21.15.57:0/1763704591 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a400b870 con 0x7fc7ac1432e0 2021-06-25T04:55:26.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7aa7fc700 1 -- 172.21.15.57:0/1763704591 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a400b9d0 con 0x7fc7ac1432e0 2021-06-25T04:55:26.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7aa7fc700 1 -- 172.21.15.57:0/1763704591 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a400bb40 con 0x7fc7ac1432e0 2021-06-25T04:55:26.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 -- 172.21.15.57:0/1763704591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7ac1432e0 msgr2=0x7fc7ac143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 --2- 172.21.15.57:0/1763704591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7ac1432e0 0x7fc7ac143770 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fc7a40032f0 tx=0x7fc7a4009290).stop 2021-06-25T04:55:26.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 -- 172.21.15.57:0/1763704591 shutdown_connections 2021-06-25T04:55:26.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 --2- 172.21.15.57:0/1763704591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7ac1432e0 0x7fc7ac143770 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 --2- 172.21.15.57:0/1763704591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0a9bd0 0x7fc7ac060780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 --2- 172.21.15.57:0/1763704591 >> v2:172.21.15.87:3300/0 conn(0x7fc7ac0b3000 0x7fc7ac065e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 -- 172.21.15.57:0/1763704591 >> 172.21.15.57:0/1763704591 conn(0x7fc7ac0636a0 msgr2=0x7fc7ac063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:26.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 -- 172.21.15.57:0/1763704591 shutdown_connections 2021-06-25T04:55:26.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.768+0000 7fc7abfff700 1 -- 172.21.15.57:0/1763704591 wait complete. 2021-06-25T04:55:26.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7abfff700 1 Processor -- start 2021-06-25T04:55:26.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7abfff700 1 -- start start 2021-06-25T04:55:26.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7abfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac0a9bd0 0x7fc7ac0b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7abfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0b3000 0x7fc7ac150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7ac1432e0 0x7fc7ac151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7abfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac151960 con 0x7fc7ac1432e0 2021-06-25T04:55:26.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7abfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac0ad040 con 0x7fc7ac0a9bd0 2021-06-25T04:55:26.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7abfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac0af570 con 0x7fc7ac0b3000 2021-06-25T04:55:26.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7ab7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7ac1432e0 0x7fc7ac151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7ab7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7ac1432e0 0x7fc7ac151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41758/0 (socket says 172.21.15.57:41758) 2021-06-25T04:55:26.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7ab7fe700 1 -- 172.21.15.57:0/870449154 learned_addr learned my addr 172.21.15.57:0/870449154 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:26.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7aaffd700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac0a9bd0 0x7fc7ac0b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7a3fff700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0b3000 0x7fc7ac150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7ab7fe700 1 -- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0b3000 msgr2=0x7fc7ac150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7ab7fe700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0b3000 0x7fc7ac150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7ab7fe700 1 -- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac0a9bd0 msgr2=0x7fc7ac0b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7ab7fe700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac0a9bd0 0x7fc7ac0b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7ab7fe700 1 -- 172.21.15.57:0/870449154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4009530 con 0x7fc7ac1432e0 2021-06-25T04:55:26.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7a3fff700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0b3000 0x7fc7ac150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:26.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7aaffd700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac0a9bd0 0x7fc7ac0b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:26.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7ab7fe700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7ac1432e0 0x7fc7ac151470 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fc7a40032f0 tx=0x7fc7a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:26.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7a8ff9700 1 -- 172.21.15.57:0/870449154 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a4011cc0 con 0x7fc7ac1432e0 2021-06-25T04:55:26.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.772+0000 7fc7a8ff9700 1 -- 172.21.15.57:0/870449154 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4011e20 con 0x7fc7ac1432e0 2021-06-25T04:55:26.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.776+0000 7fc7abfff700 1 -- 172.21.15.57:0/870449154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ac0ad270 con 0x7fc7ac1432e0 2021-06-25T04:55:26.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.776+0000 7fc7a8ff9700 1 -- 172.21.15.57:0/870449154 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a401f610 con 0x7fc7ac1432e0 2021-06-25T04:55:26.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.776+0000 7fc7abfff700 1 -- 172.21.15.57:0/870449154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ac0afa70 con 0x7fc7ac1432e0 2021-06-25T04:55:26.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.776+0000 7fc7a8ff9700 1 -- 172.21.15.57:0/870449154 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc7a4026030 con 0x7fc7ac1432e0 2021-06-25T04:55:26.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.776+0000 7fc7abfff700 1 -- 172.21.15.57:0/870449154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ac057310 con 0x7fc7ac1432e0 2021-06-25T04:55:26.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.776+0000 7fc7a8ff9700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc790055340 0x7fc790057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:26.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.776+0000 7fc7a8ff9700 1 -- 172.21.15.57:0/870449154 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc7a406ea20 con 0x7fc7ac1432e0 2021-06-25T04:55:26.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.776+0000 7fc7aaffd700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc790055340 0x7fc790057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:26.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.776+0000 7fc7aaffd700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc790055340 0x7fc790057800 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fc79c00b000 tx=0x7fc79c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:26.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.784+0000 7fc7a8ff9700 1 -- 172.21.15.57:0/870449154 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc7a4044c10 con 0x7fc7ac1432e0 2021-06-25T04:55:26.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7abfff700 1 -- 172.21.15.57:0/870449154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc7ac0698a0 con 0x7fc7ac1432e0 2021-06-25T04:55:26.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7a8ff9700 1 -- 172.21.15.57:0/870449154 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v108) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc7a40150b0 con 0x7fc7ac1432e0 2021-06-25T04:55:26.916 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:55:26.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7abfff700 1 -- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc790055340 msgr2=0x7fc790057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7abfff700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc790055340 0x7fc790057800 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fc79c00b000 tx=0x7fc79c008040).stop 2021-06-25T04:55:26.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7abfff700 1 -- 172.21.15.57:0/870449154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7ac1432e0 msgr2=0x7fc7ac151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:26.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7abfff700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7ac1432e0 0x7fc7ac151470 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fc7a40032f0 tx=0x7fc7a4016000).stop 2021-06-25T04:55:26.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7abfff700 1 -- 172.21.15.57:0/870449154 shutdown_connections 2021-06-25T04:55:26.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7abfff700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc790055340 0x7fc790057800 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7abfff700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7ac1432e0 0x7fc7ac151470 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7abfff700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0b3000 0x7fc7ac150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7abfff700 1 --2- 172.21.15.57:0/870449154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac0a9bd0 0x7fc7ac0b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:26.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.912+0000 7fc7abfff700 1 -- 172.21.15.57:0/870449154 >> 172.21.15.57:0/870449154 conn(0x7fc7ac0636a0 msgr2=0x7fc7ac141310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:26.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.916+0000 7fc7abfff700 1 -- 172.21.15.57:0/870449154 shutdown_connections 2021-06-25T04:55:26.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:26.916+0000 7fc7abfff700 1 -- 172.21.15.57:0/870449154 wait complete. 2021-06-25T04:55:26.930 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:55:27.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 Processor -- start 2021-06-25T04:55:27.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 -- start start 2021-06-25T04:55:27.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa604146910 0x7fa6041401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa6040b4140 0x7fa6041406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa604143b20 con 0x7fa6040b4650 2021-06-25T04:55:27.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6041474d0 con 0x7fa604146910 2021-06-25T04:55:27.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa604143dc0 con 0x7fa6040b4140 2021-06-25T04:55:27.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa60259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa604146910 0x7fa6041401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa602d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa6040b4650 0x7fa6040b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58984/0 (socket says 172.21.15.57:58984) 2021-06-25T04:55:27.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa602d9d700 1 -- 172.21.15.57:0/350228358 learned_addr learned my addr 172.21.15.57:0/350228358 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:27.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa5f9d9b700 1 --2- 172.21.15.57:0/350228358 >> v2:172.21.15.87:3300/0 conn(0x7fa6040b4140 0x7fa6041406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa60259c700 1 -- 172.21.15.57:0/350228358 >> v2:172.21.15.87:3300/0 conn(0x7fa6040b4140 msgr2=0x7fa6041406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:27.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa60259c700 1 --2- 172.21.15.57:0/350228358 >> v2:172.21.15.87:3300/0 conn(0x7fa6040b4140 0x7fa6041406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa60259c700 1 -- 172.21.15.57:0/350228358 >> v1:172.21.15.57:6789/0 conn(0x7fa6040b4650 legacy=0x7fa6040b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa60259c700 1 -- 172.21.15.57:0/350228358 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6040b0c50 con 0x7fa604146910 2021-06-25T04:55:27.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa60259c700 1 --2- 172.21.15.57:0/350228358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa604146910 0x7fa6041401f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fa5f4002f70 tx=0x7fa5f4006df0).ready entity=mon.0 client_cookie=f2530f4e0cdb213f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa601d9b700 1 -- 172.21.15.57:0/350228358 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f400d570 con 0x7fa604146910 2021-06-25T04:55:27.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa601d9b700 1 -- 172.21.15.57:0/350228358 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4000e90 con 0x7fa604146910 2021-06-25T04:55:27.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa601d9b700 1 -- 172.21.15.57:0/350228358 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f400d8c0 con 0x7fa604146910 2021-06-25T04:55:27.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 -- 172.21.15.57:0/350228358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa604146910 msgr2=0x7fa6041401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 --2- 172.21.15.57:0/350228358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa604146910 0x7fa6041401f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fa5f4002f70 tx=0x7fa5f4006df0).stop 2021-06-25T04:55:27.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 -- 172.21.15.57:0/350228358 shutdown_connections 2021-06-25T04:55:27.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 --2- 172.21.15.57:0/350228358 >> v2:172.21.15.87:3300/0 conn(0x7fa6040b4140 0x7fa6041406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 --2- 172.21.15.57:0/350228358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa604146910 0x7fa6041401f0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 -- 172.21.15.57:0/350228358 >> 172.21.15.57:0/350228358 conn(0x7fa60405c450 msgr2=0x7fa60405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:27.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 -- 172.21.15.57:0/350228358 shutdown_connections 2021-06-25T04:55:27.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.036+0000 7fa608ce5700 1 -- 172.21.15.57:0/350228358 wait complete. 2021-06-25T04:55:27.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa608ce5700 1 Processor -- start 2021-06-25T04:55:27.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa608ce5700 1 -- start start 2021-06-25T04:55:27.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa608ce5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6040b4140 0x7fa6040b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa608ce5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6040b4650 0x7fa60413d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa608ce5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa604146910 0x7fa60413c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa608ce5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040af160 con 0x7fa6040b4650 2021-06-25T04:55:27.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa608ce5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60413b670 con 0x7fa604146910 2021-06-25T04:55:27.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa608ce5700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040b64e0 con 0x7fa6040b4140 2021-06-25T04:55:27.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5f9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6040b4650 0x7fa60413d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5f9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6040b4650 0x7fa60413d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41768/0 (socket says 172.21.15.57:41768) 2021-06-25T04:55:27.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5f9d9b700 1 -- 172.21.15.57:0/1620911028 learned_addr learned my addr 172.21.15.57:0/1620911028 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:27.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa60259c700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6040b4140 0x7fa6040b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa602d9d700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa604146910 0x7fa60413c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5f9d9b700 1 -- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6040b4140 msgr2=0x7fa6040b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5f9d9b700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6040b4140 0x7fa6040b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5f9d9b700 1 -- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa604146910 msgr2=0x7fa60413c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5f9d9b700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa604146910 0x7fa60413c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5f9d9b700 1 -- 172.21.15.57:0/1620911028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f400b180 con 0x7fa6040b4650 2021-06-25T04:55:27.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5f9d9b700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6040b4650 0x7fa60413d310 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7fa5ec00c000 tx=0x7fa5ec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5fbfff700 1 -- 172.21.15.57:0/1620911028 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5ec010780 con 0x7fa6040b4650 2021-06-25T04:55:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5fbfff700 1 -- 172.21.15.57:0/1620911028 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec00b3b0 con 0x7fa6040b4650 2021-06-25T04:55:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa608ce5700 1 -- 172.21.15.57:0/1620911028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6040b5e40 con 0x7fa6040b4650 2021-06-25T04:55:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa5fbfff700 1 -- 172.21.15.57:0/1620911028 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5ec010ad0 con 0x7fa6040b4650 2021-06-25T04:55:27.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.040+0000 7fa608ce5700 1 -- 172.21.15.57:0/1620911028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6040b52b0 con 0x7fa6040b4650 2021-06-25T04:55:27.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.044+0000 7fa608ce5700 1 -- 172.21.15.57:0/1620911028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6040b0060 con 0x7fa6040b4650 2021-06-25T04:55:27.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.044+0000 7fa5fbfff700 1 -- 172.21.15.57:0/1620911028 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa5ec010c30 con 0x7fa6040b4650 2021-06-25T04:55:27.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.044+0000 7fa5fbfff700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5e80554e0 0x7fa5e80579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.044+0000 7fa5fbfff700 1 -- 172.21.15.57:0/1620911028 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa5ec06e260 con 0x7fa6040b4650 2021-06-25T04:55:27.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.044+0000 7fa60259c700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5e80554e0 0x7fa5e80579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.044+0000 7fa60259c700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5e80554e0 0x7fa5e80579a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fa5f4019000 tx=0x7fa5f4014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.048+0000 7fa5fbfff700 1 -- 172.21.15.57:0/1620911028 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa5ec044310 con 0x7fa6040b4650 2021-06-25T04:55:27.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.180+0000 7fa608ce5700 1 -- 172.21.15.57:0/1620911028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa604057310 con 0x7fa6040b4650 2021-06-25T04:55:27.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.180+0000 7fa5fbfff700 1 -- 172.21.15.57:0/1620911028 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa5ec047930 con 0x7fa6040b4650 2021-06-25T04:55:27.184 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:27.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.180+0000 7fa608ce5700 1 -- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5e80554e0 msgr2=0x7fa5e80579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.180+0000 7fa608ce5700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5e80554e0 0x7fa5e80579a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fa5f4019000 tx=0x7fa5f4014000).stop 2021-06-25T04:55:27.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.180+0000 7fa608ce5700 1 -- 172.21.15.57:0/1620911028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6040b4650 msgr2=0x7fa60413d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.180+0000 7fa608ce5700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6040b4650 0x7fa60413d310 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7fa5ec00c000 tx=0x7fa5ec006df0).stop 2021-06-25T04:55:27.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.184+0000 7fa608ce5700 1 -- 172.21.15.57:0/1620911028 shutdown_connections 2021-06-25T04:55:27.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.184+0000 7fa608ce5700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5e80554e0 0x7fa5e80579a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.184+0000 7fa608ce5700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa604146910 0x7fa60413c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.184+0000 7fa608ce5700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6040b4650 0x7fa60413d310 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.184+0000 7fa608ce5700 1 --2- 172.21.15.57:0/1620911028 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6040b4140 0x7fa6040b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.184+0000 7fa608ce5700 1 -- 172.21.15.57:0/1620911028 >> 172.21.15.57:0/1620911028 conn(0x7fa60405c450 msgr2=0x7fa60413d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:27.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.184+0000 7fa608ce5700 1 -- 172.21.15.57:0/1620911028 shutdown_connections 2021-06-25T04:55:27.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.184+0000 7fa608ce5700 1 -- 172.21.15.57:0/1620911028 wait complete. 2021-06-25T04:55:27.198 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:55:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.304+0000 7f3df7d5b700 1 Processor -- start 2021-06-25T04:55:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.304+0000 7f3df7d5b700 1 -- start start 2021-06-25T04:55:27.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3df00aa260 0x7f3df014aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df0061950 con 0x7f3df00a9e80 2021-06-25T04:55:27.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df0061bf0 con 0x7f3df0060390 2021-06-25T04:55:27.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0060b50 con 0x7f3df00aa260 2021-06-25T04:55:27.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df5af7700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3df00a9e80 0x7f3df013cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58994/0 (socket says 172.21.15.57:58994) 2021-06-25T04:55:27.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df5af7700 1 -- 172.21.15.57:0/30012029 learned_addr learned my addr 172.21.15.57:0/30012029 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df62f8700 1 --2- 172.21.15.57:0/30012029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3df00aa260 0x7f3df014aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df4af5700 1 -- 172.21.15.57:0/30012029 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743711945 0 0) 0x7f3df0061950 con 0x7f3df00a9e80 2021-06-25T04:55:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df4af5700 1 -- 172.21.15.57:0/30012029 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd8003260 con 0x7f3df00a9e80 2021-06-25T04:55:27.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df4af5700 1 -- 172.21.15.57:0/30012029 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3665619005 0 0) 0x7f3dd8003260 con 0x7f3df00a9e80 2021-06-25T04:55:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df62f8700 1 -- 172.21.15.57:0/30012029 >> v1:172.21.15.87:6789/0 conn(0x7f3df0060390 legacy=0x7f3df013f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df62f8700 1 -- 172.21.15.57:0/30012029 >> v1:172.21.15.57:6789/0 conn(0x7f3df00a9e80 legacy=0x7f3df013cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df62f8700 1 -- 172.21.15.57:0/30012029 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0060df0 con 0x7f3df00aa260 2021-06-25T04:55:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df62f8700 1 --2- 172.21.15.57:0/30012029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3df00aa260 0x7f3df014aff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f3dec001800 tx=0x7f3de800a370).ready entity=mon.2 client_cookie=b4a0e7fa8d3bc96 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df4af5700 1 -- 172.21.15.57:0/30012029 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dec001660 con 0x7f3df00aa260 2021-06-25T04:55:27.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df4af5700 1 -- 172.21.15.57:0/30012029 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de800c870 con 0x7f3df00aa260 2021-06-25T04:55:27.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df4af5700 1 -- 172.21.15.57:0/30012029 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de800cbd0 con 0x7f3df00aa260 2021-06-25T04:55:27.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 -- 172.21.15.57:0/30012029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3df00aa260 msgr2=0x7f3df014aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 --2- 172.21.15.57:0/30012029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3df00aa260 0x7f3df014aff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f3dec001800 tx=0x7f3de800a370).stop 2021-06-25T04:55:27.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 -- 172.21.15.57:0/30012029 shutdown_connections 2021-06-25T04:55:27.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 --2- 172.21.15.57:0/30012029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3df00aa260 0x7f3df014aff0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 -- 172.21.15.57:0/30012029 >> 172.21.15.57:0/30012029 conn(0x7f3df00b2930 msgr2=0x7f3df00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 -- 172.21.15.57:0/30012029 shutdown_connections 2021-06-25T04:55:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 -- 172.21.15.57:0/30012029 wait complete. 2021-06-25T04:55:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.308+0000 7f3df7d5b700 1 Processor -- start 2021-06-25T04:55:27.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df7d5b700 1 -- start start 2021-06-25T04:55:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df7d5b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3df0060390 0x7f3df013fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df7d5b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df00a9e80 0x7f3df00ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df7d5b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3df00aa260 0x7f3df00adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df7d5b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00ad1a0 con 0x7f3df00a9e80 2021-06-25T04:55:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df7d5b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00af920 con 0x7f3df00aa260 2021-06-25T04:55:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df7d5b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00afbc0 con 0x7f3df0060390 2021-06-25T04:55:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df52f6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df00a9e80 0x7f3df00ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df52f6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df00a9e80 0x7f3df00ad600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41784/0 (socket says 172.21.15.57:41784) 2021-06-25T04:55:27.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df52f6700 1 -- 172.21.15.57:0/529777067 learned_addr learned my addr 172.21.15.57:0/529777067 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:27.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df62f8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3df00aa260 0x7f3df00adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df5af7700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3df0060390 0x7f3df013fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df52f6700 1 -- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3df0060390 msgr2=0x7f3df013fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df52f6700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3df0060390 0x7f3df013fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df52f6700 1 -- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3df00aa260 msgr2=0x7f3df00adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df52f6700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3df00aa260 0x7f3df00adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df52f6700 1 -- 172.21.15.57:0/529777067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de800a610 con 0x7f3df00a9e80 2021-06-25T04:55:27.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df52f6700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df00a9e80 0x7f3df00ad600 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f3df00b22e0 tx=0x7f3de0007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3ddeffd700 1 -- 172.21.15.57:0/529777067 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de0012400 con 0x7f3df00a9e80 2021-06-25T04:55:27.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3ddeffd700 1 -- 172.21.15.57:0/529777067 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0012560 con 0x7f3df00a9e80 2021-06-25T04:55:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df7d5b700 1 -- 172.21.15.57:0/529777067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df00afe60 con 0x7f3df00a9e80 2021-06-25T04:55:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3ddeffd700 1 -- 172.21.15.57:0/529777067 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de00128c0 con 0x7f3df00a9e80 2021-06-25T04:55:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.312+0000 7f3df7d5b700 1 -- 172.21.15.57:0/529777067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df00aed60 con 0x7f3df00a9e80 2021-06-25T04:55:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.316+0000 7f3df7d5b700 1 -- 172.21.15.57:0/529777067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df0057310 con 0x7f3df00a9e80 2021-06-25T04:55:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.316+0000 7f3ddeffd700 1 -- 172.21.15.57:0/529777067 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3de0019030 con 0x7f3df00a9e80 2021-06-25T04:55:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.316+0000 7f3ddeffd700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3dd0055450 0x7f3dd0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.316+0000 7f3ddeffd700 1 -- 172.21.15.57:0/529777067 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3de006d310 con 0x7f3df00a9e80 2021-06-25T04:55:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.316+0000 7f3df5af7700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3dd0055450 0x7f3dd0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.320+0000 7f3df5af7700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3dd0055450 0x7f3dd0057910 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f3dec00d000 tx=0x7f3dec001e90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.324+0000 7f3ddeffd700 1 -- 172.21.15.57:0/529777067 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3de0043350 con 0x7f3df00a9e80 2021-06-25T04:55:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 -- 172.21.15.57:0/529777067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3df00ac9b0 con 0x7f3df00a9e80 2021-06-25T04:55:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3ddeffd700 1 -- 172.21.15.57:0/529777067 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3de0046970 con 0x7f3df00a9e80 2021-06-25T04:55:27.456 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:27.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 -- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3dd0055450 msgr2=0x7f3dd0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3dd0055450 0x7f3dd0057910 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f3dec00d000 tx=0x7f3dec001e90).stop 2021-06-25T04:55:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 -- 172.21.15.57:0/529777067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df00a9e80 msgr2=0x7f3df00ad600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df00a9e80 0x7f3df00ad600 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f3df00b22e0 tx=0x7f3de0007c50).stop 2021-06-25T04:55:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 -- 172.21.15.57:0/529777067 shutdown_connections 2021-06-25T04:55:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3dd0055450 0x7f3dd0057910 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3df00aa260 0x7f3df00adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df00a9e80 0x7f3df00ad600 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 --2- 172.21.15.57:0/529777067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3df0060390 0x7f3df013fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 -- 172.21.15.57:0/529777067 >> 172.21.15.57:0/529777067 conn(0x7f3df00b2930 msgr2=0x7f3df0143470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 -- 172.21.15.57:0/529777067 shutdown_connections 2021-06-25T04:55:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.452+0000 7f3df7d5b700 1 -- 172.21.15.57:0/529777067 wait complete. 2021-06-25T04:55:27.472 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:55:27.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2297c700 1 Processor -- start 2021-06-25T04:55:27.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2297c700 1 -- start start 2021-06-25T04:55:27.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2297c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe1c0b2fc0 0x7efe1c0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2297c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe1c0a9bd0 0x7efe1c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2297c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1c0b33a0 con 0x7efe1c0b18b0 2021-06-25T04:55:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2297c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c0b27b0 con 0x7efe1c0a9bd0 2021-06-25T04:55:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2297c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c0b0c30 con 0x7efe1c0b2fc0 2021-06-25T04:55:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2197a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe1c0b2fc0 0x7efe1c0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2217b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe1c0a9bd0 0x7efe1c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2197a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe1c0b2fc0 0x7efe1c0b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:52954/0 (socket says 172.21.15.57:52954) 2021-06-25T04:55:27.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2197a700 1 -- 172.21.15.57:0/2623999591 learned_addr learned my addr 172.21.15.57:0/2623999591 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:27.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe21179700 1 --1- 172.21.15.57:0/2623999591 >> v1:172.21.15.87:6789/0 conn(0x7efe1c0b18b0 0x7efe1c0654d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:59758/0 (socket says 172.21.15.57:59758) 2021-06-25T04:55:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2217b700 1 -- 172.21.15.57:0/2623999591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe1c0b2fc0 msgr2=0x7efe1c0b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2217b700 1 --2- 172.21.15.57:0/2623999591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe1c0b2fc0 0x7efe1c0b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2217b700 1 -- 172.21.15.57:0/2623999591 >> v1:172.21.15.87:6789/0 conn(0x7efe1c0b18b0 legacy=0x7efe1c0654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2217b700 1 -- 172.21.15.57:0/2623999591 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c0b0ed0 con 0x7efe1c0a9bd0 2021-06-25T04:55:27.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe2217b700 1 --2- 172.21.15.57:0/2623999591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0a9bd0 0x7efe1c147c60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7efe14002f70 tx=0x7efe14006df0).ready entity=mon.1 client_cookie=f614b37f39d9efe9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.576+0000 7efe20978700 1 -- 172.21.15.57:0/2623999591 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe1400d570 con 0x7efe1c0a9bd0 2021-06-25T04:55:27.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe20978700 1 -- 172.21.15.57:0/2623999591 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe14000e90 con 0x7efe1c0a9bd0 2021-06-25T04:55:27.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe20978700 1 -- 172.21.15.57:0/2623999591 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe1400d8c0 con 0x7efe1c0a9bd0 2021-06-25T04:55:27.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe2297c700 1 -- 172.21.15.57:0/2623999591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0a9bd0 msgr2=0x7efe1c147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe2297c700 1 --2- 172.21.15.57:0/2623999591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0a9bd0 0x7efe1c147c60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7efe14002f70 tx=0x7efe14006df0).stop 2021-06-25T04:55:27.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe2297c700 1 -- 172.21.15.57:0/2623999591 shutdown_connections 2021-06-25T04:55:27.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe2297c700 1 --2- 172.21.15.57:0/2623999591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0a9bd0 0x7efe1c147c60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe2297c700 1 --2- 172.21.15.57:0/2623999591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe1c0b2fc0 0x7efe1c0b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe2297c700 1 -- 172.21.15.57:0/2623999591 >> 172.21.15.57:0/2623999591 conn(0x7efe1c0636a0 msgr2=0x7efe1c063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:27.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe2297c700 1 -- 172.21.15.57:0/2623999591 shutdown_connections 2021-06-25T04:55:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe2297c700 1 -- 172.21.15.57:0/2623999591 wait complete. 2021-06-25T04:55:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe2297c700 1 Processor -- start 2021-06-25T04:55:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.580+0000 7efe2297c700 1 -- start start 2021-06-25T04:55:27.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe2297c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe1c0a9bd0 0x7efe1c0aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe2297c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe1c0b18b0 0x7efe1c0aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe2297c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0b2fc0 0x7efe1c0abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe2297c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c0b5a90 con 0x7efe1c0b18b0 2021-06-25T04:55:27.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe2297c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c157370 con 0x7efe1c0b2fc0 2021-06-25T04:55:27.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe2297c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c156450 con 0x7efe1c0a9bd0 2021-06-25T04:55:27.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe21179700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe1c0b18b0 0x7efe1c0aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe21179700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe1c0b18b0 0x7efe1c0aadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41798/0 (socket says 172.21.15.57:41798) 2021-06-25T04:55:27.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe21179700 1 -- 172.21.15.57:0/4001961359 learned_addr learned my addr 172.21.15.57:0/4001961359 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:27.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe2197a700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe1c0a9bd0 0x7efe1c0aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe2217b700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0b2fc0 0x7efe1c0abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe21179700 1 -- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe1c0a9bd0 msgr2=0x7efe1c0aa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe21179700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe1c0a9bd0 0x7efe1c0aa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe21179700 1 -- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0b2fc0 msgr2=0x7efe1c0abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe21179700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0b2fc0 0x7efe1c0abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe21179700 1 -- 172.21.15.57:0/4001961359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1400b180 con 0x7efe1c0b18b0 2021-06-25T04:55:27.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe21179700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe1c0b18b0 0x7efe1c0aadc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7efe1c0b3d90 tx=0x7efe0c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe0affd700 1 -- 172.21.15.57:0/4001961359 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe0c0070d0 con 0x7efe1c0b18b0 2021-06-25T04:55:27.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe0affd700 1 -- 172.21.15.57:0/4001961359 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c007230 con 0x7efe1c0b18b0 2021-06-25T04:55:27.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe0affd700 1 -- 172.21.15.57:0/4001961359 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe0c005740 con 0x7efe1c0b18b0 2021-06-25T04:55:27.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe2297c700 1 -- 172.21.15.57:0/4001961359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1c1566f0 con 0x7efe1c0b18b0 2021-06-25T04:55:27.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.584+0000 7efe2297c700 1 -- 172.21.15.57:0/4001961359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1c156c30 con 0x7efe1c0b18b0 2021-06-25T04:55:27.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.588+0000 7efe2297c700 1 -- 172.21.15.57:0/4001961359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1c157070 con 0x7efe1c0b18b0 2021-06-25T04:55:27.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.588+0000 7efe0affd700 1 -- 172.21.15.57:0/4001961359 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7efe0c010070 con 0x7efe1c0b18b0 2021-06-25T04:55:27.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.588+0000 7efe0affd700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efdfc0553f0 0x7efdfc0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.588+0000 7efe0affd700 1 -- 172.21.15.57:0/4001961359 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efe0c06d310 con 0x7efe1c0b18b0 2021-06-25T04:55:27.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.588+0000 7efe2197a700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efdfc0553f0 0x7efdfc0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.588+0000 7efe2197a700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efdfc0553f0 0x7efdfc0578b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7efe1800b000 tx=0x7efe18009290).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.596+0000 7efe0affd700 1 -- 172.21.15.57:0/4001961359 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7efe0c0434c0 con 0x7efe1c0b18b0 2021-06-25T04:55:27.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.716+0000 7efe2297c700 1 -- 172.21.15.57:0/4001961359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe1c057310 con 0x7efe1c0b18b0 2021-06-25T04:55:27.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe0affd700 1 -- 172.21.15.57:0/4001961359 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+10 (secure 0 0 0) 0x7efe0c018020 con 0x7efe1c0b18b0 2021-06-25T04:55:27.723 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 -- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efdfc0553f0 msgr2=0x7efdfc0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efdfc0553f0 0x7efdfc0578b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7efe1800b000 tx=0x7efe18009290).stop 2021-06-25T04:55:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 -- 172.21.15.57:0/4001961359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe1c0b18b0 msgr2=0x7efe1c0aadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe1c0b18b0 0x7efe1c0aadc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7efe1c0b3d90 tx=0x7efe0c007bd0).stop 2021-06-25T04:55:27.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 -- 172.21.15.57:0/4001961359 shutdown_connections 2021-06-25T04:55:27.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efdfc0553f0 0x7efdfc0578b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0b2fc0 0x7efe1c0abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe1c0b18b0 0x7efe1c0aadc0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 --2- 172.21.15.57:0/4001961359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe1c0a9bd0 0x7efe1c0aa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 -- 172.21.15.57:0/4001961359 >> 172.21.15.57:0/4001961359 conn(0x7efe1c0636a0 msgr2=0x7efe1c05fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 -- 172.21.15.57:0/4001961359 shutdown_connections 2021-06-25T04:55:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.720+0000 7efe2297c700 1 -- 172.21.15.57:0/4001961359 wait complete. 2021-06-25T04:55:27.738 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:55:27.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:27.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.836+0000 7f69a6489700 1 Processor -- start 2021-06-25T04:55:27.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.836+0000 7f69a6489700 1 -- start start 2021-06-25T04:55:27.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69a00b5460 0x7f69a00af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69a00b05d0 0x7f69a0147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69a0067560 0x7f69a00acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a01452a0 con 0x7f69a00b05d0 2021-06-25T04:55:27.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a00adfb0 con 0x7f69a00b5460 2021-06-25T04:55:27.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00b5840 con 0x7f69a0067560 2021-06-25T04:55:27.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a4c86700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69a00b05d0 0x7f69a0147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a4c86700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69a00b05d0 0x7f69a0147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41804/0 (socket says 172.21.15.57:41804) 2021-06-25T04:55:27.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a4c86700 1 -- 172.21.15.57:0/1003291068 learned_addr learned my addr 172.21.15.57:0/1003291068 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:27.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a5c88700 1 --2- 172.21.15.57:0/1003291068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69a0067560 0x7f69a00acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a5487700 1 --2- 172.21.15.57:0/1003291068 >> v2:172.21.15.87:3300/0 conn(0x7f69a00b5460 0x7f69a00af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a4c86700 1 -- 172.21.15.57:0/1003291068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69a0067560 msgr2=0x7f69a00acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:27.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a4c86700 1 --2- 172.21.15.57:0/1003291068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69a0067560 0x7f69a00acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a4c86700 1 -- 172.21.15.57:0/1003291068 >> v2:172.21.15.87:3300/0 conn(0x7f69a00b5460 msgr2=0x7f69a00af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:27.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a4c86700 1 --2- 172.21.15.57:0/1003291068 >> v2:172.21.15.87:3300/0 conn(0x7f69a00b5460 0x7f69a00af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a4c86700 1 -- 172.21.15.57:0/1003291068 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a00ac7c0 con 0x7f69a00b05d0 2021-06-25T04:55:27.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a5487700 1 --2- 172.21.15.57:0/1003291068 >> v2:172.21.15.87:3300/0 conn(0x7f69a00b5460 0x7f69a00af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:27.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a4c86700 1 --2- 172.21.15.57:0/1003291068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69a00b05d0 0x7f69a0147560 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f699c0032f0 tx=0x7f699c009290).ready entity=mon.0 client_cookie=ede2a3623d222679 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f6997fff700 1 -- 172.21.15.57:0/1003291068 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f699c00b870 con 0x7f69a00b05d0 2021-06-25T04:55:27.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f6997fff700 1 -- 172.21.15.57:0/1003291068 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699c00b9d0 con 0x7f69a00b05d0 2021-06-25T04:55:27.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f6997fff700 1 -- 172.21.15.57:0/1003291068 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f699c00bb40 con 0x7f69a00b05d0 2021-06-25T04:55:27.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 -- 172.21.15.57:0/1003291068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69a00b05d0 msgr2=0x7f69a0147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 --2- 172.21.15.57:0/1003291068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69a00b05d0 0x7f69a0147560 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f699c0032f0 tx=0x7f699c009290).stop 2021-06-25T04:55:27.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 -- 172.21.15.57:0/1003291068 shutdown_connections 2021-06-25T04:55:27.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 --2- 172.21.15.57:0/1003291068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69a0067560 0x7f69a00acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 --2- 172.21.15.57:0/1003291068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69a00b05d0 0x7f69a0147560 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 --2- 172.21.15.57:0/1003291068 >> v2:172.21.15.87:3300/0 conn(0x7f69a00b5460 0x7f69a00af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 -- 172.21.15.57:0/1003291068 >> 172.21.15.57:0/1003291068 conn(0x7f69a0062520 msgr2=0x7f69a0062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:27.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 -- 172.21.15.57:0/1003291068 shutdown_connections 2021-06-25T04:55:27.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.840+0000 7f69a6489700 1 -- 172.21.15.57:0/1003291068 wait complete. 2021-06-25T04:55:27.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.844+0000 7f69a6489700 1 Processor -- start 2021-06-25T04:55:27.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.844+0000 7f69a6489700 1 -- start start 2021-06-25T04:55:27.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.844+0000 7f69a6489700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69a0067560 0x7f69a014b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.844+0000 7f69a6489700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69a00b05d0 0x7f69a00b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.844+0000 7f69a6489700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69a00b5460 0x7f69a01564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.844+0000 7f69a6489700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a014ac80 con 0x7f69a0067560 2021-06-25T04:55:27.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.844+0000 7f69a6489700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0065ad0 con 0x7f69a00b5460 2021-06-25T04:55:27.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.844+0000 7f69a6489700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0065d70 con 0x7f69a00b05d0 2021-06-25T04:55:27.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.844+0000 7f69a5487700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69a0067560 0x7f69a014b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a5487700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69a0067560 0x7f69a014b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41810/0 (socket says 172.21.15.57:41810) 2021-06-25T04:55:27.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a5487700 1 -- 172.21.15.57:0/387252185 learned_addr learned my addr 172.21.15.57:0/387252185 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:27.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a4c86700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69a00b05d0 0x7f69a00b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a5c88700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69a00b5460 0x7f69a01564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a5487700 1 -- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69a00b05d0 msgr2=0x7f69a00b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a5487700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69a00b05d0 0x7f69a00b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a5487700 1 -- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69a00b5460 msgr2=0x7f69a01564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:27.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a5487700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69a00b5460 0x7f69a01564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:27.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a5487700 1 -- 172.21.15.57:0/387252185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c009530 con 0x7f69a0067560 2021-06-25T04:55:27.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a5c88700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69a00b5460 0x7f69a01564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:27.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a5487700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69a0067560 0x7f69a014b550 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f699000a000 tx=0x7f6990008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69967fc700 1 -- 172.21.15.57:0/387252185 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6990011780 con 0x7f69a0067560 2021-06-25T04:55:27.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69967fc700 1 -- 172.21.15.57:0/387252185 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69900118e0 con 0x7f69a0067560 2021-06-25T04:55:27.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a6489700 1 -- 172.21.15.57:0/387252185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a0066010 con 0x7f69a0067560 2021-06-25T04:55:27.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69967fc700 1 -- 172.21.15.57:0/387252185 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6990011c40 con 0x7f69a0067560 2021-06-25T04:55:27.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a6489700 1 -- 172.21.15.57:0/387252185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a0066750 con 0x7f69a0067560 2021-06-25T04:55:27.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69a6489700 1 -- 172.21.15.57:0/387252185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a00b4ae0 con 0x7f69a0067560 2021-06-25T04:55:27.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.848+0000 7f69967fc700 1 -- 172.21.15.57:0/387252185 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f699001c460 con 0x7f69a0067560 2021-06-25T04:55:27.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.852+0000 7f69967fc700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69880554e0 0x7f69880579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:27.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.852+0000 7f69967fc700 1 -- 172.21.15.57:0/387252185 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f699006e3e0 con 0x7f69a0067560 2021-06-25T04:55:27.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.852+0000 7f69a4c86700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69880554e0 0x7f69880579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:27.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.852+0000 7f69a4c86700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69880554e0 0x7f69880579a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f699c018000 tx=0x7f699c016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:27.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:27.856+0000 7f69967fc700 1 -- 172.21.15.57:0/387252185 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6990044530 con 0x7f69a0067560 2021-06-25T04:55:28.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.020+0000 7f69a6489700 1 -- 172.21.15.57:0/387252185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69a00664b0 con 0x7f69a0067560 2021-06-25T04:55:28.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.020+0000 7f69967fc700 1 -- 172.21.15.57:0/387252185 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f69a00664b0 con 0x7f69a0067560 2021-06-25T04:55:28.025 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:28.026 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":52,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3265820466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3265820466},{"type":"v1","addr":"172.21.15.87:6835","nonce":3265820466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51},{"gid":7323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/994003328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":994003328},{"type":"v1","addr":"172.21.15.57:6833","nonce":994003328}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:55:23.381147+0000","modified":"2021-06-25T04:55:24.413073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7326":{"gid":7326,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/4260642378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4260642378},{"type":"v1","addr":"172.21.15.57:6835","nonce":4260642378}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-06-25T04:55:28.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 -- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69880554e0 msgr2=0x7f69880579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:28.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69880554e0 0x7f69880579a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f699c018000 tx=0x7f699c016000).stop 2021-06-25T04:55:28.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 -- 172.21.15.57:0/387252185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69a0067560 msgr2=0x7f69a014b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:28.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69a0067560 0x7f69a014b550 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f699000a000 tx=0x7f6990008040).stop 2021-06-25T04:55:28.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 -- 172.21.15.57:0/387252185 shutdown_connections 2021-06-25T04:55:28.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69880554e0 0x7f69880579a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:28.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69a00b5460 0x7f69a01564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:28.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69a00b05d0 0x7f69a00b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:28.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 --2- 172.21.15.57:0/387252185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69a0067560 0x7f69a014b550 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:28.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 -- 172.21.15.57:0/387252185 >> 172.21.15.57:0/387252185 conn(0x7f69a0062520 msgr2=0x7f69a005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:28.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 -- 172.21.15.57:0/387252185 shutdown_connections 2021-06-25T04:55:28.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:28.024+0000 7f69a6489700 1 -- 172.21.15.57:0/387252185 wait complete. 2021-06-25T04:55:28.032 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 52 2021-06-25T04:55:28.345 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:55:23.381147+0000', 'modified': '2021-06-25T04:55:24.413073+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7326}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7326': {'gid': 7326, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/4260642378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 4260642378}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 4260642378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:55:28.346 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:55:28.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-06-25T04:55:28.464 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":7326,"want_state":"up:active","state":"up:active","rank_uptime":5.0697813920000003,"mdsmap_epoch":52,"osdmap_epoch":108,"osdmap_epoch_barrier":108,"uptime":9.4304292860000007} 2021-06-25T04:55:28.465 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 7326, "mdsmap_epoch": 52, "osdmap_epoch": 108, "osdmap_epoch_barrier": 108, "rank_uptime": 5.069781392, "state": "up:active", "uptime": 9.430429286, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:55:28.465 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:55:28.466 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:55:28.466 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:55:28.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:28.467 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:28.476 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:55:28.492 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:28.492 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:28.546 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:28.547 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:28.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:28.549 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:55:28.556 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:55:28.557 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:28.559 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:55:28.577 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:28.578 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:28.633 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:55:28.630+0000 7f44f5de2080 -1 init, newargv = 0x555939bc46c0 newargc=9 2021-06-25T04:55:28.634 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15347]: starting ceph client 2021-06-25T04:55:28.637 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:28.638 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:28.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:28.640 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:55:28.644 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15347]: starting fuse 2021-06-25T04:55:28.646 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:55:28.646 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:55:28.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:28.648 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:55:28.648 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:55:28.649 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:55:28.650 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:55:28.650 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:55:28.651 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:28.651 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:55:28.651 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:55:28.652 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:55:28.652 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:28.653 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:55:28.653 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:55:28.654 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:55:28.654 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:55:28.654 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:28.655 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:55:28.655 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:55:28.656 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:55:28.656 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:55:28.656 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:55:28.657 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:28.657 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:55:28.658 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:55:28.693 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.15347.asok 2021-06-25T04:55:28.698 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15347.asok 2021-06-25T04:55:28.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:28.699 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15347.asok status 2021-06-25T04:55:28.830 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:55:28.830 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:55:28.831 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:55:28.831 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:55:28.831 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:55:28.831 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:55:28.832 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:55:28.832 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "15347", 2021-06-25T04:55:28.832 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:55:28.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:28.833 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:55:28.833 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:55:28.833 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 7482, 2021-06-25T04:55:28.834 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:55:28.834 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:55:28.834 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:55:28.834 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 7482 2021-06-25T04:55:28.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:28.835 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:55:28.835 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:55:28.835 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:55:28.836 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3555906582 2021-06-25T04:55:28.836 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:55:28.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:28.836 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:55:28.836 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:55:28.837 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:55:28.837 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3555906582 2021-06-25T04:55:28.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:28.837 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.7482 172.21.15.102:0/3555906582", 2021-06-25T04:55:28.838 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/3555906582", 2021-06-25T04:55:28.838 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:55:28.838 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 52, 2021-06-25T04:55:28.838 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 108, 2021-06-25T04:55:28.839 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:55:28.839 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:55:28.839 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:55:28.839 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:55:28.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:28.841 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:28.842 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:28.850 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:55:28.851 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:55:28.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:28.852 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:28.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:29.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.016+0000 7fdda1ea5700 1 Processor -- start 2021-06-25T04:55:29.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdda1ea5700 1 -- start start 2021-06-25T04:55:29.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdda1ea5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdd9c060240 0x7fdd9c066870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdda1ea5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdd9c0a9760 0x7fdd9c0a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdda1ea5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0abe60 con 0x7fdd9c0b1960 2021-06-25T04:55:29.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdda1ea5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9c0ab2d0 con 0x7fdd9c0a9760 2021-06-25T04:55:29.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdda1ea5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9c1402c0 con 0x7fdd9c060240 2021-06-25T04:55:29.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9affd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdd9c0b1960 0x7fdd9c066d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59036/0 (socket says 172.21.15.57:59036) 2021-06-25T04:55:29.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9affd700 1 -- 172.21.15.57:0/684810324 learned_addr learned my addr 172.21.15.57:0/684810324 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:29.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9bfff700 1 --2- 172.21.15.57:0/684810324 >> v2:172.21.15.57:3300/0 conn(0x7fdd9c0a9760 0x7fdd9c0a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9b7fe700 1 --2- 172.21.15.57:0/684810324 >> v2:172.21.15.87:3300/0 conn(0x7fdd9c060240 0x7fdd9c066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9bfff700 1 -- 172.21.15.57:0/684810324 >> v2:172.21.15.87:3300/0 conn(0x7fdd9c060240 msgr2=0x7fdd9c066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:29.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9bfff700 1 --2- 172.21.15.57:0/684810324 >> v2:172.21.15.87:3300/0 conn(0x7fdd9c060240 0x7fdd9c066870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9bfff700 1 -- 172.21.15.57:0/684810324 >> v1:172.21.15.57:6789/0 conn(0x7fdd9c0b1960 legacy=0x7fdd9c066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9bfff700 1 -- 172.21.15.57:0/684810324 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c140560 con 0x7fdd9c0a9760 2021-06-25T04:55:29.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9bfff700 1 --2- 172.21.15.57:0/684810324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9c0a9760 0x7fdd9c0a9ba0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fdd940032f0 tx=0x7fdd940091d0).ready entity=mon.0 client_cookie=29fa3c7baf495c8e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9a7fc700 1 -- 172.21.15.57:0/684810324 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9400b680 con 0x7fdd9c0a9760 2021-06-25T04:55:29.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9a7fc700 1 -- 172.21.15.57:0/684810324 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9400b7e0 con 0x7fdd9c0a9760 2021-06-25T04:55:29.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdd9a7fc700 1 -- 172.21.15.57:0/684810324 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9400b950 con 0x7fdd9c0a9760 2021-06-25T04:55:29.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdda1ea5700 1 -- 172.21.15.57:0/684810324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9c0a9760 msgr2=0x7fdd9c0a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.020+0000 7fdda1ea5700 1 --2- 172.21.15.57:0/684810324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9c0a9760 0x7fdd9c0a9ba0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fdd940032f0 tx=0x7fdd940091d0).stop 2021-06-25T04:55:29.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.024+0000 7fdda1ea5700 1 -- 172.21.15.57:0/684810324 shutdown_connections 2021-06-25T04:55:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.024+0000 7fdda1ea5700 1 --2- 172.21.15.57:0/684810324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9c0a9760 0x7fdd9c0a9ba0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.024+0000 7fdda1ea5700 1 --2- 172.21.15.57:0/684810324 >> v2:172.21.15.87:3300/0 conn(0x7fdd9c060240 0x7fdd9c066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.024+0000 7fdda1ea5700 1 -- 172.21.15.57:0/684810324 >> 172.21.15.57:0/684810324 conn(0x7fdd9c0b53a0 msgr2=0x7fdd9c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.024+0000 7fdda1ea5700 1 -- 172.21.15.57:0/684810324 shutdown_connections 2021-06-25T04:55:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.024+0000 7fdda1ea5700 1 -- 172.21.15.57:0/684810324 wait complete. 2021-06-25T04:55:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdda1ea5700 1 Processor -- start 2021-06-25T04:55:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdda1ea5700 1 -- start start 2021-06-25T04:55:29.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdda1ea5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd9c060240 0x7fdd9c0aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdda1ea5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9c0a9760 0x7fdd9c134a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdda1ea5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0b1960 0x7fdd9c134f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdda1ea5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c150830 con 0x7fdd9c0a9760 2021-06-25T04:55:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdda1ea5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c150ad0 con 0x7fdd9c0b1960 2021-06-25T04:55:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdda1ea5700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c150d70 con 0x7fdd9c060240 2021-06-25T04:55:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdd9affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9c0a9760 0x7fdd9c134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdd9affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9c0a9760 0x7fdd9c134a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41826/0 (socket says 172.21.15.57:41826) 2021-06-25T04:55:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdd9affd700 1 -- 172.21.15.57:0/3013516677 learned_addr learned my addr 172.21.15.57:0/3013516677 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdd9b7fe700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd9c060240 0x7fdd9c0aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.028+0000 7fdd9bfff700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0b1960 0x7fdd9c134f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd9bfff700 1 -- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd9c060240 msgr2=0x7fdd9c0aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd9bfff700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd9c060240 0x7fdd9c0aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd9bfff700 1 -- 172.21.15.57:0/3013516677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9c0a9760 msgr2=0x7fdd9c134a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd9bfff700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9c0a9760 0x7fdd9c134a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd9bfff700 1 -- 172.21.15.57:0/3013516677 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd94009470 con 0x7fdd9c0b1960 2021-06-25T04:55:29.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd9affd700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9c0a9760 0x7fdd9c134a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:29.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd9bfff700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0b1960 0x7fdd9c134f00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fdd940032f0 tx=0x7fdd94016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd98ff9700 1 -- 172.21.15.57:0/3013516677 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd94011e20 con 0x7fdd9c0b1960 2021-06-25T04:55:29.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd98ff9700 1 -- 172.21.15.57:0/3013516677 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd94021480 con 0x7fdd9c0b1960 2021-06-25T04:55:29.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdda1ea5700 1 -- 172.21.15.57:0/3013516677 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c151010 con 0x7fdd9c0b1960 2021-06-25T04:55:29.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd98ff9700 1 -- 172.21.15.57:0/3013516677 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd940217e0 con 0x7fdd9c0b1960 2021-06-25T04:55:29.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdda1ea5700 1 -- 172.21.15.57:0/3013516677 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c1353f0 con 0x7fdd9c0b1960 2021-06-25T04:55:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdda1ea5700 1 -- 172.21.15.57:0/3013516677 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c1511a0 con 0x7fdd9c0b1960 2021-06-25T04:55:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd98ff9700 1 -- 172.21.15.57:0/3013516677 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdd9400f070 con 0x7fdd9c0b1960 2021-06-25T04:55:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd98ff9700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd800554e0 0x7fdd800579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd98ff9700 1 -- 172.21.15.57:0/3013516677 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdd9406f170 con 0x7fdd9c0b1960 2021-06-25T04:55:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.032+0000 7fdd9b7fe700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd800554e0 0x7fdd800579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.036+0000 7fdd9b7fe700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd800554e0 0x7fdd800579a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fdd8400b000 tx=0x7fdd84006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.044+0000 7fdd98ff9700 1 -- 172.21.15.57:0/3013516677 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdd940451b0 con 0x7fdd9c0b1960 2021-06-25T04:55:29.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.176+0000 7fdda1ea5700 1 -- 172.21.15.57:0/3013516677 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd9c057310 con 0x7fdd9c0b1960 2021-06-25T04:55:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.180+0000 7fdd98ff9700 1 -- 172.21.15.57:0/3013516677 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fdd940487d0 con 0x7fdd9c0b1960 2021-06-25T04:55:29.184 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:29.184 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":108,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:24.383836+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:55:21.803828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-06-25T04:55:22.740631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:29.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.180+0000 7fdda1ea5700 1 -- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd800554e0 msgr2=0x7fdd800579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.180+0000 7fdda1ea5700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd800554e0 0x7fdd800579a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fdd8400b000 tx=0x7fdd84006df0).stop 2021-06-25T04:55:29.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.180+0000 7fdda1ea5700 1 -- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0b1960 msgr2=0x7fdd9c134f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.180+0000 7fdda1ea5700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0b1960 0x7fdd9c134f00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fdd940032f0 tx=0x7fdd94016000).stop 2021-06-25T04:55:29.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.180+0000 7fdda1ea5700 1 -- 172.21.15.57:0/3013516677 shutdown_connections 2021-06-25T04:55:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.180+0000 7fdda1ea5700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdd800554e0 0x7fdd800579a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.180+0000 7fdda1ea5700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd9c0b1960 0x7fdd9c134f00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.180+0000 7fdda1ea5700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9c0a9760 0x7fdd9c134a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.180+0000 7fdda1ea5700 1 --2- 172.21.15.57:0/3013516677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd9c060240 0x7fdd9c0aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.180+0000 7fdda1ea5700 1 -- 172.21.15.57:0/3013516677 >> 172.21.15.57:0/3013516677 conn(0x7fdd9c0b53a0 msgr2=0x7fdd9c13e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.184+0000 7fdda1ea5700 1 -- 172.21.15.57:0/3013516677 shutdown_connections 2021-06-25T04:55:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.184+0000 7fdda1ea5700 1 -- 172.21.15.57:0/3013516677 wait complete. 2021-06-25T04:55:29.200 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:55:21.803828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:55:22.740631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:55:29.201 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:55:29.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.308+0000 7fb7552f2700 1 Processor -- start 2021-06-25T04:55:29.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.308+0000 7fb7552f2700 1 -- start start 2021-06-25T04:55:29.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.308+0000 7fb7552f2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb750146910 0x7fb7501401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.308+0000 7fb7552f2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7500b4650 0x7fb7500b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.308+0000 7fb7552f2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb750143b20 con 0x7fb7500b4140 2021-06-25T04:55:29.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.308+0000 7fb7552f2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7501474d0 con 0x7fb750146910 2021-06-25T04:55:29.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.308+0000 7fb7552f2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb750143dc0 con 0x7fb7500b4650 2021-06-25T04:55:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74f7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7500b4650 0x7fb7500b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74effd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb750146910 0x7fb7501401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74f7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7500b4650 0x7fb7500b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:52998/0 (socket says 172.21.15.57:52998) 2021-06-25T04:55:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74f7fe700 1 -- 172.21.15.57:0/4293996878 learned_addr learned my addr 172.21.15.57:0/4293996878 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74effd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb750146910 0x7fb7501401f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:50326/0 (socket says 172.21.15.57:50326) 2021-06-25T04:55:29.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74f7fe700 1 -- 172.21.15.57:0/4293996878 >> v2:172.21.15.87:3300/0 conn(0x7fb750146910 msgr2=0x7fb7501401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:29.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74f7fe700 1 --2- 172.21.15.57:0/4293996878 >> v2:172.21.15.87:3300/0 conn(0x7fb750146910 0x7fb7501401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74f7fe700 1 -- 172.21.15.57:0/4293996878 >> v1:172.21.15.87:6789/0 conn(0x7fb7500b4140 legacy=0x7fb7501406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74f7fe700 1 -- 172.21.15.57:0/4293996878 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7500b0c50 con 0x7fb7500b4650 2021-06-25T04:55:29.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74effd700 1 --2- 172.21.15.57:0/4293996878 >> v2:172.21.15.87:3300/0 conn(0x7fb750146910 0x7fb7501401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:29.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74f7fe700 1 --2- 172.21.15.57:0/4293996878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7500b4650 0x7fb7500b4e90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fb7480032f0 tx=0x7fb748009290).ready entity=mon.2 client_cookie=e5d8524fa2aa3761 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74e7fc700 1 -- 172.21.15.57:0/4293996878 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb74800b8a0 con 0x7fb7500b4650 2021-06-25T04:55:29.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74e7fc700 1 -- 172.21.15.57:0/4293996878 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74800ba00 con 0x7fb7500b4650 2021-06-25T04:55:29.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb74e7fc700 1 -- 172.21.15.57:0/4293996878 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb74800bb70 con 0x7fb7500b4650 2021-06-25T04:55:29.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb7552f2700 1 -- 172.21.15.57:0/4293996878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7500b4650 msgr2=0x7fb7500b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb7552f2700 1 --2- 172.21.15.57:0/4293996878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7500b4650 0x7fb7500b4e90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fb7480032f0 tx=0x7fb748009290).stop 2021-06-25T04:55:29.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb7552f2700 1 -- 172.21.15.57:0/4293996878 shutdown_connections 2021-06-25T04:55:29.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb7552f2700 1 --2- 172.21.15.57:0/4293996878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7500b4650 0x7fb7500b4e90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb7552f2700 1 --2- 172.21.15.57:0/4293996878 >> v2:172.21.15.87:3300/0 conn(0x7fb750146910 0x7fb7501401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb7552f2700 1 -- 172.21.15.57:0/4293996878 >> 172.21.15.57:0/4293996878 conn(0x7fb75005c450 msgr2=0x7fb75005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:29.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb7552f2700 1 -- 172.21.15.57:0/4293996878 shutdown_connections 2021-06-25T04:55:29.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.312+0000 7fb7552f2700 1 -- 172.21.15.57:0/4293996878 wait complete. 2021-06-25T04:55:29.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7552f2700 1 Processor -- start 2021-06-25T04:55:29.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7552f2700 1 -- start start 2021-06-25T04:55:29.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7552f2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500b4140 0x7fb75013f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7552f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7500b4650 0x7fb7500b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7552f2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb750146910 0x7fb7500b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7552f2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500b69f0 con 0x7fb7500b4140 2021-06-25T04:55:29.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7552f2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500b5960 con 0x7fb7500b4650 2021-06-25T04:55:29.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7552f2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500b5c00 con 0x7fb750146910 2021-06-25T04:55:29.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500b4140 0x7fb75013f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74f7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb750146910 0x7fb7500b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500b4140 0x7fb75013f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41838/0 (socket says 172.21.15.57:41838) 2021-06-25T04:55:29.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7467fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7500b4650 0x7fb7500b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74effd700 1 -- 172.21.15.57:0/893292285 learned_addr learned my addr 172.21.15.57:0/893292285 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:29.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74effd700 1 -- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb750146910 msgr2=0x7fb7500b9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74effd700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb750146910 0x7fb7500b9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74effd700 1 -- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7500b4650 msgr2=0x7fb7500b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74effd700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7500b4650 0x7fb7500b8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74effd700 1 -- 172.21.15.57:0/893292285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74000b180 con 0x7fb7500b4140 2021-06-25T04:55:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7467fc700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7500b4650 0x7fb7500b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:29.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74effd700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500b4140 0x7fb75013f610 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fb74000c000 tx=0x7fb740006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74cff9700 1 -- 172.21.15.57:0/893292285 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb740010780 con 0x7fb7500b4140 2021-06-25T04:55:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74cff9700 1 -- 172.21.15.57:0/893292285 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7400108e0 con 0x7fb7500b4140 2021-06-25T04:55:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7552f2700 1 -- 172.21.15.57:0/893292285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb748009530 con 0x7fb7500b4140 2021-06-25T04:55:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb74cff9700 1 -- 172.21.15.57:0/893292285 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb740010c40 con 0x7fb7500b4140 2021-06-25T04:55:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.316+0000 7fb7552f2700 1 -- 172.21.15.57:0/893292285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7500ba250 con 0x7fb7500b4140 2021-06-25T04:55:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.320+0000 7fb7552f2700 1 -- 172.21.15.57:0/893292285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb750057310 con 0x7fb7500b4140 2021-06-25T04:55:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.320+0000 7fb74cff9700 1 -- 172.21.15.57:0/893292285 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb74001c460 con 0x7fb7500b4140 2021-06-25T04:55:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.320+0000 7fb74cff9700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb7340554e0 0x7fb7340579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.320+0000 7fb74cff9700 1 -- 172.21.15.57:0/893292285 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb74006e4b0 con 0x7fb7500b4140 2021-06-25T04:55:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.320+0000 7fb7467fc700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb7340554e0 0x7fb7340579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.320+0000 7fb7467fc700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb7340554e0 0x7fb7340579a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fb73800d000 tx=0x7fb738009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.324+0000 7fb74cff9700 1 -- 172.21.15.57:0/893292285 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb7400444f0 con 0x7fb7500b4140 2021-06-25T04:55:29.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.452+0000 7fb7552f2700 1 -- 172.21.15.57:0/893292285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb7500b6b30 con 0x7fb7500b4140 2021-06-25T04:55:29.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.452+0000 7fb74cff9700 1 -- 172.21.15.57:0/893292285 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v108) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb740047b10 con 0x7fb7500b4140 2021-06-25T04:55:29.457 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:55:29.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 -- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb7340554e0 msgr2=0x7fb7340579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb7340554e0 0x7fb7340579a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fb73800d000 tx=0x7fb738009040).stop 2021-06-25T04:55:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 -- 172.21.15.57:0/893292285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500b4140 msgr2=0x7fb75013f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500b4140 0x7fb75013f610 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fb74000c000 tx=0x7fb740006df0).stop 2021-06-25T04:55:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 -- 172.21.15.57:0/893292285 shutdown_connections 2021-06-25T04:55:29.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb7340554e0 0x7fb7340579a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb750146910 0x7fb7500b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7500b4650 0x7fb7500b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 --2- 172.21.15.57:0/893292285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500b4140 0x7fb75013f610 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 -- 172.21.15.57:0/893292285 >> 172.21.15.57:0/893292285 conn(0x7fb75005c450 msgr2=0x7fb75013ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:29.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 -- 172.21.15.57:0/893292285 shutdown_connections 2021-06-25T04:55:29.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.456+0000 7fb7552f2700 1 -- 172.21.15.57:0/893292285 wait complete. 2021-06-25T04:55:29.473 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:55:29.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.580+0000 7fd4e52a1700 1 Processor -- start 2021-06-25T04:55:29.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.580+0000 7fd4e52a1700 1 -- start start 2021-06-25T04:55:29.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.580+0000 7fd4e52a1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ad580 0x7fd4e00616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.580+0000 7fd4e52a1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e00aecb0 con 0x7fd4e00612e0 2021-06-25T04:55:29.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.580+0000 7fd4e52a1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e00b6ee0 con 0x7fd4e0140400 2021-06-25T04:55:29.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.580+0000 7fd4e52a1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e00aeee0 con 0x7fd4e00ad580 2021-06-25T04:55:29.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.580+0000 7fd4dffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd4e00612e0 0x7fd4e00b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59064/0 (socket says 172.21.15.57:59064) 2021-06-25T04:55:29.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.580+0000 7fd4dffff700 1 -- 172.21.15.57:0/3318311052 learned_addr learned my addr 172.21.15.57:0/3318311052 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:29.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4df7fe700 1 --2- 172.21.15.57:0/3318311052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ad580 0x7fd4e00616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4deffd700 1 -- 172.21.15.57:0/3318311052 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972292804 0 0) 0x7fd4e00aecb0 con 0x7fd4e00612e0 2021-06-25T04:55:29.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4deffd700 1 -- 172.21.15.57:0/3318311052 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4cc003260 con 0x7fd4e00612e0 2021-06-25T04:55:29.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4df7fe700 1 -- 172.21.15.57:0/3318311052 >> v1:172.21.15.87:6789/0 conn(0x7fd4e0140400 legacy=0x7fd4e01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4df7fe700 1 -- 172.21.15.57:0/3318311052 >> v1:172.21.15.57:6789/0 conn(0x7fd4e00612e0 legacy=0x7fd4e00b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4df7fe700 1 -- 172.21.15.57:0/3318311052 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e00af180 con 0x7fd4e00ad580 2021-06-25T04:55:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4df7fe700 1 --2- 172.21.15.57:0/3318311052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ad580 0x7fd4e00616c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fd4d0002f70 tx=0x7fd4d0006df0).ready entity=mon.2 client_cookie=19b1ae08d96b459c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4deffd700 1 -- 172.21.15.57:0/3318311052 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d000d570 con 0x7fd4e00ad580 2021-06-25T04:55:29.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4deffd700 1 -- 172.21.15.57:0/3318311052 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d0000e90 con 0x7fd4e00ad580 2021-06-25T04:55:29.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4deffd700 1 -- 172.21.15.57:0/3318311052 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d000d8c0 con 0x7fd4e00ad580 2021-06-25T04:55:29.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4e52a1700 1 -- 172.21.15.57:0/3318311052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ad580 msgr2=0x7fd4e00616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4e52a1700 1 --2- 172.21.15.57:0/3318311052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ad580 0x7fd4e00616c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fd4d0002f70 tx=0x7fd4d0006df0).stop 2021-06-25T04:55:29.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4e52a1700 1 -- 172.21.15.57:0/3318311052 shutdown_connections 2021-06-25T04:55:29.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4e52a1700 1 --2- 172.21.15.57:0/3318311052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ad580 0x7fd4e00616c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4e52a1700 1 -- 172.21.15.57:0/3318311052 >> 172.21.15.57:0/3318311052 conn(0x7fd4e0066da0 msgr2=0x7fd4e0067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:29.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4e52a1700 1 -- 172.21.15.57:0/3318311052 shutdown_connections 2021-06-25T04:55:29.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.584+0000 7fd4e52a1700 1 -- 172.21.15.57:0/3318311052 wait complete. 2021-06-25T04:55:29.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4e52a1700 1 Processor -- start 2021-06-25T04:55:29.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4e52a1700 1 -- start start 2021-06-25T04:55:29.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4e52a1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4e00612e0 0x7fd4e0152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4e52a1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e00ad580 0x7fd4e00b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4e52a1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e0140400 0x7fd4e00b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4e52a1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e00b3060 con 0x7fd4e00612e0 2021-06-25T04:55:29.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4e52a1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e00b3b10 con 0x7fd4e00ad580 2021-06-25T04:55:29.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4e52a1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e00b17c0 con 0x7fd4e0140400 2021-06-25T04:55:29.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4e00612e0 0x7fd4e0152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4e00612e0 0x7fd4e0152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41852/0 (socket says 172.21.15.57:41852) 2021-06-25T04:55:29.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dffff700 1 -- 172.21.15.57:0/2841085855 learned_addr learned my addr 172.21.15.57:0/2841085855 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:29.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4df7fe700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e00ad580 0x7fd4e00b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4e4aa0700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e0140400 0x7fd4e00b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dffff700 1 -- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e0140400 msgr2=0x7fd4e00b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dffff700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e0140400 0x7fd4e00b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dffff700 1 -- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e00ad580 msgr2=0x7fd4e00b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dffff700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e00ad580 0x7fd4e00b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dffff700 1 -- 172.21.15.57:0/2841085855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d000b180 con 0x7fd4e00612e0 2021-06-25T04:55:29.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dffff700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4e00612e0 0x7fd4e0152ee0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fd4e014a8e0 tx=0x7fd4d4007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dd7fa700 1 -- 172.21.15.57:0/2841085855 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d400ce70 con 0x7fd4e00612e0 2021-06-25T04:55:29.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dd7fa700 1 -- 172.21.15.57:0/2841085855 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d40070d0 con 0x7fd4e00612e0 2021-06-25T04:55:29.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4e52a1700 1 -- 172.21.15.57:0/2841085855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e00b3d40 con 0x7fd4e00612e0 2021-06-25T04:55:29.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4dd7fa700 1 -- 172.21.15.57:0/2841085855 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d4007430 con 0x7fd4e00612e0 2021-06-25T04:55:29.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.588+0000 7fd4e52a1700 1 -- 172.21.15.57:0/2841085855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e00b21a0 con 0x7fd4e00612e0 2021-06-25T04:55:29.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.592+0000 7fd4e52a1700 1 -- 172.21.15.57:0/2841085855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e0057310 con 0x7fd4e00612e0 2021-06-25T04:55:29.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.592+0000 7fd4dd7fa700 1 -- 172.21.15.57:0/2841085855 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd4d4010070 con 0x7fd4e00612e0 2021-06-25T04:55:29.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.592+0000 7fd4dd7fa700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4c00553f0 0x7fd4c00578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.592+0000 7fd4dd7fa700 1 -- 172.21.15.57:0/2841085855 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd4d406d390 con 0x7fd4e00612e0 2021-06-25T04:55:29.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.592+0000 7fd4df7fe700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4c00553f0 0x7fd4c00578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.592+0000 7fd4df7fe700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4c00553f0 0x7fd4c00578b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fd4d0019000 tx=0x7fd4d0014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.600+0000 7fd4dd7fa700 1 -- 172.21.15.57:0/2841085855 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd4d4043540 con 0x7fd4e00612e0 2021-06-25T04:55:29.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 -- 172.21.15.57:0/2841085855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd4e00620c0 con 0x7fd4e00612e0 2021-06-25T04:55:29.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4dd7fa700 1 -- 172.21.15.57:0/2841085855 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd4d4018070 con 0x7fd4e00612e0 2021-06-25T04:55:29.732 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:29.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 -- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4c00553f0 msgr2=0x7fd4c00578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4c00553f0 0x7fd4c00578b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fd4d0019000 tx=0x7fd4d0014000).stop 2021-06-25T04:55:29.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 -- 172.21.15.57:0/2841085855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4e00612e0 msgr2=0x7fd4e0152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4e00612e0 0x7fd4e0152ee0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fd4e014a8e0 tx=0x7fd4d4007aa0).stop 2021-06-25T04:55:29.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 -- 172.21.15.57:0/2841085855 shutdown_connections 2021-06-25T04:55:29.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd4c00553f0 0x7fd4c00578b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e0140400 0x7fd4e00b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e00ad580 0x7fd4e00b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 --2- 172.21.15.57:0/2841085855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4e00612e0 0x7fd4e0152ee0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 -- 172.21.15.57:0/2841085855 >> 172.21.15.57:0/2841085855 conn(0x7fd4e0066da0 msgr2=0x7fd4e00b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:29.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 -- 172.21.15.57:0/2841085855 shutdown_connections 2021-06-25T04:55:29.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.728+0000 7fd4e52a1700 1 -- 172.21.15.57:0/2841085855 wait complete. 2021-06-25T04:55:29.745 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:55:29.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ee9d700 1 Processor -- start 2021-06-25T04:55:29.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ee9d700 1 -- start start 2021-06-25T04:55:29.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ee9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1080612e0 0x7fa1080616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ee9d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1080aecb0 con 0x7fa108140400 2021-06-25T04:55:29.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ee9d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1080b6ee0 con 0x7fa1080ad580 2021-06-25T04:55:29.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ee9d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1080aeee0 con 0x7fa1080612e0 2021-06-25T04:55:29.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10e69c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa108140400 0x7fa1081464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59082/0 (socket says 172.21.15.57:59082) 2021-06-25T04:55:29.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10e69c700 1 -- 172.21.15.57:0/2006848614 learned_addr learned my addr 172.21.15.57:0/2006848614 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:29.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10de9b700 1 --2- 172.21.15.57:0/2006848614 >> v2:172.21.15.87:3300/0 conn(0x7fa1080612e0 0x7fa1080616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ce99700 1 -- 172.21.15.57:0/2006848614 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700089892 0 0) 0x7fa1080aecb0 con 0x7fa108140400 2021-06-25T04:55:29.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ce99700 1 -- 172.21.15.57:0/2006848614 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0f0003260 con 0x7fa108140400 2021-06-25T04:55:29.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ce99700 1 -- 172.21.15.57:0/2006848614 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948317365 0 0) 0x7fa1080b6ee0 con 0x7fa1080ad580 2021-06-25T04:55:29.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ce99700 1 -- 172.21.15.57:0/2006848614 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1080aecb0 con 0x7fa1080ad580 2021-06-25T04:55:29.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10de9b700 1 -- 172.21.15.57:0/2006848614 >> v1:172.21.15.87:6789/0 conn(0x7fa1080ad580 legacy=0x7fa1080b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10de9b700 1 -- 172.21.15.57:0/2006848614 >> v1:172.21.15.57:6789/0 conn(0x7fa108140400 legacy=0x7fa1081464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10de9b700 1 -- 172.21.15.57:0/2006848614 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1080af180 con 0x7fa1080612e0 2021-06-25T04:55:29.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10de9b700 1 --2- 172.21.15.57:0/2006848614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1080612e0 0x7fa1080616c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fa1080aeb60 tx=0x7fa104006df0).ready entity=mon.1 client_cookie=d3adf56734e0500a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ce99700 1 -- 172.21.15.57:0/2006848614 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa10400d610 con 0x7fa1080612e0 2021-06-25T04:55:29.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ce99700 1 -- 172.21.15.57:0/2006848614 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104000e90 con 0x7fa1080612e0 2021-06-25T04:55:29.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ce99700 1 -- 172.21.15.57:0/2006848614 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa10400d960 con 0x7fa1080612e0 2021-06-25T04:55:29.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ee9d700 1 -- 172.21.15.57:0/2006848614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1080612e0 msgr2=0x7fa1080616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.852+0000 7fa10ee9d700 1 --2- 172.21.15.57:0/2006848614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1080612e0 0x7fa1080616c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fa1080aeb60 tx=0x7fa104006df0).stop 2021-06-25T04:55:29.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.856+0000 7fa10ee9d700 1 -- 172.21.15.57:0/2006848614 shutdown_connections 2021-06-25T04:55:29.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.856+0000 7fa10ee9d700 1 --2- 172.21.15.57:0/2006848614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1080612e0 0x7fa1080616c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.856+0000 7fa10ee9d700 1 -- 172.21.15.57:0/2006848614 >> 172.21.15.57:0/2006848614 conn(0x7fa108066da0 msgr2=0x7fa108067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:29.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.856+0000 7fa10ee9d700 1 -- 172.21.15.57:0/2006848614 shutdown_connections 2021-06-25T04:55:29.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.856+0000 7fa10ee9d700 1 -- 172.21.15.57:0/2006848614 wait complete. 2021-06-25T04:55:29.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.856+0000 7fa10ee9d700 1 Processor -- start 2021-06-25T04:55:29.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.856+0000 7fa10ee9d700 1 -- start start 2021-06-25T04:55:29.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10ee9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1080612e0 0x7fa1080b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10ee9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1080ad580 0x7fa1080b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10ee9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa108140400 0x7fa1080b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10ee9d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1081438b0 con 0x7fa1080ad580 2021-06-25T04:55:29.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10ee9d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1080aad80 con 0x7fa1080612e0 2021-06-25T04:55:29.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10ee9d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1081532b0 con 0x7fa108140400 2021-06-25T04:55:29.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10d69a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1080ad580 0x7fa1080b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10d69a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1080ad580 0x7fa1080b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41868/0 (socket says 172.21.15.57:41868) 2021-06-25T04:55:29.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10de9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1080612e0 0x7fa1080b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10d69a700 1 -- 172.21.15.57:0/620383584 learned_addr learned my addr 172.21.15.57:0/620383584 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:29.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10e69c700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa108140400 0x7fa1080b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10d69a700 1 -- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa108140400 msgr2=0x7fa1080b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10d69a700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa108140400 0x7fa1080b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10d69a700 1 -- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1080612e0 msgr2=0x7fa1080b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10d69a700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1080612e0 0x7fa1080b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10d69a700 1 -- 172.21.15.57:0/620383584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10400b180 con 0x7fa1080ad580 2021-06-25T04:55:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10e69c700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa108140400 0x7fa1080b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10d69a700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1080ad580 0x7fa1080b2ed0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fa108153440 tx=0x7fa0f8007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa0f6ffd700 1 -- 172.21.15.57:0/620383584 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0f8012400 con 0x7fa1080ad580 2021-06-25T04:55:29.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa0f6ffd700 1 -- 172.21.15.57:0/620383584 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f8012560 con 0x7fa1080ad580 2021-06-25T04:55:29.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10ee9d700 1 -- 172.21.15.57:0/620383584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1080aafe0 con 0x7fa1080ad580 2021-06-25T04:55:29.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa0f6ffd700 1 -- 172.21.15.57:0/620383584 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0f80128c0 con 0x7fa1080ad580 2021-06-25T04:55:29.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10ee9d700 1 -- 172.21.15.57:0/620383584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1080aa120 con 0x7fa1080ad580 2021-06-25T04:55:29.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.860+0000 7fa10ee9d700 1 -- 172.21.15.57:0/620383584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa108057310 con 0x7fa1080ad580 2021-06-25T04:55:29.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.864+0000 7fa0f6ffd700 1 -- 172.21.15.57:0/620383584 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa0f8019030 con 0x7fa1080ad580 2021-06-25T04:55:29.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.864+0000 7fa0f6ffd700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa0e80553d0 0x7fa0e8057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:29.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.864+0000 7fa0f6ffd700 1 -- 172.21.15.57:0/620383584 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa0f806d430 con 0x7fa1080ad580 2021-06-25T04:55:29.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.864+0000 7fa10de9b700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa0e80553d0 0x7fa0e8057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:29.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.864+0000 7fa10de9b700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa0e80553d0 0x7fa0e8057890 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fa104019000 tx=0x7fa104014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:29.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:29.872+0000 7fa0f6ffd700 1 -- 172.21.15.57:0/620383584 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa0f80434d0 con 0x7fa1080ad580 2021-06-25T04:55:30.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.004+0000 7fa10ee9d700 1 -- 172.21.15.57:0/620383584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1080620c0 con 0x7fa1080ad580 2021-06-25T04:55:30.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.004+0000 7fa0f6ffd700 1 -- 172.21.15.57:0/620383584 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa0f8046af0 con 0x7fa1080ad580 2021-06-25T04:55:30.010 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:30.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 -- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa0e80553d0 msgr2=0x7fa0e8057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa0e80553d0 0x7fa0e8057890 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fa104019000 tx=0x7fa104014000).stop 2021-06-25T04:55:30.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 -- 172.21.15.57:0/620383584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1080ad580 msgr2=0x7fa1080b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1080ad580 0x7fa1080b2ed0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fa108153440 tx=0x7fa0f8007a80).stop 2021-06-25T04:55:30.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 -- 172.21.15.57:0/620383584 shutdown_connections 2021-06-25T04:55:30.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa0e80553d0 0x7fa0e8057890 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa108140400 0x7fa1080b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1080ad580 0x7fa1080b2ed0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 --2- 172.21.15.57:0/620383584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1080612e0 0x7fa1080b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 -- 172.21.15.57:0/620383584 >> 172.21.15.57:0/620383584 conn(0x7fa108066da0 msgr2=0x7fa108144530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:30.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 -- 172.21.15.57:0/620383584 shutdown_connections 2021-06-25T04:55:30.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.008+0000 7fa10ee9d700 1 -- 172.21.15.57:0/620383584 wait complete. 2021-06-25T04:55:30.023 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:55:30.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.128+0000 7fc38aba4700 1 Processor -- start 2021-06-25T04:55:30.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.128+0000 7fc38aba4700 1 -- start start 2021-06-25T04:55:30.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3840b1290 0x7fc3840aff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:30.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc3840b2260 0x7fc384141210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:30.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3840a7790 con 0x7fc3840b1e80 2021-06-25T04:55:30.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3840b1700 con 0x7fc3840b1290 2021-06-25T04:55:30.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3840b0610 con 0x7fc3840b2260 2021-06-25T04:55:30.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc383fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3840b1290 0x7fc3840aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:30.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc388940700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc3840b1e80 0x7fc3840a7080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59092/0 (socket says 172.21.15.57:59092) 2021-06-25T04:55:30.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc388940700 1 -- 172.21.15.57:0/1151891921 learned_addr learned my addr 172.21.15.57:0/1151891921 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:30.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc389141700 1 --2- 172.21.15.57:0/1151891921 >> v2:172.21.15.87:3300/0 conn(0x7fc3840b2260 0x7fc384141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:30.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc383fff700 1 -- 172.21.15.57:0/1151891921 >> v2:172.21.15.87:3300/0 conn(0x7fc3840b2260 msgr2=0x7fc384141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:30.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc383fff700 1 --2- 172.21.15.57:0/1151891921 >> v2:172.21.15.87:3300/0 conn(0x7fc3840b2260 0x7fc384141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc383fff700 1 -- 172.21.15.57:0/1151891921 >> v1:172.21.15.57:6789/0 conn(0x7fc3840b1e80 legacy=0x7fc3840a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc383fff700 1 -- 172.21.15.57:0/1151891921 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3840b08b0 con 0x7fc3840b1290 2021-06-25T04:55:30.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc3837fe700 1 -- 172.21.15.57:0/1151891921 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189676133 0 0) 0x7fc3840a7790 con 0x7fc3840b1e80 2021-06-25T04:55:30.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc383fff700 1 --2- 172.21.15.57:0/1151891921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3840b1290 0x7fc3840aff70 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7fc374002f70 tx=0x7fc374006df0).ready entity=mon.0 client_cookie=42d460ff7f081381 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:30.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc3837fe700 1 -- 172.21.15.57:0/1151891921 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc37400d570 con 0x7fc3840b1290 2021-06-25T04:55:30.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc3837fe700 1 -- 172.21.15.57:0/1151891921 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc374000e90 con 0x7fc3840b1290 2021-06-25T04:55:30.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc3837fe700 1 -- 172.21.15.57:0/1151891921 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc37400d8c0 con 0x7fc3840b1290 2021-06-25T04:55:30.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 -- 172.21.15.57:0/1151891921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3840b1290 msgr2=0x7fc3840aff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 --2- 172.21.15.57:0/1151891921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3840b1290 0x7fc3840aff70 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7fc374002f70 tx=0x7fc374006df0).stop 2021-06-25T04:55:30.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 -- 172.21.15.57:0/1151891921 shutdown_connections 2021-06-25T04:55:30.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 --2- 172.21.15.57:0/1151891921 >> v2:172.21.15.87:3300/0 conn(0x7fc3840b2260 0x7fc384141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 --2- 172.21.15.57:0/1151891921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3840b1290 0x7fc3840aff70 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 -- 172.21.15.57:0/1151891921 >> 172.21.15.57:0/1151891921 conn(0x7fc38405f670 msgr2=0x7fc38405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 -- 172.21.15.57:0/1151891921 shutdown_connections 2021-06-25T04:55:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.132+0000 7fc38aba4700 1 -- 172.21.15.57:0/1151891921 wait complete. 2021-06-25T04:55:30.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc38aba4700 1 Processor -- start 2021-06-25T04:55:30.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc38aba4700 1 -- start start 2021-06-25T04:55:30.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc38aba4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3840b1290 0x7fc38414bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:30.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc38aba4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3840b1e80 0x7fc3840abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:30.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc38aba4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3840b2260 0x7fc3841374e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:30.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc38aba4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840a9500 con 0x7fc3840b1290 2021-06-25T04:55:30.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc38aba4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840a9e50 con 0x7fc3840b2260 2021-06-25T04:55:30.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc38aba4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840aa0f0 con 0x7fc3840b1e80 2021-06-25T04:55:30.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc388940700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3840b1290 0x7fc38414bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:30.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc388940700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3840b1290 0x7fc38414bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41878/0 (socket says 172.21.15.57:41878) 2021-06-25T04:55:30.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc388940700 1 -- 172.21.15.57:0/1647079006 learned_addr learned my addr 172.21.15.57:0/1647079006 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:30.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc389141700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3840b2260 0x7fc3841374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:30.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc383fff700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3840b1e80 0x7fc3840abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:30.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc388940700 1 -- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3840b1e80 msgr2=0x7fc3840abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc388940700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3840b1e80 0x7fc3840abb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc388940700 1 -- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3840b2260 msgr2=0x7fc3841374e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc388940700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3840b2260 0x7fc3841374e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc388940700 1 -- 172.21.15.57:0/1647079006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37400b180 con 0x7fc3840b1290 2021-06-25T04:55:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc389141700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3840b2260 0x7fc3841374e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc388940700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3840b1290 0x7fc38414bd80 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fc36c000bc0 tx=0x7fc36c007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.136+0000 7fc381ffb700 1 -- 172.21.15.57:0/1647079006 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc36c00ce50 con 0x7fc3840b1290 2021-06-25T04:55:30.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.140+0000 7fc381ffb700 1 -- 172.21.15.57:0/1647079006 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c0072e0 con 0x7fc3840b1290 2021-06-25T04:55:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.140+0000 7fc38aba4700 1 -- 172.21.15.57:0/1647079006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3840aa440 con 0x7fc3840b1290 2021-06-25T04:55:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.140+0000 7fc381ffb700 1 -- 172.21.15.57:0/1647079006 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc36c005800 con 0x7fc3840b1290 2021-06-25T04:55:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.140+0000 7fc38aba4700 1 -- 172.21.15.57:0/1647079006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3841488c0 con 0x7fc3840b1290 2021-06-25T04:55:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.140+0000 7fc38aba4700 1 -- 172.21.15.57:0/1647079006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3840ac200 con 0x7fc3840b1290 2021-06-25T04:55:30.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.140+0000 7fc381ffb700 1 -- 172.21.15.57:0/1647079006 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc36c01a060 con 0x7fc3840b1290 2021-06-25T04:55:30.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.140+0000 7fc381ffb700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc368055450 0x7fc368057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:30.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.140+0000 7fc381ffb700 1 -- 172.21.15.57:0/1647079006 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc36c06d7e0 con 0x7fc3840b1290 2021-06-25T04:55:30.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.140+0000 7fc383fff700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc368055450 0x7fc368057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.144+0000 7fc383fff700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc368055450 0x7fc368057910 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fc374017000 tx=0x7fc374014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.144+0000 7fc381ffb700 1 -- 172.21.15.57:0/1647079006 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc36c043910 con 0x7fc3840b1290 2021-06-25T04:55:30.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.276+0000 7fc38aba4700 1 -- 172.21.15.57:0/1647079006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc384057310 con 0x7fc3840b1290 2021-06-25T04:55:30.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.276+0000 7fc381ffb700 1 -- 172.21.15.57:0/1647079006 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc36c018020 con 0x7fc3840b1290 2021-06-25T04:55:30.282 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:30.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 -- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc368055450 msgr2=0x7fc368057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc368055450 0x7fc368057910 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fc374017000 tx=0x7fc374014000).stop 2021-06-25T04:55:30.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 -- 172.21.15.57:0/1647079006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3840b1290 msgr2=0x7fc38414bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3840b1290 0x7fc38414bd80 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fc36c000bc0 tx=0x7fc36c007a60).stop 2021-06-25T04:55:30.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 -- 172.21.15.57:0/1647079006 shutdown_connections 2021-06-25T04:55:30.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc368055450 0x7fc368057910 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3840b2260 0x7fc3841374e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3840b1e80 0x7fc3840abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 --2- 172.21.15.57:0/1647079006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3840b1290 0x7fc38414bd80 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 -- 172.21.15.57:0/1647079006 >> 172.21.15.57:0/1647079006 conn(0x7fc38405f670 msgr2=0x7fc3840ad140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 -- 172.21.15.57:0/1647079006 shutdown_connections 2021-06-25T04:55:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.280+0000 7fc38aba4700 1 -- 172.21.15.57:0/1647079006 wait complete. 2021-06-25T04:55:30.301 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:55:30.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:30.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.396+0000 7fa565a8a700 1 Processor -- start 2021-06-25T04:55:30.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.396+0000 7fa565a8a700 1 -- start start 2021-06-25T04:55:30.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa565a8a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa560144cd0 0x7fa5601466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:30.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa565a8a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5601432e0 con 0x7fa560067120 2021-06-25T04:55:30.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa565a8a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa560143580 con 0x7fa560066d40 2021-06-25T04:55:30.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa565a8a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5601430f0 con 0x7fa560144cd0 2021-06-25T04:55:30.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa560067120 0x7fa5600b4440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59108/0 (socket says 172.21.15.57:59108) 2021-06-25T04:55:30.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55ffff700 1 -- 172.21.15.57:0/3465557700 learned_addr learned my addr 172.21.15.57:0/3465557700 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:30.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55effd700 1 --2- 172.21.15.57:0/3465557700 >> v2:172.21.15.87:3300/0 conn(0x7fa560144cd0 0x7fa5601466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:30.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55e7fc700 1 -- 172.21.15.57:0/3465557700 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250036811 0 0) 0x7fa5601432e0 con 0x7fa560067120 2021-06-25T04:55:30.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55e7fc700 1 -- 172.21.15.57:0/3465557700 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa544003260 con 0x7fa560067120 2021-06-25T04:55:30.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55effd700 1 -- 172.21.15.57:0/3465557700 >> v1:172.21.15.87:6789/0 conn(0x7fa560066d40 legacy=0x7fa5601445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55effd700 1 -- 172.21.15.57:0/3465557700 >> v1:172.21.15.57:6789/0 conn(0x7fa560067120 legacy=0x7fa5600b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55effd700 1 -- 172.21.15.57:0/3465557700 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa560143820 con 0x7fa560144cd0 2021-06-25T04:55:30.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55effd700 1 --2- 172.21.15.57:0/3465557700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560144cd0 0x7fa5601466c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fa548002f70 tx=0x7fa548006df0).ready entity=mon.1 client_cookie=bb431dd779aeb411 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:30.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55e7fc700 1 -- 172.21.15.57:0/3465557700 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54800d610 con 0x7fa560144cd0 2021-06-25T04:55:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55e7fc700 1 -- 172.21.15.57:0/3465557700 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548000e90 con 0x7fa560144cd0 2021-06-25T04:55:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa55e7fc700 1 -- 172.21.15.57:0/3465557700 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54800d960 con 0x7fa560144cd0 2021-06-25T04:55:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa565a8a700 1 -- 172.21.15.57:0/3465557700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560144cd0 msgr2=0x7fa5601466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa565a8a700 1 --2- 172.21.15.57:0/3465557700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560144cd0 0x7fa5601466c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fa548002f70 tx=0x7fa548006df0).stop 2021-06-25T04:55:30.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa565a8a700 1 -- 172.21.15.57:0/3465557700 shutdown_connections 2021-06-25T04:55:30.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa565a8a700 1 --2- 172.21.15.57:0/3465557700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560144cd0 0x7fa5601466c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa565a8a700 1 -- 172.21.15.57:0/3465557700 >> 172.21.15.57:0/3465557700 conn(0x7fa56005c450 msgr2=0x7fa56005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa565a8a700 1 -- 172.21.15.57:0/3465557700 shutdown_connections 2021-06-25T04:55:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.400+0000 7fa565a8a700 1 -- 172.21.15.57:0/3465557700 wait complete. 2021-06-25T04:55:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa565a8a700 1 Processor -- start 2021-06-25T04:55:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa565a8a700 1 -- start start 2021-06-25T04:55:30.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa565a8a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa560066d40 0x7fa560152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:30.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa565a8a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa560067120 0x7fa5600b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:30.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa565a8a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560144cd0 0x7fa5600ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:30.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa565a8a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600abc90 con 0x7fa560066d40 2021-06-25T04:55:30.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa565a8a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5601520e0 con 0x7fa560144cd0 2021-06-25T04:55:30.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa565a8a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa560152380 con 0x7fa560067120 2021-06-25T04:55:30.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa55f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa560066d40 0x7fa560152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:30.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa55f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa560066d40 0x7fa560152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41892/0 (socket says 172.21.15.57:41892) 2021-06-25T04:55:30.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa55f7fe700 1 -- 172.21.15.57:0/916362274 learned_addr learned my addr 172.21.15.57:0/916362274 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:30.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa55ffff700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560144cd0 0x7fa5600ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:30.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.404+0000 7fa55effd700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa560067120 0x7fa5600b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:30.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55f7fe700 1 -- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa560067120 msgr2=0x7fa5600b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55f7fe700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa560067120 0x7fa5600b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55f7fe700 1 -- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560144cd0 msgr2=0x7fa5600ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55f7fe700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560144cd0 0x7fa5600ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55f7fe700 1 -- 172.21.15.57:0/916362274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54800b180 con 0x7fa560066d40 2021-06-25T04:55:30.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55f7fe700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa560066d40 0x7fa560152ac0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7fa5600ae6b0 tx=0x7fa550007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:30.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55cff9700 1 -- 172.21.15.57:0/916362274 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa550007030 con 0x7fa560066d40 2021-06-25T04:55:30.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55cff9700 1 -- 172.21.15.57:0/916362274 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa550007190 con 0x7fa560066d40 2021-06-25T04:55:30.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa565a8a700 1 -- 172.21.15.57:0/916362274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa560152620 con 0x7fa560066d40 2021-06-25T04:55:30.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55cff9700 1 -- 172.21.15.57:0/916362274 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa550006510 con 0x7fa560066d40 2021-06-25T04:55:30.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa565a8a700 1 -- 172.21.15.57:0/916362274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5600ab870 con 0x7fa560066d40 2021-06-25T04:55:30.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa565a8a700 1 -- 172.21.15.57:0/916362274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5601527b0 con 0x7fa560066d40 2021-06-25T04:55:30.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55cff9700 1 -- 172.21.15.57:0/916362274 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa550010030 con 0x7fa560066d40 2021-06-25T04:55:30.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55cff9700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5380553d0 0x7fa538057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:30.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55cff9700 1 -- 172.21.15.57:0/916362274 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa55006def0 con 0x7fa560066d40 2021-06-25T04:55:30.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.408+0000 7fa55effd700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5380553d0 0x7fa538057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:30.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.412+0000 7fa55effd700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5380553d0 0x7fa538057890 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fa548019000 tx=0x7fa548014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:30.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.416+0000 7fa55cff9700 1 -- 172.21.15.57:0/916362274 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa5500440a0 con 0x7fa560066d40 2021-06-25T04:55:30.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 -- 172.21.15.57:0/916362274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa560057310 con 0x7fa560066d40 2021-06-25T04:55:30.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa55cff9700 1 -- 172.21.15.57:0/916362274 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fa5500476c0 con 0x7fa560066d40 2021-06-25T04:55:30.585 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:30.585 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":52,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3265820466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3265820466},{"type":"v1","addr":"172.21.15.87:6835","nonce":3265820466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51},{"gid":7323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/994003328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":994003328},{"type":"v1","addr":"172.21.15.57:6833","nonce":994003328}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:55:23.381147+0000","modified":"2021-06-25T04:55:24.413073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7326":{"gid":7326,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/4260642378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4260642378},{"type":"v1","addr":"172.21.15.57:6835","nonce":4260642378}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-06-25T04:55:30.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 -- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5380553d0 msgr2=0x7fa538057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5380553d0 0x7fa538057890 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fa548019000 tx=0x7fa548014000).stop 2021-06-25T04:55:30.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 -- 172.21.15.57:0/916362274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa560066d40 msgr2=0x7fa560152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:30.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa560066d40 0x7fa560152ac0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7fa5600ae6b0 tx=0x7fa550007c10).stop 2021-06-25T04:55:30.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 -- 172.21.15.57:0/916362274 shutdown_connections 2021-06-25T04:55:30.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa5380553d0 0x7fa538057890 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560144cd0 0x7fa5600ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa560067120 0x7fa5600b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 --2- 172.21.15.57:0/916362274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa560066d40 0x7fa560152ac0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:30.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 -- 172.21.15.57:0/916362274 >> 172.21.15.57:0/916362274 conn(0x7fa56005c450 msgr2=0x7fa5600b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:30.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 -- 172.21.15.57:0/916362274 shutdown_connections 2021-06-25T04:55:30.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:30.580+0000 7fa565a8a700 1 -- 172.21.15.57:0/916362274 wait complete. 2021-06-25T04:55:30.594 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 52 2021-06-25T04:55:30.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:55:23.381147+0000', 'modified': '2021-06-25T04:55:24.413073+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7326}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7326': {'gid': 7326, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/4260642378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 4260642378}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 4260642378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:55:30.899 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:55:30.900 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-06-25T04:55:31.020 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":7326,"want_state":"up:active","state":"up:active","rank_uptime":7.6257507259999997,"mdsmap_epoch":52,"osdmap_epoch":108,"osdmap_epoch_barrier":108,"uptime":11.986390734} 2021-06-25T04:55:31.020 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 7326, "mdsmap_epoch": 52, "osdmap_epoch": 108, "osdmap_epoch_barrier": 108, "rank_uptime": 7.625750726, "state": "up:active", "uptime": 11.986390734, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:55:31.021 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:55:31.021 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-06-25T04:55:31.022 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi161.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-06-25T04:55:31.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:31.023 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:31.031 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:55:31.047 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:31.048 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:31.106 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:31.108 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:31.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:31.109 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:55:31.116 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:55:31.116 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:31.119 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:55:31.135 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:31.136 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:31.194 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:2021-06-25T04:55:31.189+0000 7f273b073080 -1 init, newargv = 0x55e8dcdd1b80 newargc=9 2021-06-25T04:55:31.195 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14811]: starting ceph client 2021-06-25T04:55:31.196 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:31.196 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:31.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:31.197 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:55:31.204 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14811]: starting fuse 2021-06-25T04:55:32.305 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:55:32.323 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:32.323 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:32.379 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:32.380 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:32.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:32.381 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:55:32.387 INFO:teuthology.orchestra.run.smithi161.stdout:52 2021-06-25T04:55:32.388 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:55:32.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:32.389 DEBUG:teuthology.orchestra.run.smithi161:> sudo python3 -c ' 2021-06-25T04:55:32.390 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2021-06-25T04:55:32.391 DEBUG:teuthology.orchestra.run.smithi161:> import re 2021-06-25T04:55:32.392 DEBUG:teuthology.orchestra.run.smithi161:> import os 2021-06-25T04:55:32.392 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2021-06-25T04:55:32.393 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:32.394 DEBUG:teuthology.orchestra.run.smithi161:> def find_socket(client_name): 2021-06-25T04:55:32.395 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-06-25T04:55:32.395 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2021-06-25T04:55:32.396 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:32.397 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2021-06-25T04:55:32.397 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2021-06-25T04:55:32.398 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2021-06-25T04:55:32.399 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2021-06-25T04:55:32.400 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:32.401 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2021-06-25T04:55:32.401 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:55:32.402 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:55:32.403 DEBUG:teuthology.orchestra.run.smithi161:> return f 2021-06-25T04:55:32.404 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:55:32.405 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:32.406 DEBUG:teuthology.orchestra.run.smithi161:> print(find_socket("client.1")) 2021-06-25T04:55:32.406 DEBUG:teuthology.orchestra.run.smithi161:> ' 2021-06-25T04:55:32.471 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.14811.asok 2021-06-25T04:55:32.475 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14811.asok 2021-06-25T04:55:32.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:32.476 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14811.asok status 2021-06-25T04:55:32.567 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2021-06-25T04:55:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2021-06-25T04:55:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:55:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:55:32.568 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2021-06-25T04:55:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2021-06-25T04:55:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-06-25T04:55:32.569 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "14811", 2021-06-25T04:55:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2021-06-25T04:55:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2021-06-25T04:55:32.570 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2021-06-25T04:55:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 6587, 2021-06-25T04:55:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2021-06-25T04:55:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2021-06-25T04:55:32.571 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2021-06-25T04:55:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 6587 2021-06-25T04:55:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:55:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:55:32.572 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:55:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 1879022533 2021-06-25T04:55:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: } 2021-06-25T04:55:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:55:32.573 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:55:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:55:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 1879022533 2021-06-25T04:55:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:32.574 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.6587 172.21.15.161:0/1879022533", 2021-06-25T04:55:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "172.21.15.161:0/1879022533", 2021-06-25T04:55:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2021-06-25T04:55:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 52, 2021-06-25T04:55:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 108, 2021-06-25T04:55:32.575 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:55:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: "blacklisted": false, 2021-06-25T04:55:32.576 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2021-06-25T04:55:32.576 INFO:teuthology.orchestra.run.smithi161.stdout:} 2021-06-25T04:55:32.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:32.578 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:32.578 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:32.585 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:55:32.586 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:55:32.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:32.587 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:32.648 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-06-25T04:55:32.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf08b4f700 1 Processor -- start 2021-06-25T04:55:32.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf08b4f700 1 -- start start 2021-06-25T04:55:32.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf08b4f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcf040b4380 0x7fcf040b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:32.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf08b4f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf040b6920 0x7fcf0412b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:32.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf08b4f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf04144070 con 0x7fcf040b6540 2021-06-25T04:55:32.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf08b4f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf04143b30 con 0x7fcf040b6920 2021-06-25T04:55:32.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf08b4f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf04143dd0 con 0x7fcf040b4380 2021-06-25T04:55:32.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf02d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf040b6920 0x7fcf0412b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:32.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf02d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf040b6920 0x7fcf0412b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41904/0 (socket says 172.21.15.57:41904) 2021-06-25T04:55:32.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf02d9d700 1 -- 172.21.15.57:0/2467351621 learned_addr learned my addr 172.21.15.57:0/2467351621 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:32.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf0259c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcf040b6540 0x7fcf04061cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59120/0 (socket says 172.21.15.57:59120) 2021-06-25T04:55:32.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf01d9b700 1 --2- 172.21.15.57:0/2467351621 >> v2:172.21.15.87:3300/0 conn(0x7fcf040b4380 0x7fcf040b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:32.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf02d9d700 1 -- 172.21.15.57:0/2467351621 >> v2:172.21.15.87:3300/0 conn(0x7fcf040b4380 msgr2=0x7fcf040b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:32.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf02d9d700 1 --2- 172.21.15.57:0/2467351621 >> v2:172.21.15.87:3300/0 conn(0x7fcf040b4380 0x7fcf040b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:32.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf02d9d700 1 -- 172.21.15.57:0/2467351621 >> v1:172.21.15.57:6789/0 conn(0x7fcf040b6540 legacy=0x7fcf04061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:32.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf02d9d700 1 -- 172.21.15.57:0/2467351621 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf040615b0 con 0x7fcf040b6920 2021-06-25T04:55:32.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf02d9d700 1 --2- 172.21.15.57:0/2467351621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf040b6920 0x7fcf0412b9c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7fcf041430e0 tx=0x7fcefc009290).ready entity=mon.0 client_cookie=48302125fee157a1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:32.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf0159a700 1 -- 172.21.15.57:0/2467351621 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcefc00b860 con 0x7fcf040b6920 2021-06-25T04:55:32.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf0159a700 1 -- 172.21.15.57:0/2467351621 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc00b9c0 con 0x7fcf040b6920 2021-06-25T04:55:32.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2467351621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf040b6920 msgr2=0x7fcf0412b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:32.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf0159a700 1 -- 172.21.15.57:0/2467351621 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcefc00bb30 con 0x7fcf040b6920 2021-06-25T04:55:32.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.752+0000 7fcf08b4f700 1 --2- 172.21.15.57:0/2467351621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf040b6920 0x7fcf0412b9c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7fcf041430e0 tx=0x7fcefc009290).stop 2021-06-25T04:55:32.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.756+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2467351621 shutdown_connections 2021-06-25T04:55:32.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.756+0000 7fcf08b4f700 1 --2- 172.21.15.57:0/2467351621 >> v2:172.21.15.87:3300/0 conn(0x7fcf040b4380 0x7fcf040b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:32.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.756+0000 7fcf08b4f700 1 --2- 172.21.15.57:0/2467351621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf040b6920 0x7fcf0412b9c0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:32.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.756+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2467351621 >> 172.21.15.57:0/2467351621 conn(0x7fcf0405c450 msgr2=0x7fcf0405c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:32.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.756+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2467351621 shutdown_connections 2021-06-25T04:55:32.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.756+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2467351621 wait complete. 2021-06-25T04:55:32.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.756+0000 7fcf08b4f700 1 Processor -- start 2021-06-25T04:55:32.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.756+0000 7fcf08b4f700 1 -- start start 2021-06-25T04:55:32.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf08b4f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf040b4380 0x7fcf040ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:32.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf08b4f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf040b6540 0x7fcf04123b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:32.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf08b4f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf040b6920 0x7fcf040afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf08b4f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04156bb0 con 0x7fcf040b6920 2021-06-25T04:55:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf08b4f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0412b970 con 0x7fcf040b4380 2021-06-25T04:55:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf08b4f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0412c0a0 con 0x7fcf040b6540 2021-06-25T04:55:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf02d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf040b6920 0x7fcf040afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf02d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf040b6920 0x7fcf040afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41910/0 (socket says 172.21.15.57:41910) 2021-06-25T04:55:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf02d9d700 1 -- 172.21.15.57:0/2668214004 learned_addr learned my addr 172.21.15.57:0/2668214004 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf01d9b700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf040b6540 0x7fcf04123b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf0259c700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf040b4380 0x7fcf040ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf02d9d700 1 -- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf040b6540 msgr2=0x7fcf04123b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf02d9d700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf040b6540 0x7fcf04123b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf02d9d700 1 -- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf040b4380 msgr2=0x7fcf040ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf02d9d700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf040b4380 0x7fcf040ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf02d9d700 1 -- 172.21.15.57:0/2668214004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc009530 con 0x7fcf040b6920 2021-06-25T04:55:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf02d9d700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf040b6920 0x7fcf040afe80 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7fcf041430e0 tx=0x7fcefc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcefb7fe700 1 -- 172.21.15.57:0/2668214004 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcefc011aa0 con 0x7fcf040b6920 2021-06-25T04:55:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcefb7fe700 1 -- 172.21.15.57:0/2668214004 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc011c00 con 0x7fcf040b6920 2021-06-25T04:55:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2668214004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0412bb60 con 0x7fcf040b6920 2021-06-25T04:55:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcefb7fe700 1 -- 172.21.15.57:0/2668214004 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcefc0032f0 con 0x7fcf040b6920 2021-06-25T04:55:32.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.760+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2668214004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf040af9e0 con 0x7fcf040b6920 2021-06-25T04:55:32.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.764+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2668214004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf040afba0 con 0x7fcf040b6920 2021-06-25T04:55:32.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.764+0000 7fcefb7fe700 1 -- 172.21.15.57:0/2668214004 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcefc00f070 con 0x7fcf040b6920 2021-06-25T04:55:32.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.764+0000 7fcefb7fe700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcee8055450 0x7fcee8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:32.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.764+0000 7fcefb7fe700 1 -- 172.21.15.57:0/2668214004 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcefc06e810 con 0x7fcf040b6920 2021-06-25T04:55:32.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.764+0000 7fcf0259c700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcee8055450 0x7fcee8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:32.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.764+0000 7fcf0259c700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcee8055450 0x7fcee8057910 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fcef400d000 tx=0x7fcef4007b40).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:32.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.768+0000 7fcefb7fe700 1 -- 172.21.15.57:0/2668214004 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcefc0448f0 con 0x7fcf040b6920 2021-06-25T04:55:32.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.936+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2668214004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fcf04057310 con 0x7fcf040b6920 2021-06-25T04:55:32.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.936+0000 7fcefb7fe700 1 -- 172.21.15.57:0/2668214004 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1934 (secure 0 0 0) 0x7fcefc015070 con 0x7fcf040b6920 2021-06-25T04:55:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:32.942 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:55:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:55:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: "total_bytes": 773094113280, 2021-06-25T04:55:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: "total_avail_bytes": 764493234176, 2021-06-25T04:55:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_bytes": 10944512, 2021-06-25T04:55:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_bytes": 8600879104, 2021-06-25T04:55:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_ratio": 0.01112526748329401, 2021-06-25T04:55:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "num_osds": 8, 2021-06-25T04:55:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "num_per_pool_osds": 8, 2021-06-25T04:55:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "num_per_pool_omap_osds": 8 2021-06-25T04:55:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "stats_by_class": { 2021-06-25T04:55:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "ssd": { 2021-06-25T04:55:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "total_bytes": 773094113280, 2021-06-25T04:55:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "total_avail_bytes": 764493234176, 2021-06-25T04:55:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_bytes": 10944512, 2021-06-25T04:55:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_bytes": 8600879104, 2021-06-25T04:55:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_ratio": 0.01112526748329401 2021-06-25T04:55:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:55:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "device_health_metrics", 2021-06-25T04:55:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 1, 2021-06-25T04:55:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:55:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "stored": 0, 2021-06-25T04:55:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "objects": 2, 2021-06-25T04:55:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "kb_used": 0, 2021-06-25T04:55:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes_used": 0, 2021-06-25T04:55:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "percent_used": 0, 2021-06-25T04:55:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "max_avail": 362919198720 2021-06-25T04:55:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "rbd", 2021-06-25T04:55:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 2, 2021-06-25T04:55:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:55:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "stored": 0, 2021-06-25T04:55:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "objects": 0, 2021-06-25T04:55:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "kb_used": 0, 2021-06-25T04:55:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes_used": 0, 2021-06-25T04:55:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: "percent_used": 0, 2021-06-25T04:55:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: "max_avail": 362919198720 2021-06-25T04:55:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "cephfs_metadata", 2021-06-25T04:55:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 19, 2021-06-25T04:55:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:55:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "stored": 2304, 2021-06-25T04:55:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "objects": 21, 2021-06-25T04:55:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "kb_used": 64, 2021-06-25T04:55:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes_used": 65536, 2021-06-25T04:55:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: "percent_used": 9.0290065202225378e-08, 2021-06-25T04:55:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: "max_avail": 362919198720 2021-06-25T04:55:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "cephfs_data", 2021-06-25T04:55:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 20, 2021-06-25T04:55:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:55:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "stored": 0, 2021-06-25T04:55:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "objects": 0, 2021-06-25T04:55:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "kb_used": 0, 2021-06-25T04:55:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes_used": 0, 2021-06-25T04:55:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "percent_used": 0, 2021-06-25T04:55:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "max_avail": 362919198720 2021-06-25T04:55:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:32.957 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:55:32.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcee8055450 msgr2=0x7fcee8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:32.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcee8055450 0x7fcee8057910 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fcef400d000 tx=0x7fcef4007b40).stop 2021-06-25T04:55:32.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2668214004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf040b6920 msgr2=0x7fcf040afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:32.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf040b6920 0x7fcf040afe80 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7fcf041430e0 tx=0x7fcefc016000).stop 2021-06-25T04:55:32.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2668214004 shutdown_connections 2021-06-25T04:55:32.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcee8055450 0x7fcee8057910 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:32.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf040b6920 0x7fcf040afe80 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:32.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf040b6540 0x7fcf04123b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:32.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 --2- 172.21.15.57:0/2668214004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf040b4380 0x7fcf040ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:32.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2668214004 >> 172.21.15.57:0/2668214004 conn(0x7fcf0405c450 msgr2=0x7fcf04140f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:32.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2668214004 shutdown_connections 2021-06-25T04:55:32.962 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:32.940+0000 7fcf08b4f700 1 -- 172.21.15.57:0/2668214004 wait complete. 2021-06-25T04:55:32.962 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data size -f json-pretty 2021-06-25T04:55:33.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f353894f700 1 Processor -- start 2021-06-25T04:55:33.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f353894f700 1 -- start start 2021-06-25T04:55:33.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f353894f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353405d070 0x7f35340b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f353894f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f353413f350 0x7f35340aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f353894f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353405cb70 con 0x7f353405c790 2021-06-25T04:55:33.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f353894f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35340ad500 con 0x7f353413f350 2021-06-25T04:55:33.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f353894f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3534067d30 con 0x7f353405d070 2021-06-25T04:55:33.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f3532d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f353405c790 0x7f35340acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59132/0 (socket says 172.21.15.57:59132) 2021-06-25T04:55:33.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f3532d9d700 1 -- 172.21.15.57:0/2631632990 learned_addr learned my addr 172.21.15.57:0/2631632990 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:33.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f353359e700 1 --2- 172.21.15.57:0/2631632990 >> v2:172.21.15.87:3300/0 conn(0x7f353413f350 0x7f35340aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f353259c700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353405d070 0x7f35340b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858588903 0 0) 0x7f353405cb70 con 0x7f353405c790 2021-06-25T04:55:33.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.068+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3518003260 con 0x7f353405c790 2021-06-25T04:55:33.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4226007279 0 0) 0x7f3518003260 con 0x7f353405c790 2021-06-25T04:55:33.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353405d070 msgr2=0x7f35340b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:33.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353405d070 0x7f35340b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 >> v2:172.21.15.87:3300/0 conn(0x7f353413f350 msgr2=0x7f35340aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:33.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 --2- 172.21.15.57:0/2631632990 >> v2:172.21.15.87:3300/0 conn(0x7f353413f350 0x7f35340aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35340b1750 con 0x7f353405c790 2021-06-25T04:55:33.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f353359e700 1 --2- 172.21.15.57:0/2631632990 >> v2:172.21.15.87:3300/0 conn(0x7f353413f350 0x7f35340aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:33.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f3528001680 con 0x7f353405c790 2021-06-25T04:55:33.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 >> v1:172.21.15.57:6789/0 conn(0x7f353405c790 legacy=0x7f35340acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:33.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353405d070 0x7f3518003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3518003c80 0x7f3518004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35180049f0 0x7f3518004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35340ad500 con 0x7f3518003c80 2021-06-25T04:55:33.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351800d960 con 0x7f35180049f0 2021-06-25T04:55:33.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351800daa0 con 0x7f353405d070 2021-06-25T04:55:33.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f353259c700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3518003c80 0x7f3518004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3532d9d700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353405d070 0x7f3518003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f353359e700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35180049f0 0x7f3518004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3532d9d700 1 -- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35180049f0 msgr2=0x7f3518004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:33.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3532d9d700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35180049f0 0x7f3518004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3532d9d700 1 -- 172.21.15.57:0/2631632990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3518003c80 msgr2=0x7f3518004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:33.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3532d9d700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3518003c80 0x7f3518004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3532d9d700 1 -- 172.21.15.57:0/2631632990 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518003260 con 0x7f353405d070 2021-06-25T04:55:33.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3532d9d700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353405d070 0x7f3518003750 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3528001390 tx=0x7f35340b18e0).ready entity=mon.2 client_cookie=c2bca74e54289ec9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:33.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3528007170 con 0x7f353405d070 2021-06-25T04:55:33.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35280072d0 con 0x7f353405d070 2021-06-25T04:55:33.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f3531d9b700 1 -- 172.21.15.57:0/2631632990 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f352800c8c0 con 0x7f353405d070 2021-06-25T04:55:33.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f353894f700 1 -- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353405d070 msgr2=0x7f3518003750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:33.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f353894f700 1 --2- 172.21.15.57:0/2631632990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f353405d070 0x7f3518003750 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3528001390 tx=0x7f35340b18e0).stop 2021-06-25T04:55:33.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f353359e700 1 -- 172.21.15.57:0/2631632990 reap_dead start 2021-06-25T04:55:33.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f353894f700 1 -- 172.21.15.57:0/2631632990 shutdown_connections 2021-06-25T04:55:33.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f353894f700 1 -- 172.21.15.57:0/2631632990 >> 172.21.15.57:0/2631632990 conn(0x7f3534060140 msgr2=0x7f35340b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:33.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f353894f700 1 -- 172.21.15.57:0/2631632990 shutdown_connections 2021-06-25T04:55:33.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.072+0000 7f353894f700 1 -- 172.21.15.57:0/2631632990 wait complete. 2021-06-25T04:55:33.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353894f700 1 Processor -- start 2021-06-25T04:55:33.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353894f700 1 -- start start 2021-06-25T04:55:33.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353894f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35340b0070 0x7f35340ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353894f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353414aca0 0x7f353414b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353894f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35340aa280 0x7f35340aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353894f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35341421a0 con 0x7f353414aca0 2021-06-25T04:55:33.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353894f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534142980 con 0x7f35340b0070 2021-06-25T04:55:33.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353894f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3534143580 con 0x7f35340aa280 2021-06-25T04:55:33.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353414aca0 0x7f353414b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353414aca0 0x7f353414b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41930/0 (socket says 172.21.15.57:41930) 2021-06-25T04:55:33.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35340aa280 0x7f35340aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f3532d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35340b0070 0x7f35340ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353259c700 1 -- 172.21.15.57:0/1931644958 learned_addr learned my addr 172.21.15.57:0/1931644958 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:33.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353259c700 1 -- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35340aa280 msgr2=0x7f35340aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:33.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353259c700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35340aa280 0x7f35340aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353259c700 1 -- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35340b0070 msgr2=0x7f35340ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:33.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353259c700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35340b0070 0x7f35340ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353259c700 1 -- 172.21.15.57:0/1931644958 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353414e790 con 0x7f353414aca0 2021-06-25T04:55:33.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f3532d9d700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35340b0070 0x7f35340ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:33.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.076+0000 7f353259c700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353414aca0 0x7f353414b120 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f353414d9c0 tx=0x7f3524006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:33.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.080+0000 7f3523fff700 1 -- 172.21.15.57:0/1931644958 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f352400f940 con 0x7f353414aca0 2021-06-25T04:55:33.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.080+0000 7f3523fff700 1 -- 172.21.15.57:0/1931644958 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3524000e90 con 0x7f353414aca0 2021-06-25T04:55:33.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.080+0000 7f353894f700 1 -- 172.21.15.57:0/1931644958 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3534063380 con 0x7f353414aca0 2021-06-25T04:55:33.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.080+0000 7f3523fff700 1 -- 172.21.15.57:0/1931644958 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f352400fc90 con 0x7f353414aca0 2021-06-25T04:55:33.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.080+0000 7f353894f700 1 -- 172.21.15.57:0/1931644958 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3534063b40 con 0x7f353414aca0 2021-06-25T04:55:33.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.080+0000 7f3523fff700 1 -- 172.21.15.57:0/1931644958 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3524014440 con 0x7f353414aca0 2021-06-25T04:55:33.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.080+0000 7f353894f700 1 -- 172.21.15.57:0/1931644958 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3534057310 con 0x7f353414aca0 2021-06-25T04:55:33.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.080+0000 7f3523fff700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3510055360 0x7f3510057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.080+0000 7f3523fff700 1 -- 172.21.15.57:0/1931644958 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f352406e8c0 con 0x7f353414aca0 2021-06-25T04:55:33.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.080+0000 7f3532d9d700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3510055360 0x7f3510057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.084+0000 7f3532d9d700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3510055360 0x7f3510057820 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f352801b000 tx=0x7f3528015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:33.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.088+0000 7f3523fff700 1 -- 172.21.15.57:0/1931644958 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3524044900 con 0x7f353414aca0 2021-06-25T04:55:33.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.216+0000 7f353894f700 1 -- 172.21.15.57:0/1931644958 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"} v 0) v1 -- 0x7f3534143700 con 0x7f353414aca0 2021-06-25T04:55:33.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.216+0000 7f3523fff700 1 -- 172.21.15.57:0/1931644958 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"}]=0 v108) v1 ==== 123+0+64 (secure 0 0 0) 0x7f3524018020 con 0x7f353414aca0 2021-06-25T04:55:33.222 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:33.223 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:55:33.223 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": "cephfs_data", 2021-06-25T04:55:33.223 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_id": 20, 2021-06-25T04:55:33.223 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2 2021-06-25T04:55:33.224 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:55:33.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 -- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3510055360 msgr2=0x7f3510057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:33.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3510055360 0x7f3510057820 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f352801b000 tx=0x7f3528015000).stop 2021-06-25T04:55:33.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 -- 172.21.15.57:0/1931644958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353414aca0 msgr2=0x7f353414b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:33.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353414aca0 0x7f353414b120 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f353414d9c0 tx=0x7f3524006df0).stop 2021-06-25T04:55:33.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 -- 172.21.15.57:0/1931644958 shutdown_connections 2021-06-25T04:55:33.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3510055360 0x7f3510057820 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35340aa280 0x7f35340aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353414aca0 0x7f353414b120 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 --2- 172.21.15.57:0/1931644958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35340b0070 0x7f35340ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 -- 172.21.15.57:0/1931644958 >> 172.21.15.57:0/1931644958 conn(0x7f3534060140 msgr2=0x7f353413df70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:33.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 -- 172.21.15.57:0/1931644958 shutdown_connections 2021-06-25T04:55:33.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.220+0000 7f353894f700 1 -- 172.21.15.57:0/1931644958 wait complete. 2021-06-25T04:55:33.235 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-06-25T04:55:33.236 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2021-06-25T04:55:33.269 INFO:teuthology.orchestra.run.smithi102.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2021-06-25T04:55:33.270 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-fuse 354410496 0 354410496 0% /home/ubuntu/cephtest/mnt.0 2021-06-25T04:55:33.271 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:55:33.272 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:33.292 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:33.313 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:33.333 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:33.353 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:55:33.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:33.354 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:33.355 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:33.384 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:55:33.385 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:55:33.385 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:55:33.386 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:55:33.386 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:33.401 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15347]: fuse finished with error 0 and tester_r 0 2021-06-25T04:55:33.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:33.404 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:33.404 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:33.412 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:55:33.414 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:55:33.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:55:33.429 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:33.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:33.476 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:33.476 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:33.485 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:55:33.487 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:55:33.487 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2021-06-25T04:55:33.488 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:55:33.489 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:33.504 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14811]: fuse finished with error 0 and tester_r 0 2021-06-25T04:55:33.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:33.507 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:33.507 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:33.555 INFO:teuthology.orchestra.run.smithi161.stdout:ext2/ext3 2021-06-25T04:55:33.556 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:55:33.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:55:33.590 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:33.599 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:55:33.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 Processor -- start 2021-06-25T04:55:33.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 -- start start 2021-06-25T04:55:33.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6e8067140 0x7ff6e805f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff6e80b1930 0x7ff6e805fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e80a7a50 con 0x7ff6e80a7670 2021-06-25T04:55:33.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e81475e0 con 0x7ff6e80b1930 2021-06-25T04:55:33.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e8147880 con 0x7ff6e8067140 2021-06-25T04:55:33.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ee72b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff6e80b1930 0x7ff6e805fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ee72b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff6e80b1930 0x7ff6e805fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41938/0 (socket says 172.21.15.57:41938) 2021-06-25T04:55:33.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ee72b700 1 -- 172.21.15.57:0/204400162 learned_addr learned my addr 172.21.15.57:0/204400162 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:33.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6edf2a700 1 --1- 172.21.15.57:0/204400162 >> v1:172.21.15.57:6789/0 conn(0x7ff6e80a7670 0x7ff6e8066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59152/0 (socket says 172.21.15.57:59152) 2021-06-25T04:55:33.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ed729700 1 --2- 172.21.15.57:0/204400162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6e8067140 0x7ff6e805f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ee72b700 1 -- 172.21.15.57:0/204400162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6e8067140 msgr2=0x7ff6e805f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:33.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ee72b700 1 --2- 172.21.15.57:0/204400162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6e8067140 0x7ff6e805f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ee72b700 1 -- 172.21.15.57:0/204400162 >> v1:172.21.15.57:6789/0 conn(0x7ff6e80a7670 legacy=0x7ff6e8066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:33.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ee72b700 1 -- 172.21.15.57:0/204400162 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8147b20 con 0x7ff6e80b1930 2021-06-25T04:55:33.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ecf28700 1 -- 172.21.15.57:0/204400162 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301980214 0 0) 0x7ff6e80a7a50 con 0x7ff6e80a7670 2021-06-25T04:55:33.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ee72b700 1 --2- 172.21.15.57:0/204400162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6e80b1930 0x7ff6e805fb60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7ff6e00032f0 tx=0x7ff6e0009290).ready entity=mon.0 client_cookie=e05b0baf7151717 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:33.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ecf28700 1 -- 172.21.15.57:0/204400162 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e000b8a0 con 0x7ff6e80b1930 2021-06-25T04:55:33.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ecf28700 1 -- 172.21.15.57:0/204400162 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e000ba00 con 0x7ff6e80b1930 2021-06-25T04:55:33.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 -- 172.21.15.57:0/204400162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6e80b1930 msgr2=0x7ff6e805fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:33.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 --2- 172.21.15.57:0/204400162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6e80b1930 0x7ff6e805fb60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7ff6e00032f0 tx=0x7ff6e0009290).stop 2021-06-25T04:55:33.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6ecf28700 1 -- 172.21.15.57:0/204400162 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e000bb70 con 0x7ff6e80b1930 2021-06-25T04:55:33.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 -- 172.21.15.57:0/204400162 shutdown_connections 2021-06-25T04:55:33.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 --2- 172.21.15.57:0/204400162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6e8067140 0x7ff6e805f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 --2- 172.21.15.57:0/204400162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6e80b1930 0x7ff6e805fb60 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 -- 172.21.15.57:0/204400162 >> 172.21.15.57:0/204400162 conn(0x7ff6e80b53a0 msgr2=0x7ff6e80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:33.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.708+0000 7ff6f018e700 1 -- 172.21.15.57:0/204400162 shutdown_connections 2021-06-25T04:55:33.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6f018e700 1 -- 172.21.15.57:0/204400162 wait complete. 2021-06-25T04:55:33.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6f018e700 1 Processor -- start 2021-06-25T04:55:33.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6f018e700 1 -- start start 2021-06-25T04:55:33.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6f018e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6e8067140 0x7ff6e8156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6f018e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6e80a7670 0x7ff6e8141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6f018e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6e80b1930 0x7ff6e814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6f018e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80ae1c0 con 0x7ff6e80a7670 2021-06-25T04:55:33.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6f018e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80ad7e0 con 0x7ff6e80b1930 2021-06-25T04:55:33.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6f018e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80ada80 con 0x7ff6e8067140 2021-06-25T04:55:33.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6ed729700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6e80a7670 0x7ff6e8141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6ed729700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6e80a7670 0x7ff6e8141230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41940/0 (socket says 172.21.15.57:41940) 2021-06-25T04:55:33.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6ed729700 1 -- 172.21.15.57:0/3192664762 learned_addr learned my addr 172.21.15.57:0/3192664762 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:33.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6ee72b700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6e80b1930 0x7ff6e814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6edf2a700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6e8067140 0x7ff6e8156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6ed729700 1 -- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6e8067140 msgr2=0x7ff6e8156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:33.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6ed729700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6e8067140 0x7ff6e8156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6ed729700 1 -- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6e80b1930 msgr2=0x7ff6e814ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:33.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6ed729700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6e80b1930 0x7ff6e814ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:33.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6ed729700 1 -- 172.21.15.57:0/3192664762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0009530 con 0x7ff6e80a7670 2021-06-25T04:55:33.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6ed729700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6e80a7670 0x7ff6e8141230 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7ff6d800c000 tx=0x7ff6d8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6d6ffd700 1 -- 172.21.15.57:0/3192664762 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6d8010780 con 0x7ff6e80a7670 2021-06-25T04:55:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6d6ffd700 1 -- 172.21.15.57:0/3192664762 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d80108e0 con 0x7ff6e80a7670 2021-06-25T04:55:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6f018e700 1 -- 172.21.15.57:0/3192664762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e80add20 con 0x7ff6e80a7670 2021-06-25T04:55:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6d6ffd700 1 -- 172.21.15.57:0/3192664762 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6d8010c40 con 0x7ff6e80a7670 2021-06-25T04:55:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.712+0000 7ff6f018e700 1 -- 172.21.15.57:0/3192664762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e8141720 con 0x7ff6e80a7670 2021-06-25T04:55:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.716+0000 7ff6f018e700 1 -- 172.21.15.57:0/3192664762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e8057310 con 0x7ff6e80a7670 2021-06-25T04:55:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.716+0000 7ff6d6ffd700 1 -- 172.21.15.57:0/3192664762 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff6d801c460 con 0x7ff6e80a7670 2021-06-25T04:55:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.716+0000 7ff6d6ffd700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6c80553f0 0x7ff6c80578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.716+0000 7ff6d6ffd700 1 -- 172.21.15.57:0/3192664762 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff6d806e2a0 con 0x7ff6e80a7670 2021-06-25T04:55:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.716+0000 7ff6edf2a700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6c80553f0 0x7ff6c80578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.716+0000 7ff6edf2a700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6c80553f0 0x7ff6c80578b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7ff6e400d000 tx=0x7ff6e4007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:33.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.724+0000 7ff6d6ffd700 1 -- 172.21.15.57:0/3192664762 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff6d80443f0 con 0x7ff6e80a7670 2021-06-25T04:55:33.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.852+0000 7ff6f018e700 1 -- 172.21.15.57:0/3192664762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff6e80698a0 con 0x7ff6e80a7670 2021-06-25T04:55:33.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.852+0000 7ff6d6ffd700 1 -- 172.21.15.57:0/3192664762 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v108) v1 ==== 81+0+34051 (secure 0 0 0) 0x7ff6d8047a10 con 0x7ff6e80a7670 2021-06-25T04:55:33.858 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:33.858 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:55:33.859 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 108, 2021-06-25T04:55:33.859 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:55:33.859 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:55:33.859 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:55:24.383836+0000", 2021-06-25T04:55:33.860 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:55:33.860 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:55:33.860 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:55:33.860 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:55:33.861 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:55:33.861 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:55:33.861 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:55:33.862 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:55:33.862 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:55:33.862 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:33.863 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:55:33.863 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:55:33.863 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:55:33.864 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:55:33.864 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:55:33.864 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 20, 2021-06-25T04:55:33.864 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:55:33.864 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:55:33.865 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:55:33.865 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:55:33.865 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:55:33.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.866 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:55:33.866 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:55:33.866 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:55:33.866 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:33.866 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:33.867 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:33.867 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:33.867 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:33.867 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:33.868 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:33.868 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:33.868 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:55:33.868 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:55:33.868 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:55:33.869 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:55:33.869 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:55:33.869 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:33.869 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:33.870 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:33.870 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:33.870 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:33.870 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:33.871 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:33.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.871 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:55:33.871 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:33.871 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:33.872 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:33.872 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:33.872 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:33.872 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:33.873 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:33.873 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:33.874 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:33.874 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:33.874 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:33.874 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:33.875 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:33.875 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:33.875 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:33.875 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:33.876 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:33.876 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:33.876 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:33.876 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:33.876 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:33.877 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:33.877 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:33.877 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:33.877 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:33.878 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:33.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.879 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:33.880 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:33.880 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:33.881 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:33.881 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:33.882 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:33.882 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:33.883 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:33.883 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:33.884 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:33.884 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:33.884 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:55:33.885 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:55:33.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.886 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:33.886 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:55:33.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.888 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:55:33.888 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:55:33.889 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:55:33.889 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:33.890 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:33.890 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:33.891 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:33.892 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:33.892 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:33.893 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:33.893 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:33.893 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:55:33.894 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:55:33.894 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:55:33.895 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:55:33.895 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:55:33.896 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:33.896 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:33.897 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:33.897 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:33.897 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:33.898 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:33.898 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:33.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.899 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:55:33.900 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:33.900 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:33.901 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:33.902 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:33.902 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:33.902 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:33.903 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:33.903 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:33.904 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:33.904 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:33.905 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:33.905 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:33.905 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:33.906 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:33.906 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:33.907 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:33.907 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:33.908 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:33.908 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:33.908 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:33.909 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:33.909 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:33.910 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:33.910 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:33.911 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:33.911 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:33.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.912 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:33.912 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:33.913 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:33.913 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:33.914 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:33.914 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:33.915 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:33.915 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:33.916 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:33.916 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:33.916 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:33.917 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:55:33.917 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:33.918 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:55:33.918 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.919 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 19, 2021-06-25T04:55:33.920 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:55:33.921 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:55:21.803828+0000", 2021-06-25T04:55:33.921 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:33.921 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:33.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:33.922 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:33.923 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:33.923 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:33.924 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:33.924 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:33.924 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:55:33.925 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:55:33.926 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:55:33.926 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:55:33.927 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:55:33.927 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:33.927 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:33.927 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:33.928 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:33.928 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:33.928 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:33.928 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:33.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.929 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "107", 2021-06-25T04:55:33.929 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:33.929 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:33.930 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:33.930 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:33.930 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:33.930 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:33.930 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:33.931 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:33.931 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:33.932 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:33.933 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:33.933 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:33.933 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:33.934 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:33.934 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:33.934 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:33.934 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:33.935 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:33.935 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:33.936 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:33.936 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:33.937 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:33.938 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:33.940 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:33.940 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:33.940 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:33.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.941 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:33.941 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:33.941 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:33.941 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:33.942 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:33.942 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:33.942 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:33.942 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:33.943 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:33.943 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:33.943 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:33.943 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:55:33.944 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:55:33.944 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:55:33.944 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:55:33.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.944 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:33.945 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:55:33.945 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:55:33.945 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.946 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.947 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 20, 2021-06-25T04:55:33.947 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:55:33.947 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:55:22.740631+0000", 2021-06-25T04:55:33.947 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:33.948 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:33.948 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:33.948 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:33.948 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:33.949 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:33.949 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:33.949 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:33.950 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:55:33.950 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:55:33.950 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:55:33.950 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:55:33.951 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:55:33.951 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:33.951 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:33.951 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:33.952 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:33.952 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:33.952 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:33.952 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:33.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.953 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "108", 2021-06-25T04:55:33.953 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:33.953 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:33.954 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:33.954 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:33.954 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:33.954 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:33.955 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:33.955 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:33.955 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:33.956 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:33.956 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:33.956 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:33.957 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:33.957 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:33.957 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:33.957 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:33.958 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:33.958 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:33.958 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:33.958 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:33.959 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:33.959 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:33.959 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:33.959 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:33.960 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:33.960 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:33.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.960 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:33.960 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:33.961 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:33.961 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:33.961 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:33.961 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:33.962 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:33.962 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:33.962 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:33.962 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:33.963 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:33.963 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:55:33.963 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:33.963 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:55:33.964 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:55:33.964 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.964 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.964 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.964 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:33.965 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:55:33.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.965 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:55:33.965 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:55:33.966 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:33.966 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:33.966 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:33.966 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:33.967 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:33.967 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:33.972 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:33.972 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 106, 2021-06-25T04:55:33.972 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:33.972 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:33.973 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:33.973 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:33.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.973 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:33.974 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:55:33.974 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:33.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.975 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:33.975 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:55:33.975 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:33.975 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.975 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:33.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.976 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:33.976 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:33.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.977 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:33.977 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:55:33.977 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:33.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.978 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:33.978 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:55:33.978 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:33.979 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.979 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:33.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.979 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:55:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:55:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:55:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:55:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:55:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:55:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:55:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:55:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:33.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.988 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:55:33.988 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:55:33.989 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:33.989 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:33.989 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:33.990 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:33.990 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:33.990 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:33.990 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:33.990 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 106, 2021-06-25T04:55:33.991 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:33.991 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:33.991 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:33.991 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:33.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.992 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:33.992 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:55:33.992 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:33.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.993 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:33.993 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:55:33.993 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:33.994 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.994 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:33.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.994 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:33.994 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:33.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.995 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:33.995 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:55:33.995 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:33.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.996 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:33.997 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:55:33.997 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:33.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:33.997 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:33.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:33.998 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:33.998 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:33.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:55:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:55:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:34.002 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.002 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.003 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:55:34.003 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:34.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.003 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.004 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:55:34.004 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:34.004 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.004 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.005 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:55:34.005 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:55:34.006 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:55:34.006 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:55:34.006 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:34.006 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:34.007 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:34.007 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.007 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:55:34.008 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:55:34.008 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:34.008 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:34.008 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:34.009 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:34.009 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:34.009 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:34.009 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:34.010 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 105, 2021-06-25T04:55:34.010 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:34.010 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:34.011 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:34.011 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.011 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.012 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:55:34.012 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:34.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.012 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.013 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:55:34.013 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:34.013 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.013 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.014 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:34.014 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.015 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.015 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:55:34.015 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:34.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.017 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.017 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:55:34.018 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:34.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.019 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.020 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:34.020 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.021 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.021 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:55:34.022 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:34.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.023 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.023 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:55:34.024 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:34.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.024 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.025 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:34.025 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.026 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.026 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:55:34.026 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:34.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.027 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:55:34.027 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:34.027 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.028 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.028 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:55:34.028 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:55:34.029 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:55:34.029 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:55:34.029 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:34.029 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:34.030 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:34.030 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.031 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:55:34.031 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:55:34.031 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:34.032 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:34.032 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:34.032 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:34.032 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:34.033 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:34.033 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:34.033 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 106, 2021-06-25T04:55:34.033 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:34.034 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:34.034 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:34.034 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.035 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.035 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:55:34.035 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:34.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.036 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.036 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:55:34.036 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:34.037 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.037 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.037 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:34.038 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.038 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.038 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:55:34.039 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:34.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.039 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.039 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:55:34.040 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:34.040 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.040 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.041 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:34.041 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.041 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.042 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:55:34.042 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:34.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.043 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.043 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:55:34.043 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:34.043 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.044 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.044 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:34.044 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.045 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.045 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:55:34.045 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:34.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.046 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.046 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:55:34.046 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:34.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.047 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.047 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:55:34.047 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:55:34.048 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:55:34.048 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:55:34.048 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:34.049 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:34.049 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:34.049 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.050 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:55:34.050 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:55:34.050 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:34.051 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:34.051 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:34.051 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:34.052 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:34.052 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:34.052 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:34.052 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 105, 2021-06-25T04:55:34.053 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:34.053 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:34.053 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:34.053 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.054 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.054 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:55:34.054 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:34.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.055 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.056 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:55:34.056 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:34.056 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.056 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.057 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:34.057 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.058 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.058 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:55:34.058 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:34.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.059 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.059 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:55:34.059 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:34.059 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.060 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.060 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:34.061 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.062 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.062 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:55:34.062 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:34.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.063 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.063 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:55:34.064 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:34.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.064 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.064 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:34.065 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.065 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:55:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.067 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:55:34.067 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:34.067 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.068 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.068 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:55:34.068 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:55:34.068 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:55:34.069 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:55:34.069 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:34.069 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:34.069 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:34.070 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.070 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:55:34.070 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:55:34.071 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:34.071 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:34.071 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:34.071 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:34.072 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:34.072 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:34.072 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:34.073 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 105, 2021-06-25T04:55:34.073 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:34.073 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:34.073 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:34.073 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.074 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.074 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:55:34.074 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:34.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.075 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.075 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:55:34.075 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:34.076 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.076 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.076 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:34.077 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.077 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.077 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:55:34.077 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:34.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.078 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.078 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:55:34.079 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:34.079 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.079 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.079 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:34.080 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.080 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.080 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:55:34.081 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:34.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.081 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.082 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:55:34.082 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:34.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.082 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.083 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:34.083 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.084 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.084 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:55:34.084 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:34.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.085 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.085 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:55:34.085 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:34.085 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.086 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.086 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:55:34.086 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:55:34.087 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:55:34.087 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:55:34.087 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:34.087 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:34.087 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:34.088 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.088 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:55:34.089 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:55:34.089 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:34.089 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:34.089 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:34.090 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:34.090 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:34.090 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:34.090 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:34.091 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 106, 2021-06-25T04:55:34.091 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:34.091 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:34.091 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:34.091 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.092 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.092 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:55:34.092 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:34.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.093 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:55:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.095 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:34.095 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.095 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.096 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:55:34.096 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:34.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.096 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.097 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:55:34.097 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:34.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.097 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.099 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:55:34.099 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:34.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.100 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.100 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:55:34.100 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:34.100 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.101 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.101 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:34.101 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.102 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.102 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:55:34.102 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:34.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.103 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.103 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:55:34.104 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:34.104 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.104 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.105 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:55:34.105 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:55:34.105 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:55:34.105 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:55:34.105 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:34.106 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:34.106 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:34.106 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.107 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:55:34.107 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:55:34.107 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:34.107 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:34.108 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:34.108 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:34.108 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:34.108 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:34.109 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:34.109 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 106, 2021-06-25T04:55:34.109 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:34.109 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:34.109 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:34.110 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.110 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.110 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:55:34.111 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:34.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.111 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.112 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:55:34.112 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:34.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.112 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.113 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:34.113 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.113 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.114 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:55:34.114 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:34.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.115 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.115 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:55:34.115 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:34.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.116 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.116 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:34.116 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.117 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.117 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:55:34.117 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:34.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.118 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.118 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:55:34.118 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:34.119 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.119 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.119 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:34.119 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:34.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.120 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:34.120 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:55:34.120 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:34.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.121 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:34.121 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:55:34.121 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:34.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.122 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.122 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:55:34.123 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:55:34.123 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:55:34.123 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:55:34.123 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:34.124 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:34.124 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:34.124 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:34.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.124 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:34.125 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:55:34.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.125 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:55:34.126 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:34.126 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:34.126 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:34.126 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:55:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:55:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:55:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:55:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:55:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:55:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:55:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:55:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:55:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:55:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:55:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:55:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:55:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:55:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:55:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:55:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:55:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:55:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:55:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": {}, 2021-06-25T04:55:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:55:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:55:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:55:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:55:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:55:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:55:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:55:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:55:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:55:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:55:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:55:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:55:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:55:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:55:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:55:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:55:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:55:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:55:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:55:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:55:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:55:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:55:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:55:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:55:34.151 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:55:34.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 -- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6c80553f0 msgr2=0x7ff6c80578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6c80553f0 0x7ff6c80578b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7ff6e400d000 tx=0x7ff6e4007a00).stop 2021-06-25T04:55:34.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 -- 172.21.15.57:0/3192664762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6e80a7670 msgr2=0x7ff6e8141230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6e80a7670 0x7ff6e8141230 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7ff6d800c000 tx=0x7ff6d8006df0).stop 2021-06-25T04:55:34.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 -- 172.21.15.57:0/3192664762 shutdown_connections 2021-06-25T04:55:34.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6c80553f0 0x7ff6c80578b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6e80b1930 0x7ff6e814ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6e80a7670 0x7ff6e8141230 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 --2- 172.21.15.57:0/3192664762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6e8067140 0x7ff6e8156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 -- 172.21.15.57:0/3192664762 >> 172.21.15.57:0/3192664762 conn(0x7ff6e80b53a0 msgr2=0x7ff6e8149a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:34.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 -- 172.21.15.57:0/3192664762 shutdown_connections 2021-06-25T04:55:34.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:33.856+0000 7ff6f018e700 1 -- 172.21.15.57:0/3192664762 wait complete. 2021-06-25T04:55:34.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:34.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601a08e700 1 Processor -- start 2021-06-25T04:55:34.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601a08e700 1 -- start start 2021-06-25T04:55:34.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601a08e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60140b05d0 0x7f60140af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:34.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601a08e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6014147560 0x7f60140acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:34.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601a08e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60140b5840 con 0x7f60140b5460 2021-06-25T04:55:34.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601a08e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60141452a0 con 0x7f60140b05d0 2021-06-25T04:55:34.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601a08e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60140adfb0 con 0x7f6014147560 2021-06-25T04:55:34.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601908c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f60140b5460 0x7f6014067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59166/0 (socket says 172.21.15.57:59166) 2021-06-25T04:55:34.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601908c700 1 -- 172.21.15.57:0/2448990895 learned_addr learned my addr 172.21.15.57:0/2448990895 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:34.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601888b700 1 --2- 172.21.15.57:0/2448990895 >> v2:172.21.15.87:3300/0 conn(0x7f60140b05d0 0x7f60140af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:34.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601988d700 1 --2- 172.21.15.57:0/2448990895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6014147560 0x7f60140acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:34.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f6007fff700 1 -- 172.21.15.57:0/2448990895 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281877202 0 0) 0x7f60140b5840 con 0x7f60140b5460 2021-06-25T04:55:34.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f6007fff700 1 -- 172.21.15.57:0/2448990895 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff8003260 con 0x7f60140b5460 2021-06-25T04:55:34.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f6007fff700 1 -- 172.21.15.57:0/2448990895 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 84728225 0 0) 0x7f5ff8003260 con 0x7f60140b5460 2021-06-25T04:55:34.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601888b700 1 -- 172.21.15.57:0/2448990895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6014147560 msgr2=0x7f60140acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:34.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601888b700 1 --2- 172.21.15.57:0/2448990895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6014147560 0x7f60140acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601888b700 1 -- 172.21.15.57:0/2448990895 >> v1:172.21.15.57:6789/0 conn(0x7f60140b5460 legacy=0x7f6014067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601888b700 1 -- 172.21.15.57:0/2448990895 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140ac7c0 con 0x7f60140b05d0 2021-06-25T04:55:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601888b700 1 --2- 172.21.15.57:0/2448990895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60140b05d0 0x7f60140af510 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f600c001b80 tx=0x7f6010006df0).ready entity=mon.1 client_cookie=7a14289b9a9e1b9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f6007fff700 1 -- 172.21.15.57:0/2448990895 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f600c0019e0 con 0x7f60140b05d0 2021-06-25T04:55:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f6007fff700 1 -- 172.21.15.57:0/2448990895 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6010000e90 con 0x7f60140b05d0 2021-06-25T04:55:34.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f6007fff700 1 -- 172.21.15.57:0/2448990895 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6010012460 con 0x7f60140b05d0 2021-06-25T04:55:34.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601a08e700 1 -- 172.21.15.57:0/2448990895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60140b05d0 msgr2=0x7f60140af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.268+0000 7f601a08e700 1 --2- 172.21.15.57:0/2448990895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60140b05d0 0x7f60140af510 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f600c001b80 tx=0x7f6010006df0).stop 2021-06-25T04:55:34.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 -- 172.21.15.57:0/2448990895 shutdown_connections 2021-06-25T04:55:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 --2- 172.21.15.57:0/2448990895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6014147560 0x7f60140acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 --2- 172.21.15.57:0/2448990895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60140b05d0 0x7f60140af510 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 -- 172.21.15.57:0/2448990895 >> 172.21.15.57:0/2448990895 conn(0x7f6014062520 msgr2=0x7f6014062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 -- 172.21.15.57:0/2448990895 shutdown_connections 2021-06-25T04:55:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 -- 172.21.15.57:0/2448990895 wait complete. 2021-06-25T04:55:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 Processor -- start 2021-06-25T04:55:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 -- start start 2021-06-25T04:55:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60140b05d0 0x7f6014064ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60140b5460 0x7f6014159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6014147560 0x7f601415a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601414e9e0 con 0x7f60140b05d0 2021-06-25T04:55:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6014063380 con 0x7f60140b5460 2021-06-25T04:55:34.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6014063620 con 0x7f6014147560 2021-06-25T04:55:34.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601908c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60140b05d0 0x7f6014064ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601908c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60140b05d0 0x7f6014064ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41954/0 (socket says 172.21.15.57:41954) 2021-06-25T04:55:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601908c700 1 -- 172.21.15.57:0/3775205703 learned_addr learned my addr 172.21.15.57:0/3775205703 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601988d700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6014147560 0x7f601415a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601888b700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60140b5460 0x7f6014159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601908c700 1 -- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6014147560 msgr2=0x7f601415a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601908c700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6014147560 0x7f601415a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601908c700 1 -- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60140b5460 msgr2=0x7f6014159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601908c700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60140b5460 0x7f6014159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601908c700 1 -- 172.21.15.57:0/3775205703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601000b180 con 0x7f60140b05d0 2021-06-25T04:55:34.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601908c700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60140b05d0 0x7f6014064ec0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f600c001c40 tx=0x7f600c0015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:34.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f60067fc700 1 -- 172.21.15.57:0/3775205703 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f600c004ab0 con 0x7f60140b05d0 2021-06-25T04:55:34.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f60067fc700 1 -- 172.21.15.57:0/3775205703 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c004c10 con 0x7f60140b05d0 2021-06-25T04:55:34.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 -- 172.21.15.57:0/3775205703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6014066ff0 con 0x7f60140b05d0 2021-06-25T04:55:34.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f60067fc700 1 -- 172.21.15.57:0/3775205703 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f600c007170 con 0x7f60140b05d0 2021-06-25T04:55:34.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.272+0000 7f601a08e700 1 -- 172.21.15.57:0/3775205703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6014063c60 con 0x7f60140b05d0 2021-06-25T04:55:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.276+0000 7f601a08e700 1 -- 172.21.15.57:0/3775205703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60140637e0 con 0x7f60140b05d0 2021-06-25T04:55:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.276+0000 7f60067fc700 1 -- 172.21.15.57:0/3775205703 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f600c010070 con 0x7f60140b05d0 2021-06-25T04:55:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.276+0000 7f60067fc700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ffc055490 0x7f5ffc057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.276+0000 7f60067fc700 1 -- 172.21.15.57:0/3775205703 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f600c06db60 con 0x7f60140b05d0 2021-06-25T04:55:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.276+0000 7f601888b700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ffc055490 0x7f5ffc057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:34.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.276+0000 7f601888b700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ffc055490 0x7f5ffc057950 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f6010019000 tx=0x7f6010014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:34.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.284+0000 7f60067fc700 1 -- 172.21.15.57:0/3775205703 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f600c043cb0 con 0x7f60140b05d0 2021-06-25T04:55:34.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.444+0000 7f601a08e700 1 -- 172.21.15.57:0/3775205703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f601414eba0 con 0x7f60140b05d0 2021-06-25T04:55:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.444+0000 7f60067fc700 1 -- 172.21.15.57:0/3775205703 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f600c0472d0 con 0x7f60140b05d0 2021-06-25T04:55:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:34.450 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":52,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3265820466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3265820466},{"type":"v1","addr":"172.21.15.87:6835","nonce":3265820466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51},{"gid":7323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/994003328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":994003328},{"type":"v1","addr":"172.21.15.57:6833","nonce":994003328}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:55:23.381147+0000","modified":"2021-06-25T04:55:24.413073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7326":{"gid":7326,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/4260642378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4260642378},{"type":"v1","addr":"172.21.15.57:6835","nonce":4260642378}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-06-25T04:55:34.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 -- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ffc055490 msgr2=0x7f5ffc057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ffc055490 0x7f5ffc057950 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f6010019000 tx=0x7f6010014000).stop 2021-06-25T04:55:34.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 -- 172.21.15.57:0/3775205703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60140b05d0 msgr2=0x7f6014064ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60140b05d0 0x7f6014064ec0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f600c001c40 tx=0x7f600c0015b0).stop 2021-06-25T04:55:34.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 -- 172.21.15.57:0/3775205703 shutdown_connections 2021-06-25T04:55:34.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5ffc055490 0x7f5ffc057950 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6014147560 0x7f601415a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60140b5460 0x7f6014159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 --2- 172.21.15.57:0/3775205703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60140b05d0 0x7f6014064ec0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 -- 172.21.15.57:0/3775205703 >> 172.21.15.57:0/3775205703 conn(0x7f6014062520 msgr2=0x7f60140acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:34.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 -- 172.21.15.57:0/3775205703 shutdown_connections 2021-06-25T04:55:34.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.448+0000 7f601a08e700 1 -- 172.21.15.57:0/3775205703 wait complete. 2021-06-25T04:55:34.456 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 52 2021-06-25T04:55:34.463 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:55:34.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd6f37700 1 Processor -- start 2021-06-25T04:55:34.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd6f37700 1 -- start start 2021-06-25T04:55:34.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd6f37700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8cd00affd0 0x7f8cd00a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:34.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd6f37700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd00a7080 con 0x7f8cd00b2540 2021-06-25T04:55:34.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd6f37700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd00a72b0 con 0x7f8cd00afb90 2021-06-25T04:55:34.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd6f37700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd00a7550 con 0x7f8cd00affd0 2021-06-25T04:55:34.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd5734700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8cd00affd0 0x7f8cd00a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:34.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd5f35700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8cd00b2540 0x7f8cd014ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59180/0 (socket says 172.21.15.57:59180) 2021-06-25T04:55:34.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd5734700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8cd00affd0 0x7f8cd00a8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41962/0 (socket says 172.21.15.57:41962) 2021-06-25T04:55:34.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd5734700 1 -- 172.21.15.57:0/1577100334 learned_addr learned my addr 172.21.15.57:0/1577100334 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:34.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd5734700 1 -- 172.21.15.57:0/1577100334 >> v1:172.21.15.87:6789/0 conn(0x7f8cd00afb90 legacy=0x7f8cd0151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd5734700 1 -- 172.21.15.57:0/1577100334 >> v1:172.21.15.57:6789/0 conn(0x7f8cd00b2540 legacy=0x7f8cd014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd5734700 1 -- 172.21.15.57:0/1577100334 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd00a77f0 con 0x7f8cd00affd0 2021-06-25T04:55:34.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd5734700 1 --2- 172.21.15.57:0/1577100334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cd00affd0 0x7f8cd00a8370 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f8ccc0032f0 tx=0x7f8ccc009290).ready entity=mon.0 client_cookie=c789ecbb42057c38 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:34.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd4f33700 1 -- 172.21.15.57:0/1577100334 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ccc00b8a0 con 0x7f8cd00affd0 2021-06-25T04:55:34.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd4f33700 1 -- 172.21.15.57:0/1577100334 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00ba00 con 0x7f8cd00affd0 2021-06-25T04:55:34.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.560+0000 7f8cd4f33700 1 -- 172.21.15.57:0/1577100334 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ccc00bb70 con 0x7f8cd00affd0 2021-06-25T04:55:34.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.564+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1577100334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cd00affd0 msgr2=0x7f8cd00a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.564+0000 7f8cd6f37700 1 --2- 172.21.15.57:0/1577100334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cd00affd0 0x7f8cd00a8370 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f8ccc0032f0 tx=0x7f8ccc009290).stop 2021-06-25T04:55:34.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.564+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1577100334 shutdown_connections 2021-06-25T04:55:34.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.564+0000 7f8cd6f37700 1 --2- 172.21.15.57:0/1577100334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cd00affd0 0x7f8cd00a8370 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.564+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1577100334 >> 172.21.15.57:0/1577100334 conn(0x7f8cd0060140 msgr2=0x7f8cd00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:34.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.564+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1577100334 shutdown_connections 2021-06-25T04:55:34.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.564+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1577100334 wait complete. 2021-06-25T04:55:34.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.564+0000 7f8cd6f37700 1 Processor -- start 2021-06-25T04:55:34.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.564+0000 7f8cd6f37700 1 -- start start 2021-06-25T04:55:34.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd6f37700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cd00afb90 0x7f8cd0143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:34.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd6f37700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cd00affd0 0x7f8cd015a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:34.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd6f37700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd00b2540 0x7f8cd015a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:34.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd6f37700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd01599f0 con 0x7f8cd00afb90 2021-06-25T04:55:34.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd6f37700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd014cd00 con 0x7f8cd00b2540 2021-06-25T04:55:34.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd6f37700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd014cfa0 con 0x7f8cd00affd0 2021-06-25T04:55:34.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd5f35700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cd00afb90 0x7f8cd0143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:34.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd5f35700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cd00afb90 0x7f8cd0143a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41968/0 (socket says 172.21.15.57:41968) 2021-06-25T04:55:34.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd5f35700 1 -- 172.21.15.57:0/1539160077 learned_addr learned my addr 172.21.15.57:0/1539160077 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:34.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd5734700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cd00affd0 0x7f8cd015a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:34.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd6736700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd00b2540 0x7f8cd015a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:34.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd5f35700 1 -- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cd00affd0 msgr2=0x7f8cd015a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd5f35700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cd00affd0 0x7f8cd015a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd5f35700 1 -- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd00b2540 msgr2=0x7f8cd015a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd5f35700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd00b2540 0x7f8cd015a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd5f35700 1 -- 172.21.15.57:0/1539160077 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc009530 con 0x7f8cd00afb90 2021-06-25T04:55:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd6736700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd00b2540 0x7f8cd015a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd5f35700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cd00afb90 0x7f8cd0143a30 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f8cd006b780 tx=0x7f8cc0007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cbeffd700 1 -- 172.21.15.57:0/1539160077 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cc000ce30 con 0x7f8cd00afb90 2021-06-25T04:55:34.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cbeffd700 1 -- 172.21.15.57:0/1539160077 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc00072e0 con 0x7f8cd00afb90 2021-06-25T04:55:34.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1539160077 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd014d240 con 0x7f8cd00afb90 2021-06-25T04:55:34.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cbeffd700 1 -- 172.21.15.57:0/1539160077 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cc0005740 con 0x7f8cd00afb90 2021-06-25T04:55:34.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1539160077 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd0143f20 con 0x7f8cd00afb90 2021-06-25T04:55:34.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.568+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1539160077 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd014d3d0 con 0x7f8cd00afb90 2021-06-25T04:55:34.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.572+0000 7f8cbeffd700 1 -- 172.21.15.57:0/1539160077 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8cc0010070 con 0x7f8cd00afb90 2021-06-25T04:55:34.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.572+0000 7f8cbeffd700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cb0055490 0x7f8cb0057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:34.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.572+0000 7f8cbeffd700 1 -- 172.21.15.57:0/1539160077 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8cc006d420 con 0x7f8cd00afb90 2021-06-25T04:55:34.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.572+0000 7f8cd5734700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cb0055490 0x7f8cb0057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:34.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.572+0000 7f8cd5734700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cb0055490 0x7f8cb0057950 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f8ccc018000 tx=0x7f8ccc016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:34.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.576+0000 7f8cbeffd700 1 -- 172.21.15.57:0/1539160077 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8cc00435d0 con 0x7f8cd00afb90 2021-06-25T04:55:34.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:34.740+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1539160077 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8cd0057310 con 0x7f8cd00afb90 2021-06-25T04:55:35.670 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:55:35.668+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:55:35.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.672+0000 7f8cbeffd700 1 -- 172.21.15.57:0/1539160077 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8cc0046bf0 con 0x7f8cd00afb90 2021-06-25T04:55:35.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cb0055490 msgr2=0x7f8cb0057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:35.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cb0055490 0x7f8cb0057950 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f8ccc018000 tx=0x7f8ccc016000).stop 2021-06-25T04:55:35.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1539160077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cd00afb90 msgr2=0x7f8cd0143a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:35.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cd00afb90 0x7f8cd0143a30 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f8cd006b780 tx=0x7f8cc0007c60).stop 2021-06-25T04:55:35.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1539160077 shutdown_connections 2021-06-25T04:55:35.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8cb0055490 0x7f8cb0057950 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cd00b2540 0x7f8cd015a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cd00affd0 0x7f8cd015a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 --2- 172.21.15.57:0/1539160077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cd00afb90 0x7f8cd0143a30 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1539160077 >> 172.21.15.57:0/1539160077 conn(0x7f8cd0060140 msgr2=0x7f8cd0144d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:35.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1539160077 shutdown_connections 2021-06-25T04:55:35.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.676+0000 7f8cd6f37700 1 -- 172.21.15.57:0/1539160077 wait complete. 2021-06-25T04:55:35.685 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:55:35.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:35.705 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:55:35.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.804+0000 7f3230018700 1 Processor -- start 2021-06-25T04:55:35.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.804+0000 7f3230018700 1 -- start start 2021-06-25T04:55:35.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.804+0000 7f3230018700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32280ae1f0 0x7f3228143280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:35.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.804+0000 7f3230018700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32280b0920 0x7f32280b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:35.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.804+0000 7f3230018700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322805f7f0 con 0x7f322805c450 2021-06-25T04:55:35.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.804+0000 7f3230018700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322805fa90 con 0x7f32280b0920 2021-06-25T04:55:35.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.804+0000 7f3230018700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322805fd30 con 0x7f32280ae1f0 2021-06-25T04:55:35.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.804+0000 7f322e5b5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32280b0920 0x7f32280b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:35.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.804+0000 7f322e5b5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32280b0920 0x7f32280b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41992/0 (socket says 172.21.15.57:41992) 2021-06-25T04:55:35.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.804+0000 7f322e5b5700 1 -- 172.21.15.57:0/2868842088 learned_addr learned my addr 172.21.15.57:0/2868842088 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:35.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.804+0000 7f322ddb4700 1 --2- 172.21.15.57:0/2868842088 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32280ae1f0 0x7f3228143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:35.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f322e5b5700 1 -- 172.21.15.57:0/2868842088 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32280ae1f0 msgr2=0x7f3228143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f322e5b5700 1 --2- 172.21.15.57:0/2868842088 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32280ae1f0 0x7f3228143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f322e5b5700 1 -- 172.21.15.57:0/2868842088 >> v1:172.21.15.87:6789/0 conn(0x7f322805c450 legacy=0x7f3228143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f322e5b5700 1 -- 172.21.15.57:0/2868842088 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322805ffd0 con 0x7f32280b0920 2021-06-25T04:55:35.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f322e5b5700 1 --2- 172.21.15.57:0/2868842088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280b0920 0x7f32280b2550 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f3220002f70 tx=0x7f3220006eb0).ready entity=mon.0 client_cookie=ebc572293081bed4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:35.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f322cdb2700 1 -- 172.21.15.57:0/2868842088 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f322000d570 con 0x7f32280b0920 2021-06-25T04:55:35.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f322cdb2700 1 -- 172.21.15.57:0/2868842088 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3220000e90 con 0x7f32280b0920 2021-06-25T04:55:35.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f322cdb2700 1 -- 172.21.15.57:0/2868842088 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f322000d900 con 0x7f32280b0920 2021-06-25T04:55:35.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f3230018700 1 -- 172.21.15.57:0/2868842088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280b0920 msgr2=0x7f32280b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:35.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f3230018700 1 --2- 172.21.15.57:0/2868842088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280b0920 0x7f32280b2550 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f3220002f70 tx=0x7f3220006eb0).stop 2021-06-25T04:55:35.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f3230018700 1 -- 172.21.15.57:0/2868842088 shutdown_connections 2021-06-25T04:55:35.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f3230018700 1 --2- 172.21.15.57:0/2868842088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280b0920 0x7f32280b2550 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f3230018700 1 --2- 172.21.15.57:0/2868842088 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32280ae1f0 0x7f3228143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f3230018700 1 -- 172.21.15.57:0/2868842088 >> 172.21.15.57:0/2868842088 conn(0x7f322805cce0 msgr2=0x7f3228062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:35.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f3230018700 1 -- 172.21.15.57:0/2868842088 shutdown_connections 2021-06-25T04:55:35.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f3230018700 1 -- 172.21.15.57:0/2868842088 wait complete. 2021-06-25T04:55:35.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f3230018700 1 Processor -- start 2021-06-25T04:55:35.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.808+0000 7f3230018700 1 -- start start 2021-06-25T04:55:35.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f3230018700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f322805c450 0x7f3228145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:35.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f3230018700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280ae1f0 0x7f32280a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:35.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f3230018700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32280b0920 0x7f3228066fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:35.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f3230018700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3228152730 con 0x7f32280ae1f0 2021-06-25T04:55:35.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f3230018700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3228153260 con 0x7f322805c450 2021-06-25T04:55:35.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f3230018700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32280a4cc0 con 0x7f32280b0920 2021-06-25T04:55:35.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322ddb4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f322805c450 0x7f3228145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:35.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322d5b3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280ae1f0 0x7f32280a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:35.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322ddb4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f322805c450 0x7f3228145af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:50488/0 (socket says 172.21.15.57:50488) 2021-06-25T04:55:35.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322ddb4700 1 -- 172.21.15.57:0/3642733426 learned_addr learned my addr 172.21.15.57:0/3642733426 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:35.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322e5b5700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32280b0920 0x7f3228066fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:35.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322d5b3700 1 -- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32280b0920 msgr2=0x7f3228066fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:35.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322d5b3700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32280b0920 0x7f3228066fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322d5b3700 1 -- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f322805c450 msgr2=0x7f3228145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:35.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322d5b3700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f322805c450 0x7f3228145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322d5b3700 1 -- 172.21.15.57:0/3642733426 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322000b1e0 con 0x7f32280ae1f0 2021-06-25T04:55:35.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322ddb4700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f322805c450 0x7f3228145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:35.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f322d5b3700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280ae1f0 0x7f32280a53c0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f32280643e0 tx=0x7f3218007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:35.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f3216ffd700 1 -- 172.21.15.57:0/3642733426 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f321800cea0 con 0x7f32280ae1f0 2021-06-25T04:55:35.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f3216ffd700 1 -- 172.21.15.57:0/3642733426 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3218012400 con 0x7f32280ae1f0 2021-06-25T04:55:35.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f3230018700 1 -- 172.21.15.57:0/3642733426 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3228152490 con 0x7f32280ae1f0 2021-06-25T04:55:35.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f3216ffd700 1 -- 172.21.15.57:0/3642733426 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3218012760 con 0x7f32280ae1f0 2021-06-25T04:55:35.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.812+0000 7f3230018700 1 -- 172.21.15.57:0/3642733426 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3228063900 con 0x7f32280ae1f0 2021-06-25T04:55:35.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.816+0000 7f3230018700 1 -- 172.21.15.57:0/3642733426 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3228057310 con 0x7f32280ae1f0 2021-06-25T04:55:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.816+0000 7f3216ffd700 1 -- 172.21.15.57:0/3642733426 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3218019030 con 0x7f32280ae1f0 2021-06-25T04:55:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.816+0000 7f3216ffd700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3208055450 0x7f3208057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.816+0000 7f3216ffd700 1 -- 172.21.15.57:0/3642733426 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f321806d130 con 0x7f32280ae1f0 2021-06-25T04:55:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.816+0000 7f322ddb4700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3208055450 0x7f3208057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:35.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.816+0000 7f322ddb4700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3208055450 0x7f3208057910 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f322400b000 tx=0x7f32240091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:35.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.820+0000 7f3216ffd700 1 -- 172.21.15.57:0/3642733426 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3218043290 con 0x7f32280ae1f0 2021-06-25T04:55:35.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.984+0000 7f3230018700 1 -- 172.21.15.57:0/3642733426 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f322805d720 con 0x7f32280ae1f0 2021-06-25T04:55:35.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.984+0000 7f3216ffd700 1 -- 172.21.15.57:0/3642733426 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+2130 (secure 0 0 0) 0x7f32180468b0 con 0x7f32280ae1f0 2021-06-25T04:55:35.990 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:35.990 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":53,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3265820466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3265820466},{"type":"v1","addr":"172.21.15.87:6835","nonce":3265820466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51},{"gid":7323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/994003328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":994003328},{"type":"v1","addr":"172.21.15.57:6833","nonce":994003328}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:55:23.381147+0000","modified":"2021-06-25T04:55:35.669479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-06-25T04:55:35.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 -- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3208055450 msgr2=0x7f3208057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:35.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3208055450 0x7f3208057910 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f322400b000 tx=0x7f32240091d0).stop 2021-06-25T04:55:35.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 -- 172.21.15.57:0/3642733426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280ae1f0 msgr2=0x7f32280a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:35.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280ae1f0 0x7f32280a53c0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f32280643e0 tx=0x7f3218007b90).stop 2021-06-25T04:55:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 -- 172.21.15.57:0/3642733426 shutdown_connections 2021-06-25T04:55:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3208055450 0x7f3208057910 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32280b0920 0x7f3228066fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280ae1f0 0x7f32280a53c0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 --2- 172.21.15.57:0/3642733426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f322805c450 0x7f3228145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 -- 172.21.15.57:0/3642733426 >> 172.21.15.57:0/3642733426 conn(0x7f322805cce0 msgr2=0x7f32280aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 -- 172.21.15.57:0/3642733426 shutdown_connections 2021-06-25T04:55:35.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:35.988+0000 7f3230018700 1 -- 172.21.15.57:0/3642733426 wait complete. 2021-06-25T04:55:35.998 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 53 2021-06-25T04:55:36.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:55:36.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.104+0000 7fea73e12700 1 Processor -- start 2021-06-25T04:55:36.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.104+0000 7fea73e12700 1 -- start start 2021-06-25T04:55:36.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.104+0000 7fea73e12700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea6c0b6520 0x7fea6c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:36.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea73e12700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c143f20 con 0x7fea6c0b5950 2021-06-25T04:55:36.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea73e12700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c05ffa0 con 0x7fea6c05fbc0 2021-06-25T04:55:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea73e12700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0ba670 con 0x7fea6c0b6520 2021-06-25T04:55:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea723af700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fea6c0b5950 0x7fea6c0b49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59224/0 (socket says 172.21.15.57:59224) 2021-06-25T04:55:36.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea71bae700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fea6c05fbc0 0x7fea6c0b9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:59968/0 (socket says 172.21.15.57:59968) 2021-06-25T04:55:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea723af700 1 -- 172.21.15.57:0/2864981195 learned_addr learned my addr 172.21.15.57:0/2864981195 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea713ad700 1 --2- 172.21.15.57:0/2864981195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea6c0b6520 0x7fea6c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea70bac700 1 -- 172.21.15.57:0/2864981195 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070663943 0 0) 0x7fea6c143f20 con 0x7fea6c0b5950 2021-06-25T04:55:36.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea70bac700 1 -- 172.21.15.57:0/2864981195 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea54003260 con 0x7fea6c0b5950 2021-06-25T04:55:36.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea713ad700 1 -- 172.21.15.57:0/2864981195 >> v1:172.21.15.87:6789/0 conn(0x7fea6c05fbc0 legacy=0x7fea6c0b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:36.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea70bac700 1 -- 172.21.15.57:0/2864981195 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883472813 0 0) 0x7fea6c05ffa0 con 0x7fea6c05fbc0 2021-06-25T04:55:36.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea713ad700 1 -- 172.21.15.57:0/2864981195 >> v1:172.21.15.57:6789/0 conn(0x7fea6c0b5950 legacy=0x7fea6c0b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:36.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea713ad700 1 -- 172.21.15.57:0/2864981195 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c143a10 con 0x7fea6c0b6520 2021-06-25T04:55:36.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea713ad700 1 --2- 172.21.15.57:0/2864981195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea6c0b6520 0x7fea6c0b4170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fea68002f70 tx=0x7fea68006df0).ready entity=mon.2 client_cookie=c2652901753cb52d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:36.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea70bac700 1 -- 172.21.15.57:0/2864981195 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea6800d570 con 0x7fea6c0b6520 2021-06-25T04:55:36.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea70bac700 1 -- 172.21.15.57:0/2864981195 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea68000e90 con 0x7fea6c0b6520 2021-06-25T04:55:36.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea70bac700 1 -- 172.21.15.57:0/2864981195 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea6800d8c0 con 0x7fea6c0b6520 2021-06-25T04:55:36.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea73e12700 1 -- 172.21.15.57:0/2864981195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea6c0b6520 msgr2=0x7fea6c0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:36.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea73e12700 1 --2- 172.21.15.57:0/2864981195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea6c0b6520 0x7fea6c0b4170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fea68002f70 tx=0x7fea68006df0).stop 2021-06-25T04:55:36.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea73e12700 1 -- 172.21.15.57:0/2864981195 shutdown_connections 2021-06-25T04:55:36.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea73e12700 1 --2- 172.21.15.57:0/2864981195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea6c0b6520 0x7fea6c0b4170 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea73e12700 1 -- 172.21.15.57:0/2864981195 >> 172.21.15.57:0/2864981195 conn(0x7fea6c062360 msgr2=0x7fea6c066da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:36.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea73e12700 1 -- 172.21.15.57:0/2864981195 shutdown_connections 2021-06-25T04:55:36.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.108+0000 7fea73e12700 1 -- 172.21.15.57:0/2864981195 wait complete. 2021-06-25T04:55:36.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea73e12700 1 Processor -- start 2021-06-25T04:55:36.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea73e12700 1 -- start start 2021-06-25T04:55:36.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea73e12700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea6c05fbc0 0x7fea6c155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:36.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea73e12700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea6c0b5950 0x7fea6c0b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:36.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea73e12700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea6c0b6520 0x7fea6c142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:36.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea73e12700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c146aa0 con 0x7fea6c0b6520 2021-06-25T04:55:36.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea73e12700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c146d40 con 0x7fea6c05fbc0 2021-06-25T04:55:36.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea73e12700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c146fe0 con 0x7fea6c0b5950 2021-06-25T04:55:36.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea723af700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea6c0b6520 0x7fea6c142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:36.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea71bae700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea6c05fbc0 0x7fea6c155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:36.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea71bae700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea6c05fbc0 0x7fea6c155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:50502/0 (socket says 172.21.15.57:50502) 2021-06-25T04:55:36.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea71bae700 1 -- 172.21.15.57:0/3476835671 learned_addr learned my addr 172.21.15.57:0/3476835671 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:36.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea723af700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea6c0b6520 0x7fea6c142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42012/0 (socket says 172.21.15.57:42012) 2021-06-25T04:55:36.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea713ad700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea6c0b5950 0x7fea6c0b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:36.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea723af700 1 -- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea6c0b5950 msgr2=0x7fea6c0b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:36.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea723af700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea6c0b5950 0x7fea6c0b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea723af700 1 -- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea6c05fbc0 msgr2=0x7fea6c155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:36.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea723af700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea6c05fbc0 0x7fea6c155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea723af700 1 -- 172.21.15.57:0/3476835671 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6800b180 con 0x7fea6c0b6520 2021-06-25T04:55:36.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea71bae700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea6c05fbc0 0x7fea6c155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:36.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea723af700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea6c0b6520 0x7fea6c142690 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7fea64001490 tx=0x7fea64007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:36.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea5affd700 1 -- 172.21.15.57:0/3476835671 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea64005ba0 con 0x7fea6c0b6520 2021-06-25T04:55:36.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea5affd700 1 -- 172.21.15.57:0/3476835671 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea64005d00 con 0x7fea6c0b6520 2021-06-25T04:55:36.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea73e12700 1 -- 172.21.15.57:0/3476835671 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c147280 con 0x7fea6c0b6520 2021-06-25T04:55:36.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea5affd700 1 -- 172.21.15.57:0/3476835671 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea640072c0 con 0x7fea6c0b6520 2021-06-25T04:55:36.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.112+0000 7fea73e12700 1 -- 172.21.15.57:0/3476835671 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c13d3b0 con 0x7fea6c0b6520 2021-06-25T04:55:36.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.116+0000 7fea73e12700 1 -- 172.21.15.57:0/3476835671 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c147410 con 0x7fea6c0b6520 2021-06-25T04:55:36.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.116+0000 7fea5affd700 1 -- 172.21.15.57:0/3476835671 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fea6401a060 con 0x7fea6c0b6520 2021-06-25T04:55:36.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.116+0000 7fea5affd700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fea4c055490 0x7fea4c057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:36.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.116+0000 7fea5affd700 1 -- 172.21.15.57:0/3476835671 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fea6406d860 con 0x7fea6c0b6520 2021-06-25T04:55:36.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.116+0000 7fea71bae700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fea4c055490 0x7fea4c057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:36.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.116+0000 7fea71bae700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fea4c055490 0x7fea4c057950 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fea5c00d000 tx=0x7fea5c007ac0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:36.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.120+0000 7fea5affd700 1 -- 172.21.15.57:0/3476835671 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fea640439c0 con 0x7fea6c0b6520 2021-06-25T04:55:36.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.284+0000 7fea73e12700 1 -- 172.21.15.57:0/3476835671 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fea6c057310 con 0x7fea6c0b6520 2021-06-25T04:55:36.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.696+0000 7fea5affd700 1 -- 172.21.15.57:0/3476835671 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7fea64018020 con 0x7fea6c0b6520 2021-06-25T04:55:36.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 -- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fea4c055490 msgr2=0x7fea4c057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:36.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fea4c055490 0x7fea4c057950 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fea5c00d000 tx=0x7fea5c007ac0).stop 2021-06-25T04:55:36.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 -- 172.21.15.57:0/3476835671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea6c0b6520 msgr2=0x7fea6c142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:36.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea6c0b6520 0x7fea6c142690 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7fea64001490 tx=0x7fea64007d20).stop 2021-06-25T04:55:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 -- 172.21.15.57:0/3476835671 shutdown_connections 2021-06-25T04:55:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fea4c055490 0x7fea4c057950 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea6c0b6520 0x7fea6c142690 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea6c0b5950 0x7fea6c0b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 --2- 172.21.15.57:0/3476835671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea6c05fbc0 0x7fea6c155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 -- 172.21.15.57:0/3476835671 >> 172.21.15.57:0/3476835671 conn(0x7fea6c062360 msgr2=0x7fea6c05bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:36.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 -- 172.21.15.57:0/3476835671 shutdown_connections 2021-06-25T04:55:36.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.700+0000 7fea73e12700 1 -- 172.21.15.57:0/3476835671 wait complete. 2021-06-25T04:55:36.719 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:55:36.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.844+0000 7f3702cc2700 1 Processor -- start 2021-06-25T04:55:36.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.844+0000 7f3702cc2700 1 -- start start 2021-06-25T04:55:36.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.844+0000 7f3702cc2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f36fc061610 0x7f36fc066590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:36.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f36fc066a80 0x7f36fc14d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:36.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36fc0604a0 con 0x7f36fc0600c0 2021-06-25T04:55:36.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc060c30 con 0x7f36fc061610 2021-06-25T04:55:36.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc060ed0 con 0x7f36fc066a80 2021-06-25T04:55:36.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f36f3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f36fc061610 0x7f36fc066590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:36.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f36f3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f36fc061610 0x7f36fc066590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42018/0 (socket says 172.21.15.57:42018) 2021-06-25T04:55:36.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f36f3fff700 1 -- 172.21.15.57:0/3755261638 learned_addr learned my addr 172.21.15.57:0/3755261638 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:36.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f370125f700 1 --2- 172.21.15.57:0/3755261638 >> v2:172.21.15.87:3300/0 conn(0x7f36fc066a80 0x7f36fc14d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:36.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f36f3fff700 1 -- 172.21.15.57:0/3755261638 >> v2:172.21.15.87:3300/0 conn(0x7f36fc066a80 msgr2=0x7f36fc14d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:36.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f36f3fff700 1 --2- 172.21.15.57:0/3755261638 >> v2:172.21.15.87:3300/0 conn(0x7f36fc066a80 0x7f36fc14d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f36f3fff700 1 -- 172.21.15.57:0/3755261638 >> v1:172.21.15.87:6789/0 conn(0x7f36fc0600c0 legacy=0x7f36fc065930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:36.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f36f3fff700 1 -- 172.21.15.57:0/3755261638 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc061170 con 0x7f36fc061610 2021-06-25T04:55:36.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f36f3fff700 1 --2- 172.21.15.57:0/3755261638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36fc061610 0x7f36fc066590 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f36ec002f70 tx=0x7f36ec006eb0).ready entity=mon.0 client_cookie=d9db09ac8f478151 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:36.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f36f37fe700 1 -- 172.21.15.57:0/3755261638 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36ec00d610 con 0x7f36fc061610 2021-06-25T04:55:36.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f36f37fe700 1 -- 172.21.15.57:0/3755261638 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec000e90 con 0x7f36fc061610 2021-06-25T04:55:36.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f36f37fe700 1 -- 172.21.15.57:0/3755261638 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36ec00d9a0 con 0x7f36fc061610 2021-06-25T04:55:36.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 -- 172.21.15.57:0/3755261638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36fc061610 msgr2=0x7f36fc066590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:36.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 --2- 172.21.15.57:0/3755261638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36fc061610 0x7f36fc066590 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f36ec002f70 tx=0x7f36ec006eb0).stop 2021-06-25T04:55:36.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 -- 172.21.15.57:0/3755261638 shutdown_connections 2021-06-25T04:55:36.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 --2- 172.21.15.57:0/3755261638 >> v2:172.21.15.87:3300/0 conn(0x7f36fc066a80 0x7f36fc14d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 --2- 172.21.15.57:0/3755261638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36fc061610 0x7f36fc066590 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 -- 172.21.15.57:0/3755261638 >> 172.21.15.57:0/3755261638 conn(0x7f36fc05cef0 msgr2=0x7f36fc05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:36.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 -- 172.21.15.57:0/3755261638 shutdown_connections 2021-06-25T04:55:36.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.848+0000 7f3702cc2700 1 -- 172.21.15.57:0/3755261638 wait complete. 2021-06-25T04:55:36.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3702cc2700 1 Processor -- start 2021-06-25T04:55:36.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3702cc2700 1 -- start start 2021-06-25T04:55:36.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3702cc2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36fc0600c0 0x7f36fc146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:36.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3702cc2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36fc061610 0x7f36fc0b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:36.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3702cc2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36fc066a80 0x7f36fc13e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:36.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3702cc2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0b7880 con 0x7f36fc0600c0 2021-06-25T04:55:36.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3702cc2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0b7b20 con 0x7f36fc066a80 2021-06-25T04:55:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3702cc2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0b7dc0 con 0x7f36fc061610 2021-06-25T04:55:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3700a5e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36fc0600c0 0x7f36fc146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3700a5e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36fc0600c0 0x7f36fc146130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42022/0 (socket says 172.21.15.57:42022) 2021-06-25T04:55:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3700a5e700 1 -- 172.21.15.57:0/83442103 learned_addr learned my addr 172.21.15.57:0/83442103 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f370125f700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36fc066a80 0x7f36fc13e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:36.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f36f3fff700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36fc061610 0x7f36fc0b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:36.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3700a5e700 1 -- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36fc061610 msgr2=0x7f36fc0b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:36.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3700a5e700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36fc061610 0x7f36fc0b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3700a5e700 1 -- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36fc066a80 msgr2=0x7f36fc13e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:36.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3700a5e700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36fc066a80 0x7f36fc13e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:36.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3700a5e700 1 -- 172.21.15.57:0/83442103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec00b1e0 con 0x7f36fc0600c0 2021-06-25T04:55:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3700a5e700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36fc0600c0 0x7f36fc146130 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f36fc0ae8f0 tx=0x7f36f8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f36f1ffb700 1 -- 172.21.15.57:0/83442103 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36f8012400 con 0x7f36fc0600c0 2021-06-25T04:55:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f36f1ffb700 1 -- 172.21.15.57:0/83442103 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f8012560 con 0x7f36fc0600c0 2021-06-25T04:55:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3702cc2700 1 -- 172.21.15.57:0/83442103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36fc0b8060 con 0x7f36fc0600c0 2021-06-25T04:55:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f36f1ffb700 1 -- 172.21.15.57:0/83442103 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36f80128c0 con 0x7f36fc0600c0 2021-06-25T04:55:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.852+0000 7f3702cc2700 1 -- 172.21.15.57:0/83442103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc0b0550 con 0x7f36fc0600c0 2021-06-25T04:55:36.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.856+0000 7f3702cc2700 1 -- 172.21.15.57:0/83442103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc0b81f0 con 0x7f36fc0600c0 2021-06-25T04:55:36.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.856+0000 7f36f1ffb700 1 -- 172.21.15.57:0/83442103 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f36f8019030 con 0x7f36fc0600c0 2021-06-25T04:55:36.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.856+0000 7f36f1ffb700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36dc0554e0 0x7f36dc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:36.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.856+0000 7f36f1ffb700 1 -- 172.21.15.57:0/83442103 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f36f806d380 con 0x7f36fc0600c0 2021-06-25T04:55:36.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.856+0000 7f36f3fff700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36dc0554e0 0x7f36dc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:36.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.860+0000 7f36f3fff700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36dc0554e0 0x7f36dc0579a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f36ec019000 tx=0x7f36ec015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:36.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.864+0000 7f36f1ffb700 1 -- 172.21.15.57:0/83442103 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f36f80434e0 con 0x7f36fc0600c0 2021-06-25T04:55:36.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:36.992+0000 7f3702cc2700 1 -- 172.21.15.57:0/83442103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f36fc057310 con 0x7f36fc0600c0 2021-06-25T04:55:37.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.704+0000 7f36f1ffb700 1 -- 172.21.15.57:0/83442103 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v110) v1 ==== 185+0+0 (secure 0 0 0) 0x7f36f8046b00 con 0x7f36fc0600c0 2021-06-25T04:55:37.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 -- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36dc0554e0 msgr2=0x7f36dc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:37.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36dc0554e0 0x7f36dc0579a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f36ec019000 tx=0x7f36ec015000).stop 2021-06-25T04:55:37.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 -- 172.21.15.57:0/83442103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36fc0600c0 msgr2=0x7f36fc146130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:37.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36fc0600c0 0x7f36fc146130 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f36fc0ae8f0 tx=0x7f36f8007c50).stop 2021-06-25T04:55:37.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 -- 172.21.15.57:0/83442103 shutdown_connections 2021-06-25T04:55:37.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36dc0554e0 0x7f36dc0579a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:37.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36fc066a80 0x7f36fc13e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:37.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36fc061610 0x7f36fc0b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:37.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 --2- 172.21.15.57:0/83442103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36fc0600c0 0x7f36fc146130 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:37.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 -- 172.21.15.57:0/83442103 >> 172.21.15.57:0/83442103 conn(0x7f36fc05cef0 msgr2=0x7f36fc148150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:37.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 -- 172.21.15.57:0/83442103 shutdown_connections 2021-06-25T04:55:37.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.708+0000 7f3702cc2700 1 -- 172.21.15.57:0/83442103 wait complete. 2021-06-25T04:55:37.718 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:55:37.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:55:37.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.836+0000 7f2eed8c7700 1 Processor -- start 2021-06-25T04:55:37.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.836+0000 7f2eed8c7700 1 -- start start 2021-06-25T04:55:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed8c7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2ee80b46d0 0x7f2ee813fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed8c7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee80b68d0 con 0x7f2ee8143960 2021-06-25T04:55:37.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed8c7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee80b6b70 con 0x7f2ee8061640 2021-06-25T04:55:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed8c7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee80b9640 con 0x7f2ee80b46d0 2021-06-25T04:55:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed0c6700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2ee8143960 0x7f2ee8140250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59252/0 (socket says 172.21.15.57:59252) 2021-06-25T04:55:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed0c6700 1 -- 172.21.15.57:0/65121765 learned_addr learned my addr 172.21.15.57:0/65121765 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee7fff700 1 --2- 172.21.15.57:0/65121765 >> v2:172.21.15.87:3300/0 conn(0x7f2ee80b46d0 0x7f2ee813fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee77fe700 1 -- 172.21.15.57:0/65121765 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477085135 0 0) 0x7f2ee80b68d0 con 0x7f2ee8143960 2021-06-25T04:55:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee77fe700 1 -- 172.21.15.57:0/65121765 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec8003260 con 0x7f2ee8143960 2021-06-25T04:55:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee77fe700 1 -- 172.21.15.57:0/65121765 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732183144 0 0) 0x7f2ee80b6b70 con 0x7f2ee8061640 2021-06-25T04:55:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee77fe700 1 -- 172.21.15.57:0/65121765 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee80b68d0 con 0x7f2ee8061640 2021-06-25T04:55:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee7fff700 1 -- 172.21.15.57:0/65121765 >> v1:172.21.15.87:6789/0 conn(0x7f2ee8061640 legacy=0x7f2ee80b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:37.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee7fff700 1 -- 172.21.15.57:0/65121765 >> v1:172.21.15.57:6789/0 conn(0x7f2ee8143960 legacy=0x7f2ee8140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:37.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee7fff700 1 -- 172.21.15.57:0/65121765 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee80b6e10 con 0x7f2ee80b46d0 2021-06-25T04:55:37.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee7fff700 1 --2- 172.21.15.57:0/65121765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee80b46d0 0x7f2ee813fd60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f2ed0002f70 tx=0x7f2ed0006df0).ready entity=mon.1 client_cookie=d3c97612cfab4439 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:37.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee77fe700 1 -- 172.21.15.57:0/65121765 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ed000d540 con 0x7f2ee80b46d0 2021-06-25T04:55:37.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee77fe700 1 -- 172.21.15.57:0/65121765 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed0000e90 con 0x7f2ee80b46d0 2021-06-25T04:55:37.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2ee77fe700 1 -- 172.21.15.57:0/65121765 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ed000d890 con 0x7f2ee80b46d0 2021-06-25T04:55:37.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed8c7700 1 -- 172.21.15.57:0/65121765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee80b46d0 msgr2=0x7f2ee813fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:37.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed8c7700 1 --2- 172.21.15.57:0/65121765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee80b46d0 0x7f2ee813fd60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f2ed0002f70 tx=0x7f2ed0006df0).stop 2021-06-25T04:55:37.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed8c7700 1 -- 172.21.15.57:0/65121765 shutdown_connections 2021-06-25T04:55:37.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed8c7700 1 --2- 172.21.15.57:0/65121765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee80b46d0 0x7f2ee813fd60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:37.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed8c7700 1 -- 172.21.15.57:0/65121765 >> 172.21.15.57:0/65121765 conn(0x7f2ee806adb0 msgr2=0x7f2ee805f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:37.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed8c7700 1 -- 172.21.15.57:0/65121765 shutdown_connections 2021-06-25T04:55:37.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.840+0000 7f2eed8c7700 1 -- 172.21.15.57:0/65121765 wait complete. 2021-06-25T04:55:37.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed8c7700 1 Processor -- start 2021-06-25T04:55:37.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed8c7700 1 -- start start 2021-06-25T04:55:37.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed8c7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee8061640 0x7f2ee80b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:37.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed8c7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ee8143960 0x7f2ee8145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:37.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed8c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ee80b80c0 0x7f2ee8146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:37.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed8c7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8149410 con 0x7f2ee80b80c0 2021-06-25T04:55:37.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed8c7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80b8950 con 0x7f2ee8061640 2021-06-25T04:55:37.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed8c7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80b8ca0 con 0x7f2ee8143960 2021-06-25T04:55:37.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed0c6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ee80b80c0 0x7f2ee8146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:37.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed0c6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ee80b80c0 0x7f2ee8146320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42040/0 (socket says 172.21.15.57:42040) 2021-06-25T04:55:37.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed0c6700 1 -- 172.21.15.57:0/3154930329 learned_addr learned my addr 172.21.15.57:0/3154930329 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:37.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2ee7fff700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ee8143960 0x7f2ee8145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:37.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eec8c5700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee8061640 0x7f2ee80b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:37.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed0c6700 1 -- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ee8143960 msgr2=0x7f2ee8145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed0c6700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ee8143960 0x7f2ee8145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed0c6700 1 -- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee8061640 msgr2=0x7f2ee80b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed0c6700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee8061640 0x7f2ee80b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.844+0000 7f2eed0c6700 1 -- 172.21.15.57:0/3154930329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed000b180 con 0x7f2ee80b80c0 2021-06-25T04:55:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.848+0000 7f2eed0c6700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ee80b80c0 0x7f2ee8146320 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f2ee0001490 tx=0x7f2ee0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.848+0000 7f2ee5ffb700 1 -- 172.21.15.57:0/3154930329 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ee0005ba0 con 0x7f2ee80b80c0 2021-06-25T04:55:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.848+0000 7f2ee5ffb700 1 -- 172.21.15.57:0/3154930329 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee0005d00 con 0x7f2ee80b80c0 2021-06-25T04:55:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.848+0000 7f2eed8c7700 1 -- 172.21.15.57:0/3154930329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee80b8f40 con 0x7f2ee80b80c0 2021-06-25T04:55:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.848+0000 7f2ee5ffb700 1 -- 172.21.15.57:0/3154930329 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ee00072c0 con 0x7f2ee80b80c0 2021-06-25T04:55:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.848+0000 7f2eed8c7700 1 -- 172.21.15.57:0/3154930329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee81524d0 con 0x7f2ee80b80c0 2021-06-25T04:55:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.848+0000 7f2eed8c7700 1 -- 172.21.15.57:0/3154930329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee8057310 con 0x7f2ee80b80c0 2021-06-25T04:55:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.848+0000 7f2ee5ffb700 1 -- 172.21.15.57:0/3154930329 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2ee001a060 con 0x7f2ee80b80c0 2021-06-25T04:55:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.848+0000 7f2ee5ffb700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2ecc055340 0x7f2ecc057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.848+0000 7f2ee5ffb700 1 -- 172.21.15.57:0/3154930329 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f2ee006d390 con 0x7f2ee80b80c0 2021-06-25T04:55:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.848+0000 7f2eec8c5700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2ecc055340 0x7f2ecc057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:37.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.852+0000 7f2eec8c5700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2ecc055340 0x7f2ecc057800 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f2ed800d000 tx=0x7f2ed8007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:37.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.856+0000 7f2ee5ffb700 1 -- 172.21.15.57:0/3154930329 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2ee00436a0 con 0x7f2ee80b80c0 2021-06-25T04:55:37.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:37.988+0000 7f2eed8c7700 1 -- 172.21.15.57:0/3154930329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ee80b6b50 con 0x7f2ee80b80c0 2021-06-25T04:55:38.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:55:38.214 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:55:38.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:55:38.219 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:55:38.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.716+0000 7f2ee5ffb700 1 -- 172.21.15.57:0/3154930329 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v111) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2ee0018020 con 0x7f2ee80b80c0 2021-06-25T04:55:38.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 -- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2ecc055340 msgr2=0x7f2ecc057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:38.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2ecc055340 0x7f2ecc057800 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f2ed800d000 tx=0x7f2ed8007a00).stop 2021-06-25T04:55:38.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 -- 172.21.15.57:0/3154930329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ee80b80c0 msgr2=0x7f2ee8146320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:38.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ee80b80c0 0x7f2ee8146320 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f2ee0001490 tx=0x7f2ee0007e00).stop 2021-06-25T04:55:38.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 -- 172.21.15.57:0/3154930329 shutdown_connections 2021-06-25T04:55:38.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2ecc055340 0x7f2ecc057800 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:38.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ee80b80c0 0x7f2ee8146320 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:38.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ee8143960 0x7f2ee8145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:38.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 --2- 172.21.15.57:0/3154930329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee8061640 0x7f2ee80b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:38.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 -- 172.21.15.57:0/3154930329 >> 172.21.15.57:0/3154930329 conn(0x7f2ee806adb0 msgr2=0x7f2ee8141240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:38.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 -- 172.21.15.57:0/3154930329 shutdown_connections 2021-06-25T04:55:38.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.720+0000 7f2eed8c7700 1 -- 172.21.15.57:0/3154930329 wait complete. 2021-06-25T04:55:38.728 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:55:38.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-06-25T04:55:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad31af700 1 Processor -- start 2021-06-25T04:55:38.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad31af700 1 -- start start 2021-06-25T04:55:38.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad31af700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1acc0b2fc0 0x7f1acc0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:38.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad31af700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc0b33a0 con 0x7f1acc0a9bd0 2021-06-25T04:55:38.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad31af700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc0b0c30 con 0x7f1acc0b18b0 2021-06-25T04:55:38.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad31af700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc0b27b0 con 0x7f1acc0b2fc0 2021-06-25T04:55:38.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad21ad700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1acc0b2fc0 0x7f1acc0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:38.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad29ae700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1acc0a9bd0 0x7f1acc147c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59264/0 (socket says 172.21.15.57:59264) 2021-06-25T04:55:38.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad29ae700 1 -- 172.21.15.57:0/1450448353 learned_addr learned my addr 172.21.15.57:0/1450448353 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:38.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad11ab700 1 -- 172.21.15.57:0/1450448353 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418118746 0 0) 0x7f1acc0b33a0 con 0x7f1acc0a9bd0 2021-06-25T04:55:38.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad11ab700 1 -- 172.21.15.57:0/1450448353 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab4003260 con 0x7f1acc0a9bd0 2021-06-25T04:55:38.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad11ab700 1 -- 172.21.15.57:0/1450448353 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381952901 0 0) 0x7f1acc0b0c30 con 0x7f1acc0b18b0 2021-06-25T04:55:38.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad21ad700 1 -- 172.21.15.57:0/1450448353 >> v1:172.21.15.87:6789/0 conn(0x7f1acc0b18b0 legacy=0x7f1acc0654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:38.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad21ad700 1 -- 172.21.15.57:0/1450448353 >> v1:172.21.15.57:6789/0 conn(0x7f1acc0a9bd0 legacy=0x7f1acc147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:38.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.848+0000 7f1ad21ad700 1 -- 172.21.15.57:0/1450448353 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc0b0ed0 con 0x7f1acc0b2fc0 2021-06-25T04:55:38.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad21ad700 1 --2- 172.21.15.57:0/1450448353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1acc0b2fc0 0x7f1acc0b22c0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f1abc002f70 tx=0x7f1abc006df0).ready entity=mon.0 client_cookie=ff66660cb9d5fedf server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:38.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad11ab700 1 -- 172.21.15.57:0/1450448353 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1abc00d610 con 0x7f1acc0b2fc0 2021-06-25T04:55:38.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad11ab700 1 -- 172.21.15.57:0/1450448353 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc000e90 con 0x7f1acc0b2fc0 2021-06-25T04:55:38.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad11ab700 1 -- 172.21.15.57:0/1450448353 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1abc00d960 con 0x7f1acc0b2fc0 2021-06-25T04:55:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad31af700 1 -- 172.21.15.57:0/1450448353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1acc0b2fc0 msgr2=0x7f1acc0b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad31af700 1 --2- 172.21.15.57:0/1450448353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1acc0b2fc0 0x7f1acc0b22c0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f1abc002f70 tx=0x7f1abc006df0).stop 2021-06-25T04:55:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad31af700 1 -- 172.21.15.57:0/1450448353 shutdown_connections 2021-06-25T04:55:38.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad31af700 1 --2- 172.21.15.57:0/1450448353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1acc0b2fc0 0x7f1acc0b22c0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:38.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad31af700 1 -- 172.21.15.57:0/1450448353 >> 172.21.15.57:0/1450448353 conn(0x7f1acc0636a0 msgr2=0x7f1acc063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad31af700 1 -- 172.21.15.57:0/1450448353 shutdown_connections 2021-06-25T04:55:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad31af700 1 -- 172.21.15.57:0/1450448353 wait complete. 2021-06-25T04:55:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad31af700 1 Processor -- start 2021-06-25T04:55:38.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.852+0000 7f1ad31af700 1 -- start start 2021-06-25T04:55:38.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad31af700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1acc0a9bd0 0x7f1acc0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:38.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad31af700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1acc0b18b0 0x7f1acc159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:38.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad31af700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1acc0b2fc0 0x7f1acc159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:38.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad31af700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0afe60 con 0x7f1acc0b18b0 2021-06-25T04:55:38.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad31af700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0af630 con 0x7f1acc0a9bd0 2021-06-25T04:55:38.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad31af700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0b0090 con 0x7f1acc0b2fc0 2021-06-25T04:55:38.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad19ac700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1acc0b18b0 0x7f1acc159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:38.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad19ac700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1acc0b18b0 0x7f1acc159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42050/0 (socket says 172.21.15.57:42050) 2021-06-25T04:55:38.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad19ac700 1 -- 172.21.15.57:0/2781791033 learned_addr learned my addr 172.21.15.57:0/2781791033 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:38.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad29ae700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1acc0b2fc0 0x7f1acc159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:38.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad21ad700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1acc0a9bd0 0x7f1acc0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:38.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad19ac700 1 -- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1acc0b2fc0 msgr2=0x7f1acc159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:38.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad19ac700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1acc0b2fc0 0x7f1acc159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:38.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad19ac700 1 -- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1acc0a9bd0 msgr2=0x7f1acc0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:38.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad19ac700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1acc0a9bd0 0x7f1acc0abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:38.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad19ac700 1 -- 172.21.15.57:0/2781791033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc00b180 con 0x7f1acc0b18b0 2021-06-25T04:55:38.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad19ac700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1acc0b18b0 0x7f1acc159600 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f1ac8000f40 tx=0x7f1ac8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:38.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1abb7fe700 1 -- 172.21.15.57:0/2781791033 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac800e570 con 0x7f1acc0b18b0 2021-06-25T04:55:38.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1abb7fe700 1 -- 172.21.15.57:0/2781791033 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac800e6d0 con 0x7f1acc0b18b0 2021-06-25T04:55:38.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1abb7fe700 1 -- 172.21.15.57:0/2781791033 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac800ea30 con 0x7f1acc0b18b0 2021-06-25T04:55:38.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad31af700 1 -- 172.21.15.57:0/2781791033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc0b0330 con 0x7f1acc0b18b0 2021-06-25T04:55:38.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.856+0000 7f1ad31af700 1 -- 172.21.15.57:0/2781791033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc0ac960 con 0x7f1acc0b18b0 2021-06-25T04:55:38.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.860+0000 7f1ad31af700 1 -- 172.21.15.57:0/2781791033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1acc0b04c0 con 0x7f1acc0b18b0 2021-06-25T04:55:38.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.860+0000 7f1abb7fe700 1 -- 172.21.15.57:0/2781791033 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1ac8010030 con 0x7f1acc0b18b0 2021-06-25T04:55:38.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.860+0000 7f1abb7fe700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1aac055450 0x7f1aac057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:38.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.860+0000 7f1abb7fe700 1 -- 172.21.15.57:0/2781791033 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f1ac806ddc0 con 0x7f1acc0b18b0 2021-06-25T04:55:38.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.860+0000 7f1ad21ad700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1aac055450 0x7f1aac057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:38.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.860+0000 7f1ad21ad700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1aac055450 0x7f1aac057910 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f1abc019000 tx=0x7f1abc014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:38.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.868+0000 7f1abb7fe700 1 -- 172.21.15.57:0/2781791033 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1ac8044250 con 0x7f1acc0b18b0 2021-06-25T04:55:39.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:38.996+0000 7f1ad31af700 1 -- 172.21.15.57:0/2781791033 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1acc057310 con 0x7f1acc0b18b0 2021-06-25T04:55:39.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.004+0000 7f1abb7fe700 1 -- 172.21.15.57:0/2781791033 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1ac8047870 con 0x7f1acc0b18b0 2021-06-25T04:55:39.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 -- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1aac055450 msgr2=0x7f1aac057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1aac055450 0x7f1aac057910 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f1abc019000 tx=0x7f1abc014000).stop 2021-06-25T04:55:39.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 -- 172.21.15.57:0/2781791033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1acc0b18b0 msgr2=0x7f1acc159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1acc0b18b0 0x7f1acc159600 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f1ac8000f40 tx=0x7f1ac8007de0).stop 2021-06-25T04:55:39.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 -- 172.21.15.57:0/2781791033 shutdown_connections 2021-06-25T04:55:39.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1aac055450 0x7f1aac057910 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1acc0b2fc0 0x7f1acc159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1acc0b18b0 0x7f1acc159600 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 --2- 172.21.15.57:0/2781791033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1acc0a9bd0 0x7f1acc0abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 -- 172.21.15.57:0/2781791033 >> 172.21.15.57:0/2781791033 conn(0x7f1acc0636a0 msgr2=0x7f1acc0b6290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:39.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 -- 172.21.15.57:0/2781791033 shutdown_connections 2021-06-25T04:55:39.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.008+0000 7f1ad31af700 1 -- 172.21.15.57:0/2781791033 wait complete. 2021-06-25T04:55:39.025 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-06-25T04:55:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f465bfff700 1 Processor -- start 2021-06-25T04:55:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f465bfff700 1 -- start start 2021-06-25T04:55:39.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f465bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f465c0b2ea0 0x7f465c065550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f465bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f465c14ae70 0x7f465c14b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f465bfff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c0b2a50 con 0x7f465c0b7670 2021-06-25T04:55:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f465bfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c061660 con 0x7f465c0b2ea0 2021-06-25T04:55:39.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f465bfff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c065a40 con 0x7f465c14ae70 2021-06-25T04:55:39.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f4653fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f465c0b2ea0 0x7f465c065550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:39.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f4653fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f465c0b2ea0 0x7f465c065550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42058/0 (socket says 172.21.15.57:42058) 2021-06-25T04:55:39.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f4653fff700 1 -- 172.21.15.57:0/912629964 learned_addr learned my addr 172.21.15.57:0/912629964 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f465b7fe700 1 --2- 172.21.15.57:0/912629964 >> v2:172.21.15.87:3300/0 conn(0x7f465c14ae70 0x7f465c14b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f4653fff700 1 -- 172.21.15.57:0/912629964 >> v2:172.21.15.87:3300/0 conn(0x7f465c14ae70 msgr2=0x7f465c14b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f4653fff700 1 --2- 172.21.15.57:0/912629964 >> v2:172.21.15.87:3300/0 conn(0x7f465c14ae70 0x7f465c14b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f4653fff700 1 -- 172.21.15.57:0/912629964 >> v1:172.21.15.87:6789/0 conn(0x7f465c0b7670 legacy=0x7f465c060f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.124+0000 7f4653fff700 1 -- 172.21.15.57:0/912629964 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0b7a50 con 0x7f465c0b2ea0 2021-06-25T04:55:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f4653fff700 1 --2- 172.21.15.57:0/912629964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0b2ea0 0x7f465c065550 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f4644002f70 tx=0x7f4644006eb0).ready entity=mon.0 client_cookie=483ccb1efd84e4a8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f465a7fc700 1 -- 172.21.15.57:0/912629964 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464400d5c0 con 0x7f465c0b2ea0 2021-06-25T04:55:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f465a7fc700 1 -- 172.21.15.57:0/912629964 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4644000e90 con 0x7f465c0b2ea0 2021-06-25T04:55:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f465a7fc700 1 -- 172.21.15.57:0/912629964 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464400d950 con 0x7f465c0b2ea0 2021-06-25T04:55:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f465bfff700 1 -- 172.21.15.57:0/912629964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0b2ea0 msgr2=0x7f465c065550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f465bfff700 1 --2- 172.21.15.57:0/912629964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0b2ea0 0x7f465c065550 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f4644002f70 tx=0x7f4644006eb0).stop 2021-06-25T04:55:39.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f465bfff700 1 -- 172.21.15.57:0/912629964 shutdown_connections 2021-06-25T04:55:39.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f465bfff700 1 --2- 172.21.15.57:0/912629964 >> v2:172.21.15.87:3300/0 conn(0x7f465c14ae70 0x7f465c14b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f465bfff700 1 --2- 172.21.15.57:0/912629964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0b2ea0 0x7f465c065550 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f465bfff700 1 -- 172.21.15.57:0/912629964 >> 172.21.15.57:0/912629964 conn(0x7f465c05f670 msgr2=0x7f465c05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:39.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f465bfff700 1 -- 172.21.15.57:0/912629964 shutdown_connections 2021-06-25T04:55:39.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.128+0000 7f465bfff700 1 -- 172.21.15.57:0/912629964 wait complete. 2021-06-25T04:55:39.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465bfff700 1 Processor -- start 2021-06-25T04:55:39.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465bfff700 1 -- start start 2021-06-25T04:55:39.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0b2ea0 0x7f465c14e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:39.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b7670 0x7f465c0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:39.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f465c14ae70 0x7f465c0a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:39.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0ae330 con 0x7f465c0b2ea0 2021-06-25T04:55:39.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0ac660 con 0x7f465c0b7670 2021-06-25T04:55:39.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0ac900 con 0x7f465c14ae70 2021-06-25T04:55:39.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0b2ea0 0x7f465c14e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:39.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0b2ea0 0x7f465c14e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42064/0 (socket says 172.21.15.57:42064) 2021-06-25T04:55:39.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465affd700 1 -- 172.21.15.57:0/938468295 learned_addr learned my addr 172.21.15.57:0/938468295 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:39.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f4653fff700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b7670 0x7f465c0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:39.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465b7fe700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f465c14ae70 0x7f465c0a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:39.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465affd700 1 -- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f465c14ae70 msgr2=0x7f465c0a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465affd700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f465c14ae70 0x7f465c0a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465affd700 1 -- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b7670 msgr2=0x7f465c0adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465affd700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b7670 0x7f465c0adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465affd700 1 -- 172.21.15.57:0/938468295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464400b1e0 con 0x7f465c0b2ea0 2021-06-25T04:55:39.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465b7fe700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f465c14ae70 0x7f465c0a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:39.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f4653fff700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b7670 0x7f465c0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:39.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465affd700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0b2ea0 0x7f465c14e0a0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f465c069c40 tx=0x7f464c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:39.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f4658ff9700 1 -- 172.21.15.57:0/938468295 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464c00ce30 con 0x7f465c0b2ea0 2021-06-25T04:55:39.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f4658ff9700 1 -- 172.21.15.57:0/938468295 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c007020 con 0x7f465c0b2ea0 2021-06-25T04:55:39.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465bfff700 1 -- 172.21.15.57:0/938468295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c0acba0 con 0x7f465c0b2ea0 2021-06-25T04:55:39.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f4658ff9700 1 -- 172.21.15.57:0/938468295 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464c007380 con 0x7f465c0b2ea0 2021-06-25T04:55:39.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.132+0000 7f465bfff700 1 -- 172.21.15.57:0/938468295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c1566d0 con 0x7f465c0b2ea0 2021-06-25T04:55:39.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.136+0000 7f465bfff700 1 -- 172.21.15.57:0/938468295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465c0ad3b0 con 0x7f465c0b2ea0 2021-06-25T04:55:39.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.136+0000 7f4658ff9700 1 -- 172.21.15.57:0/938468295 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f464c010070 con 0x7f465c0b2ea0 2021-06-25T04:55:39.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.136+0000 7f4658ff9700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4640055510 0x7f46400579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:39.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.136+0000 7f4658ff9700 1 -- 172.21.15.57:0/938468295 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f464c06cf90 con 0x7f465c0b2ea0 2021-06-25T04:55:39.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.136+0000 7f4653fff700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4640055510 0x7f46400579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:39.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.136+0000 7f4653fff700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4640055510 0x7f46400579d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f4644019000 tx=0x7f4644015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:39.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.140+0000 7f4658ff9700 1 -- 172.21.15.57:0/938468295 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f464c041c50 con 0x7f465c0b2ea0 2021-06-25T04:55:39.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.312+0000 7f465bfff700 1 -- 172.21.15.57:0/938468295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f465c0a0600 con 0x7f465c0b2ea0 2021-06-25T04:55:39.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.724+0000 7f4658ff9700 1 -- 172.21.15.57:0/938468295 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v363) v1 ==== 127+0+0 (secure 0 0 0) 0x7f465c0ad3b0 con 0x7f465c0b2ea0 2021-06-25T04:55:39.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.724+0000 7f465bfff700 1 -- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4640055510 msgr2=0x7f46400579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.724+0000 7f465bfff700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4640055510 0x7f46400579d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f4644019000 tx=0x7f4644015000).stop 2021-06-25T04:55:39.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.724+0000 7f465bfff700 1 -- 172.21.15.57:0/938468295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0b2ea0 msgr2=0x7f465c14e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.728+0000 7f465bfff700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0b2ea0 0x7f465c14e0a0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f465c069c40 tx=0x7f464c007c40).stop 2021-06-25T04:55:39.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.728+0000 7f465bfff700 1 -- 172.21.15.57:0/938468295 shutdown_connections 2021-06-25T04:55:39.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.728+0000 7f465bfff700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4640055510 0x7f46400579d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.728+0000 7f465bfff700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f465c14ae70 0x7f465c0a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.728+0000 7f465bfff700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b7670 0x7f465c0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.728+0000 7f465bfff700 1 --2- 172.21.15.57:0/938468295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c0b2ea0 0x7f465c14e0a0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.728+0000 7f465bfff700 1 -- 172.21.15.57:0/938468295 >> 172.21.15.57:0/938468295 conn(0x7f465c05f670 msgr2=0x7f465c0b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:39.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.728+0000 7f465bfff700 1 -- 172.21.15.57:0/938468295 shutdown_connections 2021-06-25T04:55:39.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.728+0000 7f465bfff700 1 -- 172.21.15.57:0/938468295 wait complete. 2021-06-25T04:55:39.743 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2021-06-25T04:55:39.744 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2021-06-25T04:55:39.744 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-06-25T04:55:39.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7b34b6700 1 Processor -- start 2021-06-25T04:55:39.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7b34b6700 1 -- start start 2021-06-25T04:55:39.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7b34b6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 0x7fb7ac0b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:39.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7b34b6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ac0aab70 con 0x7fb7ac0672c0 2021-06-25T04:55:39.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7b34b6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ac0604a0 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7b34b6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac066e60 con 0x7fb7ac0600c0 2021-06-25T04:55:39.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7b0a51700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb7ac0672c0 0x7fb7ac1438b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59290/0 (socket says 172.21.15.57:59290) 2021-06-25T04:55:39.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7b0a51700 1 -- 172.21.15.57:0/1185159871 learned_addr learned my addr 172.21.15.57:0/1185159871 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:39.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7b1252700 1 --2- 172.21.15.57:0/1185159871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 0x7fb7ac0b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:39.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7a3fff700 1 -- 172.21.15.57:0/1185159871 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016896451 0 0) 0x7fb7ac0aab70 con 0x7fb7ac0672c0 2021-06-25T04:55:39.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7a3fff700 1 -- 172.21.15.57:0/1185159871 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb790003260 con 0x7fb7ac0672c0 2021-06-25T04:55:39.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7a3fff700 1 -- 172.21.15.57:0/1185159871 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067855130 0 0) 0x7fb7ac0604a0 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.848+0000 7fb7a3fff700 1 -- 172.21.15.57:0/1185159871 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7ac0aab70 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b1252700 1 -- 172.21.15.57:0/1185159871 >> v1:172.21.15.87:6789/0 conn(0x7fb7ac0b4c00 legacy=0x7fb7ac14b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b1252700 1 -- 172.21.15.57:0/1185159871 >> v1:172.21.15.57:6789/0 conn(0x7fb7ac0672c0 legacy=0x7fb7ac1438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b1252700 1 -- 172.21.15.57:0/1185159871 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac0b3370 con 0x7fb7ac0600c0 2021-06-25T04:55:39.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b1252700 1 --2- 172.21.15.57:0/1185159871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 0x7fb7ac0b4710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fb79c002f70 tx=0x7fb79c006df0).ready entity=mon.2 client_cookie=c833cb746018062 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:39.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7a3fff700 1 -- 172.21.15.57:0/1185159871 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb79c00d5c0 con 0x7fb7ac0600c0 2021-06-25T04:55:39.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7a3fff700 1 -- 172.21.15.57:0/1185159871 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c000e90 con 0x7fb7ac0600c0 2021-06-25T04:55:39.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7a3fff700 1 -- 172.21.15.57:0/1185159871 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb79c00d910 con 0x7fb7ac0600c0 2021-06-25T04:55:39.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b34b6700 1 -- 172.21.15.57:0/1185159871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 msgr2=0x7fb7ac0b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b34b6700 1 --2- 172.21.15.57:0/1185159871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 0x7fb7ac0b4710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fb79c002f70 tx=0x7fb79c006df0).stop 2021-06-25T04:55:39.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b34b6700 1 -- 172.21.15.57:0/1185159871 shutdown_connections 2021-06-25T04:55:39.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b34b6700 1 --2- 172.21.15.57:0/1185159871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 0x7fb7ac0b4710 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b34b6700 1 -- 172.21.15.57:0/1185159871 >> 172.21.15.57:0/1185159871 conn(0x7fb7ac05cef0 msgr2=0x7fb7ac05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:39.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b34b6700 1 -- 172.21.15.57:0/1185159871 shutdown_connections 2021-06-25T04:55:39.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b34b6700 1 -- 172.21.15.57:0/1185159871 wait complete. 2021-06-25T04:55:39.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b34b6700 1 Processor -- start 2021-06-25T04:55:39.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.852+0000 7fb7b34b6700 1 -- start start 2021-06-25T04:55:39.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b34b6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 0x7fb7ac155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:39.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b34b6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7ac0672c0 0x7fb7ac156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:39.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b34b6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7ac0b4c00 0x7fb7ac0ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:39.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b34b6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac061580 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b34b6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac061220 con 0x7fb7ac0672c0 2021-06-25T04:55:39.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b34b6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac0617e0 con 0x7fb7ac0600c0 2021-06-25T04:55:39.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b1a53700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7ac0b4c00 0x7fb7ac0ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:39.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b1a53700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7ac0b4c00 0x7fb7ac0ad3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42080/0 (socket says 172.21.15.57:42080) 2021-06-25T04:55:39.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b1a53700 1 -- 172.21.15.57:0/2913512177 learned_addr learned my addr 172.21.15.57:0/2913512177 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:39.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b1252700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 0x7fb7ac155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:39.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b0a51700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7ac0672c0 0x7fb7ac156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:39.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b1a53700 1 -- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 msgr2=0x7fb7ac155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b1a53700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 0x7fb7ac155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b1a53700 1 -- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7ac0672c0 msgr2=0x7fb7ac156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:39.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b1a53700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7ac0672c0 0x7fb7ac156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:39.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b1a53700 1 -- 172.21.15.57:0/2913512177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c00b180 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b1252700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 0x7fb7ac155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:39.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b0a51700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7ac0672c0 0x7fb7ac156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:39.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b1a53700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7ac0b4c00 0x7fb7ac0ad3f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7fb7a4001490 tx=0x7fb7a4007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:39.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7a27fc700 1 -- 172.21.15.57:0/2913512177 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a4002020 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7a27fc700 1 -- 172.21.15.57:0/2913512177 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a4002180 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7a27fc700 1 -- 172.21.15.57:0/2913512177 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a40015b0 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b34b6700 1 -- 172.21.15.57:0/2913512177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ac061b30 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b34b6700 1 -- 172.21.15.57:0/2913512177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ac062730 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7b34b6700 1 -- 172.21.15.57:0/2913512177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ac061cc0 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.856+0000 7fb7a27fc700 1 -- 172.21.15.57:0/2913512177 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb7a4010070 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.860+0000 7fb7a27fc700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb794055340 0x7fb794057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:39.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.860+0000 7fb7a27fc700 1 -- 172.21.15.57:0/2913512177 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb7a406d1a0 con 0x7fb7ac0b4c00 2021-06-25T04:55:39.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.860+0000 7fb7b1252700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb794055340 0x7fb794057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:39.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.860+0000 7fb7b1252700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb794055340 0x7fb794057800 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fb79c017000 tx=0x7fb79c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:39.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:39.864+0000 7fb7a27fc700 1 -- 172.21.15.57:0/2913512177 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb7a4041c50 con 0x7fb7ac0b4c00 2021-06-25T04:55:40.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.032+0000 7fb7b34b6700 1 -- 172.21.15.57:0/2913512177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7fb7ac057310 con 0x7fb7ac0b4c00 2021-06-25T04:55:40.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.728+0000 7fb7a27fc700 1 -- 172.21.15.57:0/2913512177 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v364) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb7a4043630 con 0x7fb7ac0b4c00 2021-06-25T04:55:40.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 -- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb794055340 msgr2=0x7fb794057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:40.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb794055340 0x7fb794057800 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fb79c017000 tx=0x7fb79c014000).stop 2021-06-25T04:55:40.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 -- 172.21.15.57:0/2913512177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7ac0b4c00 msgr2=0x7fb7ac0ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:40.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7ac0b4c00 0x7fb7ac0ad3f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7fb7a4001490 tx=0x7fb7a4007d70).stop 2021-06-25T04:55:40.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 -- 172.21.15.57:0/2913512177 shutdown_connections 2021-06-25T04:55:40.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb794055340 0x7fb794057800 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:40.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7ac0b4c00 0x7fb7ac0ad3f0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:40.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7ac0672c0 0x7fb7ac156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:40.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 --2- 172.21.15.57:0/2913512177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7ac0600c0 0x7fb7ac155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:40.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 -- 172.21.15.57:0/2913512177 >> 172.21.15.57:0/2913512177 conn(0x7fb7ac05cef0 msgr2=0x7fb7ac144a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:40.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 -- 172.21.15.57:0/2913512177 shutdown_connections 2021-06-25T04:55:40.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.732+0000 7fb7b34b6700 1 -- 172.21.15.57:0/2913512177 wait complete. 2021-06-25T04:55:40.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:55:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.864+0000 7fe199f73700 1 Processor -- start 2021-06-25T04:55:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.864+0000 7fe199f73700 1 -- start start 2021-06-25T04:55:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940afed0 0x7fe19405f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe1940ac970 0x7fe19414af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe194061320 con 0x7fe19414ab40 2021-06-25T04:55:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19414b5a0 con 0x7fe1940ac970 2021-06-25T04:55:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19414b840 con 0x7fe1940afed0 2021-06-25T04:55:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe193fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe1940ac970 0x7fe19414af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe193fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe1940ac970 0x7fe19414af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:50586/0 (socket says 172.21.15.57:50586) 2021-06-25T04:55:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe192ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940afed0 0x7fe19405f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe193fff700 1 -- 172.21.15.57:0/2553500931 learned_addr learned my addr 172.21.15.57:0/2553500931 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe193fff700 1 -- 172.21.15.57:0/2553500931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940afed0 msgr2=0x7fe19405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe193fff700 1 --2- 172.21.15.57:0/2553500931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940afed0 0x7fe19405f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe193fff700 1 -- 172.21.15.57:0/2553500931 >> v1:172.21.15.87:6789/0 conn(0x7fe19414ab40 legacy=0x7fe1940af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe193fff700 1 -- 172.21.15.57:0/2553500931 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1940aece0 con 0x7fe1940ac970 2021-06-25T04:55:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe193fff700 1 --2- 172.21.15.57:0/2553500931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1940ac970 0x7fe19414af20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fe18c002f70 tx=0x7fe18c006eb0).ready entity=mon.1 client_cookie=3f71a660fefe7f6a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe1927fc700 1 -- 172.21.15.57:0/2553500931 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18c00d570 con 0x7fe1940ac970 2021-06-25T04:55:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe1927fc700 1 -- 172.21.15.57:0/2553500931 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c000e90 con 0x7fe1940ac970 2021-06-25T04:55:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe1927fc700 1 -- 172.21.15.57:0/2553500931 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18c00d900 con 0x7fe1940ac970 2021-06-25T04:55:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 -- 172.21.15.57:0/2553500931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1940ac970 msgr2=0x7fe19414af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 --2- 172.21.15.57:0/2553500931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1940ac970 0x7fe19414af20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fe18c002f70 tx=0x7fe18c006eb0).stop 2021-06-25T04:55:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 -- 172.21.15.57:0/2553500931 shutdown_connections 2021-06-25T04:55:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 --2- 172.21.15.57:0/2553500931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1940ac970 0x7fe19414af20 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 --2- 172.21.15.57:0/2553500931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940afed0 0x7fe19405f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 -- 172.21.15.57:0/2553500931 >> 172.21.15.57:0/2553500931 conn(0x7fe1940b5530 msgr2=0x7fe1940b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 -- 172.21.15.57:0/2553500931 shutdown_connections 2021-06-25T04:55:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.868+0000 7fe199f73700 1 -- 172.21.15.57:0/2553500931 wait complete. 2021-06-25T04:55:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe199f73700 1 Processor -- start 2021-06-25T04:55:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe199f73700 1 -- start start 2021-06-25T04:55:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe199f73700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1940ac970 0x7fe19414e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe199f73700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940afed0 0x7fe194156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe199f73700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe19414ab40 0x7fe1940b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe199f73700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19415a8f0 con 0x7fe19414ab40 2021-06-25T04:55:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe199f73700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe194156610 con 0x7fe1940ac970 2021-06-25T04:55:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe199f73700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1941568b0 con 0x7fe1940afed0 2021-06-25T04:55:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe193fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe19414ab40 0x7fe1940b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:40.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe193fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe19414ab40 0x7fe1940b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42098/0 (socket says 172.21.15.57:42098) 2021-06-25T04:55:40.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe192ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940afed0 0x7fe194156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:40.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe193fff700 1 -- 172.21.15.57:0/3451442566 learned_addr learned my addr 172.21.15.57:0/3451442566 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:40.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe1937fe700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1940ac970 0x7fe19414e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:40.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe193fff700 1 -- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940afed0 msgr2=0x7fe194156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:40.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe193fff700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940afed0 0x7fe194156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:40.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe193fff700 1 -- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1940ac970 msgr2=0x7fe19414e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:40.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe193fff700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1940ac970 0x7fe19414e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:40.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe193fff700 1 -- 172.21.15.57:0/3451442566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c00b1e0 con 0x7fe19414ab40 2021-06-25T04:55:40.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe193fff700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe19414ab40 0x7fe1940b40a0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fe18c002f70 tx=0x7fe18c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:40.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe190ff9700 1 -- 172.21.15.57:0/3451442566 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18c0116e0 con 0x7fe19414ab40 2021-06-25T04:55:40.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe190ff9700 1 -- 172.21.15.57:0/3451442566 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c011840 con 0x7fe19414ab40 2021-06-25T04:55:40.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe199f73700 1 -- 172.21.15.57:0/3451442566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe194156b50 con 0x7fe19414ab40 2021-06-25T04:55:40.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe190ff9700 1 -- 172.21.15.57:0/3451442566 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18c011ba0 con 0x7fe19414ab40 2021-06-25T04:55:40.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.872+0000 7fe199f73700 1 -- 172.21.15.57:0/3451442566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1940b4590 con 0x7fe19414ab40 2021-06-25T04:55:40.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.876+0000 7fe199f73700 1 -- 172.21.15.57:0/3451442566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe194156ce0 con 0x7fe19414ab40 2021-06-25T04:55:40.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.876+0000 7fe190ff9700 1 -- 172.21.15.57:0/3451442566 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe18c00f070 con 0x7fe19414ab40 2021-06-25T04:55:40.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.876+0000 7fe190ff9700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe174055490 0x7fe174057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:40.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.876+0000 7fe190ff9700 1 -- 172.21.15.57:0/3451442566 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe18c06f410 con 0x7fe19414ab40 2021-06-25T04:55:40.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.876+0000 7fe1937fe700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe174055490 0x7fe174057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:40.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.880+0000 7fe1937fe700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe174055490 0x7fe174057950 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fe18800d000 tx=0x7fe188007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:40.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:40.884+0000 7fe190ff9700 1 -- 172.21.15.57:0/3451442566 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe18c045710 con 0x7fe19414ab40 2021-06-25T04:55:41.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.012+0000 7fe199f73700 1 -- 172.21.15.57:0/3451442566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe194057310 con 0x7fe19414ab40 2021-06-25T04:55:41.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe190ff9700 1 -- 172.21.15.57:0/3451442566 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe18c048d30 con 0x7fe19414ab40 2021-06-25T04:55:41.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 -- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe174055490 msgr2=0x7fe174057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe174055490 0x7fe174057950 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fe18800d000 tx=0x7fe188007b90).stop 2021-06-25T04:55:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 -- 172.21.15.57:0/3451442566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe19414ab40 msgr2=0x7fe1940b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe19414ab40 0x7fe1940b40a0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fe18c002f70 tx=0x7fe18c015000).stop 2021-06-25T04:55:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 -- 172.21.15.57:0/3451442566 shutdown_connections 2021-06-25T04:55:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe174055490 0x7fe174057950 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe19414ab40 0x7fe1940b40a0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1940afed0 0x7fe194156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 --2- 172.21.15.57:0/3451442566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1940ac970 0x7fe19414e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 -- 172.21.15.57:0/3451442566 >> 172.21.15.57:0/3451442566 conn(0x7fe1940b5530 msgr2=0x7fe194148970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:41.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 -- 172.21.15.57:0/3451442566 shutdown_connections 2021-06-25T04:55:41.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.024+0000 7fe199f73700 1 -- 172.21.15.57:0/3451442566 wait complete. 2021-06-25T04:55:41.043 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:55:41.044 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:41.062 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:41.085 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:41.108 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:55:41.128 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:55:41.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:41.130 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:41.130 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:41.137 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:55:41.138 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:55:41.139 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:55:41.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:41.140 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:41.140 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:41.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:55:41.180 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:55:41.180 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:55:41.181 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:55:41.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.288+0000 7f6552abe700 1 Processor -- start 2021-06-25T04:55:41.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.288+0000 7f6552abe700 1 -- start start 2021-06-25T04:55:41.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.288+0000 7f6552abe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f654c0b05d0 0x7f654c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.288+0000 7f6552abe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f654c147560 0x7f654c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.288+0000 7f6552abe700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654c1479b0 con 0x7f654c0b5460 2021-06-25T04:55:41.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.288+0000 7f6552abe700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c1452a0 con 0x7f654c0b05d0 2021-06-25T04:55:41.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.288+0000 7f6552abe700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c0adfb0 con 0x7f654c147560 2021-06-25T04:55:41.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.288+0000 7f65512bb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f654c0b05d0 0x7f654c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.288+0000 7f65522bd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f654c147560 0x7f654c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.288+0000 7f65512bb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f654c0b05d0 0x7f654c0af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42106/0 (socket says 172.21.15.57:42106) 2021-06-25T04:55:41.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.288+0000 7f65512bb700 1 -- 172.21.15.57:0/3749658374 learned_addr learned my addr 172.21.15.57:0/3749658374 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:41.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6550aba700 1 -- 172.21.15.57:0/3749658374 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728135753 0 0) 0x7f654c1479b0 con 0x7f654c0b5460 2021-06-25T04:55:41.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6550aba700 1 -- 172.21.15.57:0/3749658374 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6534003260 con 0x7f654c0b5460 2021-06-25T04:55:41.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f65512bb700 1 -- 172.21.15.57:0/3749658374 >> v2:172.21.15.87:3300/0 conn(0x7f654c147560 msgr2=0x7f654c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:41.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f65512bb700 1 --2- 172.21.15.57:0/3749658374 >> v2:172.21.15.87:3300/0 conn(0x7f654c147560 0x7f654c0acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f65512bb700 1 -- 172.21.15.57:0/3749658374 >> v1:172.21.15.87:6789/0 conn(0x7f654c0b5460 legacy=0x7f654c067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f65512bb700 1 -- 172.21.15.57:0/3749658374 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c0b5840 con 0x7f654c0b05d0 2021-06-25T04:55:41.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f65522bd700 1 --2- 172.21.15.57:0/3749658374 >> v2:172.21.15.87:3300/0 conn(0x7f654c147560 0x7f654c0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:41.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f65512bb700 1 --2- 172.21.15.57:0/3749658374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f654c0b05d0 0x7f654c0af510 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f653c002f70 tx=0x7f653c006eb0).ready entity=mon.0 client_cookie=dae00f0c6c7b301d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:41.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6550aba700 1 -- 172.21.15.57:0/3749658374 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f653c00d610 con 0x7f654c0b05d0 2021-06-25T04:55:41.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6550aba700 1 -- 172.21.15.57:0/3749658374 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c000e90 con 0x7f654c0b05d0 2021-06-25T04:55:41.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6550aba700 1 -- 172.21.15.57:0/3749658374 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f653c00d9a0 con 0x7f654c0b05d0 2021-06-25T04:55:41.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6552abe700 1 -- 172.21.15.57:0/3749658374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f654c0b05d0 msgr2=0x7f654c0af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6552abe700 1 --2- 172.21.15.57:0/3749658374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f654c0b05d0 0x7f654c0af510 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f653c002f70 tx=0x7f653c006eb0).stop 2021-06-25T04:55:41.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6552abe700 1 -- 172.21.15.57:0/3749658374 shutdown_connections 2021-06-25T04:55:41.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6552abe700 1 --2- 172.21.15.57:0/3749658374 >> v2:172.21.15.87:3300/0 conn(0x7f654c147560 0x7f654c0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6552abe700 1 --2- 172.21.15.57:0/3749658374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f654c0b05d0 0x7f654c0af510 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6552abe700 1 -- 172.21.15.57:0/3749658374 >> 172.21.15.57:0/3749658374 conn(0x7f654c062520 msgr2=0x7f654c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:41.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6552abe700 1 -- 172.21.15.57:0/3749658374 shutdown_connections 2021-06-25T04:55:41.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6552abe700 1 -- 172.21.15.57:0/3749658374 wait complete. 2021-06-25T04:55:41.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6552abe700 1 Processor -- start 2021-06-25T04:55:41.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.292+0000 7f6552abe700 1 -- start start 2021-06-25T04:55:41.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6552abe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f654c0b05d0 0x7f654c1411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6552abe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0b5460 0x7f654c1440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6552abe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f654c147560 0x7f654c13e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6552abe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c156780 con 0x7f654c0b05d0 2021-06-25T04:55:41.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6552abe700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c1458f0 con 0x7f654c0b5460 2021-06-25T04:55:41.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6552abe700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c145b90 con 0x7f654c147560 2021-06-25T04:55:41.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6551abc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f654c0b05d0 0x7f654c1411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f65512bb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0b5460 0x7f654c1440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6551abc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f654c0b05d0 0x7f654c1411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42108/0 (socket says 172.21.15.57:42108) 2021-06-25T04:55:41.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6551abc700 1 -- 172.21.15.57:0/1589804775 learned_addr learned my addr 172.21.15.57:0/1589804775 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:41.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f65522bd700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f654c147560 0x7f654c13e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6551abc700 1 -- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f654c147560 msgr2=0x7f654c13e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6551abc700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f654c147560 0x7f654c13e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6551abc700 1 -- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0b5460 msgr2=0x7f654c1440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6551abc700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0b5460 0x7f654c1440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6551abc700 1 -- 172.21.15.57:0/1589804775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6544009470 con 0x7f654c0b05d0 2021-06-25T04:55:41.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6551abc700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f654c0b05d0 0x7f654c1411b0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f6548001110 tx=0x7f6548007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:41.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f653affd700 1 -- 172.21.15.57:0/1589804775 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f654800ce50 con 0x7f654c0b05d0 2021-06-25T04:55:41.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f653affd700 1 -- 172.21.15.57:0/1589804775 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654800f470 con 0x7f654c0b05d0 2021-06-25T04:55:41.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6552abe700 1 -- 172.21.15.57:0/1589804775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c00b1e0 con 0x7f654c0b05d0 2021-06-25T04:55:41.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f653affd700 1 -- 172.21.15.57:0/1589804775 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f654800f7d0 con 0x7f654c0b05d0 2021-06-25T04:55:41.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.296+0000 7f6552abe700 1 -- 172.21.15.57:0/1589804775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c15a6e0 con 0x7f654c0b05d0 2021-06-25T04:55:41.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.300+0000 7f6552abe700 1 -- 172.21.15.57:0/1589804775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c057310 con 0x7f654c0b05d0 2021-06-25T04:55:41.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.300+0000 7f653affd700 1 -- 172.21.15.57:0/1589804775 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6548019030 con 0x7f654c0b05d0 2021-06-25T04:55:41.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.300+0000 7f653affd700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f652c0553d0 0x7f652c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.300+0000 7f653affd700 1 -- 172.21.15.57:0/1589804775 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f654806d180 con 0x7f654c0b05d0 2021-06-25T04:55:41.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.300+0000 7f65512bb700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f652c0553d0 0x7f652c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.300+0000 7f65512bb700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f652c0553d0 0x7f652c057890 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f653c01b000 tx=0x7f653c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:41.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.308+0000 7f653affd700 1 -- 172.21.15.57:0/1589804775 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6548043500 con 0x7f654c0b05d0 2021-06-25T04:55:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.440+0000 7f6552abe700 1 -- 172.21.15.57:0/1589804775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f654c060e50 con 0x7f654c0b05d0 2021-06-25T04:55:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.440+0000 7f653affd700 1 -- 172.21.15.57:0/1589804775 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) v1 ==== 81+0+29229 (secure 0 0 0) 0x7f6548046b20 con 0x7f654c0b05d0 2021-06-25T04:55:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:55:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 111, 2021-06-25T04:55:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:55:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:55:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:55:38.700986+0000", 2021-06-25T04:55:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:55:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:55:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:55:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:55:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:55:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:55:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:55:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:55:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:55:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:55:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:55:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:55:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:55:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:55:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 20, 2021-06-25T04:55:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:55:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:55:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:55:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:55:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:55:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:55:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:55:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:55:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:55:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:55:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:55:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:55:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:55:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:55:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:55:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:55:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:55:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:55:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:55:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:55:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:55:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:55:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:55:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:55:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:55:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:55:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:55:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:55:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:55:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:55:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:55:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:55:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:55:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:55:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:55:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:55:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:55:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:55:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:55:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:55:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:55:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:55:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:55:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:55:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:55:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:55:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:55:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:55:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:55:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:55:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:55:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:55:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:55:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:55:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:55:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:55:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:55:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:55:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:55:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:55:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:55:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:55:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:55:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:55:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:55:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:55:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:55:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:55:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:55:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:55:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:55:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:55:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:55:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:55:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:55:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:55:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:55:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:55:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:55:41.498 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:55:41.498 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:55:41.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:55:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:55:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:55:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 106, 2021-06-25T04:55:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:55:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:55:41.508 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:41.508 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.508 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:55:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:55:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:55:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:55:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:55:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:55:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:55:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:55:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:55:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:55:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:55:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:55:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:55:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 106, 2021-06-25T04:55:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:55:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:55:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:55:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:55:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:55:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:55:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:55:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:55:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:55:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:55:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:55:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:55:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:55:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:55:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:55:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 105, 2021-06-25T04:55:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:55:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:55:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:55:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:55:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:55:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:55:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:55:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:55:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:55:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:55:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:55:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:55:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:55:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:55:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:55:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 106, 2021-06-25T04:55:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:55:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:55:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:55:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:55:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:55:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:55:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:55:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:55:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:55:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:55:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:55:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:55:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:55:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:55:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:55:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 105, 2021-06-25T04:55:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:55:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:55:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:55:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:55:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:55:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:55:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:55:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:55:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:55:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:55:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:55:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:55:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:55:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:55:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:55:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 105, 2021-06-25T04:55:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:55:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:55:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:55:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:55:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:55:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:55:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:55:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:55:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:55:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:55:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:55:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:55:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:55:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:55:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:55:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 106, 2021-06-25T04:55:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:55:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:55:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:55:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:55:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:55:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:55:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:55:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:55:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:55:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:55:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:55:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:55:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:55:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:55:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:55:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:55:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:55:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:55:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:55:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:55:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:55:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:55:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 106, 2021-06-25T04:55:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:55:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:55:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:55:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.645 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:55:41.645 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:41.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.645 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.646 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:55:41.646 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:41.646 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.646 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.647 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:55:41.647 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.648 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.648 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:55:41.648 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:41.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.649 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.649 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:55:41.649 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:41.649 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.650 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.650 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:55:41.650 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.651 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.651 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:55:41.651 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:41.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.652 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.652 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:55:41.652 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:41.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.653 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.653 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:55:41.653 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:55:41.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.654 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:55:41.654 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:55:41.654 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:41.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.655 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:55:41.655 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:55:41.655 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:55:41.656 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.656 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.656 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:55:41.657 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:55:41.657 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:55:41.657 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:55:41.657 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:55:41.657 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:55:41.658 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:55:41.658 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:41.658 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.658 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:41.659 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:55:41.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.659 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:55:41.659 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:41.659 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:41.660 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:41.660 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:41.660 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:41.660 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:55:41.661 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:41.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:55:41.661 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:41.662 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:41.662 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:41.662 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:41.662 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:41.663 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:55:41.663 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:41.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.664 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:55:41.664 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:41.664 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:41.664 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:41.664 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:41.665 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:41.665 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:55:41.665 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:41.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.666 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:55:41.666 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:41.666 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:41.667 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:41.667 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:41.667 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:41.667 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:55:41.667 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:41.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.668 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:55:41.668 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:41.669 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:41.669 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:41.669 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:41.669 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:41.670 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:55:41.670 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:41.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.670 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:55:41.671 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:41.671 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:41.671 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:41.671 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:41.672 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:41.672 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:55:41.672 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:41.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:55:41.673 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:41.673 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:41.673 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:41.674 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:41.674 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:41.674 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:55:41.674 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:41.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:41.675 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:55:41.675 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:55:41.675 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:55:41.676 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:55:41.676 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:55:41.676 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:55:41.676 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:55:41.677 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:55:41.677 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.677 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:55:41.677 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:55:41.677 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:55:41.678 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:55:41.678 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:55:41.678 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:55:41.678 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6835/4260642378": "2021-06-26T04:55:34.746103+0000", 2021-06-25T04:55:41.679 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6834/4260642378": "2021-06-26T04:55:34.746103+0000" 2021-06-25T04:55:41.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.679 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:55:41.679 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:55:41.680 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:55:41.680 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:55:41.680 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:55:41.680 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:55:41.680 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:55:41.681 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:55:41.681 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:55:41.681 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:55:41.681 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:55:41.682 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:55:41.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.682 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:55:41.682 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:55:41.682 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:55:41.683 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:55:41.683 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:55:41.683 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:55:41.683 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:55:41.684 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:41.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:41.684 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:55:41.684 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:55:41.685 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:55:41.685 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:55:41.685 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:55:41.685 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:55:41.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 -- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f652c0553d0 msgr2=0x7f652c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f652c0553d0 0x7f652c057890 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f653c01b000 tx=0x7f653c015000).stop 2021-06-25T04:55:41.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 -- 172.21.15.57:0/1589804775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f654c0b05d0 msgr2=0x7f654c1411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f654c0b05d0 0x7f654c1411b0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f6548001110 tx=0x7f6548007ae0).stop 2021-06-25T04:55:41.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 -- 172.21.15.57:0/1589804775 shutdown_connections 2021-06-25T04:55:41.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f652c0553d0 0x7f652c057890 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f654c147560 0x7f654c13e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0b5460 0x7f654c1440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 --2- 172.21.15.57:0/1589804775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f654c0b05d0 0x7f654c1411b0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 -- 172.21.15.57:0/1589804775 >> 172.21.15.57:0/1589804775 conn(0x7f654c062520 msgr2=0x7f654c0acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 -- 172.21.15.57:0/1589804775 shutdown_connections 2021-06-25T04:55:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.444+0000 7f6552abe700 1 -- 172.21.15.57:0/1589804775 wait complete. 2021-06-25T04:55:41.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:41.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440eff9700 1 Processor -- start 2021-06-25T04:55:41.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440eff9700 1 -- start start 2021-06-25T04:55:41.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440eff9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44080a7670 0x7f4408066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440eff9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b1930 0x7f4408066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440eff9700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4408067410 con 0x7f44080b0020 2021-06-25T04:55:41.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440eff9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44080a7a50 con 0x7f44080a7670 2021-06-25T04:55:41.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440eff9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44081475e0 con 0x7f44080b1930 2021-06-25T04:55:41.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440cd95700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44080a7670 0x7f4408066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440cd95700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44080a7670 0x7f4408066a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42116/0 (socket says 172.21.15.57:42116) 2021-06-25T04:55:41.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440cd95700 1 -- 172.21.15.57:0/2950221121 learned_addr learned my addr 172.21.15.57:0/2950221121 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:41.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f4407fff700 1 --2- 172.21.15.57:0/2950221121 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b1930 0x7f4408066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440cd95700 1 -- 172.21.15.57:0/2950221121 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b1930 msgr2=0x7f4408066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:41.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440cd95700 1 --2- 172.21.15.57:0/2950221121 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b1930 0x7f4408066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440cd95700 1 -- 172.21.15.57:0/2950221121 >> v1:172.21.15.87:6789/0 conn(0x7f44080b0020 legacy=0x7f440805f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440cd95700 1 -- 172.21.15.57:0/2950221121 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4408147880 con 0x7f44080a7670 2021-06-25T04:55:41.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f4407fff700 1 --2- 172.21.15.57:0/2950221121 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b1930 0x7f4408066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:41.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f44077fe700 1 -- 172.21.15.57:0/2950221121 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745614624 0 0) 0x7f4408067410 con 0x7f44080b0020 2021-06-25T04:55:41.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440cd95700 1 --2- 172.21.15.57:0/2950221121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44080a7670 0x7f4408066a30 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f43f80032f0 tx=0x7f43f8009290).ready entity=mon.0 client_cookie=9776cb3912575062 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:41.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f44077fe700 1 -- 172.21.15.57:0/2950221121 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f800b8a0 con 0x7f44080a7670 2021-06-25T04:55:41.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f44077fe700 1 -- 172.21.15.57:0/2950221121 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f800ba00 con 0x7f44080a7670 2021-06-25T04:55:41.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f44077fe700 1 -- 172.21.15.57:0/2950221121 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43f800bb70 con 0x7f44080a7670 2021-06-25T04:55:41.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440eff9700 1 -- 172.21.15.57:0/2950221121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44080a7670 msgr2=0x7f4408066a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.800+0000 7f440eff9700 1 --2- 172.21.15.57:0/2950221121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44080a7670 0x7f4408066a30 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f43f80032f0 tx=0x7f43f8009290).stop 2021-06-25T04:55:41.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 -- 172.21.15.57:0/2950221121 shutdown_connections 2021-06-25T04:55:41.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 --2- 172.21.15.57:0/2950221121 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b1930 0x7f4408066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 --2- 172.21.15.57:0/2950221121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44080a7670 0x7f4408066a30 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 -- 172.21.15.57:0/2950221121 >> 172.21.15.57:0/2950221121 conn(0x7f44080b53a0 msgr2=0x7f44080b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:41.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 -- 172.21.15.57:0/2950221121 shutdown_connections 2021-06-25T04:55:41.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 -- 172.21.15.57:0/2950221121 wait complete. 2021-06-25T04:55:41.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 Processor -- start 2021-06-25T04:55:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 -- start start 2021-06-25T04:55:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44080a7670 0x7f44080ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b0020 0x7f44080b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44080b1930 0x7f44080ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44080ade40 con 0x7f44080b1930 2021-06-25T04:55:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44080ae0e0 con 0x7f44080a7670 2021-06-25T04:55:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440eff9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44080ab160 con 0x7f44080b0020 2021-06-25T04:55:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440d596700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44080b1930 0x7f44080ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440cd95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44080a7670 0x7f44080ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f4407fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b0020 0x7f44080b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f4407fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b0020 0x7f44080b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:53288/0 (socket says 172.21.15.57:53288) 2021-06-25T04:55:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440cd95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44080a7670 0x7f44080ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:50616/0 (socket says 172.21.15.57:50616) 2021-06-25T04:55:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f440d596700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44080b1930 0x7f44080ae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42126/0 (socket says 172.21.15.57:42126) 2021-06-25T04:55:41.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.804+0000 7f4407fff700 1 -- 172.21.15.57:0/2986204546 learned_addr learned my addr 172.21.15.57:0/2986204546 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:41.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f440d596700 1 -- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b0020 msgr2=0x7f44080b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f440d596700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b0020 0x7f44080b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f440d596700 1 -- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44080a7670 msgr2=0x7f44080ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f440d596700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44080a7670 0x7f44080ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f440d596700 1 -- 172.21.15.57:0/2986204546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc00b180 con 0x7f44080b1930 2021-06-25T04:55:41.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f4407fff700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b0020 0x7f44080b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:41.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f440d596700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44080b1930 0x7f44080ae9d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f4400000bc0 tx=0x7f4400007910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:41.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f4405ffb700 1 -- 172.21.15.57:0/2986204546 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f440000cd40 con 0x7f44080b1930 2021-06-25T04:55:41.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f4405ffb700 1 -- 172.21.15.57:0/2986204546 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400012400 con 0x7f44080b1930 2021-06-25T04:55:41.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f440eff9700 1 -- 172.21.15.57:0/2986204546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f8009530 con 0x7f44080b1930 2021-06-25T04:55:41.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f4405ffb700 1 -- 172.21.15.57:0/2986204546 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f440000cea0 con 0x7f44080b1930 2021-06-25T04:55:41.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f440eff9700 1 -- 172.21.15.57:0/2986204546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44080ae570 con 0x7f44080b1930 2021-06-25T04:55:41.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f440eff9700 1 -- 172.21.15.57:0/2986204546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44080ae820 con 0x7f44080b1930 2021-06-25T04:55:41.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f4405ffb700 1 -- 172.21.15.57:0/2986204546 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4400019030 con 0x7f44080b1930 2021-06-25T04:55:41.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f4405ffb700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f43e8055450 0x7f43e8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:41.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.808+0000 7f4405ffb700 1 -- 172.21.15.57:0/2986204546 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f440006cd10 con 0x7f44080b1930 2021-06-25T04:55:41.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.812+0000 7f440cd95700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f43e8055450 0x7f43e8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:41.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.812+0000 7f440cd95700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f43e8055450 0x7f43e8057910 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f43f801a000 tx=0x7f43f8016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:41.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.816+0000 7f4405ffb700 1 -- 172.21.15.57:0/2986204546 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4400043250 con 0x7f44080b1930 2021-06-25T04:55:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.980+0000 7f440eff9700 1 -- 172.21.15.57:0/2986204546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4408057310 con 0x7f44080b1930 2021-06-25T04:55:41.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f4405ffb700 1 -- 172.21.15.57:0/2986204546 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+1556 (secure 0 0 0) 0x7f4400017030 con 0x7f44080b1930 2021-06-25T04:55:41.987 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:41.987 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3265820466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3265820466},{"type":"v1","addr":"172.21.15.87:6835","nonce":3265820466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51},{"gid":7323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/994003328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":994003328},{"type":"v1","addr":"172.21.15.57:6833","nonce":994003328}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7572,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6835/418859831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":418859831},{"type":"v1","addr":"172.21.15.57:6835","nonce":418859831}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":55}],"filesystems":[]} 2021-06-25T04:55:41.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 -- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f43e8055450 msgr2=0x7f43e8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f43e8055450 0x7f43e8057910 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f43f801a000 tx=0x7f43f8016000).stop 2021-06-25T04:55:41.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 -- 172.21.15.57:0/2986204546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44080b1930 msgr2=0x7f44080ae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:41.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44080b1930 0x7f44080ae9d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f4400000bc0 tx=0x7f4400007910).stop 2021-06-25T04:55:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 -- 172.21.15.57:0/2986204546 shutdown_connections 2021-06-25T04:55:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f43e8055450 0x7f43e8057910 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44080b1930 0x7f44080ae9d0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44080b0020 0x7f44080b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 --2- 172.21.15.57:0/2986204546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44080a7670 0x7f44080ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:41.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 -- 172.21.15.57:0/2986204546 >> 172.21.15.57:0/2986204546 conn(0x7f44080b53a0 msgr2=0x7f440814a890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:41.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 -- 172.21.15.57:0/2986204546 shutdown_connections 2021-06-25T04:55:41.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:41.984+0000 7f440eff9700 1 -- 172.21.15.57:0/2986204546 wait complete. 2021-06-25T04:55:41.992 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 55 2021-06-25T04:55:41.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:42.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc36ab7700 1 Processor -- start 2021-06-25T04:55:42.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc36ab7700 1 -- start start 2021-06-25T04:55:42.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc36ab7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbc300a7670 0x7fbc30066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc36ab7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc300b1930 0x7fbc30066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc36ab7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc30067410 con 0x7fbc300b0020 2021-06-25T04:55:42.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc36ab7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc300a7a50 con 0x7fbc300a7670 2021-06-25T04:55:42.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc36ab7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc301475e0 con 0x7fbc300b1930 2021-06-25T04:55:42.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc35054700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbc300b0020 0x7fbc3005f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59352/0 (socket says 172.21.15.57:59352) 2021-06-25T04:55:42.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc35054700 1 -- 172.21.15.57:0/1767647018 learned_addr learned my addr 172.21.15.57:0/1767647018 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:42.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc34853700 1 --2- 172.21.15.57:0/1767647018 >> v2:172.21.15.87:3300/0 conn(0x7fbc300a7670 0x7fbc30066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc27fff700 1 --2- 172.21.15.57:0/1767647018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc300b1930 0x7fbc30066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc277fe700 1 -- 172.21.15.57:0/1767647018 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294639967 0 0) 0x7fbc30067410 con 0x7fbc300b0020 2021-06-25T04:55:42.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc277fe700 1 -- 172.21.15.57:0/1767647018 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc1c003260 con 0x7fbc300b0020 2021-06-25T04:55:42.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc34853700 1 -- 172.21.15.57:0/1767647018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc300b1930 msgr2=0x7fbc30066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:42.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc34853700 1 --2- 172.21.15.57:0/1767647018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc300b1930 0x7fbc30066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc34853700 1 -- 172.21.15.57:0/1767647018 >> v1:172.21.15.57:6789/0 conn(0x7fbc300b0020 legacy=0x7fbc3005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:42.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc34853700 1 -- 172.21.15.57:0/1767647018 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc30147880 con 0x7fbc300a7670 2021-06-25T04:55:42.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc34853700 1 --2- 172.21.15.57:0/1767647018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc300a7670 0x7fbc30066a30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fbc2c0032f0 tx=0x7fbc2c0091d0).ready entity=mon.1 client_cookie=3ddc468a19c6064a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:42.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc277fe700 1 -- 172.21.15.57:0/1767647018 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2c00b600 con 0x7fbc300a7670 2021-06-25T04:55:42.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc277fe700 1 -- 172.21.15.57:0/1767647018 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c00b760 con 0x7fbc300a7670 2021-06-25T04:55:42.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc277fe700 1 -- 172.21.15.57:0/1767647018 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2c00b8d0 con 0x7fbc300a7670 2021-06-25T04:55:42.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc36ab7700 1 -- 172.21.15.57:0/1767647018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc300a7670 msgr2=0x7fbc30066a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:42.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.104+0000 7fbc36ab7700 1 --2- 172.21.15.57:0/1767647018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc300a7670 0x7fbc30066a30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fbc2c0032f0 tx=0x7fbc2c0091d0).stop 2021-06-25T04:55:42.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 -- 172.21.15.57:0/1767647018 shutdown_connections 2021-06-25T04:55:42.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 --2- 172.21.15.57:0/1767647018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc300b1930 0x7fbc30066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 --2- 172.21.15.57:0/1767647018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc300a7670 0x7fbc30066a30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 -- 172.21.15.57:0/1767647018 >> 172.21.15.57:0/1767647018 conn(0x7fbc300b53a0 msgr2=0x7fbc300b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:42.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 -- 172.21.15.57:0/1767647018 shutdown_connections 2021-06-25T04:55:42.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 -- 172.21.15.57:0/1767647018 wait complete. 2021-06-25T04:55:42.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 Processor -- start 2021-06-25T04:55:42.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 -- start start 2021-06-25T04:55:42.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc300a7670 0x7fbc300abea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc300b0020 0x7fbc300ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc300b1930 0x7fbc300aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300a9a10 con 0x7fbc300a7670 2021-06-25T04:55:42.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300a9770 con 0x7fbc300b1930 2021-06-25T04:55:42.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc36ab7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300aaf70 con 0x7fbc300b0020 2021-06-25T04:55:42.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc34853700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc300a7670 0x7fbc300abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc34853700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc300a7670 0x7fbc300abea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42136/0 (socket says 172.21.15.57:42136) 2021-06-25T04:55:42.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc34853700 1 -- 172.21.15.57:0/587857421 learned_addr learned my addr 172.21.15.57:0/587857421 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:42.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc35054700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc300b1930 0x7fbc300aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.108+0000 7fbc27fff700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc300b0020 0x7fbc300ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc34853700 1 -- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc300b0020 msgr2=0x7fbc300ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:42.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc34853700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc300b0020 0x7fbc300ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc34853700 1 -- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc300b1930 msgr2=0x7fbc300aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:42.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc34853700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc300b1930 0x7fbc300aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc34853700 1 -- 172.21.15.57:0/587857421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c009470 con 0x7fbc300a7670 2021-06-25T04:55:42.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc27fff700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc300b0020 0x7fbc300ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:42.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc34853700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc300a7670 0x7fbc300abea0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fbc2c0032f0 tx=0x7fbc2c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:42.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc25ffb700 1 -- 172.21.15.57:0/587857421 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2c006ea0 con 0x7fbc300a7670 2021-06-25T04:55:42.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc25ffb700 1 -- 172.21.15.57:0/587857421 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c011e20 con 0x7fbc300a7670 2021-06-25T04:55:42.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc36ab7700 1 -- 172.21.15.57:0/587857421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc300ab210 con 0x7fbc300a7670 2021-06-25T04:55:42.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc25ffb700 1 -- 172.21.15.57:0/587857421 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2c021630 con 0x7fbc300a7670 2021-06-25T04:55:42.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc36ab7700 1 -- 172.21.15.57:0/587857421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc300ad610 con 0x7fbc300a7670 2021-06-25T04:55:42.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc36ab7700 1 -- 172.21.15.57:0/587857421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc300ab3a0 con 0x7fbc300a7670 2021-06-25T04:55:42.264 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc25ffb700 1 -- 172.21.15.57:0/587857421 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbc2c00f070 con 0x7fbc300a7670 2021-06-25T04:55:42.264 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc25ffb700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc100553d0 0x7fbc10057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc25ffb700 1 -- 172.21.15.57:0/587857421 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fbc2c06ec90 con 0x7fbc300a7670 2021-06-25T04:55:42.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.112+0000 7fbc27fff700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc100553d0 0x7fbc10057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.116+0000 7fbc27fff700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc100553d0 0x7fbc10057890 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fbc2000b000 tx=0x7fbc20008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:42.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.120+0000 7fbc25ffb700 1 -- 172.21.15.57:0/587857421 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbc2c045120 con 0x7fbc300a7670 2021-06-25T04:55:42.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.296+0000 7fbc36ab7700 1 -- 172.21.15.57:0/587857421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc30057310 con 0x7fbc300a7670 2021-06-25T04:55:42.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.296+0000 7fbc25ffb700 1 -- 172.21.15.57:0/587857421 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+1556 (secure 0 0 0) 0x7fbc2c015020 con 0x7fbc300a7670 2021-06-25T04:55:42.302 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:42.303 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3265820466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3265820466},{"type":"v1","addr":"172.21.15.87:6835","nonce":3265820466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51},{"gid":7323,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/994003328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":994003328},{"type":"v1","addr":"172.21.15.57:6833","nonce":994003328}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7572,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6835/418859831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":418859831},{"type":"v1","addr":"172.21.15.57:6835","nonce":418859831}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":55}],"filesystems":[]} 2021-06-25T04:55:42.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 -- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc100553d0 msgr2=0x7fbc10057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:42.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc100553d0 0x7fbc10057890 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fbc2000b000 tx=0x7fbc20008040).stop 2021-06-25T04:55:42.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 -- 172.21.15.57:0/587857421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc300a7670 msgr2=0x7fbc300abea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:42.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc300a7670 0x7fbc300abea0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fbc2c0032f0 tx=0x7fbc2c016000).stop 2021-06-25T04:55:42.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 -- 172.21.15.57:0/587857421 shutdown_connections 2021-06-25T04:55:42.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbc100553d0 0x7fbc10057890 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc300b1930 0x7fbc300aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc300b0020 0x7fbc300ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 --2- 172.21.15.57:0/587857421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc300a7670 0x7fbc300abea0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 -- 172.21.15.57:0/587857421 >> 172.21.15.57:0/587857421 conn(0x7fbc300b53a0 msgr2=0x7fbc3014a890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:42.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 -- 172.21.15.57:0/587857421 shutdown_connections 2021-06-25T04:55:42.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.300+0000 7fbc36ab7700 1 -- 172.21.15.57:0/587857421 wait complete. 2021-06-25T04:55:42.307 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 55 2021-06-25T04:55:42.318 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:55:42.318 INFO:tasks.ceph.mds.a:Stopping old one... 2021-06-25T04:55:42.319 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:55:42.319 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:55:42.319 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:55:42.320 INFO:tasks.ceph.mds.c:Stopping old one... 2021-06-25T04:55:42.320 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:55:42.321 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:55:42.322 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:55:42.322 INFO:tasks.ceph.mds.b:Stopping old one... 2021-06-25T04:55:42.324 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:55:42.324 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:55:42.336 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:55:42.337 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:55:42.338 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:55:42.339 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:55:42.340 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:55:42.341 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:55:42.384 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:55:42.385 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:55:42.386 DEBUG:teuthology.parallel:result is None 2021-06-25T04:55:42.387 DEBUG:teuthology.parallel:result is None 2021-06-25T04:55:42.388 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:55:42.389 DEBUG:teuthology.parallel:result is None 2021-06-25T04:55:42.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:55:42.461 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:55:42.464 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:55:42.472 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:55:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9939610700 1 Processor -- start 2021-06-25T04:55:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9939610700 1 -- start start 2021-06-25T04:55:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9939610700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99340b7670 0x7f9934060a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9939610700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f99340b2760 0x7f9934060f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9939610700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9934146550 0x7f99341469a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9939610700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9934067010 con 0x7f9934146550 2021-06-25T04:55:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9939610700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9934065370 con 0x7f99340b2760 2021-06-25T04:55:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9939610700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99340b7a50 con 0x7f99340b7670 2021-06-25T04:55:42.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9938e0f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9934146550 0x7f99341469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9938e0f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9934146550 0x7f99341469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42178/0 (socket says 172.21.15.57:42178) 2021-06-25T04:55:42.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9938e0f700 1 -- 172.21.15.57:0/3856570501 learned_addr learned my addr 172.21.15.57:0/3856570501 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:42.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9933fff700 1 --2- 172.21.15.57:0/3856570501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99340b7670 0x7f9934060a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f99337fe700 1 --2- 172.21.15.57:0/3856570501 >> v2:172.21.15.87:3300/0 conn(0x7f99340b2760 0x7f9934060f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9938e0f700 1 -- 172.21.15.57:0/3856570501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99340b7670 msgr2=0x7f9934060a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:42.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9938e0f700 1 --2- 172.21.15.57:0/3856570501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99340b7670 0x7f9934060a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9938e0f700 1 -- 172.21.15.57:0/3856570501 >> v2:172.21.15.87:3300/0 conn(0x7f99340b2760 msgr2=0x7f9934060f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:42.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9938e0f700 1 --2- 172.21.15.57:0/3856570501 >> v2:172.21.15.87:3300/0 conn(0x7f99340b2760 0x7f9934060f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9938e0f700 1 -- 172.21.15.57:0/3856570501 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9934066b10 con 0x7f9934146550 2021-06-25T04:55:42.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9938e0f700 1 --2- 172.21.15.57:0/3856570501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9934146550 0x7f99341469a0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f992c0032f0 tx=0x7f992c009290).ready entity=mon.0 client_cookie=afaea71327fdc5e3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:42.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9932ffd700 1 -- 172.21.15.57:0/3856570501 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c00b870 con 0x7f9934146550 2021-06-25T04:55:42.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9932ffd700 1 -- 172.21.15.57:0/3856570501 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00b9d0 con 0x7f9934146550 2021-06-25T04:55:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9932ffd700 1 -- 172.21.15.57:0/3856570501 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c00bb80 con 0x7f9934146550 2021-06-25T04:55:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9939610700 1 -- 172.21.15.57:0/3856570501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9934146550 msgr2=0x7f99341469a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.484+0000 7f9939610700 1 --2- 172.21.15.57:0/3856570501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9934146550 0x7f99341469a0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f992c0032f0 tx=0x7f992c009290).stop 2021-06-25T04:55:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 -- 172.21.15.57:0/3856570501 shutdown_connections 2021-06-25T04:55:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 --2- 172.21.15.57:0/3856570501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9934146550 0x7f99341469a0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 --2- 172.21.15.57:0/3856570501 >> v2:172.21.15.87:3300/0 conn(0x7f99340b2760 0x7f9934060f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 --2- 172.21.15.57:0/3856570501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99340b7670 0x7f9934060a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 -- 172.21.15.57:0/3856570501 >> 172.21.15.57:0/3856570501 conn(0x7f993405f670 msgr2=0x7f993405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:42.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 -- 172.21.15.57:0/3856570501 shutdown_connections 2021-06-25T04:55:42.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 -- 172.21.15.57:0/3856570501 wait complete. 2021-06-25T04:55:42.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 Processor -- start 2021-06-25T04:55:42.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 -- start start 2021-06-25T04:55:42.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99340b2760 0x7f99340abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99340b7670 0x7f99341498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9934146550 0x7f9934149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9934142790 con 0x7f9934146550 2021-06-25T04:55:42.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9934155a00 con 0x7f99340b2760 2021-06-25T04:55:42.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9939610700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9934155ca0 con 0x7f99340b7670 2021-06-25T04:55:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9938e0f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9934146550 0x7f9934149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9933fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99340b2760 0x7f99340abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9938e0f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9934146550 0x7f9934149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42184/0 (socket says 172.21.15.57:42184) 2021-06-25T04:55:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9938e0f700 1 -- 172.21.15.57:0/4050756658 learned_addr learned my addr 172.21.15.57:0/4050756658 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f99337fe700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99340b7670 0x7f99341498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9938e0f700 1 -- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99340b7670 msgr2=0x7f99341498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9938e0f700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99340b7670 0x7f99341498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9938e0f700 1 -- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99340b2760 msgr2=0x7f99340abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9938e0f700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99340b2760 0x7f99340abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9938e0f700 1 -- 172.21.15.57:0/4050756658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c009530 con 0x7f9934146550 2021-06-25T04:55:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.488+0000 7f9938e0f700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9934146550 0x7f9934149dc0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f992c0032f0 tx=0x7f992c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:42.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.492+0000 7f99317fa700 1 -- 172.21.15.57:0/4050756658 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c011b40 con 0x7f9934146550 2021-06-25T04:55:42.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.492+0000 7f99317fa700 1 -- 172.21.15.57:0/4050756658 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c011ca0 con 0x7f9934146550 2021-06-25T04:55:42.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.492+0000 7f9939610700 1 -- 172.21.15.57:0/4050756658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9934155f40 con 0x7f9934146550 2021-06-25T04:55:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.496+0000 7f99317fa700 1 -- 172.21.15.57:0/4050756658 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c020470 con 0x7f9934146550 2021-06-25T04:55:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.496+0000 7f9939610700 1 -- 172.21.15.57:0/4050756658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99340ac4b0 con 0x7f9934146550 2021-06-25T04:55:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.496+0000 7f9939610700 1 -- 172.21.15.57:0/4050756658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9934057310 con 0x7f9934146550 2021-06-25T04:55:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.496+0000 7f99317fa700 1 -- 172.21.15.57:0/4050756658 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f992c00f070 con 0x7f9934146550 2021-06-25T04:55:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.496+0000 7f99317fa700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9914055450 0x7f9914057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.496+0000 7f99317fa700 1 -- 172.21.15.57:0/4050756658 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f992c06e620 con 0x7f9934146550 2021-06-25T04:55:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.496+0000 7f9933fff700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9914055450 0x7f9914057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:42.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.496+0000 7f9933fff700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9914055450 0x7f9914057910 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f992800c000 tx=0x7f9928008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:42.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.500+0000 7f99317fa700 1 -- 172.21.15.57:0/4050756658 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f992c044a10 con 0x7f9934146550 2021-06-25T04:55:42.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:42.636+0000 7f9939610700 1 -- 172.21.15.57:0/4050756658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f9934060160 con 0x7f9934146550 2021-06-25T04:55:43.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.515+0000 7f99317fa700 1 -- 172.21.15.57:0/4050756658 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v113) v1 ==== 97+0+0 (secure 0 0 0) 0x7f992c015070 con 0x7f9934146550 2021-06-25T04:55:43.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 -- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9914055450 msgr2=0x7f9914057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:43.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9914055450 0x7f9914057910 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f992800c000 tx=0x7f9928008040).stop 2021-06-25T04:55:43.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 -- 172.21.15.57:0/4050756658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9934146550 msgr2=0x7f9934149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:43.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9934146550 0x7f9934149dc0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f992c0032f0 tx=0x7f992c016000).stop 2021-06-25T04:55:43.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 -- 172.21.15.57:0/4050756658 shutdown_connections 2021-06-25T04:55:43.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9914055450 0x7f9914057910 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9934146550 0x7f9934149dc0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99340b7670 0x7f99341498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 --2- 172.21.15.57:0/4050756658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99340b2760 0x7f99340abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 -- 172.21.15.57:0/4050756658 >> 172.21.15.57:0/4050756658 conn(0x7f993405f670 msgr2=0x7f993405c450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:43.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 -- 172.21.15.57:0/4050756658 shutdown_connections 2021-06-25T04:55:43.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.519+0000 7f9939610700 1 -- 172.21.15.57:0/4050756658 wait complete. 2021-06-25T04:55:43.527 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:55:43.541 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:55:43.542 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:55:43.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f151abcd700 1 Processor -- start 2021-06-25T04:55:43.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f151abcd700 1 -- start start 2021-06-25T04:55:43.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f151abcd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15140b5460 0x7f15140af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:43.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f151abcd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f15140b05d0 0x7f1514147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:43.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f151abcd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15140b5840 con 0x7f1514067560 2021-06-25T04:55:43.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f151abcd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15141452a0 con 0x7f15140b05d0 2021-06-25T04:55:43.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f151abcd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140adfb0 con 0x7f15140b5460 2021-06-25T04:55:43.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f15193ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f15140b05d0 0x7f1514147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:43.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f15193ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f15140b05d0 0x7f1514147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42190/0 (socket says 172.21.15.57:42190) 2021-06-25T04:55:43.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f15193ca700 1 -- 172.21.15.57:0/1109118070 learned_addr learned my addr 172.21.15.57:0/1109118070 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:43.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f15193ca700 1 -- 172.21.15.57:0/1109118070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15140b5460 msgr2=0x7f15140af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:43.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f1519bcb700 1 --2- 172.21.15.57:0/1109118070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15140b5460 0x7f15140af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:43.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f15193ca700 1 --2- 172.21.15.57:0/1109118070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15140b5460 0x7f15140af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f15193ca700 1 -- 172.21.15.57:0/1109118070 >> v1:172.21.15.57:6789/0 conn(0x7f1514067560 legacy=0x7f15140acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:43.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f15193ca700 1 -- 172.21.15.57:0/1109118070 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140ac7c0 con 0x7f15140b05d0 2021-06-25T04:55:43.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f1519bcb700 1 --2- 172.21.15.57:0/1109118070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15140b5460 0x7f15140af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:43.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f15193ca700 1 --2- 172.21.15.57:0/1109118070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15140b05d0 0x7f1514147560 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f15040032f0 tx=0x7f1504009290).ready entity=mon.0 client_cookie=9d8e050fb7a713c8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:43.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.651+0000 7f1518bc9700 1 -- 172.21.15.57:0/1109118070 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f150400b8a0 con 0x7f15140b05d0 2021-06-25T04:55:43.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f1518bc9700 1 -- 172.21.15.57:0/1109118070 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150400ba00 con 0x7f15140b05d0 2021-06-25T04:55:43.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f1518bc9700 1 -- 172.21.15.57:0/1109118070 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f150400bb70 con 0x7f15140b05d0 2021-06-25T04:55:43.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 -- 172.21.15.57:0/1109118070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15140b05d0 msgr2=0x7f1514147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:43.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 --2- 172.21.15.57:0/1109118070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15140b05d0 0x7f1514147560 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f15040032f0 tx=0x7f1504009290).stop 2021-06-25T04:55:43.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 -- 172.21.15.57:0/1109118070 shutdown_connections 2021-06-25T04:55:43.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 --2- 172.21.15.57:0/1109118070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15140b05d0 0x7f1514147560 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 --2- 172.21.15.57:0/1109118070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15140b5460 0x7f15140af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 -- 172.21.15.57:0/1109118070 >> 172.21.15.57:0/1109118070 conn(0x7f1514062520 msgr2=0x7f1514062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:43.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 -- 172.21.15.57:0/1109118070 shutdown_connections 2021-06-25T04:55:43.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 -- 172.21.15.57:0/1109118070 wait complete. 2021-06-25T04:55:43.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 Processor -- start 2021-06-25T04:55:43.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 -- start start 2021-06-25T04:55:43.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1514067560 0x7f151414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:43.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15140b05d0 0x7f15140b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:43.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15140b5460 0x7f1514146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:43.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15140b3b10 con 0x7f15140b5460 2021-06-25T04:55:43.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15140b2f20 con 0x7f15140b05d0 2021-06-25T04:55:43.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151abcd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15141460b0 con 0x7f1514067560 2021-06-25T04:55:43.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151a3cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15140b5460 0x7f1514146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:43.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151a3cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15140b5460 0x7f1514146760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42200/0 (socket says 172.21.15.57:42200) 2021-06-25T04:55:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151a3cc700 1 -- 172.21.15.57:0/2364490069 learned_addr learned my addr 172.21.15.57:0/2364490069 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f15193ca700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15140b05d0 0x7f15140b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f1519bcb700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1514067560 0x7f151414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151a3cc700 1 -- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1514067560 msgr2=0x7f151414d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151a3cc700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1514067560 0x7f151414d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151a3cc700 1 -- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15140b05d0 msgr2=0x7f15140b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:43.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151a3cc700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15140b05d0 0x7f15140b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f151a3cc700 1 -- 172.21.15.57:0/2364490069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1504009530 con 0x7f15140b5460 2021-06-25T04:55:43.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.655+0000 7f15193ca700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15140b05d0 0x7f15140b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:43.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.659+0000 7f151a3cc700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15140b5460 0x7f1514146760 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f15140ac5a0 tx=0x7f150c007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:43.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.659+0000 7f1512ffd700 1 -- 172.21.15.57:0/2364490069 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f150c00ce30 con 0x7f15140b5460 2021-06-25T04:55:43.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.659+0000 7f1512ffd700 1 -- 172.21.15.57:0/2364490069 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c00f470 con 0x7f15140b5460 2021-06-25T04:55:43.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.659+0000 7f151abcd700 1 -- 172.21.15.57:0/2364490069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1514145e10 con 0x7f15140b5460 2021-06-25T04:55:43.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.659+0000 7f1512ffd700 1 -- 172.21.15.57:0/2364490069 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f150c00f7d0 con 0x7f15140b5460 2021-06-25T04:55:43.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.659+0000 7f151abcd700 1 -- 172.21.15.57:0/2364490069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151414d7e0 con 0x7f15140b5460 2021-06-25T04:55:43.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.659+0000 7f151abcd700 1 -- 172.21.15.57:0/2364490069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1514057310 con 0x7f15140b5460 2021-06-25T04:55:43.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.659+0000 7f1512ffd700 1 -- 172.21.15.57:0/2364490069 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f150c019030 con 0x7f15140b5460 2021-06-25T04:55:43.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.659+0000 7f1512ffd700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f14f4055510 0x7f14f40579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:43.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.659+0000 7f1512ffd700 1 -- 172.21.15.57:0/2364490069 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f150c06cfe0 con 0x7f15140b5460 2021-06-25T04:55:43.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.659+0000 7f1519bcb700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f14f4055510 0x7f14f40579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:43.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.663+0000 7f1519bcb700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f14f4055510 0x7f14f40579d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f150800b000 tx=0x7f1508008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:43.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.663+0000 7f1512ffd700 1 -- 172.21.15.57:0/2364490069 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f150c0433c0 con 0x7f15140b5460 2021-06-25T04:55:43.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.835+0000 7f151abcd700 1 -- 172.21.15.57:0/2364490069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1514060e50 con 0x7f15140b5460 2021-06-25T04:55:43.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.835+0000 7f1512ffd700 1 -- 172.21.15.57:0/2364490069 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f150c0469e0 con 0x7f15140b5460 2021-06-25T04:55:43.844 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:43.844 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:55:43.844 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:55:43.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.845 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:55:43.845 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:55:43.845 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.846 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:55:43.846 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.846 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.846 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.846 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.848 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:55:43.848 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:55:43.848 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.849 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:55:43.849 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.849 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.849 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.850 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.851 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:55:43.851 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:55:43.851 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.851 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:55:43.852 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.852 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.852 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.852 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.853 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:55:43.853 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:55:43.854 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.854 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.854 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.854 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.855 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.856 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:55:43.857 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:55:43.857 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.857 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.857 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.858 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.858 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.859 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:55:43.859 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:55:43.860 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.860 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.860 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.860 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.860 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.861 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:55:43.861 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:55:43.862 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.862 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.862 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.862 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.863 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.863 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:55:43.864 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:55:43.864 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.864 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.864 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.865 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.865 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.865 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:55:43.866 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:55:43.866 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.867 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.867 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.867 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.867 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.868 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:55:43.868 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:55:43.869 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.869 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.869 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.870 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.870 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.871 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:55:43.871 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:55:43.872 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.872 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.872 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.872 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.873 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.873 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:55:43.874 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:55:43.874 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.877 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:55:43.877 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:55:43.878 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:55:43.878 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.879 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:55:43.879 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:55:43.879 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.880 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:55:43.880 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:55:43.880 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:55:43.880 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.881 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:55:43.881 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:55:43.881 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.882 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:55:43.882 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:55:43.882 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:55:43.882 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.883 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.883 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:55:43.883 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:55:43.884 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.884 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:55:43.884 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:55:43.884 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.885 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:43.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:43.885 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:55:43.885 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:55:43.886 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:55:43.886 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:55:43.886 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:55:43.886 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:55:43.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:43.887 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:55:43.888 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:55:43.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 -- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f14f4055510 msgr2=0x7f14f40579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:43.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f14f4055510 0x7f14f40579d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f150800b000 tx=0x7f1508008040).stop 2021-06-25T04:55:43.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 -- 172.21.15.57:0/2364490069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15140b5460 msgr2=0x7f1514146760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:43.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15140b5460 0x7f1514146760 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f15140ac5a0 tx=0x7f150c007bc0).stop 2021-06-25T04:55:43.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 -- 172.21.15.57:0/2364490069 shutdown_connections 2021-06-25T04:55:43.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f14f4055510 0x7f14f40579d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15140b5460 0x7f1514146760 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15140b05d0 0x7f15140b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 --2- 172.21.15.57:0/2364490069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1514067560 0x7f151414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:43.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 -- 172.21.15.57:0/2364490069 >> 172.21.15.57:0/2364490069 conn(0x7f1514062520 msgr2=0x7f151414c020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:43.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 -- 172.21.15.57:0/2364490069 shutdown_connections 2021-06-25T04:55:43.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.839+0000 7f151abcd700 1 -- 172.21.15.57:0/2364490069 wait complete. 2021-06-25T04:55:43.893 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:44.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.987+0000 7f3825c43700 1 Processor -- start 2021-06-25T04:55:44.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.987+0000 7f3825c43700 1 -- start start 2021-06-25T04:55:44.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3820061640 0x7f38200b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f38200b46d0 0x7f38200ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38200b68d0 con 0x7f3820143960 2021-06-25T04:55:44.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38200b9640 con 0x7f3820061640 2021-06-25T04:55:44.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38200b6b70 con 0x7f38200b46d0 2021-06-25T04:55:44.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3824c41700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3820061640 0x7f38200b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3824c41700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3820061640 0x7f38200b9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42204/0 (socket says 172.21.15.57:42204) 2021-06-25T04:55:44.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3824c41700 1 -- 172.21.15.57:0/941970132 learned_addr learned my addr 172.21.15.57:0/941970132 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:44.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3817fff700 1 --2- 172.21.15.57:0/941970132 >> v2:172.21.15.87:3300/0 conn(0x7f38200b46d0 0x7f38200ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3824c41700 1 -- 172.21.15.57:0/941970132 >> v2:172.21.15.87:3300/0 conn(0x7f38200b46d0 msgr2=0x7f38200ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:44.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3824c41700 1 --2- 172.21.15.57:0/941970132 >> v2:172.21.15.87:3300/0 conn(0x7f38200b46d0 0x7f38200ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3824c41700 1 -- 172.21.15.57:0/941970132 >> v1:172.21.15.87:6789/0 conn(0x7f3820143960 legacy=0x7f382013fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3824c41700 1 -- 172.21.15.57:0/941970132 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200b6e10 con 0x7f3820061640 2021-06-25T04:55:44.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3824c41700 1 --2- 172.21.15.57:0/941970132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3820061640 0x7f38200b9cd0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f3818001490 tx=0x7f381c006eb0).ready entity=mon.0 client_cookie=78601627771e61a3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f38177fe700 1 -- 172.21.15.57:0/941970132 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381c00e590 con 0x7f3820061640 2021-06-25T04:55:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f38177fe700 1 -- 172.21.15.57:0/941970132 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c000e90 con 0x7f3820061640 2021-06-25T04:55:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f38177fe700 1 -- 172.21.15.57:0/941970132 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381c00e920 con 0x7f3820061640 2021-06-25T04:55:44.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 -- 172.21.15.57:0/941970132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3820061640 msgr2=0x7f38200b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 --2- 172.21.15.57:0/941970132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3820061640 0x7f38200b9cd0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f3818001490 tx=0x7f381c006eb0).stop 2021-06-25T04:55:44.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 -- 172.21.15.57:0/941970132 shutdown_connections 2021-06-25T04:55:44.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 --2- 172.21.15.57:0/941970132 >> v2:172.21.15.87:3300/0 conn(0x7f38200b46d0 0x7f38200ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 --2- 172.21.15.57:0/941970132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3820061640 0x7f38200b9cd0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 -- 172.21.15.57:0/941970132 >> 172.21.15.57:0/941970132 conn(0x7f382006adb0 msgr2=0x7f382005f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.991+0000 7f3825c43700 1 -- 172.21.15.57:0/941970132 shutdown_connections 2021-06-25T04:55:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.995+0000 7f3825c43700 1 -- 172.21.15.57:0/941970132 wait complete. 2021-06-25T04:55:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.995+0000 7f3825c43700 1 Processor -- start 2021-06-25T04:55:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.995+0000 7f3825c43700 1 -- start start 2021-06-25T04:55:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.995+0000 7f3825c43700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3820061640 0x7f3820140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.995+0000 7f3825c43700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3820143960 0x7f3820152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825c43700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3820147d20 0x7f3820152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825c43700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38201375b0 con 0x7f3820147d20 2021-06-25T04:55:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825c43700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38200b7670 con 0x7f3820061640 2021-06-25T04:55:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825c43700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38200b7910 con 0x7f3820143960 2021-06-25T04:55:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825442700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3820147d20 0x7f3820152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825442700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3820147d20 0x7f3820152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42214/0 (socket says 172.21.15.57:42214) 2021-06-25T04:55:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825442700 1 -- 172.21.15.57:0/1452895344 learned_addr learned my addr 172.21.15.57:0/1452895344 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3824c41700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3820061640 0x7f3820140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3817fff700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3820143960 0x7f3820152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825442700 1 -- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3820143960 msgr2=0x7f3820152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825442700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3820143960 0x7f3820152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825442700 1 -- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3820061640 msgr2=0x7f3820140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825442700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3820061640 0x7f3820140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825442700 1 -- 172.21.15.57:0/1452895344 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c00b1e0 con 0x7f3820147d20 2021-06-25T04:55:44.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825442700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3820147d20 0x7f3820152630 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f3818001360 tx=0x7f3818007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3815ffb700 1 -- 172.21.15.57:0/1452895344 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3818010510 con 0x7f3820147d20 2021-06-25T04:55:44.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825c43700 1 -- 172.21.15.57:0/1452895344 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38200b7bb0 con 0x7f3820147d20 2021-06-25T04:55:44.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825c43700 1 -- 172.21.15.57:0/1452895344 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3820141620 con 0x7f3820147d20 2021-06-25T04:55:44.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3815ffb700 1 -- 172.21.15.57:0/1452895344 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3818010670 con 0x7f3820147d20 2021-06-25T04:55:44.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3815ffb700 1 -- 172.21.15.57:0/1452895344 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38180107e0 con 0x7f3820147d20 2021-06-25T04:55:44.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3825c43700 1 -- 172.21.15.57:0/1452895344 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc003410 con 0x7f3820147d20 2021-06-25T04:55:44.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:43.999+0000 7f3815ffb700 1 -- 172.21.15.57:0/1452895344 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3818010070 con 0x7f3820147d20 2021-06-25T04:55:44.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.003+0000 7f3815ffb700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3800055360 0x7f3800057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.003+0000 7f3815ffb700 1 -- 172.21.15.57:0/1452895344 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f381806d640 con 0x7f3820147d20 2021-06-25T04:55:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.003+0000 7f3824c41700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3800055360 0x7f3800057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.003+0000 7f3824c41700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3800055360 0x7f3800057820 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f381c01b000 tx=0x7f381c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.007+0000 7f3815ffb700 1 -- 172.21.15.57:0/1452895344 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3818043a90 con 0x7f3820147d20 2021-06-25T04:55:44.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.139+0000 7f3825c43700 1 -- 172.21.15.57:0/1452895344 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37fc0036c0 con 0x7f3820147d20 2021-06-25T04:55:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.139+0000 7f3815ffb700 1 -- 172.21.15.57:0/1452895344 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f38180470b0 con 0x7f3820147d20 2021-06-25T04:55:44.145 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:44.146 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":113,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:43.505668+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:44.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 -- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3800055360 msgr2=0x7f3800057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3800055360 0x7f3800057820 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f381c01b000 tx=0x7f381c015000).stop 2021-06-25T04:55:44.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 -- 172.21.15.57:0/1452895344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3820147d20 msgr2=0x7f3820152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3820147d20 0x7f3820152630 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f3818001360 tx=0x7f3818007f40).stop 2021-06-25T04:55:44.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 -- 172.21.15.57:0/1452895344 shutdown_connections 2021-06-25T04:55:44.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3800055360 0x7f3800057820 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3820147d20 0x7f3820152630 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3820143960 0x7f3820152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 --2- 172.21.15.57:0/1452895344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3820061640 0x7f3820140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 -- 172.21.15.57:0/1452895344 >> 172.21.15.57:0/1452895344 conn(0x7f382006adb0 msgr2=0x7f38200b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 -- 172.21.15.57:0/1452895344 shutdown_connections 2021-06-25T04:55:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.143+0000 7f3825c43700 1 -- 172.21.15.57:0/1452895344 wait complete. 2021-06-25T04:55:44.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:55:44.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:55:44.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b606a6700 1 Processor -- start 2021-06-25T04:55:44.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b606a6700 1 -- start start 2021-06-25T04:55:44.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b606a6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1b580b36d0 0x7f1b580b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b606a6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b581438e0 con 0x7f1b580b0570 2021-06-25T04:55:44.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b606a6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b58143b80 con 0x7f1b580a9bd0 2021-06-25T04:55:44.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b606a6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b58143e20 con 0x7f1b580b36d0 2021-06-25T04:55:44.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b5e442700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1b580b0570 0x7f1b5813d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59436/0 (socket says 172.21.15.57:59436) 2021-06-25T04:55:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b5e442700 1 -- 172.21.15.57:0/818168879 learned_addr learned my addr 172.21.15.57:0/818168879 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b5dc41700 1 --2- 172.21.15.57:0/818168879 >> v2:172.21.15.87:3300/0 conn(0x7f1b580b36d0 0x7f1b580b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b5d440700 1 -- 172.21.15.57:0/818168879 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399826158 0 0) 0x7f1b581438e0 con 0x7f1b580b0570 2021-06-25T04:55:44.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b5d440700 1 -- 172.21.15.57:0/818168879 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b40003260 con 0x7f1b580b0570 2021-06-25T04:55:44.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b5dc41700 1 -- 172.21.15.57:0/818168879 >> v1:172.21.15.87:6789/0 conn(0x7f1b580a9bd0 legacy=0x7f1b580b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b5dc41700 1 -- 172.21.15.57:0/818168879 >> v1:172.21.15.57:6789/0 conn(0x7f1b580b0570 legacy=0x7f1b5813d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b5dc41700 1 -- 172.21.15.57:0/818168879 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b581440c0 con 0x7f1b580b36d0 2021-06-25T04:55:44.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.267+0000 7f1b5dc41700 1 --2- 172.21.15.57:0/818168879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b580b36d0 0x7f1b580b0950 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f1b48002f70 tx=0x7f1b48006df0).ready entity=mon.1 client_cookie=3624e9ac0a3f4a8e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b5d440700 1 -- 172.21.15.57:0/818168879 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b4800d610 con 0x7f1b580b36d0 2021-06-25T04:55:44.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b5d440700 1 -- 172.21.15.57:0/818168879 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b48000e90 con 0x7f1b580b36d0 2021-06-25T04:55:44.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b5d440700 1 -- 172.21.15.57:0/818168879 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b4800d960 con 0x7f1b580b36d0 2021-06-25T04:55:44.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b606a6700 1 -- 172.21.15.57:0/818168879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b580b36d0 msgr2=0x7f1b580b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b606a6700 1 --2- 172.21.15.57:0/818168879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b580b36d0 0x7f1b580b0950 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f1b48002f70 tx=0x7f1b48006df0).stop 2021-06-25T04:55:44.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b606a6700 1 -- 172.21.15.57:0/818168879 shutdown_connections 2021-06-25T04:55:44.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b606a6700 1 --2- 172.21.15.57:0/818168879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b580b36d0 0x7f1b580b0950 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b606a6700 1 -- 172.21.15.57:0/818168879 >> 172.21.15.57:0/818168879 conn(0x7f1b58060780 msgr2=0x7f1b58060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:44.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b606a6700 1 -- 172.21.15.57:0/818168879 shutdown_connections 2021-06-25T04:55:44.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b606a6700 1 -- 172.21.15.57:0/818168879 wait complete. 2021-06-25T04:55:44.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b606a6700 1 Processor -- start 2021-06-25T04:55:44.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.271+0000 7f1b606a6700 1 -- start start 2021-06-25T04:55:44.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b606a6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b580a9bd0 0x7f1b580b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b606a6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b580b0570 0x7f1b580acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b606a6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b580b36d0 0x7f1b5813b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b606a6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580b43b0 con 0x7f1b580a9bd0 2021-06-25T04:55:44.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b606a6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580ad330 con 0x7f1b580b36d0 2021-06-25T04:55:44.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b606a6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580b4820 con 0x7f1b580b0570 2021-06-25T04:55:44.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5e442700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b580a9bd0 0x7f1b580b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5e442700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b580a9bd0 0x7f1b580b5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42224/0 (socket says 172.21.15.57:42224) 2021-06-25T04:55:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5e442700 1 -- 172.21.15.57:0/1344960969 learned_addr learned my addr 172.21.15.57:0/1344960969 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5ec43700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b580b36d0 0x7f1b5813b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5dc41700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b580b0570 0x7f1b580acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5e442700 1 -- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b580b0570 msgr2=0x7f1b580acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5e442700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b580b0570 0x7f1b580acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5e442700 1 -- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b580b36d0 msgr2=0x7f1b5813b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5e442700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b580b36d0 0x7f1b5813b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5e442700 1 -- 172.21.15.57:0/1344960969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4800b180 con 0x7f1b580a9bd0 2021-06-25T04:55:44.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5ec43700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b580b36d0 0x7f1b5813b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:44.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b5e442700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b580a9bd0 0x7f1b580b5240 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f1b54001490 tx=0x7f1b54007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b477fe700 1 -- 172.21.15.57:0/1344960969 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b54005ba0 con 0x7f1b580a9bd0 2021-06-25T04:55:44.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b477fe700 1 -- 172.21.15.57:0/1344960969 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b54005d00 con 0x7f1b580a9bd0 2021-06-25T04:55:44.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b606a6700 1 -- 172.21.15.57:0/1344960969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b580b5c30 con 0x7f1b580a9bd0 2021-06-25T04:55:44.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b477fe700 1 -- 172.21.15.57:0/1344960969 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b540072c0 con 0x7f1b580a9bd0 2021-06-25T04:55:44.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.275+0000 7f1b606a6700 1 -- 172.21.15.57:0/1344960969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b580b5730 con 0x7f1b580a9bd0 2021-06-25T04:55:44.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.279+0000 7f1b477fe700 1 -- 172.21.15.57:0/1344960969 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1b5401a070 con 0x7f1b580a9bd0 2021-06-25T04:55:44.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.279+0000 7f1b606a6700 1 -- 172.21.15.57:0/1344960969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b58057310 con 0x7f1b580a9bd0 2021-06-25T04:55:44.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.279+0000 7f1b477fe700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b38055490 0x7f1b38057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.279+0000 7f1b477fe700 1 -- 172.21.15.57:0/1344960969 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f1b5406ce70 con 0x7f1b580a9bd0 2021-06-25T04:55:44.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.279+0000 7f1b5dc41700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b38055490 0x7f1b38057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.279+0000 7f1b5dc41700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b38055490 0x7f1b38057950 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f1b48019000 tx=0x7f1b48014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.287+0000 7f1b477fe700 1 -- 172.21.15.57:0/1344960969 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1b54043360 con 0x7f1b580a9bd0 2021-06-25T04:55:44.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b606a6700 1 -- 172.21.15.57:0/1344960969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1b58044610 con 0x7f1b580a9bd0 2021-06-25T04:55:44.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b477fe700 1 -- 172.21.15.57:0/1344960969 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v113) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1b54046980 con 0x7f1b580a9bd0 2021-06-25T04:55:44.420 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:55:44.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b606a6700 1 -- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b38055490 msgr2=0x7f1b38057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b606a6700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b38055490 0x7f1b38057950 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f1b48019000 tx=0x7f1b48014000).stop 2021-06-25T04:55:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b606a6700 1 -- 172.21.15.57:0/1344960969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b580a9bd0 msgr2=0x7f1b580b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b606a6700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b580a9bd0 0x7f1b580b5240 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f1b54001490 tx=0x7f1b54007e20).stop 2021-06-25T04:55:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b606a6700 1 -- 172.21.15.57:0/1344960969 shutdown_connections 2021-06-25T04:55:44.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b606a6700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b38055490 0x7f1b38057950 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b606a6700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b580b36d0 0x7f1b5813b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b606a6700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b580b0570 0x7f1b580acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b606a6700 1 --2- 172.21.15.57:0/1344960969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b580a9bd0 0x7f1b580b5240 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.415+0000 7f1b606a6700 1 -- 172.21.15.57:0/1344960969 >> 172.21.15.57:0/1344960969 conn(0x7f1b58060780 msgr2=0x7f1b580b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:44.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.419+0000 7f1b606a6700 1 -- 172.21.15.57:0/1344960969 shutdown_connections 2021-06-25T04:55:44.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.419+0000 7f1b606a6700 1 -- 172.21.15.57:0/1344960969 wait complete. 2021-06-25T04:55:44.433 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:55:44.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa873fff700 1 Processor -- start 2021-06-25T04:55:44.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa873fff700 1 -- start start 2021-06-25T04:55:44.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa873fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa87405d070 0x7fa8740b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa873fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87413f350 0x7fa8740aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa873fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87405cb70 con 0x7fa87405c790 2021-06-25T04:55:44.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa873fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8740ad500 con 0x7fa87405d070 2021-06-25T04:55:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa873fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa874067d30 con 0x7fa87413f350 2021-06-25T04:55:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa872ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa87405c790 0x7fa8740acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59450/0 (socket says 172.21.15.57:59450) 2021-06-25T04:55:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa872ffd700 1 -- 172.21.15.57:0/3617384135 learned_addr learned my addr 172.21.15.57:0/3617384135 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:44.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa8727fc700 1 --2- 172.21.15.57:0/3617384135 >> v2:172.21.15.87:3300/0 conn(0x7fa87405d070 0x7fa8740b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa8737fe700 1 --2- 172.21.15.57:0/3617384135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87413f350 0x7fa8740aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa871ffb700 1 -- 172.21.15.57:0/3617384135 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208643332 0 0) 0x7fa87405cb70 con 0x7fa87405c790 2021-06-25T04:55:44.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa871ffb700 1 -- 172.21.15.57:0/3617384135 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa858003260 con 0x7fa87405c790 2021-06-25T04:55:44.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa8727fc700 1 -- 172.21.15.57:0/3617384135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87413f350 msgr2=0x7fa8740aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:44.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa8727fc700 1 --2- 172.21.15.57:0/3617384135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87413f350 0x7fa8740aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa8727fc700 1 -- 172.21.15.57:0/3617384135 >> v1:172.21.15.57:6789/0 conn(0x7fa87405c790 legacy=0x7fa8740acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa8727fc700 1 -- 172.21.15.57:0/3617384135 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8740b1750 con 0x7fa87405d070 2021-06-25T04:55:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.539+0000 7fa8737fe700 1 --2- 172.21.15.57:0/3617384135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87413f350 0x7fa8740aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa8727fc700 1 --2- 172.21.15.57:0/3617384135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87405d070 0x7fa8740b10b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fa864002f70 tx=0x7fa864006df0).ready entity=mon.1 client_cookie=f8795aad6c7ecfa9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa871ffb700 1 -- 172.21.15.57:0/3617384135 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86400d4a0 con 0x7fa87405d070 2021-06-25T04:55:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa871ffb700 1 -- 172.21.15.57:0/3617384135 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa864000e90 con 0x7fa87405d070 2021-06-25T04:55:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa871ffb700 1 -- 172.21.15.57:0/3617384135 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86400d7f0 con 0x7fa87405d070 2021-06-25T04:55:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa873fff700 1 -- 172.21.15.57:0/3617384135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87405d070 msgr2=0x7fa8740b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa873fff700 1 --2- 172.21.15.57:0/3617384135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87405d070 0x7fa8740b10b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fa864002f70 tx=0x7fa864006df0).stop 2021-06-25T04:55:44.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa873fff700 1 -- 172.21.15.57:0/3617384135 shutdown_connections 2021-06-25T04:55:44.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa873fff700 1 --2- 172.21.15.57:0/3617384135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87413f350 0x7fa8740aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa873fff700 1 --2- 172.21.15.57:0/3617384135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87405d070 0x7fa8740b10b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa873fff700 1 -- 172.21.15.57:0/3617384135 >> 172.21.15.57:0/3617384135 conn(0x7fa874060140 msgr2=0x7fa8740b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:44.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa873fff700 1 -- 172.21.15.57:0/3617384135 shutdown_connections 2021-06-25T04:55:44.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa873fff700 1 -- 172.21.15.57:0/3617384135 wait complete. 2021-06-25T04:55:44.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa873fff700 1 Processor -- start 2021-06-25T04:55:44.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.543+0000 7fa873fff700 1 -- start start 2021-06-25T04:55:44.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa873fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87405c790 0x7fa874139990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa873fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87405d070 0x7fa8740b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa873fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87413f350 0x7fa8740b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa873fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8740b3840 con 0x7fa87405c790 2021-06-25T04:55:44.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa873fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa874143610 con 0x7fa87413f350 2021-06-25T04:55:44.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa873fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8741430d0 con 0x7fa87405d070 2021-06-25T04:55:44.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa872ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87405c790 0x7fa874139990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa872ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87405c790 0x7fa874139990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42238/0 (socket says 172.21.15.57:42238) 2021-06-25T04:55:44.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa872ffd700 1 -- 172.21.15.57:0/3212199038 learned_addr learned my addr 172.21.15.57:0/3212199038 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:44.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa8727fc700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87405d070 0x7fa8740b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa8737fe700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87413f350 0x7fa8740b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa872ffd700 1 -- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87405d070 msgr2=0x7fa8740b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa872ffd700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87405d070 0x7fa8740b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.598 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa872ffd700 1 -- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87413f350 msgr2=0x7fa8740b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa872ffd700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87413f350 0x7fa8740b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa872ffd700 1 -- 172.21.15.57:0/3212199038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c009470 con 0x7fa87405c790 2021-06-25T04:55:44.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa8727fc700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87405d070 0x7fa8740b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:44.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa8737fe700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87413f350 0x7fa8740b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:44.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa872ffd700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87405c790 0x7fa874139990 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fa8741437a0 tx=0x7fa868007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa863fff700 1 -- 172.21.15.57:0/3212199038 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86800ce10 con 0x7fa87405c790 2021-06-25T04:55:44.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa863fff700 1 -- 172.21.15.57:0/3212199038 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8680072e0 con 0x7fa87405c790 2021-06-25T04:55:44.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa873fff700 1 -- 172.21.15.57:0/3212199038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86400b180 con 0x7fa87405c790 2021-06-25T04:55:44.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa863fff700 1 -- 172.21.15.57:0/3212199038 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa868005800 con 0x7fa87405c790 2021-06-25T04:55:44.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.547+0000 7fa873fff700 1 -- 172.21.15.57:0/3212199038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8740b34c0 con 0x7fa87405c790 2021-06-25T04:55:44.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.551+0000 7fa873fff700 1 -- 172.21.15.57:0/3212199038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8740b3a80 con 0x7fa87405c790 2021-06-25T04:55:44.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.551+0000 7fa863fff700 1 -- 172.21.15.57:0/3212199038 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa868005960 con 0x7fa87405c790 2021-06-25T04:55:44.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.551+0000 7fa863fff700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa850055450 0x7fa850057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.551+0000 7fa863fff700 1 -- 172.21.15.57:0/3212199038 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa86806f760 con 0x7fa87405c790 2021-06-25T04:55:44.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.551+0000 7fa8727fc700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa850055450 0x7fa850057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.551+0000 7fa8727fc700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa850055450 0x7fa850057910 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fa864013000 tx=0x7fa864014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.555+0000 7fa863fff700 1 -- 172.21.15.57:0/3212199038 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa868045b40 con 0x7fa87405c790 2021-06-25T04:55:44.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.683+0000 7fa873fff700 1 -- 172.21.15.57:0/3212199038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa874057310 con 0x7fa87405c790 2021-06-25T04:55:44.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.683+0000 7fa863fff700 1 -- 172.21.15.57:0/3212199038 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa868049160 con 0x7fa87405c790 2021-06-25T04:55:44.689 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:44.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 -- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa850055450 msgr2=0x7fa850057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa850055450 0x7fa850057910 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fa864013000 tx=0x7fa864014000).stop 2021-06-25T04:55:44.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 -- 172.21.15.57:0/3212199038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87405c790 msgr2=0x7fa874139990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87405c790 0x7fa874139990 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fa8741437a0 tx=0x7fa868007aa0).stop 2021-06-25T04:55:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 -- 172.21.15.57:0/3212199038 shutdown_connections 2021-06-25T04:55:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa850055450 0x7fa850057910 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87413f350 0x7fa8740b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa87405d070 0x7fa8740b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 --2- 172.21.15.57:0/3212199038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87405c790 0x7fa874139990 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 -- 172.21.15.57:0/3212199038 >> 172.21.15.57:0/3212199038 conn(0x7fa874060140 msgr2=0x7fa87405bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:44.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 -- 172.21.15.57:0/3212199038 shutdown_connections 2021-06-25T04:55:44.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.687+0000 7fa873fff700 1 -- 172.21.15.57:0/3212199038 wait complete. 2021-06-25T04:55:44.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:55:44.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.799+0000 7f5bfdda2700 1 Processor -- start 2021-06-25T04:55:44.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.799+0000 7f5bfdda2700 1 -- start start 2021-06-25T04:55:44.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.799+0000 7f5bfdda2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf80b5460 0x7f5bf80af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.799+0000 7f5bfdda2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5bf80b05d0 0x7f5bf8147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.799+0000 7f5bfdda2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf80b5840 con 0x7f5bf8067560 2021-06-25T04:55:44.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.799+0000 7f5bfdda2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf81452a0 con 0x7f5bf80b05d0 2021-06-25T04:55:44.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.799+0000 7f5bfdda2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80adfb0 con 0x7f5bf80b5460 2021-06-25T04:55:44.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bf7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5bf80b05d0 0x7f5bf8147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bfd5a1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5bf8067560 0x7f5bf80acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59468/0 (socket says 172.21.15.57:59468) 2021-06-25T04:55:44.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bf7fff700 1 --2- 172.21.15.57:0/883958748 >> v2:172.21.15.57:3300/0 conn(0x7f5bf80b05d0 0x7f5bf8147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42246/0 (socket says 172.21.15.57:42246) 2021-06-25T04:55:44.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bfd5a1700 1 -- 172.21.15.57:0/883958748 learned_addr learned my addr 172.21.15.57:0/883958748 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:44.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bfcda0700 1 --2- 172.21.15.57:0/883958748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf80b5460 0x7f5bf80af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bf7fff700 1 -- 172.21.15.57:0/883958748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf80b5460 msgr2=0x7f5bf80af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:44.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bf7fff700 1 --2- 172.21.15.57:0/883958748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf80b5460 0x7f5bf80af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bf77fe700 1 -- 172.21.15.57:0/883958748 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509694376 0 0) 0x7f5bf80b5840 con 0x7f5bf8067560 2021-06-25T04:55:44.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bf7fff700 1 -- 172.21.15.57:0/883958748 >> v1:172.21.15.57:6789/0 conn(0x7f5bf8067560 legacy=0x7f5bf80acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bf7fff700 1 -- 172.21.15.57:0/883958748 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf80ac7c0 con 0x7f5bf80b05d0 2021-06-25T04:55:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bf7fff700 1 --2- 172.21.15.57:0/883958748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bf80b05d0 0x7f5bf8147560 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f5be8002f70 tx=0x7f5be8006df0).ready entity=mon.0 client_cookie=b855b6fa256bde2f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bf77fe700 1 -- 172.21.15.57:0/883958748 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5be800d570 con 0x7f5bf80b05d0 2021-06-25T04:55:44.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bf77fe700 1 -- 172.21.15.57:0/883958748 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be8000e90 con 0x7f5bf80b05d0 2021-06-25T04:55:44.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bfdda2700 1 -- 172.21.15.57:0/883958748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bf80b05d0 msgr2=0x7f5bf8147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bf77fe700 1 -- 172.21.15.57:0/883958748 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5be800d8c0 con 0x7f5bf80b05d0 2021-06-25T04:55:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bfdda2700 1 --2- 172.21.15.57:0/883958748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bf80b05d0 0x7f5bf8147560 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f5be8002f70 tx=0x7f5be8006df0).stop 2021-06-25T04:55:44.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bfdda2700 1 -- 172.21.15.57:0/883958748 shutdown_connections 2021-06-25T04:55:44.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bfdda2700 1 --2- 172.21.15.57:0/883958748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bf80b05d0 0x7f5bf8147560 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bfdda2700 1 --2- 172.21.15.57:0/883958748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf80b5460 0x7f5bf80af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bfdda2700 1 -- 172.21.15.57:0/883958748 >> 172.21.15.57:0/883958748 conn(0x7f5bf8062520 msgr2=0x7f5bf8062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:44.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bfdda2700 1 -- 172.21.15.57:0/883958748 shutdown_connections 2021-06-25T04:55:44.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.803+0000 7f5bfdda2700 1 -- 172.21.15.57:0/883958748 wait complete. 2021-06-25T04:55:44.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfdda2700 1 Processor -- start 2021-06-25T04:55:44.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfdda2700 1 -- start start 2021-06-25T04:55:44.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfdda2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bf8067560 0x7f5bf8141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfdda2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf80b05d0 0x7f5bf80b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfdda2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf80b5460 0x7f5bf81567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfdda2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf81464a0 con 0x7f5bf8067560 2021-06-25T04:55:44.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfdda2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf815a8f0 con 0x7f5bf80b05d0 2021-06-25T04:55:44.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfdda2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8063200 con 0x7f5bf80b5460 2021-06-25T04:55:44.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfcda0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bf8067560 0x7f5bf8141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfcda0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bf8067560 0x7f5bf8141240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42252/0 (socket says 172.21.15.57:42252) 2021-06-25T04:55:44.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfcda0700 1 -- 172.21.15.57:0/3931199664 learned_addr learned my addr 172.21.15.57:0/3931199664 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:44.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfd5a1700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf80b5460 0x7f5bf81567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bf7fff700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf80b05d0 0x7f5bf80b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfcda0700 1 -- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf80b5460 msgr2=0x7f5bf81567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfcda0700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf80b5460 0x7f5bf81567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfcda0700 1 -- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf80b05d0 msgr2=0x7f5bf80b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfcda0700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf80b05d0 0x7f5bf80b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfcda0700 1 -- 172.21.15.57:0/3931199664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be800b180 con 0x7f5bf8067560 2021-06-25T04:55:44.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfcda0700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bf8067560 0x7f5bf8141240 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f5bf814d520 tx=0x7f5bec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bf5ffb700 1 -- 172.21.15.57:0/3931199664 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bec010780 con 0x7f5bf8067560 2021-06-25T04:55:44.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bf5ffb700 1 -- 172.21.15.57:0/3931199664 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec0108e0 con 0x7f5bf8067560 2021-06-25T04:55:44.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfdda2700 1 -- 172.21.15.57:0/3931199664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf8141730 con 0x7f5bf8067560 2021-06-25T04:55:44.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bf5ffb700 1 -- 172.21.15.57:0/3931199664 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bec010c40 con 0x7f5bf8067560 2021-06-25T04:55:44.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.807+0000 7f5bfdda2700 1 -- 172.21.15.57:0/3931199664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf8063430 con 0x7f5bf8067560 2021-06-25T04:55:44.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.811+0000 7f5bfdda2700 1 -- 172.21.15.57:0/3931199664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf8156500 con 0x7f5bf8067560 2021-06-25T04:55:44.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.811+0000 7f5bf5ffb700 1 -- 172.21.15.57:0/3931199664 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5bec01c460 con 0x7f5bf8067560 2021-06-25T04:55:44.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.811+0000 7f5bf5ffb700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bd8055490 0x7f5bd8057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:44.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.811+0000 7f5bf5ffb700 1 -- 172.21.15.57:0/3931199664 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f5bec06dd40 con 0x7f5bf8067560 2021-06-25T04:55:44.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.811+0000 7f5bf7fff700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bd8055490 0x7f5bd8057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:44.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.811+0000 7f5bf7fff700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bd8055490 0x7f5bd8057950 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f5be8019000 tx=0x7f5be8014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:44.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.819+0000 7f5bf5ffb700 1 -- 172.21.15.57:0/3931199664 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5bf8156500 con 0x7f5bf8067560 2021-06-25T04:55:44.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.947+0000 7f5bfdda2700 1 -- 172.21.15.57:0/3931199664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5bf8057310 con 0x7f5bf8067560 2021-06-25T04:55:44.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bf5ffb700 1 -- 172.21.15.57:0/3931199664 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v113) v1 ==== 84+0+143 (secure 0 0 0) 0x7f5bec044280 con 0x7f5bf8067560 2021-06-25T04:55:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:44.958 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:55:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:55:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:55:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:55:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:55:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:55:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:55:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:55:44.964 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:55:44.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 -- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bd8055490 msgr2=0x7f5bd8057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bd8055490 0x7f5bd8057950 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f5be8019000 tx=0x7f5be8014000).stop 2021-06-25T04:55:44.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 -- 172.21.15.57:0/3931199664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bf8067560 msgr2=0x7f5bf8141240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bf8067560 0x7f5bf8141240 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f5bf814d520 tx=0x7f5bec006df0).stop 2021-06-25T04:55:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 -- 172.21.15.57:0/3931199664 shutdown_connections 2021-06-25T04:55:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bd8055490 0x7f5bd8057950 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf80b5460 0x7f5bf81567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf80b05d0 0x7f5bf80b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 --2- 172.21.15.57:0/3931199664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bf8067560 0x7f5bf8141240 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:44.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 -- 172.21.15.57:0/3931199664 >> 172.21.15.57:0/3931199664 conn(0x7f5bf8062520 msgr2=0x7f5bf80ad670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:44.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 -- 172.21.15.57:0/3931199664 shutdown_connections 2021-06-25T04:55:44.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:44.951+0000 7f5bfdda2700 1 -- 172.21.15.57:0/3931199664 wait complete. 2021-06-25T04:55:44.975 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:55:44.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:55:45.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f9614a3f700 1 Processor -- start 2021-06-25T04:55:45.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f9614a3f700 1 -- start start 2021-06-25T04:55:45.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f9614a3f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f96100b00a0 0x7f9610142e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:45.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f9614a3f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9610067840 con 0x7f96100b2540 2021-06-25T04:55:45.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f9614a3f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9610067ae0 con 0x7f96100ac6b0 2021-06-25T04:55:45.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f9614a3f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96100ad570 con 0x7f96100b00a0 2021-06-25T04:55:45.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f960f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f96100b2540 0x7f9610140010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59478/0 (socket says 172.21.15.57:59478) 2021-06-25T04:55:45.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f960f7fe700 1 -- 172.21.15.57:0/2106967503 learned_addr learned my addr 172.21.15.57:0/2106967503 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:45.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f960effd700 1 --2- 172.21.15.57:0/2106967503 >> v2:172.21.15.87:3300/0 conn(0x7f96100b00a0 0x7f9610142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:45.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f960e7fc700 1 -- 172.21.15.57:0/2106967503 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563040494 0 0) 0x7f9610067840 con 0x7f96100b2540 2021-06-25T04:55:45.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f960e7fc700 1 -- 172.21.15.57:0/2106967503 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95fc003260 con 0x7f96100b2540 2021-06-25T04:55:45.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f960effd700 1 -- 172.21.15.57:0/2106967503 >> v1:172.21.15.87:6789/0 conn(0x7f96100ac6b0 legacy=0x7f9610143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:45.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f960effd700 1 -- 172.21.15.57:0/2106967503 >> v1:172.21.15.57:6789/0 conn(0x7f96100b2540 legacy=0x7f9610140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:45.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.083+0000 7f960effd700 1 -- 172.21.15.57:0/2106967503 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610146f90 con 0x7f96100b00a0 2021-06-25T04:55:45.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960effd700 1 --2- 172.21.15.57:0/2106967503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96100b00a0 0x7f9610142e30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f9600002f70 tx=0x7f9600006df0).ready entity=mon.1 client_cookie=f49eb701ed8ab9a2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:45.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960e7fc700 1 -- 172.21.15.57:0/2106967503 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f960000d5c0 con 0x7f96100b00a0 2021-06-25T04:55:45.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960e7fc700 1 -- 172.21.15.57:0/2106967503 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600000e90 con 0x7f96100b00a0 2021-06-25T04:55:45.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960e7fc700 1 -- 172.21.15.57:0/2106967503 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f960000d910 con 0x7f96100b00a0 2021-06-25T04:55:45.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 -- 172.21.15.57:0/2106967503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96100b00a0 msgr2=0x7f9610142e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:45.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 --2- 172.21.15.57:0/2106967503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96100b00a0 0x7f9610142e30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f9600002f70 tx=0x7f9600006df0).stop 2021-06-25T04:55:45.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 -- 172.21.15.57:0/2106967503 shutdown_connections 2021-06-25T04:55:45.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 --2- 172.21.15.57:0/2106967503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96100b00a0 0x7f9610142e30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 -- 172.21.15.57:0/2106967503 >> 172.21.15.57:0/2106967503 conn(0x7f9610060140 msgr2=0x7f96100b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:45.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 -- 172.21.15.57:0/2106967503 shutdown_connections 2021-06-25T04:55:45.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 -- 172.21.15.57:0/2106967503 wait complete. 2021-06-25T04:55:45.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 Processor -- start 2021-06-25T04:55:45.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 -- start start 2021-06-25T04:55:45.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96100ac6b0 0x7f9610145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:45.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96100b00a0 0x7f9610155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:45.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96100b2540 0x7f9610155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:45.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9610156150 con 0x7f96100b00a0 2021-06-25T04:55:45.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96101422c0 con 0x7f96100b2540 2021-06-25T04:55:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f9614a3f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9610143aa0 con 0x7f96100ac6b0 2021-06-25T04:55:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96100b00a0 0x7f9610155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:45.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96100b00a0 0x7f9610155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42268/0 (socket says 172.21.15.57:42268) 2021-06-25T04:55:45.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960effd700 1 -- 172.21.15.57:0/3585314975 learned_addr learned my addr 172.21.15.57:0/3585314975 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960f7fe700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96100ac6b0 0x7f9610145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960ffff700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96100b2540 0x7f9610155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:45.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960effd700 1 -- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96100ac6b0 msgr2=0x7f9610145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:45.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960effd700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96100ac6b0 0x7f9610145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960effd700 1 -- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96100b2540 msgr2=0x7f9610155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:45.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960effd700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96100b2540 0x7f9610155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960effd700 1 -- 172.21.15.57:0/3585314975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960000b180 con 0x7f96100b00a0 2021-06-25T04:55:45.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.087+0000 7f960ffff700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96100b2540 0x7f9610155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:45.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.091+0000 7f960effd700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96100b00a0 0x7f9610155770 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f9600002f70 tx=0x7f9600014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:45.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.091+0000 7f960cff9700 1 -- 172.21.15.57:0/3585314975 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f960000de40 con 0x7f96100b00a0 2021-06-25T04:55:45.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.091+0000 7f960cff9700 1 -- 172.21.15.57:0/3585314975 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960001f480 con 0x7f96100b00a0 2021-06-25T04:55:45.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.091+0000 7f9614a3f700 1 -- 172.21.15.57:0/3585314975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96100abcf0 con 0x7f96100b00a0 2021-06-25T04:55:45.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.091+0000 7f960cff9700 1 -- 172.21.15.57:0/3585314975 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f960001f7e0 con 0x7f96100b00a0 2021-06-25T04:55:45.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.091+0000 7f9614a3f700 1 -- 172.21.15.57:0/3585314975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96100ac190 con 0x7f96100b00a0 2021-06-25T04:55:45.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.091+0000 7f9614a3f700 1 -- 172.21.15.57:0/3585314975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96100abb30 con 0x7f96100b00a0 2021-06-25T04:55:45.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.091+0000 7f960cff9700 1 -- 172.21.15.57:0/3585314975 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9600026070 con 0x7f96100b00a0 2021-06-25T04:55:45.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.091+0000 7f960cff9700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95f0055360 0x7f95f0057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:45.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.095+0000 7f960cff9700 1 -- 172.21.15.57:0/3585314975 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f960006e800 con 0x7f96100b00a0 2021-06-25T04:55:45.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.095+0000 7f960f7fe700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95f0055360 0x7f95f0057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:45.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.095+0000 7f960f7fe700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95f0055360 0x7f95f0057820 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f960400b000 tx=0x7f9604009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:45.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.099+0000 7f960cff9700 1 -- 172.21.15.57:0/3585314975 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9600044cf0 con 0x7f96100b00a0 2021-06-25T04:55:45.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.223+0000 7f9614a3f700 1 -- 172.21.15.57:0/3585314975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f96100abe80 con 0x7f96100b00a0 2021-06-25T04:55:45.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.771+0000 7f960cff9700 1 -- 172.21.15.57:0/3585314975 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v114) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9600048310 con 0x7f96100b00a0 2021-06-25T04:55:45.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 -- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95f0055360 msgr2=0x7f95f0057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:45.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95f0055360 0x7f95f0057820 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f960400b000 tx=0x7f9604009040).stop 2021-06-25T04:55:45.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 -- 172.21.15.57:0/3585314975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96100b00a0 msgr2=0x7f9610155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:45.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96100b00a0 0x7f9610155770 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f9600002f70 tx=0x7f9600014000).stop 2021-06-25T04:55:45.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 -- 172.21.15.57:0/3585314975 shutdown_connections 2021-06-25T04:55:45.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f95f0055360 0x7f95f0057820 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96100b2540 0x7f9610155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96100b00a0 0x7f9610155770 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 --2- 172.21.15.57:0/3585314975 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96100ac6b0 0x7f9610145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 -- 172.21.15.57:0/3585314975 >> 172.21.15.57:0/3585314975 conn(0x7f9610060140 msgr2=0x7f96101461b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:45.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 -- 172.21.15.57:0/3585314975 shutdown_connections 2021-06-25T04:55:45.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.775+0000 7f9614a3f700 1 -- 172.21.15.57:0/3585314975 wait complete. 2021-06-25T04:55:45.783 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:55:45.796 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:55:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.903+0000 7f96aee6c700 1 Processor -- start 2021-06-25T04:55:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.903+0000 7f96aee6c700 1 -- start start 2021-06-25T04:55:45.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.903+0000 7f96aee6c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f96a80b4140 0x7f96a8140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:45.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.903+0000 7f96aee6c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96a80b4650 0x7f96a80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:45.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.903+0000 7f96aee6c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a8143b20 con 0x7f96a8146910 2021-06-25T04:55:45.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.903+0000 7f96aee6c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a81474d0 con 0x7f96a80b4140 2021-06-25T04:55:45.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.903+0000 7f96aee6c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a8143dc0 con 0x7f96a80b4650 2021-06-25T04:55:45.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.903+0000 7f96acc08700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f96a8146910 0x7f96a81401f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59492/0 (socket says 172.21.15.57:59492) 2021-06-25T04:55:45.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.903+0000 7f96acc08700 1 -- 172.21.15.57:0/1231137198 learned_addr learned my addr 172.21.15.57:0/1231137198 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:45.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.903+0000 7f96a7fff700 1 --2- 172.21.15.57:0/1231137198 >> v2:172.21.15.87:3300/0 conn(0x7f96a80b4140 0x7f96a8140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:45.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.903+0000 7f96ad409700 1 --2- 172.21.15.57:0/1231137198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96a80b4650 0x7f96a80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:45.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96a77fe700 1 -- 172.21.15.57:0/1231137198 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759925979 0 0) 0x7f96a8143b20 con 0x7f96a8146910 2021-06-25T04:55:45.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96a77fe700 1 -- 172.21.15.57:0/1231137198 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9694003260 con 0x7f96a8146910 2021-06-25T04:55:45.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96a7fff700 1 -- 172.21.15.57:0/1231137198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96a80b4650 msgr2=0x7f96a80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:45.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96a7fff700 1 --2- 172.21.15.57:0/1231137198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96a80b4650 0x7f96a80b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96a7fff700 1 -- 172.21.15.57:0/1231137198 >> v1:172.21.15.57:6789/0 conn(0x7f96a8146910 legacy=0x7f96a81401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:45.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96a7fff700 1 -- 172.21.15.57:0/1231137198 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a80b0c50 con 0x7f96a80b4140 2021-06-25T04:55:45.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96a7fff700 1 --2- 172.21.15.57:0/1231137198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a80b4140 0x7f96a8140900 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f969c002f70 tx=0x7f969c006df0).ready entity=mon.1 client_cookie=68ae81530ea08e9d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:45.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96a77fe700 1 -- 172.21.15.57:0/1231137198 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969c00d4a0 con 0x7f96a80b4140 2021-06-25T04:55:45.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96a77fe700 1 -- 172.21.15.57:0/1231137198 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c000e90 con 0x7f96a80b4140 2021-06-25T04:55:45.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96a77fe700 1 -- 172.21.15.57:0/1231137198 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969c00d7f0 con 0x7f96a80b4140 2021-06-25T04:55:45.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96aee6c700 1 -- 172.21.15.57:0/1231137198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a80b4140 msgr2=0x7f96a8140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:45.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96aee6c700 1 --2- 172.21.15.57:0/1231137198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a80b4140 0x7f96a8140900 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f969c002f70 tx=0x7f969c006df0).stop 2021-06-25T04:55:45.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96aee6c700 1 -- 172.21.15.57:0/1231137198 shutdown_connections 2021-06-25T04:55:45.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96aee6c700 1 --2- 172.21.15.57:0/1231137198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96a80b4650 0x7f96a80b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96aee6c700 1 --2- 172.21.15.57:0/1231137198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a80b4140 0x7f96a8140900 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96aee6c700 1 -- 172.21.15.57:0/1231137198 >> 172.21.15.57:0/1231137198 conn(0x7f96a805c450 msgr2=0x7f96a805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:45.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96aee6c700 1 -- 172.21.15.57:0/1231137198 shutdown_connections 2021-06-25T04:55:45.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96aee6c700 1 -- 172.21.15.57:0/1231137198 wait complete. 2021-06-25T04:55:45.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96aee6c700 1 Processor -- start 2021-06-25T04:55:45.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.907+0000 7f96aee6c700 1 -- start start 2021-06-25T04:55:45.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96aee6c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96a80b4140 0x7f96a80b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:45.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96aee6c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a80b4650 0x7f96a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:45.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96aee6c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a8146910 0x7f96a80af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96aee6c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80b6b00 con 0x7f96a8146910 2021-06-25T04:55:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96aee6c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80ae2c0 con 0x7f96a80b4650 2021-06-25T04:55:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96aee6c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80b9080 con 0x7f96a80b4140 2021-06-25T04:55:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96ad409700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a8146910 0x7f96a80af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96ad409700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a8146910 0x7f96a80af950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42284/0 (socket says 172.21.15.57:42284) 2021-06-25T04:55:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96ad409700 1 -- 172.21.15.57:0/689452962 learned_addr learned my addr 172.21.15.57:0/689452962 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96acc08700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96a80b4140 0x7f96a80b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96a7fff700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a80b4650 0x7f96a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96ad409700 1 -- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96a80b4140 msgr2=0x7f96a80b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:45.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96ad409700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96a80b4140 0x7f96a80b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96ad409700 1 -- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a80b4650 msgr2=0x7f96a80b8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:45.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96ad409700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a80b4650 0x7f96a80b8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:45.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96ad409700 1 -- 172.21.15.57:0/689452962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c00b180 con 0x7f96a8146910 2021-06-25T04:55:45.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96ad409700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a8146910 0x7f96a80af950 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f96a80b6c40 tx=0x7f9698006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:45.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96a5ffb700 1 -- 172.21.15.57:0/689452962 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9698010780 con 0x7f96a8146910 2021-06-25T04:55:45.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96a5ffb700 1 -- 172.21.15.57:0/689452962 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96980108e0 con 0x7f96a8146910 2021-06-25T04:55:45.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96aee6c700 1 -- 172.21.15.57:0/689452962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a8152ef0 con 0x7f96a8146910 2021-06-25T04:55:45.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96a5ffb700 1 -- 172.21.15.57:0/689452962 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9698010c40 con 0x7f96a8146910 2021-06-25T04:55:45.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.911+0000 7f96aee6c700 1 -- 172.21.15.57:0/689452962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a80adf40 con 0x7f96a8146910 2021-06-25T04:55:45.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.915+0000 7f96a5ffb700 1 -- 172.21.15.57:0/689452962 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f969801c460 con 0x7f96a8146910 2021-06-25T04:55:45.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.915+0000 7f96aee6c700 1 -- 172.21.15.57:0/689452962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a80b9240 con 0x7f96a8146910 2021-06-25T04:55:45.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.915+0000 7f96a5ffb700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9688055450 0x7f9688057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:45.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.915+0000 7f96a5ffb700 1 -- 172.21.15.57:0/689452962 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f969806df70 con 0x7f96a8146910 2021-06-25T04:55:45.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.915+0000 7f96acc08700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9688055450 0x7f9688057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:45.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.915+0000 7f96acc08700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9688055450 0x7f9688057910 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f96a000d000 tx=0x7f96a0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:45.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:45.919+0000 7f96a5ffb700 1 -- 172.21.15.57:0/689452962 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f96a80b9240 con 0x7f96a8146910 2021-06-25T04:55:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.047+0000 7f96aee6c700 1 -- 172.21.15.57:0/689452962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f96a80b9240 con 0x7f96a8146910 2021-06-25T04:55:46.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.503+0000 7f96a5ffb700 1 -- 172.21.15.57:0/689452962 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v115) v1 ==== 125+0+0 (secure 0 0 0) 0x7f96a80b9240 con 0x7f96a8146910 2021-06-25T04:55:46.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.507+0000 7f96aee6c700 1 -- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9688055450 msgr2=0x7f9688057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.507+0000 7f96aee6c700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9688055450 0x7f9688057910 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f96a000d000 tx=0x7f96a0009040).stop 2021-06-25T04:55:46.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.507+0000 7f96aee6c700 1 -- 172.21.15.57:0/689452962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a8146910 msgr2=0x7f96a80af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.507+0000 7f96aee6c700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a8146910 0x7f96a80af950 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f96a80b6c40 tx=0x7f9698006df0).stop 2021-06-25T04:55:46.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.507+0000 7f96aee6c700 1 -- 172.21.15.57:0/689452962 shutdown_connections 2021-06-25T04:55:46.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.507+0000 7f96aee6c700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9688055450 0x7f9688057910 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.507+0000 7f96aee6c700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a8146910 0x7f96a80af950 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.507+0000 7f96aee6c700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a80b4650 0x7f96a80b8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.507+0000 7f96aee6c700 1 --2- 172.21.15.57:0/689452962 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96a80b4140 0x7f96a80b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.507+0000 7f96aee6c700 1 -- 172.21.15.57:0/689452962 >> 172.21.15.57:0/689452962 conn(0x7f96a805c450 msgr2=0x7f96a8140e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:46.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.507+0000 7f96aee6c700 1 -- 172.21.15.57:0/689452962 shutdown_connections 2021-06-25T04:55:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.511+0000 7f96aee6c700 1 -- 172.21.15.57:0/689452962 wait complete. 2021-06-25T04:55:46.518 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:55:46.533 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:55:46.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.635+0000 7f04af59e700 1 Processor -- start 2021-06-25T04:55:46.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.635+0000 7f04af59e700 1 -- start start 2021-06-25T04:55:46.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b00ad830 0x7f04b00b5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04b00b13f0 0x7f04b0066fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b00acdd0 con 0x7f04b00ac9f0 2021-06-25T04:55:46.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00b5120 con 0x7f04b00b13f0 2021-06-25T04:55:46.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00adea0 con 0x7f04b00ad830 2021-06-25T04:55:46.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04aed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04b00b13f0 0x7f04b0066fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04aed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04b00b13f0 0x7f04b0066fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42292/0 (socket says 172.21.15.57:42292) 2021-06-25T04:55:46.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04aed9d700 1 -- 172.21.15.57:0/1344282480 learned_addr learned my addr 172.21.15.57:0/1344282480 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:46.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04add9b700 1 --2- 172.21.15.57:0/1344282480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b00ad830 0x7f04b00b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04aed9d700 1 -- 172.21.15.57:0/1344282480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b00ad830 msgr2=0x7f04b00b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:46.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04aed9d700 1 --2- 172.21.15.57:0/1344282480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b00ad830 0x7f04b00b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04aed9d700 1 -- 172.21.15.57:0/1344282480 >> v1:172.21.15.87:6789/0 conn(0x7f04b00ac9f0 legacy=0x7f04b0143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04aed9d700 1 -- 172.21.15.57:0/1344282480 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00ae140 con 0x7f04b00b13f0 2021-06-25T04:55:46.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04aed9d700 1 --2- 172.21.15.57:0/1344282480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04b00b13f0 0x7f04b0066fc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f04a80032f0 tx=0x7f04a8009290).ready entity=mon.0 client_cookie=c0c0db2fe7ec006f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:46.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04ad59a700 1 -- 172.21.15.57:0/1344282480 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04a800ba90 con 0x7f04b00b13f0 2021-06-25T04:55:46.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04ad59a700 1 -- 172.21.15.57:0/1344282480 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a800bbf0 con 0x7f04b00b13f0 2021-06-25T04:55:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04ad59a700 1 -- 172.21.15.57:0/1344282480 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04a8010470 con 0x7f04b00b13f0 2021-06-25T04:55:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 -- 172.21.15.57:0/1344282480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04b00b13f0 msgr2=0x7f04b0066fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 --2- 172.21.15.57:0/1344282480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04b00b13f0 0x7f04b0066fc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f04a80032f0 tx=0x7f04a8009290).stop 2021-06-25T04:55:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 -- 172.21.15.57:0/1344282480 shutdown_connections 2021-06-25T04:55:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 --2- 172.21.15.57:0/1344282480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04b00b13f0 0x7f04b0066fc0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 --2- 172.21.15.57:0/1344282480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b00ad830 0x7f04b00b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 -- 172.21.15.57:0/1344282480 >> 172.21.15.57:0/1344282480 conn(0x7f04b0062520 msgr2=0x7f04b0062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 -- 172.21.15.57:0/1344282480 shutdown_connections 2021-06-25T04:55:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.639+0000 7f04af59e700 1 -- 172.21.15.57:0/1344282480 wait complete. 2021-06-25T04:55:46.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04af59e700 1 Processor -- start 2021-06-25T04:55:46.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04af59e700 1 -- start start 2021-06-25T04:55:46.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04af59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b00ac9f0 0x7f04b013dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04af59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b00ad830 0x7f04b0066b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04af59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04b00b13f0 0x7f04b013c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04af59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00660b0 con 0x7f04b00b13f0 2021-06-25T04:55:46.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04af59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0063fa0 con 0x7f04b00ad830 2021-06-25T04:55:46.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04af59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0152000 con 0x7f04b00ac9f0 2021-06-25T04:55:46.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04aed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04b00b13f0 0x7f04b013c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04aed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04b00b13f0 0x7f04b013c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42298/0 (socket says 172.21.15.57:42298) 2021-06-25T04:55:46.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04add9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b00ad830 0x7f04b0066b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04aed9d700 1 -- 172.21.15.57:0/2479747361 learned_addr learned my addr 172.21.15.57:0/2479747361 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:46.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04ae59c700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b00ac9f0 0x7f04b013dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04aed9d700 1 -- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b00ac9f0 msgr2=0x7f04b013dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04aed9d700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b00ac9f0 0x7f04b013dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04aed9d700 1 -- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b00ad830 msgr2=0x7f04b0066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04aed9d700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b00ad830 0x7f04b0066b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04aed9d700 1 -- 172.21.15.57:0/2479747361 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a8009530 con 0x7f04b00b13f0 2021-06-25T04:55:46.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04add9b700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b00ad830 0x7f04b0066b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:46.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04aed9d700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04b00b13f0 0x7f04b013c800 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f04a80032f0 tx=0x7f04a8018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:46.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f049f7fe700 1 -- 172.21.15.57:0/2479747361 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04a801e070 con 0x7f04b00b13f0 2021-06-25T04:55:46.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f049f7fe700 1 -- 172.21.15.57:0/2479747361 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8010c30 con 0x7f04b00b13f0 2021-06-25T04:55:46.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04af59e700 1 -- 172.21.15.57:0/2479747361 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b01522a0 con 0x7f04b00b13f0 2021-06-25T04:55:46.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f049f7fe700 1 -- 172.21.15.57:0/2479747361 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04a8018400 con 0x7f04b00b13f0 2021-06-25T04:55:46.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.643+0000 7f04af59e700 1 -- 172.21.15.57:0/2479747361 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b00b4480 con 0x7f04b00b13f0 2021-06-25T04:55:46.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.647+0000 7f04af59e700 1 -- 172.21.15.57:0/2479747361 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b0067220 con 0x7f04b00b13f0 2021-06-25T04:55:46.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.647+0000 7f049f7fe700 1 -- 172.21.15.57:0/2479747361 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f04a8018560 con 0x7f04b00b13f0 2021-06-25T04:55:46.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.647+0000 7f049f7fe700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f048c055450 0x7f048c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.647+0000 7f049f7fe700 1 -- 172.21.15.57:0/2479747361 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f04a80718d0 con 0x7f04b00b13f0 2021-06-25T04:55:46.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.647+0000 7f04ae59c700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f048c055450 0x7f048c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.651+0000 7f04ae59c700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f048c055450 0x7f048c057910 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f04a400d000 tx=0x7f04a4007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:46.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.655+0000 7f049f7fe700 1 -- 172.21.15.57:0/2479747361 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f04a8047a80 con 0x7f04b00b13f0 2021-06-25T04:55:46.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.823+0000 7f04af59e700 1 -- 172.21.15.57:0/2479747361 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f04b0057310 con 0x7f04b00b13f0 2021-06-25T04:55:46.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.835+0000 7f049f7fe700 1 -- 172.21.15.57:0/2479747361 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v58) v1 ==== 189+0+0 (secure 0 0 0) 0x7f04a804b0a0 con 0x7f04b00b13f0 2021-06-25T04:55:46.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 -- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f048c055450 msgr2=0x7f048c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f048c055450 0x7f048c057910 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f04a400d000 tx=0x7f04a4007b90).stop 2021-06-25T04:55:46.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 -- 172.21.15.57:0/2479747361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04b00b13f0 msgr2=0x7f04b013c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04b00b13f0 0x7f04b013c800 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f04a80032f0 tx=0x7f04a8018000).stop 2021-06-25T04:55:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 -- 172.21.15.57:0/2479747361 shutdown_connections 2021-06-25T04:55:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f048c055450 0x7f048c057910 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04b00b13f0 0x7f04b013c800 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b00ad830 0x7f04b0066b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 --2- 172.21.15.57:0/2479747361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b00ac9f0 0x7f04b013dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 -- 172.21.15.57:0/2479747361 >> 172.21.15.57:0/2479747361 conn(0x7f04b0062520 msgr2=0x7f04b0067440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:46.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 -- 172.21.15.57:0/2479747361 shutdown_connections 2021-06-25T04:55:46.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.839+0000 7f04af59e700 1 -- 172.21.15.57:0/2479747361 wait complete. 2021-06-25T04:55:46.849 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 21 and data pool 22 2021-06-25T04:55:46.861 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:46.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f0366e1b700 1 Processor -- start 2021-06-25T04:55:46.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f0366e1b700 1 -- start start 2021-06-25T04:55:46.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f0366e1b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0360140ee0 0x7f0360066de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f0366e1b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03600b1f10 0x7f03600672d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f0366e1b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03601445c0 con 0x7f0360066a00 2021-06-25T04:55:46.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f0366e1b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0360141f30 con 0x7f03600b1f10 2021-06-25T04:55:46.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f0366e1b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03600b42a0 con 0x7f0360140ee0 2021-06-25T04:55:46.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f03653b8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03600b1f10 0x7f03600672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f0364bb7700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0360066a00 0x7f036013e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59534/0 (socket says 172.21.15.57:59534) 2021-06-25T04:55:46.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f03653b8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03600b1f10 0x7f03600672d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42320/0 (socket says 172.21.15.57:42320) 2021-06-25T04:55:46.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f0364bb7700 1 -- 172.21.15.57:0/3489205282 learned_addr learned my addr 172.21.15.57:0/3489205282 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:46.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f035ffff700 1 --2- 172.21.15.57:0/3489205282 >> v2:172.21.15.87:3300/0 conn(0x7f0360140ee0 0x7f0360066de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f03653b8700 1 -- 172.21.15.57:0/3489205282 >> v2:172.21.15.87:3300/0 conn(0x7f0360140ee0 msgr2=0x7f0360066de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:46.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f03653b8700 1 --2- 172.21.15.57:0/3489205282 >> v2:172.21.15.87:3300/0 conn(0x7f0360140ee0 0x7f0360066de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f035f7fe700 1 -- 172.21.15.57:0/3489205282 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737830134 0 0) 0x7f03601445c0 con 0x7f0360066a00 2021-06-25T04:55:46.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f03653b8700 1 -- 172.21.15.57:0/3489205282 >> v1:172.21.15.57:6789/0 conn(0x7f0360066a00 legacy=0x7f036013e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f03653b8700 1 -- 172.21.15.57:0/3489205282 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03600aaf10 con 0x7f03600b1f10 2021-06-25T04:55:46.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f03653b8700 1 --2- 172.21.15.57:0/3489205282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03600b1f10 0x7f03600672d0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f03580032f0 tx=0x7f03580091d0).ready entity=mon.0 client_cookie=d3f6a237fa50f619 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f035f7fe700 1 -- 172.21.15.57:0/3489205282 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f035800b680 con 0x7f03600b1f10 2021-06-25T04:55:46.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f035f7fe700 1 -- 172.21.15.57:0/3489205282 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035800b7e0 con 0x7f03600b1f10 2021-06-25T04:55:46.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f035f7fe700 1 -- 172.21.15.57:0/3489205282 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f035800b950 con 0x7f03600b1f10 2021-06-25T04:55:46.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f0366e1b700 1 -- 172.21.15.57:0/3489205282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03600b1f10 msgr2=0x7f03600672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.955+0000 7f0366e1b700 1 --2- 172.21.15.57:0/3489205282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03600b1f10 0x7f03600672d0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f03580032f0 tx=0x7f03580091d0).stop 2021-06-25T04:55:46.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 -- 172.21.15.57:0/3489205282 shutdown_connections 2021-06-25T04:55:46.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 --2- 172.21.15.57:0/3489205282 >> v2:172.21.15.87:3300/0 conn(0x7f0360140ee0 0x7f0360066de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 --2- 172.21.15.57:0/3489205282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03600b1f10 0x7f03600672d0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 -- 172.21.15.57:0/3489205282 >> 172.21.15.57:0/3489205282 conn(0x7f036005c450 msgr2=0x7f036005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:46.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 -- 172.21.15.57:0/3489205282 shutdown_connections 2021-06-25T04:55:46.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 -- 172.21.15.57:0/3489205282 wait complete. 2021-06-25T04:55:46.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 Processor -- start 2021-06-25T04:55:46.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 -- start start 2021-06-25T04:55:46.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0360066a00 0x7f03601373e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03600b1f10 0x7f0360146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0360138260 0x7f0360147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03601398f0 con 0x7f0360066a00 2021-06-25T04:55:46.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03601456f0 con 0x7f03600b1f10 2021-06-25T04:55:46.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0366e1b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0360139b20 con 0x7f0360138260 2021-06-25T04:55:46.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0364bb7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0360066a00 0x7f03601373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0364bb7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0360066a00 0x7f03601373e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42324/0 (socket says 172.21.15.57:42324) 2021-06-25T04:55:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0364bb7700 1 -- 172.21.15.57:0/1619564631 learned_addr learned my addr 172.21.15.57:0/1619564631 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f03653b8700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0360138260 0x7f0360147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f035ffff700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03600b1f10 0x7f0360146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0364bb7700 1 -- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0360138260 msgr2=0x7f0360147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0364bb7700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0360138260 0x7f0360147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0364bb7700 1 -- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03600b1f10 msgr2=0x7f0360146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0364bb7700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03600b1f10 0x7f0360146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0364bb7700 1 -- 172.21.15.57:0/1619564631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0358009470 con 0x7f0360066a00 2021-06-25T04:55:46.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f03653b8700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0360138260 0x7f0360147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:46.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f035ffff700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03600b1f10 0x7f0360146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:46.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.959+0000 7f0364bb7700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0360066a00 0x7f03601373e0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f0354000ed0 tx=0x7f0354007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:46.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.963+0000 7f035dffb700 1 -- 172.21.15.57:0/1619564631 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f035400ce50 con 0x7f0360066a00 2021-06-25T04:55:46.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.963+0000 7f035dffb700 1 -- 172.21.15.57:0/1619564631 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03540072e0 con 0x7f0360066a00 2021-06-25T04:55:46.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.963+0000 7f0366e1b700 1 -- 172.21.15.57:0/1619564631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0360139dc0 con 0x7f0360066a00 2021-06-25T04:55:46.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.963+0000 7f035dffb700 1 -- 172.21.15.57:0/1619564631 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0354005610 con 0x7f0360066a00 2021-06-25T04:55:46.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.963+0000 7f0366e1b700 1 -- 172.21.15.57:0/1619564631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03601422e0 con 0x7f0360066a00 2021-06-25T04:55:46.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.963+0000 7f0366e1b700 1 -- 172.21.15.57:0/1619564631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0360057310 con 0x7f0360066a00 2021-06-25T04:55:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.963+0000 7f035dffb700 1 -- 172.21.15.57:0/1619564631 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f035401a060 con 0x7f0360066a00 2021-06-25T04:55:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.963+0000 7f035dffb700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f03400554e0 0x7f03400579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.967+0000 7f035dffb700 1 -- 172.21.15.57:0/1619564631 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f035406d770 con 0x7f0360066a00 2021-06-25T04:55:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.967+0000 7f035ffff700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f03400554e0 0x7f03400579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:46.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.967+0000 7f035ffff700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f03400554e0 0x7f03400579a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f035000b000 tx=0x7f0350008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:46.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:46.971+0000 7f035dffb700 1 -- 172.21.15.57:0/1619564631 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0354043920 con 0x7f0360066a00 2021-06-25T04:55:47.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.099+0000 7f0366e1b700 1 -- 172.21.15.57:0/1619564631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03600b3d20 con 0x7f0360066a00 2021-06-25T04:55:47.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.099+0000 7f035dffb700 1 -- 172.21.15.57:0/1619564631 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f0354018020 con 0x7f0360066a00 2021-06-25T04:55:47.123 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:47.124 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":117,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:46.830206+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:55:45.280146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-06-25T04:55:46.105368+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:47.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 -- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f03400554e0 msgr2=0x7f03400579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f03400554e0 0x7f03400579a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f035000b000 tx=0x7f0350008040).stop 2021-06-25T04:55:47.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 -- 172.21.15.57:0/1619564631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0360066a00 msgr2=0x7f03601373e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0360066a00 0x7f03601373e0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f0354000ed0 tx=0x7f0354007ac0).stop 2021-06-25T04:55:47.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 -- 172.21.15.57:0/1619564631 shutdown_connections 2021-06-25T04:55:47.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f03400554e0 0x7f03400579a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0360138260 0x7f0360147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03600b1f10 0x7f0360146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 --2- 172.21.15.57:0/1619564631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0360066a00 0x7f03601373e0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 -- 172.21.15.57:0/1619564631 >> 172.21.15.57:0/1619564631 conn(0x7f036005c450 msgr2=0x7f036005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:47.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 -- 172.21.15.57:0/1619564631 shutdown_connections 2021-06-25T04:55:47.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.103+0000 7f0366e1b700 1 -- 172.21.15.57:0/1619564631 wait complete. 2021-06-25T04:55:47.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.231+0000 7fa8759b6700 1 Processor -- start 2021-06-25T04:55:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.231+0000 7fa8759b6700 1 -- start start 2021-06-25T04:55:47.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa8759b6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa8700afd00 0x7fa8700b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa8759b6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8700ad560 con 0x7fa8700af920 2021-06-25T04:55:47.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa8759b6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8700ad020 con 0x7fa8700b04b0 2021-06-25T04:55:47.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa8700af920 0x7fa8700b1b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59548/0 (socket says 172.21.15.57:59548) 2021-06-25T04:55:47.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86effd700 1 -- 172.21.15.57:0/2969973326 learned_addr learned my addr 172.21.15.57:0/2969973326 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:47.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa8759b6700 1 -- 172.21.15.57:0/2969973326 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8700af420 con 0x7fa8700afd00 2021-06-25T04:55:47.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86f7fe700 1 --2- 172.21.15.57:0/2969973326 >> v2:172.21.15.87:3300/0 conn(0x7fa8700afd00 0x7fa8700b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86e7fc700 1 -- 172.21.15.57:0/2969973326 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052807099 0 0) 0x7fa8700ad560 con 0x7fa8700af920 2021-06-25T04:55:47.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86e7fc700 1 -- 172.21.15.57:0/2969973326 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa850003260 con 0x7fa8700af920 2021-06-25T04:55:47.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86e7fc700 1 -- 172.21.15.57:0/2969973326 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3379468514 0 0) 0x7fa850003260 con 0x7fa8700af920 2021-06-25T04:55:47.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86f7fe700 1 -- 172.21.15.57:0/2969973326 >> v1:172.21.15.87:6789/0 conn(0x7fa8700b04b0 legacy=0x7fa87013fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86f7fe700 1 -- 172.21.15.57:0/2969973326 >> v1:172.21.15.57:6789/0 conn(0x7fa8700af920 legacy=0x7fa8700b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86f7fe700 1 -- 172.21.15.57:0/2969973326 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8700ad2c0 con 0x7fa8700afd00 2021-06-25T04:55:47.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86f7fe700 1 --2- 172.21.15.57:0/2969973326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8700afd00 0x7fa8700b22a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fa860001800 tx=0x7fa86800a370).ready entity=mon.1 client_cookie=9dbd139bd9b2ec70 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:47.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86e7fc700 1 -- 172.21.15.57:0/2969973326 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa860001660 con 0x7fa8700afd00 2021-06-25T04:55:47.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86e7fc700 1 -- 172.21.15.57:0/2969973326 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86800c870 con 0x7fa8700afd00 2021-06-25T04:55:47.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa86e7fc700 1 -- 172.21.15.57:0/2969973326 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86800cbd0 con 0x7fa8700afd00 2021-06-25T04:55:47.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa8759b6700 1 -- 172.21.15.57:0/2969973326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8700afd00 msgr2=0x7fa8700b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa8759b6700 1 --2- 172.21.15.57:0/2969973326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8700afd00 0x7fa8700b22a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fa860001800 tx=0x7fa86800a370).stop 2021-06-25T04:55:47.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa8759b6700 1 -- 172.21.15.57:0/2969973326 shutdown_connections 2021-06-25T04:55:47.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa8759b6700 1 --2- 172.21.15.57:0/2969973326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8700afd00 0x7fa8700b22a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa8759b6700 1 -- 172.21.15.57:0/2969973326 >> 172.21.15.57:0/2969973326 conn(0x7fa87005cce0 msgr2=0x7fa870062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:47.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa8759b6700 1 -- 172.21.15.57:0/2969973326 shutdown_connections 2021-06-25T04:55:47.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.235+0000 7fa8759b6700 1 -- 172.21.15.57:0/2969973326 wait complete. 2021-06-25T04:55:47.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.239+0000 7fa8759b6700 1 Processor -- start 2021-06-25T04:55:47.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.239+0000 7fa8759b6700 1 -- start start 2021-06-25T04:55:47.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.239+0000 7fa8759b6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8700af920 0x7fa8701462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.239+0000 7fa8759b6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8700afd00 0x7fa8701536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.239+0000 7fa8759b6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8700b04b0 0x7fa870153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.239+0000 7fa8759b6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87014fdc0 con 0x7fa8700b04b0 2021-06-25T04:55:47.263 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.239+0000 7fa8759b6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700ac370 con 0x7fa8700afd00 2021-06-25T04:55:47.264 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.239+0000 7fa8759b6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700abb90 con 0x7fa8700af920 2021-06-25T04:55:47.264 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.239+0000 7fa86f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8700b04b0 0x7fa870153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.264 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8700b04b0 0x7fa870153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42340/0 (socket says 172.21.15.57:42340) 2021-06-25T04:55:47.264 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86f7fe700 1 -- 172.21.15.57:0/3513430330 learned_addr learned my addr 172.21.15.57:0/3513430330 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:47.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86effd700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8700af920 0x7fa8701462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa867fff700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8700afd00 0x7fa8701536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86f7fe700 1 -- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8700af920 msgr2=0x7fa8701462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86f7fe700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8700af920 0x7fa8701462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86f7fe700 1 -- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8700afd00 msgr2=0x7fa8701536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.266 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86f7fe700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8700afd00 0x7fa8701536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86f7fe700 1 -- 172.21.15.57:0/3513430330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86800a610 con 0x7fa8700b04b0 2021-06-25T04:55:47.267 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86f7fe700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8700b04b0 0x7fa870153b90 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fa8700ac500 tx=0x7fa8700608f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:47.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86cff9700 1 -- 172.21.15.57:0/3513430330 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa868006ea0 con 0x7fa8700b04b0 2021-06-25T04:55:47.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86cff9700 1 -- 172.21.15.57:0/3513430330 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86801a440 con 0x7fa8700b04b0 2021-06-25T04:55:47.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86cff9700 1 -- 172.21.15.57:0/3513430330 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86801a7a0 con 0x7fa8700b04b0 2021-06-25T04:55:47.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa8759b6700 1 -- 172.21.15.57:0/3513430330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8700abe30 con 0x7fa8700b04b0 2021-06-25T04:55:47.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa8759b6700 1 -- 172.21.15.57:0/3513430330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8700ab880 con 0x7fa8700b04b0 2021-06-25T04:55:47.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa8759b6700 1 -- 172.21.15.57:0/3513430330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa870057310 con 0x7fa8700b04b0 2021-06-25T04:55:47.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86cff9700 1 -- 172.21.15.57:0/3513430330 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa86800e040 con 0x7fa8700b04b0 2021-06-25T04:55:47.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86cff9700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa854055360 0x7fa854057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.243+0000 7fa86cff9700 1 -- 172.21.15.57:0/3513430330 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa86806fac0 con 0x7fa8700b04b0 2021-06-25T04:55:47.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.247+0000 7fa86effd700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa854055360 0x7fa854057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.247+0000 7fa86effd700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa854055360 0x7fa854057820 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fa86000d000 tx=0x7fa860001e90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.247+0000 7fa86cff9700 1 -- 172.21.15.57:0/3513430330 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa868045c10 con 0x7fa8700b04b0 2021-06-25T04:55:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.375+0000 7fa8759b6700 1 -- 172.21.15.57:0/3513430330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa87005d720 con 0x7fa8700b04b0 2021-06-25T04:55:47.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa86cff9700 1 -- 172.21.15.57:0/3513430330 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fa868049230 con 0x7fa8700b04b0 2021-06-25T04:55:47.383 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:47.383 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":117,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:46.830206+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:55:45.280146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-06-25T04:55:46.105368+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:47.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 -- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa854055360 msgr2=0x7fa854057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa854055360 0x7fa854057820 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fa86000d000 tx=0x7fa860001e90).stop 2021-06-25T04:55:47.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 -- 172.21.15.57:0/3513430330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8700b04b0 msgr2=0x7fa870153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8700b04b0 0x7fa870153b90 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fa8700ac500 tx=0x7fa8700608f0).stop 2021-06-25T04:55:47.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 -- 172.21.15.57:0/3513430330 shutdown_connections 2021-06-25T04:55:47.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa854055360 0x7fa854057820 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8700b04b0 0x7fa870153b90 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8700afd00 0x7fa8701536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 --2- 172.21.15.57:0/3513430330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8700af920 0x7fa8701462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 -- 172.21.15.57:0/3513430330 >> 172.21.15.57:0/3513430330 conn(0x7fa87005cce0 msgr2=0x7fa870143080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:47.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 -- 172.21.15.57:0/3513430330 shutdown_connections 2021-06-25T04:55:47.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.379+0000 7fa8759b6700 1 -- 172.21.15.57:0/3513430330 wait complete. 2021-06-25T04:55:47.398 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:55:47.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65fbc41700 1 Processor -- start 2021-06-25T04:55:47.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65fbc41700 1 -- start start 2021-06-25T04:55:47.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65fbc41700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f65f40b37b0 0x7f65f4147d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65fbc41700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65f40b4140 0x7f65f40b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65fbc41700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f40b5e00 con 0x7f65f4144660 2021-06-25T04:55:47.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65fbc41700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f40b3b90 con 0x7f65f40b37b0 2021-06-25T04:55:47.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65fbc41700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40b6030 con 0x7f65f40b4140 2021-06-25T04:55:47.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65f91dc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f65f4144660 0x7f65f4144aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59564/0 (socket says 172.21.15.57:59564) 2021-06-25T04:55:47.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65f91dc700 1 -- 172.21.15.57:0/1182821413 learned_addr learned my addr 172.21.15.57:0/1182821413 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:47.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65f99dd700 1 --2- 172.21.15.57:0/1182821413 >> v2:172.21.15.57:3300/0 conn(0x7f65f40b37b0 0x7f65f4147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65fa1de700 1 --2- 172.21.15.57:0/1182821413 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65f40b4140 0x7f65f40b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65f89db700 1 -- 172.21.15.57:0/1182821413 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939143441 0 0) 0x7f65f40b5e00 con 0x7f65f4144660 2021-06-25T04:55:47.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65f89db700 1 -- 172.21.15.57:0/1182821413 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65d8003260 con 0x7f65f4144660 2021-06-25T04:55:47.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65f99dd700 1 -- 172.21.15.57:0/1182821413 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65f40b4140 msgr2=0x7f65f40b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:47.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65f99dd700 1 --2- 172.21.15.57:0/1182821413 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65f40b4140 0x7f65f40b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65f99dd700 1 -- 172.21.15.57:0/1182821413 >> v1:172.21.15.57:6789/0 conn(0x7f65f4144660 legacy=0x7f65f4144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65f99dd700 1 -- 172.21.15.57:0/1182821413 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f40b62d0 con 0x7f65f40b37b0 2021-06-25T04:55:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.503+0000 7f65fa1de700 1 --2- 172.21.15.57:0/1182821413 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65f40b4140 0x7f65f40b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65f99dd700 1 --2- 172.21.15.57:0/1182821413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65f40b37b0 0x7f65f4147d50 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f65f0002f70 tx=0x7f65f0006df0).ready entity=mon.0 client_cookie=447fae43a31636df server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65f89db700 1 -- 172.21.15.57:0/1182821413 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65f000d4a0 con 0x7f65f40b37b0 2021-06-25T04:55:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65f89db700 1 -- 172.21.15.57:0/1182821413 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f0000e90 con 0x7f65f40b37b0 2021-06-25T04:55:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65f89db700 1 -- 172.21.15.57:0/1182821413 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65f000d7f0 con 0x7f65f40b37b0 2021-06-25T04:55:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65fbc41700 1 -- 172.21.15.57:0/1182821413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65f40b37b0 msgr2=0x7f65f4147d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65fbc41700 1 --2- 172.21.15.57:0/1182821413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65f40b37b0 0x7f65f4147d50 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f65f0002f70 tx=0x7f65f0006df0).stop 2021-06-25T04:55:47.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65fbc41700 1 -- 172.21.15.57:0/1182821413 shutdown_connections 2021-06-25T04:55:47.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65fbc41700 1 --2- 172.21.15.57:0/1182821413 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65f40b4140 0x7f65f40b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65fbc41700 1 --2- 172.21.15.57:0/1182821413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65f40b37b0 0x7f65f4147d50 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65fbc41700 1 -- 172.21.15.57:0/1182821413 >> 172.21.15.57:0/1182821413 conn(0x7f65f405c450 msgr2=0x7f65f405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:47.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65fbc41700 1 -- 172.21.15.57:0/1182821413 shutdown_connections 2021-06-25T04:55:47.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65fbc41700 1 -- 172.21.15.57:0/1182821413 wait complete. 2021-06-25T04:55:47.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65fbc41700 1 Processor -- start 2021-06-25T04:55:47.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.507+0000 7f65fbc41700 1 -- start start 2021-06-25T04:55:47.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fbc41700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65f40b37b0 0x7f65f4148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fbc41700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f40b4140 0x7f65f4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fbc41700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65f4144660 0x7f65f414a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fbc41700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4149a60 con 0x7f65f4144660 2021-06-25T04:55:47.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fbc41700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40ad890 con 0x7f65f40b4140 2021-06-25T04:55:47.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fbc41700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40afc80 con 0x7f65f40b37b0 2021-06-25T04:55:47.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fa1de700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65f4144660 0x7f65f414a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fa1de700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65f4144660 0x7f65f414a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42354/0 (socket says 172.21.15.57:42354) 2021-06-25T04:55:47.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fa1de700 1 -- 172.21.15.57:0/2867787322 learned_addr learned my addr 172.21.15.57:0/2867787322 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:47.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65f99dd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65f40b37b0 0x7f65f4148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65f91dc700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f40b4140 0x7f65f4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fa1de700 1 -- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65f40b37b0 msgr2=0x7f65f4148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fa1de700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65f40b37b0 0x7f65f4148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fa1de700 1 -- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f40b4140 msgr2=0x7f65f4156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fa1de700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f40b4140 0x7f65f4156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fa1de700 1 -- 172.21.15.57:0/2867787322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec009470 con 0x7f65f4144660 2021-06-25T04:55:47.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fa1de700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65f4144660 0x7f65f414a270 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f65f414a1c0 tx=0x7f65ec0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:47.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65e77fe700 1 -- 172.21.15.57:0/2867787322 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ec00c850 con 0x7f65f4144660 2021-06-25T04:55:47.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65e77fe700 1 -- 172.21.15.57:0/2867787322 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec00c9b0 con 0x7f65f4144660 2021-06-25T04:55:47.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fbc41700 1 -- 172.21.15.57:0/2867787322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f000b180 con 0x7f65f4144660 2021-06-25T04:55:47.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65e77fe700 1 -- 172.21.15.57:0/2867787322 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ec00cd10 con 0x7f65f4144660 2021-06-25T04:55:47.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fbc41700 1 -- 172.21.15.57:0/2867787322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f4156640 con 0x7f65f4144660 2021-06-25T04:55:47.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65fbc41700 1 -- 172.21.15.57:0/2867787322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f414a900 con 0x7f65f4144660 2021-06-25T04:55:47.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65e77fe700 1 -- 172.21.15.57:0/2867787322 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f65ec022070 con 0x7f65f4144660 2021-06-25T04:55:47.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.511+0000 7f65e77fe700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f65d0055450 0x7f65d0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.515+0000 7f65e77fe700 1 -- 172.21.15.57:0/2867787322 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f65ec06e6c0 con 0x7f65f4144660 2021-06-25T04:55:47.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.515+0000 7f65f99dd700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f65d0055450 0x7f65d0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.515+0000 7f65f99dd700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f65d0055450 0x7f65d0057910 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f65f0019000 tx=0x7f65f0014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.519+0000 7f65e77fe700 1 -- 172.21.15.57:0/2867787322 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f65ec0447d0 con 0x7f65f4144660 2021-06-25T04:55:47.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.683+0000 7f65fbc41700 1 -- 172.21.15.57:0/2867787322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f65f4057310 con 0x7f65f4144660 2021-06-25T04:55:47.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.835+0000 7f65e77fe700 1 -- 172.21.15.57:0/2867787322 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) v1 ==== 118+0+0 (secure 0 0 0) 0x7f65ec047df0 con 0x7f65f4144660 2021-06-25T04:55:47.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 -- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f65d0055450 msgr2=0x7f65d0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f65d0055450 0x7f65d0057910 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f65f0019000 tx=0x7f65f0014000).stop 2021-06-25T04:55:47.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 -- 172.21.15.57:0/2867787322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65f4144660 msgr2=0x7f65f414a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:47.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65f4144660 0x7f65f414a270 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f65f414a1c0 tx=0x7f65ec0091d0).stop 2021-06-25T04:55:47.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 -- 172.21.15.57:0/2867787322 shutdown_connections 2021-06-25T04:55:47.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f65d0055450 0x7f65d0057910 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65f4144660 0x7f65f414a270 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f40b4140 0x7f65f4156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 --2- 172.21.15.57:0/2867787322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65f40b37b0 0x7f65f4148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:47.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 -- 172.21.15.57:0/2867787322 >> 172.21.15.57:0/2867787322 conn(0x7f65f405c450 msgr2=0x7f65f41422b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:47.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 -- 172.21.15.57:0/2867787322 shutdown_connections 2021-06-25T04:55:47.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.839+0000 7f65fbc41700 1 -- 172.21.15.57:0/2867787322 wait complete. 2021-06-25T04:55:47.863 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:47.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.971+0000 7f408333b700 1 Processor -- start 2021-06-25T04:55:47.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.971+0000 7f408333b700 1 -- start start 2021-06-25T04:55:47.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f408333b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c0afd20 0x7f407c067820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:47.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f408333b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407c144410 con 0x7f407c0b2810 2021-06-25T04:55:47.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4082339700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f407c0b2810 0x7f407c067110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59576/0 (socket says 172.21.15.57:59576) 2021-06-25T04:55:47.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f408333b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407c0b2bf0 con 0x7f407c0af0f0 2021-06-25T04:55:47.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4082339700 1 -- 172.21.15.57:0/1261120203 learned_addr learned my addr 172.21.15.57:0/1261120203 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:47.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f408333b700 1 -- 172.21.15.57:0/1261120203 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c1452c0 con 0x7f407c0afd20 2021-06-25T04:55:47.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4082b3a700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c0afd20 0x7f407c067820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:47.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209854869 0 0) 0x7f407c144410 con 0x7f407c0b2810 2021-06-25T04:55:48.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4064003260 con 0x7f407c0b2810 2021-06-25T04:55:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502100958 0 0) 0x7f407c0b2bf0 con 0x7f407c0af0f0 2021-06-25T04:55:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f407c144410 con 0x7f407c0af0f0 2021-06-25T04:55:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2318553590 0 0) 0x7f4064003260 con 0x7f407c0b2810 2021-06-25T04:55:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c0afd20 msgr2=0x7f407c067820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:48.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c0afd20 0x7f407c067820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 >> v1:172.21.15.87:6789/0 conn(0x7f407c0af0f0 legacy=0x7f407c140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c144640 con 0x7f407c0b2810 2021-06-25T04:55:48.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f4078001680 con 0x7f407c0b2810 2021-06-25T04:55:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 >> v1:172.21.15.57:6789/0 conn(0x7f407c0b2810 legacy=0x7f407c067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4064003910 0x7f4064003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c0afd20 0x7f4064004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40640049f0 0x7f4064004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c1452c0 con 0x7f40640049f0 2021-06-25T04:55:48.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406400b780 con 0x7f4064003910 2021-06-25T04:55:48.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406400b940 con 0x7f407c0afd20 2021-06-25T04:55:48.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4082339700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4064003910 0x7f4064003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4082b3a700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40640049f0 0x7f4064004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.975+0000 7f4081b38700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c0afd20 0x7f4064004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f4082b3a700 1 -- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c0afd20 msgr2=0x7f4064004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:48.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f4082b3a700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c0afd20 0x7f4064004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f4082b3a700 1 -- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4064003910 msgr2=0x7f4064003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:48.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f4082b3a700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4064003910 0x7f4064003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f4082b3a700 1 -- 172.21.15.57:0/1261120203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4064003260 con 0x7f40640049f0 2021-06-25T04:55:48.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f4082339700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4064003910 0x7f4064003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f4082b3a700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40640049f0 0x7f4064004e70 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f407400c000 tx=0x7f40740091d0).ready entity=mon.0 client_cookie=bf01dd27aab836ae server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f407400e7e0 con 0x7f40640049f0 2021-06-25T04:55:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407400e940 con 0x7f40640049f0 2021-06-25T04:55:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f4081337700 1 -- 172.21.15.57:0/1261120203 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f407400eca0 con 0x7f40640049f0 2021-06-25T04:55:48.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f408333b700 1 -- 172.21.15.57:0/1261120203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40640049f0 msgr2=0x7f4064004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f408333b700 1 --2- 172.21.15.57:0/1261120203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40640049f0 0x7f4064004e70 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f407400c000 tx=0x7f40740091d0).stop 2021-06-25T04:55:48.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f4082b3a700 1 -- 172.21.15.57:0/1261120203 reap_dead start 2021-06-25T04:55:48.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f408333b700 1 -- 172.21.15.57:0/1261120203 shutdown_connections 2021-06-25T04:55:48.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f408333b700 1 -- 172.21.15.57:0/1261120203 >> 172.21.15.57:0/1261120203 conn(0x7f407c0611f0 msgr2=0x7f407c062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:48.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f408333b700 1 -- 172.21.15.57:0/1261120203 shutdown_connections 2021-06-25T04:55:48.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f408333b700 1 -- 172.21.15.57:0/1261120203 wait complete. 2021-06-25T04:55:48.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f408333b700 1 Processor -- start 2021-06-25T04:55:48.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.979+0000 7f408333b700 1 -- start start 2021-06-25T04:55:48.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f408333b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c155f40 0x7f407c0acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f408333b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f407c13fab0 0x7f407c156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f408333b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f407c141360 0x7f407c152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f408333b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c156810 con 0x7f407c13fab0 2021-06-25T04:55:48.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f408333b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c13ffd0 con 0x7f407c141360 2021-06-25T04:55:48.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f408333b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c140980 con 0x7f407c155f40 2021-06-25T04:55:48.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4082339700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c155f40 0x7f407c0acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4081b38700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f407c13fab0 0x7f407c156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4082b3a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f407c141360 0x7f407c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4082339700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c155f40 0x7f407c0acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:53534/0 (socket says 172.21.15.57:53534) 2021-06-25T04:55:48.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4082339700 1 -- 172.21.15.57:0/3251360702 learned_addr learned my addr 172.21.15.57:0/3251360702 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:48.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4081b38700 1 -- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c155f40 msgr2=0x7f407c0acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4081b38700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c155f40 0x7f407c0acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4081b38700 1 -- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f407c141360 msgr2=0x7f407c152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4081b38700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f407c141360 0x7f407c152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4081b38700 1 -- 172.21.15.57:0/3251360702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c140c20 con 0x7f407c13fab0 2021-06-25T04:55:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4082339700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c155f40 0x7f407c0acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f4081b38700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f407c13fab0 0x7f407c156320 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f406c00d000 tx=0x7f406c007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f406b7fe700 1 -- 172.21.15.57:0/3251360702 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f406c011590 con 0x7f407c13fab0 2021-06-25T04:55:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f406b7fe700 1 -- 172.21.15.57:0/3251360702 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c0116f0 con 0x7f407c13fab0 2021-06-25T04:55:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f408333b700 1 -- 172.21.15.57:0/3251360702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407c140ec0 con 0x7f407c13fab0 2021-06-25T04:55:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f406b7fe700 1 -- 172.21.15.57:0/3251360702 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f406c011a50 con 0x7f407c13fab0 2021-06-25T04:55:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.983+0000 7f408333b700 1 -- 172.21.15.57:0/3251360702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c1417f0 con 0x7f407c13fab0 2021-06-25T04:55:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.987+0000 7f408333b700 1 -- 172.21.15.57:0/3251360702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407c141b00 con 0x7f407c13fab0 2021-06-25T04:55:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.987+0000 7f406b7fe700 1 -- 172.21.15.57:0/3251360702 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f406c01a030 con 0x7f407c13fab0 2021-06-25T04:55:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.987+0000 7f406b7fe700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f405c0554e0 0x7f405c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.987+0000 7f406b7fe700 1 -- 172.21.15.57:0/3251360702 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f406c06dbc0 con 0x7f407c13fab0 2021-06-25T04:55:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.987+0000 7f4082339700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f405c0554e0 0x7f405c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.987+0000 7f4082339700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f405c0554e0 0x7f405c0579a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f4078005000 tx=0x7f407c0b1c30).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:47.991+0000 7f406b7fe700 1 -- 172.21.15.57:0/3251360702 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f406c043cd0 con 0x7f407c13fab0 2021-06-25T04:55:48.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.159+0000 7f408333b700 1 -- 172.21.15.57:0/3251360702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f407c057310 con 0x7f407c13fab0 2021-06-25T04:55:48.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.159+0000 7f406b7fe700 1 -- 172.21.15.57:0/3251360702 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f406c018070 con 0x7f407c13fab0 2021-06-25T04:55:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:48.166 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3329717460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329717460},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329717460}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57},{"gid":7537,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2255831830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2255831830},{"type":"v1","addr":"172.21.15.57:6833","nonce":2255831830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:55:46.830590+0000","modified":"2021-06-25T04:55:47.833713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7659":{"gid":7659,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/863055178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":863055178},{"type":"v1","addr":"172.21.15.57:6835","nonce":863055178}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-06-25T04:55:48.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 -- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f405c0554e0 msgr2=0x7f405c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f405c0554e0 0x7f405c0579a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f4078005000 tx=0x7f407c0b1c30).stop 2021-06-25T04:55:48.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 -- 172.21.15.57:0/3251360702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f407c13fab0 msgr2=0x7f407c156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f407c13fab0 0x7f407c156320 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f406c00d000 tx=0x7f406c007a00).stop 2021-06-25T04:55:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 -- 172.21.15.57:0/3251360702 shutdown_connections 2021-06-25T04:55:48.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f405c0554e0 0x7f405c0579a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f407c141360 0x7f407c152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f407c13fab0 0x7f407c156320 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 --2- 172.21.15.57:0/3251360702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f407c155f40 0x7f407c0acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 -- 172.21.15.57:0/3251360702 >> 172.21.15.57:0/3251360702 conn(0x7f407c0611f0 msgr2=0x7f407c13d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:48.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 -- 172.21.15.57:0/3251360702 shutdown_connections 2021-06-25T04:55:48.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.163+0000 7f408333b700 1 -- 172.21.15.57:0/3251360702 wait complete. 2021-06-25T04:55:48.191 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 59 2021-06-25T04:55:48.193 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 Processor -- start 2021-06-25T04:55:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 -- start start 2021-06-25T04:55:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f11e00b05d0 0x7f11e00af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f11e0147560 0x7f11e00acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e01479b0 con 0x7f11e00b5460 2021-06-25T04:55:48.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e01452a0 con 0x7f11e00b05d0 2021-06-25T04:55:48.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e00adfb0 con 0x7f11e0147560 2021-06-25T04:55:48.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e5a8b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f11e00b05d0 0x7f11e00af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e628c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f11e00b5460 0x7f11e0067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59596/0 (socket says 172.21.15.57:59596) 2021-06-25T04:55:48.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e628c700 1 -- 172.21.15.57:0/2745682007 learned_addr learned my addr 172.21.15.57:0/2745682007 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:48.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e6a8d700 1 --2- 172.21.15.57:0/2745682007 >> v2:172.21.15.87:3300/0 conn(0x7f11e0147560 0x7f11e00acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e5a8b700 1 -- 172.21.15.57:0/2745682007 >> v2:172.21.15.87:3300/0 conn(0x7f11e0147560 msgr2=0x7f11e00acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:48.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e5a8b700 1 --2- 172.21.15.57:0/2745682007 >> v2:172.21.15.87:3300/0 conn(0x7f11e0147560 0x7f11e00acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e5a8b700 1 -- 172.21.15.57:0/2745682007 >> v1:172.21.15.57:6789/0 conn(0x7f11e00b5460 legacy=0x7f11e0067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e528a700 1 -- 172.21.15.57:0/2745682007 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670710793 0 0) 0x7f11e01479b0 con 0x7f11e00b5460 2021-06-25T04:55:48.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e5a8b700 1 -- 172.21.15.57:0/2745682007 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e00b5840 con 0x7f11e00b05d0 2021-06-25T04:55:48.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e5a8b700 1 --2- 172.21.15.57:0/2745682007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00b05d0 0x7f11e00af510 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f11d40032f0 tx=0x7f11d40091d0).ready entity=mon.0 client_cookie=322cfb0c05786c3c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e528a700 1 -- 172.21.15.57:0/2745682007 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d400b680 con 0x7f11e00b05d0 2021-06-25T04:55:48.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e528a700 1 -- 172.21.15.57:0/2745682007 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d400b7e0 con 0x7f11e00b05d0 2021-06-25T04:55:48.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e528a700 1 -- 172.21.15.57:0/2745682007 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d400b950 con 0x7f11e00b05d0 2021-06-25T04:55:48.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 -- 172.21.15.57:0/2745682007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00b05d0 msgr2=0x7f11e00af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 --2- 172.21.15.57:0/2745682007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00b05d0 0x7f11e00af510 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f11d40032f0 tx=0x7f11d40091d0).stop 2021-06-25T04:55:48.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 -- 172.21.15.57:0/2745682007 shutdown_connections 2021-06-25T04:55:48.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 --2- 172.21.15.57:0/2745682007 >> v2:172.21.15.87:3300/0 conn(0x7f11e0147560 0x7f11e00acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 --2- 172.21.15.57:0/2745682007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00b05d0 0x7f11e00af510 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.291+0000 7f11e728e700 1 -- 172.21.15.57:0/2745682007 >> 172.21.15.57:0/2745682007 conn(0x7f11e0062520 msgr2=0x7f11e0062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:48.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 -- 172.21.15.57:0/2745682007 shutdown_connections 2021-06-25T04:55:48.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 -- 172.21.15.57:0/2745682007 wait complete. 2021-06-25T04:55:48.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 Processor -- start 2021-06-25T04:55:48.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 -- start start 2021-06-25T04:55:48.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11e00b05d0 0x7f11e0159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f11e00b5460 0x7f11e01466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e0147560 0x7f11e0157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0066db0 con 0x7f11e0147560 2021-06-25T04:55:48.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0067050 con 0x7f11e00b05d0 2021-06-25T04:55:48.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0156c80 con 0x7f11e00b5460 2021-06-25T04:55:48.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e6a8d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e0147560 0x7f11e0157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e6a8d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e0147560 0x7f11e0157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42388/0 (socket says 172.21.15.57:42388) 2021-06-25T04:55:48.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e6a8d700 1 -- 172.21.15.57:0/2599014943 learned_addr learned my addr 172.21.15.57:0/2599014943 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:48.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e5a8b700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f11e00b5460 0x7f11e01466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e628c700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11e00b05d0 0x7f11e0159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e6a8d700 1 -- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f11e00b5460 msgr2=0x7f11e01466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e6a8d700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f11e00b5460 0x7f11e01466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e6a8d700 1 -- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11e00b05d0 msgr2=0x7f11e0159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e6a8d700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11e00b05d0 0x7f11e0159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e6a8d700 1 -- 172.21.15.57:0/2599014943 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d4009470 con 0x7f11e0147560 2021-06-25T04:55:48.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e6a8d700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e0147560 0x7f11e0157120 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f11dc00c000 tx=0x7f11dc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11d37fe700 1 -- 172.21.15.57:0/2599014943 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11dc011750 con 0x7f11e0147560 2021-06-25T04:55:48.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11d37fe700 1 -- 172.21.15.57:0/2599014943 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc0118b0 con 0x7f11e0147560 2021-06-25T04:55:48.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 -- 172.21.15.57:0/2599014943 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e01569b0 con 0x7f11e0147560 2021-06-25T04:55:48.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11d37fe700 1 -- 172.21.15.57:0/2599014943 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11dc011c10 con 0x7f11e0147560 2021-06-25T04:55:48.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.295+0000 7f11e728e700 1 -- 172.21.15.57:0/2599014943 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e0157610 con 0x7f11e0147560 2021-06-25T04:55:48.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.299+0000 7f11e728e700 1 -- 172.21.15.57:0/2599014943 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e0156e40 con 0x7f11e0147560 2021-06-25T04:55:48.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.299+0000 7f11d37fe700 1 -- 172.21.15.57:0/2599014943 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f11dc011d70 con 0x7f11e0147560 2021-06-25T04:55:48.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.299+0000 7f11d37fe700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f11c00554e0 0x7f11c00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.299+0000 7f11d37fe700 1 -- 172.21.15.57:0/2599014943 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f11dc06e320 con 0x7f11e0147560 2021-06-25T04:55:48.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.299+0000 7f11e628c700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f11c00554e0 0x7f11c00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.299+0000 7f11e628c700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f11c00554e0 0x7f11c00579a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f11d800d000 tx=0x7f11d8007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.307+0000 7f11d37fe700 1 -- 172.21.15.57:0/2599014943 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f11dc0443c0 con 0x7f11e0147560 2021-06-25T04:55:48.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.435+0000 7f11e728e700 1 -- 172.21.15.57:0/2599014943 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11e0057310 con 0x7f11e0147560 2021-06-25T04:55:48.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.435+0000 7f11d37fe700 1 -- 172.21.15.57:0/2599014943 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f11dc0479e0 con 0x7f11e0147560 2021-06-25T04:55:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:48.441 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":118,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:47.834493+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:55:45.280146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-06-25T04:55:46.105368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:48.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 -- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f11c00554e0 msgr2=0x7f11c00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f11c00554e0 0x7f11c00579a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f11d800d000 tx=0x7f11d8007a00).stop 2021-06-25T04:55:48.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 -- 172.21.15.57:0/2599014943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e0147560 msgr2=0x7f11e0157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e0147560 0x7f11e0157120 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f11dc00c000 tx=0x7f11dc006df0).stop 2021-06-25T04:55:48.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 -- 172.21.15.57:0/2599014943 shutdown_connections 2021-06-25T04:55:48.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f11c00554e0 0x7f11c00579a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e0147560 0x7f11e0157120 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f11e00b5460 0x7f11e01466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 --2- 172.21.15.57:0/2599014943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11e00b05d0 0x7f11e0159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 -- 172.21.15.57:0/2599014943 >> 172.21.15.57:0/2599014943 conn(0x7f11e0062520 msgr2=0x7f11e0067330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:48.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 -- 172.21.15.57:0/2599014943 shutdown_connections 2021-06-25T04:55:48.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.439+0000 7f11e728e700 1 -- 172.21.15.57:0/2599014943 wait complete. 2021-06-25T04:55:48.455 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:55:48.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.563+0000 7fda99ee6700 1 Processor -- start 2021-06-25T04:55:48.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.563+0000 7fda99ee6700 1 -- start start 2021-06-25T04:55:48.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad2e0 0x7fda940af660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fda940ad810 0x7fda940a8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda940afd60 con 0x7fda940af280 2021-06-25T04:55:48.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9405c5d0 con 0x7fda940ad810 2021-06-25T04:55:48.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda941407c0 con 0x7fda940ad2e0 2021-06-25T04:55:48.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda93fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad2e0 0x7fda940af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda996e5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fda940ad810 0x7fda940a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda98ee4700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fda940af280 0x7fda94143110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:60358/0 (socket says 172.21.15.57:60358) 2021-06-25T04:55:48.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda93fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad2e0 0x7fda940af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:53558/0 (socket says 172.21.15.57:53558) 2021-06-25T04:55:48.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda98ee4700 1 -- 172.21.15.57:0/1867012018 learned_addr learned my addr 172.21.15.57:0/1867012018 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:48.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda93fff700 1 -- 172.21.15.57:0/1867012018 >> v2:172.21.15.87:3300/0 conn(0x7fda940ad810 msgr2=0x7fda940a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:48.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda93fff700 1 --2- 172.21.15.57:0/1867012018 >> v2:172.21.15.87:3300/0 conn(0x7fda940ad810 0x7fda940a8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda93fff700 1 -- 172.21.15.57:0/1867012018 >> v1:172.21.15.87:6789/0 conn(0x7fda940af280 legacy=0x7fda94143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda937fe700 1 -- 172.21.15.57:0/1867012018 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678266433 0 0) 0x7fda940afd60 con 0x7fda940af280 2021-06-25T04:55:48.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda93fff700 1 -- 172.21.15.57:0/1867012018 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94143820 con 0x7fda940ad2e0 2021-06-25T04:55:48.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda996e5700 1 --2- 172.21.15.57:0/1867012018 >> v2:172.21.15.87:3300/0 conn(0x7fda940ad810 0x7fda940a8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda93fff700 1 --2- 172.21.15.57:0/1867012018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad2e0 0x7fda940af660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fda84002f70 tx=0x7fda84006df0).ready entity=mon.2 client_cookie=95f94df2ecf6469f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda937fe700 1 -- 172.21.15.57:0/1867012018 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda8400d570 con 0x7fda940ad2e0 2021-06-25T04:55:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda937fe700 1 -- 172.21.15.57:0/1867012018 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda84000e90 con 0x7fda940ad2e0 2021-06-25T04:55:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 -- 172.21.15.57:0/1867012018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad2e0 msgr2=0x7fda940af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda937fe700 1 -- 172.21.15.57:0/1867012018 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda8400d8c0 con 0x7fda940ad2e0 2021-06-25T04:55:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 --2- 172.21.15.57:0/1867012018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad2e0 0x7fda940af660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fda84002f70 tx=0x7fda84006df0).stop 2021-06-25T04:55:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 -- 172.21.15.57:0/1867012018 shutdown_connections 2021-06-25T04:55:48.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 --2- 172.21.15.57:0/1867012018 >> v2:172.21.15.87:3300/0 conn(0x7fda940ad810 0x7fda940a8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 --2- 172.21.15.57:0/1867012018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad2e0 0x7fda940af660 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 -- 172.21.15.57:0/1867012018 >> 172.21.15.57:0/1867012018 conn(0x7fda94061100 msgr2=0x7fda94062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:48.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 -- 172.21.15.57:0/1867012018 shutdown_connections 2021-06-25T04:55:48.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.567+0000 7fda99ee6700 1 -- 172.21.15.57:0/1867012018 wait complete. 2021-06-25T04:55:48.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.571+0000 7fda99ee6700 1 Processor -- start 2021-06-25T04:55:48.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.571+0000 7fda99ee6700 1 -- start start 2021-06-25T04:55:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda99ee6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda940ad2e0 0x7fda94063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda99ee6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad810 0x7fda940b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda99ee6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda940af280 0x7fda941514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda99ee6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda940b6120 con 0x7fda940af280 2021-06-25T04:55:48.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda99ee6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda94151c80 con 0x7fda940ad2e0 2021-06-25T04:55:48.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda99ee6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda94064a80 con 0x7fda940ad810 2021-06-25T04:55:48.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda996e5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda940af280 0x7fda941514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda996e5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda940af280 0x7fda941514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42402/0 (socket says 172.21.15.57:42402) 2021-06-25T04:55:48.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda98ee4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda940ad2e0 0x7fda94063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda93fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad810 0x7fda940b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda996e5700 1 -- 172.21.15.57:0/4251254592 learned_addr learned my addr 172.21.15.57:0/4251254592 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda996e5700 1 -- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad810 msgr2=0x7fda940b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda996e5700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad810 0x7fda940b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda996e5700 1 -- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda940ad2e0 msgr2=0x7fda94063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda996e5700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda940ad2e0 0x7fda94063bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda996e5700 1 -- 172.21.15.57:0/4251254592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c00b710 con 0x7fda940af280 2021-06-25T04:55:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda996e5700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda940af280 0x7fda941514b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fda8c00e000 tx=0x7fda8c00b470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda91ffb700 1 -- 172.21.15.57:0/4251254592 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda8c01a470 con 0x7fda940af280 2021-06-25T04:55:48.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda91ffb700 1 -- 172.21.15.57:0/4251254592 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c01a5d0 con 0x7fda940af280 2021-06-25T04:55:48.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda99ee6700 1 -- 172.21.15.57:0/4251254592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8400b180 con 0x7fda940af280 2021-06-25T04:55:48.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda91ffb700 1 -- 172.21.15.57:0/4251254592 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda8c01a930 con 0x7fda940af280 2021-06-25T04:55:48.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.575+0000 7fda99ee6700 1 -- 172.21.15.57:0/4251254592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda941519a0 con 0x7fda940af280 2021-06-25T04:55:48.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.579+0000 7fda99ee6700 1 -- 172.21.15.57:0/4251254592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda94057310 con 0x7fda940af280 2021-06-25T04:55:48.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.579+0000 7fda91ffb700 1 -- 172.21.15.57:0/4251254592 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fda8c021060 con 0x7fda940af280 2021-06-25T04:55:48.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.579+0000 7fda91ffb700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda740553f0 0x7fda740578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.579+0000 7fda91ffb700 1 -- 172.21.15.57:0/4251254592 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fda8c0712f0 con 0x7fda940af280 2021-06-25T04:55:48.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.579+0000 7fda98ee4700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda740553f0 0x7fda740578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.579+0000 7fda98ee4700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda740553f0 0x7fda740578b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fda8800d000 tx=0x7fda88007c00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.587+0000 7fda91ffb700 1 -- 172.21.15.57:0/4251254592 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fda8c0474a0 con 0x7fda940af280 2021-06-25T04:55:48.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.755+0000 7fda99ee6700 1 -- 172.21.15.57:0/4251254592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fda94061950 con 0x7fda940af280 2021-06-25T04:55:48.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda91ffb700 1 -- 172.21.15.57:0/4251254592 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7fda8c01f0e0 con 0x7fda940af280 2021-06-25T04:55:48.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 -- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda740553f0 msgr2=0x7fda740578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda740553f0 0x7fda740578b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fda8800d000 tx=0x7fda88007c00).stop 2021-06-25T04:55:48.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 -- 172.21.15.57:0/4251254592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda940af280 msgr2=0x7fda941514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda940af280 0x7fda941514b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fda8c00e000 tx=0x7fda8c00b470).stop 2021-06-25T04:55:48.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 -- 172.21.15.57:0/4251254592 shutdown_connections 2021-06-25T04:55:48.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda740553f0 0x7fda740578b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda940af280 0x7fda941514b0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda940ad810 0x7fda940b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 --2- 172.21.15.57:0/4251254592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda940ad2e0 0x7fda94063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 -- 172.21.15.57:0/4251254592 >> 172.21.15.57:0/4251254592 conn(0x7fda94061100 msgr2=0x7fda9413dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:48.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 -- 172.21.15.57:0/4251254592 shutdown_connections 2021-06-25T04:55:48.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.763+0000 7fda99ee6700 1 -- 172.21.15.57:0/4251254592 wait complete. 2021-06-25T04:55:48.774 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:55:48.787 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:55:48.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc5398d7700 1 Processor -- start 2021-06-25T04:55:48.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc5398d7700 1 -- start start 2021-06-25T04:55:48.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc5398d7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b7330 0x7fc5340b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc5398d7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc5340aabe0 0x7fc534064b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc5398d7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5340b2340 con 0x7fc5340b3020 2021-06-25T04:55:48.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc5398d7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc534144210 con 0x7fc5340aabe0 2021-06-25T04:55:48.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc5398d7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340b3530 con 0x7fc5340b7330 2021-06-25T04:55:48.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc533fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc5340b3020 0x7fc53413e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59624/0 (socket says 172.21.15.57:59624) 2021-06-25T04:55:48.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc533fff700 1 -- 172.21.15.57:0/3303056042 learned_addr learned my addr 172.21.15.57:0/3303056042 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:48.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc5390d6700 1 --2- 172.21.15.57:0/3303056042 >> v2:172.21.15.87:3300/0 conn(0x7fc5340aabe0 0x7fc534064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc5388d5700 1 --2- 172.21.15.57:0/3303056042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b7330 0x7fc5340b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc5337fe700 1 -- 172.21.15.57:0/3303056042 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179599613 0 0) 0x7fc5340b2340 con 0x7fc5340b3020 2021-06-25T04:55:48.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.891+0000 7fc5337fe700 1 -- 172.21.15.57:0/3303056042 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc514003260 con 0x7fc5340b3020 2021-06-25T04:55:48.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5390d6700 1 -- 172.21.15.57:0/3303056042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b7330 msgr2=0x7fc5340b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:48.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5390d6700 1 --2- 172.21.15.57:0/3303056042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b7330 0x7fc5340b7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5390d6700 1 -- 172.21.15.57:0/3303056042 >> v1:172.21.15.57:6789/0 conn(0x7fc5340b3020 legacy=0x7fc53413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5390d6700 1 -- 172.21.15.57:0/3303056042 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5340b2570 con 0x7fc5340aabe0 2021-06-25T04:55:48.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5388d5700 1 --2- 172.21.15.57:0/3303056042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b7330 0x7fc5340b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:48.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5390d6700 1 --2- 172.21.15.57:0/3303056042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5340aabe0 0x7fc534064b60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fc52c0032f0 tx=0x7fc52c0091d0).ready entity=mon.1 client_cookie=8ed9f45fd31021d3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5337fe700 1 -- 172.21.15.57:0/3303056042 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc52c00b600 con 0x7fc5340aabe0 2021-06-25T04:55:48.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5337fe700 1 -- 172.21.15.57:0/3303056042 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c00b760 con 0x7fc5340aabe0 2021-06-25T04:55:48.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5337fe700 1 -- 172.21.15.57:0/3303056042 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc52c00b8d0 con 0x7fc5340aabe0 2021-06-25T04:55:48.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5398d7700 1 -- 172.21.15.57:0/3303056042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5340aabe0 msgr2=0x7fc534064b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5398d7700 1 --2- 172.21.15.57:0/3303056042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5340aabe0 0x7fc534064b60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fc52c0032f0 tx=0x7fc52c0091d0).stop 2021-06-25T04:55:48.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5398d7700 1 -- 172.21.15.57:0/3303056042 shutdown_connections 2021-06-25T04:55:48.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5398d7700 1 --2- 172.21.15.57:0/3303056042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5340aabe0 0x7fc534064b60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5398d7700 1 --2- 172.21.15.57:0/3303056042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b7330 0x7fc5340b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5398d7700 1 -- 172.21.15.57:0/3303056042 >> 172.21.15.57:0/3303056042 conn(0x7fc53405f670 msgr2=0x7fc53405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:48.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5398d7700 1 -- 172.21.15.57:0/3303056042 shutdown_connections 2021-06-25T04:55:48.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5398d7700 1 -- 172.21.15.57:0/3303056042 wait complete. 2021-06-25T04:55:48.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5398d7700 1 Processor -- start 2021-06-25T04:55:48.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.895+0000 7fc5398d7700 1 -- start start 2021-06-25T04:55:48.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5398d7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5340aabe0 0x7fc5340ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5398d7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b3020 0x7fc53413f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5398d7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5340b7330 0x7fc5340b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5398d7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340ab530 con 0x7fc5340aabe0 2021-06-25T04:55:48.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5398d7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340b0490 con 0x7fc5340b7330 2021-06-25T04:55:48.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5398d7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340b1db0 con 0x7fc5340b3020 2021-06-25T04:55:48.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5388d5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5340aabe0 0x7fc5340ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5388d5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5340aabe0 0x7fc5340ac3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42412/0 (socket says 172.21.15.57:42412) 2021-06-25T04:55:48.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5388d5700 1 -- 172.21.15.57:0/3338100024 learned_addr learned my addr 172.21.15.57:0/3338100024 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:48.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5390d6700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5340b7330 0x7fc5340b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc533fff700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b3020 0x7fc53413f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5388d5700 1 -- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b3020 msgr2=0x7fc53413f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5388d5700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b3020 0x7fc53413f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5388d5700 1 -- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5340b7330 msgr2=0x7fc5340b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:48.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5388d5700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5340b7330 0x7fc5340b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:48.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5388d5700 1 -- 172.21.15.57:0/3338100024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52400b120 con 0x7fc5340aabe0 2021-06-25T04:55:48.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc533fff700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b3020 0x7fc53413f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:48.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5388d5700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5340aabe0 0x7fc5340ac3d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fc52400c000 tx=0x7fc524008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc531ffb700 1 -- 172.21.15.57:0/3338100024 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc524012600 con 0x7fc5340aabe0 2021-06-25T04:55:48.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5398d7700 1 -- 172.21.15.57:0/3338100024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52c009470 con 0x7fc5340aabe0 2021-06-25T04:55:48.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc531ffb700 1 -- 172.21.15.57:0/3338100024 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524012760 con 0x7fc5340aabe0 2021-06-25T04:55:48.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc531ffb700 1 -- 172.21.15.57:0/3338100024 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc524012ac0 con 0x7fc5340aabe0 2021-06-25T04:55:48.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5398d7700 1 -- 172.21.15.57:0/3338100024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5340aba00 con 0x7fc5340aabe0 2021-06-25T04:55:48.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc5398d7700 1 -- 172.21.15.57:0/3338100024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc534057310 con 0x7fc5340aabe0 2021-06-25T04:55:48.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.899+0000 7fc531ffb700 1 -- 172.21.15.57:0/3338100024 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc524022070 con 0x7fc5340aabe0 2021-06-25T04:55:48.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.903+0000 7fc531ffb700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc518055490 0x7fc518057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:48.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.903+0000 7fc531ffb700 1 -- 172.21.15.57:0/3338100024 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc52406e4c0 con 0x7fc5340aabe0 2021-06-25T04:55:48.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.903+0000 7fc533fff700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc518055490 0x7fc518057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:48.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.903+0000 7fc533fff700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc518055490 0x7fc518057950 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fc51c008000 tx=0x7fc51c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:48.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:48.907+0000 7fc531ffb700 1 -- 172.21.15.57:0/3338100024 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc5240445d0 con 0x7fc5340aabe0 2021-06-25T04:55:49.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.079+0000 7fc5398d7700 1 -- 172.21.15.57:0/3338100024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc534060160 con 0x7fc5340aabe0 2021-06-25T04:55:49.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc531ffb700 1 -- 172.21.15.57:0/3338100024 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc524047bf0 con 0x7fc5340aabe0 2021-06-25T04:55:49.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 -- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc518055490 msgr2=0x7fc518057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc518055490 0x7fc518057950 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fc51c008000 tx=0x7fc51c009040).stop 2021-06-25T04:55:49.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 -- 172.21.15.57:0/3338100024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5340aabe0 msgr2=0x7fc5340ac3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5340aabe0 0x7fc5340ac3d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fc52400c000 tx=0x7fc524008040).stop 2021-06-25T04:55:49.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 -- 172.21.15.57:0/3338100024 shutdown_connections 2021-06-25T04:55:49.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc518055490 0x7fc518057950 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5340b7330 0x7fc5340b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5340b3020 0x7fc53413f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 --2- 172.21.15.57:0/3338100024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5340aabe0 0x7fc5340ac3d0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 -- 172.21.15.57:0/3338100024 >> 172.21.15.57:0/3338100024 conn(0x7fc53405f670 msgr2=0x7fc53405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 -- 172.21.15.57:0/3338100024 shutdown_connections 2021-06-25T04:55:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.091+0000 7fc5398d7700 1 -- 172.21.15.57:0/3338100024 wait complete. 2021-06-25T04:55:49.103 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:55:49.112 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:49.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 Processor -- start 2021-06-25T04:55:49.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 -- start start 2021-06-25T04:55:49.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdaf00b5460 0x7fdaf00af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdaf0147560 0x7fdaf00acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf01479b0 con 0x7fdaf00b05d0 2021-06-25T04:55:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf01452a0 con 0x7fdaf0147560 2021-06-25T04:55:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf00adfb0 con 0x7fdaf00b5460 2021-06-25T04:55:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf543d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdaf0147560 0x7fdaf00acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf543d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdaf0147560 0x7fdaf00acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42424/0 (socket says 172.21.15.57:42424) 2021-06-25T04:55:49.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf543d700 1 -- 172.21.15.57:0/380215130 learned_addr learned my addr 172.21.15.57:0/380215130 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:49.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf4c3c700 1 --2- 172.21.15.57:0/380215130 >> v2:172.21.15.87:3300/0 conn(0x7fdaf00b5460 0x7fdaf00af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf543d700 1 -- 172.21.15.57:0/380215130 >> v2:172.21.15.87:3300/0 conn(0x7fdaf00b5460 msgr2=0x7fdaf00af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:49.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf543d700 1 --2- 172.21.15.57:0/380215130 >> v2:172.21.15.87:3300/0 conn(0x7fdaf00b5460 0x7fdaf00af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf543d700 1 -- 172.21.15.57:0/380215130 >> v1:172.21.15.87:6789/0 conn(0x7fdaf00b05d0 legacy=0x7fdaf0067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf543d700 1 -- 172.21.15.57:0/380215130 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf00b5840 con 0x7fdaf0147560 2021-06-25T04:55:49.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf543d700 1 --2- 172.21.15.57:0/380215130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf0147560 0x7fdaf00acc20 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fdae0002f70 tx=0x7fdae0006eb0).ready entity=mon.0 client_cookie=a9c6b80e43a31962 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:49.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaef7fe700 1 -- 172.21.15.57:0/380215130 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdae000d5c0 con 0x7fdaf0147560 2021-06-25T04:55:49.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaef7fe700 1 -- 172.21.15.57:0/380215130 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae0000e90 con 0x7fdaf0147560 2021-06-25T04:55:49.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaef7fe700 1 -- 172.21.15.57:0/380215130 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdae000d950 con 0x7fdaf0147560 2021-06-25T04:55:49.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/380215130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf0147560 msgr2=0x7fdaf00acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 --2- 172.21.15.57:0/380215130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf0147560 0x7fdaf00acc20 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fdae0002f70 tx=0x7fdae0006eb0).stop 2021-06-25T04:55:49.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/380215130 shutdown_connections 2021-06-25T04:55:49.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 --2- 172.21.15.57:0/380215130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf0147560 0x7fdaf00acc20 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 --2- 172.21.15.57:0/380215130 >> v2:172.21.15.87:3300/0 conn(0x7fdaf00b5460 0x7fdaf00af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.211+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/380215130 >> 172.21.15.57:0/380215130 conn(0x7fdaf0062520 msgr2=0x7fdaf0062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:49.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.215+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/380215130 shutdown_connections 2021-06-25T04:55:49.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.215+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/380215130 wait complete. 2021-06-25T04:55:49.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.215+0000 7fdaf5c3e700 1 Processor -- start 2021-06-25T04:55:49.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.215+0000 7fdaf5c3e700 1 -- start start 2021-06-25T04:55:49.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf5c3e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdaf00b05d0 0x7fdaf0149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf5c3e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdaf00b5460 0x7fdaf00b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf5c3e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf0147560 0x7fdaf0159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf5c3e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0157590 con 0x7fdaf0147560 2021-06-25T04:55:49.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf5c3e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf00666e0 con 0x7fdaf00b05d0 2021-06-25T04:55:49.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf5c3e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0066980 con 0x7fdaf00b5460 2021-06-25T04:55:49.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf543d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf0147560 0x7fdaf0159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf543d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf0147560 0x7fdaf0159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42430/0 (socket says 172.21.15.57:42430) 2021-06-25T04:55:49.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf543d700 1 -- 172.21.15.57:0/635366977 learned_addr learned my addr 172.21.15.57:0/635366977 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:49.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf4c3c700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdaf00b05d0 0x7fdaf0149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaeffff700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdaf00b5460 0x7fdaf00b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf543d700 1 -- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdaf00b5460 msgr2=0x7fdaf00b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf543d700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdaf00b5460 0x7fdaf00b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf543d700 1 -- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdaf00b05d0 msgr2=0x7fdaf0149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf543d700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdaf00b05d0 0x7fdaf0149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf543d700 1 -- 172.21.15.57:0/635366977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae000b1e0 con 0x7fdaf0147560 2021-06-25T04:55:49.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf543d700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf0147560 0x7fdaf0159da0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fdae0002f70 tx=0x7fdae0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:49.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaedffb700 1 -- 172.21.15.57:0/635366977 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdae0021070 con 0x7fdaf0147560 2021-06-25T04:55:49.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaedffb700 1 -- 172.21.15.57:0/635366977 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae0000e90 con 0x7fdaf0147560 2021-06-25T04:55:49.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaedffb700 1 -- 172.21.15.57:0/635366977 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdae00118d0 con 0x7fdaf0147560 2021-06-25T04:55:49.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/635366977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf01572b0 con 0x7fdaf0147560 2021-06-25T04:55:49.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/635366977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf015a430 con 0x7fdaf0147560 2021-06-25T04:55:49.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.219+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/635366977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf0057310 con 0x7fdaf0147560 2021-06-25T04:55:49.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.223+0000 7fdaedffb700 1 -- 172.21.15.57:0/635366977 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fdae000f070 con 0x7fdaf0147560 2021-06-25T04:55:49.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.223+0000 7fdaedffb700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad4055450 0x7fdad4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.223+0000 7fdaedffb700 1 -- 172.21.15.57:0/635366977 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdae006f280 con 0x7fdaf0147560 2021-06-25T04:55:49.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.223+0000 7fdaf4c3c700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad4055450 0x7fdad4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.223+0000 7fdaf4c3c700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad4055450 0x7fdad4057910 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fdad800b000 tx=0x7fdad8006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:49.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.227+0000 7fdaedffb700 1 -- 172.21.15.57:0/635366977 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fdae00453d0 con 0x7fdaf0147560 2021-06-25T04:55:49.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.395+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/635366977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdaf005f200 con 0x7fdaf0147560 2021-06-25T04:55:49.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.395+0000 7fdaedffb700 1 -- 172.21.15.57:0/635366977 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fdae00489f0 con 0x7fdaf0147560 2021-06-25T04:55:49.401 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:49.401 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3329717460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329717460},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329717460}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57},{"gid":7537,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2255831830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2255831830},{"type":"v1","addr":"172.21.15.57:6833","nonce":2255831830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:55:46.830590+0000","modified":"2021-06-25T04:55:47.833713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7659":{"gid":7659,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/863055178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":863055178},{"type":"v1","addr":"172.21.15.57:6835","nonce":863055178}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-06-25T04:55:49.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.395+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad4055450 msgr2=0x7fdad4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.395+0000 7fdaf5c3e700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad4055450 0x7fdad4057910 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fdad800b000 tx=0x7fdad8006df0).stop 2021-06-25T04:55:49.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.395+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/635366977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf0147560 msgr2=0x7fdaf0159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.395+0000 7fdaf5c3e700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf0147560 0x7fdaf0159da0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fdae0002f70 tx=0x7fdae0015000).stop 2021-06-25T04:55:49.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.395+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/635366977 shutdown_connections 2021-06-25T04:55:49.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.395+0000 7fdaf5c3e700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fdad4055450 0x7fdad4057910 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.395+0000 7fdaf5c3e700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf0147560 0x7fdaf0159da0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.395+0000 7fdaf5c3e700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdaf00b5460 0x7fdaf00b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.395+0000 7fdaf5c3e700 1 --2- 172.21.15.57:0/635366977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdaf00b05d0 0x7fdaf0149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.399+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/635366977 >> 172.21.15.57:0/635366977 conn(0x7fdaf0062520 msgr2=0x7fdaf00acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:49.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.399+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/635366977 shutdown_connections 2021-06-25T04:55:49.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.399+0000 7fdaf5c3e700 1 -- 172.21.15.57:0/635366977 wait complete. 2021-06-25T04:55:49.410 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 59 2021-06-25T04:55:49.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:55:46.830590+0000', 'modified': '2021-06-25T04:55:47.833713+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7659}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7659': {'gid': 7659, 'name': 'a', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/863055178', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 863055178}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 863055178}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:55:49.718 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:55:49.720 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:55:49.848 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":7659,"want_state":"up:active","state":"up:active","rank_uptime":3.0029942620000001,"mdsmap_epoch":59,"osdmap_epoch":118,"osdmap_epoch_barrier":117,"uptime":7.3648235849999999} 2021-06-25T04:55:49.849 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 7659, "mdsmap_epoch": 59, "osdmap_epoch": 118, "osdmap_epoch_barrier": 117, "rank_uptime": 3.002994262, "state": "up:active", "uptime": 7.364823585, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:55:49.850 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:49.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.951+0000 7f2c73436700 1 Processor -- start 2021-06-25T04:55:49.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.951+0000 7f2c73436700 1 -- start start 2021-06-25T04:55:49.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c73436700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c067140 0x7f2c6c05f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c73436700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2c6c0b1930 0x7f2c6c05fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c73436700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c0a7a50 con 0x7f2c6c0a7670 2021-06-25T04:55:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c73436700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c1475e0 con 0x7f2c6c0b1930 2021-06-25T04:55:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c73436700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c147880 con 0x7f2c6c067140 2021-06-25T04:55:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c711d2700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2c6c0a7670 0x7f2c6c066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59654/0 (socket says 172.21.15.57:59654) 2021-06-25T04:55:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c711d2700 1 -- 172.21.15.57:0/3376648847 learned_addr learned my addr 172.21.15.57:0/3376648847 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c709d1700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c067140 0x7f2c6c05f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c719d3700 1 --2- 172.21.15.57:0/3376648847 >> v2:172.21.15.87:3300/0 conn(0x7f2c6c0b1930 0x7f2c6c05fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664037625 0 0) 0x7f2c6c0a7a50 con 0x7f2c6c0a7670 2021-06-25T04:55:49.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c50003260 con 0x7f2c6c0a7670 2021-06-25T04:55:49.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3722958081 0 0) 0x7f2c50003260 con 0x7f2c6c0a7670 2021-06-25T04:55:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c067140 msgr2=0x7f2c6c05f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c067140 0x7f2c6c05f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 >> v2:172.21.15.87:3300/0 conn(0x7f2c6c0b1930 msgr2=0x7f2c6c05fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 --2- 172.21.15.57:0/3376648847 >> v2:172.21.15.87:3300/0 conn(0x7f2c6c0b1930 0x7f2c6c05fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c147b20 con 0x7f2c6c0a7670 2021-06-25T04:55:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f2c5c001680 con 0x7f2c6c0a7670 2021-06-25T04:55:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 >> v1:172.21.15.57:6789/0 conn(0x7f2c6c0a7670 legacy=0x7f2c6c066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c50003750 0x7f2c50003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c067140 0x7f2c50004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c500049f0 0x7f2c50004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1475e0 con 0x7f2c50003750 2021-06-25T04:55:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c147880 con 0x7f2c500049f0 2021-06-25T04:55:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5000b750 con 0x7f2c6c067140 2021-06-25T04:55:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c711d2700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c50003750 0x7f2c50003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c719d3700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c500049f0 0x7f2c50004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c709d1700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c067140 0x7f2c50004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c711d2700 1 -- 172.21.15.57:0/3376648847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c067140 msgr2=0x7f2c50004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:49.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c711d2700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c067140 0x7f2c50004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c711d2700 1 -- 172.21.15.57:0/3376648847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c500049f0 msgr2=0x7f2c50004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:49.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c711d2700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c500049f0 0x7f2c50004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c711d2700 1 -- 172.21.15.57:0/3376648847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c50003260 con 0x7f2c50003750 2021-06-25T04:55:49.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c711d2700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c50003750 0x7f2c50003b70 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f2c5c001390 tx=0x7f2c6c0a8ee0).ready entity=mon.0 client_cookie=77a2b59f57fae191 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:49.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c5c007170 con 0x7f2c50003750 2021-06-25T04:55:49.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c0072d0 con 0x7f2c50003750 2021-06-25T04:55:49.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c63fff700 1 -- 172.21.15.57:0/3376648847 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c5c00c9c0 con 0x7f2c50003750 2021-06-25T04:55:49.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c73436700 1 -- 172.21.15.57:0/3376648847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c50003750 msgr2=0x7f2c50003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c73436700 1 --2- 172.21.15.57:0/3376648847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c50003750 0x7f2c50003b70 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f2c5c001390 tx=0x7f2c6c0a8ee0).stop 2021-06-25T04:55:49.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c719d3700 1 -- 172.21.15.57:0/3376648847 reap_dead start 2021-06-25T04:55:49.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c73436700 1 -- 172.21.15.57:0/3376648847 shutdown_connections 2021-06-25T04:55:49.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c73436700 1 -- 172.21.15.57:0/3376648847 >> 172.21.15.57:0/3376648847 conn(0x7f2c6c0b53a0 msgr2=0x7f2c6c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:49.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c73436700 1 -- 172.21.15.57:0/3376648847 shutdown_connections 2021-06-25T04:55:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.955+0000 7f2c73436700 1 -- 172.21.15.57:0/3376648847 wait complete. 2021-06-25T04:55:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c73436700 1 Processor -- start 2021-06-25T04:55:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c73436700 1 -- start start 2021-06-25T04:55:49.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c73436700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0b4550 0x7f2c6c144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c73436700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0aab00 0x7f2c6c144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c73436700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c156b80 0x7f2c6c157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c73436700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0ac4e0 con 0x7f2c6c0aab00 2021-06-25T04:55:49.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c73436700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0b4930 con 0x7f2c6c0b4550 2021-06-25T04:55:49.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c73436700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0ac710 con 0x7f2c6c156b80 2021-06-25T04:55:49.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c709d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0aab00 0x7f2c6c144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c709d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0aab00 0x7f2c6c144b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42450/0 (socket says 172.21.15.57:42450) 2021-06-25T04:55:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c709d1700 1 -- 172.21.15.57:0/1380494031 learned_addr learned my addr 172.21.15.57:0/1380494031 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c719d3700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c156b80 0x7f2c6c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c711d2700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0b4550 0x7f2c6c144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c709d1700 1 -- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c156b80 msgr2=0x7f2c6c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c709d1700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c156b80 0x7f2c6c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c709d1700 1 -- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0b4550 msgr2=0x7f2c6c144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:49.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c709d1700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0b4550 0x7f2c6c144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c709d1700 1 -- 172.21.15.57:0/1380494031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0ac9b0 con 0x7f2c6c0aab00 2021-06-25T04:55:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c709d1700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0aab00 0x7f2c6c144b20 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f2c6800b000 tx=0x7f2c68006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c627fc700 1 -- 172.21.15.57:0/1380494031 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c6800f940 con 0x7f2c6c0aab00 2021-06-25T04:55:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c627fc700 1 -- 172.21.15.57:0/1380494031 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6800faa0 con 0x7f2c6c0aab00 2021-06-25T04:55:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c73436700 1 -- 172.21.15.57:0/1380494031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c0acc50 con 0x7f2c6c0aab00 2021-06-25T04:55:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c627fc700 1 -- 172.21.15.57:0/1380494031 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c6800fe00 con 0x7f2c6c0aab00 2021-06-25T04:55:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.959+0000 7f2c73436700 1 -- 172.21.15.57:0/1380494031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c0af000 con 0x7f2c6c0aab00 2021-06-25T04:55:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.963+0000 7f2c73436700 1 -- 172.21.15.57:0/1380494031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c057310 con 0x7f2c6c0aab00 2021-06-25T04:55:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.963+0000 7f2c627fc700 1 -- 172.21.15.57:0/1380494031 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2c68014440 con 0x7f2c6c0aab00 2021-06-25T04:55:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.963+0000 7f2c627fc700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c54055360 0x7f2c54057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.963+0000 7f2c627fc700 1 -- 172.21.15.57:0/1380494031 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2c6806e910 con 0x7f2c6c0aab00 2021-06-25T04:55:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.963+0000 7f2c711d2700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c54055360 0x7f2c54057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:49.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.963+0000 7f2c711d2700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c54055360 0x7f2c54057820 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f2c5c018000 tx=0x7f2c5c013000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:49.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:49.967+0000 7f2c627fc700 1 -- 172.21.15.57:0/1380494031 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2c68044a60 con 0x7f2c6c0aab00 2021-06-25T04:55:50.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.095+0000 7f2c73436700 1 -- 172.21.15.57:0/1380494031 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c6c0b0f30 con 0x7f2c6c0aab00 2021-06-25T04:55:50.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c627fc700 1 -- 172.21.15.57:0/1380494031 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f2c68018020 con 0x7f2c6c0aab00 2021-06-25T04:55:50.106 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:50.107 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":118,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:47.834493+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:55:45.280146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-06-25T04:55:46.105368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:50.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 -- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c54055360 msgr2=0x7f2c54057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c54055360 0x7f2c54057820 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f2c5c018000 tx=0x7f2c5c013000).stop 2021-06-25T04:55:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 -- 172.21.15.57:0/1380494031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0aab00 msgr2=0x7f2c6c144b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0aab00 0x7f2c6c144b20 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f2c6800b000 tx=0x7f2c68006df0).stop 2021-06-25T04:55:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 -- 172.21.15.57:0/1380494031 shutdown_connections 2021-06-25T04:55:50.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c54055360 0x7f2c54057820 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c6c156b80 0x7f2c6c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0aab00 0x7f2c6c144b20 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 --2- 172.21.15.57:0/1380494031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0b4550 0x7f2c6c144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 -- 172.21.15.57:0/1380494031 >> 172.21.15.57:0/1380494031 conn(0x7f2c6c0b53a0 msgr2=0x7f2c6c05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:50.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 -- 172.21.15.57:0/1380494031 shutdown_connections 2021-06-25T04:55:50.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.099+0000 7f2c73436700 1 -- 172.21.15.57:0/1380494031 wait complete. 2021-06-25T04:55:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:55:45.280146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:55:46.105368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:55:50.116 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:55:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb536ac6700 1 Processor -- start 2021-06-25T04:55:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb536ac6700 1 -- start start 2021-06-25T04:55:50.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb536ac6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb53005fa60 0x7fb530143890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb536ac6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb530060790 0x7fb530143d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb536ac6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53005fe40 con 0x7fb5300ac4c0 2021-06-25T04:55:50.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb536ac6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb530143200 con 0x7fb530060790 2021-06-25T04:55:50.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb536ac6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300acc20 con 0x7fb53005fa60 2021-06-25T04:55:50.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb535063700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb5300ac4c0 0x7fb5301467d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59672/0 (socket says 172.21.15.57:59672) 2021-06-25T04:55:50.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb535063700 1 -- 172.21.15.57:0/721158222 learned_addr learned my addr 172.21.15.57:0/721158222 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:50.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb534862700 1 --2- 172.21.15.57:0/721158222 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb53005fa60 0x7fb530143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb52ffff700 1 --2- 172.21.15.57:0/721158222 >> v2:172.21.15.87:3300/0 conn(0x7fb530060790 0x7fb530143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb52f7fe700 1 -- 172.21.15.57:0/721158222 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174978335 0 0) 0x7fb53005fe40 con 0x7fb5300ac4c0 2021-06-25T04:55:50.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.219+0000 7fb52f7fe700 1 -- 172.21.15.57:0/721158222 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb510003260 con 0x7fb5300ac4c0 2021-06-25T04:55:50.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb52f7fe700 1 -- 172.21.15.57:0/721158222 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2955979560 0 0) 0x7fb510003260 con 0x7fb5300ac4c0 2021-06-25T04:55:50.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb52ffff700 1 -- 172.21.15.57:0/721158222 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb53005fa60 msgr2=0x7fb530143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:50.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb52ffff700 1 --2- 172.21.15.57:0/721158222 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb53005fa60 0x7fb530143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb52ffff700 1 -- 172.21.15.57:0/721158222 >> v1:172.21.15.57:6789/0 conn(0x7fb5300ac4c0 legacy=0x7fb5301467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb52ffff700 1 -- 172.21.15.57:0/721158222 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5300acec0 con 0x7fb530060790 2021-06-25T04:55:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb534862700 1 --2- 172.21.15.57:0/721158222 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb53005fa60 0x7fb530143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb52ffff700 1 --2- 172.21.15.57:0/721158222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb530060790 0x7fb530143d80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fb528001800 tx=0x7fb518006df0).ready entity=mon.1 client_cookie=20e5e68d276f70cd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:50.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb52f7fe700 1 -- 172.21.15.57:0/721158222 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb528001660 con 0x7fb530060790 2021-06-25T04:55:50.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb52f7fe700 1 -- 172.21.15.57:0/721158222 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb518000e90 con 0x7fb530060790 2021-06-25T04:55:50.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb52f7fe700 1 -- 172.21.15.57:0/721158222 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb518012460 con 0x7fb530060790 2021-06-25T04:55:50.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb536ac6700 1 -- 172.21.15.57:0/721158222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb530060790 msgr2=0x7fb530143d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb536ac6700 1 --2- 172.21.15.57:0/721158222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb530060790 0x7fb530143d80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fb528001800 tx=0x7fb518006df0).stop 2021-06-25T04:55:50.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb536ac6700 1 -- 172.21.15.57:0/721158222 shutdown_connections 2021-06-25T04:55:50.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb536ac6700 1 --2- 172.21.15.57:0/721158222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb530060790 0x7fb530143d80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb536ac6700 1 --2- 172.21.15.57:0/721158222 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb53005fa60 0x7fb530143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb536ac6700 1 -- 172.21.15.57:0/721158222 >> 172.21.15.57:0/721158222 conn(0x7fb5300b2930 msgr2=0x7fb5300b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:50.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb536ac6700 1 -- 172.21.15.57:0/721158222 shutdown_connections 2021-06-25T04:55:50.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb536ac6700 1 -- 172.21.15.57:0/721158222 wait complete. 2021-06-25T04:55:50.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb536ac6700 1 Processor -- start 2021-06-25T04:55:50.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.223+0000 7fb536ac6700 1 -- start start 2021-06-25T04:55:50.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb536ac6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53005fa60 0x7fb5300b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb536ac6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb530060790 0x7fb5301528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb536ac6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5300ac4c0 0x7fb5300af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb536ac6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5301521e0 con 0x7fb53005fa60 2021-06-25T04:55:50.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb536ac6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300ae6a0 con 0x7fb530060790 2021-06-25T04:55:50.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb536ac6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300b1080 con 0x7fb5300ac4c0 2021-06-25T04:55:50.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb534862700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53005fa60 0x7fb5300b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb534862700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53005fa60 0x7fb5300b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42460/0 (socket says 172.21.15.57:42460) 2021-06-25T04:55:50.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb534862700 1 -- 172.21.15.57:0/331303831 learned_addr learned my addr 172.21.15.57:0/331303831 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:50.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb52ffff700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb530060790 0x7fb5301528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb535063700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5300ac4c0 0x7fb5300af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb534862700 1 -- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5300ac4c0 msgr2=0x7fb5300af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb534862700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5300ac4c0 0x7fb5300af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb534862700 1 -- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb530060790 msgr2=0x7fb5301528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb534862700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb530060790 0x7fb5301528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb534862700 1 -- 172.21.15.57:0/331303831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb520009470 con 0x7fb53005fa60 2021-06-25T04:55:50.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb534862700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53005fa60 0x7fb5300b3e40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fb52000c000 tx=0x7fb5200091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:50.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb52dffb700 1 -- 172.21.15.57:0/331303831 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb52000c920 con 0x7fb53005fa60 2021-06-25T04:55:50.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb52dffb700 1 -- 172.21.15.57:0/331303831 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52000ca80 con 0x7fb53005fa60 2021-06-25T04:55:50.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb52dffb700 1 -- 172.21.15.57:0/331303831 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb52000cde0 con 0x7fb53005fa60 2021-06-25T04:55:50.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb536ac6700 1 -- 172.21.15.57:0/331303831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51800b180 con 0x7fb53005fa60 2021-06-25T04:55:50.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb536ac6700 1 -- 172.21.15.57:0/331303831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb530152440 con 0x7fb53005fa60 2021-06-25T04:55:50.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.227+0000 7fb536ac6700 1 -- 172.21.15.57:0/331303831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb530152640 con 0x7fb53005fa60 2021-06-25T04:55:50.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.231+0000 7fb52dffb700 1 -- 172.21.15.57:0/331303831 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb520022070 con 0x7fb53005fa60 2021-06-25T04:55:50.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.231+0000 7fb52dffb700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb514055450 0x7fb514057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.231+0000 7fb52dffb700 1 -- 172.21.15.57:0/331303831 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb52006e860 con 0x7fb53005fa60 2021-06-25T04:55:50.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.231+0000 7fb52ffff700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb514055450 0x7fb514057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.231+0000 7fb52ffff700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb514055450 0x7fb514057910 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fb518019000 tx=0x7fb518014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:50.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.235+0000 7fb52dffb700 1 -- 172.21.15.57:0/331303831 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb530152640 con 0x7fb53005fa60 2021-06-25T04:55:50.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 -- 172.21.15.57:0/331303831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb530057310 con 0x7fb53005fa60 2021-06-25T04:55:50.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb52dffb700 1 -- 172.21.15.57:0/331303831 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v118) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb520044900 con 0x7fb53005fa60 2021-06-25T04:55:50.372 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:55:50.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 -- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb514055450 msgr2=0x7fb514057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb514055450 0x7fb514057910 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fb518019000 tx=0x7fb518014000).stop 2021-06-25T04:55:50.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 -- 172.21.15.57:0/331303831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53005fa60 msgr2=0x7fb5300b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53005fa60 0x7fb5300b3e40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fb52000c000 tx=0x7fb5200091d0).stop 2021-06-25T04:55:50.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 -- 172.21.15.57:0/331303831 shutdown_connections 2021-06-25T04:55:50.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb514055450 0x7fb514057910 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5300ac4c0 0x7fb5300af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb530060790 0x7fb5301528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 --2- 172.21.15.57:0/331303831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb53005fa60 0x7fb5300b3e40 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 -- 172.21.15.57:0/331303831 >> 172.21.15.57:0/331303831 conn(0x7fb5300b2930 msgr2=0x7fb5301437b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:50.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 -- 172.21.15.57:0/331303831 shutdown_connections 2021-06-25T04:55:50.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.367+0000 7fb536ac6700 1 -- 172.21.15.57:0/331303831 wait complete. 2021-06-25T04:55:50.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:55:50.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.487+0000 7fbe5751e700 1 Processor -- start 2021-06-25T04:55:50.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.487+0000 7fbe5751e700 1 -- start start 2021-06-25T04:55:50.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.487+0000 7fbe5751e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe500b2560 0x7fbe500664e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.487+0000 7fbe5751e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe500669d0 0x7fbe5014d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.487+0000 7fbe5751e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500652f0 con 0x7fbe500b2fc0 2021-06-25T04:55:50.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.487+0000 7fbe5751e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe50061fc0 con 0x7fbe500669d0 2021-06-25T04:55:50.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.487+0000 7fbe5751e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b33a0 con 0x7fbe500b2560 2021-06-25T04:55:50.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5651c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbe500b2fc0 0x7fbe50060ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59686/0 (socket says 172.21.15.57:59686) 2021-06-25T04:55:50.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5651c700 1 -- 172.21.15.57:0/37965006 learned_addr learned my addr 172.21.15.57:0/37965006 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:50.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe56d1d700 1 --2- 172.21.15.57:0/37965006 >> v2:172.21.15.57:3300/0 conn(0x7fbe500669d0 0x7fbe5014d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231580929 0 0) 0x7fbe500652f0 con 0x7fbe500b2fc0 2021-06-25T04:55:50.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe38003260 con 0x7fbe500b2fc0 2021-06-25T04:55:50.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe55d1b700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe500b2560 0x7fbe500664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4147948558 0 0) 0x7fbe38003260 con 0x7fbe500b2fc0 2021-06-25T04:55:50.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe500b2560 msgr2=0x7fbe500664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:50.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe500b2560 0x7fbe500664e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 >> v2:172.21.15.57:3300/0 conn(0x7fbe500669d0 msgr2=0x7fbe5014d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:50.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 --2- 172.21.15.57:0/37965006 >> v2:172.21.15.57:3300/0 conn(0x7fbe500669d0 0x7fbe5014d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5005fa20 con 0x7fbe500b2fc0 2021-06-25T04:55:50.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fbe480019e0 con 0x7fbe500b2fc0 2021-06-25T04:55:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 >> v1:172.21.15.57:6789/0 conn(0x7fbe500b2fc0 legacy=0x7fbe50060ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe38003750 0x7fbe38003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe38004500 0x7fbe38004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe500b2560 0x7fbe38004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50061fc0 con 0x7fbe38004500 2021-06-25T04:55:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b33a0 con 0x7fbe38003750 2021-06-25T04:55:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3800b750 con 0x7fbe500b2560 2021-06-25T04:55:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe56d1d700 1 --2- 172.21.15.57:0/37965006 >> v2:172.21.15.57:3300/0 conn(0x7fbe500669d0 0x7fbe5014d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe55d1b700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe38004500 0x7fbe38004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5651c700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe38003750 0x7fbe38003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe56d1d700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe500b2560 0x7fbe38004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe55d1b700 1 -- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe500b2560 msgr2=0x7fbe38004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe55d1b700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe500b2560 0x7fbe38004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe55d1b700 1 -- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe38003750 msgr2=0x7fbe38003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:50.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe55d1b700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe38003750 0x7fbe38003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe55d1b700 1 -- 172.21.15.57:0/37965006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe38003260 con 0x7fbe38004500 2021-06-25T04:55:50.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe56d1d700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe500b2560 0x7fbe38004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:50.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe55d1b700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe38004500 0x7fbe38004980 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7fbe4000a000 tx=0x7fbe40008040).ready entity=mon.0 client_cookie=f1e79338ed4a83bf server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe40013670 con 0x7fbe38004500 2021-06-25T04:55:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe400137d0 con 0x7fbe38004500 2021-06-25T04:55:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5551a700 1 -- 172.21.15.57:0/37965006 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe40013b30 con 0x7fbe38004500 2021-06-25T04:55:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5751e700 1 -- 172.21.15.57:0/37965006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe38004500 msgr2=0x7fbe38004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5751e700 1 --2- 172.21.15.57:0/37965006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe38004500 0x7fbe38004980 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7fbe4000a000 tx=0x7fbe40008040).stop 2021-06-25T04:55:50.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe56d1d700 1 -- 172.21.15.57:0/37965006 reap_dead start 2021-06-25T04:55:50.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5751e700 1 -- 172.21.15.57:0/37965006 shutdown_connections 2021-06-25T04:55:50.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5751e700 1 -- 172.21.15.57:0/37965006 >> 172.21.15.57:0/37965006 conn(0x7fbe500636a0 msgr2=0x7fbe50063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:50.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5751e700 1 -- 172.21.15.57:0/37965006 shutdown_connections 2021-06-25T04:55:50.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.491+0000 7fbe5751e700 1 -- 172.21.15.57:0/37965006 wait complete. 2021-06-25T04:55:50.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5751e700 1 Processor -- start 2021-06-25T04:55:50.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5751e700 1 -- start start 2021-06-25T04:55:50.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5751e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe5014a120 0x7fbe500add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5751e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50151fa0 0x7fbe500af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5751e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500afe90 0x7fbe501554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5751e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5014a500 con 0x7fbe500afe90 2021-06-25T04:55:50.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5751e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500ac980 con 0x7fbe50151fa0 2021-06-25T04:55:50.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5751e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500ab830 con 0x7fbe5014a120 2021-06-25T04:55:50.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe56d1d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500afe90 0x7fbe501554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe56d1d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500afe90 0x7fbe501554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42484/0 (socket says 172.21.15.57:42484) 2021-06-25T04:55:50.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe56d1d700 1 -- 172.21.15.57:0/1793494698 learned_addr learned my addr 172.21.15.57:0/1793494698 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:50.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5651c700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe5014a120 0x7fbe500add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe55d1b700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50151fa0 0x7fbe500af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5651c700 1 -- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50151fa0 msgr2=0x7fbe500af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5651c700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50151fa0 0x7fbe500af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5651c700 1 -- 172.21.15.57:0/1793494698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500afe90 msgr2=0x7fbe501554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5651c700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500afe90 0x7fbe501554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5651c700 1 -- 172.21.15.57:0/1793494698 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500abad0 con 0x7fbe5014a120 2021-06-25T04:55:50.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe56d1d700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500afe90 0x7fbe501554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:50.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.495+0000 7fbe5651c700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe5014a120 0x7fbe500add70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbe4800d000 tx=0x7fbe500604a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:50.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.499+0000 7fbe3f7fe700 1 -- 172.21.15.57:0/1793494698 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe4800fa90 con 0x7fbe5014a120 2021-06-25T04:55:50.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.499+0000 7fbe3f7fe700 1 -- 172.21.15.57:0/1793494698 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4800fbf0 con 0x7fbe5014a120 2021-06-25T04:55:50.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.499+0000 7fbe5751e700 1 -- 172.21.15.57:0/1793494698 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe500abd70 con 0x7fbe5014a120 2021-06-25T04:55:50.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.499+0000 7fbe3f7fe700 1 -- 172.21.15.57:0/1793494698 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe48012350 con 0x7fbe5014a120 2021-06-25T04:55:50.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.499+0000 7fbe5751e700 1 -- 172.21.15.57:0/1793494698 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe500ac350 con 0x7fbe5014a120 2021-06-25T04:55:50.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.499+0000 7fbe5751e700 1 -- 172.21.15.57:0/1793494698 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe50057310 con 0x7fbe5014a120 2021-06-25T04:55:50.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.499+0000 7fbe3f7fe700 1 -- 172.21.15.57:0/1793494698 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbe480124b0 con 0x7fbe5014a120 2021-06-25T04:55:50.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.499+0000 7fbe3f7fe700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe30055490 0x7fbe30057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.499+0000 7fbe3f7fe700 1 -- 172.21.15.57:0/1793494698 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbe4806dd30 con 0x7fbe5014a120 2021-06-25T04:55:50.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.499+0000 7fbe55d1b700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe30055490 0x7fbe30057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.503+0000 7fbe55d1b700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe30055490 0x7fbe30057950 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fbe40019000 tx=0x7fbe40008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:50.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.511+0000 7fbe3f7fe700 1 -- 172.21.15.57:0/1793494698 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbe48043cf0 con 0x7fbe5014a120 2021-06-25T04:55:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.635+0000 7fbe5751e700 1 -- 172.21.15.57:0/1793494698 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbe500698a0 con 0x7fbe5014a120 2021-06-25T04:55:50.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe3f7fe700 1 -- 172.21.15.57:0/1793494698 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbe48019030 con 0x7fbe5014a120 2021-06-25T04:55:50.643 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:50.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 -- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe30055490 msgr2=0x7fbe30057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe30055490 0x7fbe30057950 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fbe40019000 tx=0x7fbe40008040).stop 2021-06-25T04:55:50.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 -- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe5014a120 msgr2=0x7fbe500add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe5014a120 0x7fbe500add70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbe4800d000 tx=0x7fbe500604a0).stop 2021-06-25T04:55:50.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 -- 172.21.15.57:0/1793494698 shutdown_connections 2021-06-25T04:55:50.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbe30055490 0x7fbe30057950 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe500afe90 0x7fbe501554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50151fa0 0x7fbe500af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 --2- 172.21.15.57:0/1793494698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe5014a120 0x7fbe500add70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 -- 172.21.15.57:0/1793494698 >> 172.21.15.57:0/1793494698 conn(0x7fbe500636a0 msgr2=0x7fbe50144bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:50.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 -- 172.21.15.57:0/1793494698 shutdown_connections 2021-06-25T04:55:50.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.639+0000 7fbe5751e700 1 -- 172.21.15.57:0/1793494698 wait complete. 2021-06-25T04:55:50.658 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:55:50.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b90abc700 1 Processor -- start 2021-06-25T04:55:50.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b90abc700 1 -- start start 2021-06-25T04:55:50.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b90abc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1b8c0b6250 0x7f1b8c061430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b90abc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b8c0b4020 0x7f1b8c061920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b90abc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b8c061e10 0x7f1b8c1463f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b90abc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8c0b5f10 con 0x7f1b8c0b4020 2021-06-25T04:55:50.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b90abc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8c0b1f30 con 0x7f1b8c0b6250 2021-06-25T04:55:50.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b90abc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0b21d0 con 0x7f1b8c061e10 2021-06-25T04:55:50.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b8affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b8c0b4020 0x7f1b8c061920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b8affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b8c0b4020 0x7f1b8c061920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42490/0 (socket says 172.21.15.57:42490) 2021-06-25T04:55:50.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b8affd700 1 -- 172.21.15.57:0/3250165229 learned_addr learned my addr 172.21.15.57:0/3250165229 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:50.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b8b7fe700 1 --2- 172.21.15.57:0/3250165229 >> v2:172.21.15.87:3300/0 conn(0x7f1b8c0b6250 0x7f1b8c061430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b8bfff700 1 --2- 172.21.15.57:0/3250165229 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b8c061e10 0x7f1b8c1463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b8affd700 1 -- 172.21.15.57:0/3250165229 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b8c061e10 msgr2=0x7f1b8c1463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:50.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b8affd700 1 --2- 172.21.15.57:0/3250165229 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b8c061e10 0x7f1b8c1463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b8affd700 1 -- 172.21.15.57:0/3250165229 >> v2:172.21.15.87:3300/0 conn(0x7f1b8c0b6250 msgr2=0x7f1b8c061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:50.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b8affd700 1 --2- 172.21.15.57:0/3250165229 >> v2:172.21.15.87:3300/0 conn(0x7f1b8c0b6250 0x7f1b8c061430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b8affd700 1 -- 172.21.15.57:0/3250165229 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c0b2470 con 0x7f1b8c0b4020 2021-06-25T04:55:50.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.767+0000 7f1b8affd700 1 --2- 172.21.15.57:0/3250165229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b8c0b4020 0x7f1b8c061920 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f1b7c002f70 tx=0x7f1b7c006eb0).ready entity=mon.0 client_cookie=a847b99ed8ba7d1e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:50.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8a7fc700 1 -- 172.21.15.57:0/3250165229 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7c00d570 con 0x7f1b8c0b4020 2021-06-25T04:55:50.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8a7fc700 1 -- 172.21.15.57:0/3250165229 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c000e90 con 0x7f1b8c0b4020 2021-06-25T04:55:50.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8a7fc700 1 -- 172.21.15.57:0/3250165229 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7c00d900 con 0x7f1b8c0b4020 2021-06-25T04:55:50.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 -- 172.21.15.57:0/3250165229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b8c0b4020 msgr2=0x7f1b8c061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 --2- 172.21.15.57:0/3250165229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b8c0b4020 0x7f1b8c061920 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f1b7c002f70 tx=0x7f1b7c006eb0).stop 2021-06-25T04:55:50.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 -- 172.21.15.57:0/3250165229 shutdown_connections 2021-06-25T04:55:50.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 --2- 172.21.15.57:0/3250165229 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b8c061e10 0x7f1b8c1463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 --2- 172.21.15.57:0/3250165229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b8c0b4020 0x7f1b8c061920 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 --2- 172.21.15.57:0/3250165229 >> v2:172.21.15.87:3300/0 conn(0x7f1b8c0b6250 0x7f1b8c061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 -- 172.21.15.57:0/3250165229 >> 172.21.15.57:0/3250165229 conn(0x7f1b8c05c450 msgr2=0x7f1b8c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:50.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 -- 172.21.15.57:0/3250165229 shutdown_connections 2021-06-25T04:55:50.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 -- 172.21.15.57:0/3250165229 wait complete. 2021-06-25T04:55:50.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 Processor -- start 2021-06-25T04:55:50.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 -- start start 2021-06-25T04:55:50.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b8c061e10 0x7f1b8c0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b8c0b4020 0x7f1b8c0b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b8c0b6250 0x7f1b8c0ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c13d510 con 0x7f1b8c0b4020 2021-06-25T04:55:50.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c152f30 con 0x7f1b8c0b6250 2021-06-25T04:55:50.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b90abc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c1531d0 con 0x7f1b8c061e10 2021-06-25T04:55:50.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b8c0b4020 0x7f1b8c0b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b8c0b4020 0x7f1b8c0b0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42494/0 (socket says 172.21.15.57:42494) 2021-06-25T04:55:50.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8affd700 1 -- 172.21.15.57:0/3198860998 learned_addr learned my addr 172.21.15.57:0/3198860998 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:50.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8b7fe700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b8c061e10 0x7f1b8c0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8bfff700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b8c0b6250 0x7f1b8c0ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8affd700 1 -- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b8c061e10 msgr2=0x7f1b8c0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8affd700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b8c061e10 0x7f1b8c0b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8affd700 1 -- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b8c0b6250 msgr2=0x7f1b8c0ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8affd700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b8c0b6250 0x7f1b8c0ad710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8affd700 1 -- 172.21.15.57:0/3198860998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c00b1e0 con 0x7f1b8c0b4020 2021-06-25T04:55:50.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b8affd700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b8c0b4020 0x7f1b8c0b0710 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f1b7c002f70 tx=0x7f1b7c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:50.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.771+0000 7f1b88ff9700 1 -- 172.21.15.57:0/3198860998 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7c021070 con 0x7f1b8c0b4020 2021-06-25T04:55:50.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.775+0000 7f1b88ff9700 1 -- 172.21.15.57:0/3198860998 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c000e90 con 0x7f1b8c0b4020 2021-06-25T04:55:50.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.775+0000 7f1b90abc700 1 -- 172.21.15.57:0/3198860998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8c13d700 con 0x7f1b8c0b4020 2021-06-25T04:55:50.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.775+0000 7f1b88ff9700 1 -- 172.21.15.57:0/3198860998 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7c0119d0 con 0x7f1b8c0b4020 2021-06-25T04:55:50.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.775+0000 7f1b90abc700 1 -- 172.21.15.57:0/3198860998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8c143750 con 0x7f1b8c0b4020 2021-06-25T04:55:50.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.775+0000 7f1b90abc700 1 -- 172.21.15.57:0/3198860998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8c153390 con 0x7f1b8c0b4020 2021-06-25T04:55:50.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.775+0000 7f1b88ff9700 1 -- 172.21.15.57:0/3198860998 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1b7c00f070 con 0x7f1b8c0b4020 2021-06-25T04:55:50.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.775+0000 7f1b88ff9700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b6c055490 0x7f1b6c057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:50.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.775+0000 7f1b88ff9700 1 -- 172.21.15.57:0/3198860998 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1b7c06f1e0 con 0x7f1b8c0b4020 2021-06-25T04:55:50.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.779+0000 7f1b8b7fe700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b6c055490 0x7f1b6c057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:50.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.779+0000 7f1b8b7fe700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b6c055490 0x7f1b6c057950 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f1b8000c000 tx=0x7f1b80008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:50.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.783+0000 7f1b88ff9700 1 -- 172.21.15.57:0/3198860998 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1b7c045390 con 0x7f1b8c0b4020 2021-06-25T04:55:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.915+0000 7f1b90abc700 1 -- 172.21.15.57:0/3198860998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b8c13d8c0 con 0x7f1b8c0b4020 2021-06-25T04:55:50.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.915+0000 7f1b88ff9700 1 -- 172.21.15.57:0/3198860998 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1b7c0489b0 con 0x7f1b8c0b4020 2021-06-25T04:55:50.921 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:50.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 -- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b6c055490 msgr2=0x7f1b6c057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b6c055490 0x7f1b6c057950 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f1b8000c000 tx=0x7f1b80008040).stop 2021-06-25T04:55:50.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 -- 172.21.15.57:0/3198860998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b8c0b4020 msgr2=0x7f1b8c0b0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:50.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b8c0b4020 0x7f1b8c0b0710 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f1b7c002f70 tx=0x7f1b7c015000).stop 2021-06-25T04:55:50.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 -- 172.21.15.57:0/3198860998 shutdown_connections 2021-06-25T04:55:50.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1b6c055490 0x7f1b6c057950 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b8c0b6250 0x7f1b8c0ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b8c0b4020 0x7f1b8c0b0710 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 --2- 172.21.15.57:0/3198860998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b8c061e10 0x7f1b8c0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:50.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 -- 172.21.15.57:0/3198860998 >> 172.21.15.57:0/3198860998 conn(0x7f1b8c05c450 msgr2=0x7f1b8c0b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:50.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 -- 172.21.15.57:0/3198860998 shutdown_connections 2021-06-25T04:55:50.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:50.919+0000 7f1b90abc700 1 -- 172.21.15.57:0/3198860998 wait complete. 2021-06-25T04:55:50.934 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:55:51.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.035+0000 7fb37d38b700 1 Processor -- start 2021-06-25T04:55:51.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.035+0000 7fb37d38b700 1 -- start start 2021-06-25T04:55:51.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3780b1290 0x7fb3780aff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3780b2260 0x7fb378141210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3780a7790 con 0x7fb3780b1e80 2021-06-25T04:55:51.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3780b1700 con 0x7fb3780b1290 2021-06-25T04:55:51.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780b0610 con 0x7fb3780b2260 2021-06-25T04:55:51.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb376ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb3780b1e80 0x7fb3780a7080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59720/0 (socket says 172.21.15.57:59720) 2021-06-25T04:55:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb376ffd700 1 -- 172.21.15.57:0/2742254256 learned_addr learned my addr 172.21.15.57:0/2742254256 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb3767fc700 1 --2- 172.21.15.57:0/2742254256 >> v2:172.21.15.87:3300/0 conn(0x7fb3780b1290 0x7fb3780aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb3777fe700 1 --2- 172.21.15.57:0/2742254256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3780b2260 0x7fb378141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb375ffb700 1 -- 172.21.15.57:0/2742254256 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834283893 0 0) 0x7fb3780a7790 con 0x7fb3780b1e80 2021-06-25T04:55:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb375ffb700 1 -- 172.21.15.57:0/2742254256 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb358003260 con 0x7fb3780b1e80 2021-06-25T04:55:51.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb375ffb700 1 -- 172.21.15.57:0/2742254256 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 231102587 0 0) 0x7fb358003260 con 0x7fb3780b1e80 2021-06-25T04:55:51.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb3767fc700 1 -- 172.21.15.57:0/2742254256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3780b2260 msgr2=0x7fb378141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:51.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb3767fc700 1 --2- 172.21.15.57:0/2742254256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3780b2260 0x7fb378141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb3767fc700 1 -- 172.21.15.57:0/2742254256 >> v1:172.21.15.57:6789/0 conn(0x7fb3780b1e80 legacy=0x7fb3780a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb3767fc700 1 -- 172.21.15.57:0/2742254256 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3780b08b0 con 0x7fb3780b1290 2021-06-25T04:55:51.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb3767fc700 1 --2- 172.21.15.57:0/2742254256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3780b1290 0x7fb3780aff70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fb360001800 tx=0x7fb368006df0).ready entity=mon.1 client_cookie=344e95a4554b2801 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:51.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb375ffb700 1 -- 172.21.15.57:0/2742254256 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb360001660 con 0x7fb3780b1290 2021-06-25T04:55:51.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb375ffb700 1 -- 172.21.15.57:0/2742254256 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb368000e90 con 0x7fb3780b1290 2021-06-25T04:55:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb375ffb700 1 -- 172.21.15.57:0/2742254256 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb368012460 con 0x7fb3780b1290 2021-06-25T04:55:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 -- 172.21.15.57:0/2742254256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3780b1290 msgr2=0x7fb3780aff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 --2- 172.21.15.57:0/2742254256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3780b1290 0x7fb3780aff70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fb360001800 tx=0x7fb368006df0).stop 2021-06-25T04:55:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 -- 172.21.15.57:0/2742254256 shutdown_connections 2021-06-25T04:55:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 --2- 172.21.15.57:0/2742254256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3780b2260 0x7fb378141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 --2- 172.21.15.57:0/2742254256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3780b1290 0x7fb3780aff70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 -- 172.21.15.57:0/2742254256 >> 172.21.15.57:0/2742254256 conn(0x7fb37805f670 msgr2=0x7fb37805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 -- 172.21.15.57:0/2742254256 shutdown_connections 2021-06-25T04:55:51.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.039+0000 7fb37d38b700 1 -- 172.21.15.57:0/2742254256 wait complete. 2021-06-25T04:55:51.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb37d38b700 1 Processor -- start 2021-06-25T04:55:51.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb37d38b700 1 -- start start 2021-06-25T04:55:51.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb37d38b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3780b1290 0x7fb3780aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb37d38b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3780b1e80 0x7fb378156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb37d38b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3780b2260 0x7fb378156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb37d38b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb378157010 con 0x7fb3780b1290 2021-06-25T04:55:51.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb37d38b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37815a920 con 0x7fb3780b1e80 2021-06-25T04:55:51.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb37d38b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37814b240 con 0x7fb3780b2260 2021-06-25T04:55:51.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb376ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3780b1290 0x7fb3780aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb376ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3780b1290 0x7fb3780aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42506/0 (socket says 172.21.15.57:42506) 2021-06-25T04:55:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb376ffd700 1 -- 172.21.15.57:0/2960875652 learned_addr learned my addr 172.21.15.57:0/2960875652 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb3777fe700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3780b2260 0x7fb378156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb3767fc700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3780b1e80 0x7fb378156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb376ffd700 1 -- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3780b2260 msgr2=0x7fb378156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb376ffd700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3780b2260 0x7fb378156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb376ffd700 1 -- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3780b1e80 msgr2=0x7fb378156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb376ffd700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3780b1e80 0x7fb378156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb376ffd700 1 -- 172.21.15.57:0/2960875652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36800b180 con 0x7fb3780b1290 2021-06-25T04:55:51.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb376ffd700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3780b1290 0x7fb3780aef30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7fb3600018c0 tx=0x7fb360001230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:51.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb36ffff700 1 -- 172.21.15.57:0/2960875652 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb360007170 con 0x7fb3780b1290 2021-06-25T04:55:51.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb37d38b700 1 -- 172.21.15.57:0/2960875652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37814b4e0 con 0x7fb3780b1290 2021-06-25T04:55:51.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb37d38b700 1 -- 172.21.15.57:0/2960875652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37815a610 con 0x7fb3780b1290 2021-06-25T04:55:51.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb36ffff700 1 -- 172.21.15.57:0/2960875652 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3600072d0 con 0x7fb3780b1290 2021-06-25T04:55:51.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.043+0000 7fb36ffff700 1 -- 172.21.15.57:0/2960875652 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb360001b60 con 0x7fb3780b1290 2021-06-25T04:55:51.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.047+0000 7fb37d38b700 1 -- 172.21.15.57:0/2960875652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb350003410 con 0x7fb3780b1290 2021-06-25T04:55:51.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.047+0000 7fb36ffff700 1 -- 172.21.15.57:0/2960875652 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb36001b070 con 0x7fb3780b1290 2021-06-25T04:55:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.047+0000 7fb36ffff700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb35c055450 0x7fb35c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.047+0000 7fb36ffff700 1 -- 172.21.15.57:0/2960875652 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb36006d6e0 con 0x7fb3780b1290 2021-06-25T04:55:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.047+0000 7fb3767fc700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb35c055450 0x7fb35c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.047+0000 7fb3767fc700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb35c055450 0x7fb35c057910 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fb368019000 tx=0x7fb368014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:51.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.055+0000 7fb36ffff700 1 -- 172.21.15.57:0/2960875652 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb360043700 con 0x7fb3780b1290 2021-06-25T04:55:51.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 -- 172.21.15.57:0/2960875652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb350003c40 con 0x7fb3780b1290 2021-06-25T04:55:51.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb36ffff700 1 -- 172.21.15.57:0/2960875652 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb360046d20 con 0x7fb3780b1290 2021-06-25T04:55:51.187 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:51.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 -- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb35c055450 msgr2=0x7fb35c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb35c055450 0x7fb35c057910 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fb368019000 tx=0x7fb368014000).stop 2021-06-25T04:55:51.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 -- 172.21.15.57:0/2960875652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3780b1290 msgr2=0x7fb3780aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3780b1290 0x7fb3780aef30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7fb3600018c0 tx=0x7fb360001230).stop 2021-06-25T04:55:51.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 -- 172.21.15.57:0/2960875652 shutdown_connections 2021-06-25T04:55:51.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb35c055450 0x7fb35c057910 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3780b2260 0x7fb378156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3780b1e80 0x7fb378156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 --2- 172.21.15.57:0/2960875652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3780b1290 0x7fb3780aef30 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 -- 172.21.15.57:0/2960875652 >> 172.21.15.57:0/2960875652 conn(0x7fb37805f670 msgr2=0x7fb37805bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:51.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 -- 172.21.15.57:0/2960875652 shutdown_connections 2021-06-25T04:55:51.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.183+0000 7fb37d38b700 1 -- 172.21.15.57:0/2960875652 wait complete. 2021-06-25T04:55:51.204 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:55:51.205 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:51.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0e04f68700 1 Processor -- start 2021-06-25T04:55:51.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0e04f68700 1 -- start start 2021-06-25T04:55:51.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0e04f68700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e00067140 0x7f0e0005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0e04f68700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0e000b1930 0x7f0e0005fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0e04f68700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e000a7a50 con 0x7f0e000a7670 2021-06-25T04:55:51.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0e04f68700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e001475e0 con 0x7f0e00067140 2021-06-25T04:55:51.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0e04f68700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e00147880 con 0x7f0e000b1930 2021-06-25T04:55:51.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0dfe59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0e000a7670 0x7f0e00066a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59732/0 (socket says 172.21.15.57:59732) 2021-06-25T04:55:51.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0dfe59c700 1 -- 172.21.15.57:0/457169698 learned_addr learned my addr 172.21.15.57:0/457169698 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:51.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0dfdd9b700 1 --2- 172.21.15.57:0/457169698 >> v2:172.21.15.57:3300/0 conn(0x7f0e00067140 0x7f0e0005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0dfed9d700 1 --2- 172.21.15.57:0/457169698 >> v2:172.21.15.87:3300/0 conn(0x7f0e000b1930 0x7f0e0005fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0dfd59a700 1 -- 172.21.15.57:0/457169698 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951865589 0 0) 0x7f0e000a7a50 con 0x7f0e000a7670 2021-06-25T04:55:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0dfd59a700 1 -- 172.21.15.57:0/457169698 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de4003260 con 0x7f0e000a7670 2021-06-25T04:55:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0dfd59a700 1 -- 172.21.15.57:0/457169698 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3677718121 0 0) 0x7f0de4003260 con 0x7f0e000a7670 2021-06-25T04:55:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0dfdd9b700 1 -- 172.21.15.57:0/457169698 >> v2:172.21.15.87:3300/0 conn(0x7f0e000b1930 msgr2=0x7f0e0005fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:51.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.303+0000 7f0dfdd9b700 1 --2- 172.21.15.57:0/457169698 >> v2:172.21.15.87:3300/0 conn(0x7f0e000b1930 0x7f0e0005fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0dfdd9b700 1 -- 172.21.15.57:0/457169698 >> v1:172.21.15.57:6789/0 conn(0x7f0e000a7670 legacy=0x7f0e00066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0dfdd9b700 1 -- 172.21.15.57:0/457169698 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e00147b20 con 0x7f0e00067140 2021-06-25T04:55:51.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0dfed9d700 1 --2- 172.21.15.57:0/457169698 >> v2:172.21.15.87:3300/0 conn(0x7f0e000b1930 0x7f0e0005fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:51.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0dfdd9b700 1 --2- 172.21.15.57:0/457169698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e00067140 0x7f0e0005f670 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f0df8001b80 tx=0x7f0df4006df0).ready entity=mon.0 client_cookie=296b732274fa9d42 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:51.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0dfd59a700 1 -- 172.21.15.57:0/457169698 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0df80019e0 con 0x7f0e00067140 2021-06-25T04:55:51.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0dfd59a700 1 -- 172.21.15.57:0/457169698 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df4000e90 con 0x7f0e00067140 2021-06-25T04:55:51.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0dfd59a700 1 -- 172.21.15.57:0/457169698 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0df4012460 con 0x7f0e00067140 2021-06-25T04:55:51.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 -- 172.21.15.57:0/457169698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e00067140 msgr2=0x7f0e0005f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 --2- 172.21.15.57:0/457169698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e00067140 0x7f0e0005f670 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f0df8001b80 tx=0x7f0df4006df0).stop 2021-06-25T04:55:51.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 -- 172.21.15.57:0/457169698 shutdown_connections 2021-06-25T04:55:51.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 --2- 172.21.15.57:0/457169698 >> v2:172.21.15.87:3300/0 conn(0x7f0e000b1930 0x7f0e0005fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 --2- 172.21.15.57:0/457169698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e00067140 0x7f0e0005f670 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 -- 172.21.15.57:0/457169698 >> 172.21.15.57:0/457169698 conn(0x7f0e000b53a0 msgr2=0x7f0e000b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:51.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 -- 172.21.15.57:0/457169698 shutdown_connections 2021-06-25T04:55:51.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 -- 172.21.15.57:0/457169698 wait complete. 2021-06-25T04:55:51.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 Processor -- start 2021-06-25T04:55:51.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 -- start start 2021-06-25T04:55:51.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e00067140 0x7f0e000abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e000a7670 0x7f0e000ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e000b1930 0x7f0e000adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e00156630 con 0x7f0e000a7670 2021-06-25T04:55:51.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000ae410 con 0x7f0e000b1930 2021-06-25T04:55:51.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.307+0000 7f0e04f68700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000acb80 con 0x7f0e00067140 2021-06-25T04:55:51.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfdd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e000a7670 0x7f0e000ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfe59c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e00067140 0x7f0e000abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfdd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e000a7670 0x7f0e000ac4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42522/0 (socket says 172.21.15.57:42522) 2021-06-25T04:55:51.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e000b1930 0x7f0e000adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfdd9b700 1 -- 172.21.15.57:0/3219611567 learned_addr learned my addr 172.21.15.57:0/3219611567 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:51.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfe59c700 1 -- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e000b1930 msgr2=0x7f0e000adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfe59c700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e000b1930 0x7f0e000adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfe59c700 1 -- 172.21.15.57:0/3219611567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e000a7670 msgr2=0x7f0e000ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfe59c700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e000a7670 0x7f0e000ac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfe59c700 1 -- 172.21.15.57:0/3219611567 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df000b180 con 0x7f0e00067140 2021-06-25T04:55:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfdd9b700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e000a7670 0x7f0e000ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:51.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0dfe59c700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e00067140 0x7f0e000abb20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f0df8001c40 tx=0x7f0df8002180).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:51.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0def7fe700 1 -- 172.21.15.57:0/3219611567 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0df8004ab0 con 0x7f0e00067140 2021-06-25T04:55:51.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0def7fe700 1 -- 172.21.15.57:0/3219611567 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df8004c10 con 0x7f0e00067140 2021-06-25T04:55:51.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0e04f68700 1 -- 172.21.15.57:0/3219611567 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df400b180 con 0x7f0e00067140 2021-06-25T04:55:51.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0def7fe700 1 -- 172.21.15.57:0/3219611567 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0df8007170 con 0x7f0e00067140 2021-06-25T04:55:51.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.311+0000 7f0e04f68700 1 -- 172.21.15.57:0/3219611567 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e00156ac0 con 0x7f0e00067140 2021-06-25T04:55:51.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.315+0000 7f0e04f68700 1 -- 172.21.15.57:0/3219611567 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e00156c80 con 0x7f0e00067140 2021-06-25T04:55:51.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.315+0000 7f0def7fe700 1 -- 172.21.15.57:0/3219611567 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0df801b070 con 0x7f0e00067140 2021-06-25T04:55:51.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.315+0000 7f0def7fe700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ddc0554e0 0x7f0ddc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:51.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.315+0000 7f0def7fe700 1 -- 172.21.15.57:0/3219611567 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0df806d7c0 con 0x7f0e00067140 2021-06-25T04:55:51.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.315+0000 7f0dfdd9b700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ddc0554e0 0x7f0ddc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:51.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.315+0000 7f0dfdd9b700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ddc0554e0 0x7f0ddc0579a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0df4019000 tx=0x7f0df4014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:51.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.323+0000 7f0def7fe700 1 -- 172.21.15.57:0/3219611567 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0df80438d0 con 0x7f0e00067140 2021-06-25T04:55:51.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.491+0000 7f0e04f68700 1 -- 172.21.15.57:0/3219611567 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e00057310 con 0x7f0e00067140 2021-06-25T04:55:51.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.491+0000 7f0def7fe700 1 -- 172.21.15.57:0/3219611567 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f0df8046ef0 con 0x7f0e00067140 2021-06-25T04:55:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:51.500 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3329717460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329717460},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329717460}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57},{"gid":7537,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2255831830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2255831830},{"type":"v1","addr":"172.21.15.57:6833","nonce":2255831830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:55:46.830590+0000","modified":"2021-06-25T04:55:47.833713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7659":{"gid":7659,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/863055178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":863055178},{"type":"v1","addr":"172.21.15.57:6835","nonce":863055178}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-06-25T04:55:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 -- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ddc0554e0 msgr2=0x7f0ddc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ddc0554e0 0x7f0ddc0579a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0df4019000 tx=0x7f0df4014000).stop 2021-06-25T04:55:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 -- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e00067140 msgr2=0x7f0e000abb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e00067140 0x7f0e000abb20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f0df8001c40 tx=0x7f0df8002180).stop 2021-06-25T04:55:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 -- 172.21.15.57:0/3219611567 shutdown_connections 2021-06-25T04:55:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0ddc0554e0 0x7f0ddc0579a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e000b1930 0x7f0e000adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e000a7670 0x7f0e000ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 --2- 172.21.15.57:0/3219611567 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e00067140 0x7f0e000abb20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:51.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 -- 172.21.15.57:0/3219611567 >> 172.21.15.57:0/3219611567 conn(0x7f0e000b53a0 msgr2=0x7f0e001489c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:51.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 -- 172.21.15.57:0/3219611567 shutdown_connections 2021-06-25T04:55:51.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:51.495+0000 7f0e04f68700 1 -- 172.21.15.57:0/3219611567 wait complete. 2021-06-25T04:55:51.504 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 59 2021-06-25T04:55:51.815 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:55:46.830590+0000', 'modified': '2021-06-25T04:55:47.833713+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7659}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7659': {'gid': 7659, 'name': 'a', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/863055178', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 863055178}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 863055178}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:55:51.815 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:55:51.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:55:51.939 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":7659,"want_state":"up:active","state":"up:active","rank_uptime":5.091673911,"mdsmap_epoch":59,"osdmap_epoch":118,"osdmap_epoch_barrier":117,"uptime":9.4535014579999999} 2021-06-25T04:55:51.940 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 7659, "mdsmap_epoch": 59, "osdmap_epoch": 118, "osdmap_epoch_barrier": 117, "rank_uptime": 5.091673911, "state": "up:active", "uptime": 9.453501458, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:55:51.940 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:55:51.941 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:55:51.941 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:55:51.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:51.942 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:51.951 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:55:52.010 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:52.010 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:52.025 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:52.026 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:52.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:52.028 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:55:52.035 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:55:52.035 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:52.038 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:55:52.053 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:52.053 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:52.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:55:52.101+0000 7f4429786080 -1 init, newargv = 0x558f2158e8c0 newargc=9 2021-06-25T04:55:52.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15430]: starting ceph client 2021-06-25T04:55:52.115 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:52.116 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:52.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:52.117 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:55:52.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15430]: starting fuse 2021-06-25T04:55:52.123 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:55:52.123 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:55:52.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:52.124 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:55:52.125 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:55:52.125 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:55:52.126 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:55:52.126 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:55:52.127 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:52.127 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:55:52.128 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:55:52.128 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:55:52.129 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:52.129 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:55:52.129 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:55:52.130 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:55:52.130 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:55:52.131 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:52.131 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:55:52.132 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:55:52.132 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:55:52.132 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:55:52.133 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:55:52.133 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:55:52.134 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:55:52.134 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:55:52.174 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.15430.asok 2021-06-25T04:55:52.178 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15430.asok 2021-06-25T04:55:52.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:52.179 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15430.asok status 2021-06-25T04:55:52.310 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:55:52.310 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:55:52.310 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:55:52.311 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:55:52.311 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:55:52.311 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:55:52.312 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:55:52.312 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "15430", 2021-06-25T04:55:52.312 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:55:52.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:52.313 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:55:52.313 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:55:52.313 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 7824, 2021-06-25T04:55:52.313 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:55:52.314 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:55:52.314 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:55:52.314 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 7824 2021-06-25T04:55:52.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:52.314 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:55:52.315 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:55:52.315 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:55:52.315 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2118719997 2021-06-25T04:55:52.315 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:55:52.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:52.316 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:55:52.316 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:55:52.316 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:55:52.316 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2118719997 2021-06-25T04:55:52.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:55:52.317 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.7824 172.21.15.102:0/2118719997", 2021-06-25T04:55:52.317 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/2118719997", 2021-06-25T04:55:52.317 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:55:52.318 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 59, 2021-06-25T04:55:52.318 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 118, 2021-06-25T04:55:52.318 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:55:52.318 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:55:52.318 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:55:52.319 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:55:52.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:52.320 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:52.321 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:52.338 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:55:52.339 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:55:52.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:52.340 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:52.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:55:52.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f5120cf2700 1 Processor -- start 2021-06-25T04:55:52.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f5120cf2700 1 -- start start 2021-06-25T04:55:52.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f5120cf2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511c0b5460 0x7f511c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f5120cf2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f511c0b05d0 0x7f511c147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f5120cf2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f511c067560 0x7f511c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f5120cf2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c1452a0 con 0x7f511c0b05d0 2021-06-25T04:55:52.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f5120cf2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c0adfb0 con 0x7f511c067560 2021-06-25T04:55:52.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f5120cf2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0b5840 con 0x7f511c0b5460 2021-06-25T04:55:52.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f511affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f511c0b05d0 0x7f511c147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f511affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f511c0b05d0 0x7f511c147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42528/0 (socket says 172.21.15.57:42528) 2021-06-25T04:55:52.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f511affd700 1 -- 172.21.15.57:0/2988367474 learned_addr learned my addr 172.21.15.57:0/2988367474 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:52.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f511bfff700 1 --2- 172.21.15.57:0/2988367474 >> v2:172.21.15.87:3300/0 conn(0x7f511c067560 0x7f511c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.511+0000 7f511b7fe700 1 --2- 172.21.15.57:0/2988367474 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511c0b5460 0x7f511c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f511affd700 1 -- 172.21.15.57:0/2988367474 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511c0b5460 msgr2=0x7f511c0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:52.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f511affd700 1 --2- 172.21.15.57:0/2988367474 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511c0b5460 0x7f511c0af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f511affd700 1 -- 172.21.15.57:0/2988367474 >> v2:172.21.15.87:3300/0 conn(0x7f511c067560 msgr2=0x7f511c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:52.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f511affd700 1 --2- 172.21.15.57:0/2988367474 >> v2:172.21.15.87:3300/0 conn(0x7f511c067560 0x7f511c0acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f511affd700 1 -- 172.21.15.57:0/2988367474 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c0ac7c0 con 0x7f511c0b05d0 2021-06-25T04:55:52.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f511affd700 1 --2- 172.21.15.57:0/2988367474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f511c0b05d0 0x7f511c147560 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f510c002f70 tx=0x7f510c006eb0).ready entity=mon.0 client_cookie=f37f025a60eec990 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:52.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f511a7fc700 1 -- 172.21.15.57:0/2988367474 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510c00d570 con 0x7f511c0b05d0 2021-06-25T04:55:52.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f511a7fc700 1 -- 172.21.15.57:0/2988367474 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c000e90 con 0x7f511c0b05d0 2021-06-25T04:55:52.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f511a7fc700 1 -- 172.21.15.57:0/2988367474 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510c00d900 con 0x7f511c0b05d0 2021-06-25T04:55:52.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f5120cf2700 1 -- 172.21.15.57:0/2988367474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f511c0b05d0 msgr2=0x7f511c147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f5120cf2700 1 --2- 172.21.15.57:0/2988367474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f511c0b05d0 0x7f511c147560 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f510c002f70 tx=0x7f510c006eb0).stop 2021-06-25T04:55:52.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f5120cf2700 1 -- 172.21.15.57:0/2988367474 shutdown_connections 2021-06-25T04:55:52.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f5120cf2700 1 --2- 172.21.15.57:0/2988367474 >> v2:172.21.15.87:3300/0 conn(0x7f511c067560 0x7f511c0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f5120cf2700 1 --2- 172.21.15.57:0/2988367474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f511c0b05d0 0x7f511c147560 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f5120cf2700 1 --2- 172.21.15.57:0/2988367474 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511c0b5460 0x7f511c0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f5120cf2700 1 -- 172.21.15.57:0/2988367474 >> 172.21.15.57:0/2988367474 conn(0x7f511c062520 msgr2=0x7f511c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:52.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f5120cf2700 1 -- 172.21.15.57:0/2988367474 shutdown_connections 2021-06-25T04:55:52.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.515+0000 7f5120cf2700 1 -- 172.21.15.57:0/2988367474 wait complete. 2021-06-25T04:55:52.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f5120cf2700 1 Processor -- start 2021-06-25T04:55:52.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f5120cf2700 1 -- start start 2021-06-25T04:55:52.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f5120cf2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511c067560 0x7f511c147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f5120cf2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f511c0b05d0 0x7f511c157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f5120cf2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f511c0b5460 0x7f511c0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f5120cf2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c1415a0 con 0x7f511c0b5460 2021-06-25T04:55:52.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f5120cf2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c1476b0 con 0x7f511c0b05d0 2021-06-25T04:55:52.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f5120cf2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c156680 con 0x7f511c067560 2021-06-25T04:55:52.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f511bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f511c0b5460 0x7f511c0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f511b7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511c067560 0x7f511c147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f511bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f511c0b5460 0x7f511c0b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42538/0 (socket says 172.21.15.57:42538) 2021-06-25T04:55:52.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f511bfff700 1 -- 172.21.15.57:0/3639657836 learned_addr learned my addr 172.21.15.57:0/3639657836 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:52.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f511affd700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f511c0b05d0 0x7f511c157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f511bfff700 1 -- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511c067560 msgr2=0x7f511c147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f511bfff700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511c067560 0x7f511c147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f511bfff700 1 -- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f511c0b05d0 msgr2=0x7f511c157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f511bfff700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f511c0b05d0 0x7f511c157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f511bfff700 1 -- 172.21.15.57:0/3639657836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c00b1e0 con 0x7f511c0b5460 2021-06-25T04:55:52.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.519+0000 7f511bfff700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f511c0b5460 0x7f511c0b4950 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f5114006e00 tx=0x7f51140091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:52.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.523+0000 7f5118ff9700 1 -- 172.21.15.57:0/3639657836 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511400c640 con 0x7f511c0b5460 2021-06-25T04:55:52.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.523+0000 7f5118ff9700 1 -- 172.21.15.57:0/3639657836 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511400c7a0 con 0x7f511c0b5460 2021-06-25T04:55:52.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.523+0000 7f5120cf2700 1 -- 172.21.15.57:0/3639657836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c156920 con 0x7f511c0b5460 2021-06-25T04:55:52.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.523+0000 7f5118ff9700 1 -- 172.21.15.57:0/3639657836 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f511400cb00 con 0x7f511c0b5460 2021-06-25T04:55:52.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.523+0000 7f5120cf2700 1 -- 172.21.15.57:0/3639657836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c0b4e40 con 0x7f511c0b5460 2021-06-25T04:55:52.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.523+0000 7f5120cf2700 1 -- 172.21.15.57:0/3639657836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c057310 con 0x7f511c0b5460 2021-06-25T04:55:52.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.523+0000 7f5118ff9700 1 -- 172.21.15.57:0/3639657836 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f511400cc60 con 0x7f511c0b5460 2021-06-25T04:55:52.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.523+0000 7f5118ff9700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50fc0553f0 0x7f50fc0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.523+0000 7f5118ff9700 1 -- 172.21.15.57:0/3639657836 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f511406e160 con 0x7f511c0b5460 2021-06-25T04:55:52.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.523+0000 7f511b7fe700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50fc0553f0 0x7f50fc0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.527+0000 7f511b7fe700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50fc0553f0 0x7f50fc0578b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f511000b000 tx=0x7f5110006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:52.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.531+0000 7f5118ff9700 1 -- 172.21.15.57:0/3639657836 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5114044270 con 0x7f511c0b5460 2021-06-25T04:55:52.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.675+0000 7f5120cf2700 1 -- 172.21.15.57:0/3639657836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f511c156dc0 con 0x7f511c0b5460 2021-06-25T04:55:52.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5118ff9700 1 -- 172.21.15.57:0/3639657836 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f5114047890 con 0x7f511c0b5460 2021-06-25T04:55:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:52.684 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":118,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:55:47.834493+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:55:45.280146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-06-25T04:55:46.105368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:55:52.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 -- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50fc0553f0 msgr2=0x7f50fc0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50fc0553f0 0x7f50fc0578b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f511000b000 tx=0x7f5110006df0).stop 2021-06-25T04:55:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 -- 172.21.15.57:0/3639657836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f511c0b5460 msgr2=0x7f511c0b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f511c0b5460 0x7f511c0b4950 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f5114006e00 tx=0x7f51140091d0).stop 2021-06-25T04:55:52.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 -- 172.21.15.57:0/3639657836 shutdown_connections 2021-06-25T04:55:52.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50fc0553f0 0x7f50fc0578b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f511c0b5460 0x7f511c0b4950 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f511c0b05d0 0x7f511c157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 --2- 172.21.15.57:0/3639657836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511c067560 0x7f511c147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 -- 172.21.15.57:0/3639657836 >> 172.21.15.57:0/3639657836 conn(0x7f511c062520 msgr2=0x7f511c0af460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:52.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 -- 172.21.15.57:0/3639657836 shutdown_connections 2021-06-25T04:55:52.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.679+0000 7f5120cf2700 1 -- 172.21.15.57:0/3639657836 wait complete. 2021-06-25T04:55:52.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:55:45.280146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:55:46.105368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:55:52.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:55:52.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcf38d700 1 Processor -- start 2021-06-25T04:55:52.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcf38d700 1 -- start start 2021-06-25T04:55:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcf38d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc8144660 0x7fcbc8144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcf38d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc80b5e00 con 0x7fcbc80b37b0 2021-06-25T04:55:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcf38d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc8148460 con 0x7fcbc80b4140 2021-06-25T04:55:52.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcf38d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80b3b90 con 0x7fcbc8144660 2021-06-25T04:55:52.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcd129700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcbc80b37b0 0x7fcbc8147d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59760/0 (socket says 172.21.15.57:59760) 2021-06-25T04:55:52.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcd129700 1 -- 172.21.15.57:0/115272054 learned_addr learned my addr 172.21.15.57:0/115272054 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:52.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcc928700 1 --2- 172.21.15.57:0/115272054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc8144660 0x7fcbc8144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbbffff700 1 -- 172.21.15.57:0/115272054 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926325936 0 0) 0x7fcbc80b5e00 con 0x7fcbc80b37b0 2021-06-25T04:55:52.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbbffff700 1 -- 172.21.15.57:0/115272054 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbac003260 con 0x7fcbc80b37b0 2021-06-25T04:55:52.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcc928700 1 -- 172.21.15.57:0/115272054 >> v1:172.21.15.87:6789/0 conn(0x7fcbc80b4140 legacy=0x7fcbc80b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcc928700 1 -- 172.21.15.57:0/115272054 >> v1:172.21.15.57:6789/0 conn(0x7fcbc80b37b0 legacy=0x7fcbc8147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcc928700 1 -- 172.21.15.57:0/115272054 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc80b4ce0 con 0x7fcbc8144660 2021-06-25T04:55:52.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcc928700 1 --2- 172.21.15.57:0/115272054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc8144660 0x7fcbc8144aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fcbb8002f70 tx=0x7fcbb8006df0).ready entity=mon.2 client_cookie=6b6d3b07f2c9dec0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbbffff700 1 -- 172.21.15.57:0/115272054 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbb800d570 con 0x7fcbc8144660 2021-06-25T04:55:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbbffff700 1 -- 172.21.15.57:0/115272054 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb8000e90 con 0x7fcbc8144660 2021-06-25T04:55:52.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbbffff700 1 -- 172.21.15.57:0/115272054 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbb800d8c0 con 0x7fcbc8144660 2021-06-25T04:55:52.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcf38d700 1 -- 172.21.15.57:0/115272054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc8144660 msgr2=0x7fcbc8144aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.803+0000 7fcbcf38d700 1 --2- 172.21.15.57:0/115272054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc8144660 0x7fcbc8144aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fcbb8002f70 tx=0x7fcbb8006df0).stop 2021-06-25T04:55:52.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 -- 172.21.15.57:0/115272054 shutdown_connections 2021-06-25T04:55:52.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 --2- 172.21.15.57:0/115272054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc8144660 0x7fcbc8144aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 -- 172.21.15.57:0/115272054 >> 172.21.15.57:0/115272054 conn(0x7fcbc805c450 msgr2=0x7fcbc805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:52.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 -- 172.21.15.57:0/115272054 shutdown_connections 2021-06-25T04:55:52.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 -- 172.21.15.57:0/115272054 wait complete. 2021-06-25T04:55:52.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 Processor -- start 2021-06-25T04:55:52.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 -- start start 2021-06-25T04:55:52.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc80b37b0 0x7fcbc80b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc80b4140 0x7fcbc8156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc8144660 0x7fcbc80ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80b7d50 con 0x7fcbc8144660 2021-06-25T04:55:52.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80b7ff0 con 0x7fcbc80b4140 2021-06-25T04:55:52.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.807+0000 7fcbcf38d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80b8290 con 0x7fcbc80b37b0 2021-06-25T04:55:52.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcd129700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc80b37b0 0x7fcbc80b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcd129700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc80b37b0 0x7fcbc80b89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:53712/0 (socket says 172.21.15.57:53712) 2021-06-25T04:55:52.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcd92a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc8144660 0x7fcbc80ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcd129700 1 -- 172.21.15.57:0/1984873525 learned_addr learned my addr 172.21.15.57:0/1984873525 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:52.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcc928700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc80b4140 0x7fcbc8156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcd92a700 1 -- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc80b37b0 msgr2=0x7fcbc80b89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcd92a700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc80b37b0 0x7fcbc80b89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcd92a700 1 -- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc80b4140 msgr2=0x7fcbc8156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcd92a700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc80b4140 0x7fcbc8156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcd92a700 1 -- 172.21.15.57:0/1984873525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb800b180 con 0x7fcbc8144660 2021-06-25T04:55:52.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcd129700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc80b37b0 0x7fcbc80b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:52.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcd92a700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc8144660 0x7fcbc80ae580 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fcbc8060c10 tx=0x7fcbc0007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:52.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbbe7fc700 1 -- 172.21.15.57:0/1984873525 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc000f470 con 0x7fcbc8144660 2021-06-25T04:55:52.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbbe7fc700 1 -- 172.21.15.57:0/1984873525 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc000f5d0 con 0x7fcbc8144660 2021-06-25T04:55:52.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbbe7fc700 1 -- 172.21.15.57:0/1984873525 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc000f930 con 0x7fcbc8144660 2021-06-25T04:55:52.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcf38d700 1 -- 172.21.15.57:0/1984873525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc80b8530 con 0x7fcbc8144660 2021-06-25T04:55:52.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcf38d700 1 -- 172.21.15.57:0/1984873525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc80b77f0 con 0x7fcbc8144660 2021-06-25T04:55:52.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbcf38d700 1 -- 172.21.15.57:0/1984873525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc80b86c0 con 0x7fcbc8144660 2021-06-25T04:55:52.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.811+0000 7fcbbe7fc700 1 -- 172.21.15.57:0/1984873525 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcbc0010070 con 0x7fcbc8144660 2021-06-25T04:55:52.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.815+0000 7fcbbe7fc700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbb0055340 0x7fcbb0057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:52.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.815+0000 7fcbbe7fc700 1 -- 172.21.15.57:0/1984873525 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcbc006d1e0 con 0x7fcbc8144660 2021-06-25T04:55:52.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.815+0000 7fcbcd129700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbb0055340 0x7fcbb0057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:52.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.815+0000 7fcbcd129700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbb0055340 0x7fcbb0057800 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fcbc400d000 tx=0x7fcbc4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:52.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.819+0000 7fcbbe7fc700 1 -- 172.21.15.57:0/1984873525 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcbc0043390 con 0x7fcbc8144660 2021-06-25T04:55:52.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 -- 172.21.15.57:0/1984873525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcbc8148460 con 0x7fcbc8144660 2021-06-25T04:55:52.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbbe7fc700 1 -- 172.21.15.57:0/1984873525 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v118) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcbc8148460 con 0x7fcbc8144660 2021-06-25T04:55:52.956 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:55:52.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 -- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbb0055340 msgr2=0x7fcbb0057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbb0055340 0x7fcbb0057800 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fcbc400d000 tx=0x7fcbc4009040).stop 2021-06-25T04:55:52.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 -- 172.21.15.57:0/1984873525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc8144660 msgr2=0x7fcbc80ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:52.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc8144660 0x7fcbc80ae580 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fcbc8060c10 tx=0x7fcbc0007eb0).stop 2021-06-25T04:55:52.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 -- 172.21.15.57:0/1984873525 shutdown_connections 2021-06-25T04:55:52.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcbb0055340 0x7fcbb0057800 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbc8144660 0x7fcbc80ae580 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbc80b4140 0x7fcbc8156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 --2- 172.21.15.57:0/1984873525 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbc80b37b0 0x7fcbc80b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:52.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 -- 172.21.15.57:0/1984873525 >> 172.21.15.57:0/1984873525 conn(0x7fcbc805c450 msgr2=0x7fcbc814dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:52.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 -- 172.21.15.57:0/1984873525 shutdown_connections 2021-06-25T04:55:52.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:52.951+0000 7fcbcf38d700 1 -- 172.21.15.57:0/1984873525 wait complete. 2021-06-25T04:55:52.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:55:53.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.075+0000 7f235e51c700 1 Processor -- start 2021-06-25T04:55:53.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.075+0000 7f235e51c700 1 -- start start 2021-06-25T04:55:53.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.075+0000 7f235e51c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23580b7330 0x7f23580b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.075+0000 7f235e51c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23580b3020 0x7f235813e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.075+0000 7f235e51c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23580b2340 con 0x7f235813e6d0 2021-06-25T04:55:53.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.075+0000 7f235e51c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2358144210 con 0x7f23580b7330 2021-06-25T04:55:53.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.075+0000 7f235e51c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23580b3530 con 0x7f23580b3020 2021-06-25T04:55:53.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235d51a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23580b7330 0x7f23580b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235d51a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23580b7330 0x7f23580b7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42556/0 (socket says 172.21.15.57:42556) 2021-06-25T04:55:53.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235d51a700 1 -- 172.21.15.57:0/374229154 learned_addr learned my addr 172.21.15.57:0/374229154 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:53.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235cd19700 1 --2- 172.21.15.57:0/374229154 >> v2:172.21.15.87:3300/0 conn(0x7f23580b3020 0x7f235813e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235d51a700 1 -- 172.21.15.57:0/374229154 >> v2:172.21.15.87:3300/0 conn(0x7f23580b3020 msgr2=0x7f235813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:53.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235d51a700 1 --2- 172.21.15.57:0/374229154 >> v2:172.21.15.87:3300/0 conn(0x7f23580b3020 0x7f235813e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235d51a700 1 -- 172.21.15.57:0/374229154 >> v1:172.21.15.87:6789/0 conn(0x7f235813e6d0 legacy=0x7f2358064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235d51a700 1 -- 172.21.15.57:0/374229154 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580b2570 con 0x7f23580b7330 2021-06-25T04:55:53.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235cd19700 1 --2- 172.21.15.57:0/374229154 >> v2:172.21.15.87:3300/0 conn(0x7f23580b3020 0x7f235813e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:53.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235d51a700 1 --2- 172.21.15.57:0/374229154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23580b7330 0x7f23580b7710 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f2354002f70 tx=0x7f2354006e50).ready entity=mon.0 client_cookie=813ed67303e9265c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f234ffff700 1 -- 172.21.15.57:0/374229154 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235400d610 con 0x7f23580b7330 2021-06-25T04:55:53.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f234ffff700 1 -- 172.21.15.57:0/374229154 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354000e90 con 0x7f23580b7330 2021-06-25T04:55:53.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f234ffff700 1 -- 172.21.15.57:0/374229154 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235400d9a0 con 0x7f23580b7330 2021-06-25T04:55:53.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235e51c700 1 -- 172.21.15.57:0/374229154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23580b7330 msgr2=0x7f23580b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235e51c700 1 --2- 172.21.15.57:0/374229154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23580b7330 0x7f23580b7710 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f2354002f70 tx=0x7f2354006e50).stop 2021-06-25T04:55:53.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235e51c700 1 -- 172.21.15.57:0/374229154 shutdown_connections 2021-06-25T04:55:53.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235e51c700 1 --2- 172.21.15.57:0/374229154 >> v2:172.21.15.87:3300/0 conn(0x7f23580b3020 0x7f235813e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235e51c700 1 --2- 172.21.15.57:0/374229154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23580b7330 0x7f23580b7710 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235e51c700 1 -- 172.21.15.57:0/374229154 >> 172.21.15.57:0/374229154 conn(0x7f235805f670 msgr2=0x7f235805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:53.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235e51c700 1 -- 172.21.15.57:0/374229154 shutdown_connections 2021-06-25T04:55:53.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235e51c700 1 -- 172.21.15.57:0/374229154 wait complete. 2021-06-25T04:55:53.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235e51c700 1 Processor -- start 2021-06-25T04:55:53.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.079+0000 7f235e51c700 1 -- start start 2021-06-25T04:55:53.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235e51c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23580b3020 0x7f235813fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235e51c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23580b7330 0x7f23581505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235e51c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f235813e6d0 0x7f2358150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235e51c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235814ff70 con 0x7f23580b7330 2021-06-25T04:55:53.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235e51c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2358143de0 con 0x7f235813e6d0 2021-06-25T04:55:53.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235e51c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23580ab590 con 0x7f23580b3020 2021-06-25T04:55:53.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235cd19700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23580b7330 0x7f23581505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235cd19700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23580b7330 0x7f23581505c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42562/0 (socket says 172.21.15.57:42562) 2021-06-25T04:55:53.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235cd19700 1 -- 172.21.15.57:0/2823128851 learned_addr learned my addr 172.21.15.57:0/2823128851 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:53.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235d51a700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23580b3020 0x7f235813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235dd1b700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f235813e6d0 0x7f2358150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235cd19700 1 -- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23580b3020 msgr2=0x7f235813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235cd19700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23580b3020 0x7f235813fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235cd19700 1 -- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f235813e6d0 msgr2=0x7f2358150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235cd19700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f235813e6d0 0x7f2358150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235cd19700 1 -- 172.21.15.57:0/2823128851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235400b1e0 con 0x7f23580b7330 2021-06-25T04:55:53.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235cd19700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23580b7330 0x7f23581505c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f2348006940 tx=0x7f2348008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f234e7fc700 1 -- 172.21.15.57:0/2823128851 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2348011780 con 0x7f23580b7330 2021-06-25T04:55:53.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f234e7fc700 1 -- 172.21.15.57:0/2823128851 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23480118e0 con 0x7f23580b7330 2021-06-25T04:55:53.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235e51c700 1 -- 172.21.15.57:0/2823128851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2358150160 con 0x7f23580b7330 2021-06-25T04:55:53.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f234e7fc700 1 -- 172.21.15.57:0/2823128851 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2348011c40 con 0x7f23580b7330 2021-06-25T04:55:53.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.083+0000 7f235e51c700 1 -- 172.21.15.57:0/2823128851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2358140160 con 0x7f23580b7330 2021-06-25T04:55:53.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.087+0000 7f235e51c700 1 -- 172.21.15.57:0/2823128851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2358057310 con 0x7f23580b7330 2021-06-25T04:55:53.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.087+0000 7f234e7fc700 1 -- 172.21.15.57:0/2823128851 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2348012420 con 0x7f23580b7330 2021-06-25T04:55:53.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.087+0000 7f234e7fc700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f23400553f0 0x7f23400578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.087+0000 7f234e7fc700 1 -- 172.21.15.57:0/2823128851 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f234806ddc0 con 0x7f23580b7330 2021-06-25T04:55:53.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.087+0000 7f235d51a700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f23400553f0 0x7f23400578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.087+0000 7f235d51a700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f23400553f0 0x7f23400578b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f235401b000 tx=0x7f2354015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.095+0000 7f234e7fc700 1 -- 172.21.15.57:0/2823128851 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2348043e00 con 0x7f23580b7330 2021-06-25T04:55:53.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.215+0000 7f235e51c700 1 -- 172.21.15.57:0/2823128851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23581502f0 con 0x7f23580b7330 2021-06-25T04:55:53.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.215+0000 7f234e7fc700 1 -- 172.21.15.57:0/2823128851 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2348047420 con 0x7f23580b7330 2021-06-25T04:55:53.222 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:53.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 -- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f23400553f0 msgr2=0x7f23400578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f23400553f0 0x7f23400578b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f235401b000 tx=0x7f2354015000).stop 2021-06-25T04:55:53.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 -- 172.21.15.57:0/2823128851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23580b7330 msgr2=0x7f23581505c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23580b7330 0x7f23581505c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f2348006940 tx=0x7f2348008040).stop 2021-06-25T04:55:53.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 -- 172.21.15.57:0/2823128851 shutdown_connections 2021-06-25T04:55:53.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f23400553f0 0x7f23400578b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f235813e6d0 0x7f2358150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23580b7330 0x7f23581505c0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 --2- 172.21.15.57:0/2823128851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23580b3020 0x7f235813fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 -- 172.21.15.57:0/2823128851 >> 172.21.15.57:0/2823128851 conn(0x7f235805f670 msgr2=0x7f2358064a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:53.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 -- 172.21.15.57:0/2823128851 shutdown_connections 2021-06-25T04:55:53.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.219+0000 7f235e51c700 1 -- 172.21.15.57:0/2823128851 wait complete. 2021-06-25T04:55:53.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:55:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.339+0000 7fde1d3ba700 1 Processor -- start 2021-06-25T04:55:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.339+0000 7fde1d3ba700 1 -- start start 2021-06-25T04:55:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.339+0000 7fde1d3ba700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fde180b6250 0x7fde18061430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde180b4020 0x7fde18061920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde180b5f10 con 0x7fde18061e10 2021-06-25T04:55:53.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde180b1f30 con 0x7fde180b4020 2021-06-25T04:55:53.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde180b21d0 con 0x7fde180b6250 2021-06-25T04:55:53.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde177fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde180b4020 0x7fde18061920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde177fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde180b4020 0x7fde18061920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42570/0 (socket says 172.21.15.57:42570) 2021-06-25T04:55:53.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde177fe700 1 -- 172.21.15.57:0/1554142979 learned_addr learned my addr 172.21.15.57:0/1554142979 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:53.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde17fff700 1 --2- 172.21.15.57:0/1554142979 >> v2:172.21.15.87:3300/0 conn(0x7fde180b6250 0x7fde18061430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde177fe700 1 -- 172.21.15.57:0/1554142979 >> v2:172.21.15.87:3300/0 conn(0x7fde180b6250 msgr2=0x7fde18061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:53.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde177fe700 1 --2- 172.21.15.57:0/1554142979 >> v2:172.21.15.87:3300/0 conn(0x7fde180b6250 0x7fde18061430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde177fe700 1 -- 172.21.15.57:0/1554142979 >> v1:172.21.15.87:6789/0 conn(0x7fde18061e10 legacy=0x7fde181463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde177fe700 1 -- 172.21.15.57:0/1554142979 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde180b2470 con 0x7fde180b4020 2021-06-25T04:55:53.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde17fff700 1 --2- 172.21.15.57:0/1554142979 >> v2:172.21.15.87:3300/0 conn(0x7fde180b6250 0x7fde18061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:53.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde177fe700 1 --2- 172.21.15.57:0/1554142979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180b4020 0x7fde18061920 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fde00002f70 tx=0x7fde00006eb0).ready entity=mon.0 client_cookie=86996b4a6a4278a5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde16ffd700 1 -- 172.21.15.57:0/1554142979 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde0000d610 con 0x7fde180b4020 2021-06-25T04:55:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde16ffd700 1 -- 172.21.15.57:0/1554142979 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde00000e90 con 0x7fde180b4020 2021-06-25T04:55:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde16ffd700 1 -- 172.21.15.57:0/1554142979 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde0000d9a0 con 0x7fde180b4020 2021-06-25T04:55:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1554142979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180b4020 msgr2=0x7fde18061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 --2- 172.21.15.57:0/1554142979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180b4020 0x7fde18061920 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fde00002f70 tx=0x7fde00006eb0).stop 2021-06-25T04:55:53.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1554142979 shutdown_connections 2021-06-25T04:55:53.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 --2- 172.21.15.57:0/1554142979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180b4020 0x7fde18061920 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 --2- 172.21.15.57:0/1554142979 >> v2:172.21.15.87:3300/0 conn(0x7fde180b6250 0x7fde18061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1554142979 >> 172.21.15.57:0/1554142979 conn(0x7fde1805c450 msgr2=0x7fde1805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:53.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1554142979 shutdown_connections 2021-06-25T04:55:53.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1554142979 wait complete. 2021-06-25T04:55:53.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 Processor -- start 2021-06-25T04:55:53.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.343+0000 7fde1d3ba700 1 -- start start 2021-06-25T04:55:53.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde1d3ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde18061e10 0x7fde18142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde1d3ba700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde180b4020 0x7fde18152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde1d3ba700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fde180b6250 0x7fde180ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde1d3ba700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18152300 con 0x7fde18061e10 2021-06-25T04:55:53.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde1d3ba700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18141ea0 con 0x7fde180b4020 2021-06-25T04:55:53.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde1d3ba700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde18141c00 con 0x7fde180b6250 2021-06-25T04:55:53.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde17fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde18061e10 0x7fde18142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde17fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde18061e10 0x7fde18142a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42574/0 (socket says 172.21.15.57:42574) 2021-06-25T04:55:53.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde17fff700 1 -- 172.21.15.57:0/1778955134 learned_addr learned my addr 172.21.15.57:0/1778955134 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:53.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde177fe700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde180b4020 0x7fde18152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde1cbb9700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fde180b6250 0x7fde180ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde17fff700 1 -- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fde180b6250 msgr2=0x7fde180ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde17fff700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fde180b6250 0x7fde180ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde17fff700 1 -- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde180b4020 msgr2=0x7fde18152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde17fff700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde180b4020 0x7fde18152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde17fff700 1 -- 172.21.15.57:0/1778955134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0000b1e0 con 0x7fde18061e10 2021-06-25T04:55:53.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde17fff700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde18061e10 0x7fde18142a90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fde08006940 tx=0x7fde08008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde157fa700 1 -- 172.21.15.57:0/1778955134 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde08011780 con 0x7fde18061e10 2021-06-25T04:55:53.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde157fa700 1 -- 172.21.15.57:0/1778955134 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde080118e0 con 0x7fde18061e10 2021-06-25T04:55:53.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1778955134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde18152560 con 0x7fde18061e10 2021-06-25T04:55:53.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde157fa700 1 -- 172.21.15.57:0/1778955134 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde08011c40 con 0x7fde18061e10 2021-06-25T04:55:53.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.347+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1778955134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde18152ef0 con 0x7fde18061e10 2021-06-25T04:55:53.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.351+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1778955134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde18057310 con 0x7fde18061e10 2021-06-25T04:55:53.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.351+0000 7fde157fa700 1 -- 172.21.15.57:0/1778955134 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fde08012420 con 0x7fde18061e10 2021-06-25T04:55:53.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.351+0000 7fde157fa700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fddfc055450 0x7fddfc057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.351+0000 7fde157fa700 1 -- 172.21.15.57:0/1778955134 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fde0806dc80 con 0x7fde18061e10 2021-06-25T04:55:53.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.351+0000 7fde177fe700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fddfc055450 0x7fddfc057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.351+0000 7fde177fe700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fddfc055450 0x7fddfc057910 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fde0001b000 tx=0x7fde00015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.359+0000 7fde157fa700 1 -- 172.21.15.57:0/1778955134 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fde08043dd0 con 0x7fde18061e10 2021-06-25T04:55:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.487+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1778955134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde1806afd0 con 0x7fde18061e10 2021-06-25T04:55:53.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.487+0000 7fde157fa700 1 -- 172.21.15.57:0/1778955134 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+10 (secure 0 0 0) 0x7fde080473f0 con 0x7fde18061e10 2021-06-25T04:55:53.492 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:53.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fddfc055450 msgr2=0x7fddfc057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fddfc055450 0x7fddfc057910 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fde0001b000 tx=0x7fde00015000).stop 2021-06-25T04:55:53.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1778955134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde18061e10 msgr2=0x7fde18142a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde18061e10 0x7fde18142a90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fde08006940 tx=0x7fde08008040).stop 2021-06-25T04:55:53.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1778955134 shutdown_connections 2021-06-25T04:55:53.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fddfc055450 0x7fddfc057910 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fde180b6250 0x7fde180ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde180b4020 0x7fde18152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 --2- 172.21.15.57:0/1778955134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde18061e10 0x7fde18142a90 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1778955134 >> 172.21.15.57:0/1778955134 conn(0x7fde1805c450 msgr2=0x7fde180b88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1778955134 shutdown_connections 2021-06-25T04:55:53.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.491+0000 7fde1d3ba700 1 -- 172.21.15.57:0/1778955134 wait complete. 2021-06-25T04:55:53.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:55:53.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.611+0000 7f9e3bee0700 1 Processor -- start 2021-06-25T04:55:53.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.611+0000 7f9e3bee0700 1 -- start start 2021-06-25T04:55:53.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3bee0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9e340b4140 0x7f9e34140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3bee0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e34143b20 con 0x7f9e340b4650 2021-06-25T04:55:53.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3bee0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e34143dc0 con 0x7f9e34146910 2021-06-25T04:55:53.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3bee0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e341474d0 con 0x7f9e340b4140 2021-06-25T04:55:53.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3947b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9e340b4140 0x7f9e34140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3a47d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9e340b4650 0x7f9e340b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59804/0 (socket says 172.21.15.57:59804) 2021-06-25T04:55:53.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3a47d700 1 -- 172.21.15.57:0/1173788160 learned_addr learned my addr 172.21.15.57:0/1173788160 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:53.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3947b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9e340b4140 0x7f9e34140900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42584/0 (socket says 172.21.15.57:42584) 2021-06-25T04:55:53.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3947b700 1 -- 172.21.15.57:0/1173788160 >> v1:172.21.15.87:6789/0 conn(0x7f9e34146910 legacy=0x7f9e341401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3947b700 1 -- 172.21.15.57:0/1173788160 >> v1:172.21.15.57:6789/0 conn(0x7f9e340b4650 legacy=0x7f9e340b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3947b700 1 -- 172.21.15.57:0/1173788160 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e340b0c50 con 0x7f9e340b4140 2021-06-25T04:55:53.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e38c7a700 1 -- 172.21.15.57:0/1173788160 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613308029 0 0) 0x7f9e34143b20 con 0x7f9e340b4650 2021-06-25T04:55:53.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3947b700 1 --2- 172.21.15.57:0/1173788160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e340b4140 0x7f9e34140900 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f9e24002f70 tx=0x7f9e24006df0).ready entity=mon.0 client_cookie=8252f1569d7b57ba server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e38c7a700 1 -- 172.21.15.57:0/1173788160 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e2400d610 con 0x7f9e340b4140 2021-06-25T04:55:53.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e38c7a700 1 -- 172.21.15.57:0/1173788160 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e24000e90 con 0x7f9e340b4140 2021-06-25T04:55:53.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e38c7a700 1 -- 172.21.15.57:0/1173788160 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e2400d960 con 0x7f9e340b4140 2021-06-25T04:55:53.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3bee0700 1 -- 172.21.15.57:0/1173788160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e340b4140 msgr2=0x7f9e34140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3bee0700 1 --2- 172.21.15.57:0/1173788160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e340b4140 0x7f9e34140900 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f9e24002f70 tx=0x7f9e24006df0).stop 2021-06-25T04:55:53.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3bee0700 1 -- 172.21.15.57:0/1173788160 shutdown_connections 2021-06-25T04:55:53.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3bee0700 1 --2- 172.21.15.57:0/1173788160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e340b4140 0x7f9e34140900 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3bee0700 1 -- 172.21.15.57:0/1173788160 >> 172.21.15.57:0/1173788160 conn(0x7f9e3405c450 msgr2=0x7f9e3405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:53.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3bee0700 1 -- 172.21.15.57:0/1173788160 shutdown_connections 2021-06-25T04:55:53.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.615+0000 7f9e3bee0700 1 -- 172.21.15.57:0/1173788160 wait complete. 2021-06-25T04:55:53.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3bee0700 1 Processor -- start 2021-06-25T04:55:53.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3bee0700 1 -- start start 2021-06-25T04:55:53.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3bee0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e340b4140 0x7f9e340b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3bee0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e340b4650 0x7f9e3413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3bee0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e34146910 0x7f9e340b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3bee0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340b77c0 con 0x7f9e34146910 2021-06-25T04:55:53.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3bee0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e34146cf0 con 0x7f9e340b4140 2021-06-25T04:55:53.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3bee0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340b5290 con 0x7f9e340b4650 2021-06-25T04:55:53.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3a47d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e34146910 0x7f9e340b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3a47d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e34146910 0x7f9e340b7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42592/0 (socket says 172.21.15.57:42592) 2021-06-25T04:55:53.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3a47d700 1 -- 172.21.15.57:0/2774298220 learned_addr learned my addr 172.21.15.57:0/2774298220 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:53.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e39c7c700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e340b4140 0x7f9e340b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3947b700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e340b4650 0x7f9e3413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3a47d700 1 -- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e340b4650 msgr2=0x7f9e3413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3a47d700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e340b4650 0x7f9e3413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3a47d700 1 -- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e340b4140 msgr2=0x7f9e340b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3a47d700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e340b4140 0x7f9e340b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3a47d700 1 -- 172.21.15.57:0/2774298220 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2400b180 con 0x7f9e34146910 2021-06-25T04:55:53.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3a47d700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e34146910 0x7f9e340b7bd0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f9e2c001250 tx=0x7f9e2c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e22ffd700 1 -- 172.21.15.57:0/2774298220 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e2c005c70 con 0x7f9e34146910 2021-06-25T04:55:53.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e22ffd700 1 -- 172.21.15.57:0/2774298220 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c005dd0 con 0x7f9e34146910 2021-06-25T04:55:53.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.619+0000 7f9e3bee0700 1 -- 172.21.15.57:0/2774298220 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e340b5890 con 0x7f9e34146910 2021-06-25T04:55:53.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.623+0000 7f9e22ffd700 1 -- 172.21.15.57:0/2774298220 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e2c004a90 con 0x7f9e34146910 2021-06-25T04:55:53.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.623+0000 7f9e3bee0700 1 -- 172.21.15.57:0/2774298220 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e340b5dd0 con 0x7f9e34146910 2021-06-25T04:55:53.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.623+0000 7f9e3bee0700 1 -- 172.21.15.57:0/2774298220 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e340b7540 con 0x7f9e34146910 2021-06-25T04:55:53.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.623+0000 7f9e22ffd700 1 -- 172.21.15.57:0/2774298220 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9e2c004bf0 con 0x7f9e34146910 2021-06-25T04:55:53.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.623+0000 7f9e22ffd700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9e14055510 0x7f9e140579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.623+0000 7f9e22ffd700 1 -- 172.21.15.57:0/2774298220 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9e2c06dbe0 con 0x7f9e34146910 2021-06-25T04:55:53.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.623+0000 7f9e39c7c700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9e14055510 0x7f9e140579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.627+0000 7f9e39c7c700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9e14055510 0x7f9e140579d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f9e3000b000 tx=0x7f9e30009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.631+0000 7f9e22ffd700 1 -- 172.21.15.57:0/2774298220 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9e2c043d90 con 0x7f9e34146910 2021-06-25T04:55:53.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 -- 172.21.15.57:0/2774298220 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e340b7900 con 0x7f9e34146910 2021-06-25T04:55:53.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e22ffd700 1 -- 172.21.15.57:0/2774298220 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9e2c0473b0 con 0x7f9e34146910 2021-06-25T04:55:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:55:53.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 -- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9e14055510 msgr2=0x7f9e140579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9e14055510 0x7f9e140579d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f9e3000b000 tx=0x7f9e30009040).stop 2021-06-25T04:55:53.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 -- 172.21.15.57:0/2774298220 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e34146910 msgr2=0x7f9e340b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e34146910 0x7f9e340b7bd0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f9e2c001250 tx=0x7f9e2c007dc0).stop 2021-06-25T04:55:53.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 -- 172.21.15.57:0/2774298220 shutdown_connections 2021-06-25T04:55:53.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9e14055510 0x7f9e140579d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e34146910 0x7f9e340b7bd0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e340b4650 0x7f9e3413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 --2- 172.21.15.57:0/2774298220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e340b4140 0x7f9e340b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 -- 172.21.15.57:0/2774298220 >> 172.21.15.57:0/2774298220 conn(0x7f9e3405c450 msgr2=0x7f9e34142190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:53.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 -- 172.21.15.57:0/2774298220 shutdown_connections 2021-06-25T04:55:53.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.763+0000 7f9e3bee0700 1 -- 172.21.15.57:0/2774298220 wait complete. 2021-06-25T04:55:53.782 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:55:53.782 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:55:53.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b9359e700 1 Processor -- start 2021-06-25T04:55:53.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b9359e700 1 -- start start 2021-06-25T04:55:53.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b9359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9b940acfc0 0x7f9b94146af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b9359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b940b0440 0x7f9b94146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b9359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b940b0950 con 0x7f9b940aea00 2021-06-25T04:55:53.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b9359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b940adc10 con 0x7f9b940acfc0 2021-06-25T04:55:53.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b9359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940aede0 con 0x7f9b940b0440 2021-06-25T04:55:53.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b91d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9b940acfc0 0x7f9b94146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b91d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9b940acfc0 0x7f9b94146af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42596/0 (socket says 172.21.15.57:42596) 2021-06-25T04:55:53.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b91d9b700 1 -- 172.21.15.57:0/2904483362 learned_addr learned my addr 172.21.15.57:0/2904483362 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:53.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b92d9d700 1 --2- 172.21.15.57:0/2904483362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b940b0440 0x7f9b94146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b91d9b700 1 -- 172.21.15.57:0/2904483362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b940b0440 msgr2=0x7f9b94146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:53.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b91d9b700 1 --2- 172.21.15.57:0/2904483362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b940b0440 0x7f9b94146fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b91d9b700 1 -- 172.21.15.57:0/2904483362 >> v1:172.21.15.87:6789/0 conn(0x7f9b940aea00 legacy=0x7f9b94143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b91d9b700 1 -- 172.21.15.57:0/2904483362 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b941466c0 con 0x7f9b940acfc0 2021-06-25T04:55:53.888 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b92d9d700 1 --2- 172.21.15.57:0/2904483362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b940b0440 0x7f9b94146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:53.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.879+0000 7f9b91d9b700 1 --2- 172.21.15.57:0/2904483362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b940acfc0 0x7f9b94146af0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f9b84002f70 tx=0x7f9b84006eb0).ready entity=mon.0 client_cookie=e53c85ddbc02c7cd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.889 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.883+0000 7f9b9159a700 1 -- 172.21.15.57:0/2904483362 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b8400d5c0 con 0x7f9b940acfc0 2021-06-25T04:55:53.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.883+0000 7f9b9159a700 1 -- 172.21.15.57:0/2904483362 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b84000e90 con 0x7f9b940acfc0 2021-06-25T04:55:53.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.883+0000 7f9b9159a700 1 -- 172.21.15.57:0/2904483362 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b8400d950 con 0x7f9b940acfc0 2021-06-25T04:55:53.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.883+0000 7f9b9359e700 1 -- 172.21.15.57:0/2904483362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b940acfc0 msgr2=0x7f9b94146af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.883+0000 7f9b9359e700 1 --2- 172.21.15.57:0/2904483362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b940acfc0 0x7f9b94146af0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f9b84002f70 tx=0x7f9b84006eb0).stop 2021-06-25T04:55:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.887+0000 7f9b9359e700 1 -- 172.21.15.57:0/2904483362 shutdown_connections 2021-06-25T04:55:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.887+0000 7f9b9359e700 1 --2- 172.21.15.57:0/2904483362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b940b0440 0x7f9b94146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.887+0000 7f9b9359e700 1 --2- 172.21.15.57:0/2904483362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b940acfc0 0x7f9b94146af0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.887+0000 7f9b9359e700 1 -- 172.21.15.57:0/2904483362 >> 172.21.15.57:0/2904483362 conn(0x7f9b940611f0 msgr2=0x7f9b94062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.887+0000 7f9b9359e700 1 -- 172.21.15.57:0/2904483362 shutdown_connections 2021-06-25T04:55:53.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.887+0000 7f9b9359e700 1 -- 172.21.15.57:0/2904483362 wait complete. 2021-06-25T04:55:53.893 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.887+0000 7f9b9359e700 1 Processor -- start 2021-06-25T04:55:53.894 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.887+0000 7f9b9359e700 1 -- start start 2021-06-25T04:55:53.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b9359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b940acfc0 0x7f9b94065c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b9359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b940aea00 0x7f9b940b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b9359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b940b0440 0x7f9b940b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b9359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b94152f90 con 0x7f9b940b0440 2021-06-25T04:55:53.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b9359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940b39b0 con 0x7f9b940aea00 2021-06-25T04:55:53.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b9359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940b5370 con 0x7f9b940acfc0 2021-06-25T04:55:53.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b92d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b940b0440 0x7f9b940b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b92d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b940b0440 0x7f9b940b4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42606/0 (socket says 172.21.15.57:42606) 2021-06-25T04:55:53.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b92d9d700 1 -- 172.21.15.57:0/2239637946 learned_addr learned my addr 172.21.15.57:0/2239637946 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:53.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b91d9b700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b940aea00 0x7f9b940b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b9259c700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b940acfc0 0x7f9b94065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b92d9d700 1 -- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b940acfc0 msgr2=0x7f9b94065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b92d9d700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b940acfc0 0x7f9b94065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b92d9d700 1 -- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b940aea00 msgr2=0x7f9b940b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:53.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b92d9d700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b940aea00 0x7f9b940b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:53.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b92d9d700 1 -- 172.21.15.57:0/2239637946 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8400b1e0 con 0x7f9b940b0440 2021-06-25T04:55:53.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b92d9d700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b940b0440 0x7f9b940b4a60 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f9b8c007000 tx=0x7f9b8c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b8b7fe700 1 -- 172.21.15.57:0/2239637946 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b8c00ce20 con 0x7f9b940b0440 2021-06-25T04:55:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b8b7fe700 1 -- 172.21.15.57:0/2239637946 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00f4e0 con 0x7f9b940b0440 2021-06-25T04:55:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b8b7fe700 1 -- 172.21.15.57:0/2239637946 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b8c00f840 con 0x7f9b940b0440 2021-06-25T04:55:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b9359e700 1 -- 172.21.15.57:0/2239637946 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b94153190 con 0x7f9b940b0440 2021-06-25T04:55:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.891+0000 7f9b9359e700 1 -- 172.21.15.57:0/2239637946 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b94150110 con 0x7f9b940b0440 2021-06-25T04:55:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.895+0000 7f9b9359e700 1 -- 172.21.15.57:0/2239637946 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b94057310 con 0x7f9b940b0440 2021-06-25T04:55:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.895+0000 7f9b8b7fe700 1 -- 172.21.15.57:0/2239637946 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9b8c019030 con 0x7f9b940b0440 2021-06-25T04:55:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.895+0000 7f9b8b7fe700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9b780553d0 0x7f9b78057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.895+0000 7f9b8b7fe700 1 -- 172.21.15.57:0/2239637946 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9b8c06d8b0 con 0x7f9b940b0440 2021-06-25T04:55:53.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.895+0000 7f9b9259c700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9b780553d0 0x7f9b78057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:53.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.895+0000 7f9b9259c700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9b780553d0 0x7f9b78057890 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f9b7c00d000 tx=0x7f9b7c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:53.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:53.899+0000 7f9b8b7fe700 1 -- 172.21.15.57:0/2239637946 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9b8c043950 con 0x7f9b940b0440 2021-06-25T04:55:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.063+0000 7f9b9359e700 1 -- 172.21.15.57:0/2239637946 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b940af3a0 con 0x7f9b940b0440 2021-06-25T04:55:54.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.067+0000 7f9b8b7fe700 1 -- 172.21.15.57:0/2239637946 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f9b8c046f70 con 0x7f9b940b0440 2021-06-25T04:55:54.071 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:55:54.072 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.87:6835/3329717460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3329717460},{"type":"v1","addr":"172.21.15.87:6835","nonce":3329717460}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57},{"gid":7537,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2255831830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2255831830},{"type":"v1","addr":"172.21.15.57:6833","nonce":2255831830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:55:46.830590+0000","modified":"2021-06-25T04:55:47.833713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7659":{"gid":7659,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/863055178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":863055178},{"type":"v1","addr":"172.21.15.57:6835","nonce":863055178}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-06-25T04:55:54.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.067+0000 7f9b9359e700 1 -- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9b780553d0 msgr2=0x7f9b78057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:54.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.067+0000 7f9b9359e700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9b780553d0 0x7f9b78057890 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f9b7c00d000 tx=0x7f9b7c009040).stop 2021-06-25T04:55:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.067+0000 7f9b9359e700 1 -- 172.21.15.57:0/2239637946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b940b0440 msgr2=0x7f9b940b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.067+0000 7f9b9359e700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b940b0440 0x7f9b940b4a60 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f9b8c007000 tx=0x7f9b8c008040).stop 2021-06-25T04:55:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.067+0000 7f9b9359e700 1 -- 172.21.15.57:0/2239637946 shutdown_connections 2021-06-25T04:55:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.067+0000 7f9b9359e700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9b780553d0 0x7f9b78057890 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.067+0000 7f9b9359e700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b940b0440 0x7f9b940b4a60 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.071+0000 7f9b9359e700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b940aea00 0x7f9b940b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.071+0000 7f9b9359e700 1 --2- 172.21.15.57:0/2239637946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b940acfc0 0x7f9b94065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.071+0000 7f9b9359e700 1 -- 172.21.15.57:0/2239637946 >> 172.21.15.57:0/2239637946 conn(0x7f9b940611f0 msgr2=0x7f9b9413bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.071+0000 7f9b9359e700 1 -- 172.21.15.57:0/2239637946 shutdown_connections 2021-06-25T04:55:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:54.071+0000 7f9b9359e700 1 -- 172.21.15.57:0/2239637946 wait complete. 2021-06-25T04:55:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 59 2021-06-25T04:55:54.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:55:46.830590+0000', 'modified': '2021-06-25T04:55:47.833713+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7659}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7659': {'gid': 7659, 'name': 'a', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/863055178', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 863055178}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 863055178}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:55:54.395 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:55:54.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:55:54.513 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":7659,"want_state":"up:active","state":"up:active","rank_uptime":7.6687525350000003,"mdsmap_epoch":59,"osdmap_epoch":118,"osdmap_epoch_barrier":117,"uptime":12.030577734} 2021-06-25T04:55:54.514 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 7659, "mdsmap_epoch": 59, "osdmap_epoch": 118, "osdmap_epoch_barrier": 117, "rank_uptime": 7.668752535, "state": "up:active", "uptime": 12.030577734, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:55:54.514 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:55:54.515 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-06-25T04:55:54.515 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi161.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-06-25T04:55:54.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:54.516 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:54.524 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:55:54.538 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:54.538 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:54.594 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:54.596 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:54.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:54.597 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:55:54.603 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:55:54.604 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:54.607 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:55:54.624 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:54.624 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:54.678 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:54.679 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:54.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:54.681 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:55:54.683 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:2021-06-25T04:55:54.676+0000 7fb9aa9b4080 -1 init, newargv = 0x55bbc1d954d0 newargc=9 2021-06-25T04:55:54.683 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14896]: starting ceph client 2021-06-25T04:55:54.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14896]: starting fuse 2021-06-25T04:55:55.790 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:55:55.809 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:55:55.809 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:55:55.867 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:55:55.869 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:55:55.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:55.870 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:55:55.877 INFO:teuthology.orchestra.run.smithi161.stdout:52 2021-06-25T04:55:55.878 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:55:55.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:55.879 DEBUG:teuthology.orchestra.run.smithi161:> sudo python3 -c ' 2021-06-25T04:55:55.879 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2021-06-25T04:55:55.880 DEBUG:teuthology.orchestra.run.smithi161:> import re 2021-06-25T04:55:55.880 DEBUG:teuthology.orchestra.run.smithi161:> import os 2021-06-25T04:55:55.881 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2021-06-25T04:55:55.881 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:55.882 DEBUG:teuthology.orchestra.run.smithi161:> def find_socket(client_name): 2021-06-25T04:55:55.882 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-06-25T04:55:55.882 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2021-06-25T04:55:55.883 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:55.883 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2021-06-25T04:55:55.884 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2021-06-25T04:55:55.884 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2021-06-25T04:55:55.885 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2021-06-25T04:55:55.885 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:55.885 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2021-06-25T04:55:55.886 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:55:55.887 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:55:55.887 DEBUG:teuthology.orchestra.run.smithi161:> return f 2021-06-25T04:55:55.887 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:55:55.888 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:55:55.888 DEBUG:teuthology.orchestra.run.smithi161:> print(find_socket("client.1")) 2021-06-25T04:55:55.889 DEBUG:teuthology.orchestra.run.smithi161:> ' 2021-06-25T04:55:55.932 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.14896.asok 2021-06-25T04:55:55.936 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14896.asok 2021-06-25T04:55:55.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:55.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14896.asok status 2021-06-25T04:55:56.070 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2021-06-25T04:55:56.071 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2021-06-25T04:55:56.071 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:55:56.071 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:55:56.072 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2021-06-25T04:55:56.072 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2021-06-25T04:55:56.073 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-06-25T04:55:56.073 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "14896", 2021-06-25T04:55:56.073 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2021-06-25T04:55:56.073 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:56.074 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2021-06-25T04:55:56.074 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2021-06-25T04:55:56.074 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 7872, 2021-06-25T04:55:56.074 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2021-06-25T04:55:56.074 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2021-06-25T04:55:56.075 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2021-06-25T04:55:56.075 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 7872 2021-06-25T04:55:56.075 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:56.076 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:55:56.076 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:55:56.076 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:55:56.076 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 3538562396 2021-06-25T04:55:56.077 INFO:teuthology.orchestra.run.smithi161.stdout: } 2021-06-25T04:55:56.077 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:56.077 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:55:56.077 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:55:56.077 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:55:56.078 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 3538562396 2021-06-25T04:55:56.078 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:55:56.078 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.7872 172.21.15.161:0/3538562396", 2021-06-25T04:55:56.079 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "172.21.15.161:0/3538562396", 2021-06-25T04:55:56.079 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2021-06-25T04:55:56.079 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 59, 2021-06-25T04:55:56.079 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 118, 2021-06-25T04:55:56.080 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:55:56.080 INFO:teuthology.orchestra.run.smithi161.stdout: "blacklisted": false, 2021-06-25T04:55:56.080 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2021-06-25T04:55:56.080 INFO:teuthology.orchestra.run.smithi161.stdout:} 2021-06-25T04:55:56.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:56.083 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:56.083 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:56.091 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:55:56.093 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:55:56.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:56.094 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:56.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:56.154 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:56.155 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:56.163 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:55:56.166 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:55:56.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:56.168 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:56.169 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:56.178 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:55:56.180 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:55:56.180 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:55:56.181 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:55:56.181 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:56.235 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15430]: fuse finished with error 0 and tester_r 0 2021-06-25T04:55:56.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:56.238 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:56.238 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:56.245 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:55:56.247 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:55:56.247 INFO:teuthology.orchestra.run:waiting for 900 2021-06-25T04:55:56.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:55:56.308 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:55:56.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:56.315 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:56.316 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:56.324 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:55:56.325 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:55:56.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:56.326 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:56.327 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:56.335 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:55:56.336 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:55:56.336 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2021-06-25T04:55:56.337 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:55:56.337 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:56.392 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14896]: fuse finished with error 0 and tester_r 0 2021-06-25T04:55:56.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:55:56.394 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:55:56.395 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:56.402 INFO:teuthology.orchestra.run.smithi161.stdout:ext2/ext3 2021-06-25T04:55:56.403 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:55:56.403 INFO:teuthology.orchestra.run:waiting for 900 2021-06-25T04:55:56.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:55:56.475 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:55:56.487 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:55:56.488 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:55:56.489 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:55:56.489 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:55:56.490 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:55:56.490 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:55:56.503 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:55:56.503 DEBUG:teuthology.parallel:result is None 2021-06-25T04:55:56.505 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:55:56.505 DEBUG:teuthology.parallel:result is None 2021-06-25T04:55:56.507 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:55:56.508 DEBUG:teuthology.parallel:result is None 2021-06-25T04:55:56.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2021-06-25T04:55:56.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2021-06-25T04:55:56.510 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2021-06-25T04:55:56.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.643+0000 7f218eaac700 1 Processor -- start 2021-06-25T04:55:56.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.643+0000 7f218eaac700 1 -- start start 2021-06-25T04:55:56.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218eaac700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880608d0 0x7f21880acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218eaac700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880b6ca0 con 0x7f21880b68c0 2021-06-25T04:55:56.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218eaac700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880611a0 con 0x7f21880aa590 2021-06-25T04:55:56.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218eaac700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2188061440 con 0x7f21880608d0 2021-06-25T04:55:56.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218c848700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f21880b68c0 0x7f21880a9e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59828/0 (socket says 172.21.15.57:59828) 2021-06-25T04:55:56.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218c848700 1 -- 172.21.15.57:0/3787758483 learned_addr learned my addr 172.21.15.57:0/3787758483 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:56.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f2187fff700 1 --2- 172.21.15.57:0/3787758483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880608d0 0x7f21880acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f21877fe700 1 -- 172.21.15.57:0/3787758483 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028877376 0 0) 0x7f21880b6ca0 con 0x7f21880b68c0 2021-06-25T04:55:56.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f21877fe700 1 -- 172.21.15.57:0/3787758483 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f216c003260 con 0x7f21880b68c0 2021-06-25T04:55:56.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f21877fe700 1 -- 172.21.15.57:0/3787758483 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675287284 0 0) 0x7f21880611a0 con 0x7f21880aa590 2021-06-25T04:55:56.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f2187fff700 1 -- 172.21.15.57:0/3787758483 >> v1:172.21.15.87:6789/0 conn(0x7f21880aa590 legacy=0x7f218813c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f2187fff700 1 -- 172.21.15.57:0/3787758483 >> v1:172.21.15.57:6789/0 conn(0x7f21880b68c0 legacy=0x7f21880a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.656 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f2187fff700 1 -- 172.21.15.57:0/3787758483 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880616e0 con 0x7f21880608d0 2021-06-25T04:55:56.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f2187fff700 1 --2- 172.21.15.57:0/3787758483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880608d0 0x7f21880acd10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f2174002f70 tx=0x7f2174006e80).ready entity=mon.2 client_cookie=993bf1def81b702f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:56.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f21877fe700 1 -- 172.21.15.57:0/3787758483 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2174014070 con 0x7f21880608d0 2021-06-25T04:55:56.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f21877fe700 1 -- 172.21.15.57:0/3787758483 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174000e90 con 0x7f21880608d0 2021-06-25T04:55:56.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f21877fe700 1 -- 172.21.15.57:0/3787758483 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21740107f0 con 0x7f21880608d0 2021-06-25T04:55:56.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218eaac700 1 -- 172.21.15.57:0/3787758483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880608d0 msgr2=0x7f21880acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218eaac700 1 --2- 172.21.15.57:0/3787758483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880608d0 0x7f21880acd10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f2174002f70 tx=0x7f2174006e80).stop 2021-06-25T04:55:56.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218eaac700 1 -- 172.21.15.57:0/3787758483 shutdown_connections 2021-06-25T04:55:56.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218eaac700 1 --2- 172.21.15.57:0/3787758483 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880608d0 0x7f21880acd10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218eaac700 1 -- 172.21.15.57:0/3787758483 >> 172.21.15.57:0/3787758483 conn(0x7f21880b3440 msgr2=0x7f21880b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:56.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218eaac700 1 -- 172.21.15.57:0/3787758483 shutdown_connections 2021-06-25T04:55:56.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.647+0000 7f218eaac700 1 -- 172.21.15.57:0/3787758483 wait complete. 2021-06-25T04:55:56.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.651+0000 7f218eaac700 1 Processor -- start 2021-06-25T04:55:56.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.651+0000 7f218eaac700 1 -- start start 2021-06-25T04:55:56.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218eaac700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21880608d0 0x7f21880afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218eaac700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880aa590 0x7f21881520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218eaac700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21880b68c0 0x7f21881525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218eaac700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218813df40 con 0x7f21880b68c0 2021-06-25T04:55:56.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218eaac700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218813e5d0 con 0x7f21880608d0 2021-06-25T04:55:56.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218eaac700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218813ea60 con 0x7f21880aa590 2021-06-25T04:55:56.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218d049700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21880b68c0 0x7f21881525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218c848700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21880608d0 0x7f21880afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218d049700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21880b68c0 0x7f21881525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42620/0 (socket says 172.21.15.57:42620) 2021-06-25T04:55:56.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218d049700 1 -- 172.21.15.57:0/3602123199 learned_addr learned my addr 172.21.15.57:0/3602123199 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f2187fff700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880aa590 0x7f21881520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218d049700 1 -- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880aa590 msgr2=0x7f21881520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218d049700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880aa590 0x7f21881520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218d049700 1 -- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21880608d0 msgr2=0x7f21880afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218d049700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21880608d0 0x7f21880afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218d049700 1 -- 172.21.15.57:0/3602123199 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217400c310 con 0x7f21880b68c0 2021-06-25T04:55:56.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f2187fff700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880aa590 0x7f21881520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:56.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218d049700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21880b68c0 0x7f21881525a0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f218813e710 tx=0x7f2180007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:56.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f2185ffb700 1 -- 172.21.15.57:0/3602123199 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f218000e4a0 con 0x7f21880b68c0 2021-06-25T04:55:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f2185ffb700 1 -- 172.21.15.57:0/3602123199 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218000e600 con 0x7f21880b68c0 2021-06-25T04:55:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218eaac700 1 -- 172.21.15.57:0/3602123199 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21880b0190 con 0x7f21880b68c0 2021-06-25T04:55:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f2185ffb700 1 -- 172.21.15.57:0/3602123199 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f218000e960 con 0x7f21880b68c0 2021-06-25T04:55:56.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218eaac700 1 -- 172.21.15.57:0/3602123199 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218813ef30 con 0x7f21880b68c0 2021-06-25T04:55:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f2185ffb700 1 -- 172.21.15.57:0/3602123199 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2180010070 con 0x7f21880b68c0 2021-06-25T04:55:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f218eaac700 1 -- 172.21.15.57:0/3602123199 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2164003410 con 0x7f21880b68c0 2021-06-25T04:55:56.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f2185ffb700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f21700554e0 0x7f21700579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7f2185ffb700 1 -- 172.21.15.57:0/3602123199 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f218006d320 con 0x7f21880b68c0 2021-06-25T04:55:56.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7fe59c328700 1 Processor -- start 2021-06-25T04:55:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.655+0000 7fe59c328700 1 -- start start 2021-06-25T04:55:56.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7f218c848700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f21700554e0 0x7f21700579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.676 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe59c328700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe5940608d0 0x7fe5940acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe59c328700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe5940aa590 0x7fe59413c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe59c328700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5940b6ca0 con 0x7fe5940b68c0 2021-06-25T04:55:56.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7f218c848700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f21700554e0 0x7f21700579a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f217c00d000 tx=0x7f217c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe59c328700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5940611a0 con 0x7fe5940608d0 2021-06-25T04:55:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe59c328700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe594061440 con 0x7fe5940aa590 2021-06-25T04:55:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe5998c3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe5940608d0 0x7fe5940acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe5998c3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe5940608d0 0x7fe5940acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42628/0 (socket says 172.21.15.57:42628) 2021-06-25T04:55:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe5998c3700 1 -- 172.21.15.57:0/463338946 learned_addr learned my addr 172.21.15.57:0/463338946 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe59a8c5700 1 --2- 172.21.15.57:0/463338946 >> v2:172.21.15.87:3300/0 conn(0x7fe5940aa590 0x7fe59413c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe5998c3700 1 -- 172.21.15.57:0/463338946 >> v2:172.21.15.87:3300/0 conn(0x7fe5940aa590 msgr2=0x7fe59413c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:56.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe5998c3700 1 --2- 172.21.15.57:0/463338946 >> v2:172.21.15.87:3300/0 conn(0x7fe5940aa590 0x7fe59413c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe5998c3700 1 -- 172.21.15.57:0/463338946 >> v1:172.21.15.87:6789/0 conn(0x7fe5940b68c0 legacy=0x7fe5940a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe5998c3700 1 -- 172.21.15.57:0/463338946 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940616e0 con 0x7fe5940608d0 2021-06-25T04:55:56.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe5998c3700 1 --2- 172.21.15.57:0/463338946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5940608d0 0x7fe5940acd10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fe590002f70 tx=0x7fe590006eb0).ready entity=mon.0 client_cookie=7fc49d568b5acb74 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:56.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe5990c2700 1 -- 172.21.15.57:0/463338946 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe59000d5c0 con 0x7fe5940608d0 2021-06-25T04:55:56.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe5990c2700 1 -- 172.21.15.57:0/463338946 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590000e90 con 0x7fe5940608d0 2021-06-25T04:55:56.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe5990c2700 1 -- 172.21.15.57:0/463338946 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe59000d950 con 0x7fe5940608d0 2021-06-25T04:55:56.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe59c328700 1 -- 172.21.15.57:0/463338946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5940608d0 msgr2=0x7fe5940acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7fe59c328700 1 --2- 172.21.15.57:0/463338946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5940608d0 0x7fe5940acd10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fe590002f70 tx=0x7fe590006eb0).stop 2021-06-25T04:55:56.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.659+0000 7f2185ffb700 1 -- 172.21.15.57:0/3602123199 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2180043430 con 0x7f21880b68c0 2021-06-25T04:55:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 -- 172.21.15.57:0/463338946 shutdown_connections 2021-06-25T04:55:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 --2- 172.21.15.57:0/463338946 >> v2:172.21.15.87:3300/0 conn(0x7fe5940aa590 0x7fe59413c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 --2- 172.21.15.57:0/463338946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5940608d0 0x7fe5940acd10 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 -- 172.21.15.57:0/463338946 >> 172.21.15.57:0/463338946 conn(0x7fe5940b3440 msgr2=0x7fe5940b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 -- 172.21.15.57:0/463338946 shutdown_connections 2021-06-25T04:55:56.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 -- 172.21.15.57:0/463338946 wait complete. 2021-06-25T04:55:56.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 Processor -- start 2021-06-25T04:55:56.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 -- start start 2021-06-25T04:55:56.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5940608d0 0x7fe594134950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5940aa590 0x7fe5941536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5940b68c0 0x7fe594153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59413ba20 con 0x7fe5940b68c0 2021-06-25T04:55:56.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940b1bf0 con 0x7fe5940608d0 2021-06-25T04:55:56.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59c328700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59413d5e0 con 0x7fe5940aa590 2021-06-25T04:55:56.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59a8c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5940b68c0 0x7fe594153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59a8c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5940b68c0 0x7fe594153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42634/0 (socket says 172.21.15.57:42634) 2021-06-25T04:55:56.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59a8c5700 1 -- 172.21.15.57:0/2290562878 learned_addr learned my addr 172.21.15.57:0/2290562878 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:56.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe5998c3700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5940aa590 0x7fe5941536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59a0c4700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5940608d0 0x7fe594134950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59a8c5700 1 -- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5940aa590 msgr2=0x7fe5941536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59a8c5700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5940aa590 0x7fe5941536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59a8c5700 1 -- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5940608d0 msgr2=0x7fe594134950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59a8c5700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5940608d0 0x7fe594134950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.663+0000 7fe59a8c5700 1 -- 172.21.15.57:0/2290562878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59000b1e0 con 0x7fe5940b68c0 2021-06-25T04:55:56.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe59a8c5700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5940b68c0 0x7fe594153be0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fe58c006e00 tx=0x7fe58c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:56.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe5837fe700 1 -- 172.21.15.57:0/2290562878 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe58c00c640 con 0x7fe5940b68c0 2021-06-25T04:55:56.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe5837fe700 1 -- 172.21.15.57:0/2290562878 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c00c7a0 con 0x7fe5940b68c0 2021-06-25T04:55:56.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe59c328700 1 -- 172.21.15.57:0/2290562878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5940b1e20 con 0x7fe5940b68c0 2021-06-25T04:55:56.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe5837fe700 1 -- 172.21.15.57:0/2290562878 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe58c00cb00 con 0x7fe5940b68c0 2021-06-25T04:55:56.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe59c328700 1 -- 172.21.15.57:0/2290562878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5940b2530 con 0x7fe5940b68c0 2021-06-25T04:55:56.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe59c328700 1 -- 172.21.15.57:0/2290562878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59413d720 con 0x7fe5940b68c0 2021-06-25T04:55:56.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe5837fe700 1 -- 172.21.15.57:0/2290562878 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe58c00cc60 con 0x7fe5940b68c0 2021-06-25T04:55:56.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe5837fe700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe574055460 0x7fe574057920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe5837fe700 1 -- 172.21.15.57:0/2290562878 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe58c06e150 con 0x7fe5940b68c0 2021-06-25T04:55:56.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe59a0c4700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe574055460 0x7fe574057920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.667+0000 7fe59a0c4700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe574055460 0x7fe574057920 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fe58400d000 tx=0x7fe584007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:56.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab3fff700 1 Processor -- start 2021-06-25T04:55:56.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab3fff700 1 -- start start 2021-06-25T04:55:56.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab3fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2ab40b5400 0x7f2ab40af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 0x7f2ab4143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab3fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab40b57e0 con 0x7f2ab40677c0 2021-06-25T04:55:56.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab3fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab40aea20 con 0x7f2ab40b5400 2021-06-25T04:55:56.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab3fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40b02a0 con 0x7f2ab40afb90 2021-06-25T04:55:56.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab37fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 0x7f2ab4143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab37fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 0x7f2ab4143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:53804/0 (socket says 172.21.15.57:53804) 2021-06-25T04:55:56.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab37fe700 1 -- 172.21.15.57:0/1984428362 learned_addr learned my addr 172.21.15.57:0/1984428362 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:56.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab2ffd700 1 --2- 172.21.15.57:0/1984428362 >> v2:172.21.15.87:3300/0 conn(0x7f2ab40b5400 0x7f2ab40af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab37fe700 1 -- 172.21.15.57:0/1984428362 >> v2:172.21.15.87:3300/0 conn(0x7f2ab40b5400 msgr2=0x7f2ab40af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:56.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab37fe700 1 --2- 172.21.15.57:0/1984428362 >> v2:172.21.15.87:3300/0 conn(0x7f2ab40b5400 0x7f2ab40af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab37fe700 1 -- 172.21.15.57:0/1984428362 >> v1:172.21.15.87:6789/0 conn(0x7f2ab40677c0 legacy=0x7f2ab405c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab37fe700 1 -- 172.21.15.57:0/1984428362 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab40aec30 con 0x7f2ab40afb90 2021-06-25T04:55:56.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab37fe700 1 --2- 172.21.15.57:0/1984428362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 0x7f2ab4143430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f2aac0032f0 tx=0x7f2aac009290).ready entity=mon.2 client_cookie=47652bf368bd9eb8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:56.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab1ffb700 1 -- 172.21.15.57:0/1984428362 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aac00b870 con 0x7f2ab40afb90 2021-06-25T04:55:56.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab1ffb700 1 -- 172.21.15.57:0/1984428362 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac00b9d0 con 0x7f2ab40afb90 2021-06-25T04:55:56.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab1ffb700 1 -- 172.21.15.57:0/1984428362 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aac00bb80 con 0x7f2ab40afb90 2021-06-25T04:55:56.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab3fff700 1 -- 172.21.15.57:0/1984428362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 msgr2=0x7f2ab4143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7f2ab3fff700 1 --2- 172.21.15.57:0/1984428362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 0x7f2ab4143430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f2aac0032f0 tx=0x7f2aac009290).stop 2021-06-25T04:55:56.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.671+0000 7fe5837fe700 1 -- 172.21.15.57:0/2290562878 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe58c044300 con 0x7fe5940b68c0 2021-06-25T04:55:56.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.675+0000 7f2ab3fff700 1 -- 172.21.15.57:0/1984428362 shutdown_connections 2021-06-25T04:55:56.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.675+0000 7f2ab3fff700 1 --2- 172.21.15.57:0/1984428362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 0x7f2ab4143430 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.675+0000 7f2ab3fff700 1 --2- 172.21.15.57:0/1984428362 >> v2:172.21.15.87:3300/0 conn(0x7f2ab40b5400 0x7f2ab40af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.675+0000 7f2ab3fff700 1 -- 172.21.15.57:0/1984428362 >> 172.21.15.57:0/1984428362 conn(0x7f2ab405f670 msgr2=0x7f2ab405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:56.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.675+0000 7f2ab3fff700 1 -- 172.21.15.57:0/1984428362 shutdown_connections 2021-06-25T04:55:56.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.675+0000 7f2ab3fff700 1 -- 172.21.15.57:0/1984428362 wait complete. 2021-06-25T04:55:56.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.675+0000 7f2ab3fff700 1 Processor -- start 2021-06-25T04:55:56.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.675+0000 7f2ab3fff700 1 -- start start 2021-06-25T04:55:56.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.675+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ab40677c0 0x7f2ab413fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.675+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 0x7f2ab40a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.675+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ab40b5400 0x7f2ab41558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab3fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab4150060 con 0x7f2ab40b5400 2021-06-25T04:55:56.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab3fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40b04a0 con 0x7f2ab40677c0 2021-06-25T04:55:56.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab3fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab4152d60 con 0x7f2ab40afb90 2021-06-25T04:55:56.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ab40b5400 0x7f2ab41558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ab40b5400 0x7f2ab41558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42648/0 (socket says 172.21.15.57:42648) 2021-06-25T04:55:56.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab37fe700 1 -- 172.21.15.57:0/2857788327 learned_addr learned my addr 172.21.15.57:0/2857788327 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:56.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab2ffd700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ab40677c0 0x7f2ab413fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab27fc700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 0x7f2ab40a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab37fe700 1 -- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 msgr2=0x7f2ab40a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab37fe700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 0x7f2ab40a9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab37fe700 1 -- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ab40677c0 msgr2=0x7f2ab413fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:56.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab37fe700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ab40677c0 0x7f2ab413fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:56.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab37fe700 1 -- 172.21.15.57:0/2857788327 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac009530 con 0x7f2ab40b5400 2021-06-25T04:55:56.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab37fe700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ab40b5400 0x7f2ab41558e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f2aac0032f0 tx=0x7f2aac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:56.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2aa3fff700 1 -- 172.21.15.57:0/2857788327 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aac011b60 con 0x7f2ab40b5400 2021-06-25T04:55:56.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2aa3fff700 1 -- 172.21.15.57:0/2857788327 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac011cc0 con 0x7f2ab40b5400 2021-06-25T04:55:56.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab3fff700 1 -- 172.21.15.57:0/2857788327 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab40b1a70 con 0x7f2ab40b5400 2021-06-25T04:55:56.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2aa3fff700 1 -- 172.21.15.57:0/2857788327 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aac020620 con 0x7f2ab40b5400 2021-06-25T04:55:56.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab3fff700 1 -- 172.21.15.57:0/2857788327 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab4153260 con 0x7f2ab40b5400 2021-06-25T04:55:56.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2ab3fff700 1 -- 172.21.15.57:0/2857788327 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab4057310 con 0x7f2ab40b5400 2021-06-25T04:55:56.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2aa3fff700 1 -- 172.21.15.57:0/2857788327 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2aac026020 con 0x7f2ab40b5400 2021-06-25T04:55:56.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.679+0000 7f2aa3fff700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a900553d0 0x7f2a90057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.683+0000 7f2aa3fff700 1 -- 172.21.15.57:0/2857788327 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2aac06ea80 con 0x7f2ab40b5400 2021-06-25T04:55:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.683+0000 7f2ab2ffd700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a900553d0 0x7f2a90057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.683+0000 7f2ab2ffd700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a900553d0 0x7f2a90057890 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f2aa400c000 tx=0x7f2aa4008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.687+0000 7f2aa3fff700 1 -- 172.21.15.57:0/2857788327 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2aac044c30 con 0x7f2ab40b5400 2021-06-25T04:55:56.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.827+0000 7f218eaac700 1 -- 172.21.15.57:0/3602123199 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f21640036c0 con 0x7f21880b68c0 2021-06-25T04:55:56.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.847+0000 7fe59c328700 1 -- 172.21.15.57:0/2290562878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fe594057310 con 0x7fe5940b68c0 2021-06-25T04:55:56.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:56.859+0000 7f2ab3fff700 1 -- 172.21.15.57:0/2857788327 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f2ab40affe0 con 0x7f2ab40b5400 2021-06-25T04:55:57.659 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:55:57.655+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:55:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.671+0000 7f2185ffb700 1 -- 172.21.15.57:0/3602123199 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7537 v60) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2180046a50 con 0x7f21880b68c0 2021-06-25T04:55:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.671+0000 7f2aa3fff700 1 -- 172.21.15.57:0/2857788327 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7659 v60) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2aac015090 con 0x7f2ab40b5400 2021-06-25T04:55:57.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.671+0000 7fe5837fe700 1 -- 172.21.15.57:0/2290562878 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7534 v60) v1 ==== 95+0+0 (secure 0 0 0) 0x7fe58c047920 con 0x7fe5940b68c0 2021-06-25T04:55:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 -- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f21700554e0 msgr2=0x7f21700579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f21700554e0 0x7f21700579a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f217c00d000 tx=0x7f217c009040).stop 2021-06-25T04:55:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 -- 172.21.15.57:0/3602123199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21880b68c0 msgr2=0x7f21881525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:57.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21880b68c0 0x7f21881525a0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f218813e710 tx=0x7f2180007d60).stop 2021-06-25T04:55:57.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 -- 172.21.15.57:0/3602123199 shutdown_connections 2021-06-25T04:55:57.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f21700554e0 0x7f21700579a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21880b68c0 0x7f21881525a0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21880aa590 0x7f21881520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 --2- 172.21.15.57:0/3602123199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21880608d0 0x7f21880afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 -- 172.21.15.57:0/3602123199 >> 172.21.15.57:0/3602123199 conn(0x7f21880b3440 msgr2=0x7f21880b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:57.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 -- 172.21.15.57:0/3602123199 shutdown_connections 2021-06-25T04:55:57.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f218eaac700 1 -- 172.21.15.57:0/3602123199 wait complete. 2021-06-25T04:55:57.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 -- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a900553d0 msgr2=0x7f2a90057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:57.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a900553d0 0x7f2a90057890 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f2aa400c000 tx=0x7f2aa4008040).stop 2021-06-25T04:55:57.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 -- 172.21.15.57:0/2857788327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ab40b5400 msgr2=0x7f2ab41558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:57.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ab40b5400 0x7f2ab41558e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f2aac0032f0 tx=0x7f2aac016000).stop 2021-06-25T04:55:57.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 -- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe574055460 msgr2=0x7fe574057920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe574055460 0x7fe574057920 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fe58400d000 tx=0x7fe584007b90).stop 2021-06-25T04:55:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 -- 172.21.15.57:0/2290562878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5940b68c0 msgr2=0x7fe594153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5940b68c0 0x7fe594153be0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fe58c006e00 tx=0x7fe58c0091d0).stop 2021-06-25T04:55:57.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 -- 172.21.15.57:0/2857788327 shutdown_connections 2021-06-25T04:55:57.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a900553d0 0x7f2a90057890 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.686 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ab40b5400 0x7f2ab41558e0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ab40afb90 0x7f2ab40a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 --2- 172.21.15.57:0/2857788327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ab40677c0 0x7f2ab413fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 -- 172.21.15.57:0/2857788327 >> 172.21.15.57:0/2857788327 conn(0x7f2ab405f670 msgr2=0x7f2ab4146650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:57.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 -- 172.21.15.57:0/2290562878 shutdown_connections 2021-06-25T04:55:57.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 -- 172.21.15.57:0/2857788327 shutdown_connections 2021-06-25T04:55:57.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe574055460 0x7fe574057920 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5940b68c0 0x7fe594153be0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5940aa590 0x7fe5941536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 --2- 172.21.15.57:0/2290562878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5940608d0 0x7fe594134950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 -- 172.21.15.57:0/2290562878 >> 172.21.15.57:0/2290562878 conn(0x7fe5940b3440 msgr2=0x7fe5940b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:57.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7f2ab3fff700 1 -- 172.21.15.57:0/2857788327 wait complete. 2021-06-25T04:55:57.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 -- 172.21.15.57:0/2290562878 shutdown_connections 2021-06-25T04:55:57.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.675+0000 7fe59c328700 1 -- 172.21.15.57:0/2290562878 wait complete. 2021-06-25T04:55:57.692 INFO:teuthology.orchestra.run.smithi057.stderr:failed mds gid 7537 2021-06-25T04:55:57.692 INFO:teuthology.orchestra.run.smithi057.stderr:failed mds gid 7659 2021-06-25T04:55:57.693 INFO:teuthology.orchestra.run.smithi057.stderr:failed mds gid 7534 2021-06-25T04:55:57.695 DEBUG:teuthology.parallel:result is '' 2021-06-25T04:55:57.696 DEBUG:teuthology.parallel:result is '' 2021-06-25T04:55:57.699 DEBUG:teuthology.parallel:result is '' 2021-06-25T04:55:57.701 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:55:57.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.803+0000 7f5690e4d700 1 Processor -- start 2021-06-25T04:55:57.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.803+0000 7f5690e4d700 1 -- start start 2021-06-25T04:55:57.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.803+0000 7f5690e4d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f568c0b11f0 0x7f568c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:57.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.803+0000 7f5690e4d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c0ac350 con 0x7f568c0ae6a0 2021-06-25T04:55:57.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.803+0000 7f5690e4d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c0b15d0 con 0x7f568c0afbb0 2021-06-25T04:55:57.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.803+0000 7f5690e4d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c0b0280 con 0x7f568c0b11f0 2021-06-25T04:55:57.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f568c0ae6a0 0x7f568c0aeaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59874/0 (socket says 172.21.15.57:59874) 2021-06-25T04:55:57.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568bfff700 1 -- 172.21.15.57:0/1935137912 learned_addr learned my addr 172.21.15.57:0/1935137912 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:57.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568b7fe700 1 --2- 172.21.15.57:0/1935137912 >> v2:172.21.15.57:3300/0 conn(0x7f568c0b11f0 0x7f568c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568a7fc700 1 -- 172.21.15.57:0/1935137912 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137201867 0 0) 0x7f568c0ac350 con 0x7f568c0ae6a0 2021-06-25T04:55:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568a7fc700 1 -- 172.21.15.57:0/1935137912 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f566c003260 con 0x7f568c0ae6a0 2021-06-25T04:55:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568a7fc700 1 -- 172.21.15.57:0/1935137912 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904849649 0 0) 0x7f568c0b15d0 con 0x7f568c0afbb0 2021-06-25T04:55:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568a7fc700 1 -- 172.21.15.57:0/1935137912 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f568c0ac350 con 0x7f568c0afbb0 2021-06-25T04:55:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568b7fe700 1 -- 172.21.15.57:0/1935137912 >> v1:172.21.15.87:6789/0 conn(0x7f568c0afbb0 legacy=0x7f568c142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:57.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568b7fe700 1 -- 172.21.15.57:0/1935137912 >> v1:172.21.15.57:6789/0 conn(0x7f568c0ae6a0 legacy=0x7f568c0aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:57.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568b7fe700 1 -- 172.21.15.57:0/1935137912 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0b0520 con 0x7f568c0b11f0 2021-06-25T04:55:57.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568b7fe700 1 --2- 172.21.15.57:0/1935137912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f568c0b11f0 0x7f568c0b0950 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f567c002f70 tx=0x7f567c006df0).ready entity=mon.0 client_cookie=f6003dd5bbba3055 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:57.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568a7fc700 1 -- 172.21.15.57:0/1935137912 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f567c00d540 con 0x7f568c0b11f0 2021-06-25T04:55:57.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568a7fc700 1 -- 172.21.15.57:0/1935137912 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c000e90 con 0x7f568c0b11f0 2021-06-25T04:55:57.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f568a7fc700 1 -- 172.21.15.57:0/1935137912 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f567c00d890 con 0x7f568c0b11f0 2021-06-25T04:55:57.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f5690e4d700 1 -- 172.21.15.57:0/1935137912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f568c0b11f0 msgr2=0x7f568c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:57.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f5690e4d700 1 --2- 172.21.15.57:0/1935137912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f568c0b11f0 0x7f568c0b0950 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f567c002f70 tx=0x7f567c006df0).stop 2021-06-25T04:55:57.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f5690e4d700 1 -- 172.21.15.57:0/1935137912 shutdown_connections 2021-06-25T04:55:57.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f5690e4d700 1 --2- 172.21.15.57:0/1935137912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f568c0b11f0 0x7f568c0b0950 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f5690e4d700 1 -- 172.21.15.57:0/1935137912 >> 172.21.15.57:0/1935137912 conn(0x7f568c062520 msgr2=0x7f568c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:57.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f5690e4d700 1 -- 172.21.15.57:0/1935137912 shutdown_connections 2021-06-25T04:55:57.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.807+0000 7f5690e4d700 1 -- 172.21.15.57:0/1935137912 wait complete. 2021-06-25T04:55:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5690e4d700 1 Processor -- start 2021-06-25T04:55:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5690e4d700 1 -- start start 2021-06-25T04:55:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5690e4d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f568c0ae6a0 0x7f568c13d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5690e4d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f568c0afbb0 0x7f568c152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5690e4d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f568c0b11f0 0x7f568c140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5690e4d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c141cc0 con 0x7f568c0b11f0 2021-06-25T04:55:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5690e4d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c13d810 con 0x7f568c0afbb0 2021-06-25T04:55:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5690e4d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c144e80 con 0x7f568c0ae6a0 2021-06-25T04:55:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f568c0b11f0 0x7f568c140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:57.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f568c0b11f0 0x7f568c140e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42662/0 (socket says 172.21.15.57:42662) 2021-06-25T04:55:57.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568bfff700 1 -- 172.21.15.57:0/692045840 learned_addr learned my addr 172.21.15.57:0/692045840 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:57.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568b7fe700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f568c0ae6a0 0x7f568c13d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:57.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568affd700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f568c0afbb0 0x7f568c152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:57.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568bfff700 1 -- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f568c0ae6a0 msgr2=0x7f568c13d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:57.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568bfff700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f568c0ae6a0 0x7f568c13d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568bfff700 1 -- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f568c0afbb0 msgr2=0x7f568c152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:57.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568bfff700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f568c0afbb0 0x7f568c152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:57.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568bfff700 1 -- 172.21.15.57:0/692045840 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c00b180 con 0x7f568c0b11f0 2021-06-25T04:55:57.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568affd700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f568c0afbb0 0x7f568c152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:55:57.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f568bfff700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f568c0b11f0 0x7f568c140e90 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f568c145010 tx=0x7f5684007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:57.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5688ff9700 1 -- 172.21.15.57:0/692045840 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5684005c70 con 0x7f568c0b11f0 2021-06-25T04:55:57.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5688ff9700 1 -- 172.21.15.57:0/692045840 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684005dd0 con 0x7f568c0b11f0 2021-06-25T04:55:57.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5690e4d700 1 -- 172.21.15.57:0/692045840 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c13de50 con 0x7f568c0b11f0 2021-06-25T04:55:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5688ff9700 1 -- 172.21.15.57:0/692045840 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56840072c0 con 0x7f568c0b11f0 2021-06-25T04:55:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.811+0000 7f5690e4d700 1 -- 172.21.15.57:0/692045840 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c145390 con 0x7f568c0b11f0 2021-06-25T04:55:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.815+0000 7f5690e4d700 1 -- 172.21.15.57:0/692045840 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568c13d120 con 0x7f568c0b11f0 2021-06-25T04:55:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.815+0000 7f5688ff9700 1 -- 172.21.15.57:0/692045840 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f568401a060 con 0x7f568c0b11f0 2021-06-25T04:55:57.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.815+0000 7f5688ff9700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56700553f0 0x7f56700578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:57.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.815+0000 7f5688ff9700 1 -- 172.21.15.57:0/692045840 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f568406d650 con 0x7f568c0b11f0 2021-06-25T04:55:57.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.815+0000 7f568b7fe700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56700553f0 0x7f56700578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:57.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.815+0000 7f568b7fe700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56700553f0 0x7f56700578b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f567c019000 tx=0x7f567c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:57.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.819+0000 7f5688ff9700 1 -- 172.21.15.57:0/692045840 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f56840437b0 con 0x7f568c0b11f0 2021-06-25T04:55:57.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:57.987+0000 7f5690e4d700 1 -- 172.21.15.57:0/692045840 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f568c13e7f0 con 0x7f568c0b11f0 2021-06-25T04:55:58.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.679+0000 7f5688ff9700 1 -- 172.21.15.57:0/692045840 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f568c13e7f0 con 0x7f568c0b11f0 2021-06-25T04:55:58.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 -- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56700553f0 msgr2=0x7f56700578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56700553f0 0x7f56700578b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f567c019000 tx=0x7f567c014000).stop 2021-06-25T04:55:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 -- 172.21.15.57:0/692045840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f568c0b11f0 msgr2=0x7f568c140e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f568c0b11f0 0x7f568c140e90 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f568c145010 tx=0x7f5684007e40).stop 2021-06-25T04:55:58.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 -- 172.21.15.57:0/692045840 shutdown_connections 2021-06-25T04:55:58.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56700553f0 0x7f56700578b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:58.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f568c0b11f0 0x7f568c140e90 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:58.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f568c0afbb0 0x7f568c152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 --2- 172.21.15.57:0/692045840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f568c0ae6a0 0x7f568c13d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 -- 172.21.15.57:0/692045840 >> 172.21.15.57:0/692045840 conn(0x7f568c062520 msgr2=0x7f568c0b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 -- 172.21.15.57:0/692045840 shutdown_connections 2021-06-25T04:55:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.683+0000 7f5690e4d700 1 -- 172.21.15.57:0/692045840 wait complete. 2021-06-25T04:55:58.706 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:55:58.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.819+0000 7fcf591ed700 1 Processor -- start 2021-06-25T04:55:58.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.819+0000 7fcf591ed700 1 -- start start 2021-06-25T04:55:58.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf540b6540 0x7fcf540b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:58.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcf540b4380 0x7fcf540b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:58.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf54144070 con 0x7fcf54061cf0 2021-06-25T04:55:58.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf540b6e10 con 0x7fcf540b6540 2021-06-25T04:55:58.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf54143b30 con 0x7fcf540b4380 2021-06-25T04:55:58.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf5359e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcf54061cf0 0x7fcf54146680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59884/0 (socket says 172.21.15.57:59884) 2021-06-25T04:55:58.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf5359e700 1 -- 172.21.15.57:0/1109443339 learned_addr learned my addr 172.21.15.57:0/1109443339 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:55:58.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf52d9d700 1 --2- 172.21.15.57:0/1109443339 >> v2:172.21.15.57:3300/0 conn(0x7fcf540b6540 0x7fcf540b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:58.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf4bfff700 1 --2- 172.21.15.57:0/1109443339 >> v2:172.21.15.87:3300/0 conn(0x7fcf540b4380 0x7fcf540b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:58.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf5259c700 1 -- 172.21.15.57:0/1109443339 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021948024 0 0) 0x7fcf54144070 con 0x7fcf54061cf0 2021-06-25T04:55:58.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf5259c700 1 -- 172.21.15.57:0/1109443339 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf34003260 con 0x7fcf54061cf0 2021-06-25T04:55:58.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf52d9d700 1 -- 172.21.15.57:0/1109443339 >> v2:172.21.15.87:3300/0 conn(0x7fcf540b4380 msgr2=0x7fcf540b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:58.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf52d9d700 1 --2- 172.21.15.57:0/1109443339 >> v2:172.21.15.87:3300/0 conn(0x7fcf540b4380 0x7fcf540b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:58.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf5259c700 1 -- 172.21.15.57:0/1109443339 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1555282041 0 0) 0x7fcf34003260 con 0x7fcf54061cf0 2021-06-25T04:55:58.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf52d9d700 1 -- 172.21.15.57:0/1109443339 >> v1:172.21.15.57:6789/0 conn(0x7fcf54061cf0 legacy=0x7fcf54146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:58.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf52d9d700 1 -- 172.21.15.57:0/1109443339 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf54143dd0 con 0x7fcf540b6540 2021-06-25T04:55:58.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf4bfff700 1 --2- 172.21.15.57:0/1109443339 >> v2:172.21.15.87:3300/0 conn(0x7fcf540b4380 0x7fcf540b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:55:58.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf52d9d700 1 --2- 172.21.15.57:0/1109443339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf540b6540 0x7fcf540b5bb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7fcf4c001b80 tx=0x7fcf44006df0).ready entity=mon.0 client_cookie=afa09e4ef572f12d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:58.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf5259c700 1 -- 172.21.15.57:0/1109443339 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf4c0019e0 con 0x7fcf540b6540 2021-06-25T04:55:58.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf5259c700 1 -- 172.21.15.57:0/1109443339 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf44000e90 con 0x7fcf540b6540 2021-06-25T04:55:58.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf5259c700 1 -- 172.21.15.57:0/1109443339 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf44012460 con 0x7fcf540b6540 2021-06-25T04:55:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 -- 172.21.15.57:0/1109443339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf540b6540 msgr2=0x7fcf540b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 --2- 172.21.15.57:0/1109443339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf540b6540 0x7fcf540b5bb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7fcf4c001b80 tx=0x7fcf44006df0).stop 2021-06-25T04:55:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 -- 172.21.15.57:0/1109443339 shutdown_connections 2021-06-25T04:55:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 --2- 172.21.15.57:0/1109443339 >> v2:172.21.15.87:3300/0 conn(0x7fcf540b4380 0x7fcf540b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 --2- 172.21.15.57:0/1109443339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf540b6540 0x7fcf540b5bb0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:58.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 -- 172.21.15.57:0/1109443339 >> 172.21.15.57:0/1109443339 conn(0x7fcf5405c450 msgr2=0x7fcf5405c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:58.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 -- 172.21.15.57:0/1109443339 shutdown_connections 2021-06-25T04:55:58.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.823+0000 7fcf591ed700 1 -- 172.21.15.57:0/1109443339 wait complete. 2021-06-25T04:55:58.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf591ed700 1 Processor -- start 2021-06-25T04:55:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf591ed700 1 -- start start 2021-06-25T04:55:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf591ed700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf54061cf0 0x7fcf540b9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf591ed700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf540b4380 0x7fcf540af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf591ed700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf540b6540 0x7fcf540af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf591ed700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf540b78c0 con 0x7fcf540b6540 2021-06-25T04:55:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf591ed700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf540b80a0 con 0x7fcf540b4380 2021-06-25T04:55:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf591ed700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf540b7af0 con 0x7fcf54061cf0 2021-06-25T04:55:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf5359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf540b6540 0x7fcf540af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf5359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf540b6540 0x7fcf540af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42674/0 (socket says 172.21.15.57:42674) 2021-06-25T04:55:58.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf5359e700 1 -- 172.21.15.57:0/142110271 learned_addr learned my addr 172.21.15.57:0/142110271 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:58.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf52d9d700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf54061cf0 0x7fcf540b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:58.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf4bfff700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf540b4380 0x7fcf540af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:58.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf5359e700 1 -- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf54061cf0 msgr2=0x7fcf540b9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:58.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf5359e700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf54061cf0 0x7fcf540b9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:58.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf5359e700 1 -- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf540b4380 msgr2=0x7fcf540af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:58.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf5359e700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf540b4380 0x7fcf540af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:58.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf5359e700 1 -- 172.21.15.57:0/142110271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c00b180 con 0x7fcf540b6540 2021-06-25T04:55:58.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf52d9d700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf54061cf0 0x7fcf540b9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:55:58.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf5359e700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf540b6540 0x7fcf540af550 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fcf4c001c40 tx=0x7fcf4c0021e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:58.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf50d99700 1 -- 172.21.15.57:0/142110271 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf4c004ab0 con 0x7fcf540b6540 2021-06-25T04:55:58.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf50d99700 1 -- 172.21.15.57:0/142110271 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c004c10 con 0x7fcf540b6540 2021-06-25T04:55:58.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf591ed700 1 -- 172.21.15.57:0/142110271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4400b180 con 0x7fcf540b6540 2021-06-25T04:55:58.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf50d99700 1 -- 172.21.15.57:0/142110271 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf4c007170 con 0x7fcf540b6540 2021-06-25T04:55:58.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.827+0000 7fcf591ed700 1 -- 172.21.15.57:0/142110271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf540b8570 con 0x7fcf540b6540 2021-06-25T04:55:58.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.831+0000 7fcf591ed700 1 -- 172.21.15.57:0/142110271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf540b8730 con 0x7fcf540b6540 2021-06-25T04:55:58.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.831+0000 7fcf50d99700 1 -- 172.21.15.57:0/142110271 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcf4c01b060 con 0x7fcf540b6540 2021-06-25T04:55:58.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.831+0000 7fcf50d99700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf38055510 0x7fcf380579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:58.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.831+0000 7fcf50d99700 1 -- 172.21.15.57:0/142110271 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fcf4c06dce0 con 0x7fcf540b6540 2021-06-25T04:55:58.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.831+0000 7fcf52d9d700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf38055510 0x7fcf380579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:58.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.831+0000 7fcf52d9d700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf38055510 0x7fcf380579d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fcf44013000 tx=0x7fcf44014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:58.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.839+0000 7fcf50d99700 1 -- 172.21.15.57:0/142110271 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcf4c043e40 con 0x7fcf540b6540 2021-06-25T04:55:58.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:58.963+0000 7fcf591ed700 1 -- 172.21.15.57:0/142110271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcf54057310 con 0x7fcf540b6540 2021-06-25T04:55:59.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.687+0000 7fcf50d99700 1 -- 172.21.15.57:0/142110271 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v122) v1 ==== 185+0+0 (secure 0 0 0) 0x7fcf4c019070 con 0x7fcf540b6540 2021-06-25T04:55:59.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 -- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf38055510 msgr2=0x7fcf380579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:59.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf38055510 0x7fcf380579d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fcf44013000 tx=0x7fcf44014000).stop 2021-06-25T04:55:59.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 -- 172.21.15.57:0/142110271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf540b6540 msgr2=0x7fcf540af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:59.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf540b6540 0x7fcf540af550 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fcf4c001c40 tx=0x7fcf4c0021e0).stop 2021-06-25T04:55:59.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 -- 172.21.15.57:0/142110271 shutdown_connections 2021-06-25T04:55:59.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcf38055510 0x7fcf380579d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:59.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf540b6540 0x7fcf540af550 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:59.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf540b4380 0x7fcf540af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:59.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 --2- 172.21.15.57:0/142110271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf54061cf0 0x7fcf540b9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:59.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 -- 172.21.15.57:0/142110271 >> 172.21.15.57:0/142110271 conn(0x7fcf5405c450 msgr2=0x7fcf54128270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:59.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 -- 172.21.15.57:0/142110271 shutdown_connections 2021-06-25T04:55:59.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.691+0000 7fcf591ed700 1 -- 172.21.15.57:0/142110271 wait complete. 2021-06-25T04:55:59.698 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:55:59.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:55:59.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f8798ed7700 1 Processor -- start 2021-06-25T04:55:59.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f8798ed7700 1 -- start start 2021-06-25T04:55:59.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f8798ed7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87940b13b0 0x7f87940b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:59.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f8798ed7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87940b1d20 0x7f8794146b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:59.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f8798ed7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87940ae610 con 0x7f8794147060 2021-06-25T04:55:59.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f8798ed7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87940b1790 con 0x7f87940b13b0 2021-06-25T04:55:59.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f8798ed7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87940b22a0 con 0x7f87940b1d20 2021-06-25T04:55:59.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f879259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87940b13b0 0x7f87940b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:59.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f879259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87940b13b0 0x7f87940b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42680/0 (socket says 172.21.15.57:42680) 2021-06-25T04:55:59.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f879259c700 1 -- 172.21.15.57:0/2181293040 learned_addr learned my addr 172.21.15.57:0/2181293040 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:59.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f8791d9b700 1 --2- 172.21.15.57:0/2181293040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87940b1d20 0x7f8794146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:59.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f879259c700 1 -- 172.21.15.57:0/2181293040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87940b1d20 msgr2=0x7f8794146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:55:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f879259c700 1 --2- 172.21.15.57:0/2181293040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87940b1d20 0x7f8794146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f879259c700 1 -- 172.21.15.57:0/2181293040 >> v1:172.21.15.87:6789/0 conn(0x7f8794147060 legacy=0x7f879405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f879259c700 1 -- 172.21.15.57:0/2181293040 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87940b2540 con 0x7f87940b13b0 2021-06-25T04:55:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f879259c700 1 --2- 172.21.15.57:0/2181293040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940b13b0 0x7f87940b3040 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f8784002f70 tx=0x7f8784006eb0).ready entity=mon.0 client_cookie=e1b88a852e3dd31d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:59.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f879159a700 1 -- 172.21.15.57:0/2181293040 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f878400d570 con 0x7f87940b13b0 2021-06-25T04:55:59.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f879159a700 1 -- 172.21.15.57:0/2181293040 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8784000e90 con 0x7f87940b13b0 2021-06-25T04:55:59.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f879159a700 1 -- 172.21.15.57:0/2181293040 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f878400d900 con 0x7f87940b13b0 2021-06-25T04:55:59.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f8798ed7700 1 -- 172.21.15.57:0/2181293040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940b13b0 msgr2=0x7f87940b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:59.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.823+0000 7f8798ed7700 1 --2- 172.21.15.57:0/2181293040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940b13b0 0x7f87940b3040 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f8784002f70 tx=0x7f8784006eb0).stop 2021-06-25T04:55:59.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 -- 172.21.15.57:0/2181293040 shutdown_connections 2021-06-25T04:55:59.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 --2- 172.21.15.57:0/2181293040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87940b1d20 0x7f8794146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:59.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 --2- 172.21.15.57:0/2181293040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940b13b0 0x7f87940b3040 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:59.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 -- 172.21.15.57:0/2181293040 >> 172.21.15.57:0/2181293040 conn(0x7f8794060780 msgr2=0x7f8794060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:55:59.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 -- 172.21.15.57:0/2181293040 shutdown_connections 2021-06-25T04:55:59.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 -- 172.21.15.57:0/2181293040 wait complete. 2021-06-25T04:55:59.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 Processor -- start 2021-06-25T04:55:59.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 -- start start 2021-06-25T04:55:59.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87940b13b0 0x7f8794067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:59.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940b1d20 0x7f87940a9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:59.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8794147060 0x7f87940a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:59.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8794065950 con 0x7f87940b1d20 2021-06-25T04:55:59.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8794065bf0 con 0x7f8794147060 2021-06-25T04:55:59.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8794152720 con 0x7f87940b13b0 2021-06-25T04:55:59.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8791d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940b1d20 0x7f87940a9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:59.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f879259c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87940b13b0 0x7f8794067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:59.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8791d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940b1d20 0x7f87940a9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42688/0 (socket says 172.21.15.57:42688) 2021-06-25T04:55:59.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f879259c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87940b13b0 0x7f8794067210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:53850/0 (socket says 172.21.15.57:53850) 2021-06-25T04:55:59.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8791d9b700 1 -- 172.21.15.57:0/4202418629 learned_addr learned my addr 172.21.15.57:0/4202418629 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:55:59.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8792d9d700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8794147060 0x7f87940a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:59.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8791d9b700 1 -- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87940b13b0 msgr2=0x7f8794067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:59.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8791d9b700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87940b13b0 0x7f8794067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:59.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8791d9b700 1 -- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8794147060 msgr2=0x7f87940a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:55:59.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8791d9b700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8794147060 0x7f87940a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:55:59.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8791d9b700 1 -- 172.21.15.57:0/4202418629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878400b1e0 con 0x7f87940b1d20 2021-06-25T04:55:59.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8791d9b700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940b1d20 0x7f87940a9120 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f878800c000 tx=0x7f8788006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:59.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f87837fe700 1 -- 172.21.15.57:0/4202418629 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8788010780 con 0x7f87940b1d20 2021-06-25T04:55:59.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f87837fe700 1 -- 172.21.15.57:0/4202418629 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87880108e0 con 0x7f87940b1d20 2021-06-25T04:55:59.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 -- 172.21.15.57:0/4202418629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87940a9b00 con 0x7f87940b1d20 2021-06-25T04:55:59.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f87837fe700 1 -- 172.21.15.57:0/4202418629 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8788010c40 con 0x7f87940b1d20 2021-06-25T04:55:59.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.827+0000 7f8798ed7700 1 -- 172.21.15.57:0/4202418629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8794067700 con 0x7f87940b1d20 2021-06-25T04:55:59.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.831+0000 7f8798ed7700 1 -- 172.21.15.57:0/4202418629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8794057310 con 0x7f87940b1d20 2021-06-25T04:55:59.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.831+0000 7f87837fe700 1 -- 172.21.15.57:0/4202418629 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f878801c460 con 0x7f87940b1d20 2021-06-25T04:55:59.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.831+0000 7f87837fe700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87700553f0 0x7f87700578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:55:59.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.831+0000 7f87837fe700 1 -- 172.21.15.57:0/4202418629 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f878806e290 con 0x7f87940b1d20 2021-06-25T04:55:59.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.831+0000 7f879259c700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87700553f0 0x7f87700578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:55:59.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.831+0000 7f879259c700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87700553f0 0x7f87700578b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f878401b000 tx=0x7f8784015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:55:59.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.839+0000 7f87837fe700 1 -- 172.21.15.57:0/4202418629 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f87880443b0 con 0x7f87940b1d20 2021-06-25T04:55:59.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:55:59.967+0000 7f8798ed7700 1 -- 172.21.15.57:0/4202418629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f8794044610 con 0x7f87940b1d20 2021-06-25T04:56:00.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.691+0000 7f87837fe700 1 -- 172.21.15.57:0/4202418629 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v123) v1 ==== 133+0+0 (secure 0 0 0) 0x7f87880479d0 con 0x7f87940b1d20 2021-06-25T04:56:00.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 -- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87700553f0 msgr2=0x7f87700578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87700553f0 0x7f87700578b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f878401b000 tx=0x7f8784015000).stop 2021-06-25T04:56:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 -- 172.21.15.57:0/4202418629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940b1d20 msgr2=0x7f87940a9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940b1d20 0x7f87940a9120 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f878800c000 tx=0x7f8788006df0).stop 2021-06-25T04:56:00.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 -- 172.21.15.57:0/4202418629 shutdown_connections 2021-06-25T04:56:00.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f87700553f0 0x7f87700578b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:00.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8794147060 0x7f87940a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:00.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940b1d20 0x7f87940a9120 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:00.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 --2- 172.21.15.57:0/4202418629 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87940b13b0 0x7f8794067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 -- 172.21.15.57:0/4202418629 >> 172.21.15.57:0/4202418629 conn(0x7f8794060780 msgr2=0x7f87940b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 -- 172.21.15.57:0/4202418629 shutdown_connections 2021-06-25T04:56:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:00.695+0000 7f8798ed7700 1 -- 172.21.15.57:0/4202418629 wait complete. 2021-06-25T04:56:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:56:00.715 DEBUG:teuthology.orchestra.run.smithi102:> sudo rados -p cephfs_metadata put key /etc/fstab 2021-06-25T04:56:00.763 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.748+0000 7fb9467e6b80 1 Processor -- start 2021-06-25T04:56:00.764 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.748+0000 7fb9467e6b80 1 -- start start 2021-06-25T04:56:00.764 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.748+0000 7fb9467e6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c7f0d88e0 0x561c7f16ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:00.765 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.748+0000 7fb9467e6b80 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x561c7f0d91b0 0x561c7f16b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:00.765 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.748+0000 7fb9467e6b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561c7f170c10 0x561c7f16b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:00.765 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.748+0000 7fb9467e6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c7f085370 con 0x561c7f0d88e0 2021-06-25T04:56:00.765 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.748+0000 7fb9467e6b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c7f055380 con 0x561c7f170c10 2021-06-25T04:56:00.766 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.748+0000 7fb9467e6b80 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c7f17a8c0 con 0x561c7f0d91b0 2021-06-25T04:56:00.766 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb945425700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561c7f170c10 0x561c7f16b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:00.766 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb944423700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x561c7f0d91b0 0x561c7f16b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:00.766 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb945425700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561c7f170c10 0x561c7f16b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.102:43026/0 (socket says 172.21.15.102:43026) 2021-06-25T04:56:00.767 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb945425700 1 -- 172.21.15.102:0/2196361924 learned_addr learned my addr 172.21.15.102:0/2196361924 (peer_addr_for_me v2:172.21.15.102:0/0) 2021-06-25T04:56:00.767 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb944c24700 1 --2- 172.21.15.102:0/2196361924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c7f0d88e0 0x561c7f16ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:00.767 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb945425700 1 -- 172.21.15.102:0/2196361924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x561c7f0d91b0 msgr2=0x561c7f16b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:00.767 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb945425700 1 --2- 172.21.15.102:0/2196361924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x561c7f0d91b0 0x561c7f16b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:00.768 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb945425700 1 -- 172.21.15.102:0/2196361924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c7f0d88e0 msgr2=0x561c7f16ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:00.768 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb945425700 1 --2- 172.21.15.102:0/2196361924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c7f0d88e0 0x561c7f16ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:00.768 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb945425700 1 -- 172.21.15.102:0/2196361924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb934005cd0 con 0x561c7f170c10 2021-06-25T04:56:00.768 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb945425700 1 --2- 172.21.15.102:0/2196361924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561c7f170c10 0x561c7f16b770 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fb93400b000 tx=0x7fb93400c040).ready entity=mon.1 client_cookie=4e2f9f087826a8c1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:00.768 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb942c20700 1 -- 172.21.15.102:0/2196361924 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb93400f040 con 0x561c7f170c10 2021-06-25T04:56:00.770 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb942c20700 1 -- 172.21.15.102:0/2196361924 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9340089d0 con 0x561c7f170c10 2021-06-25T04:56:00.770 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb942c20700 1 -- 172.21.15.102:0/2196361924 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb934008d30 con 0x561c7f170c10 2021-06-25T04:56:00.770 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2196361924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561c7f170c10 msgr2=0x561c7f16b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:00.771 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 --2- 172.21.15.102:0/2196361924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561c7f170c10 0x561c7f16b770 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fb93400b000 tx=0x7fb93400c040).stop 2021-06-25T04:56:00.771 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2196361924 shutdown_connections 2021-06-25T04:56:00.771 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 --2- 172.21.15.102:0/2196361924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561c7f170c10 0x561c7f16b770 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:00.771 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 --2- 172.21.15.102:0/2196361924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x561c7f0d91b0 0x561c7f16b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:00.772 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 --2- 172.21.15.102:0/2196361924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c7f0d88e0 0x561c7f16ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:00.772 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2196361924 >> 172.21.15.102:0/2196361924 conn(0x561c7f15ec80 msgr2=0x561c7f160b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:00.772 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2196361924 shutdown_connections 2021-06-25T04:56:00.772 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2196361924 wait complete. 2021-06-25T04:56:00.772 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 Processor -- start 2021-06-25T04:56:00.773 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 -- start start 2021-06-25T04:56:00.773 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x561c7f0d88e0 0x561c7f17a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:00.773 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561c7f0d91b0 0x561c7f1753e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:00.773 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c7f170c10 0x561c7f1758d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:00.774 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c7f1752a0 con 0x561c7f170c10 2021-06-25T04:56:00.774 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c7f176010 con 0x561c7f0d91b0 2021-06-25T04:56:00.774 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb9467e6b80 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c7f1761d0 con 0x561c7f0d88e0 2021-06-25T04:56:00.774 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb944c24700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x561c7f0d88e0 0x561c7f17a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:00.774 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb944c24700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x561c7f0d88e0 0x561c7f17a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.102:38346/0 (socket says 172.21.15.102:38346) 2021-06-25T04:56:00.775 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb944423700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561c7f0d91b0 0x561c7f1753e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:00.775 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb944c24700 1 -- 172.21.15.102:0/2520413985 learned_addr learned my addr 172.21.15.102:0/2520413985 (peer_addr_for_me v2:172.21.15.102:0/0) 2021-06-25T04:56:00.775 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.752+0000 7fb945425700 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c7f170c10 0x561c7f1758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:00.776 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb944c24700 1 -- 172.21.15.102:0/2520413985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561c7f0d91b0 msgr2=0x561c7f1753e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:00.776 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb944c24700 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561c7f0d91b0 0x561c7f1753e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:00.776 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb944c24700 1 -- 172.21.15.102:0/2520413985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c7f170c10 msgr2=0x561c7f1758d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:00.777 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb944c24700 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c7f170c10 0x561c7f1758d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:00.777 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb944c24700 1 -- 172.21.15.102:0/2520413985 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340095c0 con 0x561c7f0d88e0 2021-06-25T04:56:00.777 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb944c24700 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x561c7f0d88e0 0x561c7f17a230 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fb93c019000 tx=0x7fb93c014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:00.777 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb94241f700 1 -- 172.21.15.102:0/2520413985 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb93c005ea0 con 0x561c7f0d88e0 2021-06-25T04:56:00.778 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb94241f700 1 -- 172.21.15.102:0/2520413985 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c00d070 con 0x561c7f0d88e0 2021-06-25T04:56:00.778 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2520413985 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c00a0e0 con 0x561c7f0d88e0 2021-06-25T04:56:00.778 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb94241f700 1 -- 172.21.15.102:0/2520413985 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb93c01d430 con 0x561c7f0d88e0 2021-06-25T04:56:00.778 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2520413985 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c7f079600 con 0x561c7f0d88e0 2021-06-25T04:56:00.782 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb94241f700 1 -- 172.21.15.102:0/2520413985 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb93c016070 con 0x561c7f0d88e0 2021-06-25T04:56:00.782 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.756+0000 7fb94241f700 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb924054050 0x7fb924056510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:00.782 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.760+0000 7fb94241f700 1 -- 172.21.15.102:0/2520413985 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6422+0+0 (secure 0 0 0) 0x7fb93c06e0f0 con 0x561c7f0d88e0 2021-06-25T04:56:00.783 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.760+0000 7fb944423700 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb924054050 0x7fb924056510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:00.783 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.760+0000 7fb9467e6b80 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x561c7f182a70 0x561c7f184e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:00.783 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.760+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2520413985 --> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] -- osd_op(unknown.0.0:1 23.0 23:0620e6f9:::key:head [writefull 0~617 in=617b] snapc 0=[] ondisk+write+known_if_redirected e123) v8 -- 0x561c7f1853f0 con 0x561c7f182a70 2021-06-25T04:56:00.783 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.760+0000 7fb944423700 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb924054050 0x7fb924056510 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fb92c009000 tx=0x7fb92c001750).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:00.784 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.760+0000 7fb945425700 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x561c7f182a70 0x561c7f184e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:00.784 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:00.760+0000 7fb945425700 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x561c7f182a70 0x561c7f184e60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:01.897 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.892+0000 7fb94241f700 1 -- 172.21.15.102:0/2520413985 <== osd.0 v2:172.21.15.57:6800/15205 1 ==== osd_map(124..124 src has 1..124) v4 ==== 320+0+0 (crc 0 0 0) 0x7fb934008c00 con 0x561c7f182a70 2021-06-25T04:56:01.904 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb945425700 1 -- 172.21.15.102:0/2520413985 <== osd.0 v2:172.21.15.57:6800/15205 2 ==== osd_op_reply(1 key [writefull 0~617] v124'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7fb934008dc0 con 0x561c7f182a70 2021-06-25T04:56:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2520413985 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x561c7f182a70 msgr2=0x561c7f184e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb9467e6b80 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x561c7f182a70 0x561c7f184e60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2520413985 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb924054050 msgr2=0x7fb924056510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb9467e6b80 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb924054050 0x7fb924056510 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fb92c009000 tx=0x7fb92c001750).stop 2021-06-25T04:56:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2520413985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x561c7f0d88e0 msgr2=0x561c7f17a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb9467e6b80 1 --2- 172.21.15.102:0/2520413985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x561c7f0d88e0 0x561c7f17a230 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fb93c019000 tx=0x7fb93c014000).stop 2021-06-25T04:56:01.908 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb945425700 1 -- 172.21.15.102:0/2520413985 reap_dead start 2021-06-25T04:56:01.908 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2520413985 shutdown_connections 2021-06-25T04:56:01.908 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2520413985 >> 172.21.15.102:0/2520413985 conn(0x561c7f15ec80 msgr2=0x561c7f16afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:01.908 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2520413985 shutdown_connections 2021-06-25T04:56:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2021-06-25T04:56:01.900+0000 7fb9467e6b80 1 -- 172.21.15.102:0/2520413985 wait complete. 2021-06-25T04:56:01.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-06-25T04:56:02.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.015+0000 7f0d762d3700 1 Processor -- start 2021-06-25T04:56:02.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.015+0000 7f0d762d3700 1 -- start start 2021-06-25T04:56:02.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.015+0000 7f0d762d3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0d700b06d0 0x7f0d70142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:02.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.015+0000 7f0d762d3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d701438e0 con 0x7f0d700ace30 2021-06-25T04:56:02.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.015+0000 7f0d762d3700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d700b0ab0 con 0x7f0d700b3090 2021-06-25T04:56:02.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.015+0000 7f0d762d3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d700ae640 con 0x7f0d700b06d0 2021-06-25T04:56:02.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d75ad2700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0d700ace30 0x7f0d7013f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59916/0 (socket says 172.21.15.57:59916) 2021-06-25T04:56:02.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d75ad2700 1 -- 172.21.15.57:0/2422574041 learned_addr learned my addr 172.21.15.57:0/2422574041 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:02.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d752d1700 1 --2- 172.21.15.57:0/2422574041 >> v2:172.21.15.87:3300/0 conn(0x7f0d700b06d0 0x7f0d70142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:02.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d67fff700 1 -- 172.21.15.57:0/2422574041 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454692923 0 0) 0x7f0d701438e0 con 0x7f0d700ace30 2021-06-25T04:56:02.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d67fff700 1 -- 172.21.15.57:0/2422574041 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d54003260 con 0x7f0d700ace30 2021-06-25T04:56:02.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d752d1700 1 -- 172.21.15.57:0/2422574041 >> v1:172.21.15.87:6789/0 conn(0x7f0d700b3090 legacy=0x7f0d701431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:02.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d752d1700 1 -- 172.21.15.57:0/2422574041 >> v1:172.21.15.57:6789/0 conn(0x7f0d700ace30 legacy=0x7f0d7013f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:02.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d752d1700 1 -- 172.21.15.57:0/2422574041 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d700ae8e0 con 0x7f0d700b06d0 2021-06-25T04:56:02.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d752d1700 1 --2- 172.21.15.57:0/2422574041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d700b06d0 0x7f0d70142ce0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f0d6c002f70 tx=0x7f0d6c006e80).ready entity=mon.1 client_cookie=1296cbc409dc8760 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:02.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d67fff700 1 -- 172.21.15.57:0/2422574041 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d6c014070 con 0x7f0d700b06d0 2021-06-25T04:56:02.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d67fff700 1 -- 172.21.15.57:0/2422574041 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c000e90 con 0x7f0d700b06d0 2021-06-25T04:56:02.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d67fff700 1 -- 172.21.15.57:0/2422574041 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d6c0107f0 con 0x7f0d700b06d0 2021-06-25T04:56:02.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d762d3700 1 -- 172.21.15.57:0/2422574041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d700b06d0 msgr2=0x7f0d70142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:02.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d762d3700 1 --2- 172.21.15.57:0/2422574041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d700b06d0 0x7f0d70142ce0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f0d6c002f70 tx=0x7f0d6c006e80).stop 2021-06-25T04:56:02.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d762d3700 1 -- 172.21.15.57:0/2422574041 shutdown_connections 2021-06-25T04:56:02.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d762d3700 1 --2- 172.21.15.57:0/2422574041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d700b06d0 0x7f0d70142ce0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:02.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d762d3700 1 -- 172.21.15.57:0/2422574041 >> 172.21.15.57:0/2422574041 conn(0x7f0d70061100 msgr2=0x7f0d70062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:02.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d762d3700 1 -- 172.21.15.57:0/2422574041 shutdown_connections 2021-06-25T04:56:02.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.019+0000 7f0d762d3700 1 -- 172.21.15.57:0/2422574041 wait complete. 2021-06-25T04:56:02.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d762d3700 1 Processor -- start 2021-06-25T04:56:02.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d762d3700 1 -- start start 2021-06-25T04:56:02.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d762d3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d700ace30 0x7f0d700abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:02.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d762d3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d700b06d0 0x7f0d70063aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d762d3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d700b3090 0x7f0d70150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d762d3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d70067430 con 0x7f0d700ace30 2021-06-25T04:56:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d762d3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d70066c50 con 0x7f0d700b06d0 2021-06-25T04:56:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d762d3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d70066ef0 con 0x7f0d700b3090 2021-06-25T04:56:02.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d752d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d700ace30 0x7f0d700abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:02.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d752d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d700ace30 0x7f0d700abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42700/0 (socket says 172.21.15.57:42700) 2021-06-25T04:56:02.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d752d1700 1 -- 172.21.15.57:0/601119318 learned_addr learned my addr 172.21.15.57:0/601119318 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:02.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d75ad2700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d700b3090 0x7f0d70150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:02.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.023+0000 7f0d74ad0700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d700b06d0 0x7f0d70063aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d752d1700 1 -- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d700b3090 msgr2=0x7f0d70150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d752d1700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d700b3090 0x7f0d70150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d752d1700 1 -- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d700b06d0 msgr2=0x7f0d70063aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d752d1700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d700b06d0 0x7f0d70063aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d752d1700 1 -- 172.21.15.57:0/601119318 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c00c310 con 0x7f0d700ace30 2021-06-25T04:56:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d752d1700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d700ace30 0x7f0d700abd50 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f0d6c002f70 tx=0x7f0d700ae560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d667fc700 1 -- 172.21.15.57:0/601119318 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d6c00e800 con 0x7f0d700ace30 2021-06-25T04:56:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d667fc700 1 -- 172.21.15.57:0/601119318 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c00e960 con 0x7f0d700ace30 2021-06-25T04:56:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d762d3700 1 -- 172.21.15.57:0/601119318 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d70067190 con 0x7f0d700ace30 2021-06-25T04:56:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d667fc700 1 -- 172.21.15.57:0/601119318 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d6c00ecc0 con 0x7f0d700ace30 2021-06-25T04:56:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d762d3700 1 -- 172.21.15.57:0/601119318 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d70063f90 con 0x7f0d700ace30 2021-06-25T04:56:02.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d667fc700 1 -- 172.21.15.57:0/601119318 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0d6c021020 con 0x7f0d700ace30 2021-06-25T04:56:02.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d762d3700 1 -- 172.21.15.57:0/601119318 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d70057310 con 0x7f0d700ace30 2021-06-25T04:56:02.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d667fc700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d580553d0 0x7f0d58057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:02.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d667fc700 1 -- 172.21.15.57:0/601119318 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6422+0+0 (secure 0 0 0) 0x7f0d6c06f390 con 0x7f0d700ace30 2021-06-25T04:56:02.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.027+0000 7f0d74ad0700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d580553d0 0x7f0d58057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:02.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.031+0000 7f0d74ad0700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d580553d0 0x7f0d58057890 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f0d6000b000 tx=0x7f0d60009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:02.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.035+0000 7f0d667fc700 1 -- 172.21.15.57:0/601119318 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0d6c045430 con 0x7f0d700ace30 2021-06-25T04:56:02.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 -- 172.21.15.57:0/601119318 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f0d700b1150 con 0x7f0d700ace30 2021-06-25T04:56:02.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d667fc700 1 -- 172.21.15.57:0/601119318 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1588 (secure 0 0 0) 0x7f0d6c048a50 con 0x7f0d700ace30 2021-06-25T04:56:02.212 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:02.212 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:56:02.213 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:56:02.213 INFO:teuthology.orchestra.run.smithi057.stdout: "total_bytes": 773094113280, 2021-06-25T04:56:02.213 INFO:teuthology.orchestra.run.smithi057.stdout: "total_avail_bytes": 764491890688, 2021-06-25T04:56:02.213 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_bytes": 12288000, 2021-06-25T04:56:02.213 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_bytes": 8602222592, 2021-06-25T04:56:02.214 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_ratio": 0.011127005331218243, 2021-06-25T04:56:02.214 INFO:teuthology.orchestra.run.smithi057.stdout: "num_osds": 8, 2021-06-25T04:56:02.214 INFO:teuthology.orchestra.run.smithi057.stdout: "num_per_pool_osds": 8, 2021-06-25T04:56:02.214 INFO:teuthology.orchestra.run.smithi057.stdout: "num_per_pool_omap_osds": 8 2021-06-25T04:56:02.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:02.215 INFO:teuthology.orchestra.run.smithi057.stdout: "stats_by_class": { 2021-06-25T04:56:02.215 INFO:teuthology.orchestra.run.smithi057.stdout: "ssd": { 2021-06-25T04:56:02.215 INFO:teuthology.orchestra.run.smithi057.stdout: "total_bytes": 773094113280, 2021-06-25T04:56:02.215 INFO:teuthology.orchestra.run.smithi057.stdout: "total_avail_bytes": 764491890688, 2021-06-25T04:56:02.216 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_bytes": 12288000, 2021-06-25T04:56:02.216 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_bytes": 8602222592, 2021-06-25T04:56:02.216 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_ratio": 0.011127005331218243 2021-06-25T04:56:02.216 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:02.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:02.217 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:56:02.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:02.217 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "device_health_metrics", 2021-06-25T04:56:02.218 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 1, 2021-06-25T04:56:02.218 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:56:02.218 INFO:teuthology.orchestra.run.smithi057.stdout: "stored": 0, 2021-06-25T04:56:02.218 INFO:teuthology.orchestra.run.smithi057.stdout: "objects": 2, 2021-06-25T04:56:02.218 INFO:teuthology.orchestra.run.smithi057.stdout: "kb_used": 0, 2021-06-25T04:56:02.219 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes_used": 0, 2021-06-25T04:56:02.219 INFO:teuthology.orchestra.run.smithi057.stdout: "percent_used": 0, 2021-06-25T04:56:02.219 INFO:teuthology.orchestra.run.smithi057.stdout: "max_avail": 362918510592 2021-06-25T04:56:02.219 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:02.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:02.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:02.220 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "rbd", 2021-06-25T04:56:02.220 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 2, 2021-06-25T04:56:02.220 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:56:02.221 INFO:teuthology.orchestra.run.smithi057.stdout: "stored": 0, 2021-06-25T04:56:02.221 INFO:teuthology.orchestra.run.smithi057.stdout: "objects": 0, 2021-06-25T04:56:02.221 INFO:teuthology.orchestra.run.smithi057.stdout: "kb_used": 0, 2021-06-25T04:56:02.221 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes_used": 0, 2021-06-25T04:56:02.221 INFO:teuthology.orchestra.run.smithi057.stdout: "percent_used": 0, 2021-06-25T04:56:02.222 INFO:teuthology.orchestra.run.smithi057.stdout: "max_avail": 362918510592 2021-06-25T04:56:02.222 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:02.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:02.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:02.223 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "cephfs_data", 2021-06-25T04:56:02.223 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 22, 2021-06-25T04:56:02.223 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:56:02.224 INFO:teuthology.orchestra.run.smithi057.stdout: "stored": 0, 2021-06-25T04:56:02.224 INFO:teuthology.orchestra.run.smithi057.stdout: "objects": 0, 2021-06-25T04:56:02.224 INFO:teuthology.orchestra.run.smithi057.stdout: "kb_used": 0, 2021-06-25T04:56:02.224 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes_used": 0, 2021-06-25T04:56:02.225 INFO:teuthology.orchestra.run.smithi057.stdout: "percent_used": 0, 2021-06-25T04:56:02.225 INFO:teuthology.orchestra.run.smithi057.stdout: "max_avail": 362918510592 2021-06-25T04:56:02.225 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:02.225 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:02.225 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:02.226 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:56:02.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 -- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d580553d0 msgr2=0x7f0d58057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:02.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d580553d0 0x7f0d58057890 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f0d6000b000 tx=0x7f0d60009040).stop 2021-06-25T04:56:02.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 -- 172.21.15.57:0/601119318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d700ace30 msgr2=0x7f0d700abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:02.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d700ace30 0x7f0d700abd50 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f0d6c002f70 tx=0x7f0d700ae560).stop 2021-06-25T04:56:02.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 -- 172.21.15.57:0/601119318 shutdown_connections 2021-06-25T04:56:02.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f0d580553d0 0x7f0d58057890 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:02.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d700b3090 0x7f0d70150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:02.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d700b06d0 0x7f0d70063aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:02.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 --2- 172.21.15.57:0/601119318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d700ace30 0x7f0d700abd50 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:02.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 -- 172.21.15.57:0/601119318 >> 172.21.15.57:0/601119318 conn(0x7f0d70061100 msgr2=0x7f0d70062da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:02.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 -- 172.21.15.57:0/601119318 shutdown_connections 2021-06-25T04:56:02.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:02.207+0000 7f0d762d3700 1 -- 172.21.15.57:0/601119318 wait complete. 2021-06-25T04:56:02.231 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30)... 2021-06-25T04:56:07.233 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-06-25T04:56:07.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.339+0000 7f52f62bf700 1 Processor -- start 2021-06-25T04:56:07.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.339+0000 7f52f62bf700 1 -- start start 2021-06-25T04:56:07.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.339+0000 7f52f62bf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52f00b30f0 0x7f52f00af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.339+0000 7f52f62bf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f00aa250 con 0x7f52f00b36a0 2021-06-25T04:56:07.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.339+0000 7f52f62bf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f00af520 con 0x7f52f00a9e70 2021-06-25T04:56:07.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.339+0000 7f52f62bf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f00ae2c0 con 0x7f52f00b30f0 2021-06-25T04:56:07.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.339+0000 7f52e7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f52f00b36a0 0x7f52f0144440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59926/0 (socket says 172.21.15.57:59926) 2021-06-25T04:56:07.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.339+0000 7f52e7fff700 1 -- 172.21.15.57:0/1330674427 learned_addr learned my addr 172.21.15.57:0/1330674427 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:07.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.339+0000 7f52f485c700 1 --2- 172.21.15.57:0/1330674427 >> v2:172.21.15.57:3300/0 conn(0x7f52f00b30f0 0x7f52f00af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:07.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52ef7fe700 1 -- 172.21.15.57:0/1330674427 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248104550 0 0) 0x7f52f00aa250 con 0x7f52f00b36a0 2021-06-25T04:56:07.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52ef7fe700 1 -- 172.21.15.57:0/1330674427 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d0003260 con 0x7f52f00b36a0 2021-06-25T04:56:07.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52ef7fe700 1 -- 172.21.15.57:0/1330674427 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361637133 0 0) 0x7f52f00af520 con 0x7f52f00a9e70 2021-06-25T04:56:07.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52ef7fe700 1 -- 172.21.15.57:0/1330674427 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f00aa250 con 0x7f52f00a9e70 2021-06-25T04:56:07.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52ef7fe700 1 -- 172.21.15.57:0/1330674427 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2456033473 0 0) 0x7f52d0003260 con 0x7f52f00b36a0 2021-06-25T04:56:07.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f485c700 1 -- 172.21.15.57:0/1330674427 >> v1:172.21.15.87:6789/0 conn(0x7f52f00a9e70 legacy=0x7f52f014b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:07.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f485c700 1 -- 172.21.15.57:0/1330674427 >> v1:172.21.15.57:6789/0 conn(0x7f52f00b36a0 legacy=0x7f52f0144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:07.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f485c700 1 -- 172.21.15.57:0/1330674427 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0148130 con 0x7f52f00b30f0 2021-06-25T04:56:07.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f485c700 1 --2- 172.21.15.57:0/1330674427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f00b30f0 0x7f52f00af030 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f52d8001800 tx=0x7f52e80091d0).ready entity=mon.0 client_cookie=c00144aaa6846e39 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:07.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52ef7fe700 1 -- 172.21.15.57:0/1330674427 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d8001660 con 0x7f52f00b30f0 2021-06-25T04:56:07.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52ef7fe700 1 -- 172.21.15.57:0/1330674427 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e800f510 con 0x7f52f00b30f0 2021-06-25T04:56:07.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52ef7fe700 1 -- 172.21.15.57:0/1330674427 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52e800f680 con 0x7f52f00b30f0 2021-06-25T04:56:07.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f62bf700 1 -- 172.21.15.57:0/1330674427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f00b30f0 msgr2=0x7f52f00af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:07.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f62bf700 1 --2- 172.21.15.57:0/1330674427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f00b30f0 0x7f52f00af030 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f52d8001800 tx=0x7f52e80091d0).stop 2021-06-25T04:56:07.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f62bf700 1 -- 172.21.15.57:0/1330674427 shutdown_connections 2021-06-25T04:56:07.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f62bf700 1 --2- 172.21.15.57:0/1330674427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f00b30f0 0x7f52f00af030 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f62bf700 1 -- 172.21.15.57:0/1330674427 >> 172.21.15.57:0/1330674427 conn(0x7f52f0060780 msgr2=0x7f52f0060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:07.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f62bf700 1 -- 172.21.15.57:0/1330674427 shutdown_connections 2021-06-25T04:56:07.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f62bf700 1 -- 172.21.15.57:0/1330674427 wait complete. 2021-06-25T04:56:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f62bf700 1 Processor -- start 2021-06-25T04:56:07.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.343+0000 7f52f62bf700 1 -- start start 2021-06-25T04:56:07.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f62bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f00a9e70 0x7f52f0157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f62bf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f00b30f0 0x7f52f01470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f62bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f00b36a0 0x7f52f00b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f62bf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f00b51c0 con 0x7f52f00b36a0 2021-06-25T04:56:07.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f62bf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0156890 con 0x7f52f00a9e70 2021-06-25T04:56:07.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f62bf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0156b30 con 0x7f52f00b30f0 2021-06-25T04:56:07.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f485c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f00b36a0 0x7f52f00b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:07.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f485c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f00b36a0 0x7f52f00b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42716/0 (socket says 172.21.15.57:42716) 2021-06-25T04:56:07.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f485c700 1 -- 172.21.15.57:0/2994496083 learned_addr learned my addr 172.21.15.57:0/2994496083 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:07.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52e7fff700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f00b30f0 0x7f52f01470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:07.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52effff700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f00a9e70 0x7f52f0157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:07.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f485c700 1 -- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f00b30f0 msgr2=0x7f52f01470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:07.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f485c700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f00b30f0 0x7f52f01470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f485c700 1 -- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f00a9e70 msgr2=0x7f52f0157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:07.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f485c700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f00a9e70 0x7f52f0157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f485c700 1 -- 172.21.15.57:0/2994496083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8009470 con 0x7f52f00b36a0 2021-06-25T04:56:07.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52effff700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f00a9e70 0x7f52f0157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:07.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f485c700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f00b36a0 0x7f52f00b4b20 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7f52d8001800 tx=0x7f52e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:07.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52edffb700 1 -- 172.21.15.57:0/2994496083 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52e8006ea0 con 0x7f52f00b36a0 2021-06-25T04:56:07.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52edffb700 1 -- 172.21.15.57:0/2994496083 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e8011a80 con 0x7f52f00b36a0 2021-06-25T04:56:07.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f62bf700 1 -- 172.21.15.57:0/2994496083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f0156dd0 con 0x7f52f00b36a0 2021-06-25T04:56:07.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52edffb700 1 -- 172.21.15.57:0/2994496083 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52e8011de0 con 0x7f52f00b36a0 2021-06-25T04:56:07.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.347+0000 7f52f62bf700 1 -- 172.21.15.57:0/2994496083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f00b23b0 con 0x7f52f00b36a0 2021-06-25T04:56:07.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.351+0000 7f52f62bf700 1 -- 172.21.15.57:0/2994496083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f01566e0 con 0x7f52f00b36a0 2021-06-25T04:56:07.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.351+0000 7f52edffb700 1 -- 172.21.15.57:0/2994496083 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f52e8027020 con 0x7f52f00b36a0 2021-06-25T04:56:07.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.351+0000 7f52edffb700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d40553f0 0x7f52d40578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.351+0000 7f52edffb700 1 -- 172.21.15.57:0/2994496083 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6422+0+0 (secure 0 0 0) 0x7f52e806ecd0 con 0x7f52f00b36a0 2021-06-25T04:56:07.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.351+0000 7f52effff700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d40553f0 0x7f52d40578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:07.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.351+0000 7f52effff700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d40553f0 0x7f52d40578b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f52e000b000 tx=0x7f52e0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:07.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.359+0000 7f52edffb700 1 -- 172.21.15.57:0/2994496083 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f52e8044e80 con 0x7f52f00b36a0 2021-06-25T04:56:07.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.531+0000 7f52f62bf700 1 -- 172.21.15.57:0/2994496083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f52f0156f60 con 0x7f52f00b36a0 2021-06-25T04:56:07.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.531+0000 7f52edffb700 1 -- 172.21.15.57:0/2994496083 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1932 (secure 0 0 0) 0x7f52e8015020 con 0x7f52f00b36a0 2021-06-25T04:56:07.536 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:07.536 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:56:07.536 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:56:07.536 INFO:teuthology.orchestra.run.smithi057.stdout: "total_bytes": 773094113280, 2021-06-25T04:56:07.537 INFO:teuthology.orchestra.run.smithi057.stdout: "total_avail_bytes": 764491571200, 2021-06-25T04:56:07.537 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_bytes": 12607488, 2021-06-25T04:56:07.537 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_bytes": 8602542080, 2021-06-25T04:56:07.537 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_ratio": 0.011127418838441372, 2021-06-25T04:56:07.538 INFO:teuthology.orchestra.run.smithi057.stdout: "num_osds": 8, 2021-06-25T04:56:07.538 INFO:teuthology.orchestra.run.smithi057.stdout: "num_per_pool_osds": 8, 2021-06-25T04:56:07.538 INFO:teuthology.orchestra.run.smithi057.stdout: "num_per_pool_omap_osds": 8 2021-06-25T04:56:07.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:07.539 INFO:teuthology.orchestra.run.smithi057.stdout: "stats_by_class": { 2021-06-25T04:56:07.539 INFO:teuthology.orchestra.run.smithi057.stdout: "ssd": { 2021-06-25T04:56:07.539 INFO:teuthology.orchestra.run.smithi057.stdout: "total_bytes": 773094113280, 2021-06-25T04:56:07.539 INFO:teuthology.orchestra.run.smithi057.stdout: "total_avail_bytes": 764491571200, 2021-06-25T04:56:07.540 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_bytes": 12607488, 2021-06-25T04:56:07.540 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_bytes": 8602542080, 2021-06-25T04:56:07.540 INFO:teuthology.orchestra.run.smithi057.stdout: "total_used_raw_ratio": 0.011127418838441372 2021-06-25T04:56:07.540 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:07.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:07.541 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:56:07.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:07.541 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "device_health_metrics", 2021-06-25T04:56:07.541 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 1, 2021-06-25T04:56:07.542 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:56:07.542 INFO:teuthology.orchestra.run.smithi057.stdout: "stored": 0, 2021-06-25T04:56:07.542 INFO:teuthology.orchestra.run.smithi057.stdout: "objects": 2, 2021-06-25T04:56:07.542 INFO:teuthology.orchestra.run.smithi057.stdout: "kb_used": 0, 2021-06-25T04:56:07.543 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes_used": 0, 2021-06-25T04:56:07.543 INFO:teuthology.orchestra.run.smithi057.stdout: "percent_used": 0, 2021-06-25T04:56:07.543 INFO:teuthology.orchestra.run.smithi057.stdout: "max_avail": 362918379520 2021-06-25T04:56:07.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:07.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:07.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:07.544 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "rbd", 2021-06-25T04:56:07.544 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 2, 2021-06-25T04:56:07.544 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:56:07.545 INFO:teuthology.orchestra.run.smithi057.stdout: "stored": 0, 2021-06-25T04:56:07.545 INFO:teuthology.orchestra.run.smithi057.stdout: "objects": 0, 2021-06-25T04:56:07.545 INFO:teuthology.orchestra.run.smithi057.stdout: "kb_used": 0, 2021-06-25T04:56:07.545 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes_used": 0, 2021-06-25T04:56:07.546 INFO:teuthology.orchestra.run.smithi057.stdout: "percent_used": 0, 2021-06-25T04:56:07.546 INFO:teuthology.orchestra.run.smithi057.stdout: "max_avail": 362918379520 2021-06-25T04:56:07.546 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:07.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:07.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:07.547 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "cephfs_data", 2021-06-25T04:56:07.547 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 22, 2021-06-25T04:56:07.547 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:56:07.547 INFO:teuthology.orchestra.run.smithi057.stdout: "stored": 0, 2021-06-25T04:56:07.548 INFO:teuthology.orchestra.run.smithi057.stdout: "objects": 0, 2021-06-25T04:56:07.548 INFO:teuthology.orchestra.run.smithi057.stdout: "kb_used": 0, 2021-06-25T04:56:07.548 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes_used": 0, 2021-06-25T04:56:07.548 INFO:teuthology.orchestra.run.smithi057.stdout: "percent_used": 0, 2021-06-25T04:56:07.549 INFO:teuthology.orchestra.run.smithi057.stdout: "max_avail": 362918379520 2021-06-25T04:56:07.549 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:07.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:07.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:07.549 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "cephfs_metadata", 2021-06-25T04:56:07.550 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 23, 2021-06-25T04:56:07.550 INFO:teuthology.orchestra.run.smithi057.stdout: "stats": { 2021-06-25T04:56:07.550 INFO:teuthology.orchestra.run.smithi057.stdout: "stored": 617, 2021-06-25T04:56:07.550 INFO:teuthology.orchestra.run.smithi057.stdout: "objects": 1, 2021-06-25T04:56:07.551 INFO:teuthology.orchestra.run.smithi057.stdout: "kb_used": 8, 2021-06-25T04:56:07.551 INFO:teuthology.orchestra.run.smithi057.stdout: "bytes_used": 8192, 2021-06-25T04:56:07.551 INFO:teuthology.orchestra.run.smithi057.stdout: "percent_used": 1.1286283907452344e-08, 2021-06-25T04:56:07.551 INFO:teuthology.orchestra.run.smithi057.stdout: "max_avail": 362918379520 2021-06-25T04:56:07.552 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:07.552 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:07.552 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:07.552 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:56:07.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 -- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d40553f0 msgr2=0x7f52d40578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:07.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d40553f0 0x7f52d40578b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f52e000b000 tx=0x7f52e0009040).stop 2021-06-25T04:56:07.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 -- 172.21.15.57:0/2994496083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f00b36a0 msgr2=0x7f52f00b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:07.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f00b36a0 0x7f52f00b4b20 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7f52d8001800 tx=0x7f52e8016000).stop 2021-06-25T04:56:07.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 -- 172.21.15.57:0/2994496083 shutdown_connections 2021-06-25T04:56:07.555 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52d40553f0 0x7f52d40578b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f00b36a0 0x7f52f00b4b20 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f00b30f0 0x7f52f01470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 --2- 172.21.15.57:0/2994496083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f00a9e70 0x7f52f0157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 -- 172.21.15.57:0/2994496083 >> 172.21.15.57:0/2994496083 conn(0x7f52f0060780 msgr2=0x7f52f00b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:07.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 -- 172.21.15.57:0/2994496083 shutdown_connections 2021-06-25T04:56:07.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.535+0000 7f52f62bf700 1 -- 172.21.15.57:0/2994496083 wait complete. 2021-06-25T04:56:07.558 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2021-06-25T04:56:07.558 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-06-25T04:56:07.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.667+0000 7f6910a36700 1 Processor -- start 2021-06-25T04:56:07.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.667+0000 7f6910a36700 1 -- start start 2021-06-25T04:56:07.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f690c0b3020 0x7f690c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f690c0aabe0 0x7f690c064b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c0b2340 con 0x7f690c0b7330 2021-06-25T04:56:07.687 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c144210 con 0x7f690c0aabe0 2021-06-25T04:56:07.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0b3530 con 0x7f690c0b3020 2021-06-25T04:56:07.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f690bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f690c0aabe0 0x7f690c064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:07.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f690bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f690c0aabe0 0x7f690c064b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42724/0 (socket says 172.21.15.57:42724) 2021-06-25T04:56:07.688 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f690bfff700 1 -- 172.21.15.57:0/2332566083 learned_addr learned my addr 172.21.15.57:0/2332566083 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:07.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6902ffd700 1 --2- 172.21.15.57:0/2332566083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f690c0b3020 0x7f690c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:07.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f690bfff700 1 -- 172.21.15.57:0/2332566083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f690c0b3020 msgr2=0x7f690c0b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:07.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f690bfff700 1 --2- 172.21.15.57:0/2332566083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f690c0b3020 0x7f690c0b7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f690bfff700 1 -- 172.21.15.57:0/2332566083 >> v1:172.21.15.57:6789/0 conn(0x7f690c0b7330 legacy=0x7f690c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:07.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f690bfff700 1 -- 172.21.15.57:0/2332566083 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0b2570 con 0x7f690c0aabe0 2021-06-25T04:56:07.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f690bfff700 1 --2- 172.21.15.57:0/2332566083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f690c0aabe0 0x7f690c064b60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f69040032f0 tx=0x7f6904009290).ready entity=mon.0 client_cookie=499c6b1cd207ddd7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:07.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f690affd700 1 -- 172.21.15.57:0/2332566083 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f690400b8a0 con 0x7f690c0aabe0 2021-06-25T04:56:07.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f690affd700 1 -- 172.21.15.57:0/2332566083 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690400ba00 con 0x7f690c0aabe0 2021-06-25T04:56:07.690 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f690affd700 1 -- 172.21.15.57:0/2332566083 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f690400bb70 con 0x7f690c0aabe0 2021-06-25T04:56:07.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 -- 172.21.15.57:0/2332566083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f690c0aabe0 msgr2=0x7f690c064b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:07.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 --2- 172.21.15.57:0/2332566083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f690c0aabe0 0x7f690c064b60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f69040032f0 tx=0x7f6904009290).stop 2021-06-25T04:56:07.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 -- 172.21.15.57:0/2332566083 shutdown_connections 2021-06-25T04:56:07.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 --2- 172.21.15.57:0/2332566083 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f690c0b3020 0x7f690c0b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 --2- 172.21.15.57:0/2332566083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f690c0aabe0 0x7f690c064b60 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 -- 172.21.15.57:0/2332566083 >> 172.21.15.57:0/2332566083 conn(0x7f690c05f670 msgr2=0x7f690c05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:07.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 -- 172.21.15.57:0/2332566083 shutdown_connections 2021-06-25T04:56:07.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.671+0000 7f6910a36700 1 -- 172.21.15.57:0/2332566083 wait complete. 2021-06-25T04:56:07.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6910a36700 1 Processor -- start 2021-06-25T04:56:07.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6910a36700 1 -- start start 2021-06-25T04:56:07.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6910a36700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f690c0aabe0 0x7f690c142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6910a36700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f690c0b3020 0x7f690c150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6910a36700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f690c0b7330 0x7f690c150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6910a36700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0b6ef0 con 0x7f690c0b7330 2021-06-25T04:56:07.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6910a36700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0b57c0 con 0x7f690c0b3020 2021-06-25T04:56:07.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6910a36700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0b5a60 con 0x7f690c0aabe0 2021-06-25T04:56:07.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f690bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f690c0b7330 0x7f690c150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:07.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f690bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f690c0b7330 0x7f690c150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42730/0 (socket says 172.21.15.57:42730) 2021-06-25T04:56:07.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f690bfff700 1 -- 172.21.15.57:0/3048579929 learned_addr learned my addr 172.21.15.57:0/3048579929 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:07.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f690b7fe700 1 --2- 172.21.15.57:0/3048579929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f690c0aabe0 0x7f690c142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:07.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6902ffd700 1 --2- 172.21.15.57:0/3048579929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f690c0b3020 0x7f690c150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:07.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f690bfff700 1 -- 172.21.15.57:0/3048579929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f690c0aabe0 msgr2=0x7f690c142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:07.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f690bfff700 1 --2- 172.21.15.57:0/3048579929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f690c0aabe0 0x7f690c142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f690bfff700 1 -- 172.21.15.57:0/3048579929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f690c0b3020 msgr2=0x7f690c150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:07.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f690bfff700 1 --2- 172.21.15.57:0/3048579929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f690c0b3020 0x7f690c150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:07.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f690bfff700 1 -- 172.21.15.57:0/3048579929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904009530 con 0x7f690c0b7330 2021-06-25T04:56:07.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6902ffd700 1 --2- 172.21.15.57:0/3048579929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f690c0b3020 0x7f690c150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:07.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f690bfff700 1 --2- 172.21.15.57:0/3048579929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f690c0b7330 0x7f690c150550 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f69040032f0 tx=0x7f6904016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:07.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f69097fa700 1 -- 172.21.15.57:0/3048579929 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6904011c10 con 0x7f690c0b7330 2021-06-25T04:56:07.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f69097fa700 1 -- 172.21.15.57:0/3048579929 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6904011d70 con 0x7f690c0b7330 2021-06-25T04:56:07.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6910a36700 1 -- 172.21.15.57:0/3048579929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c0b6b70 con 0x7f690c0b7330 2021-06-25T04:56:07.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f69097fa700 1 -- 172.21.15.57:0/3048579929 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6904020620 con 0x7f690c0b7330 2021-06-25T04:56:07.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.675+0000 7f6910a36700 1 -- 172.21.15.57:0/3048579929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c142b80 con 0x7f690c0b7330 2021-06-25T04:56:07.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.679+0000 7f6910a36700 1 -- 172.21.15.57:0/3048579929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c0b70f0 con 0x7f690c0b7330 2021-06-25T04:56:07.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.679+0000 7f69097fa700 1 -- 172.21.15.57:0/3048579929 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f690400f070 con 0x7f690c0b7330 2021-06-25T04:56:07.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.679+0000 7f69097fa700 1 --2- 172.21.15.57:0/3048579929 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68f0055450 0x7f68f0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.679+0000 7f69097fa700 1 -- 172.21.15.57:0/3048579929 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6422+0+0 (secure 0 0 0) 0x7f690406ed50 con 0x7f690c0b7330 2021-06-25T04:56:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.679+0000 7f690b7fe700 1 --2- 172.21.15.57:0/3048579929 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68f0055450 0x7f68f0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.679+0000 7f690b7fe700 1 --2- 172.21.15.57:0/3048579929 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f68f0055450 0x7f68f0057910 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f68fc00d000 tx=0x7f68fc007b70).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:07.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.683+0000 7f69097fa700 1 -- 172.21.15.57:0/3048579929 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6904044df0 con 0x7f690c0b7330 2021-06-25T04:56:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.847+0000 7f6910a36700 1 -- 172.21.15.57:0/3048579929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f690c0b5c20 con 0x7f690c0b7330 2021-06-25T04:56:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.851+0000 7f69097fa700 1 -- 172.21.15.57:0/3048579929 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v61) v1 ==== 209+0+0 (secure 0 0 0) 0x7f6904015070 con 0x7f690c0b7330 2021-06-25T04:56:07.861 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2021-06-25T04:56:07.864 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-06-25T04:56:07.867 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:56:07.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.987+0000 7f936d2bf700 1 Processor -- start 2021-06-25T04:56:07.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.987+0000 7f936d2bf700 1 -- start start 2021-06-25T04:56:07.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9368066f80 0x7f93680a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:07.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93680abe60 con 0x7f93680b1960 2021-06-25T04:56:07.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93680673c0 con 0x7f9368060240 2021-06-25T04:56:07.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93680ab2d0 con 0x7f9368066f80 2021-06-25T04:56:07.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f93667fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f93680b1960 0x7f93680a9760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59954/0 (socket says 172.21.15.57:59954) 2021-06-25T04:56:08.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f93667fc700 1 -- 172.21.15.57:0/2681239044 learned_addr learned my addr 172.21.15.57:0/2681239044 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:08.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f93677fe700 1 --2- 172.21.15.57:0/2681239044 >> v2:172.21.15.87:3300/0 conn(0x7f9368066f80 0x7f93680a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f9365ffb700 1 -- 172.21.15.57:0/2681239044 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849304449 0 0) 0x7f93680abe60 con 0x7f93680b1960 2021-06-25T04:56:08.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f9365ffb700 1 -- 172.21.15.57:0/2681239044 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9348003260 con 0x7f93680b1960 2021-06-25T04:56:08.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f93677fe700 1 -- 172.21.15.57:0/2681239044 >> v1:172.21.15.87:6789/0 conn(0x7f9368060240 legacy=0x7f9368066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f93677fe700 1 -- 172.21.15.57:0/2681239044 >> v1:172.21.15.57:6789/0 conn(0x7f93680b1960 legacy=0x7f93680a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f9365ffb700 1 -- 172.21.15.57:0/2681239044 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115543589 0 0) 0x7f9348003260 con 0x7f93680b1960 2021-06-25T04:56:08.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f93677fe700 1 -- 172.21.15.57:0/2681239044 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93681402c0 con 0x7f9368066f80 2021-06-25T04:56:08.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f93677fe700 1 --2- 172.21.15.57:0/2681239044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9368066f80 0x7f93680a9e70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f9350001800 tx=0x7f93600091d0).ready entity=mon.1 client_cookie=82fd37a370acd005 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:08.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f9365ffb700 1 -- 172.21.15.57:0/2681239044 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9350001660 con 0x7f9368066f80 2021-06-25T04:56:08.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f9365ffb700 1 -- 172.21.15.57:0/2681239044 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936000b580 con 0x7f9368066f80 2021-06-25T04:56:08.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f9365ffb700 1 -- 172.21.15.57:0/2681239044 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f936000b6f0 con 0x7f9368066f80 2021-06-25T04:56:08.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 -- 172.21.15.57:0/2681239044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9368066f80 msgr2=0x7f93680a9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 --2- 172.21.15.57:0/2681239044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9368066f80 0x7f93680a9e70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f9350001800 tx=0x7f93600091d0).stop 2021-06-25T04:56:08.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 -- 172.21.15.57:0/2681239044 shutdown_connections 2021-06-25T04:56:08.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 --2- 172.21.15.57:0/2681239044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9368066f80 0x7f93680a9e70 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 -- 172.21.15.57:0/2681239044 >> 172.21.15.57:0/2681239044 conn(0x7f93680b53a0 msgr2=0x7f93680b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:08.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 -- 172.21.15.57:0/2681239044 shutdown_connections 2021-06-25T04:56:08.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 -- 172.21.15.57:0/2681239044 wait complete. 2021-06-25T04:56:08.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.991+0000 7f936d2bf700 1 Processor -- start 2021-06-25T04:56:08.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f936d2bf700 1 -- start start 2021-06-25T04:56:08.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f936d2bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9368060240 0x7f93680add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f936d2bf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9368066f80 0x7f93680628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f936d2bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93680b1960 0x7f9368150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f936d2bf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93680ad650 con 0x7f93680b1960 2021-06-25T04:56:08.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f936d2bf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93680ac660 con 0x7f9368060240 2021-06-25T04:56:08.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f936d2bf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93680ad1c0 con 0x7f9368066f80 2021-06-25T04:56:08.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f93677fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93680b1960 0x7f9368150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f93677fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93680b1960 0x7f9368150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42744/0 (socket says 172.21.15.57:42744) 2021-06-25T04:56:08.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f93677fe700 1 -- 172.21.15.57:0/1361156141 learned_addr learned my addr 172.21.15.57:0/1361156141 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:08.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f93667fc700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9368066f80 0x7f93680628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f9366ffd700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9368060240 0x7f93680add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f93677fe700 1 -- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9368066f80 msgr2=0x7f93680628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f93677fe700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9368066f80 0x7f93680628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f93677fe700 1 -- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9368060240 msgr2=0x7f93680add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f93677fe700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9368060240 0x7f93680add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f93677fe700 1 -- 172.21.15.57:0/1361156141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9360009470 con 0x7f93680b1960 2021-06-25T04:56:08.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f9366ffd700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9368060240 0x7f93680add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:08.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f93677fe700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93680b1960 0x7f9368150330 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f9350001800 tx=0x7f9360016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:08.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f935ffff700 1 -- 172.21.15.57:0/1361156141 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93600032f0 con 0x7f93680b1960 2021-06-25T04:56:08.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f935ffff700 1 -- 172.21.15.57:0/1361156141 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936000be80 con 0x7f93680b1960 2021-06-25T04:56:08.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f936d2bf700 1 -- 172.21.15.57:0/1361156141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93680acda0 con 0x7f93680b1960 2021-06-25T04:56:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f935ffff700 1 -- 172.21.15.57:0/1361156141 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9360011e00 con 0x7f93680b1960 2021-06-25T04:56:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f936d2bf700 1 -- 172.21.15.57:0/1361156141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93680af610 con 0x7f93680b1960 2021-06-25T04:56:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.995+0000 7f936d2bf700 1 -- 172.21.15.57:0/1361156141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9368057310 con 0x7f93680b1960 2021-06-25T04:56:08.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.999+0000 7f935ffff700 1 -- 172.21.15.57:0/1361156141 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f936000f070 con 0x7f93680b1960 2021-06-25T04:56:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.999+0000 7f935ffff700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f934c0553d0 0x7f934c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.999+0000 7f935ffff700 1 -- 172.21.15.57:0/1361156141 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6422+0+0 (secure 0 0 0) 0x7f936006f080 con 0x7f93680b1960 2021-06-25T04:56:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.999+0000 7f9366ffd700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f934c0553d0 0x7f934c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:07.999+0000 7f9366ffd700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f934c0553d0 0x7f934c057890 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f935800b000 tx=0x7f9358009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:08.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.003+0000 7f935ffff700 1 -- 172.21.15.57:0/1361156141 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9360045230 con 0x7f93680b1960 2021-06-25T04:56:08.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.171+0000 7f936d2bf700 1 -- 172.21.15.57:0/1361156141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f936813d3b0 con 0x7f93680b1960 2021-06-25T04:56:08.176 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:56:08.171+0000 7f8c3e600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:56:08.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.183+0000 7f935ffff700 1 -- 172.21.15.57:0/1361156141 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 22 v62) v1 ==== 189+0+0 (secure 0 0 0) 0x7f93600150d0 con 0x7f93680b1960 2021-06-25T04:56:08.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 -- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f934c0553d0 msgr2=0x7f934c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f934c0553d0 0x7f934c057890 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f935800b000 tx=0x7f9358009040).stop 2021-06-25T04:56:08.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 -- 172.21.15.57:0/1361156141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93680b1960 msgr2=0x7f9368150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93680b1960 0x7f9368150330 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f9350001800 tx=0x7f9360016000).stop 2021-06-25T04:56:08.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 -- 172.21.15.57:0/1361156141 shutdown_connections 2021-06-25T04:56:08.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f934c0553d0 0x7f934c057890 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93680b1960 0x7f9368150330 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9368066f80 0x7f93680628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 --2- 172.21.15.57:0/1361156141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9368060240 0x7f93680add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 -- 172.21.15.57:0/1361156141 >> 172.21.15.57:0/1361156141 conn(0x7f93680b53a0 msgr2=0x7f936813ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:08.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 -- 172.21.15.57:0/1361156141 shutdown_connections 2021-06-25T04:56:08.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.187+0000 7f936d2bf700 1 -- 172.21.15.57:0/1361156141 wait complete. 2021-06-25T04:56:08.194 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 23 and data pool 22 2021-06-25T04:56:08.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:56:08.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:56:08.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.307+0000 7f3d243e1700 1 Processor -- start 2021-06-25T04:56:08.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.307+0000 7f3d243e1700 1 -- start start 2021-06-25T04:56:08.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d243e1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c0ac970 0x7f3d1c05f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d243e1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1c061320 con 0x7f3d1c14ab40 2021-06-25T04:56:08.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d243e1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1c14b5a0 con 0x7f3d1c0afed0 2021-06-25T04:56:08.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d243e1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c14b840 con 0x7f3d1c0ac970 2021-06-25T04:56:08.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2217d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3d1c14ab40 0x7f3d1c0af180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59966/0 (socket says 172.21.15.57:59966) 2021-06-25T04:56:08.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2217d700 1 -- 172.21.15.57:0/2853614644 learned_addr learned my addr 172.21.15.57:0/2853614644 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:08.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2297e700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c0ac970 0x7f3d1c05f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.318 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:56:08.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777560322 0 0) 0x7f3d1c061320 con 0x7f3d1c14ab40 2021-06-25T04:56:08.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d04003260 con 0x7f3d1c14ab40 2021-06-25T04:56:08.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059377467 0 0) 0x7f3d1c14b5a0 con 0x7f3d1c0afed0 2021-06-25T04:56:08.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d1c061320 con 0x7f3d1c0afed0 2021-06-25T04:56:08.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 174085868 0 0) 0x7f3d04003260 con 0x7f3d1c14ab40 2021-06-25T04:56:08.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c0ac970 msgr2=0x7f3d1c05f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:08.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c0ac970 0x7f3d1c05f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 >> v1:172.21.15.87:6789/0 conn(0x7f3d1c0afed0 legacy=0x7f3d1c0b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c0aece0 con 0x7f3d1c14ab40 2021-06-25T04:56:08.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f3d10001660 con 0x7f3d1c14ab40 2021-06-25T04:56:08.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2297e700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c0ac970 0x7f3d1c05f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:08.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 >> v1:172.21.15.57:6789/0 conn(0x7f3d1c14ab40 legacy=0x7f3d1c0af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d04004970 0x7f3d04004d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c0ac970 0x7f3d040034a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d04003990 0x7f3d04003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c14b840 con 0x7f3d04004970 2021-06-25T04:56:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0400b750 con 0x7f3d04003990 2021-06-25T04:56:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0400b910 con 0x7f3d1c0ac970 2021-06-25T04:56:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2217d700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d04004970 0x7f3d04004d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2297e700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d04003990 0x7f3d04003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2197c700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c0ac970 0x7f3d040034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2217d700 1 -- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c0ac970 msgr2=0x7f3d040034a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2217d700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c0ac970 0x7f3d040034a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2217d700 1 -- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d04003990 msgr2=0x7f3d04003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2217d700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d04003990 0x7f3d04003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2217d700 1 -- 172.21.15.57:0/2853614644 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d14009470 con 0x7f3d04004970 2021-06-25T04:56:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2217d700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d04004970 0x7f3d04004d70 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f3d10001430 tx=0x7f3d1c14b730).ready entity=mon.0 client_cookie=fd9fb9a60c2fb3ec server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d100071a0 con 0x7f3d04004970 2021-06-25T04:56:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d10007300 con 0x7f3d04004970 2021-06-25T04:56:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d2117b700 1 -- 172.21.15.57:0/2853614644 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d1000c8f0 con 0x7f3d04004970 2021-06-25T04:56:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d243e1700 1 -- 172.21.15.57:0/2853614644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d04004970 msgr2=0x7f3d04004d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.311+0000 7f3d243e1700 1 --2- 172.21.15.57:0/2853614644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d04004970 0x7f3d04004d70 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f3d10001430 tx=0x7f3d1c14b730).stop 2021-06-25T04:56:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d2297e700 1 -- 172.21.15.57:0/2853614644 reap_dead start 2021-06-25T04:56:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 -- 172.21.15.57:0/2853614644 shutdown_connections 2021-06-25T04:56:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 -- 172.21.15.57:0/2853614644 >> 172.21.15.57:0/2853614644 conn(0x7f3d1c0b5530 msgr2=0x7f3d1c0b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 -- 172.21.15.57:0/2853614644 shutdown_connections 2021-06-25T04:56:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 -- 172.21.15.57:0/2853614644 wait complete. 2021-06-25T04:56:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 Processor -- start 2021-06-25T04:56:08.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 -- start start 2021-06-25T04:56:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d1c159fd0 0x7f3d1c147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d1c0632f0 0x7f3d1c142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c142fd0 0x7f3d1c145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c144be0 con 0x7f3d1c0632f0 2021-06-25T04:56:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c144e80 con 0x7f3d1c159fd0 2021-06-25T04:56:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.315+0000 7f3d243e1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c15a810 con 0x7f3d1c142fd0 2021-06-25T04:56:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2197c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d1c0632f0 0x7f3d1c142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2197c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d1c0632f0 0x7f3d1c142ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42762/0 (socket says 172.21.15.57:42762) 2021-06-25T04:56:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2217d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d1c159fd0 0x7f3d1c147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2197c700 1 -- 172.21.15.57:0/4174776557 learned_addr learned my addr 172.21.15.57:0/4174776557 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:08.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2297e700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c142fd0 0x7f3d1c145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2217d700 1 -- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c142fd0 msgr2=0x7f3d1c145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2217d700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c142fd0 0x7f3d1c145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2217d700 1 -- 172.21.15.57:0/4174776557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d1c0632f0 msgr2=0x7f3d1c142ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2217d700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d1c0632f0 0x7f3d1c142ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2217d700 1 -- 172.21.15.57:0/4174776557 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c15a3b0 con 0x7f3d1c159fd0 2021-06-25T04:56:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2197c700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d1c0632f0 0x7f3d1c142ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d2217d700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d1c159fd0 0x7f3d1c147c30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f3d10001430 tx=0x7f3d10013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:08.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d0f7fe700 1 -- 172.21.15.57:0/4174776557 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d1000cb80 con 0x7f3d1c159fd0 2021-06-25T04:56:08.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d0f7fe700 1 -- 172.21.15.57:0/4174776557 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1000cce0 con 0x7f3d1c159fd0 2021-06-25T04:56:08.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d0f7fe700 1 -- 172.21.15.57:0/4174776557 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d100045e0 con 0x7f3d1c159fd0 2021-06-25T04:56:08.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d243e1700 1 -- 172.21.15.57:0/4174776557 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1c15a5a0 con 0x7f3d1c159fd0 2021-06-25T04:56:08.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d243e1700 1 -- 172.21.15.57:0/4174776557 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1c1435f0 con 0x7f3d1c159fd0 2021-06-25T04:56:08.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d243e1700 1 -- 172.21.15.57:0/4174776557 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1c15a9d0 con 0x7f3d1c159fd0 2021-06-25T04:56:08.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.319+0000 7f3d0f7fe700 1 -- 172.21.15.57:0/4174776557 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3d1001c070 con 0x7f3d1c159fd0 2021-06-25T04:56:08.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.323+0000 7f3d0f7fe700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3cfc055450 0x7f3cfc057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:08.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.323+0000 7f3d0f7fe700 1 -- 172.21.15.57:0/4174776557 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f3d1006dbf0 con 0x7f3d1c159fd0 2021-06-25T04:56:08.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.323+0000 7f3d2197c700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3cfc055450 0x7f3cfc057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:08.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.323+0000 7f3d2197c700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3cfc055450 0x7f3cfc057910 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f3d180011f0 tx=0x7f3d18007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:08.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:56:08.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.331+0000 7f3d0f7fe700 1 -- 172.21.15.57:0/4174776557 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3d10043d50 con 0x7f3d1c159fd0 2021-06-25T04:56:08.348 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:56:08.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:08.503+0000 7f3d243e1700 1 -- 172.21.15.57:0/4174776557 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3d1c057310 con 0x7f3d1c159fd0 2021-06-25T04:56:09.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.191+0000 7f3d0f7fe700 1 -- 172.21.15.57:0/4174776557 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3d10047370 con 0x7f3d1c159fd0 2021-06-25T04:56:09.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 -- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3cfc055450 msgr2=0x7f3cfc057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:09.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3cfc055450 0x7f3cfc057910 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f3d180011f0 tx=0x7f3d18007a00).stop 2021-06-25T04:56:09.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 -- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d1c159fd0 msgr2=0x7f3d1c147c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:09.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d1c159fd0 0x7f3d1c147c30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f3d10001430 tx=0x7f3d10013000).stop 2021-06-25T04:56:09.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 -- 172.21.15.57:0/4174776557 shutdown_connections 2021-06-25T04:56:09.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3cfc055450 0x7f3cfc057910 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:09.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d1c142fd0 0x7f3d1c145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:09.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d1c0632f0 0x7f3d1c142ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:09.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 --2- 172.21.15.57:0/4174776557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d1c159fd0 0x7f3d1c147c30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:09.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 -- 172.21.15.57:0/4174776557 >> 172.21.15.57:0/4174776557 conn(0x7f3d1c0b5530 msgr2=0x7f3d1c060a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:09.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 -- 172.21.15.57:0/4174776557 shutdown_connections 2021-06-25T04:56:09.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.195+0000 7f3d243e1700 1 -- 172.21.15.57:0/4174776557 wait complete. 2021-06-25T04:56:09.217 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:56:09.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd35e020700 1 Processor -- start 2021-06-25T04:56:09.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd35e020700 1 -- start start 2021-06-25T04:56:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd35e020700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd358148360 0x7fd3580b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd35e020700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580b0310 con 0x7fd3580a7080 2021-06-25T04:56:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd35e020700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580b05b0 con 0x7fd3580b1d70 2021-06-25T04:56:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd35e020700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580a9080 con 0x7fd358148360 2021-06-25T04:56:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd357fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd3580a7080 0x7fd3581446e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59990/0 (socket says 172.21.15.57:59990) 2021-06-25T04:56:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd357fff700 1 -- 172.21.15.57:0/655263102 learned_addr learned my addr 172.21.15.57:0/655263102 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:09.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd34effd700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd358148360 0x7fd3580b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:09.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487345502 0 0) 0x7fd3580b0310 con 0x7fd3580a7080 2021-06-25T04:56:09.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd338003260 con 0x7fd3580a7080 2021-06-25T04:56:09.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183061529 0 0) 0x7fd3580b05b0 con 0x7fd3580b1d70 2021-06-25T04:56:09.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3580b0310 con 0x7fd3580b1d70 2021-06-25T04:56:09.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1924940126 0 0) 0x7fd338003260 con 0x7fd3580a7080 2021-06-25T04:56:09.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd358148360 msgr2=0x7fd3580b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:09.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd358148360 0x7fd3580b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:09.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 >> v1:172.21.15.87:6789/0 conn(0x7fd3580b1d70 legacy=0x7fd3580b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:09.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580b0850 con 0x7fd3580a7080 2021-06-25T04:56:09.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fd3500019e0 con 0x7fd3580a7080 2021-06-25T04:56:09.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 >> v1:172.21.15.57:6789/0 conn(0x7fd3580a7080 legacy=0x7fd3581446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:09.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd358148360 0x7fd338003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:09.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd338003e20 0x7fd338004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:09.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3380049f0 0x7fd338004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:09.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33800b800 con 0x7fd3380049f0 2021-06-25T04:56:09.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33800b940 con 0x7fd338003e20 2021-06-25T04:56:09.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.327+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33800bb00 con 0x7fd358148360 2021-06-25T04:56:09.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd357fff700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3380049f0 0x7fd338004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:09.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd34effd700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd338003e20 0x7fd338004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:09.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd3577fe700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd358148360 0x7fd338003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:09.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd357fff700 1 -- 172.21.15.57:0/655263102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd358148360 msgr2=0x7fd338003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:09.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd357fff700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd358148360 0x7fd338003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:09.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd357fff700 1 -- 172.21.15.57:0/655263102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd338003e20 msgr2=0x7fd338004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:09.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd357fff700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd338003e20 0x7fd338004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:09.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd357fff700 1 -- 172.21.15.57:0/655263102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338003260 con 0x7fd3380049f0 2021-06-25T04:56:09.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd357fff700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3380049f0 0x7fd338004e70 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fd3500017b0 tx=0x7fd3580b0740).ready entity=mon.0 client_cookie=5c2c270d3cc0978c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:09.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd35000cca0 con 0x7fd3380049f0 2021-06-25T04:56:09.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35000ce00 con 0x7fd3380049f0 2021-06-25T04:56:09.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd356ffd700 1 -- 172.21.15.57:0/655263102 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd350005b80 con 0x7fd3380049f0 2021-06-25T04:56:09.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd35e020700 1 -- 172.21.15.57:0/655263102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3380049f0 msgr2=0x7fd338004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:09.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd35e020700 1 --2- 172.21.15.57:0/655263102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3380049f0 0x7fd338004e70 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fd3500017b0 tx=0x7fd3580b0740).stop 2021-06-25T04:56:09.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd357fff700 1 -- 172.21.15.57:0/655263102 reap_dead start 2021-06-25T04:56:09.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd35e020700 1 -- 172.21.15.57:0/655263102 shutdown_connections 2021-06-25T04:56:09.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd35e020700 1 -- 172.21.15.57:0/655263102 >> 172.21.15.57:0/655263102 conn(0x7fd35805f670 msgr2=0x7fd35805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:09.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd35e020700 1 -- 172.21.15.57:0/655263102 shutdown_connections 2021-06-25T04:56:09.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.331+0000 7fd35e020700 1 -- 172.21.15.57:0/655263102 wait complete. 2021-06-25T04:56:09.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd35e020700 1 Processor -- start 2021-06-25T04:56:09.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd35e020700 1 -- start start 2021-06-25T04:56:09.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd35e020700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd35814af10 0x7fd3580640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:09.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd35e020700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3580abac0 0x7fd3580645e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:09.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd35e020700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580aaf20 0x7fd358159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:09.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd35e020700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35814b2f0 con 0x7fd3580abac0 2021-06-25T04:56:09.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd35e020700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580aa6b0 con 0x7fd3580aaf20 2021-06-25T04:56:09.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd35e020700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580aa950 con 0x7fd35814af10 2021-06-25T04:56:09.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd34effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3580abac0 0x7fd3580645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:09.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd34effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3580abac0 0x7fd3580645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42782/0 (socket says 172.21.15.57:42782) 2021-06-25T04:56:09.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd357fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580aaf20 0x7fd358159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:09.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd34effd700 1 -- 172.21.15.57:0/1140743994 learned_addr learned my addr 172.21.15.57:0/1140743994 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd3577fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd35814af10 0x7fd3580640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd34effd700 1 -- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd35814af10 msgr2=0x7fd3580640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd34effd700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd35814af10 0x7fd3580640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd34effd700 1 -- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580aaf20 msgr2=0x7fd358159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:09.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd34effd700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580aaf20 0x7fd358159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:09.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd34effd700 1 -- 172.21.15.57:0/1140743994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580aabf0 con 0x7fd3580abac0 2021-06-25T04:56:09.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd34effd700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3580abac0 0x7fd3580645e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fd34000b000 tx=0x7fd340006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:09.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd3557fa700 1 -- 172.21.15.57:0/1140743994 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34000f700 con 0x7fd3580abac0 2021-06-25T04:56:09.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd3557fa700 1 -- 172.21.15.57:0/1140743994 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd340000e90 con 0x7fd3580abac0 2021-06-25T04:56:09.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd35e020700 1 -- 172.21.15.57:0/1140743994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd358062780 con 0x7fd3580abac0 2021-06-25T04:56:09.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd3557fa700 1 -- 172.21.15.57:0/1140743994 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34000fa50 con 0x7fd3580abac0 2021-06-25T04:56:09.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.335+0000 7fd35e020700 1 -- 172.21.15.57:0/1140743994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35815a0b0 con 0x7fd3580abac0 2021-06-25T04:56:09.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.339+0000 7fd35e020700 1 -- 172.21.15.57:0/1140743994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd358057310 con 0x7fd3580abac0 2021-06-25T04:56:09.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.339+0000 7fd3557fa700 1 -- 172.21.15.57:0/1140743994 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd34000fbb0 con 0x7fd3580abac0 2021-06-25T04:56:09.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.339+0000 7fd3557fa700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd33c0553f0 0x7fd33c0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:09.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.339+0000 7fd3557fa700 1 -- 172.21.15.57:0/1140743994 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fd34006e680 con 0x7fd3580abac0 2021-06-25T04:56:09.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.339+0000 7fd3577fe700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd33c0553f0 0x7fd33c0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:09.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.339+0000 7fd3577fe700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd33c0553f0 0x7fd33c0578b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fd34800d000 tx=0x7fd34800c040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:09.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.347+0000 7fd3557fa700 1 -- 172.21.15.57:0/1140743994 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd3400447e0 con 0x7fd3580abac0 2021-06-25T04:56:09.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:09.475+0000 7fd35e020700 1 -- 172.21.15.57:0/1140743994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd3580a9140 con 0x7fd3580abac0 2021-06-25T04:56:10.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.195+0000 7fd3557fa700 1 -- 172.21.15.57:0/1140743994 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v127) v1 ==== 185+0+0 (secure 0 0 0) 0x7fd340018020 con 0x7fd3580abac0 2021-06-25T04:56:10.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 -- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd33c0553f0 msgr2=0x7fd33c0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:10.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd33c0553f0 0x7fd33c0578b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fd34800d000 tx=0x7fd34800c040).stop 2021-06-25T04:56:10.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 -- 172.21.15.57:0/1140743994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3580abac0 msgr2=0x7fd3580645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:10.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3580abac0 0x7fd3580645e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fd34000b000 tx=0x7fd340006df0).stop 2021-06-25T04:56:10.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 -- 172.21.15.57:0/1140743994 shutdown_connections 2021-06-25T04:56:10.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd33c0553f0 0x7fd33c0578b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:10.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580aaf20 0x7fd358159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:10.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3580abac0 0x7fd3580645e0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:10.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 --2- 172.21.15.57:0/1140743994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd35814af10 0x7fd3580640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:10.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 -- 172.21.15.57:0/1140743994 >> 172.21.15.57:0/1140743994 conn(0x7fd35805f670 msgr2=0x7fd358147b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:10.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 -- 172.21.15.57:0/1140743994 shutdown_connections 2021-06-25T04:56:10.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.199+0000 7fd35e020700 1 -- 172.21.15.57:0/1140743994 wait complete. 2021-06-25T04:56:10.212 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:56:10.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:56:10.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.331+0000 7fa964d2f700 1 Processor -- start 2021-06-25T04:56:10.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.331+0000 7fa964d2f700 1 -- start start 2021-06-25T04:56:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9600b1290 0x7fa9600aff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa9600b2260 0x7fa960141210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600a7790 con 0x7fa9600b1e80 2021-06-25T04:56:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9600b1700 con 0x7fa9600b2260 2021-06-25T04:56:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600b0610 con 0x7fa9600b1290 2021-06-25T04:56:10.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95ed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa9600b2260 0x7fa960141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:10.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95ed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa9600b2260 0x7fa960141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42792/0 (socket says 172.21.15.57:42792) 2021-06-25T04:56:10.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95ed9d700 1 -- 172.21.15.57:0/4267893552 learned_addr learned my addr 172.21.15.57:0/4267893552 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:10.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95dd9b700 1 --2- 172.21.15.57:0/4267893552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9600b1290 0x7fa9600aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95ed9d700 1 -- 172.21.15.57:0/4267893552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9600b1290 msgr2=0x7fa9600aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95ed9d700 1 --2- 172.21.15.57:0/4267893552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9600b1290 0x7fa9600aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95ed9d700 1 -- 172.21.15.57:0/4267893552 >> v1:172.21.15.87:6789/0 conn(0x7fa9600b1e80 legacy=0x7fa9600a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95ed9d700 1 -- 172.21.15.57:0/4267893552 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600b08b0 con 0x7fa9600b2260 2021-06-25T04:56:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95ed9d700 1 --2- 172.21.15.57:0/4267893552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9600b2260 0x7fa960141210 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fa950002f70 tx=0x7fa950006eb0).ready entity=mon.0 client_cookie=3750e223e11a8672 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:10.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95d59a700 1 -- 172.21.15.57:0/4267893552 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa95000d5c0 con 0x7fa9600b2260 2021-06-25T04:56:10.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95d59a700 1 -- 172.21.15.57:0/4267893552 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa950000e90 con 0x7fa9600b2260 2021-06-25T04:56:10.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa95d59a700 1 -- 172.21.15.57:0/4267893552 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa95000d950 con 0x7fa9600b2260 2021-06-25T04:56:10.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 -- 172.21.15.57:0/4267893552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9600b2260 msgr2=0x7fa960141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:10.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 --2- 172.21.15.57:0/4267893552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9600b2260 0x7fa960141210 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fa950002f70 tx=0x7fa950006eb0).stop 2021-06-25T04:56:10.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 -- 172.21.15.57:0/4267893552 shutdown_connections 2021-06-25T04:56:10.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 --2- 172.21.15.57:0/4267893552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9600b2260 0x7fa960141210 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:10.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 --2- 172.21.15.57:0/4267893552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9600b1290 0x7fa9600aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:10.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 -- 172.21.15.57:0/4267893552 >> 172.21.15.57:0/4267893552 conn(0x7fa96005f670 msgr2=0x7fa96005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:10.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 -- 172.21.15.57:0/4267893552 shutdown_connections 2021-06-25T04:56:10.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.335+0000 7fa964d2f700 1 -- 172.21.15.57:0/4267893552 wait complete. 2021-06-25T04:56:10.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa964d2f700 1 Processor -- start 2021-06-25T04:56:10.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa964d2f700 1 -- start start 2021-06-25T04:56:10.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa964d2f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9600b1290 0x7fa960140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:10.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa964d2f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9600b1e80 0x7fa960156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:10.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa964d2f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9600b2260 0x7fa96015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:10.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa964d2f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600a9e90 con 0x7fa9600b1290 2021-06-25T04:56:10.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa964d2f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600aa0c0 con 0x7fa9600b2260 2021-06-25T04:56:10.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa964d2f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa960159df0 con 0x7fa9600b1e80 2021-06-25T04:56:10.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa95e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9600b1290 0x7fa960140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:10.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa95e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9600b1290 0x7fa960140840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42794/0 (socket says 172.21.15.57:42794) 2021-06-25T04:56:10.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa95e59c700 1 -- 172.21.15.57:0/2499300615 learned_addr learned my addr 172.21.15.57:0/2499300615 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:10.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa95dd9b700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9600b1e80 0x7fa960156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:10.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa95ed9d700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9600b2260 0x7fa96015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:10.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa95e59c700 1 -- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9600b1e80 msgr2=0x7fa960156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:10.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa95e59c700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9600b1e80 0x7fa960156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:10.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa95e59c700 1 -- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9600b2260 msgr2=0x7fa96015a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:10.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa95e59c700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9600b2260 0x7fa96015a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:10.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa95e59c700 1 -- 172.21.15.57:0/2499300615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95000b1e0 con 0x7fa9600b1290 2021-06-25T04:56:10.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa95e59c700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9600b1290 0x7fa960140840 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7fa96006a0b0 tx=0x7fa9580014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:10.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa94f7fe700 1 -- 172.21.15.57:0/2499300615 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa958010510 con 0x7fa9600b1290 2021-06-25T04:56:10.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa94f7fe700 1 -- 172.21.15.57:0/2499300615 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958010670 con 0x7fa9600b1290 2021-06-25T04:56:10.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa964d2f700 1 -- 172.21.15.57:0/2499300615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96015a090 con 0x7fa9600b1290 2021-06-25T04:56:10.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa94f7fe700 1 -- 172.21.15.57:0/2499300615 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9580107e0 con 0x7fa9600b1290 2021-06-25T04:56:10.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.339+0000 7fa964d2f700 1 -- 172.21.15.57:0/2499300615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9600a9770 con 0x7fa9600b1290 2021-06-25T04:56:10.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.343+0000 7fa964d2f700 1 -- 172.21.15.57:0/2499300615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96015a220 con 0x7fa9600b1290 2021-06-25T04:56:10.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.343+0000 7fa94f7fe700 1 -- 172.21.15.57:0/2499300615 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa958010070 con 0x7fa9600b1290 2021-06-25T04:56:10.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.343+0000 7fa94f7fe700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa93c0553d0 0x7fa93c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:10.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.343+0000 7fa94f7fe700 1 -- 172.21.15.57:0/2499300615 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fa95806da90 con 0x7fa9600b1290 2021-06-25T04:56:10.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.343+0000 7fa95dd9b700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa93c0553d0 0x7fa93c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:10.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.343+0000 7fa95dd9b700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa93c0553d0 0x7fa93c057890 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fa95400c000 tx=0x7fa954008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:10.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.347+0000 7fa94f7fe700 1 -- 172.21.15.57:0/2499300615 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa958043d00 con 0x7fa9600b1290 2021-06-25T04:56:10.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:10.475+0000 7fa964d2f700 1 -- 172.21.15.57:0/2499300615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fa960057310 con 0x7fa9600b1290 2021-06-25T04:56:11.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.319+0000 7fa94f7fe700 1 -- 172.21.15.57:0/2499300615 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v128) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa958047320 con 0x7fa9600b1290 2021-06-25T04:56:11.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.323+0000 7fa964d2f700 1 -- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa93c0553d0 msgr2=0x7fa93c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.323+0000 7fa964d2f700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa93c0553d0 0x7fa93c057890 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fa95400c000 tx=0x7fa954008040).stop 2021-06-25T04:56:11.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.323+0000 7fa964d2f700 1 -- 172.21.15.57:0/2499300615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9600b1290 msgr2=0x7fa960140840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.323+0000 7fa964d2f700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9600b1290 0x7fa960140840 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7fa96006a0b0 tx=0x7fa9580014a0).stop 2021-06-25T04:56:11.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.323+0000 7fa964d2f700 1 -- 172.21.15.57:0/2499300615 shutdown_connections 2021-06-25T04:56:11.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.323+0000 7fa964d2f700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa93c0553d0 0x7fa93c057890 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.323+0000 7fa964d2f700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9600b2260 0x7fa96015a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.323+0000 7fa964d2f700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9600b1e80 0x7fa960156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.323+0000 7fa964d2f700 1 --2- 172.21.15.57:0/2499300615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9600b1290 0x7fa960140840 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.323+0000 7fa964d2f700 1 -- 172.21.15.57:0/2499300615 >> 172.21.15.57:0/2499300615 conn(0x7fa96005f670 msgr2=0x7fa960147760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:11.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.327+0000 7fa964d2f700 1 -- 172.21.15.57:0/2499300615 shutdown_connections 2021-06-25T04:56:11.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.327+0000 7fa964d2f700 1 -- 172.21.15.57:0/2499300615 wait complete. 2021-06-25T04:56:11.333 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:56:11.346 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-06-25T04:56:11.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.455+0000 7f822347b700 1 Processor -- start 2021-06-25T04:56:11.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.455+0000 7f822347b700 1 -- start start 2021-06-25T04:56:11.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.455+0000 7f822347b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f821c0ac220 0x7f821c0b1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.455+0000 7f822347b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0b1c20 con 0x7f821c0a9920 2021-06-25T04:56:11.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.455+0000 7f822347b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0a9d00 con 0x7f821c0b0680 2021-06-25T04:56:11.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.455+0000 7f822347b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0b2900 con 0x7f821c0ac220 2021-06-25T04:56:11.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.455+0000 7f8221217700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f821c0a9920 0x7f821c0aec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60020/0 (socket says 172.21.15.57:60020) 2021-06-25T04:56:11.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.455+0000 7f8221217700 1 -- 172.21.15.57:0/884902403 learned_addr learned my addr 172.21.15.57:0/884902403 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:11.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.455+0000 7f8220a16700 1 --2- 172.21.15.57:0/884902403 >> v2:172.21.15.87:3300/0 conn(0x7f821c0ac220 0x7f821c0b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.455+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232299866 0 0) 0x7f820c001490 con 0x7f821c0a9920 2021-06-25T04:56:11.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.455+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8208003260 con 0x7f821c0a9920 2021-06-25T04:56:11.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941186807 0 0) 0x7f821c0a9d00 con 0x7f821c0b0680 2021-06-25T04:56:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f820c001490 con 0x7f821c0b0680 2021-06-25T04:56:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 725397760 0 0) 0x7f8208003260 con 0x7f821c0a9920 2021-06-25T04:56:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 >> v2:172.21.15.87:3300/0 conn(0x7f821c0ac220 msgr2=0x7f821c0b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:11.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 --2- 172.21.15.57:0/884902403 >> v2:172.21.15.87:3300/0 conn(0x7f821c0ac220 0x7f821c0b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 >> v1:172.21.15.87:6789/0 conn(0x7f821c0b0680 legacy=0x7f821c0af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0b0080 con 0x7f821c0a9920 2021-06-25T04:56:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f820c001b70 con 0x7f821c0a9920 2021-06-25T04:56:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 >> v1:172.21.15.57:6789/0 conn(0x7f821c0a9920 legacy=0x7f821c0aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8208003930 0x7f8208003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8208004500 0x7f8208004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8208004e70 0x7f820800fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0b2900 con 0x7f8208004e70 2021-06-25T04:56:11.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8208010130 con 0x7f8208004500 2021-06-25T04:56:11.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82080102f0 con 0x7f8208003930 2021-06-25T04:56:11.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f8221a18700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8208004e70 0x7f820800fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f8220a16700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8208004500 0x7f8208004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f8221217700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8208003930 0x7f8208003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f8221a18700 1 -- 172.21.15.57:0/884902403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8208003930 msgr2=0x7f8208003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f8221a18700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8208003930 0x7f8208003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f8221a18700 1 -- 172.21.15.57:0/884902403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8208004500 msgr2=0x7f8208004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:11.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f8221a18700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8208004500 0x7f8208004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f8221a18700 1 -- 172.21.15.57:0/884902403 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208003260 con 0x7f8208004e70 2021-06-25T04:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f8221217700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8208003930 0x7f8208003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f8221a18700 1 -- 172.21.15.57:0/884902403 reap_dead start 2021-06-25T04:56:11.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f8221a18700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8208004e70 0x7f820800fb60 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f8214001110 tx=0x7f8214007a00).ready entity=mon.0 client_cookie=adde95f1a914abd8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:11.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8214007d10 con 0x7f8208004e70 2021-06-25T04:56:11.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8214007030 con 0x7f8208004e70 2021-06-25T04:56:11.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f821bfff700 1 -- 172.21.15.57:0/884902403 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8214007390 con 0x7f8208004e70 2021-06-25T04:56:11.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f822347b700 1 -- 172.21.15.57:0/884902403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8208004e70 msgr2=0x7f820800fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f822347b700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8208004e70 0x7f820800fb60 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f8214001110 tx=0x7f8214007a00).stop 2021-06-25T04:56:11.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f822347b700 1 -- 172.21.15.57:0/884902403 shutdown_connections 2021-06-25T04:56:11.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f822347b700 1 --2- 172.21.15.57:0/884902403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8208004e70 0x7f820800fb60 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f822347b700 1 -- 172.21.15.57:0/884902403 >> 172.21.15.57:0/884902403 conn(0x7f821c05f670 msgr2=0x7f821c05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:11.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f822347b700 1 -- 172.21.15.57:0/884902403 shutdown_connections 2021-06-25T04:56:11.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.459+0000 7f822347b700 1 -- 172.21.15.57:0/884902403 wait complete. 2021-06-25T04:56:11.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f822347b700 1 Processor -- start 2021-06-25T04:56:11.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f822347b700 1 -- start start 2021-06-25T04:56:11.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f822347b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8208004e70 0x7f821c142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f822347b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f821c14efa0 0x7f821c13ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f822347b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0ad450 0x7f821c13f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f822347b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c14f440 con 0x7f821c0ad450 2021-06-25T04:56:11.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f822347b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0ae0b0 con 0x7f821c14efa0 2021-06-25T04:56:11.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f822347b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0adb70 con 0x7f8208004e70 2021-06-25T04:56:11.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8221a18700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0ad450 0x7f821c13f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8220a16700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f821c14efa0 0x7f821c13ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8221a18700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0ad450 0x7f821c13f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42818/0 (socket says 172.21.15.57:42818) 2021-06-25T04:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8221a18700 1 -- 172.21.15.57:0/1613833161 learned_addr learned my addr 172.21.15.57:0/1613833161 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8221217700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8208004e70 0x7f821c142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8221a18700 1 -- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8208004e70 msgr2=0x7f821c142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8221a18700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8208004e70 0x7f821c142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8221a18700 1 -- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f821c14efa0 msgr2=0x7f821c13ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8221a18700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f821c14efa0 0x7f821c13ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8221a18700 1 -- 172.21.15.57:0/1613833161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0ade10 con 0x7f821c0ad450 2021-06-25T04:56:11.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8221217700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8208004e70 0x7f821c142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:11.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f8221a18700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0ad450 0x7f821c13f400 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f8214001110 tx=0x7f8214016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:11.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f821a7fc700 1 -- 172.21.15.57:0/1613833161 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82140077e0 con 0x7f821c0ad450 2021-06-25T04:56:11.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f821a7fc700 1 -- 172.21.15.57:0/1613833161 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821401d600 con 0x7f821c0ad450 2021-06-25T04:56:11.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f822347b700 1 -- 172.21.15.57:0/1613833161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c1434a0 con 0x7f821c0ad450 2021-06-25T04:56:11.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f821a7fc700 1 -- 172.21.15.57:0/1613833161 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f821401d960 con 0x7f821c0ad450 2021-06-25T04:56:11.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.463+0000 7f822347b700 1 -- 172.21.15.57:0/1613833161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c13fb10 con 0x7f821c0ad450 2021-06-25T04:56:11.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.467+0000 7f822347b700 1 -- 172.21.15.57:0/1613833161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c057310 con 0x7f821c0ad450 2021-06-25T04:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.467+0000 7f821a7fc700 1 -- 172.21.15.57:0/1613833161 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8214024030 con 0x7f821c0ad450 2021-06-25T04:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.467+0000 7f821a7fc700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81fc0554e0 0x7f81fc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.467+0000 7f821a7fc700 1 -- 172.21.15.57:0/1613833161 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6422+0+0 (secure 0 0 0) 0x7f821406ea50 con 0x7f821c0ad450 2021-06-25T04:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.467+0000 7f8221217700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81fc0554e0 0x7f81fc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.467+0000 7f8221217700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81fc0554e0 0x7f81fc0579a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f820c00d000 tx=0x7f820c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:11.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.475+0000 7f821a7fc700 1 -- 172.21.15.57:0/1613833161 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8214044af0 con 0x7f821c0ad450 2021-06-25T04:56:11.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.643+0000 7f822347b700 1 -- 172.21.15.57:0/1613833161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f821c067c60 con 0x7f821c0ad450 2021-06-25T04:56:11.649 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:56:11.643+0000 7f8c3e600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:56:11.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f821a7fc700 1 -- 172.21.15.57:0/1613833161 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 22 v64) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8214022020 con 0x7f821c0ad450 2021-06-25T04:56:11.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 -- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81fc0554e0 msgr2=0x7f81fc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81fc0554e0 0x7f81fc0579a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f820c00d000 tx=0x7f820c009040).stop 2021-06-25T04:56:11.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 -- 172.21.15.57:0/1613833161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0ad450 msgr2=0x7f821c13f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0ad450 0x7f821c13f400 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f8214001110 tx=0x7f8214016000).stop 2021-06-25T04:56:11.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 -- 172.21.15.57:0/1613833161 shutdown_connections 2021-06-25T04:56:11.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81fc0554e0 0x7f81fc0579a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0ad450 0x7f821c13f400 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f821c14efa0 0x7f821c13ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 --2- 172.21.15.57:0/1613833161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8208004e70 0x7f821c142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 -- 172.21.15.57:0/1613833161 >> 172.21.15.57:0/1613833161 conn(0x7f821c05f670 msgr2=0x7f821c0b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:11.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 -- 172.21.15.57:0/1613833161 shutdown_connections 2021-06-25T04:56:11.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.655+0000 7f822347b700 1 -- 172.21.15.57:0/1613833161 wait complete. 2021-06-25T04:56:11.665 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 24 and data pool 22 2021-06-25T04:56:11.674 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:56:11.675 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:11.687 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:11.704 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:11.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:11.746 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:56:11.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:11.747 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:11.747 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:11.754 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:56:11.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:56:11.756 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:56:11.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:56:11.757 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:11.803 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:56:11.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:56:11.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:11.806 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:11.807 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:11.814 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:56:11.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:56:11.815 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:56:11.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:56:11.817 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:11.863 INFO:teuthology.orchestra.run.smithi161.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:56:11.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:56:11.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:56:11.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.971+0000 7f884e397700 1 Processor -- start 2021-06-25T04:56:11.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.971+0000 7f884e397700 1 -- start start 2021-06-25T04:56:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.971+0000 7f884e397700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f884805f9b0 0x7f884813fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.971+0000 7f884e397700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f88480b1e80 0x7f88481402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884e397700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88480af880 con 0x7f88480ae1f0 2021-06-25T04:56:11.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884e397700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88480b01f0 con 0x7f88480b1e80 2021-06-25T04:56:11.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884e397700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884805fd90 con 0x7f884805f9b0 2021-06-25T04:56:11.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884db96700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f88480ae1f0 0x7f8848143310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60042/0 (socket says 172.21.15.57:60042) 2021-06-25T04:56:11.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884db96700 1 -- 172.21.15.57:0/388853743 learned_addr learned my addr 172.21.15.57:0/388853743 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:11.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884cb94700 1 --2- 172.21.15.57:0/388853743 >> v2:172.21.15.87:3300/0 conn(0x7f88480b1e80 0x7f88481402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884d395700 1 --2- 172.21.15.57:0/388853743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f884805f9b0 0x7f884813fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f8837fff700 1 -- 172.21.15.57:0/388853743 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157199834 0 0) 0x7f88480af880 con 0x7f88480ae1f0 2021-06-25T04:56:11.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f8837fff700 1 -- 172.21.15.57:0/388853743 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8830003260 con 0x7f88480ae1f0 2021-06-25T04:56:11.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884cb94700 1 -- 172.21.15.57:0/388853743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f884805f9b0 msgr2=0x7f884813fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:11.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884cb94700 1 --2- 172.21.15.57:0/388853743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f884805f9b0 0x7f884813fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884cb94700 1 -- 172.21.15.57:0/388853743 >> v1:172.21.15.57:6789/0 conn(0x7f88480ae1f0 legacy=0x7f8848143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884cb94700 1 -- 172.21.15.57:0/388853743 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480acff0 con 0x7f88480b1e80 2021-06-25T04:56:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884cb94700 1 --2- 172.21.15.57:0/388853743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88480b1e80 0x7f88481402b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f8838002f70 tx=0x7f8838006df0).ready entity=mon.1 client_cookie=40a9697261ef19e0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f8837fff700 1 -- 172.21.15.57:0/388853743 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883800d4a0 con 0x7f88480b1e80 2021-06-25T04:56:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f8837fff700 1 -- 172.21.15.57:0/388853743 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8838000e90 con 0x7f88480b1e80 2021-06-25T04:56:11.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884e397700 1 -- 172.21.15.57:0/388853743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88480b1e80 msgr2=0x7f88481402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f8837fff700 1 -- 172.21.15.57:0/388853743 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883800d7f0 con 0x7f88480b1e80 2021-06-25T04:56:11.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884e397700 1 --2- 172.21.15.57:0/388853743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88480b1e80 0x7f88481402b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f8838002f70 tx=0x7f8838006df0).stop 2021-06-25T04:56:11.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884e397700 1 -- 172.21.15.57:0/388853743 shutdown_connections 2021-06-25T04:56:11.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884e397700 1 --2- 172.21.15.57:0/388853743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88480b1e80 0x7f88481402b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884e397700 1 --2- 172.21.15.57:0/388853743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f884805f9b0 0x7f884813fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884e397700 1 -- 172.21.15.57:0/388853743 >> 172.21.15.57:0/388853743 conn(0x7f88480611f0 msgr2=0x7f8848062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884e397700 1 -- 172.21.15.57:0/388853743 shutdown_connections 2021-06-25T04:56:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.975+0000 7f884e397700 1 -- 172.21.15.57:0/388853743 wait complete. 2021-06-25T04:56:11.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884e397700 1 Processor -- start 2021-06-25T04:56:11.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884e397700 1 -- start start 2021-06-25T04:56:11.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884e397700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f884805f9b0 0x7f8848135300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884e397700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88480ae1f0 0x7f884813ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884e397700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88480b1e80 0x7f884813f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884e397700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848155a40 con 0x7f88480b1e80 2021-06-25T04:56:11.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884e397700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848155ce0 con 0x7f88480ae1f0 2021-06-25T04:56:11.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884e397700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8848155f80 con 0x7f884805f9b0 2021-06-25T04:56:11.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884db96700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88480b1e80 0x7f884813f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884db96700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88480b1e80 0x7f884813f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42830/0 (socket says 172.21.15.57:42830) 2021-06-25T04:56:11.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884db96700 1 -- 172.21.15.57:0/2025915584 learned_addr learned my addr 172.21.15.57:0/2025915584 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:11.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884cb94700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88480ae1f0 0x7f884813ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884d395700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f884805f9b0 0x7f8848135300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:11.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884db96700 1 -- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f884805f9b0 msgr2=0x7f8848135300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884db96700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f884805f9b0 0x7f8848135300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884db96700 1 -- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88480ae1f0 msgr2=0x7f884813ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884db96700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88480ae1f0 0x7f884813ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884db96700 1 -- 172.21.15.57:0/2025915584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883800b180 con 0x7f88480b1e80 2021-06-25T04:56:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884db96700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88480b1e80 0x7f884813f230 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f8840001490 tx=0x7f8840007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f88367fc700 1 -- 172.21.15.57:0/2025915584 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8840005ba0 con 0x7f88480b1e80 2021-06-25T04:56:11.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f88367fc700 1 -- 172.21.15.57:0/2025915584 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8840005d00 con 0x7f88480b1e80 2021-06-25T04:56:11.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884e397700 1 -- 172.21.15.57:0/2025915584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8848156220 con 0x7f88480b1e80 2021-06-25T04:56:11.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f88367fc700 1 -- 172.21.15.57:0/2025915584 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88400072c0 con 0x7f88480b1e80 2021-06-25T04:56:11.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.979+0000 7f884e397700 1 -- 172.21.15.57:0/2025915584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88481556c0 con 0x7f88480b1e80 2021-06-25T04:56:11.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.983+0000 7f884e397700 1 -- 172.21.15.57:0/2025915584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88481563b0 con 0x7f88480b1e80 2021-06-25T04:56:11.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.983+0000 7f88367fc700 1 -- 172.21.15.57:0/2025915584 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8840010070 con 0x7f88480b1e80 2021-06-25T04:56:11.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.983+0000 7f88367fc700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f88280554e0 0x7f88280579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:11.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.983+0000 7f88367fc700 1 -- 172.21.15.57:0/2025915584 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f884006db50 con 0x7f88480b1e80 2021-06-25T04:56:12.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.983+0000 7f884d395700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f88280554e0 0x7f88280579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.983+0000 7f884d395700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f88280554e0 0x7f88280579a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f884400b000 tx=0x7f8844006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:12.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:11.991+0000 7f88367fc700 1 -- 172.21.15.57:0/2025915584 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8840043ba0 con 0x7f88480b1e80 2021-06-25T04:56:12.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.123+0000 7f884e397700 1 -- 172.21.15.57:0/2025915584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f884813f8c0 con 0x7f88480b1e80 2021-06-25T04:56:12.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.123+0000 7f88367fc700 1 -- 172.21.15.57:0/2025915584 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v129) v1 ==== 81+0+34216 (secure 0 0 0) 0x7f88400471c0 con 0x7f88480b1e80 2021-06-25T04:56:12.130 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:12.130 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:56:12.131 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 129, 2021-06-25T04:56:12.131 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:56:12.131 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:56:12.132 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:56:11.647824+0000", 2021-06-25T04:56:12.132 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:56:12.132 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:56:12.133 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:56:12.133 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:56:12.134 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:56:12.134 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:56:12.134 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:56:12.135 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:56:12.135 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:56:12.135 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:12.136 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:56:12.136 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:56:12.136 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:56:12.136 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:56:12.137 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:56:12.137 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 24, 2021-06-25T04:56:12.137 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:56:12.137 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:56:12.138 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:56:12.138 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:56:12.138 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:56:12.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.139 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:56:12.139 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:56:12.139 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:56:12.139 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:56:12.140 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:56:12.140 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:12.140 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:12.140 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:12.140 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:12.141 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:12.141 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:12.141 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:56:12.142 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:56:12.142 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:56:12.142 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:56:12.143 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:56:12.143 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:12.143 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:12.143 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:12.144 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:12.144 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:12.145 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:12.145 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:12.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.145 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:56:12.146 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:12.146 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:12.147 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:12.147 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:12.147 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:12.147 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:12.148 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:12.148 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:12.148 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:12.148 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:12.149 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:12.149 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:12.149 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:12.149 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:12.149 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:12.150 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:12.150 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:12.150 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:12.150 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:12.151 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:12.151 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:12.151 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:12.151 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:12.151 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:12.152 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:12.152 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:12.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.153 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:12.153 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:12.153 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:12.153 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:12.154 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:12.154 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:12.154 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:12.154 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:12.155 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:12.155 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:12.155 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:12.155 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:56:12.155 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:56:12.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.156 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:12.156 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:56:12.156 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.157 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:56:12.157 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:56:12.157 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:56:12.158 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:56:12.158 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:56:12.158 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:12.158 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:12.158 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:12.159 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:12.159 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:12.159 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:12.159 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:56:12.160 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:56:12.160 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:56:12.160 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:56:12.160 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:56:12.160 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:12.161 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:12.161 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:12.161 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:12.161 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:12.161 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:12.162 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:12.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.162 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:56:12.162 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:12.163 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:12.163 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:12.163 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:12.163 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:12.163 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:12.164 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:12.164 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:12.164 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:12.164 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:12.165 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:12.165 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:12.165 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:12.165 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:12.165 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:12.166 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:12.166 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:12.166 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:12.166 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:12.167 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:12.167 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:12.167 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:12.167 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:12.167 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:12.168 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:12.168 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:12.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.168 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:12.168 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:12.169 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:12.169 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:12.169 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:12.169 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:12.170 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:12.170 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:12.170 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:12.170 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:12.171 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:12.171 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:56:12.171 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:12.171 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:56:12.171 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.172 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 22, 2021-06-25T04:56:12.172 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:56:12.173 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:55:46.105368+0000", 2021-06-25T04:56:12.173 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:56:12.173 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:56:12.173 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:12.175 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:56:12.175 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:56:12.175 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:56:12.175 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:56:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:56:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "129", 2021-06-25T04:56:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:12.189 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:56:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:56:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:56:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 24, 2021-06-25T04:56:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:56:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:56:10.531144+0000", 2021-06-25T04:56:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 32769, 2021-06-25T04:56:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool,creating", 2021-06-25T04:56:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:56:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:56:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:56:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:56:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:56:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "129", 2021-06-25T04:56:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:12.211 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:12.211 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:12.211 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:56:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:56:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:56:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:56:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:56:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:56:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:56:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:56:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:56:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:56:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:56:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:56:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:56:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:56:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:56:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:56:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:56:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:56:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:56:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:56:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:56:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:56:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:56:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:56:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:56:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:56:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:56:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:56:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:56:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:56:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:56:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:56:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:56:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:56:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:56:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:56:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:56:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 123, 2021-06-25T04:56:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:56:12.261 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:12.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.261 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.262 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:56:12.262 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:12.262 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.262 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.263 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:12.263 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.264 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.264 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:56:12.264 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:12.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.265 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.265 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:56:12.265 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:56:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:56:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:56:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:56:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:56:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:56:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:56:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:56:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:56:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:56:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 123, 2021-06-25T04:56:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:56:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:56:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:56:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:56:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:56:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:56:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:12.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.294 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.294 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:12.295 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.295 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.295 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:56:12.296 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:12.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.296 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.297 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:56:12.297 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:12.297 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.297 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.298 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:56:12.298 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:56:12.298 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:56:12.299 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:56:12.299 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:12.299 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:12.299 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:12.299 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.300 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:56:12.300 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:56:12.301 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:12.301 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:12.301 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:12.301 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:12.302 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:12.302 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:12.302 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:12.302 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 123, 2021-06-25T04:56:12.302 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:12.303 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:12.303 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:12.303 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.304 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.304 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:56:12.304 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:12.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.305 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.305 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:56:12.305 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:12.306 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.306 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.306 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:12.307 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.307 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.307 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:56:12.308 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:12.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.308 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.308 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:56:12.309 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:12.309 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.309 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.310 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:12.310 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.310 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.311 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:56:12.311 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:12.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.311 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.312 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:56:12.312 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:12.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.312 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.313 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:12.313 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.313 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.314 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:56:12.314 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:12.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.315 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.315 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:56:12.315 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:12.316 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.316 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.316 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:56:12.317 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:56:12.317 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:56:12.317 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:56:12.317 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:12.317 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:12.318 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:12.318 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.319 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:56:12.319 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:56:12.319 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:12.319 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:12.320 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:12.320 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:12.320 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:12.320 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:12.321 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:12.321 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:12.321 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:12.321 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:12.321 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:12.322 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.322 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.322 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:56:12.323 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:12.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.323 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.323 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:56:12.324 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:12.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.324 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.325 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:12.325 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.325 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.326 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:56:12.326 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:12.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.327 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.327 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:56:12.327 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:12.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.328 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.328 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:12.328 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.329 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.329 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:56:12.329 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:12.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.330 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.330 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:56:12.331 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:12.331 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.331 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.331 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:12.332 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.332 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.332 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:56:12.333 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:12.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.333 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.334 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:56:12.334 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:12.334 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.334 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.335 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:56:12.335 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:56:12.335 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:56:12.335 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:56:12.336 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:12.336 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:12.336 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:12.337 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.338 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:56:12.338 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:56:12.338 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:12.338 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:12.339 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:12.339 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:12.339 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:12.339 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:12.340 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:12.340 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:12.340 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:12.340 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:12.341 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:12.341 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.341 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.341 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:56:12.342 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:12.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.342 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.343 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:56:12.343 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:12.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.343 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.344 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:12.344 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.345 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.345 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:56:12.345 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:12.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.346 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.346 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:56:12.346 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:12.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.347 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.348 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:12.348 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.348 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.349 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:56:12.349 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:12.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.350 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.350 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:56:12.350 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:12.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.351 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.351 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:12.351 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.352 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.352 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:56:12.352 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:12.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.353 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.354 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:56:12.354 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:12.354 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.355 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.355 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:56:12.355 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:56:12.355 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:56:12.356 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:56:12.356 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:12.356 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:12.356 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:12.357 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.358 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:56:12.358 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:56:12.358 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:12.358 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:12.359 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:12.359 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:12.359 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:12.359 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:12.360 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:12.360 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:12.360 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:12.360 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:12.360 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:12.361 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.361 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.361 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:56:12.362 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:12.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.362 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.362 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:56:12.363 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:12.363 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.363 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.364 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:12.364 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.364 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.365 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:56:12.365 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:12.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.365 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.366 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:56:12.366 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:12.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.366 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.367 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:12.367 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.368 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.368 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:56:12.368 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:12.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.369 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.369 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:56:12.369 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:12.370 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.370 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.370 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:12.371 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:12.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.371 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:12.371 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:56:12.371 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:12.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.372 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:12.372 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:56:12.373 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:12.373 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.373 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.373 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:56:12.374 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:56:12.374 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:56:12.374 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:56:12.374 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:12.375 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:12.375 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:12.375 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:12.375 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.376 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:12.376 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:56:12.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.376 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:56:12.376 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:12.377 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:12.377 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:12.377 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:12.377 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:12.378 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:56:12.378 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:12.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.379 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:56:12.379 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:12.379 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:12.379 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:12.380 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:12.380 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:12.380 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:56:12.380 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:12.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.381 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:56:12.381 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:12.382 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:12.382 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:12.382 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:12.382 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:12.382 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:56:12.383 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:12.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.383 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:56:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:12.385 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:56:12.385 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:12.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.386 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:56:12.386 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:12.386 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:12.386 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:12.387 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:12.387 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:12.387 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:56:12.387 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:12.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.388 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:56:12.388 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:12.389 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:12.389 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:12.389 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:12.390 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:12.390 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:56:12.390 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:12.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.391 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:56:12.391 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:12.391 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:12.391 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:12.392 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:12.392 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:12.392 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:56:12.392 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:12.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:12.393 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:56:12.393 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:12.394 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:12.394 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:12.394 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:12.394 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:12.395 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:56:12.395 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:12.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.395 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:12.396 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:56:12.396 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:56:12.396 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:56:12.396 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:56:12.397 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:56:12.397 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6835/863055178": "2021-06-26T04:55:56.865606+0000", 2021-06-25T04:56:12.397 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6834/863055178": "2021-06-26T04:55:56.865606+0000" 2021-06-25T04:56:12.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.398 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:56:12.398 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:56:12.398 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:56:12.399 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:56:12.399 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:56:12.399 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:56:12.400 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:56:12.400 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:56:12.400 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:56:12.400 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:56:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:56:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:56:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:56:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:56:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:56:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:56:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:56:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:56:12.403 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:56:12.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:12.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:12.403 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:56:12.404 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:56:12.404 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:56:12.404 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:56:12.404 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:56:12.404 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:56:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 -- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f88280554e0 msgr2=0x7f88280579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f88280554e0 0x7f88280579a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f884400b000 tx=0x7f8844006df0).stop 2021-06-25T04:56:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 -- 172.21.15.57:0/2025915584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88480b1e80 msgr2=0x7f884813f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88480b1e80 0x7f884813f230 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f8840001490 tx=0x7f8840007dc0).stop 2021-06-25T04:56:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 -- 172.21.15.57:0/2025915584 shutdown_connections 2021-06-25T04:56:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f88280554e0 0x7f88280579a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88480b1e80 0x7f884813f230 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88480ae1f0 0x7f884813ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 --2- 172.21.15.57:0/2025915584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f884805f9b0 0x7f8848135300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 -- 172.21.15.57:0/2025915584 >> 172.21.15.57:0/2025915584 conn(0x7f88480611f0 msgr2=0x7f88480b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 -- 172.21.15.57:0/2025915584 shutdown_connections 2021-06-25T04:56:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.127+0000 7f884e397700 1 -- 172.21.15.57:0/2025915584 wait complete. 2021-06-25T04:56:12.411 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:12.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc806dc700 1 Processor -- start 2021-06-25T04:56:12.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc806dc700 1 -- start start 2021-06-25T04:56:12.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc806dc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcc780b77d0 0x7fcc78144560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:12.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc806dc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc780b3190 con 0x7fcc78144a50 2021-06-25T04:56:12.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc806dc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc780b7bb0 con 0x7fcc780b1130 2021-06-25T04:56:12.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc806dc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc78144ee0 con 0x7fcc780b77d0 2021-06-25T04:56:12.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7ec79700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcc78144a50 0x7fcc78064f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60058/0 (socket says 172.21.15.57:60058) 2021-06-25T04:56:12.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7ec79700 1 -- 172.21.15.57:0/4166980918 learned_addr learned my addr 172.21.15.57:0/4166980918 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:12.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7e478700 1 --2- 172.21.15.57:0/4166980918 >> v2:172.21.15.87:3300/0 conn(0x7fcc780b77d0 0x7fcc78144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7d476700 1 -- 172.21.15.57:0/4166980918 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572129061 0 0) 0x7fcc780b3190 con 0x7fcc78144a50 2021-06-25T04:56:12.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7d476700 1 -- 172.21.15.57:0/4166980918 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc60003260 con 0x7fcc78144a50 2021-06-25T04:56:12.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7d476700 1 -- 172.21.15.57:0/4166980918 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114217744 0 0) 0x7fcc780b7bb0 con 0x7fcc780b1130 2021-06-25T04:56:12.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7d476700 1 -- 172.21.15.57:0/4166980918 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc780b3190 con 0x7fcc780b1130 2021-06-25T04:56:12.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7e478700 1 -- 172.21.15.57:0/4166980918 >> v1:172.21.15.87:6789/0 conn(0x7fcc780b1130 legacy=0x7fcc78064830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7e478700 1 -- 172.21.15.57:0/4166980918 >> v1:172.21.15.57:6789/0 conn(0x7fcc78144a50 legacy=0x7fcc78064f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7e478700 1 -- 172.21.15.57:0/4166980918 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78067580 con 0x7fcc780b77d0 2021-06-25T04:56:12.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7e478700 1 --2- 172.21.15.57:0/4166980918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc780b77d0 0x7fcc78144560 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fcc74002f70 tx=0x7fcc74006df0).ready entity=mon.1 client_cookie=45d48885714d1551 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:12.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7d476700 1 -- 172.21.15.57:0/4166980918 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc7400d540 con 0x7fcc780b77d0 2021-06-25T04:56:12.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7d476700 1 -- 172.21.15.57:0/4166980918 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc74000e90 con 0x7fcc780b77d0 2021-06-25T04:56:12.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc7d476700 1 -- 172.21.15.57:0/4166980918 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc7400d890 con 0x7fcc780b77d0 2021-06-25T04:56:12.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc806dc700 1 -- 172.21.15.57:0/4166980918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc780b77d0 msgr2=0x7fcc78144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.519+0000 7fcc806dc700 1 --2- 172.21.15.57:0/4166980918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc780b77d0 0x7fcc78144560 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fcc74002f70 tx=0x7fcc74006df0).stop 2021-06-25T04:56:12.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 -- 172.21.15.57:0/4166980918 shutdown_connections 2021-06-25T04:56:12.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 --2- 172.21.15.57:0/4166980918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc780b77d0 0x7fcc78144560 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 -- 172.21.15.57:0/4166980918 >> 172.21.15.57:0/4166980918 conn(0x7fcc7805f670 msgr2=0x7fcc7805fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:12.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 -- 172.21.15.57:0/4166980918 shutdown_connections 2021-06-25T04:56:12.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 -- 172.21.15.57:0/4166980918 wait complete. 2021-06-25T04:56:12.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 Processor -- start 2021-06-25T04:56:12.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 -- start start 2021-06-25T04:56:12.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc780b1130 0x7fcc78143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:12.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc780b77d0 0x7fcc780aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:12.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc78144a50 0x7fcc7814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:12.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780ae540 con 0x7fcc78144a50 2021-06-25T04:56:12.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78153ff0 con 0x7fcc780b77d0 2021-06-25T04:56:12.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc806dc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78154290 con 0x7fcc780b1130 2021-06-25T04:56:12.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc7ec79700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc78144a50 0x7fcc7814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc7ec79700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc78144a50 0x7fcc7814fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42846/0 (socket says 172.21.15.57:42846) 2021-06-25T04:56:12.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.523+0000 7fcc7ec79700 1 -- 172.21.15.57:0/1844966269 learned_addr learned my addr 172.21.15.57:0/1844966269 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:12.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc7e478700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc780b1130 0x7fcc78143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc7dc77700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc780b77d0 0x7fcc780aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc7ec79700 1 -- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc780b1130 msgr2=0x7fcc78143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc7ec79700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc780b1130 0x7fcc78143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc7ec79700 1 -- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc780b77d0 msgr2=0x7fcc780aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc7ec79700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc780b77d0 0x7fcc780aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc7ec79700 1 -- 172.21.15.57:0/1844966269 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7400b180 con 0x7fcc78144a50 2021-06-25T04:56:12.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc7dc77700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc780b77d0 0x7fcc780aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:12.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc7ec79700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc78144a50 0x7fcc7814fe90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fcc70001490 tx=0x7fcc70007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:12.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc677fe700 1 -- 172.21.15.57:0/1844966269 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc70005ba0 con 0x7fcc78144a50 2021-06-25T04:56:12.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc806dc700 1 -- 172.21.15.57:0/1844966269 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc780ae770 con 0x7fcc78144a50 2021-06-25T04:56:12.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc677fe700 1 -- 172.21.15.57:0/1844966269 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc70005d00 con 0x7fcc78144a50 2021-06-25T04:56:12.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc677fe700 1 -- 172.21.15.57:0/1844966269 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc700072c0 con 0x7fcc78144a50 2021-06-25T04:56:12.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc806dc700 1 -- 172.21.15.57:0/1844966269 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc781407a0 con 0x7fcc78144a50 2021-06-25T04:56:12.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc806dc700 1 -- 172.21.15.57:0/1844966269 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc780ae900 con 0x7fcc78144a50 2021-06-25T04:56:12.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc677fe700 1 -- 172.21.15.57:0/1844966269 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcc70010070 con 0x7fcc78144a50 2021-06-25T04:56:12.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc677fe700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcc58055340 0x7fcc58057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:12.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.527+0000 7fcc677fe700 1 -- 172.21.15.57:0/1844966269 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fcc7006da30 con 0x7fcc78144a50 2021-06-25T04:56:12.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.531+0000 7fcc7e478700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcc58055340 0x7fcc58057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.531+0000 7fcc7e478700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcc58055340 0x7fcc58057800 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fcc74017000 tx=0x7fcc74014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:12.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.535+0000 7fcc677fe700 1 -- 172.21.15.57:0/1844966269 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcc70043af0 con 0x7fcc78144a50 2021-06-25T04:56:12.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.707+0000 7fcc806dc700 1 -- 172.21.15.57:0/1844966269 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc78057310 con 0x7fcc78144a50 2021-06-25T04:56:12.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc677fe700 1 -- 172.21.15.57:0/1844966269 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+1426 (secure 0 0 0) 0x7fcc70047110 con 0x7fcc78144a50 2021-06-25T04:56:12.715 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:12.716 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":64,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:11.648284+0000","modified":"2021-06-25T04:56:11.648433+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-06-25T04:56:12.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 -- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcc58055340 msgr2=0x7fcc58057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcc58055340 0x7fcc58057800 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fcc74017000 tx=0x7fcc74014000).stop 2021-06-25T04:56:12.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 -- 172.21.15.57:0/1844966269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc78144a50 msgr2=0x7fcc7814fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc78144a50 0x7fcc7814fe90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fcc70001490 tx=0x7fcc70007e00).stop 2021-06-25T04:56:12.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 -- 172.21.15.57:0/1844966269 shutdown_connections 2021-06-25T04:56:12.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcc58055340 0x7fcc58057800 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc78144a50 0x7fcc7814fe90 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc780b77d0 0x7fcc780aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 --2- 172.21.15.57:0/1844966269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc780b1130 0x7fcc78143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 -- 172.21.15.57:0/1844966269 >> 172.21.15.57:0/1844966269 conn(0x7fcc7805f670 msgr2=0x7fcc780b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:12.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 -- 172.21.15.57:0/1844966269 shutdown_connections 2021-06-25T04:56:12.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.711+0000 7fcc806dc700 1 -- 172.21.15.57:0/1844966269 wait complete. 2021-06-25T04:56:12.720 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 64 2021-06-25T04:56:12.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:56:12.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 Processor -- start 2021-06-25T04:56:12.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 -- start start 2021-06-25T04:56:12.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13cc148360 0x7f13cc0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13cc0a7080 0x7f13cc1446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13cc0b0310 con 0x7f13cc0b1d70 2021-06-25T04:56:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13cc0a9080 con 0x7f13cc0a7080 2021-06-25T04:56:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0b05b0 con 0x7f13cc148360 2021-06-25T04:56:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d13aa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13cc0a7080 0x7f13cc1446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d13aa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13cc0a7080 0x7f13cc1446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42854/0 (socket says 172.21.15.57:42854) 2021-06-25T04:56:12.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d13aa700 1 -- 172.21.15.57:0/1887785269 learned_addr learned my addr 172.21.15.57:0/1887785269 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:12.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13cbfff700 1 --2- 172.21.15.57:0/1887785269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13cc148360 0x7f13cc0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13cb7fe700 1 -- 172.21.15.57:0/1887785269 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433212948 0 0) 0x7f13cc0b0310 con 0x7f13cc0b1d70 2021-06-25T04:56:12.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13cb7fe700 1 -- 172.21.15.57:0/1887785269 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b8003260 con 0x7f13cc0b1d70 2021-06-25T04:56:12.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d13aa700 1 -- 172.21.15.57:0/1887785269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13cc148360 msgr2=0x7f13cc0b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:12.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d13aa700 1 --2- 172.21.15.57:0/1887785269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13cc148360 0x7f13cc0b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d13aa700 1 -- 172.21.15.57:0/1887785269 >> v1:172.21.15.87:6789/0 conn(0x7f13cc0b1d70 legacy=0x7f13cc0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d13aa700 1 -- 172.21.15.57:0/1887785269 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc0b0850 con 0x7f13cc0a7080 2021-06-25T04:56:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d13aa700 1 --2- 172.21.15.57:0/1887785269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13cc0a7080 0x7f13cc1446e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f13c4002f70 tx=0x7f13c4006eb0).ready entity=mon.0 client_cookie=689faceaf3a5f07e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13cb7fe700 1 -- 172.21.15.57:0/1887785269 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c400d5c0 con 0x7f13cc0a7080 2021-06-25T04:56:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13cb7fe700 1 -- 172.21.15.57:0/1887785269 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c4000e90 con 0x7f13cc0a7080 2021-06-25T04:56:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13cb7fe700 1 -- 172.21.15.57:0/1887785269 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c400d950 con 0x7f13cc0a7080 2021-06-25T04:56:12.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 -- 172.21.15.57:0/1887785269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13cc0a7080 msgr2=0x7f13cc1446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 --2- 172.21.15.57:0/1887785269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13cc0a7080 0x7f13cc1446e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f13c4002f70 tx=0x7f13c4006eb0).stop 2021-06-25T04:56:12.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 -- 172.21.15.57:0/1887785269 shutdown_connections 2021-06-25T04:56:12.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 --2- 172.21.15.57:0/1887785269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13cc0a7080 0x7f13cc1446e0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 --2- 172.21.15.57:0/1887785269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13cc148360 0x7f13cc0b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 -- 172.21.15.57:0/1887785269 >> 172.21.15.57:0/1887785269 conn(0x7f13cc05f670 msgr2=0x7f13cc05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:12.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.823+0000 7f13d2e0d700 1 -- 172.21.15.57:0/1887785269 shutdown_connections 2021-06-25T04:56:12.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13d2e0d700 1 -- 172.21.15.57:0/1887785269 wait complete. 2021-06-25T04:56:12.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13d2e0d700 1 Processor -- start 2021-06-25T04:56:12.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13d2e0d700 1 -- start start 2021-06-25T04:56:12.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13d2e0d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13cc0a7080 0x7f13cc0652f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:12.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13d2e0d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13cc0b1d70 0x7f13cc062e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:12.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13d2e0d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13cc148360 0x7f13cc063300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:12.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13d2e0d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc064230 con 0x7f13cc0b1d70 2021-06-25T04:56:12.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13d2e0d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0ab210 con 0x7f13cc148360 2021-06-25T04:56:12.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13d2e0d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc0ac320 con 0x7f13cc0a7080 2021-06-25T04:56:12.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13cbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13cc0b1d70 0x7f13cc062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13cbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13cc0b1d70 0x7f13cc062e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42858/0 (socket says 172.21.15.57:42858) 2021-06-25T04:56:12.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13cbfff700 1 -- 172.21.15.57:0/324198102 learned_addr learned my addr 172.21.15.57:0/324198102 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:12.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13d0ba9700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13cc0a7080 0x7f13cc0652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13d13aa700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13cc148360 0x7f13cc063300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13cbfff700 1 -- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13cc0a7080 msgr2=0x7f13cc0652f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13cbfff700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13cc0a7080 0x7f13cc0652f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13cbfff700 1 -- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13cc148360 msgr2=0x7f13cc063300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:12.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13cbfff700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13cc148360 0x7f13cc063300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:12.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13cbfff700 1 -- 172.21.15.57:0/324198102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c400b1e0 con 0x7f13cc0b1d70 2021-06-25T04:56:12.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.827+0000 7f13cbfff700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13cc0b1d70 0x7f13cc062e10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f13cc0ab350 tx=0x7f13c0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:12.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.831+0000 7f13c9ffb700 1 -- 172.21.15.57:0/324198102 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c0011750 con 0x7f13cc0b1d70 2021-06-25T04:56:12.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.831+0000 7f13c9ffb700 1 -- 172.21.15.57:0/324198102 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c00118b0 con 0x7f13cc0b1d70 2021-06-25T04:56:12.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.831+0000 7f13d2e0d700 1 -- 172.21.15.57:0/324198102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13cc062ac0 con 0x7f13cc0b1d70 2021-06-25T04:56:12.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.831+0000 7f13c9ffb700 1 -- 172.21.15.57:0/324198102 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c0011c10 con 0x7f13cc0b1d70 2021-06-25T04:56:12.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.831+0000 7f13d2e0d700 1 -- 172.21.15.57:0/324198102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13cc145300 con 0x7f13cc0b1d70 2021-06-25T04:56:12.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.831+0000 7f13d2e0d700 1 -- 172.21.15.57:0/324198102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13cc057310 con 0x7f13cc0b1d70 2021-06-25T04:56:12.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.831+0000 7f13c9ffb700 1 -- 172.21.15.57:0/324198102 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f13c0011d70 con 0x7f13cc0b1d70 2021-06-25T04:56:12.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.831+0000 7f13c9ffb700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f13ac0553f0 0x7f13ac0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:12.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.831+0000 7f13c9ffb700 1 -- 172.21.15.57:0/324198102 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f13c006e240 con 0x7f13cc0b1d70 2021-06-25T04:56:12.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.831+0000 7f13d0ba9700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f13ac0553f0 0x7f13ac0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:12.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.835+0000 7f13d0ba9700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f13ac0553f0 0x7f13ac0578b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f13bc00d000 tx=0x7f13bc007da0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:12.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:12.835+0000 7f13c9ffb700 1 -- 172.21.15.57:0/324198102 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f13c0044340 con 0x7f13cc0b1d70 2021-06-25T04:56:13.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.003+0000 7f13d2e0d700 1 -- 172.21.15.57:0/324198102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f13cc0a7f20 con 0x7f13cc0b1d70 2021-06-25T04:56:13.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.667+0000 7f13c9ffb700 1 -- 172.21.15.57:0/324198102 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v65) v1 ==== 161+0+0 (secure 0 0 0) 0x7f13c0047960 con 0x7f13cc0b1d70 2021-06-25T04:56:13.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 -- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f13ac0553f0 msgr2=0x7f13ac0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:13.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f13ac0553f0 0x7f13ac0578b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f13bc00d000 tx=0x7f13bc007da0).stop 2021-06-25T04:56:13.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 -- 172.21.15.57:0/324198102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13cc0b1d70 msgr2=0x7f13cc062e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:13.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13cc0b1d70 0x7f13cc062e10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f13cc0ab350 tx=0x7f13c0006df0).stop 2021-06-25T04:56:13.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 -- 172.21.15.57:0/324198102 shutdown_connections 2021-06-25T04:56:13.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f13ac0553f0 0x7f13ac0578b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13cc148360 0x7f13cc063300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13cc0b1d70 0x7f13cc062e10 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 --2- 172.21.15.57:0/324198102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13cc0a7080 0x7f13cc0652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 -- 172.21.15.57:0/324198102 >> 172.21.15.57:0/324198102 conn(0x7f13cc05f670 msgr2=0x7f13cc0b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:13.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 -- 172.21.15.57:0/324198102 shutdown_connections 2021-06-25T04:56:13.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.671+0000 7f13d2e0d700 1 -- 172.21.15.57:0/324198102 wait complete. 2021-06-25T04:56:13.681 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:56:13.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:13.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.799+0000 7f5c14dc4700 1 Processor -- start 2021-06-25T04:56:13.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.799+0000 7f5c14dc4700 1 -- start start 2021-06-25T04:56:13.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.799+0000 7f5c14dc4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c10061640 0x7f5c100b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:13.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.799+0000 7f5c14dc4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c10143960 0x7f5c10140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:13.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.799+0000 7f5c14dc4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c100b68d0 con 0x7f5c100b46d0 2021-06-25T04:56:13.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.799+0000 7f5c14dc4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c100b9640 con 0x7f5c10143960 2021-06-25T04:56:13.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.799+0000 7f5c14dc4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100b6b70 con 0x7f5c10061640 2021-06-25T04:56:13.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.799+0000 7f5c0ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c10143960 0x7f5c10140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:13.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.799+0000 7f5c0effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5c100b46d0 0x7f5c1013fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60082/0 (socket says 172.21.15.57:60082) 2021-06-25T04:56:13.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.799+0000 7f5c0effd700 1 -- 172.21.15.57:0/1768185663 learned_addr learned my addr 172.21.15.57:0/1768185663 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:13.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.799+0000 7f5c0f7fe700 1 --2- 172.21.15.57:0/1768185663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c10061640 0x7f5c100b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:13.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c0e7fc700 1 -- 172.21.15.57:0/1768185663 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513569611 0 0) 0x7f5c100b68d0 con 0x7f5c100b46d0 2021-06-25T04:56:13.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c0e7fc700 1 -- 172.21.15.57:0/1768185663 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bfc003260 con 0x7f5c100b46d0 2021-06-25T04:56:13.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c0e7fc700 1 -- 172.21.15.57:0/1768185663 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1466749871 0 0) 0x7f5bfc003260 con 0x7f5c100b46d0 2021-06-25T04:56:13.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c0ffff700 1 -- 172.21.15.57:0/1768185663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c10061640 msgr2=0x7f5c100b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:13.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c0ffff700 1 --2- 172.21.15.57:0/1768185663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c10061640 0x7f5c100b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c0ffff700 1 -- 172.21.15.57:0/1768185663 >> v1:172.21.15.57:6789/0 conn(0x7f5c100b46d0 legacy=0x7f5c1013fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:13.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c0ffff700 1 -- 172.21.15.57:0/1768185663 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100b6e10 con 0x7f5c10143960 2021-06-25T04:56:13.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c0ffff700 1 --2- 172.21.15.57:0/1768185663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c10143960 0x7f5c10140470 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f5c00001800 tx=0x7f5c080091d0).ready entity=mon.0 client_cookie=6aa2a7720eb57294 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:13.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c0e7fc700 1 -- 172.21.15.57:0/1768185663 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c00001660 con 0x7f5c10143960 2021-06-25T04:56:13.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c0e7fc700 1 -- 172.21.15.57:0/1768185663 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0800f510 con 0x7f5c10143960 2021-06-25T04:56:13.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c0e7fc700 1 -- 172.21.15.57:0/1768185663 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0800f680 con 0x7f5c10143960 2021-06-25T04:56:13.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c14dc4700 1 -- 172.21.15.57:0/1768185663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c10143960 msgr2=0x7f5c10140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:13.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c14dc4700 1 --2- 172.21.15.57:0/1768185663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c10143960 0x7f5c10140470 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f5c00001800 tx=0x7f5c080091d0).stop 2021-06-25T04:56:13.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c14dc4700 1 -- 172.21.15.57:0/1768185663 shutdown_connections 2021-06-25T04:56:13.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c14dc4700 1 --2- 172.21.15.57:0/1768185663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c10143960 0x7f5c10140470 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c14dc4700 1 --2- 172.21.15.57:0/1768185663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c10061640 0x7f5c100b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c14dc4700 1 -- 172.21.15.57:0/1768185663 >> 172.21.15.57:0/1768185663 conn(0x7f5c1006adb0 msgr2=0x7f5c1005f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:13.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c14dc4700 1 -- 172.21.15.57:0/1768185663 shutdown_connections 2021-06-25T04:56:13.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c14dc4700 1 -- 172.21.15.57:0/1768185663 wait complete. 2021-06-25T04:56:13.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.803+0000 7f5c14dc4700 1 Processor -- start 2021-06-25T04:56:13.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c14dc4700 1 -- start start 2021-06-25T04:56:13.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c14dc4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c10061640 0x7f5c10147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:13.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c14dc4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c10143960 0x7f5c10155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:13.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c14dc4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c101562c0 0x7f5c10144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:13.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c14dc4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c10148f10 con 0x7f5c10143960 2021-06-25T04:56:13.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c14dc4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100b0aa0 con 0x7f5c101562c0 2021-06-25T04:56:13.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c14dc4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c10142750 con 0x7f5c10061640 2021-06-25T04:56:13.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c10143960 0x7f5c10155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:13.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c10143960 0x7f5c10155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42872/0 (socket says 172.21.15.57:42872) 2021-06-25T04:56:13.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0effd700 1 -- 172.21.15.57:0/28516294 learned_addr learned my addr 172.21.15.57:0/28516294 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:13.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0f7fe700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c10061640 0x7f5c10147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:13.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0ffff700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c101562c0 0x7f5c10144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:13.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0effd700 1 -- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c10061640 msgr2=0x7f5c10147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:13.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0effd700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c10061640 0x7f5c10147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0effd700 1 -- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c101562c0 msgr2=0x7f5c10144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:13.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0effd700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c101562c0 0x7f5c10144190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0effd700 1 -- 172.21.15.57:0/28516294 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08009470 con 0x7f5c10143960 2021-06-25T04:56:13.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0effd700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c10143960 0x7f5c10155dd0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f5c000018c0 tx=0x7f5c00001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:13.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0cff9700 1 -- 172.21.15.57:0/28516294 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c00007170 con 0x7f5c10143960 2021-06-25T04:56:13.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0cff9700 1 -- 172.21.15.57:0/28516294 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c000072d0 con 0x7f5c10143960 2021-06-25T04:56:13.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c14dc4700 1 -- 172.21.15.57:0/28516294 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c10142dc0 con 0x7f5c10143960 2021-06-25T04:56:13.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c0cff9700 1 -- 172.21.15.57:0/28516294 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c00004920 con 0x7f5c10143960 2021-06-25T04:56:13.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.807+0000 7f5c14dc4700 1 -- 172.21.15.57:0/28516294 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c10142150 con 0x7f5c10143960 2021-06-25T04:56:13.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.811+0000 7f5c14dc4700 1 -- 172.21.15.57:0/28516294 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c101491e0 con 0x7f5c10143960 2021-06-25T04:56:13.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.811+0000 7f5c0cff9700 1 -- 172.21.15.57:0/28516294 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5c00010070 con 0x7f5c10143960 2021-06-25T04:56:13.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.811+0000 7f5c0cff9700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bf0055490 0x7f5bf0057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:13.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.811+0000 7f5c0cff9700 1 -- 172.21.15.57:0/28516294 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f5c0006ddb0 con 0x7f5c10143960 2021-06-25T04:56:13.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.811+0000 7f5c0f7fe700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bf0055490 0x7f5bf0057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:13.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.811+0000 7f5c0f7fe700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bf0055490 0x7f5bf0057950 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f5c0400b000 tx=0x7f5c04006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:13.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.819+0000 7f5c0cff9700 1 -- 172.21.15.57:0/28516294 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5c00072070 con 0x7f5c10143960 2021-06-25T04:56:13.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.983+0000 7f5c14dc4700 1 -- 172.21.15.57:0/28516294 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c10142f50 con 0x7f5c10143960 2021-06-25T04:56:13.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.983+0000 7f5c0cff9700 1 -- 172.21.15.57:0/28516294 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f5c00043e00 con 0x7f5c10143960 2021-06-25T04:56:13.989 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:13.989 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":65,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":65,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:11.648284+0000","modified":"2021-06-25T04:56:13.658247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-06-25T04:56:13.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.983+0000 7f5c14dc4700 1 -- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bf0055490 msgr2=0x7f5bf0057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:13.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.983+0000 7f5c14dc4700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bf0055490 0x7f5bf0057950 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f5c0400b000 tx=0x7f5c04006df0).stop 2021-06-25T04:56:13.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.987+0000 7f5c14dc4700 1 -- 172.21.15.57:0/28516294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c10143960 msgr2=0x7f5c10155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:13.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.987+0000 7f5c14dc4700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c10143960 0x7f5c10155dd0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f5c000018c0 tx=0x7f5c00001b30).stop 2021-06-25T04:56:13.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.987+0000 7f5c14dc4700 1 -- 172.21.15.57:0/28516294 shutdown_connections 2021-06-25T04:56:13.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.987+0000 7f5c14dc4700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5bf0055490 0x7f5bf0057950 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.987+0000 7f5c14dc4700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c101562c0 0x7f5c10144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.987+0000 7f5c14dc4700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c10143960 0x7f5c10155dd0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.987+0000 7f5c14dc4700 1 --2- 172.21.15.57:0/28516294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c10061640 0x7f5c10147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:13.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.987+0000 7f5c14dc4700 1 -- 172.21.15.57:0/28516294 >> 172.21.15.57:0/28516294 conn(0x7f5c1006adb0 msgr2=0x7f5c1013f510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:13.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.987+0000 7f5c14dc4700 1 -- 172.21.15.57:0/28516294 shutdown_connections 2021-06-25T04:56:13.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:13.987+0000 7f5c14dc4700 1 -- 172.21.15.57:0/28516294 wait complete. 2021-06-25T04:56:13.995 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 65 2021-06-25T04:56:14.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:56:14.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.099+0000 7fe1cf59e700 1 Processor -- start 2021-06-25T04:56:14.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.099+0000 7fe1cf59e700 1 -- start start 2021-06-25T04:56:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1d00b2170 0x7fe1d005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1d0060ce0 0x7fe1d00b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d00b2550 con 0x7fe1d0143c50 2021-06-25T04:56:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d0063db0 con 0x7fe1d0060ce0 2021-06-25T04:56:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d00b2df0 con 0x7fe1d00b2170 2021-06-25T04:56:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1c5d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1d0060ce0 0x7fe1d00b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1ced9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe1d0143c50 0x7fe1d012bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60100/0 (socket says 172.21.15.57:60100) 2021-06-25T04:56:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1ced9d700 1 -- 172.21.15.57:0/4210050142 learned_addr learned my addr 172.21.15.57:0/4210050142 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1ce59c700 1 --2- 172.21.15.57:0/4210050142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1d00b2170 0x7fe1d005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cdd9b700 1 -- 172.21.15.57:0/4210050142 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926555582 0 0) 0x7fe1d00b2550 con 0x7fe1d0143c50 2021-06-25T04:56:14.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cdd9b700 1 -- 172.21.15.57:0/4210050142 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b0003260 con 0x7fe1d0143c50 2021-06-25T04:56:14.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1c5d9b700 1 -- 172.21.15.57:0/4210050142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1d00b2170 msgr2=0x7fe1d005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:14.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1c5d9b700 1 --2- 172.21.15.57:0/4210050142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1d00b2170 0x7fe1d005f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1c5d9b700 1 -- 172.21.15.57:0/4210050142 >> v1:172.21.15.57:6789/0 conn(0x7fe1d0143c50 legacy=0x7fe1d012bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:14.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1c5d9b700 1 -- 172.21.15.57:0/4210050142 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0063870 con 0x7fe1d0060ce0 2021-06-25T04:56:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1c5d9b700 1 --2- 172.21.15.57:0/4210050142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d0060ce0 0x7fe1d00b34f0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7fe1b8002f70 tx=0x7fe1b8006df0).ready entity=mon.0 client_cookie=610540ac3b9e617b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cdd9b700 1 -- 172.21.15.57:0/4210050142 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b800d4a0 con 0x7fe1d0060ce0 2021-06-25T04:56:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cdd9b700 1 -- 172.21.15.57:0/4210050142 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b8000e90 con 0x7fe1d0060ce0 2021-06-25T04:56:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cdd9b700 1 -- 172.21.15.57:0/4210050142 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b800d7f0 con 0x7fe1d0060ce0 2021-06-25T04:56:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4210050142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d0060ce0 msgr2=0x7fe1d00b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 --2- 172.21.15.57:0/4210050142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d0060ce0 0x7fe1d00b34f0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7fe1b8002f70 tx=0x7fe1b8006df0).stop 2021-06-25T04:56:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4210050142 shutdown_connections 2021-06-25T04:56:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 --2- 172.21.15.57:0/4210050142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d0060ce0 0x7fe1d00b34f0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 --2- 172.21.15.57:0/4210050142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1d00b2170 0x7fe1d005f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4210050142 >> 172.21.15.57:0/4210050142 conn(0x7fe1d005c450 msgr2=0x7fe1d005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.103+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4210050142 shutdown_connections 2021-06-25T04:56:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.107+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4210050142 wait complete. 2021-06-25T04:56:14.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.107+0000 7fe1cf59e700 1 Processor -- start 2021-06-25T04:56:14.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.107+0000 7fe1cf59e700 1 -- start start 2021-06-25T04:56:14.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1cf59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d0060ce0 0x7fe1d0065ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1cf59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1d00b2170 0x7fe1d0148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1cf59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d0143c50 0x7fe1d0152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1cf59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d0149420 con 0x7fe1d0143c50 2021-06-25T04:56:14.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1cf59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d0149a40 con 0x7fe1d0060ce0 2021-06-25T04:56:14.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1cf59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d0149600 con 0x7fe1d00b2170 2021-06-25T04:56:14.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1ced9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d0143c50 0x7fe1d0152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1ce59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d0060ce0 0x7fe1d0065ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1ced9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d0143c50 0x7fe1d0152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42888/0 (socket says 172.21.15.57:42888) 2021-06-25T04:56:14.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1ced9d700 1 -- 172.21.15.57:0/4126924612 learned_addr learned my addr 172.21.15.57:0/4126924612 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:14.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1c5d9b700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1d00b2170 0x7fe1d0148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1ced9d700 1 -- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1d00b2170 msgr2=0x7fe1d0148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:14.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1ced9d700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1d00b2170 0x7fe1d0148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1ced9d700 1 -- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d0060ce0 msgr2=0x7fe1d0065ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:14.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1ced9d700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d0060ce0 0x7fe1d0065ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1ced9d700 1 -- 172.21.15.57:0/4126924612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b800b180 con 0x7fe1d0143c50 2021-06-25T04:56:14.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1ced9d700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d0143c50 0x7fe1d0152380 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fe1c8001490 tx=0x7fe1c8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:14.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1c7fff700 1 -- 172.21.15.57:0/4126924612 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c8005ba0 con 0x7fe1d0143c50 2021-06-25T04:56:14.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1c7fff700 1 -- 172.21.15.57:0/4126924612 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8005d00 con 0x7fe1d0143c50 2021-06-25T04:56:14.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4126924612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d0144560 con 0x7fe1d0143c50 2021-06-25T04:56:14.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1c7fff700 1 -- 172.21.15.57:0/4126924612 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c80072c0 con 0x7fe1d0143c50 2021-06-25T04:56:14.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4126924612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d0144aa0 con 0x7fe1d0143c50 2021-06-25T04:56:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.111+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4126924612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d0057310 con 0x7fe1d0143c50 2021-06-25T04:56:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.115+0000 7fe1c7fff700 1 -- 172.21.15.57:0/4126924612 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe1c801a060 con 0x7fe1d0143c50 2021-06-25T04:56:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.115+0000 7fe1c7fff700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1b40553d0 0x7fe1b4057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.115+0000 7fe1c7fff700 1 -- 172.21.15.57:0/4126924612 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fe1c806d9a0 con 0x7fe1d0143c50 2021-06-25T04:56:14.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.115+0000 7fe1ce59c700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1b40553d0 0x7fe1b4057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.115+0000 7fe1ce59c700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1b40553d0 0x7fe1b4057890 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fe1c000b000 tx=0x7fe1c0006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:14.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.119+0000 7fe1c7fff700 1 -- 172.21.15.57:0/4126924612 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe1c8043b00 con 0x7fe1d0143c50 2021-06-25T04:56:14.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.291+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4126924612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe1d005f200 con 0x7fe1d0143c50 2021-06-25T04:56:14.689 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.683+0000 7fe1c7fff700 1 -- 172.21.15.57:0/4126924612 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v66) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe1c8018020 con 0x7fe1d0143c50 2021-06-25T04:56:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1b40553d0 msgr2=0x7fe1b4057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1b40553d0 0x7fe1b4057890 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fe1c000b000 tx=0x7fe1c0006df0).stop 2021-06-25T04:56:14.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4126924612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d0143c50 msgr2=0x7fe1d0152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:14.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d0143c50 0x7fe1d0152380 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fe1c8001490 tx=0x7fe1c8007e00).stop 2021-06-25T04:56:14.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4126924612 shutdown_connections 2021-06-25T04:56:14.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1b40553d0 0x7fe1b4057890 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1d0143c50 0x7fe1d0152380 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1d00b2170 0x7fe1d0148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 --2- 172.21.15.57:0/4126924612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d0060ce0 0x7fe1d0065ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4126924612 >> 172.21.15.57:0/4126924612 conn(0x7fe1d005c450 msgr2=0x7fe1d012a520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:14.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4126924612 shutdown_connections 2021-06-25T04:56:14.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.687+0000 7fe1cf59e700 1 -- 172.21.15.57:0/4126924612 wait complete. 2021-06-25T04:56:14.710 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:56:14.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.823+0000 7f45b2075700 1 Processor -- start 2021-06-25T04:56:14.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.823+0000 7f45b2075700 1 -- start start 2021-06-25T04:56:14.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f45ac0b6540 0x7f45ac0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45ac0b6920 0x7f45ac12b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac144070 con 0x7f45ac0b4380 2021-06-25T04:56:14.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac143b30 con 0x7f45ac0b6920 2021-06-25T04:56:14.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac143dd0 con 0x7f45ac0b6540 2021-06-25T04:56:14.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45abfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45ac0b6920 0x7f45ac12b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45abfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45ac0b6920 0x7f45ac12b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42896/0 (socket says 172.21.15.57:42896) 2021-06-25T04:56:14.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45abfff700 1 -- 172.21.15.57:0/1882624963 learned_addr learned my addr 172.21.15.57:0/1882624963 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:14.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45ab7fe700 1 --2- 172.21.15.57:0/1882624963 >> v2:172.21.15.87:3300/0 conn(0x7f45ac0b6540 0x7f45ac0b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45abfff700 1 -- 172.21.15.57:0/1882624963 >> v2:172.21.15.87:3300/0 conn(0x7f45ac0b6540 msgr2=0x7f45ac0b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:14.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45abfff700 1 --2- 172.21.15.57:0/1882624963 >> v2:172.21.15.87:3300/0 conn(0x7f45ac0b6540 0x7f45ac0b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45abfff700 1 -- 172.21.15.57:0/1882624963 >> v1:172.21.15.87:6789/0 conn(0x7f45ac0b4380 legacy=0x7f45ac061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:14.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45abfff700 1 -- 172.21.15.57:0/1882624963 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac0615b0 con 0x7f45ac0b6920 2021-06-25T04:56:14.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45abfff700 1 --2- 172.21.15.57:0/1882624963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b6920 0x7f45ac12b9c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f45ac1430e0 tx=0x7f45a4009290).ready entity=mon.0 client_cookie=453a856ff5342ffc server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:14.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45aa7fc700 1 -- 172.21.15.57:0/1882624963 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45a400b860 con 0x7f45ac0b6920 2021-06-25T04:56:14.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45aa7fc700 1 -- 172.21.15.57:0/1882624963 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a400b9c0 con 0x7f45ac0b6920 2021-06-25T04:56:14.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 -- 172.21.15.57:0/1882624963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b6920 msgr2=0x7f45ac12b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:14.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45aa7fc700 1 -- 172.21.15.57:0/1882624963 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45a400bb30 con 0x7f45ac0b6920 2021-06-25T04:56:14.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 --2- 172.21.15.57:0/1882624963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b6920 0x7f45ac12b9c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f45ac1430e0 tx=0x7f45a4009290).stop 2021-06-25T04:56:14.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 -- 172.21.15.57:0/1882624963 shutdown_connections 2021-06-25T04:56:14.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 --2- 172.21.15.57:0/1882624963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b6920 0x7f45ac12b9c0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 --2- 172.21.15.57:0/1882624963 >> v2:172.21.15.87:3300/0 conn(0x7f45ac0b6540 0x7f45ac0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 -- 172.21.15.57:0/1882624963 >> 172.21.15.57:0/1882624963 conn(0x7f45ac05c450 msgr2=0x7f45ac05c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:14.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 -- 172.21.15.57:0/1882624963 shutdown_connections 2021-06-25T04:56:14.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.827+0000 7f45b2075700 1 -- 172.21.15.57:0/1882624963 wait complete. 2021-06-25T04:56:14.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45b2075700 1 Processor -- start 2021-06-25T04:56:14.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45b2075700 1 -- start start 2021-06-25T04:56:14.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45b2075700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45ac0b4380 0x7f45ac1228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45b2075700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45ac0b6540 0x7f45ac155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45b2075700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b6920 0x7f45ac155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45b2075700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac156490 con 0x7f45ac0b6920 2021-06-25T04:56:14.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45b2075700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0adf90 con 0x7f45ac0b6540 2021-06-25T04:56:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45b2075700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0ae230 con 0x7f45ac0b4380 2021-06-25T04:56:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b6920 0x7f45ac155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b6920 0x7f45ac155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42900/0 (socket says 172.21.15.57:42900) 2021-06-25T04:56:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45abfff700 1 -- 172.21.15.57:0/3163697697 learned_addr learned my addr 172.21.15.57:0/3163697697 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45ab7fe700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45ac0b4380 0x7f45ac1228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45aaffd700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45ac0b6540 0x7f45ac155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45abfff700 1 -- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45ac0b4380 msgr2=0x7f45ac1228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45abfff700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45ac0b4380 0x7f45ac1228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45abfff700 1 -- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45ac0b6540 msgr2=0x7f45ac155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:14.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45abfff700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45ac0b6540 0x7f45ac155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:14.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.831+0000 7f45abfff700 1 -- 172.21.15.57:0/3163697697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4009530 con 0x7f45ac0b6920 2021-06-25T04:56:14.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.835+0000 7f45abfff700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b6920 0x7f45ac155fa0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f45ac1430e0 tx=0x7f45a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:14.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.835+0000 7f45a8ff9700 1 -- 172.21.15.57:0/3163697697 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45a4011bf0 con 0x7f45ac0b6920 2021-06-25T04:56:14.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.835+0000 7f45a8ff9700 1 -- 172.21.15.57:0/3163697697 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a4011d50 con 0x7f45ac0b6920 2021-06-25T04:56:14.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.835+0000 7f45b2075700 1 -- 172.21.15.57:0/3163697697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac0ae4d0 con 0x7f45ac0b6920 2021-06-25T04:56:14.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.835+0000 7f45a8ff9700 1 -- 172.21.15.57:0/3163697697 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45a401f610 con 0x7f45ac0b6920 2021-06-25T04:56:14.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.835+0000 7f45b2075700 1 -- 172.21.15.57:0/3163697697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac0b24f0 con 0x7f45ac0b6920 2021-06-25T04:56:14.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.835+0000 7f45b2075700 1 -- 172.21.15.57:0/3163697697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac0b26b0 con 0x7f45ac0b6920 2021-06-25T04:56:14.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.835+0000 7f45a8ff9700 1 -- 172.21.15.57:0/3163697697 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f45a400f070 con 0x7f45ac0b6920 2021-06-25T04:56:14.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.835+0000 7f45a8ff9700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 0x7f458c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:14.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.835+0000 7f45a8ff9700 1 -- 172.21.15.57:0/3163697697 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f45a406e760 con 0x7f45ac0b6920 2021-06-25T04:56:14.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.839+0000 7f45ab7fe700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 0x7f458c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:14.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.839+0000 7f45ab7fe700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 0x7f458c057910 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f459c00b000 tx=0x7f459c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:14.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.843+0000 7f45a8ff9700 1 -- 172.21.15.57:0/3163697697 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f45a4044900 con 0x7f45ac0b6920 2021-06-25T04:56:14.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:14.971+0000 7f45b2075700 1 -- 172.21.15.57:0/3163697697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f45ac057310 con 0x7f45ac0b6920 2021-06-25T04:56:15.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.687+0000 7f45a8ff9700 1 -- 172.21.15.57:0/3163697697 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v132) v1 ==== 185+0+0 (secure 0 0 0) 0x7f45a4015070 con 0x7f45ac0b6920 2021-06-25T04:56:15.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 -- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 msgr2=0x7f458c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:15.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 0x7f458c057910 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f459c00b000 tx=0x7f459c006df0).stop 2021-06-25T04:56:15.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 -- 172.21.15.57:0/3163697697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b6920 msgr2=0x7f45ac155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:15.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b6920 0x7f45ac155fa0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f45ac1430e0 tx=0x7f45a4016000).stop 2021-06-25T04:56:15.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 -- 172.21.15.57:0/3163697697 shutdown_connections 2021-06-25T04:56:15.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f458c055450 0x7f458c057910 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:15.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45ac0b6920 0x7f45ac155fa0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:15.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45ac0b6540 0x7f45ac155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:15.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 --2- 172.21.15.57:0/3163697697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45ac0b4380 0x7f45ac1228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:15.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 -- 172.21.15.57:0/3163697697 >> 172.21.15.57:0/3163697697 conn(0x7f45ac05c450 msgr2=0x7f45ac141ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:15.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 -- 172.21.15.57:0/3163697697 shutdown_connections 2021-06-25T04:56:15.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.691+0000 7f45b2075700 1 -- 172.21.15.57:0/3163697697 wait complete. 2021-06-25T04:56:15.700 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:56:15.711 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:56:15.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.819+0000 7f4af7bc0700 1 Processor -- start 2021-06-25T04:56:15.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.819+0000 7f4af7bc0700 1 -- start start 2021-06-25T04:56:15.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.819+0000 7f4af7bc0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4af00670e0 0x7f4af00b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:15.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af7bc0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af00b9b90 con 0x7f4af0143970 2021-06-25T04:56:15.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af7bc0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af00674c0 con 0x7f4af013ffb0 2021-06-25T04:56:15.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af7bc0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af0143040 con 0x7f4af00670e0 2021-06-25T04:56:15.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af595c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4af00670e0 0x7f4af00b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:15.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af515b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4af0143970 0x7f4af00aebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60126/0 (socket says 172.21.15.57:60126) 2021-06-25T04:56:15.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af595c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4af00670e0 0x7f4af00b96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42906/0 (socket says 172.21.15.57:42906) 2021-06-25T04:56:15.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af515b700 1 -- 172.21.15.57:0/1509430262 learned_addr learned my addr 172.21.15.57:0/1509430262 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:15.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af595c700 1 -- 172.21.15.57:0/1509430262 >> v1:172.21.15.87:6789/0 conn(0x7f4af013ffb0 legacy=0x7f4af0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:15.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af595c700 1 -- 172.21.15.57:0/1509430262 >> v1:172.21.15.57:6789/0 conn(0x7f4af0143970 legacy=0x7f4af00aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:15.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af595c700 1 -- 172.21.15.57:0/1509430262 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00af490 con 0x7f4af00670e0 2021-06-25T04:56:15.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af595c700 1 --2- 172.21.15.57:0/1509430262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4af00670e0 0x7f4af00b96a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f4aec002f70 tx=0x7f4aec006df0).ready entity=mon.0 client_cookie=8197e3b42f6f3e81 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:15.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af495a700 1 -- 172.21.15.57:0/1509430262 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aec00d610 con 0x7f4af00670e0 2021-06-25T04:56:15.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af495a700 1 -- 172.21.15.57:0/1509430262 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec000e90 con 0x7f4af00670e0 2021-06-25T04:56:15.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af495a700 1 -- 172.21.15.57:0/1509430262 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aec00d960 con 0x7f4af00670e0 2021-06-25T04:56:15.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af7bc0700 1 -- 172.21.15.57:0/1509430262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4af00670e0 msgr2=0x7f4af00b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:15.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af7bc0700 1 --2- 172.21.15.57:0/1509430262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4af00670e0 0x7f4af00b96a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f4aec002f70 tx=0x7f4aec006df0).stop 2021-06-25T04:56:15.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af7bc0700 1 -- 172.21.15.57:0/1509430262 shutdown_connections 2021-06-25T04:56:15.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af7bc0700 1 --2- 172.21.15.57:0/1509430262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4af00670e0 0x7f4af00b96a0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:15.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af7bc0700 1 -- 172.21.15.57:0/1509430262 >> 172.21.15.57:0/1509430262 conn(0x7f4af005f9b0 msgr2=0x7f4af0061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:15.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af7bc0700 1 -- 172.21.15.57:0/1509430262 shutdown_connections 2021-06-25T04:56:15.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.823+0000 7f4af7bc0700 1 -- 172.21.15.57:0/1509430262 wait complete. 2021-06-25T04:56:15.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af7bc0700 1 Processor -- start 2021-06-25T04:56:15.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af7bc0700 1 -- start start 2021-06-25T04:56:15.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af7bc0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4af00670e0 0x7f4af0146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:15.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af7bc0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4af013ffb0 0x7f4af013c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:15.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af7bc0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4af0143970 0x7f4af0139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:15.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af7bc0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0155840 con 0x7f4af013ffb0 2021-06-25T04:56:15.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af7bc0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af013e190 con 0x7f4af00670e0 2021-06-25T04:56:15.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af7bc0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af013e430 con 0x7f4af0143970 2021-06-25T04:56:15.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af515b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4af013ffb0 0x7f4af013c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:15.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af515b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4af013ffb0 0x7f4af013c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42914/0 (socket says 172.21.15.57:42914) 2021-06-25T04:56:15.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af515b700 1 -- 172.21.15.57:0/3637489621 learned_addr learned my addr 172.21.15.57:0/3637489621 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:15.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af595c700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4af00670e0 0x7f4af0146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:15.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af615d700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4af0143970 0x7f4af0139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:15.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af515b700 1 -- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4af0143970 msgr2=0x7f4af0139bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:15.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af515b700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4af0143970 0x7f4af0139bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:15.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af515b700 1 -- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4af00670e0 msgr2=0x7f4af0146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:15.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af515b700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4af00670e0 0x7f4af0146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:15.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af515b700 1 -- 172.21.15.57:0/3637489621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec00b180 con 0x7f4af013ffb0 2021-06-25T04:56:15.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af515b700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4af013ffb0 0x7f4af013c710 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f4af0060240 tx=0x7f4ae4007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:15.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4ae2ffd700 1 -- 172.21.15.57:0/3637489621 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ae4007110 con 0x7f4af013ffb0 2021-06-25T04:56:15.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4ae2ffd700 1 -- 172.21.15.57:0/3637489621 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae4007270 con 0x7f4af013ffb0 2021-06-25T04:56:15.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4ae2ffd700 1 -- 172.21.15.57:0/3637489621 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ae4005030 con 0x7f4af013ffb0 2021-06-25T04:56:15.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.827+0000 7f4af7bc0700 1 -- 172.21.15.57:0/3637489621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af013e6d0 con 0x7f4af013ffb0 2021-06-25T04:56:15.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.831+0000 7f4af7bc0700 1 -- 172.21.15.57:0/3637489621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af013cc00 con 0x7f4af013ffb0 2021-06-25T04:56:15.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.831+0000 7f4af7bc0700 1 -- 172.21.15.57:0/3637489621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af013a420 con 0x7f4af013ffb0 2021-06-25T04:56:15.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.831+0000 7f4ae2ffd700 1 -- 172.21.15.57:0/3637489621 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4ae401b070 con 0x7f4af013ffb0 2021-06-25T04:56:15.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.831+0000 7f4ae2ffd700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ad0055360 0x7f4ad0057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:15.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.831+0000 7f4ae2ffd700 1 -- 172.21.15.57:0/3637489621 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f4ae406d000 con 0x7f4af013ffb0 2021-06-25T04:56:15.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.831+0000 7f4af595c700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ad0055360 0x7f4ad0057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:15.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.835+0000 7f4af595c700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ad0055360 0x7f4ad0057820 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f4aec01b000 tx=0x7f4aec015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:15.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.839+0000 7f4ae2ffd700 1 -- 172.21.15.57:0/3637489621 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4ae4043270 con 0x7f4af013ffb0 2021-06-25T04:56:15.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:15.963+0000 7f4af7bc0700 1 -- 172.21.15.57:0/3637489621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4af00b9b90 con 0x7f4af013ffb0 2021-06-25T04:56:16.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.691+0000 7f4ae2ffd700 1 -- 172.21.15.57:0/3637489621 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v133) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4af00b9b90 con 0x7f4af013ffb0 2021-06-25T04:56:16.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.699+0000 7f4af7bc0700 1 -- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ad0055360 msgr2=0x7f4ad0057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:16.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.699+0000 7f4af7bc0700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ad0055360 0x7f4ad0057820 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f4aec01b000 tx=0x7f4aec015000).stop 2021-06-25T04:56:16.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.699+0000 7f4af7bc0700 1 -- 172.21.15.57:0/3637489621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4af013ffb0 msgr2=0x7f4af013c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:16.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.699+0000 7f4af7bc0700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4af013ffb0 0x7f4af013c710 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f4af0060240 tx=0x7f4ae4007c60).stop 2021-06-25T04:56:16.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.703+0000 7f4af7bc0700 1 -- 172.21.15.57:0/3637489621 shutdown_connections 2021-06-25T04:56:16.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.703+0000 7f4af7bc0700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ad0055360 0x7f4ad0057820 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:16.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.703+0000 7f4af7bc0700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4af0143970 0x7f4af0139bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:16.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.703+0000 7f4af7bc0700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4af013ffb0 0x7f4af013c710 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:16.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.703+0000 7f4af7bc0700 1 --2- 172.21.15.57:0/3637489621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4af00670e0 0x7f4af0146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:16.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.703+0000 7f4af7bc0700 1 -- 172.21.15.57:0/3637489621 >> 172.21.15.57:0/3637489621 conn(0x7f4af005f9b0 msgr2=0x7f4af005cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:16.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.703+0000 7f4af7bc0700 1 -- 172.21.15.57:0/3637489621 shutdown_connections 2021-06-25T04:56:16.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.703+0000 7f4af7bc0700 1 -- 172.21.15.57:0/3637489621 wait complete. 2021-06-25T04:56:16.711 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:56:16.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-06-25T04:56:16.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.827+0000 7f52a0a07700 1 Processor -- start 2021-06-25T04:56:16.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.827+0000 7f52a0a07700 1 -- start start 2021-06-25T04:56:16.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f52a0a07700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f529c0a9bd0 0x7f529c060780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:16.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f52a0a07700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c066e60 con 0x7f529c0b3000 2021-06-25T04:56:16.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f52a0a07700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c0b33e0 con 0x7f529c140100 2021-06-25T04:56:16.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f52a0a07700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0648a0 con 0x7f529c0a9bd0 2021-06-25T04:56:16.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f529ad9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f529c0b3000 0x7f529c065e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60138/0 (socket says 172.21.15.57:60138) 2021-06-25T04:56:16.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f529ad9d700 1 -- 172.21.15.57:0/1530731265 learned_addr learned my addr 172.21.15.57:0/1530731265 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:16.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f529a59c700 1 --2- 172.21.15.57:0/1530731265 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f529c0a9bd0 0x7f529c060780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:16.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f5299d9b700 1 -- 172.21.15.57:0/1530731265 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457204152 0 0) 0x7f529c066e60 con 0x7f529c0b3000 2021-06-25T04:56:16.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f5299d9b700 1 -- 172.21.15.57:0/1530731265 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f527c003260 con 0x7f529c0b3000 2021-06-25T04:56:16.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f5299d9b700 1 -- 172.21.15.57:0/1530731265 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913256864 0 0) 0x7f529c0b33e0 con 0x7f529c140100 2021-06-25T04:56:16.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f5299d9b700 1 -- 172.21.15.57:0/1530731265 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f529c066e60 con 0x7f529c140100 2021-06-25T04:56:16.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f529a59c700 1 -- 172.21.15.57:0/1530731265 >> v1:172.21.15.87:6789/0 conn(0x7f529c140100 legacy=0x7f529c140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:16.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f5299d9b700 1 -- 172.21.15.57:0/1530731265 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2399633468 0 0) 0x7f527c003260 con 0x7f529c0b3000 2021-06-25T04:56:16.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f529a59c700 1 -- 172.21.15.57:0/1530731265 >> v1:172.21.15.57:6789/0 conn(0x7f529c0b3000 legacy=0x7f529c065e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:16.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f529a59c700 1 -- 172.21.15.57:0/1530731265 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c066920 con 0x7f529c0a9bd0 2021-06-25T04:56:16.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f529a59c700 1 --2- 172.21.15.57:0/1530731265 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f529c0a9bd0 0x7f529c060780 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f528c001110 tx=0x7f5284006df0).ready entity=mon.2 client_cookie=bfb79f7461af8705 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:16.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f5299d9b700 1 -- 172.21.15.57:0/1530731265 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f528c001660 con 0x7f529c0a9bd0 2021-06-25T04:56:16.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f5299d9b700 1 -- 172.21.15.57:0/1530731265 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5284000e90 con 0x7f529c0a9bd0 2021-06-25T04:56:16.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f5299d9b700 1 -- 172.21.15.57:0/1530731265 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5284012460 con 0x7f529c0a9bd0 2021-06-25T04:56:16.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f52a0a07700 1 -- 172.21.15.57:0/1530731265 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f529c0a9bd0 msgr2=0x7f529c060780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:16.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f52a0a07700 1 --2- 172.21.15.57:0/1530731265 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f529c0a9bd0 0x7f529c060780 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f528c001110 tx=0x7f5284006df0).stop 2021-06-25T04:56:16.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f52a0a07700 1 -- 172.21.15.57:0/1530731265 shutdown_connections 2021-06-25T04:56:16.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f52a0a07700 1 --2- 172.21.15.57:0/1530731265 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f529c0a9bd0 0x7f529c060780 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:16.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f52a0a07700 1 -- 172.21.15.57:0/1530731265 >> 172.21.15.57:0/1530731265 conn(0x7f529c0636a0 msgr2=0x7f529c063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:16.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f52a0a07700 1 -- 172.21.15.57:0/1530731265 shutdown_connections 2021-06-25T04:56:16.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.831+0000 7f52a0a07700 1 -- 172.21.15.57:0/1530731265 wait complete. 2021-06-25T04:56:16.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f52a0a07700 1 Processor -- start 2021-06-25T04:56:16.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f52a0a07700 1 -- start start 2021-06-25T04:56:16.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f52a0a07700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f529c0a9bd0 0x7f529c13e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:16.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f52a0a07700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f529c0b3000 0x7f529c0aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:16.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f52a0a07700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f529c140100 0x7f529c13aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:16.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f52a0a07700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0afad0 con 0x7f529c0a9bd0 2021-06-25T04:56:16.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f52a0a07700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0ac330 con 0x7f529c0b3000 2021-06-25T04:56:16.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f52a0a07700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0ac590 con 0x7f529c140100 2021-06-25T04:56:16.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f529ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f529c0a9bd0 0x7f529c13e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:16.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f529ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f529c0a9bd0 0x7f529c13e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42926/0 (socket says 172.21.15.57:42926) 2021-06-25T04:56:16.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f529ad9d700 1 -- 172.21.15.57:0/1452092819 learned_addr learned my addr 172.21.15.57:0/1452092819 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:16.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f529b59e700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f529c140100 0x7f529c13aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:16.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f529a59c700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f529c0b3000 0x7f529c0aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:16.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f529ad9d700 1 -- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f529c140100 msgr2=0x7f529c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:16.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f529ad9d700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f529c140100 0x7f529c13aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:16.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f529ad9d700 1 -- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f529c0b3000 msgr2=0x7f529c0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:16.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f529ad9d700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f529c0b3000 0x7f529c0aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:16.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f529ad9d700 1 -- 172.21.15.57:0/1452092819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528400b180 con 0x7f529c0a9bd0 2021-06-25T04:56:16.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f529ad9d700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f529c0a9bd0 0x7f529c13e090 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f528c000fe0 tx=0x7f528c001970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:16.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f5293fff700 1 -- 172.21.15.57:0/1452092819 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f528c007170 con 0x7f529c0a9bd0 2021-06-25T04:56:16.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f5293fff700 1 -- 172.21.15.57:0/1452092819 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c0072d0 con 0x7f529c0a9bd0 2021-06-25T04:56:16.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f52a0a07700 1 -- 172.21.15.57:0/1452092819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c0ac830 con 0x7f529c0a9bd0 2021-06-25T04:56:16.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f5293fff700 1 -- 172.21.15.57:0/1452092819 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f528c004710 con 0x7f529c0a9bd0 2021-06-25T04:56:16.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.835+0000 7f52a0a07700 1 -- 172.21.15.57:0/1452092819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c0b0430 con 0x7f529c0a9bd0 2021-06-25T04:56:16.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.839+0000 7f52a0a07700 1 -- 172.21.15.57:0/1452092819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529c057310 con 0x7f529c0a9bd0 2021-06-25T04:56:16.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.839+0000 7f5293fff700 1 -- 172.21.15.57:0/1452092819 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f528c01b070 con 0x7f529c0a9bd0 2021-06-25T04:56:16.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.839+0000 7f5293fff700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5280055450 0x7f5280057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:16.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.839+0000 7f5293fff700 1 -- 172.21.15.57:0/1452092819 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f528c06d310 con 0x7f529c0a9bd0 2021-06-25T04:56:16.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.839+0000 7f529a59c700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5280055450 0x7f5280057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:16.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.839+0000 7f529a59c700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5280055450 0x7f5280057910 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f5284019000 tx=0x7f5284014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:16.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.847+0000 7f5293fff700 1 -- 172.21.15.57:0/1452092819 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f528c043700 con 0x7f529c0a9bd0 2021-06-25T04:56:16.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.971+0000 7f52a0a07700 1 -- 172.21.15.57:0/1452092819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f529c0accd0 con 0x7f529c0a9bd0 2021-06-25T04:56:16.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f5293fff700 1 -- 172.21.15.57:0/1452092819 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f528c046d20 con 0x7f529c0a9bd0 2021-06-25T04:56:16.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 -- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5280055450 msgr2=0x7f5280057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:16.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5280055450 0x7f5280057910 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f5284019000 tx=0x7f5284014000).stop 2021-06-25T04:56:16.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 -- 172.21.15.57:0/1452092819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f529c0a9bd0 msgr2=0x7f529c13e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:16.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f529c0a9bd0 0x7f529c13e090 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f528c000fe0 tx=0x7f528c001970).stop 2021-06-25T04:56:16.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 -- 172.21.15.57:0/1452092819 shutdown_connections 2021-06-25T04:56:16.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5280055450 0x7f5280057910 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:16.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f529c140100 0x7f529c13aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:16.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f529c0b3000 0x7f529c0aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:16.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 --2- 172.21.15.57:0/1452092819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f529c0a9bd0 0x7f529c13e090 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:16.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 -- 172.21.15.57:0/1452092819 >> 172.21.15.57:0/1452092819 conn(0x7f529c0636a0 msgr2=0x7f529c0b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:16.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 -- 172.21.15.57:0/1452092819 shutdown_connections 2021-06-25T04:56:16.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:16.983+0000 7f52a0a07700 1 -- 172.21.15.57:0/1452092819 wait complete. 2021-06-25T04:56:17.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-06-25T04:56:17.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d62daf700 1 Processor -- start 2021-06-25T04:56:17.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d62daf700 1 -- start start 2021-06-25T04:56:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d62daf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9d5c0b1d70 0x7f9d5c0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d62daf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9d5c148360 0x7f9d5c0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d62daf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c0b0310 con 0x7f9d5c0a7080 2021-06-25T04:56:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d62daf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c0a9080 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d62daf700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c0b05b0 con 0x7f9d5c148360 2021-06-25T04:56:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d60b4b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9d5c0b1d70 0x7f9d5c0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d5bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9d5c148360 0x7f9d5c0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d60b4b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9d5c0b1d70 0x7f9d5c0b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42936/0 (socket says 172.21.15.57:42936) 2021-06-25T04:56:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d60b4b700 1 -- 172.21.15.57:0/4223529800 learned_addr learned my addr 172.21.15.57:0/4223529800 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d60b4b700 1 -- 172.21.15.57:0/4223529800 >> v2:172.21.15.87:3300/0 conn(0x7f9d5c148360 msgr2=0x7f9d5c0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d60b4b700 1 --2- 172.21.15.57:0/4223529800 >> v2:172.21.15.87:3300/0 conn(0x7f9d5c148360 0x7f9d5c0b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d60b4b700 1 -- 172.21.15.57:0/4223529800 >> v1:172.21.15.87:6789/0 conn(0x7f9d5c0a7080 legacy=0x7f9d5c1446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d60b4b700 1 -- 172.21.15.57:0/4223529800 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c0b0850 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.103+0000 7f9d60b4b700 1 --2- 172.21.15.57:0/4223529800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c0b1d70 0x7f9d5c0b0f90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f9d5c1476f0 tx=0x7f9d50006eb0).ready entity=mon.0 client_cookie=8153657a0f0b1377 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d5b7fe700 1 -- 172.21.15.57:0/4223529800 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d5000d610 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d5b7fe700 1 -- 172.21.15.57:0/4223529800 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d50000e90 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d5b7fe700 1 -- 172.21.15.57:0/4223529800 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d5000d9a0 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 -- 172.21.15.57:0/4223529800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c0b1d70 msgr2=0x7f9d5c0b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 --2- 172.21.15.57:0/4223529800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c0b1d70 0x7f9d5c0b0f90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f9d5c1476f0 tx=0x7f9d50006eb0).stop 2021-06-25T04:56:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 -- 172.21.15.57:0/4223529800 shutdown_connections 2021-06-25T04:56:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 --2- 172.21.15.57:0/4223529800 >> v2:172.21.15.87:3300/0 conn(0x7f9d5c148360 0x7f9d5c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 --2- 172.21.15.57:0/4223529800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c0b1d70 0x7f9d5c0b0f90 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 -- 172.21.15.57:0/4223529800 >> 172.21.15.57:0/4223529800 conn(0x7f9d5c05f670 msgr2=0x7f9d5c05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 -- 172.21.15.57:0/4223529800 shutdown_connections 2021-06-25T04:56:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 -- 172.21.15.57:0/4223529800 wait complete. 2021-06-25T04:56:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 Processor -- start 2021-06-25T04:56:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 -- start start 2021-06-25T04:56:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5c0a7080 0x7f9d5c13e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c0b1d70 0x7f9d5c13ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d5c148360 0x7f9d5c0af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c1406a0 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c157720 con 0x7f9d5c0a7080 2021-06-25T04:56:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d62daf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c1579c0 con 0x7f9d5c148360 2021-06-25T04:56:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d5bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c0b1d70 0x7f9d5c13ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d5bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c0b1d70 0x7f9d5c13ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42944/0 (socket says 172.21.15.57:42944) 2021-06-25T04:56:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d5bfff700 1 -- 172.21.15.57:0/3613061835 learned_addr learned my addr 172.21.15.57:0/3613061835 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d60b4b700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5c0a7080 0x7f9d5c13e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.107+0000 7f9d6134c700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d5c148360 0x7f9d5c0af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d5bfff700 1 -- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d5c148360 msgr2=0x7f9d5c0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d5bfff700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d5c148360 0x7f9d5c0af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d5bfff700 1 -- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5c0a7080 msgr2=0x7f9d5c13e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d5bfff700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5c0a7080 0x7f9d5c13e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d5bfff700 1 -- 172.21.15.57:0/3613061835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5000b1e0 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d5bfff700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c0b1d70 0x7f9d5c13ede0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f9d4c00c000 tx=0x7f9d4c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d59ffb700 1 -- 172.21.15.57:0/3613061835 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d4c011750 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d59ffb700 1 -- 172.21.15.57:0/3613061835 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c0118b0 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d62daf700 1 -- 172.21.15.57:0/3613061835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c140320 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d59ffb700 1 -- 172.21.15.57:0/3613061835 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d4c011c10 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d62daf700 1 -- 172.21.15.57:0/3613061835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c13f630 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d62daf700 1 -- 172.21.15.57:0/3613061835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c057310 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d59ffb700 1 -- 172.21.15.57:0/3613061835 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9d4c011d70 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d59ffb700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9d3c0554e0 0x7f9d3c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d59ffb700 1 -- 172.21.15.57:0/3613061835 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f9d4c06df10 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.111+0000 7f9d60b4b700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9d3c0554e0 0x7f9d3c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.115+0000 7f9d60b4b700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9d3c0554e0 0x7f9d3c0579a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f9d5001b000 tx=0x7f9d50015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.119+0000 7f9d59ffb700 1 -- 172.21.15.57:0/3613061835 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9d4c0443a0 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.291+0000 7f9d62daf700 1 -- 172.21.15.57:0/3613061835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f9d5c147e20 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.707+0000 7f9d59ffb700 1 -- 172.21.15.57:0/3613061835 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v398) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9d4c0479c0 con 0x7f9d5c0b1d70 2021-06-25T04:56:17.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 -- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9d3c0554e0 msgr2=0x7f9d3c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:17.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9d3c0554e0 0x7f9d3c0579a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f9d5001b000 tx=0x7f9d50015000).stop 2021-06-25T04:56:17.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 -- 172.21.15.57:0/3613061835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c0b1d70 msgr2=0x7f9d5c13ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:17.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c0b1d70 0x7f9d5c13ede0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f9d4c00c000 tx=0x7f9d4c006df0).stop 2021-06-25T04:56:17.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 -- 172.21.15.57:0/3613061835 shutdown_connections 2021-06-25T04:56:17.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9d3c0554e0 0x7f9d3c0579a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d5c148360 0x7f9d5c0af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c0b1d70 0x7f9d5c13ede0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 --2- 172.21.15.57:0/3613061835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5c0a7080 0x7f9d5c13e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 -- 172.21.15.57:0/3613061835 >> 172.21.15.57:0/3613061835 conn(0x7f9d5c05f670 msgr2=0x7f9d5c0a7510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:17.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 -- 172.21.15.57:0/3613061835 shutdown_connections 2021-06-25T04:56:17.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.711+0000 7f9d62daf700 1 -- 172.21.15.57:0/3613061835 wait complete. 2021-06-25T04:56:17.730 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2021-06-25T04:56:17.730 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2021-06-25T04:56:17.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-06-25T04:56:17.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 Processor -- start 2021-06-25T04:56:17.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 -- start start 2021-06-25T04:56:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e180b1d70 0x7f4e180b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e18148360 0x7f4e180b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4e180a7080 0x7f4e181446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e180a9080 con 0x7f4e180b1d70 2021-06-25T04:56:17.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e180b0310 con 0x7f4e180a7080 2021-06-25T04:56:17.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e180b05b0 con 0x7f4e18148360 2021-06-25T04:56:17.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1dc5b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e180b1d70 0x7f4e180b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1dc5b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e180b1d70 0x7f4e180b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42948/0 (socket says 172.21.15.57:42948) 2021-06-25T04:56:17.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1dc5b700 1 -- 172.21.15.57:0/3589372066 learned_addr learned my addr 172.21.15.57:0/3589372066 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:17.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1d45a700 1 --2- 172.21.15.57:0/3589372066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e18148360 0x7f4e180b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1e45c700 1 --2- 172.21.15.57:0/3589372066 >> v2:172.21.15.87:3300/0 conn(0x7f4e180a7080 0x7f4e181446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1dc5b700 1 -- 172.21.15.57:0/3589372066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e18148360 msgr2=0x7f4e180b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:17.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1dc5b700 1 --2- 172.21.15.57:0/3589372066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e18148360 0x7f4e180b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1dc5b700 1 -- 172.21.15.57:0/3589372066 >> v2:172.21.15.87:3300/0 conn(0x7f4e180a7080 msgr2=0x7f4e181446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:17.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1dc5b700 1 --2- 172.21.15.57:0/3589372066 >> v2:172.21.15.87:3300/0 conn(0x7f4e180a7080 0x7f4e181446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1dc5b700 1 -- 172.21.15.57:0/3589372066 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e180b0850 con 0x7f4e180b1d70 2021-06-25T04:56:17.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1d45a700 1 --2- 172.21.15.57:0/3589372066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e18148360 0x7f4e180b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:17.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1dc5b700 1 --2- 172.21.15.57:0/3589372066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e180b1d70 0x7f4e180b0f90 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f4e00002f70 tx=0x7f4e00006eb0).ready entity=mon.0 client_cookie=8b16a31cca0515f3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:17.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1cc59700 1 -- 172.21.15.57:0/3589372066 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e0000d570 con 0x7f4e180b1d70 2021-06-25T04:56:17.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1cc59700 1 -- 172.21.15.57:0/3589372066 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e00000e90 con 0x7f4e180b1d70 2021-06-25T04:56:17.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1cc59700 1 -- 172.21.15.57:0/3589372066 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e0000d900 con 0x7f4e180b1d70 2021-06-25T04:56:17.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 -- 172.21.15.57:0/3589372066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e180b1d70 msgr2=0x7f4e180b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:17.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 --2- 172.21.15.57:0/3589372066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e180b1d70 0x7f4e180b0f90 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f4e00002f70 tx=0x7f4e00006eb0).stop 2021-06-25T04:56:17.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 -- 172.21.15.57:0/3589372066 shutdown_connections 2021-06-25T04:56:17.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 --2- 172.21.15.57:0/3589372066 >> v2:172.21.15.87:3300/0 conn(0x7f4e180a7080 0x7f4e181446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 --2- 172.21.15.57:0/3589372066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e18148360 0x7f4e180b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 --2- 172.21.15.57:0/3589372066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e180b1d70 0x7f4e180b0f90 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 -- 172.21.15.57:0/3589372066 >> 172.21.15.57:0/3589372066 conn(0x7f4e1805f670 msgr2=0x7f4e1805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:17.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 -- 172.21.15.57:0/3589372066 shutdown_connections 2021-06-25T04:56:17.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.839+0000 7f4e1febf700 1 -- 172.21.15.57:0/3589372066 wait complete. 2021-06-25T04:56:17.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1febf700 1 Processor -- start 2021-06-25T04:56:17.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1febf700 1 -- start start 2021-06-25T04:56:17.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1febf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180a7080 0x7f4e18156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1febf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e180b1d70 0x7f4e18067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1febf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e18148360 0x7f4e180adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1febf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e181481b0 con 0x7f4e18148360 2021-06-25T04:56:17.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1febf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1815aa20 con 0x7f4e180b1d70 2021-06-25T04:56:17.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1febf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1815a5f0 con 0x7f4e180a7080 2021-06-25T04:56:17.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1d45a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e180b1d70 0x7f4e18067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1d45a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e180b1d70 0x7f4e18067270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:51450/0 (socket says 172.21.15.57:51450) 2021-06-25T04:56:17.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1dc5b700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180a7080 0x7f4e18156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1d45a700 1 -- 172.21.15.57:0/3837103853 learned_addr learned my addr 172.21.15.57:0/3837103853 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:17.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1e45c700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e18148360 0x7f4e180adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1e45c700 1 -- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180a7080 msgr2=0x7f4e18156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:17.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1e45c700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180a7080 0x7f4e18156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1e45c700 1 -- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e180b1d70 msgr2=0x7f4e18067270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:17.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1e45c700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e180b1d70 0x7f4e18067270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:17.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1e45c700 1 -- 172.21.15.57:0/3837103853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0000b1e0 con 0x7f4e18148360 2021-06-25T04:56:17.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1d45a700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e180b1d70 0x7f4e18067270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:17.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.843+0000 7f4e1e45c700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e18148360 0x7f4e180adf90 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f4e1815ab60 tx=0x7f4e10008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:17.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.847+0000 7f4e16ffd700 1 -- 172.21.15.57:0/3837103853 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e10013670 con 0x7f4e18148360 2021-06-25T04:56:17.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.847+0000 7f4e16ffd700 1 -- 172.21.15.57:0/3837103853 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e100137d0 con 0x7f4e18148360 2021-06-25T04:56:17.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.847+0000 7f4e1febf700 1 -- 172.21.15.57:0/3837103853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e18156a60 con 0x7f4e18148360 2021-06-25T04:56:17.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.847+0000 7f4e16ffd700 1 -- 172.21.15.57:0/3837103853 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e10013b30 con 0x7f4e18148360 2021-06-25T04:56:17.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.847+0000 7f4e1febf700 1 -- 172.21.15.57:0/3837103853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e18064ce0 con 0x7f4e18148360 2021-06-25T04:56:17.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.847+0000 7f4e1febf700 1 -- 172.21.15.57:0/3837103853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1815a730 con 0x7f4e18148360 2021-06-25T04:56:17.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.847+0000 7f4e16ffd700 1 -- 172.21.15.57:0/3837103853 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4e1001a030 con 0x7f4e18148360 2021-06-25T04:56:17.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.847+0000 7f4e16ffd700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4dfc0553d0 0x7f4dfc057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:17.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.847+0000 7f4e16ffd700 1 -- 172.21.15.57:0/3837103853 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f4e1006db40 con 0x7f4e18148360 2021-06-25T04:56:17.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.851+0000 7f4e1dc5b700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4dfc0553d0 0x7f4dfc057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:17.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.851+0000 7f4e1dc5b700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4dfc0553d0 0x7f4dfc057890 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f4e0001b000 tx=0x7f4e00015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:17.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:17.859+0000 7f4e16ffd700 1 -- 172.21.15.57:0/3837103853 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4e10043e60 con 0x7f4e18148360 2021-06-25T04:56:18.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.027+0000 7f4e1febf700 1 -- 172.21.15.57:0/3837103853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f4e18156a60 con 0x7f4e18148360 2021-06-25T04:56:18.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.715+0000 7f4e16ffd700 1 -- 172.21.15.57:0/3837103853 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v399) v1 ==== 131+0+0 (secure 0 0 0) 0x7f4e18156a60 con 0x7f4e18148360 2021-06-25T04:56:18.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 -- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4dfc0553d0 msgr2=0x7f4dfc057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:18.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4dfc0553d0 0x7f4dfc057890 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f4e0001b000 tx=0x7f4e00015000).stop 2021-06-25T04:56:18.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 -- 172.21.15.57:0/3837103853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e18148360 msgr2=0x7f4e180adf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:18.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e18148360 0x7f4e180adf90 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f4e1815ab60 tx=0x7f4e10008040).stop 2021-06-25T04:56:18.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 -- 172.21.15.57:0/3837103853 shutdown_connections 2021-06-25T04:56:18.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4dfc0553d0 0x7f4dfc057890 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:18.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e18148360 0x7f4e180adf90 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:18.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e180b1d70 0x7f4e18067270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:18.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 --2- 172.21.15.57:0/3837103853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180a7080 0x7f4e18156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:18.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 -- 172.21.15.57:0/3837103853 >> 172.21.15.57:0/3837103853 conn(0x7f4e1805f670 msgr2=0x7f4e18146290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:18.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 -- 172.21.15.57:0/3837103853 shutdown_connections 2021-06-25T04:56:18.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.719+0000 7f4e1febf700 1 -- 172.21.15.57:0/3837103853 wait complete. 2021-06-25T04:56:18.742 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:56:18.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.851+0000 7fc7ab425700 1 Processor -- start 2021-06-25T04:56:18.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.851+0000 7fc7ab425700 1 -- start start 2021-06-25T04:56:18.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.851+0000 7fc7ab425700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc7a405fbc0 0x7fc7a40b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:18.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.851+0000 7fc7ab425700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a4143f20 con 0x7fc7a40b6520 2021-06-25T04:56:18.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7ab425700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a405ffa0 con 0x7fc7a40b5950 2021-06-25T04:56:18.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7ab425700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a40ba670 con 0x7fc7a405fbc0 2021-06-25T04:56:18.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7a91c1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc7a405fbc0 0x7fc7a40b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:18.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7a89c0700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc7a40b6520 0x7fc7a40b9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60182/0 (socket says 172.21.15.57:60182) 2021-06-25T04:56:18.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7a89c0700 1 -- 172.21.15.57:0/3219964912 learned_addr learned my addr 172.21.15.57:0/3219964912 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:18.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7a99c2700 1 --1- 172.21.15.57:0/3219964912 >> v1:172.21.15.87:6789/0 conn(0x7fc7a40b5950 0x7fc7a40b49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:60932/0 (socket says 172.21.15.57:60932) 2021-06-25T04:56:18.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc797fff700 1 -- 172.21.15.57:0/3219964912 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100910050 0 0) 0x7fc7a405ffa0 con 0x7fc7a40b5950 2021-06-25T04:56:18.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7a91c1700 1 -- 172.21.15.57:0/3219964912 >> v1:172.21.15.87:6789/0 conn(0x7fc7a40b5950 legacy=0x7fc7a40b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:18.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7a91c1700 1 -- 172.21.15.57:0/3219964912 >> v1:172.21.15.57:6789/0 conn(0x7fc7a40b6520 legacy=0x7fc7a40b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:18.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7a91c1700 1 -- 172.21.15.57:0/3219964912 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4143a10 con 0x7fc7a405fbc0 2021-06-25T04:56:18.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7a91c1700 1 --2- 172.21.15.57:0/3219964912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a405fbc0 0x7fc7a40b4170 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fc7a0001110 tx=0x7fc798006df0).ready entity=mon.0 client_cookie=5a1fc6cacfeabab9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:18.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc797fff700 1 -- 172.21.15.57:0/3219964912 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79800d5c0 con 0x7fc7a405fbc0 2021-06-25T04:56:18.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc797fff700 1 -- 172.21.15.57:0/3219964912 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc798000e90 con 0x7fc7a405fbc0 2021-06-25T04:56:18.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc797fff700 1 -- 172.21.15.57:0/3219964912 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79800d910 con 0x7fc7a405fbc0 2021-06-25T04:56:18.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7ab425700 1 -- 172.21.15.57:0/3219964912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a405fbc0 msgr2=0x7fc7a40b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:18.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7ab425700 1 --2- 172.21.15.57:0/3219964912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a405fbc0 0x7fc7a40b4170 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fc7a0001110 tx=0x7fc798006df0).stop 2021-06-25T04:56:18.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7ab425700 1 -- 172.21.15.57:0/3219964912 shutdown_connections 2021-06-25T04:56:18.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7ab425700 1 --2- 172.21.15.57:0/3219964912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a405fbc0 0x7fc7a40b4170 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:18.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7ab425700 1 -- 172.21.15.57:0/3219964912 >> 172.21.15.57:0/3219964912 conn(0x7fc7a4062360 msgr2=0x7fc7a4066da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:18.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7ab425700 1 -- 172.21.15.57:0/3219964912 shutdown_connections 2021-06-25T04:56:18.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.855+0000 7fc7ab425700 1 -- 172.21.15.57:0/3219964912 wait complete. 2021-06-25T04:56:18.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.859+0000 7fc7ab425700 1 Processor -- start 2021-06-25T04:56:18.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.859+0000 7fc7ab425700 1 -- start start 2021-06-25T04:56:18.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.859+0000 7fc7ab425700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7a405fbc0 0x7fc7a40aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:18.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.859+0000 7fc7ab425700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7a40b5950 0x7fc7a4155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:18.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.859+0000 7fc7ab425700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a40b6520 0x7fc7a41459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:18.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.859+0000 7fc7ab425700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a413de60 con 0x7fc7a40b6520 2021-06-25T04:56:18.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.859+0000 7fc7ab425700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a413e100 con 0x7fc7a40b5950 2021-06-25T04:56:18.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.859+0000 7fc7ab425700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a413e3a0 con 0x7fc7a405fbc0 2021-06-25T04:56:18.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.859+0000 7fc7a99c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a40b6520 0x7fc7a41459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:18.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.859+0000 7fc7a99c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a40b6520 0x7fc7a41459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42972/0 (socket says 172.21.15.57:42972) 2021-06-25T04:56:18.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.859+0000 7fc7a99c2700 1 -- 172.21.15.57:0/3267709573 learned_addr learned my addr 172.21.15.57:0/3267709573 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:18.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7a89c0700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7a40b5950 0x7fc7a4155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7a91c1700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7a405fbc0 0x7fc7a40aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7a99c2700 1 -- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7a405fbc0 msgr2=0x7fc7a40aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7a99c2700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7a405fbc0 0x7fc7a40aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:18.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7a99c2700 1 -- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7a40b5950 msgr2=0x7fc7a4155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7a99c2700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7a40b5950 0x7fc7a4155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7a99c2700 1 -- 172.21.15.57:0/3267709573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79800b180 con 0x7fc7a40b6520 2021-06-25T04:56:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7a89c0700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7a40b5950 0x7fc7a4155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7a99c2700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a40b6520 0x7fc7a41459b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fc79c000f40 tx=0x7fc79c007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc796ffd700 1 -- 172.21.15.57:0/3267709573 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79c005ae0 con 0x7fc7a40b6520 2021-06-25T04:56:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc796ffd700 1 -- 172.21.15.57:0/3267709573 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c005c40 con 0x7fc7a40b6520 2021-06-25T04:56:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7ab425700 1 -- 172.21.15.57:0/3267709573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a40ad680 con 0x7fc7a40b6520 2021-06-25T04:56:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc796ffd700 1 -- 172.21.15.57:0/3267709573 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79c0070d0 con 0x7fc7a40b6520 2021-06-25T04:56:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7ab425700 1 -- 172.21.15.57:0/3267709573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a413d8e0 con 0x7fc7a40b6520 2021-06-25T04:56:18.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.863+0000 7fc7ab425700 1 -- 172.21.15.57:0/3267709573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a40ad810 con 0x7fc7a40b6520 2021-06-25T04:56:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.867+0000 7fc796ffd700 1 -- 172.21.15.57:0/3267709573 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc79c010070 con 0x7fc7a40b6520 2021-06-25T04:56:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.867+0000 7fc796ffd700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc780055340 0x7fc780057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.867+0000 7fc796ffd700 1 -- 172.21.15.57:0/3267709573 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc79c06d5a0 con 0x7fc7a40b6520 2021-06-25T04:56:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.867+0000 7fc7a91c1700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc780055340 0x7fc780057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:18.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.867+0000 7fc7a91c1700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc780055340 0x7fc780057800 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fc798019000 tx=0x7fc798014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:18.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.875+0000 7fc796ffd700 1 -- 172.21.15.57:0/3267709573 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc79c043ae0 con 0x7fc7a40b6520 2021-06-25T04:56:19.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:18.999+0000 7fc7ab425700 1 -- 172.21.15.57:0/3267709573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc7a4057310 con 0x7fc7a40b6520 2021-06-25T04:56:19.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.007+0000 7fc796ffd700 1 -- 172.21.15.57:0/3267709573 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc79c047100 con 0x7fc7a40b6520 2021-06-25T04:56:19.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 -- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc780055340 msgr2=0x7fc780057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc780055340 0x7fc780057800 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fc798019000 tx=0x7fc798014000).stop 2021-06-25T04:56:19.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 -- 172.21.15.57:0/3267709573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a40b6520 msgr2=0x7fc7a41459b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a40b6520 0x7fc7a41459b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fc79c000f40 tx=0x7fc79c007d60).stop 2021-06-25T04:56:19.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 -- 172.21.15.57:0/3267709573 shutdown_connections 2021-06-25T04:56:19.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc780055340 0x7fc780057800 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a40b6520 0x7fc7a41459b0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7a40b5950 0x7fc7a4155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 --2- 172.21.15.57:0/3267709573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7a405fbc0 0x7fc7a40aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 -- 172.21.15.57:0/3267709573 >> 172.21.15.57:0/3267709573 conn(0x7fc7a4062360 msgr2=0x7fc7a405bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 -- 172.21.15.57:0/3267709573 shutdown_connections 2021-06-25T04:56:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.011+0000 7fc7ab425700 1 -- 172.21.15.57:0/3267709573 wait complete. 2021-06-25T04:56:19.031 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:56:19.032 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:19.057 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:19.079 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:19.103 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:19.131 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:56:19.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:19.132 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:19.136 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:19.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:56:19.153 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:56:19.154 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:56:19.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:19.155 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:19.155 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:19.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:56:19.183 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:56:19.183 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:56:19.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:56:19.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.287+0000 7f8e1f9f1700 1 Processor -- start 2021-06-25T04:56:19.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 -- start start 2021-06-25T04:56:19.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e180a7670 0x7f8e18066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:19.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8e180b0020 0x7f8e1805fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:19.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e180a7a50 con 0x7f8e180b1930 2021-06-25T04:56:19.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e181475e0 con 0x7f8e180a7670 2021-06-25T04:56:19.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e18147880 con 0x7f8e180b0020 2021-06-25T04:56:19.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1d78d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e180a7670 0x7f8e18066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:19.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1d78d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e180a7670 0x7f8e18066a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42978/0 (socket says 172.21.15.57:42978) 2021-06-25T04:56:19.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1d78d700 1 -- 172.21.15.57:0/2699842085 learned_addr learned my addr 172.21.15.57:0/2699842085 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:19.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1df8e700 1 --2- 172.21.15.57:0/2699842085 >> v2:172.21.15.87:3300/0 conn(0x7f8e180b0020 0x7f8e1805fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:19.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e0bfff700 1 -- 172.21.15.57:0/2699842085 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420340200 0 0) 0x7f8e180a7a50 con 0x7f8e180b1930 2021-06-25T04:56:19.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e0bfff700 1 -- 172.21.15.57:0/2699842085 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dfc003260 con 0x7f8e180b1930 2021-06-25T04:56:19.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1d78d700 1 -- 172.21.15.57:0/2699842085 >> v2:172.21.15.87:3300/0 conn(0x7f8e180b0020 msgr2=0x7f8e1805fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:19.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1d78d700 1 --2- 172.21.15.57:0/2699842085 >> v2:172.21.15.87:3300/0 conn(0x7f8e180b0020 0x7f8e1805fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1d78d700 1 -- 172.21.15.57:0/2699842085 >> v1:172.21.15.87:6789/0 conn(0x7f8e180b1930 legacy=0x7f8e1805f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1d78d700 1 -- 172.21.15.57:0/2699842085 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e18147b20 con 0x7f8e180a7670 2021-06-25T04:56:19.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1d78d700 1 --2- 172.21.15.57:0/2699842085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e180a7670 0x7f8e18066a30 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f8e0c002f70 tx=0x7f8e0c006eb0).ready entity=mon.0 client_cookie=8e3d91369f1d3ab3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:19.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e0bfff700 1 -- 172.21.15.57:0/2699842085 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e0c00d610 con 0x7f8e180a7670 2021-06-25T04:56:19.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e0bfff700 1 -- 172.21.15.57:0/2699842085 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c000e90 con 0x7f8e180a7670 2021-06-25T04:56:19.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e0bfff700 1 -- 172.21.15.57:0/2699842085 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e0c00d9a0 con 0x7f8e180a7670 2021-06-25T04:56:19.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/2699842085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e180a7670 msgr2=0x7f8e18066a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 --2- 172.21.15.57:0/2699842085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e180a7670 0x7f8e18066a30 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f8e0c002f70 tx=0x7f8e0c006eb0).stop 2021-06-25T04:56:19.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/2699842085 shutdown_connections 2021-06-25T04:56:19.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 --2- 172.21.15.57:0/2699842085 >> v2:172.21.15.87:3300/0 conn(0x7f8e180b0020 0x7f8e1805fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 --2- 172.21.15.57:0/2699842085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e180a7670 0x7f8e18066a30 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.291+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/2699842085 >> 172.21.15.57:0/2699842085 conn(0x7f8e180b53a0 msgr2=0x7f8e180b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:19.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.295+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/2699842085 shutdown_connections 2021-06-25T04:56:19.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.295+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/2699842085 wait complete. 2021-06-25T04:56:19.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.295+0000 7f8e1f9f1700 1 Processor -- start 2021-06-25T04:56:19.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.295+0000 7f8e1f9f1700 1 -- start start 2021-06-25T04:56:19.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1f9f1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e180a7670 0x7f8e180abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1f9f1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e180b0020 0x7f8e180aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1f9f1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e180b1930 0x7f8e180ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1f9f1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1814e500 con 0x7f8e180b0020 2021-06-25T04:56:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1f9f1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1814d390 con 0x7f8e180b1930 2021-06-25T04:56:19.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1f9f1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1814d5c0 con 0x7f8e180a7670 2021-06-25T04:56:19.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1cf8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e180b0020 0x7f8e180aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:19.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1cf8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e180b0020 0x7f8e180aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42984/0 (socket says 172.21.15.57:42984) 2021-06-25T04:56:19.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1cf8c700 1 -- 172.21.15.57:0/382371180 learned_addr learned my addr 172.21.15.57:0/382371180 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:19.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1d78d700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e180a7670 0x7f8e180abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1df8e700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e180b1930 0x7f8e180ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1cf8c700 1 -- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e180a7670 msgr2=0x7f8e180abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1cf8c700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e180a7670 0x7f8e180abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1cf8c700 1 -- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e180b1930 msgr2=0x7f8e180ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1cf8c700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e180b1930 0x7f8e180ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1cf8c700 1 -- 172.21.15.57:0/382371180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c00b1e0 con 0x7f8e180b0020 2021-06-25T04:56:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1cf8c700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e180b0020 0x7f8e180aca20 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f8e180ae260 tx=0x7f8e14007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e0a7fc700 1 -- 172.21.15.57:0/382371180 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e1400cd70 con 0x7f8e180b0020 2021-06-25T04:56:19.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e0a7fc700 1 -- 172.21.15.57:0/382371180 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e14012400 con 0x7f8e180b0020 2021-06-25T04:56:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/382371180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1814d860 con 0x7f8e180b0020 2021-06-25T04:56:19.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e0a7fc700 1 -- 172.21.15.57:0/382371180 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e14012760 con 0x7f8e180b0020 2021-06-25T04:56:19.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/382371180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e180ac580 con 0x7f8e180b0020 2021-06-25T04:56:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.299+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/382371180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e180ac740 con 0x7f8e180b0020 2021-06-25T04:56:19.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.303+0000 7f8e0a7fc700 1 -- 172.21.15.57:0/382371180 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8e14019030 con 0x7f8e180b0020 2021-06-25T04:56:19.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.303+0000 7f8e0a7fc700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e00055450 0x7f8e00057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:19.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.303+0000 7f8e0a7fc700 1 -- 172.21.15.57:0/382371180 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f8e1406cec0 con 0x7f8e180b0020 2021-06-25T04:56:19.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.303+0000 7f8e1d78d700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e00055450 0x7f8e00057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:19.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.303+0000 7f8e1d78d700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e00055450 0x7f8e00057910 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f8e0c01b000 tx=0x7f8e0c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:19.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.307+0000 7f8e0a7fc700 1 -- 172.21.15.57:0/382371180 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8e140432f0 con 0x7f8e180b0020 2021-06-25T04:56:19.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.435+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/382371180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8e18057310 con 0x7f8e180b0020 2021-06-25T04:56:19.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e0a7fc700 1 -- 172.21.15.57:0/382371180 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v133) v1 ==== 81+0+29227 (secure 0 0 0) 0x7f8e14069e60 con 0x7f8e180b0020 2021-06-25T04:56:19.444 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:19.445 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:56:19.445 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 133, 2021-06-25T04:56:19.445 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:56:19.445 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:56:19.446 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:56:16.687607+0000", 2021-06-25T04:56:19.446 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:56:19.446 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:56:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:56:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:56:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:56:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:56:19.448 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:56:19.448 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:56:19.448 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:56:19.449 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:19.449 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:56:19.449 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:56:19.449 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:56:19.450 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:56:19.450 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:56:19.450 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 24, 2021-06-25T04:56:19.450 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:56:19.451 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:56:19.451 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:56:19.452 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:56:19.452 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:56:19.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.453 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:56:19.453 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:56:19.454 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:56:19.454 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:56:19.454 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:56:19.455 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:19.455 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:19.455 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:19.455 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:19.456 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:19.456 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:19.456 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:56:19.456 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:56:19.457 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:56:19.457 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:56:19.457 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:56:19.457 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:19.458 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:19.458 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:19.458 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:19.459 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:19.459 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:19.460 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:19.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.460 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:56:19.460 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:19.461 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:19.461 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:19.461 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:19.461 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:19.461 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:19.462 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:19.462 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:19.462 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:19.462 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:19.463 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:19.463 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:19.463 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:19.463 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:19.464 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:19.464 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:19.464 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:19.464 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:19.464 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:19.465 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:19.465 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:19.465 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:19.465 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:19.465 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:19.466 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:19.466 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:19.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.466 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:19.467 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:19.467 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:19.467 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:19.467 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:19.468 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:19.468 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:19.468 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:19.468 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:19.468 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:19.469 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:19.469 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:56:19.469 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:56:19.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.470 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:19.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:56:19.470 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.471 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:56:19.471 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:56:19.471 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:56:19.472 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:56:19.472 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:56:19.472 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:19.472 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:19.473 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:19.473 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:19.473 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:19.473 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:19.473 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:56:19.474 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:56:19.474 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:56:19.474 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:56:19.474 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:56:19.475 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:19.475 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:19.475 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:19.475 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:19.476 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:19.476 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:19.476 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:19.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.476 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:56:19.477 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:19.477 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:19.477 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:19.477 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:19.477 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:19.478 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:19.478 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:19.478 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:19.478 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:19.479 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:19.479 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:19.479 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:19.479 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:19.480 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:19.480 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:19.480 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:19.480 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:19.480 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:19.481 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:19.481 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:19.481 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:19.481 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:19.482 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:19.482 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:19.482 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:19.482 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:19.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.483 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:19.483 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:19.483 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:19.483 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:19.484 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:19.484 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:19.484 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:19.484 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:19.485 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:19.485 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:19.485 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:19.485 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:56:19.485 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:19.486 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:56:19.486 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.486 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.486 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:19.486 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:56:19.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.487 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:56:19.487 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:56:19.487 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:19.488 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:19.488 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:19.488 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:19.488 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:19.489 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:19.489 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:19.489 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:19.489 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:19.490 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:19.490 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:19.490 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.491 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.491 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:56:19.491 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:19.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.492 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.492 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:56:19.492 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:19.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.493 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.493 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:19.493 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.494 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.494 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:56:19.494 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:19.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.495 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.495 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:56:19.495 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:19.496 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.496 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.496 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:19.497 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.497 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.497 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:56:19.497 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:19.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.498 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.498 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:56:19.498 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:19.499 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.499 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.499 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:19.500 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.500 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.500 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:56:19.501 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:19.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.501 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.501 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:56:19.502 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:19.502 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.502 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.503 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:56:19.503 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:56:19.503 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:56:19.503 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:56:19.503 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:56:19.505 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:56:19.505 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:19.505 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:19.506 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:19.506 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:19.506 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:19.506 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:19.507 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:19.507 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:19.507 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:19.507 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:19.508 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:19.508 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.508 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.508 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:56:19.509 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:19.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.509 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.509 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:56:19.510 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:19.510 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.510 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.511 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:19.511 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.512 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.512 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:56:19.512 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:19.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.513 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.513 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:56:19.514 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:19.514 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.514 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.515 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:19.515 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.515 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.516 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:56:19.516 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:19.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.516 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.517 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:56:19.517 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:19.517 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.517 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.518 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:19.518 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.518 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.519 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:56:19.519 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:19.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.519 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.520 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:56:19.520 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:19.520 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.520 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.521 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:56:19.521 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:56:19.521 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:56:19.522 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:56:19.522 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:19.522 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:19.522 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:19.523 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.523 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:56:19.524 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:56:19.524 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:19.524 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:19.525 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:19.525 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:19.525 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:19.525 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:19.525 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:19.526 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 123, 2021-06-25T04:56:19.526 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:19.526 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:19.526 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:19.527 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.527 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.527 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:56:19.528 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:19.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.528 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.529 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:56:19.529 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:19.529 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.530 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.530 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:19.531 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.531 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.531 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:56:19.532 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:19.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.533 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.533 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:56:19.533 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:19.533 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.534 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.536 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:19.536 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.536 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.537 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:56:19.537 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:19.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.538 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.538 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:56:19.538 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:19.539 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.539 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.539 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:19.539 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.540 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.540 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:56:19.540 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:19.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.541 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.541 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:56:19.542 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:19.542 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.542 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.543 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:56:19.543 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:56:19.543 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:56:19.544 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:56:19.544 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:19.544 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:19.544 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:19.545 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.545 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:56:19.545 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:56:19.546 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:19.546 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:19.546 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:19.547 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:19.547 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:19.547 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:19.548 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:19.548 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 129, 2021-06-25T04:56:19.548 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:19.549 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:19.549 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:19.549 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.550 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.550 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:56:19.551 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:19.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.552 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.552 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:56:19.552 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:19.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.553 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.553 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:19.554 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.554 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.554 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:56:19.554 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:19.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.555 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.555 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:56:19.556 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:19.556 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.556 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.556 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:19.557 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.557 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.557 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:56:19.558 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:19.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.558 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.559 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:56:19.559 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:19.559 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.559 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.560 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:19.560 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.560 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.561 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:56:19.561 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:19.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.562 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.562 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:56:19.562 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:19.562 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.562 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.563 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:56:19.563 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:56:19.563 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:56:19.564 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:56:19.564 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:19.564 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:19.564 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:19.564 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.565 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:56:19.565 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:56:19.565 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:19.566 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:19.566 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:19.566 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:19.566 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:19.567 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:19.567 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:19.567 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 123, 2021-06-25T04:56:19.567 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:19.568 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:19.568 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:19.568 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.569 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.569 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:56:19.569 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:19.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.571 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.571 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:56:19.571 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:19.571 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.572 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.573 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:19.573 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.574 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.574 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:56:19.574 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:19.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.575 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.575 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:56:19.575 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:19.575 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.576 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.576 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:19.576 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.577 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.577 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:56:19.577 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:19.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.578 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:56:19.579 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:19.579 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.579 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.580 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:19.580 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.580 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.580 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:56:19.581 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:19.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.581 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.582 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:56:19.582 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:19.582 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.582 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.583 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:56:19.583 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:56:19.583 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:56:19.583 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:56:19.584 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:19.584 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:19.584 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:19.584 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.585 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:56:19.585 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:56:19.585 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:19.586 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:19.586 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:19.586 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:19.586 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:19.586 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:19.587 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:19.587 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:19.587 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:19.587 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:19.587 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:19.588 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.588 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.588 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:56:19.589 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:19.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.589 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.590 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:56:19.590 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:19.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.590 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.591 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:19.591 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.591 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.592 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:56:19.592 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:19.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.593 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.593 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:56:19.593 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:19.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.594 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.594 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:19.594 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.595 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.595 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:56:19.596 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:19.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.596 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.596 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:56:19.597 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:19.597 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.597 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.598 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:19.598 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.598 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.598 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:56:19.599 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:19.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.599 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.599 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:56:19.600 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:19.600 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.600 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.601 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:56:19.601 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:56:19.601 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:56:19.601 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:56:19.601 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:19.602 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:19.602 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:19.602 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.603 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:56:19.603 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:56:19.603 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:19.603 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:19.604 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:19.604 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:19.604 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:19.604 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:19.604 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:19.605 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:19.605 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:19.605 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:19.605 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:19.606 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.606 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.606 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:56:19.606 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:19.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.607 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.607 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:56:19.608 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:19.608 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.608 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.609 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:19.609 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.609 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.609 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:56:19.610 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:19.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.610 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.611 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:56:19.611 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:19.611 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.611 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.612 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:19.612 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.613 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.613 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:56:19.613 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:19.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.614 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.614 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:56:19.614 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:19.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.615 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:19.615 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.616 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.616 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:56:19.616 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:19.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.617 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.617 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:56:19.617 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:19.617 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.618 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.618 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:56:19.618 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:56:19.618 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:56:19.619 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:56:19.619 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:19.619 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:19.619 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:56:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:56:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:56:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:56:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:56:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:56:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:56:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:56:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:56:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:56:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:56:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:56:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:56:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:56:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:56:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:56:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:56:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:56:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:56:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:56:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:56:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:56:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:56:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:56:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:56:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:56:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:56:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:56:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:56:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:56:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:56:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:56:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:56:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:56:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:56:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:56:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6835/863055178": "2021-06-26T04:55:56.865606+0000", 2021-06-25T04:56:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6834/863055178": "2021-06-26T04:55:56.865606+0000" 2021-06-25T04:56:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:56:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:56:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:56:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:56:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:56:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:56:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:56:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:56:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:56:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:56:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:56:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:56:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:56:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:56:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:56:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:56:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:56:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:56:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:56:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:56:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:56:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:56:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:56:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:56:19.665 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:56:19.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e00055450 msgr2=0x7f8e00057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e00055450 0x7f8e00057910 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f8e0c01b000 tx=0x7f8e0c015000).stop 2021-06-25T04:56:19.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/382371180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e180b0020 msgr2=0x7f8e180aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e180b0020 0x7f8e180aca20 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f8e180ae260 tx=0x7f8e14007a30).stop 2021-06-25T04:56:19.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/382371180 shutdown_connections 2021-06-25T04:56:19.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8e00055450 0x7f8e00057910 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e180b1930 0x7f8e180ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e180b0020 0x7f8e180aca20 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 --2- 172.21.15.57:0/382371180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e180a7670 0x7f8e180abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/382371180 >> 172.21.15.57:0/382371180 conn(0x7f8e180b53a0 msgr2=0x7f8e181458d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:19.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/382371180 shutdown_connections 2021-06-25T04:56:19.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.439+0000 7f8e1f9f1700 1 -- 172.21.15.57:0/382371180 wait complete. 2021-06-25T04:56:19.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:19.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.779+0000 7f18b1c5d700 1 Processor -- start 2021-06-25T04:56:19.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.779+0000 7f18b1c5d700 1 -- start start 2021-06-25T04:56:19.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18b1c5d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f18ac061850 0x7f18ac0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:19.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18b1c5d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac061c30 con 0x7f18ac12b830 2021-06-25T04:56:19.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18b1c5d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac12bec0 con 0x7f18ac0b6eb0 2021-06-25T04:56:19.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18b1c5d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac0b2c70 con 0x7f18ac061850 2021-06-25T04:56:19.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18abfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f18ac12b830 0x7f18ac1466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60212/0 (socket says 172.21.15.57:60212) 2021-06-25T04:56:19.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18abfff700 1 -- 172.21.15.57:0/914548922 learned_addr learned my addr 172.21.15.57:0/914548922 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:19.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18ab7fe700 1 --2- 172.21.15.57:0/914548922 >> v2:172.21.15.87:3300/0 conn(0x7f18ac061850 0x7f18ac0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:19.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18aa7fc700 1 -- 172.21.15.57:0/914548922 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733732402 0 0) 0x7f18ac061c30 con 0x7f18ac12b830 2021-06-25T04:56:19.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18aa7fc700 1 -- 172.21.15.57:0/914548922 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f188c003260 con 0x7f18ac12b830 2021-06-25T04:56:19.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18ab7fe700 1 -- 172.21.15.57:0/914548922 >> v1:172.21.15.87:6789/0 conn(0x7f18ac0b6eb0 legacy=0x7f18ac12b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18ab7fe700 1 -- 172.21.15.57:0/914548922 >> v1:172.21.15.57:6789/0 conn(0x7f18ac12b830 legacy=0x7f18ac1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18ab7fe700 1 -- 172.21.15.57:0/914548922 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac12c160 con 0x7f18ac061850 2021-06-25T04:56:19.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18ab7fe700 1 --2- 172.21.15.57:0/914548922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18ac061850 0x7f18ac0b4130 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f189c002f70 tx=0x7f189c006df0).ready entity=mon.1 client_cookie=612cc5aa0018cd10 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:19.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18aa7fc700 1 -- 172.21.15.57:0/914548922 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f189c00d610 con 0x7f18ac061850 2021-06-25T04:56:19.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18aa7fc700 1 -- 172.21.15.57:0/914548922 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c000e90 con 0x7f18ac061850 2021-06-25T04:56:19.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18aa7fc700 1 -- 172.21.15.57:0/914548922 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f189c00d960 con 0x7f18ac061850 2021-06-25T04:56:19.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18b1c5d700 1 -- 172.21.15.57:0/914548922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18ac061850 msgr2=0x7f18ac0b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18b1c5d700 1 --2- 172.21.15.57:0/914548922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18ac061850 0x7f18ac0b4130 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f189c002f70 tx=0x7f189c006df0).stop 2021-06-25T04:56:19.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18b1c5d700 1 -- 172.21.15.57:0/914548922 shutdown_connections 2021-06-25T04:56:19.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18b1c5d700 1 --2- 172.21.15.57:0/914548922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18ac061850 0x7f18ac0b4130 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18b1c5d700 1 -- 172.21.15.57:0/914548922 >> 172.21.15.57:0/914548922 conn(0x7f18ac066da0 msgr2=0x7f18ac0671b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:19.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18b1c5d700 1 -- 172.21.15.57:0/914548922 shutdown_connections 2021-06-25T04:56:19.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.783+0000 7f18b1c5d700 1 -- 172.21.15.57:0/914548922 wait complete. 2021-06-25T04:56:19.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.787+0000 7f18b1c5d700 1 Processor -- start 2021-06-25T04:56:19.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.787+0000 7f18b1c5d700 1 -- start start 2021-06-25T04:56:19.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.787+0000 7f18b1c5d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18ac061850 0x7f18ac0aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:19.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.787+0000 7f18b1c5d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18ac0b6eb0 0x7f18ac0b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:19.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.787+0000 7f18b1c5d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ac12b830 0x7f18ac0b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:19.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.787+0000 7f18b1c5d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac1440d0 con 0x7f18ac12b830 2021-06-25T04:56:19.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.787+0000 7f18b1c5d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac0b9920 con 0x7f18ac0b6eb0 2021-06-25T04:56:19.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.787+0000 7f18b1c5d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac0b9680 con 0x7f18ac061850 2021-06-25T04:56:19.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18ab7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18ac061850 0x7f18ac0aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:19.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ac12b830 0x7f18ac0b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:19.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18aaffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18ac0b6eb0 0x7f18ac0b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:19.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18aaffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18ac0b6eb0 0x7f18ac0b9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:51492/0 (socket says 172.21.15.57:51492) 2021-06-25T04:56:19.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18aaffd700 1 -- 172.21.15.57:0/2775527712 learned_addr learned my addr 172.21.15.57:0/2775527712 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:19.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18abfff700 1 -- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18ac061850 msgr2=0x7f18ac0aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18abfff700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18ac061850 0x7f18ac0aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18abfff700 1 -- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18ac0b6eb0 msgr2=0x7f18ac0b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18abfff700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18ac0b6eb0 0x7f18ac0b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18abfff700 1 -- 172.21.15.57:0/2775527712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c00b180 con 0x7f18ac12b830 2021-06-25T04:56:19.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18abfff700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ac12b830 0x7f18ac0b8150 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f18a4001490 tx=0x7f18a4007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:19.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18a8ff9700 1 -- 172.21.15.57:0/2775527712 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18a400ce20 con 0x7f18ac12b830 2021-06-25T04:56:19.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18a8ff9700 1 -- 172.21.15.57:0/2775527712 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4005ba0 con 0x7f18ac12b830 2021-06-25T04:56:19.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18b1c5d700 1 -- 172.21.15.57:0/2775527712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac0b93e0 con 0x7f18ac12b830 2021-06-25T04:56:19.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18a8ff9700 1 -- 172.21.15.57:0/2775527712 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18a40070d0 con 0x7f18ac12b830 2021-06-25T04:56:19.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18b1c5d700 1 -- 172.21.15.57:0/2775527712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac156340 con 0x7f18ac12b830 2021-06-25T04:56:19.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.791+0000 7f18b1c5d700 1 -- 172.21.15.57:0/2775527712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ac0b9a70 con 0x7f18ac12b830 2021-06-25T04:56:19.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.795+0000 7f18a8ff9700 1 -- 172.21.15.57:0/2775527712 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f18a4010070 con 0x7f18ac12b830 2021-06-25T04:56:19.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.795+0000 7f18a8ff9700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18900553d0 0x7f1890057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:19.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.795+0000 7f18a8ff9700 1 -- 172.21.15.57:0/2775527712 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f18a406d410 con 0x7f18ac12b830 2021-06-25T04:56:19.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.795+0000 7f18ab7fe700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18900553d0 0x7f1890057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:19.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.795+0000 7f18ab7fe700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18900553d0 0x7f1890057890 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f189c019000 tx=0x7f189c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:19.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.799+0000 7f18a8ff9700 1 -- 172.21.15.57:0/2775527712 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f18ac0b9a70 con 0x7f18ac12b830 2021-06-25T04:56:19.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.967+0000 7f18b1c5d700 1 -- 172.21.15.57:0/2775527712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18ac0b9a70 con 0x7f18ac12b830 2021-06-25T04:56:19.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.967+0000 7f18a8ff9700 1 -- 172.21.15.57:0/2775527712 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+504 (secure 0 0 0) 0x7f18ac0b9a70 con 0x7f18ac12b830 2021-06-25T04:56:19.973 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:19.974 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":66,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-06-25T04:56:19.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 -- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18900553d0 msgr2=0x7f1890057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18900553d0 0x7f1890057890 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f189c019000 tx=0x7f189c014000).stop 2021-06-25T04:56:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 -- 172.21.15.57:0/2775527712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ac12b830 msgr2=0x7f18ac0b8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:19.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ac12b830 0x7f18ac0b8150 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f18a4001490 tx=0x7f18a4007d00).stop 2021-06-25T04:56:19.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 -- 172.21.15.57:0/2775527712 shutdown_connections 2021-06-25T04:56:19.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f18900553d0 0x7f1890057890 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ac12b830 0x7f18ac0b8150 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18ac0b6eb0 0x7f18ac0b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 --2- 172.21.15.57:0/2775527712 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18ac061850 0x7f18ac0aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:19.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 -- 172.21.15.57:0/2775527712 >> 172.21.15.57:0/2775527712 conn(0x7f18ac066da0 msgr2=0x7f18ac128d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:19.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 -- 172.21.15.57:0/2775527712 shutdown_connections 2021-06-25T04:56:19.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:19.971+0000 7f18b1c5d700 1 -- 172.21.15.57:0/2775527712 wait complete. 2021-06-25T04:56:19.980 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 66 2021-06-25T04:56:19.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:20.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.083+0000 7f2b6a592700 1 Processor -- start 2021-06-25T04:56:20.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.083+0000 7f2b6a592700 1 -- start start 2021-06-25T04:56:20.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.083+0000 7f2b6a592700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b640a7670 0x7f2b64066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:20.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.083+0000 7f2b6a592700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b640b1930 0x7f2b64066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:20.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.083+0000 7f2b6a592700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b64067410 con 0x7f2b640b0020 2021-06-25T04:56:20.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b6a592700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b640a7a50 con 0x7f2b640b1930 2021-06-25T04:56:20.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b6a592700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b641475e0 con 0x7f2b640a7670 2021-06-25T04:56:20.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b637fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b640b1930 0x7f2b64066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:20.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b63fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b640a7670 0x7f2b64066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:20.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b637fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b640b1930 0x7f2b64066f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:51498/0 (socket says 172.21.15.57:51498) 2021-06-25T04:56:20.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b68b2f700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2b640b0020 0x7f2b6405f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:60974/0 (socket says 172.21.15.57:60974) 2021-06-25T04:56:20.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b637fe700 1 -- 172.21.15.57:0/3259034126 learned_addr learned my addr 172.21.15.57:0/3259034126 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:20.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b63fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b640a7670 0x7f2b64066a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:54170/0 (socket says 172.21.15.57:54170) 2021-06-25T04:56:20.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b637fe700 1 -- 172.21.15.57:0/3259034126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b640a7670 msgr2=0x7f2b64066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:20.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b637fe700 1 --2- 172.21.15.57:0/3259034126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b640a7670 0x7f2b64066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b62ffd700 1 -- 172.21.15.57:0/3259034126 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092779645 0 0) 0x7f2b64067410 con 0x7f2b640b0020 2021-06-25T04:56:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b637fe700 1 -- 172.21.15.57:0/3259034126 >> v1:172.21.15.87:6789/0 conn(0x7f2b640b0020 legacy=0x7f2b6405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b637fe700 1 -- 172.21.15.57:0/3259034126 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b64147880 con 0x7f2b640b1930 2021-06-25T04:56:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b637fe700 1 --2- 172.21.15.57:0/3259034126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b640b1930 0x7f2b64066f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f2b54002f70 tx=0x7f2b54006eb0).ready entity=mon.1 client_cookie=d655dd10e4f50642 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:20.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b62ffd700 1 -- 172.21.15.57:0/3259034126 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b5400d570 con 0x7f2b640b1930 2021-06-25T04:56:20.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b62ffd700 1 -- 172.21.15.57:0/3259034126 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b54000e90 con 0x7f2b640b1930 2021-06-25T04:56:20.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b62ffd700 1 -- 172.21.15.57:0/3259034126 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b5400d8c0 con 0x7f2b640b1930 2021-06-25T04:56:20.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b6a592700 1 -- 172.21.15.57:0/3259034126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b640b1930 msgr2=0x7f2b64066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:20.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b6a592700 1 --2- 172.21.15.57:0/3259034126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b640b1930 0x7f2b64066f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f2b54002f70 tx=0x7f2b54006eb0).stop 2021-06-25T04:56:20.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b6a592700 1 -- 172.21.15.57:0/3259034126 shutdown_connections 2021-06-25T04:56:20.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b6a592700 1 --2- 172.21.15.57:0/3259034126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b640b1930 0x7f2b64066f20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b6a592700 1 --2- 172.21.15.57:0/3259034126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b640a7670 0x7f2b64066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b6a592700 1 -- 172.21.15.57:0/3259034126 >> 172.21.15.57:0/3259034126 conn(0x7f2b640b53a0 msgr2=0x7f2b640b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:20.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b6a592700 1 -- 172.21.15.57:0/3259034126 shutdown_connections 2021-06-25T04:56:20.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.087+0000 7f2b6a592700 1 -- 172.21.15.57:0/3259034126 wait complete. 2021-06-25T04:56:20.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b6a592700 1 Processor -- start 2021-06-25T04:56:20.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b6a592700 1 -- start start 2021-06-25T04:56:20.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b6a592700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b640a7670 0x7f2b64156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:20.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b6a592700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b640b0020 0x7f2b64156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:20.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b6a592700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b640b1930 0x7f2b640aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:20.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b6a592700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640a9ac0 con 0x7f2b640b0020 2021-06-25T04:56:20.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b6a592700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6414d010 con 0x7f2b640b1930 2021-06-25T04:56:20.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b6a592700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b64141600 con 0x7f2b640a7670 2021-06-25T04:56:20.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b637fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b640b0020 0x7f2b64156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:20.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b637fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b640b0020 0x7f2b64156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43014/0 (socket says 172.21.15.57:43014) 2021-06-25T04:56:20.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b637fe700 1 -- 172.21.15.57:0/2764255091 learned_addr learned my addr 172.21.15.57:0/2764255091 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:20.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.091+0000 7f2b63fff700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b640a7670 0x7f2b64156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:20.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b68b2f700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b640b1930 0x7f2b640aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:20.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b637fe700 1 -- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b640a7670 msgr2=0x7f2b64156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:20.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b637fe700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b640a7670 0x7f2b64156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b637fe700 1 -- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b640b1930 msgr2=0x7f2b640aa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:20.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b637fe700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b640b1930 0x7f2b640aa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b637fe700 1 -- 172.21.15.57:0/2764255091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5400b1e0 con 0x7f2b640b0020 2021-06-25T04:56:20.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b68b2f700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b640b1930 0x7f2b640aa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:20.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b637fe700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b640b0020 0x7f2b64156b70 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f2b640b5020 tx=0x7f2b54015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:20.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b617fa700 1 -- 172.21.15.57:0/2764255091 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b54021070 con 0x7f2b640b0020 2021-06-25T04:56:20.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b617fa700 1 -- 172.21.15.57:0/2764255091 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b54000e90 con 0x7f2b640b0020 2021-06-25T04:56:20.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b617fa700 1 -- 172.21.15.57:0/2764255091 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b54011a50 con 0x7f2b640b0020 2021-06-25T04:56:20.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b6a592700 1 -- 172.21.15.57:0/2764255091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6414c780 con 0x7f2b640b0020 2021-06-25T04:56:20.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b6a592700 1 -- 172.21.15.57:0/2764255091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b640ab040 con 0x7f2b640b0020 2021-06-25T04:56:20.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b6a592700 1 -- 172.21.15.57:0/2764255091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b64057310 con 0x7f2b640b0020 2021-06-25T04:56:20.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b617fa700 1 -- 172.21.15.57:0/2764255091 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2b5400f070 con 0x7f2b640b0020 2021-06-25T04:56:20.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b617fa700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b440553f0 0x7f2b440578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:20.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.095+0000 7f2b617fa700 1 -- 172.21.15.57:0/2764255091 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f2b5406ef90 con 0x7f2b640b0020 2021-06-25T04:56:20.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.099+0000 7f2b63fff700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b440553f0 0x7f2b440578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:20.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.099+0000 7f2b63fff700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b440553f0 0x7f2b440578b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f2b5800b000 tx=0x7f2b58006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:20.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.103+0000 7f2b617fa700 1 -- 172.21.15.57:0/2764255091 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2b54045380 con 0x7f2b640b0020 2021-06-25T04:56:20.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.271+0000 7f2b6a592700 1 -- 172.21.15.57:0/2764255091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b6414a8d0 con 0x7f2b640b0020 2021-06-25T04:56:20.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.271+0000 7f2b617fa700 1 -- 172.21.15.57:0/2764255091 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+504 (secure 0 0 0) 0x7f2b540489a0 con 0x7f2b640b0020 2021-06-25T04:56:20.280 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:20.280 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":66,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-06-25T04:56:20.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 -- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b440553f0 msgr2=0x7f2b440578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:20.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b440553f0 0x7f2b440578b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f2b5800b000 tx=0x7f2b58006df0).stop 2021-06-25T04:56:20.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 -- 172.21.15.57:0/2764255091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b640b0020 msgr2=0x7f2b64156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:20.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b640b0020 0x7f2b64156b70 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f2b640b5020 tx=0x7f2b54015000).stop 2021-06-25T04:56:20.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 -- 172.21.15.57:0/2764255091 shutdown_connections 2021-06-25T04:56:20.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2b440553f0 0x7f2b440578b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b640b1930 0x7f2b640aa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b640b0020 0x7f2b64156b70 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 --2- 172.21.15.57:0/2764255091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b640a7670 0x7f2b64156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 -- 172.21.15.57:0/2764255091 >> 172.21.15.57:0/2764255091 conn(0x7f2b640b53a0 msgr2=0x7f2b6414b030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:20.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 -- 172.21.15.57:0/2764255091 shutdown_connections 2021-06-25T04:56:20.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.275+0000 7f2b6a592700 1 -- 172.21.15.57:0/2764255091 wait complete. 2021-06-25T04:56:20.284 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 66 2021-06-25T04:56:20.291 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:56:20.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:56:20.292 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:56:20.293 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:56:20.293 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:56:20.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:56:20.296 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:56:20.296 DEBUG:teuthology.parallel:result is None 2021-06-25T04:56:20.298 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:56:20.298 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:56:20.299 DEBUG:teuthology.parallel:result is None 2021-06-25T04:56:20.299 DEBUG:teuthology.parallel:result is None 2021-06-25T04:56:20.299 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:56:20.360 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:56:20.361 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:56:20.375 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:56:20.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.391+0000 7f9ee359e700 1 Processor -- start 2021-06-25T04:56:20.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.391+0000 7f9ee359e700 1 -- start start 2021-06-25T04:56:20.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.391+0000 7f9ee359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ee40a9150 0x7f9ee4146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:20.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.391+0000 7f9ee359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee40b1100 con 0x7f9ee40b0b40 2021-06-25T04:56:20.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.391+0000 7f9ee359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee40a9530 con 0x7f9ee40b0390 2021-06-25T04:56:20.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40b1330 con 0x7f9ee40a9150 2021-06-25T04:56:20.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee1d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9ee40b0b40 0x7f9ee4146a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60260/0 (socket says 172.21.15.57:60260) 2021-06-25T04:56:20.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee1d9b700 1 -- 172.21.15.57:0/3833212157 learned_addr learned my addr 172.21.15.57:0/3833212157 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:20.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee259c700 1 --2- 172.21.15.57:0/3833212157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ee40a9150 0x7f9ee4146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:20.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee159a700 1 -- 172.21.15.57:0/3833212157 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062345474 0 0) 0x7f9ee40b1100 con 0x7f9ee40b0b40 2021-06-25T04:56:20.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee159a700 1 -- 172.21.15.57:0/3833212157 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec8003260 con 0x7f9ee40b0b40 2021-06-25T04:56:20.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee259c700 1 -- 172.21.15.57:0/3833212157 >> v1:172.21.15.87:6789/0 conn(0x7f9ee40b0390 legacy=0x7f9ee4140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:20.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee259c700 1 -- 172.21.15.57:0/3833212157 >> v1:172.21.15.57:6789/0 conn(0x7f9ee40b0b40 legacy=0x7f9ee4146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:20.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee259c700 1 -- 172.21.15.57:0/3833212157 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40b15d0 con 0x7f9ee40a9150 2021-06-25T04:56:20.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee259c700 1 --2- 172.21.15.57:0/3833212157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ee40a9150 0x7f9ee4146510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f9edc002f70 tx=0x7f9edc006df0).ready entity=mon.2 client_cookie=6d120180bdfae8c4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:20.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee159a700 1 -- 172.21.15.57:0/3833212157 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9edc00d570 con 0x7f9ee40a9150 2021-06-25T04:56:20.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee159a700 1 -- 172.21.15.57:0/3833212157 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc000e90 con 0x7f9ee40a9150 2021-06-25T04:56:20.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee159a700 1 -- 172.21.15.57:0/3833212157 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9edc00d8c0 con 0x7f9ee40a9150 2021-06-25T04:56:20.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee359e700 1 -- 172.21.15.57:0/3833212157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ee40a9150 msgr2=0x7f9ee4146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:20.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee359e700 1 --2- 172.21.15.57:0/3833212157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ee40a9150 0x7f9ee4146510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f9edc002f70 tx=0x7f9edc006df0).stop 2021-06-25T04:56:20.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee359e700 1 -- 172.21.15.57:0/3833212157 shutdown_connections 2021-06-25T04:56:20.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee359e700 1 --2- 172.21.15.57:0/3833212157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ee40a9150 0x7f9ee4146510 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee359e700 1 -- 172.21.15.57:0/3833212157 >> 172.21.15.57:0/3833212157 conn(0x7f9ee4061100 msgr2=0x7f9ee4062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:20.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee359e700 1 -- 172.21.15.57:0/3833212157 shutdown_connections 2021-06-25T04:56:20.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee359e700 1 -- 172.21.15.57:0/3833212157 wait complete. 2021-06-25T04:56:20.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee359e700 1 Processor -- start 2021-06-25T04:56:20.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.395+0000 7f9ee359e700 1 -- start start 2021-06-25T04:56:20.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ee40a9150 0x7f9ee414f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:20.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ee40b0390 0x7f9ee414fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:20.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ee40b0b40 0x7f9ee4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:20.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee4142090 con 0x7f9ee40b0b40 2021-06-25T04:56:20.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee41531f0 con 0x7f9ee40a9150 2021-06-25T04:56:20.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee4153450 con 0x7f9ee40b0390 2021-06-25T04:56:20.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ee40b0b40 0x7f9ee4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:20.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee1d9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ee40b0390 0x7f9ee414fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:20.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ee40a9150 0x7f9ee414f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:20.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ee40b0b40 0x7f9ee4155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43052/0 (socket says 172.21.15.57:43052) 2021-06-25T04:56:20.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee2d9d700 1 -- 172.21.15.57:0/2906466189 learned_addr learned my addr 172.21.15.57:0/2906466189 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:20.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee2d9d700 1 -- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ee40b0390 msgr2=0x7f9ee414fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:20.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee2d9d700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ee40b0390 0x7f9ee414fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee2d9d700 1 -- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ee40a9150 msgr2=0x7f9ee414f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:20.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee2d9d700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ee40a9150 0x7f9ee414f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:20.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee2d9d700 1 -- 172.21.15.57:0/2906466189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc00b180 con 0x7f9ee40b0b40 2021-06-25T04:56:20.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee2d9d700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ee40b0b40 0x7f9ee4155b80 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f9ee4063540 tx=0x7f9ed4007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:20.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ed37fe700 1 -- 172.21.15.57:0/2906466189 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed400f470 con 0x7f9ee40b0b40 2021-06-25T04:56:20.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ed37fe700 1 -- 172.21.15.57:0/2906466189 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed400f5d0 con 0x7f9ee40b0b40 2021-06-25T04:56:20.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee359e700 1 -- 172.21.15.57:0/2906466189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee41422c0 con 0x7f9ee40b0b40 2021-06-25T04:56:20.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ed37fe700 1 -- 172.21.15.57:0/2906466189 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed400f930 con 0x7f9ee40b0b40 2021-06-25T04:56:20.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee359e700 1 -- 172.21.15.57:0/2906466189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee4146700 con 0x7f9ee40b0b40 2021-06-25T04:56:20.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ee359e700 1 -- 172.21.15.57:0/2906466189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee4142450 con 0x7f9ee40b0b40 2021-06-25T04:56:20.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.399+0000 7f9ed37fe700 1 -- 172.21.15.57:0/2906466189 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9ed4019030 con 0x7f9ee40b0b40 2021-06-25T04:56:20.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.403+0000 7f9ed37fe700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9ec00554e0 0x7f9ec00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:20.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.403+0000 7f9ed37fe700 1 -- 172.21.15.57:0/2906466189 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f9ed406d200 con 0x7f9ee40b0b40 2021-06-25T04:56:20.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.403+0000 7f9ee259c700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9ec00554e0 0x7f9ec00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:20.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.403+0000 7f9ee259c700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9ec00554e0 0x7f9ec00579a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f9edc019000 tx=0x7f9edc014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:20.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.407+0000 7f9ed37fe700 1 -- 172.21.15.57:0/2906466189 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9ed4043690 con 0x7f9ee40b0b40 2021-06-25T04:56:20.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:20.547+0000 7f9ee359e700 1 -- 172.21.15.57:0/2906466189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f9ee4057310 con 0x7f9ee40b0b40 2021-06-25T04:56:21.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.395+0000 7f9ed37fe700 1 -- 172.21.15.57:0/2906466189 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v134) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9ed4046cb0 con 0x7f9ee40b0b40 2021-06-25T04:56:21.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 -- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9ec00554e0 msgr2=0x7f9ec00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:21.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9ec00554e0 0x7f9ec00579a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f9edc019000 tx=0x7f9edc014000).stop 2021-06-25T04:56:21.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 -- 172.21.15.57:0/2906466189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ee40b0b40 msgr2=0x7f9ee4155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:21.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ee40b0b40 0x7f9ee4155b80 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f9ee4063540 tx=0x7f9ed4007f40).stop 2021-06-25T04:56:21.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 -- 172.21.15.57:0/2906466189 shutdown_connections 2021-06-25T04:56:21.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9ec00554e0 0x7f9ec00579a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ee40b0b40 0x7f9ee4155b80 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ee40b0390 0x7f9ee414fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 --2- 172.21.15.57:0/2906466189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ee40a9150 0x7f9ee414f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 -- 172.21.15.57:0/2906466189 >> 172.21.15.57:0/2906466189 conn(0x7f9ee4061100 msgr2=0x7f9ee405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:21.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 -- 172.21.15.57:0/2906466189 shutdown_connections 2021-06-25T04:56:21.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.399+0000 7f9ee359e700 1 -- 172.21.15.57:0/2906466189 wait complete. 2021-06-25T04:56:21.408 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:56:21.419 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:56:21.420 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:56:21.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61ad89700 1 Processor -- start 2021-06-25T04:56:21.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61ad89700 1 -- start start 2021-06-25T04:56:21.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61ad89700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6140b46d0 0x7fb61413fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61ad89700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb614143960 0x7fb614140250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61ad89700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6140b68d0 con 0x7fb614061640 2021-06-25T04:56:21.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61ad89700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6140b9640 con 0x7fb614143960 2021-06-25T04:56:21.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61ad89700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140b6b70 con 0x7fb6140b46d0 2021-06-25T04:56:21.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61a588700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb614143960 0x7fb614140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61a588700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb614143960 0x7fb614140250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43064/0 (socket says 172.21.15.57:43064) 2021-06-25T04:56:21.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61a588700 1 -- 172.21.15.57:0/2330099295 learned_addr learned my addr 172.21.15.57:0/2330099295 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:21.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb619d87700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb614061640 0x7fb6140b9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60280/0 (socket says 172.21.15.57:60280) 2021-06-25T04:56:21.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb619586700 1 --2- 172.21.15.57:0/2330099295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6140b46d0 0x7fb61413fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61a588700 1 -- 172.21.15.57:0/2330099295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6140b46d0 msgr2=0x7fb61413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:21.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61a588700 1 --2- 172.21.15.57:0/2330099295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6140b46d0 0x7fb61413fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb618d85700 1 -- 172.21.15.57:0/2330099295 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767627151 0 0) 0x7fb6140b68d0 con 0x7fb614061640 2021-06-25T04:56:21.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61a588700 1 -- 172.21.15.57:0/2330099295 >> v1:172.21.15.57:6789/0 conn(0x7fb614061640 legacy=0x7fb6140b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:21.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61a588700 1 -- 172.21.15.57:0/2330099295 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140b6e10 con 0x7fb614143960 2021-06-25T04:56:21.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61a588700 1 --2- 172.21.15.57:0/2330099295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb614143960 0x7fb614140250 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7fb604002f70 tx=0x7fb604006eb0).ready entity=mon.0 client_cookie=1441dc758eda30e5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:21.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb618d85700 1 -- 172.21.15.57:0/2330099295 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60400d570 con 0x7fb614143960 2021-06-25T04:56:21.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb618d85700 1 -- 172.21.15.57:0/2330099295 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb604000e90 con 0x7fb614143960 2021-06-25T04:56:21.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb618d85700 1 -- 172.21.15.57:0/2330099295 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb60400d8c0 con 0x7fb614143960 2021-06-25T04:56:21.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61ad89700 1 -- 172.21.15.57:0/2330099295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb614143960 msgr2=0x7fb614140250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:21.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.523+0000 7fb61ad89700 1 --2- 172.21.15.57:0/2330099295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb614143960 0x7fb614140250 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7fb604002f70 tx=0x7fb604006eb0).stop 2021-06-25T04:56:21.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 -- 172.21.15.57:0/2330099295 shutdown_connections 2021-06-25T04:56:21.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 --2- 172.21.15.57:0/2330099295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6140b46d0 0x7fb61413fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 --2- 172.21.15.57:0/2330099295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb614143960 0x7fb614140250 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 -- 172.21.15.57:0/2330099295 >> 172.21.15.57:0/2330099295 conn(0x7fb61406adb0 msgr2=0x7fb61405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:21.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 -- 172.21.15.57:0/2330099295 shutdown_connections 2021-06-25T04:56:21.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 -- 172.21.15.57:0/2330099295 wait complete. 2021-06-25T04:56:21.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 Processor -- start 2021-06-25T04:56:21.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 -- start start 2021-06-25T04:56:21.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb614061640 0x7fb614152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb614143960 0x7fb6140b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6140b72f0 0x7fb6140ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb614152190 con 0x7fb614143960 2021-06-25T04:56:21.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb614152380 con 0x7fb614061640 2021-06-25T04:56:21.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb614152620 con 0x7fb6140b72f0 2021-06-25T04:56:21.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb619586700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb614143960 0x7fb6140b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb619586700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb614143960 0x7fb6140b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43066/0 (socket says 172.21.15.57:43066) 2021-06-25T04:56:21.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb619586700 1 -- 172.21.15.57:0/2600205294 learned_addr learned my addr 172.21.15.57:0/2600205294 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:21.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb619d87700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb614061640 0x7fb614152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61a588700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6140b72f0 0x7fb6140ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb619586700 1 -- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6140b72f0 msgr2=0x7fb6140ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:21.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb619586700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6140b72f0 0x7fb6140ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb619586700 1 -- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb614061640 msgr2=0x7fb614152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:21.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb619586700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb614061640 0x7fb614152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb619586700 1 -- 172.21.15.57:0/2600205294 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60400b1e0 con 0x7fb614143960 2021-06-25T04:56:21.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb619d87700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb614061640 0x7fb614152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb619586700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb614143960 0x7fb6140b2010 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7fb61000c000 tx=0x7fb6100091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb60affd700 1 -- 172.21.15.57:0/2600205294 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61000c850 con 0x7fb614143960 2021-06-25T04:56:21.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb60affd700 1 -- 172.21.15.57:0/2600205294 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61000c9b0 con 0x7fb614143960 2021-06-25T04:56:21.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb61ad89700 1 -- 172.21.15.57:0/2600205294 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6141528c0 con 0x7fb614143960 2021-06-25T04:56:21.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.527+0000 7fb60affd700 1 -- 172.21.15.57:0/2600205294 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61000cd10 con 0x7fb614143960 2021-06-25T04:56:21.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.531+0000 7fb61ad89700 1 -- 172.21.15.57:0/2600205294 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61414fd00 con 0x7fb614143960 2021-06-25T04:56:21.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.531+0000 7fb61ad89700 1 -- 172.21.15.57:0/2600205294 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb614152a50 con 0x7fb614143960 2021-06-25T04:56:21.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.531+0000 7fb60affd700 1 -- 172.21.15.57:0/2600205294 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb610022070 con 0x7fb614143960 2021-06-25T04:56:21.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.531+0000 7fb60affd700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5f4055450 0x7fb5f4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.531+0000 7fb60affd700 1 -- 172.21.15.57:0/2600205294 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fb61006e430 con 0x7fb614143960 2021-06-25T04:56:21.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.531+0000 7fb619d87700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5f4055450 0x7fb5f4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.535+0000 7fb619d87700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5f4055450 0x7fb5f4057910 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fb60c00b000 tx=0x7fb60c0070e0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:21.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.539+0000 7fb60affd700 1 -- 172.21.15.57:0/2600205294 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb610044810 con 0x7fb614143960 2021-06-25T04:56:21.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.703+0000 7fb61ad89700 1 -- 172.21.15.57:0/2600205294 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb614057310 con 0x7fb614143960 2021-06-25T04:56:21.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb60affd700 1 -- 172.21.15.57:0/2600205294 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fb610047e30 con 0x7fb614143960 2021-06-25T04:56:21.711 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:21.711 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:56:21.711 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:56:21.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.712 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:56:21.712 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:56:21.712 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.712 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:56:21.712 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.713 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.713 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.713 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.714 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:56:21.714 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:56:21.714 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.715 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:56:21.715 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.715 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.715 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.715 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.716 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:56:21.716 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:56:21.717 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.717 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:56:21.717 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.717 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.717 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.718 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.718 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:56:21.719 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:56:21.719 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.719 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.719 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.720 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.720 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.720 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:56:21.721 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:56:21.721 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.721 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.721 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.722 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.722 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:56:21.723 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:56:21.723 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.723 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.723 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.724 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.724 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.725 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:56:21.725 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:56:21.725 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.725 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.725 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.726 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.726 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.727 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:56:21.727 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:56:21.727 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.727 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.727 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.728 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.728 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.729 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:56:21.729 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:56:21.729 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.729 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.729 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.730 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.730 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.731 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:56:21.731 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:56:21.731 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.732 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.732 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.732 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.732 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.733 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:56:21.733 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:56:21.733 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.733 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.734 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.734 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.735 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:56:21.735 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:56:21.735 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.735 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:56:21.736 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:56:21.736 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:56:21.736 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.737 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:56:21.737 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:56:21.737 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.738 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:56:21.738 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:56:21.738 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:56:21.738 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.739 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:56:21.739 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:56:21.739 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.740 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:56:21.740 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:21.740 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:21.740 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.741 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.741 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:56:21.741 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:56:21.742 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.742 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:56:21.742 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:56:21.742 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:21.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:21.743 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:56:21.743 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:56:21.744 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:21.744 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:56:21.744 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:56:21.744 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:21.745 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.745 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:21.745 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:21.745 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:56:21.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 -- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5f4055450 msgr2=0x7fb5f4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:21.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5f4055450 0x7fb5f4057910 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fb60c00b000 tx=0x7fb60c0070e0).stop 2021-06-25T04:56:21.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 -- 172.21.15.57:0/2600205294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb614143960 msgr2=0x7fb6140b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:21.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb614143960 0x7fb6140b2010 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7fb61000c000 tx=0x7fb6100091d0).stop 2021-06-25T04:56:21.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 -- 172.21.15.57:0/2600205294 shutdown_connections 2021-06-25T04:56:21.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5f4055450 0x7fb5f4057910 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6140b72f0 0x7fb6140ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb614143960 0x7fb6140b2010 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 --2- 172.21.15.57:0/2600205294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb614061640 0x7fb614152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 -- 172.21.15.57:0/2600205294 >> 172.21.15.57:0/2600205294 conn(0x7fb61406adb0 msgr2=0x7fb614142db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:21.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 -- 172.21.15.57:0/2600205294 shutdown_connections 2021-06-25T04:56:21.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.707+0000 7fb61ad89700 1 -- 172.21.15.57:0/2600205294 wait complete. 2021-06-25T04:56:21.751 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:21.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.851+0000 7f9fd629e700 1 Processor -- start 2021-06-25T04:56:21.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.851+0000 7f9fd629e700 1 -- start start 2021-06-25T04:56:21.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9fd00a7670 0x7f9fd0066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9fd00b1930 0x7f9fd0066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fd00b0020 0x7f9fd005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd0067410 con 0x7f9fd00a7670 2021-06-25T04:56:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd00a7a50 con 0x7f9fd00b1930 2021-06-25T04:56:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd01475e0 con 0x7f9fd00b0020 2021-06-25T04:56:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fcffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9fd00a7670 0x7f9fd0066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fcf7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9fd00b1930 0x7f9fd0066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fcffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9fd00a7670 0x7f9fd0066a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43076/0 (socket says 172.21.15.57:43076) 2021-06-25T04:56:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd483b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fd00b0020 0x7f9fd005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fcffff700 1 -- 172.21.15.57:0/1539413420 learned_addr learned my addr 172.21.15.57:0/1539413420 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fcf7fe700 1 -- 172.21.15.57:0/1539413420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fd00b0020 msgr2=0x7f9fd005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fcf7fe700 1 --2- 172.21.15.57:0/1539413420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fd00b0020 0x7f9fd005f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fcf7fe700 1 -- 172.21.15.57:0/1539413420 >> v2:172.21.15.57:3300/0 conn(0x7f9fd00a7670 msgr2=0x7f9fd0066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fcf7fe700 1 --2- 172.21.15.57:0/1539413420 >> v2:172.21.15.57:3300/0 conn(0x7f9fd00a7670 0x7f9fd0066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fcf7fe700 1 -- 172.21.15.57:0/1539413420 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd0147880 con 0x7f9fd00b1930 2021-06-25T04:56:21.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fcf7fe700 1 --2- 172.21.15.57:0/1539413420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd00b1930 0x7f9fd0066f20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f9fc00032f0 tx=0x7f9fc00091d0).ready entity=mon.1 client_cookie=925ae135cf861d47 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fceffd700 1 -- 172.21.15.57:0/1539413420 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc000b600 con 0x7f9fd00b1930 2021-06-25T04:56:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fceffd700 1 -- 172.21.15.57:0/1539413420 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc000b760 con 0x7f9fd00b1930 2021-06-25T04:56:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fceffd700 1 -- 172.21.15.57:0/1539413420 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc000b8d0 con 0x7f9fd00b1930 2021-06-25T04:56:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 -- 172.21.15.57:0/1539413420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd00b1930 msgr2=0x7f9fd0066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:21.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 --2- 172.21.15.57:0/1539413420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd00b1930 0x7f9fd0066f20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f9fc00032f0 tx=0x7f9fc00091d0).stop 2021-06-25T04:56:21.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 -- 172.21.15.57:0/1539413420 shutdown_connections 2021-06-25T04:56:21.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 --2- 172.21.15.57:0/1539413420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fd00b0020 0x7f9fd005f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 --2- 172.21.15.57:0/1539413420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd00b1930 0x7f9fd0066f20 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 --2- 172.21.15.57:0/1539413420 >> v2:172.21.15.57:3300/0 conn(0x7f9fd00a7670 0x7f9fd0066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 -- 172.21.15.57:0/1539413420 >> 172.21.15.57:0/1539413420 conn(0x7f9fd00b53a0 msgr2=0x7f9fd00b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 -- 172.21.15.57:0/1539413420 shutdown_connections 2021-06-25T04:56:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.855+0000 7f9fd629e700 1 -- 172.21.15.57:0/1539413420 wait complete. 2021-06-25T04:56:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fd629e700 1 Processor -- start 2021-06-25T04:56:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fd629e700 1 -- start start 2021-06-25T04:56:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fd629e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fd00a7670 0x7f9fd00ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fd629e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd00b0020 0x7f9fd00aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fd629e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fd00b1930 0x7f9fd00aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fd629e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd00ab050 con 0x7f9fd00b1930 2021-06-25T04:56:21.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fd629e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd00aab10 con 0x7f9fd00b0020 2021-06-25T04:56:21.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fd629e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd00aadb0 con 0x7f9fd00a7670 2021-06-25T04:56:21.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fd483b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fd00b1930 0x7f9fd00aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fd483b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fd00b1930 0x7f9fd00aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43084/0 (socket says 172.21.15.57:43084) 2021-06-25T04:56:21.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fd483b700 1 -- 172.21.15.57:0/4077640804 learned_addr learned my addr 172.21.15.57:0/4077640804 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:21.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fcf7fe700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd00b0020 0x7f9fd00aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.859+0000 7f9fcffff700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fd00a7670 0x7f9fd00ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fd483b700 1 -- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fd00a7670 msgr2=0x7f9fd00ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:21.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fd483b700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fd00a7670 0x7f9fd00ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fd483b700 1 -- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd00b0020 msgr2=0x7f9fd00aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:21.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fd483b700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd00b0020 0x7f9fd00aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:21.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fd483b700 1 -- 172.21.15.57:0/4077640804 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc0009470 con 0x7f9fd00b1930 2021-06-25T04:56:21.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fcf7fe700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd00b0020 0x7f9fd00aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:21.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fd483b700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fd00b1930 0x7f9fd00aefe0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f9fc800c000 tx=0x7f9fc8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:21.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fcd7fa700 1 -- 172.21.15.57:0/4077640804 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc8010780 con 0x7f9fd00b1930 2021-06-25T04:56:21.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fcd7fa700 1 -- 172.21.15.57:0/4077640804 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc80108e0 con 0x7f9fd00b1930 2021-06-25T04:56:21.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fd629e700 1 -- 172.21.15.57:0/4077640804 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd00aba20 con 0x7f9fd00b1930 2021-06-25T04:56:21.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fcd7fa700 1 -- 172.21.15.57:0/4077640804 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc8010c40 con 0x7f9fd00b1930 2021-06-25T04:56:21.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fd629e700 1 -- 172.21.15.57:0/4077640804 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd00abec0 con 0x7f9fd00b1930 2021-06-25T04:56:21.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fd629e700 1 -- 172.21.15.57:0/4077640804 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd00aceb0 con 0x7f9fd00b1930 2021-06-25T04:56:21.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fcd7fa700 1 -- 172.21.15.57:0/4077640804 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9fc801c460 con 0x7f9fd00b1930 2021-06-25T04:56:21.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fcd7fa700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9fb00553f0 0x7f9fb00578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:21.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fcd7fa700 1 -- 172.21.15.57:0/4077640804 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f9fc806dfc0 con 0x7f9fd00b1930 2021-06-25T04:56:21.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.863+0000 7f9fcffff700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9fb00553f0 0x7f9fb00578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:21.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.867+0000 7f9fcffff700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9fb00553f0 0x7f9fb00578b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f9fc4008000 tx=0x7f9fc4008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:21.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.871+0000 7f9fcd7fa700 1 -- 172.21.15.57:0/4077640804 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9fc8044450 con 0x7f9fd00b1930 2021-06-25T04:56:22.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.999+0000 7f9fd629e700 1 -- 172.21.15.57:0/4077640804 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fd00abbb0 con 0x7f9fd00b1930 2021-06-25T04:56:22.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:21.999+0000 7f9fcd7fa700 1 -- 172.21.15.57:0/4077640804 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f9fc8047a70 con 0x7f9fd00b1930 2021-06-25T04:56:22.006 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:22.006 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":134,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:21.385650+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:22.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 -- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9fb00553f0 msgr2=0x7f9fb00578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9fb00553f0 0x7f9fb00578b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f9fc4008000 tx=0x7f9fc4008040).stop 2021-06-25T04:56:22.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 -- 172.21.15.57:0/4077640804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fd00b1930 msgr2=0x7f9fd00aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fd00b1930 0x7f9fd00aefe0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f9fc800c000 tx=0x7f9fc8006df0).stop 2021-06-25T04:56:22.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 -- 172.21.15.57:0/4077640804 shutdown_connections 2021-06-25T04:56:22.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9fb00553f0 0x7f9fb00578b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fd00b1930 0x7f9fd00aefe0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd00b0020 0x7f9fd00aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 --2- 172.21.15.57:0/4077640804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9fd00a7670 0x7f9fd00ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 -- 172.21.15.57:0/4077640804 >> 172.21.15.57:0/4077640804 conn(0x7f9fd00b53a0 msgr2=0x7f9fd0149a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:22.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 -- 172.21.15.57:0/4077640804 shutdown_connections 2021-06-25T04:56:22.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.003+0000 7f9fd629e700 1 -- 172.21.15.57:0/4077640804 wait complete. 2021-06-25T04:56:22.018 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:56:22.019 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:56:22.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.119+0000 7f705b59e700 1 Processor -- start 2021-06-25T04:56:22.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.119+0000 7f705b59e700 1 -- start start 2021-06-25T04:56:22.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f705c05d070 0x7f705c0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f705c13f350 0x7f705c0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c05cb70 con 0x7f705c05c790 2021-06-25T04:56:22.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c0ad500 con 0x7f705c13f350 2021-06-25T04:56:22.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c067d30 con 0x7f705c05d070 2021-06-25T04:56:22.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f705c13f350 0x7f705c0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f705c13f350 0x7f705c0aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43092/0 (socket says 172.21.15.57:43092) 2021-06-25T04:56:22.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705a59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f705c05c790 0x7f705c0acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60306/0 (socket says 172.21.15.57:60306) 2021-06-25T04:56:22.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705ad9d700 1 -- 172.21.15.57:0/2703823756 learned_addr learned my addr 172.21.15.57:0/2703823756 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:22.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f7059d9b700 1 --2- 172.21.15.57:0/2703823756 >> v2:172.21.15.87:3300/0 conn(0x7f705c05d070 0x7f705c0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705ad9d700 1 -- 172.21.15.57:0/2703823756 >> v2:172.21.15.87:3300/0 conn(0x7f705c05d070 msgr2=0x7f705c0b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:22.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705ad9d700 1 --2- 172.21.15.57:0/2703823756 >> v2:172.21.15.87:3300/0 conn(0x7f705c05d070 0x7f705c0b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705ad9d700 1 -- 172.21.15.57:0/2703823756 >> v1:172.21.15.57:6789/0 conn(0x7f705c05c790 legacy=0x7f705c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705ad9d700 1 -- 172.21.15.57:0/2703823756 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0b1750 con 0x7f705c13f350 2021-06-25T04:56:22.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705ad9d700 1 --2- 172.21.15.57:0/2703823756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f705c13f350 0x7f705c0aeca0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f7054002f70 tx=0x7f7054006f40).ready entity=mon.0 client_cookie=6ebb715bed32926c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705959a700 1 -- 172.21.15.57:0/2703823756 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f705400c880 con 0x7f705c13f350 2021-06-25T04:56:22.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705959a700 1 -- 172.21.15.57:0/2703823756 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7054000e90 con 0x7f705c13f350 2021-06-25T04:56:22.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705959a700 1 -- 172.21.15.57:0/2703823756 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f705400cc10 con 0x7f705c13f350 2021-06-25T04:56:22.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 -- 172.21.15.57:0/2703823756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f705c13f350 msgr2=0x7f705c0aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 --2- 172.21.15.57:0/2703823756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f705c13f350 0x7f705c0aeca0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f7054002f70 tx=0x7f7054006f40).stop 2021-06-25T04:56:22.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 -- 172.21.15.57:0/2703823756 shutdown_connections 2021-06-25T04:56:22.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 --2- 172.21.15.57:0/2703823756 >> v2:172.21.15.87:3300/0 conn(0x7f705c05d070 0x7f705c0b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 --2- 172.21.15.57:0/2703823756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f705c13f350 0x7f705c0aeca0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 -- 172.21.15.57:0/2703823756 >> 172.21.15.57:0/2703823756 conn(0x7f705c060140 msgr2=0x7f705c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:22.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 -- 172.21.15.57:0/2703823756 shutdown_connections 2021-06-25T04:56:22.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.123+0000 7f705b59e700 1 -- 172.21.15.57:0/2703823756 wait complete. 2021-06-25T04:56:22.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705b59e700 1 Processor -- start 2021-06-25T04:56:22.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705b59e700 1 -- start start 2021-06-25T04:56:22.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705b59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f705c05c790 0x7f705c0aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f705c05d070 0x7f705c142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f705c13f350 0x7f705c1406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0a9ec0 con 0x7f705c13f350 2021-06-25T04:56:22.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0abd00 con 0x7f705c05d070 2021-06-25T04:56:22.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705b59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0abfa0 con 0x7f705c05c790 2021-06-25T04:56:22.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f705c13f350 0x7f705c1406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f705c13f350 0x7f705c1406d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43098/0 (socket says 172.21.15.57:43098) 2021-06-25T04:56:22.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705ad9d700 1 -- 172.21.15.57:0/4170427305 learned_addr learned my addr 172.21.15.57:0/4170427305 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:22.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f7059d9b700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f705c05d070 0x7f705c142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705a59c700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f705c05c790 0x7f705c0aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705ad9d700 1 -- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f705c05c790 msgr2=0x7f705c0aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705ad9d700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f705c05c790 0x7f705c0aa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705ad9d700 1 -- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f705c05d070 msgr2=0x7f705c142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705ad9d700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f705c05d070 0x7f705c142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705ad9d700 1 -- 172.21.15.57:0/4170427305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705400a360 con 0x7f705c13f350 2021-06-25T04:56:22.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705a59c700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f705c05c790 0x7f705c0aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:22.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705ad9d700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f705c13f350 0x7f705c1406d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f7054002f70 tx=0x7f705c0b18e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f704b7fe700 1 -- 172.21.15.57:0/4170427305 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7054010e30 con 0x7f705c13f350 2021-06-25T04:56:22.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f704b7fe700 1 -- 172.21.15.57:0/4170427305 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705401a450 con 0x7f705c13f350 2021-06-25T04:56:22.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705b59e700 1 -- 172.21.15.57:0/4170427305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c0ac240 con 0x7f705c13f350 2021-06-25T04:56:22.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f704b7fe700 1 -- 172.21.15.57:0/4170427305 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f705401a7b0 con 0x7f705c13f350 2021-06-25T04:56:22.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.127+0000 7f705b59e700 1 -- 172.21.15.57:0/4170427305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c143680 con 0x7f705c13f350 2021-06-25T04:56:22.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.131+0000 7f705b59e700 1 -- 172.21.15.57:0/4170427305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c057310 con 0x7f705c13f350 2021-06-25T04:56:22.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.131+0000 7f704b7fe700 1 -- 172.21.15.57:0/4170427305 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f705402a070 con 0x7f705c13f350 2021-06-25T04:56:22.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.131+0000 7f704b7fe700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7038055450 0x7f7038057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.131+0000 7f704b7fe700 1 -- 172.21.15.57:0/4170427305 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f705406f270 con 0x7f705c13f350 2021-06-25T04:56:22.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.131+0000 7f705a59c700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7038055450 0x7f7038057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.131+0000 7f705a59c700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7038055450 0x7f7038057910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f705000b000 tx=0x7f70500070e0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.139+0000 7f704b7fe700 1 -- 172.21.15.57:0/4170427305 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7054045760 con 0x7f705c13f350 2021-06-25T04:56:22.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.267+0000 7f705b59e700 1 -- 172.21.15.57:0/4170427305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f705c0698a0 con 0x7f705c13f350 2021-06-25T04:56:22.275 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.267+0000 7f704b7fe700 1 -- 172.21.15.57:0/4170427305 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v134) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7054048d80 con 0x7f705c13f350 2021-06-25T04:56:22.276 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:56:22.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 -- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7038055450 msgr2=0x7f7038057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7038055450 0x7f7038057910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f705000b000 tx=0x7f70500070e0).stop 2021-06-25T04:56:22.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 -- 172.21.15.57:0/4170427305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f705c13f350 msgr2=0x7f705c1406d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f705c13f350 0x7f705c1406d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f7054002f70 tx=0x7f705c0b18e0).stop 2021-06-25T04:56:22.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 -- 172.21.15.57:0/4170427305 shutdown_connections 2021-06-25T04:56:22.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7038055450 0x7f7038057910 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f705c13f350 0x7f705c1406d0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f705c05d070 0x7f705c142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 --2- 172.21.15.57:0/4170427305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f705c05c790 0x7f705c0aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 -- 172.21.15.57:0/4170427305 >> 172.21.15.57:0/4170427305 conn(0x7f705c060140 msgr2=0x7f705c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:22.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 -- 172.21.15.57:0/4170427305 shutdown_connections 2021-06-25T04:56:22.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.271+0000 7f705b59e700 1 -- 172.21.15.57:0/4170427305 wait complete. 2021-06-25T04:56:22.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:56:22.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.391+0000 7f751843d700 1 Processor -- start 2021-06-25T04:56:22.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.391+0000 7f751843d700 1 -- start start 2021-06-25T04:56:22.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f751005ff20 0x7f7510140400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7510061190 0x7f75101408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7510140de0 con 0x7f75100b26d0 2021-06-25T04:56:22.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75100648d0 con 0x7f751005ff20 2021-06-25T04:56:22.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7510064b70 con 0x7f7510061190 2021-06-25T04:56:22.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75159d8700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f75100b26d0 0x7f75101430d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60322/0 (socket says 172.21.15.57:60322) 2021-06-25T04:56:22.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75161d9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f751005ff20 0x7f7510140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75169da700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7510061190 0x7f75101408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75159d8700 1 -- 172.21.15.57:0/3235216027 learned_addr learned my addr 172.21.15.57:0/3235216027 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:22.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75151d7700 1 -- 172.21.15.57:0/3235216027 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771450908 0 0) 0x7f7510140de0 con 0x7f75100b26d0 2021-06-25T04:56:22.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75151d7700 1 -- 172.21.15.57:0/3235216027 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74fc003260 con 0x7f75100b26d0 2021-06-25T04:56:22.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75169da700 1 -- 172.21.15.57:0/3235216027 >> v2:172.21.15.87:3300/0 conn(0x7f751005ff20 msgr2=0x7f7510140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:22.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75169da700 1 --2- 172.21.15.57:0/3235216027 >> v2:172.21.15.87:3300/0 conn(0x7f751005ff20 0x7f7510140400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75169da700 1 -- 172.21.15.57:0/3235216027 >> v1:172.21.15.57:6789/0 conn(0x7f75100b26d0 legacy=0x7f75101430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75169da700 1 -- 172.21.15.57:0/3235216027 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7510064e10 con 0x7f7510061190 2021-06-25T04:56:22.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75161d9700 1 --2- 172.21.15.57:0/3235216027 >> v2:172.21.15.87:3300/0 conn(0x7f751005ff20 0x7f7510140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:22.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75169da700 1 --2- 172.21.15.57:0/3235216027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7510061190 0x7f75101408f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f7508002f70 tx=0x7f7508006df0).ready entity=mon.2 client_cookie=420c1cfe4a57a5c4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75151d7700 1 -- 172.21.15.57:0/3235216027 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f750800d4a0 con 0x7f7510061190 2021-06-25T04:56:22.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75151d7700 1 -- 172.21.15.57:0/3235216027 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7508000e90 con 0x7f7510061190 2021-06-25T04:56:22.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f75151d7700 1 -- 172.21.15.57:0/3235216027 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f750800d7f0 con 0x7f7510061190 2021-06-25T04:56:22.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 -- 172.21.15.57:0/3235216027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7510061190 msgr2=0x7f75101408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 --2- 172.21.15.57:0/3235216027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7510061190 0x7f75101408f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f7508002f70 tx=0x7f7508006df0).stop 2021-06-25T04:56:22.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 -- 172.21.15.57:0/3235216027 shutdown_connections 2021-06-25T04:56:22.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 --2- 172.21.15.57:0/3235216027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7510061190 0x7f75101408f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 --2- 172.21.15.57:0/3235216027 >> v2:172.21.15.87:3300/0 conn(0x7f751005ff20 0x7f7510140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 -- 172.21.15.57:0/3235216027 >> 172.21.15.57:0/3235216027 conn(0x7f751005cf20 msgr2=0x7f751005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:22.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 -- 172.21.15.57:0/3235216027 shutdown_connections 2021-06-25T04:56:22.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.395+0000 7f751843d700 1 -- 172.21.15.57:0/3235216027 wait complete. 2021-06-25T04:56:22.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f751843d700 1 Processor -- start 2021-06-25T04:56:22.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f751843d700 1 -- start start 2021-06-25T04:56:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f751843d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f751005ff20 0x7f75100b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f751843d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7510061190 0x7f751013e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f751843d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75100b26d0 0x7f751013e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f751843d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7510152c90 con 0x7f751005ff20 2021-06-25T04:56:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f751843d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75100aea90 con 0x7f7510061190 2021-06-25T04:56:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f751843d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7510143a30 con 0x7f75100b26d0 2021-06-25T04:56:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f75161d9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f751005ff20 0x7f75100b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f75161d9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f751005ff20 0x7f75100b5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43108/0 (socket says 172.21.15.57:43108) 2021-06-25T04:56:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f75161d9700 1 -- 172.21.15.57:0/1971901927 learned_addr learned my addr 172.21.15.57:0/1971901927 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f75169da700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75100b26d0 0x7f751013e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f75159d8700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7510061190 0x7f751013e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f75161d9700 1 -- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75100b26d0 msgr2=0x7f751013e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f75161d9700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75100b26d0 0x7f751013e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f75161d9700 1 -- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7510061190 msgr2=0x7f751013e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f75161d9700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7510061190 0x7f751013e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f75161d9700 1 -- 172.21.15.57:0/1971901927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7500009470 con 0x7f751005ff20 2021-06-25T04:56:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f75161d9700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f751005ff20 0x7f75100b5c60 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f750000c000 tx=0x7f75000091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f750f7fe700 1 -- 172.21.15.57:0/1971901927 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f750000c920 con 0x7f751005ff20 2021-06-25T04:56:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f750f7fe700 1 -- 172.21.15.57:0/1971901927 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750000ca80 con 0x7f751005ff20 2021-06-25T04:56:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f750f7fe700 1 -- 172.21.15.57:0/1971901927 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f750000cde0 con 0x7f751005ff20 2021-06-25T04:56:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.399+0000 7f751843d700 1 -- 172.21.15.57:0/1971901927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750800b180 con 0x7f751005ff20 2021-06-25T04:56:22.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.403+0000 7f751843d700 1 -- 172.21.15.57:0/1971901927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7510153150 con 0x7f751005ff20 2021-06-25T04:56:22.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.403+0000 7f750f7fe700 1 -- 172.21.15.57:0/1971901927 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f750001b400 con 0x7f751005ff20 2021-06-25T04:56:22.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.403+0000 7f751843d700 1 -- 172.21.15.57:0/1971901927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7510057310 con 0x7f751005ff20 2021-06-25T04:56:22.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.403+0000 7f750f7fe700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74f0055510 0x7f74f00579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.403+0000 7f750f7fe700 1 -- 172.21.15.57:0/1971901927 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f750006e630 con 0x7f751005ff20 2021-06-25T04:56:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.403+0000 7f75159d8700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74f0055510 0x7f74f00579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.403+0000 7f75159d8700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74f0055510 0x7f74f00579d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f750400b000 tx=0x7f7504009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.407+0000 7f750f7fe700 1 -- 172.21.15.57:0/1971901927 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7500044a40 con 0x7f751005ff20 2021-06-25T04:56:22.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.539+0000 7f751843d700 1 -- 172.21.15.57:0/1971901927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f75100698a0 con 0x7f751005ff20 2021-06-25T04:56:22.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.539+0000 7f750f7fe700 1 -- 172.21.15.57:0/1971901927 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v134) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7500048060 con 0x7f751005ff20 2021-06-25T04:56:22.547 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:22.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 -- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74f0055510 msgr2=0x7f74f00579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74f0055510 0x7f74f00579d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f750400b000 tx=0x7f7504009040).stop 2021-06-25T04:56:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 -- 172.21.15.57:0/1971901927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f751005ff20 msgr2=0x7f75100b5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f751005ff20 0x7f75100b5c60 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f750000c000 tx=0x7f75000091d0).stop 2021-06-25T04:56:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 -- 172.21.15.57:0/1971901927 shutdown_connections 2021-06-25T04:56:22.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f74f0055510 0x7f74f00579d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75100b26d0 0x7f751013e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7510061190 0x7f751013e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 --2- 172.21.15.57:0/1971901927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f751005ff20 0x7f75100b5c60 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 -- 172.21.15.57:0/1971901927 >> 172.21.15.57:0/1971901927 conn(0x7f751005cf20 msgr2=0x7f75100b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:22.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 -- 172.21.15.57:0/1971901927 shutdown_connections 2021-06-25T04:56:22.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.543+0000 7f751843d700 1 -- 172.21.15.57:0/1971901927 wait complete. 2021-06-25T04:56:22.559 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:56:22.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.655+0000 7f2ca103c700 1 Processor -- start 2021-06-25T04:56:22.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.655+0000 7f2ca103c700 1 -- start start 2021-06-25T04:56:22.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2ca103c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2c9c0b1930 0x7f2c9c05fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2ca103c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9c0a7a50 con 0x7f2c9c067140 2021-06-25T04:56:22.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2ca103c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9c1475e0 con 0x7f2c9c0a7670 2021-06-25T04:56:22.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2ca103c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c9c147880 con 0x7f2c9c0b1930 2021-06-25T04:56:22.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c93fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2c9c067140 0x7f2c9c05f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60336/0 (socket says 172.21.15.57:60336) 2021-06-25T04:56:22.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c93fff700 1 -- 172.21.15.57:0/1170061 learned_addr learned my addr 172.21.15.57:0/1170061 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:22.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9b59e700 1 --2- 172.21.15.57:0/1170061 >> v2:172.21.15.87:3300/0 conn(0x7f2c9c0b1930 0x7f2c9c05fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750511297 0 0) 0x7f2c9c0a7a50 con 0x7f2c9c067140 2021-06-25T04:56:22.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c7c003260 con 0x7f2c9c067140 2021-06-25T04:56:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3178803451 0 0) 0x7f2c7c003260 con 0x7f2c9c067140 2021-06-25T04:56:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 >> v2:172.21.15.87:3300/0 conn(0x7f2c9c0b1930 msgr2=0x7f2c9c05fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 --2- 172.21.15.57:0/1170061 >> v2:172.21.15.87:3300/0 conn(0x7f2c9c0b1930 0x7f2c9c05fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 >> v1:172.21.15.87:6789/0 conn(0x7f2c9c0a7670 legacy=0x7f2c9c066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9c147b20 con 0x7f2c9c067140 2021-06-25T04:56:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f2c84001660 con 0x7f2c9c067140 2021-06-25T04:56:22.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 >> v1:172.21.15.57:6789/0 conn(0x7f2c9c067140 legacy=0x7f2c9c05f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 --2- 172.21.15.57:0/1170061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7c003750 0x7f2c7c003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 --2- 172.21.15.57:0/1170061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c7c004500 0x7f2c7c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 --2- 172.21.15.57:0/1170061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c7c004e70 0x7f2c7c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c147880 con 0x7f2c7c003750 2021-06-25T04:56:22.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c00bc70 con 0x7f2c7c004e70 2021-06-25T04:56:22.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c00be30 con 0x7f2c7c004500 2021-06-25T04:56:22.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9ad9d700 1 --2- 172.21.15.57:0/1170061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7c003750 0x7f2c7c003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9b59e700 1 --2- 172.21.15.57:0/1170061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c7c004e70 0x7f2c7c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c93fff700 1 --2- 172.21.15.57:0/1170061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c7c004500 0x7f2c7c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9ad9d700 1 -- 172.21.15.57:0/1170061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c7c004500 msgr2=0x7f2c7c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9ad9d700 1 --2- 172.21.15.57:0/1170061 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c7c004500 0x7f2c7c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9ad9d700 1 -- 172.21.15.57:0/1170061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c7c004e70 msgr2=0x7f2c7c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9ad9d700 1 --2- 172.21.15.57:0/1170061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c7c004e70 0x7f2c7c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9b59e700 1 -- 172.21.15.57:0/1170061 reap_dead start 2021-06-25T04:56:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9ad9d700 1 -- 172.21.15.57:0/1170061 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c003260 con 0x7f2c7c003750 2021-06-25T04:56:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9ad9d700 1 --2- 172.21.15.57:0/1170061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7c003750 0x7f2c7c003b30 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f2c8c001040 tx=0x7f2c8c007a00).ready entity=mon.0 client_cookie=814784a3f78e51e9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c8c014410 con 0x7f2c7c003750 2021-06-25T04:56:22.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c014570 con 0x7f2c7c003750 2021-06-25T04:56:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2c9a59c700 1 -- 172.21.15.57:0/1170061 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c8c0148d0 con 0x7f2c7c003750 2021-06-25T04:56:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2ca103c700 1 -- 172.21.15.57:0/1170061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7c003750 msgr2=0x7f2c7c003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2ca103c700 1 --2- 172.21.15.57:0/1170061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7c003750 0x7f2c7c003b30 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f2c8c001040 tx=0x7f2c8c007a00).stop 2021-06-25T04:56:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2ca103c700 1 -- 172.21.15.57:0/1170061 shutdown_connections 2021-06-25T04:56:22.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2ca103c700 1 --2- 172.21.15.57:0/1170061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7c003750 0x7f2c7c003b30 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2ca103c700 1 -- 172.21.15.57:0/1170061 >> 172.21.15.57:0/1170061 conn(0x7f2c9c0b53a0 msgr2=0x7f2c9c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2ca103c700 1 -- 172.21.15.57:0/1170061 shutdown_connections 2021-06-25T04:56:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.659+0000 7f2ca103c700 1 -- 172.21.15.57:0/1170061 wait complete. 2021-06-25T04:56:22.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2ca103c700 1 Processor -- start 2021-06-25T04:56:22.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2ca103c700 1 -- start start 2021-06-25T04:56:22.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2ca103c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c7c003750 0x7f2c9c0aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2ca103c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c0aa270 0x7f2c9c14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2ca103c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c9c0abb20 0x7f2c9c1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2ca103c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c0ab120 con 0x7f2c9c0aa270 2021-06-25T04:56:22.679 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2ca103c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c156fd0 con 0x7f2c9c0abb20 2021-06-25T04:56:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2ca103c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c0ac660 con 0x7f2c7c003750 2021-06-25T04:56:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c93fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c0aa270 0x7f2c9c14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c9ad9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c7c003750 0x7f2c9c0aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c93fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c0aa270 0x7f2c9c14d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43132/0 (socket says 172.21.15.57:43132) 2021-06-25T04:56:22.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c93fff700 1 -- 172.21.15.57:0/3260835692 learned_addr learned my addr 172.21.15.57:0/3260835692 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c9b59e700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c9c0abb20 0x7f2c9c1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c93fff700 1 -- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c7c003750 msgr2=0x7f2c9c0aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c93fff700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c7c003750 0x7f2c9c0aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c93fff700 1 -- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c9c0abb20 msgr2=0x7f2c9c1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c93fff700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c9c0abb20 0x7f2c9c1599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c93fff700 1 -- 172.21.15.57:0/3260835692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9c0ac900 con 0x7f2c9c0aa270 2021-06-25T04:56:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c93fff700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c0aa270 0x7f2c9c14d140 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f2c8400b000 tx=0x7f2c9c0a8c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c98d99700 1 -- 172.21.15.57:0/3260835692 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c84010640 con 0x7f2c9c0aa270 2021-06-25T04:56:22.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c98d99700 1 -- 172.21.15.57:0/3260835692 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c840107a0 con 0x7f2c9c0aa270 2021-06-25T04:56:22.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2ca103c700 1 -- 172.21.15.57:0/3260835692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9c157230 con 0x7f2c9c0aa270 2021-06-25T04:56:22.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2c98d99700 1 -- 172.21.15.57:0/3260835692 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c84010b00 con 0x7f2c9c0aa270 2021-06-25T04:56:22.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.663+0000 7f2ca103c700 1 -- 172.21.15.57:0/3260835692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9c14d630 con 0x7f2c9c0aa270 2021-06-25T04:56:22.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.667+0000 7f2ca103c700 1 -- 172.21.15.57:0/3260835692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9c0ac4c0 con 0x7f2c9c0aa270 2021-06-25T04:56:22.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.667+0000 7f2c98d99700 1 -- 172.21.15.57:0/3260835692 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2c84010c60 con 0x7f2c9c0aa270 2021-06-25T04:56:22.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.667+0000 7f2c98d99700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c80055360 0x7f2c80057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.667+0000 7f2c98d99700 1 -- 172.21.15.57:0/3260835692 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f2c8406da70 con 0x7f2c9c0aa270 2021-06-25T04:56:22.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.667+0000 7f2c9ad9d700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c80055360 0x7f2c80057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.671+0000 7f2c9ad9d700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c80055360 0x7f2c80057820 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f2c8c01c000 tx=0x7f2c8c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.675+0000 7f2c98d99700 1 -- 172.21.15.57:0/3260835692 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2c9c0ac4c0 con 0x7f2c9c0aa270 2021-06-25T04:56:22.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.803+0000 7f2ca103c700 1 -- 172.21.15.57:0/3260835692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2c9c0ac4c0 con 0x7f2c9c0aa270 2021-06-25T04:56:22.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.803+0000 7f2c98d99700 1 -- 172.21.15.57:0/3260835692 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v134) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2c9c0ac4c0 con 0x7f2c9c0aa270 2021-06-25T04:56:22.809 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:22.809 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:56:22.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:22.809 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:56:22.810 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:56:22.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:22.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:22.810 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:56:22.810 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:56:22.811 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:22.811 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:56:22.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.803+0000 7f2ca103c700 1 -- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c80055360 msgr2=0x7f2c80057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.803+0000 7f2ca103c700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c80055360 0x7f2c80057820 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f2c8c01c000 tx=0x7f2c8c015000).stop 2021-06-25T04:56:22.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.803+0000 7f2ca103c700 1 -- 172.21.15.57:0/3260835692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c0aa270 msgr2=0x7f2c9c14d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.803+0000 7f2ca103c700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c0aa270 0x7f2c9c14d140 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f2c8400b000 tx=0x7f2c9c0a8c40).stop 2021-06-25T04:56:22.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.807+0000 7f2ca103c700 1 -- 172.21.15.57:0/3260835692 shutdown_connections 2021-06-25T04:56:22.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.807+0000 7f2ca103c700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c80055360 0x7f2c80057820 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.807+0000 7f2ca103c700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c9c0abb20 0x7f2c9c1599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.807+0000 7f2ca103c700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c0aa270 0x7f2c9c14d140 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.807+0000 7f2ca103c700 1 --2- 172.21.15.57:0/3260835692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c7c003750 0x7f2c9c0aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.807+0000 7f2ca103c700 1 -- 172.21.15.57:0/3260835692 >> 172.21.15.57:0/3260835692 conn(0x7f2c9c0b53a0 msgr2=0x7f2c9c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:22.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.807+0000 7f2ca103c700 1 -- 172.21.15.57:0/3260835692 shutdown_connections 2021-06-25T04:56:22.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.807+0000 7f2ca103c700 1 -- 172.21.15.57:0/3260835692 wait complete. 2021-06-25T04:56:22.821 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:56:22.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:56:22.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8fe7d700 1 Processor -- start 2021-06-25T04:56:22.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8fe7d700 1 -- start start 2021-06-25T04:56:22.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8fe7d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c88146910 0x7f7c881401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8fe7d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7c880b4140 0x7f7c881406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8fe7d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c88143b20 con 0x7f7c880b4650 2021-06-25T04:56:22.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8fe7d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c881474d0 con 0x7f7c880b4140 2021-06-25T04:56:22.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8fe7d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c88143dc0 con 0x7f7c88146910 2021-06-25T04:56:22.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8e41a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7c880b4650 0x7f7c880b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60358/0 (socket says 172.21.15.57:60358) 2021-06-25T04:56:22.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8e41a700 1 -- 172.21.15.57:0/145513627 learned_addr learned my addr 172.21.15.57:0/145513627 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:22.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8d418700 1 --2- 172.21.15.57:0/145513627 >> v2:172.21.15.87:3300/0 conn(0x7f7c880b4140 0x7f7c881406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8dc19700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c88146910 0x7f7c881401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914874297 0 0) 0x7f7c88143b20 con 0x7f7c880b4650 2021-06-25T04:56:22.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c70003260 con 0x7f7c880b4650 2021-06-25T04:56:22.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2531838866 0 0) 0x7f7c70003260 con 0x7f7c880b4650 2021-06-25T04:56:22.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c88146910 msgr2=0x7f7c881401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:22.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8cc17700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c88146910 0x7f7c881401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 >> v2:172.21.15.87:3300/0 conn(0x7f7c880b4140 msgr2=0x7f7c881406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:22.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8cc17700 1 --2- 172.21.15.57:0/145513627 >> v2:172.21.15.87:3300/0 conn(0x7f7c880b4140 0x7f7c881406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c880b0c50 con 0x7f7c880b4650 2021-06-25T04:56:22.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f7c800019e0 con 0x7f7c880b4650 2021-06-25T04:56:22.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.927+0000 7f7c8d418700 1 --2- 172.21.15.57:0/145513627 >> v2:172.21.15.87:3300/0 conn(0x7f7c880b4140 0x7f7c881406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:22.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 >> v1:172.21.15.57:6789/0 conn(0x7f7c880b4650 legacy=0x7f7c880b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8cc17700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c70003750 0x7f7c70003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8cc17700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c70004500 0x7f7c70004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8cc17700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c88146910 0x7f7c70004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c881474d0 con 0x7f7c70003750 2021-06-25T04:56:22.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c88143dc0 con 0x7f7c70004500 2021-06-25T04:56:22.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7000b750 con 0x7f7c88146910 2021-06-25T04:56:22.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8dc19700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c70003750 0x7f7c70003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8d418700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c70004500 0x7f7c70004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8e41a700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c88146910 0x7f7c70004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8dc19700 1 -- 172.21.15.57:0/145513627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c88146910 msgr2=0x7f7c70004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:22.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8dc19700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c88146910 0x7f7c70004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.952 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8dc19700 1 -- 172.21.15.57:0/145513627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c70004500 msgr2=0x7f7c70004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:22.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8dc19700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c70004500 0x7f7c70004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8dc19700 1 -- 172.21.15.57:0/145513627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70003260 con 0x7f7c70003750 2021-06-25T04:56:22.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8dc19700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c70003750 0x7f7c70003b70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f7c7c00c000 tx=0x7f7c7c006df0).ready entity=mon.0 client_cookie=e71d2503b8613cb6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c7c00e830 con 0x7f7c70003750 2021-06-25T04:56:22.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c00e990 con 0x7f7c70003750 2021-06-25T04:56:22.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8cc17700 1 -- 172.21.15.57:0/145513627 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c7c00ecf0 con 0x7f7c70003750 2021-06-25T04:56:22.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/145513627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c70003750 msgr2=0x7f7c70003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8fe7d700 1 --2- 172.21.15.57:0/145513627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c70003750 0x7f7c70003b70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f7c7c00c000 tx=0x7f7c7c006df0).stop 2021-06-25T04:56:22.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8e41a700 1 -- 172.21.15.57:0/145513627 reap_dead start 2021-06-25T04:56:22.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/145513627 shutdown_connections 2021-06-25T04:56:22.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/145513627 >> 172.21.15.57:0/145513627 conn(0x7f7c8805c450 msgr2=0x7f7c8805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:22.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/145513627 shutdown_connections 2021-06-25T04:56:22.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/145513627 wait complete. 2021-06-25T04:56:22.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.931+0000 7f7c8fe7d700 1 Processor -- start 2021-06-25T04:56:22.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8fe7d700 1 -- start start 2021-06-25T04:56:22.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8fe7d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c8813f4f0 0x7f7c88145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8fe7d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c8813bf80 0x7f7c8813c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8fe7d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c88152400 0x7f7c88152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8fe7d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8813f8d0 con 0x7f7c88152400 2021-06-25T04:56:22.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8fe7d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c881565d0 con 0x7f7c8813bf80 2021-06-25T04:56:22.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8fe7d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c88145cd0 con 0x7f7c8813f4f0 2021-06-25T04:56:22.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8e41a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c88152400 0x7f7c88152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8e41a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c88152400 0x7f7c88152880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43152/0 (socket says 172.21.15.57:43152) 2021-06-25T04:56:22.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8d418700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c8813bf80 0x7f7c8813c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8e41a700 1 -- 172.21.15.57:0/2604156756 learned_addr learned my addr 172.21.15.57:0/2604156756 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:22.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8dc19700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c8813f4f0 0x7f7c88145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8e41a700 1 -- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c8813f4f0 msgr2=0x7f7c88145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8e41a700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c8813f4f0 0x7f7c88145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8e41a700 1 -- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c8813bf80 msgr2=0x7f7c8813c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:22.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8e41a700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c8813bf80 0x7f7c8813c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:22.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8e41a700 1 -- 172.21.15.57:0/2604156756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88145f70 con 0x7f7c88152400 2021-06-25T04:56:22.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8e41a700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c88152400 0x7f7c88152880 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f7c80001210 tx=0x7f7c88143000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c7affd700 1 -- 172.21.15.57:0/2604156756 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c80010710 con 0x7f7c88152400 2021-06-25T04:56:22.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c7affd700 1 -- 172.21.15.57:0/2604156756 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c80010870 con 0x7f7c88152400 2021-06-25T04:56:22.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c7affd700 1 -- 172.21.15.57:0/2604156756 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c80010bd0 con 0x7f7c88152400 2021-06-25T04:56:22.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/2604156756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c88146210 con 0x7f7c88152400 2021-06-25T04:56:22.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.935+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/2604156756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8813c8d0 con 0x7f7c88152400 2021-06-25T04:56:22.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.939+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/2604156756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c88057310 con 0x7f7c88152400 2021-06-25T04:56:22.962 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.939+0000 7f7c7affd700 1 -- 172.21.15.57:0/2604156756 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7c80010d30 con 0x7f7c88152400 2021-06-25T04:56:22.962 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.939+0000 7f7c7affd700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c68055340 0x7f7c68057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:22.962 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.939+0000 7f7c7affd700 1 -- 172.21.15.57:0/2604156756 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f7c8006d3b0 con 0x7f7c88152400 2021-06-25T04:56:22.962 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.939+0000 7f7c8dc19700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c68055340 0x7f7c68057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:22.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.939+0000 7f7c8dc19700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c68055340 0x7f7c68057800 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f7c7c01d000 tx=0x7f7c7c019000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:22.963 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:22.947+0000 7f7c7affd700 1 -- 172.21.15.57:0/2604156756 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7c80043800 con 0x7f7c88152400 2021-06-25T04:56:23.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.071+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/2604156756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f7c880698a0 con 0x7f7c88152400 2021-06-25T04:56:23.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.335+0000 7f7c7affd700 1 -- 172.21.15.57:0/2604156756 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v135) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7c80046e20 con 0x7f7c88152400 2021-06-25T04:56:23.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c68055340 msgr2=0x7f7c68057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:23.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c68055340 0x7f7c68057800 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f7c7c01d000 tx=0x7f7c7c019000).stop 2021-06-25T04:56:23.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/2604156756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c88152400 msgr2=0x7f7c88152880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:23.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c88152400 0x7f7c88152880 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f7c80001210 tx=0x7f7c88143000).stop 2021-06-25T04:56:23.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/2604156756 shutdown_connections 2021-06-25T04:56:23.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c68055340 0x7f7c68057800 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:23.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c88152400 0x7f7c88152880 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:23.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c8813bf80 0x7f7c8813c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:23.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 --2- 172.21.15.57:0/2604156756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c8813f4f0 0x7f7c88145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:23.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/2604156756 >> 172.21.15.57:0/2604156756 conn(0x7f7c8805c450 msgr2=0x7f7c8813e150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/2604156756 shutdown_connections 2021-06-25T04:56:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.339+0000 7f7c8fe7d700 1 -- 172.21.15.57:0/2604156756 wait complete. 2021-06-25T04:56:23.348 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:56:23.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:56:23.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.463+0000 7fb3fcbe2700 1 Processor -- start 2021-06-25T04:56:23.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.463+0000 7fb3fcbe2700 1 -- start start 2021-06-25T04:56:23.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.463+0000 7fb3fcbe2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3f80a9e80 0x7fb3f80aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:23.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.463+0000 7fb3fcbe2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3f813f750 0x7fb3f813fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:23.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.463+0000 7fb3fcbe2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f8061950 con 0x7fb3f8060390 2021-06-25T04:56:23.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.463+0000 7fb3fcbe2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f81400b0 con 0x7fb3f80a9e80 2021-06-25T04:56:23.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.463+0000 7fb3fcbe2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f8061bf0 con 0x7fb3f813f750 2021-06-25T04:56:23.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.463+0000 7fb3f659c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3f80a9e80 0x7fb3f80aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:23.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.463+0000 7fb3f6d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3f813f750 0x7fb3f813fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:23.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.463+0000 7fb3f5d9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb3f8060390 0x7fb3f813cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:32890/0 (socket says 172.21.15.57:32890) 2021-06-25T04:56:23.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3f5d9b700 1 -- 172.21.15.57:0/3293392556 learned_addr learned my addr 172.21.15.57:0/3293392556 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:23.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3f559a700 1 -- 172.21.15.57:0/3293392556 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337699049 0 0) 0x7fb3f8061950 con 0x7fb3f8060390 2021-06-25T04:56:23.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3f559a700 1 -- 172.21.15.57:0/3293392556 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3dc003260 con 0x7fb3f8060390 2021-06-25T04:56:23.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3f659c700 1 -- 172.21.15.57:0/3293392556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3f813f750 msgr2=0x7fb3f813fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:23.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3f659c700 1 --2- 172.21.15.57:0/3293392556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3f813f750 0x7fb3f813fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:23.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3f659c700 1 -- 172.21.15.57:0/3293392556 >> v1:172.21.15.87:6789/0 conn(0x7fb3f8060390 legacy=0x7fb3f813cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:23.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3f659c700 1 -- 172.21.15.57:0/3293392556 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8060b50 con 0x7fb3f80a9e80 2021-06-25T04:56:23.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3f659c700 1 --2- 172.21.15.57:0/3293392556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f80a9e80 0x7fb3f80aa260 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fb3e8002f70 tx=0x7fb3e8006df0).ready entity=mon.1 client_cookie=d7aa1b02e301c593 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:23.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3f559a700 1 -- 172.21.15.57:0/3293392556 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3e800d4a0 con 0x7fb3f80a9e80 2021-06-25T04:56:23.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3f559a700 1 -- 172.21.15.57:0/3293392556 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e8000e90 con 0x7fb3f80a9e80 2021-06-25T04:56:23.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3f559a700 1 -- 172.21.15.57:0/3293392556 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3e800d7f0 con 0x7fb3f80a9e80 2021-06-25T04:56:23.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/3293392556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f80a9e80 msgr2=0x7fb3f80aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:23.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3fcbe2700 1 --2- 172.21.15.57:0/3293392556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f80a9e80 0x7fb3f80aa260 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fb3e8002f70 tx=0x7fb3e8006df0).stop 2021-06-25T04:56:23.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/3293392556 shutdown_connections 2021-06-25T04:56:23.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3fcbe2700 1 --2- 172.21.15.57:0/3293392556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3f813f750 0x7fb3f813fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:23.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3fcbe2700 1 --2- 172.21.15.57:0/3293392556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f80a9e80 0x7fb3f80aa260 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:23.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/3293392556 >> 172.21.15.57:0/3293392556 conn(0x7fb3f80b2930 msgr2=0x7fb3f80b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:23.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/3293392556 shutdown_connections 2021-06-25T04:56:23.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/3293392556 wait complete. 2021-06-25T04:56:23.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3fcbe2700 1 Processor -- start 2021-06-25T04:56:23.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.467+0000 7fb3fcbe2700 1 -- start start 2021-06-25T04:56:23.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3fcbe2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3f8060390 0x7fb3f813b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:23.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3fcbe2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f80a9e80 0x7fb3f813a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:23.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3fcbe2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3f813f750 0x7fb3f813a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:23.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3fcbe2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f8063b00 con 0x7fb3f8060390 2021-06-25T04:56:23.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3fcbe2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f80ae090 con 0x7fb3f80a9e80 2021-06-25T04:56:23.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3fcbe2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f813ad10 con 0x7fb3f813f750 2021-06-25T04:56:23.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3f8060390 0x7fb3f813b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:23.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f5d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f80a9e80 0x7fb3f813a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:23.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f6d9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3f813f750 0x7fb3f813a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:23.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f5d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f80a9e80 0x7fb3f813a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:51656/0 (socket says 172.21.15.57:51656) 2021-06-25T04:56:23.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f5d9b700 1 -- 172.21.15.57:0/2318091489 learned_addr learned my addr 172.21.15.57:0/2318091489 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:23.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f659c700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3f8060390 0x7fb3f813b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43164/0 (socket says 172.21.15.57:43164) 2021-06-25T04:56:23.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f5d9b700 1 -- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3f813f750 msgr2=0x7fb3f813a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:23.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f5d9b700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3f813f750 0x7fb3f813a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:23.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f5d9b700 1 -- 172.21.15.57:0/2318091489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3f8060390 msgr2=0x7fb3f813b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:23.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f5d9b700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3f8060390 0x7fb3f813b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:23.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f5d9b700 1 -- 172.21.15.57:0/2318091489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e800b180 con 0x7fb3f80a9e80 2021-06-25T04:56:23.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3f5d9b700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f80a9e80 0x7fb3f813a330 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fb3ec001110 tx=0x7fb3ec007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:23.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3e77fe700 1 -- 172.21.15.57:0/2318091489 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3ec0070d0 con 0x7fb3f80a9e80 2021-06-25T04:56:23.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3e77fe700 1 -- 172.21.15.57:0/2318091489 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec007230 con 0x7fb3f80a9e80 2021-06-25T04:56:23.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3e77fe700 1 -- 172.21.15.57:0/2318091489 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3ec005610 con 0x7fb3f80a9e80 2021-06-25T04:56:23.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/2318091489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f8141f60 con 0x7fb3f80a9e80 2021-06-25T04:56:23.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/2318091489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f80af3a0 con 0x7fb3f80a9e80 2021-06-25T04:56:23.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.471+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/2318091489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f80ae780 con 0x7fb3f80a9e80 2021-06-25T04:56:23.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.475+0000 7fb3e77fe700 1 -- 172.21.15.57:0/2318091489 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb3ec010070 con 0x7fb3f80a9e80 2021-06-25T04:56:23.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.475+0000 7fb3e77fe700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3d4055450 0x7fb3d4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:23.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.475+0000 7fb3e77fe700 1 -- 172.21.15.57:0/2318091489 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5954+0+0 (secure 0 0 0) 0x7fb3ec06d540 con 0x7fb3f80a9e80 2021-06-25T04:56:23.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.475+0000 7fb3f659c700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3d4055450 0x7fb3d4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:23.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.475+0000 7fb3f659c700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3d4055450 0x7fb3d4057910 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fb3e8019000 tx=0x7fb3e8014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:23.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.483+0000 7fb3e77fe700 1 -- 172.21.15.57:0/2318091489 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb3ec043730 con 0x7fb3f80a9e80 2021-06-25T04:56:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:23.611+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/2318091489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fb3f80ae350 con 0x7fb3f80a9e80 2021-06-25T04:56:24.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.339+0000 7fb3e77fe700 1 -- 172.21.15.57:0/2318091489 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v136) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb3ec046d50 con 0x7fb3f80a9e80 2021-06-25T04:56:24.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3d4055450 msgr2=0x7fb3d4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3d4055450 0x7fb3d4057910 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fb3e8019000 tx=0x7fb3e8014000).stop 2021-06-25T04:56:24.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f80a9e80 msgr2=0x7fb3f813a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f80a9e80 0x7fb3f813a330 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fb3ec001110 tx=0x7fb3ec007ad0).stop 2021-06-25T04:56:24.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/2318091489 shutdown_connections 2021-06-25T04:56:24.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3d4055450 0x7fb3d4057910 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3f813f750 0x7fb3f813a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f80a9e80 0x7fb3f813a330 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 --2- 172.21.15.57:0/2318091489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3f8060390 0x7fb3f813b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/2318091489 >> 172.21.15.57:0/2318091489 conn(0x7fb3f80b2930 msgr2=0x7fb3f80b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:24.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/2318091489 shutdown_connections 2021-06-25T04:56:24.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.351+0000 7fb3fcbe2700 1 -- 172.21.15.57:0/2318091489 wait complete. 2021-06-25T04:56:24.360 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:56:24.371 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:56:24.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.475+0000 7f1cf8015700 1 Processor -- start 2021-06-25T04:56:24.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.475+0000 7f1cf8015700 1 -- start start 2021-06-25T04:56:24.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.475+0000 7f1cf8015700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1cf00670e0 0x7f1cf00b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.475+0000 7f1cf8015700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1cf0143970 0x7f1cf00aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.475+0000 7f1cf8015700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf013ffb0 0x7f1cf0140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.475+0000 7f1cf8015700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf0143040 con 0x7f1cf0143970 2021-06-25T04:56:24.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.475+0000 7f1cf8015700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00b9b90 con 0x7f1cf00670e0 2021-06-25T04:56:24.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.475+0000 7f1cf8015700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00674c0 con 0x7f1cf013ffb0 2021-06-25T04:56:24.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf55b0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1cf0143970 0x7f1cf00aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf55b0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1cf0143970 0x7f1cf00aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43170/0 (socket says 172.21.15.57:43170) 2021-06-25T04:56:24.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf55b0700 1 -- 172.21.15.57:0/609158714 learned_addr learned my addr 172.21.15.57:0/609158714 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:24.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf65b2700 1 --2- 172.21.15.57:0/609158714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf013ffb0 0x7f1cf0140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf5db1700 1 --2- 172.21.15.57:0/609158714 >> v2:172.21.15.87:3300/0 conn(0x7f1cf00670e0 0x7f1cf00b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf55b0700 1 -- 172.21.15.57:0/609158714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf013ffb0 msgr2=0x7f1cf0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:24.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf55b0700 1 --2- 172.21.15.57:0/609158714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf013ffb0 0x7f1cf0140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf55b0700 1 -- 172.21.15.57:0/609158714 >> v2:172.21.15.87:3300/0 conn(0x7f1cf00670e0 msgr2=0x7f1cf00b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:24.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf55b0700 1 --2- 172.21.15.57:0/609158714 >> v2:172.21.15.87:3300/0 conn(0x7f1cf00670e0 0x7f1cf00b96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf55b0700 1 -- 172.21.15.57:0/609158714 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf00af490 con 0x7f1cf0143970 2021-06-25T04:56:24.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf65b2700 1 --2- 172.21.15.57:0/609158714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf013ffb0 0x7f1cf0140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:24.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf5db1700 1 --2- 172.21.15.57:0/609158714 >> v2:172.21.15.87:3300/0 conn(0x7f1cf00670e0 0x7f1cf00b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:24.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf55b0700 1 --2- 172.21.15.57:0/609158714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf0143970 0x7f1cf00aebc0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f1ce4002f70 tx=0x7f1ce4006eb0).ready entity=mon.0 client_cookie=c6578d9422c504b8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:24.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf4daf700 1 -- 172.21.15.57:0/609158714 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce400d570 con 0x7f1cf0143970 2021-06-25T04:56:24.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf4daf700 1 -- 172.21.15.57:0/609158714 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce4000e90 con 0x7f1cf0143970 2021-06-25T04:56:24.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf4daf700 1 -- 172.21.15.57:0/609158714 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce400d900 con 0x7f1cf0143970 2021-06-25T04:56:24.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf8015700 1 -- 172.21.15.57:0/609158714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf0143970 msgr2=0x7f1cf00aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf8015700 1 --2- 172.21.15.57:0/609158714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf0143970 0x7f1cf00aebc0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f1ce4002f70 tx=0x7f1ce4006eb0).stop 2021-06-25T04:56:24.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf8015700 1 -- 172.21.15.57:0/609158714 shutdown_connections 2021-06-25T04:56:24.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf8015700 1 --2- 172.21.15.57:0/609158714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf013ffb0 0x7f1cf0140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf8015700 1 --2- 172.21.15.57:0/609158714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf0143970 0x7f1cf00aebc0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf8015700 1 --2- 172.21.15.57:0/609158714 >> v2:172.21.15.87:3300/0 conn(0x7f1cf00670e0 0x7f1cf00b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf8015700 1 -- 172.21.15.57:0/609158714 >> 172.21.15.57:0/609158714 conn(0x7f1cf005f9b0 msgr2=0x7f1cf0061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:24.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf8015700 1 -- 172.21.15.57:0/609158714 shutdown_connections 2021-06-25T04:56:24.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.479+0000 7f1cf8015700 1 -- 172.21.15.57:0/609158714 wait complete. 2021-06-25T04:56:24.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf8015700 1 Processor -- start 2021-06-25T04:56:24.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf8015700 1 -- start start 2021-06-25T04:56:24.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf8015700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf00670e0 0x7f1cf00afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf8015700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf013ffb0 0x7f1cf01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf8015700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf0143970 0x7f1cf0155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf8015700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00b8780 con 0x7f1cf013ffb0 2021-06-25T04:56:24.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf8015700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0061e00 con 0x7f1cf00670e0 2021-06-25T04:56:24.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf8015700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00b9340 con 0x7f1cf0143970 2021-06-25T04:56:24.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf55b0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf013ffb0 0x7f1cf01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf55b0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf013ffb0 0x7f1cf01555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43178/0 (socket says 172.21.15.57:43178) 2021-06-25T04:56:24.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf55b0700 1 -- 172.21.15.57:0/1201375798 learned_addr learned my addr 172.21.15.57:0/1201375798 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:24.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf5db1700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf00670e0 0x7f1cf00afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf65b2700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf0143970 0x7f1cf0155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf55b0700 1 -- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf0143970 msgr2=0x7f1cf0155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf55b0700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf0143970 0x7f1cf0155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf55b0700 1 -- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf00670e0 msgr2=0x7f1cf00afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf55b0700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf00670e0 0x7f1cf00afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.483+0000 7f1cf55b0700 1 -- 172.21.15.57:0/1201375798 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce400b1e0 con 0x7f1cf013ffb0 2021-06-25T04:56:24.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.487+0000 7f1cf55b0700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf013ffb0 0x7f1cf01555a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f1ce4002f70 tx=0x7f1ce4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:24.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.487+0000 7f1ce2ffd700 1 -- 172.21.15.57:0/1201375798 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce4021070 con 0x7f1cf013ffb0 2021-06-25T04:56:24.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.487+0000 7f1ce2ffd700 1 -- 172.21.15.57:0/1201375798 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce4000e90 con 0x7f1cf013ffb0 2021-06-25T04:56:24.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.487+0000 7f1cf8015700 1 -- 172.21.15.57:0/1201375798 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf00b84e0 con 0x7f1cf013ffb0 2021-06-25T04:56:24.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.487+0000 7f1ce2ffd700 1 -- 172.21.15.57:0/1201375798 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce40118d0 con 0x7f1cf013ffb0 2021-06-25T04:56:24.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.487+0000 7f1cf8015700 1 -- 172.21.15.57:0/1201375798 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf00b8f60 con 0x7f1cf013ffb0 2021-06-25T04:56:24.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.487+0000 7f1cf8015700 1 -- 172.21.15.57:0/1201375798 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf0057310 con 0x7f1cf013ffb0 2021-06-25T04:56:24.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.487+0000 7f1ce2ffd700 1 -- 172.21.15.57:0/1201375798 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1ce400f070 con 0x7f1cf013ffb0 2021-06-25T04:56:24.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.487+0000 7f1ce2ffd700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cd0055490 0x7f1cd0057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.487+0000 7f1ce2ffd700 1 -- 172.21.15.57:0/1201375798 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f1ce406f130 con 0x7f1cf013ffb0 2021-06-25T04:56:24.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.487+0000 7f1cf5db1700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cd0055490 0x7f1cd0057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.491+0000 7f1cf5db1700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cd0055490 0x7f1cd0057950 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f1cec00c000 tx=0x7f1cec008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:24.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.495+0000 7f1ce2ffd700 1 -- 172.21.15.57:0/1201375798 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1ce4045360 con 0x7f1cf013ffb0 2021-06-25T04:56:24.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.663+0000 7f1cf8015700 1 -- 172.21.15.57:0/1201375798 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f1cf00698a0 con 0x7f1cf013ffb0 2021-06-25T04:56:24.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.671+0000 7f1ce2ffd700 1 -- 172.21.15.57:0/1201375798 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v68) v1 ==== 189+0+0 (secure 0 0 0) 0x7f1ce4048980 con 0x7f1cf013ffb0 2021-06-25T04:56:24.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 -- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cd0055490 msgr2=0x7f1cd0057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cd0055490 0x7f1cd0057950 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f1cec00c000 tx=0x7f1cec008040).stop 2021-06-25T04:56:24.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 -- 172.21.15.57:0/1201375798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf013ffb0 msgr2=0x7f1cf01555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf013ffb0 0x7f1cf01555a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f1ce4002f70 tx=0x7f1ce4015000).stop 2021-06-25T04:56:24.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 -- 172.21.15.57:0/1201375798 shutdown_connections 2021-06-25T04:56:24.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1cd0055490 0x7f1cd0057950 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf0143970 0x7f1cf0155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf013ffb0 0x7f1cf01555a0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 --2- 172.21.15.57:0/1201375798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf00670e0 0x7f1cf00afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 -- 172.21.15.57:0/1201375798 >> 172.21.15.57:0/1201375798 conn(0x7f1cf005f9b0 msgr2=0x7f1cf00b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:24.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 -- 172.21.15.57:0/1201375798 shutdown_connections 2021-06-25T04:56:24.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.675+0000 7f1cf8015700 1 -- 172.21.15.57:0/1201375798 wait complete. 2021-06-25T04:56:24.687 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 25 and data pool 26 2021-06-25T04:56:24.698 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:24.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 Processor -- start 2021-06-25T04:56:24.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 -- start start 2021-06-25T04:56:24.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb980ae390 0x7fcb98147690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb980b0920 0x7fcb98147b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9805f670 con 0x7fcb9805c450 2021-06-25T04:56:24.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb980ae770 con 0x7fcb980b0920 2021-06-25T04:56:24.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9805f8a0 con 0x7fcb980ae390 2021-06-25T04:56:24.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb967fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb980b0920 0x7fcb98147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb977fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcb9805c450 0x7fcb980a58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60406/0 (socket says 172.21.15.57:60406) 2021-06-25T04:56:24.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb977fe700 1 -- 172.21.15.57:0/2729569657 learned_addr learned my addr 172.21.15.57:0/2729569657 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:24.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb96ffd700 1 --2- 172.21.15.57:0/2729569657 >> v2:172.21.15.87:3300/0 conn(0x7fcb980ae390 0x7fcb98147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb95ffb700 1 -- 172.21.15.57:0/2729569657 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021000963 0 0) 0x7fcb9805f670 con 0x7fcb9805c450 2021-06-25T04:56:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb95ffb700 1 -- 172.21.15.57:0/2729569657 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb78003260 con 0x7fcb9805c450 2021-06-25T04:56:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb967fc700 1 -- 172.21.15.57:0/2729569657 >> v2:172.21.15.87:3300/0 conn(0x7fcb980ae390 msgr2=0x7fcb98147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb967fc700 1 --2- 172.21.15.57:0/2729569657 >> v2:172.21.15.87:3300/0 conn(0x7fcb980ae390 0x7fcb98147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb967fc700 1 -- 172.21.15.57:0/2729569657 >> v1:172.21.15.57:6789/0 conn(0x7fcb9805c450 legacy=0x7fcb980a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb967fc700 1 -- 172.21.15.57:0/2729569657 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9805fb40 con 0x7fcb980b0920 2021-06-25T04:56:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb967fc700 1 --2- 172.21.15.57:0/2729569657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb980b0920 0x7fcb98147b80 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fcb900032f0 tx=0x7fcb900091d0).ready entity=mon.0 client_cookie=4562163abfbbaa2d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb95ffb700 1 -- 172.21.15.57:0/2729569657 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb9000b600 con 0x7fcb980b0920 2021-06-25T04:56:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb95ffb700 1 -- 172.21.15.57:0/2729569657 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9000b760 con 0x7fcb980b0920 2021-06-25T04:56:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb95ffb700 1 -- 172.21.15.57:0/2729569657 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb9000b8d0 con 0x7fcb980b0920 2021-06-25T04:56:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/2729569657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb980b0920 msgr2=0x7fcb98147b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 --2- 172.21.15.57:0/2729569657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb980b0920 0x7fcb98147b80 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fcb900032f0 tx=0x7fcb900091d0).stop 2021-06-25T04:56:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/2729569657 shutdown_connections 2021-06-25T04:56:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 --2- 172.21.15.57:0/2729569657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb980b0920 0x7fcb98147b80 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 --2- 172.21.15.57:0/2729569657 >> v2:172.21.15.87:3300/0 conn(0x7fcb980ae390 0x7fcb98147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.787+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/2729569657 >> 172.21.15.57:0/2729569657 conn(0x7fcb9805cce0 msgr2=0x7fcb98062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:24.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.791+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/2729569657 shutdown_connections 2021-06-25T04:56:24.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.791+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/2729569657 wait complete. 2021-06-25T04:56:24.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.791+0000 7fcb9d5f2700 1 Processor -- start 2021-06-25T04:56:24.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.791+0000 7fcb9d5f2700 1 -- start start 2021-06-25T04:56:24.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb9d5f2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9805c450 0x7fcb98148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb9d5f2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb980ae390 0x7fcb980672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb9d5f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb980b0920 0x7fcb980677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb9d5f2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98066e60 con 0x7fcb9805c450 2021-06-25T04:56:24.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb9d5f2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980af280 con 0x7fcb980b0920 2021-06-25T04:56:24.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb9d5f2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980af4e0 con 0x7fcb980ae390 2021-06-25T04:56:24.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb96ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9805c450 0x7fcb98148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb96ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9805c450 0x7fcb98148130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43190/0 (socket says 172.21.15.57:43190) 2021-06-25T04:56:24.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb96ffd700 1 -- 172.21.15.57:0/3859439373 learned_addr learned my addr 172.21.15.57:0/3859439373 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:24.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb967fc700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb980ae390 0x7fcb980672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb977fe700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb980b0920 0x7fcb980677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb96ffd700 1 -- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb980ae390 msgr2=0x7fcb980672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb96ffd700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb980ae390 0x7fcb980672b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb96ffd700 1 -- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb980b0920 msgr2=0x7fcb980677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb96ffd700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb980b0920 0x7fcb980677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb96ffd700 1 -- 172.21.15.57:0/3859439373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90009470 con 0x7fcb9805c450 2021-06-25T04:56:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb96ffd700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9805c450 0x7fcb98148130 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fcb8800c000 tx=0x7fcb88006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb8ffff700 1 -- 172.21.15.57:0/3859439373 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb88010780 con 0x7fcb9805c450 2021-06-25T04:56:24.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb8ffff700 1 -- 172.21.15.57:0/3859439373 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb880108e0 con 0x7fcb9805c450 2021-06-25T04:56:24.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb8ffff700 1 -- 172.21.15.57:0/3859439373 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb88010c40 con 0x7fcb9805c450 2021-06-25T04:56:24.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/3859439373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb980af780 con 0x7fcb9805c450 2021-06-25T04:56:24.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/3859439373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb98063e60 con 0x7fcb9805c450 2021-06-25T04:56:24.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.795+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/3859439373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb98066fd0 con 0x7fcb9805c450 2021-06-25T04:56:24.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.799+0000 7fcb8ffff700 1 -- 172.21.15.57:0/3859439373 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcb88026430 con 0x7fcb9805c450 2021-06-25T04:56:24.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.799+0000 7fcb8ffff700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb7c055450 0x7fcb7c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:24.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.799+0000 7fcb8ffff700 1 -- 172.21.15.57:0/3859439373 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcb8806ef00 con 0x7fcb9805c450 2021-06-25T04:56:24.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.799+0000 7fcb967fc700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb7c055450 0x7fcb7c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:24.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.799+0000 7fcb967fc700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb7c055450 0x7fcb7c057910 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fcb9001b000 tx=0x7fcb90016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.799+0000 7fcb8ffff700 1 -- 172.21.15.57:0/3859439373 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcb88044f40 con 0x7fcb9805c450 2021-06-25T04:56:24.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.923+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/3859439373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb98057310 con 0x7fcb9805c450 2021-06-25T04:56:24.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb8ffff700 1 -- 172.21.15.57:0/3859439373 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16311 (secure 0 0 0) 0x7fcb88048560 con 0x7fcb9805c450 2021-06-25T04:56:24.932 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:24.933 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":137,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:24.666386+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:56:23.126544+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-06-25T04:56:23.668536+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:24.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb7c055450 msgr2=0x7fcb7c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb7c055450 0x7fcb7c057910 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fcb9001b000 tx=0x7fcb90016000).stop 2021-06-25T04:56:24.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/3859439373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9805c450 msgr2=0x7fcb98148130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:24.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9805c450 0x7fcb98148130 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fcb8800c000 tx=0x7fcb88006df0).stop 2021-06-25T04:56:24.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/3859439373 shutdown_connections 2021-06-25T04:56:24.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fcb7c055450 0x7fcb7c057910 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb980b0920 0x7fcb980677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb980ae390 0x7fcb980672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 --2- 172.21.15.57:0/3859439373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9805c450 0x7fcb98148130 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:24.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/3859439373 >> 172.21.15.57:0/3859439373 conn(0x7fcb9805cce0 msgr2=0x7fcb980b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:24.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/3859439373 shutdown_connections 2021-06-25T04:56:24.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:24.927+0000 7fcb9d5f2700 1 -- 172.21.15.57:0/3859439373 wait complete. 2021-06-25T04:56:24.955 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:25.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.051+0000 7f84503aa700 1 Processor -- start 2021-06-25T04:56:25.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.051+0000 7f84503aa700 1 -- start start 2021-06-25T04:56:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f84503aa700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 0x7f84480b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f84503aa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8448146820 con 0x7f84480b1ea0 2021-06-25T04:56:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f84503aa700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844805f710 con 0x7f84480a93d0 2021-06-25T04:56:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f84503aa700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844805f9b0 con 0x7f84480b27d0 2021-06-25T04:56:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f844e947700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f84480b1ea0 0x7f8448097930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60420/0 (socket says 172.21.15.57:60420) 2021-06-25T04:56:25.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f844e947700 1 -- 172.21.15.57:0/3576562881 learned_addr learned my addr 172.21.15.57:0/3576562881 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:25.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f844e146700 1 --2- 172.21.15.57:0/3576562881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 0x7f84480b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:25.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f844d144700 1 -- 172.21.15.57:0/3576562881 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485956971 0 0) 0x7f8448146820 con 0x7f84480b1ea0 2021-06-25T04:56:25.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f844e146700 1 -- 172.21.15.57:0/3576562881 >> v1:172.21.15.87:6789/0 conn(0x7f84480a93d0 legacy=0x7f84480b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:25.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f844e146700 1 -- 172.21.15.57:0/3576562881 >> v1:172.21.15.57:6789/0 conn(0x7f84480b1ea0 legacy=0x7f8448097930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:25.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f844e146700 1 -- 172.21.15.57:0/3576562881 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844805fc50 con 0x7f84480b27d0 2021-06-25T04:56:25.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f844e146700 1 --2- 172.21.15.57:0/3576562881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 0x7f84480b07d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8444002f70 tx=0x7f8444006df0).ready entity=mon.2 client_cookie=378a2c14427ff7b2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:25.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f844d144700 1 -- 172.21.15.57:0/3576562881 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f844400d5c0 con 0x7f84480b27d0 2021-06-25T04:56:25.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f844d144700 1 -- 172.21.15.57:0/3576562881 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8444000e90 con 0x7f84480b27d0 2021-06-25T04:56:25.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f844d144700 1 -- 172.21.15.57:0/3576562881 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f844400d910 con 0x7f84480b27d0 2021-06-25T04:56:25.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f84503aa700 1 -- 172.21.15.57:0/3576562881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 msgr2=0x7f84480b07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:25.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f84503aa700 1 --2- 172.21.15.57:0/3576562881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 0x7f84480b07d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8444002f70 tx=0x7f8444006df0).stop 2021-06-25T04:56:25.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f84503aa700 1 -- 172.21.15.57:0/3576562881 shutdown_connections 2021-06-25T04:56:25.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f84503aa700 1 --2- 172.21.15.57:0/3576562881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 0x7f84480b07d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f84503aa700 1 -- 172.21.15.57:0/3576562881 >> 172.21.15.57:0/3576562881 conn(0x7f8448062ed0 msgr2=0x7f84480632b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:25.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f84503aa700 1 -- 172.21.15.57:0/3576562881 shutdown_connections 2021-06-25T04:56:25.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.055+0000 7f84503aa700 1 -- 172.21.15.57:0/3576562881 wait complete. 2021-06-25T04:56:25.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84503aa700 1 Processor -- start 2021-06-25T04:56:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84503aa700 1 -- start start 2021-06-25T04:56:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84503aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84480a93d0 0x7f8448146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84503aa700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84480b1ea0 0x7f844814a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84503aa700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 0x7f84480ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84503aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84480ac090 con 0x7f84480a93d0 2021-06-25T04:56:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84503aa700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8448149140 con 0x7f84480b1ea0 2021-06-25T04:56:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84503aa700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84481493e0 con 0x7f84480b27d0 2021-06-25T04:56:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844e146700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84480a93d0 0x7f8448146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844e146700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84480a93d0 0x7f8448146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43204/0 (socket says 172.21.15.57:43204) 2021-06-25T04:56:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844e146700 1 -- 172.21.15.57:0/3730485627 learned_addr learned my addr 172.21.15.57:0/3730485627 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844d945700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84480b1ea0 0x7f844814a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844e947700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 0x7f84480ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844e947700 1 -- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84480b1ea0 msgr2=0x7f844814a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844e947700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84480b1ea0 0x7f844814a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844e947700 1 -- 172.21.15.57:0/3730485627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84480a93d0 msgr2=0x7f8448146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844e947700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84480a93d0 0x7f8448146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844e947700 1 -- 172.21.15.57:0/3730485627 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844400b180 con 0x7f84480b27d0 2021-06-25T04:56:25.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844e146700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84480a93d0 0x7f8448146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:25.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844d945700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84480b1ea0 0x7f844814a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f844e947700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 0x7f84480ae810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f8440001250 tx=0x7f8440007d00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84377fe700 1 -- 172.21.15.57:0/3730485627 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8440005ba0 con 0x7f84480b27d0 2021-06-25T04:56:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84377fe700 1 -- 172.21.15.57:0/3730485627 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8440005d00 con 0x7f84480b27d0 2021-06-25T04:56:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84503aa700 1 -- 172.21.15.57:0/3730485627 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8448149e80 con 0x7f84480b27d0 2021-06-25T04:56:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84377fe700 1 -- 172.21.15.57:0/3730485627 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8440004a90 con 0x7f84480b27d0 2021-06-25T04:56:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.059+0000 7f84503aa700 1 -- 172.21.15.57:0/3730485627 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8448148dc0 con 0x7f84480b27d0 2021-06-25T04:56:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.063+0000 7f84377fe700 1 -- 172.21.15.57:0/3730485627 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8440004bf0 con 0x7f84480b27d0 2021-06-25T04:56:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.063+0000 7f84503aa700 1 -- 172.21.15.57:0/3730485627 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8448057310 con 0x7f84480b27d0 2021-06-25T04:56:25.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.063+0000 7f84377fe700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84280554e0 0x7f84280579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:25.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.063+0000 7f84377fe700 1 -- 172.21.15.57:0/3730485627 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f844006da10 con 0x7f84480b27d0 2021-06-25T04:56:25.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.063+0000 7f844e146700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84280554e0 0x7f84280579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:25.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.063+0000 7f844e146700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84280554e0 0x7f84280579a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f844401b000 tx=0x7f8444015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:25.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.067+0000 7f84377fe700 1 -- 172.21.15.57:0/3730485627 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8440043ae0 con 0x7f84480b27d0 2021-06-25T04:56:25.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.195+0000 7f84503aa700 1 -- 172.21.15.57:0/3730485627 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f844814a010 con 0x7f84480b27d0 2021-06-25T04:56:25.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.195+0000 7f84377fe700 1 -- 172.21.15.57:0/3730485627 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16311 (secure 0 0 0) 0x7f8440047100 con 0x7f84480b27d0 2021-06-25T04:56:25.201 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:25.202 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":137,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:24.666386+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:56:23.126544+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-06-25T04:56:23.668536+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:25.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 -- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84280554e0 msgr2=0x7f84280579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:25.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84280554e0 0x7f84280579a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f844401b000 tx=0x7f8444015000).stop 2021-06-25T04:56:25.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 -- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 msgr2=0x7f84480ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:25.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 0x7f84480ae810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f8440001250 tx=0x7f8440007d00).stop 2021-06-25T04:56:25.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 -- 172.21.15.57:0/3730485627 shutdown_connections 2021-06-25T04:56:25.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84280554e0 0x7f84280579a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84480b27d0 0x7f84480ae810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84480b1ea0 0x7f844814a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 --2- 172.21.15.57:0/3730485627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84480a93d0 0x7f8448146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 -- 172.21.15.57:0/3730485627 >> 172.21.15.57:0/3730485627 conn(0x7f8448062ed0 msgr2=0x7f8448097680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:25.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 -- 172.21.15.57:0/3730485627 shutdown_connections 2021-06-25T04:56:25.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.199+0000 7f84503aa700 1 -- 172.21.15.57:0/3730485627 wait complete. 2021-06-25T04:56:25.215 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:56:25.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a6e6e700 1 Processor -- start 2021-06-25T04:56:25.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a6e6e700 1 -- start start 2021-06-25T04:56:25.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a6e6e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62a00ac220 0x7f62a00b1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:25.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a6e6e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f62a00b0680 0x7f62a00aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:25.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a6e6e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a00b1c20 con 0x7f62a00a9920 2021-06-25T04:56:25.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a6e6e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a00a9d00 con 0x7f62a00b0680 2021-06-25T04:56:25.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a6e6e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00b2900 con 0x7f62a00ac220 2021-06-25T04:56:25.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a540b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f62a00b0680 0x7f62a00aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:25.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a4c0a700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f62a00a9920 0x7f62a00aec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:32946/0 (socket says 172.21.15.57:32946) 2021-06-25T04:56:25.329 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a540b700 1 --2- 172.21.15.57:0/164196467 >> v2:172.21.15.57:3300/0 conn(0x7f62a00b0680 0x7f62a00aaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43216/0 (socket says 172.21.15.57:43216) 2021-06-25T04:56:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a4c0a700 1 -- 172.21.15.57:0/164196467 learned_addr learned my addr 172.21.15.57:0/164196467 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f629ffff700 1 --2- 172.21.15.57:0/164196467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62a00ac220 0x7f62a00b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a540b700 1 -- 172.21.15.57:0/164196467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62a00ac220 msgr2=0x7f62a00b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a540b700 1 --2- 172.21.15.57:0/164196467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62a00ac220 0x7f62a00b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a540b700 1 -- 172.21.15.57:0/164196467 >> v1:172.21.15.87:6789/0 conn(0x7f62a00a9920 legacy=0x7f62a00aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:25.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.319+0000 7f62a540b700 1 -- 172.21.15.57:0/164196467 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a00b0080 con 0x7f62a00b0680 2021-06-25T04:56:25.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a540b700 1 --2- 172.21.15.57:0/164196467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62a00b0680 0x7f62a00aaf60 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f62980032f0 tx=0x7f62980091d0).ready entity=mon.0 client_cookie=3a28e4fabcff6083 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:25.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f629f7fe700 1 -- 172.21.15.57:0/164196467 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f629800b6c0 con 0x7f62a00b0680 2021-06-25T04:56:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f629f7fe700 1 -- 172.21.15.57:0/164196467 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629800b820 con 0x7f62a00b0680 2021-06-25T04:56:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f629f7fe700 1 -- 172.21.15.57:0/164196467 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f629800b990 con 0x7f62a00b0680 2021-06-25T04:56:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 -- 172.21.15.57:0/164196467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62a00b0680 msgr2=0x7f62a00aaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 --2- 172.21.15.57:0/164196467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62a00b0680 0x7f62a00aaf60 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f62980032f0 tx=0x7f62980091d0).stop 2021-06-25T04:56:25.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 -- 172.21.15.57:0/164196467 shutdown_connections 2021-06-25T04:56:25.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 --2- 172.21.15.57:0/164196467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62a00b0680 0x7f62a00aaf60 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 --2- 172.21.15.57:0/164196467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62a00ac220 0x7f62a00b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 -- 172.21.15.57:0/164196467 >> 172.21.15.57:0/164196467 conn(0x7f62a005f670 msgr2=0x7f62a005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:25.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 -- 172.21.15.57:0/164196467 shutdown_connections 2021-06-25T04:56:25.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 -- 172.21.15.57:0/164196467 wait complete. 2021-06-25T04:56:25.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 Processor -- start 2021-06-25T04:56:25.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 -- start start 2021-06-25T04:56:25.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62a00a9920 0x7f62a013f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:25.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62a00ac220 0x7f62a013c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:25.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62a00b0680 0x7f62a013ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:25.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a0062b20 con 0x7f62a00ac220 2021-06-25T04:56:25.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a013d320 con 0x7f62a00b0680 2021-06-25T04:56:25.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f62a6e6e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a0154780 con 0x7f62a00a9920 2021-06-25T04:56:25.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f629ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62a00ac220 0x7f62a013c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:25.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f629ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62a00ac220 0x7f62a013c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43220/0 (socket says 172.21.15.57:43220) 2021-06-25T04:56:25.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.323+0000 7f629ffff700 1 -- 172.21.15.57:0/1658601772 learned_addr learned my addr 172.21.15.57:0/1658601772 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:25.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f62a4c0a700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62a00a9920 0x7f62a013f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:25.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f62a540b700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62a00b0680 0x7f62a013ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629ffff700 1 -- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62a00a9920 msgr2=0x7f62a013f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629ffff700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62a00a9920 0x7f62a013f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629ffff700 1 -- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62a00b0680 msgr2=0x7f62a013ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629ffff700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62a00b0680 0x7f62a013ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629ffff700 1 -- 172.21.15.57:0/1658601772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6298009470 con 0x7f62a00ac220 2021-06-25T04:56:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f62a540b700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62a00b0680 0x7f62a013ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629ffff700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62a00ac220 0x7f62a013c940 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f628c00c000 tx=0x7f628c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:25.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629dffb700 1 -- 172.21.15.57:0/1658601772 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f628c010780 con 0x7f62a00ac220 2021-06-25T04:56:25.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629dffb700 1 -- 172.21.15.57:0/1658601772 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c0108e0 con 0x7f62a00ac220 2021-06-25T04:56:25.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629dffb700 1 -- 172.21.15.57:0/1658601772 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f628c010c40 con 0x7f62a00ac220 2021-06-25T04:56:25.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f62a6e6e700 1 -- 172.21.15.57:0/1658601772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a0154a20 con 0x7f62a00ac220 2021-06-25T04:56:25.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f62a6e6e700 1 -- 172.21.15.57:0/1658601772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a0143f40 con 0x7f62a00ac220 2021-06-25T04:56:25.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629dffb700 1 -- 172.21.15.57:0/1658601772 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f628c01c460 con 0x7f62a00ac220 2021-06-25T04:56:25.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f62a6e6e700 1 -- 172.21.15.57:0/1658601772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a0057310 con 0x7f62a00ac220 2021-06-25T04:56:25.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629dffb700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f62880554e0 0x7f62880579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:25.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f629dffb700 1 -- 172.21.15.57:0/1658601772 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f628c06e400 con 0x7f62a00ac220 2021-06-25T04:56:25.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.327+0000 7f62a4c0a700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f62880554e0 0x7f62880579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:25.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.331+0000 7f62a4c0a700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f62880554e0 0x7f62880579a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f629400d000 tx=0x7f6294009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:25.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.331+0000 7f629dffb700 1 -- 172.21.15.57:0/1658601772 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f628c0444b0 con 0x7f62a00ac220 2021-06-25T04:56:25.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:25.499+0000 7f62a6e6e700 1 -- 172.21.15.57:0/1658601772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f62a0067c60 con 0x7f62a00ac220 2021-06-25T04:56:26.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.367+0000 7f629dffb700 1 -- 172.21.15.57:0/1658601772 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) v1 ==== 118+0+0 (secure 0 0 0) 0x7f628c047ad0 con 0x7f62a00ac220 2021-06-25T04:56:26.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 -- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f62880554e0 msgr2=0x7f62880579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f62880554e0 0x7f62880579a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f629400d000 tx=0x7f6294009040).stop 2021-06-25T04:56:26.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 -- 172.21.15.57:0/1658601772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62a00ac220 msgr2=0x7f62a013c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62a00ac220 0x7f62a013c940 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f628c00c000 tx=0x7f628c006df0).stop 2021-06-25T04:56:26.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 -- 172.21.15.57:0/1658601772 shutdown_connections 2021-06-25T04:56:26.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f62880554e0 0x7f62880579a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62a00b0680 0x7f62a013ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62a00ac220 0x7f62a013c940 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 --2- 172.21.15.57:0/1658601772 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62a00a9920 0x7f62a013f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 -- 172.21.15.57:0/1658601772 >> 172.21.15.57:0/1658601772 conn(0x7f62a005f670 msgr2=0x7f62a0141250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:26.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 -- 172.21.15.57:0/1658601772 shutdown_connections 2021-06-25T04:56:26.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.371+0000 7f62a6e6e700 1 -- 172.21.15.57:0/1658601772 wait complete. 2021-06-25T04:56:26.392 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:26.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.499+0000 7fb6ef59e700 1 Processor -- start 2021-06-25T04:56:26.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.499+0000 7fb6ef59e700 1 -- start start 2021-06-25T04:56:26.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb6f00b5460 0x7fb6f00af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f0147560 0x7fb6f00acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f00b5840 con 0x7fb6f00b05d0 2021-06-25T04:56:26.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f01452a0 con 0x7fb6f00b5460 2021-06-25T04:56:26.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f00adfb0 con 0x7fb6f0147560 2021-06-25T04:56:26.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6eed9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f0147560 0x7fb6f00acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ee59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb6f00b5460 0x7fb6f00af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ee59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb6f00b5460 0x7fb6f00af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:51720/0 (socket says 172.21.15.57:51720) 2021-06-25T04:56:26.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ee59c700 1 -- 172.21.15.57:0/3648236136 learned_addr learned my addr 172.21.15.57:0/3648236136 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:26.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6eed9d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f0147560 0x7fb6f00acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:54394/0 (socket says 172.21.15.57:54394) 2021-06-25T04:56:26.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6edd9b700 1 --1- 172.21.15.57:0/3648236136 >> v1:172.21.15.87:6789/0 conn(0x7fb6f00b05d0 0x7fb6f0067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:32960/0 (socket says 172.21.15.57:32960) 2021-06-25T04:56:26.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ed59a700 1 -- 172.21.15.57:0/3648236136 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782750625 0 0) 0x7fb6f00b5840 con 0x7fb6f00b05d0 2021-06-25T04:56:26.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ee59c700 1 -- 172.21.15.57:0/3648236136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f0147560 msgr2=0x7fb6f00acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:26.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ee59c700 1 --2- 172.21.15.57:0/3648236136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f0147560 0x7fb6f00acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ee59c700 1 -- 172.21.15.57:0/3648236136 >> v1:172.21.15.87:6789/0 conn(0x7fb6f00b05d0 legacy=0x7fb6f0067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ee59c700 1 -- 172.21.15.57:0/3648236136 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f00ac7c0 con 0x7fb6f00b5460 2021-06-25T04:56:26.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6eed9d700 1 --2- 172.21.15.57:0/3648236136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f0147560 0x7fb6f00acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:26.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ee59c700 1 --2- 172.21.15.57:0/3648236136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6f00b5460 0x7fb6f00af510 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fb6e4002f70 tx=0x7fb6e4006eb0).ready entity=mon.1 client_cookie=29d2ac1f64fa8dce server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:26.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ed59a700 1 -- 172.21.15.57:0/3648236136 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e400d570 con 0x7fb6f00b5460 2021-06-25T04:56:26.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ed59a700 1 -- 172.21.15.57:0/3648236136 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e4000e90 con 0x7fb6f00b5460 2021-06-25T04:56:26.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ed59a700 1 -- 172.21.15.57:0/3648236136 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e400d8c0 con 0x7fb6f00b5460 2021-06-25T04:56:26.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 -- 172.21.15.57:0/3648236136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6f00b5460 msgr2=0x7fb6f00af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 --2- 172.21.15.57:0/3648236136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6f00b5460 0x7fb6f00af510 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fb6e4002f70 tx=0x7fb6e4006eb0).stop 2021-06-25T04:56:26.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 -- 172.21.15.57:0/3648236136 shutdown_connections 2021-06-25T04:56:26.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 --2- 172.21.15.57:0/3648236136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f0147560 0x7fb6f00acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 --2- 172.21.15.57:0/3648236136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6f00b5460 0x7fb6f00af510 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 -- 172.21.15.57:0/3648236136 >> 172.21.15.57:0/3648236136 conn(0x7fb6f0062520 msgr2=0x7fb6f0062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:26.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 -- 172.21.15.57:0/3648236136 shutdown_connections 2021-06-25T04:56:26.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.503+0000 7fb6ef59e700 1 -- 172.21.15.57:0/3648236136 wait complete. 2021-06-25T04:56:26.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.507+0000 7fb6ef59e700 1 Processor -- start 2021-06-25T04:56:26.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.507+0000 7fb6ef59e700 1 -- start start 2021-06-25T04:56:26.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.507+0000 7fb6ef59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f00b05d0 0x7fb6f0063850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.507+0000 7fb6ef59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f00b5460 0x7fb6f0145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.507+0000 7fb6ef59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6f0147560 0x7fb6f0159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.507+0000 7fb6ef59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f0064090 con 0x7fb6f00b5460 2021-06-25T04:56:26.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.507+0000 7fb6ef59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f0066fa0 con 0x7fb6f0147560 2021-06-25T04:56:26.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.507+0000 7fb6ef59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f0146e50 con 0x7fb6f00b05d0 2021-06-25T04:56:26.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.507+0000 7fb6edd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f00b5460 0x7fb6f0145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.507+0000 7fb6edd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f00b5460 0x7fb6f0145e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43234/0 (socket says 172.21.15.57:43234) 2021-06-25T04:56:26.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.507+0000 7fb6edd9b700 1 -- 172.21.15.57:0/1972633810 learned_addr learned my addr 172.21.15.57:0/1972633810 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:26.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6ee59c700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f00b05d0 0x7fb6f0063850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6eed9d700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6f0147560 0x7fb6f0159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6edd9b700 1 -- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f00b05d0 msgr2=0x7fb6f0063850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6edd9b700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f00b05d0 0x7fb6f0063850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6edd9b700 1 -- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6f0147560 msgr2=0x7fb6f0159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6edd9b700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6f0147560 0x7fb6f0159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6edd9b700 1 -- 172.21.15.57:0/1972633810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e800b180 con 0x7fb6f00b5460 2021-06-25T04:56:26.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6edd9b700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f00b5460 0x7fb6f0145e50 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fb6e0001250 tx=0x7fb6e0007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:26.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6df7fe700 1 -- 172.21.15.57:0/1972633810 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e0005ae0 con 0x7fb6f00b5460 2021-06-25T04:56:26.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6df7fe700 1 -- 172.21.15.57:0/1972633810 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e0005c40 con 0x7fb6f00b5460 2021-06-25T04:56:26.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6ef59e700 1 -- 172.21.15.57:0/1972633810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e400b1e0 con 0x7fb6f00b5460 2021-06-25T04:56:26.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6df7fe700 1 -- 172.21.15.57:0/1972633810 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e00070d0 con 0x7fb6f00b5460 2021-06-25T04:56:26.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6ef59e700 1 -- 172.21.15.57:0/1972633810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f0063d40 con 0x7fb6f00b5460 2021-06-25T04:56:26.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6ef59e700 1 -- 172.21.15.57:0/1972633810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f0063f00 con 0x7fb6f00b5460 2021-06-25T04:56:26.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.511+0000 7fb6df7fe700 1 -- 172.21.15.57:0/1972633810 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb6e001a060 con 0x7fb6f00b5460 2021-06-25T04:56:26.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.515+0000 7fb6df7fe700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb6cc055450 0x7fb6cc057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.515+0000 7fb6df7fe700 1 -- 172.21.15.57:0/1972633810 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb6e006d6b0 con 0x7fb6f00b5460 2021-06-25T04:56:26.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.515+0000 7fb6ee59c700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb6cc055450 0x7fb6cc057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.515+0000 7fb6ee59c700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb6cc055450 0x7fb6cc057910 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fb6e401b000 tx=0x7fb6e4015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:26.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.519+0000 7fb6df7fe700 1 -- 172.21.15.57:0/1972633810 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb6e0043750 con 0x7fb6f00b5460 2021-06-25T04:56:26.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 -- 172.21.15.57:0/1972633810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6f0141cc0 con 0x7fb6f00b5460 2021-06-25T04:56:26.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6df7fe700 1 -- 172.21.15.57:0/1972633810 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fb6e0018090 con 0x7fb6f00b5460 2021-06-25T04:56:26.692 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:26.693 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3591673245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3591673245},{"type":"v1","addr":"172.21.15.57:6833","nonce":3591673245}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2597000234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2597000234},{"type":"v1","addr":"172.21.15.57:6835","nonce":2597000234}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:24.666625+0000","modified":"2021-06-25T04:56:26.355926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8088":{"gid":8088,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2964573030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2964573030},{"type":"v1","addr":"172.21.15.87:6835","nonce":2964573030}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-06-25T04:56:26.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 -- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb6cc055450 msgr2=0x7fb6cc057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.694 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb6cc055450 0x7fb6cc057910 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fb6e401b000 tx=0x7fb6e4015000).stop 2021-06-25T04:56:26.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 -- 172.21.15.57:0/1972633810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f00b5460 msgr2=0x7fb6f0145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f00b5460 0x7fb6f0145e50 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fb6e0001250 tx=0x7fb6e0007e40).stop 2021-06-25T04:56:26.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 -- 172.21.15.57:0/1972633810 shutdown_connections 2021-06-25T04:56:26.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb6cc055450 0x7fb6cc057910 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6f0147560 0x7fb6f0159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f00b5460 0x7fb6f0145e50 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 --2- 172.21.15.57:0/1972633810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb6f00b05d0 0x7fb6f0063850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 -- 172.21.15.57:0/1972633810 >> 172.21.15.57:0/1972633810 conn(0x7fb6f0062520 msgr2=0x7fb6f014ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:26.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 -- 172.21.15.57:0/1972633810 shutdown_connections 2021-06-25T04:56:26.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.687+0000 7fb6ef59e700 1 -- 172.21.15.57:0/1972633810 wait complete. 2021-06-25T04:56:26.697 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 70 2021-06-25T04:56:26.705 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:26.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.795+0000 7fd35e0e8700 1 Processor -- start 2021-06-25T04:56:26.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.795+0000 7fd35e0e8700 1 -- start start 2021-06-25T04:56:26.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd35e0e8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3580b96a0 0x7fd3580aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd35e0e8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd35813ffb0 0x7fd358140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd35e0e8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580674c0 con 0x7fd3580670e0 2021-06-25T04:56:26.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd35e0e8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd358143040 con 0x7fd35813ffb0 2021-06-25T04:56:26.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd35e0e8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580af490 con 0x7fd3580b96a0 2021-06-25T04:56:26.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd357fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd35813ffb0 0x7fd358140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd357fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd35813ffb0 0x7fd358140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43244/0 (socket says 172.21.15.57:43244) 2021-06-25T04:56:26.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd357fff700 1 -- 172.21.15.57:0/4091913150 learned_addr learned my addr 172.21.15.57:0/4091913150 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:26.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd356ffd700 1 --2- 172.21.15.57:0/4091913150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3580b96a0 0x7fd3580aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd357fff700 1 -- 172.21.15.57:0/4091913150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3580b96a0 msgr2=0x7fd3580aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:26.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd357fff700 1 --2- 172.21.15.57:0/4091913150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3580b96a0 0x7fd3580aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd357fff700 1 -- 172.21.15.57:0/4091913150 >> v1:172.21.15.87:6789/0 conn(0x7fd3580670e0 legacy=0x7fd358143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd357fff700 1 -- 172.21.15.57:0/4091913150 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358143230 con 0x7fd35813ffb0 2021-06-25T04:56:26.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd357fff700 1 --2- 172.21.15.57:0/4091913150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd35813ffb0 0x7fd358140440 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7fd3500032f0 tx=0x7fd350009290).ready entity=mon.0 client_cookie=3aadf735fbcad719 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:26.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd3567fc700 1 -- 172.21.15.57:0/4091913150 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd35000b8a0 con 0x7fd35813ffb0 2021-06-25T04:56:26.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd3567fc700 1 -- 172.21.15.57:0/4091913150 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35000ba00 con 0x7fd35813ffb0 2021-06-25T04:56:26.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd3567fc700 1 -- 172.21.15.57:0/4091913150 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd35000bb70 con 0x7fd35813ffb0 2021-06-25T04:56:26.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd35e0e8700 1 -- 172.21.15.57:0/4091913150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd35813ffb0 msgr2=0x7fd358140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.799+0000 7fd35e0e8700 1 --2- 172.21.15.57:0/4091913150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd35813ffb0 0x7fd358140440 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7fd3500032f0 tx=0x7fd350009290).stop 2021-06-25T04:56:26.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 -- 172.21.15.57:0/4091913150 shutdown_connections 2021-06-25T04:56:26.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 --2- 172.21.15.57:0/4091913150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd35813ffb0 0x7fd358140440 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 --2- 172.21.15.57:0/4091913150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3580b96a0 0x7fd3580aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 -- 172.21.15.57:0/4091913150 >> 172.21.15.57:0/4091913150 conn(0x7fd35805f9b0 msgr2=0x7fd358061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:26.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 -- 172.21.15.57:0/4091913150 shutdown_connections 2021-06-25T04:56:26.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 -- 172.21.15.57:0/4091913150 wait complete. 2021-06-25T04:56:26.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 Processor -- start 2021-06-25T04:56:26.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 -- start start 2021-06-25T04:56:26.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580670e0 0x7fd358137590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3580b96a0 0x7fd3581386c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd35813ffb0 0x7fd3580af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358148840 con 0x7fd35813ffb0 2021-06-25T04:56:26.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358147d80 con 0x7fd3580670e0 2021-06-25T04:56:26.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd35e0e8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd358139ca0 con 0x7fd3580b96a0 2021-06-25T04:56:26.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd357fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd35813ffb0 0x7fd3580af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd357fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd35813ffb0 0x7fd3580af8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43250/0 (socket says 172.21.15.57:43250) 2021-06-25T04:56:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd357fff700 1 -- 172.21.15.57:0/118113216 learned_addr learned my addr 172.21.15.57:0/118113216 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.803+0000 7fd356ffd700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3580b96a0 0x7fd3581386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd3577fe700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580670e0 0x7fd358137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd357fff700 1 -- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3580b96a0 msgr2=0x7fd3581386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd357fff700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3580b96a0 0x7fd3581386c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd357fff700 1 -- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580670e0 msgr2=0x7fd358137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd357fff700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580670e0 0x7fd358137590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd357fff700 1 -- 172.21.15.57:0/118113216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd350009530 con 0x7fd35813ffb0 2021-06-25T04:56:26.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd357fff700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd35813ffb0 0x7fd3580af8a0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fd3500032f0 tx=0x7fd350016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:26.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd354ff9700 1 -- 172.21.15.57:0/118113216 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd350011c10 con 0x7fd35813ffb0 2021-06-25T04:56:26.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd354ff9700 1 -- 172.21.15.57:0/118113216 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350011d70 con 0x7fd35813ffb0 2021-06-25T04:56:26.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd35e0e8700 1 -- 172.21.15.57:0/118113216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd358148a70 con 0x7fd35813ffb0 2021-06-25T04:56:26.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd354ff9700 1 -- 172.21.15.57:0/118113216 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd35001f610 con 0x7fd35813ffb0 2021-06-25T04:56:26.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd35e0e8700 1 -- 172.21.15.57:0/118113216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3581383c0 con 0x7fd35813ffb0 2021-06-25T04:56:26.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd35e0e8700 1 -- 172.21.15.57:0/118113216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3581380b0 con 0x7fd35813ffb0 2021-06-25T04:56:26.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.807+0000 7fd354ff9700 1 -- 172.21.15.57:0/118113216 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd35000f070 con 0x7fd35813ffb0 2021-06-25T04:56:26.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.811+0000 7fd354ff9700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3380554e0 0x7fd3380579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.811+0000 7fd354ff9700 1 -- 172.21.15.57:0/118113216 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd35006e800 con 0x7fd35813ffb0 2021-06-25T04:56:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.811+0000 7fd3577fe700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3380554e0 0x7fd3380579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:26.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.811+0000 7fd3577fe700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3380554e0 0x7fd3380579a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fd34800d000 tx=0x7fd348009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:26.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.819+0000 7fd354ff9700 1 -- 172.21.15.57:0/118113216 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd3500449b0 con 0x7fd35813ffb0 2021-06-25T04:56:26.953 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.947+0000 7fd35e0e8700 1 -- 172.21.15.57:0/118113216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd358057310 con 0x7fd35813ffb0 2021-06-25T04:56:26.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd354ff9700 1 -- 172.21.15.57:0/118113216 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fd350030fb0 con 0x7fd35813ffb0 2021-06-25T04:56:26.955 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:26.956 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":139,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:26.672360+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:56:23.126544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-06-25T04:56:23.668536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 -- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3380554e0 msgr2=0x7fd3380579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3380554e0 0x7fd3380579a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fd34800d000 tx=0x7fd348009040).stop 2021-06-25T04:56:26.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 -- 172.21.15.57:0/118113216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd35813ffb0 msgr2=0x7fd3580af8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd35813ffb0 0x7fd3580af8a0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fd3500032f0 tx=0x7fd350016000).stop 2021-06-25T04:56:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 -- 172.21.15.57:0/118113216 shutdown_connections 2021-06-25T04:56:26.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd3380554e0 0x7fd3380579a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd35813ffb0 0x7fd3580af8a0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3580b96a0 0x7fd3581386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 --2- 172.21.15.57:0/118113216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580670e0 0x7fd358137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:26.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 -- 172.21.15.57:0/118113216 >> 172.21.15.57:0/118113216 conn(0x7fd35805f9b0 msgr2=0x7fd358061860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:26.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 -- 172.21.15.57:0/118113216 shutdown_connections 2021-06-25T04:56:26.960 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:26.951+0000 7fd35e0e8700 1 -- 172.21.15.57:0/118113216 wait complete. 2021-06-25T04:56:26.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:56:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9abad9e700 1 Processor -- start 2021-06-25T04:56:27.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9abad9e700 1 -- start start 2021-06-25T04:56:27.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9abad9e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ab40612e0 0x7f9ab40616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9abad9e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9ab4140400 0x7f9ab4140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9abad9e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab40aecb0 con 0x7f9ab40ad580 2021-06-25T04:56:27.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9abad9e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab40b6ee0 con 0x7f9ab40612e0 2021-06-25T04:56:27.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9abad9e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab40aeee0 con 0x7f9ab4140400 2021-06-25T04:56:27.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab959b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9ab40ad580 0x7f9ab40b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60474/0 (socket says 172.21.15.57:60474) 2021-06-25T04:56:27.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab9d9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ab40612e0 0x7f9ab40616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab959b700 1 -- 172.21.15.57:0/2031475795 learned_addr learned my addr 172.21.15.57:0/2031475795 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:27.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9aba59d700 1 --2- 172.21.15.57:0/2031475795 >> v2:172.21.15.87:3300/0 conn(0x7f9ab4140400 0x7f9ab4140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab9d9c700 1 -- 172.21.15.57:0/2031475795 >> v2:172.21.15.87:3300/0 conn(0x7f9ab4140400 msgr2=0x7f9ab4140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:27.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab9d9c700 1 --2- 172.21.15.57:0/2031475795 >> v2:172.21.15.87:3300/0 conn(0x7f9ab4140400 0x7f9ab4140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab9d9c700 1 -- 172.21.15.57:0/2031475795 >> v1:172.21.15.57:6789/0 conn(0x7f9ab40ad580 legacy=0x7f9ab40b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab9d9c700 1 -- 172.21.15.57:0/2031475795 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab40af180 con 0x7f9ab40612e0 2021-06-25T04:56:27.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab8d9a700 1 -- 172.21.15.57:0/2031475795 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137366431 0 0) 0x7f9ab40aecb0 con 0x7f9ab40ad580 2021-06-25T04:56:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab9d9c700 1 --2- 172.21.15.57:0/2031475795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ab40612e0 0x7f9ab40616c0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f9ab40aeb60 tx=0x7f9ab0006df0).ready entity=mon.0 client_cookie=90bf084818779cd4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab8d9a700 1 -- 172.21.15.57:0/2031475795 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ab000d5c0 con 0x7f9ab40612e0 2021-06-25T04:56:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab8d9a700 1 -- 172.21.15.57:0/2031475795 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0000e90 con 0x7f9ab40612e0 2021-06-25T04:56:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9ab8d9a700 1 -- 172.21.15.57:0/2031475795 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ab000d910 con 0x7f9ab40612e0 2021-06-25T04:56:27.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9abad9e700 1 -- 172.21.15.57:0/2031475795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ab40612e0 msgr2=0x7f9ab40616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.083+0000 7f9abad9e700 1 --2- 172.21.15.57:0/2031475795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ab40612e0 0x7f9ab40616c0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f9ab40aeb60 tx=0x7f9ab0006df0).stop 2021-06-25T04:56:27.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.087+0000 7f9abad9e700 1 -- 172.21.15.57:0/2031475795 shutdown_connections 2021-06-25T04:56:27.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.087+0000 7f9abad9e700 1 --2- 172.21.15.57:0/2031475795 >> v2:172.21.15.87:3300/0 conn(0x7f9ab4140400 0x7f9ab4140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.087+0000 7f9abad9e700 1 --2- 172.21.15.57:0/2031475795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ab40612e0 0x7f9ab40616c0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.087+0000 7f9abad9e700 1 -- 172.21.15.57:0/2031475795 >> 172.21.15.57:0/2031475795 conn(0x7f9ab4066da0 msgr2=0x7f9ab4067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:27.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.087+0000 7f9abad9e700 1 -- 172.21.15.57:0/2031475795 shutdown_connections 2021-06-25T04:56:27.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.087+0000 7f9abad9e700 1 -- 172.21.15.57:0/2031475795 wait complete. 2021-06-25T04:56:27.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.087+0000 7f9abad9e700 1 Processor -- start 2021-06-25T04:56:27.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.087+0000 7f9abad9e700 1 -- start start 2021-06-25T04:56:27.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9abad9e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ab40612e0 0x7f9ab40b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9abad9e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ab40ad580 0x7f9ab41566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9abad9e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ab4140400 0x7f9ab40aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9abad9e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab40b35a0 con 0x7f9ab4140400 2021-06-25T04:56:27.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9abad9e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4142ca0 con 0x7f9ab40612e0 2021-06-25T04:56:27.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9abad9e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4143c30 con 0x7f9ab40ad580 2021-06-25T04:56:27.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aba59d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ab4140400 0x7f9ab40aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9ab9d9c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ab40612e0 0x7f9ab40b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aba59d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ab4140400 0x7f9ab40aa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43264/0 (socket says 172.21.15.57:43264) 2021-06-25T04:56:27.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aba59d700 1 -- 172.21.15.57:0/742106578 learned_addr learned my addr 172.21.15.57:0/742106578 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:27.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9ab959b700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ab40ad580 0x7f9ab41566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aba59d700 1 -- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ab40ad580 msgr2=0x7f9ab41566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aba59d700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ab40ad580 0x7f9ab41566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aba59d700 1 -- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ab40612e0 msgr2=0x7f9ab40b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aba59d700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ab40612e0 0x7f9ab40b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aba59d700 1 -- 172.21.15.57:0/742106578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab000b180 con 0x7f9ab4140400 2021-06-25T04:56:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aba59d700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ab4140400 0x7f9ab40aa310 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f9ab40b3d10 tx=0x7f9aac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aaaffd700 1 -- 172.21.15.57:0/742106578 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aac0127e0 con 0x7f9ab4140400 2021-06-25T04:56:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aaaffd700 1 -- 172.21.15.57:0/742106578 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac012940 con 0x7f9ab4140400 2021-06-25T04:56:27.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9abad9e700 1 -- 172.21.15.57:0/742106578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab4155cc0 con 0x7f9ab4140400 2021-06-25T04:56:27.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9aaaffd700 1 -- 172.21.15.57:0/742106578 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aac012ca0 con 0x7f9ab4140400 2021-06-25T04:56:27.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9abad9e700 1 -- 172.21.15.57:0/742106578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab41438b0 con 0x7f9ab4140400 2021-06-25T04:56:27.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.091+0000 7f9abad9e700 1 -- 172.21.15.57:0/742106578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab40aab40 con 0x7f9ab4140400 2021-06-25T04:56:27.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.095+0000 7f9aaaffd700 1 -- 172.21.15.57:0/742106578 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9aac013480 con 0x7f9ab4140400 2021-06-25T04:56:27.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.095+0000 7f9aaaffd700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a9c055450 0x7f9a9c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.095+0000 7f9aaaffd700 1 -- 172.21.15.57:0/742106578 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9aac06e640 con 0x7f9ab4140400 2021-06-25T04:56:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.095+0000 7f9ab9d9c700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a9c055450 0x7f9a9c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.095+0000 7f9ab9d9c700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a9c055450 0x7f9a9c057910 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f9ab0018000 tx=0x7f9ab0012000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.099+0000 7f9aaaffd700 1 -- 172.21.15.57:0/742106578 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9aac044680 con 0x7f9ab4140400 2021-06-25T04:56:27.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.275+0000 7f9abad9e700 1 -- 172.21.15.57:0/742106578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9ab4156070 con 0x7f9ab4140400 2021-06-25T04:56:27.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.283+0000 7f9aaaffd700 1 -- 172.21.15.57:0/742106578 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9aac047ca0 con 0x7f9ab4140400 2021-06-25T04:56:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 -- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a9c055450 msgr2=0x7f9a9c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a9c055450 0x7f9a9c057910 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f9ab0018000 tx=0x7f9ab0012000).stop 2021-06-25T04:56:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 -- 172.21.15.57:0/742106578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ab4140400 msgr2=0x7f9ab40aa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ab4140400 0x7f9ab40aa310 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f9ab40b3d10 tx=0x7f9aac008040).stop 2021-06-25T04:56:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 -- 172.21.15.57:0/742106578 shutdown_connections 2021-06-25T04:56:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9a9c055450 0x7f9a9c057910 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ab4140400 0x7f9ab40aa310 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ab40ad580 0x7f9ab41566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 --2- 172.21.15.57:0/742106578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ab40612e0 0x7f9ab40b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 -- 172.21.15.57:0/742106578 >> 172.21.15.57:0/742106578 conn(0x7f9ab4066da0 msgr2=0x7f9ab405bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:27.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 -- 172.21.15.57:0/742106578 shutdown_connections 2021-06-25T04:56:27.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.287+0000 7f9abad9e700 1 -- 172.21.15.57:0/742106578 wait complete. 2021-06-25T04:56:27.295 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:56:27.305 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:56:27.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f8a0d270700 1 Processor -- start 2021-06-25T04:56:27.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f8a0d270700 1 -- start start 2021-06-25T04:56:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f8a0d270700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a080612e0 0x7f8a080616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f8a0d270700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8a08140400 0x7f8a08140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f8a0d270700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a080aecb0 con 0x7f8a080ad580 2021-06-25T04:56:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f8a0d270700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a080b6ee0 con 0x7f8a08140400 2021-06-25T04:56:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f8a0d270700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080aeee0 con 0x7f8a080612e0 2021-06-25T04:56:27.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f8a0ca6f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8a08140400 0x7f8a08140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f89fffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8a080ad580 0x7f8a080b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60488/0 (socket says 172.21.15.57:60488) 2021-06-25T04:56:27.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f8a0ca6f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8a08140400 0x7f8a08140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43272/0 (socket says 172.21.15.57:43272) 2021-06-25T04:56:27.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f89fffff700 1 -- 172.21.15.57:0/3338514296 learned_addr learned my addr 172.21.15.57:0/3338514296 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:27.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.415+0000 7f8a07fff700 1 --2- 172.21.15.57:0/3338514296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a080612e0 0x7f8a080616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0ca6f700 1 -- 172.21.15.57:0/3338514296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a080612e0 msgr2=0x7f8a080616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:27.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0ca6f700 1 --2- 172.21.15.57:0/3338514296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a080612e0 0x7f8a080616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0ca6f700 1 -- 172.21.15.57:0/3338514296 >> v1:172.21.15.57:6789/0 conn(0x7f8a080ad580 legacy=0x7f8a080b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0ca6f700 1 -- 172.21.15.57:0/3338514296 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a080af180 con 0x7f8a08140400 2021-06-25T04:56:27.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0ca6f700 1 --2- 172.21.15.57:0/3338514296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a08140400 0x7f8a08140890 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f8a000032f0 tx=0x7f8a000091d0).ready entity=mon.0 client_cookie=caef89debcce1677 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:27.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a077fe700 1 -- 172.21.15.57:0/3338514296 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a00009ea0 con 0x7f8a08140400 2021-06-25T04:56:27.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a077fe700 1 -- 172.21.15.57:0/3338514296 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0000b8a0 con 0x7f8a08140400 2021-06-25T04:56:27.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a077fe700 1 -- 172.21.15.57:0/3338514296 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0000ba10 con 0x7f8a08140400 2021-06-25T04:56:27.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0d270700 1 -- 172.21.15.57:0/3338514296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a08140400 msgr2=0x7f8a08140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0d270700 1 --2- 172.21.15.57:0/3338514296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a08140400 0x7f8a08140890 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f8a000032f0 tx=0x7f8a000091d0).stop 2021-06-25T04:56:27.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0d270700 1 -- 172.21.15.57:0/3338514296 shutdown_connections 2021-06-25T04:56:27.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0d270700 1 --2- 172.21.15.57:0/3338514296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a08140400 0x7f8a08140890 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0d270700 1 --2- 172.21.15.57:0/3338514296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a080612e0 0x7f8a080616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0d270700 1 -- 172.21.15.57:0/3338514296 >> 172.21.15.57:0/3338514296 conn(0x7f8a08066da0 msgr2=0x7f8a08067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:27.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0d270700 1 -- 172.21.15.57:0/3338514296 shutdown_connections 2021-06-25T04:56:27.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0d270700 1 -- 172.21.15.57:0/3338514296 wait complete. 2021-06-25T04:56:27.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0d270700 1 Processor -- start 2021-06-25T04:56:27.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.419+0000 7f8a0d270700 1 -- start start 2021-06-25T04:56:27.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0d270700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a080612e0 0x7f8a080aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0d270700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a080ad580 0x7f8a080ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0d270700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a08140400 0x7f8a080b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0d270700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080b0f40 con 0x7f8a08140400 2021-06-25T04:56:27.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0d270700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080b0560 con 0x7f8a080612e0 2021-06-25T04:56:27.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0d270700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080b0800 con 0x7f8a080ad580 2021-06-25T04:56:27.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0ca6f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a08140400 0x7f8a080b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0ca6f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a08140400 0x7f8a080b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43278/0 (socket says 172.21.15.57:43278) 2021-06-25T04:56:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0ca6f700 1 -- 172.21.15.57:0/3754172068 learned_addr learned my addr 172.21.15.57:0/3754172068 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f89fffff700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a080ad580 0x7f8a080ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a07fff700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a080612e0 0x7f8a080aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0ca6f700 1 -- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a080ad580 msgr2=0x7f8a080ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0ca6f700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a080ad580 0x7f8a080ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0ca6f700 1 -- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a080612e0 msgr2=0x7f8a080aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0ca6f700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a080612e0 0x7f8a080aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0ca6f700 1 -- 172.21.15.57:0/3754172068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a00009470 con 0x7f8a08140400 2021-06-25T04:56:27.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0ca6f700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a08140400 0x7f8a080b3330 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f8a000032f0 tx=0x7f8a00016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:27.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a05ffb700 1 -- 172.21.15.57:0/3754172068 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a00011e90 con 0x7f8a08140400 2021-06-25T04:56:27.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a05ffb700 1 -- 172.21.15.57:0/3754172068 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a00021480 con 0x7f8a08140400 2021-06-25T04:56:27.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0d270700 1 -- 172.21.15.57:0/3754172068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a080b0aa0 con 0x7f8a08140400 2021-06-25T04:56:27.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a05ffb700 1 -- 172.21.15.57:0/3754172068 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a000217e0 con 0x7f8a08140400 2021-06-25T04:56:27.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0d270700 1 -- 172.21.15.57:0/3754172068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a080ac860 con 0x7f8a08140400 2021-06-25T04:56:27.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.423+0000 7f8a0d270700 1 -- 172.21.15.57:0/3754172068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a080b0c30 con 0x7f8a08140400 2021-06-25T04:56:27.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.427+0000 7f8a05ffb700 1 -- 172.21.15.57:0/3754172068 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8a00028070 con 0x7f8a08140400 2021-06-25T04:56:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.427+0000 7f8a05ffb700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89ec0553f0 0x7f89ec0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.427+0000 7f8a05ffb700 1 -- 172.21.15.57:0/3754172068 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8a0006efc0 con 0x7f8a08140400 2021-06-25T04:56:27.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.427+0000 7f8a07fff700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89ec0553f0 0x7f89ec0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.427+0000 7f8a07fff700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89ec0553f0 0x7f89ec0578b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f89f800c000 tx=0x7f89f8008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:27.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.435+0000 7f8a05ffb700 1 -- 172.21.15.57:0/3754172068 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8a00044fe0 con 0x7f8a08140400 2021-06-25T04:56:27.610 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.603+0000 7f8a0d270700 1 -- 172.21.15.57:0/3754172068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8a08057310 con 0x7f8a08140400 2021-06-25T04:56:27.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.611+0000 7f8a05ffb700 1 -- 172.21.15.57:0/3754172068 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8a00015020 con 0x7f8a08140400 2021-06-25T04:56:27.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.611+0000 7f8a0d270700 1 -- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89ec0553f0 msgr2=0x7f89ec0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.611+0000 7f8a0d270700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89ec0553f0 0x7f89ec0578b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f89f800c000 tx=0x7f89f8008040).stop 2021-06-25T04:56:27.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.611+0000 7f8a0d270700 1 -- 172.21.15.57:0/3754172068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a08140400 msgr2=0x7f8a080b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.611+0000 7f8a0d270700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a08140400 0x7f8a080b3330 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f8a000032f0 tx=0x7f8a00016000).stop 2021-06-25T04:56:27.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.615+0000 7f8a0d270700 1 -- 172.21.15.57:0/3754172068 shutdown_connections 2021-06-25T04:56:27.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.615+0000 7f8a0d270700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89ec0553f0 0x7f89ec0578b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.615+0000 7f8a0d270700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a08140400 0x7f8a080b3330 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.615+0000 7f8a0d270700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a080ad580 0x7f8a080ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.615+0000 7f8a0d270700 1 --2- 172.21.15.57:0/3754172068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a080612e0 0x7f8a080aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.615+0000 7f8a0d270700 1 -- 172.21.15.57:0/3754172068 >> 172.21.15.57:0/3754172068 conn(0x7f8a08066da0 msgr2=0x7f8a0805cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:27.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.615+0000 7f8a0d270700 1 -- 172.21.15.57:0/3754172068 shutdown_connections 2021-06-25T04:56:27.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.615+0000 7f8a0d270700 1 -- 172.21.15.57:0/3754172068 wait complete. 2021-06-25T04:56:27.626 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:56:27.631 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:27.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.731+0000 7fb8e18fd700 1 Processor -- start 2021-06-25T04:56:27.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.731+0000 7fb8e18fd700 1 -- start start 2021-06-25T04:56:27.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb8dc067140 0x7fb8dc05f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc0a7a50 con 0x7fb8dc0b1930 2021-06-25T04:56:27.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc1475e0 con 0x7fb8dc0a7670 2021-06-25T04:56:27.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc147880 con 0x7fb8dc067140 2021-06-25T04:56:27.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8da7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb8dc067140 0x7fb8dc05f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8da7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb8dc067140 0x7fb8dc05f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43282/0 (socket says 172.21.15.57:43282) 2021-06-25T04:56:27.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8da7fc700 1 -- 172.21.15.57:0/1302597456 learned_addr learned my addr 172.21.15.57:0/1302597456 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:27.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8da7fc700 1 -- 172.21.15.57:0/1302597456 >> v1:172.21.15.87:6789/0 conn(0x7fb8dc0a7670 legacy=0x7fb8dc066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:27.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8da7fc700 1 -- 172.21.15.57:0/1302597456 >> v1:172.21.15.57:6789/0 conn(0x7fb8dc0b1930 legacy=0x7fb8dc05fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8da7fc700 1 -- 172.21.15.57:0/1302597456 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc147b20 con 0x7fb8dc067140 2021-06-25T04:56:27.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8da7fc700 1 --2- 172.21.15.57:0/1302597456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8dc067140 0x7fb8dc05f670 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7fb8cc0032f0 tx=0x7fb8cc009290).ready entity=mon.0 client_cookie=9485cea0676c3fc9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:27.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8d9ffb700 1 -- 172.21.15.57:0/1302597456 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8cc00b8a0 con 0x7fb8dc067140 2021-06-25T04:56:27.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8d9ffb700 1 -- 172.21.15.57:0/1302597456 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc00ba00 con 0x7fb8dc067140 2021-06-25T04:56:27.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 -- 172.21.15.57:0/1302597456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8dc067140 msgr2=0x7fb8dc05f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 --2- 172.21.15.57:0/1302597456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8dc067140 0x7fb8dc05f670 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7fb8cc0032f0 tx=0x7fb8cc009290).stop 2021-06-25T04:56:27.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8d9ffb700 1 -- 172.21.15.57:0/1302597456 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8cc00bb70 con 0x7fb8dc067140 2021-06-25T04:56:27.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 -- 172.21.15.57:0/1302597456 shutdown_connections 2021-06-25T04:56:27.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 --2- 172.21.15.57:0/1302597456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8dc067140 0x7fb8dc05f670 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 -- 172.21.15.57:0/1302597456 >> 172.21.15.57:0/1302597456 conn(0x7fb8dc0b53a0 msgr2=0x7fb8dc0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:27.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 -- 172.21.15.57:0/1302597456 shutdown_connections 2021-06-25T04:56:27.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 -- 172.21.15.57:0/1302597456 wait complete. 2021-06-25T04:56:27.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 Processor -- start 2021-06-25T04:56:27.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.735+0000 7fb8e18fd700 1 -- start start 2021-06-25T04:56:27.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8e18fd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8dc067140 0x7fb8dc0aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8e18fd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8dc0a7670 0x7fb8dc0b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8e18fd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8dc0b1930 0x7fb8dc156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8e18fd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0abb60 con 0x7fb8dc067140 2021-06-25T04:56:27.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8e18fd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0abe00 con 0x7fb8dc0b1930 2021-06-25T04:56:27.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8e18fd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0ac0a0 con 0x7fb8dc0a7670 2021-06-25T04:56:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8daffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8dc067140 0x7fb8dc0aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8daffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8dc067140 0x7fb8dc0aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43290/0 (socket says 172.21.15.57:43290) 2021-06-25T04:56:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8db7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8dc0b1930 0x7fb8dc156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8da7fc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8dc0a7670 0x7fb8dc0b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8daffd700 1 -- 172.21.15.57:0/305100224 learned_addr learned my addr 172.21.15.57:0/305100224 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8daffd700 1 -- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8dc0a7670 msgr2=0x7fb8dc0b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8daffd700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8dc0a7670 0x7fb8dc0b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8daffd700 1 -- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8dc0b1930 msgr2=0x7fb8dc156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8daffd700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8dc0b1930 0x7fb8dc156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8daffd700 1 -- 172.21.15.57:0/305100224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc009530 con 0x7fb8dc067140 2021-06-25T04:56:27.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8daffd700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8dc067140 0x7fb8dc0aeb50 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7fb8dc06a140 tx=0x7fb8d0007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:27.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8cbfff700 1 -- 172.21.15.57:0/305100224 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8d0007030 con 0x7fb8dc067140 2021-06-25T04:56:27.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8cbfff700 1 -- 172.21.15.57:0/305100224 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d0007190 con 0x7fb8dc067140 2021-06-25T04:56:27.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8e18fd700 1 -- 172.21.15.57:0/305100224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8dc0ac750 con 0x7fb8dc067140 2021-06-25T04:56:27.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8cbfff700 1 -- 172.21.15.57:0/305100224 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8d0006510 con 0x7fb8dc067140 2021-06-25T04:56:27.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8e18fd700 1 -- 172.21.15.57:0/305100224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc0ab020 con 0x7fb8dc067140 2021-06-25T04:56:27.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.739+0000 7fb8e18fd700 1 -- 172.21.15.57:0/305100224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc0ac260 con 0x7fb8dc067140 2021-06-25T04:56:27.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.743+0000 7fb8cbfff700 1 -- 172.21.15.57:0/305100224 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb8d0006670 con 0x7fb8dc067140 2021-06-25T04:56:27.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.743+0000 7fb8cbfff700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb8b8055340 0x7fb8b8057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:27.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.743+0000 7fb8cbfff700 1 -- 172.21.15.57:0/305100224 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb8d006d8b0 con 0x7fb8dc067140 2021-06-25T04:56:27.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.743+0000 7fb8da7fc700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb8b8055340 0x7fb8b8057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:27.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.743+0000 7fb8da7fc700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb8b8055340 0x7fb8b8057800 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fb8cc01a000 tx=0x7fb8cc016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:27.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.747+0000 7fb8cbfff700 1 -- 172.21.15.57:0/305100224 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb8d0043950 con 0x7fb8dc067140 2021-06-25T04:56:27.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 -- 172.21.15.57:0/305100224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8dc057310 con 0x7fb8dc067140 2021-06-25T04:56:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8cbfff700 1 -- 172.21.15.57:0/305100224 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fb8d0046f70 con 0x7fb8dc067140 2021-06-25T04:56:27.920 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:27.920 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3591673245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3591673245},{"type":"v1","addr":"172.21.15.57:6833","nonce":3591673245}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2597000234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2597000234},{"type":"v1","addr":"172.21.15.57:6835","nonce":2597000234}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:24.666625+0000","modified":"2021-06-25T04:56:26.355926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8088":{"gid":8088,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2964573030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2964573030},{"type":"v1","addr":"172.21.15.87:6835","nonce":2964573030}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-06-25T04:56:27.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 -- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb8b8055340 msgr2=0x7fb8b8057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb8b8055340 0x7fb8b8057800 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fb8cc01a000 tx=0x7fb8cc016000).stop 2021-06-25T04:56:27.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 -- 172.21.15.57:0/305100224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8dc067140 msgr2=0x7fb8dc0aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:27.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8dc067140 0x7fb8dc0aeb50 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7fb8dc06a140 tx=0x7fb8d0007be0).stop 2021-06-25T04:56:27.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 -- 172.21.15.57:0/305100224 shutdown_connections 2021-06-25T04:56:27.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb8b8055340 0x7fb8b8057800 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8dc0b1930 0x7fb8dc156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8dc0a7670 0x7fb8dc0b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 --2- 172.21.15.57:0/305100224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8dc067140 0x7fb8dc0aeb50 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:27.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 -- 172.21.15.57:0/305100224 >> 172.21.15.57:0/305100224 conn(0x7fb8dc0b53a0 msgr2=0x7fb8dc1489c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 -- 172.21.15.57:0/305100224 shutdown_connections 2021-06-25T04:56:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:27.915+0000 7fb8e18fd700 1 -- 172.21.15.57:0/305100224 wait complete. 2021-06-25T04:56:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 70 2021-06-25T04:56:28.236 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:56:24.666625+0000', 'modified': '2021-06-25T04:56:26.355926+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8088': {'gid': 8088, 'name': 'b', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/2964573030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 2964573030}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 2964573030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:56:28.236 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:56:28.237 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-06-25T04:56:28.352 INFO:teuthology.orchestra.run.smithi087.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":8088,"want_state":"up:active","state":"up:active","rank_uptime":3.672207046,"mdsmap_epoch":70,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":7.9662168060000003} 2021-06-25T04:56:28.353 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 8088, "mdsmap_epoch": 70, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 3.672207046, "state": "up:active", "uptime": 7.966216806, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:56:28.354 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:28.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.463+0000 7f53118cd700 1 Processor -- start 2021-06-25T04:56:28.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.463+0000 7f53118cd700 1 -- start start 2021-06-25T04:56:28.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f530c0acfc0 0x7f530c146af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f530c0b0440 0x7f530c146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c0b0950 con 0x7f530c0aea00 2021-06-25T04:56:28.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530c0adc10 con 0x7f530c0acfc0 2021-06-25T04:56:28.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530c0aede0 con 0x7f530c0b0440 2021-06-25T04:56:28.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53108cb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f530c0aea00 0x7f530c143770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60514/0 (socket says 172.21.15.57:60514) 2021-06-25T04:56:28.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53108cb700 1 -- 172.21.15.57:0/1643616628 learned_addr learned my addr 172.21.15.57:0/1643616628 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:28.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f530bfff700 1 --2- 172.21.15.57:0/1643616628 >> v2:172.21.15.57:3300/0 conn(0x7f530c0acfc0 0x7f530c146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53110cc700 1 --2- 172.21.15.57:0/1643616628 >> v2:172.21.15.87:3300/0 conn(0x7f530c0b0440 0x7f530c146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f530b7fe700 1 -- 172.21.15.57:0/1643616628 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309288123 0 0) 0x7f530c0b0950 con 0x7f530c0aea00 2021-06-25T04:56:28.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f530b7fe700 1 -- 172.21.15.57:0/1643616628 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f0003260 con 0x7f530c0aea00 2021-06-25T04:56:28.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f530bfff700 1 -- 172.21.15.57:0/1643616628 >> v2:172.21.15.87:3300/0 conn(0x7f530c0b0440 msgr2=0x7f530c146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:28.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f530bfff700 1 --2- 172.21.15.57:0/1643616628 >> v2:172.21.15.87:3300/0 conn(0x7f530c0b0440 0x7f530c146fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f530bfff700 1 -- 172.21.15.57:0/1643616628 >> v1:172.21.15.57:6789/0 conn(0x7f530c0aea00 legacy=0x7f530c143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f530bfff700 1 -- 172.21.15.57:0/1643616628 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c1466c0 con 0x7f530c0acfc0 2021-06-25T04:56:28.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f530bfff700 1 --2- 172.21.15.57:0/1643616628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f530c0acfc0 0x7f530c146af0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f52f8002f70 tx=0x7f52f8006df0).ready entity=mon.0 client_cookie=46ab521f988d2ab1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:28.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f530b7fe700 1 -- 172.21.15.57:0/1643616628 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52f800d4f0 con 0x7f530c0acfc0 2021-06-25T04:56:28.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f530b7fe700 1 -- 172.21.15.57:0/1643616628 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f8000e90 con 0x7f530c0acfc0 2021-06-25T04:56:28.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f530b7fe700 1 -- 172.21.15.57:0/1643616628 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52f800d840 con 0x7f530c0acfc0 2021-06-25T04:56:28.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 -- 172.21.15.57:0/1643616628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f530c0acfc0 msgr2=0x7f530c146af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 --2- 172.21.15.57:0/1643616628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f530c0acfc0 0x7f530c146af0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f52f8002f70 tx=0x7f52f8006df0).stop 2021-06-25T04:56:28.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 -- 172.21.15.57:0/1643616628 shutdown_connections 2021-06-25T04:56:28.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 --2- 172.21.15.57:0/1643616628 >> v2:172.21.15.87:3300/0 conn(0x7f530c0b0440 0x7f530c146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 --2- 172.21.15.57:0/1643616628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f530c0acfc0 0x7f530c146af0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 -- 172.21.15.57:0/1643616628 >> 172.21.15.57:0/1643616628 conn(0x7f530c0611f0 msgr2=0x7f530c062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:28.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.467+0000 7f53118cd700 1 -- 172.21.15.57:0/1643616628 shutdown_connections 2021-06-25T04:56:28.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53118cd700 1 -- 172.21.15.57:0/1643616628 wait complete. 2021-06-25T04:56:28.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53118cd700 1 Processor -- start 2021-06-25T04:56:28.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53118cd700 1 -- start start 2021-06-25T04:56:28.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53118cd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f530c0acfc0 0x7f530c0b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53118cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f530c0aea00 0x7f530c141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53118cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f530c0b0440 0x7f530c156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53118cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c0b57b0 con 0x7f530c0aea00 2021-06-25T04:56:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53118cd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c156a20 con 0x7f530c0b0440 2021-06-25T04:56:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53118cd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c0af8c0 con 0x7f530c0acfc0 2021-06-25T04:56:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f530bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f530c0aea00 0x7f530c141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53108cb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f530c0acfc0 0x7f530c0b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53110cc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f530c0b0440 0x7f530c156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f530bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f530c0aea00 0x7f530c141e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43304/0 (socket says 172.21.15.57:43304) 2021-06-25T04:56:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53110cc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f530c0b0440 0x7f530c156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:51798/0 (socket says 172.21.15.57:51798) 2021-06-25T04:56:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53110cc700 1 -- 172.21.15.57:0/3072993780 learned_addr learned my addr 172.21.15.57:0/3072993780 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.471+0000 7f53108cb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f530c0acfc0 0x7f530c0b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:54466/0 (socket says 172.21.15.57:54466) 2021-06-25T04:56:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f53108cb700 1 -- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f530c0b0440 msgr2=0x7f530c156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f53108cb700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f530c0b0440 0x7f530c156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f53108cb700 1 -- 172.21.15.57:0/3072993780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f530c0aea00 msgr2=0x7f530c141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f53108cb700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f530c0aea00 0x7f530c141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f53108cb700 1 -- 172.21.15.57:0/3072993780 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f800b180 con 0x7f530c0acfc0 2021-06-25T04:56:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f53110cc700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f530c0b0440 0x7f530c156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f530bfff700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f530c0aea00 0x7f530c141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f53108cb700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f530c0acfc0 0x7f530c0b4820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f530c156b60 tx=0x7f5300007a20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f5309ffb700 1 -- 172.21.15.57:0/3072993780 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f530000ce70 con 0x7f530c0acfc0 2021-06-25T04:56:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f5309ffb700 1 -- 172.21.15.57:0/3072993780 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53000070d0 con 0x7f530c0acfc0 2021-06-25T04:56:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f5309ffb700 1 -- 172.21.15.57:0/3072993780 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5300007430 con 0x7f530c0acfc0 2021-06-25T04:56:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f53118cd700 1 -- 172.21.15.57:0/3072993780 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530c0afb60 con 0x7f530c0acfc0 2021-06-25T04:56:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f53118cd700 1 -- 172.21.15.57:0/3072993780 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530c13af30 con 0x7f530c0acfc0 2021-06-25T04:56:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f53118cd700 1 -- 172.21.15.57:0/3072993780 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530c152630 con 0x7f530c0acfc0 2021-06-25T04:56:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f5309ffb700 1 -- 172.21.15.57:0/3072993780 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5300010070 con 0x7f530c0acfc0 2021-06-25T04:56:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f5309ffb700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52f4055340 0x7f52f4057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.475+0000 7f5309ffb700 1 -- 172.21.15.57:0/3072993780 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f530006d550 con 0x7f530c0acfc0 2021-06-25T04:56:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.479+0000 7f530bfff700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52f4055340 0x7f52f4057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.479+0000 7f530bfff700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52f4055340 0x7f52f4057800 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f52f8019000 tx=0x7f52f8014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:28.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.487+0000 7f5309ffb700 1 -- 172.21.15.57:0/3072993780 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f530c152630 con 0x7f530c0acfc0 2021-06-25T04:56:28.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.615+0000 7f53118cd700 1 -- 172.21.15.57:0/3072993780 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f530c0b0000 con 0x7f530c0acfc0 2021-06-25T04:56:28.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.619+0000 7f5309ffb700 1 -- 172.21.15.57:0/3072993780 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f53000435f0 con 0x7f530c0acfc0 2021-06-25T04:56:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:28.624 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":139,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:26.672360+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:56:23.126544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-06-25T04:56:23.668536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:28.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 -- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52f4055340 msgr2=0x7f52f4057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52f4055340 0x7f52f4057800 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f52f8019000 tx=0x7f52f8014000).stop 2021-06-25T04:56:28.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 -- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f530c0acfc0 msgr2=0x7f530c0b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f530c0acfc0 0x7f530c0b4820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f530c156b60 tx=0x7f5300007a20).stop 2021-06-25T04:56:28.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 -- 172.21.15.57:0/3072993780 shutdown_connections 2021-06-25T04:56:28.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f52f4055340 0x7f52f4057800 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f530c0b0440 0x7f530c156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f530c0aea00 0x7f530c141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 --2- 172.21.15.57:0/3072993780 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f530c0acfc0 0x7f530c0b4820 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 -- 172.21.15.57:0/3072993780 >> 172.21.15.57:0/3072993780 conn(0x7f530c0611f0 msgr2=0x7f530c1446b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:28.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 -- 172.21.15.57:0/3072993780 shutdown_connections 2021-06-25T04:56:28.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.623+0000 7f53118cd700 1 -- 172.21.15.57:0/3072993780 wait complete. 2021-06-25T04:56:28.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:56:23.126544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:56:23.668536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:56:28.644 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:56:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95c4a3700 1 Processor -- start 2021-06-25T04:56:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95c4a3700 1 -- start start 2021-06-25T04:56:28.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95c4a3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9540b3170 0x7ff95413e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95c4a3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff9540b3550 0x7ff95413ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95c4a3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9540ad8b0 con 0x7ff954145050 2021-06-25T04:56:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95c4a3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540afec0 con 0x7ff9540b3550 2021-06-25T04:56:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95c4a3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff954145520 con 0x7ff9540b3170 2021-06-25T04:56:28.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95aa40700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff954145050 0x7ff9541413c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60532/0 (socket says 172.21.15.57:60532) 2021-06-25T04:56:28.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95aa40700 1 -- 172.21.15.57:0/4256625335 learned_addr learned my addr 172.21.15.57:0/4256625335 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:28.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff959a3e700 1 --2- 172.21.15.57:0/4256625335 >> v2:172.21.15.87:3300/0 conn(0x7ff9540b3550 0x7ff95413ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95a23f700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9540b3170 0x7ff95413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430383166 0 0) 0x7ff9540ad8b0 con 0x7ff954145050 2021-06-25T04:56:28.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff93c003260 con 0x7ff954145050 2021-06-25T04:56:28.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3120404019 0 0) 0x7ff93c003260 con 0x7ff954145050 2021-06-25T04:56:28.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9540b3170 msgr2=0x7ff95413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:28.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95923d700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9540b3170 0x7ff95413e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 >> v2:172.21.15.87:3300/0 conn(0x7ff9540b3550 msgr2=0x7ff95413ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:28.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95923d700 1 --2- 172.21.15.57:0/4256625335 >> v2:172.21.15.87:3300/0 conn(0x7ff9540b3550 0x7ff95413ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540b0120 con 0x7ff954145050 2021-06-25T04:56:28.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7ff94c0019e0 con 0x7ff954145050 2021-06-25T04:56:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 >> v1:172.21.15.57:6789/0 conn(0x7ff954145050 legacy=0x7ff9541413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.751+0000 7ff95923d700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9540b3170 0x7ff93c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95923d700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff93c003c80 0x7ff93c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95923d700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff93c0049f0 0x7ff93c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540afec0 con 0x7ff93c003c80 2021-06-25T04:56:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff954145520 con 0x7ff93c0049f0 2021-06-25T04:56:28.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c00fb60 con 0x7ff9540b3170 2021-06-25T04:56:28.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95a23f700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9540b3170 0x7ff93c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95aa40700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff93c0049f0 0x7ff93c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff959a3e700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff93c003c80 0x7ff93c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95aa40700 1 -- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9540b3170 msgr2=0x7ff93c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:28.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95aa40700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9540b3170 0x7ff93c003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95aa40700 1 -- 172.21.15.57:0/4256625335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff93c003c80 msgr2=0x7ff93c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:28.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95aa40700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff93c003c80 0x7ff93c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95aa40700 1 -- 172.21.15.57:0/4256625335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c003260 con 0x7ff93c0049f0 2021-06-25T04:56:28.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95aa40700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff93c0049f0 0x7ff93c004e70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7ff93c0054d0 tx=0x7ff9540b02b0).ready entity=mon.1 client_cookie=1fab1d6b3784e5b6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:28.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff94c00cc10 con 0x7ff93c0049f0 2021-06-25T04:56:28.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c00cd70 con 0x7ff93c0049f0 2021-06-25T04:56:28.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95923d700 1 -- 172.21.15.57:0/4256625335 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff94c005b80 con 0x7ff93c0049f0 2021-06-25T04:56:28.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95c4a3700 1 -- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff93c0049f0 msgr2=0x7ff93c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95c4a3700 1 --2- 172.21.15.57:0/4256625335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff93c0049f0 0x7ff93c004e70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7ff93c0054d0 tx=0x7ff9540b02b0).stop 2021-06-25T04:56:28.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95aa40700 1 -- 172.21.15.57:0/4256625335 reap_dead start 2021-06-25T04:56:28.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95c4a3700 1 -- 172.21.15.57:0/4256625335 shutdown_connections 2021-06-25T04:56:28.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95c4a3700 1 -- 172.21.15.57:0/4256625335 >> 172.21.15.57:0/4256625335 conn(0x7ff954060780 msgr2=0x7ff954060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:28.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95c4a3700 1 -- 172.21.15.57:0/4256625335 shutdown_connections 2021-06-25T04:56:28.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.755+0000 7ff95c4a3700 1 -- 172.21.15.57:0/4256625335 wait complete. 2021-06-25T04:56:28.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95c4a3700 1 Processor -- start 2021-06-25T04:56:28.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95c4a3700 1 -- start start 2021-06-25T04:56:28.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95c4a3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9541444d0 0x7ff95414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95c4a3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff954143be0 0x7ff95414e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95c4a3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff954066c30 0x7ff9540670e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95c4a3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff954144d10 con 0x7ff9541444d0 2021-06-25T04:56:28.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95c4a3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff954063a10 con 0x7ff954143be0 2021-06-25T04:56:28.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95c4a3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9541430d0 con 0x7ff954066c30 2021-06-25T04:56:28.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95a23f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9541444d0 0x7ff95414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95a23f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9541444d0 0x7ff95414dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43322/0 (socket says 172.21.15.57:43322) 2021-06-25T04:56:28.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95a23f700 1 -- 172.21.15.57:0/1441763980 learned_addr learned my addr 172.21.15.57:0/1441763980 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:28.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff959a3e700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff954143be0 0x7ff95414e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95aa40700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff954066c30 0x7ff9540670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95a23f700 1 -- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff954066c30 msgr2=0x7ff9540670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95a23f700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff954066c30 0x7ff9540670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95a23f700 1 -- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff954143be0 msgr2=0x7ff95414e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95a23f700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff954143be0 0x7ff95414e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95a23f700 1 -- 172.21.15.57:0/1441763980 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540ac9e0 con 0x7ff9541444d0 2021-06-25T04:56:28.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.759+0000 7ff95a23f700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9541444d0 0x7ff95414dfe0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7ff95000b000 tx=0x7ff950006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:28.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.763+0000 7ff9437fe700 1 -- 172.21.15.57:0/1441763980 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff95000f760 con 0x7ff9541444d0 2021-06-25T04:56:28.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.763+0000 7ff9437fe700 1 -- 172.21.15.57:0/1441763980 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95000f8c0 con 0x7ff9541444d0 2021-06-25T04:56:28.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.763+0000 7ff9437fe700 1 -- 172.21.15.57:0/1441763980 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff95000fc60 con 0x7ff9541444d0 2021-06-25T04:56:28.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.763+0000 7ff95c4a3700 1 -- 172.21.15.57:0/1441763980 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9541427c0 con 0x7ff9541444d0 2021-06-25T04:56:28.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.763+0000 7ff95c4a3700 1 -- 172.21.15.57:0/1441763980 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff954065a20 con 0x7ff9541444d0 2021-06-25T04:56:28.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.763+0000 7ff95c4a3700 1 -- 172.21.15.57:0/1441763980 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff954057310 con 0x7ff9541444d0 2021-06-25T04:56:28.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.763+0000 7ff9437fe700 1 -- 172.21.15.57:0/1441763980 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff950014440 con 0x7ff9541444d0 2021-06-25T04:56:28.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.763+0000 7ff9437fe700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9340553f0 0x7ff9340578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:28.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.763+0000 7ff9437fe700 1 -- 172.21.15.57:0/1441763980 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff95006e880 con 0x7ff9541444d0 2021-06-25T04:56:28.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.763+0000 7ff959a3e700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9340553f0 0x7ff9340578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:28.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.763+0000 7ff959a3e700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9340553f0 0x7ff9340578b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7ff94400b000 tx=0x7ff944006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:28.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.771+0000 7ff9437fe700 1 -- 172.21.15.57:0/1441763980 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff950044930 con 0x7ff9541444d0 2021-06-25T04:56:28.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.895+0000 7ff95c4a3700 1 -- 172.21.15.57:0/1441763980 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff9540afb00 con 0x7ff9541444d0 2021-06-25T04:56:28.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.895+0000 7ff9437fe700 1 -- 172.21.15.57:0/1441763980 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff950018020 con 0x7ff9541444d0 2021-06-25T04:56:28.900 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:56:28.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.895+0000 7ff95c4a3700 1 -- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9340553f0 msgr2=0x7ff9340578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.899+0000 7ff95c4a3700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9340553f0 0x7ff9340578b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7ff94400b000 tx=0x7ff944006df0).stop 2021-06-25T04:56:28.904 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.899+0000 7ff95c4a3700 1 -- 172.21.15.57:0/1441763980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9541444d0 msgr2=0x7ff95414dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:28.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.899+0000 7ff95c4a3700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9541444d0 0x7ff95414dfe0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7ff95000b000 tx=0x7ff950006df0).stop 2021-06-25T04:56:28.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.899+0000 7ff95c4a3700 1 -- 172.21.15.57:0/1441763980 shutdown_connections 2021-06-25T04:56:28.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.899+0000 7ff95c4a3700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff9340553f0 0x7ff9340578b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.905 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.899+0000 7ff95c4a3700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff954066c30 0x7ff9540670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.899+0000 7ff95c4a3700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff954143be0 0x7ff95414e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.899+0000 7ff95c4a3700 1 --2- 172.21.15.57:0/1441763980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9541444d0 0x7ff95414dfe0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:28.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.899+0000 7ff95c4a3700 1 -- 172.21.15.57:0/1441763980 >> 172.21.15.57:0/1441763980 conn(0x7ff954060780 msgr2=0x7ff9540b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:28.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.899+0000 7ff95c4a3700 1 -- 172.21.15.57:0/1441763980 shutdown_connections 2021-06-25T04:56:28.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:28.899+0000 7ff95c4a3700 1 -- 172.21.15.57:0/1441763980 wait complete. 2021-06-25T04:56:28.917 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:56:29.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd658e9c700 1 Processor -- start 2021-06-25T04:56:29.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd658e9c700 1 -- start start 2021-06-25T04:56:29.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd658e9c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540b2540 0x7fd65414ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd658e9c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6540a7080 con 0x7fd6540affd0 2021-06-25T04:56:29.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd658e9c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6540a72b0 con 0x7fd6540a8a80 2021-06-25T04:56:29.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd658e9c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540a7550 con 0x7fd6540b2540 2021-06-25T04:56:29.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd64affd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd6540affd0 0x7fd6540a8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60548/0 (socket says 172.21.15.57:60548) 2021-06-25T04:56:29.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd64affd700 1 -- 172.21.15.57:0/1539311195 learned_addr learned my addr 172.21.15.57:0/1539311195 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:29.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd6537fe700 1 --2- 172.21.15.57:0/1539311195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540b2540 0x7fd65414ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd652ffd700 1 -- 172.21.15.57:0/1539311195 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645662769 0 0) 0x7fd6540a7080 con 0x7fd6540affd0 2021-06-25T04:56:29.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd652ffd700 1 -- 172.21.15.57:0/1539311195 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd634003260 con 0x7fd6540affd0 2021-06-25T04:56:29.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd652ffd700 1 -- 172.21.15.57:0/1539311195 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964443838 0 0) 0x7fd6540a72b0 con 0x7fd6540a8a80 2021-06-25T04:56:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd652ffd700 1 -- 172.21.15.57:0/1539311195 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6540a7080 con 0x7fd6540a8a80 2021-06-25T04:56:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd6537fe700 1 -- 172.21.15.57:0/1539311195 >> v1:172.21.15.87:6789/0 conn(0x7fd6540a8a80 legacy=0x7fd654151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd6537fe700 1 -- 172.21.15.57:0/1539311195 >> v1:172.21.15.57:6789/0 conn(0x7fd6540affd0 legacy=0x7fd6540a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd652ffd700 1 -- 172.21.15.57:0/1539311195 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4137751653 0 0) 0x7fd634003260 con 0x7fd6540affd0 2021-06-25T04:56:29.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd6537fe700 1 -- 172.21.15.57:0/1539311195 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6540a77f0 con 0x7fd6540b2540 2021-06-25T04:56:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd6537fe700 1 --2- 172.21.15.57:0/1539311195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540b2540 0x7fd65414ae00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fd63c001110 tx=0x7fd644006df0).ready entity=mon.2 client_cookie=e44628e2e3377542 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd652ffd700 1 -- 172.21.15.57:0/1539311195 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd63c001660 con 0x7fd6540b2540 2021-06-25T04:56:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd652ffd700 1 -- 172.21.15.57:0/1539311195 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd644000e90 con 0x7fd6540b2540 2021-06-25T04:56:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd652ffd700 1 -- 172.21.15.57:0/1539311195 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd644012460 con 0x7fd6540b2540 2021-06-25T04:56:29.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd658e9c700 1 -- 172.21.15.57:0/1539311195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540b2540 msgr2=0x7fd65414ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.023+0000 7fd658e9c700 1 --2- 172.21.15.57:0/1539311195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540b2540 0x7fd65414ae00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fd63c001110 tx=0x7fd644006df0).stop 2021-06-25T04:56:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.027+0000 7fd658e9c700 1 -- 172.21.15.57:0/1539311195 shutdown_connections 2021-06-25T04:56:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.027+0000 7fd658e9c700 1 --2- 172.21.15.57:0/1539311195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540b2540 0x7fd65414ae00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.027+0000 7fd658e9c700 1 -- 172.21.15.57:0/1539311195 >> 172.21.15.57:0/1539311195 conn(0x7fd654060140 msgr2=0x7fd6540b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.027+0000 7fd658e9c700 1 -- 172.21.15.57:0/1539311195 shutdown_connections 2021-06-25T04:56:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.027+0000 7fd658e9c700 1 -- 172.21.15.57:0/1539311195 wait complete. 2021-06-25T04:56:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.027+0000 7fd658e9c700 1 Processor -- start 2021-06-25T04:56:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.027+0000 7fd658e9c700 1 -- start start 2021-06-25T04:56:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd658e9c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540a8a80 0x7fd65414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd658e9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6540affd0 0x7fd65414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd658e9c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6540b2540 0x7fd65414e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd658e9c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654066a80 con 0x7fd6540affd0 2021-06-25T04:56:29.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd658e9c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654156b80 con 0x7fd6540b2540 2021-06-25T04:56:29.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd658e9c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd654066cb0 con 0x7fd6540a8a80 2021-06-25T04:56:29.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd64affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6540affd0 0x7fd65414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd64affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6540affd0 0x7fd65414dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43338/0 (socket says 172.21.15.57:43338) 2021-06-25T04:56:29.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd64affd700 1 -- 172.21.15.57:0/2554605006 learned_addr learned my addr 172.21.15.57:0/2554605006 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:29.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd653fff700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6540b2540 0x7fd65414e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd6537fe700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540a8a80 0x7fd65414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd653fff700 1 -- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540a8a80 msgr2=0x7fd65414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd653fff700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540a8a80 0x7fd65414b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd653fff700 1 -- 172.21.15.57:0/2554605006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6540affd0 msgr2=0x7fd65414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd653fff700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6540affd0 0x7fd65414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd653fff700 1 -- 172.21.15.57:0/2554605006 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64400b180 con 0x7fd6540b2540 2021-06-25T04:56:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd64affd700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6540affd0 0x7fd65414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd6537fe700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540a8a80 0x7fd65414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd653fff700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6540b2540 0x7fd65414e190 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fd65414a7d0 tx=0x7fd64c007d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd6517fa700 1 -- 172.21.15.57:0/2554605006 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd64c00f470 con 0x7fd6540b2540 2021-06-25T04:56:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd6517fa700 1 -- 172.21.15.57:0/2554605006 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c00f5d0 con 0x7fd6540b2540 2021-06-25T04:56:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd658e9c700 1 -- 172.21.15.57:0/2554605006 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd654156df0 con 0x7fd6540b2540 2021-06-25T04:56:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd6517fa700 1 -- 172.21.15.57:0/2554605006 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd64c00f930 con 0x7fd6540b2540 2021-06-25T04:56:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.031+0000 7fd658e9c700 1 -- 172.21.15.57:0/2554605006 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd654065ec0 con 0x7fd6540b2540 2021-06-25T04:56:29.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.035+0000 7fd658e9c700 1 -- 172.21.15.57:0/2554605006 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd654156f80 con 0x7fd6540b2540 2021-06-25T04:56:29.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.035+0000 7fd6517fa700 1 -- 172.21.15.57:0/2554605006 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd64c019030 con 0x7fd6540b2540 2021-06-25T04:56:29.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.035+0000 7fd6517fa700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6380554e0 0x7fd6380579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.035+0000 7fd6517fa700 1 -- 172.21.15.57:0/2554605006 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd64c06d540 con 0x7fd6540b2540 2021-06-25T04:56:29.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.035+0000 7fd6537fe700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6380554e0 0x7fd6380579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.035+0000 7fd6537fe700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6380554e0 0x7fd6380579a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fd644019000 tx=0x7fd644014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.043+0000 7fd6517fa700 1 -- 172.21.15.57:0/2554605006 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd64c0435e0 con 0x7fd6540b2540 2021-06-25T04:56:29.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.171+0000 7fd658e9c700 1 -- 172.21.15.57:0/2554605006 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd654057310 con 0x7fd6540b2540 2021-06-25T04:56:29.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.171+0000 7fd6517fa700 1 -- 172.21.15.57:0/2554605006 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd64c046c00 con 0x7fd6540b2540 2021-06-25T04:56:29.178 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 -- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6380554e0 msgr2=0x7fd6380579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6380554e0 0x7fd6380579a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fd644019000 tx=0x7fd644014000).stop 2021-06-25T04:56:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 -- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6540b2540 msgr2=0x7fd65414e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6540b2540 0x7fd65414e190 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fd65414a7d0 tx=0x7fd64c007d40).stop 2021-06-25T04:56:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 -- 172.21.15.57:0/2554605006 shutdown_connections 2021-06-25T04:56:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6380554e0 0x7fd6380579a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6540b2540 0x7fd65414e190 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6540affd0 0x7fd65414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 --2- 172.21.15.57:0/2554605006 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6540a8a80 0x7fd65414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 -- 172.21.15.57:0/2554605006 >> 172.21.15.57:0/2554605006 conn(0x7fd654060140 msgr2=0x7fd6540b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:29.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 -- 172.21.15.57:0/2554605006 shutdown_connections 2021-06-25T04:56:29.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.175+0000 7fd658e9c700 1 -- 172.21.15.57:0/2554605006 wait complete. 2021-06-25T04:56:29.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:56:29.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.291+0000 7fb63ce12700 1 Processor -- start 2021-06-25T04:56:29.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.291+0000 7fb63ce12700 1 -- start start 2021-06-25T04:56:29.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63ce12700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb6380b3170 0x7fb63813e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63ce12700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6380ad8b0 con 0x7fb6380b3550 2021-06-25T04:56:29.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63ce12700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6380afec0 con 0x7fb638145050 2021-06-25T04:56:29.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63ce12700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb638145520 con 0x7fb6380b3170 2021-06-25T04:56:29.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb6380b3170 0x7fb63813e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb635d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb6380b3550 0x7fb6381413c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60562/0 (socket says 172.21.15.57:60562) 2021-06-25T04:56:29.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb635d9b700 1 -- 172.21.15.57:0/1442292221 learned_addr learned my addr 172.21.15.57:0/1442292221 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:29.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548058101 0 0) 0x7fb6380ad8b0 con 0x7fb6380b3550 2021-06-25T04:56:29.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb618003260 con 0x7fb6380b3550 2021-06-25T04:56:29.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365364452 0 0) 0x7fb6380afec0 con 0x7fb638145050 2021-06-25T04:56:29.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6380ad8b0 con 0x7fb638145050 2021-06-25T04:56:29.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4150535606 0 0) 0x7fb618003260 con 0x7fb6380b3550 2021-06-25T04:56:29.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 >> v2:172.21.15.57:3300/0 conn(0x7fb6380b3170 msgr2=0x7fb63813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:29.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 --2- 172.21.15.57:0/1442292221 >> v2:172.21.15.57:3300/0 conn(0x7fb6380b3170 0x7fb63813e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 >> v1:172.21.15.87:6789/0 conn(0x7fb638145050 legacy=0x7fb63814b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6380b0120 con 0x7fb6380b3550 2021-06-25T04:56:29.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fb620001660 con 0x7fb6380b3550 2021-06-25T04:56:29.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63659c700 1 --2- 172.21.15.57:0/1442292221 >> v2:172.21.15.57:3300/0 conn(0x7fb6380b3170 0x7fb63813e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:29.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 >> v1:172.21.15.57:6789/0 conn(0x7fb6380b3550 legacy=0x7fb6381413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6180038e0 0x7fb618003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb618004500 0x7fb618004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 0x7fb61800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb638145520 con 0x7fb618004e70 2021-06-25T04:56:29.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61800bcf0 con 0x7fb6180038e0 2021-06-25T04:56:29.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61800beb0 con 0x7fb618004500 2021-06-25T04:56:29.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb636d9d700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 0x7fb61800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63659c700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6180038e0 0x7fb618003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb635d9b700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb618004500 0x7fb618004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb636d9d700 1 -- 172.21.15.57:0/1442292221 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb618004500 msgr2=0x7fb618004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb636d9d700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb618004500 0x7fb618004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb636d9d700 1 -- 172.21.15.57:0/1442292221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6180038e0 msgr2=0x7fb618003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb636d9d700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6180038e0 0x7fb618003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb636d9d700 1 -- 172.21.15.57:0/1442292221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb618003260 con 0x7fb618004e70 2021-06-25T04:56:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb635d9b700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb618004500 0x7fb618004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:56:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb636d9d700 1 -- 172.21.15.57:0/1442292221 reap_dead start 2021-06-25T04:56:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb636d9d700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 0x7fb61800b750 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fb630001490 tx=0x7fb630007d80).ready entity=mon.0 client_cookie=ce77ea038b6cd3c9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb630006890 con 0x7fb618004e70 2021-06-25T04:56:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6300069f0 con 0x7fb618004e70 2021-06-25T04:56:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63559a700 1 -- 172.21.15.57:0/1442292221 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb630006d50 con 0x7fb618004e70 2021-06-25T04:56:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63ce12700 1 -- 172.21.15.57:0/1442292221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 msgr2=0x7fb61800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63ce12700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 0x7fb61800b750 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fb630001490 tx=0x7fb630007d80).stop 2021-06-25T04:56:29.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63ce12700 1 -- 172.21.15.57:0/1442292221 shutdown_connections 2021-06-25T04:56:29.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63ce12700 1 --2- 172.21.15.57:0/1442292221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 0x7fb61800b750 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63ce12700 1 -- 172.21.15.57:0/1442292221 >> 172.21.15.57:0/1442292221 conn(0x7fb638060780 msgr2=0x7fb638060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63ce12700 1 -- 172.21.15.57:0/1442292221 shutdown_connections 2021-06-25T04:56:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.295+0000 7fb63ce12700 1 -- 172.21.15.57:0/1442292221 wait complete. 2021-06-25T04:56:29.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.299+0000 7fb63ce12700 1 Processor -- start 2021-06-25T04:56:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.299+0000 7fb63ce12700 1 -- start start 2021-06-25T04:56:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.299+0000 7fb63ce12700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 0x7fb638153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.299+0000 7fb63ce12700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb638147a40 0x7fb6380abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63ce12700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6380658b0 0x7fb6381456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63ce12700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb638148100 con 0x7fb618004e70 2021-06-25T04:56:29.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63ce12700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6381483a0 con 0x7fb6380658b0 2021-06-25T04:56:29.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63ce12700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380ac420 con 0x7fb638147a40 2021-06-25T04:56:29.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 0x7fb638153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 0x7fb638153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43356/0 (socket says 172.21.15.57:43356) 2021-06-25T04:56:29.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63659c700 1 -- 172.21.15.57:0/126396201 learned_addr learned my addr 172.21.15.57:0/126396201 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:29.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb636d9d700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6380658b0 0x7fb6381456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb635d9b700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb638147a40 0x7fb6380abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63659c700 1 -- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb638147a40 msgr2=0x7fb6380abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63659c700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb638147a40 0x7fb6380abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63659c700 1 -- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6380658b0 msgr2=0x7fb6381456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63659c700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6380658b0 0x7fb6381456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63659c700 1 -- 172.21.15.57:0/126396201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63813d870 con 0x7fb618004e70 2021-06-25T04:56:29.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb635d9b700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb638147a40 0x7fb6380abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:29.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63659c700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 0x7fb638153c30 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fb62800b000 tx=0x7fb628008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb62f7fe700 1 -- 172.21.15.57:0/126396201 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb628014870 con 0x7fb618004e70 2021-06-25T04:56:29.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb62f7fe700 1 -- 172.21.15.57:0/126396201 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6280149d0 con 0x7fb618004e70 2021-06-25T04:56:29.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63ce12700 1 -- 172.21.15.57:0/126396201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb638065d60 con 0x7fb618004e70 2021-06-25T04:56:29.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb62f7fe700 1 -- 172.21.15.57:0/126396201 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb628014d30 con 0x7fb618004e70 2021-06-25T04:56:29.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63ce12700 1 -- 172.21.15.57:0/126396201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb638145de0 con 0x7fb618004e70 2021-06-25T04:56:29.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb62f7fe700 1 -- 172.21.15.57:0/126396201 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb62800e460 con 0x7fb618004e70 2021-06-25T04:56:29.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb63ce12700 1 -- 172.21.15.57:0/126396201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb638148510 con 0x7fb618004e70 2021-06-25T04:56:29.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb62f7fe700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb61c055450 0x7fb61c057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb62f7fe700 1 -- 172.21.15.57:0/126396201 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb62806e8c0 con 0x7fb618004e70 2021-06-25T04:56:29.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.303+0000 7fb635d9b700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb61c055450 0x7fb61c057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.307+0000 7fb635d9b700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb61c055450 0x7fb61c057910 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fb62000c000 tx=0x7fb620009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.311+0000 7fb62f7fe700 1 -- 172.21.15.57:0/126396201 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb628044a10 con 0x7fb618004e70 2021-06-25T04:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 -- 172.21.15.57:0/126396201 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb638057310 con 0x7fb618004e70 2021-06-25T04:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb62f7fe700 1 -- 172.21.15.57:0/126396201 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb6280180a0 con 0x7fb618004e70 2021-06-25T04:56:29.440 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:29.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 -- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb61c055450 msgr2=0x7fb61c057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb61c055450 0x7fb61c057910 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fb62000c000 tx=0x7fb620009040).stop 2021-06-25T04:56:29.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 -- 172.21.15.57:0/126396201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 msgr2=0x7fb638153c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 0x7fb638153c30 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fb62800b000 tx=0x7fb628008040).stop 2021-06-25T04:56:29.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 -- 172.21.15.57:0/126396201 shutdown_connections 2021-06-25T04:56:29.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb61c055450 0x7fb61c057910 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6380658b0 0x7fb6381456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb638147a40 0x7fb6380abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 --2- 172.21.15.57:0/126396201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618004e70 0x7fb638153c30 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 -- 172.21.15.57:0/126396201 >> 172.21.15.57:0/126396201 conn(0x7fb638060780 msgr2=0x7fb63805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:29.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 -- 172.21.15.57:0/126396201 shutdown_connections 2021-06-25T04:56:29.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.435+0000 7fb63ce12700 1 -- 172.21.15.57:0/126396201 wait complete. 2021-06-25T04:56:29.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:56:29.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2079b81700 1 Processor -- start 2021-06-25T04:56:29.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2079b81700 1 -- start start 2021-06-25T04:56:29.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2079b81700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f20740b2540 0x7f20740abad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2079b81700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20740b02a0 0x7f20740abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2079b81700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20740add40 con 0x7f20740b1220 2021-06-25T04:56:29.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2079b81700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20740adfe0 con 0x7f20740b2540 2021-06-25T04:56:29.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2079b81700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20740a9350 con 0x7f20740b02a0 2021-06-25T04:56:29.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2078b7f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f20740b2540 0x7f20740abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2073fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f20740b1220 0x7f20740afb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60584/0 (socket says 172.21.15.57:60584) 2021-06-25T04:56:29.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2073fff700 1 -- 172.21.15.57:0/2362071773 learned_addr learned my addr 172.21.15.57:0/2362071773 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:29.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2079380700 1 --2- 172.21.15.57:0/2362071773 >> v2:172.21.15.87:3300/0 conn(0x7f20740b02a0 0x7f20740abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2078b7f700 1 -- 172.21.15.57:0/2362071773 >> v2:172.21.15.87:3300/0 conn(0x7f20740b02a0 msgr2=0x7f20740abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:29.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2078b7f700 1 --2- 172.21.15.57:0/2362071773 >> v2:172.21.15.87:3300/0 conn(0x7f20740b02a0 0x7f20740abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2078b7f700 1 -- 172.21.15.57:0/2362071773 >> v1:172.21.15.57:6789/0 conn(0x7f20740b1220 legacy=0x7f20740afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2078b7f700 1 -- 172.21.15.57:0/2362071773 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20740a97f0 con 0x7f20740b2540 2021-06-25T04:56:29.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2078b7f700 1 --2- 172.21.15.57:0/2362071773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20740b2540 0x7f20740abad0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f205c002f70 tx=0x7f205c006df0).ready entity=mon.0 client_cookie=d6d0710cc21dc198 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f20737fe700 1 -- 172.21.15.57:0/2362071773 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f205c014070 con 0x7f20740b2540 2021-06-25T04:56:29.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f20737fe700 1 -- 172.21.15.57:0/2362071773 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c000e90 con 0x7f20740b2540 2021-06-25T04:56:29.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f20737fe700 1 -- 172.21.15.57:0/2362071773 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f205c00fb60 con 0x7f20740b2540 2021-06-25T04:56:29.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2079b81700 1 -- 172.21.15.57:0/2362071773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20740b2540 msgr2=0x7f20740abad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.559+0000 7f2079b81700 1 --2- 172.21.15.57:0/2362071773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20740b2540 0x7f20740abad0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f205c002f70 tx=0x7f205c006df0).stop 2021-06-25T04:56:29.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 -- 172.21.15.57:0/2362071773 shutdown_connections 2021-06-25T04:56:29.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 --2- 172.21.15.57:0/2362071773 >> v2:172.21.15.87:3300/0 conn(0x7f20740b02a0 0x7f20740abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 --2- 172.21.15.57:0/2362071773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20740b2540 0x7f20740abad0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 -- 172.21.15.57:0/2362071773 >> 172.21.15.57:0/2362071773 conn(0x7f2074060140 msgr2=0x7f20740b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 -- 172.21.15.57:0/2362071773 shutdown_connections 2021-06-25T04:56:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 -- 172.21.15.57:0/2362071773 wait complete. 2021-06-25T04:56:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 Processor -- start 2021-06-25T04:56:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 -- start start 2021-06-25T04:56:29.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20740b02a0 0x7f20740a8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20740b1220 0x7f20740a1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20740b2540 0x7f207413e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740ab0e0 con 0x7f20740b2540 2021-06-25T04:56:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740a0ac0 con 0x7f20740b02a0 2021-06-25T04:56:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079b81700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20740a0d60 con 0x7f20740b1220 2021-06-25T04:56:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079380700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20740b2540 0x7f207413e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079380700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20740b2540 0x7f207413e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43374/0 (socket says 172.21.15.57:43374) 2021-06-25T04:56:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079380700 1 -- 172.21.15.57:0/1013983317 learned_addr learned my addr 172.21.15.57:0/1013983317 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2078b7f700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20740b02a0 0x7f20740a8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2073fff700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20740b1220 0x7f20740a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079380700 1 -- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20740b1220 msgr2=0x7f20740a1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079380700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20740b1220 0x7f20740a1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079380700 1 -- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20740b02a0 msgr2=0x7f20740a8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079380700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20740b02a0 0x7f20740a8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079380700 1 -- 172.21.15.57:0/1013983317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c00b180 con 0x7f20740b2540 2021-06-25T04:56:29.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2078b7f700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20740b02a0 0x7f20740a8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:29.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.563+0000 7f2079380700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20740b2540 0x7f207413e9a0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f206c00c000 tx=0x7f206c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.567+0000 7f2071ffb700 1 -- 172.21.15.57:0/1013983317 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f206c011750 con 0x7f20740b2540 2021-06-25T04:56:29.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.567+0000 7f2071ffb700 1 -- 172.21.15.57:0/1013983317 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206c0118b0 con 0x7f20740b2540 2021-06-25T04:56:29.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.567+0000 7f2079b81700 1 -- 172.21.15.57:0/1013983317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20740ab380 con 0x7f20740b2540 2021-06-25T04:56:29.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.567+0000 7f2071ffb700 1 -- 172.21.15.57:0/1013983317 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f206c011c10 con 0x7f20740b2540 2021-06-25T04:56:29.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.567+0000 7f2079b81700 1 -- 172.21.15.57:0/1013983317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20740aac60 con 0x7f20740b2540 2021-06-25T04:56:29.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.567+0000 7f2079b81700 1 -- 172.21.15.57:0/1013983317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20740aaeb0 con 0x7f20740b2540 2021-06-25T04:56:29.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.567+0000 7f2071ffb700 1 -- 172.21.15.57:0/1013983317 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f206c011d70 con 0x7f20740b2540 2021-06-25T04:56:29.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.567+0000 7f2071ffb700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2058055340 0x7f2058057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.567+0000 7f2071ffb700 1 -- 172.21.15.57:0/1013983317 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f206c06e280 con 0x7f20740b2540 2021-06-25T04:56:29.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.567+0000 7f2078b7f700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2058055340 0x7f2058057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.567+0000 7f2078b7f700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2058055340 0x7f2058057800 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f205c01a000 tx=0x7f205c016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.575+0000 7f2071ffb700 1 -- 172.21.15.57:0/1013983317 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f206c044430 con 0x7f20740b2540 2021-06-25T04:56:29.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.699+0000 7f2079b81700 1 -- 172.21.15.57:0/1013983317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20740a0f20 con 0x7f20740b2540 2021-06-25T04:56:29.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2071ffb700 1 -- 172.21.15.57:0/1013983317 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+10 (secure 0 0 0) 0x7f206c047a50 con 0x7f20740b2540 2021-06-25T04:56:29.707 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:29.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 -- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2058055340 msgr2=0x7f2058057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2058055340 0x7f2058057800 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f205c01a000 tx=0x7f205c016000).stop 2021-06-25T04:56:29.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 -- 172.21.15.57:0/1013983317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20740b2540 msgr2=0x7f207413e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20740b2540 0x7f207413e9a0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f206c00c000 tx=0x7f206c006df0).stop 2021-06-25T04:56:29.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 -- 172.21.15.57:0/1013983317 shutdown_connections 2021-06-25T04:56:29.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2058055340 0x7f2058057800 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20740b2540 0x7f207413e9a0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20740b1220 0x7f20740a1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 --2- 172.21.15.57:0/1013983317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20740b02a0 0x7f20740a8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 -- 172.21.15.57:0/1013983317 >> 172.21.15.57:0/1013983317 conn(0x7f2074060140 msgr2=0x7f20740b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:29.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 -- 172.21.15.57:0/1013983317 shutdown_connections 2021-06-25T04:56:29.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.703+0000 7f2079b81700 1 -- 172.21.15.57:0/1013983317 wait complete. 2021-06-25T04:56:29.723 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:56:29.724 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:29.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.823+0000 7f4a32228700 1 Processor -- start 2021-06-25T04:56:29.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.823+0000 7f4a32228700 1 -- start start 2021-06-25T04:56:29.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4a2c143500 0x7f4a2c0a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a2c05f670 0x7f4a2c1438e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4a2c0a8b20 0x7f4a2c0b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c0ab3a0 con 0x7f4a2c0a8b20 2021-06-25T04:56:29.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c0b1b50 con 0x7f4a2c143500 2021-06-25T04:56:29.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c143f60 con 0x7f4a2c05f670 2021-06-25T04:56:29.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4a2c0a8b20 0x7f4a2c0b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4a2c0a8b20 0x7f4a2c0b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43382/0 (socket says 172.21.15.57:43382) 2021-06-25T04:56:29.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2bfff700 1 -- 172.21.15.57:0/4153291883 learned_addr learned my addr 172.21.15.57:0/4153291883 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:29.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2affd700 1 --2- 172.21.15.57:0/4153291883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a2c05f670 0x7f4a2c1438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2b7fe700 1 --2- 172.21.15.57:0/4153291883 >> v2:172.21.15.87:3300/0 conn(0x7f4a2c143500 0x7f4a2c0a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2bfff700 1 -- 172.21.15.57:0/4153291883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a2c05f670 msgr2=0x7f4a2c1438e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:29.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2bfff700 1 --2- 172.21.15.57:0/4153291883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a2c05f670 0x7f4a2c1438e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2bfff700 1 -- 172.21.15.57:0/4153291883 >> v2:172.21.15.87:3300/0 conn(0x7f4a2c143500 msgr2=0x7f4a2c0a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:29.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2bfff700 1 --2- 172.21.15.57:0/4153291883 >> v2:172.21.15.87:3300/0 conn(0x7f4a2c143500 0x7f4a2c0a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2bfff700 1 -- 172.21.15.57:0/4153291883 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c144200 con 0x7f4a2c0a8b20 2021-06-25T04:56:29.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2bfff700 1 --2- 172.21.15.57:0/4153291883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a2c0a8b20 0x7f4a2c0b0d70 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f4a240032f0 tx=0x7f4a24009290).ready entity=mon.0 client_cookie=cd0bbbf4c695d4fd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2a7fc700 1 -- 172.21.15.57:0/4153291883 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a2400b680 con 0x7f4a2c0a8b20 2021-06-25T04:56:29.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2a7fc700 1 -- 172.21.15.57:0/4153291883 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2400b7e0 con 0x7f4a2c0a8b20 2021-06-25T04:56:29.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a2a7fc700 1 -- 172.21.15.57:0/4153291883 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a2400b950 con 0x7f4a2c0a8b20 2021-06-25T04:56:29.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 -- 172.21.15.57:0/4153291883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a2c0a8b20 msgr2=0x7f4a2c0b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 --2- 172.21.15.57:0/4153291883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a2c0a8b20 0x7f4a2c0b0d70 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f4a240032f0 tx=0x7f4a24009290).stop 2021-06-25T04:56:29.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 -- 172.21.15.57:0/4153291883 shutdown_connections 2021-06-25T04:56:29.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 --2- 172.21.15.57:0/4153291883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a2c0a8b20 0x7f4a2c0b0d70 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 --2- 172.21.15.57:0/4153291883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a2c05f670 0x7f4a2c1438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 --2- 172.21.15.57:0/4153291883 >> v2:172.21.15.87:3300/0 conn(0x7f4a2c143500 0x7f4a2c0a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 -- 172.21.15.57:0/4153291883 >> 172.21.15.57:0/4153291883 conn(0x7f4a2c0b53a0 msgr2=0x7f4a2c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:29.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 -- 172.21.15.57:0/4153291883 shutdown_connections 2021-06-25T04:56:29.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.827+0000 7f4a32228700 1 -- 172.21.15.57:0/4153291883 wait complete. 2021-06-25T04:56:29.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a32228700 1 Processor -- start 2021-06-25T04:56:29.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a32228700 1 -- start start 2021-06-25T04:56:29.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a32228700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a2c05f670 0x7f4a2c060240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a32228700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a2c0a8b20 0x7f4a2c150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a32228700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a2c143500 0x7f4a2c150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a32228700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c13b3d0 con 0x7f4a2c143500 2021-06-25T04:56:29.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a32228700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c140070 con 0x7f4a2c05f670 2021-06-25T04:56:29.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a32228700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c140310 con 0x7f4a2c0a8b20 2021-06-25T04:56:29.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a2bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a2c143500 0x7f4a2c150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a2bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a2c143500 0x7f4a2c150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43388/0 (socket says 172.21.15.57:43388) 2021-06-25T04:56:29.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a2bfff700 1 -- 172.21.15.57:0/3010363973 learned_addr learned my addr 172.21.15.57:0/3010363973 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:29.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a2affd700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a2c0a8b20 0x7f4a2c150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.831+0000 7f4a2b7fe700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a2c05f670 0x7f4a2c060240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a2bfff700 1 -- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a2c0a8b20 msgr2=0x7f4a2c150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a2bfff700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a2c0a8b20 0x7f4a2c150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a2bfff700 1 -- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a2c05f670 msgr2=0x7f4a2c060240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:29.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a2bfff700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a2c05f670 0x7f4a2c060240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:29.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a2bfff700 1 -- 172.21.15.57:0/3010363973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a24009530 con 0x7f4a2c143500 2021-06-25T04:56:29.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a2bfff700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a2c143500 0x7f4a2c150b60 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f4a240032f0 tx=0x7f4a24017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a28ff9700 1 -- 172.21.15.57:0/3010363973 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a24011bf0 con 0x7f4a2c143500 2021-06-25T04:56:29.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a28ff9700 1 -- 172.21.15.57:0/3010363973 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24011d50 con 0x7f4a2c143500 2021-06-25T04:56:29.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a32228700 1 -- 172.21.15.57:0/3010363973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c1405b0 con 0x7f4a2c143500 2021-06-25T04:56:29.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a28ff9700 1 -- 172.21.15.57:0/3010363973 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a2401b630 con 0x7f4a2c143500 2021-06-25T04:56:29.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a32228700 1 -- 172.21.15.57:0/3010363973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c13e780 con 0x7f4a2c143500 2021-06-25T04:56:29.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a32228700 1 -- 172.21.15.57:0/3010363973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2c057310 con 0x7f4a2c143500 2021-06-25T04:56:29.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a28ff9700 1 -- 172.21.15.57:0/3010363973 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4a2400f070 con 0x7f4a2c143500 2021-06-25T04:56:29.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.835+0000 7f4a28ff9700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a10055450 0x7f4a10057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:29.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.839+0000 7f4a28ff9700 1 -- 172.21.15.57:0/3010363973 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4a2406eba0 con 0x7f4a2c143500 2021-06-25T04:56:29.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.839+0000 7f4a2b7fe700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a10055450 0x7f4a10057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:29.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.839+0000 7f4a2b7fe700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a10055450 0x7f4a10057910 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f4a1400b000 tx=0x7f4a14006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:29.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:29.843+0000 7f4a28ff9700 1 -- 172.21.15.57:0/3010363973 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4a24044d50 con 0x7f4a2c143500 2021-06-25T04:56:30.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.007+0000 7f4a32228700 1 -- 172.21.15.57:0/3010363973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a2c0aaf10 con 0x7f4a2c143500 2021-06-25T04:56:30.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.007+0000 7f4a28ff9700 1 -- 172.21.15.57:0/3010363973 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f4a24048370 con 0x7f4a2c143500 2021-06-25T04:56:30.014 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:30.014 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3591673245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3591673245},{"type":"v1","addr":"172.21.15.57:6833","nonce":3591673245}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2597000234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2597000234},{"type":"v1","addr":"172.21.15.57:6835","nonce":2597000234}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:24.666625+0000","modified":"2021-06-25T04:56:26.355926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8088":{"gid":8088,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2964573030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2964573030},{"type":"v1","addr":"172.21.15.87:6835","nonce":2964573030}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-06-25T04:56:30.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 -- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a10055450 msgr2=0x7f4a10057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:30.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a10055450 0x7f4a10057910 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f4a1400b000 tx=0x7f4a14006df0).stop 2021-06-25T04:56:30.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 -- 172.21.15.57:0/3010363973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a2c143500 msgr2=0x7f4a2c150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:30.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a2c143500 0x7f4a2c150b60 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f4a240032f0 tx=0x7f4a24017000).stop 2021-06-25T04:56:30.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 -- 172.21.15.57:0/3010363973 shutdown_connections 2021-06-25T04:56:30.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4a10055450 0x7f4a10057910 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:30.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a2c143500 0x7f4a2c150b60 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:30.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a2c0a8b20 0x7f4a2c150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:30.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 --2- 172.21.15.57:0/3010363973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a2c05f670 0x7f4a2c060240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:30.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 -- 172.21.15.57:0/3010363973 >> 172.21.15.57:0/3010363973 conn(0x7f4a2c0b53a0 msgr2=0x7f4a2c0b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:30.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 -- 172.21.15.57:0/3010363973 shutdown_connections 2021-06-25T04:56:30.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:30.011+0000 7f4a32228700 1 -- 172.21.15.57:0/3010363973 wait complete. 2021-06-25T04:56:30.020 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 70 2021-06-25T04:56:30.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:56:24.666625+0000', 'modified': '2021-06-25T04:56:26.355926+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8088': {'gid': 8088, 'name': 'b', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/2964573030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 2964573030}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 2964573030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:56:30.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:56:30.335 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-06-25T04:56:30.450 INFO:teuthology.orchestra.run.smithi087.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":8088,"want_state":"up:active","state":"up:active","rank_uptime":5.7696790250000003,"mdsmap_epoch":70,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":10.063689154} 2021-06-25T04:56:30.451 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 8088, "mdsmap_epoch": 70, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 5.769679025, "state": "up:active", "uptime": 10.063689154, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:56:30.452 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:56:30.452 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:56:30.453 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:56:30.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:30.453 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:30.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:56:30.479 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:56:30.480 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:56:30.493 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:56:30.494 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:56:30.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:30.495 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:56:30.544 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:56:30.545 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:30.547 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:56:30.564 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:56:30.564 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:56:30.573 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:56:30.574 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:56:30.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:30.576 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:56:30.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15543]: starting ceph client2021-06-25T04:56:30.611+0000 7f08d6b29080 -1 init, newargv = 0x55ead826ad00 newargc=9 2021-06-25T04:56:30.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr: 2021-06-25T04:56:30.632 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15543]: starting fuse 2021-06-25T04:56:31.727 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:56:31.745 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:56:31.746 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:56:31.804 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:56:31.805 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:56:31.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:31.807 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:56:31.812 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:56:31.812 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:56:31.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:31.814 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:56:31.815 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:56:31.815 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:56:31.816 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:56:31.816 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:56:31.816 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:56:31.817 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:56:31.817 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:56:31.818 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:56:31.818 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:56:31.818 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:56:31.819 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:56:31.819 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:56:31.820 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:56:31.820 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:56:31.820 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:56:31.821 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:56:31.821 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:56:31.822 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:56:31.822 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:56:31.822 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:56:31.823 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:56:31.823 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:56:31.896 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.15543.asok 2021-06-25T04:56:31.901 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15543.asok 2021-06-25T04:56:31.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:31.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15543.asok status 2021-06-25T04:56:31.994 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:56:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:56:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:56:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:56:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:56:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:56:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:56:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "15543", 2021-06-25T04:56:31.996 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:56:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:56:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:56:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:56:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 8256, 2021-06-25T04:56:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:56:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:56:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:56:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 8256 2021-06-25T04:56:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:56:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:56:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:56:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:56:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 859096524 2021-06-25T04:56:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:56:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:56:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:56:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:56:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:56:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 859096524 2021-06-25T04:56:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:56:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.8256 172.21.15.102:0/859096524", 2021-06-25T04:56:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/859096524", 2021-06-25T04:56:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:56:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 70, 2021-06-25T04:56:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 139, 2021-06-25T04:56:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:56:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:56:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:56:32.003 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:56:32.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:32.011 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:32.011 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:32.020 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:56:32.020 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:56:32.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:32.021 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:32.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:32.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.187+0000 7f809f59e700 1 Processor -- start 2021-06-25T04:56:32.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.187+0000 7f809f59e700 1 -- start start 2021-06-25T04:56:32.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00acee0 0x7f80a00ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809f59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00b2bf0 con 0x7f80a00b2810 2021-06-25T04:56:32.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809f59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00b1620 con 0x7f80a013c6a0 2021-06-25T04:56:32.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00b1170 con 0x7f80a00acee0 2021-06-25T04:56:32.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809e59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f80a00b2810 0x7f80a00b0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60610/0 (socket says 172.21.15.57:60610) 2021-06-25T04:56:32.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809e59c700 1 -- 172.21.15.57:0/1817635293 learned_addr learned my addr 172.21.15.57:0/1817635293 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:32.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809ed9d700 1 --2- 172.21.15.57:0/1817635293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00acee0 0x7f80a00ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809dd9b700 1 -- 172.21.15.57:0/1817635293 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486897320 0 0) 0x7f80a00b2bf0 con 0x7f80a00b2810 2021-06-25T04:56:32.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809dd9b700 1 -- 172.21.15.57:0/1817635293 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8080003260 con 0x7f80a00b2810 2021-06-25T04:56:32.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809dd9b700 1 -- 172.21.15.57:0/1817635293 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055288367 0 0) 0x7f80a00b1620 con 0x7f80a013c6a0 2021-06-25T04:56:32.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809dd9b700 1 -- 172.21.15.57:0/1817635293 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a00b2bf0 con 0x7f80a013c6a0 2021-06-25T04:56:32.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809ed9d700 1 -- 172.21.15.57:0/1817635293 >> v1:172.21.15.87:6789/0 conn(0x7f80a013c6a0 legacy=0x7f80a013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809ed9d700 1 -- 172.21.15.57:0/1817635293 >> v1:172.21.15.57:6789/0 conn(0x7f80a00b2810 legacy=0x7f80a00b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809ed9d700 1 -- 172.21.15.57:0/1817635293 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a00b18c0 con 0x7f80a00acee0 2021-06-25T04:56:32.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809ed9d700 1 --2- 172.21.15.57:0/1817635293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00acee0 0x7f80a00ad350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f80980032f0 tx=0x7f809800a370).ready entity=mon.2 client_cookie=6e7dc3474b49c2c0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:32.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809dd9b700 1 -- 172.21.15.57:0/1817635293 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f809800cba0 con 0x7f80a00acee0 2021-06-25T04:56:32.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809dd9b700 1 -- 172.21.15.57:0/1817635293 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800cd00 con 0x7f80a00acee0 2021-06-25T04:56:32.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809dd9b700 1 -- 172.21.15.57:0/1817635293 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8098010600 con 0x7f80a00acee0 2021-06-25T04:56:32.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809f59e700 1 -- 172.21.15.57:0/1817635293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00acee0 msgr2=0x7f80a00ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.191+0000 7f809f59e700 1 --2- 172.21.15.57:0/1817635293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00acee0 0x7f80a00ad350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f80980032f0 tx=0x7f809800a370).stop 2021-06-25T04:56:32.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 -- 172.21.15.57:0/1817635293 shutdown_connections 2021-06-25T04:56:32.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 --2- 172.21.15.57:0/1817635293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00acee0 0x7f80a00ad350 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 -- 172.21.15.57:0/1817635293 >> 172.21.15.57:0/1817635293 conn(0x7f80a00611f0 msgr2=0x7f80a0062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:32.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 -- 172.21.15.57:0/1817635293 shutdown_connections 2021-06-25T04:56:32.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 -- 172.21.15.57:0/1817635293 wait complete. 2021-06-25T04:56:32.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 Processor -- start 2021-06-25T04:56:32.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 -- start start 2021-06-25T04:56:32.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a00acee0 0x7f80a0137600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00b2810 0x7f80a00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a013c6a0 0x7f80a01557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0134900 con 0x7f80a00acee0 2021-06-25T04:56:32.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0134b30 con 0x7f80a013c6a0 2021-06-25T04:56:32.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809f59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00b5260 con 0x7f80a00b2810 2021-06-25T04:56:32.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a00acee0 0x7f80a0137600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a00acee0 0x7f80a0137600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43398/0 (socket says 172.21.15.57:43398) 2021-06-25T04:56:32.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809e59c700 1 -- 172.21.15.57:0/3614129527 learned_addr learned my addr 172.21.15.57:0/3614129527 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:32.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f8097fff700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00b2810 0x7f80a00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.195+0000 7f809ed9d700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a013c6a0 0x7f80a01557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f809e59c700 1 -- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00b2810 msgr2=0x7f80a00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f809e59c700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00b2810 0x7f80a00b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f809e59c700 1 -- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a013c6a0 msgr2=0x7f80a01557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f809e59c700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a013c6a0 0x7f80a01557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f809e59c700 1 -- 172.21.15.57:0/3614129527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809800a610 con 0x7f80a00acee0 2021-06-25T04:56:32.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f809e59c700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a00acee0 0x7f80a0137600 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f8090001110 tx=0x7f8090007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:32.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f80977fe700 1 -- 172.21.15.57:0/3614129527 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80900070d0 con 0x7f80a00acee0 2021-06-25T04:56:32.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f80977fe700 1 -- 172.21.15.57:0/3614129527 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090007230 con 0x7f80a00acee0 2021-06-25T04:56:32.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f80977fe700 1 -- 172.21.15.57:0/3614129527 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8090005610 con 0x7f80a00acee0 2021-06-25T04:56:32.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f809f59e700 1 -- 172.21.15.57:0/3614129527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a00b5500 con 0x7f80a00acee0 2021-06-25T04:56:32.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f809f59e700 1 -- 172.21.15.57:0/3614129527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a01430b0 con 0x7f80a00acee0 2021-06-25T04:56:32.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f809f59e700 1 -- 172.21.15.57:0/3614129527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a0057310 con 0x7f80a00acee0 2021-06-25T04:56:32.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f80977fe700 1 -- 172.21.15.57:0/3614129527 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8090010070 con 0x7f80a00acee0 2021-06-25T04:56:32.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f80977fe700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8084055450 0x7f8084057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f80977fe700 1 -- 172.21.15.57:0/3614129527 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f809006d5b0 con 0x7f80a00acee0 2021-06-25T04:56:32.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.199+0000 7f8097fff700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8084055450 0x7f8084057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.203+0000 7f8097fff700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8084055450 0x7f8084057910 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f808800d000 tx=0x7f8088007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:32.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.207+0000 7f80977fe700 1 -- 172.21.15.57:0/3614129527 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8090043760 con 0x7f80a00acee0 2021-06-25T04:56:32.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.335+0000 7f809f59e700 1 -- 172.21.15.57:0/3614129527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80a005f200 con 0x7f80a00acee0 2021-06-25T04:56:32.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f80977fe700 1 -- 172.21.15.57:0/3614129527 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f8090018020 con 0x7f80a00acee0 2021-06-25T04:56:32.344 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:32.344 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":139,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:26.672360+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:56:23.126544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-06-25T04:56:23.668536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:32.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 -- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8084055450 msgr2=0x7f8084057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8084055450 0x7f8084057910 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f808800d000 tx=0x7f8088007a20).stop 2021-06-25T04:56:32.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 -- 172.21.15.57:0/3614129527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a00acee0 msgr2=0x7f80a0137600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a00acee0 0x7f80a0137600 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f8090001110 tx=0x7f8090007ad0).stop 2021-06-25T04:56:32.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 -- 172.21.15.57:0/3614129527 shutdown_connections 2021-06-25T04:56:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8084055450 0x7f8084057910 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a013c6a0 0x7f80a01557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00b2810 0x7f80a00b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 --2- 172.21.15.57:0/3614129527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a00acee0 0x7f80a0137600 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 -- 172.21.15.57:0/3614129527 >> 172.21.15.57:0/3614129527 conn(0x7f80a00611f0 msgr2=0x7f80a00b62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:32.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 -- 172.21.15.57:0/3614129527 shutdown_connections 2021-06-25T04:56:32.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.339+0000 7f809f59e700 1 -- 172.21.15.57:0/3614129527 wait complete. 2021-06-25T04:56:32.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:56:23.126544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:56:23.668536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:56:32.359 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:56:32.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.459+0000 7f76b9ee2700 1 Processor -- start 2021-06-25T04:56:32.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.459+0000 7f76b9ee2700 1 -- start start 2021-06-25T04:56:32.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76b40b1e80 0x7f76b40b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f76b40aff70 0x7f76b40b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76b40a7080 0x7f76b4141210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b40b03e0 con 0x7f76b40b1e80 2021-06-25T04:56:32.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b40b2750 con 0x7f76b40aff70 2021-06-25T04:56:32.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40b0610 con 0x7f76b40a7080 2021-06-25T04:56:32.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b37fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76b40b1e80 0x7f76b40b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b37fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76b40b1e80 0x7f76b40b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43408/0 (socket says 172.21.15.57:43408) 2021-06-25T04:56:32.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b37fe700 1 -- 172.21.15.57:0/3922225348 learned_addr learned my addr 172.21.15.57:0/3922225348 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:32.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b2ffd700 1 --2- 172.21.15.57:0/3922225348 >> v2:172.21.15.87:3300/0 conn(0x7f76b40aff70 0x7f76b40b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b3fff700 1 --2- 172.21.15.57:0/3922225348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76b40a7080 0x7f76b4141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b37fe700 1 -- 172.21.15.57:0/3922225348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76b40a7080 msgr2=0x7f76b4141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:32.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b37fe700 1 --2- 172.21.15.57:0/3922225348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76b40a7080 0x7f76b4141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b37fe700 1 -- 172.21.15.57:0/3922225348 >> v2:172.21.15.87:3300/0 conn(0x7f76b40aff70 msgr2=0x7f76b40b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:32.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b37fe700 1 --2- 172.21.15.57:0/3922225348 >> v2:172.21.15.87:3300/0 conn(0x7f76b40aff70 0x7f76b40b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b37fe700 1 -- 172.21.15.57:0/3922225348 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b40b08b0 con 0x7f76b40b1e80 2021-06-25T04:56:32.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b37fe700 1 --2- 172.21.15.57:0/3922225348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b40b1e80 0x7f76b40b1290 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f76a8002f70 tx=0x7f76a8006eb0).ready entity=mon.0 client_cookie=9c7633c436aaf056 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:32.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b27fc700 1 -- 172.21.15.57:0/3922225348 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76a800d570 con 0x7f76b40b1e80 2021-06-25T04:56:32.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b27fc700 1 -- 172.21.15.57:0/3922225348 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a8000e90 con 0x7f76b40b1e80 2021-06-25T04:56:32.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b27fc700 1 -- 172.21.15.57:0/3922225348 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76a800d900 con 0x7f76b40b1e80 2021-06-25T04:56:32.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 -- 172.21.15.57:0/3922225348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b40b1e80 msgr2=0x7f76b40b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 --2- 172.21.15.57:0/3922225348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b40b1e80 0x7f76b40b1290 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f76a8002f70 tx=0x7f76a8006eb0).stop 2021-06-25T04:56:32.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 -- 172.21.15.57:0/3922225348 shutdown_connections 2021-06-25T04:56:32.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 --2- 172.21.15.57:0/3922225348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76b40a7080 0x7f76b4141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 --2- 172.21.15.57:0/3922225348 >> v2:172.21.15.87:3300/0 conn(0x7f76b40aff70 0x7f76b40b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 --2- 172.21.15.57:0/3922225348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b40b1e80 0x7f76b40b1290 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 -- 172.21.15.57:0/3922225348 >> 172.21.15.57:0/3922225348 conn(0x7f76b405f670 msgr2=0x7f76b405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:32.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 -- 172.21.15.57:0/3922225348 shutdown_connections 2021-06-25T04:56:32.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.463+0000 7f76b9ee2700 1 -- 172.21.15.57:0/3922225348 wait complete. 2021-06-25T04:56:32.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b9ee2700 1 Processor -- start 2021-06-25T04:56:32.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b9ee2700 1 -- start start 2021-06-25T04:56:32.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b9ee2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76b40a7080 0x7f76b40aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b9ee2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76b40aff70 0x7f76b40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b9ee2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b40b1e80 0x7f76b415a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b9ee2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b414a600 con 0x7f76b40b1e80 2021-06-25T04:56:32.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b9ee2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b406aa10 con 0x7f76b40a7080 2021-06-25T04:56:32.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b9ee2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40ab670 con 0x7f76b40aff70 2021-06-25T04:56:32.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b40b1e80 0x7f76b415a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b40b1e80 0x7f76b415a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43416/0 (socket says 172.21.15.57:43416) 2021-06-25T04:56:32.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b3fff700 1 -- 172.21.15.57:0/1090554630 learned_addr learned my addr 172.21.15.57:0/1090554630 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:32.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b2ffd700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76b40aff70 0x7f76b40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b37fe700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76b40a7080 0x7f76b40aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b3fff700 1 -- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76b40aff70 msgr2=0x7f76b40b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b3fff700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76b40aff70 0x7f76b40b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b3fff700 1 -- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76b40a7080 msgr2=0x7f76b40aaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b3fff700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76b40a7080 0x7f76b40aaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b3fff700 1 -- 172.21.15.57:0/1090554630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a800b1e0 con 0x7f76b40b1e80 2021-06-25T04:56:32.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b37fe700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76b40a7080 0x7f76b40aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:32.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b3fff700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b40b1e80 0x7f76b415a090 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f76ac006e00 tx=0x7f76ac0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:32.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b0ff9700 1 -- 172.21.15.57:0/1090554630 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76ac00c850 con 0x7f76b40b1e80 2021-06-25T04:56:32.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b0ff9700 1 -- 172.21.15.57:0/1090554630 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac00c9b0 con 0x7f76b40b1e80 2021-06-25T04:56:32.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b9ee2700 1 -- 172.21.15.57:0/1090554630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b414b280 con 0x7f76b40b1e80 2021-06-25T04:56:32.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b0ff9700 1 -- 172.21.15.57:0/1090554630 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76ac00cd10 con 0x7f76b40b1e80 2021-06-25T04:56:32.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.467+0000 7f76b9ee2700 1 -- 172.21.15.57:0/1090554630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b414a280 con 0x7f76b40b1e80 2021-06-25T04:56:32.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.471+0000 7f76b9ee2700 1 -- 172.21.15.57:0/1090554630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b40b5910 con 0x7f76b40b1e80 2021-06-25T04:56:32.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.471+0000 7f76b0ff9700 1 -- 172.21.15.57:0/1090554630 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f76ac022070 con 0x7f76b40b1e80 2021-06-25T04:56:32.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.471+0000 7f76b0ff9700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f76940553f0 0x7f76940578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.471+0000 7f76b0ff9700 1 -- 172.21.15.57:0/1090554630 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f76ac06e660 con 0x7f76b40b1e80 2021-06-25T04:56:32.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.471+0000 7f76b37fe700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f76940553f0 0x7f76940578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.471+0000 7f76b37fe700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f76940553f0 0x7f76940578b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f76a8019000 tx=0x7f76a8015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:32.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.479+0000 7f76b0ff9700 1 -- 172.21.15.57:0/1090554630 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f76ac044810 con 0x7f76b40b1e80 2021-06-25T04:56:32.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.607+0000 7f76b9ee2700 1 -- 172.21.15.57:0/1090554630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f76b4057310 con 0x7f76b40b1e80 2021-06-25T04:56:32.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.607+0000 7f76b0ff9700 1 -- 172.21.15.57:0/1090554630 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7f76ac016020 con 0x7f76b40b1e80 2021-06-25T04:56:32.612 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:56:32.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.607+0000 7f76b9ee2700 1 -- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f76940553f0 msgr2=0x7f76940578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.607+0000 7f76b9ee2700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f76940553f0 0x7f76940578b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f76a8019000 tx=0x7f76a8015000).stop 2021-06-25T04:56:32.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.611+0000 7f76b9ee2700 1 -- 172.21.15.57:0/1090554630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b40b1e80 msgr2=0x7f76b415a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.611+0000 7f76b9ee2700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b40b1e80 0x7f76b415a090 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f76ac006e00 tx=0x7f76ac0091d0).stop 2021-06-25T04:56:32.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.611+0000 7f76b9ee2700 1 -- 172.21.15.57:0/1090554630 shutdown_connections 2021-06-25T04:56:32.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.611+0000 7f76b9ee2700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f76940553f0 0x7f76940578b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.611+0000 7f76b9ee2700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b40b1e80 0x7f76b415a090 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.611+0000 7f76b9ee2700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76b40aff70 0x7f76b40b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.611+0000 7f76b9ee2700 1 --2- 172.21.15.57:0/1090554630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76b40a7080 0x7f76b40aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.611+0000 7f76b9ee2700 1 -- 172.21.15.57:0/1090554630 >> 172.21.15.57:0/1090554630 conn(0x7f76b405f670 msgr2=0x7f76b413e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.611+0000 7f76b9ee2700 1 -- 172.21.15.57:0/1090554630 shutdown_connections 2021-06-25T04:56:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.611+0000 7f76b9ee2700 1 -- 172.21.15.57:0/1090554630 wait complete. 2021-06-25T04:56:32.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:56:32.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f48b50700 1 Processor -- start 2021-06-25T04:56:32.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f48b50700 1 -- start start 2021-06-25T04:56:32.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f48b50700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f440b4140 0x7f5f44140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f48b50700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f44143b20 con 0x7f5f440b4650 2021-06-25T04:56:32.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f48b50700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f44143dc0 con 0x7f5f44146910 2021-06-25T04:56:32.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f48b50700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441474d0 con 0x7f5f440b4140 2021-06-25T04:56:32.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f42d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5f440b4650 0x7f5f440b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60642/0 (socket says 172.21.15.57:60642) 2021-06-25T04:56:32.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f42d9d700 1 -- 172.21.15.57:0/1492864968 learned_addr learned my addr 172.21.15.57:0/1492864968 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:32.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f39d9b700 1 --2- 172.21.15.57:0/1492864968 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f440b4140 0x7f5f44140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f41d9b700 1 -- 172.21.15.57:0/1492864968 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209460825 0 0) 0x7f5f44143b20 con 0x7f5f440b4650 2021-06-25T04:56:32.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f41d9b700 1 -- 172.21.15.57:0/1492864968 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f24003260 con 0x7f5f440b4650 2021-06-25T04:56:32.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f41d9b700 1 -- 172.21.15.57:0/1492864968 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868563849 0 0) 0x7f5f44143dc0 con 0x7f5f44146910 2021-06-25T04:56:32.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f41d9b700 1 -- 172.21.15.57:0/1492864968 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f44143b20 con 0x7f5f44146910 2021-06-25T04:56:32.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f39d9b700 1 -- 172.21.15.57:0/1492864968 >> v1:172.21.15.87:6789/0 conn(0x7f5f44146910 legacy=0x7f5f441401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f39d9b700 1 -- 172.21.15.57:0/1492864968 >> v1:172.21.15.57:6789/0 conn(0x7f5f440b4650 legacy=0x7f5f440b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f39d9b700 1 -- 172.21.15.57:0/1492864968 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440b0c50 con 0x7f5f440b4140 2021-06-25T04:56:32.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f39d9b700 1 --2- 172.21.15.57:0/1492864968 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f440b4140 0x7f5f44140900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f5f2c002f70 tx=0x7f5f2c006df0).ready entity=mon.2 client_cookie=3d99292b2e57eb8f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:32.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f41d9b700 1 -- 172.21.15.57:0/1492864968 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f2c00d5c0 con 0x7f5f440b4140 2021-06-25T04:56:32.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f41d9b700 1 -- 172.21.15.57:0/1492864968 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c000e90 con 0x7f5f440b4140 2021-06-25T04:56:32.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f41d9b700 1 -- 172.21.15.57:0/1492864968 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f2c00d910 con 0x7f5f440b4140 2021-06-25T04:56:32.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f48b50700 1 -- 172.21.15.57:0/1492864968 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f440b4140 msgr2=0x7f5f44140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.731+0000 7f5f48b50700 1 --2- 172.21.15.57:0/1492864968 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f440b4140 0x7f5f44140900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f5f2c002f70 tx=0x7f5f2c006df0).stop 2021-06-25T04:56:32.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.735+0000 7f5f48b50700 1 -- 172.21.15.57:0/1492864968 shutdown_connections 2021-06-25T04:56:32.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.735+0000 7f5f48b50700 1 --2- 172.21.15.57:0/1492864968 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f440b4140 0x7f5f44140900 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.735+0000 7f5f48b50700 1 -- 172.21.15.57:0/1492864968 >> 172.21.15.57:0/1492864968 conn(0x7f5f4405c450 msgr2=0x7f5f4405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:32.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.735+0000 7f5f48b50700 1 -- 172.21.15.57:0/1492864968 shutdown_connections 2021-06-25T04:56:32.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.735+0000 7f5f48b50700 1 -- 172.21.15.57:0/1492864968 wait complete. 2021-06-25T04:56:32.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.735+0000 7f5f48b50700 1 Processor -- start 2021-06-25T04:56:32.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.735+0000 7f5f48b50700 1 -- start start 2021-06-25T04:56:32.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f48b50700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440b4140 0x7f5f44142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f48b50700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f440b4650 0x7f5f4413e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f48b50700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f44146910 0x7f5f4413e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f48b50700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440ae350 con 0x7f5f440b4140 2021-06-25T04:56:32.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f48b50700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4413eb50 con 0x7f5f44146910 2021-06-25T04:56:32.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f48b50700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441410b0 con 0x7f5f440b4650 2021-06-25T04:56:32.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f4259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440b4140 0x7f5f44142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f4259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440b4140 0x7f5f44142a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43426/0 (socket says 172.21.15.57:43426) 2021-06-25T04:56:32.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f4259c700 1 -- 172.21.15.57:0/1204402160 learned_addr learned my addr 172.21.15.57:0/1204402160 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:32.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f42d9d700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f44146910 0x7f5f4413e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f39d9b700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f440b4650 0x7f5f4413e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f4259c700 1 -- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f440b4650 msgr2=0x7f5f4413e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f4259c700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f440b4650 0x7f5f4413e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f4259c700 1 -- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f44146910 msgr2=0x7f5f4413e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f4259c700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f44146910 0x7f5f4413e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f4259c700 1 -- 172.21.15.57:0/1204402160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c00b180 con 0x7f5f440b4140 2021-06-25T04:56:32.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f4259c700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440b4140 0x7f5f44142a60 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f5f4413ece0 tx=0x7f5f34007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:32.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f3bfff700 1 -- 172.21.15.57:0/1204402160 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f34012400 con 0x7f5f440b4140 2021-06-25T04:56:32.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f3bfff700 1 -- 172.21.15.57:0/1204402160 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f34012560 con 0x7f5f440b4140 2021-06-25T04:56:32.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f48b50700 1 -- 172.21.15.57:0/1204402160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f441419e0 con 0x7f5f440b4140 2021-06-25T04:56:32.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f3bfff700 1 -- 172.21.15.57:0/1204402160 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f340128c0 con 0x7f5f440b4140 2021-06-25T04:56:32.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f48b50700 1 -- 172.21.15.57:0/1204402160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f441423e0 con 0x7f5f440b4140 2021-06-25T04:56:32.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.739+0000 7f5f48b50700 1 -- 172.21.15.57:0/1204402160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f44057310 con 0x7f5f440b4140 2021-06-25T04:56:32.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.743+0000 7f5f3bfff700 1 -- 172.21.15.57:0/1204402160 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5f34019030 con 0x7f5f440b4140 2021-06-25T04:56:32.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.743+0000 7f5f3bfff700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f28055340 0x7f5f28057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:32.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.743+0000 7f5f3bfff700 1 -- 172.21.15.57:0/1204402160 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5f3406d3f0 con 0x7f5f440b4140 2021-06-25T04:56:32.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.743+0000 7f5f39d9b700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f28055340 0x7f5f28057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:32.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.743+0000 7f5f39d9b700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f28055340 0x7f5f28057800 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f5f2c017000 tx=0x7f5f2c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:32.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.751+0000 7f5f3bfff700 1 -- 172.21.15.57:0/1204402160 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5f34043410 con 0x7f5f440b4140 2021-06-25T04:56:32.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.875+0000 7f5f48b50700 1 -- 172.21.15.57:0/1204402160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f440698a0 con 0x7f5f440b4140 2021-06-25T04:56:32.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.875+0000 7f5f3bfff700 1 -- 172.21.15.57:0/1204402160 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f34046a30 con 0x7f5f440b4140 2021-06-25T04:56:32.882 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:32.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 -- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f28055340 msgr2=0x7f5f28057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f28055340 0x7f5f28057800 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f5f2c017000 tx=0x7f5f2c014000).stop 2021-06-25T04:56:32.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 -- 172.21.15.57:0/1204402160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440b4140 msgr2=0x7f5f44142a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:32.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440b4140 0x7f5f44142a60 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f5f4413ece0 tx=0x7f5f34007ae0).stop 2021-06-25T04:56:32.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 -- 172.21.15.57:0/1204402160 shutdown_connections 2021-06-25T04:56:32.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5f28055340 0x7f5f28057800 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f44146910 0x7f5f4413e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f440b4650 0x7f5f4413e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 --2- 172.21.15.57:0/1204402160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440b4140 0x7f5f44142a60 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:32.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 -- 172.21.15.57:0/1204402160 >> 172.21.15.57:0/1204402160 conn(0x7f5f4405c450 msgr2=0x7f5f440ba030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:32.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 -- 172.21.15.57:0/1204402160 shutdown_connections 2021-06-25T04:56:32.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.879+0000 7f5f48b50700 1 -- 172.21.15.57:0/1204402160 wait complete. 2021-06-25T04:56:32.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:56:33.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.999+0000 7fa43359e700 1 Processor -- start 2021-06-25T04:56:33.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:32.999+0000 7fa43359e700 1 -- start start 2021-06-25T04:56:33.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340b06d0 0x7fa434142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4341438e0 con 0x7fa4340ace30 2021-06-25T04:56:33.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4340b0ab0 con 0x7fa4340b3090 2021-06-25T04:56:33.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340ae640 con 0x7fa4340b06d0 2021-06-25T04:56:33.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa432d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa4340ace30 0x7fa43413f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60656/0 (socket says 172.21.15.57:60656) 2021-06-25T04:56:33.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa432d9d700 1 -- 172.21.15.57:0/1268056388 learned_addr learned my addr 172.21.15.57:0/1268056388 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:33.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43259c700 1 --2- 172.21.15.57:0/1268056388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340b06d0 0x7fa434142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa431d9b700 1 -- 172.21.15.57:0/1268056388 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736953087 0 0) 0x7fa4341438e0 con 0x7fa4340ace30 2021-06-25T04:56:33.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa431d9b700 1 -- 172.21.15.57:0/1268056388 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa414003260 con 0x7fa4340ace30 2021-06-25T04:56:33.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa431d9b700 1 -- 172.21.15.57:0/1268056388 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739409576 0 0) 0x7fa4340b0ab0 con 0x7fa4340b3090 2021-06-25T04:56:33.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa431d9b700 1 -- 172.21.15.57:0/1268056388 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4341438e0 con 0x7fa4340b3090 2021-06-25T04:56:33.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43259c700 1 -- 172.21.15.57:0/1268056388 >> v1:172.21.15.87:6789/0 conn(0x7fa4340b3090 legacy=0x7fa4341431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43259c700 1 -- 172.21.15.57:0/1268056388 >> v1:172.21.15.57:6789/0 conn(0x7fa4340ace30 legacy=0x7fa43413f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa431d9b700 1 -- 172.21.15.57:0/1268056388 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1529176131 0 0) 0x7fa414003260 con 0x7fa4340ace30 2021-06-25T04:56:33.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43259c700 1 -- 172.21.15.57:0/1268056388 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4340ae8e0 con 0x7fa4340b06d0 2021-06-25T04:56:33.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43259c700 1 --2- 172.21.15.57:0/1268056388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340b06d0 0x7fa434142ce0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa42c001490 tx=0x7fa424006df0).ready entity=mon.2 client_cookie=f6f7ada7a178b861 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:33.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa431d9b700 1 -- 172.21.15.57:0/1268056388 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa42c0019e0 con 0x7fa4340b06d0 2021-06-25T04:56:33.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa431d9b700 1 -- 172.21.15.57:0/1268056388 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424000e90 con 0x7fa4340b06d0 2021-06-25T04:56:33.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa431d9b700 1 -- 172.21.15.57:0/1268056388 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa424012460 con 0x7fa4340b06d0 2021-06-25T04:56:33.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43359e700 1 -- 172.21.15.57:0/1268056388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340b06d0 msgr2=0x7fa434142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43359e700 1 --2- 172.21.15.57:0/1268056388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340b06d0 0x7fa434142ce0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa42c001490 tx=0x7fa424006df0).stop 2021-06-25T04:56:33.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43359e700 1 -- 172.21.15.57:0/1268056388 shutdown_connections 2021-06-25T04:56:33.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43359e700 1 --2- 172.21.15.57:0/1268056388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340b06d0 0x7fa434142ce0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43359e700 1 -- 172.21.15.57:0/1268056388 >> 172.21.15.57:0/1268056388 conn(0x7fa434061100 msgr2=0x7fa434062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:33.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43359e700 1 -- 172.21.15.57:0/1268056388 shutdown_connections 2021-06-25T04:56:33.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.003+0000 7fa43359e700 1 -- 172.21.15.57:0/1268056388 wait complete. 2021-06-25T04:56:33.023 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.007+0000 7fa43359e700 1 Processor -- start 2021-06-25T04:56:33.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.007+0000 7fa43359e700 1 -- start start 2021-06-25T04:56:33.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.007+0000 7fa43359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340ace30 0x7fa4340abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.024 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.007+0000 7fa43359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4340b06d0 0x7fa434153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.007+0000 7fa43359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4340b3090 0x7fa4341392e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.007+0000 7fa43359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa434067580 con 0x7fa4340b3090 2021-06-25T04:56:33.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.007+0000 7fa43359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa434138c10 con 0x7fa4340b06d0 2021-06-25T04:56:33.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.007+0000 7fa43359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa434153c10 con 0x7fa4340ace30 2021-06-25T04:56:33.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa432d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4340b3090 0x7fa4341392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa432d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4340b3090 0x7fa4341392e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43444/0 (socket says 172.21.15.57:43444) 2021-06-25T04:56:33.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa432d9d700 1 -- 172.21.15.57:0/2276669495 learned_addr learned my addr 172.21.15.57:0/2276669495 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:33.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa43259c700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340ace30 0x7fa4340abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa42bfff700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4340b06d0 0x7fa434153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa432d9d700 1 -- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340ace30 msgr2=0x7fa4340abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa432d9d700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340ace30 0x7fa4340abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa432d9d700 1 -- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4340b06d0 msgr2=0x7fa434153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa432d9d700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4340b06d0 0x7fa434153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa432d9d700 1 -- 172.21.15.57:0/2276669495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42400b180 con 0x7fa4340b3090 2021-06-25T04:56:33.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa42bfff700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4340b06d0 0x7fa434153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:56:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa432d9d700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4340b3090 0x7fa4341392e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7fa42c001360 tx=0x7fa42c001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa42b7fe700 1 -- 172.21.15.57:0/2276669495 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa42c004ab0 con 0x7fa4340b3090 2021-06-25T04:56:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa42b7fe700 1 -- 172.21.15.57:0/2276669495 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c004c10 con 0x7fa4340b3090 2021-06-25T04:56:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa43359e700 1 -- 172.21.15.57:0/2276669495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4340677b0 con 0x7fa4340b3090 2021-06-25T04:56:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa42b7fe700 1 -- 172.21.15.57:0/2276669495 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa42c007170 con 0x7fa4340b3090 2021-06-25T04:56:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa43359e700 1 -- 172.21.15.57:0/2276669495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa434138e40 con 0x7fa4340b3090 2021-06-25T04:56:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa43359e700 1 -- 172.21.15.57:0/2276669495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43413bcf0 con 0x7fa4340b3090 2021-06-25T04:56:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa42b7fe700 1 -- 172.21.15.57:0/2276669495 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa42c01b060 con 0x7fa4340b3090 2021-06-25T04:56:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa42b7fe700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa418055360 0x7fa418057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.011+0000 7fa42b7fe700 1 -- 172.21.15.57:0/2276669495 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa42c06dd30 con 0x7fa4340b3090 2021-06-25T04:56:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.015+0000 7fa43259c700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa418055360 0x7fa418057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.015+0000 7fa43259c700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa418055360 0x7fa418057820 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fa424017000 tx=0x7fa424014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.019+0000 7fa42b7fe700 1 -- 172.21.15.57:0/2276669495 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa42c043e40 con 0x7fa4340b3090 2021-06-25T04:56:33.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.147+0000 7fa43359e700 1 -- 172.21.15.57:0/2276669495 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa434139040 con 0x7fa4340b3090 2021-06-25T04:56:33.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.147+0000 7fa42b7fe700 1 -- 172.21.15.57:0/2276669495 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa434139040 con 0x7fa4340b3090 2021-06-25T04:56:33.155 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:33.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 -- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa418055360 msgr2=0x7fa418057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa418055360 0x7fa418057820 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fa424017000 tx=0x7fa424014000).stop 2021-06-25T04:56:33.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 -- 172.21.15.57:0/2276669495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4340b3090 msgr2=0x7fa4341392e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4340b3090 0x7fa4341392e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7fa42c001360 tx=0x7fa42c001aa0).stop 2021-06-25T04:56:33.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 -- 172.21.15.57:0/2276669495 shutdown_connections 2021-06-25T04:56:33.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa418055360 0x7fa418057820 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4340b3090 0x7fa4341392e0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4340b06d0 0x7fa434153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 --2- 172.21.15.57:0/2276669495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340ace30 0x7fa4340abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 -- 172.21.15.57:0/2276669495 >> 172.21.15.57:0/2276669495 conn(0x7fa434061100 msgr2=0x7fa434142da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 -- 172.21.15.57:0/2276669495 shutdown_connections 2021-06-25T04:56:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.151+0000 7fa43359e700 1 -- 172.21.15.57:0/2276669495 wait complete. 2021-06-25T04:56:33.167 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:56:33.277 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.271+0000 7f3d8d8ad700 1 Processor -- start 2021-06-25T04:56:33.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.271+0000 7f3d8d8ad700 1 -- start start 2021-06-25T04:56:33.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8d8ad700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880b0b40 0x7f3d88146c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8d8ad700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d880b1100 con 0x7f3d880a9150 2021-06-25T04:56:33.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8d8ad700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d880a9530 con 0x7f3d880b0390 2021-06-25T04:56:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8d8ad700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880b1330 con 0x7f3d880b0b40 2021-06-25T04:56:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8c8ab700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3d880a9150 0x7f3d88146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60666/0 (socket says 172.21.15.57:60666) 2021-06-25T04:56:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8c8ab700 1 -- 172.21.15.57:0/2213696972 learned_addr learned my addr 172.21.15.57:0/2213696972 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7ffff700 1 --2- 172.21.15.57:0/2213696972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880b0b40 0x7f3d88146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7f7fe700 1 -- 172.21.15.57:0/2213696972 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587065831 0 0) 0x7f3d880b1100 con 0x7f3d880a9150 2021-06-25T04:56:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7f7fe700 1 -- 172.21.15.57:0/2213696972 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d74003260 con 0x7f3d880a9150 2021-06-25T04:56:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7f7fe700 1 -- 172.21.15.57:0/2213696972 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294503078 0 0) 0x7f3d880a9530 con 0x7f3d880b0390 2021-06-25T04:56:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7f7fe700 1 -- 172.21.15.57:0/2213696972 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d880b1100 con 0x7f3d880b0390 2021-06-25T04:56:33.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7f7fe700 1 -- 172.21.15.57:0/2213696972 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2233278332 0 0) 0x7f3d74003260 con 0x7f3d880a9150 2021-06-25T04:56:33.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7ffff700 1 -- 172.21.15.57:0/2213696972 >> v1:172.21.15.87:6789/0 conn(0x7f3d880b0390 legacy=0x7f3d88140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7ffff700 1 -- 172.21.15.57:0/2213696972 >> v1:172.21.15.57:6789/0 conn(0x7f3d880a9150 legacy=0x7f3d88146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7ffff700 1 -- 172.21.15.57:0/2213696972 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880b15d0 con 0x7f3d880b0b40 2021-06-25T04:56:33.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7ffff700 1 --2- 172.21.15.57:0/2213696972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880b0b40 0x7f3d88146c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f3d84001800 tx=0x7f3d78006df0).ready entity=mon.2 client_cookie=70410dbbbcd6a616 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:33.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7f7fe700 1 -- 172.21.15.57:0/2213696972 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d84001660 con 0x7f3d880b0b40 2021-06-25T04:56:33.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7f7fe700 1 -- 172.21.15.57:0/2213696972 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78000e90 con 0x7f3d880b0b40 2021-06-25T04:56:33.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d7f7fe700 1 -- 172.21.15.57:0/2213696972 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d78012460 con 0x7f3d880b0b40 2021-06-25T04:56:33.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/2213696972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880b0b40 msgr2=0x7f3d88146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8d8ad700 1 --2- 172.21.15.57:0/2213696972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880b0b40 0x7f3d88146c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f3d84001800 tx=0x7f3d78006df0).stop 2021-06-25T04:56:33.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/2213696972 shutdown_connections 2021-06-25T04:56:33.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8d8ad700 1 --2- 172.21.15.57:0/2213696972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880b0b40 0x7f3d88146c20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/2213696972 >> 172.21.15.57:0/2213696972 conn(0x7f3d88061100 msgr2=0x7f3d88062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:33.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/2213696972 shutdown_connections 2021-06-25T04:56:33.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.275+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/2213696972 wait complete. 2021-06-25T04:56:33.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d8ad700 1 Processor -- start 2021-06-25T04:56:33.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d8ad700 1 -- start start 2021-06-25T04:56:33.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d8ad700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d880a9150 0x7f3d880ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d8ad700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880b0390 0x7f3d88145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d8ad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880b0b40 0x7f3d8813be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d8ad700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d881428e0 con 0x7f3d880b0b40 2021-06-25T04:56:33.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d8ad700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88145850 con 0x7f3d880a9150 2021-06-25T04:56:33.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d8ad700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88145ae0 con 0x7f3d880b0390 2021-06-25T04:56:33.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d0ac700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880b0b40 0x7f3d8813be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d0ac700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880b0b40 0x7f3d8813be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43458/0 (socket says 172.21.15.57:43458) 2021-06-25T04:56:33.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8c8ab700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d880a9150 0x7f3d880ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d0ac700 1 -- 172.21.15.57:0/3525786781 learned_addr learned my addr 172.21.15.57:0/3525786781 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:33.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d7ffff700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880b0390 0x7f3d88145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8c8ab700 1 -- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880b0390 msgr2=0x7f3d88145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8c8ab700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880b0390 0x7f3d88145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8c8ab700 1 -- 172.21.15.57:0/3525786781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880b0b40 msgr2=0x7f3d8813be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8c8ab700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880b0b40 0x7f3d8813be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8c8ab700 1 -- 172.21.15.57:0/3525786781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7800b180 con 0x7f3d880a9150 2021-06-25T04:56:33.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d0ac700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880b0b40 0x7f3d8813be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:33.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8c8ab700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d880a9150 0x7f3d880ac160 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f3d84000fe0 tx=0x7f3d84001740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:33.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d7dffb700 1 -- 172.21.15.57:0/3525786781 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d84007170 con 0x7f3d880a9150 2021-06-25T04:56:33.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/3525786781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d88143190 con 0x7f3d880a9150 2021-06-25T04:56:33.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d7dffb700 1 -- 172.21.15.57:0/3525786781 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d840072d0 con 0x7f3d880a9150 2021-06-25T04:56:33.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d7dffb700 1 -- 172.21.15.57:0/3525786781 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d84004710 con 0x7f3d880a9150 2021-06-25T04:56:33.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.279+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/3525786781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d881436d0 con 0x7f3d880a9150 2021-06-25T04:56:33.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.283+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/3525786781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d88057310 con 0x7f3d880a9150 2021-06-25T04:56:33.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.283+0000 7f3d7dffb700 1 -- 172.21.15.57:0/3525786781 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3d84004870 con 0x7f3d880a9150 2021-06-25T04:56:33.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.283+0000 7f3d7dffb700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d68055490 0x7f3d68057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.283+0000 7f3d7dffb700 1 -- 172.21.15.57:0/3525786781 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3d8406d8a0 con 0x7f3d880a9150 2021-06-25T04:56:33.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.283+0000 7f3d7ffff700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d68055490 0x7f3d68057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.283+0000 7f3d7ffff700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d68055490 0x7f3d68057950 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f3d78019000 tx=0x7f3d78014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:33.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.291+0000 7f3d7dffb700 1 -- 172.21.15.57:0/3525786781 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3d840439b0 con 0x7f3d880a9150 2021-06-25T04:56:33.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.419+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/3525786781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d88067bf0 con 0x7f3d880a9150 2021-06-25T04:56:33.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.423+0000 7f3d7dffb700 1 -- 172.21.15.57:0/3525786781 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3d84046fd0 con 0x7f3d880a9150 2021-06-25T04:56:33.428 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:33.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d68055490 msgr2=0x7f3d68057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d68055490 0x7f3d68057950 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f3d78019000 tx=0x7f3d78014000).stop 2021-06-25T04:56:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d880a9150 msgr2=0x7f3d880ac160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d880a9150 0x7f3d880ac160 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f3d84000fe0 tx=0x7f3d84001740).stop 2021-06-25T04:56:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/3525786781 shutdown_connections 2021-06-25T04:56:33.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d68055490 0x7f3d68057950 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d880b0b40 0x7f3d8813be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d880b0390 0x7f3d88145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 --2- 172.21.15.57:0/3525786781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d880a9150 0x7f3d880ac160 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/3525786781 >> 172.21.15.57:0/3525786781 conn(0x7f3d88061100 msgr2=0x7f3d880af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:33.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/3525786781 shutdown_connections 2021-06-25T04:56:33.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.427+0000 7f3d8d8ad700 1 -- 172.21.15.57:0/3525786781 wait complete. 2021-06-25T04:56:33.446 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:56:33.446 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:33.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c2b12700 1 Processor -- start 2021-06-25T04:56:33.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c2b12700 1 -- start start 2021-06-25T04:56:33.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c2b12700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45bc063890 0x7f45bc143d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c2b12700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45bc0618e0 0x7f45bc140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c2b12700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc063c70 con 0x7f45bc0b1290 2021-06-25T04:56:33.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c2b12700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc13fd70 con 0x7f45bc0618e0 2021-06-25T04:56:33.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c2b12700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc061fb0 con 0x7f45bc063890 2021-06-25T04:56:33.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c130f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45bc0618e0 0x7f45bc140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c130f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45bc0618e0 0x7f45bc140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43464/0 (socket says 172.21.15.57:43464) 2021-06-25T04:56:33.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c130f700 1 -- 172.21.15.57:0/2994605521 learned_addr learned my addr 172.21.15.57:0/2994605521 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:33.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c2311700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f45bc0b1290 0x7f45bc128c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60684/0 (socket says 172.21.15.57:60684) 2021-06-25T04:56:33.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c1b10700 1 --2- 172.21.15.57:0/2994605521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45bc063890 0x7f45bc143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c130f700 1 -- 172.21.15.57:0/2994605521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45bc063890 msgr2=0x7f45bc143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:33.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c130f700 1 --2- 172.21.15.57:0/2994605521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45bc063890 0x7f45bc143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c130f700 1 -- 172.21.15.57:0/2994605521 >> v1:172.21.15.57:6789/0 conn(0x7f45bc0b1290 legacy=0x7f45bc128c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c130f700 1 -- 172.21.15.57:0/2994605521 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc13ff60 con 0x7f45bc0618e0 2021-06-25T04:56:33.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c130f700 1 --2- 172.21.15.57:0/2994605521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45bc0618e0 0x7f45bc140940 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f45b80032f0 tx=0x7f45b800b530).ready entity=mon.0 client_cookie=b44e4f2cb129b026 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:33.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c0b0e700 1 -- 172.21.15.57:0/2994605521 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b8010660 con 0x7f45bc0618e0 2021-06-25T04:56:33.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c0b0e700 1 -- 172.21.15.57:0/2994605521 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b80107c0 con 0x7f45bc0618e0 2021-06-25T04:56:33.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c0b0e700 1 -- 172.21.15.57:0/2994605521 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b8010b20 con 0x7f45bc0618e0 2021-06-25T04:56:33.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c2b12700 1 -- 172.21.15.57:0/2994605521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45bc0618e0 msgr2=0x7f45bc140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.539+0000 7f45c2b12700 1 --2- 172.21.15.57:0/2994605521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45bc0618e0 0x7f45bc140940 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f45b80032f0 tx=0x7f45b800b530).stop 2021-06-25T04:56:33.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 -- 172.21.15.57:0/2994605521 shutdown_connections 2021-06-25T04:56:33.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 --2- 172.21.15.57:0/2994605521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45bc0618e0 0x7f45bc140940 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 --2- 172.21.15.57:0/2994605521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45bc063890 0x7f45bc143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 -- 172.21.15.57:0/2994605521 >> 172.21.15.57:0/2994605521 conn(0x7f45bc05c450 msgr2=0x7f45bc05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:33.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 -- 172.21.15.57:0/2994605521 shutdown_connections 2021-06-25T04:56:33.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 -- 172.21.15.57:0/2994605521 wait complete. 2021-06-25T04:56:33.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 Processor -- start 2021-06-25T04:56:33.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 -- start start 2021-06-25T04:56:33.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45bc0618e0 0x7f45bc13eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45bc063890 0x7f45bc0ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45bc0b1290 0x7f45bc0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc14e240 con 0x7f45bc063890 2021-06-25T04:56:33.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0af2e0 con 0x7f45bc0618e0 2021-06-25T04:56:33.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2b12700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc14e430 con 0x7f45bc0b1290 2021-06-25T04:56:33.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c130f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45bc063890 0x7f45bc0ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c2311700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45bc0b1290 0x7f45bc0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c1b10700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45bc0618e0 0x7f45bc13eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c130f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45bc063890 0x7f45bc0ae900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43472/0 (socket says 172.21.15.57:43472) 2021-06-25T04:56:33.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.543+0000 7f45c130f700 1 -- 172.21.15.57:0/222604674 learned_addr learned my addr 172.21.15.57:0/222604674 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:33.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45c130f700 1 -- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45bc0b1290 msgr2=0x7f45bc0aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45c130f700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45bc0b1290 0x7f45bc0aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45c130f700 1 -- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45bc0618e0 msgr2=0x7f45bc13eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45c130f700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45bc0618e0 0x7f45bc13eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45c130f700 1 -- 172.21.15.57:0/222604674 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b800b7d0 con 0x7f45bc063890 2021-06-25T04:56:33.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45c130f700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45bc063890 0x7f45bc0ae900 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f45b80032f0 tx=0x7f45bc0ae890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:33.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45af7fe700 1 -- 172.21.15.57:0/222604674 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b800de40 con 0x7f45bc063890 2021-06-25T04:56:33.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45af7fe700 1 -- 172.21.15.57:0/222604674 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b8018610 con 0x7f45bc063890 2021-06-25T04:56:33.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45af7fe700 1 -- 172.21.15.57:0/222604674 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b8018970 con 0x7f45bc063890 2021-06-25T04:56:33.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45c2b12700 1 -- 172.21.15.57:0/222604674 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc14e6d0 con 0x7f45bc063890 2021-06-25T04:56:33.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45c2b12700 1 -- 172.21.15.57:0/222604674 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc14ec10 con 0x7f45bc063890 2021-06-25T04:56:33.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45c2b12700 1 -- 172.21.15.57:0/222604674 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc057310 con 0x7f45bc063890 2021-06-25T04:56:33.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45af7fe700 1 -- 172.21.15.57:0/222604674 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f45b802b070 con 0x7f45bc063890 2021-06-25T04:56:33.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45af7fe700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45980554e0 0x7f45980579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:33.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45af7fe700 1 -- 172.21.15.57:0/222604674 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f45b8071c30 con 0x7f45bc063890 2021-06-25T04:56:33.562 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.547+0000 7f45c1b10700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45980554e0 0x7f45980579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:33.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.551+0000 7f45c1b10700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45980554e0 0x7f45980579a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f45b000c000 tx=0x7f45b0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:33.563 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.555+0000 7f45af7fe700 1 -- 172.21.15.57:0/222604674 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f45b8047cd0 con 0x7f45bc063890 2021-06-25T04:56:33.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 -- 172.21.15.57:0/222604674 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45bc0b3bc0 con 0x7f45bc063890 2021-06-25T04:56:33.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45af7fe700 1 -- 172.21.15.57:0/222604674 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f45b804b2f0 con 0x7f45bc063890 2021-06-25T04:56:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:33.725 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3591673245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3591673245},{"type":"v1","addr":"172.21.15.57:6833","nonce":3591673245}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2597000234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2597000234},{"type":"v1","addr":"172.21.15.57:6835","nonce":2597000234}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:24.666625+0000","modified":"2021-06-25T04:56:26.355926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8088":{"gid":8088,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2964573030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2964573030},{"type":"v1","addr":"172.21.15.87:6835","nonce":2964573030}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-06-25T04:56:33.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 -- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45980554e0 msgr2=0x7f45980579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45980554e0 0x7f45980579a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f45b000c000 tx=0x7f45b0008040).stop 2021-06-25T04:56:33.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 -- 172.21.15.57:0/222604674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45bc063890 msgr2=0x7f45bc0ae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:33.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45bc063890 0x7f45bc0ae900 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f45b80032f0 tx=0x7f45bc0ae890).stop 2021-06-25T04:56:33.727 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 -- 172.21.15.57:0/222604674 shutdown_connections 2021-06-25T04:56:33.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f45980554e0 0x7f45980579a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45bc0b1290 0x7f45bc0aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45bc063890 0x7f45bc0ae900 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 --2- 172.21.15.57:0/222604674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45bc0618e0 0x7f45bc13eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 -- 172.21.15.57:0/222604674 >> 172.21.15.57:0/222604674 conn(0x7f45bc05c450 msgr2=0x7f45bc141ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 -- 172.21.15.57:0/222604674 shutdown_connections 2021-06-25T04:56:33.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:33.719+0000 7f45c2b12700 1 -- 172.21.15.57:0/222604674 wait complete. 2021-06-25T04:56:33.730 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 70 2021-06-25T04:56:34.040 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:56:24.666625+0000', 'modified': '2021-06-25T04:56:26.355926+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8088': {'gid': 8088, 'name': 'b', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/2964573030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 2964573030}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 2964573030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:56:34.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:56:34.042 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-06-25T04:56:34.157 INFO:teuthology.orchestra.run.smithi087.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":8088,"want_state":"up:active","state":"up:active","rank_uptime":9.4774442600000004,"mdsmap_epoch":70,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":13.771464282} 2021-06-25T04:56:34.158 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 8088, "mdsmap_epoch": 70, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 9.47744426, "state": "up:active", "uptime": 13.771464282, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:56:34.159 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:56:34.159 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-06-25T04:56:34.159 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi161.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-06-25T04:56:34.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:34.160 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:34.168 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:56:34.182 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:56:34.183 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:56:34.240 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:56:34.241 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:56:34.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:34.242 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:56:34.247 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:56:34.248 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:34.251 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:56:34.269 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:56:34.269 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:56:34.326 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:56:34.327 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:2021-06-25T04:56:34.324+0000 7f1eb5bf3080 -1 init, newargv = 0x55a1598978b0 newargc=9 2021-06-25T04:56:34.327 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14987]: starting ceph client 2021-06-25T04:56:34.328 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:56:34.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:34.329 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:56:34.336 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14987]: starting fuse 2021-06-25T04:56:35.436 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:56:35.455 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:56:35.455 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:56:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:56:35.512 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:56:35.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:35.513 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:56:35.518 INFO:teuthology.orchestra.run.smithi161.stdout:52 2021-06-25T04:56:35.519 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:56:35.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:35.520 DEBUG:teuthology.orchestra.run.smithi161:> sudo python3 -c ' 2021-06-25T04:56:35.520 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2021-06-25T04:56:35.520 DEBUG:teuthology.orchestra.run.smithi161:> import re 2021-06-25T04:56:35.521 DEBUG:teuthology.orchestra.run.smithi161:> import os 2021-06-25T04:56:35.521 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2021-06-25T04:56:35.522 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:56:35.522 DEBUG:teuthology.orchestra.run.smithi161:> def find_socket(client_name): 2021-06-25T04:56:35.522 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-06-25T04:56:35.523 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2021-06-25T04:56:35.523 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:56:35.524 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2021-06-25T04:56:35.524 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2021-06-25T04:56:35.524 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2021-06-25T04:56:35.525 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2021-06-25T04:56:35.525 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:56:35.526 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2021-06-25T04:56:35.526 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:56:35.527 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:56:35.527 DEBUG:teuthology.orchestra.run.smithi161:> return f 2021-06-25T04:56:35.527 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:56:35.528 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:56:35.528 DEBUG:teuthology.orchestra.run.smithi161:> print(find_socket("client.1")) 2021-06-25T04:56:35.529 DEBUG:teuthology.orchestra.run.smithi161:> ' 2021-06-25T04:56:35.606 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.14987.asok 2021-06-25T04:56:35.611 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14987.asok 2021-06-25T04:56:35.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:35.612 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14987.asok status 2021-06-25T04:56:35.698 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2021-06-25T04:56:35.698 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2021-06-25T04:56:35.699 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:56:35.699 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:56:35.699 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2021-06-25T04:56:35.699 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2021-06-25T04:56:35.700 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-06-25T04:56:35.700 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "14987", 2021-06-25T04:56:35.700 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2021-06-25T04:56:35.700 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:56:35.700 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2021-06-25T04:56:35.701 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2021-06-25T04:56:35.701 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 8301, 2021-06-25T04:56:35.701 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2021-06-25T04:56:35.701 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2021-06-25T04:56:35.702 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2021-06-25T04:56:35.702 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 8301 2021-06-25T04:56:35.702 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:56:35.702 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:56:35.702 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:56:35.703 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:56:35.703 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 2543497131 2021-06-25T04:56:35.703 INFO:teuthology.orchestra.run.smithi161.stdout: } 2021-06-25T04:56:35.703 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:56:35.704 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:56:35.704 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:56:35.704 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:56:35.704 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 2543497131 2021-06-25T04:56:35.705 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:56:35.705 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.8301 172.21.15.161:0/2543497131", 2021-06-25T04:56:35.705 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "172.21.15.161:0/2543497131", 2021-06-25T04:56:35.706 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2021-06-25T04:56:35.706 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 70, 2021-06-25T04:56:35.706 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 139, 2021-06-25T04:56:35.706 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:56:35.707 INFO:teuthology.orchestra.run.smithi161.stdout: "blacklisted": false, 2021-06-25T04:56:35.707 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2021-06-25T04:56:35.707 INFO:teuthology.orchestra.run.smithi161.stdout:} 2021-06-25T04:56:35.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:35.709 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:35.709 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:35.716 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:56:35.718 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:56:35.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:35.719 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:35.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:35.785 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:35.786 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:35.793 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:56:35.794 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:56:35.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:35.795 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:35.795 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:35.844 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:56:35.846 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:56:35.846 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2021-06-25T04:56:35.847 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:56:35.847 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:35.862 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[14987]: fuse finished with error 0 and tester_r 0 2021-06-25T04:56:35.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:35.865 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:35.866 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:35.873 INFO:teuthology.orchestra.run.smithi161.stdout:ext2/ext3 2021-06-25T04:56:35.874 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:56:35.875 INFO:teuthology.orchestra.run:waiting for 900 2021-06-25T04:56:35.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:56:35.922 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:35.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:56:35.933 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:56:35.936 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:56:35.939 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:56:35.967 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2021-06-25T04:56:35.968 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2021-06-25T04:56:35.969 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:56:35.969 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2021-06-25T04:56:35.969 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.970 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2021-06-25T04:56:35.970 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.970 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2021-06-25T04:56:35.970 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.971 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2021-06-25T04:56:35.971 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2021-06-25T04:56:35.971 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.971 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2021-06-25T04:56:35.972 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2021-06-25T04:56:35.976 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.977 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:56:35.977 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2021-06-25T04:56:35.977 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.978 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:56:35.978 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:56:35.978 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.978 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2021-06-25T04:56:35.979 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.979 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2021-06-25T04:56:35.979 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2021-06-25T04:56:35.979 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:56:35.980 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:56:35.980 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2021-06-25T04:56:35.980 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:56:35.980 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2021-06-25T04:56:35.981 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:56:35.981 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:56:35.981 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.981 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:56:35.982 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.983 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2021-06-25T04:56:35.983 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.983 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2021-06-25T04:56:35.984 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.984 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2021-06-25T04:56:35.984 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2021-06-25T04:56:35.984 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2021-06-25T04:56:35.984 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:56:35.985 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:56:35.985 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.985 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2021-06-25T04:56:35.985 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2021-06-25T04:56:35.986 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.986 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2021-06-25T04:56:35.986 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2021-06-25T04:56:35.986 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.987 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2021-06-25T04:56:35.987 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2021-06-25T04:56:35.987 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.987 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2021-06-25T04:56:35.987 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2021-06-25T04:56:35.988 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2021-06-25T04:56:35.988 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.988 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2021-06-25T04:56:35.988 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2021-06-25T04:56:35.989 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.989 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:56:35.989 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.989 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2021-06-25T04:56:35.989 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.990 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2021-06-25T04:56:35.990 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.991 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:56:35.991 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2021-06-25T04:56:35.991 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.992 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2021-06-25T04:56:35.992 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2021-06-25T04:56:35.992 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2021-06-25T04:56:35.992 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore compression mode = aggressive 2021-06-25T04:56:35.992 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2021-06-25T04:56:35.993 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 20 2021-06-25T04:56:35.993 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 20 2021-06-25T04:56:35.993 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:56:35.994 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2021-06-25T04:56:35.994 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 10 2021-06-25T04:56:35.994 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:56:35.994 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2021-06-25T04:56:35.995 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:56:35.995 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:56:35.995 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2021-06-25T04:56:35.995 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2021-06-25T04:56:35.995 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.996 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2021-06-25T04:56:35.996 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:56:35.996 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2021-06-25T04:56:35.996 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2021-06-25T04:56:35.997 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2021-06-25T04:56:35.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:35.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:35.997 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2021-06-25T04:56:35.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:35.998 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2021-06-25T04:56:35.998 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:56:35.998 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2021-06-25T04:56:35.999 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2021-06-25T04:56:36.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2021-06-25T04:56:36.000 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2021-06-25T04:56:36.000 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2021-06-25T04:56:36.001 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:36.001 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2021-06-25T04:56:36.001 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2021-06-25T04:56:36.001 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:36.001 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:36.002 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:56:36.002 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:56:36.002 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:56:36.003 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:36.003 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:56:36.003 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:56:36.003 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:56:36.004 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2021-06-25T04:56:36.004 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:36.004 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2021-06-25T04:56:36.004 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2021-06-25T04:56:36.004 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2021-06-25T04:56:36.005 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2021-06-25T04:56:36.005 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:56:36.005 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:56:36.005 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2021-06-25T04:56:36.006 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2021-06-25T04:56:36.006 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:56:36.006 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 15m 2021-06-25T04:56:36.006 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 15m 2021-06-25T04:56:36.007 INFO:teuthology.orchestra.run.smithi057.stdout: client debug getattr caps = true 2021-06-25T04:56:36.007 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2021-06-25T04:56:36.007 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2021-06-25T04:56:36.008 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2021-06-25T04:56:36.008 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2021-06-25T04:56:36.008 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2021-06-25T04:56:36.009 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2021-06-25T04:56:36.009 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2021-06-25T04:56:36.010 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2021-06-25T04:56:36.010 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:56:36.010 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal frag = True 2021-06-25T04:56:36.010 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal fragment size max = 10000 2021-06-25T04:56:36.010 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal merge size = 5 2021-06-25T04:56:36.011 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal split bits = 3 2021-06-25T04:56:36.011 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal split size = 100 2021-06-25T04:56:36.011 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2021-06-25T04:56:36.011 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2021-06-25T04:56:36.012 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2021-06-25T04:56:36.012 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2021-06-25T04:56:36.012 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2021-06-25T04:56:36.012 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 15m 2021-06-25T04:56:36.012 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 15m 2021-06-25T04:56:36.016 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2021-06-25T04:56:36.016 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2021-06-25T04:56:36.017 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:56:36.017 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2021-06-25T04:56:36.017 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.017 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2021-06-25T04:56:36.017 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.018 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2021-06-25T04:56:36.018 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.018 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2021-06-25T04:56:36.018 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2021-06-25T04:56:36.019 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.019 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2021-06-25T04:56:36.019 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2021-06-25T04:56:36.019 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.019 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:56:36.020 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2021-06-25T04:56:36.020 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.020 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:56:36.020 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:56:36.021 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.021 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2021-06-25T04:56:36.021 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.021 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2021-06-25T04:56:36.021 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2021-06-25T04:56:36.022 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:56:36.022 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:56:36.022 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2021-06-25T04:56:36.022 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:56:36.023 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2021-06-25T04:56:36.023 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:56:36.023 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:56:36.023 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.023 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:56:36.024 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.024 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2021-06-25T04:56:36.024 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.024 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2021-06-25T04:56:36.025 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.025 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2021-06-25T04:56:36.025 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2021-06-25T04:56:36.025 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2021-06-25T04:56:36.025 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:56:36.026 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:56:36.026 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.026 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2021-06-25T04:56:36.026 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2021-06-25T04:56:36.026 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.027 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2021-06-25T04:56:36.027 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2021-06-25T04:56:36.027 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.027 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2021-06-25T04:56:36.028 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2021-06-25T04:56:36.028 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.028 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2021-06-25T04:56:36.028 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2021-06-25T04:56:36.028 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2021-06-25T04:56:36.029 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.029 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2021-06-25T04:56:36.029 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2021-06-25T04:56:36.029 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.029 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:56:36.030 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.030 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2021-06-25T04:56:36.030 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.030 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2021-06-25T04:56:36.031 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.031 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:56:36.031 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2021-06-25T04:56:36.031 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.031 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2021-06-25T04:56:36.032 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2021-06-25T04:56:36.032 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2021-06-25T04:56:36.032 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore compression mode = aggressive 2021-06-25T04:56:36.032 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2021-06-25T04:56:36.033 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 20 2021-06-25T04:56:36.033 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 20 2021-06-25T04:56:36.033 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:56:36.033 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2021-06-25T04:56:36.034 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 10 2021-06-25T04:56:36.034 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:56:36.034 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2021-06-25T04:56:36.034 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:56:36.034 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:56:36.035 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2021-06-25T04:56:36.035 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2021-06-25T04:56:36.035 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.035 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2021-06-25T04:56:36.035 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:56:36.036 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2021-06-25T04:56:36.036 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2021-06-25T04:56:36.036 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2021-06-25T04:56:36.037 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:36.037 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:36.037 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2021-06-25T04:56:36.037 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.037 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2021-06-25T04:56:36.038 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:56:36.038 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2021-06-25T04:56:36.038 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2021-06-25T04:56:36.038 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2021-06-25T04:56:36.039 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2021-06-25T04:56:36.039 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2021-06-25T04:56:36.039 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:36.040 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2021-06-25T04:56:36.040 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2021-06-25T04:56:36.040 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:36.040 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.040 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:56:36.041 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:56:36.041 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:56:36.042 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.042 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:56:36.042 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:56:36.043 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:56:36.043 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2021-06-25T04:56:36.043 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:36.043 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2021-06-25T04:56:36.044 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2021-06-25T04:56:36.044 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2021-06-25T04:56:36.044 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2021-06-25T04:56:36.044 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:56:36.045 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:56:36.045 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2021-06-25T04:56:36.045 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2021-06-25T04:56:36.045 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:56:36.045 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 15m 2021-06-25T04:56:36.046 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 15m 2021-06-25T04:56:36.046 INFO:teuthology.orchestra.run.smithi161.stdout: client debug getattr caps = true 2021-06-25T04:56:36.046 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2021-06-25T04:56:36.046 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2021-06-25T04:56:36.047 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2021-06-25T04:56:36.047 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2021-06-25T04:56:36.047 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2021-06-25T04:56:36.047 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2021-06-25T04:56:36.048 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2021-06-25T04:56:36.048 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2021-06-25T04:56:36.048 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:56:36.048 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal frag = True 2021-06-25T04:56:36.049 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal fragment size max = 10000 2021-06-25T04:56:36.049 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal merge size = 5 2021-06-25T04:56:36.049 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal split bits = 3 2021-06-25T04:56:36.049 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal split size = 100 2021-06-25T04:56:36.050 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2021-06-25T04:56:36.050 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2021-06-25T04:56:36.051 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2021-06-25T04:56:36.051 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2021-06-25T04:56:36.052 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2021-06-25T04:56:36.052 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 15m 2021-06-25T04:56:36.052 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 15m 2021-06-25T04:56:36.052 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2021-06-25T04:56:36.053 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2021-06-25T04:56:36.053 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:56:36.053 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2021-06-25T04:56:36.053 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.053 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2021-06-25T04:56:36.054 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.054 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2021-06-25T04:56:36.054 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.054 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2021-06-25T04:56:36.055 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2021-06-25T04:56:36.055 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.055 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2021-06-25T04:56:36.055 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2021-06-25T04:56:36.056 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.056 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:56:36.056 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2021-06-25T04:56:36.056 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.057 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:56:36.057 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:56:36.057 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.057 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2021-06-25T04:56:36.057 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.058 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2021-06-25T04:56:36.058 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2021-06-25T04:56:36.058 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:56:36.058 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:56:36.058 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2021-06-25T04:56:36.059 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:56:36.059 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2021-06-25T04:56:36.059 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:56:36.059 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:56:36.059 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.060 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:56:36.060 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.060 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2021-06-25T04:56:36.060 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.061 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2021-06-25T04:56:36.061 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.061 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2021-06-25T04:56:36.061 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2021-06-25T04:56:36.062 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2021-06-25T04:56:36.062 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:56:36.062 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:56:36.062 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.062 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2021-06-25T04:56:36.063 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2021-06-25T04:56:36.063 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.063 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2021-06-25T04:56:36.063 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2021-06-25T04:56:36.063 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.064 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2021-06-25T04:56:36.064 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2021-06-25T04:56:36.064 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.064 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2021-06-25T04:56:36.065 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2021-06-25T04:56:36.065 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2021-06-25T04:56:36.065 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.065 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2021-06-25T04:56:36.066 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2021-06-25T04:56:36.066 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.066 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:56:36.066 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.067 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2021-06-25T04:56:36.067 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.067 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2021-06-25T04:56:36.067 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.067 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:56:36.068 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2021-06-25T04:56:36.068 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.068 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2021-06-25T04:56:36.068 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2021-06-25T04:56:36.069 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2021-06-25T04:56:36.069 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore compression mode = aggressive 2021-06-25T04:56:36.069 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2021-06-25T04:56:36.069 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2021-06-25T04:56:36.069 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2021-06-25T04:56:36.070 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:56:36.070 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2021-06-25T04:56:36.070 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2021-06-25T04:56:36.070 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:56:36.071 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2021-06-25T04:56:36.071 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:56:36.071 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:56:36.071 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2021-06-25T04:56:36.071 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-06-25T04:56:36.072 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.072 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2021-06-25T04:56:36.072 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:56:36.072 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2021-06-25T04:56:36.073 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-06-25T04:56:36.073 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-06-25T04:56:36.073 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:36.073 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:36.073 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2021-06-25T04:56:36.074 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.074 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2021-06-25T04:56:36.074 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:56:36.074 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-06-25T04:56:36.075 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2021-06-25T04:56:36.075 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-06-25T04:56:36.075 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2021-06-25T04:56:36.075 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2021-06-25T04:56:36.075 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:36.076 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2021-06-25T04:56:36.076 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2021-06-25T04:56:36.076 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:36.076 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.076 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:56:36.077 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:56:36.077 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:56:36.077 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.077 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:56:36.078 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:56:36.078 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:56:36.078 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2021-06-25T04:56:36.078 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:36.078 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2021-06-25T04:56:36.079 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2021-06-25T04:56:36.079 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2021-06-25T04:56:36.079 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2021-06-25T04:56:36.079 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:56:36.080 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:56:36.080 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2021-06-25T04:56:36.080 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2021-06-25T04:56:36.080 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:56:36.080 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-06-25T04:56:36.081 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-06-25T04:56:36.081 INFO:teuthology.orchestra.run.smithi102.stdout: client debug getattr caps = true 2021-06-25T04:56:36.081 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2021-06-25T04:56:36.081 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2021-06-25T04:56:36.081 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2021-06-25T04:56:36.082 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2021-06-25T04:56:36.082 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2021-06-25T04:56:36.082 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2021-06-25T04:56:36.082 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2021-06-25T04:56:36.083 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2021-06-25T04:56:36.083 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:56:36.083 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal frag = True 2021-06-25T04:56:36.083 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal fragment size max = 10000 2021-06-25T04:56:36.083 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal merge size = 5 2021-06-25T04:56:36.084 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split bits = 3 2021-06-25T04:56:36.084 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split size = 100 2021-06-25T04:56:36.084 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2021-06-25T04:56:36.084 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2021-06-25T04:56:36.084 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2021-06-25T04:56:36.085 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2021-06-25T04:56:36.085 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-06-25T04:56:36.085 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-06-25T04:56:36.085 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-06-25T04:56:36.086 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2021-06-25T04:56:36.086 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2021-06-25T04:56:36.086 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:56:36.086 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2021-06-25T04:56:36.086 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.087 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2021-06-25T04:56:36.087 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.087 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2021-06-25T04:56:36.087 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.088 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2021-06-25T04:56:36.088 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2021-06-25T04:56:36.088 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.088 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2021-06-25T04:56:36.088 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2021-06-25T04:56:36.089 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.089 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:56:36.089 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2021-06-25T04:56:36.089 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.089 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:56:36.090 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:56:36.090 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.090 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2021-06-25T04:56:36.090 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.090 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2021-06-25T04:56:36.091 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2021-06-25T04:56:36.091 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:56:36.091 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:56:36.091 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2021-06-25T04:56:36.092 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:56:36.092 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2021-06-25T04:56:36.092 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:56:36.092 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:56:36.092 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.093 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:56:36.093 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.093 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2021-06-25T04:56:36.094 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.094 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2021-06-25T04:56:36.094 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.095 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2021-06-25T04:56:36.095 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2021-06-25T04:56:36.095 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2021-06-25T04:56:36.095 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:56:36.096 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:56:36.096 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.096 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2021-06-25T04:56:36.096 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2021-06-25T04:56:36.097 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.097 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2021-06-25T04:56:36.097 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2021-06-25T04:56:36.098 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.098 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2021-06-25T04:56:36.098 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2021-06-25T04:56:36.098 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.099 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2021-06-25T04:56:36.099 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2021-06-25T04:56:36.099 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2021-06-25T04:56:36.099 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.100 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2021-06-25T04:56:36.100 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2021-06-25T04:56:36.100 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.100 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:56:36.101 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.101 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2021-06-25T04:56:36.101 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.101 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2021-06-25T04:56:36.102 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.102 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:56:36.102 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2021-06-25T04:56:36.102 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.102 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2021-06-25T04:56:36.103 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2021-06-25T04:56:36.103 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2021-06-25T04:56:36.103 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore compression mode = aggressive 2021-06-25T04:56:36.103 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2021-06-25T04:56:36.103 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 20 2021-06-25T04:56:36.104 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 20 2021-06-25T04:56:36.104 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:56:36.104 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2021-06-25T04:56:36.104 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 10 2021-06-25T04:56:36.105 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:56:36.105 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2021-06-25T04:56:36.105 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:56:36.105 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:56:36.105 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2021-06-25T04:56:36.106 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2021-06-25T04:56:36.106 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.106 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2021-06-25T04:56:36.106 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:56:36.107 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2021-06-25T04:56:36.107 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2021-06-25T04:56:36.107 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2021-06-25T04:56:36.107 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:36.107 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:36.108 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2021-06-25T04:56:36.108 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2021-06-25T04:56:36.108 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:56:36.108 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2021-06-25T04:56:36.109 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2021-06-25T04:56:36.109 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2021-06-25T04:56:36.109 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2021-06-25T04:56:36.109 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2021-06-25T04:56:36.110 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:36.110 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2021-06-25T04:56:36.110 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2021-06-25T04:56:36.110 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:36.110 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.111 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:56:36.111 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:56:36.111 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:56:36.111 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.111 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:56:36.112 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:56:36.112 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:56:36.112 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2021-06-25T04:56:36.112 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:36.112 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2021-06-25T04:56:36.113 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2021-06-25T04:56:36.113 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2021-06-25T04:56:36.113 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2021-06-25T04:56:36.113 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:56:36.114 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:56:36.114 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2021-06-25T04:56:36.114 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2021-06-25T04:56:36.114 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:56:36.114 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 15m 2021-06-25T04:56:36.115 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 15m 2021-06-25T04:56:36.115 INFO:teuthology.orchestra.run.smithi087.stdout: client debug getattr caps = true 2021-06-25T04:56:36.115 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2021-06-25T04:56:36.115 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2021-06-25T04:56:36.116 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2021-06-25T04:56:36.116 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2021-06-25T04:56:36.116 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2021-06-25T04:56:36.116 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2021-06-25T04:56:36.116 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2021-06-25T04:56:36.117 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2021-06-25T04:56:36.117 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:56:36.117 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal frag = True 2021-06-25T04:56:36.117 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal fragment size max = 10000 2021-06-25T04:56:36.117 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal merge size = 5 2021-06-25T04:56:36.118 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split bits = 3 2021-06-25T04:56:36.118 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split size = 100 2021-06-25T04:56:36.118 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2021-06-25T04:56:36.119 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2021-06-25T04:56:36.119 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2021-06-25T04:56:36.119 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2021-06-25T04:56:36.120 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2021-06-25T04:56:36.120 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 15m 2021-06-25T04:56:36.120 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 15m 2021-06-25T04:56:36.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:36.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.223+0000 7fc7daa99700 1 Processor -- start 2021-06-25T04:56:36.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.223+0000 7fc7daa99700 1 -- start start 2021-06-25T04:56:36.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.223+0000 7fc7daa99700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40b9b90 0x7fc7d40b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.223+0000 7fc7daa99700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d40b9f70 con 0x7fc7d40b50f0 2021-06-25T04:56:36.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.223+0000 7fc7daa99700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d40b69a0 con 0x7fc7d413d290 2021-06-25T04:56:36.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.223+0000 7fc7daa99700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d413d720 con 0x7fc7d40b9b90 2021-06-25T04:56:36.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.223+0000 7fc7d3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc7d40b50f0 0x7fc7d413cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60694/0 (socket says 172.21.15.57:60694) 2021-06-25T04:56:36.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.223+0000 7fc7d3fff700 1 -- 172.21.15.57:0/2397760795 learned_addr learned my addr 172.21.15.57:0/2397760795 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:36.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.223+0000 7fc7d8835700 1 --2- 172.21.15.57:0/2397760795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40b9b90 0x7fc7d40b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7d37fe700 1 -- 172.21.15.57:0/2397760795 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741080846 0 0) 0x7fc7d40b9f70 con 0x7fc7d40b50f0 2021-06-25T04:56:36.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7d37fe700 1 -- 172.21.15.57:0/2397760795 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b8003260 con 0x7fc7d40b50f0 2021-06-25T04:56:36.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7d37fe700 1 -- 172.21.15.57:0/2397760795 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429011967 0 0) 0x7fc7d40b69a0 con 0x7fc7d413d290 2021-06-25T04:56:36.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7d37fe700 1 -- 172.21.15.57:0/2397760795 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7d40b9f70 con 0x7fc7d413d290 2021-06-25T04:56:36.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7d8835700 1 -- 172.21.15.57:0/2397760795 >> v1:172.21.15.87:6789/0 conn(0x7fc7d413d290 legacy=0x7fc7d4146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7d8835700 1 -- 172.21.15.57:0/2397760795 >> v1:172.21.15.57:6789/0 conn(0x7fc7d40b50f0 legacy=0x7fc7d413cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7d8835700 1 -- 172.21.15.57:0/2397760795 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d40b6c40 con 0x7fc7d40b9b90 2021-06-25T04:56:36.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7d8835700 1 --2- 172.21.15.57:0/2397760795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40b9b90 0x7fc7d40b5c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fc7c8002f70 tx=0x7fc7c8006df0).ready entity=mon.2 client_cookie=39c3c76c61a4e96a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:36.238 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7d37fe700 1 -- 172.21.15.57:0/2397760795 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c800d5c0 con 0x7fc7d40b9b90 2021-06-25T04:56:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7d37fe700 1 -- 172.21.15.57:0/2397760795 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c8000e90 con 0x7fc7d40b9b90 2021-06-25T04:56:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7d37fe700 1 -- 172.21.15.57:0/2397760795 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c800d910 con 0x7fc7d40b9b90 2021-06-25T04:56:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7daa99700 1 -- 172.21.15.57:0/2397760795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40b9b90 msgr2=0x7fc7d40b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7daa99700 1 --2- 172.21.15.57:0/2397760795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40b9b90 0x7fc7d40b5c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fc7c8002f70 tx=0x7fc7c8006df0).stop 2021-06-25T04:56:36.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7daa99700 1 -- 172.21.15.57:0/2397760795 shutdown_connections 2021-06-25T04:56:36.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7daa99700 1 --2- 172.21.15.57:0/2397760795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d40b9b90 0x7fc7d40b5c20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7daa99700 1 -- 172.21.15.57:0/2397760795 >> 172.21.15.57:0/2397760795 conn(0x7fc7d405f920 msgr2=0x7fc7d4061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:36.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7daa99700 1 -- 172.21.15.57:0/2397760795 shutdown_connections 2021-06-25T04:56:36.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.227+0000 7fc7daa99700 1 -- 172.21.15.57:0/2397760795 wait complete. 2021-06-25T04:56:36.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7daa99700 1 Processor -- start 2021-06-25T04:56:36.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7daa99700 1 -- start start 2021-06-25T04:56:36.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7daa99700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b50f0 0x7fc7d4142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7daa99700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7d40b9b90 0x7fc7d41411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7daa99700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d413d290 0x7fc7d4148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7daa99700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d4147800 con 0x7fc7d40b50f0 2021-06-25T04:56:36.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7daa99700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d41433a0 con 0x7fc7d40b9b90 2021-06-25T04:56:36.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7daa99700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d4152f20 con 0x7fc7d413d290 2021-06-25T04:56:36.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d8835700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b50f0 0x7fc7d4142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d8835700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b50f0 0x7fc7d4142eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43482/0 (socket says 172.21.15.57:43482) 2021-06-25T04:56:36.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d8835700 1 -- 172.21.15.57:0/1066313245 learned_addr learned my addr 172.21.15.57:0/1066313245 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:36.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d9036700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d413d290 0x7fc7d4148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d3fff700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7d40b9b90 0x7fc7d41411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d8835700 1 -- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d413d290 msgr2=0x7fc7d4148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d8835700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d413d290 0x7fc7d4148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d8835700 1 -- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7d40b9b90 msgr2=0x7fc7d41411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d8835700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7d40b9b90 0x7fc7d41411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d8835700 1 -- 172.21.15.57:0/1066313245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c800b180 con 0x7fc7d40b50f0 2021-06-25T04:56:36.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d8835700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b50f0 0x7fc7d4142eb0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fc7c8002f70 tx=0x7fc7c8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:36.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d1ffb700 1 -- 172.21.15.57:0/1066313245 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c801e3f0 con 0x7fc7d40b50f0 2021-06-25T04:56:36.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d1ffb700 1 -- 172.21.15.57:0/1066313245 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c8000e90 con 0x7fc7d40b50f0 2021-06-25T04:56:36.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7daa99700 1 -- 172.21.15.57:0/1066313245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d4147a30 con 0x7fc7d40b50f0 2021-06-25T04:56:36.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7d1ffb700 1 -- 172.21.15.57:0/1066313245 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7c801e740 con 0x7fc7d40b50f0 2021-06-25T04:56:36.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7daa99700 1 -- 172.21.15.57:0/1066313245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d41416a0 con 0x7fc7d40b50f0 2021-06-25T04:56:36.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.231+0000 7fc7daa99700 1 -- 172.21.15.57:0/1066313245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d4057310 con 0x7fc7d40b50f0 2021-06-25T04:56:36.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.235+0000 7fc7d1ffb700 1 -- 172.21.15.57:0/1066313245 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc7c8024020 con 0x7fc7d40b50f0 2021-06-25T04:56:36.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.235+0000 7fc7d1ffb700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7bc055360 0x7fc7bc057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.235+0000 7fc7d1ffb700 1 -- 172.21.15.57:0/1066313245 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc7c806ebe0 con 0x7fc7d40b50f0 2021-06-25T04:56:36.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.235+0000 7fc7d3fff700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7bc055360 0x7fc7bc057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.235+0000 7fc7d3fff700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7bc055360 0x7fc7bc057820 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fc7c000b000 tx=0x7fc7c0009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:36.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.239+0000 7fc7d1ffb700 1 -- 172.21.15.57:0/1066313245 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc7c8044d30 con 0x7fc7d40b50f0 2021-06-25T04:56:36.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.367+0000 7fc7daa99700 1 -- 172.21.15.57:0/1066313245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7d4147ed0 con 0x7fc7d40b50f0 2021-06-25T04:56:36.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7d1ffb700 1 -- 172.21.15.57:0/1066313245 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fc7c8048350 con 0x7fc7d40b50f0 2021-06-25T04:56:36.375 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:36.375 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":139,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:26.672360+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:56:23.126544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-06-25T04:56:23.668536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:36.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 -- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7bc055360 msgr2=0x7fc7bc057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7bc055360 0x7fc7bc057820 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fc7c000b000 tx=0x7fc7c0009040).stop 2021-06-25T04:56:36.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 -- 172.21.15.57:0/1066313245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b50f0 msgr2=0x7fc7d4142eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b50f0 0x7fc7d4142eb0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fc7c8002f70 tx=0x7fc7c8014000).stop 2021-06-25T04:56:36.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 -- 172.21.15.57:0/1066313245 shutdown_connections 2021-06-25T04:56:36.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc7bc055360 0x7fc7bc057820 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7d413d290 0x7fc7d4148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7d40b9b90 0x7fc7d41411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 --2- 172.21.15.57:0/1066313245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7d40b50f0 0x7fc7d4142eb0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 -- 172.21.15.57:0/1066313245 >> 172.21.15.57:0/1066313245 conn(0x7fc7d405f920 msgr2=0x7fc7d413bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:36.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 -- 172.21.15.57:0/1066313245 shutdown_connections 2021-06-25T04:56:36.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.371+0000 7fc7daa99700 1 -- 172.21.15.57:0/1066313245 wait complete. 2021-06-25T04:56:36.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:56:23.126544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:56:23.668536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:56:36.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:56:36.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.499+0000 7f42ae8d2700 1 Processor -- start 2021-06-25T04:56:36.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.499+0000 7f42ae8d2700 1 -- start start 2021-06-25T04:56:36.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.499+0000 7f42ae8d2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f42a80b6340 0x7f42a80b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.499+0000 7f42ae8d2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a8060200 0x7f42a81435f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.499+0000 7f42ae8d2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a8146630 con 0x7f42a805fd90 2021-06-25T04:56:36.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.499+0000 7f42ae8d2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a81468d0 con 0x7f42a80b6340 2021-06-25T04:56:36.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.499+0000 7f42ae8d2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a8146b70 con 0x7f42a8060200 2021-06-25T04:56:36.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ad8d0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f42a80b6340 0x7f42a80b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae0d1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a8060200 0x7f42a81435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ad8d0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f42a80b6340 0x7f42a80b6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43492/0 (socket says 172.21.15.57:43492) 2021-06-25T04:56:36.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ad8d0700 1 -- 172.21.15.57:0/1553086269 learned_addr learned my addr 172.21.15.57:0/1553086269 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:36.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ad0cf700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f42a805fd90 0x7f42a8142ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:33224/0 (socket says 172.21.15.57:33224) 2021-06-25T04:56:36.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae0d1700 1 -- 172.21.15.57:0/1553086269 >> v2:172.21.15.57:3300/0 conn(0x7f42a80b6340 msgr2=0x7f42a80b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:36.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae0d1700 1 --2- 172.21.15.57:0/1553086269 >> v2:172.21.15.57:3300/0 conn(0x7f42a80b6340 0x7f42a80b6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae0d1700 1 -- 172.21.15.57:0/1553086269 >> v1:172.21.15.87:6789/0 conn(0x7f42a805fd90 legacy=0x7f42a8142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae0d1700 1 -- 172.21.15.57:0/1553086269 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a8146e10 con 0x7f42a8060200 2021-06-25T04:56:36.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ac8ce700 1 -- 172.21.15.57:0/1553086269 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727284136 0 0) 0x7f42a8146630 con 0x7f42a805fd90 2021-06-25T04:56:36.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ad8d0700 1 --2- 172.21.15.57:0/1553086269 >> v2:172.21.15.57:3300/0 conn(0x7f42a80b6340 0x7f42a80b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:36.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae0d1700 1 --2- 172.21.15.57:0/1553086269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a8060200 0x7f42a81435f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f42a00032f0 tx=0x7f42a00091d0).ready entity=mon.2 client_cookie=d71b632fb1afa903 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:36.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ac8ce700 1 -- 172.21.15.57:0/1553086269 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a000b6c0 con 0x7f42a8060200 2021-06-25T04:56:36.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ac8ce700 1 -- 172.21.15.57:0/1553086269 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a000b820 con 0x7f42a8060200 2021-06-25T04:56:36.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ac8ce700 1 -- 172.21.15.57:0/1553086269 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a000b990 con 0x7f42a8060200 2021-06-25T04:56:36.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae8d2700 1 -- 172.21.15.57:0/1553086269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a8060200 msgr2=0x7f42a81435f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae8d2700 1 --2- 172.21.15.57:0/1553086269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a8060200 0x7f42a81435f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f42a00032f0 tx=0x7f42a00091d0).stop 2021-06-25T04:56:36.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae8d2700 1 -- 172.21.15.57:0/1553086269 shutdown_connections 2021-06-25T04:56:36.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae8d2700 1 --2- 172.21.15.57:0/1553086269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a8060200 0x7f42a81435f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae8d2700 1 --2- 172.21.15.57:0/1553086269 >> v2:172.21.15.57:3300/0 conn(0x7f42a80b6340 0x7f42a80b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae8d2700 1 -- 172.21.15.57:0/1553086269 >> 172.21.15.57:0/1553086269 conn(0x7f42a805c6e0 msgr2=0x7f42a805cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:36.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae8d2700 1 -- 172.21.15.57:0/1553086269 shutdown_connections 2021-06-25T04:56:36.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.503+0000 7f42ae8d2700 1 -- 172.21.15.57:0/1553086269 wait complete. 2021-06-25T04:56:36.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ae8d2700 1 Processor -- start 2021-06-25T04:56:36.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ae8d2700 1 -- start start 2021-06-25T04:56:36.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ae8d2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a805fd90 0x7f42a8155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ae8d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42a8060200 0x7f42a8155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ae8d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a80b6340 0x7f42a812b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ae8d2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a81403c0 con 0x7f42a8060200 2021-06-25T04:56:36.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ae8d2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a81408c0 con 0x7f42a80b6340 2021-06-25T04:56:36.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ae8d2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a8140620 con 0x7f42a805fd90 2021-06-25T04:56:36.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ad0cf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42a8060200 0x7f42a8155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ad8d0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a805fd90 0x7f42a8155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ad0cf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42a8060200 0x7f42a8155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43498/0 (socket says 172.21.15.57:43498) 2021-06-25T04:56:36.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ad0cf700 1 -- 172.21.15.57:0/800514274 learned_addr learned my addr 172.21.15.57:0/800514274 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:36.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ae0d1700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a80b6340 0x7f42a812b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ad0cf700 1 -- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a805fd90 msgr2=0x7f42a8155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ad0cf700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a805fd90 0x7f42a8155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ad0cf700 1 -- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a80b6340 msgr2=0x7f42a812b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ad0cf700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a80b6340 0x7f42a812b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ad0cf700 1 -- 172.21.15.57:0/800514274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c00b1e0 con 0x7f42a8060200 2021-06-25T04:56:36.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ad8d0700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a805fd90 0x7f42a8155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:36.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ad0cf700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42a8060200 0x7f42a8155df0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f42a4000bc0 tx=0x7f42a4007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:36.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f429affd700 1 -- 172.21.15.57:0/800514274 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a40070d0 con 0x7f42a8060200 2021-06-25T04:56:36.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f429affd700 1 -- 172.21.15.57:0/800514274 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a4007230 con 0x7f42a8060200 2021-06-25T04:56:36.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ae8d2700 1 -- 172.21.15.57:0/800514274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a0009470 con 0x7f42a8060200 2021-06-25T04:56:36.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f429affd700 1 -- 172.21.15.57:0/800514274 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a4005740 con 0x7f42a8060200 2021-06-25T04:56:36.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.507+0000 7f42ae8d2700 1 -- 172.21.15.57:0/800514274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a813dc10 con 0x7f42a8060200 2021-06-25T04:56:36.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.511+0000 7f42ae8d2700 1 -- 172.21.15.57:0/800514274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a8057310 con 0x7f42a8060200 2021-06-25T04:56:36.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.511+0000 7f429affd700 1 -- 172.21.15.57:0/800514274 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f42a4010070 con 0x7f42a8060200 2021-06-25T04:56:36.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.511+0000 7f429affd700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4288055450 0x7f4288057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.511+0000 7f429affd700 1 -- 172.21.15.57:0/800514274 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f42a406d660 con 0x7f42a8060200 2021-06-25T04:56:36.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.511+0000 7f42ad8d0700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4288055450 0x7f4288057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.511+0000 7f42ad8d0700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4288055450 0x7f4288057910 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f429c00b000 tx=0x7f429c006eb0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:36.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.515+0000 7f429affd700 1 -- 172.21.15.57:0/800514274 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f42a4043700 con 0x7f42a8060200 2021-06-25T04:56:36.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.643+0000 7f42ae8d2700 1 -- 172.21.15.57:0/800514274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f42a813e990 con 0x7f42a8060200 2021-06-25T04:56:36.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.643+0000 7f429affd700 1 -- 172.21.15.57:0/800514274 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7f42a4046d20 con 0x7f42a8060200 2021-06-25T04:56:36.648 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:56:36.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.643+0000 7f42ae8d2700 1 -- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4288055450 msgr2=0x7f4288057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.643+0000 7f42ae8d2700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4288055450 0x7f4288057910 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f429c00b000 tx=0x7f429c006eb0).stop 2021-06-25T04:56:36.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.643+0000 7f42ae8d2700 1 -- 172.21.15.57:0/800514274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42a8060200 msgr2=0x7f42a8155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.643+0000 7f42ae8d2700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42a8060200 0x7f42a8155df0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f42a4000bc0 tx=0x7f42a4007a60).stop 2021-06-25T04:56:36.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.647+0000 7f42ae8d2700 1 -- 172.21.15.57:0/800514274 shutdown_connections 2021-06-25T04:56:36.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.647+0000 7f42ae8d2700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4288055450 0x7f4288057910 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.647+0000 7f42ae8d2700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a80b6340 0x7f42a812b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.647+0000 7f42ae8d2700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42a8060200 0x7f42a8155df0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.647+0000 7f42ae8d2700 1 --2- 172.21.15.57:0/800514274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42a805fd90 0x7f42a8155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.647+0000 7f42ae8d2700 1 -- 172.21.15.57:0/800514274 >> 172.21.15.57:0/800514274 conn(0x7f42a805c6e0 msgr2=0x7f42a80b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:36.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.647+0000 7f42ae8d2700 1 -- 172.21.15.57:0/800514274 shutdown_connections 2021-06-25T04:56:36.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.647+0000 7f42ae8d2700 1 -- 172.21.15.57:0/800514274 wait complete. 2021-06-25T04:56:36.661 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:56:36.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8da8b4700 1 Processor -- start 2021-06-25T04:56:36.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8da8b4700 1 -- start start 2021-06-25T04:56:36.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8da8b4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d40b64d0 0x7fc8d4143a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8da8b4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d40b68b0 con 0x7fc8d40b4b00 2021-06-25T04:56:36.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8da8b4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d4143f70 con 0x7fc8d41402b0 2021-06-25T04:56:36.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8da8b4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40ae620 con 0x7fc8d40b64d0 2021-06-25T04:56:36.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8da0b3700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc8d40b4b00 0x7fc8d40b4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60726/0 (socket says 172.21.15.57:60726) 2021-06-25T04:56:36.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8da0b3700 1 -- 172.21.15.57:0/923527811 learned_addr learned my addr 172.21.15.57:0/923527811 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8d98b2700 1 --2- 172.21.15.57:0/923527811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d40b64d0 0x7fc8d4143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8d88b0700 1 -- 172.21.15.57:0/923527811 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175393186 0 0) 0x7fc8d40b68b0 con 0x7fc8d40b4b00 2021-06-25T04:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8d88b0700 1 -- 172.21.15.57:0/923527811 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8b8003260 con 0x7fc8d40b4b00 2021-06-25T04:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8d88b0700 1 -- 172.21.15.57:0/923527811 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434189440 0 0) 0x7fc8d4143f70 con 0x7fc8d41402b0 2021-06-25T04:56:36.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8d88b0700 1 -- 172.21.15.57:0/923527811 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8d40b68b0 con 0x7fc8d41402b0 2021-06-25T04:56:36.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8d98b2700 1 -- 172.21.15.57:0/923527811 >> v1:172.21.15.87:6789/0 conn(0x7fc8d41402b0 legacy=0x7fc8d41406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8d98b2700 1 -- 172.21.15.57:0/923527811 >> v1:172.21.15.57:6789/0 conn(0x7fc8d40b4b00 legacy=0x7fc8d40b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8d88b0700 1 -- 172.21.15.57:0/923527811 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3800327213 0 0) 0x7fc8b8003260 con 0x7fc8d40b4b00 2021-06-25T04:56:36.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8d98b2700 1 -- 172.21.15.57:0/923527811 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d40ae8c0 con 0x7fc8d40b64d0 2021-06-25T04:56:36.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.771+0000 7fc8d98b2700 1 --2- 172.21.15.57:0/923527811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d40b64d0 0x7fc8d4143a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fc8d0002f70 tx=0x7fc8d0006df0).ready entity=mon.2 client_cookie=876e8e77b8deab81 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:36.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8d88b0700 1 -- 172.21.15.57:0/923527811 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d000d5c0 con 0x7fc8d40b64d0 2021-06-25T04:56:36.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8d88b0700 1 -- 172.21.15.57:0/923527811 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d0000e90 con 0x7fc8d40b64d0 2021-06-25T04:56:36.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8d88b0700 1 -- 172.21.15.57:0/923527811 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d000d910 con 0x7fc8d40b64d0 2021-06-25T04:56:36.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8da8b4700 1 -- 172.21.15.57:0/923527811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d40b64d0 msgr2=0x7fc8d4143a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8da8b4700 1 --2- 172.21.15.57:0/923527811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d40b64d0 0x7fc8d4143a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fc8d0002f70 tx=0x7fc8d0006df0).stop 2021-06-25T04:56:36.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8da8b4700 1 -- 172.21.15.57:0/923527811 shutdown_connections 2021-06-25T04:56:36.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8da8b4700 1 --2- 172.21.15.57:0/923527811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d40b64d0 0x7fc8d4143a80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8da8b4700 1 -- 172.21.15.57:0/923527811 >> 172.21.15.57:0/923527811 conn(0x7fc8d405f880 msgr2=0x7fc8d4061470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:36.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8da8b4700 1 -- 172.21.15.57:0/923527811 shutdown_connections 2021-06-25T04:56:36.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8da8b4700 1 -- 172.21.15.57:0/923527811 wait complete. 2021-06-25T04:56:36.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8da8b4700 1 Processor -- start 2021-06-25T04:56:36.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.775+0000 7fc8da8b4700 1 -- start start 2021-06-25T04:56:36.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8da8b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d40b4b00 0x7fc8d40b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8da8b4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d40b64d0 0x7fc8d41423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8da8b4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d41402b0 0x7fc8d40b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8da8b4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d4156280 con 0x7fc8d40b4b00 2021-06-25T04:56:36.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8da8b4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d4156750 con 0x7fc8d40b64d0 2021-06-25T04:56:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8da8b4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d41564b0 con 0x7fc8d41402b0 2021-06-25T04:56:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8d98b2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d40b4b00 0x7fc8d40b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8d98b2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d40b4b00 0x7fc8d40b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43510/0 (socket says 172.21.15.57:43510) 2021-06-25T04:56:36.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8d98b2700 1 -- 172.21.15.57:0/1927348322 learned_addr learned my addr 172.21.15.57:0/1927348322 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:36.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8da0b3700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d41402b0 0x7fc8d40b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8d90b1700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d40b64d0 0x7fc8d41423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8d98b2700 1 -- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d41402b0 msgr2=0x7fc8d40b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8d98b2700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d41402b0 0x7fc8d40b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8d98b2700 1 -- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d40b64d0 msgr2=0x7fc8d41423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8d98b2700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d40b64d0 0x7fc8d41423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8d98b2700 1 -- 172.21.15.57:0/1927348322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d000b180 con 0x7fc8d40b4b00 2021-06-25T04:56:36.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8da0b3700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d41402b0 0x7fc8d40b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:36.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8d90b1700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d40b64d0 0x7fc8d41423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:36.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8d98b2700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d40b4b00 0x7fc8d40b0ab0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fc8d0002f70 tx=0x7fc8d0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:36.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8c77fe700 1 -- 172.21.15.57:0/1927348322 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d0012e70 con 0x7fc8d40b4b00 2021-06-25T04:56:36.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8c77fe700 1 -- 172.21.15.57:0/1927348322 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d000de40 con 0x7fc8d40b4b00 2021-06-25T04:56:36.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8da8b4700 1 -- 172.21.15.57:0/1927348322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d40b2a40 con 0x7fc8d40b4b00 2021-06-25T04:56:36.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8c77fe700 1 -- 172.21.15.57:0/1927348322 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d001f630 con 0x7fc8d40b4b00 2021-06-25T04:56:36.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8da8b4700 1 -- 172.21.15.57:0/1927348322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d40b3670 con 0x7fc8d40b4b00 2021-06-25T04:56:36.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.779+0000 7fc8da8b4700 1 -- 172.21.15.57:0/1927348322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d40b2ee0 con 0x7fc8d40b4b00 2021-06-25T04:56:36.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.783+0000 7fc8c77fe700 1 -- 172.21.15.57:0/1927348322 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc8d0025020 con 0x7fc8d40b4b00 2021-06-25T04:56:36.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.783+0000 7fc8c77fe700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc8b0055450 0x7fc8b0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:36.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.783+0000 7fc8c77fe700 1 -- 172.21.15.57:0/1927348322 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc8d006f080 con 0x7fc8d40b4b00 2021-06-25T04:56:36.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.783+0000 7fc8d90b1700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc8b0055450 0x7fc8b0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:36.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.783+0000 7fc8d90b1700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc8b0055450 0x7fc8b0057910 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fc8c800b000 tx=0x7fc8c8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:36.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.787+0000 7fc8c77fe700 1 -- 172.21.15.57:0/1927348322 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc8d40b2ee0 con 0x7fc8d40b4b00 2021-06-25T04:56:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.911+0000 7fc8da8b4700 1 -- 172.21.15.57:0/1927348322 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc8d40b2ee0 con 0x7fc8d40b4b00 2021-06-25T04:56:36.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.911+0000 7fc8c77fe700 1 -- 172.21.15.57:0/1927348322 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc8d40b2ee0 con 0x7fc8d40b4b00 2021-06-25T04:56:36.917 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:36.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.911+0000 7fc8da8b4700 1 -- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc8b0055450 msgr2=0x7fc8b0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.911+0000 7fc8da8b4700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc8b0055450 0x7fc8b0057910 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fc8c800b000 tx=0x7fc8c8009040).stop 2021-06-25T04:56:36.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.911+0000 7fc8da8b4700 1 -- 172.21.15.57:0/1927348322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d40b4b00 msgr2=0x7fc8d40b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:36.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.911+0000 7fc8da8b4700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d40b4b00 0x7fc8d40b0ab0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fc8d0002f70 tx=0x7fc8d0014000).stop 2021-06-25T04:56:36.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.915+0000 7fc8da8b4700 1 -- 172.21.15.57:0/1927348322 shutdown_connections 2021-06-25T04:56:36.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.915+0000 7fc8da8b4700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc8b0055450 0x7fc8b0057910 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.915+0000 7fc8da8b4700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8d41402b0 0x7fc8d40b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.915+0000 7fc8da8b4700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d40b64d0 0x7fc8d41423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.915+0000 7fc8da8b4700 1 --2- 172.21.15.57:0/1927348322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d40b4b00 0x7fc8d40b0ab0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:36.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.915+0000 7fc8da8b4700 1 -- 172.21.15.57:0/1927348322 >> 172.21.15.57:0/1927348322 conn(0x7fc8d405f880 msgr2=0x7fc8d40b8150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:36.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.915+0000 7fc8da8b4700 1 -- 172.21.15.57:0/1927348322 shutdown_connections 2021-06-25T04:56:36.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:36.915+0000 7fc8da8b4700 1 -- 172.21.15.57:0/1927348322 wait complete. 2021-06-25T04:56:36.929 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:56:37.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.031+0000 7f800a1e2700 1 Processor -- start 2021-06-25T04:56:37.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.031+0000 7f800a1e2700 1 -- start start 2021-06-25T04:56:37.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f800a1e2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80040b4330 0x7f80040b9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f800a1e2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80041468a0 con 0x7f80040b98d0 2021-06-25T04:56:37.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f800a1e2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80040b4950 con 0x7f80040b7120 2021-06-25T04:56:37.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f800a1e2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80040b4bf0 con 0x7f80040b4330 2021-06-25T04:56:37.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f80037fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f80040b98d0 0x7f8004146fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60736/0 (socket says 172.21.15.57:60736) 2021-06-25T04:56:37.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f80037fe700 1 -- 172.21.15.57:0/1341776320 learned_addr learned my addr 172.21.15.57:0/1341776320 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:37.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f8002ffd700 1 --2- 172.21.15.57:0/1341776320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80040b4330 0x7f80040b9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f80027fc700 1 -- 172.21.15.57:0/1341776320 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877035881 0 0) 0x7f80041468a0 con 0x7f80040b98d0 2021-06-25T04:56:37.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f80027fc700 1 -- 172.21.15.57:0/1341776320 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff0003260 con 0x7f80040b98d0 2021-06-25T04:56:37.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f80027fc700 1 -- 172.21.15.57:0/1341776320 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564963746 0 0) 0x7f80040b4950 con 0x7f80040b7120 2021-06-25T04:56:37.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f80027fc700 1 -- 172.21.15.57:0/1341776320 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80041468a0 con 0x7f80040b7120 2021-06-25T04:56:37.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f8002ffd700 1 -- 172.21.15.57:0/1341776320 >> v1:172.21.15.87:6789/0 conn(0x7f80040b7120 legacy=0x7f800413ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f8002ffd700 1 -- 172.21.15.57:0/1341776320 >> v1:172.21.15.57:6789/0 conn(0x7f80040b98d0 legacy=0x7f8004146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f8002ffd700 1 -- 172.21.15.57:0/1341776320 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004146b00 con 0x7f80040b4330 2021-06-25T04:56:37.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f8002ffd700 1 --2- 172.21.15.57:0/1341776320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80040b4330 0x7f80040b9cb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f7ff4002f70 tx=0x7f7ff4006df0).ready entity=mon.2 client_cookie=e4bfce2dc5f69e6d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:37.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f80027fc700 1 -- 172.21.15.57:0/1341776320 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff400d5c0 con 0x7f80040b4330 2021-06-25T04:56:37.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f80027fc700 1 -- 172.21.15.57:0/1341776320 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff4000e90 con 0x7f80040b4330 2021-06-25T04:56:37.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f80027fc700 1 -- 172.21.15.57:0/1341776320 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff400d910 con 0x7f80040b4330 2021-06-25T04:56:37.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f800a1e2700 1 -- 172.21.15.57:0/1341776320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80040b4330 msgr2=0x7f80040b9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f800a1e2700 1 --2- 172.21.15.57:0/1341776320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80040b4330 0x7f80040b9cb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f7ff4002f70 tx=0x7f7ff4006df0).stop 2021-06-25T04:56:37.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f800a1e2700 1 -- 172.21.15.57:0/1341776320 shutdown_connections 2021-06-25T04:56:37.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f800a1e2700 1 --2- 172.21.15.57:0/1341776320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80040b4330 0x7f80040b9cb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f800a1e2700 1 -- 172.21.15.57:0/1341776320 >> 172.21.15.57:0/1341776320 conn(0x7f800405ff20 msgr2=0x7f8004061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:37.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f800a1e2700 1 -- 172.21.15.57:0/1341776320 shutdown_connections 2021-06-25T04:56:37.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.035+0000 7f800a1e2700 1 -- 172.21.15.57:0/1341776320 wait complete. 2021-06-25T04:56:37.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f800a1e2700 1 Processor -- start 2021-06-25T04:56:37.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f800a1e2700 1 -- start start 2021-06-25T04:56:37.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f800a1e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80040b4330 0x7f8004145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f800a1e2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80040b7120 0x7f800413ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f800a1e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80040b98d0 0x7f80040b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f800a1e2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8004143920 con 0x7f80040b4330 2021-06-25T04:56:37.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f800a1e2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800413eac0 con 0x7f80040b98d0 2021-06-25T04:56:37.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f800a1e2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8004143b50 con 0x7f80040b7120 2021-06-25T04:56:37.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f80037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80040b4330 0x7f8004145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f80037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80040b4330 0x7f8004145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43524/0 (socket says 172.21.15.57:43524) 2021-06-25T04:56:37.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f80037fe700 1 -- 172.21.15.57:0/1584451721 learned_addr learned my addr 172.21.15.57:0/1584451721 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:37.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f8003fff700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80040b98d0 0x7f80040b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f8002ffd700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80040b7120 0x7f800413ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f80037fe700 1 -- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80040b7120 msgr2=0x7f800413ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f80037fe700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80040b7120 0x7f800413ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f80037fe700 1 -- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80040b98d0 msgr2=0x7f80040b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f80037fe700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80040b98d0 0x7f80040b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f80037fe700 1 -- 172.21.15.57:0/1584451721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff400b180 con 0x7f80040b4330 2021-06-25T04:56:37.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f80037fe700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80040b4330 0x7f8004145f20 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f7ff80010d0 tx=0x7f7ff8007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:37.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f8000ff9700 1 -- 172.21.15.57:0/1584451721 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff80070d0 con 0x7f80040b4330 2021-06-25T04:56:37.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f8000ff9700 1 -- 172.21.15.57:0/1584451721 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff8007230 con 0x7f80040b4330 2021-06-25T04:56:37.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f800a1e2700 1 -- 172.21.15.57:0/1584451721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80040ad840 con 0x7f80040b4330 2021-06-25T04:56:37.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.039+0000 7f8000ff9700 1 -- 172.21.15.57:0/1584451721 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff8005610 con 0x7f80040b4330 2021-06-25T04:56:37.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.043+0000 7f800a1e2700 1 -- 172.21.15.57:0/1584451721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8004140950 con 0x7f80040b4330 2021-06-25T04:56:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.043+0000 7f800a1e2700 1 -- 172.21.15.57:0/1584451721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8004143fd0 con 0x7f80040b4330 2021-06-25T04:56:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.043+0000 7f8000ff9700 1 -- 172.21.15.57:0/1584451721 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7ff801a070 con 0x7f80040b4330 2021-06-25T04:56:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.043+0000 7f8000ff9700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fe4055450 0x7f7fe4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.043+0000 7f8000ff9700 1 -- 172.21.15.57:0/1584451721 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7ff806cfe0 con 0x7f80040b4330 2021-06-25T04:56:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.043+0000 7f8002ffd700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fe4055450 0x7f7fe4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.047+0000 7f8002ffd700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fe4055450 0x7f7fe4057910 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f7ff4017000 tx=0x7f7ff4014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.051+0000 7f8000ff9700 1 -- 172.21.15.57:0/1584451721 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7ff80430e0 con 0x7f80040b4330 2021-06-25T04:56:37.183 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 -- 172.21.15.57:0/1584451721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80041436c0 con 0x7f80040b4330 2021-06-25T04:56:37.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f8000ff9700 1 -- 172.21.15.57:0/1584451721 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7ff8046700 con 0x7f80040b4330 2021-06-25T04:56:37.184 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:37.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 -- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fe4055450 msgr2=0x7f7fe4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fe4055450 0x7f7fe4057910 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f7ff4017000 tx=0x7f7ff4014000).stop 2021-06-25T04:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 -- 172.21.15.57:0/1584451721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80040b4330 msgr2=0x7f8004145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80040b4330 0x7f8004145f20 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f7ff80010d0 tx=0x7f7ff8007b00).stop 2021-06-25T04:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 -- 172.21.15.57:0/1584451721 shutdown_connections 2021-06-25T04:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fe4055450 0x7f7fe4057910 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80040b98d0 0x7f80040b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80040b7120 0x7f800413ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 --2- 172.21.15.57:0/1584451721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80040b4330 0x7f8004145f20 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 -- 172.21.15.57:0/1584451721 >> 172.21.15.57:0/1584451721 conn(0x7f800405ff20 msgr2=0x7f80040b8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:37.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 -- 172.21.15.57:0/1584451721 shutdown_connections 2021-06-25T04:56:37.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.179+0000 7f800a1e2700 1 -- 172.21.15.57:0/1584451721 wait complete. 2021-06-25T04:56:37.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:56:37.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.295+0000 7f594bebd700 1 Processor -- start 2021-06-25T04:56:37.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.295+0000 7f594bebd700 1 -- start start 2021-06-25T04:56:37.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f59440b08e0 0x7f59440aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f59440acee0 0x7f59440b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59440b0cc0 con 0x7f5944143560 2021-06-25T04:56:37.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59440ae0e0 con 0x7f59440b08e0 2021-06-25T04:56:37.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59440ae380 con 0x7f59440acee0 2021-06-25T04:56:37.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f5949c59700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f59440b08e0 0x7f59440aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594a45a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5944143560 0x7f59440b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60754/0 (socket says 172.21.15.57:60754) 2021-06-25T04:56:37.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594a45a700 1 -- 172.21.15.57:0/742607716 learned_addr learned my addr 172.21.15.57:0/742607716 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:37.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f5949458700 1 --2- 172.21.15.57:0/742607716 >> v2:172.21.15.87:3300/0 conn(0x7f59440acee0 0x7f59440b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f5949c59700 1 -- 172.21.15.57:0/742607716 >> v2:172.21.15.87:3300/0 conn(0x7f59440acee0 msgr2=0x7f59440b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:37.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f5949c59700 1 --2- 172.21.15.57:0/742607716 >> v2:172.21.15.87:3300/0 conn(0x7f59440acee0 0x7f59440b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f5949c59700 1 -- 172.21.15.57:0/742607716 >> v1:172.21.15.57:6789/0 conn(0x7f5944143560 legacy=0x7f59440b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f5949c59700 1 -- 172.21.15.57:0/742607716 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59440ae620 con 0x7f59440b08e0 2021-06-25T04:56:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f5949458700 1 --2- 172.21.15.57:0/742607716 >> v2:172.21.15.87:3300/0 conn(0x7f59440acee0 0x7f59440b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:37.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f5949c59700 1 --2- 172.21.15.57:0/742607716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59440b08e0 0x7f59440aed60 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f5940002f70 tx=0x7f5940006df0).ready entity=mon.0 client_cookie=3a9cdf05b7794928 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:37.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f5948c57700 1 -- 172.21.15.57:0/742607716 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f594000d5c0 con 0x7f59440b08e0 2021-06-25T04:56:37.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f5948c57700 1 -- 172.21.15.57:0/742607716 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5940000e90 con 0x7f59440b08e0 2021-06-25T04:56:37.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f5948c57700 1 -- 172.21.15.57:0/742607716 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f594000d910 con 0x7f59440b08e0 2021-06-25T04:56:37.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 -- 172.21.15.57:0/742607716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59440b08e0 msgr2=0x7f59440aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 --2- 172.21.15.57:0/742607716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59440b08e0 0x7f59440aed60 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f5940002f70 tx=0x7f5940006df0).stop 2021-06-25T04:56:37.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 -- 172.21.15.57:0/742607716 shutdown_connections 2021-06-25T04:56:37.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 --2- 172.21.15.57:0/742607716 >> v2:172.21.15.87:3300/0 conn(0x7f59440acee0 0x7f59440b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 --2- 172.21.15.57:0/742607716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59440b08e0 0x7f59440aed60 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 -- 172.21.15.57:0/742607716 >> 172.21.15.57:0/742607716 conn(0x7f5944060780 msgr2=0x7f5944060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:37.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 -- 172.21.15.57:0/742607716 shutdown_connections 2021-06-25T04:56:37.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.299+0000 7f594bebd700 1 -- 172.21.15.57:0/742607716 wait complete. 2021-06-25T04:56:37.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594bebd700 1 Processor -- start 2021-06-25T04:56:37.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594bebd700 1 -- start start 2021-06-25T04:56:37.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594bebd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59440acee0 0x7f5944144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594bebd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59440b08e0 0x7f59440667f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594bebd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5944143560 0x7f5944066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594bebd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944066120 con 0x7f59440b08e0 2021-06-25T04:56:37.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594bebd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594413f8a0 con 0x7f59440acee0 2021-06-25T04:56:37.316 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594bebd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5944066350 con 0x7f5944143560 2021-06-25T04:56:37.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f5949458700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59440b08e0 0x7f59440667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f5949458700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59440b08e0 0x7f59440667f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43538/0 (socket says 172.21.15.57:43538) 2021-06-25T04:56:37.317 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f5949458700 1 -- 172.21.15.57:0/2627361376 learned_addr learned my addr 172.21.15.57:0/2627361376 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:37.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f5949c59700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59440acee0 0x7f5944144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594a45a700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5944143560 0x7f5944066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f5949458700 1 -- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5944143560 msgr2=0x7f5944066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f5949458700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5944143560 0x7f5944066ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.318 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f5949458700 1 -- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59440acee0 msgr2=0x7f5944144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f5949458700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59440acee0 0x7f5944144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f5949458700 1 -- 172.21.15.57:0/2627361376 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594000b180 con 0x7f59440b08e0 2021-06-25T04:56:37.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594a45a700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5944143560 0x7f5944066ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:56:37.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f5949458700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59440b08e0 0x7f59440667f0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f5934006940 tx=0x7f5934008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:37.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f593affd700 1 -- 172.21.15.57:0/2627361376 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5934011780 con 0x7f59440b08e0 2021-06-25T04:56:37.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f593affd700 1 -- 172.21.15.57:0/2627361376 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59340118e0 con 0x7f59440b08e0 2021-06-25T04:56:37.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594bebd700 1 -- 172.21.15.57:0/2627361376 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5944143290 con 0x7f59440b08e0 2021-06-25T04:56:37.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f593affd700 1 -- 172.21.15.57:0/2627361376 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5934011c40 con 0x7f59440b08e0 2021-06-25T04:56:37.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.303+0000 7f594bebd700 1 -- 172.21.15.57:0/2627361376 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594413e8e0 con 0x7f59440b08e0 2021-06-25T04:56:37.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.307+0000 7f594bebd700 1 -- 172.21.15.57:0/2627361376 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5944066510 con 0x7f59440b08e0 2021-06-25T04:56:37.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.307+0000 7f593affd700 1 -- 172.21.15.57:0/2627361376 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f593401c460 con 0x7f59440b08e0 2021-06-25T04:56:37.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.307+0000 7f593affd700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f592c0553f0 0x7f592c0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.307+0000 7f593affd700 1 -- 172.21.15.57:0/2627361376 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f593406e260 con 0x7f59440b08e0 2021-06-25T04:56:37.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.307+0000 7f5949c59700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f592c0553f0 0x7f592c0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.307+0000 7f5949c59700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f592c0553f0 0x7f592c0578b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f5940017000 tx=0x7f5940014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:37.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.315+0000 7f593affd700 1 -- 172.21.15.57:0/2627361376 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5934044310 con 0x7f59440b08e0 2021-06-25T04:56:37.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.443+0000 7f594bebd700 1 -- 172.21.15.57:0/2627361376 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f594413f640 con 0x7f59440b08e0 2021-06-25T04:56:37.452 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.447+0000 7f593affd700 1 -- 172.21.15.57:0/2627361376 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5934047930 con 0x7f59440b08e0 2021-06-25T04:56:37.452 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:37.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.447+0000 7f594bebd700 1 -- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f592c0553f0 msgr2=0x7f592c0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.447+0000 7f594bebd700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f592c0553f0 0x7f592c0578b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f5940017000 tx=0x7f5940014000).stop 2021-06-25T04:56:37.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.447+0000 7f594bebd700 1 -- 172.21.15.57:0/2627361376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59440b08e0 msgr2=0x7f59440667f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.447+0000 7f594bebd700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59440b08e0 0x7f59440667f0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f5934006940 tx=0x7f5934008040).stop 2021-06-25T04:56:37.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.447+0000 7f594bebd700 1 -- 172.21.15.57:0/2627361376 shutdown_connections 2021-06-25T04:56:37.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.447+0000 7f594bebd700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f592c0553f0 0x7f592c0578b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.447+0000 7f594bebd700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5944143560 0x7f5944066ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.447+0000 7f594bebd700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59440b08e0 0x7f59440667f0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.447+0000 7f594bebd700 1 --2- 172.21.15.57:0/2627361376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59440acee0 0x7f5944144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.447+0000 7f594bebd700 1 -- 172.21.15.57:0/2627361376 >> 172.21.15.57:0/2627361376 conn(0x7f5944060780 msgr2=0x7f59440b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.451+0000 7f594bebd700 1 -- 172.21.15.57:0/2627361376 shutdown_connections 2021-06-25T04:56:37.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.451+0000 7f594bebd700 1 -- 172.21.15.57:0/2627361376 wait complete. 2021-06-25T04:56:37.465 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:56:37.466 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.559+0000 7f7c9aea6700 1 Processor -- start 2021-06-25T04:56:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.559+0000 7f7c9aea6700 1 -- start start 2021-06-25T04:56:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.559+0000 7f7c9aea6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7c940acaf0 0x7f7c940b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.559+0000 7f7c9aea6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c940b0340 0x7f7c940ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.559+0000 7f7c9aea6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c940aced0 con 0x7f7c940b5520 2021-06-25T04:56:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.559+0000 7f7c9aea6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c940b0020 con 0x7f7c940acaf0 2021-06-25T04:56:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.559+0000 7f7c9aea6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940af1f0 con 0x7f7c940b0340 2021-06-25T04:56:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.559+0000 7f7c996a3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c940b0340 0x7f7c940ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.559+0000 7f7c9a6a5700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7c940b5520 0x7f7c940b1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:33284/0 (socket says 172.21.15.57:33284) 2021-06-25T04:56:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.559+0000 7f7c99ea4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7c940acaf0 0x7f7c940b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.559+0000 7f7c9a6a5700 1 -- 172.21.15.57:0/3214665046 learned_addr learned my addr 172.21.15.57:0/3214665046 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c98ea2700 1 -- 172.21.15.57:0/3214665046 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800707954 0 0) 0x7f7c940aced0 con 0x7f7c940b5520 2021-06-25T04:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c98ea2700 1 -- 172.21.15.57:0/3214665046 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c7c003260 con 0x7f7c940b5520 2021-06-25T04:56:37.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c996a3700 1 -- 172.21.15.57:0/3214665046 >> v2:172.21.15.87:3300/0 conn(0x7f7c940acaf0 msgr2=0x7f7c940b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c996a3700 1 --2- 172.21.15.57:0/3214665046 >> v2:172.21.15.87:3300/0 conn(0x7f7c940acaf0 0x7f7c940b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c996a3700 1 -- 172.21.15.57:0/3214665046 >> v1:172.21.15.87:6789/0 conn(0x7f7c940b5520 legacy=0x7f7c940b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c996a3700 1 -- 172.21.15.57:0/3214665046 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940af490 con 0x7f7c940b0340 2021-06-25T04:56:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c99ea4700 1 --2- 172.21.15.57:0/3214665046 >> v2:172.21.15.87:3300/0 conn(0x7f7c940acaf0 0x7f7c940b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c996a3700 1 --2- 172.21.15.57:0/3214665046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c940b0340 0x7f7c940ae180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f7c90002f70 tx=0x7f7c90006df0).ready entity=mon.2 client_cookie=b791867707e28ce2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c98ea2700 1 -- 172.21.15.57:0/3214665046 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9000d4a0 con 0x7f7c940b0340 2021-06-25T04:56:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c98ea2700 1 -- 172.21.15.57:0/3214665046 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90000e90 con 0x7f7c940b0340 2021-06-25T04:56:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c9aea6700 1 -- 172.21.15.57:0/3214665046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c940b0340 msgr2=0x7f7c940ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c98ea2700 1 -- 172.21.15.57:0/3214665046 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9000d7f0 con 0x7f7c940b0340 2021-06-25T04:56:37.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c9aea6700 1 --2- 172.21.15.57:0/3214665046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c940b0340 0x7f7c940ae180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f7c90002f70 tx=0x7f7c90006df0).stop 2021-06-25T04:56:37.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c9aea6700 1 -- 172.21.15.57:0/3214665046 shutdown_connections 2021-06-25T04:56:37.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c9aea6700 1 --2- 172.21.15.57:0/3214665046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c940b0340 0x7f7c940ae180 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c9aea6700 1 --2- 172.21.15.57:0/3214665046 >> v2:172.21.15.87:3300/0 conn(0x7f7c940acaf0 0x7f7c940b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c9aea6700 1 -- 172.21.15.57:0/3214665046 >> 172.21.15.57:0/3214665046 conn(0x7f7c9405c7f0 msgr2=0x7f7c9405cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:37.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c9aea6700 1 -- 172.21.15.57:0/3214665046 shutdown_connections 2021-06-25T04:56:37.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.563+0000 7f7c9aea6700 1 -- 172.21.15.57:0/3214665046 wait complete. 2021-06-25T04:56:37.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c9aea6700 1 Processor -- start 2021-06-25T04:56:37.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c9aea6700 1 -- start start 2021-06-25T04:56:37.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c9aea6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c940acaf0 0x7f7c94140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c9aea6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c940b0340 0x7f7c94063390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c9aea6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c940b5520 0x7f7c940b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c9aea6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940b2f70 con 0x7f7c940b0340 2021-06-25T04:56:37.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c9aea6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94063a30 con 0x7f7c940b5520 2021-06-25T04:56:37.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c9aea6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940b31a0 con 0x7f7c940acaf0 2021-06-25T04:56:37.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c996a3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c940b0340 0x7f7c94063390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c996a3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c940b0340 0x7f7c94063390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43554/0 (socket says 172.21.15.57:43554) 2021-06-25T04:56:37.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c996a3700 1 -- 172.21.15.57:0/1738431015 learned_addr learned my addr 172.21.15.57:0/1738431015 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c99ea4700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c940acaf0 0x7f7c94140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c9a6a5700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c940b5520 0x7f7c940b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c996a3700 1 -- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c940acaf0 msgr2=0x7f7c94140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c996a3700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c940acaf0 0x7f7c94140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c996a3700 1 -- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c940b5520 msgr2=0x7f7c940b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c996a3700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c940b5520 0x7f7c940b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c996a3700 1 -- 172.21.15.57:0/1738431015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8400b180 con 0x7f7c940b0340 2021-06-25T04:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c996a3700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c940b0340 0x7f7c94063390 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f7c90002f70 tx=0x7f7c90014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c82ffd700 1 -- 172.21.15.57:0/1738431015 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c90006b20 con 0x7f7c940b0340 2021-06-25T04:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c82ffd700 1 -- 172.21.15.57:0/1738431015 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90012d50 con 0x7f7c940b0340 2021-06-25T04:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c82ffd700 1 -- 172.21.15.57:0/1738431015 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9001f670 con 0x7f7c940b0340 2021-06-25T04:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.567+0000 7f7c9aea6700 1 -- 172.21.15.57:0/1738431015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9000b180 con 0x7f7c940b0340 2021-06-25T04:56:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.571+0000 7f7c9aea6700 1 -- 172.21.15.57:0/1738431015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c940b38e0 con 0x7f7c940b0340 2021-06-25T04:56:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.571+0000 7f7c9aea6700 1 -- 172.21.15.57:0/1738431015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c94067110 con 0x7f7c940b0340 2021-06-25T04:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.571+0000 7f7c82ffd700 1 -- 172.21.15.57:0/1738431015 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7c9000f030 con 0x7f7c940b0340 2021-06-25T04:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.571+0000 7f7c82ffd700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c740554e0 0x7f7c740579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.571+0000 7f7c82ffd700 1 -- 172.21.15.57:0/1738431015 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7c9006f060 con 0x7f7c940b0340 2021-06-25T04:56:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.575+0000 7f7c99ea4700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c740554e0 0x7f7c740579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.575+0000 7f7c99ea4700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c740554e0 0x7f7c740579a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f7c8400b000 tx=0x7f7c84006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.579+0000 7f7c82ffd700 1 -- 172.21.15.57:0/1738431015 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7c94067110 con 0x7f7c940b0340 2021-06-25T04:56:37.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.743+0000 7f7c9aea6700 1 -- 172.21.15.57:0/1738431015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c94067110 con 0x7f7c940b0340 2021-06-25T04:56:37.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c82ffd700 1 -- 172.21.15.57:0/1738431015 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f7c94067110 con 0x7f7c940b0340 2021-06-25T04:56:37.751 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:37.751 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3591673245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3591673245},{"type":"v1","addr":"172.21.15.57:6833","nonce":3591673245}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2597000234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2597000234},{"type":"v1","addr":"172.21.15.57:6835","nonce":2597000234}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:24.666625+0000","modified":"2021-06-25T04:56:26.355926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8088":{"gid":8088,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2964573030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2964573030},{"type":"v1","addr":"172.21.15.87:6835","nonce":2964573030}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-06-25T04:56:37.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 -- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c740554e0 msgr2=0x7f7c740579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c740554e0 0x7f7c740579a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f7c8400b000 tx=0x7f7c84006df0).stop 2021-06-25T04:56:37.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 -- 172.21.15.57:0/1738431015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c940b0340 msgr2=0x7f7c94063390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:37.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c940b0340 0x7f7c94063390 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f7c90002f70 tx=0x7f7c90014000).stop 2021-06-25T04:56:37.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 -- 172.21.15.57:0/1738431015 shutdown_connections 2021-06-25T04:56:37.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c740554e0 0x7f7c740579a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c940b5520 0x7f7c940b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c940b0340 0x7f7c94063390 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 --2- 172.21.15.57:0/1738431015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c940acaf0 0x7f7c94140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:37.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 -- 172.21.15.57:0/1738431015 >> 172.21.15.57:0/1738431015 conn(0x7f7c9405c7f0 msgr2=0x7f7c940b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:37.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 -- 172.21.15.57:0/1738431015 shutdown_connections 2021-06-25T04:56:37.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:37.747+0000 7f7c9aea6700 1 -- 172.21.15.57:0/1738431015 wait complete. 2021-06-25T04:56:37.757 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 70 2021-06-25T04:56:38.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:56:24.666625+0000', 'modified': '2021-06-25T04:56:26.355926+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8088': {'gid': 8088, 'name': 'b', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/2964573030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 2964573030}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 2964573030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:56:38.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:56:38.068 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-06-25T04:56:38.184 INFO:teuthology.orchestra.run.smithi087.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":8088,"want_state":"up:active","state":"up:active","rank_uptime":13.504502112999999,"mdsmap_epoch":70,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":17.798523751000001} 2021-06-25T04:56:38.185 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 8088, "mdsmap_epoch": 70, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 13.504502113, "state": "up:active", "uptime": 17.798523751, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:56:38.185 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:56:38.186 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-06-25T04:56:38.186 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi161.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-06-25T04:56:38.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:38.187 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:38.195 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:56:38.212 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:56:38.212 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:56:38.223 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:56:38.224 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:56:38.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:38.226 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:56:38.275 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:56:38.275 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:38.279 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:56:38.295 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:56:38.296 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:56:38.305 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:56:38.306 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:56:38.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:38.307 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:56:38.353 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:2021-06-25T04:56:38.351+0000 7f3ce9f16080 -1 init, newargv = 0x556aeed1da80 newargc=9 2021-06-25T04:56:38.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[15071]: starting ceph client 2021-06-25T04:56:38.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[15071]: starting fuse 2021-06-25T04:56:38.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:56:38.405 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:56:38.409 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:56:38.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:56:39.457 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:56:39.475 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:56:39.476 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:56:39.532 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:56:39.533 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:56:39.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:39.535 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:56:39.542 INFO:teuthology.orchestra.run.smithi161.stdout:52 2021-06-25T04:56:39.542 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:56:39.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:39.543 DEBUG:teuthology.orchestra.run.smithi161:> sudo python3 -c ' 2021-06-25T04:56:39.544 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2021-06-25T04:56:39.544 DEBUG:teuthology.orchestra.run.smithi161:> import re 2021-06-25T04:56:39.545 DEBUG:teuthology.orchestra.run.smithi161:> import os 2021-06-25T04:56:39.545 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2021-06-25T04:56:39.545 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:56:39.546 DEBUG:teuthology.orchestra.run.smithi161:> def find_socket(client_name): 2021-06-25T04:56:39.546 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-06-25T04:56:39.550 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2021-06-25T04:56:39.551 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:56:39.551 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2021-06-25T04:56:39.552 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2021-06-25T04:56:39.552 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2021-06-25T04:56:39.553 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2021-06-25T04:56:39.554 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:56:39.555 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2021-06-25T04:56:39.555 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:56:39.556 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:56:39.556 DEBUG:teuthology.orchestra.run.smithi161:> return f 2021-06-25T04:56:39.557 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:56:39.559 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:56:39.559 DEBUG:teuthology.orchestra.run.smithi161:> print(find_socket("client.1")) 2021-06-25T04:56:39.559 DEBUG:teuthology.orchestra.run.smithi161:> ' 2021-06-25T04:56:39.602 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.15071.asok 2021-06-25T04:56:39.606 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.15071.asok 2021-06-25T04:56:39.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:39.607 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.15071.asok status 2021-06-25T04:56:39.739 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2021-06-25T04:56:39.740 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2021-06-25T04:56:39.740 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:56:39.740 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:56:39.741 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2021-06-25T04:56:39.742 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2021-06-25T04:56:39.743 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-06-25T04:56:39.744 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "15071", 2021-06-25T04:56:39.744 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2021-06-25T04:56:39.744 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:56:39.744 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2021-06-25T04:56:39.745 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2021-06-25T04:56:39.745 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 8179, 2021-06-25T04:56:39.745 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2021-06-25T04:56:39.745 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2021-06-25T04:56:39.746 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2021-06-25T04:56:39.746 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 8179 2021-06-25T04:56:39.746 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:56:39.746 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:56:39.747 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:56:39.747 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:56:39.747 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 3643681374 2021-06-25T04:56:39.747 INFO:teuthology.orchestra.run.smithi161.stdout: } 2021-06-25T04:56:39.748 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:56:39.748 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:56:39.748 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:56:39.748 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:56:39.749 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 3643681374 2021-06-25T04:56:39.750 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:56:39.750 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.8179 172.21.15.161:0/3643681374", 2021-06-25T04:56:39.752 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "172.21.15.161:0/3643681374", 2021-06-25T04:56:39.753 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2021-06-25T04:56:39.753 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 70, 2021-06-25T04:56:39.754 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 139, 2021-06-25T04:56:39.754 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:56:39.754 INFO:teuthology.orchestra.run.smithi161.stdout: "blacklisted": false, 2021-06-25T04:56:39.754 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2021-06-25T04:56:39.755 INFO:teuthology.orchestra.run.smithi161.stdout:} 2021-06-25T04:56:39.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:39.757 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:39.758 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:39.767 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:56:39.768 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:56:39.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:39.769 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:39.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:39.787 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:39.787 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:39.796 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:56:39.797 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:56:39.797 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-06-25T04:56:39.798 DEBUG:teuthology.orchestra.run.smithi102:> import time 2021-06-25T04:56:39.798 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:56:39.800 DEBUG:teuthology.orchestra.run.smithi102:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2021-06-25T04:56:39.800 DEBUG:teuthology.orchestra.run.smithi102:> f.write('"'"'content'"'"') 2021-06-25T04:56:39.801 DEBUG:teuthology.orchestra.run.smithi102:> f.flush() 2021-06-25T04:56:39.801 DEBUG:teuthology.orchestra.run.smithi102:> f.write('"'"'content2'"'"') 2021-06-25T04:56:39.802 DEBUG:teuthology.orchestra.run.smithi102:> while True: 2021-06-25T04:56:39.802 DEBUG:teuthology.orchestra.run.smithi102:> time.sleep(1) 2021-06-25T04:56:39.802 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:56:39.805 DEBUG:teuthology.orchestra.run.smithi102:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-06-25T04:56:39.828 INFO:teuthology.orchestra.run.smithi102.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2021-06-25T04:56:39.829 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-06-25T04:56:40.831 DEBUG:teuthology.orchestra.run.smithi102:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-06-25T04:56:40.849 INFO:teuthology.orchestra.run.smithi102.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2021-06-25T04:56:40.851 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2021-06-25T04:56:40.851 DEBUG:teuthology.orchestra.run.smithi161:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2021-06-25T04:56:40.888 INFO:teuthology.orchestra.run.smithi161.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2021-06-25T04:56:40.890 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2021-06-25T04:56:40.890 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-06-25T04:56:40.891 DEBUG:teuthology.orchestra.run.smithi161:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2021-06-25T04:56:40.937 INFO:teuthology.orchestra.run.smithi161.stdout:content 2021-06-25T04:56:40.954 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:56:40.955 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:40.977 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:40.999 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:41.019 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:41.041 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:56:41.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:41.042 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:41.042 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:41.050 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:56:41.051 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:56:41.052 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:56:41.052 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:56:41.053 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:41.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15543]: fuse finished with error 0 and tester_r 0 2021-06-25T04:56:41.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:41.070 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:41.070 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:41.120 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:56:41.121 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:56:41.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:56:41.230 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:41.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:41.238 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:41.238 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:41.246 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:56:41.247 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:56:41.248 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2021-06-25T04:56:41.249 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:56:41.249 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:41.265 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[15071]: fuse finished with error 0 and tester_r 0 2021-06-25T04:56:41.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:41.268 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:41.268 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:41.276 INFO:teuthology.orchestra.run.smithi161.stdout:ext2/ext3 2021-06-25T04:56:41.278 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:56:41.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:56:41.352 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:41.359 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:56:41.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.463+0000 7f8f1b4bf700 1 Processor -- start 2021-06-25T04:56:41.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.463+0000 7f8f1b4bf700 1 -- start start 2021-06-25T04:56:41.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8f1405cbf0 0x7f8f140b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f141419a0 0x7f8f1413df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f140b2a50 con 0x7f8f140b2670 2021-06-25T04:56:41.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1405bfa0 con 0x7f8f1405cbf0 2021-06-25T04:56:41.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f140b4690 con 0x7f8f141419a0 2021-06-25T04:56:41.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f19cbc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8f1405cbf0 0x7f8f140b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f19cbc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8f1405cbf0 0x7f8f140b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43560/0 (socket says 172.21.15.57:43560) 2021-06-25T04:56:41.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f19cbc700 1 -- 172.21.15.57:0/862258389 learned_addr learned my addr 172.21.15.57:0/862258389 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:41.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1a4bd700 1 --1- 172.21.15.57:0/862258389 >> v1:172.21.15.57:6789/0 conn(0x7f8f140b2670 0x7f8f14141290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60778/0 (socket says 172.21.15.57:60778) 2021-06-25T04:56:41.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1acbe700 1 --2- 172.21.15.57:0/862258389 >> v2:172.21.15.87:3300/0 conn(0x7f8f141419a0 0x7f8f1413df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f19cbc700 1 -- 172.21.15.57:0/862258389 >> v2:172.21.15.87:3300/0 conn(0x7f8f141419a0 msgr2=0x7f8f1413df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:41.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f19cbc700 1 --2- 172.21.15.57:0/862258389 >> v2:172.21.15.87:3300/0 conn(0x7f8f141419a0 0x7f8f1413df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f19cbc700 1 -- 172.21.15.57:0/862258389 >> v1:172.21.15.57:6789/0 conn(0x7f8f140b2670 legacy=0x7f8f14141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:41.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f194bb700 1 -- 172.21.15.57:0/862258389 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295862609 0 0) 0x7f8f140b2a50 con 0x7f8f140b2670 2021-06-25T04:56:41.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f19cbc700 1 -- 172.21.15.57:0/862258389 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f140b4930 con 0x7f8f1405cbf0 2021-06-25T04:56:41.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1acbe700 1 --2- 172.21.15.57:0/862258389 >> v2:172.21.15.87:3300/0 conn(0x7f8f141419a0 0x7f8f1413df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:41.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f19cbc700 1 --2- 172.21.15.57:0/862258389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f1405cbf0 0x7f8f140b3ff0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f8f04002f70 tx=0x7f8f04006eb0).ready entity=mon.0 client_cookie=410cf77ff06712ad server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:41.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f194bb700 1 -- 172.21.15.57:0/862258389 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0400d610 con 0x7f8f1405cbf0 2021-06-25T04:56:41.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f194bb700 1 -- 172.21.15.57:0/862258389 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04000e90 con 0x7f8f1405cbf0 2021-06-25T04:56:41.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f194bb700 1 -- 172.21.15.57:0/862258389 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0400d960 con 0x7f8f1405cbf0 2021-06-25T04:56:41.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/862258389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f1405cbf0 msgr2=0x7f8f140b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:41.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 --2- 172.21.15.57:0/862258389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f1405cbf0 0x7f8f140b3ff0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f8f04002f70 tx=0x7f8f04006eb0).stop 2021-06-25T04:56:41.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/862258389 shutdown_connections 2021-06-25T04:56:41.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 --2- 172.21.15.57:0/862258389 >> v2:172.21.15.87:3300/0 conn(0x7f8f141419a0 0x7f8f1413df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 --2- 172.21.15.57:0/862258389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f1405cbf0 0x7f8f140b3ff0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/862258389 >> 172.21.15.57:0/862258389 conn(0x7f8f1405f670 msgr2=0x7f8f1405fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:41.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/862258389 shutdown_connections 2021-06-25T04:56:41.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.467+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/862258389 wait complete. 2021-06-25T04:56:41.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f1b4bf700 1 Processor -- start 2021-06-25T04:56:41.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f1b4bf700 1 -- start start 2021-06-25T04:56:41.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f1b4bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f1405cbf0 0x7f8f140b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f1b4bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f140b2670 0x7f8f141372a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f1b4bf700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f141419a0 0x7f8f14137790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f1b4bf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140653e0 con 0x7f8f140b2670 2021-06-25T04:56:41.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f1b4bf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14067050 con 0x7f8f1405cbf0 2021-06-25T04:56:41.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f1b4bf700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140672f0 con 0x7f8f141419a0 2021-06-25T04:56:41.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f19cbc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f140b2670 0x7f8f141372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f19cbc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f140b2670 0x7f8f141372a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43568/0 (socket says 172.21.15.57:43568) 2021-06-25T04:56:41.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f19cbc700 1 -- 172.21.15.57:0/2796202731 learned_addr learned my addr 172.21.15.57:0/2796202731 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:41.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f1a4bd700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f1405cbf0 0x7f8f140b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f1acbe700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f141419a0 0x7f8f14137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f19cbc700 1 -- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f141419a0 msgr2=0x7f8f14137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:41.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f19cbc700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f141419a0 0x7f8f14137790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f19cbc700 1 -- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f1405cbf0 msgr2=0x7f8f140b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:41.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f19cbc700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f1405cbf0 0x7f8f140b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f19cbc700 1 -- 172.21.15.57:0/2796202731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0400b1e0 con 0x7f8f140b2670 2021-06-25T04:56:41.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f19cbc700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f140b2670 0x7f8f141372a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f8f04002f70 tx=0x7f8f04015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:41.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f037fe700 1 -- 172.21.15.57:0/2796202731 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f04021070 con 0x7f8f140b2670 2021-06-25T04:56:41.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f037fe700 1 -- 172.21.15.57:0/2796202731 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04000e90 con 0x7f8f140b2670 2021-06-25T04:56:41.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/2796202731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f14137c80 con 0x7f8f140b2670 2021-06-25T04:56:41.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.471+0000 7f8f037fe700 1 -- 172.21.15.57:0/2796202731 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0400d290 con 0x7f8f140b2670 2021-06-25T04:56:41.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.475+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/2796202731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f140b6130 con 0x7f8f140b2670 2021-06-25T04:56:41.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.475+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/2796202731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f14057310 con 0x7f8f140b2670 2021-06-25T04:56:41.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.475+0000 7f8f037fe700 1 -- 172.21.15.57:0/2796202731 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8f0400f070 con 0x7f8f140b2670 2021-06-25T04:56:41.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.475+0000 7f8f037fe700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ef4055510 0x7f8ef40579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.475+0000 7f8f037fe700 1 -- 172.21.15.57:0/2796202731 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8f0406f0e0 con 0x7f8f140b2670 2021-06-25T04:56:41.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.475+0000 7f8f1a4bd700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ef4055510 0x7f8ef40579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.479+0000 7f8f1a4bd700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ef4055510 0x7f8ef40579d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f8f1000d000 tx=0x7f8f10009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.483+0000 7f8f037fe700 1 -- 172.21.15.57:0/2796202731 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8f04045180 con 0x7f8f140b2670 2021-06-25T04:56:41.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.607+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/2796202731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8f140698a0 con 0x7f8f140b2670 2021-06-25T04:56:41.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.611+0000 7f8f037fe700 1 -- 172.21.15.57:0/2796202731 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+34051 (secure 0 0 0) 0x7f8f040487a0 con 0x7f8f140b2670 2021-06-25T04:56:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:41.617 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:56:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 139, 2021-06-25T04:56:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:56:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:56:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:56:26.672360+0000", 2021-06-25T04:56:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:56:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:56:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:56:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:56:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:56:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:56:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:56:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:56:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:56:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:56:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:56:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:56:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:56:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:56:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 26, 2021-06-25T04:56:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:56:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:56:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:56:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:56:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:56:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:56:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:56:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:56:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:56:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:56:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:56:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:56:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:56:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:56:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:56:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:56:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:56:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:56:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:56:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.645 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:56:41.645 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:56:41.645 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:56:41.645 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:56:41.646 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:56:41.646 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:41.646 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:41.646 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:41.646 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:41.647 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:41.647 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:41.647 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:56:41.647 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:56:41.647 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:56:41.648 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:56:41.648 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:56:41.648 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:41.648 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:41.649 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:41.649 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:41.649 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:41.649 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:41.650 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:41.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.650 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:56:41.650 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:41.650 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:41.651 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:41.651 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:41.651 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:41.651 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:41.652 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:41.652 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:41.652 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:41.653 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:41.653 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:41.653 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:41.653 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:41.653 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:41.654 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:41.654 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:41.654 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:41.654 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:41.655 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:41.655 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:41.655 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:41.655 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:41.656 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:41.656 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:41.656 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:41.656 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:41.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.657 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:41.657 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:41.657 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:41.657 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:41.658 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:41.658 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:41.658 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:41.658 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:41.658 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:41.659 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:41.659 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:41.659 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:56:41.659 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:41.660 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:56:41.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.660 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 25, 2021-06-25T04:56:41.661 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:56:41.661 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:56:23.126544+0000", 2021-06-25T04:56:41.661 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:56:41.661 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:56:41.662 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:41.662 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:41.662 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:41.662 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:41.662 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:41.663 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:41.663 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:56:41.663 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:56:41.663 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:56:41.664 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:56:41.664 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:56:41.664 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:41.664 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:41.664 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:41.665 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:41.665 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:41.665 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:41.665 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:41.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.666 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "138", 2021-06-25T04:56:41.666 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:41.666 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:41.666 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:41.667 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:41.667 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:41.667 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:41.667 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:41.667 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:41.668 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:41.668 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:41.668 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:41.668 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:41.669 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:41.669 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:41.669 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:41.669 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:41.669 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:41.670 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:41.670 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:41.670 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:41.670 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:41.671 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:41.671 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:41.671 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:41.671 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:41.671 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:41.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.672 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:41.672 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:41.672 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:41.673 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:41.673 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:41.673 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:41.673 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:41.674 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:41.674 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:41.674 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:41.674 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:41.674 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:56:41.675 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:56:41.675 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:56:41.675 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:56:41.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.676 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:41.676 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:56:41.676 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:56:41.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.677 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 26, 2021-06-25T04:56:41.677 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:56:41.678 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:56:23.668536+0000", 2021-06-25T04:56:41.678 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:56:41.678 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:56:41.679 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:41.679 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:41.679 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:41.679 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:41.680 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:41.680 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:41.680 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:56:41.680 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:56:41.680 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:56:41.681 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:56:41.681 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:56:41.681 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:41.681 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:41.682 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:41.682 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:41.682 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:41.682 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:41.682 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:41.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.683 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "139", 2021-06-25T04:56:41.683 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:41.683 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:41.684 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:41.684 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:41.684 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:41.684 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:41.684 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:41.685 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:41.685 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:41.685 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:41.685 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:41.686 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:41.686 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:41.686 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:41.686 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:41.686 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:41.687 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:41.687 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:41.687 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:41.687 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:41.688 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:41.688 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:41.688 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:41.688 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:41.688 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:41.689 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:41.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.689 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:41.689 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:41.690 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:41.690 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:41.690 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:41.690 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:41.690 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:41.691 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:41.691 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:41.691 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:41.691 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:41.692 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:56:41.692 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:41.692 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:56:41.692 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:56:41.692 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.693 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.693 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.693 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:41.694 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:56:41.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.694 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:56:41.694 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:56:41.694 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:41.695 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:41.695 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:41.695 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:41.695 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:41.696 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:41.696 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:41.696 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 135, 2021-06-25T04:56:41.696 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:41.697 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:41.697 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:41.697 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.697 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.698 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:56:41.698 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:41.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.698 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.699 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:56:41.699 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:41.699 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.699 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.700 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:41.700 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.700 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.701 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:56:41.701 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:41.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.702 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.702 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:56:41.702 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:41.702 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.702 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.703 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:41.703 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.704 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.704 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:56:41.704 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:41.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.705 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.705 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:56:41.705 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:41.705 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.706 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.706 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:41.706 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.707 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.707 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:56:41.707 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:41.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.708 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.708 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:56:41.708 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:41.708 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.709 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.709 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:56:41.709 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:56:41.710 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:56:41.710 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:56:41.710 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:41.710 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:41.711 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:41.711 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.712 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:56:41.712 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:56:41.712 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:41.712 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:41.713 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:41.713 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:41.713 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:41.713 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:41.714 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:41.714 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 136, 2021-06-25T04:56:41.714 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:41.714 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:41.714 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:41.715 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.715 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.715 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:56:41.716 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:41.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.716 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.717 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:56:41.717 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:41.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.717 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.718 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:41.718 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.718 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.719 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:56:41.719 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:41.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.720 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.720 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:56:41.720 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:41.720 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.721 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.721 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:41.721 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.722 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.722 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:56:41.722 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:41.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.723 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.723 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:56:41.723 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:41.724 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.724 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.724 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:41.724 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.725 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.725 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:56:41.725 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:41.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.726 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.726 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:56:41.727 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:41.727 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.727 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:56:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:56:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:56:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:56:41.728 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:41.729 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:41.729 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:41.729 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.730 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:56:41.730 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:56:41.730 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:41.730 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:41.731 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:41.731 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:41.731 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:41.731 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:41.732 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:41.732 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 136, 2021-06-25T04:56:41.732 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:41.732 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:41.733 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:41.733 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.733 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.733 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:56:41.734 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:41.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.734 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.735 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:56:41.735 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:41.735 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.735 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.736 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:41.736 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.736 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.737 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:56:41.737 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:41.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.738 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.738 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:56:41.738 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:41.738 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.738 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.739 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:41.739 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.740 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.740 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:56:41.740 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:41.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.741 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.741 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:56:41.741 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:41.741 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.742 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.742 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:41.742 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.743 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.743 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:56:41.743 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:41.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.744 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.744 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:56:41.744 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:41.745 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.745 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.745 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:56:41.745 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:56:41.746 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:56:41.746 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:56:41.746 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:41.746 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:41.747 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:41.747 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.748 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:56:41.748 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:56:41.748 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:41.748 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:41.748 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:41.749 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:41.749 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:41.749 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:41.749 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:41.750 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 135, 2021-06-25T04:56:41.750 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:41.750 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:41.750 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:41.750 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.751 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.751 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:56:41.751 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:41.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.752 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.752 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:56:41.753 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:41.753 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.753 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.753 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:41.754 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.754 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.754 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:56:41.755 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:41.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.755 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.756 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:56:41.756 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:41.756 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.756 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.757 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:41.757 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.757 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.757 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:56:41.758 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:41.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.758 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.759 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:56:41.759 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:41.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.759 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.760 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:41.760 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.760 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.761 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:56:41.761 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:41.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.761 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.762 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:56:41.762 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:41.762 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.762 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.763 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:56:41.763 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:56:41.763 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:56:41.763 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:56:41.764 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:41.764 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:41.764 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:41.764 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.765 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:56:41.765 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:56:41.765 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:41.766 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:41.766 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:41.766 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:41.766 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:41.767 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:41.767 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:41.767 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 137, 2021-06-25T04:56:41.767 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:41.767 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:41.768 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:41.768 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.768 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.769 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:56:41.769 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:41.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.769 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.770 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:56:41.770 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:41.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.770 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.771 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:41.771 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.771 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.772 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:56:41.772 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:41.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.773 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.773 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:56:41.773 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:41.773 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.773 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.774 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:41.774 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.775 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.775 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:56:41.775 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:41.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.776 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.776 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:56:41.776 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:41.776 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.777 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.777 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:41.777 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.778 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.778 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:56:41.778 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:41.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.779 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.779 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:56:41.779 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:41.780 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.780 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.780 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:56:41.780 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:56:41.781 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:56:41.781 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:56:41.781 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:41.781 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:41.782 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:41.782 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.782 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:56:41.783 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:56:41.783 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:41.783 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:41.783 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:41.784 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:41.784 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:41.784 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:41.784 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:41.784 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:41.785 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:41.785 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:41.785 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:41.785 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.786 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.786 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:56:41.786 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:41.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.787 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.787 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:56:41.787 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:41.787 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.788 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.788 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:41.788 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.789 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.789 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:56:41.789 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:41.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:56:41.790 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:41.791 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.792 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.792 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:56:41.792 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:41.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.793 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.793 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:56:41.793 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.795 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.795 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:56:41.795 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:56:41.796 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:41.797 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.797 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.797 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:56:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:56:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:56:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:56:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:41.798 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:41.799 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:41.799 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.800 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:56:41.800 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:56:41.800 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:41.800 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:41.800 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:41.801 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:41.801 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:41.801 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:41.801 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 136, 2021-06-25T04:56:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:41.802 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.803 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.803 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:56:41.803 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:41.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.804 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.804 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:56:41.804 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:41.805 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.805 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.805 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:41.806 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.806 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.806 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:56:41.806 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:41.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.807 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.807 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:56:41.808 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:41.808 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.808 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.808 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:56:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.810 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:56:41.811 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:41.811 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.811 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.812 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:41.812 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.812 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.812 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:56:41.813 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:41.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.813 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.813 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:56:41.814 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:41.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.814 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.815 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:56:41.815 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:56:41.815 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:56:41.815 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:56:41.816 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:41.816 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:41.816 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:41.816 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.817 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:56:41.817 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:56:41.817 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:41.818 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:41.818 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:41.818 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:41.818 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:41.818 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:41.819 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:41.819 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 136, 2021-06-25T04:56:41.819 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:41.819 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:41.820 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:41.820 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.820 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.820 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:56:41.821 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:41.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.821 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.822 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:56:41.822 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:41.822 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.822 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.823 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:41.823 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.823 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.823 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:56:41.824 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:41.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.824 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.825 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:56:41.825 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:41.825 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.825 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.826 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:41.826 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.826 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.827 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:56:41.827 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:41.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.827 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.828 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:56:41.828 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:41.828 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.828 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.829 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:41.829 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:41.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.830 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:41.830 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:56:41.830 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:41.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.831 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:41.831 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:56:41.831 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:41.831 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:56:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:56:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:56:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:56:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:56:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:56:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:56:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:56:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:56:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:56:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:56:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:56:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:56:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:56:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:56:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:56:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:56:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:56:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:56:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:56:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:56:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:56:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:56:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:56:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:56:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": {}, 2021-06-25T04:56:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:56:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:56:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:56:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:56:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:56:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:56:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:56:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:56:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:56:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:56:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:56:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:56:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:56:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:56:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:56:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:56:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:56:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:56:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:56:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:56:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:56:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:56:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:56:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:56:41.860 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:56:41.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ef4055510 msgr2=0x7f8ef40579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:41.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ef4055510 0x7f8ef40579d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f8f1000d000 tx=0x7f8f10009040).stop 2021-06-25T04:56:41.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/2796202731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f140b2670 msgr2=0x7f8f141372a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:41.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f140b2670 0x7f8f141372a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f8f04002f70 tx=0x7f8f04015000).stop 2021-06-25T04:56:41.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/2796202731 shutdown_connections 2021-06-25T04:56:41.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ef4055510 0x7f8ef40579d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f141419a0 0x7f8f14137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f140b2670 0x7f8f141372a0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 --2- 172.21.15.57:0/2796202731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f1405cbf0 0x7f8f140b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/2796202731 >> 172.21.15.57:0/2796202731 conn(0x7f8f1405f670 msgr2=0x7f8f1413ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/2796202731 shutdown_connections 2021-06-25T04:56:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.615+0000 7f8f1b4bf700 1 -- 172.21.15.57:0/2796202731 wait complete. 2021-06-25T04:56:41.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:41.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d7264700 1 Processor -- start 2021-06-25T04:56:41.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d7264700 1 -- start start 2021-06-25T04:56:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d7264700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d00b5c20 0x7fc2d013d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d7264700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc2d00b50f0 0x7fc2d0146860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d7264700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d00b9f70 con 0x7fc2d00b9b90 2021-06-25T04:56:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d7264700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d00b6060 con 0x7fc2d00b50f0 2021-06-25T04:56:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d7264700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00b69a0 con 0x7fc2d00b5c20 2021-06-25T04:56:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d5000700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc2d00b9b90 0x7fc2d013cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60792/0 (socket says 172.21.15.57:60792) 2021-06-25T04:56:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d5000700 1 -- 172.21.15.57:0/4172629685 learned_addr learned my addr 172.21.15.57:0/4172629685 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2cffff700 1 --2- 172.21.15.57:0/4172629685 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d00b5c20 0x7fc2d013d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d5801700 1 --2- 172.21.15.57:0/4172629685 >> v2:172.21.15.87:3300/0 conn(0x7fc2d00b50f0 0x7fc2d0146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2cf7fe700 1 -- 172.21.15.57:0/4172629685 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002778109 0 0) 0x7fc2d00b9f70 con 0x7fc2d00b9b90 2021-06-25T04:56:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2cf7fe700 1 -- 172.21.15.57:0/4172629685 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b0003260 con 0x7fc2d00b9b90 2021-06-25T04:56:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2cffff700 1 -- 172.21.15.57:0/4172629685 >> v2:172.21.15.87:3300/0 conn(0x7fc2d00b50f0 msgr2=0x7fc2d0146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:41.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2cffff700 1 --2- 172.21.15.57:0/4172629685 >> v2:172.21.15.87:3300/0 conn(0x7fc2d00b50f0 0x7fc2d0146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2cffff700 1 -- 172.21.15.57:0/4172629685 >> v1:172.21.15.57:6789/0 conn(0x7fc2d00b9b90 legacy=0x7fc2d013cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:41.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2cffff700 1 -- 172.21.15.57:0/4172629685 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00b6c40 con 0x7fc2d00b5c20 2021-06-25T04:56:41.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2cffff700 1 --2- 172.21.15.57:0/4172629685 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d00b5c20 0x7fc2d013d290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fc2c00032f0 tx=0x7fc2c00091d0).ready entity=mon.2 client_cookie=94af64fcbb630c31 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:41.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2cf7fe700 1 -- 172.21.15.57:0/4172629685 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2c000b600 con 0x7fc2d00b5c20 2021-06-25T04:56:41.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2cf7fe700 1 -- 172.21.15.57:0/4172629685 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c000b760 con 0x7fc2d00b5c20 2021-06-25T04:56:41.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2cf7fe700 1 -- 172.21.15.57:0/4172629685 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2c000b8d0 con 0x7fc2d00b5c20 2021-06-25T04:56:41.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d7264700 1 -- 172.21.15.57:0/4172629685 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d00b5c20 msgr2=0x7fc2d013d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:41.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.971+0000 7fc2d7264700 1 --2- 172.21.15.57:0/4172629685 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d00b5c20 0x7fc2d013d290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fc2c00032f0 tx=0x7fc2c00091d0).stop 2021-06-25T04:56:41.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 -- 172.21.15.57:0/4172629685 shutdown_connections 2021-06-25T04:56:41.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 --2- 172.21.15.57:0/4172629685 >> v2:172.21.15.87:3300/0 conn(0x7fc2d00b50f0 0x7fc2d0146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 --2- 172.21.15.57:0/4172629685 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d00b5c20 0x7fc2d013d290 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 -- 172.21.15.57:0/4172629685 >> 172.21.15.57:0/4172629685 conn(0x7fc2d005f920 msgr2=0x7fc2d0061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 -- 172.21.15.57:0/4172629685 shutdown_connections 2021-06-25T04:56:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 -- 172.21.15.57:0/4172629685 wait complete. 2021-06-25T04:56:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 Processor -- start 2021-06-25T04:56:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 -- start start 2021-06-25T04:56:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d00b50f0 0x7fc2d00b8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d00b5c20 0x7fc2d0147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d00b9b90 0x7fc2d0147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00ae360 con 0x7fc2d00b50f0 2021-06-25T04:56:41.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00ad750 con 0x7fc2d00b9b90 2021-06-25T04:56:41.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d7264700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0061690 con 0x7fc2d00b5c20 2021-06-25T04:56:41.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.975+0000 7fc2d5000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d00b50f0 0x7fc2d00b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d5000700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d00b50f0 0x7fc2d00b8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43580/0 (socket says 172.21.15.57:43580) 2021-06-25T04:56:41.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d5000700 1 -- 172.21.15.57:0/956274144 learned_addr learned my addr 172.21.15.57:0/956274144 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:41.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d5801700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d00b9b90 0x7fc2d0147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2cffff700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d00b5c20 0x7fc2d0147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d5000700 1 -- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d00b5c20 msgr2=0x7fc2d0147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:41.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d5000700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d00b5c20 0x7fc2d0147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d5000700 1 -- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d00b9b90 msgr2=0x7fc2d0147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d5000700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d00b9b90 0x7fc2d0147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d5000700 1 -- 172.21.15.57:0/956274144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c0009470 con 0x7fc2d00b50f0 2021-06-25T04:56:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d5000700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d00b50f0 0x7fc2d00b8810 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7fc2b8001110 tx=0x7fc2b8007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2cdffb700 1 -- 172.21.15.57:0/956274144 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2b80070d0 con 0x7fc2d00b50f0 2021-06-25T04:56:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2cdffb700 1 -- 172.21.15.57:0/956274144 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b8007230 con 0x7fc2d00b50f0 2021-06-25T04:56:41.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d7264700 1 -- 172.21.15.57:0/956274144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d0148d00 con 0x7fc2d00b50f0 2021-06-25T04:56:41.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2cdffb700 1 -- 172.21.15.57:0/956274144 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2b8005610 con 0x7fc2d00b50f0 2021-06-25T04:56:41.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d7264700 1 -- 172.21.15.57:0/956274144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d00adc20 con 0x7fc2d00b50f0 2021-06-25T04:56:41.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2d7264700 1 -- 172.21.15.57:0/956274144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d0057310 con 0x7fc2d00b50f0 2021-06-25T04:56:41.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2cdffb700 1 -- 172.21.15.57:0/956274144 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc2b8010070 con 0x7fc2d00b50f0 2021-06-25T04:56:41.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2cdffb700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc2b4055450 0x7fc2b4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:41.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.979+0000 7fc2cdffb700 1 -- 172.21.15.57:0/956274144 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc2b806d660 con 0x7fc2d00b50f0 2021-06-25T04:56:41.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.983+0000 7fc2cffff700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc2b4055450 0x7fc2b4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:41.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.983+0000 7fc2cffff700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc2b4055450 0x7fc2b4057910 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fc2c001b000 tx=0x7fc2c0016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:41.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:41.987+0000 7fc2cdffb700 1 -- 172.21.15.57:0/956274144 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc2b8043680 con 0x7fc2d00b50f0 2021-06-25T04:56:42.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.151+0000 7fc2d7264700 1 -- 172.21.15.57:0/956274144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2d00b5580 con 0x7fc2d00b50f0 2021-06-25T04:56:42.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.151+0000 7fc2cdffb700 1 -- 172.21.15.57:0/956274144 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fc2b8018020 con 0x7fc2d00b50f0 2021-06-25T04:56:42.158 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:42.158 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3591673245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3591673245},{"type":"v1","addr":"172.21.15.57:6833","nonce":3591673245}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2597000234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2597000234},{"type":"v1","addr":"172.21.15.57:6835","nonce":2597000234}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:24.666625+0000","modified":"2021-06-25T04:56:26.355926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8088":{"gid":8088,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2964573030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2964573030},{"type":"v1","addr":"172.21.15.87:6835","nonce":2964573030}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-06-25T04:56:42.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 -- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc2b4055450 msgr2=0x7fc2b4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:42.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc2b4055450 0x7fc2b4057910 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fc2c001b000 tx=0x7fc2c0016000).stop 2021-06-25T04:56:42.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 -- 172.21.15.57:0/956274144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d00b50f0 msgr2=0x7fc2d00b8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:42.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d00b50f0 0x7fc2d00b8810 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7fc2b8001110 tx=0x7fc2b8007aa0).stop 2021-06-25T04:56:42.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 -- 172.21.15.57:0/956274144 shutdown_connections 2021-06-25T04:56:42.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc2b4055450 0x7fc2b4057910 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:42.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d00b9b90 0x7fc2d0147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:42.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2d00b5c20 0x7fc2d0147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:42.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 --2- 172.21.15.57:0/956274144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d00b50f0 0x7fc2d00b8810 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:42.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 -- 172.21.15.57:0/956274144 >> 172.21.15.57:0/956274144 conn(0x7fc2d005f920 msgr2=0x7fc2d005bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:42.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 -- 172.21.15.57:0/956274144 shutdown_connections 2021-06-25T04:56:42.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.155+0000 7fc2d7264700 1 -- 172.21.15.57:0/956274144 wait complete. 2021-06-25T04:56:42.163 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 70 2021-06-25T04:56:42.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:56:42.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb493126700 1 Processor -- start 2021-06-25T04:56:42.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb493126700 1 -- start start 2021-06-25T04:56:42.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb493126700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb48c0b08e0 0x7fb48c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb493126700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 0x7fb48c0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb493126700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48c0b1690 con 0x7fb48c0acee0 2021-06-25T04:56:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb493126700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48c0b0cc0 con 0x7fb48c0b08e0 2021-06-25T04:56:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb493126700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0ae0e0 con 0x7fb48c143560 2021-06-25T04:56:42.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb4916c3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 0x7fb48c0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:42.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb490ec2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb48c0b08e0 0x7fb48c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:42.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb4916c3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 0x7fb48c0b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:54754/0 (socket says 172.21.15.57:54754) 2021-06-25T04:56:42.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb4916c3700 1 -- 172.21.15.57:0/2349075757 learned_addr learned my addr 172.21.15.57:0/2349075757 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:42.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb48bfff700 1 --1- 172.21.15.57:0/2349075757 >> v1:172.21.15.87:6789/0 conn(0x7fb48c0acee0 0x7fb48c0b0f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:33326/0 (socket says 172.21.15.57:33326) 2021-06-25T04:56:42.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb4916c3700 1 -- 172.21.15.57:0/2349075757 >> v2:172.21.15.87:3300/0 conn(0x7fb48c0b08e0 msgr2=0x7fb48c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:42.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb4916c3700 1 --2- 172.21.15.57:0/2349075757 >> v2:172.21.15.87:3300/0 conn(0x7fb48c0b08e0 0x7fb48c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:42.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb4916c3700 1 -- 172.21.15.57:0/2349075757 >> v1:172.21.15.87:6789/0 conn(0x7fb48c0acee0 legacy=0x7fb48c0b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:42.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb4916c3700 1 -- 172.21.15.57:0/2349075757 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c0ae380 con 0x7fb48c143560 2021-06-25T04:56:42.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb4916c3700 1 --2- 172.21.15.57:0/2349075757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 0x7fb48c0b1b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fb4840032f0 tx=0x7fb484009290).ready entity=mon.2 client_cookie=882331cd5caaa371 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:42.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb48b7fe700 1 -- 172.21.15.57:0/2349075757 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb48400b8a0 con 0x7fb48c143560 2021-06-25T04:56:42.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb48b7fe700 1 -- 172.21.15.57:0/2349075757 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48400ba00 con 0x7fb48c143560 2021-06-25T04:56:42.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb48b7fe700 1 -- 172.21.15.57:0/2349075757 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb48400bb70 con 0x7fb48c143560 2021-06-25T04:56:42.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb493126700 1 -- 172.21.15.57:0/2349075757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 msgr2=0x7fb48c0b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:42.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.275+0000 7fb493126700 1 --2- 172.21.15.57:0/2349075757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 0x7fb48c0b1b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fb4840032f0 tx=0x7fb484009290).stop 2021-06-25T04:56:42.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 -- 172.21.15.57:0/2349075757 shutdown_connections 2021-06-25T04:56:42.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 --2- 172.21.15.57:0/2349075757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 0x7fb48c0b1b10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:42.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 --2- 172.21.15.57:0/2349075757 >> v2:172.21.15.87:3300/0 conn(0x7fb48c0b08e0 0x7fb48c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:42.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 -- 172.21.15.57:0/2349075757 >> 172.21.15.57:0/2349075757 conn(0x7fb48c060780 msgr2=0x7fb48c060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:42.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 -- 172.21.15.57:0/2349075757 shutdown_connections 2021-06-25T04:56:42.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 -- 172.21.15.57:0/2349075757 wait complete. 2021-06-25T04:56:42.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 Processor -- start 2021-06-25T04:56:42.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 -- start start 2021-06-25T04:56:42.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb48c0acee0 0x7fb48c05f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:42.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb48c0b08e0 0x7fb48c0aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:42.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 0x7fb48c155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:42.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0abdd0 con 0x7fb48c0acee0 2021-06-25T04:56:42.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0aa510 con 0x7fb48c0b08e0 2021-06-25T04:56:42.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb493126700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0ac000 con 0x7fb48c143560 2021-06-25T04:56:42.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb490ec2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb48c0acee0 0x7fb48c05f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:42.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb490ec2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb48c0acee0 0x7fb48c05f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43594/0 (socket says 172.21.15.57:43594) 2021-06-25T04:56:42.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb490ec2700 1 -- 172.21.15.57:0/1395976190 learned_addr learned my addr 172.21.15.57:0/1395976190 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:42.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb48bfff700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb48c0b08e0 0x7fb48c0aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:42.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb4916c3700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 0x7fb48c155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:42.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb490ec2700 1 -- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 msgr2=0x7fb48c155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:42.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb490ec2700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 0x7fb48c155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:42.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb490ec2700 1 -- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb48c0b08e0 msgr2=0x7fb48c0aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:42.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb490ec2700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb48c0b08e0 0x7fb48c0aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:42.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb490ec2700 1 -- 172.21.15.57:0/1395976190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484009530 con 0x7fb48c0acee0 2021-06-25T04:56:42.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb48bfff700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb48c0b08e0 0x7fb48c0aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:42.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.279+0000 7fb490ec2700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb48c0acee0 0x7fb48c05f9b0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fb48000c000 tx=0x7fb480006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:42.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.283+0000 7fb489ffb700 1 -- 172.21.15.57:0/1395976190 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb480010780 con 0x7fb48c0acee0 2021-06-25T04:56:42.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.283+0000 7fb489ffb700 1 -- 172.21.15.57:0/1395976190 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4800108e0 con 0x7fb48c0acee0 2021-06-25T04:56:42.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.283+0000 7fb493126700 1 -- 172.21.15.57:0/1395976190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48c0aa770 con 0x7fb48c0acee0 2021-06-25T04:56:42.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.283+0000 7fb489ffb700 1 -- 172.21.15.57:0/1395976190 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb480010c40 con 0x7fb48c0acee0 2021-06-25T04:56:42.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.283+0000 7fb493126700 1 -- 172.21.15.57:0/1395976190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c060020 con 0x7fb48c0acee0 2021-06-25T04:56:42.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.283+0000 7fb489ffb700 1 -- 172.21.15.57:0/1395976190 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb48001c460 con 0x7fb48c0acee0 2021-06-25T04:56:42.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.283+0000 7fb493126700 1 -- 172.21.15.57:0/1395976190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c057310 con 0x7fb48c0acee0 2021-06-25T04:56:42.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.283+0000 7fb489ffb700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb474055450 0x7fb474057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:42.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.283+0000 7fb489ffb700 1 -- 172.21.15.57:0/1395976190 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb48006e250 con 0x7fb48c0acee0 2021-06-25T04:56:42.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.283+0000 7fb48bfff700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb474055450 0x7fb474057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:42.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.287+0000 7fb48bfff700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb474055450 0x7fb474057910 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fb47800d000 tx=0x7fb478007b80).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:42.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.291+0000 7fb489ffb700 1 -- 172.21.15.57:0/1395976190 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb4800443a0 con 0x7fb48c0acee0 2021-06-25T04:56:42.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:42.455+0000 7fb493126700 1 -- 172.21.15.57:0/1395976190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb48c0abb70 con 0x7fb48c0acee0 2021-06-25T04:56:43.333 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:56:43.331+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:56:43.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.343+0000 7fb489ffb700 1 -- 172.21.15.57:0/1395976190 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb4800479c0 con 0x7fb48c0acee0 2021-06-25T04:56:43.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 -- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb474055450 msgr2=0x7fb474057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb474055450 0x7fb474057910 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fb47800d000 tx=0x7fb478007b80).stop 2021-06-25T04:56:43.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 -- 172.21.15.57:0/1395976190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb48c0acee0 msgr2=0x7fb48c05f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb48c0acee0 0x7fb48c05f9b0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fb48000c000 tx=0x7fb480006df0).stop 2021-06-25T04:56:43.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 -- 172.21.15.57:0/1395976190 shutdown_connections 2021-06-25T04:56:43.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb474055450 0x7fb474057910 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb48c143560 0x7fb48c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb48c0b08e0 0x7fb48c0aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 --2- 172.21.15.57:0/1395976190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb48c0acee0 0x7fb48c05f9b0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 -- 172.21.15.57:0/1395976190 >> 172.21.15.57:0/1395976190 conn(0x7fb48c060780 msgr2=0x7fb48c143970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:43.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 -- 172.21.15.57:0/1395976190 shutdown_connections 2021-06-25T04:56:43.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.347+0000 7fb493126700 1 -- 172.21.15.57:0/1395976190 wait complete. 2021-06-25T04:56:43.357 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:56:43.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:43.379 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:56:43.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f47151fa700 1 Processor -- start 2021-06-25T04:56:43.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f47151fa700 1 -- start start 2021-06-25T04:56:43.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f47151fa700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4710097e00 0x7f47100b5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f47151fa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f47100b43f0 0x7f471009ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f47151fa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47100b3690 con 0x7f471009b000 2021-06-25T04:56:43.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f47151fa700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47100b4180 con 0x7f47100b43f0 2021-06-25T04:56:43.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f47151fa700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47100b33f0 con 0x7f4710097e00 2021-06-25T04:56:43.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470e59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f47100b43f0 0x7f471009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470f59e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f471009b000 0x7f4710098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60824/0 (socket says 172.21.15.57:60824) 2021-06-25T04:56:43.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470f59e700 1 -- 172.21.15.57:0/2832751379 learned_addr learned my addr 172.21.15.57:0/2832751379 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:43.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470ed9d700 1 --2- 172.21.15.57:0/2832751379 >> v2:172.21.15.87:3300/0 conn(0x7f4710097e00 0x7f47100b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470e59c700 1 -- 172.21.15.57:0/2832751379 >> v2:172.21.15.87:3300/0 conn(0x7f4710097e00 msgr2=0x7f47100b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:43.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470e59c700 1 --2- 172.21.15.57:0/2832751379 >> v2:172.21.15.87:3300/0 conn(0x7f4710097e00 0x7f47100b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470e59c700 1 -- 172.21.15.57:0/2832751379 >> v1:172.21.15.57:6789/0 conn(0x7f471009b000 legacy=0x7f4710098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470dd9b700 1 -- 172.21.15.57:0/2832751379 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916066214 0 0) 0x7f47100b3690 con 0x7f471009b000 2021-06-25T04:56:43.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470e59c700 1 -- 172.21.15.57:0/2832751379 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47100b31c0 con 0x7f47100b43f0 2021-06-25T04:56:43.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470e59c700 1 --2- 172.21.15.57:0/2832751379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47100b43f0 0x7f471009ab10 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f46f8002f70 tx=0x7f46f8006df0).ready entity=mon.0 client_cookie=1acc463e46ff2a1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:43.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470dd9b700 1 -- 172.21.15.57:0/2832751379 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46f800d570 con 0x7f47100b43f0 2021-06-25T04:56:43.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470dd9b700 1 -- 172.21.15.57:0/2832751379 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f8000e90 con 0x7f47100b43f0 2021-06-25T04:56:43.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f470dd9b700 1 -- 172.21.15.57:0/2832751379 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46f800d8c0 con 0x7f47100b43f0 2021-06-25T04:56:43.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f47151fa700 1 -- 172.21.15.57:0/2832751379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47100b43f0 msgr2=0x7f471009ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.471+0000 7f47151fa700 1 --2- 172.21.15.57:0/2832751379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47100b43f0 0x7f471009ab10 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f46f8002f70 tx=0x7f46f8006df0).stop 2021-06-25T04:56:43.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 -- 172.21.15.57:0/2832751379 shutdown_connections 2021-06-25T04:56:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 --2- 172.21.15.57:0/2832751379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47100b43f0 0x7f471009ab10 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 --2- 172.21.15.57:0/2832751379 >> v2:172.21.15.87:3300/0 conn(0x7f4710097e00 0x7f47100b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 -- 172.21.15.57:0/2832751379 >> 172.21.15.57:0/2832751379 conn(0x7f471005c590 msgr2=0x7f471005c970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 -- 172.21.15.57:0/2832751379 shutdown_connections 2021-06-25T04:56:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 -- 172.21.15.57:0/2832751379 wait complete. 2021-06-25T04:56:43.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 Processor -- start 2021-06-25T04:56:43.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 -- start start 2021-06-25T04:56:43.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4710097e00 0x7f47100af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471009b000 0x7f4710153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47100b43f0 0x7f47100aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47100aaa30 con 0x7f471009b000 2021-06-25T04:56:43.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47100aac50 con 0x7f47100b43f0 2021-06-25T04:56:43.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4710153500 con 0x7f4710097e00 2021-06-25T04:56:43.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471009b000 0x7f4710153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471009b000 0x7f4710153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43612/0 (socket says 172.21.15.57:43612) 2021-06-25T04:56:43.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470e59c700 1 -- 172.21.15.57:0/870371684 learned_addr learned my addr 172.21.15.57:0/870371684 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:43.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470ed9d700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4710097e00 0x7f47100af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470f59e700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47100b43f0 0x7f47100aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470ed9d700 1 -- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47100b43f0 msgr2=0x7f47100aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470ed9d700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47100b43f0 0x7f47100aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470ed9d700 1 -- 172.21.15.57:0/870371684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471009b000 msgr2=0x7f4710153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470ed9d700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471009b000 0x7f4710153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470ed9d700 1 -- 172.21.15.57:0/870371684 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f800b180 con 0x7f4710097e00 2021-06-25T04:56:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470e59c700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471009b000 0x7f4710153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f470ed9d700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4710097e00 0x7f47100af950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f47100aab70 tx=0x7f4700006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f4707fff700 1 -- 172.21.15.57:0/870371684 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4700010780 con 0x7f4710097e00 2021-06-25T04:56:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f4707fff700 1 -- 172.21.15.57:0/870371684 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47000108e0 con 0x7f4710097e00 2021-06-25T04:56:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 -- 172.21.15.57:0/870371684 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47101537a0 con 0x7f4710097e00 2021-06-25T04:56:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f4707fff700 1 -- 172.21.15.57:0/870371684 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4700010c40 con 0x7f4710097e00 2021-06-25T04:56:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.475+0000 7f47151fa700 1 -- 172.21.15.57:0/870371684 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47100ab060 con 0x7f4710097e00 2021-06-25T04:56:43.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.479+0000 7f4707fff700 1 -- 172.21.15.57:0/870371684 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f470001b400 con 0x7f4710097e00 2021-06-25T04:56:43.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.479+0000 7f47151fa700 1 -- 172.21.15.57:0/870371684 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4710057310 con 0x7f4710097e00 2021-06-25T04:56:43.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.479+0000 7f4707fff700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46f4055450 0x7f46f4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.479+0000 7f4707fff700 1 -- 172.21.15.57:0/870371684 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f470006e100 con 0x7f4710097e00 2021-06-25T04:56:43.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.479+0000 7f470e59c700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46f4055450 0x7f46f4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.479+0000 7f470e59c700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46f4055450 0x7f46f4057910 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f46f8019000 tx=0x7f46f8014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:43.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.487+0000 7f4707fff700 1 -- 172.21.15.57:0/870371684 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f47000440f0 con 0x7f4710097e00 2021-06-25T04:56:43.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 -- 172.21.15.57:0/870371684 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4710069950 con 0x7f4710097e00 2021-06-25T04:56:43.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f4707fff700 1 -- 172.21.15.57:0/870371684 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f4700047710 con 0x7f4710097e00 2021-06-25T04:56:43.660 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:43.660 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":71,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3591673245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3591673245},{"type":"v1","addr":"172.21.15.57:6833","nonce":3591673245}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2597000234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2597000234},{"type":"v1","addr":"172.21.15.57:6835","nonce":2597000234}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":71,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:24.666625+0000","modified":"2021-06-25T04:56:43.332234+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":140,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-06-25T04:56:43.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 -- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46f4055450 msgr2=0x7f46f4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46f4055450 0x7f46f4057910 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f46f8019000 tx=0x7f46f8014000).stop 2021-06-25T04:56:43.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 -- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4710097e00 msgr2=0x7f47100af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.662 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4710097e00 0x7f47100af950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f47100aab70 tx=0x7f4700006df0).stop 2021-06-25T04:56:43.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 -- 172.21.15.57:0/870371684 shutdown_connections 2021-06-25T04:56:43.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f46f4055450 0x7f46f4057910 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47100b43f0 0x7f47100aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f471009b000 0x7f4710153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 --2- 172.21.15.57:0/870371684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4710097e00 0x7f47100af950 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 -- 172.21.15.57:0/870371684 >> 172.21.15.57:0/870371684 conn(0x7f471005c590 msgr2=0x7f47100951a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:43.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 -- 172.21.15.57:0/870371684 shutdown_connections 2021-06-25T04:56:43.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.655+0000 7f47151fa700 1 -- 172.21.15.57:0/870371684 wait complete. 2021-06-25T04:56:43.665 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 71 2021-06-25T04:56:43.674 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:56:43.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa1a5e2d700 1 Processor -- start 2021-06-25T04:56:43.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa1a5e2d700 1 -- start start 2021-06-25T04:56:43.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa1a5e2d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1a00a8d20 0x7fa1a0145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa1a5e2d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa1a00677b0 0x7fa1a00b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa1a5e2d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a00b5bc0 con 0x7fa1a00b57e0 2021-06-25T04:56:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa1a5e2d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a00b0070 con 0x7fa1a00677b0 2021-06-25T04:56:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa1a5e2d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a00b0310 con 0x7fa1a00a8d20 2021-06-25T04:56:43.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa1a00b57e0 0x7fa1a01449f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60834/0 (socket says 172.21.15.57:60834) 2021-06-25T04:56:43.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19f7fe700 1 -- 172.21.15.57:0/1468522547 learned_addr learned my addr 172.21.15.57:0/1468522547 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:43.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19ffff700 1 --2- 172.21.15.57:0/1468522547 >> v2:172.21.15.57:3300/0 conn(0x7fa1a00677b0 0x7fa1a00b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19effd700 1 --2- 172.21.15.57:0/1468522547 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1a00a8d20 0x7fa1a0145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19ffff700 1 -- 172.21.15.57:0/1468522547 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1a00a8d20 msgr2=0x7fa1a0145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:43.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19ffff700 1 --2- 172.21.15.57:0/1468522547 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1a00a8d20 0x7fa1a0145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19ffff700 1 -- 172.21.15.57:0/1468522547 >> v1:172.21.15.57:6789/0 conn(0x7fa1a00b57e0 legacy=0x7fa1a01449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19ffff700 1 -- 172.21.15.57:0/1468522547 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a00b05b0 con 0x7fa1a00677b0 2021-06-25T04:56:43.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19e7fc700 1 -- 172.21.15.57:0/1468522547 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673927896 0 0) 0x7fa1a00b5bc0 con 0x7fa1a00b57e0 2021-06-25T04:56:43.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19ffff700 1 --2- 172.21.15.57:0/1468522547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a00677b0 0x7fa1a00b1fb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fa1980032f0 tx=0x7fa1980091d0).ready entity=mon.0 client_cookie=483a075412876af7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:43.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19e7fc700 1 -- 172.21.15.57:0/1468522547 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa19800b6c0 con 0x7fa1a00677b0 2021-06-25T04:56:43.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19e7fc700 1 -- 172.21.15.57:0/1468522547 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19800b820 con 0x7fa1a00677b0 2021-06-25T04:56:43.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/1468522547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a00677b0 msgr2=0x7fa1a00b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa19e7fc700 1 -- 172.21.15.57:0/1468522547 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa19800b990 con 0x7fa1a00677b0 2021-06-25T04:56:43.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.779+0000 7fa1a5e2d700 1 --2- 172.21.15.57:0/1468522547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a00677b0 0x7fa1a00b1fb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fa1980032f0 tx=0x7fa1980091d0).stop 2021-06-25T04:56:43.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/1468522547 shutdown_connections 2021-06-25T04:56:43.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 --2- 172.21.15.57:0/1468522547 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1a00a8d20 0x7fa1a0145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 --2- 172.21.15.57:0/1468522547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a00677b0 0x7fa1a00b1fb0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/1468522547 >> 172.21.15.57:0/1468522547 conn(0x7fa1a005bd00 msgr2=0x7fa1a005c110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:43.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/1468522547 shutdown_connections 2021-06-25T04:56:43.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/1468522547 wait complete. 2021-06-25T04:56:43.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 Processor -- start 2021-06-25T04:56:43.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 -- start start 2021-06-25T04:56:43.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a00677b0 0x7fa1a0159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1a00a8d20 0x7fa1a014ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1a00b57e0 0x7fa1a00a9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a015a400 con 0x7fa1a00677b0 2021-06-25T04:56:43.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a015a630 con 0x7fa1a00a8d20 2021-06-25T04:56:43.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa1a5e2d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0149480 con 0x7fa1a00b57e0 2021-06-25T04:56:43.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa19f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a00677b0 0x7fa1a0159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa19f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a00677b0 0x7fa1a0159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43622/0 (socket says 172.21.15.57:43622) 2021-06-25T04:56:43.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa19f7fe700 1 -- 172.21.15.57:0/2024059159 learned_addr learned my addr 172.21.15.57:0/2024059159 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:43.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa19ffff700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1a00b57e0 0x7fa1a00a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa19effd700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1a00a8d20 0x7fa1a014ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa19f7fe700 1 -- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1a00b57e0 msgr2=0x7fa1a00a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa19f7fe700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1a00b57e0 0x7fa1a00a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa19f7fe700 1 -- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1a00a8d20 msgr2=0x7fa1a014ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:43.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa19f7fe700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1a00a8d20 0x7fa1a014ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:43.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.783+0000 7fa19f7fe700 1 -- 172.21.15.57:0/2024059159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa198009470 con 0x7fa1a00677b0 2021-06-25T04:56:43.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.787+0000 7fa19f7fe700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a00677b0 0x7fa1a0159f10 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fa190000bc0 tx=0x7fa190007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:43.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.787+0000 7fa19cff9700 1 -- 172.21.15.57:0/2024059159 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1900070d0 con 0x7fa1a00677b0 2021-06-25T04:56:43.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.787+0000 7fa19cff9700 1 -- 172.21.15.57:0/2024059159 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa190007230 con 0x7fa1a00677b0 2021-06-25T04:56:43.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.787+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/2024059159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a0149720 con 0x7fa1a00677b0 2021-06-25T04:56:43.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.787+0000 7fa19cff9700 1 -- 172.21.15.57:0/2024059159 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa190005610 con 0x7fa1a00677b0 2021-06-25T04:56:43.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.787+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/2024059159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a00a9c50 con 0x7fa1a00677b0 2021-06-25T04:56:43.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.787+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/2024059159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a0148c00 con 0x7fa1a00677b0 2021-06-25T04:56:43.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.787+0000 7fa19cff9700 1 -- 172.21.15.57:0/2024059159 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa19001a060 con 0x7fa1a00677b0 2021-06-25T04:56:43.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.787+0000 7fa19cff9700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa1840553d0 0x7fa184057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:43.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.787+0000 7fa19cff9700 1 -- 172.21.15.57:0/2024059159 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fa19006d750 con 0x7fa1a00677b0 2021-06-25T04:56:43.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.787+0000 7fa19effd700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa1840553d0 0x7fa184057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:43.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.791+0000 7fa19effd700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa1840553d0 0x7fa184057890 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fa18800b000 tx=0x7fa188006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:43.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.791+0000 7fa19cff9700 1 -- 172.21.15.57:0/2024059159 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa1900437a0 con 0x7fa1a00677b0 2021-06-25T04:56:43.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:43.951+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/2024059159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa1a01498b0 con 0x7fa1a00677b0 2021-06-25T04:56:44.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.347+0000 7fa19cff9700 1 -- 172.21.15.57:0/2024059159 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa1900180a0 con 0x7fa1a00677b0 2021-06-25T04:56:44.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa1840553d0 msgr2=0x7fa184057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:44.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa1840553d0 0x7fa184057890 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fa18800b000 tx=0x7fa188006df0).stop 2021-06-25T04:56:44.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/2024059159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a00677b0 msgr2=0x7fa1a0159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:44.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a00677b0 0x7fa1a0159f10 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fa190000bc0 tx=0x7fa190007c90).stop 2021-06-25T04:56:44.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/2024059159 shutdown_connections 2021-06-25T04:56:44.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa1840553d0 0x7fa184057890 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:44.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1a00b57e0 0x7fa1a00a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:44.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1a00a8d20 0x7fa1a014ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:44.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 --2- 172.21.15.57:0/2024059159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a00677b0 0x7fa1a0159f10 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:44.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/2024059159 >> 172.21.15.57:0/2024059159 conn(0x7fa1a005bd00 msgr2=0x7fa1a01447c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:44.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/2024059159 shutdown_connections 2021-06-25T04:56:44.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.351+0000 7fa1a5e2d700 1 -- 172.21.15.57:0/2024059159 wait complete. 2021-06-25T04:56:44.436 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:56:44.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.547+0000 7f547fafc700 1 Processor -- start 2021-06-25T04:56:44.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.547+0000 7f547fafc700 1 -- start start 2021-06-25T04:56:44.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547fafc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f54780b98d0 0x7f54780b9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:44.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547fafc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54781468a0 con 0x7f54780b4330 2021-06-25T04:56:44.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547fafc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54780b4950 con 0x7f54780b7120 2021-06-25T04:56:44.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547fafc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54780b4bf0 con 0x7f54780b98d0 2021-06-25T04:56:44.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547d097700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f54780b4330 0x7f5478146fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60852/0 (socket says 172.21.15.57:60852) 2021-06-25T04:56:44.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547d097700 1 -- 172.21.15.57:0/191283688 learned_addr learned my addr 172.21.15.57:0/191283688 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:44.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547d898700 1 --2- 172.21.15.57:0/191283688 >> v2:172.21.15.87:3300/0 conn(0x7f54780b98d0 0x7f54780b9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:44.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547c896700 1 -- 172.21.15.57:0/191283688 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126521894 0 0) 0x7f54781468a0 con 0x7f54780b4330 2021-06-25T04:56:44.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547c896700 1 -- 172.21.15.57:0/191283688 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5460003260 con 0x7f54780b4330 2021-06-25T04:56:44.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547c896700 1 -- 172.21.15.57:0/191283688 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113833488 0 0) 0x7f54780b4950 con 0x7f54780b7120 2021-06-25T04:56:44.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547c896700 1 -- 172.21.15.57:0/191283688 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54781468a0 con 0x7f54780b7120 2021-06-25T04:56:44.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547d898700 1 -- 172.21.15.57:0/191283688 >> v1:172.21.15.87:6789/0 conn(0x7f54780b7120 legacy=0x7f547813ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:44.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547d898700 1 -- 172.21.15.57:0/191283688 >> v1:172.21.15.57:6789/0 conn(0x7f54780b4330 legacy=0x7f5478146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:44.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547d898700 1 -- 172.21.15.57:0/191283688 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5478146b00 con 0x7f54780b98d0 2021-06-25T04:56:44.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547d898700 1 --2- 172.21.15.57:0/191283688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54780b98d0 0x7f54780b9cb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f546c002f70 tx=0x7f546c006df0).ready entity=mon.1 client_cookie=18cd3561ada2ef6c server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:44.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547c896700 1 -- 172.21.15.57:0/191283688 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f546c00d540 con 0x7f54780b98d0 2021-06-25T04:56:44.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547c896700 1 -- 172.21.15.57:0/191283688 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c000e90 con 0x7f54780b98d0 2021-06-25T04:56:44.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547c896700 1 -- 172.21.15.57:0/191283688 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f546c00d890 con 0x7f54780b98d0 2021-06-25T04:56:44.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547fafc700 1 -- 172.21.15.57:0/191283688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54780b98d0 msgr2=0x7f54780b9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:44.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547fafc700 1 --2- 172.21.15.57:0/191283688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54780b98d0 0x7f54780b9cb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f546c002f70 tx=0x7f546c006df0).stop 2021-06-25T04:56:44.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547fafc700 1 -- 172.21.15.57:0/191283688 shutdown_connections 2021-06-25T04:56:44.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547fafc700 1 --2- 172.21.15.57:0/191283688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54780b98d0 0x7f54780b9cb0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:44.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547fafc700 1 -- 172.21.15.57:0/191283688 >> 172.21.15.57:0/191283688 conn(0x7f547805ff20 msgr2=0x7f5478061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:44.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547fafc700 1 -- 172.21.15.57:0/191283688 shutdown_connections 2021-06-25T04:56:44.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.551+0000 7f547fafc700 1 -- 172.21.15.57:0/191283688 wait complete. 2021-06-25T04:56:44.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547fafc700 1 Processor -- start 2021-06-25T04:56:44.576 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547fafc700 1 -- start start 2021-06-25T04:56:44.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547fafc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54780b4330 0x7f54780adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:44.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547fafc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54780b7120 0x7f5478152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:44.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547fafc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54780b98d0 0x7f547813e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:44.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547fafc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547813d940 con 0x7f54780b7120 2021-06-25T04:56:44.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547fafc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5478143740 con 0x7f54780b4330 2021-06-25T04:56:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547fafc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54781439e0 con 0x7f54780b98d0 2021-06-25T04:56:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547d097700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54780b7120 0x7f5478152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:44.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547d097700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54780b7120 0x7f5478152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43638/0 (socket says 172.21.15.57:43638) 2021-06-25T04:56:44.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547d097700 1 -- 172.21.15.57:0/3347991404 learned_addr learned my addr 172.21.15.57:0/3347991404 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:44.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547d898700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54780b4330 0x7f54780adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:44.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547e099700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54780b98d0 0x7f547813e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:44.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547d097700 1 -- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54780b98d0 msgr2=0x7f547813e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:44.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547d097700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54780b98d0 0x7f547813e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:44.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547d097700 1 -- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54780b4330 msgr2=0x7f54780adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:44.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547d097700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54780b4330 0x7f54780adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:44.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547d097700 1 -- 172.21.15.57:0/3347991404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c00b180 con 0x7f54780b7120 2021-06-25T04:56:44.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.555+0000 7f547d097700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54780b7120 0x7f5478152b90 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f54740010d0 tx=0x7f5474007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:44.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.559+0000 7f546affd700 1 -- 172.21.15.57:0/3347991404 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54740070d0 con 0x7f54780b7120 2021-06-25T04:56:44.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.559+0000 7f546affd700 1 -- 172.21.15.57:0/3347991404 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474007230 con 0x7f54780b7120 2021-06-25T04:56:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.559+0000 7f547fafc700 1 -- 172.21.15.57:0/3347991404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5478143c80 con 0x7f54780b7120 2021-06-25T04:56:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.559+0000 7f546affd700 1 -- 172.21.15.57:0/3347991404 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5474005610 con 0x7f54780b7120 2021-06-25T04:56:44.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.559+0000 7f547fafc700 1 -- 172.21.15.57:0/3347991404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5478142a00 con 0x7f54780b7120 2021-06-25T04:56:44.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.559+0000 7f547fafc700 1 -- 172.21.15.57:0/3347991404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5478143e10 con 0x7f54780b7120 2021-06-25T04:56:44.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.559+0000 7f546affd700 1 -- 172.21.15.57:0/3347991404 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5474010070 con 0x7f54780b7120 2021-06-25T04:56:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.559+0000 7f546affd700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54580553d0 0x7f5458057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.559+0000 7f546affd700 1 -- 172.21.15.57:0/3347991404 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f547406d550 con 0x7f54780b7120 2021-06-25T04:56:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.563+0000 7f547d898700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54580553d0 0x7f5458057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.563+0000 7f547d898700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54580553d0 0x7f5458057890 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f546c019000 tx=0x7f546c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:44.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.567+0000 7f546affd700 1 -- 172.21.15.57:0/3347991404 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f54740435a0 con 0x7f54780b7120 2021-06-25T04:56:44.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:44.695+0000 7f547fafc700 1 -- 172.21.15.57:0/3347991404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5478057310 con 0x7f54780b7120 2021-06-25T04:56:45.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.355+0000 7f546affd700 1 -- 172.21.15.57:0/3347991404 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v141) v1 ==== 185+0+0 (secure 0 0 0) 0x7f5474046bc0 con 0x7f54780b7120 2021-06-25T04:56:45.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.359+0000 7f547fafc700 1 -- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54580553d0 msgr2=0x7f5458057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:45.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.359+0000 7f547fafc700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54580553d0 0x7f5458057890 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f546c019000 tx=0x7f546c014000).stop 2021-06-25T04:56:45.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.359+0000 7f547fafc700 1 -- 172.21.15.57:0/3347991404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54780b7120 msgr2=0x7f5478152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:45.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.359+0000 7f547fafc700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54780b7120 0x7f5478152b90 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f54740010d0 tx=0x7f5474007b00).stop 2021-06-25T04:56:45.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.359+0000 7f547fafc700 1 -- 172.21.15.57:0/3347991404 shutdown_connections 2021-06-25T04:56:45.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.359+0000 7f547fafc700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54580553d0 0x7f5458057890 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:45.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.359+0000 7f547fafc700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54780b98d0 0x7f547813e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:45.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.359+0000 7f547fafc700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54780b7120 0x7f5478152b90 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:45.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.359+0000 7f547fafc700 1 --2- 172.21.15.57:0/3347991404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54780b4330 0x7f54780adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:45.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.359+0000 7f547fafc700 1 -- 172.21.15.57:0/3347991404 >> 172.21.15.57:0/3347991404 conn(0x7f547805ff20 msgr2=0x7f54780b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:45.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.363+0000 7f547fafc700 1 -- 172.21.15.57:0/3347991404 shutdown_connections 2021-06-25T04:56:45.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.363+0000 7f547fafc700 1 -- 172.21.15.57:0/3347991404 wait complete. 2021-06-25T04:56:45.369 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:56:45.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:56:45.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.487+0000 7f41df59e700 1 Processor -- start 2021-06-25T04:56:45.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.487+0000 7f41df59e700 1 -- start start 2021-06-25T04:56:45.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.487+0000 7f41df59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41e005c040 0x7f41e00b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:45.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.487+0000 7f41df59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41e00b6d40 0x7f41e012bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:45.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.487+0000 7f41df59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e005c420 con 0x7f41e005c890 2021-06-25T04:56:45.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.487+0000 7f41df59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e00b1e80 con 0x7f41e00b6d40 2021-06-25T04:56:45.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.487+0000 7f41df59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0143e30 con 0x7f41e005c040 2021-06-25T04:56:45.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41ded9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41e00b6d40 0x7f41e012bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:45.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41ded9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41e00b6d40 0x7f41e012bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43646/0 (socket says 172.21.15.57:43646) 2021-06-25T04:56:45.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41ddd9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f41e005c890 0x7f41e00b2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60866/0 (socket says 172.21.15.57:60866) 2021-06-25T04:56:45.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41ded9d700 1 -- 172.21.15.57:0/889801347 learned_addr learned my addr 172.21.15.57:0/889801347 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:45.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41de59c700 1 --2- 172.21.15.57:0/889801347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41e005c040 0x7f41e00b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:45.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41ded9d700 1 -- 172.21.15.57:0/889801347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41e005c040 msgr2=0x7f41e00b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:45.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41ded9d700 1 --2- 172.21.15.57:0/889801347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41e005c040 0x7f41e00b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:45.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41ded9d700 1 -- 172.21.15.57:0/889801347 >> v1:172.21.15.57:6789/0 conn(0x7f41e005c890 legacy=0x7f41e00b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:45.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41ded9d700 1 -- 172.21.15.57:0/889801347 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00b2070 con 0x7f41e00b6d40 2021-06-25T04:56:45.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41dd59a700 1 -- 172.21.15.57:0/889801347 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130187320 0 0) 0x7f41e005c420 con 0x7f41e005c890 2021-06-25T04:56:45.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41ded9d700 1 --2- 172.21.15.57:0/889801347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e00b6d40 0x7f41e012bb30 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f41d80032f0 tx=0x7f41d8009290).ready entity=mon.0 client_cookie=db86f2cf8345d026 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:45.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41dd59a700 1 -- 172.21.15.57:0/889801347 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d800b8a0 con 0x7f41e00b6d40 2021-06-25T04:56:45.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41dd59a700 1 -- 172.21.15.57:0/889801347 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d800ba00 con 0x7f41e00b6d40 2021-06-25T04:56:45.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41dd59a700 1 -- 172.21.15.57:0/889801347 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d800bb70 con 0x7f41e00b6d40 2021-06-25T04:56:45.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41df59e700 1 -- 172.21.15.57:0/889801347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e00b6d40 msgr2=0x7f41e012bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:45.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41df59e700 1 --2- 172.21.15.57:0/889801347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e00b6d40 0x7f41e012bb30 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f41d80032f0 tx=0x7f41d8009290).stop 2021-06-25T04:56:45.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41df59e700 1 -- 172.21.15.57:0/889801347 shutdown_connections 2021-06-25T04:56:45.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41df59e700 1 --2- 172.21.15.57:0/889801347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e00b6d40 0x7f41e012bb30 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:45.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41df59e700 1 --2- 172.21.15.57:0/889801347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41e005c040 0x7f41e00b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:45.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41df59e700 1 -- 172.21.15.57:0/889801347 >> 172.21.15.57:0/889801347 conn(0x7f41e0066da0 msgr2=0x7f41e00671b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:45.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41df59e700 1 -- 172.21.15.57:0/889801347 shutdown_connections 2021-06-25T04:56:45.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41df59e700 1 -- 172.21.15.57:0/889801347 wait complete. 2021-06-25T04:56:45.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41df59e700 1 Processor -- start 2021-06-25T04:56:45.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.491+0000 7f41df59e700 1 -- start start 2021-06-25T04:56:45.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41df59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41e005c040 0x7f41e00b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:45.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41df59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e005c890 0x7f41e00ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:45.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41df59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41e00b6d40 0x7f41e00affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:45.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41df59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0144fe0 con 0x7f41e005c890 2021-06-25T04:56:45.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41df59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0152ac0 con 0x7f41e00b6d40 2021-06-25T04:56:45.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41df59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00afb10 con 0x7f41e005c040 2021-06-25T04:56:45.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41ddd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e005c890 0x7f41e00ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:45.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41ddd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e005c890 0x7f41e00ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43650/0 (socket says 172.21.15.57:43650) 2021-06-25T04:56:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41ddd9b700 1 -- 172.21.15.57:0/2577565153 learned_addr learned my addr 172.21.15.57:0/2577565153 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41ded9d700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41e00b6d40 0x7f41e00affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41de59c700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41e005c040 0x7f41e00b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41ddd9b700 1 -- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41e005c040 msgr2=0x7f41e00b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:45.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41ddd9b700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41e005c040 0x7f41e00b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:45.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41ddd9b700 1 -- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41e00b6d40 msgr2=0x7f41e00affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:45.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41ddd9b700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41e00b6d40 0x7f41e00affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:45.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41ddd9b700 1 -- 172.21.15.57:0/2577565153 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009530 con 0x7f41e005c890 2021-06-25T04:56:45.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41ded9d700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41e00b6d40 0x7f41e00affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:45.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41ddd9b700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e005c890 0x7f41e00ad410 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f41e00afca0 tx=0x7f41d0007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:45.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41d77fe700 1 -- 172.21.15.57:0/2577565153 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d00070d0 con 0x7f41e005c890 2021-06-25T04:56:45.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41d77fe700 1 -- 172.21.15.57:0/2577565153 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0007230 con 0x7f41e005c890 2021-06-25T04:56:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41df59e700 1 -- 172.21.15.57:0/2577565153 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e00af870 con 0x7f41e005c890 2021-06-25T04:56:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41d77fe700 1 -- 172.21.15.57:0/2577565153 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d0005740 con 0x7f41e005c890 2021-06-25T04:56:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41df59e700 1 -- 172.21.15.57:0/2577565153 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e00b5fd0 con 0x7f41e005c890 2021-06-25T04:56:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.495+0000 7f41df59e700 1 -- 172.21.15.57:0/2577565153 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e0057310 con 0x7f41e005c890 2021-06-25T04:56:45.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.499+0000 7f41d77fe700 1 -- 172.21.15.57:0/2577565153 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f41d0010070 con 0x7f41e005c890 2021-06-25T04:56:45.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.499+0000 7f41d77fe700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c4055490 0x7f41c4057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:45.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.499+0000 7f41d77fe700 1 -- 172.21.15.57:0/2577565153 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f41d006d620 con 0x7f41e005c890 2021-06-25T04:56:45.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.499+0000 7f41de59c700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c4055490 0x7f41c4057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:45.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.499+0000 7f41de59c700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c4055490 0x7f41c4057950 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f41c800b000 tx=0x7f41c8006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:45.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.503+0000 7f41d77fe700 1 -- 172.21.15.57:0/2577565153 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f41d0043930 con 0x7f41e005c890 2021-06-25T04:56:45.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:45.631+0000 7f41df59e700 1 -- 172.21.15.57:0/2577565153 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f41e00698a0 con 0x7f41e005c890 2021-06-25T04:56:46.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.371+0000 7f41d77fe700 1 -- 172.21.15.57:0/2577565153 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v142) v1 ==== 173+0+0 (secure 0 0 0) 0x7f41d0046f50 con 0x7f41e005c890 2021-06-25T04:56:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 -- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c4055490 msgr2=0x7f41c4057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c4055490 0x7f41c4057950 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f41c800b000 tx=0x7f41c8006df0).stop 2021-06-25T04:56:46.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 -- 172.21.15.57:0/2577565153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e005c890 msgr2=0x7f41e00ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:46.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e005c890 0x7f41e00ad410 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f41e00afca0 tx=0x7f41d0007a30).stop 2021-06-25T04:56:46.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 -- 172.21.15.57:0/2577565153 shutdown_connections 2021-06-25T04:56:46.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c4055490 0x7f41c4057950 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:46.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41e00b6d40 0x7f41e00affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:46.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e005c890 0x7f41e00ad410 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:46.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 --2- 172.21.15.57:0/2577565153 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41e005c040 0x7f41e00b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:46.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 -- 172.21.15.57:0/2577565153 >> 172.21.15.57:0/2577565153 conn(0x7f41e0066da0 msgr2=0x7f41e00b9780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:46.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 -- 172.21.15.57:0/2577565153 shutdown_connections 2021-06-25T04:56:46.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.375+0000 7f41df59e700 1 -- 172.21.15.57:0/2577565153 wait complete. 2021-06-25T04:56:46.384 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:56:46.397 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:56:46.400 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:56:46.403 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:56:46.405 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-06-25T04:56:46.430 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2021-06-25T04:56:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2021-06-25T04:56:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:56:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2021-06-25T04:56:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2021-06-25T04:56:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2021-06-25T04:56:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2021-06-25T04:56:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2021-06-25T04:56:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2021-06-25T04:56:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2021-06-25T04:56:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:56:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2021-06-25T04:56:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:56:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:56:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2021-06-25T04:56:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2021-06-25T04:56:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2021-06-25T04:56:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:56:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:56:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2021-06-25T04:56:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:56:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2021-06-25T04:56:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:56:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:56:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:56:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2021-06-25T04:56:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2021-06-25T04:56:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2021-06-25T04:56:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2021-06-25T04:56:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2021-06-25T04:56:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:56:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:56:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.445 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2021-06-25T04:56:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2021-06-25T04:56:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2021-06-25T04:56:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2021-06-25T04:56:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2021-06-25T04:56:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2021-06-25T04:56:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2021-06-25T04:56:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2021-06-25T04:56:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2021-06-25T04:56:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2021-06-25T04:56:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2021-06-25T04:56:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:56:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2021-06-25T04:56:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2021-06-25T04:56:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:56:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2021-06-25T04:56:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2021-06-25T04:56:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2021-06-25T04:56:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2021-06-25T04:56:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore compression mode = aggressive 2021-06-25T04:56:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2021-06-25T04:56:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 20 2021-06-25T04:56:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 20 2021-06-25T04:56:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:56:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2021-06-25T04:56:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 10 2021-06-25T04:56:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:56:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2021-06-25T04:56:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:56:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:56:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2021-06-25T04:56:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2021-06-25T04:56:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.457 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2021-06-25T04:56:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:56:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2021-06-25T04:56:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2021-06-25T04:56:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2021-06-25T04:56:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2021-06-25T04:56:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.459 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2021-06-25T04:56:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:56:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2021-06-25T04:56:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2021-06-25T04:56:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2021-06-25T04:56:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2021-06-25T04:56:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2021-06-25T04:56:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2021-06-25T04:56:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2021-06-25T04:56:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:56:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:56:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:56:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:56:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:56:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:56:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2021-06-25T04:56:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:46.465 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2021-06-25T04:56:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2021-06-25T04:56:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2021-06-25T04:56:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2021-06-25T04:56:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:56:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:56:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2021-06-25T04:56:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2021-06-25T04:56:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:56:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 15m 2021-06-25T04:56:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 15m 2021-06-25T04:56:46.470 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2021-06-25T04:56:46.471 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2021-06-25T04:56:46.471 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2021-06-25T04:56:46.471 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2021-06-25T04:56:46.471 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2021-06-25T04:56:46.472 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2021-06-25T04:56:46.472 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2021-06-25T04:56:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2021-06-25T04:56:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2021-06-25T04:56:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal frag = True 2021-06-25T04:56:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal fragment size max = 10000 2021-06-25T04:56:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal merge size = 5 2021-06-25T04:56:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal split bits = 3 2021-06-25T04:56:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: mds bal split size = 100 2021-06-25T04:56:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2021-06-25T04:56:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2021-06-25T04:56:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2021-06-25T04:56:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2021-06-25T04:56:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2021-06-25T04:56:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 15m 2021-06-25T04:56:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 15m 2021-06-25T04:56:46.483 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2021-06-25T04:56:46.483 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2021-06-25T04:56:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:56:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2021-06-25T04:56:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.484 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2021-06-25T04:56:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2021-06-25T04:56:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.485 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2021-06-25T04:56:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2021-06-25T04:56:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2021-06-25T04:56:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2021-06-25T04:56:46.486 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:56:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2021-06-25T04:56:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.487 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:56:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:56:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2021-06-25T04:56:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.488 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2021-06-25T04:56:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2021-06-25T04:56:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:56:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:56:46.489 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2021-06-25T04:56:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:56:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2021-06-25T04:56:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:56:46.490 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:56:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:56:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2021-06-25T04:56:46.491 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2021-06-25T04:56:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2021-06-25T04:56:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2021-06-25T04:56:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2021-06-25T04:56:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:56:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:56:46.493 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.493 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2021-06-25T04:56:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2021-06-25T04:56:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2021-06-25T04:56:46.494 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2021-06-25T04:56:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2021-06-25T04:56:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2021-06-25T04:56:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.495 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2021-06-25T04:56:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2021-06-25T04:56:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2021-06-25T04:56:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.496 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2021-06-25T04:56:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2021-06-25T04:56:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:56:46.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2021-06-25T04:56:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2021-06-25T04:56:46.498 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:56:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2021-06-25T04:56:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.499 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2021-06-25T04:56:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2021-06-25T04:56:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2021-06-25T04:56:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore compression mode = aggressive 2021-06-25T04:56:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2021-06-25T04:56:46.500 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2021-06-25T04:56:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2021-06-25T04:56:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:56:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2021-06-25T04:56:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2021-06-25T04:56:46.501 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:56:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2021-06-25T04:56:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:56:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:56:46.502 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2021-06-25T04:56:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-06-25T04:56:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.503 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2021-06-25T04:56:46.503 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:56:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2021-06-25T04:56:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-06-25T04:56:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-06-25T04:56:46.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:46.505 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2021-06-25T04:56:46.506 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.507 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2021-06-25T04:56:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:56:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2021-06-25T04:56:46.508 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2021-06-25T04:56:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2021-06-25T04:56:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2021-06-25T04:56:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2021-06-25T04:56:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:46.509 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2021-06-25T04:56:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2021-06-25T04:56:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.510 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:56:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:56:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:56:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.511 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:56:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:56:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:56:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2021-06-25T04:56:46.512 INFO:teuthology.orchestra.run.smithi102.stdout: 2021-06-25T04:56:46.513 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2021-06-25T04:56:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2021-06-25T04:56:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2021-06-25T04:56:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2021-06-25T04:56:46.513 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:56:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:56:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2021-06-25T04:56:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2021-06-25T04:56:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:56:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-06-25T04:56:46.515 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-06-25T04:56:46.515 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2021-06-25T04:56:46.515 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2021-06-25T04:56:46.516 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2021-06-25T04:56:46.516 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2021-06-25T04:56:46.516 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2021-06-25T04:56:46.517 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2021-06-25T04:56:46.517 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2021-06-25T04:56:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2021-06-25T04:56:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2021-06-25T04:56:46.517 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal frag = True 2021-06-25T04:56:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal fragment size max = 10000 2021-06-25T04:56:46.518 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal merge size = 5 2021-06-25T04:56:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split bits = 3 2021-06-25T04:56:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: mds bal split size = 100 2021-06-25T04:56:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2021-06-25T04:56:46.519 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2021-06-25T04:56:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2021-06-25T04:56:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2021-06-25T04:56:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2021-06-25T04:56:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 15m 2021-06-25T04:56:46.520 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 15m 2021-06-25T04:56:46.521 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2021-06-25T04:56:46.521 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2021-06-25T04:56:46.521 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:56:46.521 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2021-06-25T04:56:46.522 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.522 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2021-06-25T04:56:46.522 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.522 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2021-06-25T04:56:46.523 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.523 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2021-06-25T04:56:46.523 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2021-06-25T04:56:46.523 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.523 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2021-06-25T04:56:46.524 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2021-06-25T04:56:46.524 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.524 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:56:46.524 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2021-06-25T04:56:46.524 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.525 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:56:46.525 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:56:46.525 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.525 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2021-06-25T04:56:46.526 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.526 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2021-06-25T04:56:46.526 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2021-06-25T04:56:46.526 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:56:46.526 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:56:46.527 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2021-06-25T04:56:46.527 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:56:46.527 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2021-06-25T04:56:46.527 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:56:46.528 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:56:46.528 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.529 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:56:46.529 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.529 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2021-06-25T04:56:46.530 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.530 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2021-06-25T04:56:46.530 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.530 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2021-06-25T04:56:46.531 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2021-06-25T04:56:46.531 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2021-06-25T04:56:46.531 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:56:46.532 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:56:46.532 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.532 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2021-06-25T04:56:46.532 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2021-06-25T04:56:46.533 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.533 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2021-06-25T04:56:46.533 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2021-06-25T04:56:46.533 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.534 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2021-06-25T04:56:46.534 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2021-06-25T04:56:46.534 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.534 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2021-06-25T04:56:46.534 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2021-06-25T04:56:46.535 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2021-06-25T04:56:46.535 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.535 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2021-06-25T04:56:46.536 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2021-06-25T04:56:46.536 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.536 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:56:46.537 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.537 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2021-06-25T04:56:46.537 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.547 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2021-06-25T04:56:46.548 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.548 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:56:46.548 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2021-06-25T04:56:46.549 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.549 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2021-06-25T04:56:46.549 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2021-06-25T04:56:46.549 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2021-06-25T04:56:46.550 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore compression mode = aggressive 2021-06-25T04:56:46.550 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2021-06-25T04:56:46.550 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 20 2021-06-25T04:56:46.550 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 20 2021-06-25T04:56:46.551 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:56:46.551 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2021-06-25T04:56:46.551 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 10 2021-06-25T04:56:46.551 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:56:46.552 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2021-06-25T04:56:46.552 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:56:46.553 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:56:46.553 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2021-06-25T04:56:46.553 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2021-06-25T04:56:46.554 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.554 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2021-06-25T04:56:46.554 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:56:46.554 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2021-06-25T04:56:46.555 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2021-06-25T04:56:46.555 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2021-06-25T04:56:46.555 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:46.555 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:46.556 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2021-06-25T04:56:46.556 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.556 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2021-06-25T04:56:46.556 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:56:46.556 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2021-06-25T04:56:46.557 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2021-06-25T04:56:46.557 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2021-06-25T04:56:46.557 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2021-06-25T04:56:46.557 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2021-06-25T04:56:46.558 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:46.558 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2021-06-25T04:56:46.558 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2021-06-25T04:56:46.558 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:46.559 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.560 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:56:46.560 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:56:46.561 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:56:46.561 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.561 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:56:46.562 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:56:46.562 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:56:46.562 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2021-06-25T04:56:46.563 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-06-25T04:56:46.563 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2021-06-25T04:56:46.563 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2021-06-25T04:56:46.563 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2021-06-25T04:56:46.563 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2021-06-25T04:56:46.564 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:56:46.564 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:56:46.564 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2021-06-25T04:56:46.565 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2021-06-25T04:56:46.565 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:56:46.565 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 15m 2021-06-25T04:56:46.566 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 15m 2021-06-25T04:56:46.566 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2021-06-25T04:56:46.566 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2021-06-25T04:56:46.566 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2021-06-25T04:56:46.567 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2021-06-25T04:56:46.567 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2021-06-25T04:56:46.567 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2021-06-25T04:56:46.567 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2021-06-25T04:56:46.568 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2021-06-25T04:56:46.568 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-06-25T04:56:46.568 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal frag = True 2021-06-25T04:56:46.568 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal fragment size max = 10000 2021-06-25T04:56:46.569 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal merge size = 5 2021-06-25T04:56:46.569 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal split bits = 3 2021-06-25T04:56:46.569 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal split size = 100 2021-06-25T04:56:46.569 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2021-06-25T04:56:46.569 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2021-06-25T04:56:46.570 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2021-06-25T04:56:46.570 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2021-06-25T04:56:46.570 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2021-06-25T04:56:46.570 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 15m 2021-06-25T04:56:46.571 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 15m 2021-06-25T04:56:46.571 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2021-06-25T04:56:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2021-06-25T04:56:46.571 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-06-25T04:56:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2021-06-25T04:56:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2021-06-25T04:56:46.572 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2021-06-25T04:56:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2021-06-25T04:56:46.573 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2021-06-25T04:56:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2021-06-25T04:56:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2021-06-25T04:56:46.574 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2021-06-25T04:56:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2021-06-25T04:56:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2021-06-25T04:56:46.575 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2021-06-25T04:56:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2021-06-25T04:56:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.576 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2021-06-25T04:56:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2021-06-25T04:56:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2021-06-25T04:56:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2021-06-25T04:56:46.577 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2021-06-25T04:56:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2021-06-25T04:56:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2021-06-25T04:56:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-06-25T04:56:46.578 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2021-06-25T04:56:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-06-25T04:56:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.579 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2021-06-25T04:56:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2021-06-25T04:56:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2021-06-25T04:56:46.580 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2021-06-25T04:56:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2021-06-25T04:56:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.57,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2021-06-25T04:56:46.581 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = d067c0ce-62d7-4088-9fe1-bc0002e5c6e5 2021-06-25T04:56:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.582 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2021-06-25T04:56:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2021-06-25T04:56:46.582 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2021-06-25T04:56:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2021-06-25T04:56:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2021-06-25T04:56:46.583 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2021-06-25T04:56:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2021-06-25T04:56:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2021-06-25T04:56:46.584 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2021-06-25T04:56:46.585 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2021-06-25T04:56:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2021-06-25T04:56:46.586 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2021-06-25T04:56:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.587 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2021-06-25T04:56:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.588 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2021-06-25T04:56:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.589 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2021-06-25T04:56:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2021-06-25T04:56:46.590 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2021-06-25T04:56:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2021-06-25T04:56:46.591 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2021-06-25T04:56:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore compression mode = aggressive 2021-06-25T04:56:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2021-06-25T04:56:46.592 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 20 2021-06-25T04:56:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 20 2021-06-25T04:56:46.593 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:56:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2021-06-25T04:56:46.594 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 10 2021-06-25T04:56:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2021-06-25T04:56:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2021-06-25T04:56:46.595 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2021-06-25T04:56:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2021-06-25T04:56:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2021-06-25T04:56:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2021-06-25T04:56:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.597 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2021-06-25T04:56:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:56:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2021-06-25T04:56:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2021-06-25T04:56:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2021-06-25T04:56:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2021-06-25T04:56:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.600 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2021-06-25T04:56:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:56:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2021-06-25T04:56:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2021-06-25T04:56:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2021-06-25T04:56:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2021-06-25T04:56:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2021-06-25T04:56:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2021-06-25T04:56:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2021-06-25T04:56:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2021-06-25T04:56:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2021-06-25T04:56:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-06-25T04:56:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2021-06-25T04:56:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2021-06-25T04:56:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2021-06-25T04:56:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-06-25T04:56:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-06-25T04:56:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2021-06-25T04:56:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-06-25T04:56:46.607 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2021-06-25T04:56:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2021-06-25T04:56:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2021-06-25T04:56:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2021-06-25T04:56:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-06-25T04:56:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-06-25T04:56:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2021-06-25T04:56:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2021-06-25T04:56:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:56:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 15m 2021-06-25T04:56:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 15m 2021-06-25T04:56:46.610 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2021-06-25T04:56:46.611 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2021-06-25T04:56:46.611 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2021-06-25T04:56:46.611 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2021-06-25T04:56:46.611 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2021-06-25T04:56:46.612 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2021-06-25T04:56:46.612 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2021-06-25T04:56:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2021-06-25T04:56:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-06-25T04:56:46.612 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal frag = True 2021-06-25T04:56:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal fragment size max = 10000 2021-06-25T04:56:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal merge size = 5 2021-06-25T04:56:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split bits = 3 2021-06-25T04:56:46.613 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split size = 100 2021-06-25T04:56:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2021-06-25T04:56:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2021-06-25T04:56:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2021-06-25T04:56:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2021-06-25T04:56:46.614 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2021-06-25T04:56:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 15m 2021-06-25T04:56:46.615 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 15m 2021-06-25T04:56:46.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-06-25T04:56:46.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.727+0000 7f7a63c67700 1 Processor -- start 2021-06-25T04:56:46.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.727+0000 7f7a63c67700 1 -- start start 2021-06-25T04:56:46.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a63c67700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7a5c0b4140 0x7f7a5c140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:46.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a63c67700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c143b20 con 0x7f7a5c146910 2021-06-25T04:56:46.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a63c67700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c143dc0 con 0x7f7a5c0b4650 2021-06-25T04:56:46.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a63c67700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c1474d0 con 0x7f7a5c0b4140 2021-06-25T04:56:46.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a61a03700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7a5c146910 0x7f7a5c1401f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60876/0 (socket says 172.21.15.57:60876) 2021-06-25T04:56:46.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a61a03700 1 -- 172.21.15.57:0/3582023787 learned_addr learned my addr 172.21.15.57:0/3582023787 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:46.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a61202700 1 --2- 172.21.15.57:0/3582023787 >> v2:172.21.15.87:3300/0 conn(0x7f7a5c0b4140 0x7f7a5c140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:46.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a60a01700 1 -- 172.21.15.57:0/3582023787 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74595061 0 0) 0x7f7a5c143b20 con 0x7f7a5c146910 2021-06-25T04:56:46.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a60a01700 1 -- 172.21.15.57:0/3582023787 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a44003260 con 0x7f7a5c146910 2021-06-25T04:56:46.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a60a01700 1 -- 172.21.15.57:0/3582023787 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122700992 0 0) 0x7f7a5c143dc0 con 0x7f7a5c0b4650 2021-06-25T04:56:46.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a61202700 1 -- 172.21.15.57:0/3582023787 >> v1:172.21.15.87:6789/0 conn(0x7f7a5c0b4650 legacy=0x7f7a5c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:46.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a61202700 1 -- 172.21.15.57:0/3582023787 >> v1:172.21.15.57:6789/0 conn(0x7f7a5c146910 legacy=0x7f7a5c1401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:46.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a61202700 1 -- 172.21.15.57:0/3582023787 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0b0c50 con 0x7f7a5c0b4140 2021-06-25T04:56:46.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a61202700 1 --2- 172.21.15.57:0/3582023787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c0b4140 0x7f7a5c140900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f7a58002f70 tx=0x7f7a58006df0).ready entity=mon.1 client_cookie=2ba26583b6e45291 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:46.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a60a01700 1 -- 172.21.15.57:0/3582023787 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a5800d610 con 0x7f7a5c0b4140 2021-06-25T04:56:46.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a60a01700 1 -- 172.21.15.57:0/3582023787 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a58000e90 con 0x7f7a5c0b4140 2021-06-25T04:56:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a60a01700 1 -- 172.21.15.57:0/3582023787 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a5800d960 con 0x7f7a5c0b4140 2021-06-25T04:56:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a63c67700 1 -- 172.21.15.57:0/3582023787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c0b4140 msgr2=0x7f7a5c140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a63c67700 1 --2- 172.21.15.57:0/3582023787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c0b4140 0x7f7a5c140900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f7a58002f70 tx=0x7f7a58006df0).stop 2021-06-25T04:56:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a63c67700 1 -- 172.21.15.57:0/3582023787 shutdown_connections 2021-06-25T04:56:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a63c67700 1 --2- 172.21.15.57:0/3582023787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c0b4140 0x7f7a5c140900 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a63c67700 1 -- 172.21.15.57:0/3582023787 >> 172.21.15.57:0/3582023787 conn(0x7f7a5c05c450 msgr2=0x7f7a5c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a63c67700 1 -- 172.21.15.57:0/3582023787 shutdown_connections 2021-06-25T04:56:46.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.731+0000 7f7a63c67700 1 -- 172.21.15.57:0/3582023787 wait complete. 2021-06-25T04:56:46.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a63c67700 1 Processor -- start 2021-06-25T04:56:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a63c67700 1 -- start start 2021-06-25T04:56:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a63c67700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a5c0b4140 0x7f7a5c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:46.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a63c67700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c0b4650 0x7f7a5c0b9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:46.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a63c67700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a5c146910 0x7f7a5c155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:46.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a63c67700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c156400 con 0x7f7a5c146910 2021-06-25T04:56:46.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a63c67700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0b76b0 con 0x7f7a5c0b4650 2021-06-25T04:56:46.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a63c67700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0b7950 con 0x7f7a5c0b4140 2021-06-25T04:56:46.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a62204700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a5c146910 0x7f7a5c155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:46.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a61a03700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a5c0b4140 0x7f7a5c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:46.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a62204700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a5c146910 0x7f7a5c155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43668/0 (socket says 172.21.15.57:43668) 2021-06-25T04:56:46.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a61a03700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a5c0b4140 0x7f7a5c0b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:54828/0 (socket says 172.21.15.57:54828) 2021-06-25T04:56:46.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a61202700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c0b4650 0x7f7a5c0b9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:46.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.735+0000 7f7a62204700 1 -- 172.21.15.57:0/2475567924 learned_addr learned my addr 172.21.15.57:0/2475567924 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:46.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a61202700 1 -- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a5c0b4140 msgr2=0x7f7a5c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:46.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a61202700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a5c0b4140 0x7f7a5c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:46.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a61202700 1 -- 172.21.15.57:0/2475567924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a5c146910 msgr2=0x7f7a5c155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:46.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a61202700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a5c146910 0x7f7a5c155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:46.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a61202700 1 -- 172.21.15.57:0/2475567924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5800b180 con 0x7f7a5c0b4650 2021-06-25T04:56:46.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a61a03700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a5c0b4140 0x7f7a5c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:46.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a62204700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a5c146910 0x7f7a5c155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:46.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a61202700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c0b4650 0x7f7a5c0b9750 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f7a58002f70 tx=0x7f7a58014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:46.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a4effd700 1 -- 172.21.15.57:0/2475567924 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a58012d10 con 0x7f7a5c0b4650 2021-06-25T04:56:46.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a4effd700 1 -- 172.21.15.57:0/2475567924 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5800d290 con 0x7f7a5c0b4650 2021-06-25T04:56:46.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a4effd700 1 -- 172.21.15.57:0/2475567924 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a5801e620 con 0x7f7a5c0b4650 2021-06-25T04:56:46.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a63c67700 1 -- 172.21.15.57:0/2475567924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c0b85b0 con 0x7f7a5c0b4650 2021-06-25T04:56:46.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a63c67700 1 -- 172.21.15.57:0/2475567924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c0b9e60 con 0x7f7a5c0b4650 2021-06-25T04:56:46.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a63c67700 1 -- 172.21.15.57:0/2475567924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c057310 con 0x7f7a5c0b4650 2021-06-25T04:56:46.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.739+0000 7f7a4effd700 1 -- 172.21.15.57:0/2475567924 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7a58024020 con 0x7f7a5c0b4650 2021-06-25T04:56:46.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.743+0000 7f7a4effd700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a3c0554e0 0x7f7a3c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:46.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.743+0000 7f7a4effd700 1 -- 172.21.15.57:0/2475567924 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f7a5806ed50 con 0x7f7a5c0b4650 2021-06-25T04:56:46.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.743+0000 7f7a61a03700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a3c0554e0 0x7f7a3c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:46.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.743+0000 7f7a61a03700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a3c0554e0 0x7f7a3c0579a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f7a5000d000 tx=0x7f7a50009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:46.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.751+0000 7f7a4effd700 1 -- 172.21.15.57:0/2475567924 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7a580450d0 con 0x7f7a5c0b4650 2021-06-25T04:56:46.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.879+0000 7f7a63c67700 1 -- 172.21.15.57:0/2475567924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7a5c0698a0 con 0x7f7a5c0b4650 2021-06-25T04:56:46.896 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.891+0000 7f7a4effd700 1 -- 172.21.15.57:0/2475567924 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7a58006980 con 0x7f7a5c0b4650 2021-06-25T04:56:46.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 -- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a3c0554e0 msgr2=0x7f7a3c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:46.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a3c0554e0 0x7f7a3c0579a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f7a5000d000 tx=0x7f7a50009040).stop 2021-06-25T04:56:46.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 -- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c0b4650 msgr2=0x7f7a5c0b9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:46.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c0b4650 0x7f7a5c0b9750 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f7a58002f70 tx=0x7f7a58014000).stop 2021-06-25T04:56:46.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 -- 172.21.15.57:0/2475567924 shutdown_connections 2021-06-25T04:56:46.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7a3c0554e0 0x7f7a3c0579a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:46.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a5c146910 0x7f7a5c155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:46.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c0b4650 0x7f7a5c0b9750 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:46.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 --2- 172.21.15.57:0/2475567924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a5c0b4140 0x7f7a5c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:46.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 -- 172.21.15.57:0/2475567924 >> 172.21.15.57:0/2475567924 conn(0x7f7a5c05c450 msgr2=0x7f7a5c141950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:46.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 -- 172.21.15.57:0/2475567924 shutdown_connections 2021-06-25T04:56:46.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:46.895+0000 7f7a63c67700 1 -- 172.21.15.57:0/2475567924 wait complete. 2021-06-25T04:56:46.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-06-25T04:56:47.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a168ae700 1 Processor -- start 2021-06-25T04:56:47.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a168ae700 1 -- start start 2021-06-25T04:56:47.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a168ae700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a10148360 0x7f8a100b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a168ae700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a100a7080 0x7f8a101446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a168ae700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a100b0310 con 0x7f8a100b1d70 2021-06-25T04:56:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a168ae700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a100a9080 con 0x7f8a100a7080 2021-06-25T04:56:47.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a168ae700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100b05b0 con 0x7f8a10148360 2021-06-25T04:56:47.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0f7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a10148360 0x7f8a100b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a14e4b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a100a7080 0x7f8a101446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0f7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a10148360 0x7f8a100b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:54838/0 (socket says 172.21.15.57:54838) 2021-06-25T04:56:47.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0f7fe700 1 -- 172.21.15.57:0/2863226066 learned_addr learned my addr 172.21.15.57:0/2863226066 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:47.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a14e4b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a100a7080 0x7f8a101446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:52170/0 (socket says 172.21.15.57:52170) 2021-06-25T04:56:47.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0ffff700 1 --1- 172.21.15.57:0/2863226066 >> v1:172.21.15.87:6789/0 conn(0x7f8a100b1d70 0x7f8a100b2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:33406/0 (socket says 172.21.15.57:33406) 2021-06-25T04:56:47.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0f7fe700 1 -- 172.21.15.57:0/2863226066 >> v2:172.21.15.87:3300/0 conn(0x7f8a100a7080 msgr2=0x7f8a101446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:47.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0f7fe700 1 --2- 172.21.15.57:0/2863226066 >> v2:172.21.15.87:3300/0 conn(0x7f8a100a7080 0x7f8a101446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0f7fe700 1 -- 172.21.15.57:0/2863226066 >> v1:172.21.15.87:6789/0 conn(0x7f8a100b1d70 legacy=0x7f8a100b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:47.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0f7fe700 1 -- 172.21.15.57:0/2863226066 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a100b0850 con 0x7f8a10148360 2021-06-25T04:56:47.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0f7fe700 1 --2- 172.21.15.57:0/2863226066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a10148360 0x7f8a100b0f90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f8a00002f70 tx=0x7f8a00006eb0).ready entity=mon.2 client_cookie=ed5dc34298093e56 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:47.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0effd700 1 -- 172.21.15.57:0/2863226066 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0000d570 con 0x7f8a10148360 2021-06-25T04:56:47.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0effd700 1 -- 172.21.15.57:0/2863226066 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a00000e90 con 0x7f8a10148360 2021-06-25T04:56:47.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a0effd700 1 -- 172.21.15.57:0/2863226066 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0000d900 con 0x7f8a10148360 2021-06-25T04:56:47.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a168ae700 1 -- 172.21.15.57:0/2863226066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a10148360 msgr2=0x7f8a100b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:47.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.011+0000 7f8a168ae700 1 --2- 172.21.15.57:0/2863226066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a10148360 0x7f8a100b0f90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f8a00002f70 tx=0x7f8a00006eb0).stop 2021-06-25T04:56:47.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 -- 172.21.15.57:0/2863226066 shutdown_connections 2021-06-25T04:56:47.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 --2- 172.21.15.57:0/2863226066 >> v2:172.21.15.87:3300/0 conn(0x7f8a100a7080 0x7f8a101446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 --2- 172.21.15.57:0/2863226066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a10148360 0x7f8a100b0f90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 -- 172.21.15.57:0/2863226066 >> 172.21.15.57:0/2863226066 conn(0x7f8a1005f670 msgr2=0x7f8a1005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:47.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 -- 172.21.15.57:0/2863226066 shutdown_connections 2021-06-25T04:56:47.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 -- 172.21.15.57:0/2863226066 wait complete. 2021-06-25T04:56:47.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 Processor -- start 2021-06-25T04:56:47.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 -- start start 2021-06-25T04:56:47.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a100a7080 0x7f8a10145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a100b1d70 0x7f8a10141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a10148360 0x7f8a1015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100aa160 con 0x7f8a10148360 2021-06-25T04:56:47.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10145d80 con 0x7f8a100b1d70 2021-06-25T04:56:47.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a168ae700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1015ac00 con 0x7f8a100a7080 2021-06-25T04:56:47.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a14e4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a10148360 0x7f8a1015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a14e4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a10148360 0x7f8a1015a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43682/0 (socket says 172.21.15.57:43682) 2021-06-25T04:56:47.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a0ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a100a7080 0x7f8a10145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.036 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a14e4b700 1 -- 172.21.15.57:0/3973556660 learned_addr learned my addr 172.21.15.57:0/3973556660 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:47.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a0f7fe700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a100b1d70 0x7f8a10141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a14e4b700 1 -- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a100a7080 msgr2=0x7f8a10145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:47.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a14e4b700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a100a7080 0x7f8a10145fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.037 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a14e4b700 1 -- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a100b1d70 msgr2=0x7f8a10141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:47.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a14e4b700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a100b1d70 0x7f8a10141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a14e4b700 1 -- 172.21.15.57:0/3973556660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0000b1e0 con 0x7f8a10148360 2021-06-25T04:56:47.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a14e4b700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a10148360 0x7f8a1015a710 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f8a100a9cb0 tx=0x7f8a080091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:47.038 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a0d7fa700 1 -- 172.21.15.57:0/3973556660 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0800c640 con 0x7f8a10148360 2021-06-25T04:56:47.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.015+0000 7f8a0d7fa700 1 -- 172.21.15.57:0/3973556660 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0800c7a0 con 0x7f8a10148360 2021-06-25T04:56:47.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.019+0000 7f8a168ae700 1 -- 172.21.15.57:0/3973556660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1013e8d0 con 0x7f8a10148360 2021-06-25T04:56:47.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.019+0000 7f8a0d7fa700 1 -- 172.21.15.57:0/3973556660 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a0800cb00 con 0x7f8a10148360 2021-06-25T04:56:47.039 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.019+0000 7f8a168ae700 1 -- 172.21.15.57:0/3973556660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1013eb30 con 0x7f8a10148360 2021-06-25T04:56:47.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.019+0000 7f8a168ae700 1 -- 172.21.15.57:0/3973556660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a10057310 con 0x7f8a10148360 2021-06-25T04:56:47.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.019+0000 7f8a0d7fa700 1 -- 172.21.15.57:0/3973556660 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8a08022070 con 0x7f8a10148360 2021-06-25T04:56:47.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.019+0000 7f8a0d7fa700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89f0055450 0x7f89f0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.019+0000 7f8a0d7fa700 1 -- 172.21.15.57:0/3973556660 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f8a0806e1a0 con 0x7f8a10148360 2021-06-25T04:56:47.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.019+0000 7f8a0ffff700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89f0055450 0x7f89f0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.019+0000 7f8a0ffff700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89f0055450 0x7f89f0057910 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f8a0400d000 tx=0x7f8a04007b40).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:47.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.027+0000 7f8a0d7fa700 1 -- 172.21.15.57:0/3973556660 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8a08044630 con 0x7f8a10148360 2021-06-25T04:56:47.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.195+0000 7f8a168ae700 1 -- 172.21.15.57:0/3973556660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f8a10044610 con 0x7f8a10148360 2021-06-25T04:56:47.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.371+0000 7f8a0d7fa700 1 -- 172.21.15.57:0/3973556660 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v426) v1 ==== 128+0+0 (secure 0 0 0) 0x7f8a080160c0 con 0x7f8a10148360 2021-06-25T04:56:47.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 -- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89f0055450 msgr2=0x7f89f0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:47.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89f0055450 0x7f89f0057910 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f8a0400d000 tx=0x7f8a04007b40).stop 2021-06-25T04:56:47.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 -- 172.21.15.57:0/3973556660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a10148360 msgr2=0x7f8a1015a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a10148360 0x7f8a1015a710 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f8a100a9cb0 tx=0x7f8a080091d0).stop 2021-06-25T04:56:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 -- 172.21.15.57:0/3973556660 shutdown_connections 2021-06-25T04:56:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f89f0055450 0x7f89f0057910 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a10148360 0x7f8a1015a710 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a100b1d70 0x7f8a10141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 --2- 172.21.15.57:0/3973556660 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a100a7080 0x7f8a10145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 -- 172.21.15.57:0/3973556660 >> 172.21.15.57:0/3973556660 conn(0x7f8a1005f670 msgr2=0x7f8a100b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:47.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 -- 172.21.15.57:0/3973556660 shutdown_connections 2021-06-25T04:56:47.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.375+0000 7f8a168ae700 1 -- 172.21.15.57:0/3973556660 wait complete. 2021-06-25T04:56:47.394 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2021-06-25T04:56:47.395 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2021-06-25T04:56:47.395 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-06-25T04:56:47.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f5117eae700 1 Processor -- start 2021-06-25T04:56:47.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f5117eae700 1 -- start start 2021-06-25T04:56:47.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f5117eae700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5110139c80 0x7f51100acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f5117eae700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f51100b2180 0x7f51101434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f5117eae700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51100ad030 con 0x7f511013a060 2021-06-25T04:56:47.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f5117eae700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100b26f0 con 0x7f51100b2180 2021-06-25T04:56:47.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f5117eae700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5110060d00 con 0x7f5110139c80 2021-06-25T04:56:47.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f5115449700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f51100b2180 0x7f51101434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f5115c4a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5110139c80 0x7f51100acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f5115c4a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5110139c80 0x7f51100acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:54850/0 (socket says 172.21.15.57:54850) 2021-06-25T04:56:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f5115c4a700 1 -- 172.21.15.57:0/1501365096 learned_addr learned my addr 172.21.15.57:0/1501365096 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:47.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.495+0000 7f511644b700 1 --1- 172.21.15.57:0/1501365096 >> v1:172.21.15.87:6789/0 conn(0x7f511013a060 0x7f51100b6580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:33424/0 (socket says 172.21.15.57:33424) 2021-06-25T04:56:47.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5115c4a700 1 -- 172.21.15.57:0/1501365096 >> v2:172.21.15.87:3300/0 conn(0x7f51100b2180 msgr2=0x7f51101434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:47.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5115c4a700 1 --2- 172.21.15.57:0/1501365096 >> v2:172.21.15.87:3300/0 conn(0x7f51100b2180 0x7f51101434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5115c4a700 1 -- 172.21.15.57:0/1501365096 >> v1:172.21.15.87:6789/0 conn(0x7f511013a060 legacy=0x7f51100b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:47.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5115c4a700 1 -- 172.21.15.57:0/1501365096 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100b6c90 con 0x7f5110139c80 2021-06-25T04:56:47.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5115c4a700 1 --2- 172.21.15.57:0/1501365096 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5110139c80 0x7f51100acb40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f510c002f70 tx=0x7f510c006eb0).ready entity=mon.2 client_cookie=7a8fa4df6ee5cd11 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:47.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5114c48700 1 -- 172.21.15.57:0/1501365096 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510c00f970 con 0x7f5110139c80 2021-06-25T04:56:47.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5114c48700 1 -- 172.21.15.57:0/1501365096 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c000e90 con 0x7f5110139c80 2021-06-25T04:56:47.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5114c48700 1 -- 172.21.15.57:0/1501365096 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510c00fd00 con 0x7f5110139c80 2021-06-25T04:56:47.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5117eae700 1 -- 172.21.15.57:0/1501365096 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5110139c80 msgr2=0x7f51100acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:47.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5117eae700 1 --2- 172.21.15.57:0/1501365096 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5110139c80 0x7f51100acb40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f510c002f70 tx=0x7f510c006eb0).stop 2021-06-25T04:56:47.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5117eae700 1 -- 172.21.15.57:0/1501365096 shutdown_connections 2021-06-25T04:56:47.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5117eae700 1 --2- 172.21.15.57:0/1501365096 >> v2:172.21.15.87:3300/0 conn(0x7f51100b2180 0x7f51101434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5117eae700 1 --2- 172.21.15.57:0/1501365096 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5110139c80 0x7f51100acb40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5117eae700 1 -- 172.21.15.57:0/1501365096 >> 172.21.15.57:0/1501365096 conn(0x7f51100b3440 msgr2=0x7f51100b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:47.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5117eae700 1 -- 172.21.15.57:0/1501365096 shutdown_connections 2021-06-25T04:56:47.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5117eae700 1 -- 172.21.15.57:0/1501365096 wait complete. 2021-06-25T04:56:47.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.499+0000 7f5117eae700 1 Processor -- start 2021-06-25T04:56:47.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5117eae700 1 -- start start 2021-06-25T04:56:47.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5117eae700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51100b2180 0x7f511013a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5117eae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5110139c80 0x7f511014df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5117eae700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511013a060 0x7f511014e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5117eae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5110064d50 con 0x7f5110139c80 2021-06-25T04:56:47.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5117eae700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5110065d40 con 0x7f51100b2180 2021-06-25T04:56:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5117eae700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5110063620 con 0x7f511013a060 2021-06-25T04:56:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5115449700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5110139c80 0x7f511014df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5115449700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5110139c80 0x7f511014df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43694/0 (socket says 172.21.15.57:43694) 2021-06-25T04:56:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5115449700 1 -- 172.21.15.57:0/743829948 learned_addr learned my addr 172.21.15.57:0/743829948 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:47.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5115c4a700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51100b2180 0x7f511013a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f511644b700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511013a060 0x7f511014e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5115449700 1 -- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511013a060 msgr2=0x7f511014e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:47.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5115449700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511013a060 0x7f511014e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5115449700 1 -- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51100b2180 msgr2=0x7f511013a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:47.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5115449700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51100b2180 0x7f511013a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:47.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5115449700 1 -- 172.21.15.57:0/743829948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c00b1e0 con 0x7f5110139c80 2021-06-25T04:56:47.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5115449700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5110139c80 0x7f511014df50 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f51100649d0 tx=0x7f5100006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:47.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f50feffd700 1 -- 172.21.15.57:0/743829948 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5100010780 con 0x7f5110139c80 2021-06-25T04:56:47.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f50feffd700 1 -- 172.21.15.57:0/743829948 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51000108e0 con 0x7f5110139c80 2021-06-25T04:56:47.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5117eae700 1 -- 172.21.15.57:0/743829948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5110064ab0 con 0x7f5110139c80 2021-06-25T04:56:47.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f50feffd700 1 -- 172.21.15.57:0/743829948 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5100010c40 con 0x7f5110139c80 2021-06-25T04:56:47.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.503+0000 7f5117eae700 1 -- 172.21.15.57:0/743829948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5110065a60 con 0x7f5110139c80 2021-06-25T04:56:47.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.507+0000 7f50feffd700 1 -- 172.21.15.57:0/743829948 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f510001c460 con 0x7f5110139c80 2021-06-25T04:56:47.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.507+0000 7f5117eae700 1 -- 172.21.15.57:0/743829948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5110057310 con 0x7f5110139c80 2021-06-25T04:56:47.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.507+0000 7f50feffd700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50f00553f0 0x7f50f00578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:47.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.507+0000 7f50feffd700 1 -- 172.21.15.57:0/743829948 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f510006dfd0 con 0x7f5110139c80 2021-06-25T04:56:47.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.507+0000 7f5115c4a700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50f00553f0 0x7f50f00578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:47.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.507+0000 7f5115c4a700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50f00553f0 0x7f50f00578b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f510c01d000 tx=0x7f510c017000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:47.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.515+0000 7f50feffd700 1 -- 172.21.15.57:0/743829948 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5100044360 con 0x7f5110139c80 2021-06-25T04:56:47.691 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:47.687+0000 7f5117eae700 1 -- 172.21.15.57:0/743829948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f5110044610 con 0x7f5110139c80 2021-06-25T04:56:48.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.375+0000 7f50feffd700 1 -- 172.21.15.57:0/743829948 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v427) v1 ==== 130+0+0 (secure 0 0 0) 0x7f5100047980 con 0x7f5110139c80 2021-06-25T04:56:48.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 -- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50f00553f0 msgr2=0x7f50f00578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50f00553f0 0x7f50f00578b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f510c01d000 tx=0x7f510c017000).stop 2021-06-25T04:56:48.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 -- 172.21.15.57:0/743829948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5110139c80 msgr2=0x7f511014df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5110139c80 0x7f511014df50 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f51100649d0 tx=0x7f5100006df0).stop 2021-06-25T04:56:48.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 -- 172.21.15.57:0/743829948 shutdown_connections 2021-06-25T04:56:48.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f50f00553f0 0x7f50f00578b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f511013a060 0x7f511014e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5110139c80 0x7f511014df50 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 --2- 172.21.15.57:0/743829948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51100b2180 0x7f511013a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 -- 172.21.15.57:0/743829948 >> 172.21.15.57:0/743829948 conn(0x7f51100b3440 msgr2=0x7f5110144de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 -- 172.21.15.57:0/743829948 shutdown_connections 2021-06-25T04:56:48.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.379+0000 7f5117eae700 1 -- 172.21.15.57:0/743829948 wait complete. 2021-06-25T04:56:48.401 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:56:48.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb436545700 1 Processor -- start 2021-06-25T04:56:48.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb436545700 1 -- start start 2021-06-25T04:56:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb436545700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4300af740 0x7fb4300b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb436545700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4300b4380 0x7fb43013e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb436545700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4300b3fb0 con 0x7fb4300b0750 2021-06-25T04:56:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb436545700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43013ece0 con 0x7fb4300af740 2021-06-25T04:56:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb436545700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43005ca10 con 0x7fb4300b4380 2021-06-25T04:56:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb42ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4300af740 0x7fb4300b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb42ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4300af740 0x7fb4300b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43702/0 (socket says 172.21.15.57:43702) 2021-06-25T04:56:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb42ffff700 1 -- 172.21.15.57:0/3421156205 learned_addr learned my addr 172.21.15.57:0/3421156205 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb434ae2700 1 --2- 172.21.15.57:0/3421156205 >> v2:172.21.15.87:3300/0 conn(0x7fb4300b4380 0x7fb43013e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb42ffff700 1 -- 172.21.15.57:0/3421156205 >> v2:172.21.15.87:3300/0 conn(0x7fb4300b4380 msgr2=0x7fb43013e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb42ffff700 1 --2- 172.21.15.57:0/3421156205 >> v2:172.21.15.87:3300/0 conn(0x7fb4300b4380 0x7fb43013e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb42ffff700 1 -- 172.21.15.57:0/3421156205 >> v1:172.21.15.87:6789/0 conn(0x7fb4300b0750 legacy=0x7fb43013df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb42ffff700 1 -- 172.21.15.57:0/3421156205 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4300afb20 con 0x7fb4300af740 2021-06-25T04:56:48.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb42ffff700 1 --2- 172.21.15.57:0/3421156205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4300af740 0x7fb4300b1de0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fb420002f70 tx=0x7fb420006eb0).ready entity=mon.0 client_cookie=3dd937b8084e05ed server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:48.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.511+0000 7fb42effd700 1 -- 172.21.15.57:0/3421156205 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb42000d5c0 con 0x7fb4300af740 2021-06-25T04:56:48.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb42effd700 1 -- 172.21.15.57:0/3421156205 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb420000e90 con 0x7fb4300af740 2021-06-25T04:56:48.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb42effd700 1 -- 172.21.15.57:0/3421156205 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb42000d950 con 0x7fb4300af740 2021-06-25T04:56:48.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 -- 172.21.15.57:0/3421156205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4300af740 msgr2=0x7fb4300b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 --2- 172.21.15.57:0/3421156205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4300af740 0x7fb4300b1de0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fb420002f70 tx=0x7fb420006eb0).stop 2021-06-25T04:56:48.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 -- 172.21.15.57:0/3421156205 shutdown_connections 2021-06-25T04:56:48.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 --2- 172.21.15.57:0/3421156205 >> v2:172.21.15.87:3300/0 conn(0x7fb4300b4380 0x7fb43013e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 --2- 172.21.15.57:0/3421156205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4300af740 0x7fb4300b1de0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 -- 172.21.15.57:0/3421156205 >> 172.21.15.57:0/3421156205 conn(0x7fb43006a0d0 msgr2=0x7fb43005cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:48.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 -- 172.21.15.57:0/3421156205 shutdown_connections 2021-06-25T04:56:48.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 -- 172.21.15.57:0/3421156205 wait complete. 2021-06-25T04:56:48.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 Processor -- start 2021-06-25T04:56:48.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 -- start start 2021-06-25T04:56:48.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb4300af740 0x7fb430063e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4300b0750 0x7fb430066730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4300b4380 0x7fb430066c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb430067110 con 0x7fb4300b0750 2021-06-25T04:56:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb430149210 con 0x7fb4300b4380 2021-06-25T04:56:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb436545700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43014a260 con 0x7fb4300af740 2021-06-25T04:56:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb42f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4300b0750 0x7fb430066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb42f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4300b0750 0x7fb430066730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43708/0 (socket says 172.21.15.57:43708) 2021-06-25T04:56:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb42f7fe700 1 -- 172.21.15.57:0/101686575 learned_addr learned my addr 172.21.15.57:0/101686575 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb42ffff700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb4300af740 0x7fb430063e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:48.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb434ae2700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4300b4380 0x7fb430066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:48.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb42f7fe700 1 -- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb4300af740 msgr2=0x7fb430063e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb42f7fe700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb4300af740 0x7fb430063e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb42f7fe700 1 -- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4300b4380 msgr2=0x7fb430066c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb42f7fe700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4300b4380 0x7fb430066c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.515+0000 7fb42f7fe700 1 -- 172.21.15.57:0/101686575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42000b1e0 con 0x7fb4300b0750 2021-06-25T04:56:48.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.519+0000 7fb42f7fe700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4300b0750 0x7fb430066730 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fb43005d580 tx=0x7fb424007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:48.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.519+0000 7fb42d7fa700 1 -- 172.21.15.57:0/101686575 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb424012400 con 0x7fb4300b0750 2021-06-25T04:56:48.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.519+0000 7fb42d7fa700 1 -- 172.21.15.57:0/101686575 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb424012560 con 0x7fb4300b0750 2021-06-25T04:56:48.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.519+0000 7fb436545700 1 -- 172.21.15.57:0/101686575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43013f3f0 con 0x7fb4300b0750 2021-06-25T04:56:48.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.519+0000 7fb42d7fa700 1 -- 172.21.15.57:0/101686575 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4240128c0 con 0x7fb4300b0750 2021-06-25T04:56:48.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.519+0000 7fb436545700 1 -- 172.21.15.57:0/101686575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb430156500 con 0x7fb4300b0750 2021-06-25T04:56:48.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.519+0000 7fb436545700 1 -- 172.21.15.57:0/101686575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb430057310 con 0x7fb4300b0750 2021-06-25T04:56:48.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.519+0000 7fb42d7fa700 1 -- 172.21.15.57:0/101686575 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb424019030 con 0x7fb4300b0750 2021-06-25T04:56:48.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.519+0000 7fb42d7fa700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb410055450 0x7fb410057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:48.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.523+0000 7fb42d7fa700 1 -- 172.21.15.57:0/101686575 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb42406cf00 con 0x7fb4300b0750 2021-06-25T04:56:48.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.523+0000 7fb42ffff700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb410055450 0x7fb410057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:48.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.523+0000 7fb42ffff700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb410055450 0x7fb410057910 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fb42001b000 tx=0x7fb420015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:48.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.527+0000 7fb42d7fa700 1 -- 172.21.15.57:0/101686575 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb424043390 con 0x7fb4300b0750 2021-06-25T04:56:48.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.655+0000 7fb436545700 1 -- 172.21.15.57:0/101686575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb43013f580 con 0x7fb4300b0750 2021-06-25T04:56:48.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb42d7fa700 1 -- 172.21.15.57:0/101686575 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb4240469b0 con 0x7fb4300b0750 2021-06-25T04:56:48.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 -- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb410055450 msgr2=0x7fb410057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb410055450 0x7fb410057910 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fb42001b000 tx=0x7fb420015000).stop 2021-06-25T04:56:48.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 -- 172.21.15.57:0/101686575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4300b0750 msgr2=0x7fb430066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4300b0750 0x7fb430066730 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fb43005d580 tx=0x7fb424007c50).stop 2021-06-25T04:56:48.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 -- 172.21.15.57:0/101686575 shutdown_connections 2021-06-25T04:56:48.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb410055450 0x7fb410057910 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4300b4380 0x7fb430066c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4300b0750 0x7fb430066730 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 --2- 172.21.15.57:0/101686575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb4300af740 0x7fb430063e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 -- 172.21.15.57:0/101686575 >> 172.21.15.57:0/101686575 conn(0x7fb43006a0d0 msgr2=0x7fb4300b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:48.673 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 -- 172.21.15.57:0/101686575 shutdown_connections 2021-06-25T04:56:48.674 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.663+0000 7fb436545700 1 -- 172.21.15.57:0/101686575 wait complete. 2021-06-25T04:56:48.683 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:56:48.684 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:48.698 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:48.718 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:48.740 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:56:48.761 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:56:48.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:48.763 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:48.764 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:48.787 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:56:48.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:56:48.789 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:56:48.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:48.790 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:56:48.790 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:56:48.798 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:56:48.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:56:48.799 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:56:48.800 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:56:48.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e91d79700 1 Processor -- start 2021-06-25T04:56:48.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e91d79700 1 -- start start 2021-06-25T04:56:48.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e91d79700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4e8c0aad40 0x7f4e8c0672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:48.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e91d79700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c065920 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e91d79700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c064ed0 con 0x7f4e8c0ab120 2021-06-25T04:56:48.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e91d79700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c0b3ca0 con 0x7f4e8c0aad40 2021-06-25T04:56:48.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e91578700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4e8c0b4d10 0x7f4e8c0b74e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60936/0 (socket says 172.21.15.57:60936) 2021-06-25T04:56:48.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e91578700 1 -- 172.21.15.57:0/3164471259 learned_addr learned my addr 172.21.15.57:0/3164471259 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:48.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e90d77700 1 --2- 172.21.15.57:0/3164471259 >> v2:172.21.15.87:3300/0 conn(0x7f4e8c0aad40 0x7f4e8c0672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:48.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e8b7fe700 1 -- 172.21.15.57:0/3164471259 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924054538 0 0) 0x7f4e8c065920 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e8b7fe700 1 -- 172.21.15.57:0/3164471259 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e70003260 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e8b7fe700 1 -- 172.21.15.57:0/3164471259 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006937945 0 0) 0x7f4e8c064ed0 con 0x7f4e8c0ab120 2021-06-25T04:56:48.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e8b7fe700 1 -- 172.21.15.57:0/3164471259 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e8c065920 con 0x7f4e8c0ab120 2021-06-25T04:56:48.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e90d77700 1 -- 172.21.15.57:0/3164471259 >> v1:172.21.15.87:6789/0 conn(0x7f4e8c0ab120 legacy=0x7f4e8c0647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e90d77700 1 -- 172.21.15.57:0/3164471259 >> v1:172.21.15.57:6789/0 conn(0x7f4e8c0b4d10 legacy=0x7f4e8c0b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e90d77700 1 -- 172.21.15.57:0/3164471259 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c066e20 con 0x7f4e8c0aad40 2021-06-25T04:56:48.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e90d77700 1 --2- 172.21.15.57:0/3164471259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e8c0aad40 0x7f4e8c0672c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f4e80002f70 tx=0x7f4e80006df0).ready entity=mon.1 client_cookie=acdb3d69a7cf7b7e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:48.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e8b7fe700 1 -- 172.21.15.57:0/3164471259 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e8000d540 con 0x7f4e8c0aad40 2021-06-25T04:56:48.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e8b7fe700 1 -- 172.21.15.57:0/3164471259 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e80000e90 con 0x7f4e8c0aad40 2021-06-25T04:56:48.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e8b7fe700 1 -- 172.21.15.57:0/3164471259 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e8000d890 con 0x7f4e8c0aad40 2021-06-25T04:56:48.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e91d79700 1 -- 172.21.15.57:0/3164471259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e8c0aad40 msgr2=0x7f4e8c0672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.911+0000 7f4e91d79700 1 --2- 172.21.15.57:0/3164471259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e8c0aad40 0x7f4e8c0672c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f4e80002f70 tx=0x7f4e80006df0).stop 2021-06-25T04:56:48.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.915+0000 7f4e91d79700 1 -- 172.21.15.57:0/3164471259 shutdown_connections 2021-06-25T04:56:48.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.915+0000 7f4e91d79700 1 --2- 172.21.15.57:0/3164471259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e8c0aad40 0x7f4e8c0672c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.915+0000 7f4e91d79700 1 -- 172.21.15.57:0/3164471259 >> 172.21.15.57:0/3164471259 conn(0x7f4e8c062ba0 msgr2=0x7f4e8c05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:48.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.915+0000 7f4e91d79700 1 -- 172.21.15.57:0/3164471259 shutdown_connections 2021-06-25T04:56:48.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.915+0000 7f4e91d79700 1 -- 172.21.15.57:0/3164471259 wait complete. 2021-06-25T04:56:48.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.915+0000 7f4e91d79700 1 Processor -- start 2021-06-25T04:56:48.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.915+0000 7f4e91d79700 1 -- start start 2021-06-25T04:56:48.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.915+0000 7f4e91d79700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e8c0aad40 0x7f4e8c146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:48.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.915+0000 7f4e91d79700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c0ab120 0x7f4e8c13d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:48.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.915+0000 7f4e91d79700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e8c0b4d10 0x7f4e8c13dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:48.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91d79700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c151ef0 con 0x7f4e8c0ab120 2021-06-25T04:56:48.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91d79700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c13e250 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91d79700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c0b6960 con 0x7f4e8c0aad40 2021-06-25T04:56:48.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e8bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c0ab120 0x7f4e8c13d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:48.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91578700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e8c0b4d10 0x7f4e8c13dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:48.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91578700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e8c0b4d10 0x7f4e8c13dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:52218/0 (socket says 172.21.15.57:52218) 2021-06-25T04:56:48.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91578700 1 -- 172.21.15.57:0/1503207431 learned_addr learned my addr 172.21.15.57:0/1503207431 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:48.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e8bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c0ab120 0x7f4e8c13d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43722/0 (socket says 172.21.15.57:43722) 2021-06-25T04:56:48.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e90d77700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e8c0aad40 0x7f4e8c146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:48.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91578700 1 -- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e8c0aad40 msgr2=0x7f4e8c146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91578700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e8c0aad40 0x7f4e8c146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91578700 1 -- 172.21.15.57:0/1503207431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c0ab120 msgr2=0x7f4e8c13d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:48.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91578700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c0ab120 0x7f4e8c13d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:48.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91578700 1 -- 172.21.15.57:0/1503207431 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8000b180 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e8bfff700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c0ab120 0x7f4e8c13d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:48.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91578700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e8c0b4d10 0x7f4e8c13dd60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f4e84001490 tx=0x7f4e84007d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:48.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e89ffb700 1 -- 172.21.15.57:0/1503207431 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e8400ce80 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e89ffb700 1 -- 172.21.15.57:0/1503207431 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e84005ba0 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91d79700 1 -- 172.21.15.57:0/1503207431 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c1420c0 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e89ffb700 1 -- 172.21.15.57:0/1503207431 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e840070d0 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91d79700 1 -- 172.21.15.57:0/1503207431 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c142600 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.919+0000 7f4e91d79700 1 -- 172.21.15.57:0/1503207431 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c1427c0 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.923+0000 7f4e89ffb700 1 -- 172.21.15.57:0/1503207431 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4e84010070 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.923+0000 7f4e89ffb700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e740553d0 0x7f4e74057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:48.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.923+0000 7f4e89ffb700 1 -- 172.21.15.57:0/1503207431 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f4e8406d420 con 0x7f4e8c0b4d10 2021-06-25T04:56:48.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.923+0000 7f4e90d77700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e740553d0 0x7f4e74057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:48.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.923+0000 7f4e90d77700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e740553d0 0x7f4e74057890 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f4e80017000 tx=0x7f4e80014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:48.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:48.931+0000 7f4e89ffb700 1 -- 172.21.15.57:0/1503207431 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4e840437e0 con 0x7f4e8c0b4d10 2021-06-25T04:56:49.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.059+0000 7f4e91d79700 1 -- 172.21.15.57:0/1503207431 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4e8c057310 con 0x7f4e8c0b4d10 2021-06-25T04:56:49.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e89ffb700 1 -- 172.21.15.57:0/1503207431 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v142) v1 ==== 81+0+29229 (secure 0 0 0) 0x7f4e84046e00 con 0x7f4e8c0b4d10 2021-06-25T04:56:49.067 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:49.068 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:56:49.068 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 142, 2021-06-25T04:56:49.069 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:56:49.069 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:56:49.069 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:56:46.357515+0000", 2021-06-25T04:56:49.069 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:56:49.070 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:56:49.070 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:56:49.070 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:56:49.070 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:56:49.071 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:56:49.071 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:56:49.071 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:56:49.071 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:56:49.071 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:49.072 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:56:49.072 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:56:49.072 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:56:49.072 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:56:49.073 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:56:49.073 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 26, 2021-06-25T04:56:49.073 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:56:49.073 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:56:49.074 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:56:49.074 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:56:49.074 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:56:49.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.075 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:56:49.075 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:56:49.075 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:56:49.075 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:56:49.076 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:56:49.076 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:49.076 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:49.076 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:49.076 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:49.077 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:49.077 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:49.077 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:56:49.077 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:56:49.078 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:56:49.078 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:56:49.078 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:56:49.079 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:49.079 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:49.079 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:49.079 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:49.080 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:49.080 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:49.080 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:49.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.081 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:56:49.081 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:49.081 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:49.081 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:49.082 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:49.082 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:49.082 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:49.082 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:49.083 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:49.083 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:49.083 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:49.083 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:49.084 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:49.084 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:49.084 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:49.084 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:56:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:56:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:56:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:56:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:56:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:56:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:56:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:56:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:56:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:56:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:56:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:56:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:56:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:56:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:56:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:56:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:56:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:56:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:56:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:56:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:56:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:56:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:56:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:56:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:56:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:56:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:56:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:56:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:56:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:56:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:56:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:56:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:56:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:56:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:56:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:56:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:56:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:56:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:56:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:56:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:56:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:56:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:56:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:56:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:56:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:56:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:56:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:56:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:56:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:56:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:56:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:56:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:56:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:56:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:56:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:56:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:56:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:56:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:56:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:56:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:56:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:56:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:56:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:56:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:56:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:56:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:56:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:56:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:56:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:56:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 135, 2021-06-25T04:56:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:56:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:56:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:56:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:56:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:56:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:56:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:56:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:56:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:56:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:56:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:56:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:56:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:56:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:56:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:56:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 136, 2021-06-25T04:56:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:56:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:56:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:56:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:56:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:56:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:56:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:56:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:56:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:56:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:56:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:56:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:56:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:56:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:56:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:56:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 136, 2021-06-25T04:56:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:56:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:56:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:56:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:56:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:56:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:56:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:56:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:56:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:56:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:56:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:56:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:56:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:56:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:56:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:56:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 135, 2021-06-25T04:56:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:56:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:56:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:56:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:56:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:56:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:56:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.181 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.181 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:49.181 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:56:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:56:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:56:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:56:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:56:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:56:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:56:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:56:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:56:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 137, 2021-06-25T04:56:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:56:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:56:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:56:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:56:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:56:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:56:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.200 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.200 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:56:49.200 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:49.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.201 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.201 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:56:49.201 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:56:49.202 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.202 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.202 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:56:49.202 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:56:49.203 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:56:49.203 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:56:49.203 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:49.203 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:49.204 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:49.204 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.204 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:56:49.205 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:56:49.205 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:49.205 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:49.205 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:49.206 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:49.206 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:49.206 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:49.206 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:49.206 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 128, 2021-06-25T04:56:49.207 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:49.207 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:49.207 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:49.207 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.208 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.208 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:56:49.208 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:49.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.209 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.209 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:56:49.209 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:49.210 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.210 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.210 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:49.210 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.211 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.211 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:56:49.211 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:49.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.212 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.212 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:56:49.212 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:49.213 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.213 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.213 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:49.214 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.214 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.214 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:56:49.214 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:49.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.215 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.215 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:56:49.216 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:49.216 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.216 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.216 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:49.217 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.217 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.217 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:56:49.217 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:49.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.218 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.218 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:56:49.219 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:56:49.219 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.219 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.219 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:56:49.220 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:56:49.220 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:56:49.220 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:56:49.220 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:49.221 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:49.221 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:49.221 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.222 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:56:49.222 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:56:49.222 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:49.222 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:49.223 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:49.223 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:49.223 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:49.223 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:49.223 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:49.224 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 136, 2021-06-25T04:56:49.224 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:49.224 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:49.224 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:49.225 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.225 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.225 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:56:49.225 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:49.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.226 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.226 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:56:49.227 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:49.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.227 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.227 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:49.228 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.228 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.228 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:56:49.229 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:49.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.229 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.229 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:56:49.230 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:49.230 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.230 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.231 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:49.231 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.231 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.231 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:56:49.232 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:49.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.232 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.233 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:56:49.233 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:49.233 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.233 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.234 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:49.234 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.234 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.235 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:56:49.235 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:49.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.235 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.236 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:56:49.236 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:56:49.236 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.236 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.237 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:56:49.237 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:56:49.237 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:56:49.237 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:56:49.238 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:49.238 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:49.238 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:49.238 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.239 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:56:49.239 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:56:49.239 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:56:49.240 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:56:49.240 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:56:49.240 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:56:49.240 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:56:49.240 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:56:49.241 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:56:49.241 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 136, 2021-06-25T04:56:49.241 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:56:49.241 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:56:49.242 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:56:49.242 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.242 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.242 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:56:49.243 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:49.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.243 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.244 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:56:49.244 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:49.244 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.244 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.245 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:56:49.245 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.245 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.245 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:56:49.246 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:49.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.246 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.247 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:56:49.247 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:49.247 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.247 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.248 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:56:49.248 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.248 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.249 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:56:49.249 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:49.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.249 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.250 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:56:49.250 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:49.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.250 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.251 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:56:49.251 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:56:49.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.251 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:56:49.252 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:56:49.252 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:49.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.253 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:56:49.253 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:56:49.253 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:56:49.253 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.253 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.254 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:56:49.254 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:56:49.254 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:56:49.255 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:56:49.255 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:56:49.255 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:56:49.255 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:56:49.256 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:49.256 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.256 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:49.256 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:56:49.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.257 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:56:49.257 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:49.257 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:49.257 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:49.257 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:49.258 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:49.258 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:56:49.258 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:49.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.259 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:56:49.259 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:49.259 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:49.259 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:49.260 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:49.260 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:49.260 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:56:49.260 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:49.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.261 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:56:49.261 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:49.261 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:49.262 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:49.262 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:49.262 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:49.262 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:56:49.263 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:49.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.263 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:56:49.263 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:49.264 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:49.264 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:49.264 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:49.264 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:49.264 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:56:49.265 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:49.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.265 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:56:49.266 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:49.266 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:49.266 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:49.266 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:49.266 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:49.267 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:56:49.267 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:49.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.268 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:56:49.268 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:49.268 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:49.268 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:49.268 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:49.269 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:49.269 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:56:49.269 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:49.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.270 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:56:49.270 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:49.270 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:49.270 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:49.271 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:49.271 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:49.271 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:56:49.271 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:49.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:49.272 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:56:49.272 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:56:49.272 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:56:49.273 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:56:49.273 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:56:49.273 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:56:49.273 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:56:49.274 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:56:49.274 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.274 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:56:49.274 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:56:49.274 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:56:49.275 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:56:49.275 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:56:49.275 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:56:49.275 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.87:6835/2964573030": "2021-06-26T04:56:42.459940+0000", 2021-06-25T04:56:49.275 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.87:6834/2964573030": "2021-06-26T04:56:42.459940+0000" 2021-06-25T04:56:49.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.276 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:56:49.276 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:56:49.276 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:56:49.277 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:56:49.277 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:56:49.277 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:56:49.277 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:56:49.277 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:56:49.278 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:56:49.278 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:56:49.278 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:56:49.278 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:56:49.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.279 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:56:49.279 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:56:49.279 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:56:49.279 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:56:49.280 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:56:49.280 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:56:49.280 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:56:49.280 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:49.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:49.281 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:56:49.281 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:56:49.281 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:56:49.281 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:56:49.282 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:56:49.282 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:56:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 -- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e740553d0 msgr2=0x7f4e74057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e740553d0 0x7f4e74057890 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f4e80017000 tx=0x7f4e80014000).stop 2021-06-25T04:56:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 -- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e8c0b4d10 msgr2=0x7f4e8c13dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e8c0b4d10 0x7f4e8c13dd60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f4e84001490 tx=0x7f4e84007d60).stop 2021-06-25T04:56:49.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 -- 172.21.15.57:0/1503207431 shutdown_connections 2021-06-25T04:56:49.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4e740553d0 0x7f4e74057890 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e8c0b4d10 0x7f4e8c13dd60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e8c0ab120 0x7f4e8c13d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 --2- 172.21.15.57:0/1503207431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e8c0aad40 0x7f4e8c146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 -- 172.21.15.57:0/1503207431 >> 172.21.15.57:0/1503207431 conn(0x7f4e8c062ba0 msgr2=0x7f4e8c061820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 -- 172.21.15.57:0/1503207431 shutdown_connections 2021-06-25T04:56:49.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.063+0000 7f4e91d79700 1 -- 172.21.15.57:0/1503207431 wait complete. 2021-06-25T04:56:49.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:49.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 Processor -- start 2021-06-25T04:56:49.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 -- start start 2021-06-25T04:56:49.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b480acee0 0x7f7b480ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:49.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b480b2bf0 con 0x7f7b480b2810 2021-06-25T04:56:49.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b480b1620 con 0x7f7b4813c6a0 2021-06-25T04:56:49.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480b1170 con 0x7f7b480acee0 2021-06-25T04:56:49.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4d67b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7b480b2810 0x7f7b480b0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60946/0 (socket says 172.21.15.57:60946) 2021-06-25T04:56:49.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4d67b700 1 -- 172.21.15.57:0/237914961 learned_addr learned my addr 172.21.15.57:0/237914961 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:49.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4de7c700 1 --2- 172.21.15.57:0/237914961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b480acee0 0x7f7b480ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:49.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b3ffff700 1 -- 172.21.15.57:0/237914961 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532230229 0 0) 0x7f7b480b2bf0 con 0x7f7b480b2810 2021-06-25T04:56:49.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b3ffff700 1 -- 172.21.15.57:0/237914961 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b2c003260 con 0x7f7b480b2810 2021-06-25T04:56:49.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b3ffff700 1 -- 172.21.15.57:0/237914961 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619976927 0 0) 0x7f7b480b1620 con 0x7f7b4813c6a0 2021-06-25T04:56:49.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b3ffff700 1 -- 172.21.15.57:0/237914961 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b480b2bf0 con 0x7f7b4813c6a0 2021-06-25T04:56:49.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4de7c700 1 -- 172.21.15.57:0/237914961 >> v1:172.21.15.87:6789/0 conn(0x7f7b4813c6a0 legacy=0x7f7b4813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b3ffff700 1 -- 172.21.15.57:0/237914961 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1157579202 0 0) 0x7f7b480b2bf0 con 0x7f7b4813c6a0 2021-06-25T04:56:49.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4de7c700 1 -- 172.21.15.57:0/237914961 >> v1:172.21.15.57:6789/0 conn(0x7f7b480b2810 legacy=0x7f7b480b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4de7c700 1 -- 172.21.15.57:0/237914961 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480b18c0 con 0x7f7b480acee0 2021-06-25T04:56:49.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4de7c700 1 --2- 172.21.15.57:0/237914961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b480acee0 0x7f7b480ad350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f7b38001110 tx=0x7f7b400091d0).ready entity=mon.2 client_cookie=229667b9f68ed08b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:49.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b3ffff700 1 -- 172.21.15.57:0/237914961 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b38001660 con 0x7f7b480acee0 2021-06-25T04:56:49.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b3ffff700 1 -- 172.21.15.57:0/237914961 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4000f510 con 0x7f7b480acee0 2021-06-25T04:56:49.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b3ffff700 1 -- 172.21.15.57:0/237914961 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4000f680 con 0x7f7b480acee0 2021-06-25T04:56:49.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 -- 172.21.15.57:0/237914961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b480acee0 msgr2=0x7f7b480ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 --2- 172.21.15.57:0/237914961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b480acee0 0x7f7b480ad350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f7b38001110 tx=0x7f7b400091d0).stop 2021-06-25T04:56:49.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 -- 172.21.15.57:0/237914961 shutdown_connections 2021-06-25T04:56:49.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 --2- 172.21.15.57:0/237914961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b480acee0 0x7f7b480ad350 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 -- 172.21.15.57:0/237914961 >> 172.21.15.57:0/237914961 conn(0x7f7b480611f0 msgr2=0x7f7b48062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:49.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 -- 172.21.15.57:0/237914961 shutdown_connections 2021-06-25T04:56:49.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.395+0000 7f7b4e67d700 1 -- 172.21.15.57:0/237914961 wait complete. 2021-06-25T04:56:49.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4e67d700 1 Processor -- start 2021-06-25T04:56:49.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4e67d700 1 -- start start 2021-06-25T04:56:49.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4e67d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b480acee0 0x7f7b48141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:49.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4e67d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b480b2810 0x7f7b48142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:49.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4e67d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b4813c6a0 0x7f7b481520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:49.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4e67d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48066b70 con 0x7f7b480acee0 2021-06-25T04:56:49.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4e67d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48143860 con 0x7f7b4813c6a0 2021-06-25T04:56:49.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4e67d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48065a80 con 0x7f7b480b2810 2021-06-25T04:56:49.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4d67b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b480acee0 0x7f7b48141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:49.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4d67b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b480acee0 0x7f7b48141bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43734/0 (socket says 172.21.15.57:43734) 2021-06-25T04:56:49.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4d67b700 1 -- 172.21.15.57:0/489179239 learned_addr learned my addr 172.21.15.57:0/489179239 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:49.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4ce7a700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b480b2810 0x7f7b48142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:49.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4de7c700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b4813c6a0 0x7f7b481520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:49.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4d67b700 1 -- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b480b2810 msgr2=0x7f7b48142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4d67b700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b480b2810 0x7f7b48142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4d67b700 1 -- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b4813c6a0 msgr2=0x7f7b481520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4d67b700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b4813c6a0 0x7f7b481520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4d67b700 1 -- 172.21.15.57:0/489179239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40009470 con 0x7f7b480acee0 2021-06-25T04:56:49.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4d67b700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b480acee0 0x7f7b48141bc0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f7b48067300 tx=0x7f7b44007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:49.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b3e7fc700 1 -- 172.21.15.57:0/489179239 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b44007110 con 0x7f7b480acee0 2021-06-25T04:56:49.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b3e7fc700 1 -- 172.21.15.57:0/489179239 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b44007270 con 0x7f7b480acee0 2021-06-25T04:56:49.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4e67d700 1 -- 172.21.15.57:0/489179239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b48065d20 con 0x7f7b480acee0 2021-06-25T04:56:49.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b3e7fc700 1 -- 172.21.15.57:0/489179239 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b44005030 con 0x7f7b480acee0 2021-06-25T04:56:49.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.399+0000 7f7b4e67d700 1 -- 172.21.15.57:0/489179239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b48142410 con 0x7f7b480acee0 2021-06-25T04:56:49.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.403+0000 7f7b4e67d700 1 -- 172.21.15.57:0/489179239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b48057310 con 0x7f7b480acee0 2021-06-25T04:56:49.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.403+0000 7f7b3e7fc700 1 -- 172.21.15.57:0/489179239 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7b4401b070 con 0x7f7b480acee0 2021-06-25T04:56:49.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.403+0000 7f7b3e7fc700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7b30055340 0x7f7b30057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:49.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.403+0000 7f7b3e7fc700 1 -- 172.21.15.57:0/489179239 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f7b4406d260 con 0x7f7b480acee0 2021-06-25T04:56:49.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.403+0000 7f7b4ce7a700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7b30055340 0x7f7b30057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:49.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.403+0000 7f7b4ce7a700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7b30055340 0x7f7b30057800 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f7b3800c000 tx=0x7f7b380091a0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:49.423 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.411+0000 7f7b3e7fc700 1 -- 172.21.15.57:0/489179239 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7b440435e0 con 0x7f7b480acee0 2021-06-25T04:56:49.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.575+0000 7f7b4e67d700 1 -- 172.21.15.57:0/489179239 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b4805f200 con 0x7f7b480acee0 2021-06-25T04:56:49.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b3e7fc700 1 -- 172.21.15.57:0/489179239 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f7b44046c00 con 0x7f7b480acee0 2021-06-25T04:56:49.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:49.583 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3591673245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3591673245},{"type":"v1","addr":"172.21.15.57:6833","nonce":3591673245}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2597000234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2597000234},{"type":"v1","addr":"172.21.15.57:6835","nonce":2597000234}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8206,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3663243498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3663243498},{"type":"v1","addr":"172.21.15.87:6835","nonce":3663243498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":72}],"filesystems":[]} 2021-06-25T04:56:49.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 -- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7b30055340 msgr2=0x7f7b30057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7b30055340 0x7f7b30057800 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f7b3800c000 tx=0x7f7b380091a0).stop 2021-06-25T04:56:49.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 -- 172.21.15.57:0/489179239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b480acee0 msgr2=0x7f7b48141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b480acee0 0x7f7b48141bc0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f7b48067300 tx=0x7f7b44007a80).stop 2021-06-25T04:56:49.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 -- 172.21.15.57:0/489179239 shutdown_connections 2021-06-25T04:56:49.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7b30055340 0x7f7b30057800 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.586 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b4813c6a0 0x7f7b481520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b480b2810 0x7f7b48142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 --2- 172.21.15.57:0/489179239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b480acee0 0x7f7b48141bc0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 -- 172.21.15.57:0/489179239 >> 172.21.15.57:0/489179239 conn(0x7f7b480611f0 msgr2=0x7f7b481361c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:49.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 -- 172.21.15.57:0/489179239 shutdown_connections 2021-06-25T04:56:49.587 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.579+0000 7f7b4e67d700 1 -- 172.21.15.57:0/489179239 wait complete. 2021-06-25T04:56:49.588 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 72 2021-06-25T04:56:49.596 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:49.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff84a614700 1 Processor -- start 2021-06-25T04:56:49.695 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff84a614700 1 -- start start 2021-06-25T04:56:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff84a614700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff8440a7670 0x7ff844066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff84a614700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 0x7ff844066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff84a614700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff844067410 con 0x7ff8440b0020 2021-06-25T04:56:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff84a614700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8440a7a50 con 0x7ff8440a7670 2021-06-25T04:56:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff84a614700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8441475e0 con 0x7ff8440b1930 2021-06-25T04:56:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff8437fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 0x7ff844066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff843fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff8440a7670 0x7ff844066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff8437fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 0x7ff844066f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:54906/0 (socket says 172.21.15.57:54906) 2021-06-25T04:56:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff8437fe700 1 -- 172.21.15.57:0/3261752879 learned_addr learned my addr 172.21.15.57:0/3261752879 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff8437fe700 1 -- 172.21.15.57:0/3261752879 >> v2:172.21.15.87:3300/0 conn(0x7ff8440a7670 msgr2=0x7ff844066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff8437fe700 1 --2- 172.21.15.57:0/3261752879 >> v2:172.21.15.87:3300/0 conn(0x7ff8440a7670 0x7ff844066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff8437fe700 1 -- 172.21.15.57:0/3261752879 >> v1:172.21.15.87:6789/0 conn(0x7ff8440b0020 legacy=0x7ff84405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff8437fe700 1 -- 172.21.15.57:0/3261752879 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff844147880 con 0x7ff8440b1930 2021-06-25T04:56:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff8437fe700 1 --2- 172.21.15.57:0/3261752879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 0x7ff844066f20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7ff834002f70 tx=0x7ff834006eb0).ready entity=mon.2 client_cookie=20ce098fea73d6ed server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff842ffd700 1 -- 172.21.15.57:0/3261752879 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff83400d570 con 0x7ff8440b1930 2021-06-25T04:56:49.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff842ffd700 1 -- 172.21.15.57:0/3261752879 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff834000e90 con 0x7ff8440b1930 2021-06-25T04:56:49.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff842ffd700 1 -- 172.21.15.57:0/3261752879 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff83400d900 con 0x7ff8440b1930 2021-06-25T04:56:49.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff84a614700 1 -- 172.21.15.57:0/3261752879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 msgr2=0x7ff844066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.691+0000 7ff84a614700 1 --2- 172.21.15.57:0/3261752879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 0x7ff844066f20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7ff834002f70 tx=0x7ff834006eb0).stop 2021-06-25T04:56:49.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 -- 172.21.15.57:0/3261752879 shutdown_connections 2021-06-25T04:56:49.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 --2- 172.21.15.57:0/3261752879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 0x7ff844066f20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 --2- 172.21.15.57:0/3261752879 >> v2:172.21.15.87:3300/0 conn(0x7ff8440a7670 0x7ff844066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 -- 172.21.15.57:0/3261752879 >> 172.21.15.57:0/3261752879 conn(0x7ff8440b53a0 msgr2=0x7ff8440b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:49.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 -- 172.21.15.57:0/3261752879 shutdown_connections 2021-06-25T04:56:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 -- 172.21.15.57:0/3261752879 wait complete. 2021-06-25T04:56:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 Processor -- start 2021-06-25T04:56:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 -- start start 2021-06-25T04:56:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8440a7670 0x7ff8440abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440b0020 0x7ff8440aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 0x7ff8440adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844146a90 con 0x7ff8440b0020 2021-06-25T04:56:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844146cc0 con 0x7ff8440a7670 2021-06-25T04:56:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff84a614700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff844146f60 con 0x7ff8440b1930 2021-06-25T04:56:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff8437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440b0020 0x7ff8440aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff8437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440b0020 0x7ff8440aae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43748/0 (socket says 172.21.15.57:43748) 2021-06-25T04:56:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff8437fe700 1 -- 172.21.15.57:0/1553258601 learned_addr learned my addr 172.21.15.57:0/1553258601 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff848bb1700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 0x7ff8440adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff843fff700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8440a7670 0x7ff8440abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff8437fe700 1 -- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 msgr2=0x7ff8440adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff8437fe700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 0x7ff8440adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff8437fe700 1 -- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8440a7670 msgr2=0x7ff8440abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff8437fe700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8440a7670 0x7ff8440abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff8437fe700 1 -- 172.21.15.57:0/1553258601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83400b1e0 con 0x7ff8440b0020 2021-06-25T04:56:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff843fff700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8440a7670 0x7ff8440abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff848bb1700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 0x7ff8440adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.695+0000 7ff8437fe700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440b0020 0x7ff8440aae20 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7ff834002f70 tx=0x7ff834015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.699+0000 7ff8417fa700 1 -- 172.21.15.57:0/1553258601 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff834021070 con 0x7ff8440b0020 2021-06-25T04:56:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.699+0000 7ff8417fa700 1 -- 172.21.15.57:0/1553258601 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff834000e90 con 0x7ff8440b0020 2021-06-25T04:56:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.699+0000 7ff8417fa700 1 -- 172.21.15.57:0/1553258601 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8340118d0 con 0x7ff8440b0020 2021-06-25T04:56:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.699+0000 7ff84a614700 1 -- 172.21.15.57:0/1553258601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff844147200 con 0x7ff8440b0020 2021-06-25T04:56:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.699+0000 7ff84a614700 1 -- 172.21.15.57:0/1553258601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8440aed90 con 0x7ff8440b0020 2021-06-25T04:56:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.699+0000 7ff84a614700 1 -- 172.21.15.57:0/1553258601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8440ad9a0 con 0x7ff8440b0020 2021-06-25T04:56:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.699+0000 7ff8417fa700 1 -- 172.21.15.57:0/1553258601 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff83400f070 con 0x7ff8440b0020 2021-06-25T04:56:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.699+0000 7ff8417fa700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff824055490 0x7ff824057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.699+0000 7ff8417fa700 1 -- 172.21.15.57:0/1553258601 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ff83406efe0 con 0x7ff8440b0020 2021-06-25T04:56:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.699+0000 7ff843fff700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff824055490 0x7ff824057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.699+0000 7ff843fff700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff824055490 0x7ff824057950 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7ff83800b000 tx=0x7ff838006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.707+0000 7ff8417fa700 1 -- 172.21.15.57:0/1553258601 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff8440ad9a0 con 0x7ff8440b0020 2021-06-25T04:56:49.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.871+0000 7ff84a614700 1 -- 172.21.15.57:0/1553258601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8440ad9a0 con 0x7ff8440b0020 2021-06-25T04:56:49.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.871+0000 7ff8417fa700 1 -- 172.21.15.57:0/1553258601 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+1562 (secure 0 0 0) 0x7ff8440ad9a0 con 0x7ff8440b0020 2021-06-25T04:56:49.879 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:49.880 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3591673245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3591673245},{"type":"v1","addr":"172.21.15.57:6833","nonce":3591673245}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2597000234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2597000234},{"type":"v1","addr":"172.21.15.57:6835","nonce":2597000234}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67},{"gid":8206,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3663243498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3663243498},{"type":"v1","addr":"172.21.15.87:6835","nonce":3663243498}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":72}],"filesystems":[]} 2021-06-25T04:56:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.871+0000 7ff84a614700 1 -- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff824055490 msgr2=0x7ff824057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.871+0000 7ff84a614700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff824055490 0x7ff824057950 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7ff83800b000 tx=0x7ff838006df0).stop 2021-06-25T04:56:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.871+0000 7ff84a614700 1 -- 172.21.15.57:0/1553258601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440b0020 msgr2=0x7ff8440aae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.871+0000 7ff84a614700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440b0020 0x7ff8440aae20 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7ff834002f70 tx=0x7ff834015000).stop 2021-06-25T04:56:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.871+0000 7ff84a614700 1 -- 172.21.15.57:0/1553258601 shutdown_connections 2021-06-25T04:56:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.871+0000 7ff84a614700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff824055490 0x7ff824057950 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.871+0000 7ff84a614700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8440b1930 0x7ff8440adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.875+0000 7ff84a614700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440b0020 0x7ff8440aae20 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.875+0000 7ff84a614700 1 --2- 172.21.15.57:0/1553258601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8440a7670 0x7ff8440abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:49.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.875+0000 7ff84a614700 1 -- 172.21.15.57:0/1553258601 >> 172.21.15.57:0/1553258601 conn(0x7ff8440b53a0 msgr2=0x7ff84405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:49.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.875+0000 7ff84a614700 1 -- 172.21.15.57:0/1553258601 shutdown_connections 2021-06-25T04:56:49.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:49.875+0000 7ff84a614700 1 -- 172.21.15.57:0/1553258601 wait complete. 2021-06-25T04:56:49.884 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 72 2021-06-25T04:56:49.889 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:56:49.890 INFO:tasks.ceph.mds.a:Stopping old one... 2021-06-25T04:56:49.890 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:56:49.890 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:56:49.891 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:56:49.891 INFO:tasks.ceph.mds.c:Stopping old one... 2021-06-25T04:56:49.891 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:56:49.892 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:56:49.892 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:56:49.892 INFO:tasks.ceph.mds.b:Stopping old one... 2021-06-25T04:56:49.892 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:56:49.893 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:56:49.904 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:56:49.904 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:56:49.905 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:56:49.905 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:56:49.907 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:56:49.907 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:56:49.910 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:56:49.910 DEBUG:teuthology.parallel:result is None 2021-06-25T04:56:49.948 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:56:49.948 DEBUG:teuthology.parallel:result is None 2021-06-25T04:56:49.949 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:56:49.950 DEBUG:teuthology.parallel:result is None 2021-06-25T04:56:49.950 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:56:49.984 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:56:50.015 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:56:50.016 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:56:50.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.075+0000 7f543bfff700 1 Processor -- start 2021-06-25T04:56:50.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.075+0000 7f543bfff700 1 -- start start 2021-06-25T04:56:50.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f543c0b06d0 0x7f543c142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:50.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f543c0b3090 0x7f543c1431d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:50.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c0b0ab0 con 0x7f543c0ace30 2021-06-25T04:56:50.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c0ae640 con 0x7f543c0b06d0 2021-06-25T04:56:50.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0ae8e0 con 0x7f543c0b3090 2021-06-25T04:56:50.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f543c0b06d0 0x7f543c142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:50.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f543c0ace30 0x7f543c05f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32770/0 (socket says 172.21.15.57:32770) 2021-06-25T04:56:50.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543b7fe700 1 -- 172.21.15.57:0/3167359305 learned_addr learned my addr 172.21.15.57:0/3167359305 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:50.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543a7fc700 1 --2- 172.21.15.57:0/3167359305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f543c0b3090 0x7f543c1431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:50.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f5439ffb700 1 -- 172.21.15.57:0/3167359305 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535107281 0 0) 0x7f543c0b0ab0 con 0x7f543c0ace30 2021-06-25T04:56:50.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f5439ffb700 1 -- 172.21.15.57:0/3167359305 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5420003260 con 0x7f543c0ace30 2021-06-25T04:56:50.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543affd700 1 -- 172.21.15.57:0/3167359305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f543c0b3090 msgr2=0x7f543c1431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:50.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543affd700 1 --2- 172.21.15.57:0/3167359305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f543c0b3090 0x7f543c1431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:50.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543affd700 1 -- 172.21.15.57:0/3167359305 >> v1:172.21.15.57:6789/0 conn(0x7f543c0ace30 legacy=0x7f543c05f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:50.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543affd700 1 -- 172.21.15.57:0/3167359305 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c0aeb80 con 0x7f543c0b06d0 2021-06-25T04:56:50.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543affd700 1 --2- 172.21.15.57:0/3167359305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f543c0b06d0 0x7f543c142ce0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f542c002f70 tx=0x7f542c006df0).ready entity=mon.0 client_cookie=6dacb6859554cbd5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:50.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f5439ffb700 1 -- 172.21.15.57:0/3167359305 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542c00d4a0 con 0x7f543c0b06d0 2021-06-25T04:56:50.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f5439ffb700 1 -- 172.21.15.57:0/3167359305 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c000e90 con 0x7f543c0b06d0 2021-06-25T04:56:50.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f5439ffb700 1 -- 172.21.15.57:0/3167359305 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542c00d7f0 con 0x7f543c0b06d0 2021-06-25T04:56:50.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 -- 172.21.15.57:0/3167359305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f543c0b06d0 msgr2=0x7f543c142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:50.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 --2- 172.21.15.57:0/3167359305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f543c0b06d0 0x7f543c142ce0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f542c002f70 tx=0x7f542c006df0).stop 2021-06-25T04:56:50.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 -- 172.21.15.57:0/3167359305 shutdown_connections 2021-06-25T04:56:50.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 --2- 172.21.15.57:0/3167359305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f543c0b3090 0x7f543c1431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:50.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 --2- 172.21.15.57:0/3167359305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f543c0b06d0 0x7f543c142ce0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:50.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 -- 172.21.15.57:0/3167359305 >> 172.21.15.57:0/3167359305 conn(0x7f543c061100 msgr2=0x7f543c062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:50.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 -- 172.21.15.57:0/3167359305 shutdown_connections 2021-06-25T04:56:50.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.079+0000 7f543bfff700 1 -- 172.21.15.57:0/3167359305 wait complete. 2021-06-25T04:56:50.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543bfff700 1 Processor -- start 2021-06-25T04:56:50.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543bfff700 1 -- start start 2021-06-25T04:56:50.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f543c0ace30 0x7f543c064c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:50.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f543c0b06d0 0x7f543c0a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:50.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f543c0b3090 0x7f543c153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:50.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c13f990 con 0x7f543c0ace30 2021-06-25T04:56:50.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c154160 con 0x7f543c0b3090 2021-06-25T04:56:50.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c09f4d0 con 0x7f543c0b06d0 2021-06-25T04:56:50.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f543c0ace30 0x7f543c064c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:50.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f543c0ace30 0x7f543c064c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43786/0 (socket says 172.21.15.57:43786) 2021-06-25T04:56:50.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543affd700 1 -- 172.21.15.57:0/2398994664 learned_addr learned my addr 172.21.15.57:0/2398994664 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:50.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543b7fe700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f543c0b3090 0x7f543c153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:50.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543a7fc700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f543c0b06d0 0x7f543c0a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:50.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543affd700 1 -- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f543c0b06d0 msgr2=0x7f543c0a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:50.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543affd700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f543c0b06d0 0x7f543c0a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:50.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543affd700 1 -- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f543c0b3090 msgr2=0x7f543c153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:50.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543affd700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f543c0b3090 0x7f543c153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:50.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543affd700 1 -- 172.21.15.57:0/2398994664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c00b180 con 0x7f543c0ace30 2021-06-25T04:56:50.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543affd700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f543c0ace30 0x7f543c064c10 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f542c002f70 tx=0x7f542c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:50.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f542bfff700 1 -- 172.21.15.57:0/2398994664 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542c012930 con 0x7f543c0ace30 2021-06-25T04:56:50.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f542bfff700 1 -- 172.21.15.57:0/2398994664 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c012a90 con 0x7f543c0ace30 2021-06-25T04:56:50.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f542bfff700 1 -- 172.21.15.57:0/2398994664 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542c012df0 con 0x7f543c0ace30 2021-06-25T04:56:50.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543bfff700 1 -- 172.21.15.57:0/2398994664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c09f770 con 0x7f543c0ace30 2021-06-25T04:56:50.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543bfff700 1 -- 172.21.15.57:0/2398994664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c0a0e40 con 0x7f543c0ace30 2021-06-25T04:56:50.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.083+0000 7f543bfff700 1 -- 172.21.15.57:0/2398994664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c154320 con 0x7f543c0ace30 2021-06-25T04:56:50.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.087+0000 7f542bfff700 1 -- 172.21.15.57:0/2398994664 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f542c025020 con 0x7f543c0ace30 2021-06-25T04:56:50.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.087+0000 7f542bfff700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54180553d0 0x7f5418057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:50.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.087+0000 7f542bfff700 1 -- 172.21.15.57:0/2398994664 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f542c06eba0 con 0x7f543c0ace30 2021-06-25T04:56:50.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.087+0000 7f543a7fc700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54180553d0 0x7f5418057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:50.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.087+0000 7f543a7fc700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54180553d0 0x7f5418057890 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f543000b000 tx=0x7f5430006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:50.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.091+0000 7f542bfff700 1 -- 172.21.15.57:0/2398994664 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f542c045030 con 0x7f543c0ace30 2021-06-25T04:56:50.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:50.231+0000 7f543bfff700 1 -- 172.21.15.57:0/2398994664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f543c057310 con 0x7f543c0ace30 2021-06-25T04:56:51.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.043+0000 7f542bfff700 1 -- 172.21.15.57:0/2398994664 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v145) v1 ==== 97+0+0 (secure 0 0 0) 0x7f542c048650 con 0x7f543c0ace30 2021-06-25T04:56:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 -- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54180553d0 msgr2=0x7f5418057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54180553d0 0x7f5418057890 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f543000b000 tx=0x7f5430006df0).stop 2021-06-25T04:56:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 -- 172.21.15.57:0/2398994664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f543c0ace30 msgr2=0x7f543c064c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f543c0ace30 0x7f543c064c10 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f542c002f70 tx=0x7f542c014000).stop 2021-06-25T04:56:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 -- 172.21.15.57:0/2398994664 shutdown_connections 2021-06-25T04:56:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f54180553d0 0x7f5418057890 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f543c0b3090 0x7f543c153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f543c0b06d0 0x7f543c0a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 --2- 172.21.15.57:0/2398994664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f543c0ace30 0x7f543c064c10 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 -- 172.21.15.57:0/2398994664 >> 172.21.15.57:0/2398994664 conn(0x7f543c061100 msgr2=0x7f543c0abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:51.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 -- 172.21.15.57:0/2398994664 shutdown_connections 2021-06-25T04:56:51.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.047+0000 7f543bfff700 1 -- 172.21.15.57:0/2398994664 wait complete. 2021-06-25T04:56:51.055 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:56:51.067 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:56:51.067 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:56:51.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c84dfe700 1 Processor -- start 2021-06-25T04:56:51.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c84dfe700 1 -- start start 2021-06-25T04:56:51.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c84dfe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c80064b60 0x7f7c800b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c84dfe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c800b1f90 0x7f7c800619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c84dfe700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c80066bc0 con 0x7f7c80061eb0 2021-06-25T04:56:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c84dfe700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c80066110 con 0x7f7c800b1f90 2021-06-25T04:56:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c84dfe700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c80064f40 con 0x7f7c80064b60 2021-06-25T04:56:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c7effd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c800b1f90 0x7f7c800619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c7f7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c80064b60 0x7f7c800b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c7f7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c80064b60 0x7f7c800b7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:54960/0 (socket says 172.21.15.57:54960) 2021-06-25T04:56:51.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c7effd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c800b1f90 0x7f7c800619c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43800/0 (socket says 172.21.15.57:43800) 2021-06-25T04:56:51.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c7f7fe700 1 -- 172.21.15.57:0/488535808 learned_addr learned my addr 172.21.15.57:0/488535808 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:51.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c7e7fc700 1 -- 172.21.15.57:0/488535808 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563192278 0 0) 0x7f7c80066bc0 con 0x7f7c80061eb0 2021-06-25T04:56:51.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c7f7fe700 1 -- 172.21.15.57:0/488535808 >> v2:172.21.15.57:3300/0 conn(0x7f7c800b1f90 msgr2=0x7f7c800619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:51.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c7f7fe700 1 --2- 172.21.15.57:0/488535808 >> v2:172.21.15.57:3300/0 conn(0x7f7c800b1f90 0x7f7c800619c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c7f7fe700 1 -- 172.21.15.57:0/488535808 >> v1:172.21.15.87:6789/0 conn(0x7f7c80061eb0 legacy=0x7f7c800b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c7f7fe700 1 -- 172.21.15.57:0/488535808 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c80066e60 con 0x7f7c80064b60 2021-06-25T04:56:51.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.171+0000 7f7c7f7fe700 1 --2- 172.21.15.57:0/488535808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c80064b60 0x7f7c800b7de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f7c70002f70 tx=0x7f7c70006eb0).ready entity=mon.2 client_cookie=412afc9dd5b2e778 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:51.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c7e7fc700 1 -- 172.21.15.57:0/488535808 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c7000d570 con 0x7f7c80064b60 2021-06-25T04:56:51.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c7e7fc700 1 -- 172.21.15.57:0/488535808 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c70000e90 con 0x7f7c80064b60 2021-06-25T04:56:51.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 -- 172.21.15.57:0/488535808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c80064b60 msgr2=0x7f7c800b7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c7e7fc700 1 -- 172.21.15.57:0/488535808 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c7000d8c0 con 0x7f7c80064b60 2021-06-25T04:56:51.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 --2- 172.21.15.57:0/488535808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c80064b60 0x7f7c800b7de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f7c70002f70 tx=0x7f7c70006eb0).stop 2021-06-25T04:56:51.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 -- 172.21.15.57:0/488535808 shutdown_connections 2021-06-25T04:56:51.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 --2- 172.21.15.57:0/488535808 >> v2:172.21.15.57:3300/0 conn(0x7f7c800b1f90 0x7f7c800619c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 --2- 172.21.15.57:0/488535808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c80064b60 0x7f7c800b7de0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 -- 172.21.15.57:0/488535808 >> 172.21.15.57:0/488535808 conn(0x7f7c80062ba0 msgr2=0x7f7c8005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:51.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 -- 172.21.15.57:0/488535808 shutdown_connections 2021-06-25T04:56:51.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 -- 172.21.15.57:0/488535808 wait complete. 2021-06-25T04:56:51.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 Processor -- start 2021-06-25T04:56:51.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 -- start start 2021-06-25T04:56:51.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c80061eb0 0x7f7c80060ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c80064b60 0x7f7c8015a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c800b1f90 0x7f7c800ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c800b1b90 con 0x7f7c80064b60 2021-06-25T04:56:51.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c801597b0 con 0x7f7c80061eb0 2021-06-25T04:56:51.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c84dfe700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c80159a50 con 0x7f7c800b1f90 2021-06-25T04:56:51.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.175+0000 7f7c7effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c80064b60 0x7f7c8015a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c80064b60 0x7f7c8015a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43802/0 (socket says 172.21.15.57:43802) 2021-06-25T04:56:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c80061eb0 0x7f7c80060ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7effd700 1 -- 172.21.15.57:0/1685305884 learned_addr learned my addr 172.21.15.57:0/1685305884 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7ffff700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c800b1f90 0x7f7c800ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7effd700 1 -- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c800b1f90 msgr2=0x7f7c800ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7effd700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c800b1f90 0x7f7c800ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7effd700 1 -- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c80061eb0 msgr2=0x7f7c80060ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7effd700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c80061eb0 0x7f7c80060ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7effd700 1 -- 172.21.15.57:0/1685305884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7000b1e0 con 0x7f7c80064b60 2021-06-25T04:56:51.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7effd700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c80064b60 0x7f7c8015a190 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f7c6800c000 tx=0x7f7c680091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:51.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7cff9700 1 -- 172.21.15.57:0/1685305884 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c68012600 con 0x7f7c80064b60 2021-06-25T04:56:51.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7cff9700 1 -- 172.21.15.57:0/1685305884 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c68012760 con 0x7f7c80064b60 2021-06-25T04:56:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c84dfe700 1 -- 172.21.15.57:0/1685305884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c80159cf0 con 0x7f7c80064b60 2021-06-25T04:56:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7cff9700 1 -- 172.21.15.57:0/1685305884 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c68012ac0 con 0x7f7c80064b60 2021-06-25T04:56:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c84dfe700 1 -- 172.21.15.57:0/1685305884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c800b09f0 con 0x7f7c80064b60 2021-06-25T04:56:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c84dfe700 1 -- 172.21.15.57:0/1685305884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c80159e80 con 0x7f7c80064b60 2021-06-25T04:56:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7cff9700 1 -- 172.21.15.57:0/1685305884 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7c68022070 con 0x7f7c80064b60 2021-06-25T04:56:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7cff9700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c64055340 0x7f7c64057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.179+0000 7f7c7cff9700 1 -- 172.21.15.57:0/1685305884 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f7c6806e180 con 0x7f7c80064b60 2021-06-25T04:56:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.183+0000 7f7c7f7fe700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c64055340 0x7f7c64057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.183+0000 7f7c7f7fe700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c64055340 0x7f7c64057800 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f7c7001b000 tx=0x7f7c70015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.187+0000 7f7c7cff9700 1 -- 172.21.15.57:0/1685305884 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7c68044570 con 0x7f7c80064b60 2021-06-25T04:56:51.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.359+0000 7f7c84dfe700 1 -- 172.21.15.57:0/1685305884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7c80057310 con 0x7f7c80064b60 2021-06-25T04:56:51.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.359+0000 7f7c7cff9700 1 -- 172.21.15.57:0/1685305884 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f7c68047b90 con 0x7f7c80064b60 2021-06-25T04:56:51.364 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:51.365 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:56:51.365 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:56:51.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.368 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:56:51.368 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:56:51.368 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.369 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:56:51.369 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.369 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.369 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.370 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.370 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:56:51.370 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:56:51.371 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.371 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:56:51.371 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.371 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.372 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.372 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.373 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:56:51.373 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:56:51.374 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.374 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:56:51.374 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.374 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.375 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.375 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.376 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:56:51.376 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:56:51.376 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.376 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.376 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.377 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.377 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.378 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:56:51.378 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:56:51.378 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.378 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.378 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.379 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.379 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.381 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:56:51.381 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:56:51.381 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.381 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.381 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.382 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.382 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.383 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:56:51.383 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:56:51.383 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.383 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.384 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.384 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.384 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.385 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:56:51.385 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:56:51.386 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.386 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.386 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.386 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.386 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.387 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:56:51.387 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:56:51.388 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.388 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.388 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.388 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.388 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.389 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:56:51.390 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:56:51.390 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.390 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.390 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.390 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.391 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.391 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:56:51.392 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:56:51.392 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.392 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.392 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.392 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.393 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:56:51.394 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:56:51.394 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.394 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:56:51.394 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:56:51.394 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:56:51.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.395 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:56:51.395 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:56:51.396 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.396 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:56:51.396 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:56:51.396 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:56:51.397 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.397 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:56:51.397 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:56:51.398 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.398 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:56:51.398 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:56:51.398 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:56:51.399 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.399 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.400 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:56:51.400 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:56:51.400 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.401 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:56:51.401 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:56:51.401 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.401 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:51.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:51.402 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:56:51.402 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:56:51.402 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:56:51.403 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:56:51.403 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:56:51.403 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:56:51.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:51.404 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:56:51.404 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:56:51.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 -- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c64055340 msgr2=0x7f7c64057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c64055340 0x7f7c64057800 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f7c7001b000 tx=0x7f7c70015000).stop 2021-06-25T04:56:51.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 -- 172.21.15.57:0/1685305884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c80064b60 msgr2=0x7f7c8015a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c80064b60 0x7f7c8015a190 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f7c6800c000 tx=0x7f7c680091d0).stop 2021-06-25T04:56:51.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 -- 172.21.15.57:0/1685305884 shutdown_connections 2021-06-25T04:56:51.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7c64055340 0x7f7c64057800 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c800b1f90 0x7f7c800ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c80064b60 0x7f7c8015a190 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 --2- 172.21.15.57:0/1685305884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c80061eb0 0x7f7c80060ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 -- 172.21.15.57:0/1685305884 >> 172.21.15.57:0/1685305884 conn(0x7f7c80062ba0 msgr2=0x7f7c80148680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:51.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 -- 172.21.15.57:0/1685305884 shutdown_connections 2021-06-25T04:56:51.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.363+0000 7f7c84dfe700 1 -- 172.21.15.57:0/1685305884 wait complete. 2021-06-25T04:56:51.412 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:51.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 Processor -- start 2021-06-25T04:56:51.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 -- start start 2021-06-25T04:56:51.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ce80ae390 0x7f4ce8147690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ce80b0920 0x7f4ce8147b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce805f670 con 0x7f4ce805c450 2021-06-25T04:56:51.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce80ae770 con 0x7f4ce80b0920 2021-06-25T04:56:51.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce805f8a0 con 0x7f4ce80ae390 2021-06-25T04:56:51.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce5d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ce80b0920 0x7f4ce8147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce5d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ce80b0920 0x7f4ce8147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43810/0 (socket says 172.21.15.57:43810) 2021-06-25T04:56:51.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce5d9b700 1 -- 172.21.15.57:0/3225205566 learned_addr learned my addr 172.21.15.57:0/3225205566 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:51.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce659c700 1 --2- 172.21.15.57:0/3225205566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ce80ae390 0x7f4ce8147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce5d9b700 1 -- 172.21.15.57:0/3225205566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ce80ae390 msgr2=0x7f4ce8147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:51.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce5d9b700 1 --2- 172.21.15.57:0/3225205566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ce80ae390 0x7f4ce8147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce5d9b700 1 -- 172.21.15.57:0/3225205566 >> v1:172.21.15.87:6789/0 conn(0x7f4ce805c450 legacy=0x7f4ce80a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce5d9b700 1 -- 172.21.15.57:0/3225205566 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce805fb40 con 0x7f4ce80b0920 2021-06-25T04:56:51.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce659c700 1 --2- 172.21.15.57:0/3225205566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ce80ae390 0x7f4ce8147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:51.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce5d9b700 1 --2- 172.21.15.57:0/3225205566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ce80b0920 0x7f4ce8147b80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f4ce00032f0 tx=0x7f4ce0009290).ready entity=mon.0 client_cookie=696ee69aba116c8d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:51.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce559a700 1 -- 172.21.15.57:0/3225205566 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ce000b8a0 con 0x7f4ce80b0920 2021-06-25T04:56:51.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce559a700 1 -- 172.21.15.57:0/3225205566 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce000ba00 con 0x7f4ce80b0920 2021-06-25T04:56:51.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ce559a700 1 -- 172.21.15.57:0/3225205566 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ce000bb70 con 0x7f4ce80b0920 2021-06-25T04:56:51.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 -- 172.21.15.57:0/3225205566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ce80b0920 msgr2=0x7f4ce8147b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 --2- 172.21.15.57:0/3225205566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ce80b0920 0x7f4ce8147b80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f4ce00032f0 tx=0x7f4ce0009290).stop 2021-06-25T04:56:51.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 -- 172.21.15.57:0/3225205566 shutdown_connections 2021-06-25T04:56:51.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 --2- 172.21.15.57:0/3225205566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ce80b0920 0x7f4ce8147b80 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 --2- 172.21.15.57:0/3225205566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ce80ae390 0x7f4ce8147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 -- 172.21.15.57:0/3225205566 >> 172.21.15.57:0/3225205566 conn(0x7f4ce805cce0 msgr2=0x7f4ce8062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:51.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 -- 172.21.15.57:0/3225205566 shutdown_connections 2021-06-25T04:56:51.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.519+0000 7f4ceca26700 1 -- 172.21.15.57:0/3225205566 wait complete. 2021-06-25T04:56:51.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ceca26700 1 Processor -- start 2021-06-25T04:56:51.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ceca26700 1 -- start start 2021-06-25T04:56:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ceca26700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ce805c450 0x7f4ce80658e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ceca26700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ce80ae390 0x7f4ce8065dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ceca26700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ce80b0920 0x7f4ce81565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ceca26700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80662c0 con 0x7f4ce80b0920 2021-06-25T04:56:51.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ceca26700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce8157290 con 0x7f4ce805c450 2021-06-25T04:56:51.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ceca26700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce8157530 con 0x7f4ce80ae390 2021-06-25T04:56:51.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ce6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ce80b0920 0x7f4ce81565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ce659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ce805c450 0x7f4ce80658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ce5d9b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ce80ae390 0x7f4ce8065dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ce6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ce80b0920 0x7f4ce81565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43820/0 (socket says 172.21.15.57:43820) 2021-06-25T04:56:51.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ce6d9d700 1 -- 172.21.15.57:0/3335916663 learned_addr learned my addr 172.21.15.57:0/3335916663 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:51.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ce6d9d700 1 -- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ce80ae390 msgr2=0x7f4ce8065dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ce6d9d700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ce80ae390 0x7f4ce8065dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ce6d9d700 1 -- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ce805c450 msgr2=0x7f4ce80658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ce6d9d700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ce805c450 0x7f4ce80658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ce6d9d700 1 -- 172.21.15.57:0/3335916663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0009530 con 0x7f4ce80b0920 2021-06-25T04:56:51.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4ce6d9d700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ce80b0920 0x7f4ce81565e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f4ce8063670 tx=0x7f4cd8007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:51.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.523+0000 7f4cdf7fe700 1 -- 172.21.15.57:0/3335916663 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cd8012400 con 0x7f4ce80b0920 2021-06-25T04:56:51.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.527+0000 7f4cdf7fe700 1 -- 172.21.15.57:0/3335916663 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd8012560 con 0x7f4ce80b0920 2021-06-25T04:56:51.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.527+0000 7f4ceca26700 1 -- 172.21.15.57:0/3335916663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce8064c00 con 0x7f4ce80b0920 2021-06-25T04:56:51.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.527+0000 7f4cdf7fe700 1 -- 172.21.15.57:0/3335916663 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cd80128c0 con 0x7f4ce80b0920 2021-06-25T04:56:51.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.527+0000 7f4ceca26700 1 -- 172.21.15.57:0/3335916663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce8064250 con 0x7f4ce80b0920 2021-06-25T04:56:51.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.527+0000 7f4ceca26700 1 -- 172.21.15.57:0/3335916663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce8057310 con 0x7f4ce80b0920 2021-06-25T04:56:51.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.527+0000 7f4cdf7fe700 1 -- 172.21.15.57:0/3335916663 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4cd8019030 con 0x7f4ce80b0920 2021-06-25T04:56:51.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.527+0000 7f4cdf7fe700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ccc055450 0x7f4ccc057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.527+0000 7f4cdf7fe700 1 -- 172.21.15.57:0/3335916663 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f4cd806ced0 con 0x7f4ce80b0920 2021-06-25T04:56:51.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.527+0000 7f4ce659c700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ccc055450 0x7f4ccc057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.531+0000 7f4ce659c700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ccc055450 0x7f4ccc057910 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f4cd000c000 tx=0x7f4cd0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:51.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.535+0000 7f4cdf7fe700 1 -- 172.21.15.57:0/3335916663 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4cd8043320 con 0x7f4ce80b0920 2021-06-25T04:56:51.675 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.671+0000 7f4ceca26700 1 -- 172.21.15.57:0/3335916663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ce8064d90 con 0x7f4ce80b0920 2021-06-25T04:56:51.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.671+0000 7f4cdf7fe700 1 -- 172.21.15.57:0/3335916663 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f4cd8046940 con 0x7f4ce80b0920 2021-06-25T04:56:51.678 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:51.678 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":145,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:51.031730+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:51.680 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 -- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ccc055450 msgr2=0x7f4ccc057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ccc055450 0x7f4ccc057910 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f4cd000c000 tx=0x7f4cd0008040).stop 2021-06-25T04:56:51.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 -- 172.21.15.57:0/3335916663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ce80b0920 msgr2=0x7f4ce81565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ce80b0920 0x7f4ce81565e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f4ce8063670 tx=0x7f4cd8007b90).stop 2021-06-25T04:56:51.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 -- 172.21.15.57:0/3335916663 shutdown_connections 2021-06-25T04:56:51.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4ccc055450 0x7f4ccc057910 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ce80b0920 0x7f4ce81565e0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ce80ae390 0x7f4ce8065dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 --2- 172.21.15.57:0/3335916663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ce805c450 0x7f4ce80658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 -- 172.21.15.57:0/3335916663 >> 172.21.15.57:0/3335916663 conn(0x7f4ce805cce0 msgr2=0x7f4ce80b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:51.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 -- 172.21.15.57:0/3335916663 shutdown_connections 2021-06-25T04:56:51.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.675+0000 7f4ceca26700 1 -- 172.21.15.57:0/3335916663 wait complete. 2021-06-25T04:56:51.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:56:51.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:56:51.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d66f8700 1 Processor -- start 2021-06-25T04:56:51.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d66f8700 1 -- start start 2021-06-25T04:56:51.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d66f8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5d00ad580 0x7fe5d00616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d66f8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d00aecb0 con 0x7fe5d00612e0 2021-06-25T04:56:51.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d66f8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d00b6ee0 con 0x7fe5d0140400 2021-06-25T04:56:51.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d66f8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00aeee0 con 0x7fe5d00ad580 2021-06-25T04:56:51.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d56f6700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe5d00612e0 0x7fe5d00b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32810/0 (socket says 172.21.15.57:32810) 2021-06-25T04:56:51.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d56f6700 1 -- 172.21.15.57:0/3885985093 learned_addr learned my addr 172.21.15.57:0/3885985093 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:51.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d4ef5700 1 --2- 172.21.15.57:0/3885985093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5d00ad580 0x7fe5d00616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.816 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5c7fff700 1 -- 172.21.15.57:0/3885985093 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936812420 0 0) 0x7fe5d00aecb0 con 0x7fe5d00612e0 2021-06-25T04:56:51.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5c7fff700 1 -- 172.21.15.57:0/3885985093 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b4003260 con 0x7fe5d00612e0 2021-06-25T04:56:51.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5c7fff700 1 -- 172.21.15.57:0/3885985093 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902765841 0 0) 0x7fe5d00b6ee0 con 0x7fe5d0140400 2021-06-25T04:56:51.817 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5c7fff700 1 -- 172.21.15.57:0/3885985093 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5d00aecb0 con 0x7fe5d0140400 2021-06-25T04:56:51.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5c7fff700 1 -- 172.21.15.57:0/3885985093 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4286733970 0 0) 0x7fe5b4003260 con 0x7fe5d00612e0 2021-06-25T04:56:51.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d4ef5700 1 -- 172.21.15.57:0/3885985093 >> v1:172.21.15.87:6789/0 conn(0x7fe5d0140400 legacy=0x7fe5d01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d4ef5700 1 -- 172.21.15.57:0/3885985093 >> v1:172.21.15.57:6789/0 conn(0x7fe5d00612e0 legacy=0x7fe5d00b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d4ef5700 1 -- 172.21.15.57:0/3885985093 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d00af180 con 0x7fe5d00ad580 2021-06-25T04:56:51.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d4ef5700 1 --2- 172.21.15.57:0/3885985093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5d00ad580 0x7fe5d00616c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fe5cc001110 tx=0x7fe5c0006df0).ready entity=mon.2 client_cookie=65b76ad0c2af4259 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:51.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5c7fff700 1 -- 172.21.15.57:0/3885985093 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc001660 con 0x7fe5d00ad580 2021-06-25T04:56:51.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5c7fff700 1 -- 172.21.15.57:0/3885985093 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c0000e90 con 0x7fe5d00ad580 2021-06-25T04:56:51.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5c7fff700 1 -- 172.21.15.57:0/3885985093 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5c0012460 con 0x7fe5d00ad580 2021-06-25T04:56:51.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d66f8700 1 -- 172.21.15.57:0/3885985093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5d00ad580 msgr2=0x7fe5d00616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.803+0000 7fe5d66f8700 1 --2- 172.21.15.57:0/3885985093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5d00ad580 0x7fe5d00616c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fe5cc001110 tx=0x7fe5c0006df0).stop 2021-06-25T04:56:51.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 -- 172.21.15.57:0/3885985093 shutdown_connections 2021-06-25T04:56:51.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 --2- 172.21.15.57:0/3885985093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5d00ad580 0x7fe5d00616c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 -- 172.21.15.57:0/3885985093 >> 172.21.15.57:0/3885985093 conn(0x7fe5d0066da0 msgr2=0x7fe5d0067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:51.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 -- 172.21.15.57:0/3885985093 shutdown_connections 2021-06-25T04:56:51.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 -- 172.21.15.57:0/3885985093 wait complete. 2021-06-25T04:56:51.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 Processor -- start 2021-06-25T04:56:51.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 -- start start 2021-06-25T04:56:51.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d00612e0 0x7fe5d01562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d00ad580 0x7fe5d0145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5d0140400 0x7fe5d00ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d009ea30 con 0x7fe5d00ad580 2021-06-25T04:56:51.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d009ecd0 con 0x7fe5d00612e0 2021-06-25T04:56:51.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d66f8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d009ef70 con 0x7fe5d0140400 2021-06-25T04:56:51.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.807+0000 7fe5d4ef5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d00ad580 0x7fe5d0145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d4ef5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d00ad580 0x7fe5d0145670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43832/0 (socket says 172.21.15.57:43832) 2021-06-25T04:56:51.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d4ef5700 1 -- 172.21.15.57:0/470169794 learned_addr learned my addr 172.21.15.57:0/470169794 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:51.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d5ef7700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5d0140400 0x7fe5d00ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d56f6700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d00612e0 0x7fe5d01562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d4ef5700 1 -- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5d0140400 msgr2=0x7fe5d00ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d4ef5700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5d0140400 0x7fe5d00ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d4ef5700 1 -- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d00612e0 msgr2=0x7fe5d01562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d4ef5700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d00612e0 0x7fe5d01562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d4ef5700 1 -- 172.21.15.57:0/470169794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c000b180 con 0x7fe5d00ad580 2021-06-25T04:56:51.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d4ef5700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d00ad580 0x7fe5d0145670 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7fe5cc001110 tx=0x7fe5c0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:51.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5c67fc700 1 -- 172.21.15.57:0/470169794 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5c0012460 con 0x7fe5d00ad580 2021-06-25T04:56:51.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5c67fc700 1 -- 172.21.15.57:0/470169794 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c000dd40 con 0x7fe5d00ad580 2021-06-25T04:56:51.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d66f8700 1 -- 172.21.15.57:0/470169794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d0146320 con 0x7fe5d00ad580 2021-06-25T04:56:51.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5c67fc700 1 -- 172.21.15.57:0/470169794 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5c0006b20 con 0x7fe5d00ad580 2021-06-25T04:56:51.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d66f8700 1 -- 172.21.15.57:0/470169794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d00b2b20 con 0x7fe5d00ad580 2021-06-25T04:56:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5d66f8700 1 -- 172.21.15.57:0/470169794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d009e870 con 0x7fe5d00ad580 2021-06-25T04:56:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5c67fc700 1 -- 172.21.15.57:0/470169794 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe5c000f030 con 0x7fe5d00ad580 2021-06-25T04:56:51.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5c67fc700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe5b80554e0 0x7fe5b80579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:51.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.811+0000 7fe5c67fc700 1 -- 172.21.15.57:0/470169794 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fe5c006e960 con 0x7fe5d00ad580 2021-06-25T04:56:51.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.815+0000 7fe5d56f6700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe5b80554e0 0x7fe5b80579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:51.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.815+0000 7fe5d56f6700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe5b80554e0 0x7fe5b80579a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fe5cc00d000 tx=0x7fe5cc000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:51.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.819+0000 7fe5c67fc700 1 -- 172.21.15.57:0/470169794 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe5c0044e50 con 0x7fe5d00ad580 2021-06-25T04:56:51.954 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.947+0000 7fe5d66f8700 1 -- 172.21.15.57:0/470169794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe5d0057310 con 0x7fe5d00ad580 2021-06-25T04:56:51.955 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.947+0000 7fe5c67fc700 1 -- 172.21.15.57:0/470169794 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v145) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe5c0023020 con 0x7fe5d00ad580 2021-06-25T04:56:51.955 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:56:51.956 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 -- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe5b80554e0 msgr2=0x7fe5b80579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe5b80554e0 0x7fe5b80579a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fe5cc00d000 tx=0x7fe5cc000bc0).stop 2021-06-25T04:56:51.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 -- 172.21.15.57:0/470169794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d00ad580 msgr2=0x7fe5d0145670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:51.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d00ad580 0x7fe5d0145670 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7fe5cc001110 tx=0x7fe5c0014000).stop 2021-06-25T04:56:51.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 -- 172.21.15.57:0/470169794 shutdown_connections 2021-06-25T04:56:51.957 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe5b80554e0 0x7fe5b80579a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe5d0140400 0x7fe5d00ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5d00ad580 0x7fe5d0145670 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 --2- 172.21.15.57:0/470169794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5d00612e0 0x7fe5d01562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:51.958 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 -- 172.21.15.57:0/470169794 >> 172.21.15.57:0/470169794 conn(0x7fe5d0066da0 msgr2=0x7fe5d00b7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:51.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 -- 172.21.15.57:0/470169794 shutdown_connections 2021-06-25T04:56:51.959 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:51.951+0000 7fe5d66f8700 1 -- 172.21.15.57:0/470169794 wait complete. 2021-06-25T04:56:51.967 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:56:52.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7efff1450700 1 Processor -- start 2021-06-25T04:56:52.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7efff1450700 1 -- start start 2021-06-25T04:56:52.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7efff1450700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7effec146910 0x7effec1401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7efff1450700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec143b20 con 0x7effec0b4140 2021-06-25T04:56:52.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7efff1450700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec143dc0 con 0x7effec0b4650 2021-06-25T04:56:52.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7efff1450700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec1474d0 con 0x7effec146910 2021-06-25T04:56:52.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effea7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7effec0b4140 0x7effec1406e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32826/0 (socket says 172.21.15.57:32826) 2021-06-25T04:56:52.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effea7fc700 1 -- 172.21.15.57:0/2643487391 learned_addr learned my addr 172.21.15.57:0/2643487391 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:52.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effeaffd700 1 --2- 172.21.15.57:0/2643487391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7effec146910 0x7effec1401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effe9ffb700 1 -- 172.21.15.57:0/2643487391 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300307682 0 0) 0x7effec143b20 con 0x7effec0b4140 2021-06-25T04:56:52.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effe9ffb700 1 -- 172.21.15.57:0/2643487391 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effcc003260 con 0x7effec0b4140 2021-06-25T04:56:52.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effe9ffb700 1 -- 172.21.15.57:0/2643487391 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177273519 0 0) 0x7effec143dc0 con 0x7effec0b4650 2021-06-25T04:56:52.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effe9ffb700 1 -- 172.21.15.57:0/2643487391 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effec143b20 con 0x7effec0b4650 2021-06-25T04:56:52.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effeaffd700 1 -- 172.21.15.57:0/2643487391 >> v1:172.21.15.87:6789/0 conn(0x7effec0b4650 legacy=0x7effec0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effeaffd700 1 -- 172.21.15.57:0/2643487391 >> v1:172.21.15.57:6789/0 conn(0x7effec0b4140 legacy=0x7effec1406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effeaffd700 1 -- 172.21.15.57:0/2643487391 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec0b0c50 con 0x7effec146910 2021-06-25T04:56:52.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effeaffd700 1 --2- 172.21.15.57:0/2643487391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7effec146910 0x7effec1401f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7effdc002f70 tx=0x7effdc006df0).ready entity=mon.2 client_cookie=e89db2cc7018155b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:52.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effe9ffb700 1 -- 172.21.15.57:0/2643487391 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effdc00d5c0 con 0x7effec146910 2021-06-25T04:56:52.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effe9ffb700 1 -- 172.21.15.57:0/2643487391 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc000e90 con 0x7effec146910 2021-06-25T04:56:52.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7effe9ffb700 1 -- 172.21.15.57:0/2643487391 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effdc00d910 con 0x7effec146910 2021-06-25T04:56:52.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7efff1450700 1 -- 172.21.15.57:0/2643487391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7effec146910 msgr2=0x7effec1401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.067+0000 7efff1450700 1 --2- 172.21.15.57:0/2643487391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7effec146910 0x7effec1401f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7effdc002f70 tx=0x7effdc006df0).stop 2021-06-25T04:56:52.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 -- 172.21.15.57:0/2643487391 shutdown_connections 2021-06-25T04:56:52.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 --2- 172.21.15.57:0/2643487391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7effec146910 0x7effec1401f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 -- 172.21.15.57:0/2643487391 >> 172.21.15.57:0/2643487391 conn(0x7effec05c450 msgr2=0x7effec05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:52.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 -- 172.21.15.57:0/2643487391 shutdown_connections 2021-06-25T04:56:52.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 -- 172.21.15.57:0/2643487391 wait complete. 2021-06-25T04:56:52.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 Processor -- start 2021-06-25T04:56:52.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 -- start start 2021-06-25T04:56:52.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7effec0b4140 0x7effec0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effec0b4650 0x7effec0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec146910 0x7effec155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec0ad5b0 con 0x7effec0b4650 2021-06-25T04:56:52.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec0ad7e0 con 0x7effec146910 2021-06-25T04:56:52.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7efff1450700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec0afbb0 con 0x7effec0b4140 2021-06-25T04:56:52.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7effea7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effec0b4650 0x7effec0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7effea7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effec0b4650 0x7effec0b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43844/0 (socket says 172.21.15.57:43844) 2021-06-25T04:56:52.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.071+0000 7effea7fc700 1 -- 172.21.15.57:0/513269124 learned_addr learned my addr 172.21.15.57:0/513269124 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:52.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effeaffd700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7effec0b4140 0x7effec0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effeb7fe700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec146910 0x7effec155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effea7fc700 1 -- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7effec0b4140 msgr2=0x7effec0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effea7fc700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7effec0b4140 0x7effec0b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effea7fc700 1 -- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec146910 msgr2=0x7effec155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effea7fc700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec146910 0x7effec155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effea7fc700 1 -- 172.21.15.57:0/513269124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc00b180 con 0x7effec0b4650 2021-06-25T04:56:52.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effeb7fe700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec146910 0x7effec155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:52.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effea7fc700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effec0b4650 0x7effec0b54f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7effd4001110 tx=0x7effd4007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:52.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effe3fff700 1 -- 172.21.15.57:0/513269124 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd400ce20 con 0x7effec0b4650 2021-06-25T04:56:52.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effe3fff700 1 -- 172.21.15.57:0/513269124 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd40072e0 con 0x7effec0b4650 2021-06-25T04:56:52.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7efff1450700 1 -- 172.21.15.57:0/513269124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec0afe50 con 0x7effec0b4650 2021-06-25T04:56:52.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7efff1450700 1 -- 172.21.15.57:0/513269124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec0ae430 con 0x7effec0b4650 2021-06-25T04:56:52.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effe3fff700 1 -- 172.21.15.57:0/513269124 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd4005800 con 0x7effec0b4650 2021-06-25T04:56:52.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7efff1450700 1 -- 172.21.15.57:0/513269124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec142d60 con 0x7effec0b4650 2021-06-25T04:56:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effe3fff700 1 -- 172.21.15.57:0/513269124 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7effd401a060 con 0x7effec0b4650 2021-06-25T04:56:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effe3fff700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7effd00553d0 0x7effd0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effe3fff700 1 -- 172.21.15.57:0/513269124 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5600+0+0 (secure 0 0 0) 0x7effd406d360 con 0x7effec0b4650 2021-06-25T04:56:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.075+0000 7effeaffd700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7effd00553d0 0x7effd0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.079+0000 7effeaffd700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7effd00553d0 0x7effd0057890 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7effdc017000 tx=0x7effdc014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:52.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.083+0000 7effe3fff700 1 -- 172.21.15.57:0/513269124 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7effd4043850 con 0x7effec0b4650 2021-06-25T04:56:52.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.207+0000 7efff1450700 1 -- 172.21.15.57:0/513269124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7effec0affe0 con 0x7effec0b4650 2021-06-25T04:56:52.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.207+0000 7effe3fff700 1 -- 172.21.15.57:0/513269124 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v145) v1 ==== 92+0+10 (secure 0 0 0) 0x7effd4018020 con 0x7effec0b4650 2021-06-25T04:56:52.214 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:52.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 -- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7effd00553d0 msgr2=0x7effd0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7effd00553d0 0x7effd0057890 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7effdc017000 tx=0x7effdc014000).stop 2021-06-25T04:56:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 -- 172.21.15.57:0/513269124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effec0b4650 msgr2=0x7effec0b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effec0b4650 0x7effec0b54f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7effd4001110 tx=0x7effd4007af0).stop 2021-06-25T04:56:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 -- 172.21.15.57:0/513269124 shutdown_connections 2021-06-25T04:56:52.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7effd00553d0 0x7effd0057890 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effec146910 0x7effec155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effec0b4650 0x7effec0b54f0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 --2- 172.21.15.57:0/513269124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7effec0b4140 0x7effec0b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 -- 172.21.15.57:0/513269124 >> 172.21.15.57:0/513269124 conn(0x7effec05c450 msgr2=0x7effec0b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:52.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 -- 172.21.15.57:0/513269124 shutdown_connections 2021-06-25T04:56:52.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.211+0000 7efff1450700 1 -- 172.21.15.57:0/513269124 wait complete. 2021-06-25T04:56:52.226 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:56:52.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.323+0000 7ffa5f50c700 1 Processor -- start 2021-06-25T04:56:52.330 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.323+0000 7ffa5f50c700 1 -- start start 2021-06-25T04:56:52.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5f50c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa580b46d0 0x7ffa5813fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5f50c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa580b68d0 con 0x7ffa58061640 2021-06-25T04:56:52.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5f50c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa580b6b70 con 0x7ffa58143960 2021-06-25T04:56:52.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5f50c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa580b9640 con 0x7ffa580b46d0 2021-06-25T04:56:52.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5e50a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffa58061640 0x7ffa580b9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32838/0 (socket says 172.21.15.57:32838) 2021-06-25T04:56:52.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5e50a700 1 -- 172.21.15.57:0/3666195111 learned_addr learned my addr 172.21.15.57:0/3666195111 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:52.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5dd09700 1 --2- 172.21.15.57:0/3666195111 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa580b46d0 0x7ffa5813fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5d508700 1 -- 172.21.15.57:0/3666195111 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507789170 0 0) 0x7ffa580b68d0 con 0x7ffa58061640 2021-06-25T04:56:52.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5d508700 1 -- 172.21.15.57:0/3666195111 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa40003260 con 0x7ffa58061640 2021-06-25T04:56:52.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5d508700 1 -- 172.21.15.57:0/3666195111 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262757408 0 0) 0x7ffa580b6b70 con 0x7ffa58143960 2021-06-25T04:56:52.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5d508700 1 -- 172.21.15.57:0/3666195111 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa580b68d0 con 0x7ffa58143960 2021-06-25T04:56:52.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5dd09700 1 -- 172.21.15.57:0/3666195111 >> v1:172.21.15.87:6789/0 conn(0x7ffa58143960 legacy=0x7ffa58140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5dd09700 1 -- 172.21.15.57:0/3666195111 >> v1:172.21.15.57:6789/0 conn(0x7ffa58061640 legacy=0x7ffa580b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5dd09700 1 -- 172.21.15.57:0/3666195111 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa580b6e10 con 0x7ffa580b46d0 2021-06-25T04:56:52.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5dd09700 1 --2- 172.21.15.57:0/3666195111 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa580b46d0 0x7ffa5813fd60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ffa48002f70 tx=0x7ffa48006df0).ready entity=mon.2 client_cookie=b2b3e25fb4d91299 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:52.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5d508700 1 -- 172.21.15.57:0/3666195111 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa4800d5c0 con 0x7ffa580b46d0 2021-06-25T04:56:52.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5d508700 1 -- 172.21.15.57:0/3666195111 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa48000e90 con 0x7ffa580b46d0 2021-06-25T04:56:52.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5d508700 1 -- 172.21.15.57:0/3666195111 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa4800d910 con 0x7ffa580b46d0 2021-06-25T04:56:52.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3666195111 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa580b46d0 msgr2=0x7ffa5813fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.327+0000 7ffa5f50c700 1 --2- 172.21.15.57:0/3666195111 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa580b46d0 0x7ffa5813fd60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ffa48002f70 tx=0x7ffa48006df0).stop 2021-06-25T04:56:52.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3666195111 shutdown_connections 2021-06-25T04:56:52.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 --2- 172.21.15.57:0/3666195111 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa580b46d0 0x7ffa5813fd60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3666195111 >> 172.21.15.57:0/3666195111 conn(0x7ffa5806adb0 msgr2=0x7ffa5805f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:52.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3666195111 shutdown_connections 2021-06-25T04:56:52.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3666195111 wait complete. 2021-06-25T04:56:52.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 Processor -- start 2021-06-25T04:56:52.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 -- start start 2021-06-25T04:56:52.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa58061640 0x7ffa58149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa58143960 0x7ffa581557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa58155c90 0x7ffa580b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa58139130 con 0x7ffa58061640 2021-06-25T04:56:52.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa581393e0 con 0x7ffa58155c90 2021-06-25T04:56:52.345 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5f50c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa58139680 con 0x7ffa58143960 2021-06-25T04:56:52.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5e50a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa58061640 0x7ffa58149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5e50a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa58061640 0x7ffa58149a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43858/0 (socket says 172.21.15.57:43858) 2021-06-25T04:56:52.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5e50a700 1 -- 172.21.15.57:0/3218081769 learned_addr learned my addr 172.21.15.57:0/3218081769 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:52.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5dd09700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa58143960 0x7ffa581557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.331+0000 7ffa5ed0b700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa58155c90 0x7ffa580b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa5e50a700 1 -- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa58143960 msgr2=0x7ffa581557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa5e50a700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa58143960 0x7ffa581557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa5e50a700 1 -- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa58155c90 msgr2=0x7ffa580b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa5e50a700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa58155c90 0x7ffa580b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa5e50a700 1 -- 172.21.15.57:0/3218081769 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4800b180 con 0x7ffa58061640 2021-06-25T04:56:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa5e50a700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa58061640 0x7ffa58149a10 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7ffa540010d0 tx=0x7ffa54007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa477fe700 1 -- 172.21.15.57:0/3218081769 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa540070d0 con 0x7ffa58061640 2021-06-25T04:56:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa477fe700 1 -- 172.21.15.57:0/3218081769 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54007230 con 0x7ffa58061640 2021-06-25T04:56:52.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3218081769 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa581474c0 con 0x7ffa58061640 2021-06-25T04:56:52.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa477fe700 1 -- 172.21.15.57:0/3218081769 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa54005610 con 0x7ffa58061640 2021-06-25T04:56:52.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3218081769 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa58147a00 con 0x7ffa58061640 2021-06-25T04:56:52.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3218081769 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa58057310 con 0x7ffa58061640 2021-06-25T04:56:52.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa477fe700 1 -- 172.21.15.57:0/3218081769 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ffa54010070 con 0x7ffa58061640 2021-06-25T04:56:52.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa477fe700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa38055450 0x7ffa38057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.335+0000 7ffa477fe700 1 -- 172.21.15.57:0/3218081769 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ffa5406d210 con 0x7ffa58061640 2021-06-25T04:56:52.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.339+0000 7ffa5dd09700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa38055450 0x7ffa38057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.339+0000 7ffa5dd09700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa38055450 0x7ffa38057910 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7ffa48019000 tx=0x7ffa48014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.343+0000 7ffa477fe700 1 -- 172.21.15.57:0/3218081769 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ffa540436a0 con 0x7ffa58061640 2021-06-25T04:56:52.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.475+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3218081769 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffa58147c00 con 0x7ffa58061640 2021-06-25T04:56:52.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.479+0000 7ffa477fe700 1 -- 172.21.15.57:0/3218081769 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v145) v1 ==== 84+0+143 (secure 0 0 0) 0x7ffa54046cc0 con 0x7ffa58061640 2021-06-25T04:56:52.484 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:52.484 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:56:52.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:52.485 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:56:52.485 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:56:52.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:56:52.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:56:52.486 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:56:52.486 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:56:52.486 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:56:52.486 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:56:52.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa38055450 msgr2=0x7ffa38057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa38055450 0x7ffa38057910 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7ffa48019000 tx=0x7ffa48014000).stop 2021-06-25T04:56:52.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3218081769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa58061640 msgr2=0x7ffa58149a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa58061640 0x7ffa58149a10 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7ffa540010d0 tx=0x7ffa54007b00).stop 2021-06-25T04:56:52.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3218081769 shutdown_connections 2021-06-25T04:56:52.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa38055450 0x7ffa38057910 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa58155c90 0x7ffa580b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa58143960 0x7ffa581557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 --2- 172.21.15.57:0/3218081769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa58061640 0x7ffa58149a10 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3218081769 >> 172.21.15.57:0/3218081769 conn(0x7ffa5806adb0 msgr2=0x7ffa58142e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:52.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3218081769 shutdown_connections 2021-06-25T04:56:52.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.483+0000 7ffa5f50c700 1 -- 172.21.15.57:0/3218081769 wait complete. 2021-06-25T04:56:52.500 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:56:52.501 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:56:52.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.607+0000 7f41e0d47700 1 Processor -- start 2021-06-25T04:56:52.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.607+0000 7f41e0d47700 1 -- start start 2021-06-25T04:56:52.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.607+0000 7f41e0d47700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060160 0x7f41dc0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.607+0000 7f41e0d47700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc0aa460 con 0x7f41dc05c520 2021-06-25T04:56:52.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.607+0000 7f41e0d47700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc05fb40 con 0x7f41dc0af380 2021-06-25T04:56:52.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41e0d47700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0b1410 con 0x7f41dc060160 2021-06-25T04:56:52.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41dbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f41dc05c520 0x7f41dc0a8bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32856/0 (socket says 172.21.15.57:32856) 2021-06-25T04:56:52.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41dbfff700 1 -- 172.21.15.57:0/1815899904 learned_addr learned my addr 172.21.15.57:0/1815899904 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:52.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41d3fff700 1 --2- 172.21.15.57:0/1815899904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060160 0x7f41dc0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41daffd700 1 -- 172.21.15.57:0/1815899904 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423154992 0 0) 0x7f41dc0aa460 con 0x7f41dc05c520 2021-06-25T04:56:52.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41daffd700 1 -- 172.21.15.57:0/1815899904 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41bc003260 con 0x7f41dc05c520 2021-06-25T04:56:52.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41daffd700 1 -- 172.21.15.57:0/1815899904 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359819312 0 0) 0x7f41dc05fb40 con 0x7f41dc0af380 2021-06-25T04:56:52.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41daffd700 1 -- 172.21.15.57:0/1815899904 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41dc0aa460 con 0x7f41dc0af380 2021-06-25T04:56:52.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41d3fff700 1 -- 172.21.15.57:0/1815899904 >> v1:172.21.15.87:6789/0 conn(0x7f41dc0af380 legacy=0x7f41dc144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41d3fff700 1 -- 172.21.15.57:0/1815899904 >> v1:172.21.15.57:6789/0 conn(0x7f41dc05c520 legacy=0x7f41dc0a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41d3fff700 1 -- 172.21.15.57:0/1815899904 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc05f670 con 0x7f41dc060160 2021-06-25T04:56:52.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41d3fff700 1 --2- 172.21.15.57:0/1815899904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060160 0x7f41dc0b0c70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f41c4002f70 tx=0x7f41c4006df0).ready entity=mon.2 client_cookie=3be3919543485672 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:52.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41daffd700 1 -- 172.21.15.57:0/1815899904 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c400d5c0 con 0x7f41dc060160 2021-06-25T04:56:52.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41daffd700 1 -- 172.21.15.57:0/1815899904 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c4000e90 con 0x7f41dc060160 2021-06-25T04:56:52.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41e0d47700 1 -- 172.21.15.57:0/1815899904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060160 msgr2=0x7f41dc0b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41daffd700 1 -- 172.21.15.57:0/1815899904 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c400d910 con 0x7f41dc060160 2021-06-25T04:56:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41e0d47700 1 --2- 172.21.15.57:0/1815899904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060160 0x7f41dc0b0c70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f41c4002f70 tx=0x7f41c4006df0).stop 2021-06-25T04:56:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41e0d47700 1 -- 172.21.15.57:0/1815899904 shutdown_connections 2021-06-25T04:56:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41e0d47700 1 --2- 172.21.15.57:0/1815899904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060160 0x7f41dc0b0c70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41e0d47700 1 -- 172.21.15.57:0/1815899904 >> 172.21.15.57:0/1815899904 conn(0x7f41dc061100 msgr2=0x7f41dc062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:52.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41e0d47700 1 -- 172.21.15.57:0/1815899904 shutdown_connections 2021-06-25T04:56:52.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.611+0000 7f41e0d47700 1 -- 172.21.15.57:0/1815899904 wait complete. 2021-06-25T04:56:52.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41e0d47700 1 Processor -- start 2021-06-25T04:56:52.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41e0d47700 1 -- start start 2021-06-25T04:56:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41e0d47700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc05c520 0x7f41dc146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41e0d47700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060160 0x7f41dc066710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41e0d47700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0af380 0x7f41dc066c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41e0d47700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc065f10 con 0x7f41dc05c520 2021-06-25T04:56:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41e0d47700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0659d0 con 0x7f41dc0af380 2021-06-25T04:56:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41e0d47700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc065c70 con 0x7f41dc060160 2021-06-25T04:56:52.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41db7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc05c520 0x7f41dc146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41db7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc05c520 0x7f41dc146880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43872/0 (socket says 172.21.15.57:43872) 2021-06-25T04:56:52.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41d3fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060160 0x7f41dc066710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41db7fe700 1 -- 172.21.15.57:0/3274137894 learned_addr learned my addr 172.21.15.57:0/3274137894 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:52.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41dbfff700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0af380 0x7f41dc066c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41db7fe700 1 -- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060160 msgr2=0x7f41dc066710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41db7fe700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060160 0x7f41dc066710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41db7fe700 1 -- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0af380 msgr2=0x7f41dc066c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:52.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41db7fe700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0af380 0x7f41dc066c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:52.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41db7fe700 1 -- 172.21.15.57:0/3274137894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c400b180 con 0x7f41dc05c520 2021-06-25T04:56:52.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.615+0000 7f41db7fe700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc05c520 0x7f41dc146880 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f41cc001110 tx=0x7f41cc007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:52.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.619+0000 7f41d97fa700 1 -- 172.21.15.57:0/3274137894 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc012400 con 0x7f41dc05c520 2021-06-25T04:56:52.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.619+0000 7f41d97fa700 1 -- 172.21.15.57:0/3274137894 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc012560 con 0x7f41dc05c520 2021-06-25T04:56:52.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.619+0000 7f41e0d47700 1 -- 172.21.15.57:0/3274137894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41dc146d70 con 0x7f41dc05c520 2021-06-25T04:56:52.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.619+0000 7f41d97fa700 1 -- 172.21.15.57:0/3274137894 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc0128c0 con 0x7f41dc05c520 2021-06-25T04:56:52.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.619+0000 7f41e0d47700 1 -- 172.21.15.57:0/3274137894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc064f90 con 0x7f41dc05c520 2021-06-25T04:56:52.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.619+0000 7f41e0d47700 1 -- 172.21.15.57:0/3274137894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41dc0670f0 con 0x7f41dc05c520 2021-06-25T04:56:52.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.619+0000 7f41d97fa700 1 -- 172.21.15.57:0/3274137894 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f41cc019030 con 0x7f41dc05c520 2021-06-25T04:56:52.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.619+0000 7f41d97fa700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c0055450 0x7f41c0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:52.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.619+0000 7f41d97fa700 1 -- 172.21.15.57:0/3274137894 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f41cc06cfc0 con 0x7f41dc05c520 2021-06-25T04:56:52.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.619+0000 7f41d3fff700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c0055450 0x7f41c0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:52.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.623+0000 7f41d3fff700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c0055450 0x7f41c0057910 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f41c4017000 tx=0x7f41c4014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:52.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.627+0000 7f41d97fa700 1 -- 172.21.15.57:0/3274137894 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f41cc0433a0 con 0x7f41dc05c520 2021-06-25T04:56:52.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:52.755+0000 7f41e0d47700 1 -- 172.21.15.57:0/3274137894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f41dc057310 con 0x7f41dc05c520 2021-06-25T04:56:53.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.439+0000 7f41d97fa700 1 -- 172.21.15.57:0/3274137894 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v146) v1 ==== 133+0+0 (secure 0 0 0) 0x7f41cc0469c0 con 0x7f41dc05c520 2021-06-25T04:56:53.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 -- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c0055450 msgr2=0x7f41c0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:53.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c0055450 0x7f41c0057910 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f41c4017000 tx=0x7f41c4014000).stop 2021-06-25T04:56:53.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 -- 172.21.15.57:0/3274137894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc05c520 msgr2=0x7f41dc146880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:53.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc05c520 0x7f41dc146880 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f41cc001110 tx=0x7f41cc007ae0).stop 2021-06-25T04:56:53.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 -- 172.21.15.57:0/3274137894 shutdown_connections 2021-06-25T04:56:53.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41c0055450 0x7f41c0057910 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:53.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0af380 0x7f41dc066c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:53.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41dc060160 0x7f41dc066710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:53.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 --2- 172.21.15.57:0/3274137894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41dc05c520 0x7f41dc146880 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:53.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 -- 172.21.15.57:0/3274137894 >> 172.21.15.57:0/3274137894 conn(0x7f41dc061100 msgr2=0x7f41dc0aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:53.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 -- 172.21.15.57:0/3274137894 shutdown_connections 2021-06-25T04:56:53.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.443+0000 7f41e0d47700 1 -- 172.21.15.57:0/3274137894 wait complete. 2021-06-25T04:56:53.452 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:56:53.462 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:56:53.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 Processor -- start 2021-06-25T04:56:53.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 -- start start 2021-06-25T04:56:53.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c940a9e80 0x7f5c940aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:53.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c9413f750 0x7f5c9413fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:53.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c94061950 con 0x7f5c94060390 2021-06-25T04:56:53.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c941400b0 con 0x7f5c940a9e80 2021-06-25T04:56:53.581 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94061bf0 con 0x7f5c9413f750 2021-06-25T04:56:53.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9a3d0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c940a9e80 0x7f5c940aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:53.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c99bcf700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5c94060390 0x7f5c9413cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32868/0 (socket says 172.21.15.57:32868) 2021-06-25T04:56:53.582 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c99bcf700 1 -- 172.21.15.57:0/1526662071 learned_addr learned my addr 172.21.15.57:0/1526662071 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:53.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9abd1700 1 --2- 172.21.15.57:0/1526662071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c9413f750 0x7f5c9413fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:53.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c993ce700 1 -- 172.21.15.57:0/1526662071 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010182331 0 0) 0x7f5c94061950 con 0x7f5c94060390 2021-06-25T04:56:53.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c993ce700 1 -- 172.21.15.57:0/1526662071 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c7c003260 con 0x7f5c94060390 2021-06-25T04:56:53.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9a3d0700 1 -- 172.21.15.57:0/1526662071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c9413f750 msgr2=0x7f5c9413fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:53.583 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9a3d0700 1 --2- 172.21.15.57:0/1526662071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c9413f750 0x7f5c9413fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9a3d0700 1 -- 172.21.15.57:0/1526662071 >> v1:172.21.15.57:6789/0 conn(0x7f5c94060390 legacy=0x7f5c9413cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9a3d0700 1 -- 172.21.15.57:0/1526662071 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94060b50 con 0x7f5c940a9e80 2021-06-25T04:56:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9a3d0700 1 --2- 172.21.15.57:0/1526662071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c940a9e80 0x7f5c940aa260 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f5c90002f70 tx=0x7f5c90006e80).ready entity=mon.0 client_cookie=18e667bd19b1572 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c993ce700 1 -- 172.21.15.57:0/1526662071 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9000b7d0 con 0x7f5c940a9e80 2021-06-25T04:56:53.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c993ce700 1 -- 172.21.15.57:0/1526662071 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9000b930 con 0x7f5c940a9e80 2021-06-25T04:56:53.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c993ce700 1 -- 172.21.15.57:0/1526662071 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c9000bc90 con 0x7f5c940a9e80 2021-06-25T04:56:53.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 -- 172.21.15.57:0/1526662071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c940a9e80 msgr2=0x7f5c940aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:53.585 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 --2- 172.21.15.57:0/1526662071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c940a9e80 0x7f5c940aa260 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f5c90002f70 tx=0x7f5c90006e80).stop 2021-06-25T04:56:53.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 -- 172.21.15.57:0/1526662071 shutdown_connections 2021-06-25T04:56:53.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 --2- 172.21.15.57:0/1526662071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c9413f750 0x7f5c9413fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:53.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 --2- 172.21.15.57:0/1526662071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c940a9e80 0x7f5c940aa260 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:53.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 -- 172.21.15.57:0/1526662071 >> 172.21.15.57:0/1526662071 conn(0x7f5c940b2930 msgr2=0x7f5c940b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:53.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 -- 172.21.15.57:0/1526662071 shutdown_connections 2021-06-25T04:56:53.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.575+0000 7f5c9c634700 1 -- 172.21.15.57:0/1526662071 wait complete. 2021-06-25T04:56:53.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9c634700 1 Processor -- start 2021-06-25T04:56:53.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9c634700 1 -- start start 2021-06-25T04:56:53.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9c634700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c94060390 0x7f5c94143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:53.590 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9c634700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c940a9e80 0x7f5c9414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:53.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9c634700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c9413f750 0x7f5c94141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:53.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9c634700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9414f0c0 con 0x7f5c940a9e80 2021-06-25T04:56:53.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9c634700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940af740 con 0x7f5c94060390 2021-06-25T04:56:53.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9c634700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940af9e0 con 0x7f5c9413f750 2021-06-25T04:56:53.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c99bcf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c940a9e80 0x7f5c9414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:53.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c99bcf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c940a9e80 0x7f5c9414ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43886/0 (socket says 172.21.15.57:43886) 2021-06-25T04:56:53.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c99bcf700 1 -- 172.21.15.57:0/3371269350 learned_addr learned my addr 172.21.15.57:0/3371269350 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:53.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9a3d0700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c94060390 0x7f5c94143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:53.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9abd1700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c9413f750 0x7f5c94141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:53.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c99bcf700 1 -- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c9413f750 msgr2=0x7f5c94141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:53.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c99bcf700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c9413f750 0x7f5c94141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:53.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c99bcf700 1 -- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c94060390 msgr2=0x7f5c94143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:53.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c99bcf700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c94060390 0x7f5c94143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:53.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c99bcf700 1 -- 172.21.15.57:0/3371269350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9000d410 con 0x7f5c940a9e80 2021-06-25T04:56:53.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9abd1700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c9413f750 0x7f5c94141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:56:53.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c99bcf700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c940a9e80 0x7f5c9414ebd0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f5c88001490 tx=0x7f5c88007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:53.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c877fe700 1 -- 172.21.15.57:0/3371269350 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c88005ba0 con 0x7f5c940a9e80 2021-06-25T04:56:53.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c877fe700 1 -- 172.21.15.57:0/3371269350 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c88005d00 con 0x7f5c940a9e80 2021-06-25T04:56:53.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c877fe700 1 -- 172.21.15.57:0/3371269350 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c88007300 con 0x7f5c940a9e80 2021-06-25T04:56:53.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9c634700 1 -- 172.21.15.57:0/3371269350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c940afc80 con 0x7f5c940a9e80 2021-06-25T04:56:53.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.579+0000 7f5c9c634700 1 -- 172.21.15.57:0/3371269350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c940af170 con 0x7f5c940a9e80 2021-06-25T04:56:53.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.583+0000 7f5c877fe700 1 -- 172.21.15.57:0/3371269350 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5c88010030 con 0x7f5c940a9e80 2021-06-25T04:56:53.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.583+0000 7f5c9c634700 1 -- 172.21.15.57:0/3371269350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c94057310 con 0x7f5c940a9e80 2021-06-25T04:56:53.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.583+0000 7f5c877fe700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c74055340 0x7f5c74057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:53.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.583+0000 7f5c877fe700 1 -- 172.21.15.57:0/3371269350 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f5c8806de80 con 0x7f5c940a9e80 2021-06-25T04:56:53.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.583+0000 7f5c9a3d0700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c74055340 0x7f5c74057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:53.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.583+0000 7f5c9a3d0700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c74055340 0x7f5c74057800 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f5c9001c000 tx=0x7f5c94060ce0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:53.597 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.591+0000 7f5c877fe700 1 -- 172.21.15.57:0/3371269350 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5c880440f0 con 0x7f5c940a9e80 2021-06-25T04:56:53.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:53.719+0000 7f5c9c634700 1 -- 172.21.15.57:0/3371269350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f5c94044610 con 0x7f5c940a9e80 2021-06-25T04:56:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.063+0000 7f5c877fe700 1 -- 172.21.15.57:0/3371269350 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v147) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5c88047710 con 0x7f5c940a9e80 2021-06-25T04:56:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 -- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c74055340 msgr2=0x7f5c74057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c74055340 0x7f5c74057800 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f5c9001c000 tx=0x7f5c94060ce0).stop 2021-06-25T04:56:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 -- 172.21.15.57:0/3371269350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c940a9e80 msgr2=0x7f5c9414ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c940a9e80 0x7f5c9414ebd0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f5c88001490 tx=0x7f5c88007e50).stop 2021-06-25T04:56:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 -- 172.21.15.57:0/3371269350 shutdown_connections 2021-06-25T04:56:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c74055340 0x7f5c74057800 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c9413f750 0x7f5c94141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c940a9e80 0x7f5c9414ebd0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 --2- 172.21.15.57:0/3371269350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c94060390 0x7f5c94143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 -- 172.21.15.57:0/3371269350 >> 172.21.15.57:0/3371269350 conn(0x7f5c940b2930 msgr2=0x7f5c9405bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 -- 172.21.15.57:0/3371269350 shutdown_connections 2021-06-25T04:56:54.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.071+0000 7f5c9c634700 1 -- 172.21.15.57:0/3371269350 wait complete. 2021-06-25T04:56:54.080 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:56:54.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:56:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.191+0000 7f61389ec700 1 Processor -- start 2021-06-25T04:56:54.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.191+0000 7f61389ec700 1 -- start start 2021-06-25T04:56:54.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f61340ab120 0x7f61340672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f61340b4d10 0x7f61340b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6134065920 con 0x7f61340aad40 2021-06-25T04:56:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6134064ed0 con 0x7f61340ab120 2021-06-25T04:56:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61340b3ca0 con 0x7f61340b4d10 2021-06-25T04:56:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61337fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f61340aad40 0x7f61340647c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32880/0 (socket says 172.21.15.57:32880) 2021-06-25T04:56:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f6132ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f61340ab120 0x7f61340672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61337fe700 1 -- 172.21.15.57:0/246862092 learned_addr learned my addr 172.21.15.57:0/246862092 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:54.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f6133fff700 1 --2- 172.21.15.57:0/246862092 >> v2:172.21.15.87:3300/0 conn(0x7f61340b4d10 0x7f61340b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61327fc700 1 -- 172.21.15.57:0/246862092 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830264172 0 0) 0x7f6134065920 con 0x7f61340aad40 2021-06-25T04:56:54.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61327fc700 1 -- 172.21.15.57:0/246862092 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6120003260 con 0x7f61340aad40 2021-06-25T04:56:54.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f6132ffd700 1 -- 172.21.15.57:0/246862092 >> v2:172.21.15.87:3300/0 conn(0x7f61340b4d10 msgr2=0x7f61340b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:54.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f6132ffd700 1 --2- 172.21.15.57:0/246862092 >> v2:172.21.15.87:3300/0 conn(0x7f61340b4d10 0x7f61340b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f6132ffd700 1 -- 172.21.15.57:0/246862092 >> v1:172.21.15.57:6789/0 conn(0x7f61340aad40 legacy=0x7f61340647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61327fc700 1 -- 172.21.15.57:0/246862092 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4025788662 0 0) 0x7f6120003260 con 0x7f61340aad40 2021-06-25T04:56:54.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f6132ffd700 1 -- 172.21.15.57:0/246862092 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6134066e20 con 0x7f61340ab120 2021-06-25T04:56:54.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f6132ffd700 1 --2- 172.21.15.57:0/246862092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61340ab120 0x7f61340672c0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f6128001820 tx=0x7f6124006d90).ready entity=mon.0 client_cookie=fc763a59fa0cc11d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:54.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61327fc700 1 -- 172.21.15.57:0/246862092 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6128001680 con 0x7f61340ab120 2021-06-25T04:56:54.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61327fc700 1 -- 172.21.15.57:0/246862092 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6124000e90 con 0x7f61340ab120 2021-06-25T04:56:54.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61327fc700 1 -- 172.21.15.57:0/246862092 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f612400be80 con 0x7f61340ab120 2021-06-25T04:56:54.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 -- 172.21.15.57:0/246862092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61340ab120 msgr2=0x7f61340672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 --2- 172.21.15.57:0/246862092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61340ab120 0x7f61340672c0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f6128001820 tx=0x7f6124006d90).stop 2021-06-25T04:56:54.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 -- 172.21.15.57:0/246862092 shutdown_connections 2021-06-25T04:56:54.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 --2- 172.21.15.57:0/246862092 >> v2:172.21.15.87:3300/0 conn(0x7f61340b4d10 0x7f61340b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 --2- 172.21.15.57:0/246862092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61340ab120 0x7f61340672c0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 -- 172.21.15.57:0/246862092 >> 172.21.15.57:0/246862092 conn(0x7f6134062ba0 msgr2=0x7f613405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:54.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 -- 172.21.15.57:0/246862092 shutdown_connections 2021-06-25T04:56:54.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.195+0000 7f61389ec700 1 -- 172.21.15.57:0/246862092 wait complete. 2021-06-25T04:56:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61389ec700 1 Processor -- start 2021-06-25T04:56:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61389ec700 1 -- start start 2021-06-25T04:56:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61389ec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61340aad40 0x7f61340ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61389ec700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61340ab120 0x7f61341439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61389ec700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61340b4d10 0x7f6134143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61389ec700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61341431d0 con 0x7f61340aad40 2021-06-25T04:56:54.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61389ec700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61340b0490 con 0x7f61340ab120 2021-06-25T04:56:54.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61389ec700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61340b1d30 con 0x7f61340b4d10 2021-06-25T04:56:54.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61337fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61340aad40 0x7f61340ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61337fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61340aad40 0x7f61340ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43900/0 (socket says 172.21.15.57:43900) 2021-06-25T04:56:54.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61337fe700 1 -- 172.21.15.57:0/964126502 learned_addr learned my addr 172.21.15.57:0/964126502 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:54.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f6133fff700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61340b4d10 0x7f6134143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f6132ffd700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61340ab120 0x7f61341439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f6133fff700 1 -- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61340ab120 msgr2=0x7f61341439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f6133fff700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61340ab120 0x7f61341439e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f6133fff700 1 -- 172.21.15.57:0/964126502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61340aad40 msgr2=0x7f61340ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f6133fff700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61340aad40 0x7f61340ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f6133fff700 1 -- 172.21.15.57:0/964126502 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612400b120 con 0x7f61340b4d10 2021-06-25T04:56:54.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f6133fff700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61340b4d10 0x7f6134143ed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f613413d760 tx=0x7f612c0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:54.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f6130ff9700 1 -- 172.21.15.57:0/964126502 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f612c012600 con 0x7f61340b4d10 2021-06-25T04:56:54.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f6130ff9700 1 -- 172.21.15.57:0/964126502 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c012760 con 0x7f61340b4d10 2021-06-25T04:56:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61389ec700 1 -- 172.21.15.57:0/964126502 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6134141f30 con 0x7f61340b4d10 2021-06-25T04:56:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f6130ff9700 1 -- 172.21.15.57:0/964126502 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f612c012ac0 con 0x7f61340b4d10 2021-06-25T04:56:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.199+0000 7f61389ec700 1 -- 172.21.15.57:0/964126502 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61340ae430 con 0x7f61340b4d10 2021-06-25T04:56:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.203+0000 7f61389ec700 1 -- 172.21.15.57:0/964126502 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6134057310 con 0x7f61340b4d10 2021-06-25T04:56:54.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.203+0000 7f6130ff9700 1 -- 172.21.15.57:0/964126502 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f612c022070 con 0x7f61340b4d10 2021-06-25T04:56:54.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.203+0000 7f6130ff9700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f61140554e0 0x7f61140579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.203+0000 7f6130ff9700 1 -- 172.21.15.57:0/964126502 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f612c06e5e0 con 0x7f61340b4d10 2021-06-25T04:56:54.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.203+0000 7f61337fe700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f61140554e0 0x7f61140579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.203+0000 7f61337fe700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f61140554e0 0x7f61140579a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f612800d000 tx=0x7f61280013c0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:54.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.211+0000 7f6130ff9700 1 -- 172.21.15.57:0/964126502 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f612c044620 con 0x7f61340b4d10 2021-06-25T04:56:54.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.375+0000 7f61389ec700 1 -- 172.21.15.57:0/964126502 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f613405d990 con 0x7f61340b4d10 2021-06-25T04:56:54.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.391+0000 7f6130ff9700 1 -- 172.21.15.57:0/964126502 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v74) v1 ==== 189+0+0 (secure 0 0 0) 0x7f612c016020 con 0x7f61340b4d10 2021-06-25T04:56:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 -- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f61140554e0 msgr2=0x7f61140579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f61140554e0 0x7f61140579a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f612800d000 tx=0x7f61280013c0).stop 2021-06-25T04:56:54.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 -- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61340b4d10 msgr2=0x7f6134143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61340b4d10 0x7f6134143ed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f613413d760 tx=0x7f612c0091d0).stop 2021-06-25T04:56:54.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 -- 172.21.15.57:0/964126502 shutdown_connections 2021-06-25T04:56:54.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f61140554e0 0x7f61140579a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61340b4d10 0x7f6134143ed0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61340ab120 0x7f61341439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 --2- 172.21.15.57:0/964126502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61340aad40 0x7f61340ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 -- 172.21.15.57:0/964126502 >> 172.21.15.57:0/964126502 conn(0x7f6134062ba0 msgr2=0x7f613405caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 -- 172.21.15.57:0/964126502 shutdown_connections 2021-06-25T04:56:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.395+0000 7f61389ec700 1 -- 172.21.15.57:0/964126502 wait complete. 2021-06-25T04:56:54.403 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 27 and data pool 28 2021-06-25T04:56:54.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:54.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.503+0000 7f2cb7fff700 1 Processor -- start 2021-06-25T04:56:54.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.503+0000 7f2cb7fff700 1 -- start start 2021-06-25T04:56:54.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.503+0000 7f2cb7fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2cb8061640 0x7f2cb80b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.503+0000 7f2cb7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cb8143960 0x7f2cb8140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.503+0000 7f2cb7fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80b68d0 con 0x7f2cb80b46d0 2021-06-25T04:56:54.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.503+0000 7f2cb7fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb80b9640 con 0x7f2cb8143960 2021-06-25T04:56:54.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.503+0000 7f2cb7fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb80b6b70 con 0x7f2cb8061640 2021-06-25T04:56:54.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.503+0000 7f2cb77fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cb8143960 0x7f2cb8140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb77fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cb8143960 0x7f2cb8140470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43922/0 (socket says 172.21.15.57:43922) 2021-06-25T04:56:54.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb77fe700 1 -- 172.21.15.57:0/708968776 learned_addr learned my addr 172.21.15.57:0/708968776 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:54.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb6ffd700 1 --2- 172.21.15.57:0/708968776 >> v2:172.21.15.87:3300/0 conn(0x7f2cb8061640 0x7f2cb80b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb77fe700 1 -- 172.21.15.57:0/708968776 >> v2:172.21.15.87:3300/0 conn(0x7f2cb8061640 msgr2=0x7f2cb80b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:54.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb77fe700 1 --2- 172.21.15.57:0/708968776 >> v2:172.21.15.87:3300/0 conn(0x7f2cb8061640 0x7f2cb80b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb77fe700 1 -- 172.21.15.57:0/708968776 >> v1:172.21.15.87:6789/0 conn(0x7f2cb80b46d0 legacy=0x7f2cb813fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb77fe700 1 -- 172.21.15.57:0/708968776 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80b6e10 con 0x7f2cb8143960 2021-06-25T04:56:54.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb77fe700 1 --2- 172.21.15.57:0/708968776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb8143960 0x7f2cb8140470 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f2cb00032f0 tx=0x7f2cb0009290).ready entity=mon.0 client_cookie=8e928de834fd1ad9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:54.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb67fc700 1 -- 172.21.15.57:0/708968776 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb000b870 con 0x7f2cb8143960 2021-06-25T04:56:54.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb67fc700 1 -- 172.21.15.57:0/708968776 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb000b9d0 con 0x7f2cb8143960 2021-06-25T04:56:54.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb67fc700 1 -- 172.21.15.57:0/708968776 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb000bb40 con 0x7f2cb8143960 2021-06-25T04:56:54.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb7fff700 1 -- 172.21.15.57:0/708968776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb8143960 msgr2=0x7f2cb8140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb7fff700 1 --2- 172.21.15.57:0/708968776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb8143960 0x7f2cb8140470 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f2cb00032f0 tx=0x7f2cb0009290).stop 2021-06-25T04:56:54.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb7fff700 1 -- 172.21.15.57:0/708968776 shutdown_connections 2021-06-25T04:56:54.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb7fff700 1 --2- 172.21.15.57:0/708968776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb8143960 0x7f2cb8140470 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb7fff700 1 --2- 172.21.15.57:0/708968776 >> v2:172.21.15.87:3300/0 conn(0x7f2cb8061640 0x7f2cb80b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb7fff700 1 -- 172.21.15.57:0/708968776 >> 172.21.15.57:0/708968776 conn(0x7f2cb806adb0 msgr2=0x7f2cb805f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:54.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb7fff700 1 -- 172.21.15.57:0/708968776 shutdown_connections 2021-06-25T04:56:54.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb7fff700 1 -- 172.21.15.57:0/708968776 wait complete. 2021-06-25T04:56:54.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb7fff700 1 Processor -- start 2021-06-25T04:56:54.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.507+0000 7f2cb7fff700 1 -- start start 2021-06-25T04:56:54.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cb8061640 0x7f2cb81394e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cb8143960 0x7f2cb80b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb80b08a0 0x7f2cb80b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb7fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb813d970 con 0x7f2cb80b08a0 2021-06-25T04:56:54.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb7fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb813d090 con 0x7f2cb8061640 2021-06-25T04:56:54.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb7fff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb813c580 con 0x7f2cb8143960 2021-06-25T04:56:54.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb80b08a0 0x7f2cb80b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb80b08a0 0x7f2cb80b7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43930/0 (socket says 172.21.15.57:43930) 2021-06-25T04:56:54.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb77fe700 1 -- 172.21.15.57:0/319722464 learned_addr learned my addr 172.21.15.57:0/319722464 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:54.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb6ffd700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cb8061640 0x7f2cb81394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2caffff700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cb8143960 0x7f2cb80b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb77fe700 1 -- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cb8143960 msgr2=0x7f2cb80b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb77fe700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cb8143960 0x7f2cb80b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb77fe700 1 -- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cb8061640 msgr2=0x7f2cb81394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb77fe700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cb8061640 0x7f2cb81394e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb77fe700 1 -- 172.21.15.57:0/319722464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb0009530 con 0x7f2cb80b08a0 2021-06-25T04:56:54.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb77fe700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb80b08a0 0x7f2cb80b7f90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f2cb00032f0 tx=0x7f2cb0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:54.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb4ff9700 1 -- 172.21.15.57:0/319722464 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb0011c10 con 0x7f2cb80b08a0 2021-06-25T04:56:54.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb4ff9700 1 -- 172.21.15.57:0/319722464 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb0011d70 con 0x7f2cb80b08a0 2021-06-25T04:56:54.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb7fff700 1 -- 172.21.15.57:0/319722464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb813d6d0 con 0x7f2cb80b08a0 2021-06-25T04:56:54.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb4ff9700 1 -- 172.21.15.57:0/319722464 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb0020670 con 0x7f2cb80b08a0 2021-06-25T04:56:54.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb7fff700 1 -- 172.21.15.57:0/319722464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb813c150 con 0x7f2cb80b08a0 2021-06-25T04:56:54.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.511+0000 7f2cb7fff700 1 -- 172.21.15.57:0/319722464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb8147500 con 0x7f2cb80b08a0 2021-06-25T04:56:54.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.515+0000 7f2cb4ff9700 1 -- 172.21.15.57:0/319722464 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2cb0029070 con 0x7f2cb80b08a0 2021-06-25T04:56:54.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.515+0000 7f2cb4ff9700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c9c0553d0 0x7f2c9c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.515+0000 7f2cb4ff9700 1 -- 172.21.15.57:0/319722464 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2cb006e950 con 0x7f2cb80b08a0 2021-06-25T04:56:54.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.515+0000 7f2cb6ffd700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c9c0553d0 0x7f2c9c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.515+0000 7f2cb6ffd700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c9c0553d0 0x7f2c9c057890 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f2ca800b000 tx=0x7f2ca8006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:54.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.519+0000 7f2cb4ff9700 1 -- 172.21.15.57:0/319722464 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2cb0044b00 con 0x7f2cb80b08a0 2021-06-25T04:56:54.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.647+0000 7f2cb7fff700 1 -- 172.21.15.57:0/319722464 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cb8057310 con 0x7f2cb80b08a0 2021-06-25T04:56:54.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.647+0000 7f2cb4ff9700 1 -- 172.21.15.57:0/319722464 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16311 (secure 0 0 0) 0x7f2cb0015070 con 0x7f2cb80b08a0 2021-06-25T04:56:54.654 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:54.654 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":148,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:54.382913+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:56:52.813405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-06-25T04:56:53.777715+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:54.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 -- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c9c0553d0 msgr2=0x7f2c9c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c9c0553d0 0x7f2c9c057890 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f2ca800b000 tx=0x7f2ca8006df0).stop 2021-06-25T04:56:54.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 -- 172.21.15.57:0/319722464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb80b08a0 msgr2=0x7f2cb80b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb80b08a0 0x7f2cb80b7f90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f2cb00032f0 tx=0x7f2cb0016000).stop 2021-06-25T04:56:54.658 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 -- 172.21.15.57:0/319722464 shutdown_connections 2021-06-25T04:56:54.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2c9c0553d0 0x7f2c9c057890 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb80b08a0 0x7f2cb80b7f90 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cb8143960 0x7f2cb80b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 --2- 172.21.15.57:0/319722464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cb8061640 0x7f2cb81394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 -- 172.21.15.57:0/319722464 >> 172.21.15.57:0/319722464 conn(0x7f2cb806adb0 msgr2=0x7f2cb8142240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:54.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 -- 172.21.15.57:0/319722464 shutdown_connections 2021-06-25T04:56:54.660 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.651+0000 7f2cb7fff700 1 -- 172.21.15.57:0/319722464 wait complete. 2021-06-25T04:56:54.672 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.767+0000 7f57c359e700 1 Processor -- start 2021-06-25T04:56:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.767+0000 7f57c359e700 1 -- start start 2021-06-25T04:56:54.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.767+0000 7f57c359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57c40b05d0 0x7f57c40af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c40b5840 con 0x7f57c4147560 2021-06-25T04:56:54.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c40ac7c0 con 0x7f57c40b5460 2021-06-25T04:56:54.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c41452a0 con 0x7f57c40b05d0 2021-06-25T04:56:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c2d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f57c4147560 0x7f57c40acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32924/0 (socket says 172.21.15.57:32924) 2021-06-25T04:56:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c2d9d700 1 -- 172.21.15.57:0/3609358364 learned_addr learned my addr 172.21.15.57:0/3609358364 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c1d9b700 1 --2- 172.21.15.57:0/3609358364 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57c40b05d0 0x7f57c40af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c159a700 1 -- 172.21.15.57:0/3609358364 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439814305 0 0) 0x7f57c40ac7c0 con 0x7f57c40b5460 2021-06-25T04:56:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c159a700 1 -- 172.21.15.57:0/3609358364 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a8003260 con 0x7f57c40b5460 2021-06-25T04:56:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c159a700 1 -- 172.21.15.57:0/3609358364 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663933852 0 0) 0x7f57c40b5840 con 0x7f57c4147560 2021-06-25T04:56:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c1d9b700 1 -- 172.21.15.57:0/3609358364 >> v1:172.21.15.87:6789/0 conn(0x7f57c40b5460 legacy=0x7f57c4067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c1d9b700 1 -- 172.21.15.57:0/3609358364 >> v1:172.21.15.57:6789/0 conn(0x7f57c4147560 legacy=0x7f57c40acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c1d9b700 1 -- 172.21.15.57:0/3609358364 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c40b19f0 con 0x7f57c40b05d0 2021-06-25T04:56:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c1d9b700 1 --2- 172.21.15.57:0/3609358364 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57c40b05d0 0x7f57c40af510 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f57b40032f0 tx=0x7f57b40091d0).ready entity=mon.2 client_cookie=1394361b0087ca8a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:54.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c159a700 1 -- 172.21.15.57:0/3609358364 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57b400b6c0 con 0x7f57c40b05d0 2021-06-25T04:56:54.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c159a700 1 -- 172.21.15.57:0/3609358364 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b400b820 con 0x7f57c40b05d0 2021-06-25T04:56:54.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c159a700 1 -- 172.21.15.57:0/3609358364 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57b400b990 con 0x7f57c40b05d0 2021-06-25T04:56:54.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c359e700 1 -- 172.21.15.57:0/3609358364 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57c40b05d0 msgr2=0x7f57c40af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c359e700 1 --2- 172.21.15.57:0/3609358364 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57c40b05d0 0x7f57c40af510 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f57b40032f0 tx=0x7f57b40091d0).stop 2021-06-25T04:56:54.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c359e700 1 -- 172.21.15.57:0/3609358364 shutdown_connections 2021-06-25T04:56:54.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c359e700 1 --2- 172.21.15.57:0/3609358364 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57c40b05d0 0x7f57c40af510 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c359e700 1 -- 172.21.15.57:0/3609358364 >> 172.21.15.57:0/3609358364 conn(0x7f57c4062520 msgr2=0x7f57c4062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:54.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c359e700 1 -- 172.21.15.57:0/3609358364 shutdown_connections 2021-06-25T04:56:54.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.771+0000 7f57c359e700 1 -- 172.21.15.57:0/3609358364 wait complete. 2021-06-25T04:56:54.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c359e700 1 Processor -- start 2021-06-25T04:56:54.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c359e700 1 -- start start 2021-06-25T04:56:54.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57c40b05d0 0x7f57c40b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c40b5460 0x7f57c413e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c4147560 0x7f57c413d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40adfb0 con 0x7f57c4147560 2021-06-25T04:56:54.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c414e970 con 0x7f57c40b5460 2021-06-25T04:56:54.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c414dce0 con 0x7f57c40b05d0 2021-06-25T04:56:54.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c4147560 0x7f57c413d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c4147560 0x7f57c413d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43944/0 (socket says 172.21.15.57:43944) 2021-06-25T04:56:54.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c2d9d700 1 -- 172.21.15.57:0/3909461734 learned_addr learned my addr 172.21.15.57:0/3909461734 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:54.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c1d9b700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c40b5460 0x7f57c413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c259c700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57c40b05d0 0x7f57c40b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c2d9d700 1 -- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57c40b05d0 msgr2=0x7f57c40b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c2d9d700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57c40b05d0 0x7f57c40b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c2d9d700 1 -- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c40b5460 msgr2=0x7f57c413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c2d9d700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c40b5460 0x7f57c413e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c2d9d700 1 -- 172.21.15.57:0/3909461734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4009470 con 0x7f57c4147560 2021-06-25T04:56:54.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c2d9d700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c4147560 0x7f57c413d4c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f57bc000ed0 tx=0x7f57bc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:54.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57b37fe700 1 -- 172.21.15.57:0/3909461734 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57bc0070d0 con 0x7f57c4147560 2021-06-25T04:56:54.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57b37fe700 1 -- 172.21.15.57:0/3909461734 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc007230 con 0x7f57c4147560 2021-06-25T04:56:54.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c359e700 1 -- 172.21.15.57:0/3909461734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c414c5a0 con 0x7f57c4147560 2021-06-25T04:56:54.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57b37fe700 1 -- 172.21.15.57:0/3909461734 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57bc005610 con 0x7f57c4147560 2021-06-25T04:56:54.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.775+0000 7f57c359e700 1 -- 172.21.15.57:0/3909461734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c40b4c70 con 0x7f57c4147560 2021-06-25T04:56:54.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.779+0000 7f57c359e700 1 -- 172.21.15.57:0/3909461734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c414ca40 con 0x7f57c4147560 2021-06-25T04:56:54.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.779+0000 7f57b37fe700 1 -- 172.21.15.57:0/3909461734 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f57bc01a060 con 0x7f57c4147560 2021-06-25T04:56:54.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.779+0000 7f57b37fe700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57a0055340 0x7f57a0057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:54.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.779+0000 7f57b37fe700 1 -- 172.21.15.57:0/3909461734 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f57bc06d5b0 con 0x7f57c4147560 2021-06-25T04:56:54.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.779+0000 7f57c259c700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57a0055340 0x7f57a0057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:54.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.779+0000 7f57c259c700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57a0055340 0x7f57a0057800 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f57b800d000 tx=0x7f57b8009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:54.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.787+0000 7f57b37fe700 1 -- 172.21.15.57:0/3909461734 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f57bc043650 con 0x7f57c4147560 2021-06-25T04:56:54.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.911+0000 7f57c359e700 1 -- 172.21.15.57:0/3909461734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57c405f200 con 0x7f57c4147560 2021-06-25T04:56:54.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.911+0000 7f57b37fe700 1 -- 172.21.15.57:0/3909461734 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16311 (secure 0 0 0) 0x7f57bc018070 con 0x7f57c4147560 2021-06-25T04:56:54.918 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:54.919 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":148,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:54.382913+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:56:52.813405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-06-25T04:56:53.777715+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:54.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 -- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57a0055340 msgr2=0x7f57a0057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57a0055340 0x7f57a0057800 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f57b800d000 tx=0x7f57b8009040).stop 2021-06-25T04:56:54.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 -- 172.21.15.57:0/3909461734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c4147560 msgr2=0x7f57c413d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:54.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c4147560 0x7f57c413d4c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f57bc000ed0 tx=0x7f57bc007c50).stop 2021-06-25T04:56:54.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 -- 172.21.15.57:0/3909461734 shutdown_connections 2021-06-25T04:56:54.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f57a0055340 0x7f57a0057800 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c4147560 0x7f57c413d4c0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57c40b5460 0x7f57c413e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 --2- 172.21.15.57:0/3909461734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57c40b05d0 0x7f57c40b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:54.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 -- 172.21.15.57:0/3909461734 >> 172.21.15.57:0/3909461734 conn(0x7f57c4062520 msgr2=0x7f57c40acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:54.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 -- 172.21.15.57:0/3909461734 shutdown_connections 2021-06-25T04:56:54.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:54.915+0000 7f57c359e700 1 -- 172.21.15.57:0/3909461734 wait complete. 2021-06-25T04:56:54.933 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:56:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c4714d700 1 Processor -- start 2021-06-25T04:56:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c4714d700 1 -- start start 2021-06-25T04:56:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c4714d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c40146910 0x7f5c401401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c4714d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5c400b4140 0x7f5c401406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c4714d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c40143b20 con 0x7f5c400b4650 2021-06-25T04:56:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c4714d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c401474d0 con 0x7f5c400b4140 2021-06-25T04:56:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c4714d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40143dc0 con 0x7f5c40146910 2021-06-25T04:56:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c456ea700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5c400b4650 0x7f5c400b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32938/0 (socket says 172.21.15.57:32938) 2021-06-25T04:56:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c456ea700 1 -- 172.21.15.57:0/3062613407 learned_addr learned my addr 172.21.15.57:0/3062613407 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3ffff700 1 --2- 172.21.15.57:0/3062613407 >> v2:172.21.15.87:3300/0 conn(0x7f5c400b4140 0x7f5c401406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c44ee9700 1 --2- 172.21.15.57:0/3062613407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c40146910 0x7f5c401401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3f7fe700 1 -- 172.21.15.57:0/3062613407 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283570829 0 0) 0x7f5c40143b20 con 0x7f5c400b4650 2021-06-25T04:56:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3f7fe700 1 -- 172.21.15.57:0/3062613407 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c20003260 con 0x7f5c400b4650 2021-06-25T04:56:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3ffff700 1 -- 172.21.15.57:0/3062613407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c40146910 msgr2=0x7f5c401401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:55.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3ffff700 1 --2- 172.21.15.57:0/3062613407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c40146910 0x7f5c401401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3ffff700 1 -- 172.21.15.57:0/3062613407 >> v1:172.21.15.57:6789/0 conn(0x7f5c400b4650 legacy=0x7f5c400b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3f7fe700 1 -- 172.21.15.57:0/3062613407 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2612542220 0 0) 0x7f5c20003260 con 0x7f5c400b4650 2021-06-25T04:56:55.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3ffff700 1 -- 172.21.15.57:0/3062613407 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400b0c50 con 0x7f5c400b4140 2021-06-25T04:56:55.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c44ee9700 1 --2- 172.21.15.57:0/3062613407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c40146910 0x7f5c401401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:55.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3ffff700 1 --2- 172.21.15.57:0/3062613407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c400b4140 0x7f5c401406e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f5c38001800 tx=0x7f5c280091d0).ready entity=mon.1 client_cookie=5d07856dbd7541e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:55.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3f7fe700 1 -- 172.21.15.57:0/3062613407 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c38001660 con 0x7f5c400b4140 2021-06-25T04:56:55.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3f7fe700 1 -- 172.21.15.57:0/3062613407 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2800f510 con 0x7f5c400b4140 2021-06-25T04:56:55.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c4714d700 1 -- 172.21.15.57:0/3062613407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c400b4140 msgr2=0x7f5c401406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c3f7fe700 1 -- 172.21.15.57:0/3062613407 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c2800f680 con 0x7f5c400b4140 2021-06-25T04:56:55.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.043+0000 7f5c4714d700 1 --2- 172.21.15.57:0/3062613407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c400b4140 0x7f5c401406e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f5c38001800 tx=0x7f5c280091d0).stop 2021-06-25T04:56:55.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 -- 172.21.15.57:0/3062613407 shutdown_connections 2021-06-25T04:56:55.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 --2- 172.21.15.57:0/3062613407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c400b4140 0x7f5c401406e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 --2- 172.21.15.57:0/3062613407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c40146910 0x7f5c401401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 -- 172.21.15.57:0/3062613407 >> 172.21.15.57:0/3062613407 conn(0x7f5c4005c450 msgr2=0x7f5c4005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:55.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 -- 172.21.15.57:0/3062613407 shutdown_connections 2021-06-25T04:56:55.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 -- 172.21.15.57:0/3062613407 wait complete. 2021-06-25T04:56:55.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 Processor -- start 2021-06-25T04:56:55.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 -- start start 2021-06-25T04:56:55.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c400b4140 0x7f5c400ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c400b4650 0x7f5c40142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c40146910 0x7f5c40152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400b0920 con 0x7f5c40146910 2021-06-25T04:56:55.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401522f0 con 0x7f5c400b4140 2021-06-25T04:56:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.047+0000 7f5c4714d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40149990 con 0x7f5c400b4650 2021-06-25T04:56:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c456ea700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c40146910 0x7f5c40152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c456ea700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c40146910 0x7f5c40152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43956/0 (socket says 172.21.15.57:43956) 2021-06-25T04:56:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c456ea700 1 -- 172.21.15.57:0/2336031786 learned_addr learned my addr 172.21.15.57:0/2336031786 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c44ee9700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c400b4140 0x7f5c400ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c3ffff700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c400b4650 0x7f5c40142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c456ea700 1 -- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c400b4650 msgr2=0x7f5c40142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c456ea700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c400b4650 0x7f5c40142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c456ea700 1 -- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c400b4140 msgr2=0x7f5c400ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c456ea700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c400b4140 0x7f5c400ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c456ea700 1 -- 172.21.15.57:0/2336031786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3000b180 con 0x7f5c40146910 2021-06-25T04:56:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c3ffff700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c400b4650 0x7f5c40142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c456ea700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c40146910 0x7f5c40152750 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f5c380017c0 tx=0x7f5c38001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c3dffb700 1 -- 172.21.15.57:0/2336031786 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c38007170 con 0x7f5c40146910 2021-06-25T04:56:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c3dffb700 1 -- 172.21.15.57:0/2336031786 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c380072d0 con 0x7f5c40146910 2021-06-25T04:56:55.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c4714d700 1 -- 172.21.15.57:0/2336031786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c28009470 con 0x7f5c40146910 2021-06-25T04:56:55.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c3dffb700 1 -- 172.21.15.57:0/2336031786 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c38004920 con 0x7f5c40146910 2021-06-25T04:56:55.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c4714d700 1 -- 172.21.15.57:0/2336031786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c401496f0 con 0x7f5c40146910 2021-06-25T04:56:55.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c4714d700 1 -- 172.21.15.57:0/2336031786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40057310 con 0x7f5c40146910 2021-06-25T04:56:55.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c3dffb700 1 -- 172.21.15.57:0/2336031786 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5c38004a80 con 0x7f5c40146910 2021-06-25T04:56:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c3dffb700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c24055450 0x7f5c24057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c3dffb700 1 -- 172.21.15.57:0/2336031786 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5c3806dac0 con 0x7f5c40146910 2021-06-25T04:56:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.051+0000 7f5c44ee9700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c24055450 0x7f5c24057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.055+0000 7f5c44ee9700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c24055450 0x7f5c24057910 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f5c3000b000 tx=0x7f5c30006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:55.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.059+0000 7f5c3dffb700 1 -- 172.21.15.57:0/2336031786 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5c38043c70 con 0x7f5c40146910 2021-06-25T04:56:55.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.223+0000 7f5c4714d700 1 -- 172.21.15.57:0/2336031786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5c40152460 con 0x7f5c40146910 2021-06-25T04:56:55.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.391+0000 7f5c3dffb700 1 -- 172.21.15.57:0/2336031786 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5c38001c70 con 0x7f5c40146910 2021-06-25T04:56:55.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.391+0000 7f5c4714d700 1 -- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c24055450 msgr2=0x7f5c24057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.391+0000 7f5c4714d700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c24055450 0x7f5c24057910 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f5c3000b000 tx=0x7f5c30006df0).stop 2021-06-25T04:56:55.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.395+0000 7f5c4714d700 1 -- 172.21.15.57:0/2336031786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c40146910 msgr2=0x7f5c40152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.395+0000 7f5c4714d700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c40146910 0x7f5c40152750 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f5c380017c0 tx=0x7f5c38001b30).stop 2021-06-25T04:56:55.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.395+0000 7f5c4714d700 1 -- 172.21.15.57:0/2336031786 shutdown_connections 2021-06-25T04:56:55.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.395+0000 7f5c4714d700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5c24055450 0x7f5c24057910 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.395+0000 7f5c4714d700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c40146910 0x7f5c40152750 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.395+0000 7f5c4714d700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5c400b4650 0x7f5c40142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.395+0000 7f5c4714d700 1 --2- 172.21.15.57:0/2336031786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c400b4140 0x7f5c400ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.395+0000 7f5c4714d700 1 -- 172.21.15.57:0/2336031786 >> 172.21.15.57:0/2336031786 conn(0x7f5c4005c450 msgr2=0x7f5c400b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:55.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.395+0000 7f5c4714d700 1 -- 172.21.15.57:0/2336031786 shutdown_connections 2021-06-25T04:56:55.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.395+0000 7f5c4714d700 1 -- 172.21.15.57:0/2336031786 wait complete. 2021-06-25T04:56:55.413 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:55.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f3180763700 1 Processor -- start 2021-06-25T04:56:55.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f3180763700 1 -- start start 2021-06-25T04:56:55.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f3180763700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31780a7670 0x7f3178066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f3180763700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31780b0020 0x7f317805fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f3180763700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31780a7a50 con 0x7f31780b1930 2021-06-25T04:56:55.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f3180763700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31781475e0 con 0x7f31780a7670 2021-06-25T04:56:55.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f3180763700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3178147880 con 0x7f31780b0020 2021-06-25T04:56:55.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317e4ff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31780a7670 0x7f3178066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317e4ff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31780a7670 0x7f3178066a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:52458/0 (socket says 172.21.15.57:52458) 2021-06-25T04:56:55.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317dcfe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f31780b1930 0x7f317805f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:33696/0 (socket says 172.21.15.57:33696) 2021-06-25T04:56:55.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317e4ff700 1 -- 172.21.15.57:0/833680805 learned_addr learned my addr 172.21.15.57:0/833680805 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:55.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317ed00700 1 --2- 172.21.15.57:0/833680805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31780b0020 0x7f317805fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317e4ff700 1 -- 172.21.15.57:0/833680805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31780b0020 msgr2=0x7f317805fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:55.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317e4ff700 1 --2- 172.21.15.57:0/833680805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31780b0020 0x7f317805fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317e4ff700 1 -- 172.21.15.57:0/833680805 >> v1:172.21.15.87:6789/0 conn(0x7f31780b1930 legacy=0x7f317805f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317e4ff700 1 -- 172.21.15.57:0/833680805 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178147b20 con 0x7f31780a7670 2021-06-25T04:56:55.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317e4ff700 1 --2- 172.21.15.57:0/833680805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31780a7670 0x7f3178066a30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f316c002f70 tx=0x7f316c006eb0).ready entity=mon.1 client_cookie=b2e68573acef7295 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:55.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317d4fd700 1 -- 172.21.15.57:0/833680805 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f316c00d570 con 0x7f31780a7670 2021-06-25T04:56:55.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317d4fd700 1 -- 172.21.15.57:0/833680805 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c000e90 con 0x7f31780a7670 2021-06-25T04:56:55.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f317d4fd700 1 -- 172.21.15.57:0/833680805 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f316c00d900 con 0x7f31780a7670 2021-06-25T04:56:55.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f3180763700 1 -- 172.21.15.57:0/833680805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31780a7670 msgr2=0x7f3178066a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.515+0000 7f3180763700 1 --2- 172.21.15.57:0/833680805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31780a7670 0x7f3178066a30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f316c002f70 tx=0x7f316c006eb0).stop 2021-06-25T04:56:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 -- 172.21.15.57:0/833680805 shutdown_connections 2021-06-25T04:56:55.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 --2- 172.21.15.57:0/833680805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31780b0020 0x7f317805fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 --2- 172.21.15.57:0/833680805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31780a7670 0x7f3178066a30 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 -- 172.21.15.57:0/833680805 >> 172.21.15.57:0/833680805 conn(0x7f31780b53a0 msgr2=0x7f31780b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:55.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 -- 172.21.15.57:0/833680805 shutdown_connections 2021-06-25T04:56:55.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 -- 172.21.15.57:0/833680805 wait complete. 2021-06-25T04:56:55.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 Processor -- start 2021-06-25T04:56:55.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 -- start start 2021-06-25T04:56:55.538 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31780a7670 0x7f317814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31780b0020 0x7f31780aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.539 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31780b1930 0x7f31780ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31780ab190 con 0x7f31780b0020 2021-06-25T04:56:55.540 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31780ab980 con 0x7f31780a7670 2021-06-25T04:56:55.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f3180763700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31780abbd0 con 0x7f31780b1930 2021-06-25T04:56:55.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f317dcfe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31780b0020 0x7f31780aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.541 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f317dcfe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31780b0020 0x7f31780aaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43970/0 (socket says 172.21.15.57:43970) 2021-06-25T04:56:55.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f317dcfe700 1 -- 172.21.15.57:0/1532844731 learned_addr learned my addr 172.21.15.57:0/1532844731 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:55.542 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f317e4ff700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31780a7670 0x7f317814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.519+0000 7f317ed00700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31780b1930 0x7f31780ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.543 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f317dcfe700 1 -- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31780b1930 msgr2=0x7f31780ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f317dcfe700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31780b1930 0x7f31780ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.544 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f317dcfe700 1 -- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31780a7670 msgr2=0x7f317814d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f317dcfe700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31780a7670 0x7f317814d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f317dcfe700 1 -- 172.21.15.57:0/1532844731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c00b1e0 con 0x7f31780b0020 2021-06-25T04:56:55.545 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f317e4ff700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31780a7670 0x7f317814d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:55.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f317dcfe700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31780b0020 0x7f31780aaca0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f317806a0a0 tx=0x7f3170007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:55.546 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f316b7fe700 1 -- 172.21.15.57:0/1532844731 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3170004ab0 con 0x7f31780b0020 2021-06-25T04:56:55.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f316b7fe700 1 -- 172.21.15.57:0/1532844731 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3170004c10 con 0x7f31780b0020 2021-06-25T04:56:55.547 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f3180763700 1 -- 172.21.15.57:0/1532844731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31780abe70 con 0x7f31780b0020 2021-06-25T04:56:55.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f316b7fe700 1 -- 172.21.15.57:0/1532844731 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3170007170 con 0x7f31780b0020 2021-06-25T04:56:55.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f3180763700 1 -- 172.21.15.57:0/1532844731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31780addc0 con 0x7f31780b0020 2021-06-25T04:56:55.548 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f3180763700 1 -- 172.21.15.57:0/1532844731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317814e000 con 0x7f31780b0020 2021-06-25T04:56:55.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f316b7fe700 1 -- 172.21.15.57:0/1532844731 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f31700072d0 con 0x7f31780b0020 2021-06-25T04:56:55.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f316b7fe700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3158055450 0x7f3158057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.550 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.523+0000 7f316b7fe700 1 -- 172.21.15.57:0/1532844731 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f317006dae0 con 0x7f31780b0020 2021-06-25T04:56:55.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.527+0000 7f317e4ff700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3158055450 0x7f3158057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.551 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.527+0000 7f317e4ff700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3158055450 0x7f3158057910 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f316c01b000 tx=0x7f316c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:55.552 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.531+0000 7f316b7fe700 1 -- 172.21.15.57:0/1532844731 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3170043bf0 con 0x7f31780b0020 2021-06-25T04:56:55.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.691+0000 7f3180763700 1 -- 172.21.15.57:0/1532844731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3178057310 con 0x7f31780b0020 2021-06-25T04:56:55.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.695+0000 7f316b7fe700 1 -- 172.21.15.57:0/1532844731 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f3170047210 con 0x7f31780b0020 2021-06-25T04:56:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:55.700 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":75,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2769630783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2769630783},{"type":"v1","addr":"172.21.15.87:6835","nonce":2769630783}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/583651666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":583651666},{"type":"v1","addr":"172.21.15.57:6834","nonce":583651666}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:54.383291+0000","modified":"2021-06-25T04:56:55.386538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8445":{"gid":8445,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2461786269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2461786269},{"type":"v1","addr":"172.21.15.57:6835","nonce":2461786269}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-06-25T04:56:55.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.695+0000 7f3180763700 1 -- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3158055450 msgr2=0x7f3158057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.699+0000 7f3180763700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3158055450 0x7f3158057910 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f316c01b000 tx=0x7f316c015000).stop 2021-06-25T04:56:55.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.699+0000 7f3180763700 1 -- 172.21.15.57:0/1532844731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31780b0020 msgr2=0x7f31780aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.699+0000 7f3180763700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31780b0020 0x7f31780aaca0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f317806a0a0 tx=0x7f3170007f60).stop 2021-06-25T04:56:55.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.699+0000 7f3180763700 1 -- 172.21.15.57:0/1532844731 shutdown_connections 2021-06-25T04:56:55.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.699+0000 7f3180763700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3158055450 0x7f3158057910 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.699+0000 7f3180763700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31780b1930 0x7f31780ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.699+0000 7f3180763700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31780b0020 0x7f31780aaca0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.699+0000 7f3180763700 1 --2- 172.21.15.57:0/1532844731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31780a7670 0x7f317814d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.699+0000 7f3180763700 1 -- 172.21.15.57:0/1532844731 >> 172.21.15.57:0/1532844731 conn(0x7f31780b53a0 msgr2=0x7f317805f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:55.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.699+0000 7f3180763700 1 -- 172.21.15.57:0/1532844731 shutdown_connections 2021-06-25T04:56:55.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.699+0000 7f3180763700 1 -- 172.21.15.57:0/1532844731 wait complete. 2021-06-25T04:56:55.706 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 75 2021-06-25T04:56:55.717 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:55.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.815+0000 7f97c95cd700 1 Processor -- start 2021-06-25T04:56:55.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.815+0000 7f97c95cd700 1 -- start start 2021-06-25T04:56:55.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.815+0000 7f97c95cd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f97c4066dc0 0x7f97c40afd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.815+0000 7f97c95cd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f97c4060cc0 0x7f97c40aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.815+0000 7f97c95cd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c40671a0 con 0x7f97c40aacb0 2021-06-25T04:56:55.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.815+0000 7f97c95cd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c40a9410 con 0x7f97c4066dc0 2021-06-25T04:56:55.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.815+0000 7f97c95cd700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c40b0370 con 0x7f97c4060cc0 2021-06-25T04:56:55.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.815+0000 7f97c2ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f97c4066dc0 0x7f97c40afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.815+0000 7f97c37fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f97c40aacb0 0x7f97c4146940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32966/0 (socket says 172.21.15.57:32966) 2021-06-25T04:56:55.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.815+0000 7f97c37fe700 1 -- 172.21.15.57:0/2925737610 learned_addr learned my addr 172.21.15.57:0/2925737610 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:55.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c27fc700 1 --2- 172.21.15.57:0/2925737610 >> v2:172.21.15.87:3300/0 conn(0x7f97c4060cc0 0x7f97c40aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c1ffb700 1 -- 172.21.15.57:0/2925737610 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892670272 0 0) 0x7f97c40671a0 con 0x7f97c40aacb0 2021-06-25T04:56:55.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c1ffb700 1 -- 172.21.15.57:0/2925737610 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97a8003260 con 0x7f97c40aacb0 2021-06-25T04:56:55.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c2ffd700 1 -- 172.21.15.57:0/2925737610 >> v2:172.21.15.87:3300/0 conn(0x7f97c4060cc0 msgr2=0x7f97c40aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:55.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c2ffd700 1 --2- 172.21.15.57:0/2925737610 >> v2:172.21.15.87:3300/0 conn(0x7f97c4060cc0 0x7f97c40aa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c2ffd700 1 -- 172.21.15.57:0/2925737610 >> v1:172.21.15.57:6789/0 conn(0x7f97c40aacb0 legacy=0x7f97c4146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c2ffd700 1 -- 172.21.15.57:0/2925737610 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c40b14e0 con 0x7f97c4066dc0 2021-06-25T04:56:55.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c2ffd700 1 --2- 172.21.15.57:0/2925737610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c4066dc0 0x7f97c40afd40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f97b8002f70 tx=0x7f97b8006df0).ready entity=mon.0 client_cookie=b3be56d9db796e94 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:55.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c1ffb700 1 -- 172.21.15.57:0/2925737610 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b800d4f0 con 0x7f97c4066dc0 2021-06-25T04:56:55.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c1ffb700 1 -- 172.21.15.57:0/2925737610 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b8000e90 con 0x7f97c4066dc0 2021-06-25T04:56:55.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c1ffb700 1 -- 172.21.15.57:0/2925737610 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97b800d840 con 0x7f97c4066dc0 2021-06-25T04:56:55.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c95cd700 1 -- 172.21.15.57:0/2925737610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c4066dc0 msgr2=0x7f97c40afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c95cd700 1 --2- 172.21.15.57:0/2925737610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c4066dc0 0x7f97c40afd40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f97b8002f70 tx=0x7f97b8006df0).stop 2021-06-25T04:56:55.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c95cd700 1 -- 172.21.15.57:0/2925737610 shutdown_connections 2021-06-25T04:56:55.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c95cd700 1 --2- 172.21.15.57:0/2925737610 >> v2:172.21.15.87:3300/0 conn(0x7f97c4060cc0 0x7f97c40aa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c95cd700 1 --2- 172.21.15.57:0/2925737610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c4066dc0 0x7f97c40afd40 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c95cd700 1 -- 172.21.15.57:0/2925737610 >> 172.21.15.57:0/2925737610 conn(0x7f97c40b53a0 msgr2=0x7f97c40b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:55.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c95cd700 1 -- 172.21.15.57:0/2925737610 shutdown_connections 2021-06-25T04:56:55.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c95cd700 1 -- 172.21.15.57:0/2925737610 wait complete. 2021-06-25T04:56:55.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c95cd700 1 Processor -- start 2021-06-25T04:56:55.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.819+0000 7f97c95cd700 1 -- start start 2021-06-25T04:56:55.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c95cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97c4060cc0 0x7f97c40b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c95cd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97c4066dc0 0x7f97c40add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c95cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c40aacb0 0x7f97c4152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c95cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4152f60 con 0x7f97c40aacb0 2021-06-25T04:56:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c95cd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c41494d0 con 0x7f97c4060cc0 2021-06-25T04:56:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c95cd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4149770 con 0x7f97c4066dc0 2021-06-25T04:56:55.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c40aacb0 0x7f97c4152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c40aacb0 0x7f97c4152a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43986/0 (socket says 172.21.15.57:43986) 2021-06-25T04:56:55.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c37fe700 1 -- 172.21.15.57:0/1733122575 learned_addr learned my addr 172.21.15.57:0/1733122575 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:55.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c27fc700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97c4066dc0 0x7f97c40add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c2ffd700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97c4060cc0 0x7f97c40b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c37fe700 1 -- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97c4066dc0 msgr2=0x7f97c40add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c37fe700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97c4066dc0 0x7f97c40add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c37fe700 1 -- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97c4060cc0 msgr2=0x7f97c40b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c37fe700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97c4060cc0 0x7f97c40b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c37fe700 1 -- 172.21.15.57:0/1733122575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b800b180 con 0x7f97c40aacb0 2021-06-25T04:56:55.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c37fe700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c40aacb0 0x7f97c4152a70 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f97bc001490 tx=0x7f97bc007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:55.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97b3fff700 1 -- 172.21.15.57:0/1733122575 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97bc005c70 con 0x7f97c40aacb0 2021-06-25T04:56:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97b3fff700 1 -- 172.21.15.57:0/1733122575 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc005dd0 con 0x7f97c40aacb0 2021-06-25T04:56:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c95cd700 1 -- 172.21.15.57:0/1733122575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c4149a10 con 0x7f97c40aacb0 2021-06-25T04:56:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97b3fff700 1 -- 172.21.15.57:0/1733122575 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97bc0072c0 con 0x7f97c40aacb0 2021-06-25T04:56:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.823+0000 7f97c95cd700 1 -- 172.21.15.57:0/1733122575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c40ac4e0 con 0x7f97c40aacb0 2021-06-25T04:56:55.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.827+0000 7f97c95cd700 1 -- 172.21.15.57:0/1733122575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c4057310 con 0x7f97c40aacb0 2021-06-25T04:56:55.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.827+0000 7f97b3fff700 1 -- 172.21.15.57:0/1733122575 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f97bc01a060 con 0x7f97c40aacb0 2021-06-25T04:56:55.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.827+0000 7f97b3fff700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f97a00554e0 0x7f97a00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:55.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.827+0000 7f97b3fff700 1 -- 172.21.15.57:0/1733122575 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f97bc06d910 con 0x7f97c40aacb0 2021-06-25T04:56:55.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.827+0000 7f97c2ffd700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f97a00554e0 0x7f97a00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:55.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.827+0000 7f97c2ffd700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f97a00554e0 0x7f97a00579a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f97b8019000 tx=0x7f97b8014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:55.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.835+0000 7f97b3fff700 1 -- 172.21.15.57:0/1733122575 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f97bc043ac0 con 0x7f97c40aacb0 2021-06-25T04:56:55.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.959+0000 7f97c95cd700 1 -- 172.21.15.57:0/1733122575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97c4149eb0 con 0x7f97c40aacb0 2021-06-25T04:56:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97b3fff700 1 -- 172.21.15.57:0/1733122575 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f97bc018070 con 0x7f97c40aacb0 2021-06-25T04:56:55.969 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:55.969 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":149,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:55.387316+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:56:52.813405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-06-25T04:56:53.777715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:55.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 -- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f97a00554e0 msgr2=0x7f97a00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f97a00554e0 0x7f97a00579a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f97b8019000 tx=0x7f97b8014000).stop 2021-06-25T04:56:55.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 -- 172.21.15.57:0/1733122575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c40aacb0 msgr2=0x7f97c4152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:55.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c40aacb0 0x7f97c4152a70 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f97bc001490 tx=0x7f97bc007da0).stop 2021-06-25T04:56:55.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 -- 172.21.15.57:0/1733122575 shutdown_connections 2021-06-25T04:56:55.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f97a00554e0 0x7f97a00579a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c40aacb0 0x7f97c4152a70 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97c4066dc0 0x7f97c40add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 --2- 172.21.15.57:0/1733122575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97c4060cc0 0x7f97c40b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:55.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 -- 172.21.15.57:0/1733122575 >> 172.21.15.57:0/1733122575 conn(0x7f97c40b53a0 msgr2=0x7f97c41424f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:55.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 -- 172.21.15.57:0/1733122575 shutdown_connections 2021-06-25T04:56:55.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:55.963+0000 7f97c95cd700 1 -- 172.21.15.57:0/1733122575 wait complete. 2021-06-25T04:56:55.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:56:56.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 Processor -- start 2021-06-25T04:56:56.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 -- start start 2021-06-25T04:56:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f235c0b2540 0x7f235c14ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f235c0a8a80 0x7f235c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c0a7080 con 0x7f235c0affd0 2021-06-25T04:56:56.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c0a72b0 con 0x7f235c0a8a80 2021-06-25T04:56:56.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0a7550 con 0x7f235c0b2540 2021-06-25T04:56:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f235c0a8a80 0x7f235c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f235c0a8a80 0x7f235c14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43992/0 (socket says 172.21.15.57:43992) 2021-06-25T04:56:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235a7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f235c0affd0 0x7f235c0a8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32980/0 (socket says 172.21.15.57:32980) 2021-06-25T04:56:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235b7fe700 1 -- 172.21.15.57:0/2335303051 learned_addr learned my addr 172.21.15.57:0/2335303051 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235affd700 1 --2- 172.21.15.57:0/2335303051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f235c0b2540 0x7f235c14ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235b7fe700 1 -- 172.21.15.57:0/2335303051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f235c0b2540 msgr2=0x7f235c14ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235b7fe700 1 --2- 172.21.15.57:0/2335303051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f235c0b2540 0x7f235c14ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235b7fe700 1 -- 172.21.15.57:0/2335303051 >> v1:172.21.15.57:6789/0 conn(0x7f235c0affd0 legacy=0x7f235c0a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235b7fe700 1 -- 172.21.15.57:0/2335303051 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c0a77f0 con 0x7f235c0a8a80 2021-06-25T04:56:56.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235b7fe700 1 --2- 172.21.15.57:0/2335303051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f235c0a8a80 0x7f235c14b2f0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f23540032f0 tx=0x7f2354009290).ready entity=mon.0 client_cookie=a5a696cca154f3b8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:56.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f2359ffb700 1 -- 172.21.15.57:0/2335303051 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235400b8a0 con 0x7f235c0a8a80 2021-06-25T04:56:56.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f2359ffb700 1 -- 172.21.15.57:0/2335303051 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235400ba00 con 0x7f235c0a8a80 2021-06-25T04:56:56.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f2359ffb700 1 -- 172.21.15.57:0/2335303051 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235400bb70 con 0x7f235c0a8a80 2021-06-25T04:56:56.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 -- 172.21.15.57:0/2335303051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f235c0a8a80 msgr2=0x7f235c14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 --2- 172.21.15.57:0/2335303051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f235c0a8a80 0x7f235c14b2f0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f23540032f0 tx=0x7f2354009290).stop 2021-06-25T04:56:56.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 -- 172.21.15.57:0/2335303051 shutdown_connections 2021-06-25T04:56:56.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 --2- 172.21.15.57:0/2335303051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f235c0a8a80 0x7f235c14b2f0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 --2- 172.21.15.57:0/2335303051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f235c0b2540 0x7f235c14ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 -- 172.21.15.57:0/2335303051 >> 172.21.15.57:0/2335303051 conn(0x7f235c060140 msgr2=0x7f235c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:56.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 -- 172.21.15.57:0/2335303051 shutdown_connections 2021-06-25T04:56:56.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.099+0000 7f235bfff700 1 -- 172.21.15.57:0/2335303051 wait complete. 2021-06-25T04:56:56.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235bfff700 1 Processor -- start 2021-06-25T04:56:56.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235bfff700 1 -- start start 2021-06-25T04:56:56.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f235c0a8a80 0x7f235c14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f235c0affd0 0x7f235c159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f235c0b2540 0x7f235c15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0a9bf0 con 0x7f235c0affd0 2021-06-25T04:56:56.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0b5870 con 0x7f235c0b2540 2021-06-25T04:56:56.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235bfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0b4f90 con 0x7f235c0a8a80 2021-06-25T04:56:56.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f235c0affd0 0x7f235c159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f235c0affd0 0x7f235c159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43998/0 (socket says 172.21.15.57:43998) 2021-06-25T04:56:56.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235a7fc700 1 -- 172.21.15.57:0/1541562317 learned_addr learned my addr 172.21.15.57:0/1541562317 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:56.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235affd700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f235c0a8a80 0x7f235c14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235b7fe700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f235c0b2540 0x7f235c15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235a7fc700 1 -- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f235c0a8a80 msgr2=0x7f235c14aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235a7fc700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f235c0a8a80 0x7f235c14aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235a7fc700 1 -- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f235c0b2540 msgr2=0x7f235c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235a7fc700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f235c0b2540 0x7f235c15a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235a7fc700 1 -- 172.21.15.57:0/1541562317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354009530 con 0x7f235c0affd0 2021-06-25T04:56:56.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235b7fe700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f235c0b2540 0x7f235c15a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:56:56.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.103+0000 7f235affd700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f235c0a8a80 0x7f235c14aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:56:56.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f235a7fc700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f235c0affd0 0x7f235c159bd0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f235c061a40 tx=0x7f2350007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:56.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f234bfff700 1 -- 172.21.15.57:0/1541562317 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f235000ce30 con 0x7f235c0affd0 2021-06-25T04:56:56.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f234bfff700 1 -- 172.21.15.57:0/1541562317 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23500072e0 con 0x7f235c0affd0 2021-06-25T04:56:56.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f235bfff700 1 -- 172.21.15.57:0/1541562317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c0b4cf0 con 0x7f235c0affd0 2021-06-25T04:56:56.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f234bfff700 1 -- 172.21.15.57:0/1541562317 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2350007450 con 0x7f235c0affd0 2021-06-25T04:56:56.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f235bfff700 1 -- 172.21.15.57:0/1541562317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c067590 con 0x7f235c0affd0 2021-06-25T04:56:56.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f235bfff700 1 -- 172.21.15.57:0/1541562317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c057310 con 0x7f235c0affd0 2021-06-25T04:56:56.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f234bfff700 1 -- 172.21.15.57:0/1541562317 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2350010070 con 0x7f235c0affd0 2021-06-25T04:56:56.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f234bfff700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2338055450 0x7f2338057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f234bfff700 1 -- 172.21.15.57:0/1541562317 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f235006d630 con 0x7f235c0affd0 2021-06-25T04:56:56.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f235affd700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2338055450 0x7f2338057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.107+0000 7f235affd700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2338055450 0x7f2338057910 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f234c00b000 tx=0x7f234c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:56.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.111+0000 7f234bfff700 1 -- 172.21.15.57:0/1541562317 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f23500437e0 con 0x7f235c0affd0 2021-06-25T04:56:56.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.279+0000 7f235bfff700 1 -- 172.21.15.57:0/1541562317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f235c0621e0 con 0x7f235c0affd0 2021-06-25T04:56:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.287+0000 7f234bfff700 1 -- 172.21.15.57:0/1541562317 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2350046e00 con 0x7f235c0affd0 2021-06-25T04:56:56.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 -- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2338055450 msgr2=0x7f2338057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2338055450 0x7f2338057910 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f234c00b000 tx=0x7f234c008040).stop 2021-06-25T04:56:56.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 -- 172.21.15.57:0/1541562317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f235c0affd0 msgr2=0x7f235c159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f235c0affd0 0x7f235c159bd0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f235c061a40 tx=0x7f2350007c40).stop 2021-06-25T04:56:56.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 -- 172.21.15.57:0/1541562317 shutdown_connections 2021-06-25T04:56:56.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2338055450 0x7f2338057910 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f235c0b2540 0x7f235c15a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f235c0affd0 0x7f235c159bd0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 --2- 172.21.15.57:0/1541562317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f235c0a8a80 0x7f235c14aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 -- 172.21.15.57:0/1541562317 >> 172.21.15.57:0/1541562317 conn(0x7f235c060140 msgr2=0x7f235c148910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 -- 172.21.15.57:0/1541562317 shutdown_connections 2021-06-25T04:56:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.291+0000 7f235bfff700 1 -- 172.21.15.57:0/1541562317 wait complete. 2021-06-25T04:56:56.301 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:56:56.309 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:56:56.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.415+0000 7f0a155e9700 1 Processor -- start 2021-06-25T04:56:56.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.415+0000 7f0a155e9700 1 -- start start 2021-06-25T04:56:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a155e9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a100a9b30 0x7f0a100b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a155e9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a100aa350 con 0x7f0a100b0080 2021-06-25T04:56:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a155e9700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a100ab220 con 0x7f0a100b1ed0 2021-06-25T04:56:56.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a155e9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100b0460 con 0x7f0a100a9b30 2021-06-25T04:56:56.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0a100b0080 0x7f0a100aab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:32990/0 (socket says 172.21.15.57:32990) 2021-06-25T04:56:56.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0effd700 1 -- 172.21.15.57:0/2470734562 learned_addr learned my addr 172.21.15.57:0/2470734562 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:56.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0f7fe700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a100a9b30 0x7f0a100b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182212900 0 0) 0x7f0a100aa350 con 0x7f0a100b0080 2021-06-25T04:56:56.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f0003260 con 0x7f0a100b0080 2021-06-25T04:56:56.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141174076 0 0) 0x7f0a100ab220 con 0x7f0a100b1ed0 2021-06-25T04:56:56.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a100aa350 con 0x7f0a100b1ed0 2021-06-25T04:56:56.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3467460700 0 0) 0x7f09f0003260 con 0x7f0a100b0080 2021-06-25T04:56:56.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a100a9b30 msgr2=0x7f0a100b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:56.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a100a9b30 0x7f0a100b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 >> v1:172.21.15.87:6789/0 conn(0x7f0a100b1ed0 legacy=0x7f0a100b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100aa0b0 con 0x7f0a100b0080 2021-06-25T04:56:56.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f0a00001660 con 0x7f0a100b0080 2021-06-25T04:56:56.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 >> v1:172.21.15.57:6789/0 conn(0x7f0a100b0080 legacy=0x7f0a100aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a100a9b30 0x7f09f0003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f0003e70 0x7f09f0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09f00049f0 0x7f09f0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100b0460 con 0x7f09f0003e70 2021-06-25T04:56:56.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f000b830 con 0x7f09f00049f0 2021-06-25T04:56:56.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f000b9f0 con 0x7f0a100a9b30 2021-06-25T04:56:56.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a07fff700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f0003e70 0x7f09f0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0effd700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a100a9b30 0x7f09f0003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0f7fe700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09f00049f0 0x7f09f0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a07fff700 1 -- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a100a9b30 msgr2=0x7f09f0003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:56.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a07fff700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a100a9b30 0x7f09f0003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a07fff700 1 -- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09f00049f0 msgr2=0x7f09f0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:56.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a07fff700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09f00049f0 0x7f09f0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a07fff700 1 -- 172.21.15.57:0/2470734562 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0003260 con 0x7f09f0003e70 2021-06-25T04:56:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0f7fe700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09f00049f0 0x7f09f0004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a07fff700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f0003e70 0x7f09f0004500 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f09f8001110 tx=0x7f09f8007a00).ready entity=mon.0 client_cookie=49b5d0fdd88173fb server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09f8007d10 con 0x7f09f0003e70 2021-06-25T04:56:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f8007030 con 0x7f09f0003e70 2021-06-25T04:56:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0e7fc700 1 -- 172.21.15.57:0/2470734562 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09f8007390 con 0x7f09f0003e70 2021-06-25T04:56:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a155e9700 1 -- 172.21.15.57:0/2470734562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f0003e70 msgr2=0x7f09f0004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a155e9700 1 --2- 172.21.15.57:0/2470734562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09f0003e70 0x7f09f0004500 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f09f8001110 tx=0x7f09f8007a00).stop 2021-06-25T04:56:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a0f7fe700 1 -- 172.21.15.57:0/2470734562 reap_dead start 2021-06-25T04:56:56.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a155e9700 1 -- 172.21.15.57:0/2470734562 shutdown_connections 2021-06-25T04:56:56.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a155e9700 1 -- 172.21.15.57:0/2470734562 >> 172.21.15.57:0/2470734562 conn(0x7f0a10060780 msgr2=0x7f0a10060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:56.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a155e9700 1 -- 172.21.15.57:0/2470734562 shutdown_connections 2021-06-25T04:56:56.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.419+0000 7f0a155e9700 1 -- 172.21.15.57:0/2470734562 wait complete. 2021-06-25T04:56:56.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a155e9700 1 Processor -- start 2021-06-25T04:56:56.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a155e9700 1 -- start start 2021-06-25T04:56:56.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a155e9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1013f960 0x7f0a10145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a155e9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a10145830 0x7f0a10146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a155e9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a101508b0 0x7f0a10140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a155e9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a10142880 con 0x7f0a10145830 2021-06-25T04:56:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a155e9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1013fd40 con 0x7f0a1013f960 2021-06-25T04:56:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a155e9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a10154170 con 0x7f0a101508b0 2021-06-25T04:56:56.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a07fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a10145830 0x7f0a10146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a07fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a10145830 0x7f0a10146760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44018/0 (socket says 172.21.15.57:44018) 2021-06-25T04:56:56.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a07fff700 1 -- 172.21.15.57:0/2576851079 learned_addr learned my addr 172.21.15.57:0/2576851079 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:56.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a0effd700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1013f960 0x7f0a10145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.423+0000 7f0a0f7fe700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a101508b0 0x7f0a10140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a07fff700 1 -- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a101508b0 msgr2=0x7f0a10140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a07fff700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a101508b0 0x7f0a10140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a07fff700 1 -- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1013f960 msgr2=0x7f0a10145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a07fff700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1013f960 0x7f0a10145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a07fff700 1 -- 172.21.15.57:0/2576851079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10154410 con 0x7f0a10145830 2021-06-25T04:56:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a07fff700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a10145830 0x7f0a10146760 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f09f8001110 tx=0x7f09f8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a0cff9700 1 -- 172.21.15.57:0/2576851079 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09f801f620 con 0x7f0a10145830 2021-06-25T04:56:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a0cff9700 1 -- 172.21.15.57:0/2576851079 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f801f780 con 0x7f0a10145830 2021-06-25T04:56:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a155e9700 1 -- 172.21.15.57:0/2576851079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a10150410 con 0x7f0a10145830 2021-06-25T04:56:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a0cff9700 1 -- 172.21.15.57:0/2576851079 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09f801fae0 con 0x7f0a10145830 2021-06-25T04:56:56.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a155e9700 1 -- 172.21.15.57:0/2576851079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a10150d30 con 0x7f0a10145830 2021-06-25T04:56:56.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a155e9700 1 -- 172.21.15.57:0/2576851079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a101505a0 con 0x7f0a10145830 2021-06-25T04:56:56.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a0cff9700 1 -- 172.21.15.57:0/2576851079 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f09f8025020 con 0x7f0a10145830 2021-06-25T04:56:56.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.427+0000 7f0a0cff9700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09f4055450 0x7f09f4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.431+0000 7f0a0cff9700 1 -- 172.21.15.57:0/2576851079 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f09f806ede0 con 0x7f0a10145830 2021-06-25T04:56:56.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.431+0000 7f0a0effd700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09f4055450 0x7f09f4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.431+0000 7f0a0effd700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09f4055450 0x7f09f4057910 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f0a00005000 tx=0x7f0a100aaa30).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:56.451 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.439+0000 7f0a0cff9700 1 -- 172.21.15.57:0/2576851079 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f09f8044f90 con 0x7f0a10145830 2021-06-25T04:56:56.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.599+0000 7f0a155e9700 1 -- 172.21.15.57:0/2576851079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0a10057310 con 0x7f0a10145830 2021-06-25T04:56:56.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.607+0000 7f0a0cff9700 1 -- 172.21.15.57:0/2576851079 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7f09f80485b0 con 0x7f0a10145830 2021-06-25T04:56:56.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 -- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09f4055450 msgr2=0x7f09f4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.616 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09f4055450 0x7f09f4057910 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f0a00005000 tx=0x7f0a100aaa30).stop 2021-06-25T04:56:56.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 -- 172.21.15.57:0/2576851079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a10145830 msgr2=0x7f0a10146760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.617 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a10145830 0x7f0a10146760 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f09f8001110 tx=0x7f09f8015000).stop 2021-06-25T04:56:56.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 -- 172.21.15.57:0/2576851079 shutdown_connections 2021-06-25T04:56:56.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f09f4055450 0x7f09f4057910 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a101508b0 0x7f0a10140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a10145830 0x7f0a10146760 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 --2- 172.21.15.57:0/2576851079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1013f960 0x7f0a10145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 -- 172.21.15.57:0/2576851079 >> 172.21.15.57:0/2576851079 conn(0x7f0a10060780 msgr2=0x7f0a100b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:56.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 -- 172.21.15.57:0/2576851079 shutdown_connections 2021-06-25T04:56:56.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.611+0000 7f0a155e9700 1 -- 172.21.15.57:0/2576851079 wait complete. 2021-06-25T04:56:56.627 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:56:56.628 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62d12700 1 Processor -- start 2021-06-25T04:56:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62d12700 1 -- start start 2021-06-25T04:56:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62d12700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c143960 0x7f6d5c140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62d12700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c0b68d0 con 0x7f6d5c0b46d0 2021-06-25T04:56:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62d12700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c0b6b70 con 0x7f6d5c061640 2021-06-25T04:56:56.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62d12700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0b9640 con 0x7f6d5c143960 2021-06-25T04:56:56.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d6150f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6d5c0b46d0 0x7f6d5c13fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33010/0 (socket says 172.21.15.57:33010) 2021-06-25T04:56:56.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d6150f700 1 -- 172.21.15.57:0/2498641800 learned_addr learned my addr 172.21.15.57:0/2498641800 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:56.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62511700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c143960 0x7f6d5c140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498294304 0 0) 0x7f6d5c0b68d0 con 0x7f6d5c0b46d0 2021-06-25T04:56:56.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d44003260 con 0x7f6d5c0b46d0 2021-06-25T04:56:56.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 759204038 0 0) 0x7f6d44003260 con 0x7f6d5c0b46d0 2021-06-25T04:56:56.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c143960 msgr2=0x7f6d5c140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:56.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c143960 0x7f6d5c140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 >> v1:172.21.15.87:6789/0 conn(0x7f6d5c061640 legacy=0x7f6d5c0b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0b6e10 con 0x7f6d5c0b46d0 2021-06-25T04:56:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f6d500019e0 con 0x7f6d5c0b46d0 2021-06-25T04:56:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 >> v1:172.21.15.57:6789/0 conn(0x7f6d5c0b46d0 legacy=0x7f6d5c13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d44003780 0x7f6d44003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c143960 0x7f6d44004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d440049f0 0x7f6d44004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4400b750 con 0x7f6d440049f0 2021-06-25T04:56:56.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4400b8c0 con 0x7f6d44003780 2021-06-25T04:56:56.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4400ba80 con 0x7f6d5c143960 2021-06-25T04:56:56.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62511700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d440049f0 0x7f6d44004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d61d10700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d44003780 0x7f6d44003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d6150f700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c143960 0x7f6d44004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62511700 1 -- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c143960 msgr2=0x7f6d44004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:56.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62511700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c143960 0x7f6d44004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62511700 1 -- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d44003780 msgr2=0x7f6d44003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:56.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62511700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d44003780 0x7f6d44003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62511700 1 -- 172.21.15.57:0/2498641800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44003260 con 0x7f6d440049f0 2021-06-25T04:56:56.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d6150f700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c143960 0x7f6d44004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:56:56.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d62511700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d440049f0 0x7f6d44004e70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f6d5400c000 tx=0x7f6d54006df0).ready entity=mon.0 client_cookie=b1d396b2ad6f5e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:56.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5400e830 con 0x7f6d440049f0 2021-06-25T04:56:56.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.731+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5400e990 con 0x7f6d440049f0 2021-06-25T04:56:56.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d60d0e700 1 -- 172.21.15.57:0/2498641800 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d5400ecf0 con 0x7f6d440049f0 2021-06-25T04:56:56.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 -- 172.21.15.57:0/2498641800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d440049f0 msgr2=0x7f6d44004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 --2- 172.21.15.57:0/2498641800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d440049f0 0x7f6d44004e70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f6d5400c000 tx=0x7f6d54006df0).stop 2021-06-25T04:56:56.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62511700 1 -- 172.21.15.57:0/2498641800 reap_dead start 2021-06-25T04:56:56.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 -- 172.21.15.57:0/2498641800 shutdown_connections 2021-06-25T04:56:56.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 -- 172.21.15.57:0/2498641800 >> 172.21.15.57:0/2498641800 conn(0x7f6d5c06adb0 msgr2=0x7f6d5c05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:56.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 -- 172.21.15.57:0/2498641800 shutdown_connections 2021-06-25T04:56:56.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 -- 172.21.15.57:0/2498641800 wait complete. 2021-06-25T04:56:56.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 Processor -- start 2021-06-25T04:56:56.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 -- start start 2021-06-25T04:56:56.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5c13eba0 0x7f6d5c144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d5c0afbd0 0x7f6d5c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c0b00c0 0x7f6d5c13aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c145700 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c13fff0 con 0x7f6d5c13eba0 2021-06-25T04:56:56.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d62d12700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c13ef80 con 0x7f6d5c0b00c0 2021-06-25T04:56:56.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.735+0000 7f6d6150f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d5c0afbd0 0x7f6d5c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d62511700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c0b00c0 0x7f6d5c13aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d6150f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d5c0afbd0 0x7f6d5c0ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44038/0 (socket says 172.21.15.57:44038) 2021-06-25T04:56:56.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d6150f700 1 -- 172.21.15.57:0/1681317674 learned_addr learned my addr 172.21.15.57:0/1681317674 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:56.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d61d10700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5c13eba0 0x7f6d5c144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d6150f700 1 -- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c0b00c0 msgr2=0x7f6d5c13aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d6150f700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c0b00c0 0x7f6d5c13aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d6150f700 1 -- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5c13eba0 msgr2=0x7f6d5c144140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d6150f700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5c13eba0 0x7f6d5c144140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d6150f700 1 -- 172.21.15.57:0/1681317674 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0ae1f0 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d6150f700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d5c0afbd0 0x7f6d5c0ae8b0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f6d5c0ae750 tx=0x7f6d50009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:56.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d4effd700 1 -- 172.21.15.57:0/1681317674 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d50004b70 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d4effd700 1 -- 172.21.15.57:0/1681317674 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d50004cd0 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d62d12700 1 -- 172.21.15.57:0/1681317674 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c0ae490 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d4effd700 1 -- 172.21.15.57:0/1681317674 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d50007360 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d62d12700 1 -- 172.21.15.57:0/1681317674 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c0aeda0 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d62d12700 1 -- 172.21.15.57:0/1681317674 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c057310 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d4effd700 1 -- 172.21.15.57:0/1681317674 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6d500074c0 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.739+0000 7f6d4effd700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d3c055510 0x7f6d3c0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:56.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.743+0000 7f6d4effd700 1 -- 172.21.15.57:0/1681317674 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6d5006e590 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.743+0000 7f6d61d10700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d3c055510 0x7f6d3c0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:56.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.743+0000 7f6d61d10700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d3c055510 0x7f6d3c0579d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f6d5800d000 tx=0x7f6d5800c040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:56.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.747+0000 7f6d4effd700 1 -- 172.21.15.57:0/1681317674 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6d500447f0 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.911+0000 7f6d62d12700 1 -- 172.21.15.57:0/1681317674 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d5c05d990 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.915+0000 7f6d4effd700 1 -- 172.21.15.57:0/1681317674 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f6d50047e10 con 0x7f6d5c0afbd0 2021-06-25T04:56:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:56.923 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":75,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2769630783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2769630783},{"type":"v1","addr":"172.21.15.87:6835","nonce":2769630783}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/583651666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":583651666},{"type":"v1","addr":"172.21.15.57:6834","nonce":583651666}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:54.383291+0000","modified":"2021-06-25T04:56:55.386538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8445":{"gid":8445,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2461786269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2461786269},{"type":"v1","addr":"172.21.15.57:6835","nonce":2461786269}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-06-25T04:56:56.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.915+0000 7f6d62d12700 1 -- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d3c055510 msgr2=0x7f6d3c0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.915+0000 7f6d62d12700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d3c055510 0x7f6d3c0579d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f6d5800d000 tx=0x7f6d5800c040).stop 2021-06-25T04:56:56.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.915+0000 7f6d62d12700 1 -- 172.21.15.57:0/1681317674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d5c0afbd0 msgr2=0x7f6d5c0ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:56.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.915+0000 7f6d62d12700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d5c0afbd0 0x7f6d5c0ae8b0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f6d5c0ae750 tx=0x7f6d50009040).stop 2021-06-25T04:56:56.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.919+0000 7f6d62d12700 1 -- 172.21.15.57:0/1681317674 shutdown_connections 2021-06-25T04:56:56.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.919+0000 7f6d62d12700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6d3c055510 0x7f6d3c0579d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.919+0000 7f6d62d12700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d5c0b00c0 0x7f6d5c13aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.919+0000 7f6d62d12700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d5c0afbd0 0x7f6d5c0ae8b0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.919+0000 7f6d62d12700 1 --2- 172.21.15.57:0/1681317674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d5c13eba0 0x7f6d5c144140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:56.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.919+0000 7f6d62d12700 1 -- 172.21.15.57:0/1681317674 >> 172.21.15.57:0/1681317674 conn(0x7f6d5c06adb0 msgr2=0x7f6d5c0b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:56.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.919+0000 7f6d62d12700 1 -- 172.21.15.57:0/1681317674 shutdown_connections 2021-06-25T04:56:56.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:56.919+0000 7f6d62d12700 1 -- 172.21.15.57:0/1681317674 wait complete. 2021-06-25T04:56:56.927 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 75 2021-06-25T04:56:57.240 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:56:54.383291+0000', 'modified': '2021-06-25T04:56:55.386538+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8445}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8445': {'gid': 8445, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2461786269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2461786269}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2461786269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:56:57.241 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:56:57.241 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:56:57.362 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":8445,"want_state":"up:active","state":"up:active","rank_uptime":2.964992595,"mdsmap_epoch":75,"osdmap_epoch":149,"osdmap_epoch_barrier":148,"uptime":7.3355019180000003} 2021-06-25T04:56:57.362 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 8445, "mdsmap_epoch": 75, "osdmap_epoch": 149, "osdmap_epoch_barrier": 148, "rank_uptime": 2.964992595, "state": "up:active", "uptime": 7.335501918, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:56:57.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:56:57.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.459+0000 7f25e6aa3700 1 Processor -- start 2021-06-25T04:56:57.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.459+0000 7f25e6aa3700 1 -- start start 2021-06-25T04:56:57.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.459+0000 7f25e6aa3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0067140 0x7f25e005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.459+0000 7f25e6aa3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e00a7a50 con 0x7f25e00b1930 2021-06-25T04:56:57.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.459+0000 7f25e6aa3700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e01475e0 con 0x7f25e00a7670 2021-06-25T04:56:57.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.459+0000 7f25e6aa3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0147880 con 0x7f25e0067140 2021-06-25T04:56:57.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e5040700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f25e00b1930 0x7f25e005fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33034/0 (socket says 172.21.15.57:33034) 2021-06-25T04:56:57.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e5040700 1 -- 172.21.15.57:0/2956228608 learned_addr learned my addr 172.21.15.57:0/2956228608 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:57.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25dffff700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0067140 0x7f25e005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789053132 0 0) 0x7f25e00a7a50 con 0x7f25e00b1930 2021-06-25T04:56:57.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25cc003260 con 0x7f25e00b1930 2021-06-25T04:56:57.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130578488 0 0) 0x7f25e01475e0 con 0x7f25e00a7670 2021-06-25T04:56:57.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e00a7a50 con 0x7f25e00a7670 2021-06-25T04:56:57.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2211817659 0 0) 0x7f25cc003260 con 0x7f25e00b1930 2021-06-25T04:56:57.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0067140 msgr2=0x7f25e005f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:57.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0067140 0x7f25e005f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 >> v1:172.21.15.87:6789/0 conn(0x7f25e00a7670 legacy=0x7f25e0066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e0147b20 con 0x7f25e00b1930 2021-06-25T04:56:57.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f25d0001680 con 0x7f25e00b1930 2021-06-25T04:56:57.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 >> v1:172.21.15.57:6789/0 conn(0x7f25e00b1930 legacy=0x7f25e005fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.474 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0067140 0x7f25cc003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25cc003e20 0x7f25cc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25cc0049f0 0x7f25cc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0147880 con 0x7f25cc0049f0 2021-06-25T04:56:57.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc00b800 con 0x7f25cc003e20 2021-06-25T04:56:57.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc00b9c0 con 0x7f25e0067140 2021-06-25T04:56:57.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e5040700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25cc0049f0 0x7f25cc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e483f700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0067140 0x7f25cc003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25dffff700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25cc003e20 0x7f25cc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e5040700 1 -- 172.21.15.57:0/2956228608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0067140 msgr2=0x7f25cc003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:57.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e5040700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0067140 0x7f25cc003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e5040700 1 -- 172.21.15.57:0/2956228608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25cc003e20 msgr2=0x7f25cc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:57.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e5040700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25cc003e20 0x7f25cc004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e5040700 1 -- 172.21.15.57:0/2956228608 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc003260 con 0x7f25cc0049f0 2021-06-25T04:56:57.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e5040700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25cc0049f0 0x7f25cc004e70 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f25d0001450 tx=0x7f25e00a8ee0).ready entity=mon.0 client_cookie=2c55d19b3b119894 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:57.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d0007170 con 0x7f25cc0049f0 2021-06-25T04:56:57.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d00072d0 con 0x7f25cc0049f0 2021-06-25T04:56:57.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25df7fe700 1 -- 172.21.15.57:0/2956228608 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d000c8c0 con 0x7f25cc0049f0 2021-06-25T04:56:57.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e6aa3700 1 -- 172.21.15.57:0/2956228608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25cc0049f0 msgr2=0x7f25cc004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e6aa3700 1 --2- 172.21.15.57:0/2956228608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25cc0049f0 0x7f25cc004e70 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f25d0001450 tx=0x7f25e00a8ee0).stop 2021-06-25T04:56:57.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e5040700 1 -- 172.21.15.57:0/2956228608 reap_dead start 2021-06-25T04:56:57.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e6aa3700 1 -- 172.21.15.57:0/2956228608 shutdown_connections 2021-06-25T04:56:57.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e6aa3700 1 -- 172.21.15.57:0/2956228608 >> 172.21.15.57:0/2956228608 conn(0x7f25e00b53a0 msgr2=0x7f25e00b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:57.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e6aa3700 1 -- 172.21.15.57:0/2956228608 shutdown_connections 2021-06-25T04:56:57.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.463+0000 7f25e6aa3700 1 -- 172.21.15.57:0/2956228608 wait complete. 2021-06-25T04:56:57.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e6aa3700 1 Processor -- start 2021-06-25T04:56:57.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e6aa3700 1 -- start start 2021-06-25T04:56:57.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e6aa3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0146750 0x7f25e00abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e6aa3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e00ab930 0x7f25e00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e6aa3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e00af420 0x7f25e0144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e6aa3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0146b30 con 0x7f25e00af420 2021-06-25T04:56:57.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e6aa3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00aabf0 con 0x7f25e00ab930 2021-06-25T04:56:57.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e6aa3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00aae90 con 0x7f25e0146750 2021-06-25T04:56:57.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e5040700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e00af420 0x7f25e0144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e5040700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e00af420 0x7f25e0144630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44060/0 (socket says 172.21.15.57:44060) 2021-06-25T04:56:57.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e5040700 1 -- 172.21.15.57:0/3833627702 learned_addr learned my addr 172.21.15.57:0/3833627702 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:57.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e483f700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0146750 0x7f25e00abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25dffff700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e00ab930 0x7f25e00aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e5040700 1 -- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0146750 msgr2=0x7f25e00abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e5040700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0146750 0x7f25e00abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e5040700 1 -- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e00ab930 msgr2=0x7f25e00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e5040700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e00ab930 0x7f25e00aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e5040700 1 -- 172.21.15.57:0/3833627702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e00aa530 con 0x7f25e00af420 2021-06-25T04:56:57.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e5040700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e00af420 0x7f25e0144630 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f25e00a8ea0 tx=0x7f25d0013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:57.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25ddffb700 1 -- 172.21.15.57:0/3833627702 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d0000e90 con 0x7f25e00af420 2021-06-25T04:56:57.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25ddffb700 1 -- 172.21.15.57:0/3833627702 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d000c6a0 con 0x7f25e00af420 2021-06-25T04:56:57.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25ddffb700 1 -- 172.21.15.57:0/3833627702 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d00045e0 con 0x7f25e00af420 2021-06-25T04:56:57.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e6aa3700 1 -- 172.21.15.57:0/3833627702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e00aa840 con 0x7f25e00af420 2021-06-25T04:56:57.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.467+0000 7f25e6aa3700 1 -- 172.21.15.57:0/3833627702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e00adf90 con 0x7f25e00af420 2021-06-25T04:56:57.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.471+0000 7f25e6aa3700 1 -- 172.21.15.57:0/3833627702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e0057310 con 0x7f25e00af420 2021-06-25T04:56:57.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.471+0000 7f25ddffb700 1 -- 172.21.15.57:0/3833627702 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f25d001d070 con 0x7f25e00af420 2021-06-25T04:56:57.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.471+0000 7f25ddffb700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25c00553d0 0x7f25c0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.471+0000 7f25ddffb700 1 -- 172.21.15.57:0/3833627702 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f25d006d4d0 con 0x7f25e00af420 2021-06-25T04:56:57.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.471+0000 7f25e483f700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25c00553d0 0x7f25c0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.471+0000 7f25e483f700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25c00553d0 0x7f25c0057890 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f25d800d000 tx=0x7f25d800c040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:57.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.475+0000 7f25ddffb700 1 -- 172.21.15.57:0/3833627702 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f25d0043680 con 0x7f25e00af420 2021-06-25T04:56:57.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 -- 172.21.15.57:0/3833627702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25e00698a0 con 0x7f25e00af420 2021-06-25T04:56:57.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25ddffb700 1 -- 172.21.15.57:0/3833627702 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f25d0046ca0 con 0x7f25e00af420 2021-06-25T04:56:57.608 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:57.609 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":149,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:55.387316+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:56:52.813405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-06-25T04:56:53.777715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:56:57.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 -- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25c00553d0 msgr2=0x7f25c0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.611 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25c00553d0 0x7f25c0057890 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f25d800d000 tx=0x7f25d800c040).stop 2021-06-25T04:56:57.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 -- 172.21.15.57:0/3833627702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e00af420 msgr2=0x7f25e0144630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e00af420 0x7f25e0144630 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f25e00a8ea0 tx=0x7f25d0013000).stop 2021-06-25T04:56:57.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 -- 172.21.15.57:0/3833627702 shutdown_connections 2021-06-25T04:56:57.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f25c00553d0 0x7f25c0057890 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e00af420 0x7f25e0144630 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e00ab930 0x7f25e00aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 --2- 172.21.15.57:0/3833627702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e0146750 0x7f25e00abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 -- 172.21.15.57:0/3833627702 >> 172.21.15.57:0/3833627702 conn(0x7f25e00b53a0 msgr2=0x7f25e014c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 -- 172.21.15.57:0/3833627702 shutdown_connections 2021-06-25T04:56:57.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.603+0000 7f25e6aa3700 1 -- 172.21.15.57:0/3833627702 wait complete. 2021-06-25T04:56:57.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:56:52.813405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:56:53.777715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:56:57.628 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:56:57.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.735+0000 7ff701b56700 1 Processor -- start 2021-06-25T04:56:57.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.735+0000 7ff701b56700 1 -- start start 2021-06-25T04:56:57.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6fc0b26e0 0x7ff6fc13dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff6fc0b0fb0 0x7ff6fc13e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0aaa50 con 0x7ff6fc141040 2021-06-25T04:56:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc141be0 con 0x7ff6fc0b0fb0 2021-06-25T04:56:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc140c50 con 0x7ff6fc0b26e0 2021-06-25T04:56:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701355700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff6fc141040 0x7ff6fc1414d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33052/0 (socket says 172.21.15.57:33052) 2021-06-25T04:56:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701355700 1 -- 172.21.15.57:0/301535597 learned_addr learned my addr 172.21.15.57:0/301535597 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff6fbfff700 1 --2- 172.21.15.57:0/301535597 >> v2:172.21.15.57:3300/0 conn(0x7ff6fc0b0fb0 0x7ff6fc13e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff700b54700 1 --2- 172.21.15.57:0/301535597 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6fc0b26e0 0x7ff6fc13dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff6fb7fe700 1 -- 172.21.15.57:0/301535597 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422924995 0 0) 0x7ff6f4001110 con 0x7ff6fc141040 2021-06-25T04:56:57.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff6fb7fe700 1 -- 172.21.15.57:0/301535597 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6dc003260 con 0x7ff6fc141040 2021-06-25T04:56:57.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff6fbfff700 1 -- 172.21.15.57:0/301535597 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6fc0b26e0 msgr2=0x7ff6fc13dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:57.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff6fbfff700 1 --2- 172.21.15.57:0/301535597 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6fc0b26e0 0x7ff6fc13dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff6fbfff700 1 -- 172.21.15.57:0/301535597 >> v1:172.21.15.57:6789/0 conn(0x7ff6fc141040 legacy=0x7ff6fc1414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff6fbfff700 1 -- 172.21.15.57:0/301535597 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0b2ac0 con 0x7ff6fc0b0fb0 2021-06-25T04:56:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff700b54700 1 --2- 172.21.15.57:0/301535597 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6fc0b26e0 0x7ff6fc13dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:56:57.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff6fbfff700 1 --2- 172.21.15.57:0/301535597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6fc0b0fb0 0x7ff6fc13e4e0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7ff6e4002f70 tx=0x7ff6e4006df0).ready entity=mon.0 client_cookie=81164ce239cc2f48 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:57.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff6fb7fe700 1 -- 172.21.15.57:0/301535597 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e400d4a0 con 0x7ff6fc0b0fb0 2021-06-25T04:56:57.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff6fb7fe700 1 -- 172.21.15.57:0/301535597 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e4000e90 con 0x7ff6fc0b0fb0 2021-06-25T04:56:57.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff6fb7fe700 1 -- 172.21.15.57:0/301535597 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e400d7f0 con 0x7ff6fc0b0fb0 2021-06-25T04:56:57.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 -- 172.21.15.57:0/301535597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6fc0b0fb0 msgr2=0x7ff6fc13e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 --2- 172.21.15.57:0/301535597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6fc0b0fb0 0x7ff6fc13e4e0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7ff6e4002f70 tx=0x7ff6e4006df0).stop 2021-06-25T04:56:57.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 -- 172.21.15.57:0/301535597 shutdown_connections 2021-06-25T04:56:57.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 --2- 172.21.15.57:0/301535597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6fc0b0fb0 0x7ff6fc13e4e0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.757 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 --2- 172.21.15.57:0/301535597 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6fc0b26e0 0x7ff6fc13dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 -- 172.21.15.57:0/301535597 >> 172.21.15.57:0/301535597 conn(0x7ff6fc060140 msgr2=0x7ff6fc0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:57.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 -- 172.21.15.57:0/301535597 shutdown_connections 2021-06-25T04:56:57.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 -- 172.21.15.57:0/301535597 wait complete. 2021-06-25T04:56:57.758 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 Processor -- start 2021-06-25T04:56:57.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.739+0000 7ff701b56700 1 -- start start 2021-06-25T04:56:57.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701b56700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0b0fb0 0x7ff6fc0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701b56700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6fc0b26e0 0x7ff6fc139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701b56700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6fc141040 0x7ff6fc13ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701b56700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0b4ef0 con 0x7ff6fc141040 2021-06-25T04:56:57.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701b56700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0b3ab0 con 0x7ff6fc0b0fb0 2021-06-25T04:56:57.760 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701b56700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0b3d50 con 0x7ff6fc0b26e0 2021-06-25T04:56:57.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701355700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6fc141040 0x7ff6fc13ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701355700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6fc141040 0x7ff6fc13ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44074/0 (socket says 172.21.15.57:44074) 2021-06-25T04:56:57.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701355700 1 -- 172.21.15.57:0/3862283180 learned_addr learned my addr 172.21.15.57:0/3862283180 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:57.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff6fbfff700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6fc0b26e0 0x7ff6fc139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.761 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff700b54700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0b0fb0 0x7ff6fc0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701355700 1 -- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6fc0b26e0 msgr2=0x7ff6fc139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.762 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701355700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6fc0b26e0 0x7ff6fc139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701355700 1 -- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0b0fb0 msgr2=0x7ff6fc0b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701355700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0b0fb0 0x7ff6fc0b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.763 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701355700 1 -- 172.21.15.57:0/3862283180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec009470 con 0x7ff6fc141040 2021-06-25T04:56:57.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701355700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6fc141040 0x7ff6fc13ed90 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7ff6f40012a0 tx=0x7ff6f40078e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:57.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff6f9ffb700 1 -- 172.21.15.57:0/3862283180 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f400cdd0 con 0x7ff6fc141040 2021-06-25T04:56:57.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff6f9ffb700 1 -- 172.21.15.57:0/3862283180 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f40070d0 con 0x7ff6fc141040 2021-06-25T04:56:57.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701b56700 1 -- 172.21.15.57:0/3862283180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e400b180 con 0x7ff6fc141040 2021-06-25T04:56:57.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff6f9ffb700 1 -- 172.21.15.57:0/3862283180 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f4007430 con 0x7ff6fc141040 2021-06-25T04:56:57.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701b56700 1 -- 172.21.15.57:0/3862283180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc1372e0 con 0x7ff6fc141040 2021-06-25T04:56:57.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.743+0000 7ff701b56700 1 -- 172.21.15.57:0/3862283180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc057310 con 0x7ff6fc141040 2021-06-25T04:56:57.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.747+0000 7ff6f9ffb700 1 -- 172.21.15.57:0/3862283180 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff6f4010070 con 0x7ff6fc141040 2021-06-25T04:56:57.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.747+0000 7ff6f9ffb700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6e0055340 0x7ff6e0057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:57.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.747+0000 7ff6f9ffb700 1 -- 172.21.15.57:0/3862283180 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff6f406d360 con 0x7ff6fc141040 2021-06-25T04:56:57.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.747+0000 7ff700b54700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6e0055340 0x7ff6e0057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:57.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.747+0000 7ff700b54700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6e0055340 0x7ff6e0057800 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7ff6ec00b000 tx=0x7ff6ec0091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:57.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.751+0000 7ff6f9ffb700 1 -- 172.21.15.57:0/3862283180 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff6f4043470 con 0x7ff6fc141040 2021-06-25T04:56:57.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 -- 172.21.15.57:0/3862283180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff6fc0aaa50 con 0x7ff6fc141040 2021-06-25T04:56:57.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff6f9ffb700 1 -- 172.21.15.57:0/3862283180 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v149) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff6fc0aaa50 con 0x7ff6fc141040 2021-06-25T04:56:57.888 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:56:57.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 -- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6e0055340 msgr2=0x7ff6e0057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6e0055340 0x7ff6e0057800 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7ff6ec00b000 tx=0x7ff6ec0091d0).stop 2021-06-25T04:56:57.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 -- 172.21.15.57:0/3862283180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6fc141040 msgr2=0x7ff6fc13ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:57.890 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6fc141040 0x7ff6fc13ed90 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7ff6f40012a0 tx=0x7ff6f40078e0).stop 2021-06-25T04:56:57.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 -- 172.21.15.57:0/3862283180 shutdown_connections 2021-06-25T04:56:57.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff6e0055340 0x7ff6e0057800 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6fc141040 0x7ff6fc13ed90 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6fc0b26e0 0x7ff6fc139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.891 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 --2- 172.21.15.57:0/3862283180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0b0fb0 0x7ff6fc0b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:57.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 -- 172.21.15.57:0/3862283180 >> 172.21.15.57:0/3862283180 conn(0x7ff6fc060140 msgr2=0x7ff6fc13d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:57.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 -- 172.21.15.57:0/3862283180 shutdown_connections 2021-06-25T04:56:57.892 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:57.883+0000 7ff701b56700 1 -- 172.21.15.57:0/3862283180 wait complete. 2021-06-25T04:56:57.901 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:56:58.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.007+0000 7f6b0a198700 1 Processor -- start 2021-06-25T04:56:58.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.007+0000 7f6b0a198700 1 -- start start 2021-06-25T04:56:58.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.007+0000 7f6b0a198700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6b040b4140 0x7f6b04140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.007+0000 7f6b0a198700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b040b4650 0x7f6b040b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.007+0000 7f6b0a198700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b04143b20 con 0x7f6b04146910 2021-06-25T04:56:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.007+0000 7f6b0a198700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b041474d0 con 0x7f6b040b4650 2021-06-25T04:56:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.007+0000 7f6b0a198700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b04143dc0 con 0x7f6b040b4140 2021-06-25T04:56:58.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.007+0000 7f6b03fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b040b4650 0x7f6b040b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.007+0000 7f6b037fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6b04146910 0x7f6b041401f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33064/0 (socket says 172.21.15.57:33064) 2021-06-25T04:56:58.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.007+0000 7f6b037fe700 1 -- 172.21.15.57:0/952661090 learned_addr learned my addr 172.21.15.57:0/952661090 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:58.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.007+0000 7f6b02ffd700 1 --2- 172.21.15.57:0/952661090 >> v2:172.21.15.87:3300/0 conn(0x7f6b040b4140 0x7f6b04140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b03fff700 1 -- 172.21.15.57:0/952661090 >> v2:172.21.15.87:3300/0 conn(0x7f6b040b4140 msgr2=0x7f6b04140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:58.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b027fc700 1 -- 172.21.15.57:0/952661090 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402007230 0 0) 0x7f6b04143b20 con 0x7f6b04146910 2021-06-25T04:56:58.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b03fff700 1 --2- 172.21.15.57:0/952661090 >> v2:172.21.15.87:3300/0 conn(0x7f6b040b4140 0x7f6b04140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b03fff700 1 -- 172.21.15.57:0/952661090 >> v1:172.21.15.57:6789/0 conn(0x7f6b04146910 legacy=0x7f6b041401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b03fff700 1 -- 172.21.15.57:0/952661090 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b040b0c50 con 0x7f6b040b4650 2021-06-25T04:56:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b03fff700 1 --2- 172.21.15.57:0/952661090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b040b4650 0x7f6b040b4e90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f6afc0032f0 tx=0x7f6afc0091d0).ready entity=mon.0 client_cookie=f5f005276a088253 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b027fc700 1 -- 172.21.15.57:0/952661090 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6afc00b680 con 0x7f6b040b4650 2021-06-25T04:56:58.019 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b027fc700 1 -- 172.21.15.57:0/952661090 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc00b7e0 con 0x7f6b040b4650 2021-06-25T04:56:58.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b0a198700 1 -- 172.21.15.57:0/952661090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b040b4650 msgr2=0x7f6b040b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b027fc700 1 -- 172.21.15.57:0/952661090 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6afc00b950 con 0x7f6b040b4650 2021-06-25T04:56:58.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b0a198700 1 --2- 172.21.15.57:0/952661090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b040b4650 0x7f6b040b4e90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f6afc0032f0 tx=0x7f6afc0091d0).stop 2021-06-25T04:56:58.020 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b0a198700 1 -- 172.21.15.57:0/952661090 shutdown_connections 2021-06-25T04:56:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b0a198700 1 --2- 172.21.15.57:0/952661090 >> v2:172.21.15.87:3300/0 conn(0x7f6b040b4140 0x7f6b04140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b0a198700 1 --2- 172.21.15.57:0/952661090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b040b4650 0x7f6b040b4e90 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b0a198700 1 -- 172.21.15.57:0/952661090 >> 172.21.15.57:0/952661090 conn(0x7f6b0405c450 msgr2=0x7f6b0405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b0a198700 1 -- 172.21.15.57:0/952661090 shutdown_connections 2021-06-25T04:56:58.021 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b0a198700 1 -- 172.21.15.57:0/952661090 wait complete. 2021-06-25T04:56:58.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b0a198700 1 Processor -- start 2021-06-25T04:56:58.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.011+0000 7f6b0a198700 1 -- start start 2021-06-25T04:56:58.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b0a198700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b040b4140 0x7f6b040b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.025 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b0a198700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b040b4650 0x7f6b04152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b0a198700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b04146910 0x7f6b04152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b0a198700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b04151f40 con 0x7f6b04146910 2021-06-25T04:56:58.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b0a198700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b040b79f0 con 0x7f6b040b4140 2021-06-25T04:56:58.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b0a198700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b040b7f60 con 0x7f6b040b4650 2021-06-25T04:56:58.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b03fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b04146910 0x7f6b04152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b03fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b04146910 0x7f6b04152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44088/0 (socket says 172.21.15.57:44088) 2021-06-25T04:56:58.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b03fff700 1 -- 172.21.15.57:0/587652546 learned_addr learned my addr 172.21.15.57:0/587652546 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:58.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b02ffd700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b040b4650 0x7f6b04152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b037fe700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b040b4140 0x7f6b040b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b03fff700 1 -- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b040b4650 msgr2=0x7f6b04152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b03fff700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b040b4650 0x7f6b04152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b03fff700 1 -- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b040b4140 msgr2=0x7f6b040b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b03fff700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b040b4140 0x7f6b040b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b03fff700 1 -- 172.21.15.57:0/587652546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc009470 con 0x7f6b04146910 2021-06-25T04:56:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b037fe700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b040b4140 0x7f6b040b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b03fff700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b04146910 0x7f6b04152860 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f6afc0032f0 tx=0x7f6afc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b00ff9700 1 -- 172.21.15.57:0/587652546 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6afc006ea0 con 0x7f6b04146910 2021-06-25T04:56:58.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b00ff9700 1 -- 172.21.15.57:0/587652546 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc00bed0 con 0x7f6b04146910 2021-06-25T04:56:58.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b0a198700 1 -- 172.21.15.57:0/587652546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b040b8200 con 0x7f6b04146910 2021-06-25T04:56:58.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b00ff9700 1 -- 172.21.15.57:0/587652546 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6afc021670 con 0x7f6b04146910 2021-06-25T04:56:58.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.015+0000 7f6b0a198700 1 -- 172.21.15.57:0/587652546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b040b76e0 con 0x7f6b04146910 2021-06-25T04:56:58.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.019+0000 7f6b0a198700 1 -- 172.21.15.57:0/587652546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b040b8f00 con 0x7f6b04146910 2021-06-25T04:56:58.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.019+0000 7f6b00ff9700 1 -- 172.21.15.57:0/587652546 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f6afc00f070 con 0x7f6b04146910 2021-06-25T04:56:58.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.019+0000 7f6b00ff9700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6ae80554e0 0x7f6ae80579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.019+0000 7f6b00ff9700 1 -- 172.21.15.57:0/587652546 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6afc06f080 con 0x7f6b04146910 2021-06-25T04:56:58.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.019+0000 7f6b037fe700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6ae80554e0 0x7f6ae80579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.019+0000 7f6b037fe700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6ae80554e0 0x7f6ae80579a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f6aec00b000 tx=0x7f6aec009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.027+0000 7f6b00ff9700 1 -- 172.21.15.57:0/587652546 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f6afc0452e0 con 0x7f6b04146910 2021-06-25T04:56:58.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 -- 172.21.15.57:0/587652546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6b04057310 con 0x7f6b04146910 2021-06-25T04:56:58.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b00ff9700 1 -- 172.21.15.57:0/587652546 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v149) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6afc015020 con 0x7f6b04146910 2021-06-25T04:56:58.164 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:58.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 -- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6ae80554e0 msgr2=0x7f6ae80579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6ae80554e0 0x7f6ae80579a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f6aec00b000 tx=0x7f6aec009040).stop 2021-06-25T04:56:58.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 -- 172.21.15.57:0/587652546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b04146910 msgr2=0x7f6b04152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b04146910 0x7f6b04152860 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f6afc0032f0 tx=0x7f6afc016000).stop 2021-06-25T04:56:58.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 -- 172.21.15.57:0/587652546 shutdown_connections 2021-06-25T04:56:58.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f6ae80554e0 0x7f6ae80579a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b04146910 0x7f6b04152860 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b040b4650 0x7f6b04152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 --2- 172.21.15.57:0/587652546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b040b4140 0x7f6b040b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 -- 172.21.15.57:0/587652546 >> 172.21.15.57:0/587652546 conn(0x7f6b0405c450 msgr2=0x7f6b0413e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:58.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 -- 172.21.15.57:0/587652546 shutdown_connections 2021-06-25T04:56:58.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.159+0000 7f6b0a198700 1 -- 172.21.15.57:0/587652546 wait complete. 2021-06-25T04:56:58.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:56:58.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.283+0000 7fa415ebe700 1 Processor -- start 2021-06-25T04:56:58.289 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.283+0000 7fa415ebe700 1 -- start start 2021-06-25T04:56:58.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4100b4140 0x7fa410140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4100b4650 0x7fa4100b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa410143b20 con 0x7fa410146910 2021-06-25T04:56:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4101474d0 con 0x7fa4100b4650 2021-06-25T04:56:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa410143dc0 con 0x7fa4100b4140 2021-06-25T04:56:58.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4100b4650 0x7fa4100b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa410146910 0x7fa4101401f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33078/0 (socket says 172.21.15.57:33078) 2021-06-25T04:56:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4100b4650 0x7fa4100b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44096/0 (socket says 172.21.15.57:44096) 2021-06-25T04:56:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40ffff700 1 -- 172.21.15.57:0/313826931 learned_addr learned my addr 172.21.15.57:0/313826931 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:58.294 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40effd700 1 --2- 172.21.15.57:0/313826931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4100b4140 0x7fa410140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40ffff700 1 -- 172.21.15.57:0/313826931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4100b4140 msgr2=0x7fa410140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40ffff700 1 --2- 172.21.15.57:0/313826931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4100b4140 0x7fa410140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40ffff700 1 -- 172.21.15.57:0/313826931 >> v1:172.21.15.57:6789/0 conn(0x7fa410146910 legacy=0x7fa4101401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.295 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40ffff700 1 -- 172.21.15.57:0/313826931 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4100b0c50 con 0x7fa4100b4650 2021-06-25T04:56:58.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40e7fc700 1 -- 172.21.15.57:0/313826931 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570537497 0 0) 0x7fa410143b20 con 0x7fa410146910 2021-06-25T04:56:58.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40ffff700 1 --2- 172.21.15.57:0/313826931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100b4650 0x7fa4100b4e90 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fa4080032f0 tx=0x7fa408009290).ready entity=mon.0 client_cookie=41a900f57658efc4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40e7fc700 1 -- 172.21.15.57:0/313826931 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa40800b8a0 con 0x7fa4100b4650 2021-06-25T04:56:58.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40e7fc700 1 -- 172.21.15.57:0/313826931 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40800ba00 con 0x7fa4100b4650 2021-06-25T04:56:58.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa40e7fc700 1 -- 172.21.15.57:0/313826931 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa40800bb70 con 0x7fa4100b4650 2021-06-25T04:56:58.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 -- 172.21.15.57:0/313826931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100b4650 msgr2=0x7fa4100b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.297 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 --2- 172.21.15.57:0/313826931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100b4650 0x7fa4100b4e90 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fa4080032f0 tx=0x7fa408009290).stop 2021-06-25T04:56:58.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 -- 172.21.15.57:0/313826931 shutdown_connections 2021-06-25T04:56:58.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 --2- 172.21.15.57:0/313826931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4100b4140 0x7fa410140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 --2- 172.21.15.57:0/313826931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100b4650 0x7fa4100b4e90 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 -- 172.21.15.57:0/313826931 >> 172.21.15.57:0/313826931 conn(0x7fa41005c450 msgr2=0x7fa41005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:58.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 -- 172.21.15.57:0/313826931 shutdown_connections 2021-06-25T04:56:58.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.287+0000 7fa415ebe700 1 -- 172.21.15.57:0/313826931 wait complete. 2021-06-25T04:56:58.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa415ebe700 1 Processor -- start 2021-06-25T04:56:58.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa415ebe700 1 -- start start 2021-06-25T04:56:58.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa415ebe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100b4140 0x7fa4101426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa415ebe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4100b4650 0x7fa410155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa415ebe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa410146910 0x7fa410147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa415ebe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41014a100 con 0x7fa4100b4140 2021-06-25T04:56:58.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa415ebe700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa410155600 con 0x7fa410146910 2021-06-25T04:56:58.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa415ebe700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101558a0 con 0x7fa4100b4650 2021-06-25T04:56:58.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa40f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100b4140 0x7fa4101426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa40f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100b4140 0x7fa4101426b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44098/0 (socket says 172.21.15.57:44098) 2021-06-25T04:56:58.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa40f7fe700 1 -- 172.21.15.57:0/2147644537 learned_addr learned my addr 172.21.15.57:0/2147644537 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:58.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa40ffff700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa410146910 0x7fa410147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.305 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa40effd700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4100b4650 0x7fa410155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa40f7fe700 1 -- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4100b4650 msgr2=0x7fa410155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa40f7fe700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4100b4650 0x7fa410155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa40f7fe700 1 -- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa410146910 msgr2=0x7fa410147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.306 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa40f7fe700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa410146910 0x7fa410147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.291+0000 7fa40f7fe700 1 -- 172.21.15.57:0/2147644537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa408009530 con 0x7fa4100b4140 2021-06-25T04:56:58.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.295+0000 7fa40f7fe700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100b4140 0x7fa4101426b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7fa400000ed0 tx=0x7fa400007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.295+0000 7fa40cff9700 1 -- 172.21.15.57:0/2147644537 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4000070d0 con 0x7fa4100b4140 2021-06-25T04:56:58.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.295+0000 7fa40cff9700 1 -- 172.21.15.57:0/2147644537 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa400007230 con 0x7fa4100b4140 2021-06-25T04:56:58.307 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.295+0000 7fa415ebe700 1 -- 172.21.15.57:0/2147644537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa410155b40 con 0x7fa4100b4140 2021-06-25T04:56:58.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.295+0000 7fa40cff9700 1 -- 172.21.15.57:0/2147644537 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa400005550 con 0x7fa4100b4140 2021-06-25T04:56:58.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.295+0000 7fa415ebe700 1 -- 172.21.15.57:0/2147644537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa410147b80 con 0x7fa4100b4140 2021-06-25T04:56:58.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.295+0000 7fa415ebe700 1 -- 172.21.15.57:0/2147644537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa410057310 con 0x7fa4100b4140 2021-06-25T04:56:58.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.295+0000 7fa40cff9700 1 -- 172.21.15.57:0/2147644537 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa40001a060 con 0x7fa4100b4140 2021-06-25T04:56:58.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.295+0000 7fa40cff9700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3f4055490 0x7fa3f4057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.295+0000 7fa40cff9700 1 -- 172.21.15.57:0/2147644537 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa40006d2d0 con 0x7fa4100b4140 2021-06-25T04:56:58.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.295+0000 7fa40effd700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3f4055490 0x7fa3f4057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.299+0000 7fa40effd700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3f4055490 0x7fa3f4057950 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fa3f800b000 tx=0x7fa3f8008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.311 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.303+0000 7fa40cff9700 1 -- 172.21.15.57:0/2147644537 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa400043480 con 0x7fa4100b4140 2021-06-25T04:56:58.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.431+0000 7fa415ebe700 1 -- 172.21.15.57:0/2147644537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4100698a0 con 0x7fa4100b4140 2021-06-25T04:56:58.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.431+0000 7fa40cff9700 1 -- 172.21.15.57:0/2147644537 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v149) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa400018020 con 0x7fa4100b4140 2021-06-25T04:56:58.437 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:58.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 -- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3f4055490 msgr2=0x7fa3f4057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3f4055490 0x7fa3f4057950 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fa3f800b000 tx=0x7fa3f8008040).stop 2021-06-25T04:56:58.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 -- 172.21.15.57:0/2147644537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100b4140 msgr2=0x7fa4101426b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100b4140 0x7fa4101426b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7fa400000ed0 tx=0x7fa400007c80).stop 2021-06-25T04:56:58.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 -- 172.21.15.57:0/2147644537 shutdown_connections 2021-06-25T04:56:58.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa3f4055490 0x7fa3f4057950 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa410146910 0x7fa410147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4100b4650 0x7fa410155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 --2- 172.21.15.57:0/2147644537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100b4140 0x7fa4101426b0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 -- 172.21.15.57:0/2147644537 >> 172.21.15.57:0/2147644537 conn(0x7fa41005c450 msgr2=0x7fa4100b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:58.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 -- 172.21.15.57:0/2147644537 shutdown_connections 2021-06-25T04:56:58.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.435+0000 7fa415ebe700 1 -- 172.21.15.57:0/2147644537 wait complete. 2021-06-25T04:56:58.450 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:56:58.553 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.547+0000 7faf01189700 1 Processor -- start 2021-06-25T04:56:58.554 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.547+0000 7faf01189700 1 -- start start 2021-06-25T04:56:58.556 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faf01189700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faefc0b4140 0x7faefc140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faf01189700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc143b20 con 0x7faefc0b4650 2021-06-25T04:56:58.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faf01189700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc143dc0 con 0x7faefc146910 2021-06-25T04:56:58.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faf01189700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc1474d0 con 0x7faefc0b4140 2021-06-25T04:56:58.557 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faefb59e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faefc0b4650 0x7faefc0b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33096/0 (socket says 172.21.15.57:33096) 2021-06-25T04:56:58.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faefb59e700 1 -- 172.21.15.57:0/1764095846 learned_addr learned my addr 172.21.15.57:0/1764095846 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:56:58.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faefa59c700 1 --2- 172.21.15.57:0/1764095846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faefc0b4140 0x7faefc140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.558 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faef9d9b700 1 -- 172.21.15.57:0/1764095846 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435978568 0 0) 0x7faefc143b20 con 0x7faefc0b4650 2021-06-25T04:56:58.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faef9d9b700 1 -- 172.21.15.57:0/1764095846 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faee0003260 con 0x7faefc0b4650 2021-06-25T04:56:58.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faefa59c700 1 -- 172.21.15.57:0/1764095846 >> v1:172.21.15.87:6789/0 conn(0x7faefc146910 legacy=0x7faefc1401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.559 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faefa59c700 1 -- 172.21.15.57:0/1764095846 >> v1:172.21.15.57:6789/0 conn(0x7faefc0b4650 legacy=0x7faefc0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faefa59c700 1 -- 172.21.15.57:0/1764095846 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc0b0c50 con 0x7faefc0b4140 2021-06-25T04:56:58.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faefa59c700 1 --2- 172.21.15.57:0/1764095846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faefc0b4140 0x7faefc140900 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7faef0002f70 tx=0x7faef0006df0).ready entity=mon.2 client_cookie=514ffba26ee43e7a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faef9d9b700 1 -- 172.21.15.57:0/1764095846 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef000d570 con 0x7faefc0b4140 2021-06-25T04:56:58.560 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faef9d9b700 1 -- 172.21.15.57:0/1764095846 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef0000e90 con 0x7faefc0b4140 2021-06-25T04:56:58.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faef9d9b700 1 -- 172.21.15.57:0/1764095846 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef000d8c0 con 0x7faefc0b4140 2021-06-25T04:56:58.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faf01189700 1 -- 172.21.15.57:0/1764095846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faefc0b4140 msgr2=0x7faefc140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.561 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faf01189700 1 --2- 172.21.15.57:0/1764095846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faefc0b4140 0x7faefc140900 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7faef0002f70 tx=0x7faef0006df0).stop 2021-06-25T04:56:58.564 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faf01189700 1 -- 172.21.15.57:0/1764095846 shutdown_connections 2021-06-25T04:56:58.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faf01189700 1 --2- 172.21.15.57:0/1764095846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faefc0b4140 0x7faefc140900 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faf01189700 1 -- 172.21.15.57:0/1764095846 >> 172.21.15.57:0/1764095846 conn(0x7faefc05c450 msgr2=0x7faefc05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:58.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faf01189700 1 -- 172.21.15.57:0/1764095846 shutdown_connections 2021-06-25T04:56:58.565 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.551+0000 7faf01189700 1 -- 172.21.15.57:0/1764095846 wait complete. 2021-06-25T04:56:58.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.555+0000 7faf01189700 1 Processor -- start 2021-06-25T04:56:58.566 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.555+0000 7faf01189700 1 -- start start 2021-06-25T04:56:58.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.555+0000 7faf01189700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faefc0b4140 0x7faefc0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.555+0000 7faf01189700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faefc0b4650 0x7faefc0afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.567 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.555+0000 7faf01189700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc146910 0x7faefc13f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.555+0000 7faf01189700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0ae6f0 con 0x7faefc146910 2021-06-25T04:56:58.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.555+0000 7faf01189700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc142110 con 0x7faefc0b4650 2021-06-25T04:56:58.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.555+0000 7faf01189700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc142990 con 0x7faefc0b4140 2021-06-25T04:56:58.568 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faefb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc146910 0x7faefc13f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faefb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc146910 0x7faefc13f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44116/0 (socket says 172.21.15.57:44116) 2021-06-25T04:56:58.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faefb59e700 1 -- 172.21.15.57:0/1224480268 learned_addr learned my addr 172.21.15.57:0/1224480268 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:58.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faefad9d700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faefc0b4140 0x7faefc0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faefa59c700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faefc0b4650 0x7faefc0afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faefb59e700 1 -- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faefc0b4140 msgr2=0x7faefc0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faefb59e700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faefc0b4140 0x7faefc0b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faefb59e700 1 -- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faefc0b4650 msgr2=0x7faefc0afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faefb59e700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faefc0b4650 0x7faefc0afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faefb59e700 1 -- 172.21.15.57:0/1224480268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef000b180 con 0x7faefc146910 2021-06-25T04:56:58.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faefb59e700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc146910 0x7faefc13f020 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7faef4001490 tx=0x7faef4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faeebfff700 1 -- 172.21.15.57:0/1224480268 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef4005ba0 con 0x7faefc146910 2021-06-25T04:56:58.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faeebfff700 1 -- 172.21.15.57:0/1224480268 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef4005d00 con 0x7faefc146910 2021-06-25T04:56:58.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faf01189700 1 -- 172.21.15.57:0/1224480268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc1423b0 con 0x7faefc146910 2021-06-25T04:56:58.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faeebfff700 1 -- 172.21.15.57:0/1224480268 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef40072c0 con 0x7faefc146910 2021-06-25T04:56:58.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faf01189700 1 -- 172.21.15.57:0/1224480268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc0b3880 con 0x7faefc146910 2021-06-25T04:56:58.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.559+0000 7faf01189700 1 -- 172.21.15.57:0/1224480268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc142b50 con 0x7faefc146910 2021-06-25T04:56:58.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.563+0000 7faeebfff700 1 -- 172.21.15.57:0/1224480268 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7faef4010070 con 0x7faefc146910 2021-06-25T04:56:58.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.563+0000 7faeebfff700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed8055340 0x7faed8057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.563+0000 7faeebfff700 1 -- 172.21.15.57:0/1224480268 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7faef406d7c0 con 0x7faefc146910 2021-06-25T04:56:58.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.563+0000 7faefad9d700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed8055340 0x7faed8057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.563+0000 7faefad9d700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed8055340 0x7faed8057800 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7faeec00d000 tx=0x7faeec007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.571+0000 7faeebfff700 1 -- 172.21.15.57:0/1224480268 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7faef4043970 con 0x7faefc146910 2021-06-25T04:56:58.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.699+0000 7faf01189700 1 -- 172.21.15.57:0/1224480268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faefc057310 con 0x7faefc146910 2021-06-25T04:56:58.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.699+0000 7faeebfff700 1 -- 172.21.15.57:0/1224480268 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v149) v1 ==== 100+0+10 (secure 0 0 0) 0x7faef4046f90 con 0x7faefc146910 2021-06-25T04:56:58.706 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:56:58.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.703+0000 7faf01189700 1 -- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed8055340 msgr2=0x7faed8057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.703+0000 7faf01189700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed8055340 0x7faed8057800 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7faeec00d000 tx=0x7faeec007b90).stop 2021-06-25T04:56:58.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.703+0000 7faf01189700 1 -- 172.21.15.57:0/1224480268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc146910 msgr2=0x7faefc13f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.703+0000 7faf01189700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc146910 0x7faefc13f020 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7faef4001490 tx=0x7faef4007e00).stop 2021-06-25T04:56:58.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.703+0000 7faf01189700 1 -- 172.21.15.57:0/1224480268 shutdown_connections 2021-06-25T04:56:58.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.703+0000 7faf01189700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faed8055340 0x7faed8057800 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.703+0000 7faf01189700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faefc146910 0x7faefc13f020 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.703+0000 7faf01189700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faefc0b4650 0x7faefc0afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.703+0000 7faf01189700 1 --2- 172.21.15.57:0/1224480268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faefc0b4140 0x7faefc0b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.703+0000 7faf01189700 1 -- 172.21.15.57:0/1224480268 >> 172.21.15.57:0/1224480268 conn(0x7faefc05c450 msgr2=0x7faefc1452a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:58.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.703+0000 7faf01189700 1 -- 172.21.15.57:0/1224480268 shutdown_connections 2021-06-25T04:56:58.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.707+0000 7faf01189700 1 -- 172.21.15.57:0/1224480268 wait complete. 2021-06-25T04:56:58.725 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:56:58.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:56:58.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.823+0000 7f06431ed700 1 Processor -- start 2021-06-25T04:56:58.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.823+0000 7f06431ed700 1 -- start start 2021-06-25T04:56:58.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.823+0000 7f06431ed700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f063c0b5460 0x7f063c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.823+0000 7f06431ed700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f063c147560 0x7f063c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.823+0000 7f06431ed700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c0b5840 con 0x7f063c0b05d0 2021-06-25T04:56:58.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.823+0000 7f06431ed700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c1452a0 con 0x7f063c0b5460 2021-06-25T04:56:58.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.823+0000 7f06431ed700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0adfb0 con 0x7f063c147560 2021-06-25T04:56:58.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.823+0000 7f06421eb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f063c0b5460 0x7f063c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06421eb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f063c0b5460 0x7f063c0af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44122/0 (socket says 172.21.15.57:44122) 2021-06-25T04:56:58.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06421eb700 1 -- 172.21.15.57:0/3385154775 learned_addr learned my addr 172.21.15.57:0/3385154775 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:58.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06429ec700 1 --2- 172.21.15.57:0/3385154775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f063c147560 0x7f063c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06421eb700 1 -- 172.21.15.57:0/3385154775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f063c147560 msgr2=0x7f063c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:56:58.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06421eb700 1 --2- 172.21.15.57:0/3385154775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f063c147560 0x7f063c0acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06421eb700 1 -- 172.21.15.57:0/3385154775 >> v1:172.21.15.87:6789/0 conn(0x7f063c0b05d0 legacy=0x7f063c067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06421eb700 1 -- 172.21.15.57:0/3385154775 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0ac7c0 con 0x7f063c0b5460 2021-06-25T04:56:58.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06421eb700 1 --2- 172.21.15.57:0/3385154775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f063c0b5460 0x7f063c0af510 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f0630002f70 tx=0x7f0630006eb0).ready entity=mon.0 client_cookie=4ddde6090edc7012 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06411e9700 1 -- 172.21.15.57:0/3385154775 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063000d570 con 0x7f063c0b5460 2021-06-25T04:56:58.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06411e9700 1 -- 172.21.15.57:0/3385154775 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0630000e90 con 0x7f063c0b5460 2021-06-25T04:56:58.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06411e9700 1 -- 172.21.15.57:0/3385154775 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063000d900 con 0x7f063c0b5460 2021-06-25T04:56:58.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06431ed700 1 -- 172.21.15.57:0/3385154775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f063c0b5460 msgr2=0x7f063c0af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06431ed700 1 --2- 172.21.15.57:0/3385154775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f063c0b5460 0x7f063c0af510 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f0630002f70 tx=0x7f0630006eb0).stop 2021-06-25T04:56:58.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06431ed700 1 -- 172.21.15.57:0/3385154775 shutdown_connections 2021-06-25T04:56:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06431ed700 1 --2- 172.21.15.57:0/3385154775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f063c147560 0x7f063c0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06431ed700 1 --2- 172.21.15.57:0/3385154775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f063c0b5460 0x7f063c0af510 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06431ed700 1 -- 172.21.15.57:0/3385154775 >> 172.21.15.57:0/3385154775 conn(0x7f063c062520 msgr2=0x7f063c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06431ed700 1 -- 172.21.15.57:0/3385154775 shutdown_connections 2021-06-25T04:56:58.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.827+0000 7f06431ed700 1 -- 172.21.15.57:0/3385154775 wait complete. 2021-06-25T04:56:58.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06431ed700 1 Processor -- start 2021-06-25T04:56:58.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06431ed700 1 -- start start 2021-06-25T04:56:58.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06431ed700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f063c0b05d0 0x7f063c143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06431ed700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f063c0b5460 0x7f063c13ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06431ed700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f063c147560 0x7f063c13f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06431ed700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c1453e0 con 0x7f063c147560 2021-06-25T04:56:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06431ed700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c13f9e0 con 0x7f063c0b5460 2021-06-25T04:56:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06431ed700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c145610 con 0x7f063c0b05d0 2021-06-25T04:56:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06429ec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f063c147560 0x7f063c13f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06421eb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f063c0b05d0 0x7f063c143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06429ec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f063c147560 0x7f063c13f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44130/0 (socket says 172.21.15.57:44130) 2021-06-25T04:56:58.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06421eb700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f063c0b05d0 0x7f063c143280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:55290/0 (socket says 172.21.15.57:55290) 2021-06-25T04:56:58.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06429ec700 1 -- 172.21.15.57:0/3052667171 learned_addr learned my addr 172.21.15.57:0/3052667171 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:56:58.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06419ea700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f063c0b5460 0x7f063c13ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06429ec700 1 -- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f063c0b05d0 msgr2=0x7f063c143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06429ec700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f063c0b05d0 0x7f063c143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06429ec700 1 -- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f063c0b5460 msgr2=0x7f063c13ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:58.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06429ec700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f063c0b5460 0x7f063c13ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:58.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06429ec700 1 -- 172.21.15.57:0/3052667171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063000b1e0 con 0x7f063c147560 2021-06-25T04:56:58.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.831+0000 7f06419ea700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f063c0b5460 0x7f063c13ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:56:58.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f06429ec700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f063c147560 0x7f063c13f120 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f063400c000 tx=0x7f0634006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f063b7fe700 1 -- 172.21.15.57:0/3052667171 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0634011750 con 0x7f063c147560 2021-06-25T04:56:58.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f063b7fe700 1 -- 172.21.15.57:0/3052667171 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06340118b0 con 0x7f063c147560 2021-06-25T04:56:58.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f06431ed700 1 -- 172.21.15.57:0/3052667171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c13fc10 con 0x7f063c147560 2021-06-25T04:56:58.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f063b7fe700 1 -- 172.21.15.57:0/3052667171 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0634011c10 con 0x7f063c147560 2021-06-25T04:56:58.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f06431ed700 1 -- 172.21.15.57:0/3052667171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c144c60 con 0x7f063c147560 2021-06-25T04:56:58.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f06431ed700 1 -- 172.21.15.57:0/3052667171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c13fda0 con 0x7f063c147560 2021-06-25T04:56:58.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f063b7fe700 1 -- 172.21.15.57:0/3052667171 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f0634011d70 con 0x7f063c147560 2021-06-25T04:56:58.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f063b7fe700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f061c0553d0 0x7f061c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:56:58.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f063b7fe700 1 -- 172.21.15.57:0/3052667171 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f063406e2d0 con 0x7f063c147560 2021-06-25T04:56:58.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f06421eb700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f061c0553d0 0x7f061c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:56:58.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.835+0000 7f06421eb700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f061c0553d0 0x7f061c057890 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f063001b000 tx=0x7f0630015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:56:58.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:58.843+0000 7f063b7fe700 1 -- 172.21.15.57:0/3052667171 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0634044480 con 0x7f063c147560 2021-06-25T04:56:59.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 -- 172.21.15.57:0/3052667171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f063c057310 con 0x7f063c147560 2021-06-25T04:56:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f063b7fe700 1 -- 172.21.15.57:0/3052667171 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f0634047aa0 con 0x7f063c147560 2021-06-25T04:56:59.008 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:56:59.008 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":75,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2769630783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2769630783},{"type":"v1","addr":"172.21.15.87:6835","nonce":2769630783}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/583651666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":583651666},{"type":"v1","addr":"172.21.15.57:6834","nonce":583651666}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:54.383291+0000","modified":"2021-06-25T04:56:55.386538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8445":{"gid":8445,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2461786269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2461786269},{"type":"v1","addr":"172.21.15.57:6835","nonce":2461786269}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-06-25T04:56:59.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 -- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f061c0553d0 msgr2=0x7f061c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:59.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f061c0553d0 0x7f061c057890 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f063001b000 tx=0x7f0630015000).stop 2021-06-25T04:56:59.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 -- 172.21.15.57:0/3052667171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f063c147560 msgr2=0x7f063c13f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:56:59.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f063c147560 0x7f063c13f120 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f063400c000 tx=0x7f0634006df0).stop 2021-06-25T04:56:59.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 -- 172.21.15.57:0/3052667171 shutdown_connections 2021-06-25T04:56:59.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f061c0553d0 0x7f061c057890 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:59.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f063c147560 0x7f063c13f120 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:59.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f063c0b5460 0x7f063c13ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:59.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 --2- 172.21.15.57:0/3052667171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f063c0b05d0 0x7f063c143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:56:59.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 -- 172.21.15.57:0/3052667171 >> 172.21.15.57:0/3052667171 conn(0x7f063c062520 msgr2=0x7f063c148ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:56:59.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 -- 172.21.15.57:0/3052667171 shutdown_connections 2021-06-25T04:56:59.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:56:59.003+0000 7f06431ed700 1 -- 172.21.15.57:0/3052667171 wait complete. 2021-06-25T04:56:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 75 2021-06-25T04:56:59.327 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:56:54.383291+0000', 'modified': '2021-06-25T04:56:55.386538+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8445}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8445': {'gid': 8445, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2461786269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2461786269}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2461786269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:56:59.328 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:56:59.329 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:56:59.448 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":8445,"want_state":"up:active","state":"up:active","rank_uptime":5.0509913070000003,"mdsmap_epoch":75,"osdmap_epoch":149,"osdmap_epoch_barrier":148,"uptime":9.4215009129999991} 2021-06-25T04:56:59.448 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 8445, "mdsmap_epoch": 75, "osdmap_epoch": 149, "osdmap_epoch_barrier": 148, "rank_uptime": 5.050991307, "state": "up:active", "uptime": 9.421500913, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:56:59.449 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:56:59.449 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:56:59.450 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:56:59.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:59.451 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:59.460 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:56:59.523 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:56:59.524 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:56:59.536 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:56:59.537 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:56:59.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:59.539 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:56:59.545 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:56:59.546 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:56:59.588 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:56:59.605 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:56:59.606 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:56:59.618 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:56:59.620 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:56:59.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:56:59.622 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:56:59.661 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:56:59.654+0000 7fd503541080 -1 init, newargv = 0x562ccb5495f0 newargc=9ceph-fuse[15659]: starting ceph client 2021-06-25T04:56:59.662 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr: 2021-06-25T04:56:59.673 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15659]: starting fuse 2021-06-25T04:57:00.730 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:57:00.749 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:57:00.750 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:57:00.802 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:57:00.803 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:57:00.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:00.805 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:57:00.812 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:57:00.813 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:57:00.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:00.814 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:57:00.814 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:57:00.814 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:57:00.815 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:57:00.815 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:57:00.816 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:57:00.816 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:57:00.816 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:57:00.817 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:57:00.817 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:57:00.818 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:57:00.818 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:57:00.819 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:57:00.819 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:57:00.819 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:57:00.820 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:57:00.820 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:57:00.821 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:57:00.821 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:57:00.821 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:57:00.822 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:57:00.822 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:57:00.823 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:57:00.864 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.15659.asok 2021-06-25T04:57:00.869 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15659.asok 2021-06-25T04:57:00.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:00.870 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15659.asok status 2021-06-25T04:57:00.999 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:57:00.999 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:57:00.999 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:57:01.000 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:57:01.000 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:57:01.000 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:57:01.000 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:57:01.000 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "15659", 2021-06-25T04:57:01.001 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:57:01.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:57:01.001 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:57:01.001 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:57:01.002 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 8616, 2021-06-25T04:57:01.002 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:57:01.002 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:57:01.002 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:57:01.002 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 8616 2021-06-25T04:57:01.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:57:01.003 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:57:01.003 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:57:01.003 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:57:01.004 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2823946058 2021-06-25T04:57:01.004 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:57:01.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:57:01.004 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:57:01.004 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:57:01.005 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:57:01.005 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2823946058 2021-06-25T04:57:01.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:57:01.005 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.8616 172.21.15.102:0/2823946058", 2021-06-25T04:57:01.006 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/2823946058", 2021-06-25T04:57:01.006 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:57:01.006 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 75, 2021-06-25T04:57:01.006 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 149, 2021-06-25T04:57:01.006 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:57:01.007 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:57:01.007 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:57:01.007 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:57:01.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:01.009 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:01.009 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:57:01.016 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:57:01.017 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:57:01.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:01.018 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:57:01.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:57:01.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dd2495700 1 Processor -- start 2021-06-25T04:57:01.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dd2495700 1 -- start start 2021-06-25T04:57:01.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dd2495700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1dcc0b1da0 0x7f1dcc144070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.150 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dd2495700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0b2240 con 0x7f1dcc0b2610 2021-06-25T04:57:01.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dd2495700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc143690 con 0x7f1dcc05c450 2021-06-25T04:57:01.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dd2495700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc13de00 con 0x7f1dcc0b1da0 2021-06-25T04:57:01.151 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dcbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1dcc0b2610 0x7f1dcc1400a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33120/0 (socket says 172.21.15.57:33120) 2021-06-25T04:57:01.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dcbfff700 1 -- 172.21.15.57:0/1653621208 learned_addr learned my addr 172.21.15.57:0/1653621208 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:01.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dcb7fe700 1 --2- 172.21.15.57:0/1653621208 >> v2:172.21.15.87:3300/0 conn(0x7f1dcc0b1da0 0x7f1dcc144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dcaffd700 1 -- 172.21.15.57:0/1653621208 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026077272 0 0) 0x7f1dcc0b2240 con 0x7f1dcc0b2610 2021-06-25T04:57:01.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dcaffd700 1 -- 172.21.15.57:0/1653621208 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db8003260 con 0x7f1dcc0b2610 2021-06-25T04:57:01.152 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dcaffd700 1 -- 172.21.15.57:0/1653621208 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153175610 0 0) 0x7f1dcc143690 con 0x7f1dcc05c450 2021-06-25T04:57:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.143+0000 7f1dcaffd700 1 -- 172.21.15.57:0/1653621208 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dcc0b2240 con 0x7f1dcc05c450 2021-06-25T04:57:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dcb7fe700 1 -- 172.21.15.57:0/1653621208 >> v1:172.21.15.87:6789/0 conn(0x7f1dcc05c450 legacy=0x7f1dcc0ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dcb7fe700 1 -- 172.21.15.57:0/1653621208 >> v1:172.21.15.57:6789/0 conn(0x7f1dcc0b2610 legacy=0x7f1dcc1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dcb7fe700 1 -- 172.21.15.57:0/1653621208 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc143930 con 0x7f1dcc0b1da0 2021-06-25T04:57:01.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dcb7fe700 1 --2- 172.21.15.57:0/1653621208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dcc0b1da0 0x7f1dcc144070 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f1dc0002f70 tx=0x7f1dc0006df0).ready entity=mon.1 client_cookie=dd4ed9f052548484 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dcaffd700 1 -- 172.21.15.57:0/1653621208 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc000d540 con 0x7f1dcc0b1da0 2021-06-25T04:57:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dcaffd700 1 -- 172.21.15.57:0/1653621208 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc0000e90 con 0x7f1dcc0b1da0 2021-06-25T04:57:01.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dcaffd700 1 -- 172.21.15.57:0/1653621208 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc000d890 con 0x7f1dcc0b1da0 2021-06-25T04:57:01.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dd2495700 1 -- 172.21.15.57:0/1653621208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dcc0b1da0 msgr2=0x7f1dcc144070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dd2495700 1 --2- 172.21.15.57:0/1653621208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dcc0b1da0 0x7f1dcc144070 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f1dc0002f70 tx=0x7f1dc0006df0).stop 2021-06-25T04:57:01.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dd2495700 1 -- 172.21.15.57:0/1653621208 shutdown_connections 2021-06-25T04:57:01.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dd2495700 1 --2- 172.21.15.57:0/1653621208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dcc0b1da0 0x7f1dcc144070 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dd2495700 1 -- 172.21.15.57:0/1653621208 >> 172.21.15.57:0/1653621208 conn(0x7f1dcc05cce0 msgr2=0x7f1dcc062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:01.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dd2495700 1 -- 172.21.15.57:0/1653621208 shutdown_connections 2021-06-25T04:57:01.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.147+0000 7f1dd2495700 1 -- 172.21.15.57:0/1653621208 wait complete. 2021-06-25T04:57:01.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dd2495700 1 Processor -- start 2021-06-25T04:57:01.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dd2495700 1 -- start start 2021-06-25T04:57:01.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dd2495700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc05c450 0x7f1dcc14efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dd2495700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dcc0b1da0 0x7f1dcc0a70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dd2495700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dcc0b2610 0x7f1dcc0a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dd2495700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0a8990 con 0x7f1dcc05c450 2021-06-25T04:57:01.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dd2495700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0a87d0 con 0x7f1dcc0b2610 2021-06-25T04:57:01.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dd2495700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0a85a0 con 0x7f1dcc0b1da0 2021-06-25T04:57:01.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dcbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc05c450 0x7f1dcc14efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dcbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc05c450 0x7f1dcc14efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44140/0 (socket says 172.21.15.57:44140) 2021-06-25T04:57:01.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dcbfff700 1 -- 172.21.15.57:0/318191396 learned_addr learned my addr 172.21.15.57:0/318191396 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:01.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dcb7fe700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dcc0b1da0 0x7f1dcc0a70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dd0a32700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dcc0b2610 0x7f1dcc0a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.168 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dcbfff700 1 -- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dcc0b1da0 msgr2=0x7f1dcc0a70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dcbfff700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dcc0b1da0 0x7f1dcc0a70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dcbfff700 1 -- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dcc0b2610 msgr2=0x7f1dcc0a80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dcbfff700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dcc0b2610 0x7f1dcc0a80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.151+0000 7f1dcbfff700 1 -- 172.21.15.57:0/318191396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc000b180 con 0x7f1dcc05c450 2021-06-25T04:57:01.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dcbfff700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc05c450 0x7f1dcc14efa0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f1dcc0a9410 tx=0x7f1dbc007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dc97fa700 1 -- 172.21.15.57:0/318191396 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dbc00ce40 con 0x7f1dcc05c450 2021-06-25T04:57:01.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dc97fa700 1 -- 172.21.15.57:0/318191396 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc0070d0 con 0x7f1dcc05c450 2021-06-25T04:57:01.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dd2495700 1 -- 172.21.15.57:0/318191396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc0a64b0 con 0x7f1dcc05c450 2021-06-25T04:57:01.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dc97fa700 1 -- 172.21.15.57:0/318191396 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dbc007430 con 0x7f1dcc05c450 2021-06-25T04:57:01.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dd2495700 1 -- 172.21.15.57:0/318191396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc0a8b70 con 0x7f1dcc05c450 2021-06-25T04:57:01.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dd2495700 1 -- 172.21.15.57:0/318191396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc0a6ef0 con 0x7f1dcc05c450 2021-06-25T04:57:01.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dc97fa700 1 -- 172.21.15.57:0/318191396 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1dbc010070 con 0x7f1dcc05c450 2021-06-25T04:57:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dc97fa700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dac055340 0x7f1dac057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dc97fa700 1 -- 172.21.15.57:0/318191396 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1dbc06d4c0 con 0x7f1dcc05c450 2021-06-25T04:57:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dcb7fe700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dac055340 0x7f1dac057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.155+0000 7f1dcb7fe700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dac055340 0x7f1dac057800 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f1dc0019000 tx=0x7f1dc0014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.163+0000 7f1dc97fa700 1 -- 172.21.15.57:0/318191396 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1dbc043670 con 0x7f1dcc05c450 2021-06-25T04:57:01.296 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.291+0000 7f1dd2495700 1 -- 172.21.15.57:0/318191396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dcc057310 con 0x7f1dcc05c450 2021-06-25T04:57:01.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.291+0000 7f1dc97fa700 1 -- 172.21.15.57:0/318191396 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f1dbc046c90 con 0x7f1dcc05c450 2021-06-25T04:57:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:01.299 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":149,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:56:55.387316+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:56:52.813405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-06-25T04:56:53.777715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:57:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 -- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dac055340 msgr2=0x7f1dac057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dac055340 0x7f1dac057800 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f1dc0019000 tx=0x7f1dc0014000).stop 2021-06-25T04:57:01.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 -- 172.21.15.57:0/318191396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc05c450 msgr2=0x7f1dcc14efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc05c450 0x7f1dcc14efa0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f1dcc0a9410 tx=0x7f1dbc007b50).stop 2021-06-25T04:57:01.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 -- 172.21.15.57:0/318191396 shutdown_connections 2021-06-25T04:57:01.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1dac055340 0x7f1dac057800 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dcc0b2610 0x7f1dcc0a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dcc0b1da0 0x7f1dcc0a70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 --2- 172.21.15.57:0/318191396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc05c450 0x7f1dcc14efa0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 -- 172.21.15.57:0/318191396 >> 172.21.15.57:0/318191396 conn(0x7f1dcc05cce0 msgr2=0x7f1dcc0b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:01.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 -- 172.21.15.57:0/318191396 shutdown_connections 2021-06-25T04:57:01.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.295+0000 7f1dd2495700 1 -- 172.21.15.57:0/318191396 wait complete. 2021-06-25T04:57:01.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:56:52.813405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:56:53.777715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:57:01.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:57:01.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46b1e5700 1 Processor -- start 2021-06-25T04:57:01.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46b1e5700 1 -- start start 2021-06-25T04:57:01.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46b1e5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff4640b6340 0x7ff464140330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46b1e5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff4640612b0 0x7ff4640b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46b1e5700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff464146620 con 0x7ff4640b28d0 2021-06-25T04:57:01.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46b1e5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff464061f70 con 0x7ff4640b6340 2021-06-25T04:57:01.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46b1e5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4640654e0 con 0x7ff4640612b0 2021-06-25T04:57:01.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46a1e3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff4640b6340 0x7ff464140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46a1e3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff4640b6340 0x7ff464140330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44148/0 (socket says 172.21.15.57:44148) 2021-06-25T04:57:01.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46a1e3700 1 -- 172.21.15.57:0/794327256 learned_addr learned my addr 172.21.15.57:0/794327256 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:01.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46a9e4700 1 --2- 172.21.15.57:0/794327256 >> v2:172.21.15.87:3300/0 conn(0x7ff4640612b0 0x7ff4640b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46a1e3700 1 -- 172.21.15.57:0/794327256 >> v2:172.21.15.87:3300/0 conn(0x7ff4640612b0 msgr2=0x7ff4640b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:01.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46a1e3700 1 --2- 172.21.15.57:0/794327256 >> v2:172.21.15.87:3300/0 conn(0x7ff4640612b0 0x7ff4640b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46a1e3700 1 -- 172.21.15.57:0/794327256 >> v1:172.21.15.87:6789/0 conn(0x7ff4640b28d0 legacy=0x7ff4640b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46a1e3700 1 -- 172.21.15.57:0/794327256 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4641474d0 con 0x7ff4640b6340 2021-06-25T04:57:01.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.423+0000 7ff46a1e3700 1 --2- 172.21.15.57:0/794327256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4640b6340 0x7ff464140330 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7ff454002f70 tx=0x7ff454006eb0).ready entity=mon.0 client_cookie=1ff71f0e3253c822 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff4691e1700 1 -- 172.21.15.57:0/794327256 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45400d5c0 con 0x7ff4640b6340 2021-06-25T04:57:01.435 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff4691e1700 1 -- 172.21.15.57:0/794327256 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff454000e90 con 0x7ff4640b6340 2021-06-25T04:57:01.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff4691e1700 1 -- 172.21.15.57:0/794327256 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45400d950 con 0x7ff4640b6340 2021-06-25T04:57:01.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff46b1e5700 1 -- 172.21.15.57:0/794327256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4640b6340 msgr2=0x7ff464140330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.436 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff46b1e5700 1 --2- 172.21.15.57:0/794327256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4640b6340 0x7ff464140330 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7ff454002f70 tx=0x7ff454006eb0).stop 2021-06-25T04:57:01.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff46b1e5700 1 -- 172.21.15.57:0/794327256 shutdown_connections 2021-06-25T04:57:01.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff46b1e5700 1 --2- 172.21.15.57:0/794327256 >> v2:172.21.15.87:3300/0 conn(0x7ff4640612b0 0x7ff4640b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff46b1e5700 1 --2- 172.21.15.57:0/794327256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4640b6340 0x7ff464140330 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff46b1e5700 1 -- 172.21.15.57:0/794327256 >> 172.21.15.57:0/794327256 conn(0x7ff464063630 msgr2=0x7ff464063a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:01.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff46b1e5700 1 -- 172.21.15.57:0/794327256 shutdown_connections 2021-06-25T04:57:01.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff46b1e5700 1 -- 172.21.15.57:0/794327256 wait complete. 2021-06-25T04:57:01.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff46b1e5700 1 Processor -- start 2021-06-25T04:57:01.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.427+0000 7ff46b1e5700 1 -- start start 2021-06-25T04:57:01.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46b1e5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4640612b0 0x7ff4641410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46b1e5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4640b28d0 0x7ff464144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46b1e5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4640b6340 0x7ff4641520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46b1e5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464145ae0 con 0x7ff4640b6340 2021-06-25T04:57:01.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46b1e5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4641444a0 con 0x7ff4640612b0 2021-06-25T04:57:01.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46b1e5700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46413bd20 con 0x7ff4640b28d0 2021-06-25T04:57:01.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46a9e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4640b6340 0x7ff4641520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46a9e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4640b6340 0x7ff4641520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44156/0 (socket says 172.21.15.57:44156) 2021-06-25T04:57:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46a9e4700 1 -- 172.21.15.57:0/3049748978 learned_addr learned my addr 172.21.15.57:0/3049748978 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff4699e2700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4640b28d0 0x7ff464144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46a1e3700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4640612b0 0x7ff4641410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46a9e4700 1 -- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4640b28d0 msgr2=0x7ff464144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46a9e4700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4640b28d0 0x7ff464144900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46a9e4700 1 -- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4640612b0 msgr2=0x7ff4641410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46a9e4700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4640612b0 0x7ff4641410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.446 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46a9e4700 1 -- 172.21.15.57:0/3049748978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45400b1e0 con 0x7ff4640b6340 2021-06-25T04:57:01.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46a1e3700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4640612b0 0x7ff4641410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:01.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46a9e4700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4640b6340 0x7ff4641520e0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7ff46413beb0 tx=0x7ff45c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff4537fe700 1 -- 172.21.15.57:0/3049748978 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45c00eee0 con 0x7ff4640b6340 2021-06-25T04:57:01.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff4537fe700 1 -- 172.21.15.57:0/3049748978 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c00c850 con 0x7ff4640b6340 2021-06-25T04:57:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46b1e5700 1 -- 172.21.15.57:0/3049748978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46413c270 con 0x7ff4640b6340 2021-06-25T04:57:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff4537fe700 1 -- 172.21.15.57:0/3049748978 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45c00cbb0 con 0x7ff4640b6340 2021-06-25T04:57:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46b1e5700 1 -- 172.21.15.57:0/3049748978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff464144df0 con 0x7ff4640b6340 2021-06-25T04:57:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff4537fe700 1 -- 172.21.15.57:0/3049748978 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff45c022070 con 0x7ff4640b6340 2021-06-25T04:57:01.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff46b1e5700 1 -- 172.21.15.57:0/3049748978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff464057310 con 0x7ff4640b6340 2021-06-25T04:57:01.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff4537fe700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4440554e0 0x7ff4440579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.431+0000 7ff4537fe700 1 -- 172.21.15.57:0/3049748978 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff45c06e5a0 con 0x7ff4640b6340 2021-06-25T04:57:01.449 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.435+0000 7ff46a1e3700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4440554e0 0x7ff4440579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.435+0000 7ff46a1e3700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4440554e0 0x7ff4440579a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7ff454019000 tx=0x7ff454015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.450 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.439+0000 7ff4537fe700 1 -- 172.21.15.57:0/3049748978 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff45c044750 con 0x7ff4640b6340 2021-06-25T04:57:01.569 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.563+0000 7ff46b1e5700 1 -- 172.21.15.57:0/3049748978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff46406aab0 con 0x7ff4640b6340 2021-06-25T04:57:01.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.563+0000 7ff4537fe700 1 -- 172.21.15.57:0/3049748978 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v149) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff45c047d70 con 0x7ff4640b6340 2021-06-25T04:57:01.570 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:57:01.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 -- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4440554e0 msgr2=0x7ff4440579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.572 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4440554e0 0x7ff4440579a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7ff454019000 tx=0x7ff454015000).stop 2021-06-25T04:57:01.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 -- 172.21.15.57:0/3049748978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4640b6340 msgr2=0x7ff4641520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4640b6340 0x7ff4641520e0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7ff46413beb0 tx=0x7ff45c0091d0).stop 2021-06-25T04:57:01.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 -- 172.21.15.57:0/3049748978 shutdown_connections 2021-06-25T04:57:01.573 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4440554e0 0x7ff4440579a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4640b6340 0x7ff4641520e0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4640b28d0 0x7ff464144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 --2- 172.21.15.57:0/3049748978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4640612b0 0x7ff4641410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.574 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 -- 172.21.15.57:0/3049748978 >> 172.21.15.57:0/3049748978 conn(0x7ff464063630 msgr2=0x7ff4640b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:01.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 -- 172.21.15.57:0/3049748978 shutdown_connections 2021-06-25T04:57:01.575 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.567+0000 7ff46b1e5700 1 -- 172.21.15.57:0/3049748978 wait complete. 2021-06-25T04:57:01.584 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:57:01.692 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59cf088700 1 Processor -- start 2021-06-25T04:57:01.693 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59cf088700 1 -- start start 2021-06-25T04:57:01.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59cf088700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59c8146910 0x7f59c81401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.698 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59cf088700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f59c80b4140 0x7f59c81406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59cf088700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c8143b20 con 0x7f59c80b4650 2021-06-25T04:57:01.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59cf088700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c81474d0 con 0x7f59c80b4140 2021-06-25T04:57:01.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59cf088700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8143dc0 con 0x7f59c8146910 2021-06-25T04:57:01.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59cd625700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f59c80b4650 0x7f59c80b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33150/0 (socket says 172.21.15.57:33150) 2021-06-25T04:57:01.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59cd625700 1 -- 172.21.15.57:0/2027157682 learned_addr learned my addr 172.21.15.57:0/2027157682 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:01.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59c7fff700 1 --2- 172.21.15.57:0/2027157682 >> v2:172.21.15.87:3300/0 conn(0x7f59c80b4140 0x7f59c81406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59cce24700 1 --2- 172.21.15.57:0/2027157682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59c8146910 0x7f59c81401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59c77fe700 1 -- 172.21.15.57:0/2027157682 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321884914 0 0) 0x7f59c8143b20 con 0x7f59c80b4650 2021-06-25T04:57:01.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.687+0000 7f59c77fe700 1 -- 172.21.15.57:0/2027157682 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b4003260 con 0x7f59c80b4650 2021-06-25T04:57:01.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59c7fff700 1 -- 172.21.15.57:0/2027157682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59c8146910 msgr2=0x7f59c81401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:01.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59c7fff700 1 --2- 172.21.15.57:0/2027157682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59c8146910 0x7f59c81401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59c7fff700 1 -- 172.21.15.57:0/2027157682 >> v1:172.21.15.57:6789/0 conn(0x7f59c80b4650 legacy=0x7f59c80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59c7fff700 1 -- 172.21.15.57:0/2027157682 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80b0c50 con 0x7f59c80b4140 2021-06-25T04:57:01.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59c7fff700 1 --2- 172.21.15.57:0/2027157682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59c80b4140 0x7f59c81406e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f59b8002f70 tx=0x7f59b8006df0).ready entity=mon.1 client_cookie=fc54edd36643ce9a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59c77fe700 1 -- 172.21.15.57:0/2027157682 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59b800d4a0 con 0x7f59c80b4140 2021-06-25T04:57:01.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59c77fe700 1 -- 172.21.15.57:0/2027157682 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8000e90 con 0x7f59c80b4140 2021-06-25T04:57:01.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59c77fe700 1 -- 172.21.15.57:0/2027157682 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59b800d7f0 con 0x7f59c80b4140 2021-06-25T04:57:01.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59cf088700 1 -- 172.21.15.57:0/2027157682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59c80b4140 msgr2=0x7f59c81406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59cf088700 1 --2- 172.21.15.57:0/2027157682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59c80b4140 0x7f59c81406e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f59b8002f70 tx=0x7f59b8006df0).stop 2021-06-25T04:57:01.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59cf088700 1 -- 172.21.15.57:0/2027157682 shutdown_connections 2021-06-25T04:57:01.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59cf088700 1 --2- 172.21.15.57:0/2027157682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59c80b4140 0x7f59c81406e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59cf088700 1 --2- 172.21.15.57:0/2027157682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59c8146910 0x7f59c81401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59cf088700 1 -- 172.21.15.57:0/2027157682 >> 172.21.15.57:0/2027157682 conn(0x7f59c805c450 msgr2=0x7f59c805c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:01.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59cf088700 1 -- 172.21.15.57:0/2027157682 shutdown_connections 2021-06-25T04:57:01.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59cf088700 1 -- 172.21.15.57:0/2027157682 wait complete. 2021-06-25T04:57:01.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59cf088700 1 Processor -- start 2021-06-25T04:57:01.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.691+0000 7f59cf088700 1 -- start start 2021-06-25T04:57:01.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cf088700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59c80b4140 0x7f59c80ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cf088700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59c80b4650 0x7f59c80b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cf088700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59c8146910 0x7f59c8112ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cf088700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80ad730 con 0x7f59c80b4140 2021-06-25T04:57:01.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cf088700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80ad9d0 con 0x7f59c8146910 2021-06-25T04:57:01.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cf088700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80adc70 con 0x7f59c80b4650 2021-06-25T04:57:01.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cce24700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59c80b4140 0x7f59c80ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cce24700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59c80b4140 0x7f59c80ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44166/0 (socket says 172.21.15.57:44166) 2021-06-25T04:57:01.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cce24700 1 -- 172.21.15.57:0/4158679546 learned_addr learned my addr 172.21.15.57:0/4158679546 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:01.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cd625700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59c8146910 0x7f59c8112ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59c7fff700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59c80b4650 0x7f59c80b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cce24700 1 -- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59c80b4650 msgr2=0x7f59c80b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cce24700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59c80b4650 0x7f59c80b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cce24700 1 -- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59c8146910 msgr2=0x7f59c8112ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cce24700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59c8146910 0x7f59c8112ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cce24700 1 -- 172.21.15.57:0/4158679546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b800b180 con 0x7f59c80b4140 2021-06-25T04:57:01.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cce24700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59c80b4140 0x7f59c80ae290 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f59bc00c000 tx=0x7f59bc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59c5ffb700 1 -- 172.21.15.57:0/4158679546 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59bc011750 con 0x7f59c80b4140 2021-06-25T04:57:01.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59c5ffb700 1 -- 172.21.15.57:0/4158679546 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc0118b0 con 0x7f59c80b4140 2021-06-25T04:57:01.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cf088700 1 -- 172.21.15.57:0/4158679546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c80b6ae0 con 0x7f59c80b4140 2021-06-25T04:57:01.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59c5ffb700 1 -- 172.21.15.57:0/4158679546 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59bc011c10 con 0x7f59c80b4140 2021-06-25T04:57:01.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.695+0000 7f59cf088700 1 -- 172.21.15.57:0/4158679546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c80af530 con 0x7f59c80b4140 2021-06-25T04:57:01.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.699+0000 7f59cf088700 1 -- 172.21.15.57:0/4158679546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c80ade30 con 0x7f59c80b4140 2021-06-25T04:57:01.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.699+0000 7f59c5ffb700 1 -- 172.21.15.57:0/4158679546 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f59bc011d70 con 0x7f59c80b4140 2021-06-25T04:57:01.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.699+0000 7f59c5ffb700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59a8055450 0x7f59a8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.699+0000 7f59c5ffb700 1 -- 172.21.15.57:0/4158679546 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f59bc06e300 con 0x7f59c80b4140 2021-06-25T04:57:01.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.699+0000 7f59c7fff700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59a8055450 0x7f59a8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.699+0000 7f59c7fff700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59a8055450 0x7f59a8057910 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f59b8019000 tx=0x7f59b8014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.707+0000 7f59c5ffb700 1 -- 172.21.15.57:0/4158679546 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f59bc0444b0 con 0x7f59c80b4140 2021-06-25T04:57:01.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.831+0000 7f59cf088700 1 -- 172.21.15.57:0/4158679546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59c8057310 con 0x7f59c80b4140 2021-06-25T04:57:01.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.831+0000 7f59c5ffb700 1 -- 172.21.15.57:0/4158679546 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v149) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59bc047ad0 con 0x7f59c80b4140 2021-06-25T04:57:01.842 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:57:01.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 -- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59a8055450 msgr2=0x7f59a8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59a8055450 0x7f59a8057910 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f59b8019000 tx=0x7f59b8014000).stop 2021-06-25T04:57:01.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 -- 172.21.15.57:0/4158679546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59c80b4140 msgr2=0x7f59c80ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59c80b4140 0x7f59c80ae290 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f59bc00c000 tx=0x7f59bc006df0).stop 2021-06-25T04:57:01.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 -- 172.21.15.57:0/4158679546 shutdown_connections 2021-06-25T04:57:01.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f59a8055450 0x7f59a8057910 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59c8146910 0x7f59c8112ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59c80b4650 0x7f59c80b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 --2- 172.21.15.57:0/4158679546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59c80b4140 0x7f59c80ae290 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 -- 172.21.15.57:0/4158679546 >> 172.21.15.57:0/4158679546 conn(0x7f59c805c450 msgr2=0x7f59c80b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:01.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 -- 172.21.15.57:0/4158679546 shutdown_connections 2021-06-25T04:57:01.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.835+0000 7f59cf088700 1 -- 172.21.15.57:0/4158679546 wait complete. 2021-06-25T04:57:01.855 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:57:01.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.955+0000 7f423752e700 1 Processor -- start 2021-06-25T04:57:01.961 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.955+0000 7f423752e700 1 -- start start 2021-06-25T04:57:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.955+0000 7f423752e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42300b6250 0x7f4230061430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.955+0000 7f423752e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f42300b4020 0x7f4230061920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.955+0000 7f423752e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42300b5f10 con 0x7f4230061e10 2021-06-25T04:57:01.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.955+0000 7f423752e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42300b1f30 con 0x7f42300b4020 2021-06-25T04:57:01.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.955+0000 7f423752e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300b21d0 con 0x7f42300b6250 2021-06-25T04:57:01.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f4236d2d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4230061e10 0x7f42301463f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33162/0 (socket says 172.21.15.57:33162) 2021-06-25T04:57:01.965 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f4236d2d700 1 -- 172.21.15.57:0/1536162976 learned_addr learned my addr 172.21.15.57:0/1536162976 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:01.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f4235d2b700 1 --2- 172.21.15.57:0/1536162976 >> v2:172.21.15.87:3300/0 conn(0x7f42300b4020 0x7f4230061920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423652c700 1 --2- 172.21.15.57:0/1536162976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42300b6250 0x7f4230061430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423552a700 1 -- 172.21.15.57:0/1536162976 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509115227 0 0) 0x7f4228001490 con 0x7f4230061e10 2021-06-25T04:57:01.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423552a700 1 -- 172.21.15.57:0/1536162976 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4218003260 con 0x7f4230061e10 2021-06-25T04:57:01.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f4235d2b700 1 -- 172.21.15.57:0/1536162976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42300b6250 msgr2=0x7f4230061430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:01.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f4235d2b700 1 --2- 172.21.15.57:0/1536162976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42300b6250 0x7f4230061430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f4235d2b700 1 -- 172.21.15.57:0/1536162976 >> v1:172.21.15.57:6789/0 conn(0x7f4230061e10 legacy=0x7f42301463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423552a700 1 -- 172.21.15.57:0/1536162976 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3028389979 0 0) 0x7f4218003260 con 0x7f4230061e10 2021-06-25T04:57:01.967 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f4235d2b700 1 -- 172.21.15.57:0/1536162976 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300b2470 con 0x7f42300b4020 2021-06-25T04:57:01.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f4235d2b700 1 --2- 172.21.15.57:0/1536162976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42300b4020 0x7f4230061920 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f4228001d10 tx=0x7f4224006df0).ready entity=mon.1 client_cookie=e2216905f669e62d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423552a700 1 -- 172.21.15.57:0/1536162976 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4228001b70 con 0x7f42300b4020 2021-06-25T04:57:01.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423552a700 1 -- 172.21.15.57:0/1536162976 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4224000e90 con 0x7f42300b4020 2021-06-25T04:57:01.968 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423552a700 1 -- 172.21.15.57:0/1536162976 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4224012460 con 0x7f42300b4020 2021-06-25T04:57:01.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423752e700 1 -- 172.21.15.57:0/1536162976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42300b4020 msgr2=0x7f4230061920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423752e700 1 --2- 172.21.15.57:0/1536162976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42300b4020 0x7f4230061920 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f4228001d10 tx=0x7f4224006df0).stop 2021-06-25T04:57:01.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423752e700 1 -- 172.21.15.57:0/1536162976 shutdown_connections 2021-06-25T04:57:01.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423752e700 1 --2- 172.21.15.57:0/1536162976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42300b4020 0x7f4230061920 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423752e700 1 --2- 172.21.15.57:0/1536162976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42300b6250 0x7f4230061430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423752e700 1 -- 172.21.15.57:0/1536162976 >> 172.21.15.57:0/1536162976 conn(0x7f423005c450 msgr2=0x7f423005c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:01.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423752e700 1 -- 172.21.15.57:0/1536162976 shutdown_connections 2021-06-25T04:57:01.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.959+0000 7f423752e700 1 -- 172.21.15.57:0/1536162976 wait complete. 2021-06-25T04:57:01.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f423752e700 1 Processor -- start 2021-06-25T04:57:01.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f423752e700 1 -- start start 2021-06-25T04:57:01.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f423752e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4230061e10 0x7f42300add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f423752e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42300b4020 0x7f4230155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f423752e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42300b6250 0x7f4230155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f423752e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423013d530 con 0x7f42300b4020 2021-06-25T04:57:01.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f423752e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4230153330 con 0x7f4230061e10 2021-06-25T04:57:01.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f423752e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423013d760 con 0x7f42300b6250 2021-06-25T04:57:01.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f4235d2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42300b4020 0x7f4230155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f4235d2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42300b4020 0x7f4230155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44180/0 (socket says 172.21.15.57:44180) 2021-06-25T04:57:01.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f4235d2b700 1 -- 172.21.15.57:0/3458960577 learned_addr learned my addr 172.21.15.57:0/3458960577 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:01.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f4236d2d700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42300b6250 0x7f4230155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.963+0000 7f423652c700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4230061e10 0x7f42300add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f4235d2b700 1 -- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42300b6250 msgr2=0x7f4230155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f4235d2b700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42300b6250 0x7f4230155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f4235d2b700 1 -- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4230061e10 msgr2=0x7f42300add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:01.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f4235d2b700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4230061e10 0x7f42300add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:01.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f4235d2b700 1 -- 172.21.15.57:0/3458960577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422400b180 con 0x7f42300b4020 2021-06-25T04:57:01.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f423652c700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4230061e10 0x7f42300add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:01.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f4235d2b700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42300b4020 0x7f4230155b00 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f4228001d10 tx=0x7f4224014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f42237fe700 1 -- 172.21.15.57:0/3458960577 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f422400de60 con 0x7f42300b4020 2021-06-25T04:57:01.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f42237fe700 1 -- 172.21.15.57:0/3458960577 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422401e430 con 0x7f42300b4020 2021-06-25T04:57:01.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f423752e700 1 -- 172.21.15.57:0/3458960577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423013da00 con 0x7f42300b4020 2021-06-25T04:57:01.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f42237fe700 1 -- 172.21.15.57:0/3458960577 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f422401e790 con 0x7f42300b4020 2021-06-25T04:57:01.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f423752e700 1 -- 172.21.15.57:0/3458960577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4230143a70 con 0x7f42300b4020 2021-06-25T04:57:01.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f423752e700 1 -- 172.21.15.57:0/3458960577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423013dbc0 con 0x7f42300b4020 2021-06-25T04:57:01.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f42237fe700 1 -- 172.21.15.57:0/3458960577 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f422400f030 con 0x7f42300b4020 2021-06-25T04:57:01.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f42237fe700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4210055510 0x7f42100579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:01.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f42237fe700 1 -- 172.21.15.57:0/3458960577 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f422406ef20 con 0x7f42300b4020 2021-06-25T04:57:01.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.967+0000 7f423652c700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4210055510 0x7f42100579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:01.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.971+0000 7f423652c700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4210055510 0x7f42100579d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f422c00b000 tx=0x7f422c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:01.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:01.975+0000 7f42237fe700 1 -- 172.21.15.57:0/3458960577 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f42240450d0 con 0x7f42300b4020 2021-06-25T04:57:02.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.103+0000 7f423752e700 1 -- 172.21.15.57:0/3458960577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4230057310 con 0x7f42300b4020 2021-06-25T04:57:02.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.103+0000 7f42237fe700 1 -- 172.21.15.57:0/3458960577 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v149) v1 ==== 104+0+10 (secure 0 0 0) 0x7f42240486f0 con 0x7f42300b4020 2021-06-25T04:57:02.110 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:57:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 -- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4210055510 msgr2=0x7f42100579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4210055510 0x7f42100579d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f422c00b000 tx=0x7f422c008040).stop 2021-06-25T04:57:02.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 -- 172.21.15.57:0/3458960577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42300b4020 msgr2=0x7f4230155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42300b4020 0x7f4230155b00 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f4228001d10 tx=0x7f4224014000).stop 2021-06-25T04:57:02.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 -- 172.21.15.57:0/3458960577 shutdown_connections 2021-06-25T04:57:02.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4210055510 0x7f42100579d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42300b6250 0x7f4230155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42300b4020 0x7f4230155b00 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 --2- 172.21.15.57:0/3458960577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4230061e10 0x7f42300add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 -- 172.21.15.57:0/3458960577 >> 172.21.15.57:0/3458960577 conn(0x7f423005c450 msgr2=0x7f4230061430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:02.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 -- 172.21.15.57:0/3458960577 shutdown_connections 2021-06-25T04:57:02.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.107+0000 7f423752e700 1 -- 172.21.15.57:0/3458960577 wait complete. 2021-06-25T04:57:02.123 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:57:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.227+0000 7fac39df4700 1 Processor -- start 2021-06-25T04:57:02.233 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.227+0000 7fac39df4700 1 -- start start 2021-06-25T04:57:02.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac39df4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340b3090 0x7fac341433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac39df4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac341438e0 con 0x7fac340b06d0 2021-06-25T04:57:02.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac38df2700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fac340b06d0 0x7fac34142ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33172/0 (socket says 172.21.15.57:33172) 2021-06-25T04:57:02.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac38df2700 1 -- 172.21.15.57:0/1692350154 learned_addr learned my addr 172.21.15.57:0/1692350154 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:02.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac39df4700 1 -- 172.21.15.57:0/1692350154 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac340b0ab0 con 0x7fac340ace30 2021-06-25T04:57:02.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac39df4700 1 -- 172.21.15.57:0/1692350154 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac340ae640 con 0x7fac340b3090 2021-06-25T04:57:02.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac33fff700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340b3090 0x7fac341433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230000546 0 0) 0x7fac341438e0 con 0x7fac340b06d0 2021-06-25T04:57:02.237 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac18003260 con 0x7fac340b06d0 2021-06-25T04:57:02.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710685229 0 0) 0x7fac340b0ab0 con 0x7fac340ace30 2021-06-25T04:57:02.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac341438e0 con 0x7fac340ace30 2021-06-25T04:57:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3849455274 0 0) 0x7fac18003260 con 0x7fac340b06d0 2021-06-25T04:57:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340b3090 msgr2=0x7fac341433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340b3090 0x7fac341433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 >> v1:172.21.15.87:6789/0 conn(0x7fac340ace30 legacy=0x7fac3413f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340ae8e0 con 0x7fac340b06d0 2021-06-25T04:57:02.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7fac28001660 con 0x7fac340b06d0 2021-06-25T04:57:02.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 >> v1:172.21.15.57:6789/0 conn(0x7fac340b06d0 legacy=0x7fac34142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac18003910 0x7fac18003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac18004500 0x7fac18004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340b3090 0x7fac18004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340ae640 con 0x7fac18004500 2021-06-25T04:57:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1800b7b0 con 0x7fac18003910 2021-06-25T04:57:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1800b970 con 0x7fac340b3090 2021-06-25T04:57:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac33fff700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac18004500 0x7fac18004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac38df2700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac18003910 0x7fac18003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac395f3700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340b3090 0x7fac18004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac33fff700 1 -- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340b3090 msgr2=0x7fac18004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:02.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac33fff700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340b3090 0x7fac18004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac33fff700 1 -- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac18003910 msgr2=0x7fac18003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:02.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac33fff700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac18003910 0x7fac18003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac33fff700 1 -- 172.21.15.57:0/1692350154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18003260 con 0x7fac18004500 2021-06-25T04:57:02.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac395f3700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340b3090 0x7fac18004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:02.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac33fff700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac18004500 0x7fac18004980 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fac2000d000 tx=0x7fac20006e80).ready entity=mon.0 client_cookie=b31d1c21abd20b19 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:02.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac2000f720 con 0x7fac18004500 2021-06-25T04:57:02.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2000f880 con 0x7fac18004500 2021-06-25T04:57:02.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac337fe700 1 -- 172.21.15.57:0/1692350154 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac2000fbe0 con 0x7fac18004500 2021-06-25T04:57:02.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac39df4700 1 -- 172.21.15.57:0/1692350154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac18004500 msgr2=0x7fac18004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac39df4700 1 --2- 172.21.15.57:0/1692350154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac18004500 0x7fac18004980 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fac2000d000 tx=0x7fac20006e80).stop 2021-06-25T04:57:02.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.231+0000 7fac395f3700 1 -- 172.21.15.57:0/1692350154 reap_dead start 2021-06-25T04:57:02.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 -- 172.21.15.57:0/1692350154 shutdown_connections 2021-06-25T04:57:02.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 -- 172.21.15.57:0/1692350154 >> 172.21.15.57:0/1692350154 conn(0x7fac34061100 msgr2=0x7fac34062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:02.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 -- 172.21.15.57:0/1692350154 shutdown_connections 2021-06-25T04:57:02.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 -- 172.21.15.57:0/1692350154 wait complete. 2021-06-25T04:57:02.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 Processor -- start 2021-06-25T04:57:02.249 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 -- start start 2021-06-25T04:57:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac340b6070 0x7fac340676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac340ac4f0 0x7fac341502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340a7f30 0x7fac340a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac34064220 con 0x7fac340ac4f0 2021-06-25T04:57:02.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac34063a30 con 0x7fac340b6070 2021-06-25T04:57:02.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac39df4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac340b6450 con 0x7fac340a7f30 2021-06-25T04:57:02.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac33fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac340ac4f0 0x7fac341502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac33fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac340ac4f0 0x7fac341502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44200/0 (socket says 172.21.15.57:44200) 2021-06-25T04:57:02.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac33fff700 1 -- 172.21.15.57:0/3916861737 learned_addr learned my addr 172.21.15.57:0/3916861737 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:02.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac38df2700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac340b6070 0x7fac340676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.235+0000 7fac395f3700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340a7f30 0x7fac340a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac33fff700 1 -- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340a7f30 msgr2=0x7fac340a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac33fff700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340a7f30 0x7fac340a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac33fff700 1 -- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac340b6070 msgr2=0x7fac340676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac33fff700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac340b6070 0x7fac340676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac33fff700 1 -- 172.21.15.57:0/3916861737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34063c60 con 0x7fac340ac4f0 2021-06-25T04:57:02.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac33fff700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac340ac4f0 0x7fac341502f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fac2000d000 tx=0x7fac20006e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:02.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac31ffb700 1 -- 172.21.15.57:0/3916861737 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac20012bd0 con 0x7fac340ac4f0 2021-06-25T04:57:02.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac31ffb700 1 -- 172.21.15.57:0/3916861737 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20000e90 con 0x7fac340ac4f0 2021-06-25T04:57:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac39df4700 1 -- 172.21.15.57:0/3916861737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac34154450 con 0x7fac340ac4f0 2021-06-25T04:57:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac31ffb700 1 -- 172.21.15.57:0/3916861737 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac2001a3f0 con 0x7fac340ac4f0 2021-06-25T04:57:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac39df4700 1 -- 172.21.15.57:0/3916861737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac34154170 con 0x7fac340ac4f0 2021-06-25T04:57:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac31ffb700 1 -- 172.21.15.57:0/3916861737 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fac2002b070 con 0x7fac340ac4f0 2021-06-25T04:57:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac39df4700 1 -- 172.21.15.57:0/3916861737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac34150980 con 0x7fac340ac4f0 2021-06-25T04:57:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac31ffb700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac1c055340 0x7fac1c057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac31ffb700 1 -- 172.21.15.57:0/3916861737 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fac2006f380 con 0x7fac340ac4f0 2021-06-25T04:57:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.239+0000 7fac38df2700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac1c055340 0x7fac1c057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.243+0000 7fac38df2700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac1c055340 0x7fac1c057800 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fac28005000 tx=0x7fac340a93e0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:02.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.247+0000 7fac31ffb700 1 -- 172.21.15.57:0/3916861737 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fac200454b0 con 0x7fac340ac4f0 2021-06-25T04:57:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.375+0000 7fac39df4700 1 -- 172.21.15.57:0/3916861737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac340a8a40 con 0x7fac340ac4f0 2021-06-25T04:57:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.375+0000 7fac31ffb700 1 -- 172.21.15.57:0/3916861737 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v149) v1 ==== 100+0+10 (secure 0 0 0) 0x7fac20048ad0 con 0x7fac340ac4f0 2021-06-25T04:57:02.381 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:57:02.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 -- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac1c055340 msgr2=0x7fac1c057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac1c055340 0x7fac1c057800 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fac28005000 tx=0x7fac340a93e0).stop 2021-06-25T04:57:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 -- 172.21.15.57:0/3916861737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac340ac4f0 msgr2=0x7fac341502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac340ac4f0 0x7fac341502f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fac2000d000 tx=0x7fac20006e80).stop 2021-06-25T04:57:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 -- 172.21.15.57:0/3916861737 shutdown_connections 2021-06-25T04:57:02.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fac1c055340 0x7fac1c057800 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac340a7f30 0x7fac340a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac340ac4f0 0x7fac341502f0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 --2- 172.21.15.57:0/3916861737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac340b6070 0x7fac340676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 -- 172.21.15.57:0/3916861737 >> 172.21.15.57:0/3916861737 conn(0x7fac34061100 msgr2=0x7fac34142c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 -- 172.21.15.57:0/3916861737 shutdown_connections 2021-06-25T04:57:02.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.379+0000 7fac39df4700 1 -- 172.21.15.57:0/3916861737 wait complete. 2021-06-25T04:57:02.395 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:57:02.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:57:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 Processor -- start 2021-06-25T04:57:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 -- start start 2021-06-25T04:57:02.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f944c0b5460 0x7f944c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f944c0b05d0 0x7f944c147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f944c067560 0x7f944c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c1452a0 con 0x7f944c0b5460 2021-06-25T04:57:02.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c0adfb0 con 0x7f944c067560 2021-06-25T04:57:02.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c0b5840 con 0x7f944c0b05d0 2021-06-25T04:57:02.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9450cc8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f944c0b5460 0x7f944c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f944bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f944c0b05d0 0x7f944c147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9450cc8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f944c0b5460 0x7f944c0af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44206/0 (socket says 172.21.15.57:44206) 2021-06-25T04:57:02.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f94514c9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f944c067560 0x7f944c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9450cc8700 1 -- 172.21.15.57:0/316592630 learned_addr learned my addr 172.21.15.57:0/316592630 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:02.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f94514c9700 1 -- 172.21.15.57:0/316592630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f944c0b05d0 msgr2=0x7f944c147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:02.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f94514c9700 1 --2- 172.21.15.57:0/316592630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f944c0b05d0 0x7f944c147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f94514c9700 1 -- 172.21.15.57:0/316592630 >> v2:172.21.15.57:3300/0 conn(0x7f944c0b5460 msgr2=0x7f944c0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:02.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f94514c9700 1 --2- 172.21.15.57:0/316592630 >> v2:172.21.15.57:3300/0 conn(0x7f944c0b5460 0x7f944c0af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f94514c9700 1 -- 172.21.15.57:0/316592630 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c0ac7c0 con 0x7f944c067560 2021-06-25T04:57:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f94514c9700 1 --2- 172.21.15.57:0/316592630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944c067560 0x7f944c0acc20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f943c002f70 tx=0x7f943c006df0).ready entity=mon.1 client_cookie=e426fec567a8301b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f944b7fe700 1 -- 172.21.15.57:0/316592630 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943c00d4a0 con 0x7f944c067560 2021-06-25T04:57:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f944b7fe700 1 -- 172.21.15.57:0/316592630 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c000e90 con 0x7f944c067560 2021-06-25T04:57:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f944b7fe700 1 -- 172.21.15.57:0/316592630 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943c00d7f0 con 0x7f944c067560 2021-06-25T04:57:02.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 -- 172.21.15.57:0/316592630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944c067560 msgr2=0x7f944c0acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 --2- 172.21.15.57:0/316592630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944c067560 0x7f944c0acc20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f943c002f70 tx=0x7f943c006df0).stop 2021-06-25T04:57:02.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 -- 172.21.15.57:0/316592630 shutdown_connections 2021-06-25T04:57:02.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 --2- 172.21.15.57:0/316592630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944c067560 0x7f944c0acc20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 --2- 172.21.15.57:0/316592630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f944c0b05d0 0x7f944c147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 --2- 172.21.15.57:0/316592630 >> v2:172.21.15.57:3300/0 conn(0x7f944c0b5460 0x7f944c0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.491+0000 7f9451cca700 1 -- 172.21.15.57:0/316592630 >> 172.21.15.57:0/316592630 conn(0x7f944c062520 msgr2=0x7f944c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:02.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9451cca700 1 -- 172.21.15.57:0/316592630 shutdown_connections 2021-06-25T04:57:02.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9451cca700 1 -- 172.21.15.57:0/316592630 wait complete. 2021-06-25T04:57:02.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9451cca700 1 Processor -- start 2021-06-25T04:57:02.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9451cca700 1 -- start start 2021-06-25T04:57:02.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9451cca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f944c067560 0x7f944c14b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9451cca700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944c0b05d0 0x7f944c066b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9451cca700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f944c0b5460 0x7f944c15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9451cca700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c0640b0 con 0x7f944c067560 2021-06-25T04:57:02.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9451cca700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c067020 con 0x7f944c0b05d0 2021-06-25T04:57:02.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9451cca700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c15ab90 con 0x7f944c0b5460 2021-06-25T04:57:02.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9450cc8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f944c067560 0x7f944c14b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9450cc8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f944c067560 0x7f944c14b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44212/0 (socket says 172.21.15.57:44212) 2021-06-25T04:57:02.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9450cc8700 1 -- 172.21.15.57:0/945145406 learned_addr learned my addr 172.21.15.57:0/945145406 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:02.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f944bfff700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944c0b05d0 0x7f944c066b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f94514c9700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f944c0b5460 0x7f944c15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9450cc8700 1 -- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f944c0b5460 msgr2=0x7f944c15a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9450cc8700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f944c0b5460 0x7f944c15a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9450cc8700 1 -- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944c0b05d0 msgr2=0x7f944c066b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9450cc8700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944c0b05d0 0x7f944c066b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9450cc8700 1 -- 172.21.15.57:0/945145406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c00b180 con 0x7f944c067560 2021-06-25T04:57:02.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f94514c9700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f944c0b5460 0x7f944c15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:57:02.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f944bfff700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944c0b05d0 0x7f944c066b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:57:02.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9450cc8700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f944c067560 0x7f944c14b2b0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f9444006ec0 tx=0x7f9444009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:02.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9449ffb700 1 -- 172.21.15.57:0/945145406 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f944400c850 con 0x7f944c067560 2021-06-25T04:57:02.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9449ffb700 1 -- 172.21.15.57:0/945145406 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400c9b0 con 0x7f944c067560 2021-06-25T04:57:02.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9451cca700 1 -- 172.21.15.57:0/945145406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c0abf10 con 0x7f944c067560 2021-06-25T04:57:02.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.495+0000 7f9449ffb700 1 -- 172.21.15.57:0/945145406 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f944400cd10 con 0x7f944c067560 2021-06-25T04:57:02.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.499+0000 7f9451cca700 1 -- 172.21.15.57:0/945145406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c0639c0 con 0x7f944c067560 2021-06-25T04:57:02.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.499+0000 7f9451cca700 1 -- 172.21.15.57:0/945145406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944c0a72c0 con 0x7f944c067560 2021-06-25T04:57:02.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.499+0000 7f9449ffb700 1 -- 172.21.15.57:0/945145406 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f94440123f0 con 0x7f944c067560 2021-06-25T04:57:02.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.499+0000 7f9449ffb700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94240554e0 0x7f94240579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:02.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.499+0000 7f9449ffb700 1 -- 172.21.15.57:0/945145406 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f944406e370 con 0x7f944c067560 2021-06-25T04:57:02.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.499+0000 7f944bfff700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94240554e0 0x7f94240579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:02.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.499+0000 7f944bfff700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94240554e0 0x7f94240579a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f943400b000 tx=0x7f9434008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:02.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.503+0000 7f9449ffb700 1 -- 172.21.15.57:0/945145406 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f94440443b0 con 0x7f944c067560 2021-06-25T04:57:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.667+0000 7f9451cca700 1 -- 172.21.15.57:0/945145406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f944c057310 con 0x7f944c067560 2021-06-25T04:57:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.671+0000 7f9449ffb700 1 -- 172.21.15.57:0/945145406 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f94440479d0 con 0x7f944c067560 2021-06-25T04:57:02.679 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:02.680 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":75,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2769630783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2769630783},{"type":"v1","addr":"172.21.15.87:6835","nonce":2769630783}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/583651666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":583651666},{"type":"v1","addr":"172.21.15.57:6834","nonce":583651666}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:54.383291+0000","modified":"2021-06-25T04:56:55.386538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8445":{"gid":8445,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2461786269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2461786269},{"type":"v1","addr":"172.21.15.57:6835","nonce":2461786269}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-06-25T04:57:02.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 -- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94240554e0 msgr2=0x7f94240579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94240554e0 0x7f94240579a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f943400b000 tx=0x7f9434008040).stop 2021-06-25T04:57:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 -- 172.21.15.57:0/945145406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f944c067560 msgr2=0x7f944c14b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f944c067560 0x7f944c14b2b0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f9444006ec0 tx=0x7f9444009290).stop 2021-06-25T04:57:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 -- 172.21.15.57:0/945145406 shutdown_connections 2021-06-25T04:57:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f94240554e0 0x7f94240579a0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f944c0b5460 0x7f944c15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944c0b05d0 0x7f944c066b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 --2- 172.21.15.57:0/945145406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f944c067560 0x7f944c14b2b0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:02.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 -- 172.21.15.57:0/945145406 >> 172.21.15.57:0/945145406 conn(0x7f944c062520 msgr2=0x7f944c1489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:02.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 -- 172.21.15.57:0/945145406 shutdown_connections 2021-06-25T04:57:02.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:02.675+0000 7f9451cca700 1 -- 172.21.15.57:0/945145406 wait complete. 2021-06-25T04:57:02.684 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 75 2021-06-25T04:57:02.996 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:56:54.383291+0000', 'modified': '2021-06-25T04:56:55.386538+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8445}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8445': {'gid': 8445, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2461786269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2461786269}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2461786269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:57:02.996 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:57:02.997 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-06-25T04:57:03.116 INFO:teuthology.orchestra.run.smithi057.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":8445,"want_state":"up:active","state":"up:active","rank_uptime":8.7187614510000007,"mdsmap_epoch":75,"osdmap_epoch":149,"osdmap_epoch_barrier":148,"uptime":13.089270859999999} 2021-06-25T04:57:03.116 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 8445, "mdsmap_epoch": 75, "osdmap_epoch": 149, "osdmap_epoch_barrier": 148, "rank_uptime": 8.718761451, "state": "up:active", "uptime": 13.08927086, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:57:03.117 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:57:03.117 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-06-25T04:57:03.117 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi161.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-06-25T04:57:03.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:03.118 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:03.127 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:57:03.141 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:57:03.142 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:57:03.158 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:57:03.159 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:57:03.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:03.160 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:57:03.208 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:57:03.209 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:03.211 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:57:03.227 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:57:03.228 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:57:03.237 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:57:03.238 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:57:03.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:03.240 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:57:03.285 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:2021-06-25T04:57:03.283+0000 7fb760b9a080 -1 init, newargv = 0x55f2412c9b10 newargc=9ceph-fuse[ 2021-06-25T04:57:03.285 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:15169]: starting ceph client 2021-06-25T04:57:03.296 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[15169]: starting fuse 2021-06-25T04:57:04.390 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:57:04.408 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:57:04.409 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:57:04.419 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:57:04.421 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:57:04.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:04.422 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:57:04.471 INFO:teuthology.orchestra.run.smithi161.stdout:52 2021-06-25T04:57:04.472 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:57:04.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:04.473 DEBUG:teuthology.orchestra.run.smithi161:> sudo python3 -c ' 2021-06-25T04:57:04.473 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2021-06-25T04:57:04.474 DEBUG:teuthology.orchestra.run.smithi161:> import re 2021-06-25T04:57:04.474 DEBUG:teuthology.orchestra.run.smithi161:> import os 2021-06-25T04:57:04.474 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2021-06-25T04:57:04.475 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:57:04.476 DEBUG:teuthology.orchestra.run.smithi161:> def find_socket(client_name): 2021-06-25T04:57:04.477 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-06-25T04:57:04.477 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2021-06-25T04:57:04.478 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:57:04.479 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2021-06-25T04:57:04.480 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2021-06-25T04:57:04.480 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2021-06-25T04:57:04.481 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2021-06-25T04:57:04.481 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:57:04.482 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2021-06-25T04:57:04.482 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:57:04.483 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:57:04.484 DEBUG:teuthology.orchestra.run.smithi161:> return f 2021-06-25T04:57:04.484 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:57:04.484 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:57:04.485 DEBUG:teuthology.orchestra.run.smithi161:> print(find_socket("client.1")) 2021-06-25T04:57:04.486 DEBUG:teuthology.orchestra.run.smithi161:> ' 2021-06-25T04:57:04.532 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.15169.asok 2021-06-25T04:57:04.541 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.15169.asok 2021-06-25T04:57:04.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:04.542 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.15169.asok status 2021-06-25T04:57:04.685 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2021-06-25T04:57:04.686 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2021-06-25T04:57:04.686 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:57:04.686 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:57:04.692 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2021-06-25T04:57:04.692 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2021-06-25T04:57:04.693 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-06-25T04:57:04.693 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "15169", 2021-06-25T04:57:04.693 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2021-06-25T04:57:04.694 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:57:04.694 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2021-06-25T04:57:04.694 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2021-06-25T04:57:04.694 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 8658, 2021-06-25T04:57:04.695 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2021-06-25T04:57:04.695 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2021-06-25T04:57:04.695 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2021-06-25T04:57:04.695 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 8658 2021-06-25T04:57:04.696 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:57:04.696 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:57:04.696 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:57:04.697 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:57:04.697 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 865175435 2021-06-25T04:57:04.698 INFO:teuthology.orchestra.run.smithi161.stdout: } 2021-06-25T04:57:04.698 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:57:04.698 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:57:04.699 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:57:04.699 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:57:04.699 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 865175435 2021-06-25T04:57:04.699 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:57:04.700 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.8658 172.21.15.161:0/865175435", 2021-06-25T04:57:04.700 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "172.21.15.161:0/865175435", 2021-06-25T04:57:04.700 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2021-06-25T04:57:04.700 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 75, 2021-06-25T04:57:04.701 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 149, 2021-06-25T04:57:04.701 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:57:04.701 INFO:teuthology.orchestra.run.smithi161.stdout: "blacklisted": false, 2021-06-25T04:57:04.701 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2021-06-25T04:57:04.702 INFO:teuthology.orchestra.run.smithi161.stdout:} 2021-06-25T04:57:04.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:04.704 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:04.705 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:04.712 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:57:04.713 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:57:04.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:04.714 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:04.773 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-06-25T04:57:04.774 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2021-06-25T04:57:04.813 INFO:teuthology.orchestra.run.smithi102.stdout:1624597024.769439366 2021-06-25T04:57:04.814 INFO:tasks.cephfs.test_misc:rctime = 1624597024.769439366 2021-06-25T04:57:04.814 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:57:04.815 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:57:04.837 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:57:04.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:57:04.882 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:57:04.902 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:57:04.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:04.904 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:04.904 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:57:04.936 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:57:04.937 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:57:04.937 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2021-06-25T04:57:04.938 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:57:04.938 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:57:04.953 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15659]: fuse finished with error 0 and tester_r 0 2021-06-25T04:57:04.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:04.955 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:04.956 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:57:05.004 INFO:teuthology.orchestra.run.smithi102.stdout:ext2/ext3 2021-06-25T04:57:05.006 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:57:05.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:57:05.064 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:57:05.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:05.070 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:05.070 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:05.079 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:57:05.080 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:57:05.080 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2021-06-25T04:57:05.081 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:57:05.081 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:05.096 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[15169]: fuse finished with error 0 and tester_r 0 2021-06-25T04:57:05.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:05.099 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:05.099 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:05.147 INFO:teuthology.orchestra.run.smithi161.stdout:ext2/ext3 2021-06-25T04:57:05.148 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:57:05.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:57:05.264 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:05.272 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:57:05.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.379+0000 7fed2d24a700 1 Processor -- start 2021-06-25T04:57:05.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.379+0000 7fed2d24a700 1 -- start start 2021-06-25T04:57:05.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.379+0000 7fed2d24a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280afbb0 0x7fed280aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.379+0000 7fed2d24a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed280ac350 con 0x7fed280b0950 2021-06-25T04:57:05.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.379+0000 7fed2d24a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed280b15d0 con 0x7fed280b11f0 2021-06-25T04:57:05.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.379+0000 7fed2d24a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed280b0000 con 0x7fed280afbb0 2021-06-25T04:57:05.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.379+0000 7fed277fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fed280b0950 0x7fed280ae6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33206/0 (socket says 172.21.15.57:33206) 2021-06-25T04:57:05.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.379+0000 7fed277fe700 1 -- 172.21.15.57:0/3415354225 learned_addr learned my addr 172.21.15.57:0/3415354225 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:05.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.379+0000 7fed2ca49700 1 --2- 172.21.15.57:0/3415354225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280afbb0 0x7fed280aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed26ffd700 1 -- 172.21.15.57:0/3415354225 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218991026 0 0) 0x7fed280ac350 con 0x7fed280b0950 2021-06-25T04:57:05.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed26ffd700 1 -- 172.21.15.57:0/3415354225 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed14003260 con 0x7fed280b0950 2021-06-25T04:57:05.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2ca49700 1 -- 172.21.15.57:0/3415354225 >> v1:172.21.15.87:6789/0 conn(0x7fed280b11f0 legacy=0x7fed28142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:05.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2ca49700 1 -- 172.21.15.57:0/3415354225 >> v1:172.21.15.57:6789/0 conn(0x7fed280b0950 legacy=0x7fed280ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:05.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed26ffd700 1 -- 172.21.15.57:0/3415354225 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 62441877 0 0) 0x7fed14003260 con 0x7fed280b0950 2021-06-25T04:57:05.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2ca49700 1 -- 172.21.15.57:0/3415354225 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed280b0280 con 0x7fed280afbb0 2021-06-25T04:57:05.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2ca49700 1 --2- 172.21.15.57:0/3415354225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280afbb0 0x7fed280aedb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fed18001b80 tx=0x7fed20006df0).ready entity=mon.2 client_cookie=706f9eb21e7ab107 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:05.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed26ffd700 1 -- 172.21.15.57:0/3415354225 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed180019e0 con 0x7fed280afbb0 2021-06-25T04:57:05.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed26ffd700 1 -- 172.21.15.57:0/3415354225 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed20000e90 con 0x7fed280afbb0 2021-06-25T04:57:05.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2d24a700 1 -- 172.21.15.57:0/3415354225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280afbb0 msgr2=0x7fed280aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:05.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed26ffd700 1 -- 172.21.15.57:0/3415354225 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed2000d4a0 con 0x7fed280afbb0 2021-06-25T04:57:05.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2d24a700 1 --2- 172.21.15.57:0/3415354225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280afbb0 0x7fed280aedb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fed18001b80 tx=0x7fed20006df0).stop 2021-06-25T04:57:05.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2d24a700 1 -- 172.21.15.57:0/3415354225 shutdown_connections 2021-06-25T04:57:05.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2d24a700 1 --2- 172.21.15.57:0/3415354225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280afbb0 0x7fed280aedb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2d24a700 1 -- 172.21.15.57:0/3415354225 >> 172.21.15.57:0/3415354225 conn(0x7fed28062520 msgr2=0x7fed28062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:05.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2d24a700 1 -- 172.21.15.57:0/3415354225 shutdown_connections 2021-06-25T04:57:05.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2d24a700 1 -- 172.21.15.57:0/3415354225 wait complete. 2021-06-25T04:57:05.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2d24a700 1 Processor -- start 2021-06-25T04:57:05.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.383+0000 7fed2d24a700 1 -- start start 2021-06-25T04:57:05.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed2d24a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed280afbb0 0x7fed28144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed2d24a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed280b0950 0x7fed280633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed2d24a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280b11f0 0x7fed28064550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed2d24a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed28063e50 con 0x7fed280afbb0 2021-06-25T04:57:05.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed2d24a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed28147020 con 0x7fed280b0950 2021-06-25T04:57:05.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed2d24a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed281462e0 con 0x7fed280b11f0 2021-06-25T04:57:05.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed27fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed280afbb0 0x7fed28144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed27fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed280afbb0 0x7fed28144430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44226/0 (socket says 172.21.15.57:44226) 2021-06-25T04:57:05.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed27fff700 1 -- 172.21.15.57:0/809151658 learned_addr learned my addr 172.21.15.57:0/809151658 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:05.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed2ca49700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280b11f0 0x7fed28064550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed277fe700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed280b0950 0x7fed280633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed27fff700 1 -- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280b11f0 msgr2=0x7fed28064550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:05.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed27fff700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280b11f0 0x7fed28064550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed27fff700 1 -- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed280b0950 msgr2=0x7fed280633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:05.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed27fff700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed280b0950 0x7fed280633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed27fff700 1 -- 172.21.15.57:0/809151658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2000b180 con 0x7fed280afbb0 2021-06-25T04:57:05.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed2ca49700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280b11f0 0x7fed28064550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:05.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed27fff700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed280afbb0 0x7fed28144430 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fed28069df0 tx=0x7fed1c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:05.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed257fa700 1 -- 172.21.15.57:0/809151658 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed1c007030 con 0x7fed280afbb0 2021-06-25T04:57:05.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed257fa700 1 -- 172.21.15.57:0/809151658 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c007190 con 0x7fed280afbb0 2021-06-25T04:57:05.401 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed257fa700 1 -- 172.21.15.57:0/809151658 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed1c006510 con 0x7fed280afbb0 2021-06-25T04:57:05.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed2d24a700 1 -- 172.21.15.57:0/809151658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed28146d80 con 0x7fed280afbb0 2021-06-25T04:57:05.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed2d24a700 1 -- 172.21.15.57:0/809151658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed280638b0 con 0x7fed280afbb0 2021-06-25T04:57:05.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.387+0000 7fed2d24a700 1 -- 172.21.15.57:0/809151658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed28057310 con 0x7fed280afbb0 2021-06-25T04:57:05.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.391+0000 7fed257fa700 1 -- 172.21.15.57:0/809151658 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fed1c006670 con 0x7fed280afbb0 2021-06-25T04:57:05.402 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.391+0000 7fed257fa700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed080554e0 0x7fed080579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.391+0000 7fed257fa700 1 -- 172.21.15.57:0/809151658 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fed1c06d7c0 con 0x7fed280afbb0 2021-06-25T04:57:05.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.391+0000 7fed277fe700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed080554e0 0x7fed080579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.403 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.391+0000 7fed277fe700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed080554e0 0x7fed080579a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fed1800d000 tx=0x7fed18002210).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:05.404 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.395+0000 7fed257fa700 1 -- 172.21.15.57:0/809151658 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fed1c043a20 con 0x7fed280afbb0 2021-06-25T04:57:05.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.527+0000 7fed2d24a700 1 -- 172.21.15.57:0/809151658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fed2805f200 con 0x7fed280afbb0 2021-06-25T04:57:05.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.531+0000 7fed257fa700 1 -- 172.21.15.57:0/809151658 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v149) v1 ==== 81+0+34051 (secure 0 0 0) 0x7fed1c047040 con 0x7fed280afbb0 2021-06-25T04:57:05.536 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:57:05.536 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 149, 2021-06-25T04:57:05.536 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:57:05.537 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:57:05.537 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:56:55.387316+0000", 2021-06-25T04:57:05.537 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:57:05.538 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:57:05.538 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:57:05.538 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:57:05.538 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:57:05.538 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:57:05.539 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:57:05.539 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:57:05.539 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:57:05.539 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:05.540 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:57:05.540 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:57:05.540 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:57:05.540 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:57:05.541 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:57:05.541 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 28, 2021-06-25T04:57:05.541 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:57:05.542 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:57:05.542 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:57:05.542 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:57:05.542 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:57:05.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.543 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:57:05.543 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:57:05.543 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:57:05.543 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:57:05.544 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:57:05.544 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:57:05.544 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:57:05.544 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:57:05.544 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:57:05.545 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:57:05.545 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:57:05.545 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:57:05.545 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:57:05.546 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:57:05.546 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:57:05.547 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:57:05.547 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:57:05.547 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:57:05.548 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:57:05.548 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:57:05.549 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:57:05.549 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:57:05.549 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:57:05.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.549 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:57:05.550 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:57:05.550 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:57:05.550 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:57:05.550 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:57:05.551 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:57:05.551 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:57:05.551 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:57:05.551 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:57:05.551 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:57:05.552 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:57:05.552 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:57:05.552 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:57:05.552 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:57:05.553 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:57:05.553 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:57:05.553 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:57:05.553 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:57:05.553 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:57:05.554 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:57:05.554 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:57:05.555 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:57:05.555 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:57:05.555 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:57:05.556 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:57:05.556 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:57:05.556 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:57:05.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.557 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:57:05.557 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:57:05.558 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:57:05.558 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:57:05.558 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:57:05.559 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:57:05.559 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:57:05.559 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:57:05.559 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:57:05.560 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:57:05.560 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:57:05.560 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:57:05.561 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:57:05.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.561 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:57:05.562 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:57:05.562 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.563 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:57:05.564 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:57:05.565 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:57:05.566 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:57:05.566 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:57:05.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:57:05.567 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:57:05.567 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:57:05.567 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:57:05.567 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:57:05.568 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:57:05.568 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:57:05.568 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:57:05.569 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:57:05.569 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:57:05.569 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:57:05.569 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:57:05.569 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:57:05.570 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:57:05.570 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:57:05.570 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:57:05.570 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:57:05.571 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:57:05.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.571 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:57:05.571 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:57:05.571 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:57:05.572 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:57:05.572 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:57:05.572 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:57:05.572 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:57:05.573 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:57:05.573 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:57:05.573 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:57:05.573 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:57:05.573 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:57:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:57:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:57:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:57:05.574 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:57:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:57:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:57:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:57:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:57:05.575 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:57:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:57:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:57:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:57:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:57:05.576 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:57:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:57:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:57:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:57:05.578 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:57:05.578 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:57:05.578 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:57:05.578 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:57:05.578 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:57:05.579 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:57:05.579 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:57:05.579 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:57:05.579 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:57:05.580 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:57:05.580 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:57:05.580 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:57:05.580 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.581 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 27, 2021-06-25T04:57:05.581 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:57:05.581 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:56:52.813405+0000", 2021-06-25T04:57:05.581 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:57:05.582 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:57:05.582 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:57:05.582 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:57:05.582 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:57:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:57:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:57:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:57:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:57:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:57:05.584 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:57:05.584 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:57:05.584 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:57:05.584 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:57:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:57:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:57:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:57:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:57:05.585 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:57:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:57:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "149", 2021-06-25T04:57:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:57:05.586 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:57:05.587 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:57:05.587 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:57:05.587 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:57:05.587 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:57:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:57:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:57:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:57:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:57:05.588 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:57:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:57:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:57:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:57:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:57:05.589 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:57:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:57:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:57:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:57:05.590 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:57:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:57:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:57:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:57:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:57:05.591 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:57:05.592 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:57:05.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.592 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:57:05.592 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:57:05.593 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:57:05.593 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:57:05.593 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:57:05.593 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:57:05.593 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:57:05.594 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:57:05.594 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:57:05.594 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:57:05.594 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:57:05.595 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:57:05.595 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:57:05.595 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:57:05.595 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:57:05.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.596 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:57:05.596 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:57:05.596 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:57:05.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.597 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 28, 2021-06-25T04:57:05.597 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:57:05.598 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:56:53.777715+0000", 2021-06-25T04:57:05.598 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:57:05.598 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:57:05.598 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:57:05.598 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:57:05.599 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:57:05.599 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:57:05.599 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:57:05.599 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:57:05.600 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:57:05.600 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:57:05.600 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:57:05.600 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:57:05.600 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:57:05.601 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:57:05.601 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:57:05.601 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:57:05.601 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:57:05.601 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:57:05.602 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:57:05.602 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:57:05.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.602 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "149", 2021-06-25T04:57:05.603 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:57:05.603 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:57:05.603 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:57:05.603 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:57:05.604 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:57:05.604 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:57:05.604 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:57:05.604 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:57:05.604 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:57:05.605 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:57:05.605 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:57:05.605 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:57:05.605 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:57:05.605 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:57:05.606 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:57:05.606 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:57:05.606 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:57:05.606 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:57:05.607 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:57:05.607 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:57:05.607 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:57:05.607 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:57:05.607 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:57:05.608 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:57:05.608 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:57:05.608 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:57:05.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.608 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:57:05.609 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:57:05.609 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:57:05.609 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:57:05.609 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:57:05.610 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:57:05.610 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:57:05.610 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:57:05.610 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:57:05.610 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:57:05.611 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:57:05.611 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:57:05.612 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:57:05.612 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:57:05.612 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:57:05.612 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.612 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.613 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.613 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:05.613 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:57:05.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.614 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:57:05.614 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:57:05.614 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:05.614 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:05.615 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:05.615 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:05.615 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:05.615 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:05.615 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:05.616 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:05.617 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:05.617 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:05.617 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:05.617 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.618 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.618 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:57:05.618 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:05.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.619 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.619 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:57:05.620 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:05.620 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.620 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.620 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:05.622 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.622 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.622 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:57:05.623 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:05.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.623 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.624 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:57:05.624 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:05.624 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.624 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.625 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:05.625 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.626 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.626 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:57:05.626 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:05.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.627 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.627 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:57:05.627 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:05.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.628 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.628 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:05.628 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.629 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.629 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:57:05.629 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:05.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.630 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.630 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:57:05.630 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:05.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.631 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.631 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:57:05.631 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:57:05.632 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:57:05.632 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:57:05.632 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:05.632 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:05.633 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:05.633 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.633 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:57:05.634 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:57:05.634 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:05.634 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:05.634 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:05.635 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:05.635 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:05.635 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:05.635 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:05.636 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:05.636 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:05.636 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:05.636 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:05.636 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.637 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.637 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:57:05.638 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:05.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.638 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.639 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:57:05.639 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:05.639 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.639 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.640 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:05.640 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.641 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.641 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:57:05.641 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:05.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.642 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.642 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:57:05.643 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:05.643 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.643 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.644 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:05.644 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.644 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.644 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:57:05.645 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:05.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.645 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.646 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:57:05.646 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:05.646 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.646 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.647 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:05.647 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.648 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.648 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:57:05.648 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:05.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.649 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.649 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:57:05.649 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:05.650 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.650 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.650 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:57:05.651 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:57:05.651 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:57:05.651 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:57:05.651 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:05.652 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:05.652 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:05.652 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:57:05.653 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:57:05.653 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:05.654 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:05.654 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:05.654 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:05.654 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:05.654 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:05.655 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:05.655 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:05.655 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:05.655 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:05.656 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:05.656 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.656 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.656 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:57:05.657 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:05.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.657 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.658 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:57:05.658 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:05.658 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.658 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.659 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:05.659 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.660 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.660 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:57:05.660 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:05.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.661 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.661 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:57:05.661 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:05.661 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.662 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.662 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:05.662 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.663 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.663 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:57:05.663 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:05.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.664 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.664 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:57:05.664 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:05.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.665 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.665 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:05.665 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:57:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:05.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.667 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.667 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:57:05.668 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:05.668 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.668 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.668 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:57:05.669 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:57:05.669 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:57:05.669 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:57:05.669 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:05.670 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:05.670 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:05.670 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:57:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:57:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:05.672 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:05.672 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:05.672 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:05.672 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:05.673 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:05.673 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 135, 2021-06-25T04:57:05.673 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:05.673 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:05.674 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:05.674 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.674 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.674 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:57:05.675 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:05.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.675 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.676 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:57:05.676 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:05.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.676 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.677 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:05.677 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.678 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:57:05.678 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:05.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.679 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.679 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:57:05.679 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:05.679 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.680 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.680 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:05.680 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.681 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.681 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:57:05.681 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:05.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.682 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.682 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:57:05.682 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:05.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.683 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.683 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:05.684 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.684 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.684 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:57:05.684 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:05.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.685 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.685 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:57:05.686 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:05.686 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.686 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.686 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:57:05.687 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:57:05.687 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:57:05.687 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:57:05.687 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:05.688 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:05.688 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:05.688 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.689 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:57:05.689 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:57:05.689 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:05.689 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:05.690 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:05.690 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:05.690 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:05.690 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:05.691 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:05.691 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 146, 2021-06-25T04:57:05.691 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:05.691 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:05.691 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:05.692 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.692 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.692 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:57:05.693 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:05.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.693 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.693 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:57:05.694 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:05.694 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.694 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.695 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:05.695 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.695 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.696 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:57:05.696 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:05.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.697 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.697 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:57:05.697 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:05.697 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.698 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.698 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:05.698 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.699 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.699 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:57:05.699 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:05.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.700 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.700 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:57:05.700 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:05.701 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.701 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.701 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:05.702 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.702 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.702 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:57:05.702 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:05.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.703 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.703 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:57:05.704 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:05.704 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.704 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.704 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:57:05.705 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:57:05.705 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:57:05.705 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:57:05.705 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:05.706 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:05.706 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:05.706 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.707 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:57:05.707 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:57:05.707 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:05.707 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:05.708 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:05.708 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:05.708 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:05.708 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:05.709 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:05.709 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:05.709 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:05.709 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:05.710 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:05.710 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.710 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.711 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:57:05.711 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:05.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.711 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.712 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:57:05.712 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:05.712 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.712 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.713 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:05.713 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:57:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.715 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.715 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:57:05.715 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:05.715 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.716 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.716 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:05.716 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.717 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.717 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:57:05.717 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:05.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.718 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.718 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:57:05.718 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:05.719 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.719 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.719 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:05.720 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.720 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.720 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:57:05.720 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:05.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.721 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.721 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:57:05.722 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:05.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.722 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.723 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:57:05.723 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:57:05.723 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:57:05.723 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:57:05.723 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:05.724 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:05.724 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:05.724 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.725 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:57:05.725 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:57:05.725 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:05.726 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:05.726 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:05.726 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:05.726 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:05.726 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:05.727 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:05.727 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:05.727 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:05.727 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:05.728 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:05.728 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.728 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.728 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:57:05.729 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:05.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.729 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.730 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:57:05.730 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:05.730 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.730 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.731 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:05.731 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.732 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.732 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:57:05.732 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:05.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.733 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.733 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:57:05.733 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:05.733 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.734 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.734 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:05.734 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.735 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.735 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:57:05.735 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:05.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.736 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.736 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:57:05.736 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:05.737 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.737 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.737 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:05.738 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.738 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.738 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:57:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:57:05.740 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:05.740 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.740 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.741 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:57:05.741 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:57:05.741 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:57:05.741 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:57:05.741 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:05.742 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:05.742 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:05.742 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.743 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:57:05.743 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:57:05.743 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:05.744 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:05.744 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:05.744 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:05.744 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:05.744 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:05.745 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:05.745 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:05.745 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:05.745 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:05.746 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:05.746 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.746 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.747 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:57:05.747 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:05.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.747 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.748 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:57:05.748 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:05.748 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.748 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.749 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:05.749 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.749 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.750 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:57:05.750 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:05.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.751 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.751 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:57:05.751 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:05.751 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.752 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.752 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:05.752 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.753 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.753 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:57:05.753 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:05.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.754 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.754 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:57:05.754 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:05.754 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:05.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.756 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:05.756 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:57:05.756 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:05.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.757 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:05.757 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:57:05.757 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:05.758 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.758 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.758 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:57:05.758 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:57:05.759 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:57:05.759 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:57:05.759 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:05.759 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:05.760 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:05.760 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:05.760 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.760 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:05.760 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:57:05.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.761 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:57:05.761 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:05.761 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:05.762 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:05.762 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:05.762 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:05.762 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:57:05.763 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:05.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.763 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:57:05.763 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:05.764 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:05.764 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:05.764 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:05.764 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:05.765 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:57:05.765 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:05.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.765 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:57:05.766 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:05.766 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:05.766 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:05.766 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:05.767 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:05.767 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:57:05.767 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:05.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.768 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:57:05.768 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:05.768 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:05.769 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:05.769 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:05.769 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:05.769 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:57:05.770 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:05.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.770 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:57:05.771 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:05.771 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:05.771 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:05.772 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:05.772 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:05.772 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:57:05.772 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:05.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.773 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:57:05.773 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:05.774 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:05.774 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:05.774 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:05.774 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:05.774 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:57:05.775 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:05.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.775 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:57:05.776 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:05.776 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:05.776 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:05.776 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:05.777 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:05.777 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:57:05.777 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:05.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:05.778 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:57:05.778 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:05.778 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:05.778 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:05.779 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:05.779 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:05.779 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:57:05.779 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:05.780 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.780 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:05.780 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:57:05.780 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:57:05.780 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:57:05.781 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:57:05.781 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": {}, 2021-06-25T04:57:05.781 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:57:05.781 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:57:05.782 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:57:05.782 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:57:05.782 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:57:05.782 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:57:05.783 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:57:05.783 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:57:05.783 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:57:05.783 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:57:05.784 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:57:05.784 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:57:05.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.785 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:57:05.785 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:57:05.786 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:57:05.786 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:57:05.786 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:57:05.787 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:57:05.787 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:57:05.787 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:05.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:05.787 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:57:05.788 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:57:05.788 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:57:05.788 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:57:05.788 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:57:05.789 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:57:05.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.531+0000 7fed2d24a700 1 -- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed080554e0 msgr2=0x7fed080579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:05.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.531+0000 7fed2d24a700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed080554e0 0x7fed080579a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fed1800d000 tx=0x7fed18002210).stop 2021-06-25T04:57:05.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.531+0000 7fed2d24a700 1 -- 172.21.15.57:0/809151658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed280afbb0 msgr2=0x7fed28144430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:05.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.531+0000 7fed2d24a700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed280afbb0 0x7fed28144430 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fed28069df0 tx=0x7fed1c007bd0).stop 2021-06-25T04:57:05.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.535+0000 7fed2d24a700 1 -- 172.21.15.57:0/809151658 shutdown_connections 2021-06-25T04:57:05.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.535+0000 7fed2d24a700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fed080554e0 0x7fed080579a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.535+0000 7fed2d24a700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed280b11f0 0x7fed28064550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.535+0000 7fed2d24a700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed280b0950 0x7fed280633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.535+0000 7fed2d24a700 1 --2- 172.21.15.57:0/809151658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed280afbb0 0x7fed28144430 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.535+0000 7fed2d24a700 1 -- 172.21.15.57:0/809151658 >> 172.21.15.57:0/809151658 conn(0x7fed28062520 msgr2=0x7fed28140e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.535+0000 7fed2d24a700 1 -- 172.21.15.57:0/809151658 shutdown_connections 2021-06-25T04:57:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.535+0000 7fed2d24a700 1 -- 172.21.15.57:0/809151658 wait complete. 2021-06-25T04:57:05.795 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:57:05.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 Processor -- start 2021-06-25T04:57:05.906 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 -- start start 2021-06-25T04:57:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3480a7670 0x7fb348066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3480b1930 0x7fb348066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 0x7fb34805f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb348067410 con 0x7fb3480a7670 2021-06-25T04:57:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3480a7a50 con 0x7fb3480b1930 2021-06-25T04:57:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3481475e0 con 0x7fb3480b0020 2021-06-25T04:57:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34d44b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3480a7670 0x7fb348066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34dc4c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 0x7fb34805f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34cc4a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3480b1930 0x7fb348066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34dc4c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 0x7fb34805f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:55402/0 (socket says 172.21.15.57:55402) 2021-06-25T04:57:05.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34dc4c700 1 -- 172.21.15.57:0/1309046020 learned_addr learned my addr 172.21.15.57:0/1309046020 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34d44b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3480a7670 0x7fb348066a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44236/0 (socket says 172.21.15.57:44236) 2021-06-25T04:57:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34cc4a700 1 -- 172.21.15.57:0/1309046020 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 msgr2=0x7fb34805f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34cc4a700 1 --2- 172.21.15.57:0/1309046020 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 0x7fb34805f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34cc4a700 1 -- 172.21.15.57:0/1309046020 >> v2:172.21.15.57:3300/0 conn(0x7fb3480a7670 msgr2=0x7fb348066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:05.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34cc4a700 1 --2- 172.21.15.57:0/1309046020 >> v2:172.21.15.57:3300/0 conn(0x7fb3480a7670 0x7fb348066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34cc4a700 1 -- 172.21.15.57:0/1309046020 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348147880 con 0x7fb3480b1930 2021-06-25T04:57:05.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34cc4a700 1 --2- 172.21.15.57:0/1309046020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3480b1930 0x7fb348066f20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fb344002f70 tx=0x7fb344006df0).ready entity=mon.1 client_cookie=8594d18a44408474 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:05.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb33bfff700 1 -- 172.21.15.57:0/1309046020 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34400d4a0 con 0x7fb3480b1930 2021-06-25T04:57:05.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb33bfff700 1 -- 172.21.15.57:0/1309046020 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb344000e90 con 0x7fb3480b1930 2021-06-25T04:57:05.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb33bfff700 1 -- 172.21.15.57:0/1309046020 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34400d7f0 con 0x7fb3480b1930 2021-06-25T04:57:05.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 -- 172.21.15.57:0/1309046020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3480b1930 msgr2=0x7fb348066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:05.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 --2- 172.21.15.57:0/1309046020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3480b1930 0x7fb348066f20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fb344002f70 tx=0x7fb344006df0).stop 2021-06-25T04:57:05.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 -- 172.21.15.57:0/1309046020 shutdown_connections 2021-06-25T04:57:05.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 --2- 172.21.15.57:0/1309046020 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 0x7fb34805f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 --2- 172.21.15.57:0/1309046020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3480b1930 0x7fb348066f20 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 --2- 172.21.15.57:0/1309046020 >> v2:172.21.15.57:3300/0 conn(0x7fb3480a7670 0x7fb348066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 -- 172.21.15.57:0/1309046020 >> 172.21.15.57:0/1309046020 conn(0x7fb3480b53a0 msgr2=0x7fb3480b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:05.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.903+0000 7fb34f6af700 1 -- 172.21.15.57:0/1309046020 shutdown_connections 2021-06-25T04:57:05.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.907+0000 7fb34f6af700 1 -- 172.21.15.57:0/1309046020 wait complete. 2021-06-25T04:57:05.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.907+0000 7fb34f6af700 1 Processor -- start 2021-06-25T04:57:05.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.907+0000 7fb34f6af700 1 -- start start 2021-06-25T04:57:05.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34f6af700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3480a7670 0x7fb3480aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34f6af700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 0x7fb3480ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34f6af700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3480b1930 0x7fb3480aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34f6af700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480aaa10 con 0x7fb3480b1930 2021-06-25T04:57:05.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34f6af700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480adeb0 con 0x7fb3480a7670 2021-06-25T04:57:05.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34f6af700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480ae150 con 0x7fb3480b0020 2021-06-25T04:57:05.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34dc4c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3480b1930 0x7fb3480aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34cc4a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 0x7fb3480ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34dc4c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3480b1930 0x7fb3480aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44244/0 (socket says 172.21.15.57:44244) 2021-06-25T04:57:05.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34dc4c700 1 -- 172.21.15.57:0/2991708528 learned_addr learned my addr 172.21.15.57:0/2991708528 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:05.925 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34cc4a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 0x7fb3480ab980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:55406/0 (socket says 172.21.15.57:55406) 2021-06-25T04:57:05.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34d44b700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3480a7670 0x7fb3480aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34dc4c700 1 -- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 msgr2=0x7fb3480ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:05.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34dc4c700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 0x7fb3480ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.926 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34dc4c700 1 -- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3480a7670 msgr2=0x7fb3480aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:05.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34dc4c700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3480a7670 0x7fb3480aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:05.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34dc4c700 1 -- 172.21.15.57:0/2991708528 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34400b180 con 0x7fb3480b1930 2021-06-25T04:57:05.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34dc4c700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3480b1930 0x7fb3480aeb10 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7fb34000c000 tx=0x7fb340009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb33a7fc700 1 -- 172.21.15.57:0/2991708528 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34000c850 con 0x7fb3480b1930 2021-06-25T04:57:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb33a7fc700 1 -- 172.21.15.57:0/2991708528 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34000c9b0 con 0x7fb3480b1930 2021-06-25T04:57:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34f6af700 1 -- 172.21.15.57:0/2991708528 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3480ae3f0 con 0x7fb3480b1930 2021-06-25T04:57:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb33a7fc700 1 -- 172.21.15.57:0/2991708528 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34000cd10 con 0x7fb3480b1930 2021-06-25T04:57:05.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34f6af700 1 -- 172.21.15.57:0/2991708528 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3480acf30 con 0x7fb3480b1930 2021-06-25T04:57:05.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.911+0000 7fb34f6af700 1 -- 172.21.15.57:0/2991708528 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb348057310 con 0x7fb3480b1930 2021-06-25T04:57:05.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.915+0000 7fb33a7fc700 1 -- 172.21.15.57:0/2991708528 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb340022070 con 0x7fb3480b1930 2021-06-25T04:57:05.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.915+0000 7fb33a7fc700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3300553d0 0x7fb330057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:05.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.915+0000 7fb33a7fc700 1 -- 172.21.15.57:0/2991708528 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb34006e5c0 con 0x7fb3480b1930 2021-06-25T04:57:05.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.915+0000 7fb34d44b700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3300553d0 0x7fb330057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:05.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.915+0000 7fb34d44b700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3300553d0 0x7fb330057890 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb33c00b000 tx=0x7fb33c006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:05.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:05.923+0000 7fb33a7fc700 1 -- 172.21.15.57:0/2991708528 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb340044770 con 0x7fb3480b1930 2021-06-25T04:57:06.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 -- 172.21.15.57:0/2991708528 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb348066710 con 0x7fb3480b1930 2021-06-25T04:57:06.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb33a7fc700 1 -- 172.21.15.57:0/2991708528 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fb340016090 con 0x7fb3480b1930 2021-06-25T04:57:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:06.092 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":75,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2769630783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2769630783},{"type":"v1","addr":"172.21.15.87:6835","nonce":2769630783}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/583651666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":583651666},{"type":"v1","addr":"172.21.15.57:6834","nonce":583651666}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:54.383291+0000","modified":"2021-06-25T04:56:55.386538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8445":{"gid":8445,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2461786269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2461786269},{"type":"v1","addr":"172.21.15.57:6835","nonce":2461786269}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-06-25T04:57:06.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 -- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3300553d0 msgr2=0x7fb330057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3300553d0 0x7fb330057890 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb33c00b000 tx=0x7fb33c006df0).stop 2021-06-25T04:57:06.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 -- 172.21.15.57:0/2991708528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3480b1930 msgr2=0x7fb3480aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3480b1930 0x7fb3480aeb10 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7fb34000c000 tx=0x7fb340009290).stop 2021-06-25T04:57:06.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 -- 172.21.15.57:0/2991708528 shutdown_connections 2021-06-25T04:57:06.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb3300553d0 0x7fb330057890 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3480b1930 0x7fb3480aeb10 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3480b0020 0x7fb3480ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 --2- 172.21.15.57:0/2991708528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3480a7670 0x7fb3480aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 -- 172.21.15.57:0/2991708528 >> 172.21.15.57:0/2991708528 conn(0x7fb3480b53a0 msgr2=0x7fb3480601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:06.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 -- 172.21.15.57:0/2991708528 shutdown_connections 2021-06-25T04:57:06.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.087+0000 7fb34f6af700 1 -- 172.21.15.57:0/2991708528 wait complete. 2021-06-25T04:57:06.097 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 75 2021-06-25T04:57:06.105 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:57:06.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b3d19700 1 Processor -- start 2021-06-25T04:57:06.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b3d19700 1 -- start start 2021-06-25T04:57:06.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b3d19700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa7ac0b1d70 0x7fa7ac0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b3d19700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7ac148360 0x7fa7ac0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b3d19700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac0b0310 con 0x7fa7ac0a7080 2021-06-25T04:57:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b3d19700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac0a9080 con 0x7fa7ac148360 2021-06-25T04:57:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b3d19700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac0b05b0 con 0x7fa7ac0b1d70 2021-06-25T04:57:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b12b4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7ac148360 0x7fa7ac0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b12b4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7ac148360 0x7fa7ac0b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44248/0 (socket says 172.21.15.57:44248) 2021-06-25T04:57:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b12b4700 1 -- 172.21.15.57:0/3781800985 learned_addr learned my addr 172.21.15.57:0/3781800985 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b1ab5700 1 --2- 172.21.15.57:0/3781800985 >> v2:172.21.15.87:3300/0 conn(0x7fa7ac0b1d70 0x7fa7ac0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b0ab3700 1 -- 172.21.15.57:0/3781800985 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960217537 0 0) 0x7fa7ac0b0310 con 0x7fa7ac0a7080 2021-06-25T04:57:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b12b4700 1 -- 172.21.15.57:0/3781800985 >> v2:172.21.15.87:3300/0 conn(0x7fa7ac0b1d70 msgr2=0x7fa7ac0b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b12b4700 1 --2- 172.21.15.57:0/3781800985 >> v2:172.21.15.87:3300/0 conn(0x7fa7ac0b1d70 0x7fa7ac0b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b12b4700 1 -- 172.21.15.57:0/3781800985 >> v1:172.21.15.87:6789/0 conn(0x7fa7ac0a7080 legacy=0x7fa7ac1446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b12b4700 1 -- 172.21.15.57:0/3781800985 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac0b0850 con 0x7fa7ac148360 2021-06-25T04:57:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.203+0000 7fa7b12b4700 1 --2- 172.21.15.57:0/3781800985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac148360 0x7fa7ac0b2150 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7fa7ac1476f0 tx=0x7fa7a8006eb0).ready entity=mon.0 client_cookie=add4a6b610cd25f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b0ab3700 1 -- 172.21.15.57:0/3781800985 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a800d610 con 0x7fa7ac148360 2021-06-25T04:57:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b0ab3700 1 -- 172.21.15.57:0/3781800985 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a8000e90 con 0x7fa7ac148360 2021-06-25T04:57:06.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b0ab3700 1 -- 172.21.15.57:0/3781800985 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a800d960 con 0x7fa7ac148360 2021-06-25T04:57:06.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3781800985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac148360 msgr2=0x7fa7ac0b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b3d19700 1 --2- 172.21.15.57:0/3781800985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac148360 0x7fa7ac0b2150 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7fa7ac1476f0 tx=0x7fa7a8006eb0).stop 2021-06-25T04:57:06.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3781800985 shutdown_connections 2021-06-25T04:57:06.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b3d19700 1 --2- 172.21.15.57:0/3781800985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac148360 0x7fa7ac0b2150 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b3d19700 1 --2- 172.21.15.57:0/3781800985 >> v2:172.21.15.87:3300/0 conn(0x7fa7ac0b1d70 0x7fa7ac0b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3781800985 >> 172.21.15.57:0/3781800985 conn(0x7fa7ac05f670 msgr2=0x7fa7ac05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:06.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3781800985 shutdown_connections 2021-06-25T04:57:06.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3781800985 wait complete. 2021-06-25T04:57:06.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b3d19700 1 Processor -- start 2021-06-25T04:57:06.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.207+0000 7fa7b3d19700 1 -- start start 2021-06-25T04:57:06.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b3d19700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0a7080 0x7fa7ac066b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b3d19700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac0b1d70 0x7fa7ac062920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b3d19700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac148360 0x7fa7ac062e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b3d19700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0ae650 con 0x7fa7ac0a7080 2021-06-25T04:57:06.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b3d19700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0ab840 con 0x7fa7ac0b1d70 2021-06-25T04:57:06.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b3d19700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0ae880 con 0x7fa7ac148360 2021-06-25T04:57:06.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b1ab5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0a7080 0x7fa7ac066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b1ab5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0a7080 0x7fa7ac066b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44254/0 (socket says 172.21.15.57:44254) 2021-06-25T04:57:06.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b1ab5700 1 -- 172.21.15.57:0/3181718341 learned_addr learned my addr 172.21.15.57:0/3181718341 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:06.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b22b6700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac148360 0x7fa7ac062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b12b4700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac0b1d70 0x7fa7ac062920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b1ab5700 1 -- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac148360 msgr2=0x7fa7ac062e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b1ab5700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac148360 0x7fa7ac062e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b1ab5700 1 -- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac0b1d70 msgr2=0x7fa7ac062920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b1ab5700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac0b1d70 0x7fa7ac062920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b1ab5700 1 -- 172.21.15.57:0/3181718341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a800b1e0 con 0x7fa7ac0a7080 2021-06-25T04:57:06.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b1ab5700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0a7080 0x7fa7ac066b50 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7fa79c00c000 tx=0x7fa79c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:06.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa79affd700 1 -- 172.21.15.57:0/3181718341 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c010780 con 0x7fa7ac0a7080 2021-06-25T04:57:06.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa79affd700 1 -- 172.21.15.57:0/3181718341 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c00b3b0 con 0x7fa7ac0a7080 2021-06-25T04:57:06.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3181718341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac0aeb20 con 0x7fa7ac0a7080 2021-06-25T04:57:06.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa79affd700 1 -- 172.21.15.57:0/3181718341 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79c010ad0 con 0x7fa7ac0a7080 2021-06-25T04:57:06.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3181718341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac0aefc0 con 0x7fa7ac0a7080 2021-06-25T04:57:06.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.211+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3181718341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac0ac0b0 con 0x7fa7ac0a7080 2021-06-25T04:57:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.215+0000 7fa79affd700 1 -- 172.21.15.57:0/3181718341 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa79c010c30 con 0x7fa7ac0a7080 2021-06-25T04:57:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.215+0000 7fa79affd700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c0554e0 0x7fa78c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.215+0000 7fa79affd700 1 -- 172.21.15.57:0/3181718341 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa79c06e190 con 0x7fa7ac0a7080 2021-06-25T04:57:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.215+0000 7fa7b12b4700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c0554e0 0x7fa78c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.215+0000 7fa7b12b4700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c0554e0 0x7fa78c0579a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fa7a801b000 tx=0x7fa7a8015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:06.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.219+0000 7fa79affd700 1 -- 172.21.15.57:0/3181718341 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa7ac0ac0b0 con 0x7fa7ac0a7080 2021-06-25T04:57:06.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.383+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3181718341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa7ac0ac0b0 con 0x7fa7ac0a7080 2021-06-25T04:57:06.684 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:57:06.679+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:57:06.696 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.691+0000 7fa79affd700 1 -- 172.21.15.57:0/3181718341 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa7ac0ac0b0 con 0x7fa7ac0a7080 2021-06-25T04:57:06.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c0554e0 msgr2=0x7fa78c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c0554e0 0x7fa78c0579a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fa7a801b000 tx=0x7fa7a8015000).stop 2021-06-25T04:57:06.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3181718341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0a7080 msgr2=0x7fa7ac066b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0a7080 0x7fa7ac066b50 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7fa79c00c000 tx=0x7fa79c006df0).stop 2021-06-25T04:57:06.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3181718341 shutdown_connections 2021-06-25T04:57:06.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa78c0554e0 0x7fa78c0579a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7ac148360 0x7fa7ac062e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7ac0b1d70 0x7fa7ac062920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 --2- 172.21.15.57:0/3181718341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7ac0a7080 0x7fa7ac066b50 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3181718341 >> 172.21.15.57:0/3181718341 conn(0x7fa7ac05f670 msgr2=0x7fa7ac0b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3181718341 shutdown_connections 2021-06-25T04:57:06.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.695+0000 7fa7b3d19700 1 -- 172.21.15.57:0/3181718341 wait complete. 2021-06-25T04:57:06.708 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:57:06.717 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:57:06.726 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:57:06.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8678b31700 1 Processor -- start 2021-06-25T04:57:06.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8678b31700 1 -- start start 2021-06-25T04:57:06.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8678b31700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8674061640 0x7f86740b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8678b31700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674143960 0x7f8674140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8678b31700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86740b68d0 con 0x7f86740b46d0 2021-06-25T04:57:06.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8678b31700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86740b9640 con 0x7f8674061640 2021-06-25T04:57:06.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8678b31700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86740b6b70 con 0x7f8674143960 2021-06-25T04:57:06.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f86737fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8674061640 0x7f86740b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f866bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f86740b46d0 0x7f867413fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33262/0 (socket says 172.21.15.57:33262) 2021-06-25T04:57:06.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f866bfff700 1 -- 172.21.15.57:0/1185543870 learned_addr learned my addr 172.21.15.57:0/1185543870 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:06.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8673fff700 1 --2- 172.21.15.57:0/1185543870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674143960 0x7f8674140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8672ffd700 1 -- 172.21.15.57:0/1185543870 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232636838 0 0) 0x7f86740b68d0 con 0x7f86740b46d0 2021-06-25T04:57:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8672ffd700 1 -- 172.21.15.57:0/1185543870 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8654003260 con 0x7f86740b46d0 2021-06-25T04:57:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f86737fe700 1 -- 172.21.15.57:0/1185543870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674143960 msgr2=0x7f8674140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f86737fe700 1 --2- 172.21.15.57:0/1185543870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674143960 0x7f8674140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f86737fe700 1 -- 172.21.15.57:0/1185543870 >> v1:172.21.15.57:6789/0 conn(0x7f86740b46d0 legacy=0x7f867413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f86737fe700 1 -- 172.21.15.57:0/1185543870 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740b6e10 con 0x7f8674061640 2021-06-25T04:57:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8673fff700 1 --2- 172.21.15.57:0/1185543870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674143960 0x7f8674140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:06.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f86737fe700 1 --2- 172.21.15.57:0/1185543870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8674061640 0x7f86740b9cd0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f8664002f70 tx=0x7f8664006df0).ready entity=mon.0 client_cookie=8793f212e5a6091b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:06.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8672ffd700 1 -- 172.21.15.57:0/1185543870 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f866400d4a0 con 0x7f8674061640 2021-06-25T04:57:06.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8672ffd700 1 -- 172.21.15.57:0/1185543870 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8664000e90 con 0x7f8674061640 2021-06-25T04:57:06.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8672ffd700 1 -- 172.21.15.57:0/1185543870 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f866400d7f0 con 0x7f8674061640 2021-06-25T04:57:06.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8678b31700 1 -- 172.21.15.57:0/1185543870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8674061640 msgr2=0x7f86740b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.815+0000 7f8678b31700 1 --2- 172.21.15.57:0/1185543870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8674061640 0x7f86740b9cd0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f8664002f70 tx=0x7f8664006df0).stop 2021-06-25T04:57:06.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 -- 172.21.15.57:0/1185543870 shutdown_connections 2021-06-25T04:57:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 --2- 172.21.15.57:0/1185543870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674143960 0x7f8674140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 --2- 172.21.15.57:0/1185543870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8674061640 0x7f86740b9cd0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 -- 172.21.15.57:0/1185543870 >> 172.21.15.57:0/1185543870 conn(0x7f867406adb0 msgr2=0x7f867405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:06.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 -- 172.21.15.57:0/1185543870 shutdown_connections 2021-06-25T04:57:06.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 -- 172.21.15.57:0/1185543870 wait complete. 2021-06-25T04:57:06.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 Processor -- start 2021-06-25T04:57:06.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 -- start start 2021-06-25T04:57:06.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674061640 0x7f86741444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8674143960 0x7f867413b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867413ab20 0x7f86740b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867413b080 con 0x7f8674143960 2021-06-25T04:57:06.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8674061a20 con 0x7f867413ab20 2021-06-25T04:57:06.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8678b31700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867413a590 con 0x7f8674061640 2021-06-25T04:57:06.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f866bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8674143960 0x7f867413b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f86737fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674061640 0x7f86741444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f86737fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674061640 0x7f86741444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:55444/0 (socket says 172.21.15.57:55444) 2021-06-25T04:57:06.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f86737fe700 1 -- 172.21.15.57:0/717398391 learned_addr learned my addr 172.21.15.57:0/717398391 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:06.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f8673fff700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867413ab20 0x7f86740b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f86737fe700 1 -- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867413ab20 msgr2=0x7f86740b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f86737fe700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867413ab20 0x7f86740b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f86737fe700 1 -- 172.21.15.57:0/717398391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8674143960 msgr2=0x7f867413b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:06.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f86737fe700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8674143960 0x7f867413b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:06.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.819+0000 7f86737fe700 1 -- 172.21.15.57:0/717398391 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c009470 con 0x7f8674061640 2021-06-25T04:57:06.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.823+0000 7f86737fe700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674061640 0x7f86741444d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f8664002f70 tx=0x7f8664014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:06.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.823+0000 7f86717fa700 1 -- 172.21.15.57:0/717398391 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8664012e40 con 0x7f8674061640 2021-06-25T04:57:06.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.823+0000 7f86717fa700 1 -- 172.21.15.57:0/717398391 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866400de70 con 0x7f8674061640 2021-06-25T04:57:06.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.823+0000 7f86717fa700 1 -- 172.21.15.57:0/717398391 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f866401f630 con 0x7f8674061640 2021-06-25T04:57:06.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.823+0000 7f8678b31700 1 -- 172.21.15.57:0/717398391 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866400b180 con 0x7f8674061640 2021-06-25T04:57:06.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.823+0000 7f8678b31700 1 -- 172.21.15.57:0/717398391 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86740b9400 con 0x7f8674061640 2021-06-25T04:57:06.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.823+0000 7f8678b31700 1 -- 172.21.15.57:0/717398391 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867413b4b0 con 0x7f8674061640 2021-06-25T04:57:06.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.823+0000 7f86717fa700 1 -- 172.21.15.57:0/717398391 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8664025020 con 0x7f8674061640 2021-06-25T04:57:06.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.823+0000 7f86717fa700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8658055450 0x7f8658057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:06.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.823+0000 7f86717fa700 1 -- 172.21.15.57:0/717398391 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f866406eef0 con 0x7f8674061640 2021-06-25T04:57:06.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.823+0000 7f866bfff700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8658055450 0x7f8658057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.827+0000 7f866bfff700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8658055450 0x7f8658057910 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f865c00d000 tx=0x7f865c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.835+0000 7f86717fa700 1 -- 172.21.15.57:0/717398391 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f867413b4b0 con 0x7f8674061640 2021-06-25T04:57:07.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.995+0000 7f8678b31700 1 -- 172.21.15.57:0/717398391 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f867413b4b0 con 0x7f8674061640 2021-06-25T04:57:07.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f86717fa700 1 -- 172.21.15.57:0/717398391 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f867413b4b0 con 0x7f8674061640 2021-06-25T04:57:07.003 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:07.003 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":76,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2769630783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2769630783},{"type":"v1","addr":"172.21.15.87:6835","nonce":2769630783}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/583651666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":583651666},{"type":"v1","addr":"172.21.15.57:6834","nonce":583651666}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:56:54.383291+0000","modified":"2021-06-25T04:57:06.682342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":150,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-06-25T04:57:07.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 -- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8658055450 msgr2=0x7f8658057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:07.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8658055450 0x7f8658057910 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f865c00d000 tx=0x7f865c009040).stop 2021-06-25T04:57:07.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 -- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674061640 msgr2=0x7f86741444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:07.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674061640 0x7f86741444d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f8664002f70 tx=0x7f8664014000).stop 2021-06-25T04:57:07.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 -- 172.21.15.57:0/717398391 shutdown_connections 2021-06-25T04:57:07.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8658055450 0x7f8658057910 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867413ab20 0x7f86740b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8674143960 0x7f867413b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 --2- 172.21.15.57:0/717398391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8674061640 0x7f86741444d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 -- 172.21.15.57:0/717398391 >> 172.21.15.57:0/717398391 conn(0x7f867406adb0 msgr2=0x7f8674140e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:07.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 -- 172.21.15.57:0/717398391 shutdown_connections 2021-06-25T04:57:07.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:06.999+0000 7f8678b31700 1 -- 172.21.15.57:0/717398391 wait complete. 2021-06-25T04:57:07.008 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 76 2021-06-25T04:57:07.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:57:07.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5aeccf9700 1 Processor -- start 2021-06-25T04:57:07.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5aeccf9700 1 -- start start 2021-06-25T04:57:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5aeccf9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ae805fbc0 0x7f5ae80b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5aeccf9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 0x7f5ae80b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5aeccf9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5ae80b5950 0x7f5ae80b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5aeccf9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae8143f20 con 0x7f5ae805fbc0 2021-06-25T04:57:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5aeccf9700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae805ffa0 con 0x7f5ae80b5950 2021-06-25T04:57:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5aeccf9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae8143a10 con 0x7f5ae80b6520 2021-06-25T04:57:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5ae659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ae805fbc0 0x7f5ae80b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5ae659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ae805fbc0 0x7f5ae80b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44288/0 (socket says 172.21.15.57:44288) 2021-06-25T04:57:07.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5ae659c700 1 -- 172.21.15.57:0/831388850 learned_addr learned my addr 172.21.15.57:0/831388850 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:07.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5ae6d9d700 1 --2- 172.21.15.57:0/831388850 >> v2:172.21.15.87:3300/0 conn(0x7f5ae80b5950 0x7f5ae80b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.115+0000 7f5ae5d9b700 1 --2- 172.21.15.57:0/831388850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 0x7f5ae80b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5ae659c700 1 -- 172.21.15.57:0/831388850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 msgr2=0x7f5ae80b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:07.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5ae659c700 1 --2- 172.21.15.57:0/831388850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 0x7f5ae80b9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5ae659c700 1 -- 172.21.15.57:0/831388850 >> v2:172.21.15.87:3300/0 conn(0x7f5ae80b5950 msgr2=0x7f5ae80b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:07.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5ae659c700 1 --2- 172.21.15.57:0/831388850 >> v2:172.21.15.87:3300/0 conn(0x7f5ae80b5950 0x7f5ae80b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5ae659c700 1 -- 172.21.15.57:0/831388850 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8143c80 con 0x7f5ae805fbc0 2021-06-25T04:57:07.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5ae5d9b700 1 --2- 172.21.15.57:0/831388850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 0x7f5ae80b9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:07.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5ae659c700 1 --2- 172.21.15.57:0/831388850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae805fbc0 0x7f5ae80b4170 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7f5ad0002f70 tx=0x7f5ad0006eb0).ready entity=mon.0 client_cookie=abb6773781c299de server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:07.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5ae559a700 1 -- 172.21.15.57:0/831388850 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ad000d570 con 0x7f5ae805fbc0 2021-06-25T04:57:07.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5ae559a700 1 -- 172.21.15.57:0/831388850 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad0000e90 con 0x7f5ae805fbc0 2021-06-25T04:57:07.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5ae559a700 1 -- 172.21.15.57:0/831388850 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ad000d900 con 0x7f5ae805fbc0 2021-06-25T04:57:07.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5aeccf9700 1 -- 172.21.15.57:0/831388850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae805fbc0 msgr2=0x7f5ae80b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:07.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5aeccf9700 1 --2- 172.21.15.57:0/831388850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae805fbc0 0x7f5ae80b4170 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7f5ad0002f70 tx=0x7f5ad0006eb0).stop 2021-06-25T04:57:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5aeccf9700 1 -- 172.21.15.57:0/831388850 shutdown_connections 2021-06-25T04:57:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5aeccf9700 1 --2- 172.21.15.57:0/831388850 >> v2:172.21.15.87:3300/0 conn(0x7f5ae80b5950 0x7f5ae80b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5aeccf9700 1 --2- 172.21.15.57:0/831388850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 0x7f5ae80b9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5aeccf9700 1 --2- 172.21.15.57:0/831388850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae805fbc0 0x7f5ae80b4170 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5aeccf9700 1 -- 172.21.15.57:0/831388850 >> 172.21.15.57:0/831388850 conn(0x7f5ae8062360 msgr2=0x7f5ae8066da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5aeccf9700 1 -- 172.21.15.57:0/831388850 shutdown_connections 2021-06-25T04:57:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.119+0000 7f5aeccf9700 1 -- 172.21.15.57:0/831388850 wait complete. 2021-06-25T04:57:07.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5aeccf9700 1 Processor -- start 2021-06-25T04:57:07.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5aeccf9700 1 -- start start 2021-06-25T04:57:07.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5aeccf9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae805fbc0 0x7f5ae80b8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5aeccf9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ae80b5950 0x7f5ae80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5aeccf9700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 0x7f5ae80b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5aeccf9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80ae8b0 con 0x7f5ae805fbc0 2021-06-25T04:57:07.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5aeccf9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80b0080 con 0x7f5ae80b5950 2021-06-25T04:57:07.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5aeccf9700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80b0320 con 0x7f5ae80b6520 2021-06-25T04:57:07.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae805fbc0 0x7f5ae80b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae805fbc0 0x7f5ae80b8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44294/0 (socket says 172.21.15.57:44294) 2021-06-25T04:57:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae659c700 1 -- 172.21.15.57:0/778242727 learned_addr learned my addr 172.21.15.57:0/778242727 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae6d9d700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 0x7f5ae80b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae5d9b700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ae80b5950 0x7f5ae80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae659c700 1 -- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 msgr2=0x7f5ae80b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae659c700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 0x7f5ae80b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae659c700 1 -- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ae80b5950 msgr2=0x7f5ae80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae659c700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ae80b5950 0x7f5ae80b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae659c700 1 -- 172.21.15.57:0/778242727 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad000b1e0 con 0x7f5ae805fbc0 2021-06-25T04:57:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae5d9b700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ae80b5950 0x7f5ae80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae6d9d700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 0x7f5ae80b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5ae659c700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae805fbc0 0x7f5ae80b8970 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f5ad0002f70 tx=0x7f5ad0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5adf7fe700 1 -- 172.21.15.57:0/778242727 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ad0021070 con 0x7f5ae805fbc0 2021-06-25T04:57:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5adf7fe700 1 -- 172.21.15.57:0/778242727 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad0000e90 con 0x7f5ae805fbc0 2021-06-25T04:57:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5aeccf9700 1 -- 172.21.15.57:0/778242727 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae81282b0 con 0x7f5ae805fbc0 2021-06-25T04:57:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.123+0000 7f5adf7fe700 1 -- 172.21.15.57:0/778242727 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ad0011ce0 con 0x7f5ae805fbc0 2021-06-25T04:57:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.127+0000 7f5aeccf9700 1 -- 172.21.15.57:0/778242727 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae81443d0 con 0x7f5ae805fbc0 2021-06-25T04:57:07.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.127+0000 7f5aeccf9700 1 -- 172.21.15.57:0/778242727 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae80b04e0 con 0x7f5ae805fbc0 2021-06-25T04:57:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.127+0000 7f5adf7fe700 1 -- 172.21.15.57:0/778242727 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5ad000f070 con 0x7f5ae805fbc0 2021-06-25T04:57:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.127+0000 7f5adf7fe700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5acc055450 0x7f5acc057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.127+0000 7f5adf7fe700 1 -- 172.21.15.57:0/778242727 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f5ad006f500 con 0x7f5ae805fbc0 2021-06-25T04:57:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.127+0000 7f5ae5d9b700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5acc055450 0x7f5acc057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.131+0000 7f5ae5d9b700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5acc055450 0x7f5acc057910 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f5ad800c000 tx=0x7f5ad8008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:07.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.135+0000 7f5adf7fe700 1 -- 172.21.15.57:0/778242727 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5ad0045550 con 0x7f5ae805fbc0 2021-06-25T04:57:07.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.295+0000 7f5aeccf9700 1 -- 172.21.15.57:0/778242727 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5ae8057310 con 0x7f5ae805fbc0 2021-06-25T04:57:07.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.695+0000 7f5adf7fe700 1 -- 172.21.15.57:0/778242727 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5ad0048b70 con 0x7f5ae805fbc0 2021-06-25T04:57:07.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 -- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5acc055450 msgr2=0x7f5acc057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:07.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5acc055450 0x7f5acc057910 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f5ad800c000 tx=0x7f5ad8008040).stop 2021-06-25T04:57:07.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 -- 172.21.15.57:0/778242727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae805fbc0 msgr2=0x7f5ae80b8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:07.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae805fbc0 0x7f5ae80b8970 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f5ad0002f70 tx=0x7f5ad0015000).stop 2021-06-25T04:57:07.705 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 -- 172.21.15.57:0/778242727 shutdown_connections 2021-06-25T04:57:07.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5acc055450 0x7f5acc057910 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ae80b6520 0x7f5ae80b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ae80b5950 0x7f5ae80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 --2- 172.21.15.57:0/778242727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae805fbc0 0x7f5ae80b8970 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 -- 172.21.15.57:0/778242727 >> 172.21.15.57:0/778242727 conn(0x7f5ae8062360 msgr2=0x7f5ae812a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:07.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 -- 172.21.15.57:0/778242727 shutdown_connections 2021-06-25T04:57:07.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.699+0000 7f5aeccf9700 1 -- 172.21.15.57:0/778242727 wait complete. 2021-06-25T04:57:07.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:57:07.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.839+0000 7f918e94b700 1 Processor -- start 2021-06-25T04:57:07.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.839+0000 7f918e94b700 1 -- start start 2021-06-25T04:57:07.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.839+0000 7f918e94b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91880612e0 0x7f91880616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.839+0000 7f918e94b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880ad580 0x7f91880b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.839+0000 7f918e94b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91880aecb0 con 0x7f9188140400 2021-06-25T04:57:07.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.839+0000 7f918e94b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91880b6ee0 con 0x7f91880612e0 2021-06-25T04:57:07.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.839+0000 7f918e94b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91880aeee0 con 0x7f91880ad580 2021-06-25T04:57:07.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.839+0000 7f918d949700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91880612e0 0x7f91880616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918d148700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880ad580 0x7f91880b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918d949700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91880612e0 0x7f91880616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44304/0 (socket says 172.21.15.57:44304) 2021-06-25T04:57:07.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918d949700 1 -- 172.21.15.57:0/3456688699 learned_addr learned my addr 172.21.15.57:0/3456688699 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:07.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918d949700 1 -- 172.21.15.57:0/3456688699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880ad580 msgr2=0x7f91880b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918c947700 1 -- 172.21.15.57:0/3456688699 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163336146 0 0) 0x7f91880aecb0 con 0x7f9188140400 2021-06-25T04:57:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918d949700 1 --2- 172.21.15.57:0/3456688699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880ad580 0x7f91880b9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918d949700 1 -- 172.21.15.57:0/3456688699 >> v1:172.21.15.87:6789/0 conn(0x7f9188140400 legacy=0x7f91881464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918d949700 1 -- 172.21.15.57:0/3456688699 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91880af180 con 0x7f91880612e0 2021-06-25T04:57:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918d949700 1 --2- 172.21.15.57:0/3456688699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91880612e0 0x7f91880616c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f9178002f70 tx=0x7f9178006eb0).ready entity=mon.0 client_cookie=e8751d1b1fc2fb62 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918c947700 1 -- 172.21.15.57:0/3456688699 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f917800d570 con 0x7f91880612e0 2021-06-25T04:57:07.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918c947700 1 -- 172.21.15.57:0/3456688699 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9178000e90 con 0x7f91880612e0 2021-06-25T04:57:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918c947700 1 -- 172.21.15.57:0/3456688699 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f917800d8c0 con 0x7f91880612e0 2021-06-25T04:57:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918e94b700 1 -- 172.21.15.57:0/3456688699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91880612e0 msgr2=0x7f91880616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918e94b700 1 --2- 172.21.15.57:0/3456688699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91880612e0 0x7f91880616c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f9178002f70 tx=0x7f9178006eb0).stop 2021-06-25T04:57:07.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918e94b700 1 -- 172.21.15.57:0/3456688699 shutdown_connections 2021-06-25T04:57:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918e94b700 1 --2- 172.21.15.57:0/3456688699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880ad580 0x7f91880b9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918e94b700 1 --2- 172.21.15.57:0/3456688699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91880612e0 0x7f91880616c0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918e94b700 1 -- 172.21.15.57:0/3456688699 >> 172.21.15.57:0/3456688699 conn(0x7f9188066da0 msgr2=0x7f9188067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:07.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918e94b700 1 -- 172.21.15.57:0/3456688699 shutdown_connections 2021-06-25T04:57:07.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.843+0000 7f918e94b700 1 -- 172.21.15.57:0/3456688699 wait complete. 2021-06-25T04:57:07.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e94b700 1 Processor -- start 2021-06-25T04:57:07.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e94b700 1 -- start start 2021-06-25T04:57:07.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e94b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880612e0 0x7f9188152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e94b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91880ad580 0x7f91880b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e94b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9188140400 0x7f91880b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e94b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91880b3070 con 0x7f9188140400 2021-06-25T04:57:07.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e94b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91880b0ec0 con 0x7f91880ad580 2021-06-25T04:57:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e94b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918809e910 con 0x7f91880612e0 2021-06-25T04:57:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e14a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9188140400 0x7f91880b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918d949700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880612e0 0x7f9188152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918d949700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880612e0 0x7f9188152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:55472/0 (socket says 172.21.15.57:55472) 2021-06-25T04:57:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918d949700 1 -- 172.21.15.57:0/4013666846 learned_addr learned my addr 172.21.15.57:0/4013666846 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:07.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918d148700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91880ad580 0x7f91880b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918d949700 1 -- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91880ad580 msgr2=0x7f91880b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918d949700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91880ad580 0x7f91880b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918d949700 1 -- 172.21.15.57:0/4013666846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9188140400 msgr2=0x7f91880b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:07.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918d949700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9188140400 0x7f91880b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918d949700 1 -- 172.21.15.57:0/4013666846 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917800b1e0 con 0x7f91880612e0 2021-06-25T04:57:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e14a700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9188140400 0x7f91880b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918d949700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880612e0 0x7f9188152e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f91880b37f0 tx=0x7f9178015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:07.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f9176ffd700 1 -- 172.21.15.57:0/4013666846 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9178006be0 con 0x7f91880612e0 2021-06-25T04:57:07.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f9176ffd700 1 -- 172.21.15.57:0/4013666846 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917800d910 con 0x7f91880612e0 2021-06-25T04:57:07.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e94b700 1 -- 172.21.15.57:0/4013666846 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91880b3be0 con 0x7f91880612e0 2021-06-25T04:57:07.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f9176ffd700 1 -- 172.21.15.57:0/4013666846 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9178011de0 con 0x7f91880612e0 2021-06-25T04:57:07.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.847+0000 7f918e94b700 1 -- 172.21.15.57:0/4013666846 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91880b2380 con 0x7f91880612e0 2021-06-25T04:57:07.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.851+0000 7f918e94b700 1 -- 172.21.15.57:0/4013666846 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91880b0ac0 con 0x7f91880612e0 2021-06-25T04:57:07.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.851+0000 7f9176ffd700 1 -- 172.21.15.57:0/4013666846 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f917800f070 con 0x7f91880612e0 2021-06-25T04:57:07.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.851+0000 7f9176ffd700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9168055340 0x7f9168057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:07.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.851+0000 7f9176ffd700 1 -- 172.21.15.57:0/4013666846 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f917806f7f0 con 0x7f91880612e0 2021-06-25T04:57:07.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.851+0000 7f918d148700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9168055340 0x7f9168057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:07.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.851+0000 7f918d148700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9168055340 0x7f9168057800 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f918400b000 tx=0x7f9184006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:07.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.863+0000 7f9176ffd700 1 -- 172.21.15.57:0/4013666846 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9178045840 con 0x7f91880612e0 2021-06-25T04:57:07.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:07.991+0000 7f918e94b700 1 -- 172.21.15.57:0/4013666846 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f91880620c0 con 0x7f91880612e0 2021-06-25T04:57:08.538 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:57:08.541 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:57:08.543 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:57:08.546 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:57:08.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.703+0000 7f9176ffd700 1 -- 172.21.15.57:0/4013666846 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v151) v1 ==== 185+0+0 (secure 0 0 0) 0x7f9178048e60 con 0x7f91880612e0 2021-06-25T04:57:08.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 -- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9168055340 msgr2=0x7f9168057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:08.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9168055340 0x7f9168057800 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f918400b000 tx=0x7f9184006df0).stop 2021-06-25T04:57:08.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 -- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880612e0 msgr2=0x7f9188152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:08.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880612e0 0x7f9188152e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f91880b37f0 tx=0x7f9178015000).stop 2021-06-25T04:57:08.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 -- 172.21.15.57:0/4013666846 shutdown_connections 2021-06-25T04:57:08.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9168055340 0x7f9168057800 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:08.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9188140400 0x7f91880b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:08.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91880ad580 0x7f91880b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:08.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 --2- 172.21.15.57:0/4013666846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91880612e0 0x7f9188152e10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:08.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 -- 172.21.15.57:0/4013666846 >> 172.21.15.57:0/4013666846 conn(0x7f9188066da0 msgr2=0x7f91880b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:08.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 -- 172.21.15.57:0/4013666846 shutdown_connections 2021-06-25T04:57:08.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.707+0000 7f918e94b700 1 -- 172.21.15.57:0/4013666846 wait complete. 2021-06-25T04:57:08.719 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:57:08.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:57:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55ab56e700 1 Processor -- start 2021-06-25T04:57:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55ab56e700 1 -- start start 2021-06-25T04:57:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55ab56e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f55a4061640 0x7f55a40b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55ab56e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f55a4143960 0x7f55a4140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55ab56e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a40b68d0 con 0x7f55a40b46d0 2021-06-25T04:57:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55ab56e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40b9640 con 0x7f55a4143960 2021-06-25T04:57:08.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55ab56e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40b6b70 con 0x7f55a4061640 2021-06-25T04:57:08.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55a9d6b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f55a40b46d0 0x7f55a413fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33304/0 (socket says 172.21.15.57:33304) 2021-06-25T04:57:08.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55a9d6b700 1 -- 172.21.15.57:0/2324741589 learned_addr learned my addr 172.21.15.57:0/2324741589 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:08.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55aad6d700 1 --2- 172.21.15.57:0/2324741589 >> v2:172.21.15.57:3300/0 conn(0x7f55a4143960 0x7f55a4140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:08.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55aa56c700 1 --2- 172.21.15.57:0/2324741589 >> v2:172.21.15.87:3300/0 conn(0x7f55a4061640 0x7f55a40b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:08.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55a956a700 1 -- 172.21.15.57:0/2324741589 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183628637 0 0) 0x7f55a40b68d0 con 0x7f55a40b46d0 2021-06-25T04:57:08.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55a956a700 1 -- 172.21.15.57:0/2324741589 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f558c003260 con 0x7f55a40b46d0 2021-06-25T04:57:08.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55aad6d700 1 -- 172.21.15.57:0/2324741589 >> v2:172.21.15.87:3300/0 conn(0x7f55a4061640 msgr2=0x7f55a40b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:08.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55aad6d700 1 --2- 172.21.15.57:0/2324741589 >> v2:172.21.15.87:3300/0 conn(0x7f55a4061640 0x7f55a40b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:08.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55aad6d700 1 -- 172.21.15.57:0/2324741589 >> v1:172.21.15.57:6789/0 conn(0x7f55a40b46d0 legacy=0x7f55a413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:08.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55aad6d700 1 -- 172.21.15.57:0/2324741589 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a40b6e10 con 0x7f55a4143960 2021-06-25T04:57:08.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55aad6d700 1 --2- 172.21.15.57:0/2324741589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55a4143960 0x7f55a4140470 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f559c0032f0 tx=0x7f559c0091d0).ready entity=mon.0 client_cookie=bf47c4c804744cdb server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:08.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55a956a700 1 -- 172.21.15.57:0/2324741589 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f559c00b600 con 0x7f55a4143960 2021-06-25T04:57:08.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55a956a700 1 -- 172.21.15.57:0/2324741589 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c00b760 con 0x7f55a4143960 2021-06-25T04:57:08.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55a956a700 1 -- 172.21.15.57:0/2324741589 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f559c00b8d0 con 0x7f55a4143960 2021-06-25T04:57:08.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55ab56e700 1 -- 172.21.15.57:0/2324741589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55a4143960 msgr2=0x7f55a4140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:08.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.839+0000 7f55ab56e700 1 --2- 172.21.15.57:0/2324741589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55a4143960 0x7f55a4140470 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f559c0032f0 tx=0x7f559c0091d0).stop 2021-06-25T04:57:08.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 -- 172.21.15.57:0/2324741589 shutdown_connections 2021-06-25T04:57:08.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 --2- 172.21.15.57:0/2324741589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55a4143960 0x7f55a4140470 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:08.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 --2- 172.21.15.57:0/2324741589 >> v2:172.21.15.87:3300/0 conn(0x7f55a4061640 0x7f55a40b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:08.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 -- 172.21.15.57:0/2324741589 >> 172.21.15.57:0/2324741589 conn(0x7f55a406adb0 msgr2=0x7f55a405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:08.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 -- 172.21.15.57:0/2324741589 shutdown_connections 2021-06-25T04:57:08.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 -- 172.21.15.57:0/2324741589 wait complete. 2021-06-25T04:57:08.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 Processor -- start 2021-06-25T04:57:08.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 -- start start 2021-06-25T04:57:08.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55a4061640 0x7f55a40b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:08.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a4143960 0x7f55a4144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:08.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a414a110 0x7f55a4149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:08.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4146ce0 con 0x7f55a4061640 2021-06-25T04:57:08.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a41499f0 con 0x7f55a414a110 2021-06-25T04:57:08.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4144680 con 0x7f55a4143960 2021-06-25T04:57:08.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55aa56c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55a4061640 0x7f55a40b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:08.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55aa56c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55a4061640 0x7f55a40b85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44322/0 (socket says 172.21.15.57:44322) 2021-06-25T04:57:08.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55aa56c700 1 -- 172.21.15.57:0/2763496551 learned_addr learned my addr 172.21.15.57:0/2763496551 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:08.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55a9d6b700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a4143960 0x7f55a4144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:08.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55aad6d700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a414a110 0x7f55a4149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:08.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55aa56c700 1 -- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a4143960 msgr2=0x7f55a4144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55aa56c700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a4143960 0x7f55a4144190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55aa56c700 1 -- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a414a110 msgr2=0x7f55a4149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55aa56c700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a414a110 0x7f55a4149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55aa56c700 1 -- 172.21.15.57:0/2763496551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c009470 con 0x7f55a4061640 2021-06-25T04:57:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55aa56c700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55a4061640 0x7f55a40b85c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f55a000c000 tx=0x7f55a0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55937fe700 1 -- 172.21.15.57:0/2763496551 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a0010780 con 0x7f55a4061640 2021-06-25T04:57:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55937fe700 1 -- 172.21.15.57:0/2763496551 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a00108e0 con 0x7f55a4061640 2021-06-25T04:57:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 -- 172.21.15.57:0/2763496551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a4149c50 con 0x7f55a4061640 2021-06-25T04:57:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55937fe700 1 -- 172.21.15.57:0/2763496551 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55a0010c40 con 0x7f55a4061640 2021-06-25T04:57:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.843+0000 7f55ab56e700 1 -- 172.21.15.57:0/2763496551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a4148bf0 con 0x7f55a4061640 2021-06-25T04:57:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.847+0000 7f55ab56e700 1 -- 172.21.15.57:0/2763496551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a4148db0 con 0x7f55a4061640 2021-06-25T04:57:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.847+0000 7f55937fe700 1 -- 172.21.15.57:0/2763496551 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f55a001c460 con 0x7f55a4061640 2021-06-25T04:57:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.847+0000 7f55937fe700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5584055450 0x7f5584057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.847+0000 7f55937fe700 1 -- 172.21.15.57:0/2763496551 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f55a006e0e0 con 0x7f55a4061640 2021-06-25T04:57:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.847+0000 7f55a9d6b700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5584055450 0x7f5584057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:08.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.851+0000 7f55a9d6b700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5584055450 0x7f5584057910 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f559400d000 tx=0x7f5594009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:08.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.855+0000 7f55937fe700 1 -- 172.21.15.57:0/2763496551 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f55a0044390 con 0x7f55a4061640 2021-06-25T04:57:08.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:08.975+0000 7f55ab56e700 1 -- 172.21.15.57:0/2763496551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f55a4057310 con 0x7f55a4061640 2021-06-25T04:57:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55937fe700 1 -- 172.21.15.57:0/2763496551 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v152) v1 ==== 173+0+0 (secure 0 0 0) 0x7f55a00479b0 con 0x7f55a4061640 2021-06-25T04:57:09.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 -- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5584055450 msgr2=0x7f5584057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:09.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5584055450 0x7f5584057910 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f559400d000 tx=0x7f5594009040).stop 2021-06-25T04:57:09.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 -- 172.21.15.57:0/2763496551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55a4061640 msgr2=0x7f55a40b85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:09.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55a4061640 0x7f55a40b85c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f55a000c000 tx=0x7f55a0006df0).stop 2021-06-25T04:57:09.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 -- 172.21.15.57:0/2763496551 shutdown_connections 2021-06-25T04:57:09.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5584055450 0x7f5584057910 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a414a110 0x7f55a4149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a4143960 0x7f55a4144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 --2- 172.21.15.57:0/2763496551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55a4061640 0x7f55a40b85c0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 -- 172.21.15.57:0/2763496551 >> 172.21.15.57:0/2763496551 conn(0x7f55a406adb0 msgr2=0x7f55a4142040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 -- 172.21.15.57:0/2763496551 shutdown_connections 2021-06-25T04:57:09.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.715+0000 7f55ab56e700 1 -- 172.21.15.57:0/2763496551 wait complete. 2021-06-25T04:57:09.725 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:57:09.737 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-06-25T04:57:09.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.839+0000 7fb5fc338700 1 Processor -- start 2021-06-25T04:57:09.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.839+0000 7fb5fc338700 1 -- start start 2021-06-25T04:57:09.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fc338700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb5f40aca10 0x7fb5f40a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:09.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fc338700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 0x7fb5f40b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:09.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fc338700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f4139b80 con 0x7fb5f40a9590 2021-06-25T04:57:09.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fc338700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f41404c0 con 0x7fb5f40aca10 2021-06-25T04:57:09.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fc338700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f40b00f0 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fa8d5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 0x7fb5f40b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:09.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fa0d4700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb5f40a9590 0x7fb5f40a89e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:34064/0 (socket says 172.21.15.57:34064) 2021-06-25T04:57:09.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fa0d4700 1 -- 172.21.15.57:0/1701961997 learned_addr learned my addr 172.21.15.57:0/1701961997 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:09.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5f98d3700 1 --2- 172.21.15.57:0/1701961997 >> v2:172.21.15.87:3300/0 conn(0x7fb5f40aca10 0x7fb5f40a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:09.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5f90d2700 1 -- 172.21.15.57:0/1701961997 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425084568 0 0) 0x7fb5f4139b80 con 0x7fb5f40a9590 2021-06-25T04:57:09.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5f90d2700 1 -- 172.21.15.57:0/1701961997 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5e0003260 con 0x7fb5f40a9590 2021-06-25T04:57:09.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fa8d5700 1 -- 172.21.15.57:0/1701961997 >> v2:172.21.15.87:3300/0 conn(0x7fb5f40aca10 msgr2=0x7fb5f40a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:09.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fa8d5700 1 --2- 172.21.15.57:0/1701961997 >> v2:172.21.15.87:3300/0 conn(0x7fb5f40aca10 0x7fb5f40a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:09.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fa8d5700 1 -- 172.21.15.57:0/1701961997 >> v1:172.21.15.87:6789/0 conn(0x7fb5f40a9590 legacy=0x7fb5f40a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:09.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fa8d5700 1 -- 172.21.15.57:0/1701961997 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f40b0390 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fa8d5700 1 --2- 172.21.15.57:0/1701961997 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 0x7fb5f40b0830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fb5ec002f70 tx=0x7fb5ec006df0).ready entity=mon.2 client_cookie=451ea30e284c998b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:09.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5f90d2700 1 -- 172.21.15.57:0/1701961997 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5ec00d4a0 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5f90d2700 1 -- 172.21.15.57:0/1701961997 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec000e90 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5f90d2700 1 -- 172.21.15.57:0/1701961997 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5ec00d7f0 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fc338700 1 -- 172.21.15.57:0/1701961997 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 msgr2=0x7fb5f40b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fc338700 1 --2- 172.21.15.57:0/1701961997 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 0x7fb5f40b0830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fb5ec002f70 tx=0x7fb5ec006df0).stop 2021-06-25T04:57:09.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fc338700 1 -- 172.21.15.57:0/1701961997 shutdown_connections 2021-06-25T04:57:09.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fc338700 1 --2- 172.21.15.57:0/1701961997 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 0x7fb5f40b0830 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:09.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fc338700 1 --2- 172.21.15.57:0/1701961997 >> v2:172.21.15.87:3300/0 conn(0x7fb5f40aca10 0x7fb5f40a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:09.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.843+0000 7fb5fc338700 1 -- 172.21.15.57:0/1701961997 >> 172.21.15.57:0/1701961997 conn(0x7fb5f405f670 msgr2=0x7fb5f405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fc338700 1 -- 172.21.15.57:0/1701961997 shutdown_connections 2021-06-25T04:57:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fc338700 1 -- 172.21.15.57:0/1701961997 wait complete. 2021-06-25T04:57:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fc338700 1 Processor -- start 2021-06-25T04:57:09.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fc338700 1 -- start start 2021-06-25T04:57:09.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fc338700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f40a9590 0x7fb5f41421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:09.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fc338700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5f40aca10 0x7fb5f4153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:09.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fc338700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 0x7fb5f41539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:09.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fc338700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f40a9bd0 con 0x7fb5f40aca10 2021-06-25T04:57:09.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fc338700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f413ca00 con 0x7fb5f40a9590 2021-06-25T04:57:09.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fc338700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f413c020 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5f98d3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5f40aca10 0x7fb5f4153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:09.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fa0d4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f40a9590 0x7fb5f41421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:09.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fa8d5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 0x7fb5f41539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:09.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5f98d3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5f40aca10 0x7fb5f4153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44338/0 (socket says 172.21.15.57:44338) 2021-06-25T04:57:09.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fa0d4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f40a9590 0x7fb5f41421a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:52830/0 (socket says 172.21.15.57:52830) 2021-06-25T04:57:09.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5f98d3700 1 -- 172.21.15.57:0/3603988002 learned_addr learned my addr 172.21.15.57:0/3603988002 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:09.865 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fa8d5700 1 -- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f40a9590 msgr2=0x7fb5f41421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:09.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fa8d5700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f40a9590 0x7fb5f41421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:09.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fa8d5700 1 -- 172.21.15.57:0/3603988002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5f40aca10 msgr2=0x7fb5f4153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:09.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fa8d5700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5f40aca10 0x7fb5f4153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:09.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fa8d5700 1 -- 172.21.15.57:0/3603988002 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec00b180 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.847+0000 7fb5fa8d5700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 0x7fb5f41539f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb5f412de80 tx=0x7fb5ec014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:09.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.851+0000 7fb5f37fe700 1 -- 172.21.15.57:0/3603988002 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5ec012930 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.851+0000 7fb5f37fe700 1 -- 172.21.15.57:0/3603988002 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec012a90 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.851+0000 7fb5f37fe700 1 -- 172.21.15.57:0/3603988002 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5ec012df0 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.851+0000 7fb5fc338700 1 -- 172.21.15.57:0/3603988002 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f413c2c0 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.851+0000 7fb5fc338700 1 -- 172.21.15.57:0/3603988002 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f40aa600 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.851+0000 7fb5fc338700 1 -- 172.21.15.57:0/3603988002 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f40aaba0 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.851+0000 7fb5f37fe700 1 -- 172.21.15.57:0/3603988002 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb5ec025020 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.851+0000 7fb5f37fe700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5d4055340 0x7fb5d4057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:09.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.851+0000 7fb5f37fe700 1 -- 172.21.15.57:0/3603988002 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb5ec06eb40 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.851+0000 7fb5fa0d4700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5d4055340 0x7fb5d4057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:09.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.855+0000 7fb5fa0d4700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5d4055340 0x7fb5d4057800 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fb5e400d000 tx=0x7fb5e4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:09.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.859+0000 7fb5f37fe700 1 -- 172.21.15.57:0/3603988002 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb5ec044ec0 con 0x7fb5f40b2bc0 2021-06-25T04:57:09.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:09.991+0000 7fb5fc338700 1 -- 172.21.15.57:0/3603988002 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb5f4057310 con 0x7fb5f40b2bc0 2021-06-25T04:57:10.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5f37fe700 1 -- 172.21.15.57:0/3603988002 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb5ec06ee60 con 0x7fb5f40b2bc0 2021-06-25T04:57:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 -- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5d4055340 msgr2=0x7fb5d4057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5d4055340 0x7fb5d4057800 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fb5e400d000 tx=0x7fb5e4009040).stop 2021-06-25T04:57:10.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 -- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 msgr2=0x7fb5f41539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 0x7fb5f41539f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb5f412de80 tx=0x7fb5ec014000).stop 2021-06-25T04:57:10.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 -- 172.21.15.57:0/3603988002 shutdown_connections 2021-06-25T04:57:10.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb5d4055340 0x7fb5d4057800 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f40b2bc0 0x7fb5f41539f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5f40aca10 0x7fb5f4153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 --2- 172.21.15.57:0/3603988002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f40a9590 0x7fb5f41421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 -- 172.21.15.57:0/3603988002 >> 172.21.15.57:0/3603988002 conn(0x7fb5f405f670 msgr2=0x7fb5f4138a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 -- 172.21.15.57:0/3603988002 shutdown_connections 2021-06-25T04:57:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.003+0000 7fb5fc338700 1 -- 172.21.15.57:0/3603988002 wait complete. 2021-06-25T04:57:10.022 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-06-25T04:57:10.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.119+0000 7fb231d8f700 1 Processor -- start 2021-06-25T04:57:10.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.119+0000 7fb231d8f700 1 -- start start 2021-06-25T04:57:10.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb22c0665b0 0x7fb22c066990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:10.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb22c0b19f0 0x7fb22c05fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:10.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c05f710 con 0x7fb22c140c70 2021-06-25T04:57:10.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22c0b1460 con 0x7fb22c0b19f0 2021-06-25T04:57:10.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c05f940 con 0x7fb22c0665b0 2021-06-25T04:57:10.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb22bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb22c0b19f0 0x7fb22c05fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:10.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb22bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb22c0b19f0 0x7fb22c05fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44344/0 (socket says 172.21.15.57:44344) 2021-06-25T04:57:10.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb22bfff700 1 -- 172.21.15.57:0/2536678444 learned_addr learned my addr 172.21.15.57:0/2536678444 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:10.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb230d8d700 1 --2- 172.21.15.57:0/2536678444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb22c0665b0 0x7fb22c066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:10.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb22bfff700 1 -- 172.21.15.57:0/2536678444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb22c0665b0 msgr2=0x7fb22c066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:10.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb22bfff700 1 --2- 172.21.15.57:0/2536678444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb22c0665b0 0x7fb22c066990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb22bfff700 1 -- 172.21.15.57:0/2536678444 >> v1:172.21.15.87:6789/0 conn(0x7fb22c140c70 legacy=0x7fb22c13e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb22bfff700 1 -- 172.21.15.57:0/2536678444 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c0602d0 con 0x7fb22c0b19f0 2021-06-25T04:57:10.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb22bfff700 1 --2- 172.21.15.57:0/2536678444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c0b19f0 0x7fb22c05fde0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7fb218002f70 tx=0x7fb218006eb0).ready entity=mon.0 client_cookie=6f3cda364b42b19a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:10.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb22b7fe700 1 -- 172.21.15.57:0/2536678444 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21800d5c0 con 0x7fb22c0b19f0 2021-06-25T04:57:10.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb22b7fe700 1 -- 172.21.15.57:0/2536678444 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218000e90 con 0x7fb22c0b19f0 2021-06-25T04:57:10.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb22b7fe700 1 -- 172.21.15.57:0/2536678444 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21800d950 con 0x7fb22c0b19f0 2021-06-25T04:57:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 -- 172.21.15.57:0/2536678444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c0b19f0 msgr2=0x7fb22c05fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 --2- 172.21.15.57:0/2536678444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c0b19f0 0x7fb22c05fde0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7fb218002f70 tx=0x7fb218006eb0).stop 2021-06-25T04:57:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 -- 172.21.15.57:0/2536678444 shutdown_connections 2021-06-25T04:57:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 --2- 172.21.15.57:0/2536678444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c0b19f0 0x7fb22c05fde0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 --2- 172.21.15.57:0/2536678444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb22c0665b0 0x7fb22c066990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 -- 172.21.15.57:0/2536678444 >> 172.21.15.57:0/2536678444 conn(0x7fb22c0636a0 msgr2=0x7fb22c063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 -- 172.21.15.57:0/2536678444 shutdown_connections 2021-06-25T04:57:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.123+0000 7fb231d8f700 1 -- 172.21.15.57:0/2536678444 wait complete. 2021-06-25T04:57:10.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb231d8f700 1 Processor -- start 2021-06-25T04:57:10.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb231d8f700 1 -- start start 2021-06-25T04:57:10.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb231d8f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb22c0665b0 0x7fb22c153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:10.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb231d8f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb22c0b19f0 0x7fb22c0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:10.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb231d8f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c140c70 0x7fb22c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:10.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb231d8f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c144b60 con 0x7fb22c140c70 2021-06-25T04:57:10.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb231d8f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c153470 con 0x7fb22c0665b0 2021-06-25T04:57:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb231d8f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c153710 con 0x7fb22c0b19f0 2021-06-25T04:57:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb23158e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c140c70 0x7fb22c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb230d8d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb22c0665b0 0x7fb22c153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb23158e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c140c70 0x7fb22c14fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44352/0 (socket says 172.21.15.57:44352) 2021-06-25T04:57:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb23158e700 1 -- 172.21.15.57:0/966761969 learned_addr learned my addr 172.21.15.57:0/966761969 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb22bfff700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb22c0b19f0 0x7fb22c0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb23158e700 1 -- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb22c0b19f0 msgr2=0x7fb22c0b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb23158e700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb22c0b19f0 0x7fb22c0b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb23158e700 1 -- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb22c0665b0 msgr2=0x7fb22c153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb23158e700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb22c0665b0 0x7fb22c153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb23158e700 1 -- 172.21.15.57:0/966761969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21800b1e0 con 0x7fb22c140c70 2021-06-25T04:57:10.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb23158e700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c140c70 0x7fb22c14fe00 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fb22c05fcc0 tx=0x7fb2240013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:10.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb229ffb700 1 -- 172.21.15.57:0/966761969 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb224006aa0 con 0x7fb22c140c70 2021-06-25T04:57:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb229ffb700 1 -- 172.21.15.57:0/966761969 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb224006c00 con 0x7fb22c140c70 2021-06-25T04:57:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb231d8f700 1 -- 172.21.15.57:0/966761969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c1539b0 con 0x7fb22c140c70 2021-06-25T04:57:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb229ffb700 1 -- 172.21.15.57:0/966761969 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb224007030 con 0x7fb22c140c70 2021-06-25T04:57:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.127+0000 7fb231d8f700 1 -- 172.21.15.57:0/966761969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c144850 con 0x7fb22c140c70 2021-06-25T04:57:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.131+0000 7fb231d8f700 1 -- 172.21.15.57:0/966761969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c0aa520 con 0x7fb22c140c70 2021-06-25T04:57:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.131+0000 7fb229ffb700 1 -- 172.21.15.57:0/966761969 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb224010030 con 0x7fb22c140c70 2021-06-25T04:57:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.131+0000 7fb229ffb700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2140554e0 0x7fb2140579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.131+0000 7fb229ffb700 1 -- 172.21.15.57:0/966761969 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb22406d9b0 con 0x7fb22c140c70 2021-06-25T04:57:10.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.131+0000 7fb230d8d700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2140554e0 0x7fb2140579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:10.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.131+0000 7fb230d8d700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2140554e0 0x7fb2140579a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fb22000c000 tx=0x7fb220008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.139+0000 7fb229ffb700 1 -- 172.21.15.57:0/966761969 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb224043e40 con 0x7fb22c140c70 2021-06-25T04:57:10.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.311+0000 7fb231d8f700 1 -- 172.21.15.57:0/966761969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7fb22c153b40 con 0x7fb22c140c70 2021-06-25T04:57:10.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.719+0000 7fb229ffb700 1 -- 172.21.15.57:0/966761969 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v447) v1 ==== 127+0+0 (secure 0 0 0) 0x7fb224047460 con 0x7fb22c140c70 2021-06-25T04:57:10.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 -- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2140554e0 msgr2=0x7fb2140579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2140554e0 0x7fb2140579a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fb22000c000 tx=0x7fb220008040).stop 2021-06-25T04:57:10.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 -- 172.21.15.57:0/966761969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c140c70 msgr2=0x7fb22c14fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c140c70 0x7fb22c14fe00 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fb22c05fcc0 tx=0x7fb2240013a0).stop 2021-06-25T04:57:10.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 -- 172.21.15.57:0/966761969 shutdown_connections 2021-06-25T04:57:10.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb2140554e0 0x7fb2140579a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c140c70 0x7fb22c14fe00 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb22c0b19f0 0x7fb22c0b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 --2- 172.21.15.57:0/966761969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb22c0665b0 0x7fb22c153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 -- 172.21.15.57:0/966761969 >> 172.21.15.57:0/966761969 conn(0x7fb22c0636a0 msgr2=0x7fb22c13eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:10.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 -- 172.21.15.57:0/966761969 shutdown_connections 2021-06-25T04:57:10.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.723+0000 7fb231d8f700 1 -- 172.21.15.57:0/966761969 wait complete. 2021-06-25T04:57:10.743 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2021-06-25T04:57:10.743 INFO:tasks.cephfs_test_runner:Starting test: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-06-25T04:57:10.744 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs' 2021-06-25T04:57:10.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefe6910700 1 Processor -- start 2021-06-25T04:57:10.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefe6910700 1 -- start start 2021-06-25T04:57:10.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefe6910700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fefe00a9f00 0x7fefe0143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:10.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefe6910700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe00b3840 con 0x7fefe00af740 2021-06-25T04:57:10.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefe6910700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe0146970 con 0x7fefe00b3460 2021-06-25T04:57:10.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefe6910700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe0144220 con 0x7fefe00a9f00 2021-06-25T04:57:10.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefdf7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fefe00af740 0x7fefe01400d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33346/0 (socket says 172.21.15.57:33346) 2021-06-25T04:57:10.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefdf7fe700 1 -- 172.21.15.57:0/3099549310 learned_addr learned my addr 172.21.15.57:0/3099549310 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:10.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefe4ead700 1 --2- 172.21.15.57:0/3099549310 >> v2:172.21.15.87:3300/0 conn(0x7fefe00a9f00 0x7fefe0143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefdeffd700 1 -- 172.21.15.57:0/3099549310 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506857772 0 0) 0x7fefe00b3840 con 0x7fefe00af740 2021-06-25T04:57:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefdeffd700 1 -- 172.21.15.57:0/3099549310 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefc0003260 con 0x7fefe00af740 2021-06-25T04:57:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefe4ead700 1 -- 172.21.15.57:0/3099549310 >> v1:172.21.15.87:6789/0 conn(0x7fefe00b3460 legacy=0x7fefe00af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefdeffd700 1 -- 172.21.15.57:0/3099549310 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1571447867 0 0) 0x7fefc0003260 con 0x7fefe00af740 2021-06-25T04:57:10.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.851+0000 7fefe4ead700 1 -- 172.21.15.57:0/3099549310 >> v1:172.21.15.57:6789/0 conn(0x7fefe00af740 legacy=0x7fefe01400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefe4ead700 1 -- 172.21.15.57:0/3099549310 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0146c10 con 0x7fefe00a9f00 2021-06-25T04:57:10.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefe4ead700 1 --2- 172.21.15.57:0/3099549310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00a9f00 0x7fefe0143d30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fefc8001820 tx=0x7fefd0006df0).ready entity=mon.1 client_cookie=edd174bfed4dc594 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:10.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefdeffd700 1 -- 172.21.15.57:0/3099549310 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc8001680 con 0x7fefe00a9f00 2021-06-25T04:57:10.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefdeffd700 1 -- 172.21.15.57:0/3099549310 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd0000e90 con 0x7fefe00a9f00 2021-06-25T04:57:10.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefdeffd700 1 -- 172.21.15.57:0/3099549310 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd000d4f0 con 0x7fefe00a9f00 2021-06-25T04:57:10.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefe6910700 1 -- 172.21.15.57:0/3099549310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00a9f00 msgr2=0x7fefe0143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefe6910700 1 --2- 172.21.15.57:0/3099549310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00a9f00 0x7fefe0143d30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fefc8001820 tx=0x7fefd0006df0).stop 2021-06-25T04:57:10.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefe6910700 1 -- 172.21.15.57:0/3099549310 shutdown_connections 2021-06-25T04:57:10.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefe6910700 1 --2- 172.21.15.57:0/3099549310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00a9f00 0x7fefe0143d30 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefe6910700 1 -- 172.21.15.57:0/3099549310 >> 172.21.15.57:0/3099549310 conn(0x7fefe0060780 msgr2=0x7fefe0060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:10.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefe6910700 1 -- 172.21.15.57:0/3099549310 shutdown_connections 2021-06-25T04:57:10.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefe6910700 1 -- 172.21.15.57:0/3099549310 wait complete. 2021-06-25T04:57:10.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefe6910700 1 Processor -- start 2021-06-25T04:57:10.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.855+0000 7fefe6910700 1 -- start start 2021-06-25T04:57:10.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefe6910700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe00a9f00 0x7fefe0145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:10.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefe6910700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00af740 0x7fefe0137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:10.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefe6910700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fefe00b3460 0x7fefe0138350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:10.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefe6910700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00b1410 con 0x7fefe00a9f00 2021-06-25T04:57:10.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefe6910700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe0144b30 con 0x7fefe00af740 2021-06-25T04:57:10.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefe6910700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe0144dd0 con 0x7fefe00b3460 2021-06-25T04:57:10.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe00a9f00 0x7fefe0145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:10.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe00a9f00 0x7fefe0145b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44364/0 (socket says 172.21.15.57:44364) 2021-06-25T04:57:10.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdffff700 1 -- 172.21.15.57:0/3971464772 learned_addr learned my addr 172.21.15.57:0/3971464772 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:10.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefe4ead700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fefe00b3460 0x7fefe0138350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:10.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdf7fe700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00af740 0x7fefe0137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:10.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdffff700 1 -- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fefe00b3460 msgr2=0x7fefe0138350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdffff700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fefe00b3460 0x7fefe0138350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdffff700 1 -- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00af740 msgr2=0x7fefe0137e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:10.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdffff700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00af740 0x7fefe0137e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:10.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdffff700 1 -- 172.21.15.57:0/3971464772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd000b180 con 0x7fefe00a9f00 2021-06-25T04:57:10.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdf7fe700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00af740 0x7fefe0137e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:10.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdffff700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe00a9f00 0x7fefe0145b70 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fefe00ad9f0 tx=0x7fefd8001400).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:10.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdd7fa700 1 -- 172.21.15.57:0/3971464772 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd800e4a0 con 0x7fefe00a9f00 2021-06-25T04:57:10.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdd7fa700 1 -- 172.21.15.57:0/3971464772 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd800e600 con 0x7fefe00a9f00 2021-06-25T04:57:10.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefe6910700 1 -- 172.21.15.57:0/3971464772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe0145070 con 0x7fefe00a9f00 2021-06-25T04:57:10.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefdd7fa700 1 -- 172.21.15.57:0/3971464772 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd800e960 con 0x7fefe00a9f00 2021-06-25T04:57:10.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefe6910700 1 -- 172.21.15.57:0/3971464772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe00b2820 con 0x7fefe00a9f00 2021-06-25T04:57:10.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.859+0000 7fefe6910700 1 -- 172.21.15.57:0/3971464772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe00b2ef0 con 0x7fefe00a9f00 2021-06-25T04:57:10.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.863+0000 7fefdd7fa700 1 -- 172.21.15.57:0/3971464772 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fefd8019030 con 0x7fefe00a9f00 2021-06-25T04:57:10.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.863+0000 7fefdd7fa700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fefc40553d0 0x7fefc4057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:10.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.863+0000 7fefdd7fa700 1 -- 172.21.15.57:0/3971464772 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fefd806d560 con 0x7fefe00a9f00 2021-06-25T04:57:10.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.863+0000 7fefdf7fe700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fefc40553d0 0x7fefc4057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:10.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.863+0000 7fefdf7fe700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fefc40553d0 0x7fefc4057890 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fefc800b000 tx=0x7fefc8000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:10.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:10.867+0000 7fefdd7fa700 1 -- 172.21.15.57:0/3971464772 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fefd8043860 con 0x7fefe00a9f00 2021-06-25T04:57:11.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.039+0000 7fefe6910700 1 -- 172.21.15.57:0/3971464772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]} v 0) v1 -- 0x7fefe0057310 con 0x7fefe00a9f00 2021-06-25T04:57:11.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.723+0000 7fefdd7fa700 1 -- 172.21.15.57:0/3971464772 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]}]=0 v448) v1 ==== 139+0+0 (secure 0 0 0) 0x7fefd8046e80 con 0x7fefe00a9f00 2021-06-25T04:57:11.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 -- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fefc40553d0 msgr2=0x7fefc4057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:11.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fefc40553d0 0x7fefc4057890 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fefc800b000 tx=0x7fefc8000bc0).stop 2021-06-25T04:57:11.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 -- 172.21.15.57:0/3971464772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe00a9f00 msgr2=0x7fefe0145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:11.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe00a9f00 0x7fefe0145b70 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fefe00ad9f0 tx=0x7fefd8001400).stop 2021-06-25T04:57:11.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 -- 172.21.15.57:0/3971464772 shutdown_connections 2021-06-25T04:57:11.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fefc40553d0 0x7fefc4057890 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:11.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fefe00b3460 0x7fefe0138350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:11.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00af740 0x7fefe0137e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:11.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 --2- 172.21.15.57:0/3971464772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefe00a9f00 0x7fefe0145b70 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:11.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 -- 172.21.15.57:0/3971464772 >> 172.21.15.57:0/3971464772 conn(0x7fefe0060780 msgr2=0x7fefe00ade50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:11.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 -- 172.21.15.57:0/3971464772 shutdown_connections 2021-06-25T04:57:11.735 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.727+0000 7fefe6910700 1 -- 172.21.15.57:0/3971464772 wait complete. 2021-06-25T04:57:11.751 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-06-25T04:57:11.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71f5338700 1 Processor -- start 2021-06-25T04:57:11.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71f5338700 1 -- start start 2021-06-25T04:57:11.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71f5338700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f005fbc0 0x7f71f00b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:11.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71f5338700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f71f00b6520 0x7f71f00b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:11.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71f5338700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f0143f20 con 0x7f71f00b5950 2021-06-25T04:57:11.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71f5338700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f005ffa0 con 0x7f71f00b6520 2021-06-25T04:57:11.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71f5338700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0143a10 con 0x7f71f005fbc0 2021-06-25T04:57:11.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71ef7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f71f00b5950 0x7f71f00b49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33362/0 (socket says 172.21.15.57:33362) 2021-06-25T04:57:11.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71ef7fe700 1 -- 172.21.15.57:0/3097437306 learned_addr learned my addr 172.21.15.57:0/3097437306 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:11.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71ee7fc700 1 --2- 172.21.15.57:0/3097437306 >> v2:172.21.15.87:3300/0 conn(0x7f71f00b6520 0x7f71f00b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:11.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71eeffd700 1 --2- 172.21.15.57:0/3097437306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f005fbc0 0x7f71f00b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:11.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71edffb700 1 -- 172.21.15.57:0/3097437306 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568361592 0 0) 0x7f71f0143f20 con 0x7f71f00b5950 2021-06-25T04:57:11.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71edffb700 1 -- 172.21.15.57:0/3097437306 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d0003260 con 0x7f71f00b5950 2021-06-25T04:57:11.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71edffb700 1 -- 172.21.15.57:0/3097437306 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830341480 0 0) 0x7f71d0003260 con 0x7f71f00b5950 2021-06-25T04:57:11.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71ee7fc700 1 -- 172.21.15.57:0/3097437306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f005fbc0 msgr2=0x7f71f00b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:11.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71ee7fc700 1 --2- 172.21.15.57:0/3097437306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f005fbc0 0x7f71f00b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:11.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71ee7fc700 1 -- 172.21.15.57:0/3097437306 >> v1:172.21.15.57:6789/0 conn(0x7f71f00b5950 legacy=0x7f71f00b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71ee7fc700 1 -- 172.21.15.57:0/3097437306 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0143c80 con 0x7f71f00b6520 2021-06-25T04:57:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.863+0000 7f71ee7fc700 1 --2- 172.21.15.57:0/3097437306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f00b6520 0x7f71f00b9f60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f71e8001b80 tx=0x7f71d8006df0).ready entity=mon.1 client_cookie=84a851c97a84145d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71edffb700 1 -- 172.21.15.57:0/3097437306 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e80019e0 con 0x7f71f00b6520 2021-06-25T04:57:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71edffb700 1 -- 172.21.15.57:0/3097437306 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d8000e90 con 0x7f71f00b6520 2021-06-25T04:57:11.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71edffb700 1 -- 172.21.15.57:0/3097437306 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d8012460 con 0x7f71f00b6520 2021-06-25T04:57:11.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71f5338700 1 -- 172.21.15.57:0/3097437306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f00b6520 msgr2=0x7f71f00b9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:11.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71f5338700 1 --2- 172.21.15.57:0/3097437306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f00b6520 0x7f71f00b9f60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f71e8001b80 tx=0x7f71d8006df0).stop 2021-06-25T04:57:11.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71f5338700 1 -- 172.21.15.57:0/3097437306 shutdown_connections 2021-06-25T04:57:11.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71f5338700 1 --2- 172.21.15.57:0/3097437306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f00b6520 0x7f71f00b9f60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:11.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71f5338700 1 --2- 172.21.15.57:0/3097437306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f005fbc0 0x7f71f00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:11.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71f5338700 1 -- 172.21.15.57:0/3097437306 >> 172.21.15.57:0/3097437306 conn(0x7f71f0062360 msgr2=0x7f71f0066da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:11.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71f5338700 1 -- 172.21.15.57:0/3097437306 shutdown_connections 2021-06-25T04:57:11.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71f5338700 1 -- 172.21.15.57:0/3097437306 wait complete. 2021-06-25T04:57:11.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71f5338700 1 Processor -- start 2021-06-25T04:57:11.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.867+0000 7f71f5338700 1 -- start start 2021-06-25T04:57:11.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71f5338700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f005fbc0 0x7f71f00b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:11.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71f5338700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71f00b5950 0x7f71f00ad720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:11.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71f5338700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f00b6520 0x7f71f01559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:11.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71f5338700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0145f80 con 0x7f71f00b5950 2021-06-25T04:57:11.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71f5338700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f01443d0 con 0x7f71f005fbc0 2021-06-25T04:57:11.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71f5338700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0144600 con 0x7f71f00b6520 2021-06-25T04:57:11.881 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71ee7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71f00b5950 0x7f71f00ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:11.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71ee7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71f00b5950 0x7f71f00ad720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44380/0 (socket says 172.21.15.57:44380) 2021-06-25T04:57:11.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71ee7fc700 1 -- 172.21.15.57:0/2104296711 learned_addr learned my addr 172.21.15.57:0/2104296711 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:11.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71ef7fe700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f00b6520 0x7f71f01559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:11.882 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71eeffd700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f005fbc0 0x7f71f00b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:11.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71ee7fc700 1 -- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f00b6520 msgr2=0x7f71f01559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:11.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71ee7fc700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f00b6520 0x7f71f01559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:11.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71ee7fc700 1 -- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f005fbc0 msgr2=0x7f71f00b89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:11.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71ee7fc700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f005fbc0 0x7f71f00b89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:11.883 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71ee7fc700 1 -- 172.21.15.57:0/2104296711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d800b180 con 0x7f71f00b5950 2021-06-25T04:57:11.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71ee7fc700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71f00b5950 0x7f71f00ad720 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f71e8001b80 tx=0x7f71d8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:11.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71e7fff700 1 -- 172.21.15.57:0/2104296711 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d800d8a0 con 0x7f71f00b5950 2021-06-25T04:57:11.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71e7fff700 1 -- 172.21.15.57:0/2104296711 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d800da00 con 0x7f71f00b5950 2021-06-25T04:57:11.884 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71f5338700 1 -- 172.21.15.57:0/2104296711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f00b3260 con 0x7f71f00b5950 2021-06-25T04:57:11.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71e7fff700 1 -- 172.21.15.57:0/2104296711 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d800dd60 con 0x7f71f00b5950 2021-06-25T04:57:11.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71f5338700 1 -- 172.21.15.57:0/2104296711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f0148da0 con 0x7f71f00b5950 2021-06-25T04:57:11.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.871+0000 7f71e7fff700 1 -- 172.21.15.57:0/2104296711 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f71d8025020 con 0x7f71f00b5950 2021-06-25T04:57:11.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.875+0000 7f71f5338700 1 -- 172.21.15.57:0/2104296711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f0057310 con 0x7f71f00b5950 2021-06-25T04:57:11.885 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.875+0000 7f71e7fff700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71d40553d0 0x7f71d4057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:11.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.875+0000 7f71e7fff700 1 -- 172.21.15.57:0/2104296711 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f71d806ead0 con 0x7f71f00b5950 2021-06-25T04:57:11.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.875+0000 7f71eeffd700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71d40553d0 0x7f71d4057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:11.886 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.875+0000 7f71eeffd700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71d40553d0 0x7f71d4057890 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f71e000b000 tx=0x7f71e0008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:11.887 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:11.879+0000 7f71e7fff700 1 -- 172.21.15.57:0/2104296711 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f71d8044f60 con 0x7f71f00b5950 2021-06-25T04:57:12.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.011+0000 7f71f5338700 1 -- 172.21.15.57:0/2104296711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f71f00698a0 con 0x7f71f00b5950 2021-06-25T04:57:12.022 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71e7fff700 1 -- 172.21.15.57:0/2104296711 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f71d8048580 con 0x7f71f00b5950 2021-06-25T04:57:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 -- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71d40553d0 msgr2=0x7f71d4057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71d40553d0 0x7f71d4057890 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f71e000b000 tx=0x7f71e0008040).stop 2021-06-25T04:57:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 -- 172.21.15.57:0/2104296711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71f00b5950 msgr2=0x7f71f00ad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71f00b5950 0x7f71f00ad720 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f71e8001b80 tx=0x7f71d8014000).stop 2021-06-25T04:57:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 -- 172.21.15.57:0/2104296711 shutdown_connections 2021-06-25T04:57:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f71d40553d0 0x7f71d4057890 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f00b6520 0x7f71f01559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71f00b5950 0x7f71f00ad720 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 --2- 172.21.15.57:0/2104296711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f005fbc0 0x7f71f00b89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 -- 172.21.15.57:0/2104296711 >> 172.21.15.57:0/2104296711 conn(0x7f71f0062360 msgr2=0x7f71f00b76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:12.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 -- 172.21.15.57:0/2104296711 shutdown_connections 2021-06-25T04:57:12.030 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.019+0000 7f71f5338700 1 -- 172.21.15.57:0/2104296711 wait complete. 2021-06-25T04:57:12.037 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T04:57:12.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:57:12.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:57:12.073 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:57:12.092 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T04:57:12.113 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T04:57:12.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:12.114 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:12.114 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:57:12.140 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-06-25T04:57:12.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:57:12.142 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-06-25T04:57:12.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:12.143 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:12.144 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:12.151 INFO:teuthology.orchestra.run.smithi161.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-06-25T04:57:12.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T04:57:12.152 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-06-25T04:57:12.153 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:57:12.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.259+0000 7f41cbfff700 1 Processor -- start 2021-06-25T04:57:12.265 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.259+0000 7f41cbfff700 1 -- start start 2021-06-25T04:57:12.268 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41cc0b46d0 0x7f41cc13fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:12.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41cc143960 0x7f41cc140250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:12.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41cc0b68d0 con 0x7f41cc061640 2021-06-25T04:57:12.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc0b9640 con 0x7f41cc143960 2021-06-25T04:57:12.269 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc0b6b70 con 0x7f41cc0b46d0 2021-06-25T04:57:12.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41cc143960 0x7f41cc140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:12.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41caffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f41cc061640 0x7f41cc0b9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33372/0 (socket says 172.21.15.57:33372) 2021-06-25T04:57:12.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41cc143960 0x7f41cc140250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44390/0 (socket says 172.21.15.57:44390) 2021-06-25T04:57:12.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41caffd700 1 -- 172.21.15.57:0/1316336948 learned_addr learned my addr 172.21.15.57:0/1316336948 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:12.270 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41c3fff700 1 --2- 172.21.15.57:0/1316336948 >> v2:172.21.15.87:3300/0 conn(0x7f41cc0b46d0 0x7f41cc13fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:12.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cb7fe700 1 -- 172.21.15.57:0/1316336948 >> v2:172.21.15.87:3300/0 conn(0x7f41cc0b46d0 msgr2=0x7f41cc13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:12.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cb7fe700 1 --2- 172.21.15.57:0/1316336948 >> v2:172.21.15.87:3300/0 conn(0x7f41cc0b46d0 0x7f41cc13fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cb7fe700 1 -- 172.21.15.57:0/1316336948 >> v1:172.21.15.57:6789/0 conn(0x7f41cc061640 legacy=0x7f41cc0b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.271 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41ca7fc700 1 -- 172.21.15.57:0/1316336948 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211030115 0 0) 0x7f41cc0b68d0 con 0x7f41cc061640 2021-06-25T04:57:12.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cb7fe700 1 -- 172.21.15.57:0/1316336948 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc0b6e10 con 0x7f41cc143960 2021-06-25T04:57:12.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cb7fe700 1 --2- 172.21.15.57:0/1316336948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41cc143960 0x7f41cc140250 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f41c40032f0 tx=0x7f41c40091d0).ready entity=mon.0 client_cookie=1f0e41f7c5e15b32 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:12.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41ca7fc700 1 -- 172.21.15.57:0/1316336948 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c400b680 con 0x7f41cc143960 2021-06-25T04:57:12.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41ca7fc700 1 -- 172.21.15.57:0/1316336948 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c400b7e0 con 0x7f41cc143960 2021-06-25T04:57:12.272 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41ca7fc700 1 -- 172.21.15.57:0/1316336948 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c400b950 con 0x7f41cc143960 2021-06-25T04:57:12.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 -- 172.21.15.57:0/1316336948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41cc143960 msgr2=0x7f41cc140250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 --2- 172.21.15.57:0/1316336948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41cc143960 0x7f41cc140250 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f41c40032f0 tx=0x7f41c40091d0).stop 2021-06-25T04:57:12.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 -- 172.21.15.57:0/1316336948 shutdown_connections 2021-06-25T04:57:12.273 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 --2- 172.21.15.57:0/1316336948 >> v2:172.21.15.87:3300/0 conn(0x7f41cc0b46d0 0x7f41cc13fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 --2- 172.21.15.57:0/1316336948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41cc143960 0x7f41cc140250 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 -- 172.21.15.57:0/1316336948 >> 172.21.15.57:0/1316336948 conn(0x7f41cc06adb0 msgr2=0x7f41cc05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:12.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 -- 172.21.15.57:0/1316336948 shutdown_connections 2021-06-25T04:57:12.274 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.263+0000 7f41cbfff700 1 -- 172.21.15.57:0/1316336948 wait complete. 2021-06-25T04:57:12.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41cbfff700 1 Processor -- start 2021-06-25T04:57:12.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41cbfff700 1 -- start start 2021-06-25T04:57:12.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41cbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41cc061640 0x7f41cc148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:12.278 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41cbfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41cc143960 0x7f41cc1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:12.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41cbfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41cc0b72f0 0x7f41cc152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:12.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41cbfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc152050 con 0x7f41cc061640 2021-06-25T04:57:12.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41cbfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc148ea0 con 0x7f41cc0b72f0 2021-06-25T04:57:12.279 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41cbfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc144520 con 0x7f41cc143960 2021-06-25T04:57:12.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41caffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41cc061640 0x7f41cc148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:12.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41caffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41cc061640 0x7f41cc148460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44392/0 (socket says 172.21.15.57:44392) 2021-06-25T04:57:12.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41caffd700 1 -- 172.21.15.57:0/857078242 learned_addr learned my addr 172.21.15.57:0/857078242 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:12.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41c3fff700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41cc143960 0x7f41cc1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:12.280 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41cb7fe700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41cc0b72f0 0x7f41cc152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:12.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41caffd700 1 -- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41cc143960 msgr2=0x7f41cc1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41caffd700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41cc143960 0x7f41cc1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41caffd700 1 -- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41cc0b72f0 msgr2=0x7f41cc152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.281 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41caffd700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41cc0b72f0 0x7f41cc152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.267+0000 7f41caffd700 1 -- 172.21.15.57:0/857078242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c4009470 con 0x7f41cc061640 2021-06-25T04:57:12.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.271+0000 7f41caffd700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41cc061640 0x7f41cc148460 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f41bc000ed0 tx=0x7f41bc007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:12.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.271+0000 7f41c8ff9700 1 -- 172.21.15.57:0/857078242 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41bc0070d0 con 0x7f41cc061640 2021-06-25T04:57:12.282 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.271+0000 7f41c8ff9700 1 -- 172.21.15.57:0/857078242 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc007230 con 0x7f41cc061640 2021-06-25T04:57:12.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.271+0000 7f41cbfff700 1 -- 172.21.15.57:0/857078242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc0b8ea0 con 0x7f41cc061640 2021-06-25T04:57:12.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.271+0000 7f41c8ff9700 1 -- 172.21.15.57:0/857078242 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41bc005610 con 0x7f41cc061640 2021-06-25T04:57:12.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.271+0000 7f41cbfff700 1 -- 172.21.15.57:0/857078242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc0b9330 con 0x7f41cc061640 2021-06-25T04:57:12.283 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.271+0000 7f41cbfff700 1 -- 172.21.15.57:0/857078242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41cc057310 con 0x7f41cc061640 2021-06-25T04:57:12.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.271+0000 7f41c8ff9700 1 -- 172.21.15.57:0/857078242 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f41bc01a060 con 0x7f41cc061640 2021-06-25T04:57:12.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.271+0000 7f41c8ff9700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41b0055490 0x7f41b0057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:12.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.271+0000 7f41c8ff9700 1 -- 172.21.15.57:0/857078242 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f41bc06d130 con 0x7f41cc061640 2021-06-25T04:57:12.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.271+0000 7f41c3fff700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41b0055490 0x7f41b0057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:12.284 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.275+0000 7f41c3fff700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41b0055490 0x7f41b0057950 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f41b400b000 tx=0x7f41b4006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:12.285 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.279+0000 7f41c8ff9700 1 -- 172.21.15.57:0/857078242 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f41bc0434b0 con 0x7f41cc061640 2021-06-25T04:57:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.407+0000 7f41cbfff700 1 -- 172.21.15.57:0/857078242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f41cc05d990 con 0x7f41cc061640 2021-06-25T04:57:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.407+0000 7f41c8ff9700 1 -- 172.21.15.57:0/857078242 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v152) v1 ==== 81+0+29229 (secure 0 0 0) 0x7f41bc018090 con 0x7f41cc061640 2021-06-25T04:57:12.413 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:12.413 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:57:12.414 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 152, 2021-06-25T04:57:12.414 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:57:12.414 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:57:12.414 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:57:09.709492+0000", 2021-06-25T04:57:12.415 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:57:12.415 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:57:12.415 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:57:12.415 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:57:12.416 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:57:12.416 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:57:12.416 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:57:12.416 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:57:12.416 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:57:12.417 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:12.417 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:57:12.417 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:57:12.417 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:57:12.418 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:57:12.418 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:57:12.418 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 28, 2021-06-25T04:57:12.418 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:57:12.418 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:57:12.419 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:57:12.419 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:57:12.419 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:57:12.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.420 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:57:12.420 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:57:12.420 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:57:12.420 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:57:12.420 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:57:12.421 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:57:12.421 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:57:12.421 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:57:12.421 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:57:12.422 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:57:12.422 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:57:12.422 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:57:12.422 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:57:12.422 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:57:12.423 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:57:12.423 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:57:12.423 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:57:12.423 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:57:12.424 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:57:12.424 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:57:12.424 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:57:12.425 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:57:12.425 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:57:12.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.426 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:57:12.426 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:57:12.427 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:57:12.427 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:57:12.428 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:57:12.428 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:57:12.429 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:57:12.429 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:57:12.429 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:57:12.430 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:57:12.430 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:57:12.431 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:57:12.431 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:57:12.432 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:57:12.432 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:57:12.433 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:57:12.433 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:57:12.433 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:57:12.434 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:57:12.434 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:57:12.435 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:57:12.435 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:57:12.435 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:57:12.435 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:57:12.436 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:57:12.436 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:57:12.436 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:57:12.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.437 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:57:12.437 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:57:12.437 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:57:12.437 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:57:12.437 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:57:12.438 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:57:12.438 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:57:12.438 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:57:12.438 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:57:12.439 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:57:12.439 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:57:12.439 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:57:12.440 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:57:12.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.440 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:57:12.441 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:57:12.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.443 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:57:12.443 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:57:12.444 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:57:12.444 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:57:12.445 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:57:12.445 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:57:12.445 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:57:12.445 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:57:12.446 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:57:12.446 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:57:12.446 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:57:12.446 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:57:12.446 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:57:12.447 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:57:12.447 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:57:12.447 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:57:12.447 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:57:12.448 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:57:12.448 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:57:12.448 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:57:12.448 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:57:12.448 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:57:12.449 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:57:12.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.449 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:57:12.449 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:57:12.450 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:57:12.450 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:57:12.450 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:57:12.450 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:57:12.451 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:57:12.451 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:57:12.451 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:57:12.451 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:57:12.451 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:57:12.452 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:57:12.452 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:57:12.452 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:57:12.452 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:57:12.452 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:57:12.453 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:57:12.453 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:57:12.453 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:57:12.453 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:57:12.454 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:57:12.454 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:57:12.454 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:57:12.454 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:57:12.455 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:57:12.455 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:57:12.455 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:57:12.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.456 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:57:12.456 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:57:12.457 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:57:12.457 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:57:12.458 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:57:12.458 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:57:12.458 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:57:12.459 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:57:12.459 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:57:12.460 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:57:12.460 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:57:12.460 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:57:12.461 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:57:12.461 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:57:12.461 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.462 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.462 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:12.462 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:57:12.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.463 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:57:12.463 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:57:12.463 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:12.463 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:12.463 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:12.464 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:12.464 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:12.464 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:12.464 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:12.465 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:12.465 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:12.465 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:12.465 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:12.465 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.466 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.466 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:57:12.466 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:12.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.467 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.467 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:57:12.467 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:12.468 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.468 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.468 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:12.468 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.469 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.469 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:57:12.469 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:12.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.470 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.470 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:57:12.471 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:12.471 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.471 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.471 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:12.472 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.472 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.472 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:57:12.472 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:12.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.473 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.474 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:57:12.475 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:12.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.475 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.476 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:12.477 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.477 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.478 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:57:12.478 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:12.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.479 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.479 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:57:12.479 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:12.480 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.480 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.481 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:57:12.481 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:57:12.482 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:57:12.482 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:57:12.482 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:12.483 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:12.483 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:12.484 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.485 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:57:12.486 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:57:12.486 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:12.486 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:12.487 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:12.487 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:12.488 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:12.488 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:12.488 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:12.488 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:12.489 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:12.489 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:12.489 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:12.490 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.490 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.491 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:57:12.491 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:12.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.492 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.493 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:57:12.493 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:12.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.494 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.495 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:12.495 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.496 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.497 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:57:12.497 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:12.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.498 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.499 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:57:12.499 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:12.500 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.500 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.501 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:12.501 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.502 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.502 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:57:12.503 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:12.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.504 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.505 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:57:12.505 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:12.505 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.506 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.507 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:12.507 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.508 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.508 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:57:12.509 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:12.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.509 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.510 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:57:12.510 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:12.510 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.510 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.511 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:57:12.511 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:57:12.511 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:57:12.511 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:57:12.512 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:12.512 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:12.512 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:12.512 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:57:12.513 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:57:12.513 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:12.514 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:12.514 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:12.514 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:12.514 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:12.514 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:12.515 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:12.515 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:12.515 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:12.515 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:12.516 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:12.516 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.516 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.516 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:57:12.517 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:12.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.517 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.518 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:57:12.518 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:12.518 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.518 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.519 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:12.519 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.519 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.520 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:57:12.520 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:12.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.520 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.521 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:57:12.521 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:12.521 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.521 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.522 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:12.522 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.522 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.523 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:57:12.523 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:12.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.524 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.524 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:57:12.524 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:12.524 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.524 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.525 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:12.525 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.525 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.526 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:57:12.526 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:12.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.527 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.527 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:57:12.527 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:12.527 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.527 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.528 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:57:12.528 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:57:12.528 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:57:12.529 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:57:12.529 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:12.529 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:12.529 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:12.529 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.530 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:57:12.530 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:57:12.531 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:12.531 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:12.531 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:12.531 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:12.531 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:12.532 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:12.532 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:12.532 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 135, 2021-06-25T04:57:12.532 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:12.533 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:12.533 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:12.533 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.533 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.534 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:57:12.534 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:12.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.535 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.535 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:57:12.535 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:12.535 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.535 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.536 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:12.536 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.537 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.537 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:57:12.537 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:12.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.538 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.538 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:57:12.538 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:12.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.539 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.539 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:12.539 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.540 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.540 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:57:12.540 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:12.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.541 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.541 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:57:12.541 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:12.541 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.542 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.542 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:12.542 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.543 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.543 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:57:12.543 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:12.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.544 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.544 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:57:12.544 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:12.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.545 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.545 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:57:12.545 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:57:12.546 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:57:12.546 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:57:12.546 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:12.546 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:12.546 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:12.547 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.547 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:57:12.548 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:57:12.548 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:12.548 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:12.548 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:12.548 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:12.549 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:12.549 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:12.549 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:12.549 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 146, 2021-06-25T04:57:12.550 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:12.550 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:12.550 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:12.550 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.551 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.551 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:57:12.551 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:12.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.552 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.552 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:57:12.552 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:12.552 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.553 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.553 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:12.553 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.554 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.554 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:57:12.554 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:12.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.555 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.555 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:57:12.555 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:12.556 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.556 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.556 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:12.556 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.557 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.557 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:57:12.557 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:12.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:57:12.558 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:12.559 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.559 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.559 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:12.559 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.560 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.560 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:57:12.560 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:12.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.561 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.561 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:57:12.561 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:12.562 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.562 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.562 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:57:12.563 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:57:12.563 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:57:12.563 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:57:12.563 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:12.563 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:12.564 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:12.564 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.564 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:57:12.565 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:57:12.565 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:12.565 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:12.565 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:12.566 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:12.566 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:12.566 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:12.566 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:12.566 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:12.567 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:12.567 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:12.567 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:12.567 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.568 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.568 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:57:12.568 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:12.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.569 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.569 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:57:12.569 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:12.569 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.570 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.570 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:12.570 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.571 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.571 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:57:12.571 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:12.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.572 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.572 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:57:12.572 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:12.573 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.573 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.573 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:12.573 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.574 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.574 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:57:12.574 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:12.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.575 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.575 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:57:12.575 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:12.576 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.576 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.576 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:12.577 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.577 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.577 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:57:12.577 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:12.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.578 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:57:12.579 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:12.579 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.579 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.579 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:57:12.580 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:57:12.580 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:57:12.580 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:57:12.580 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:12.581 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:12.581 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:12.581 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.582 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:57:12.582 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:57:12.582 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:12.582 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:12.583 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:12.583 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:12.583 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:12.583 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:12.583 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:12.584 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:12.584 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:12.584 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:12.584 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:12.585 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.585 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.585 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:57:12.585 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:12.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.586 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.586 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:57:12.587 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:12.587 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.587 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.587 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:12.588 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.588 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.588 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:57:12.589 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:12.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.589 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.589 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:57:12.590 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:12.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.590 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.590 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:12.591 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.591 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.591 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:57:12.592 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:12.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.592 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.592 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:57:12.593 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:12.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.593 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.594 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:12.594 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.594 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.594 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:57:12.595 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:12.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.595 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.596 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:57:12.596 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:12.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.596 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.597 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:57:12.597 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:57:12.597 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:57:12.597 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:57:12.597 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:12.598 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:12.598 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:12.598 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.599 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:57:12.599 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:57:12.599 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:12.599 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:12.600 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:12.600 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:12.600 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:12.600 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:12.601 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:12.601 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 147, 2021-06-25T04:57:12.601 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:12.601 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:12.601 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:12.602 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.602 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.602 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:57:12.603 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:12.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.603 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.604 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:57:12.604 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:12.604 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.604 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.605 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:12.605 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.605 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.605 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:57:12.606 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:12.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.606 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.607 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:57:12.607 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:12.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.607 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.608 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:12.608 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.608 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.609 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:57:12.609 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:12.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.610 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.610 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:57:12.610 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:12.610 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.610 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.611 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:12.611 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:12.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.612 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:12.612 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:57:12.612 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:12.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.613 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:12.613 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:57:12.613 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:12.613 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.613 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.614 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:57:12.614 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:57:12.614 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:57:12.615 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:57:12.615 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:12.615 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:12.615 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:12.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:12.616 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.616 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:12.616 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:57:12.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.617 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:57:12.617 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:12.617 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:12.617 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:12.617 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:12.618 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:12.618 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:57:12.618 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:12.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.619 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:57:12.619 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:12.619 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:12.619 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:12.620 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:12.620 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:12.620 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:57:12.620 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:12.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.621 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:57:12.621 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:12.621 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:12.622 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:12.622 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:12.622 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:12.622 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:57:12.622 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:12.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.623 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:57:12.623 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:12.624 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:12.624 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:12.624 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:12.624 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:12.624 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:57:12.625 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:12.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.625 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:57:12.626 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:12.626 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:12.626 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:12.626 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:12.626 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:12.627 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:57:12.627 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:12.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.628 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:57:12.628 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:12.628 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:12.628 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:12.628 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:12.629 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:12.629 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:57:12.629 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:12.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.630 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:57:12.630 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:12.630 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:12.630 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:12.631 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:12.631 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:12.631 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:57:12.631 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:12.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:12.632 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:57:12.632 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:12.632 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:12.633 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:12.633 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:12.633 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:12.633 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:57:12.633 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:12.634 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.634 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:12.634 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:57:12.634 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:57:12.635 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:57:12.635 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:57:12.635 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2021-06-25T04:57:12.635 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6835/2461786269": "2021-06-26T04:57:06.388284+0000", 2021-06-25T04:57:12.635 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6833/2461786269": "2021-06-26T04:57:06.388284+0000" 2021-06-25T04:57:12.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.636 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:57:12.636 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:57:12.636 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:57:12.637 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:57:12.637 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:57:12.637 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:57:12.637 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:57:12.637 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:57:12.638 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:57:12.638 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:57:12.638 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:57:12.638 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:57:12.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.639 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:57:12.639 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:57:12.639 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:57:12.639 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:57:12.640 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:57:12.640 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:57:12.640 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:57:12.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:12.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:12.641 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:57:12.641 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:57:12.641 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:57:12.641 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:57:12.642 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:57:12.642 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:57:12.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 -- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41b0055490 msgr2=0x7f41b0057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41b0055490 0x7f41b0057950 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f41b400b000 tx=0x7f41b4006df0).stop 2021-06-25T04:57:12.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 -- 172.21.15.57:0/857078242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41cc061640 msgr2=0x7f41cc148460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41cc061640 0x7f41cc148460 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f41bc000ed0 tx=0x7f41bc007ac0).stop 2021-06-25T04:57:12.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 -- 172.21.15.57:0/857078242 shutdown_connections 2021-06-25T04:57:12.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f41b0055490 0x7f41b0057950 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41cc0b72f0 0x7f41cc152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41cc143960 0x7f41cc1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 --2- 172.21.15.57:0/857078242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41cc061640 0x7f41cc148460 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 -- 172.21.15.57:0/857078242 >> 172.21.15.57:0/857078242 conn(0x7f41cc06adb0 msgr2=0x7f41cc05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:12.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 -- 172.21.15.57:0/857078242 shutdown_connections 2021-06-25T04:57:12.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.411+0000 7f41cbfff700 1 -- 172.21.15.57:0/857078242 wait complete. 2021-06-25T04:57:12.647 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:57:12.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8f03241700 1 Processor -- start 2021-06-25T04:57:12.759 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8f03241700 1 -- start start 2021-06-25T04:57:12.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8f03241700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8efc065750 0x7f8efc060eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:12.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8f03241700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc0b35e0 con 0x7f8efc0613a0 2021-06-25T04:57:12.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8f03241700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc060230 con 0x7f8efc0b3200 2021-06-25T04:57:12.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8f03241700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8efc05fd80 con 0x7f8efc065750 2021-06-25T04:57:12.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8f017de700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8efc0613a0 0x7f8efc14ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33390/0 (socket says 172.21.15.57:33390) 2021-06-25T04:57:12.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8f017de700 1 -- 172.21.15.57:0/3945664103 learned_addr learned my addr 172.21.15.57:0/3945664103 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:12.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8efbfff700 1 --2- 172.21.15.57:0/3945664103 >> v2:172.21.15.87:3300/0 conn(0x7f8efc065750 0x7f8efc060eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:12.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8efb7fe700 1 -- 172.21.15.57:0/3945664103 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290353902 0 0) 0x7f8efc0b35e0 con 0x7f8efc0613a0 2021-06-25T04:57:12.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8efb7fe700 1 -- 172.21.15.57:0/3945664103 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ee0003260 con 0x7f8efc0613a0 2021-06-25T04:57:12.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8efbfff700 1 -- 172.21.15.57:0/3945664103 >> v1:172.21.15.87:6789/0 conn(0x7f8efc0b3200 legacy=0x7f8efc05f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8efb7fe700 1 -- 172.21.15.57:0/3945664103 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334681243 0 0) 0x7f8efc060230 con 0x7f8efc0b3200 2021-06-25T04:57:12.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8efbfff700 1 -- 172.21.15.57:0/3945664103 >> v1:172.21.15.57:6789/0 conn(0x7f8efc0613a0 legacy=0x7f8efc14ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8efbfff700 1 -- 172.21.15.57:0/3945664103 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc0604d0 con 0x7f8efc065750 2021-06-25T04:57:12.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8efbfff700 1 --2- 172.21.15.57:0/3945664103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8efc065750 0x7f8efc060eb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f8eec001820 tx=0x7f8ef40091d0).ready entity=mon.1 client_cookie=b254497b2df9f2aa server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:12.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8efb7fe700 1 -- 172.21.15.57:0/3945664103 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eec001680 con 0x7f8efc065750 2021-06-25T04:57:12.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8efb7fe700 1 -- 172.21.15.57:0/3945664103 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef400b580 con 0x7f8efc065750 2021-06-25T04:57:12.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8efb7fe700 1 -- 172.21.15.57:0/3945664103 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ef400b6f0 con 0x7f8efc065750 2021-06-25T04:57:12.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8f03241700 1 -- 172.21.15.57:0/3945664103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8efc065750 msgr2=0x7f8efc060eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.754+0000 7f8f03241700 1 --2- 172.21.15.57:0/3945664103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8efc065750 0x7f8efc060eb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f8eec001820 tx=0x7f8ef40091d0).stop 2021-06-25T04:57:12.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 -- 172.21.15.57:0/3945664103 shutdown_connections 2021-06-25T04:57:12.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 --2- 172.21.15.57:0/3945664103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8efc065750 0x7f8efc060eb0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 -- 172.21.15.57:0/3945664103 >> 172.21.15.57:0/3945664103 conn(0x7f8efc05c450 msgr2=0x7f8efc05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:12.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 -- 172.21.15.57:0/3945664103 shutdown_connections 2021-06-25T04:57:12.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 -- 172.21.15.57:0/3945664103 wait complete. 2021-06-25T04:57:12.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 Processor -- start 2021-06-25T04:57:12.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 -- start start 2021-06-25T04:57:12.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8efc0613a0 0x7f8efc0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:12.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8efc065750 0x7f8efc14e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:12.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8efc0b3200 0x7f8efc0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:12.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0a9b50 con 0x7f8efc0613a0 2021-06-25T04:57:12.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0ae7f0 con 0x7f8efc0b3200 2021-06-25T04:57:12.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f03241700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0a9d80 con 0x7f8efc065750 2021-06-25T04:57:12.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f00fdd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8efc0613a0 0x7f8efc0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:12.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f00fdd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8efc0613a0 0x7f8efc0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44406/0 (socket says 172.21.15.57:44406) 2021-06-25T04:57:12.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8f00fdd700 1 -- 172.21.15.57:0/3861756466 learned_addr learned my addr 172.21.15.57:0/3861756466 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:12.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.758+0000 7f8efbfff700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8efc065750 0x7f8efc14e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:12.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8f017de700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8efc0b3200 0x7f8efc0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:12.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8f00fdd700 1 -- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8efc065750 msgr2=0x7f8efc14e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8f00fdd700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8efc065750 0x7f8efc14e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8f00fdd700 1 -- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8efc0b3200 msgr2=0x7f8efc0acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8f00fdd700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8efc0b3200 0x7f8efc0acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8f00fdd700 1 -- 172.21.15.57:0/3861756466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef4009470 con 0x7f8efc0613a0 2021-06-25T04:57:12.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8f00fdd700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8efc0613a0 0x7f8efc0adb60 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f8ee4000bc0 tx=0x7f8ee4007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:12.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8ef9ffb700 1 -- 172.21.15.57:0/3861756466 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ee4007030 con 0x7f8efc0613a0 2021-06-25T04:57:12.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8ef9ffb700 1 -- 172.21.15.57:0/3861756466 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee4007190 con 0x7f8efc0613a0 2021-06-25T04:57:12.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8f03241700 1 -- 172.21.15.57:0/3861756466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc0aea20 con 0x7f8efc0613a0 2021-06-25T04:57:12.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8ef9ffb700 1 -- 172.21.15.57:0/3861756466 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ee4006510 con 0x7f8efc0613a0 2021-06-25T04:57:12.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8f03241700 1 -- 172.21.15.57:0/3861756466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc14c700 con 0x7f8efc0613a0 2021-06-25T04:57:12.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8f03241700 1 -- 172.21.15.57:0/3861756466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8efc0aebb0 con 0x7f8efc0613a0 2021-06-25T04:57:12.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8ef9ffb700 1 -- 172.21.15.57:0/3861756466 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8ee4010030 con 0x7f8efc0613a0 2021-06-25T04:57:12.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.762+0000 7f8ef9ffb700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ed4055340 0x7f8ed4057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:12.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.766+0000 7f8ef9ffb700 1 -- 172.21.15.57:0/3861756466 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f8ee406d740 con 0x7f8efc0613a0 2021-06-25T04:57:12.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.766+0000 7f8efbfff700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ed4055340 0x7f8ed4057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:12.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.766+0000 7f8efbfff700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ed4055340 0x7f8ed4057800 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f8ef401a000 tx=0x7f8efc067070).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:12.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.770+0000 7f8ef9ffb700 1 -- 172.21.15.57:0/3861756466 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8ee4043c80 con 0x7f8efc0613a0 2021-06-25T04:57:12.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.930+0000 7f8f03241700 1 -- 172.21.15.57:0/3861756466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8efc057310 con 0x7f8efc0613a0 2021-06-25T04:57:12.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.930+0000 7f8ef9ffb700 1 -- 172.21.15.57:0/3861756466 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f8ee40472a0 con 0x7f8efc0613a0 2021-06-25T04:57:12.939 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:12.939 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":77,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2769630783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2769630783},{"type":"v1","addr":"172.21.15.87:6835","nonce":2769630783}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/583651666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":583651666},{"type":"v1","addr":"172.21.15.57:6834","nonce":583651666}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8685,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/1158852221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1158852221},{"type":"v1","addr":"172.21.15.57:6835","nonce":1158852221}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[]} 2021-06-25T04:57:12.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 -- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ed4055340 msgr2=0x7f8ed4057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ed4055340 0x7f8ed4057800 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f8ef401a000 tx=0x7f8efc067070).stop 2021-06-25T04:57:12.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 -- 172.21.15.57:0/3861756466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8efc0613a0 msgr2=0x7f8efc0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:12.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8efc0613a0 0x7f8efc0adb60 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f8ee4000bc0 tx=0x7f8ee4007c30).stop 2021-06-25T04:57:12.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 -- 172.21.15.57:0/3861756466 shutdown_connections 2021-06-25T04:57:12.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8ed4055340 0x7f8ed4057800 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8efc0b3200 0x7f8efc0acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8efc065750 0x7f8efc14e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 --2- 172.21.15.57:0/3861756466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8efc0613a0 0x7f8efc0adb60 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:12.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 -- 172.21.15.57:0/3861756466 >> 172.21.15.57:0/3861756466 conn(0x7f8efc05c450 msgr2=0x7f8efc066400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:12.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 -- 172.21.15.57:0/3861756466 shutdown_connections 2021-06-25T04:57:12.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:12.934+0000 7f8f03241700 1 -- 172.21.15.57:0/3861756466 wait complete. 2021-06-25T04:57:12.947 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 77 2021-06-25T04:57:12.952 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:57:13.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.046+0000 7efc828bc700 1 Processor -- start 2021-06-25T04:57:13.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.046+0000 7efc828bc700 1 -- start start 2021-06-25T04:57:13.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.046+0000 7efc828bc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc7c0b2810 0x7efc7c0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.046+0000 7efc828bc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c13c6a0 0x7efc7c13cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.046+0000 7efc828bc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7c0b2bf0 con 0x7efc7c0acee0 2021-06-25T04:57:13.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.046+0000 7efc828bc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c0b1620 con 0x7efc7c0b2810 2021-06-25T04:57:13.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.046+0000 7efc828bc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0b18c0 con 0x7efc7c13c6a0 2021-06-25T04:57:13.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.046+0000 7efc820bb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efc7c0acee0 0x7efc7c0ad370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33404/0 (socket says 172.21.15.57:33404) 2021-06-25T04:57:13.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.046+0000 7efc820bb700 1 -- 172.21.15.57:0/3143733936 learned_addr learned my addr 172.21.15.57:0/3143733936 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:13.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc810b9700 1 --2- 172.21.15.57:0/3143733936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c13c6a0 0x7efc7c13cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc818ba700 1 --2- 172.21.15.57:0/3143733936 >> v2:172.21.15.87:3300/0 conn(0x7efc7c0b2810 0x7efc7c0b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc808b8700 1 -- 172.21.15.57:0/3143733936 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704755386 0 0) 0x7efc7c0b2bf0 con 0x7efc7c0acee0 2021-06-25T04:57:13.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc808b8700 1 -- 172.21.15.57:0/3143733936 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc64003260 con 0x7efc7c0acee0 2021-06-25T04:57:13.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc810b9700 1 -- 172.21.15.57:0/3143733936 >> v2:172.21.15.87:3300/0 conn(0x7efc7c0b2810 msgr2=0x7efc7c0b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:13.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc810b9700 1 --2- 172.21.15.57:0/3143733936 >> v2:172.21.15.87:3300/0 conn(0x7efc7c0b2810 0x7efc7c0b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc808b8700 1 -- 172.21.15.57:0/3143733936 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2517643103 0 0) 0x7efc64003260 con 0x7efc7c0acee0 2021-06-25T04:57:13.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc810b9700 1 -- 172.21.15.57:0/3143733936 >> v1:172.21.15.57:6789/0 conn(0x7efc7c0acee0 legacy=0x7efc7c0ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:13.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc810b9700 1 -- 172.21.15.57:0/3143733936 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0b1b60 con 0x7efc7c13c6a0 2021-06-25T04:57:13.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc810b9700 1 --2- 172.21.15.57:0/3143733936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c13c6a0 0x7efc7c13cae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7efc74001b80 tx=0x7efc78006df0).ready entity=mon.2 client_cookie=ab2445c688337b9e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:13.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc808b8700 1 -- 172.21.15.57:0/3143733936 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc740019e0 con 0x7efc7c13c6a0 2021-06-25T04:57:13.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc808b8700 1 -- 172.21.15.57:0/3143733936 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc78000e90 con 0x7efc7c13c6a0 2021-06-25T04:57:13.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc808b8700 1 -- 172.21.15.57:0/3143733936 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc78012460 con 0x7efc7c13c6a0 2021-06-25T04:57:13.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc828bc700 1 -- 172.21.15.57:0/3143733936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c13c6a0 msgr2=0x7efc7c13cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:13.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc828bc700 1 --2- 172.21.15.57:0/3143733936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c13c6a0 0x7efc7c13cae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7efc74001b80 tx=0x7efc78006df0).stop 2021-06-25T04:57:13.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc828bc700 1 -- 172.21.15.57:0/3143733936 shutdown_connections 2021-06-25T04:57:13.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc828bc700 1 --2- 172.21.15.57:0/3143733936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c13c6a0 0x7efc7c13cae0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc828bc700 1 --2- 172.21.15.57:0/3143733936 >> v2:172.21.15.87:3300/0 conn(0x7efc7c0b2810 0x7efc7c0b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc828bc700 1 -- 172.21.15.57:0/3143733936 >> 172.21.15.57:0/3143733936 conn(0x7efc7c0611f0 msgr2=0x7efc7c062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:13.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc828bc700 1 -- 172.21.15.57:0/3143733936 shutdown_connections 2021-06-25T04:57:13.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc828bc700 1 -- 172.21.15.57:0/3143733936 wait complete. 2021-06-25T04:57:13.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.050+0000 7efc828bc700 1 Processor -- start 2021-06-25T04:57:13.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc828bc700 1 -- start start 2021-06-25T04:57:13.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc828bc700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c0acee0 0x7efc7c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc828bc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc7c0b2810 0x7efc7c0671a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc828bc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc7c13c6a0 0x7efc7c064b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc828bc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c063a90 con 0x7efc7c0b2810 2021-06-25T04:57:13.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc828bc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c143740 con 0x7efc7c13c6a0 2021-06-25T04:57:13.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc828bc700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0637f0 con 0x7efc7c0acee0 2021-06-25T04:57:13.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc810b9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc7c0b2810 0x7efc7c0671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc810b9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc7c0b2810 0x7efc7c0671a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44422/0 (socket says 172.21.15.57:44422) 2021-06-25T04:57:13.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc810b9700 1 -- 172.21.15.57:0/2966030517 learned_addr learned my addr 172.21.15.57:0/2966030517 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:13.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc818ba700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c0acee0 0x7efc7c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc820bb700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc7c13c6a0 0x7efc7c064b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc810b9700 1 -- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c0acee0 msgr2=0x7efc7c065740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:13.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc810b9700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c0acee0 0x7efc7c065740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc810b9700 1 -- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc7c13c6a0 msgr2=0x7efc7c064b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:13.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc810b9700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc7c13c6a0 0x7efc7c064b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc810b9700 1 -- 172.21.15.57:0/2966030517 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7800b180 con 0x7efc7c0b2810 2021-06-25T04:57:13.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc818ba700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c0acee0 0x7efc7c065740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:13.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc810b9700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc7c0b2810 0x7efc7c0671a0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7efc74001b80 tx=0x7efc78014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:13.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc6affd700 1 -- 172.21.15.57:0/2966030517 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc7800d920 con 0x7efc7c0b2810 2021-06-25T04:57:13.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc6affd700 1 -- 172.21.15.57:0/2966030517 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7800da80 con 0x7efc7c0b2810 2021-06-25T04:57:13.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc828bc700 1 -- 172.21.15.57:0/2966030517 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c0b5420 con 0x7efc7c0b2810 2021-06-25T04:57:13.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc6affd700 1 -- 172.21.15.57:0/2966030517 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc7800dde0 con 0x7efc7c0b2810 2021-06-25T04:57:13.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc828bc700 1 -- 172.21.15.57:0/2966030517 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c063d00 con 0x7efc7c0b2810 2021-06-25T04:57:13.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.054+0000 7efc828bc700 1 -- 172.21.15.57:0/2966030517 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c0b55b0 con 0x7efc7c0b2810 2021-06-25T04:57:13.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.058+0000 7efc6affd700 1 -- 172.21.15.57:0/2966030517 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7efc78025020 con 0x7efc7c0b2810 2021-06-25T04:57:13.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.058+0000 7efc6affd700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc5c0553d0 0x7efc5c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.058+0000 7efc6affd700 1 -- 172.21.15.57:0/2966030517 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5686+0+0 (secure 0 0 0) 0x7efc7806ec60 con 0x7efc7c0b2810 2021-06-25T04:57:13.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.058+0000 7efc818ba700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc5c0553d0 0x7efc5c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.058+0000 7efc818ba700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc5c0553d0 0x7efc5c057890 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7efc6c00b000 tx=0x7efc6c008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:13.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.062+0000 7efc6affd700 1 -- 172.21.15.57:0/2966030517 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7efc78045050 con 0x7efc7c0b2810 2021-06-25T04:57:13.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc828bc700 1 -- 172.21.15.57:0/2966030517 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc7c057310 con 0x7efc7c0b2810 2021-06-25T04:57:13.232 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc6affd700 1 -- 172.21.15.57:0/2966030517 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+1559 (secure 0 0 0) 0x7efc78048670 con 0x7efc7c0b2810 2021-06-25T04:57:13.232 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:13.232 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":77,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2769630783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2769630783},{"type":"v1","addr":"172.21.15.87:6835","nonce":2769630783}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/583651666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":583651666},{"type":"v1","addr":"172.21.15.57:6834","nonce":583651666}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8685,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/1158852221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1158852221},{"type":"v1","addr":"172.21.15.57:6835","nonce":1158852221}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[]} 2021-06-25T04:57:13.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc828bc700 1 -- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc5c0553d0 msgr2=0x7efc5c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:13.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc828bc700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc5c0553d0 0x7efc5c057890 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7efc6c00b000 tx=0x7efc6c008040).stop 2021-06-25T04:57:13.234 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc828bc700 1 -- 172.21.15.57:0/2966030517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc7c0b2810 msgr2=0x7efc7c0671a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:13.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc828bc700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc7c0b2810 0x7efc7c0671a0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7efc74001b80 tx=0x7efc78014000).stop 2021-06-25T04:57:13.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc828bc700 1 -- 172.21.15.57:0/2966030517 shutdown_connections 2021-06-25T04:57:13.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc828bc700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc5c0553d0 0x7efc5c057890 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc828bc700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc7c13c6a0 0x7efc7c064b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc828bc700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc7c0b2810 0x7efc7c0671a0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc828bc700 1 --2- 172.21.15.57:0/2966030517 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc7c0acee0 0x7efc7c065740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.226+0000 7efc828bc700 1 -- 172.21.15.57:0/2966030517 >> 172.21.15.57:0/2966030517 conn(0x7efc7c0611f0 msgr2=0x7efc7c0ad330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:13.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.230+0000 7efc828bc700 1 -- 172.21.15.57:0/2966030517 shutdown_connections 2021-06-25T04:57:13.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.230+0000 7efc828bc700 1 -- 172.21.15.57:0/2966030517 wait complete. 2021-06-25T04:57:13.237 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 77 2021-06-25T04:57:13.245 INFO:tasks.ceph.mds.a:Restarting daemon 2021-06-25T04:57:13.245 INFO:tasks.ceph.mds.a:Stopping old one... 2021-06-25T04:57:13.246 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T04:57:13.246 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:57:13.246 INFO:tasks.ceph.mds.c:Restarting daemon 2021-06-25T04:57:13.247 INFO:tasks.ceph.mds.c:Stopping old one... 2021-06-25T04:57:13.247 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T04:57:13.247 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:57:13.248 INFO:tasks.ceph.mds.b:Restarting daemon 2021-06-25T04:57:13.248 INFO:tasks.ceph.mds.b:Stopping old one... 2021-06-25T04:57:13.248 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T04:57:13.249 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T04:57:13.259 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T04:57:13.260 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-06-25T04:57:13.261 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T04:57:13.261 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-06-25T04:57:13.262 INFO:tasks.ceph.mds.a:Started 2021-06-25T04:57:13.263 DEBUG:teuthology.parallel:result is None 2021-06-25T04:57:13.264 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T04:57:13.265 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-06-25T04:57:13.265 INFO:tasks.ceph.mds.c:Started 2021-06-25T04:57:13.266 DEBUG:teuthology.parallel:result is None 2021-06-25T04:57:13.268 INFO:tasks.ceph.mds.b:Started 2021-06-25T04:57:13.268 DEBUG:teuthology.parallel:result is None 2021-06-25T04:57:13.269 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-06-25T04:57:13.334 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2021-06-25T04:57:13.340 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2021-06-25T04:57:13.341 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:57:13.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f97588e2700 1 Processor -- start 2021-06-25T04:57:13.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f97588e2700 1 -- start start 2021-06-25T04:57:13.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f97588e2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f97540b6540 0x7f97540b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f97588e2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f97540b6920 0x7f975412b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f97588e2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9754144070 con 0x7f97540b4380 2021-06-25T04:57:13.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f97588e2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9754143b30 con 0x7f97540b6540 2021-06-25T04:57:13.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f97588e2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9754143dd0 con 0x7f97540b6920 2021-06-25T04:57:13.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f975259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f97540b6540 0x7f97540b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f975259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f97540b6540 0x7f97540b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44452/0 (socket says 172.21.15.57:44452) 2021-06-25T04:57:13.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f975259c700 1 -- 172.21.15.57:0/990320885 learned_addr learned my addr 172.21.15.57:0/990320885 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:13.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f9752d9d700 1 --2- 172.21.15.57:0/990320885 >> v2:172.21.15.87:3300/0 conn(0x7f97540b6920 0x7f975412b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f975259c700 1 -- 172.21.15.57:0/990320885 >> v2:172.21.15.87:3300/0 conn(0x7f97540b6920 msgr2=0x7f975412b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:13.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f975259c700 1 --2- 172.21.15.57:0/990320885 >> v2:172.21.15.87:3300/0 conn(0x7f97540b6920 0x7f975412b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f975259c700 1 -- 172.21.15.57:0/990320885 >> v1:172.21.15.87:6789/0 conn(0x7f97540b4380 legacy=0x7f9754061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:13.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.378+0000 7f975259c700 1 -- 172.21.15.57:0/990320885 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97540615b0 con 0x7f97540b6540 2021-06-25T04:57:13.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f975259c700 1 --2- 172.21.15.57:0/990320885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97540b6540 0x7f97540b5bb0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f97541430e0 tx=0x7f973c006eb0).ready entity=mon.0 client_cookie=ad895a3472dfafdf server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:13.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f975159a700 1 -- 172.21.15.57:0/990320885 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f973c00d610 con 0x7f97540b6540 2021-06-25T04:57:13.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f975159a700 1 -- 172.21.15.57:0/990320885 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c000e90 con 0x7f97540b6540 2021-06-25T04:57:13.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f975159a700 1 -- 172.21.15.57:0/990320885 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f973c00d9a0 con 0x7f97540b6540 2021-06-25T04:57:13.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 -- 172.21.15.57:0/990320885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97540b6540 msgr2=0x7f97540b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:13.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 --2- 172.21.15.57:0/990320885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97540b6540 0x7f97540b5bb0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f97541430e0 tx=0x7f973c006eb0).stop 2021-06-25T04:57:13.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 -- 172.21.15.57:0/990320885 shutdown_connections 2021-06-25T04:57:13.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 --2- 172.21.15.57:0/990320885 >> v2:172.21.15.87:3300/0 conn(0x7f97540b6920 0x7f975412b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 --2- 172.21.15.57:0/990320885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97540b6540 0x7f97540b5bb0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 -- 172.21.15.57:0/990320885 >> 172.21.15.57:0/990320885 conn(0x7f975405c450 msgr2=0x7f975405c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:13.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 -- 172.21.15.57:0/990320885 shutdown_connections 2021-06-25T04:57:13.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 -- 172.21.15.57:0/990320885 wait complete. 2021-06-25T04:57:13.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 Processor -- start 2021-06-25T04:57:13.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 -- start start 2021-06-25T04:57:13.405 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97540b4380 0x7f97540b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97540b6540 0x7f9754152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.406 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97540b6920 0x7f97541556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97540ae2a0 con 0x7f97540b6920 2021-06-25T04:57:13.407 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9754152250 con 0x7f97540b4380 2021-06-25T04:57:13.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f97588e2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97541232a0 con 0x7f97540b6540 2021-06-25T04:57:13.408 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f9752d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97540b6920 0x7f97541556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f9752d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97540b6920 0x7f97541556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44460/0 (socket says 172.21.15.57:44460) 2021-06-25T04:57:13.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f9752d9d700 1 -- 172.21.15.57:0/3979853095 learned_addr learned my addr 172.21.15.57:0/3979853095 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:13.409 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f975259c700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97540b4380 0x7f97540b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.382+0000 7f9751d9b700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97540b6540 0x7f9754152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.410 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f9752d9d700 1 -- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97540b6540 msgr2=0x7f9754152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:13.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f9752d9d700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97540b6540 0x7f9754152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.411 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f9752d9d700 1 -- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97540b4380 msgr2=0x7f97540b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:13.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f9752d9d700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97540b4380 0x7f97540b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:13.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f9752d9d700 1 -- 172.21.15.57:0/3979853095 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c00b1e0 con 0x7f97540b6920 2021-06-25T04:57:13.412 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f9752d9d700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97540b6920 0x7f97541556a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f9754123430 tx=0x7f974c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:13.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f974b7fe700 1 -- 172.21.15.57:0/3979853095 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f974c012600 con 0x7f97540b6920 2021-06-25T04:57:13.413 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f974b7fe700 1 -- 172.21.15.57:0/3979853095 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c012760 con 0x7f97540b6920 2021-06-25T04:57:13.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f97588e2700 1 -- 172.21.15.57:0/3979853095 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9754123000 con 0x7f97540b6920 2021-06-25T04:57:13.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f974b7fe700 1 -- 172.21.15.57:0/3979853095 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f974c012ac0 con 0x7f97540b6920 2021-06-25T04:57:13.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f97588e2700 1 -- 172.21.15.57:0/3979853095 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9754122c80 con 0x7f97540b6920 2021-06-25T04:57:13.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f97588e2700 1 -- 172.21.15.57:0/3979853095 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9754057310 con 0x7f97540b6920 2021-06-25T04:57:13.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f974b7fe700 1 -- 172.21.15.57:0/3979853095 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f974c022070 con 0x7f97540b6920 2021-06-25T04:57:13.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.386+0000 7f974b7fe700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f972c055340 0x7f972c057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:13.416 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.390+0000 7f974b7fe700 1 -- 172.21.15.57:0/3979853095 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f974c06e220 con 0x7f97540b6920 2021-06-25T04:57:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.390+0000 7f975259c700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f972c055340 0x7f972c057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.390+0000 7f975259c700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f972c055340 0x7f972c057800 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f973c01b000 tx=0x7f973c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.394+0000 7f974b7fe700 1 -- 172.21.15.57:0/3979853095 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f974c0445a0 con 0x7f97540b6920 2021-06-25T04:57:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:13.530+0000 7f97588e2700 1 -- 172.21.15.57:0/3979853095 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f97540698a0 con 0x7f97540b6920 2021-06-25T04:57:14.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.358+0000 7f974b7fe700 1 -- 172.21.15.57:0/3979853095 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v154) v1 ==== 97+0+0 (secure 0 0 0) 0x7f974c016020 con 0x7f97540b6920 2021-06-25T04:57:14.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 -- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f972c055340 msgr2=0x7f972c057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f972c055340 0x7f972c057800 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f973c01b000 tx=0x7f973c015000).stop 2021-06-25T04:57:14.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 -- 172.21.15.57:0/3979853095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97540b6920 msgr2=0x7f97541556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97540b6920 0x7f97541556a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f9754123430 tx=0x7f974c0091d0).stop 2021-06-25T04:57:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 -- 172.21.15.57:0/3979853095 shutdown_connections 2021-06-25T04:57:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f972c055340 0x7f972c057800 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97540b6920 0x7f97541556a0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97540b6540 0x7f9754152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 --2- 172.21.15.57:0/3979853095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97540b4380 0x7f97540b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 -- 172.21.15.57:0/3979853095 >> 172.21.15.57:0/3979853095 conn(0x7f975405c450 msgr2=0x7f9754061c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:14.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 -- 172.21.15.57:0/3979853095 shutdown_connections 2021-06-25T04:57:14.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.362+0000 7f97588e2700 1 -- 172.21.15.57:0/3979853095 wait complete. 2021-06-25T04:57:14.373 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blacklist entries 2021-06-25T04:57:14.387 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-06-25T04:57:14.388 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-06-25T04:57:14.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa35180e700 1 Processor -- start 2021-06-25T04:57:14.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa35180e700 1 -- start start 2021-06-25T04:57:14.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa35180e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa34c0b1130 0x7fa34c1413f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:14.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa35180e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa34c1418e0 0x7fa34c141d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:14.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa35180e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34c0b3190 con 0x7fa34c0b77d0 2021-06-25T04:57:14.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa35180e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34c0b7bb0 con 0x7fa34c0b1130 2021-06-25T04:57:14.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa35180e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c067580 con 0x7fa34c1418e0 2021-06-25T04:57:14.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa34a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa34c0b1130 0x7fa34c1413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:14.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa34affd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa34c0b77d0 0x7fa34c144560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33454/0 (socket says 172.21.15.57:33454) 2021-06-25T04:57:14.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa34affd700 1 -- 172.21.15.57:0/1249542009 learned_addr learned my addr 172.21.15.57:0/1249542009 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:14.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa34b7fe700 1 --2- 172.21.15.57:0/1249542009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa34c1418e0 0x7fa34c141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:14.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa349ffb700 1 -- 172.21.15.57:0/1249542009 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123844944 0 0) 0x7fa34c0b3190 con 0x7fa34c0b77d0 2021-06-25T04:57:14.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa349ffb700 1 -- 172.21.15.57:0/1249542009 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa32c003260 con 0x7fa34c0b77d0 2021-06-25T04:57:14.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa34a7fc700 1 -- 172.21.15.57:0/1249542009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa34c1418e0 msgr2=0x7fa34c141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:14.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa34a7fc700 1 --2- 172.21.15.57:0/1249542009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa34c1418e0 0x7fa34c141d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa34a7fc700 1 -- 172.21.15.57:0/1249542009 >> v1:172.21.15.57:6789/0 conn(0x7fa34c0b77d0 legacy=0x7fa34c144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa34a7fc700 1 -- 172.21.15.57:0/1249542009 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c142230 con 0x7fa34c0b1130 2021-06-25T04:57:14.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa34b7fe700 1 --2- 172.21.15.57:0/1249542009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa34c1418e0 0x7fa34c141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:14.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa34a7fc700 1 --2- 172.21.15.57:0/1249542009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa34c0b1130 0x7fa34c1413f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fa33c0032f0 tx=0x7fa33c0091d0).ready entity=mon.0 client_cookie=8f8aaa3c733489c5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:14.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa349ffb700 1 -- 172.21.15.57:0/1249542009 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa33c00b600 con 0x7fa34c0b1130 2021-06-25T04:57:14.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa349ffb700 1 -- 172.21.15.57:0/1249542009 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33c00b760 con 0x7fa34c0b1130 2021-06-25T04:57:14.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa349ffb700 1 -- 172.21.15.57:0/1249542009 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa33c00b8d0 con 0x7fa34c0b1130 2021-06-25T04:57:14.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa35180e700 1 -- 172.21.15.57:0/1249542009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa34c0b1130 msgr2=0x7fa34c1413f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.494+0000 7fa35180e700 1 --2- 172.21.15.57:0/1249542009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa34c0b1130 0x7fa34c1413f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fa33c0032f0 tx=0x7fa33c0091d0).stop 2021-06-25T04:57:14.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.498+0000 7fa35180e700 1 -- 172.21.15.57:0/1249542009 shutdown_connections 2021-06-25T04:57:14.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.498+0000 7fa35180e700 1 --2- 172.21.15.57:0/1249542009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa34c1418e0 0x7fa34c141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.498+0000 7fa35180e700 1 --2- 172.21.15.57:0/1249542009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa34c0b1130 0x7fa34c1413f0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.498+0000 7fa35180e700 1 -- 172.21.15.57:0/1249542009 >> 172.21.15.57:0/1249542009 conn(0x7fa34c05f670 msgr2=0x7fa34c05fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:14.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.498+0000 7fa35180e700 1 -- 172.21.15.57:0/1249542009 shutdown_connections 2021-06-25T04:57:14.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.498+0000 7fa35180e700 1 -- 172.21.15.57:0/1249542009 wait complete. 2021-06-25T04:57:14.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.498+0000 7fa35180e700 1 Processor -- start 2021-06-25T04:57:14.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.498+0000 7fa35180e700 1 -- start start 2021-06-25T04:57:14.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa35180e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa34c0b1130 0x7fa34c0b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:14.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa35180e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa34c0b77d0 0x7fa34c1423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:14.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa35180e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa34c1418e0 0x7fa34c137880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:14.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa35180e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c060e50 con 0x7fa34c0b1130 2021-06-25T04:57:14.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa35180e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c060780 con 0x7fa34c1418e0 2021-06-25T04:57:14.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa35180e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c144b50 con 0x7fa34c0b77d0 2021-06-25T04:57:14.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa34affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa34c0b1130 0x7fa34c0b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:14.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa34affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa34c0b1130 0x7fa34c0b0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44474/0 (socket says 172.21.15.57:44474) 2021-06-25T04:57:14.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa34affd700 1 -- 172.21.15.57:0/1611946085 learned_addr learned my addr 172.21.15.57:0/1611946085 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:14.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa34b7fe700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa34c1418e0 0x7fa34c137880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa34a7fc700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa34c0b77d0 0x7fa34c1423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa34affd700 1 -- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa34c0b77d0 msgr2=0x7fa34c1423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa34affd700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa34c0b77d0 0x7fa34c1423c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa34affd700 1 -- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa34c1418e0 msgr2=0x7fa34c137880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa34affd700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa34c1418e0 0x7fa34c137880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa34affd700 1 -- 172.21.15.57:0/1611946085 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34400b180 con 0x7fa34c0b1130 2021-06-25T04:57:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa34affd700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa34c0b1130 0x7fa34c0b0b10 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7fa34c1431b0 tx=0x7fa334007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:14.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa343fff700 1 -- 172.21.15.57:0/1611946085 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3340072e0 con 0x7fa34c0b1130 2021-06-25T04:57:14.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa343fff700 1 -- 172.21.15.57:0/1611946085 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa334007440 con 0x7fa34c0b1130 2021-06-25T04:57:14.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa35180e700 1 -- 172.21.15.57:0/1611946085 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33c009470 con 0x7fa34c0b1130 2021-06-25T04:57:14.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa343fff700 1 -- 172.21.15.57:0/1611946085 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa334005800 con 0x7fa34c0b1130 2021-06-25T04:57:14.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa35180e700 1 -- 172.21.15.57:0/1611946085 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34c144da0 con 0x7fa34c0b1130 2021-06-25T04:57:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa343fff700 1 -- 172.21.15.57:0/1611946085 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa334010070 con 0x7fa34c0b1130 2021-06-25T04:57:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.502+0000 7fa35180e700 1 -- 172.21.15.57:0/1611946085 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa34c060b50 con 0x7fa34c0b1130 2021-06-25T04:57:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.506+0000 7fa343fff700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa330055360 0x7fa330057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.506+0000 7fa343fff700 1 -- 172.21.15.57:0/1611946085 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa33406d2d0 con 0x7fa34c0b1130 2021-06-25T04:57:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.506+0000 7fa34a7fc700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa330055360 0x7fa330057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.506+0000 7fa34a7fc700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa330055360 0x7fa330057820 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fa33c019000 tx=0x7fa33c016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.514+0000 7fa343fff700 1 -- 172.21.15.57:0/1611946085 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa3340437c0 con 0x7fa34c0b1130 2021-06-25T04:57:14.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.678+0000 7fa35180e700 1 -- 172.21.15.57:0/1611946085 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa34c057310 con 0x7fa34c0b1130 2021-06-25T04:57:14.685 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.678+0000 7fa343fff700 1 -- 172.21.15.57:0/1611946085 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v33) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fa334046de0 con 0x7fa34c0b1130 2021-06-25T04:57:14.685 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:14.685 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:57:14.685 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2021-06-25T04:57:14.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.686 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2021-06-25T04:57:14.686 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgkEGeMhAABW81ZswsyZr8OZ5PNGhGnQ==", 2021-06-25T04:57:14.686 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2021-06-25T04:57:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgggMdARAA+3CW7XKcEjicvHjdCxl8QQ==", 2021-06-25T04:57:14.689 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.689 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:57:14.689 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.689 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2021-06-25T04:57:14.691 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgLr3qOBAAZP/5q8HY2o/GIYstoKUJrw==", 2021-06-25T04:57:14.691 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.691 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:57:14.691 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2021-06-25T04:57:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCzX9VghhfBORAAR/EruqcaTBz/a7wbw/wgXw==", 2021-06-25T04:57:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.695 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2021-06-25T04:57:14.695 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC2X9VgLbRxHxAAbWSaror3I6KBgY54jcM/pQ==", 2021-06-25T04:57:14.696 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.696 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.696 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.696 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.697 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.697 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2021-06-25T04:57:14.697 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC5X9VgO8duAhAAYPD+apccgihSRQ+ZtDyjYg==", 2021-06-25T04:57:14.698 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.698 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.698 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.698 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.699 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.699 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2021-06-25T04:57:14.699 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC7X9VgSmCTJRAAOcMyfeCp31kFSg6dO4nXOA==", 2021-06-25T04:57:14.700 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.700 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.700 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.700 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.701 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.701 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2021-06-25T04:57:14.702 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDAX9VgxXNsLhAAohFAB0cUjl9MGDyD8uiWfQ==", 2021-06-25T04:57:14.702 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.702 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.702 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.703 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.703 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.704 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2021-06-25T04:57:14.704 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDDX9VgVKafExAAVZ/3l00++M2QuCHH1Z7eZw==", 2021-06-25T04:57:14.704 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.704 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.704 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.705 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.705 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.706 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2021-06-25T04:57:14.706 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDFX9VgLECTNBAA4MMhKn2Ujb6MtDRu3gkLuA==", 2021-06-25T04:57:14.706 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.706 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.707 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.707 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.707 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.708 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2021-06-25T04:57:14.708 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDIX9VgoB4ZGBAAc4rzfNLIEgDxPhmjZwaEiA==", 2021-06-25T04:57:14.708 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.709 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.709 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.709 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.709 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.710 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2021-06-25T04:57:14.710 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VgNij9BBAAu7eZnwu70H+C3ZPs1dr8dA==", 2021-06-25T04:57:14.710 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.711 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:57:14.711 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:57:14.711 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:57:14.711 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.712 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2021-06-25T04:57:14.712 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCuX9VggaBVCBAABSb2eCS5+0UjpPriF68AoA==", 2021-06-25T04:57:14.713 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.713 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2021-06-25T04:57:14.713 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2021-06-25T04:57:14.713 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw pool=cephfs_data" 2021-06-25T04:57:14.714 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.714 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2021-06-25T04:57:14.715 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggU7uGBAAJmlql299an1hSCoRyhuoRQ==", 2021-06-25T04:57:14.715 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.715 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:57:14.715 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2021-06-25T04:57:14.716 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2021-06-25T04:57:14.716 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.716 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.717 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2021-06-25T04:57:14.717 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VgA7PmLxAA9ONpqc4J/pHSlJH7Iw6bTA==", 2021-06-25T04:57:14.717 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.717 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:57:14.718 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:57:14.718 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.718 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:14.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:14.719 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2021-06-25T04:57:14.719 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCtX9VggICbLBAAM/r/2wPtdW9F7TBfPNAKnw==", 2021-06-25T04:57:14.719 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2021-06-25T04:57:14.720 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2021-06-25T04:57:14.720 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2021-06-25T04:57:14.720 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2021-06-25T04:57:14.720 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.721 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:14.721 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:14.721 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:57:14.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 -- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa330055360 msgr2=0x7fa330057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.723 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa330055360 0x7fa330057820 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fa33c019000 tx=0x7fa33c016000).stop 2021-06-25T04:57:14.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 -- 172.21.15.57:0/1611946085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa34c0b1130 msgr2=0x7fa34c0b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa34c0b1130 0x7fa34c0b0b10 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7fa34c1431b0 tx=0x7fa334007ad0).stop 2021-06-25T04:57:14.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 -- 172.21.15.57:0/1611946085 shutdown_connections 2021-06-25T04:57:14.724 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa330055360 0x7fa330057820 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa34c1418e0 0x7fa34c137880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa34c0b77d0 0x7fa34c1423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 --2- 172.21.15.57:0/1611946085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa34c0b1130 0x7fa34c0b0b10 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 -- 172.21.15.57:0/1611946085 >> 172.21.15.57:0/1611946085 conn(0x7fa34c05f670 msgr2=0x7fa34c0b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:14.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 -- 172.21.15.57:0/1611946085 shutdown_connections 2021-06-25T04:57:14.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.682+0000 7fa35180e700 1 -- 172.21.15.57:0/1611946085 wait complete. 2021-06-25T04:57:14.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:57:14.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164ffff700 1 Processor -- start 2021-06-25T04:57:14.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164ffff700 1 -- start start 2021-06-25T04:57:14.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f16500af510 0x7f1650147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:14.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164ffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16500b5840 con 0x7f16500b05d0 2021-06-25T04:57:14.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164ffff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16500ac7c0 con 0x7f16500b5460 2021-06-25T04:57:14.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164ffff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16501452a0 con 0x7f16500af510 2021-06-25T04:57:14.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164e7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f16500b05d0 0x7f16500acc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33470/0 (socket says 172.21.15.57:33470) 2021-06-25T04:57:14.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164e7fc700 1 -- 172.21.15.57:0/891054704 learned_addr learned my addr 172.21.15.57:0/891054704 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:14.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164f7fe700 1 --2- 172.21.15.57:0/891054704 >> v2:172.21.15.57:3300/0 conn(0x7f16500af510 0x7f1650147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:14.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164dffb700 1 -- 172.21.15.57:0/891054704 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370546580 0 0) 0x7f16500b5840 con 0x7f16500b05d0 2021-06-25T04:57:14.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164dffb700 1 -- 172.21.15.57:0/891054704 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1630003260 con 0x7f16500b05d0 2021-06-25T04:57:14.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164dffb700 1 -- 172.21.15.57:0/891054704 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648120716 0 0) 0x7f16500ac7c0 con 0x7f16500b5460 2021-06-25T04:57:14.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164f7fe700 1 -- 172.21.15.57:0/891054704 >> v1:172.21.15.87:6789/0 conn(0x7f16500b5460 legacy=0x7f1650067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164f7fe700 1 -- 172.21.15.57:0/891054704 >> v1:172.21.15.57:6789/0 conn(0x7f16500b05d0 legacy=0x7f16500acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164f7fe700 1 -- 172.21.15.57:0/891054704 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16500b19f0 con 0x7f16500af510 2021-06-25T04:57:14.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164f7fe700 1 --2- 172.21.15.57:0/891054704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500af510 0x7f1650147560 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f1640002f70 tx=0x7f1640006df0).ready entity=mon.0 client_cookie=9bdbfcb59fea9a07 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:14.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164dffb700 1 -- 172.21.15.57:0/891054704 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f164000d610 con 0x7f16500af510 2021-06-25T04:57:14.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164dffb700 1 -- 172.21.15.57:0/891054704 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640000e90 con 0x7f16500af510 2021-06-25T04:57:14.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164dffb700 1 -- 172.21.15.57:0/891054704 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f164000d960 con 0x7f16500af510 2021-06-25T04:57:14.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164ffff700 1 -- 172.21.15.57:0/891054704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500af510 msgr2=0x7f1650147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.826+0000 7f164ffff700 1 --2- 172.21.15.57:0/891054704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500af510 0x7f1650147560 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f1640002f70 tx=0x7f1640006df0).stop 2021-06-25T04:57:14.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.830+0000 7f164ffff700 1 -- 172.21.15.57:0/891054704 shutdown_connections 2021-06-25T04:57:14.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.830+0000 7f164ffff700 1 --2- 172.21.15.57:0/891054704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500af510 0x7f1650147560 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.830+0000 7f164ffff700 1 -- 172.21.15.57:0/891054704 >> 172.21.15.57:0/891054704 conn(0x7f1650062520 msgr2=0x7f1650062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:14.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.830+0000 7f164ffff700 1 -- 172.21.15.57:0/891054704 shutdown_connections 2021-06-25T04:57:14.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.830+0000 7f164ffff700 1 -- 172.21.15.57:0/891054704 wait complete. 2021-06-25T04:57:14.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.830+0000 7f164ffff700 1 Processor -- start 2021-06-25T04:57:14.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.830+0000 7f164ffff700 1 -- start start 2021-06-25T04:57:14.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500af510 0x7f16500643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:14.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16500b05d0 0x7f16501568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16500b5460 0x7f1650156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164ffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16500adfb0 con 0x7f16500af510 2021-06-25T04:57:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164ffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16500636c0 con 0x7f16500b05d0 2021-06-25T04:57:14.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164ffff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1650063960 con 0x7f16500b5460 2021-06-25T04:57:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500af510 0x7f16500643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500af510 0x7f16500643c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44488/0 (socket says 172.21.15.57:44488) 2021-06-25T04:57:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164effd700 1 -- 172.21.15.57:0/902120755 learned_addr learned my addr 172.21.15.57:0/902120755 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164e7fc700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16500b05d0 0x7f16501568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:14.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164f7fe700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16500b5460 0x7f1650156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:14.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164effd700 1 -- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16500b5460 msgr2=0x7f1650156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164effd700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16500b5460 0x7f1650156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164effd700 1 -- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16500b05d0 msgr2=0x7f16501568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164effd700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16500b05d0 0x7f16501568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164effd700 1 -- 172.21.15.57:0/902120755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164000b180 con 0x7f16500af510 2021-06-25T04:57:14.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164effd700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500af510 0x7f16500643c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f1638000bc0 tx=0x7f1638007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:14.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f1647fff700 1 -- 172.21.15.57:0/902120755 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1638007e50 con 0x7f16500af510 2021-06-25T04:57:14.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f1647fff700 1 -- 172.21.15.57:0/902120755 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1638007030 con 0x7f16500af510 2021-06-25T04:57:14.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f1647fff700 1 -- 172.21.15.57:0/902120755 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1638007390 con 0x7f16500af510 2021-06-25T04:57:14.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164ffff700 1 -- 172.21.15.57:0/902120755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1650064be0 con 0x7f16500af510 2021-06-25T04:57:14.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.834+0000 7f164ffff700 1 -- 172.21.15.57:0/902120755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16501572b0 con 0x7f16500af510 2021-06-25T04:57:14.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.838+0000 7f164ffff700 1 -- 172.21.15.57:0/902120755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1650063b20 con 0x7f16500af510 2021-06-25T04:57:14.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.838+0000 7f1647fff700 1 -- 172.21.15.57:0/902120755 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1638006510 con 0x7f16500af510 2021-06-25T04:57:14.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.838+0000 7f1647fff700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1634055450 0x7f1634057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:14.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.838+0000 7f1647fff700 1 -- 172.21.15.57:0/902120755 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f163806d370 con 0x7f16500af510 2021-06-25T04:57:14.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.838+0000 7f164e7fc700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1634055450 0x7f1634057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:14.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.838+0000 7f164e7fc700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1634055450 0x7f1634057910 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f164800d000 tx=0x7f1648009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:14.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.842+0000 7f1647fff700 1 -- 172.21.15.57:0/902120755 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f1638043800 con 0x7f16500af510 2021-06-25T04:57:14.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.970+0000 7f164ffff700 1 -- 172.21.15.57:0/902120755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1650147fd0 con 0x7f16500af510 2021-06-25T04:57:14.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.974+0000 7f1647fff700 1 -- 172.21.15.57:0/902120755 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f1638046e20 con 0x7f16500af510 2021-06-25T04:57:14.979 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:14.980 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":154,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:57:14.356661+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:57:14.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 -- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1634055450 msgr2=0x7f1634057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1634055450 0x7f1634057910 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f164800d000 tx=0x7f1648009040).stop 2021-06-25T04:57:14.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 -- 172.21.15.57:0/902120755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500af510 msgr2=0x7f16500643c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:14.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500af510 0x7f16500643c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f1638000bc0 tx=0x7f1638007c00).stop 2021-06-25T04:57:14.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 -- 172.21.15.57:0/902120755 shutdown_connections 2021-06-25T04:57:14.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1634055450 0x7f1634057910 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16500b5460 0x7f1650156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.990 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16500b05d0 0x7f16501568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 --2- 172.21.15.57:0/902120755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16500af510 0x7f16500643c0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:14.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 -- 172.21.15.57:0/902120755 >> 172.21.15.57:0/902120755 conn(0x7f1650062520 msgr2=0x7f16501488d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:14.995 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 -- 172.21.15.57:0/902120755 shutdown_connections 2021-06-25T04:57:14.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:14.978+0000 7f164ffff700 1 -- 172.21.15.57:0/902120755 wait complete. 2021-06-25T04:57:15.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-06-25T04:57:15.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:57:15.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587e60e700 1 Processor -- start 2021-06-25T04:57:15.153 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587e60e700 1 -- start start 2021-06-25T04:57:15.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587e60e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58780b2540 0x7f587814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587e60e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f58780affd0 0x7f587814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587e60e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58780a7080 con 0x7f58780afb90 2021-06-25T04:57:15.154 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587e60e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58780a72b0 con 0x7f58780affd0 2021-06-25T04:57:15.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587e60e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58780a7550 con 0x7f58780b2540 2021-06-25T04:57:15.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587de0d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f58780afb90 0x7f58780a8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33484/0 (socket says 172.21.15.57:33484) 2021-06-25T04:57:15.155 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587de0d700 1 -- 172.21.15.57:0/530540414 learned_addr learned my addr 172.21.15.57:0/530540414 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:15.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587ce0b700 1 --2- 172.21.15.57:0/530540414 >> v2:172.21.15.87:3300/0 conn(0x7f58780affd0 0x7f587814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587d60c700 1 --2- 172.21.15.57:0/530540414 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58780b2540 0x7f587814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f586bfff700 1 -- 172.21.15.57:0/530540414 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269079104 0 0) 0x7f58780a7080 con 0x7f58780afb90 2021-06-25T04:57:15.156 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f586bfff700 1 -- 172.21.15.57:0/530540414 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f585c003260 con 0x7f58780afb90 2021-06-25T04:57:15.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f586bfff700 1 -- 172.21.15.57:0/530540414 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3828970123 0 0) 0x7f585c003260 con 0x7f58780afb90 2021-06-25T04:57:15.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587ce0b700 1 -- 172.21.15.57:0/530540414 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58780b2540 msgr2=0x7f587814ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:15.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587ce0b700 1 --2- 172.21.15.57:0/530540414 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58780b2540 0x7f587814ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587ce0b700 1 -- 172.21.15.57:0/530540414 >> v1:172.21.15.57:6789/0 conn(0x7f58780afb90 legacy=0x7f58780a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587ce0b700 1 -- 172.21.15.57:0/530540414 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58780a77f0 con 0x7f58780affd0 2021-06-25T04:57:15.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587ce0b700 1 --2- 172.21.15.57:0/530540414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58780affd0 0x7f587814b2f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f5870001800 tx=0x7f586c0091d0).ready entity=mon.1 client_cookie=e8b275bc95d93ed0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:15.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f586bfff700 1 -- 172.21.15.57:0/530540414 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5870001660 con 0x7f58780affd0 2021-06-25T04:57:15.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f586bfff700 1 -- 172.21.15.57:0/530540414 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c00f510 con 0x7f58780affd0 2021-06-25T04:57:15.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f586bfff700 1 -- 172.21.15.57:0/530540414 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f586c00f680 con 0x7f58780affd0 2021-06-25T04:57:15.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587e60e700 1 -- 172.21.15.57:0/530540414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58780affd0 msgr2=0x7f587814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.138+0000 7f587e60e700 1 --2- 172.21.15.57:0/530540414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58780affd0 0x7f587814b2f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f5870001800 tx=0x7f586c0091d0).stop 2021-06-25T04:57:15.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 -- 172.21.15.57:0/530540414 shutdown_connections 2021-06-25T04:57:15.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 --2- 172.21.15.57:0/530540414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58780affd0 0x7f587814b2f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 --2- 172.21.15.57:0/530540414 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58780b2540 0x7f587814ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 -- 172.21.15.57:0/530540414 >> 172.21.15.57:0/530540414 conn(0x7f5878060140 msgr2=0x7f58780b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:15.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 -- 172.21.15.57:0/530540414 shutdown_connections 2021-06-25T04:57:15.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 -- 172.21.15.57:0/530540414 wait complete. 2021-06-25T04:57:15.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 Processor -- start 2021-06-25T04:57:15.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 -- start start 2021-06-25T04:57:15.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58780afb90 0x7f58780adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58780affd0 0x7f58780aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58780b2540 0x7f587814d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587814cc80 con 0x7f58780affd0 2021-06-25T04:57:15.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58780ab260 con 0x7f58780afb90 2021-06-25T04:57:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587e60e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587814dc90 con 0x7f58780b2540 2021-06-25T04:57:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587ce0b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58780affd0 0x7f58780aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.142+0000 7f587d60c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58780afb90 0x7f58780adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587ce0b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58780affd0 0x7f58780aad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44502/0 (socket says 172.21.15.57:44502) 2021-06-25T04:57:15.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587d60c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58780afb90 0x7f58780adcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:52994/0 (socket says 172.21.15.57:52994) 2021-06-25T04:57:15.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587ce0b700 1 -- 172.21.15.57:0/2461655737 learned_addr learned my addr 172.21.15.57:0/2461655737 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:15.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587de0d700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58780b2540 0x7f587814d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.164 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587ce0b700 1 -- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58780b2540 msgr2=0x7f587814d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587ce0b700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58780b2540 0x7f587814d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587ce0b700 1 -- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58780afb90 msgr2=0x7f58780adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587ce0b700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58780afb90 0x7f58780adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.165 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587ce0b700 1 -- 172.21.15.57:0/2461655737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c009470 con 0x7f58780affd0 2021-06-25T04:57:15.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587ce0b700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58780affd0 0x7f58780aad70 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f5870001800 tx=0x7f586c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:15.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f586affd700 1 -- 172.21.15.57:0/2461655737 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f586c006ea0 con 0x7f58780affd0 2021-06-25T04:57:15.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f586affd700 1 -- 172.21.15.57:0/2461655737 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c0032d0 con 0x7f58780affd0 2021-06-25T04:57:15.166 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587e60e700 1 -- 172.21.15.57:0/2461655737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587814df30 con 0x7f58780affd0 2021-06-25T04:57:15.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f586affd700 1 -- 172.21.15.57:0/2461655737 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f586c011d50 con 0x7f58780affd0 2021-06-25T04:57:15.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587e60e700 1 -- 172.21.15.57:0/2461655737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587814d980 con 0x7f58780affd0 2021-06-25T04:57:15.167 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f587e60e700 1 -- 172.21.15.57:0/2461655737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587814ce40 con 0x7f58780affd0 2021-06-25T04:57:15.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.146+0000 7f586affd700 1 -- 172.21.15.57:0/2461655737 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f586c00f070 con 0x7f58780affd0 2021-06-25T04:57:15.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.150+0000 7f586affd700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5854055450 0x7f5854057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.150+0000 7f586affd700 1 -- 172.21.15.57:0/2461655737 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f586c06e380 con 0x7f58780affd0 2021-06-25T04:57:15.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.150+0000 7f587d60c700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5854055450 0x7f5854057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.150+0000 7f587d60c700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5854055450 0x7f5854057910 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f587400b000 tx=0x7f5874006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:15.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.158+0000 7f586affd700 1 -- 172.21.15.57:0/2461655737 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f587814ce40 con 0x7f58780affd0 2021-06-25T04:57:15.308 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.302+0000 7f587e60e700 1 -- 172.21.15.57:0/2461655737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f587814ce40 con 0x7f58780affd0 2021-06-25T04:57:15.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.302+0000 7f586affd700 1 -- 172.21.15.57:0/2461655737 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v154) v1 ==== 110+0+10 (secure 0 0 0) 0x7f587814ce40 con 0x7f58780affd0 2021-06-25T04:57:15.309 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:57:15.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 -- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5854055450 msgr2=0x7f5854057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5854055450 0x7f5854057910 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f587400b000 tx=0x7f5874006df0).stop 2021-06-25T04:57:15.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 -- 172.21.15.57:0/2461655737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58780affd0 msgr2=0x7f58780aad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58780affd0 0x7f58780aad70 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f5870001800 tx=0x7f586c016000).stop 2021-06-25T04:57:15.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 -- 172.21.15.57:0/2461655737 shutdown_connections 2021-06-25T04:57:15.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5854055450 0x7f5854057910 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58780b2540 0x7f587814d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58780affd0 0x7f58780aad70 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 --2- 172.21.15.57:0/2461655737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58780afb90 0x7f58780adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 -- 172.21.15.57:0/2461655737 >> 172.21.15.57:0/2461655737 conn(0x7f5878060140 msgr2=0x7f58781445f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:15.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 -- 172.21.15.57:0/2461655737 shutdown_connections 2021-06-25T04:57:15.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.306+0000 7f587e60e700 1 -- 172.21.15.57:0/2461655737 wait complete. 2021-06-25T04:57:15.328 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:57:15.447 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f0575639700 1 Processor -- start 2021-06-25T04:57:15.448 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f0575639700 1 -- start start 2021-06-25T04:57:15.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f0575639700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700b3550 0x7f05701413c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f0575639700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05700ad8b0 con 0x7f05700b3170 2021-06-25T04:57:15.453 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f0575639700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05700afec0 con 0x7f0570145050 2021-06-25T04:57:15.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f0575639700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0570145520 con 0x7f05700b3550 2021-06-25T04:57:15.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f05700b3170 0x7f057013e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33494/0 (socket says 172.21.15.57:33494) 2021-06-25T04:57:15.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056effd700 1 -- 172.21.15.57:0/1482885607 learned_addr learned my addr 172.21.15.57:0/1482885607 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:15.454 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056e7fc700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700b3550 0x7f05701413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875131959 0 0) 0x7f05700ad8b0 con 0x7f05700b3170 2021-06-25T04:57:15.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0550003260 con 0x7f05700b3170 2021-06-25T04:57:15.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690312820 0 0) 0x7f05700afec0 con 0x7f0570145050 2021-06-25T04:57:15.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05700ad8b0 con 0x7f0570145050 2021-06-25T04:57:15.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1342368371 0 0) 0x7f0550003260 con 0x7f05700b3170 2021-06-25T04:57:15.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700b3550 msgr2=0x7f05701413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:15.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700b3550 0x7f05701413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.456 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 >> v1:172.21.15.87:6789/0 conn(0x7f0570145050 legacy=0x7f05701418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700b0120 con 0x7f05700b3170 2021-06-25T04:57:15.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f0560001660 con 0x7f05700b3170 2021-06-25T04:57:15.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 >> v1:172.21.15.57:6789/0 conn(0x7f05700b3170 legacy=0x7f057013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0550003910 0x7f0550003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700b3550 0x7f0550004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05500049f0 0x7f0550004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570145520 con 0x7f05500049f0 2021-06-25T04:57:15.458 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055000b7b0 con 0x7f0550003910 2021-06-25T04:57:15.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.442+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055000b970 con 0x7f05700b3550 2021-06-25T04:57:15.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056e7fc700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700b3550 0x7f0550004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056effd700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0550003910 0x7f0550003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056f7fe700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05500049f0 0x7f0550004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.459 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056f7fe700 1 -- 172.21.15.57:0/1482885607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700b3550 msgr2=0x7f0550004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:15.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056f7fe700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700b3550 0x7f0550004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056f7fe700 1 -- 172.21.15.57:0/1482885607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0550003910 msgr2=0x7f0550003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:15.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056f7fe700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0550003910 0x7f0550003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.460 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056f7fe700 1 -- 172.21.15.57:0/1482885607 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0550003260 con 0x7f05500049f0 2021-06-25T04:57:15.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056f7fe700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05500049f0 0x7f0550004e70 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f0568001490 tx=0x7f0568007d80).ready entity=mon.0 client_cookie=f7f34f0c2dcc0f96 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:15.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0568001780 con 0x7f05500049f0 2021-06-25T04:57:15.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0568006890 con 0x7f05500049f0 2021-06-25T04:57:15.461 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056dffb700 1 -- 172.21.15.57:0/1482885607 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0568006bf0 con 0x7f05500049f0 2021-06-25T04:57:15.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f0575639700 1 -- 172.21.15.57:0/1482885607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05500049f0 msgr2=0x7f0550004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f0575639700 1 --2- 172.21.15.57:0/1482885607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05500049f0 0x7f0550004e70 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f0568001490 tx=0x7f0568007d80).stop 2021-06-25T04:57:15.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f056f7fe700 1 -- 172.21.15.57:0/1482885607 reap_dead start 2021-06-25T04:57:15.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f0575639700 1 -- 172.21.15.57:0/1482885607 shutdown_connections 2021-06-25T04:57:15.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f0575639700 1 -- 172.21.15.57:0/1482885607 >> 172.21.15.57:0/1482885607 conn(0x7f0570060780 msgr2=0x7f0570060b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:15.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f0575639700 1 -- 172.21.15.57:0/1482885607 shutdown_connections 2021-06-25T04:57:15.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.446+0000 7f0575639700 1 -- 172.21.15.57:0/1482885607 wait complete. 2021-06-25T04:57:15.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0575639700 1 Processor -- start 2021-06-25T04:57:15.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0575639700 1 -- start start 2021-06-25T04:57:15.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0575639700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0570140450 0x7f05701424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0575639700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700675e0 0x7f0570151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0575639700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f057013b720 0x7f057013bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0575639700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570144610 con 0x7f0570140450 2021-06-25T04:57:15.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0575639700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701448b0 con 0x7f057013b720 2021-06-25T04:57:15.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0575639700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0570150940 con 0x7f05700675e0 2021-06-25T04:57:15.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f056effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0570140450 0x7f05701424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f056effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0570140450 0x7f05701424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44520/0 (socket says 172.21.15.57:44520) 2021-06-25T04:57:15.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f056effd700 1 -- 172.21.15.57:0/1095833001 learned_addr learned my addr 172.21.15.57:0/1095833001 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:15.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f056e7fc700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700675e0 0x7f0570151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f056f7fe700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f057013b720 0x7f057013bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f056effd700 1 -- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700675e0 msgr2=0x7f0570151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f056effd700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700675e0 0x7f0570151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f056effd700 1 -- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f057013b720 msgr2=0x7f057013bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f056effd700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f057013b720 0x7f057013bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f056effd700 1 -- 172.21.15.57:0/1095833001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570150be0 con 0x7f0570140450 2021-06-25T04:57:15.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f056effd700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0570140450 0x7f05701424a0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f056000d000 tx=0x7f05700b02b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:15.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0567fff700 1 -- 172.21.15.57:0/1095833001 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05600116b0 con 0x7f0570140450 2021-06-25T04:57:15.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0567fff700 1 -- 172.21.15.57:0/1095833001 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560011810 con 0x7f0570140450 2021-06-25T04:57:15.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0575639700 1 -- 172.21.15.57:0/1095833001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05701438b0 con 0x7f0570140450 2021-06-25T04:57:15.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0567fff700 1 -- 172.21.15.57:0/1095833001 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0560011b70 con 0x7f0570140450 2021-06-25T04:57:15.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.450+0000 7f0575639700 1 -- 172.21.15.57:0/1095833001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0570144290 con 0x7f0570140450 2021-06-25T04:57:15.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.454+0000 7f0575639700 1 -- 172.21.15.57:0/1095833001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0570057310 con 0x7f0570140450 2021-06-25T04:57:15.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.454+0000 7f0567fff700 1 -- 172.21.15.57:0/1095833001 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f056001b030 con 0x7f0570140450 2021-06-25T04:57:15.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.454+0000 7f0567fff700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05540554e0 0x7f05540579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.454+0000 7f0567fff700 1 -- 172.21.15.57:0/1095833001 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f056006d710 con 0x7f0570140450 2021-06-25T04:57:15.472 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.454+0000 7f056e7fc700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05540554e0 0x7f05540579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.454+0000 7f056e7fc700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05540554e0 0x7f05540579a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f055800b000 tx=0x7f0558006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:15.473 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.462+0000 7f0567fff700 1 -- 172.21.15.57:0/1095833001 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f0560043a70 con 0x7f0570140450 2021-06-25T04:57:15.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.594+0000 7f0575639700 1 -- 172.21.15.57:0/1095833001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05700b3a80 con 0x7f0570140450 2021-06-25T04:57:15.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0567fff700 1 -- 172.21.15.57:0/1095833001 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v154) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0560019030 con 0x7f0570140450 2021-06-25T04:57:15.602 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:57:15.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 -- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05540554e0 msgr2=0x7f05540579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05540554e0 0x7f05540579a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f055800b000 tx=0x7f0558006df0).stop 2021-06-25T04:57:15.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 -- 172.21.15.57:0/1095833001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0570140450 msgr2=0x7f05701424a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0570140450 0x7f05701424a0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f056000d000 tx=0x7f05700b02b0).stop 2021-06-25T04:57:15.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 -- 172.21.15.57:0/1095833001 shutdown_connections 2021-06-25T04:57:15.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f05540554e0 0x7f05540579a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f057013b720 0x7f057013bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05700675e0 0x7f0570151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 --2- 172.21.15.57:0/1095833001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0570140450 0x7f05701424a0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 -- 172.21.15.57:0/1095833001 >> 172.21.15.57:0/1095833001 conn(0x7f0570060780 msgr2=0x7f05700b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:15.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 -- 172.21.15.57:0/1095833001 shutdown_connections 2021-06-25T04:57:15.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.598+0000 7f0575639700 1 -- 172.21.15.57:0/1095833001 wait complete. 2021-06-25T04:57:15.622 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-06-25T04:57:15.725 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.718+0000 7ffa3d885700 1 Processor -- start 2021-06-25T04:57:15.726 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.718+0000 7ffa3d885700 1 -- start start 2021-06-25T04:57:15.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.718+0000 7ffa3d885700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffa38061640 0x7ffa380b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.718+0000 7ffa3d885700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa380b68d0 con 0x7ffa380b46d0 2021-06-25T04:57:15.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.718+0000 7ffa3d885700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa380b6b70 con 0x7ffa38143960 2021-06-25T04:57:15.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.718+0000 7ffa3d885700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa380b9640 con 0x7ffa38061640 2021-06-25T04:57:15.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa37fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffa380b46d0 0x7ffa3813fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33514/0 (socket says 172.21.15.57:33514) 2021-06-25T04:57:15.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa37fff700 1 -- 172.21.15.57:0/3086673036 learned_addr learned my addr 172.21.15.57:0/3086673036 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:15.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3c883700 1 --2- 172.21.15.57:0/3086673036 >> v2:172.21.15.87:3300/0 conn(0x7ffa38061640 0x7ffa380b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa377fe700 1 -- 172.21.15.57:0/3086673036 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112330010 0 0) 0x7ffa380b68d0 con 0x7ffa380b46d0 2021-06-25T04:57:15.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa377fe700 1 -- 172.21.15.57:0/3086673036 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa1c003260 con 0x7ffa380b46d0 2021-06-25T04:57:15.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3c883700 1 -- 172.21.15.57:0/3086673036 >> v1:172.21.15.87:6789/0 conn(0x7ffa38143960 legacy=0x7ffa3814d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3c883700 1 -- 172.21.15.57:0/3086673036 >> v1:172.21.15.57:6789/0 conn(0x7ffa380b46d0 legacy=0x7ffa3813fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3c883700 1 -- 172.21.15.57:0/3086673036 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380b6e10 con 0x7ffa38061640 2021-06-25T04:57:15.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3c883700 1 --2- 172.21.15.57:0/3086673036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa38061640 0x7ffa380b9cd0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7ffa300032f0 tx=0x7ffa300091d0).ready entity=mon.1 client_cookie=b05c7e634f6c355b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:15.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa377fe700 1 -- 172.21.15.57:0/3086673036 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa3000b6c0 con 0x7ffa38061640 2021-06-25T04:57:15.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa377fe700 1 -- 172.21.15.57:0/3086673036 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3000b820 con 0x7ffa38061640 2021-06-25T04:57:15.745 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa377fe700 1 -- 172.21.15.57:0/3086673036 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa3000b990 con 0x7ffa38061640 2021-06-25T04:57:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3d885700 1 -- 172.21.15.57:0/3086673036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa38061640 msgr2=0x7ffa380b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3d885700 1 --2- 172.21.15.57:0/3086673036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa38061640 0x7ffa380b9cd0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7ffa300032f0 tx=0x7ffa300091d0).stop 2021-06-25T04:57:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3d885700 1 -- 172.21.15.57:0/3086673036 shutdown_connections 2021-06-25T04:57:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3d885700 1 --2- 172.21.15.57:0/3086673036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa38061640 0x7ffa380b9cd0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3d885700 1 -- 172.21.15.57:0/3086673036 >> 172.21.15.57:0/3086673036 conn(0x7ffa3806adb0 msgr2=0x7ffa3805f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3d885700 1 -- 172.21.15.57:0/3086673036 shutdown_connections 2021-06-25T04:57:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.722+0000 7ffa3d885700 1 -- 172.21.15.57:0/3086673036 wait complete. 2021-06-25T04:57:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d885700 1 Processor -- start 2021-06-25T04:57:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d885700 1 -- start start 2021-06-25T04:57:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d885700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa38061640 0x7ffa381444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d885700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa38143960 0x7ffa3813b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d885700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa3813a630 0x7ffa380b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d885700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3813ac90 con 0x7ffa38143960 2021-06-25T04:57:15.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d885700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3813af30 con 0x7ffa3813a630 2021-06-25T04:57:15.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d885700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3813b4e0 con 0x7ffa38061640 2021-06-25T04:57:15.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa37fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa38143960 0x7ffa3813b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa37fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa38143960 0x7ffa3813b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44536/0 (socket says 172.21.15.57:44536) 2021-06-25T04:57:15.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d084700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa3813a630 0x7ffa380b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa37fff700 1 -- 172.21.15.57:0/2934087048 learned_addr learned my addr 172.21.15.57:0/2934087048 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:15.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3c883700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa38061640 0x7ffa381444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa37fff700 1 -- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa38061640 msgr2=0x7ffa381444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa37fff700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa38061640 0x7ffa381444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa37fff700 1 -- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa3813a630 msgr2=0x7ffa380b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa37fff700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa3813a630 0x7ffa380b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa37fff700 1 -- 172.21.15.57:0/2934087048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa30009470 con 0x7ffa38143960 2021-06-25T04:57:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa37fff700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa38143960 0x7ffa3813b980 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7ffa20001110 tx=0x7ffa20007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa35ffb700 1 -- 172.21.15.57:0/2934087048 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa200070d0 con 0x7ffa38143960 2021-06-25T04:57:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa35ffb700 1 -- 172.21.15.57:0/2934087048 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa20007230 con 0x7ffa38143960 2021-06-25T04:57:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d885700 1 -- 172.21.15.57:0/2934087048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa381471c0 con 0x7ffa38143960 2021-06-25T04:57:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa35ffb700 1 -- 172.21.15.57:0/2934087048 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa20005610 con 0x7ffa38143960 2021-06-25T04:57:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d885700 1 -- 172.21.15.57:0/2934087048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa380b77e0 con 0x7ffa38143960 2021-06-25T04:57:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.726+0000 7ffa3d885700 1 -- 172.21.15.57:0/2934087048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3813b340 con 0x7ffa38143960 2021-06-25T04:57:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.730+0000 7ffa35ffb700 1 -- 172.21.15.57:0/2934087048 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ffa20010070 con 0x7ffa38143960 2021-06-25T04:57:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.730+0000 7ffa35ffb700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa100553b0 0x7ffa10057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.730+0000 7ffa35ffb700 1 -- 172.21.15.57:0/2934087048 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ffa2006d1c0 con 0x7ffa38143960 2021-06-25T04:57:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.730+0000 7ffa3c883700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa100553b0 0x7ffa10057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.730+0000 7ffa3c883700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa100553b0 0x7ffa10057870 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7ffa3001b000 tx=0x7ffa30016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.734+0000 7ffa35ffb700 1 -- 172.21.15.57:0/2934087048 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ffa3813b340 con 0x7ffa38143960 2021-06-25T04:57:15.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.858+0000 7ffa3d885700 1 -- 172.21.15.57:0/2934087048 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffa3813b340 con 0x7ffa38143960 2021-06-25T04:57:15.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.858+0000 7ffa35ffb700 1 -- 172.21.15.57:0/2934087048 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v154) v1 ==== 84+0+143 (secure 0 0 0) 0x7ffa3813b340 con 0x7ffa38143960 2021-06-25T04:57:15.868 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:15.868 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2021-06-25T04:57:15.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:15.869 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2021-06-25T04:57:15.869 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2021-06-25T04:57:15.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:15.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:15.871 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2021-06-25T04:57:15.871 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2021-06-25T04:57:15.871 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:15.872 INFO:teuthology.orchestra.run.smithi057.stdout:] 2021-06-25T04:57:15.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 -- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa100553b0 msgr2=0x7ffa10057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.875 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa100553b0 0x7ffa10057870 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7ffa3001b000 tx=0x7ffa30016000).stop 2021-06-25T04:57:15.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 -- 172.21.15.57:0/2934087048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa38143960 msgr2=0x7ffa3813b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.876 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa38143960 0x7ffa3813b980 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7ffa20001110 tx=0x7ffa20007ad0).stop 2021-06-25T04:57:15.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 -- 172.21.15.57:0/2934087048 shutdown_connections 2021-06-25T04:57:15.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffa100553b0 0x7ffa10057870 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.877 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa3813a630 0x7ffa380b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa38143960 0x7ffa3813b980 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.878 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 --2- 172.21.15.57:0/2934087048 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa38061640 0x7ffa381444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:15.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 -- 172.21.15.57:0/2934087048 >> 172.21.15.57:0/2934087048 conn(0x7ffa3806adb0 msgr2=0x7ffa380b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:15.879 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 -- 172.21.15.57:0/2934087048 shutdown_connections 2021-06-25T04:57:15.880 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.862+0000 7ffa3d885700 1 -- 172.21.15.57:0/2934087048 wait complete. 2021-06-25T04:57:15.882 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-06-25T04:57:15.882 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-06-25T04:57:15.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f69c0a700 1 Processor -- start 2021-06-25T04:57:15.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f69c0a700 1 -- start start 2021-06-25T04:57:15.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f69c0a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f640affd0 0x7f3f640a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:15.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f69c0a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f640a7080 con 0x7f3f640b2540 2021-06-25T04:57:15.996 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f69c0a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f640a72b0 con 0x7f3f640afb90 2021-06-25T04:57:15.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f69c0a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640a7550 con 0x7f3f640affd0 2021-06-25T04:57:15.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f68c08700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3f640b2540 0x7f3f6414ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33528/0 (socket says 172.21.15.57:33528) 2021-06-25T04:57:15.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f68c08700 1 -- 172.21.15.57:0/3017428026 learned_addr learned my addr 172.21.15.57:0/3017428026 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:15.997 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f63fff700 1 --2- 172.21.15.57:0/3017428026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f640affd0 0x7f3f640a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:15.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f637fe700 1 -- 172.21.15.57:0/3017428026 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461188388 0 0) 0x7f3f640a7080 con 0x7f3f640b2540 2021-06-25T04:57:15.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f637fe700 1 -- 172.21.15.57:0/3017428026 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f50003260 con 0x7f3f640b2540 2021-06-25T04:57:15.998 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f637fe700 1 -- 172.21.15.57:0/3017428026 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347610431 0 0) 0x7f3f640a72b0 con 0x7f3f640afb90 2021-06-25T04:57:15.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f637fe700 1 -- 172.21.15.57:0/3017428026 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f640a7080 con 0x7f3f640afb90 2021-06-25T04:57:15.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f63fff700 1 -- 172.21.15.57:0/3017428026 >> v1:172.21.15.87:6789/0 conn(0x7f3f640afb90 legacy=0x7f3f64151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f63fff700 1 -- 172.21.15.57:0/3017428026 >> v1:172.21.15.57:6789/0 conn(0x7f3f640b2540 legacy=0x7f3f6414ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:15.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f63fff700 1 -- 172.21.15.57:0/3017428026 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f640a77f0 con 0x7f3f640affd0 2021-06-25T04:57:15.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.986+0000 7f3f63fff700 1 --2- 172.21.15.57:0/3017428026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f640affd0 0x7f3f640a8370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f3f540032f0 tx=0x7f3f540091d0).ready entity=mon.2 client_cookie=5ec01f5b33964abd server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:16.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f637fe700 1 -- 172.21.15.57:0/3017428026 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f5400b640 con 0x7f3f640affd0 2021-06-25T04:57:16.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f637fe700 1 -- 172.21.15.57:0/3017428026 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5400b7a0 con 0x7f3f640affd0 2021-06-25T04:57:16.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f637fe700 1 -- 172.21.15.57:0/3017428026 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f5400b910 con 0x7f3f640affd0 2021-06-25T04:57:16.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3017428026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f640affd0 msgr2=0x7f3f640a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:16.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f69c0a700 1 --2- 172.21.15.57:0/3017428026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f640affd0 0x7f3f640a8370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f3f540032f0 tx=0x7f3f540091d0).stop 2021-06-25T04:57:16.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3017428026 shutdown_connections 2021-06-25T04:57:16.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f69c0a700 1 --2- 172.21.15.57:0/3017428026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f640affd0 0x7f3f640a8370 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:16.001 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3017428026 >> 172.21.15.57:0/3017428026 conn(0x7f3f64060140 msgr2=0x7f3f640b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:16.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3017428026 shutdown_connections 2021-06-25T04:57:16.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3017428026 wait complete. 2021-06-25T04:57:16.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f69c0a700 1 Processor -- start 2021-06-25T04:57:16.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.990+0000 7f3f69c0a700 1 -- start start 2021-06-25T04:57:16.007 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69c0a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f640afb90 0x7f3f64159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:16.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69c0a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f640affd0 0x7f3f64159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:16.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69c0a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f640b2540 0x7f3f640aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:16.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69c0a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640ac020 con 0x7f3f640b2540 2021-06-25T04:57:16.008 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69c0a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640b58a0 con 0x7f3f640affd0 2021-06-25T04:57:16.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69c0a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f64063060 con 0x7f3f640afb90 2021-06-25T04:57:16.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69409700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f640b2540 0x7f3f640aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:16.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69409700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f640b2540 0x7f3f640aa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44552/0 (socket says 172.21.15.57:44552) 2021-06-25T04:57:16.009 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f63fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f640affd0 0x7f3f64159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:16.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69409700 1 -- 172.21.15.57:0/3806853841 learned_addr learned my addr 172.21.15.57:0/3806853841 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:16.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f68c08700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f640afb90 0x7f3f64159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:16.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69409700 1 -- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f640afb90 msgr2=0x7f3f64159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:16.010 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69409700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f640afb90 0x7f3f64159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:16.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69409700 1 -- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f640affd0 msgr2=0x7f3f64159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:16.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69409700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f640affd0 0x7f3f64159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:16.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69409700 1 -- 172.21.15.57:0/3806853841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f54009470 con 0x7f3f640b2540 2021-06-25T04:57:16.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f63fff700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f640affd0 0x7f3f64159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:16.011 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69409700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f640b2540 0x7f3f640aa0f0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f3f5c001110 tx=0x7f3f5c007a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:16.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f61ffb700 1 -- 172.21.15.57:0/3806853841 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f5c012400 con 0x7f3f640b2540 2021-06-25T04:57:16.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f61ffb700 1 -- 172.21.15.57:0/3806853841 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c012560 con 0x7f3f640b2540 2021-06-25T04:57:16.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3806853841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f64063300 con 0x7f3f640b2540 2021-06-25T04:57:16.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f61ffb700 1 -- 172.21.15.57:0/3806853841 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f5c0128c0 con 0x7f3f640b2540 2021-06-25T04:57:16.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3806853841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f640b5590 con 0x7f3f640b2540 2021-06-25T04:57:16.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.994+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3806853841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f640ac1e0 con 0x7f3f640b2540 2021-06-25T04:57:16.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.998+0000 7f3f61ffb700 1 -- 172.21.15.57:0/3806853841 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3f5c019030 con 0x7f3f640b2540 2021-06-25T04:57:16.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.998+0000 7f3f61ffb700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f440553f0 0x7f3f440578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:16.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.998+0000 7f3f61ffb700 1 -- 172.21.15.57:0/3806853841 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f3f5c06ce30 con 0x7f3f640b2540 2021-06-25T04:57:16.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.998+0000 7f3f68c08700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f440553f0 0x7f3f440578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:16.014 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:15.998+0000 7f3f68c08700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f440553f0 0x7f3f440578b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f3f5800d000 tx=0x7f3f58009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:16.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:16.002+0000 7f3f61ffb700 1 -- 172.21.15.57:0/3806853841 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3f640ac1e0 con 0x7f3f640b2540 2021-06-25T04:57:16.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:16.134+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3806853841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f3f640ac1e0 con 0x7f3f640b2540 2021-06-25T04:57:17.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.042+0000 7f3f61ffb700 1 -- 172.21.15.57:0/3806853841 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v155) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3f640ac1e0 con 0x7f3f640b2540 2021-06-25T04:57:17.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f440553f0 msgr2=0x7f3f440578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f440553f0 0x7f3f440578b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f3f5800d000 tx=0x7f3f58009040).stop 2021-06-25T04:57:17.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3806853841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f640b2540 msgr2=0x7f3f640aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f640b2540 0x7f3f640aa0f0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f3f5c001110 tx=0x7f3f5c007a50).stop 2021-06-25T04:57:17.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3806853841 shutdown_connections 2021-06-25T04:57:17.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3f440553f0 0x7f3f440578b0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f640b2540 0x7f3f640aa0f0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f640affd0 0x7f3f64159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 --2- 172.21.15.57:0/3806853841 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f640afb90 0x7f3f64159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3806853841 >> 172.21.15.57:0/3806853841 conn(0x7f3f64060140 msgr2=0x7f3f64148680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:17.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3806853841 shutdown_connections 2021-06-25T04:57:17.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.046+0000 7f3f69c0a700 1 -- 172.21.15.57:0/3806853841 wait complete. 2021-06-25T04:57:17.054 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2021-06-25T04:57:17.064 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-06-25T04:57:17.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.166+0000 7f3e120a3700 1 Processor -- start 2021-06-25T04:57:17.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.166+0000 7f3e120a3700 1 -- start start 2021-06-25T04:57:17.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.166+0000 7f3e120a3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3e0c146910 0x7f3e0c1401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.166+0000 7f3e120a3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4650 0x7f3e0c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.166+0000 7f3e120a3700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0c143b20 con 0x7f3e0c0b4140 2021-06-25T04:57:17.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.166+0000 7f3e120a3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c1474d0 con 0x7f3e0c146910 2021-06-25T04:57:17.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.166+0000 7f3e120a3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c143dc0 con 0x7f3e0c0b4650 2021-06-25T04:57:17.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4650 0x7f3e0c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0bfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4650 0x7f3e0c0b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:55724/0 (socket says 172.21.15.57:55724) 2021-06-25T04:57:17.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0bfff700 1 -- 172.21.15.57:0/2075189660 learned_addr learned my addr 172.21.15.57:0/2075189660 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:17.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0b7fe700 1 --2- 172.21.15.57:0/2075189660 >> v2:172.21.15.87:3300/0 conn(0x7f3e0c146910 0x7f3e0c1401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0bfff700 1 -- 172.21.15.57:0/2075189660 >> v2:172.21.15.87:3300/0 conn(0x7f3e0c146910 msgr2=0x7f3e0c1401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:17.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0bfff700 1 --2- 172.21.15.57:0/2075189660 >> v2:172.21.15.87:3300/0 conn(0x7f3e0c146910 0x7f3e0c1401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0bfff700 1 -- 172.21.15.57:0/2075189660 >> v1:172.21.15.87:6789/0 conn(0x7f3e0c0b4140 legacy=0x7f3e0c1406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0bfff700 1 -- 172.21.15.57:0/2075189660 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c0b0c50 con 0x7f3e0c0b4650 2021-06-25T04:57:17.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0bfff700 1 --2- 172.21.15.57:0/2075189660 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4650 0x7f3e0c0b4e90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f3e040032f0 tx=0x7f3e04009290).ready entity=mon.2 client_cookie=bf53ecbcc069f714 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:17.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0a7fc700 1 -- 172.21.15.57:0/2075189660 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0400b8a0 con 0x7f3e0c0b4650 2021-06-25T04:57:17.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0a7fc700 1 -- 172.21.15.57:0/2075189660 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0400ba00 con 0x7f3e0c0b4650 2021-06-25T04:57:17.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e0a7fc700 1 -- 172.21.15.57:0/2075189660 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0400bb70 con 0x7f3e0c0b4650 2021-06-25T04:57:17.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e120a3700 1 -- 172.21.15.57:0/2075189660 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4650 msgr2=0x7f3e0c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e120a3700 1 --2- 172.21.15.57:0/2075189660 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4650 0x7f3e0c0b4e90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f3e040032f0 tx=0x7f3e04009290).stop 2021-06-25T04:57:17.184 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e120a3700 1 -- 172.21.15.57:0/2075189660 shutdown_connections 2021-06-25T04:57:17.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e120a3700 1 --2- 172.21.15.57:0/2075189660 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4650 0x7f3e0c0b4e90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e120a3700 1 --2- 172.21.15.57:0/2075189660 >> v2:172.21.15.87:3300/0 conn(0x7f3e0c146910 0x7f3e0c1401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e120a3700 1 -- 172.21.15.57:0/2075189660 >> 172.21.15.57:0/2075189660 conn(0x7f3e0c05c450 msgr2=0x7f3e0c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:17.185 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e120a3700 1 -- 172.21.15.57:0/2075189660 shutdown_connections 2021-06-25T04:57:17.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e120a3700 1 -- 172.21.15.57:0/2075189660 wait complete. 2021-06-25T04:57:17.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e120a3700 1 Processor -- start 2021-06-25T04:57:17.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.170+0000 7f3e120a3700 1 -- start start 2021-06-25T04:57:17.186 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e120a3700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4140 0x7f3e0c13f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e120a3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e0c0b4650 0x7f3e0c136f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e120a3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e0c146910 0x7f3e0c137420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e120a3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c139d40 con 0x7f3e0c0b4650 2021-06-25T04:57:17.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e120a3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c139fa0 con 0x7f3e0c146910 2021-06-25T04:57:17.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e120a3700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c13a240 con 0x7f3e0c0b4140 2021-06-25T04:57:17.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e0affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e0c0b4650 0x7f3e0c136f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e0affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e0c0b4650 0x7f3e0c136f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44564/0 (socket says 172.21.15.57:44564) 2021-06-25T04:57:17.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e0affd700 1 -- 172.21.15.57:0/2895759109 learned_addr learned my addr 172.21.15.57:0/2895759109 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:17.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e0b7fe700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4140 0x7f3e0c13f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e0bfff700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e0c146910 0x7f3e0c137420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e0b7fe700 1 -- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e0c146910 msgr2=0x7f3e0c137420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e0b7fe700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e0c146910 0x7f3e0c137420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.189 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e0b7fe700 1 -- 172.21.15.57:0/2895759109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e0c0b4650 msgr2=0x7f3e0c136f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e0b7fe700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e0c0b4650 0x7f3e0c136f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e0b7fe700 1 -- 172.21.15.57:0/2895759109 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04009530 con 0x7f3e0c0b4140 2021-06-25T04:57:17.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e0b7fe700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4140 0x7f3e0c13f600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f3dfc00c000 tx=0x7f3dfc006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:17.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e08ff9700 1 -- 172.21.15.57:0/2895759109 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dfc011750 con 0x7f3e0c0b4140 2021-06-25T04:57:17.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e08ff9700 1 -- 172.21.15.57:0/2895759109 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc0118b0 con 0x7f3e0c0b4140 2021-06-25T04:57:17.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e120a3700 1 -- 172.21.15.57:0/2895759109 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0c13a4e0 con 0x7f3e0c0b4140 2021-06-25T04:57:17.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e08ff9700 1 -- 172.21.15.57:0/2895759109 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dfc011c10 con 0x7f3e0c0b4140 2021-06-25T04:57:17.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.174+0000 7f3e120a3700 1 -- 172.21.15.57:0/2895759109 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0c137910 con 0x7f3e0c0b4140 2021-06-25T04:57:17.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.178+0000 7f3e08ff9700 1 -- 172.21.15.57:0/2895759109 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3dfc011d70 con 0x7f3e0c0b4140 2021-06-25T04:57:17.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.178+0000 7f3e120a3700 1 -- 172.21.15.57:0/2895759109 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0c13a670 con 0x7f3e0c0b4140 2021-06-25T04:57:17.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.178+0000 7f3e08ff9700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3df0055450 0x7f3df0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.178+0000 7f3e08ff9700 1 -- 172.21.15.57:0/2895759109 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f3dfc06e180 con 0x7f3e0c0b4140 2021-06-25T04:57:17.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.178+0000 7f3e0affd700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3df0055450 0x7f3df0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.178+0000 7f3e0affd700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3df0055450 0x7f3df0057910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f3df400d000 tx=0x7f3df4007c20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:17.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.186+0000 7f3e08ff9700 1 -- 172.21.15.57:0/2895759109 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3dfc044390 con 0x7f3e0c0b4140 2021-06-25T04:57:17.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.322+0000 7f3e120a3700 1 -- 172.21.15.57:0/2895759109 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f3e0c057310 con 0x7f3e0c0b4140 2021-06-25T04:57:17.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.386+0000 7f3e08ff9700 1 -- 172.21.15.57:0/2895759109 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v156) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3dfc0479b0 con 0x7f3e0c0b4140 2021-06-25T04:57:17.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.390+0000 7f3e120a3700 1 -- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3df0055450 msgr2=0x7f3df0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.390+0000 7f3e120a3700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3df0055450 0x7f3df0057910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f3df400d000 tx=0x7f3df4007c20).stop 2021-06-25T04:57:17.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.390+0000 7f3e120a3700 1 -- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4140 msgr2=0x7f3e0c13f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.390+0000 7f3e120a3700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4140 0x7f3e0c13f600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f3dfc00c000 tx=0x7f3dfc006df0).stop 2021-06-25T04:57:17.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.394+0000 7f3e120a3700 1 -- 172.21.15.57:0/2895759109 shutdown_connections 2021-06-25T04:57:17.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.394+0000 7f3e120a3700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3df0055450 0x7f3df0057910 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.394+0000 7f3e120a3700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e0c146910 0x7f3e0c137420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.394+0000 7f3e120a3700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e0c0b4650 0x7f3e0c136f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.394+0000 7f3e120a3700 1 --2- 172.21.15.57:0/2895759109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e0c0b4140 0x7f3e0c13f600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.399 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.394+0000 7f3e120a3700 1 -- 172.21.15.57:0/2895759109 >> 172.21.15.57:0/2895759109 conn(0x7f3e0c05c450 msgr2=0x7f3e0c0b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:17.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.394+0000 7f3e120a3700 1 -- 172.21.15.57:0/2895759109 shutdown_connections 2021-06-25T04:57:17.400 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.394+0000 7f3e120a3700 1 -- 172.21.15.57:0/2895759109 wait complete. 2021-06-25T04:57:17.402 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2021-06-25T04:57:17.414 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-06-25T04:57:17.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a24a5d700 1 Processor -- start 2021-06-25T04:57:17.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a24a5d700 1 -- start start 2021-06-25T04:57:17.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a24a5d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2a200b05d0 0x7f2a200af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a24a5d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a20147560 0x7f2a200acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a24a5d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a200b5840 con 0x7f2a200b5460 2021-06-25T04:57:17.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a24a5d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a201452a0 con 0x7f2a200b05d0 2021-06-25T04:57:17.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a24a5d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200adfb0 con 0x7f2a20147560 2021-06-25T04:57:17.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a20147560 0x7f2a200acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a1effd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2a200b05d0 0x7f2a200af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a1f7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2a200b5460 0x7f2a20067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:34304/0 (socket says 172.21.15.57:34304) 2021-06-25T04:57:17.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a1f7fe700 1 -- 172.21.15.57:0/2060934285 learned_addr learned my addr 172.21.15.57:0/2060934285 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:17.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a1effd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2a200b05d0 0x7f2a200af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:53064/0 (socket says 172.21.15.57:53064) 2021-06-25T04:57:17.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.510+0000 7f2a1ffff700 1 --2- 172.21.15.57:0/2060934285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a20147560 0x7f2a200acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:55738/0 (socket says 172.21.15.57:55738) 2021-06-25T04:57:17.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a1effd700 1 -- 172.21.15.57:0/2060934285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a20147560 msgr2=0x7f2a200acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:17.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a1effd700 1 --2- 172.21.15.57:0/2060934285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a20147560 0x7f2a200acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a1effd700 1 -- 172.21.15.57:0/2060934285 >> v1:172.21.15.87:6789/0 conn(0x7f2a200b5460 legacy=0x7f2a20067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a1effd700 1 -- 172.21.15.57:0/2060934285 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a200ac7c0 con 0x7f2a200b05d0 2021-06-25T04:57:17.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a1ffff700 1 --2- 172.21.15.57:0/2060934285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a20147560 0x7f2a200acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:17.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a1effd700 1 --2- 172.21.15.57:0/2060934285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a200b05d0 0x7f2a200af510 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f2a100032f0 tx=0x7f2a100091d0).ready entity=mon.1 client_cookie=d12534ae7eb9ecf6 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:17.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a1e7fc700 1 -- 172.21.15.57:0/2060934285 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a1000b680 con 0x7f2a200b05d0 2021-06-25T04:57:17.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a1e7fc700 1 -- 172.21.15.57:0/2060934285 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1000b7e0 con 0x7f2a200b05d0 2021-06-25T04:57:17.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a1e7fc700 1 -- 172.21.15.57:0/2060934285 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a1000b990 con 0x7f2a200b05d0 2021-06-25T04:57:17.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a24a5d700 1 -- 172.21.15.57:0/2060934285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a200b05d0 msgr2=0x7f2a200af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a24a5d700 1 --2- 172.21.15.57:0/2060934285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a200b05d0 0x7f2a200af510 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f2a100032f0 tx=0x7f2a100091d0).stop 2021-06-25T04:57:17.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a24a5d700 1 -- 172.21.15.57:0/2060934285 shutdown_connections 2021-06-25T04:57:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a24a5d700 1 --2- 172.21.15.57:0/2060934285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a20147560 0x7f2a200acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a24a5d700 1 --2- 172.21.15.57:0/2060934285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a200b05d0 0x7f2a200af510 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a24a5d700 1 -- 172.21.15.57:0/2060934285 >> 172.21.15.57:0/2060934285 conn(0x7f2a20062520 msgr2=0x7f2a20062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a24a5d700 1 -- 172.21.15.57:0/2060934285 shutdown_connections 2021-06-25T04:57:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.514+0000 7f2a24a5d700 1 -- 172.21.15.57:0/2060934285 wait complete. 2021-06-25T04:57:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a24a5d700 1 Processor -- start 2021-06-25T04:57:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a24a5d700 1 -- start start 2021-06-25T04:57:17.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a24a5d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a200b05d0 0x7f2a201495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a24a5d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a200b5460 0x7f2a201413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a24a5d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a20147560 0x7f2a200b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a24a5d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20146200 con 0x7f2a20147560 2021-06-25T04:57:17.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a24a5d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20146460 con 0x7f2a200b5460 2021-06-25T04:57:17.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a24a5d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20146700 con 0x7f2a200b05d0 2021-06-25T04:57:17.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a20147560 0x7f2a200b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a200b5460 0x7f2a201413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1f7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a200b05d0 0x7f2a201495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a200b5460 0x7f2a201413e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:53072/0 (socket says 172.21.15.57:53072) 2021-06-25T04:57:17.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1effd700 1 -- 172.21.15.57:0/324223173 learned_addr learned my addr 172.21.15.57:0/324223173 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:17.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1ffff700 1 -- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a200b05d0 msgr2=0x7f2a201495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1ffff700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a200b05d0 0x7f2a201495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1ffff700 1 -- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a200b5460 msgr2=0x7f2a201413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1ffff700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a200b5460 0x7f2a201413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1ffff700 1 -- 172.21.15.57:0/324223173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1800b180 con 0x7f2a20147560 2021-06-25T04:57:17.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1ffff700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a20147560 0x7f2a200b34e0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f2a1800c000 tx=0x7f2a18006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:17.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.518+0000 7f2a1cff9700 1 -- 172.21.15.57:0/324223173 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a18010780 con 0x7f2a20147560 2021-06-25T04:57:17.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.522+0000 7f2a24a5d700 1 -- 172.21.15.57:0/324223173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a10009470 con 0x7f2a20147560 2021-06-25T04:57:17.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.522+0000 7f2a24a5d700 1 -- 172.21.15.57:0/324223173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a200ac350 con 0x7f2a20147560 2021-06-25T04:57:17.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.522+0000 7f2a1cff9700 1 -- 172.21.15.57:0/324223173 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a180108e0 con 0x7f2a20147560 2021-06-25T04:57:17.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.522+0000 7f2a1cff9700 1 -- 172.21.15.57:0/324223173 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a18010c40 con 0x7f2a20147560 2021-06-25T04:57:17.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.522+0000 7f2a24a5d700 1 -- 172.21.15.57:0/324223173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc003410 con 0x7f2a20147560 2021-06-25T04:57:17.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.522+0000 7f2a1cff9700 1 -- 172.21.15.57:0/324223173 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2a1801c460 con 0x7f2a20147560 2021-06-25T04:57:17.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.522+0000 7f2a1cff9700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a000553f0 0x7f2a000578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.522+0000 7f2a1cff9700 1 -- 172.21.15.57:0/324223173 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f2a1806e2b0 con 0x7f2a20147560 2021-06-25T04:57:17.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.522+0000 7f2a1f7fe700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a000553f0 0x7f2a000578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.526+0000 7f2a1f7fe700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a000553f0 0x7f2a000578b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f2a1400d000 tx=0x7f2a14009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:17.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.530+0000 7f2a1cff9700 1 -- 172.21.15.57:0/324223173 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2a180443e0 con 0x7f2a20147560 2021-06-25T04:57:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.694+0000 7f2a24a5d700 1 -- 172.21.15.57:0/324223173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f29fc003c40 con 0x7f2a20147560 2021-06-25T04:57:17.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.706+0000 7f2a1cff9700 1 -- 172.21.15.57:0/324223173 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v79) v1 ==== 189+0+0 (secure 0 0 0) 0x7f2a18047a00 con 0x7f2a20147560 2021-06-25T04:57:17.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.706+0000 7f2a24a5d700 1 -- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a000553f0 msgr2=0x7f2a000578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.706+0000 7f2a24a5d700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a000553f0 0x7f2a000578b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f2a1400d000 tx=0x7f2a14009040).stop 2021-06-25T04:57:17.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.706+0000 7f2a24a5d700 1 -- 172.21.15.57:0/324223173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a20147560 msgr2=0x7f2a200b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.706+0000 7f2a24a5d700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a20147560 0x7f2a200b34e0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f2a1800c000 tx=0x7f2a18006df0).stop 2021-06-25T04:57:17.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.710+0000 7f2a24a5d700 1 -- 172.21.15.57:0/324223173 shutdown_connections 2021-06-25T04:57:17.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.710+0000 7f2a24a5d700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2a000553f0 0x7f2a000578b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.710+0000 7f2a24a5d700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a20147560 0x7f2a200b34e0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.710+0000 7f2a24a5d700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a200b5460 0x7f2a201413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.710+0000 7f2a24a5d700 1 --2- 172.21.15.57:0/324223173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a200b05d0 0x7f2a201495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.710+0000 7f2a24a5d700 1 -- 172.21.15.57:0/324223173 >> 172.21.15.57:0/324223173 conn(0x7f2a20062520 msgr2=0x7f2a200acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:17.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.710+0000 7f2a24a5d700 1 -- 172.21.15.57:0/324223173 shutdown_connections 2021-06-25T04:57:17.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.710+0000 7f2a24a5d700 1 -- 172.21.15.57:0/324223173 wait complete. 2021-06-25T04:57:17.717 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 29 and data pool 30 2021-06-25T04:57:17.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:57:17.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff530afd700 1 Processor -- start 2021-06-25T04:57:17.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff530afd700 1 -- start start 2021-06-25T04:57:17.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff530afd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0b2810 0x7ff52c0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff530afd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff52c0acee0 0x7ff52c0ad370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff530afd700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c0b2bf0 con 0x7ff52c13c6a0 2021-06-25T04:57:17.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff530afd700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c13d1f0 con 0x7ff52c0acee0 2021-06-25T04:57:17.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff530afd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c0b1620 con 0x7ff52c0b2810 2021-06-25T04:57:17.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff52b7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0b2810 0x7ff52c0b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff52bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff52c0acee0 0x7ff52c0ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff52affd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff52c13c6a0 0x7ff52c13cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:34322/0 (socket says 172.21.15.57:34322) 2021-06-25T04:57:17.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff52b7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0b2810 0x7ff52c0b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:55750/0 (socket says 172.21.15.57:55750) 2021-06-25T04:57:17.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.818+0000 7ff52affd700 1 -- 172.21.15.57:0/1324216152 learned_addr learned my addr 172.21.15.57:0/1324216152 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:17.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff52b7fe700 1 -- 172.21.15.57:0/1324216152 >> v2:172.21.15.87:3300/0 conn(0x7ff52c0acee0 msgr2=0x7ff52c0ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:17.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff52b7fe700 1 --2- 172.21.15.57:0/1324216152 >> v2:172.21.15.87:3300/0 conn(0x7ff52c0acee0 0x7ff52c0ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff52b7fe700 1 -- 172.21.15.57:0/1324216152 >> v1:172.21.15.87:6789/0 conn(0x7ff52c13c6a0 legacy=0x7ff52c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff52b7fe700 1 -- 172.21.15.57:0/1324216152 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c0b18c0 con 0x7ff52c0b2810 2021-06-25T04:57:17.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff52bfff700 1 --2- 172.21.15.57:0/1324216152 >> v2:172.21.15.87:3300/0 conn(0x7ff52c0acee0 0x7ff52c0ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:17.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff52b7fe700 1 --2- 172.21.15.57:0/1324216152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0b2810 0x7ff52c0b0a60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ff51c002f70 tx=0x7ff51c006df0).ready entity=mon.2 client_cookie=2de8029afe66c431 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:17.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff52a7fc700 1 -- 172.21.15.57:0/1324216152 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51c00d570 con 0x7ff52c0b2810 2021-06-25T04:57:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff52a7fc700 1 -- 172.21.15.57:0/1324216152 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c000e90 con 0x7ff52c0b2810 2021-06-25T04:57:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff52a7fc700 1 -- 172.21.15.57:0/1324216152 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51c00d8c0 con 0x7ff52c0b2810 2021-06-25T04:57:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff530afd700 1 -- 172.21.15.57:0/1324216152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0b2810 msgr2=0x7ff52c0b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff530afd700 1 --2- 172.21.15.57:0/1324216152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0b2810 0x7ff52c0b0a60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ff51c002f70 tx=0x7ff51c006df0).stop 2021-06-25T04:57:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff530afd700 1 -- 172.21.15.57:0/1324216152 shutdown_connections 2021-06-25T04:57:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff530afd700 1 --2- 172.21.15.57:0/1324216152 >> v2:172.21.15.87:3300/0 conn(0x7ff52c0acee0 0x7ff52c0ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff530afd700 1 --2- 172.21.15.57:0/1324216152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0b2810 0x7ff52c0b0a60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff530afd700 1 -- 172.21.15.57:0/1324216152 >> 172.21.15.57:0/1324216152 conn(0x7ff52c0611f0 msgr2=0x7ff52c062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff530afd700 1 -- 172.21.15.57:0/1324216152 shutdown_connections 2021-06-25T04:57:17.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.822+0000 7ff530afd700 1 -- 172.21.15.57:0/1324216152 wait complete. 2021-06-25T04:57:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff530afd700 1 Processor -- start 2021-06-25T04:57:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff530afd700 1 -- start start 2021-06-25T04:57:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff530afd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0acee0 0x7ff52c13bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff530afd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c0b2810 0x7ff52c13e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff530afd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff52c13c6a0 0x7ff52c064240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff530afd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c13f750 con 0x7ff52c13c6a0 2021-06-25T04:57:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff530afd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c13e9a0 con 0x7ff52c0b2810 2021-06-25T04:57:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff530afd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c13f980 con 0x7ff52c0acee0 2021-06-25T04:57:17.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff52bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff52c13c6a0 0x7ff52c064240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff52bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff52c13c6a0 0x7ff52c064240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44596/0 (socket says 172.21.15.57:44596) 2021-06-25T04:57:17.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff52bfff700 1 -- 172.21.15.57:0/3504207713 learned_addr learned my addr 172.21.15.57:0/3504207713 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:17.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff52b7fe700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0acee0 0x7ff52c13bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff52affd700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c0b2810 0x7ff52c13e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff52bfff700 1 -- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0acee0 msgr2=0x7ff52c13bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff52bfff700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0acee0 0x7ff52c13bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff52bfff700 1 -- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c0b2810 msgr2=0x7ff52c13e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff52bfff700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c0b2810 0x7ff52c13e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff52bfff700 1 -- 172.21.15.57:0/3504207713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524009470 con 0x7ff52c13c6a0 2021-06-25T04:57:17.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff52bfff700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff52c13c6a0 0x7ff52c064240 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7ff52400c000 tx=0x7ff5240091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:17.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff528ff9700 1 -- 172.21.15.57:0/3504207713 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff524009e70 con 0x7ff52c13c6a0 2021-06-25T04:57:17.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.826+0000 7ff528ff9700 1 -- 172.21.15.57:0/3504207713 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52401a470 con 0x7ff52c13c6a0 2021-06-25T04:57:17.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.830+0000 7ff530afd700 1 -- 172.21.15.57:0/3504207713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c00b180 con 0x7ff52c13c6a0 2021-06-25T04:57:17.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.830+0000 7ff528ff9700 1 -- 172.21.15.57:0/3504207713 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff52401a7d0 con 0x7ff52c13c6a0 2021-06-25T04:57:17.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.830+0000 7ff530afd700 1 -- 172.21.15.57:0/3504207713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52c13d5f0 con 0x7ff52c13c6a0 2021-06-25T04:57:17.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.830+0000 7ff528ff9700 1 -- 172.21.15.57:0/3504207713 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff52401a930 con 0x7ff52c13c6a0 2021-06-25T04:57:17.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.830+0000 7ff530afd700 1 -- 172.21.15.57:0/3504207713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52c057310 con 0x7ff52c13c6a0 2021-06-25T04:57:17.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.830+0000 7ff528ff9700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0553d0 0x7ff50c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:17.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.830+0000 7ff528ff9700 1 -- 172.21.15.57:0/3504207713 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff524070c30 con 0x7ff52c13c6a0 2021-06-25T04:57:17.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.838+0000 7ff52b7fe700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0553d0 0x7ff50c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:17.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.838+0000 7ff528ff9700 1 -- 172.21.15.57:0/3504207713 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff524046c50 con 0x7ff52c13c6a0 2021-06-25T04:57:17.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.838+0000 7ff52b7fe700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0553d0 0x7ff50c057890 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7ff51c019000 tx=0x7ff51c014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:17.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.966+0000 7ff530afd700 1 -- 172.21.15.57:0/3504207713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff52c05f200 con 0x7ff52c13c6a0 2021-06-25T04:57:17.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.966+0000 7ff528ff9700 1 -- 172.21.15.57:0/3504207713 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+16298 (secure 0 0 0) 0x7ff52401f020 con 0x7ff52c13c6a0 2021-06-25T04:57:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:17.974 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":158,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:57:17.702064+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:57:16.192470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-06-25T04:57:17.377680+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:57:17.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 -- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0553d0 msgr2=0x7ff50c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0553d0 0x7ff50c057890 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7ff51c019000 tx=0x7ff51c014000).stop 2021-06-25T04:57:17.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 -- 172.21.15.57:0/3504207713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff52c13c6a0 msgr2=0x7ff52c064240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:17.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff52c13c6a0 0x7ff52c064240 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7ff52400c000 tx=0x7ff5240091d0).stop 2021-06-25T04:57:17.976 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 -- 172.21.15.57:0/3504207713 shutdown_connections 2021-06-25T04:57:17.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff50c0553d0 0x7ff50c057890 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff52c13c6a0 0x7ff52c064240 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c0b2810 0x7ff52c13e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.977 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 --2- 172.21.15.57:0/3504207713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff52c0acee0 0x7ff52c13bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:17.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 -- 172.21.15.57:0/3504207713 >> 172.21.15.57:0/3504207713 conn(0x7ff52c0611f0 msgr2=0x7ff52c1389c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:17.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 -- 172.21.15.57:0/3504207713 shutdown_connections 2021-06-25T04:57:17.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:17.970+0000 7ff530afd700 1 -- 172.21.15.57:0/3504207713 wait complete. 2021-06-25T04:57:17.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:57:18.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3dabfff700 1 Processor -- start 2021-06-25T04:57:18.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3dabfff700 1 -- start start 2021-06-25T04:57:18.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3dabfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3dac0b52c0 0x7f3dac13e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3dabfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dac0aeee0 con 0x7f3dac0b1420 2021-06-25T04:57:18.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3dabfff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dac0ac2c0 con 0x7f3dac13e560 2021-06-25T04:57:18.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3dabfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dac0af110 con 0x7f3dac0b52c0 2021-06-25T04:57:18.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3daa7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3dac0b1420 0x7f3dac141000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33586/0 (socket says 172.21.15.57:33586) 2021-06-25T04:57:18.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3daa7fc700 1 -- 172.21.15.57:0/3905944029 learned_addr learned my addr 172.21.15.57:0/3905944029 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:18.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3daaffd700 1 --2- 172.21.15.57:0/3905944029 >> v2:172.21.15.57:3300/0 conn(0x7f3dac0b52c0 0x7f3dac13e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3da9ffb700 1 -- 172.21.15.57:0/3905944029 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923458068 0 0) 0x7f3dac0aeee0 con 0x7f3dac0b1420 2021-06-25T04:57:18.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3da9ffb700 1 -- 172.21.15.57:0/3905944029 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d90003260 con 0x7f3dac0b1420 2021-06-25T04:57:18.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3daaffd700 1 -- 172.21.15.57:0/3905944029 >> v1:172.21.15.87:6789/0 conn(0x7f3dac13e560 legacy=0x7f3dac141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3daaffd700 1 -- 172.21.15.57:0/3905944029 >> v1:172.21.15.57:6789/0 conn(0x7f3dac0b1420 legacy=0x7f3dac141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.082+0000 7f3daaffd700 1 -- 172.21.15.57:0/3905944029 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac0af3b0 con 0x7f3dac0b52c0 2021-06-25T04:57:18.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3daaffd700 1 --2- 172.21.15.57:0/3905944029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dac0b52c0 0x7f3dac13e070 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f3da0002f70 tx=0x7f3da0006df0).ready entity=mon.0 client_cookie=23e9f6e21af7ab77 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:18.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3da9ffb700 1 -- 172.21.15.57:0/3905944029 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3da000d610 con 0x7f3dac0b52c0 2021-06-25T04:57:18.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3da9ffb700 1 -- 172.21.15.57:0/3905944029 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da0000e90 con 0x7f3dac0b52c0 2021-06-25T04:57:18.094 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3da9ffb700 1 -- 172.21.15.57:0/3905944029 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3da000d960 con 0x7f3dac0b52c0 2021-06-25T04:57:18.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 -- 172.21.15.57:0/3905944029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dac0b52c0 msgr2=0x7f3dac13e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 --2- 172.21.15.57:0/3905944029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dac0b52c0 0x7f3dac13e070 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f3da0002f70 tx=0x7f3da0006df0).stop 2021-06-25T04:57:18.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 -- 172.21.15.57:0/3905944029 shutdown_connections 2021-06-25T04:57:18.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 --2- 172.21.15.57:0/3905944029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dac0b52c0 0x7f3dac13e070 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 -- 172.21.15.57:0/3905944029 >> 172.21.15.57:0/3905944029 conn(0x7f3dac062520 msgr2=0x7f3dac062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:18.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 -- 172.21.15.57:0/3905944029 shutdown_connections 2021-06-25T04:57:18.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 -- 172.21.15.57:0/3905944029 wait complete. 2021-06-25T04:57:18.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 Processor -- start 2021-06-25T04:57:18.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 -- start start 2021-06-25T04:57:18.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dac0b1420 0x7f3dac0b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dac0b52c0 0x7f3dac13c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dac13e560 0x7f3dac13c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac1402c0 con 0x7f3dac0b1420 2021-06-25T04:57:18.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac0adba0 con 0x7f3dac13e560 2021-06-25T04:57:18.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3dabfff700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac0ae360 con 0x7f3dac0b52c0 2021-06-25T04:57:18.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.086+0000 7f3daaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dac0b1420 0x7f3dac0b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3daaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dac0b1420 0x7f3dac0b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44606/0 (socket says 172.21.15.57:44606) 2021-06-25T04:57:18.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3daaffd700 1 -- 172.21.15.57:0/3919972023 learned_addr learned my addr 172.21.15.57:0/3919972023 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:18.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3daa7fc700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dac0b52c0 0x7f3dac13c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3dab7fe700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dac13e560 0x7f3dac13c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.102 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3daaffd700 1 -- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dac0b52c0 msgr2=0x7f3dac13c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3daaffd700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dac0b52c0 0x7f3dac13c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3daaffd700 1 -- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dac13e560 msgr2=0x7f3dac13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3daaffd700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dac13e560 0x7f3dac13c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3daaffd700 1 -- 172.21.15.57:0/3919972023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da000b180 con 0x7f3dac0b1420 2021-06-25T04:57:18.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3daaffd700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dac0b1420 0x7f3dac0b42d0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f3da0002f70 tx=0x7f3da0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:18.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3d9bfff700 1 -- 172.21.15.57:0/3919972023 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3da0012dd0 con 0x7f3dac0b1420 2021-06-25T04:57:18.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3d9bfff700 1 -- 172.21.15.57:0/3919972023 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da000d290 con 0x7f3dac0b1420 2021-06-25T04:57:18.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3d9bfff700 1 -- 172.21.15.57:0/3919972023 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3da001f630 con 0x7f3dac0b1420 2021-06-25T04:57:18.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3dabfff700 1 -- 172.21.15.57:0/3919972023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dac0b5f70 con 0x7f3dac0b1420 2021-06-25T04:57:18.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3dabfff700 1 -- 172.21.15.57:0/3919972023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dac1433d0 con 0x7f3dac0b1420 2021-06-25T04:57:18.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3dabfff700 1 -- 172.21.15.57:0/3919972023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dac0add10 con 0x7f3dac0b1420 2021-06-25T04:57:18.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.090+0000 7f3d9bfff700 1 -- 172.21.15.57:0/3919972023 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f3da0025020 con 0x7f3dac0b1420 2021-06-25T04:57:18.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.094+0000 7f3d9bfff700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d88055450 0x7f3d88057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.094+0000 7f3d9bfff700 1 -- 172.21.15.57:0/3919972023 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3da006f0c0 con 0x7f3dac0b1420 2021-06-25T04:57:18.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.094+0000 7f3daa7fc700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d88055450 0x7f3d88057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.094+0000 7f3daa7fc700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d88055450 0x7f3d88057910 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f3da400d000 tx=0x7f3da4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:18.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.098+0000 7f3d9bfff700 1 -- 172.21.15.57:0/3919972023 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f3da0045160 con 0x7f3dac0b1420 2021-06-25T04:57:18.235 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.230+0000 7f3dabfff700 1 -- 172.21.15.57:0/3919972023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dac057310 con 0x7f3dac0b1420 2021-06-25T04:57:18.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.230+0000 7f3d9bfff700 1 -- 172.21.15.57:0/3919972023 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f3da0006980 con 0x7f3dac0b1420 2021-06-25T04:57:18.237 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:18.238 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":158,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:57:17.702064+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:57:16.192470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-06-25T04:57:17.377680+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:57:18.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 -- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d88055450 msgr2=0x7f3d88057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.239 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d88055450 0x7f3d88057910 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f3da400d000 tx=0x7f3da4009040).stop 2021-06-25T04:57:18.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 -- 172.21.15.57:0/3919972023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dac0b1420 msgr2=0x7f3dac0b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dac0b1420 0x7f3dac0b42d0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f3da0002f70 tx=0x7f3da0014000).stop 2021-06-25T04:57:18.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 -- 172.21.15.57:0/3919972023 shutdown_connections 2021-06-25T04:57:18.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3d88055450 0x7f3d88057910 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dac13e560 0x7f3dac13c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dac0b52c0 0x7f3dac13c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 --2- 172.21.15.57:0/3919972023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dac0b1420 0x7f3dac0b42d0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 -- 172.21.15.57:0/3919972023 >> 172.21.15.57:0/3919972023 conn(0x7f3dac062520 msgr2=0x7f3dac05ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:18.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 -- 172.21.15.57:0/3919972023 shutdown_connections 2021-06-25T04:57:18.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.234+0000 7f3dabfff700 1 -- 172.21.15.57:0/3919972023 wait complete. 2021-06-25T04:57:18.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-06-25T04:57:18.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.354+0000 7fe1b737d700 1 Processor -- start 2021-06-25T04:57:18.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.354+0000 7fe1b737d700 1 -- start start 2021-06-25T04:57:18.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe1b00612e0 0x7fe1b00616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1b00ad580 0x7fe1b00b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b00aecb0 con 0x7fe1b0140400 2021-06-25T04:57:18.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b00b6ee0 con 0x7fe1b00612e0 2021-06-25T04:57:18.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00aeee0 con 0x7fe1b00ad580 2021-06-25T04:57:18.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b6b7c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe1b0140400 0x7fe1b01464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33604/0 (socket says 172.21.15.57:33604) 2021-06-25T04:57:18.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b6b7c700 1 -- 172.21.15.57:0/3212470825 learned_addr learned my addr 172.21.15.57:0/3212470825 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:18.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b637b700 1 --2- 172.21.15.57:0/3212470825 >> v2:172.21.15.87:3300/0 conn(0x7fe1b00612e0 0x7fe1b00616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b5b7a700 1 --2- 172.21.15.57:0/3212470825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1b00ad580 0x7fe1b00b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b5379700 1 -- 172.21.15.57:0/3212470825 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490891965 0 0) 0x7fe1b00aecb0 con 0x7fe1b0140400 2021-06-25T04:57:18.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b5379700 1 -- 172.21.15.57:0/3212470825 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe198003260 con 0x7fe1b0140400 2021-06-25T04:57:18.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b637b700 1 -- 172.21.15.57:0/3212470825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1b00ad580 msgr2=0x7fe1b00b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:18.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b637b700 1 --2- 172.21.15.57:0/3212470825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1b00ad580 0x7fe1b00b9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b637b700 1 -- 172.21.15.57:0/3212470825 >> v1:172.21.15.57:6789/0 conn(0x7fe1b0140400 legacy=0x7fe1b01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b637b700 1 -- 172.21.15.57:0/3212470825 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00af180 con 0x7fe1b00612e0 2021-06-25T04:57:18.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b5b7a700 1 --2- 172.21.15.57:0/3212470825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1b00ad580 0x7fe1b00b9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:18.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b637b700 1 --2- 172.21.15.57:0/3212470825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1b00612e0 0x7fe1b00616c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fe1a4002f70 tx=0x7fe1a4006df0).ready entity=mon.1 client_cookie=2eb317a324ddf151 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:18.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b5379700 1 -- 172.21.15.57:0/3212470825 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a400d4a0 con 0x7fe1b00612e0 2021-06-25T04:57:18.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b5379700 1 -- 172.21.15.57:0/3212470825 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4000e90 con 0x7fe1b00612e0 2021-06-25T04:57:18.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b5379700 1 -- 172.21.15.57:0/3212470825 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a400d7f0 con 0x7fe1b00612e0 2021-06-25T04:57:18.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 -- 172.21.15.57:0/3212470825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1b00612e0 msgr2=0x7fe1b00616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 --2- 172.21.15.57:0/3212470825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1b00612e0 0x7fe1b00616c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fe1a4002f70 tx=0x7fe1a4006df0).stop 2021-06-25T04:57:18.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 -- 172.21.15.57:0/3212470825 shutdown_connections 2021-06-25T04:57:18.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 --2- 172.21.15.57:0/3212470825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1b00ad580 0x7fe1b00b9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 --2- 172.21.15.57:0/3212470825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1b00612e0 0x7fe1b00616c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 -- 172.21.15.57:0/3212470825 >> 172.21.15.57:0/3212470825 conn(0x7fe1b0066da0 msgr2=0x7fe1b0067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:18.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 -- 172.21.15.57:0/3212470825 shutdown_connections 2021-06-25T04:57:18.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.358+0000 7fe1b737d700 1 -- 172.21.15.57:0/3212470825 wait complete. 2021-06-25T04:57:18.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b737d700 1 Processor -- start 2021-06-25T04:57:18.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b737d700 1 -- start start 2021-06-25T04:57:18.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b737d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1b00612e0 0x7fe1b014a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b737d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1b00ad580 0x7fe1b0155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b737d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1b0140400 0x7fe1b0156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b737d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0144c00 con 0x7fe1b00612e0 2021-06-25T04:57:18.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b737d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00ad010 con 0x7fe1b00ad580 2021-06-25T04:57:18.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b737d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0144730 con 0x7fe1b0140400 2021-06-25T04:57:18.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b637b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1b00612e0 0x7fe1b014a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b637b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1b00612e0 0x7fe1b014a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44620/0 (socket says 172.21.15.57:44620) 2021-06-25T04:57:18.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b637b700 1 -- 172.21.15.57:0/928119614 learned_addr learned my addr 172.21.15.57:0/928119614 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:18.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b6b7c700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1b0140400 0x7fe1b0156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b5b7a700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1b00ad580 0x7fe1b0155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b637b700 1 -- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1b0140400 msgr2=0x7fe1b0156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b637b700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1b0140400 0x7fe1b0156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b637b700 1 -- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1b00ad580 msgr2=0x7fe1b0155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b637b700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1b00ad580 0x7fe1b0155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b637b700 1 -- 172.21.15.57:0/928119614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac00b180 con 0x7fe1b00612e0 2021-06-25T04:57:18.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1b637b700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1b00612e0 0x7fe1b014a130 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7fe1b0147470 tx=0x7fe1a4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:18.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.362+0000 7fe1a37fe700 1 -- 172.21.15.57:0/928119614 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a4012930 con 0x7fe1b00612e0 2021-06-25T04:57:18.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.366+0000 7fe1a37fe700 1 -- 172.21.15.57:0/928119614 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4012a90 con 0x7fe1b00612e0 2021-06-25T04:57:18.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.366+0000 7fe1b737d700 1 -- 172.21.15.57:0/928119614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a400b180 con 0x7fe1b00612e0 2021-06-25T04:57:18.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.366+0000 7fe1a37fe700 1 -- 172.21.15.57:0/928119614 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a4012df0 con 0x7fe1b00612e0 2021-06-25T04:57:18.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.366+0000 7fe1b737d700 1 -- 172.21.15.57:0/928119614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b0144960 con 0x7fe1b00612e0 2021-06-25T04:57:18.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.366+0000 7fe1b737d700 1 -- 172.21.15.57:0/928119614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b0057310 con 0x7fe1b00612e0 2021-06-25T04:57:18.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.366+0000 7fe1a37fe700 1 -- 172.21.15.57:0/928119614 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe1a4025020 con 0x7fe1b00612e0 2021-06-25T04:57:18.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.366+0000 7fe1a37fe700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1900553d0 0x7fe190057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.366+0000 7fe1a37fe700 1 -- 172.21.15.57:0/928119614 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe1a406ede0 con 0x7fe1b00612e0 2021-06-25T04:57:18.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.366+0000 7fe1b5b7a700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1900553d0 0x7fe190057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.366+0000 7fe1b5b7a700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1900553d0 0x7fe190057890 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fe1ac00b000 tx=0x7fe1ac006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:18.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.374+0000 7fe1a37fe700 1 -- 172.21.15.57:0/928119614 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe1a4044f90 con 0x7fe1b00612e0 2021-06-25T04:57:18.549 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.542+0000 7fe1b737d700 1 -- 172.21.15.57:0/928119614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe1b00620c0 con 0x7fe1b00612e0 2021-06-25T04:57:18.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.710+0000 7fe1a37fe700 1 -- 172.21.15.57:0/928119614 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v80) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe1a40485b0 con 0x7fe1b00612e0 2021-06-25T04:57:18.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 -- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1900553d0 msgr2=0x7fe190057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1900553d0 0x7fe190057890 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fe1ac00b000 tx=0x7fe1ac006df0).stop 2021-06-25T04:57:18.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 -- 172.21.15.57:0/928119614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1b00612e0 msgr2=0x7fe1b014a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1b00612e0 0x7fe1b014a130 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7fe1b0147470 tx=0x7fe1a4014000).stop 2021-06-25T04:57:18.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 -- 172.21.15.57:0/928119614 shutdown_connections 2021-06-25T04:57:18.720 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe1900553d0 0x7fe190057890 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1b0140400 0x7fe1b0156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1b00ad580 0x7fe1b0155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 --2- 172.21.15.57:0/928119614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1b00612e0 0x7fe1b014a130 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.721 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 -- 172.21.15.57:0/928119614 >> 172.21.15.57:0/928119614 conn(0x7fe1b0066da0 msgr2=0x7fe1b0140fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:18.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 -- 172.21.15.57:0/928119614 shutdown_connections 2021-06-25T04:57:18.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.714+0000 7fe1b737d700 1 -- 172.21.15.57:0/928119614 wait complete. 2021-06-25T04:57:18.737 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:57:18.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e3d20700 1 Processor -- start 2021-06-25T04:57:18.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e3d20700 1 -- start start 2021-06-25T04:57:18.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e3d20700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd8dc0afd00 0x7fd8dc0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e3d20700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc0ad560 con 0x7fd8dc0af920 2021-06-25T04:57:18.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e3d20700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc0ad020 con 0x7fd8dc0b04b0 2021-06-25T04:57:18.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e3d20700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc0af420 con 0x7fd8dc0afd00 2021-06-25T04:57:18.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e1abc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd8dc0af920 0x7fd8dc0b1b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33614/0 (socket says 172.21.15.57:33614) 2021-06-25T04:57:18.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e1abc700 1 -- 172.21.15.57:0/337435569 learned_addr learned my addr 172.21.15.57:0/337435569 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:18.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e22bd700 1 --2- 172.21.15.57:0/337435569 >> v2:172.21.15.87:3300/0 conn(0x7fd8dc0afd00 0x7fd8dc0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e0aba700 1 -- 172.21.15.57:0/337435569 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934911689 0 0) 0x7fd8dc0ad560 con 0x7fd8dc0af920 2021-06-25T04:57:18.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e0aba700 1 -- 172.21.15.57:0/337435569 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c8003260 con 0x7fd8dc0af920 2021-06-25T04:57:18.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e0aba700 1 -- 172.21.15.57:0/337435569 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410389255 0 0) 0x7fd8dc0ad020 con 0x7fd8dc0b04b0 2021-06-25T04:57:18.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e0aba700 1 -- 172.21.15.57:0/337435569 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8dc0ad560 con 0x7fd8dc0b04b0 2021-06-25T04:57:18.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e22bd700 1 -- 172.21.15.57:0/337435569 >> v1:172.21.15.87:6789/0 conn(0x7fd8dc0b04b0 legacy=0x7fd8dc13fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e22bd700 1 -- 172.21.15.57:0/337435569 >> v1:172.21.15.57:6789/0 conn(0x7fd8dc0af920 legacy=0x7fd8dc0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e0aba700 1 -- 172.21.15.57:0/337435569 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1627409081 0 0) 0x7fd8c8003260 con 0x7fd8dc0af920 2021-06-25T04:57:18.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e22bd700 1 -- 172.21.15.57:0/337435569 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc0ad2c0 con 0x7fd8dc0afd00 2021-06-25T04:57:18.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e22bd700 1 --2- 172.21.15.57:0/337435569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8dc0afd00 0x7fd8dc0b22a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fd8d0001110 tx=0x7fd8d4006e80).ready entity=mon.1 client_cookie=bbbc5571242c9512 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:18.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e0aba700 1 -- 172.21.15.57:0/337435569 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d4014070 con 0x7fd8dc0afd00 2021-06-25T04:57:18.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e0aba700 1 -- 172.21.15.57:0/337435569 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d4000e90 con 0x7fd8dc0afd00 2021-06-25T04:57:18.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.834+0000 7fd8e0aba700 1 -- 172.21.15.57:0/337435569 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d0001660 con 0x7fd8dc0afd00 2021-06-25T04:57:18.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 -- 172.21.15.57:0/337435569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8dc0afd00 msgr2=0x7fd8dc0b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 --2- 172.21.15.57:0/337435569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8dc0afd00 0x7fd8dc0b22a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fd8d0001110 tx=0x7fd8d4006e80).stop 2021-06-25T04:57:18.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 -- 172.21.15.57:0/337435569 shutdown_connections 2021-06-25T04:57:18.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 --2- 172.21.15.57:0/337435569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8dc0afd00 0x7fd8dc0b22a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 -- 172.21.15.57:0/337435569 >> 172.21.15.57:0/337435569 conn(0x7fd8dc05cce0 msgr2=0x7fd8dc062f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:18.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 -- 172.21.15.57:0/337435569 shutdown_connections 2021-06-25T04:57:18.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 -- 172.21.15.57:0/337435569 wait complete. 2021-06-25T04:57:18.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 Processor -- start 2021-06-25T04:57:18.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 -- start start 2021-06-25T04:57:18.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8dc0af920 0x7fd8dc141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8dc0afd00 0x7fd8dc0a79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8dc0b04b0 0x7fd8dc0a7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0a43b0 con 0x7fd8dc0af920 2021-06-25T04:57:18.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0a45e0 con 0x7fd8dc0afd00 2021-06-25T04:57:18.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e3d20700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0a4880 con 0x7fd8dc0b04b0 2021-06-25T04:57:18.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e1abc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8dc0af920 0x7fd8dc141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.838+0000 7fd8e1abc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8dc0af920 0x7fd8dc141fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44634/0 (socket says 172.21.15.57:44634) 2021-06-25T04:57:18.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e1abc700 1 -- 172.21.15.57:0/1122384094 learned_addr learned my addr 172.21.15.57:0/1122384094 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:18.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e22bd700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8dc0b04b0 0x7fd8dc0a7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e12bb700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8dc0afd00 0x7fd8dc0a79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e1abc700 1 -- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8dc0b04b0 msgr2=0x7fd8dc0a7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e1abc700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8dc0b04b0 0x7fd8dc0a7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e1abc700 1 -- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8dc0afd00 msgr2=0x7fd8dc0a79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:18.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e1abc700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8dc0afd00 0x7fd8dc0a79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:18.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e1abc700 1 -- 172.21.15.57:0/1122384094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d400c310 con 0x7fd8dc0af920 2021-06-25T04:57:18.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e22bd700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8dc0b04b0 0x7fd8dc0a7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:18.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e12bb700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8dc0afd00 0x7fd8dc0a79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e1abc700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8dc0af920 0x7fd8dc141fe0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fd8d0000fe0 tx=0x7fd8d0001970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8daffd700 1 -- 172.21.15.57:0/1122384094 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d0007170 con 0x7fd8dc0af920 2021-06-25T04:57:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8daffd700 1 -- 172.21.15.57:0/1122384094 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d00072d0 con 0x7fd8dc0af920 2021-06-25T04:57:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e3d20700 1 -- 172.21.15.57:0/1122384094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc0a5210 con 0x7fd8dc0af920 2021-06-25T04:57:18.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8daffd700 1 -- 172.21.15.57:0/1122384094 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d0004920 con 0x7fd8dc0af920 2021-06-25T04:57:18.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e3d20700 1 -- 172.21.15.57:0/1122384094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc1558a0 con 0x7fd8dc0af920 2021-06-25T04:57:18.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8e3d20700 1 -- 172.21.15.57:0/1122384094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc0a4a80 con 0x7fd8dc0af920 2021-06-25T04:57:18.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.842+0000 7fd8daffd700 1 -- 172.21.15.57:0/1122384094 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd8d001b070 con 0x7fd8dc0af920 2021-06-25T04:57:18.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.846+0000 7fd8daffd700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8bc0553d0 0x7fd8bc057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:18.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.846+0000 7fd8daffd700 1 -- 172.21.15.57:0/1122384094 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd8d006d6b0 con 0x7fd8dc0af920 2021-06-25T04:57:18.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.846+0000 7fd8e12bb700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8bc0553d0 0x7fd8bc057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:18.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.846+0000 7fd8e12bb700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8bc0553d0 0x7fd8bc057890 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fd8cc00b000 tx=0x7fd8cc009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:18.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:18.850+0000 7fd8daffd700 1 -- 172.21.15.57:0/1122384094 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd8d00437c0 con 0x7fd8dc0af920 2021-06-25T04:57:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.022+0000 7fd8e3d20700 1 -- 172.21.15.57:0/1122384094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8dc05d720 con 0x7fd8dc0af920 2021-06-25T04:57:19.029 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.022+0000 7fd8daffd700 1 -- 172.21.15.57:0/1122384094 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2486 (secure 0 0 0) 0x7fd8d0046de0 con 0x7fd8dc0af920 2021-06-25T04:57:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:19.030 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/982651038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":982651038},{"type":"v1","addr":"172.21.15.57:6833","nonce":982651038}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/58225035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":58225035},{"type":"v1","addr":"172.21.15.57:6835","nonce":58225035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:57:17.702431+0000","modified":"2021-06-25T04:57:18.706360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8778":{"gid":8778,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3809657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3809657492},{"type":"v1","addr":"172.21.15.87:6835","nonce":3809657492}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-06-25T04:57:19.031 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 -- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8bc0553d0 msgr2=0x7fd8bc057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8bc0553d0 0x7fd8bc057890 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fd8cc00b000 tx=0x7fd8cc009040).stop 2021-06-25T04:57:19.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 -- 172.21.15.57:0/1122384094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8dc0af920 msgr2=0x7fd8dc141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8dc0af920 0x7fd8dc141fe0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fd8d0000fe0 tx=0x7fd8d0001970).stop 2021-06-25T04:57:19.032 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 -- 172.21.15.57:0/1122384094 shutdown_connections 2021-06-25T04:57:19.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd8bc0553d0 0x7fd8bc057890 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8dc0b04b0 0x7fd8dc0a7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8dc0afd00 0x7fd8dc0a79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 --2- 172.21.15.57:0/1122384094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8dc0af920 0x7fd8dc141fe0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.033 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 -- 172.21.15.57:0/1122384094 >> 172.21.15.57:0/1122384094 conn(0x7fd8dc05cce0 msgr2=0x7fd8dc0b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:19.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 -- 172.21.15.57:0/1122384094 shutdown_connections 2021-06-25T04:57:19.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.026+0000 7fd8e3d20700 1 -- 172.21.15.57:0/1122384094 wait complete. 2021-06-25T04:57:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 80 2021-06-25T04:57:19.043 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:57:19.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.134+0000 7f98eaf8a700 1 Processor -- start 2021-06-25T04:57:19.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.134+0000 7f98eaf8a700 1 -- start start 2021-06-25T04:57:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.134+0000 7f98eaf8a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f98e40b4d10 0x7f98e40672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.134+0000 7f98eaf8a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e4065920 con 0x7f98e40ab120 2021-06-25T04:57:19.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.134+0000 7f98eaf8a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e4064ed0 con 0x7f98e40aad40 2021-06-25T04:57:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.134+0000 7f98eaf8a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e40b3ca0 con 0x7f98e40b4d10 2021-06-25T04:57:19.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.134+0000 7f98e9787700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f98e40ab120 0x7f98e40b74e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33628/0 (socket says 172.21.15.57:33628) 2021-06-25T04:57:19.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.134+0000 7f98e9787700 1 -- 172.21.15.57:0/746054165 learned_addr learned my addr 172.21.15.57:0/746054165 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:19.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.134+0000 7f98ea789700 1 --2- 172.21.15.57:0/746054165 >> v2:172.21.15.87:3300/0 conn(0x7f98e40b4d10 0x7f98e40672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.149 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.134+0000 7f98e8f86700 1 -- 172.21.15.57:0/746054165 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253600633 0 0) 0x7f98e4065920 con 0x7f98e40ab120 2021-06-25T04:57:19.157 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.134+0000 7f98e8f86700 1 -- 172.21.15.57:0/746054165 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98cc003260 con 0x7f98e40ab120 2021-06-25T04:57:19.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98ea789700 1 -- 172.21.15.57:0/746054165 >> v1:172.21.15.87:6789/0 conn(0x7f98e40aad40 legacy=0x7f98e40647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.158 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98ea789700 1 -- 172.21.15.57:0/746054165 >> v1:172.21.15.57:6789/0 conn(0x7f98e40ab120 legacy=0x7f98e40b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98ea789700 1 -- 172.21.15.57:0/746054165 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e4066e20 con 0x7f98e40b4d10 2021-06-25T04:57:19.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98ea789700 1 --2- 172.21.15.57:0/746054165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98e40b4d10 0x7f98e40672c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f98dc0032f0 tx=0x7f98dc0091d0).ready entity=mon.1 client_cookie=e89edc5808b07a2f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:19.159 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98e8f86700 1 -- 172.21.15.57:0/746054165 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98dc00b6c0 con 0x7f98e40b4d10 2021-06-25T04:57:19.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98e8f86700 1 -- 172.21.15.57:0/746054165 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc00b820 con 0x7f98e40b4d10 2021-06-25T04:57:19.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98e8f86700 1 -- 172.21.15.57:0/746054165 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98dc00b990 con 0x7f98e40b4d10 2021-06-25T04:57:19.160 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98eaf8a700 1 -- 172.21.15.57:0/746054165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98e40b4d10 msgr2=0x7f98e40672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98eaf8a700 1 --2- 172.21.15.57:0/746054165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98e40b4d10 0x7f98e40672c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f98dc0032f0 tx=0x7f98dc0091d0).stop 2021-06-25T04:57:19.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98eaf8a700 1 -- 172.21.15.57:0/746054165 shutdown_connections 2021-06-25T04:57:19.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98eaf8a700 1 --2- 172.21.15.57:0/746054165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98e40b4d10 0x7f98e40672c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.161 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98eaf8a700 1 -- 172.21.15.57:0/746054165 >> 172.21.15.57:0/746054165 conn(0x7f98e4062ba0 msgr2=0x7f98e405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:19.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98eaf8a700 1 -- 172.21.15.57:0/746054165 shutdown_connections 2021-06-25T04:57:19.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98eaf8a700 1 -- 172.21.15.57:0/746054165 wait complete. 2021-06-25T04:57:19.162 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98eaf8a700 1 Processor -- start 2021-06-25T04:57:19.163 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.138+0000 7f98eaf8a700 1 -- start start 2021-06-25T04:57:19.169 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98eaf8a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98e40aad40 0x7f98e4147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98eaf8a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98e40ab120 0x7f98e4146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.170 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98eaf8a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98e40b4d10 0x7f98e414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98eaf8a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e41462d0 con 0x7f98e40ab120 2021-06-25T04:57:19.171 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98eaf8a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e4145430 con 0x7f98e40b4d10 2021-06-25T04:57:19.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98eaf8a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e4145690 con 0x7f98e40aad40 2021-06-25T04:57:19.172 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98e9787700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98e40ab120 0x7f98e4146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98e9787700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98e40ab120 0x7f98e4146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44650/0 (socket says 172.21.15.57:44650) 2021-06-25T04:57:19.173 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98e9787700 1 -- 172.21.15.57:0/2547215287 learned_addr learned my addr 172.21.15.57:0/2547215287 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:19.174 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98ea789700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98e40b4d10 0x7f98e414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.174 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98e9f88700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98e40aad40 0x7f98e4147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.174 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98e9787700 1 -- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98e40aad40 msgr2=0x7f98e4147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98e9787700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98e40aad40 0x7f98e4147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.175 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98e9787700 1 -- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98e40b4d10 msgr2=0x7f98e414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98e9787700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98e40b4d10 0x7f98e414fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.176 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98e9787700 1 -- 172.21.15.57:0/2547215287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc009470 con 0x7f98e40ab120 2021-06-25T04:57:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98e9787700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98e40ab120 0x7f98e4146ee0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f98e0001290 tx=0x7f98e00028b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98d2ffd700 1 -- 172.21.15.57:0/2547215287 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e00070d0 con 0x7f98e40ab120 2021-06-25T04:57:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98d2ffd700 1 -- 172.21.15.57:0/2547215287 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0007230 con 0x7f98e40ab120 2021-06-25T04:57:19.178 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98eaf8a700 1 -- 172.21.15.57:0/2547215287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e4145e30 con 0x7f98e40ab120 2021-06-25T04:57:19.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98d2ffd700 1 -- 172.21.15.57:0/2547215287 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e00073a0 con 0x7f98e40ab120 2021-06-25T04:57:19.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98eaf8a700 1 -- 172.21.15.57:0/2547215287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e4144c60 con 0x7f98e40ab120 2021-06-25T04:57:19.179 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.142+0000 7f98eaf8a700 1 -- 172.21.15.57:0/2547215287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e4145890 con 0x7f98e40ab120 2021-06-25T04:57:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.146+0000 7f98d2ffd700 1 -- 172.21.15.57:0/2547215287 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f98e0010070 con 0x7f98e40ab120 2021-06-25T04:57:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.146+0000 7f98d2ffd700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f98c4055450 0x7f98c4057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.146+0000 7f98d2ffd700 1 -- 172.21.15.57:0/2547215287 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f98e006d560 con 0x7f98e40ab120 2021-06-25T04:57:19.181 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.146+0000 7f98e9f88700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f98c4055450 0x7f98c4057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.146+0000 7f98e9f88700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f98c4055450 0x7f98c4057910 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f98d400b000 tx=0x7f98d4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:19.182 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.154+0000 7f98d2ffd700 1 -- 172.21.15.57:0/2547215287 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f98e00437c0 con 0x7f98e40ab120 2021-06-25T04:57:19.286 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.282+0000 7f98eaf8a700 1 -- 172.21.15.57:0/2547215287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e4145fc0 con 0x7f98e40ab120 2021-06-25T04:57:19.288 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.282+0000 7f98d2ffd700 1 -- 172.21.15.57:0/2547215287 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f98e00029d0 con 0x7f98e40ab120 2021-06-25T04:57:19.288 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:19.289 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":159,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:57:18.707220+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:57:16.192470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-06-25T04:57:17.377680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:57:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.282+0000 7f98eaf8a700 1 -- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f98c4055450 msgr2=0x7f98c4057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.282+0000 7f98eaf8a700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f98c4055450 0x7f98c4057910 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f98d400b000 tx=0x7f98d4009040).stop 2021-06-25T04:57:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.286+0000 7f98eaf8a700 1 -- 172.21.15.57:0/2547215287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98e40ab120 msgr2=0x7f98e4146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.286+0000 7f98eaf8a700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98e40ab120 0x7f98e4146ee0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f98e0001290 tx=0x7f98e00028b0).stop 2021-06-25T04:57:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.286+0000 7f98eaf8a700 1 -- 172.21.15.57:0/2547215287 shutdown_connections 2021-06-25T04:57:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.286+0000 7f98eaf8a700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f98c4055450 0x7f98c4057910 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.286+0000 7f98eaf8a700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98e40b4d10 0x7f98e414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.286+0000 7f98eaf8a700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98e40ab120 0x7f98e4146ee0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.286+0000 7f98eaf8a700 1 --2- 172.21.15.57:0/2547215287 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98e40aad40 0x7f98e4147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.286+0000 7f98eaf8a700 1 -- 172.21.15.57:0/2547215287 >> 172.21.15.57:0/2547215287 conn(0x7f98e4062ba0 msgr2=0x7f98e4143430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.286+0000 7f98eaf8a700 1 -- 172.21.15.57:0/2547215287 shutdown_connections 2021-06-25T04:57:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.286+0000 7f98eaf8a700 1 -- 172.21.15.57:0/2547215287 wait complete. 2021-06-25T04:57:19.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:57:19.414 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b5ba1700 1 Processor -- start 2021-06-25T04:57:19.415 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b5ba1700 1 -- start start 2021-06-25T04:57:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b5ba1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff4b00a9bd0 0x7ff4b0148370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b5ba1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b00b33a0 con 0x7ff4b00b18b0 2021-06-25T04:57:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b5ba1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b00b0c30 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b5ba1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b00b0ed0 con 0x7ff4b00a9bd0 2021-06-25T04:57:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4affff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff4b00b18b0 0x7ff4b0147c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33644/0 (socket says 172.21.15.57:33644) 2021-06-25T04:57:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4affff700 1 -- 172.21.15.57:0/3381274865 learned_addr learned my addr 172.21.15.57:0/3381274865 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b53a0700 1 --2- 172.21.15.57:0/3381274865 >> v2:172.21.15.57:3300/0 conn(0x7ff4b00a9bd0 0x7ff4b0148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4af7fe700 1 -- 172.21.15.57:0/3381274865 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060429250 0 0) 0x7ff4b00b33a0 con 0x7ff4b00b18b0 2021-06-25T04:57:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4af7fe700 1 -- 172.21.15.57:0/3381274865 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff490003260 con 0x7ff4b00b18b0 2021-06-25T04:57:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4af7fe700 1 -- 172.21.15.57:0/3381274865 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660077845 0 0) 0x7ff4b00b0c30 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4af7fe700 1 -- 172.21.15.57:0/3381274865 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b00b33a0 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b53a0700 1 -- 172.21.15.57:0/3381274865 >> v1:172.21.15.87:6789/0 conn(0x7ff4b00b2fc0 legacy=0x7ff4b00654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b53a0700 1 -- 172.21.15.57:0/3381274865 >> v1:172.21.15.57:6789/0 conn(0x7ff4b00b18b0 legacy=0x7ff4b0147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4af7fe700 1 -- 172.21.15.57:0/3381274865 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2697615047 0 0) 0x7ff490003260 con 0x7ff4b00b18b0 2021-06-25T04:57:19.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b53a0700 1 -- 172.21.15.57:0/3381274865 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00b1170 con 0x7ff4b00a9bd0 2021-06-25T04:57:19.421 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b53a0700 1 --2- 172.21.15.57:0/3381274865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4b00a9bd0 0x7ff4b0148370 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7ff498001110 tx=0x7ff4a80091d0).ready entity=mon.0 client_cookie=4e45ad3c47cc24e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:19.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4af7fe700 1 -- 172.21.15.57:0/3381274865 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff498001660 con 0x7ff4b00a9bd0 2021-06-25T04:57:19.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4af7fe700 1 -- 172.21.15.57:0/3381274865 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a800f510 con 0x7ff4b00a9bd0 2021-06-25T04:57:19.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4af7fe700 1 -- 172.21.15.57:0/3381274865 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4a800f680 con 0x7ff4b00a9bd0 2021-06-25T04:57:19.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/3381274865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4b00a9bd0 msgr2=0x7ff4b0148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.422 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.410+0000 7ff4b5ba1700 1 --2- 172.21.15.57:0/3381274865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4b00a9bd0 0x7ff4b0148370 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7ff498001110 tx=0x7ff4a80091d0).stop 2021-06-25T04:57:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/3381274865 shutdown_connections 2021-06-25T04:57:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 --2- 172.21.15.57:0/3381274865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4b00a9bd0 0x7ff4b0148370 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/3381274865 >> 172.21.15.57:0/3381274865 conn(0x7ff4b00636a0 msgr2=0x7ff4b0063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/3381274865 shutdown_connections 2021-06-25T04:57:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/3381274865 wait complete. 2021-06-25T04:57:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 Processor -- start 2021-06-25T04:57:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 -- start start 2021-06-25T04:57:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b00a9bd0 0x7ff4b014e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4b00b18b0 0x7ff4b00ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4b00b2fc0 0x7ff4b0145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b015a280 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b015a4e0 con 0x7ff4b00a9bd0 2021-06-25T04:57:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b5ba1700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b015a780 con 0x7ff4b00b18b0 2021-06-25T04:57:19.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b53a0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4b00b2fc0 0x7ff4b0145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b53a0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4b00b2fc0 0x7ff4b0145260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44666/0 (socket says 172.21.15.57:44666) 2021-06-25T04:57:19.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.414+0000 7ff4b53a0700 1 -- 172.21.15.57:0/1618021356 learned_addr learned my addr 172.21.15.57:0/1618021356 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:19.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4b4b9f700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b00a9bd0 0x7ff4b014e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4affff700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4b00b18b0 0x7ff4b00ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4b53a0700 1 -- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4b00b18b0 msgr2=0x7ff4b00ab1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4b53a0700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4b00b18b0 0x7ff4b00ab1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4b53a0700 1 -- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b00a9bd0 msgr2=0x7ff4b014e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4b53a0700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b00a9bd0 0x7ff4b014e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4b53a0700 1 -- 172.21.15.57:0/1618021356 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8009470 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4affff700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4b00b18b0 0x7ff4b00ab1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4b53a0700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4b00b2fc0 0x7ff4b0145260 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7ff498001110 tx=0x7ff4a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4adffb700 1 -- 172.21.15.57:0/1618021356 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4a8006ea0 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4adffb700 1 -- 172.21.15.57:0/1618021356 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a80032d0 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/1618021356 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b014bfa0 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4adffb700 1 -- 172.21.15.57:0/1618021356 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4a8011dc0 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/1618021356 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b014c440 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/1618021356 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b014c130 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4adffb700 1 -- 172.21.15.57:0/1618021356 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff4a800f070 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.418+0000 7ff4adffb700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4940553d0 0x7ff494057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.422+0000 7ff4adffb700 1 -- 172.21.15.57:0/1618021356 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff4a806ec10 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.422+0000 7ff4b4b9f700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4940553d0 0x7ff494057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.422+0000 7ff4b4b9f700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4940553d0 0x7ff494057890 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7ff4a000d000 tx=0x7ff4a0007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.426+0000 7ff4adffb700 1 -- 172.21.15.57:0/1618021356 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff4a8044d60 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.594+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/1618021356 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff4b0057310 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.602+0000 7ff4adffb700 1 -- 172.21.15.57:0/1618021356 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff4a8015070 con 0x7ff4b00b2fc0 2021-06-25T04:57:19.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4940553d0 msgr2=0x7ff494057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.612 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4940553d0 0x7ff494057890 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7ff4a000d000 tx=0x7ff4a0007a00).stop 2021-06-25T04:57:19.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/1618021356 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4b00b2fc0 msgr2=0x7ff4b0145260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4b00b2fc0 0x7ff4b0145260 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7ff498001110 tx=0x7ff4a8016000).stop 2021-06-25T04:57:19.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/1618021356 shutdown_connections 2021-06-25T04:57:19.613 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4940553d0 0x7ff494057890 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4b00b2fc0 0x7ff4b0145260 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4b00b18b0 0x7ff4b00ab1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 --2- 172.21.15.57:0/1618021356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b00a9bd0 0x7ff4b014e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.614 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/1618021356 >> 172.21.15.57:0/1618021356 conn(0x7ff4b00636a0 msgr2=0x7ff4b0063a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:19.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/1618021356 shutdown_connections 2021-06-25T04:57:19.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.606+0000 7ff4b5ba1700 1 -- 172.21.15.57:0/1618021356 wait complete. 2021-06-25T04:57:19.615 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2021-06-25T04:57:19.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-06-25T04:57:19.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.730+0000 7f84fb278700 1 Processor -- start 2021-06-25T04:57:19.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.730+0000 7f84fb278700 1 -- start start 2021-06-25T04:57:19.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fb278700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f405c520 0x7f84f40b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fb278700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f40aa460 con 0x7f84f40af380 2021-06-25T04:57:19.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fb278700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f405fb40 con 0x7f84f4060160 2021-06-25T04:57:19.740 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fb278700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40b1410 con 0x7f84f405c520 2021-06-25T04:57:19.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fa276700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f84f40af380 0x7f84f4144410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33656/0 (socket says 172.21.15.57:33656) 2021-06-25T04:57:19.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fa276700 1 -- 172.21.15.57:0/3765254351 learned_addr learned my addr 172.21.15.57:0/3765254351 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:19.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84faa77700 1 --2- 172.21.15.57:0/3765254351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f405c520 0x7f84f40b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.741 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84f9274700 1 -- 172.21.15.57:0/3765254351 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844074234 0 0) 0x7f84f40aa460 con 0x7f84f40af380 2021-06-25T04:57:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84f9274700 1 -- 172.21.15.57:0/3765254351 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84dc003260 con 0x7f84f40af380 2021-06-25T04:57:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84f9274700 1 -- 172.21.15.57:0/3765254351 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134092675 0 0) 0x7f84f405fb40 con 0x7f84f4060160 2021-06-25T04:57:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84f9274700 1 -- 172.21.15.57:0/3765254351 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f40aa460 con 0x7f84f4060160 2021-06-25T04:57:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84f9274700 1 -- 172.21.15.57:0/3765254351 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 599713150 0 0) 0x7f84dc003260 con 0x7f84f40af380 2021-06-25T04:57:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84faa77700 1 -- 172.21.15.57:0/3765254351 >> v1:172.21.15.87:6789/0 conn(0x7f84f4060160 legacy=0x7f84f40a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84faa77700 1 -- 172.21.15.57:0/3765254351 >> v1:172.21.15.57:6789/0 conn(0x7f84f40af380 legacy=0x7f84f4144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84faa77700 1 -- 172.21.15.57:0/3765254351 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f405f670 con 0x7f84f405c520 2021-06-25T04:57:19.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84faa77700 1 --2- 172.21.15.57:0/3765254351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f405c520 0x7f84f40b0c70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f84f0001110 tx=0x7f84ec0091d0).ready entity=mon.2 client_cookie=b83f12db88e49021 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:19.743 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84f9274700 1 -- 172.21.15.57:0/3765254351 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f0001680 con 0x7f84f405c520 2021-06-25T04:57:19.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84f9274700 1 -- 172.21.15.57:0/3765254351 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec00f510 con 0x7f84f405c520 2021-06-25T04:57:19.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84f9274700 1 -- 172.21.15.57:0/3765254351 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84ec00f680 con 0x7f84f405c520 2021-06-25T04:57:19.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fb278700 1 -- 172.21.15.57:0/3765254351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f405c520 msgr2=0x7f84f40b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.744 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fb278700 1 --2- 172.21.15.57:0/3765254351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f405c520 0x7f84f40b0c70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f84f0001110 tx=0x7f84ec0091d0).stop 2021-06-25T04:57:19.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fb278700 1 -- 172.21.15.57:0/3765254351 shutdown_connections 2021-06-25T04:57:19.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fb278700 1 --2- 172.21.15.57:0/3765254351 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f405c520 0x7f84f40b0c70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.747 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fb278700 1 -- 172.21.15.57:0/3765254351 >> 172.21.15.57:0/3765254351 conn(0x7f84f4061100 msgr2=0x7f84f4062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:19.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fb278700 1 -- 172.21.15.57:0/3765254351 shutdown_connections 2021-06-25T04:57:19.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.734+0000 7f84fb278700 1 -- 172.21.15.57:0/3765254351 wait complete. 2021-06-25T04:57:19.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fb278700 1 Processor -- start 2021-06-25T04:57:19.748 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fb278700 1 -- start start 2021-06-25T04:57:19.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fb278700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84f405c520 0x7f84f414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fb278700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f4060160 0x7f84f414f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fb278700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40af380 0x7f84f41553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fb278700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40646f0 con 0x7f84f405c520 2021-06-25T04:57:19.749 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fb278700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4063f20 con 0x7f84f40af380 2021-06-25T04:57:19.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fb278700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4063c80 con 0x7f84f4060160 2021-06-25T04:57:19.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fa276700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84f405c520 0x7f84f414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fa276700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84f405c520 0x7f84f414f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44676/0 (socket says 172.21.15.57:44676) 2021-06-25T04:57:19.750 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fa276700 1 -- 172.21.15.57:0/1646668477 learned_addr learned my addr 172.21.15.57:0/1646668477 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:19.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84faa77700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40af380 0x7f84f41553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84f9a75700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f4060160 0x7f84f414f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fa276700 1 -- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f4060160 msgr2=0x7f84f414f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fa276700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f4060160 0x7f84f414f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.751 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fa276700 1 -- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40af380 msgr2=0x7f84f41553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fa276700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40af380 0x7f84f41553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fa276700 1 -- 172.21.15.57:0/1646668477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec009470 con 0x7f84f405c520 2021-06-25T04:57:19.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84faa77700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40af380 0x7f84f41553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:19.752 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fa276700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84f405c520 0x7f84f414f1c0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f84f0001860 tx=0x7f84f0001a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:19.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84e37fe700 1 -- 172.21.15.57:0/1646668477 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f000ce70 con 0x7f84f405c520 2021-06-25T04:57:19.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84e37fe700 1 -- 172.21.15.57:0/1646668477 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f0007170 con 0x7f84f405c520 2021-06-25T04:57:19.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fb278700 1 -- 172.21.15.57:0/1646668477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f4064450 con 0x7f84f405c520 2021-06-25T04:57:19.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84e37fe700 1 -- 172.21.15.57:0/1646668477 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f0004730 con 0x7f84f405c520 2021-06-25T04:57:19.753 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.738+0000 7f84fb278700 1 -- 172.21.15.57:0/1646668477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f40a2c80 con 0x7f84f405c520 2021-06-25T04:57:19.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.742+0000 7f84e37fe700 1 -- 172.21.15.57:0/1646668477 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f84f0004890 con 0x7f84f405c520 2021-06-25T04:57:19.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.742+0000 7f84fb278700 1 -- 172.21.15.57:0/1646668477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f4057310 con 0x7f84f405c520 2021-06-25T04:57:19.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.742+0000 7f84e37fe700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84d4055360 0x7f84d4057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:19.755 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.742+0000 7f84e37fe700 1 -- 172.21.15.57:0/1646668477 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f84f006db20 con 0x7f84f405c520 2021-06-25T04:57:19.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.742+0000 7f84f9a75700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84d4055360 0x7f84d4057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:19.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.742+0000 7f84f9a75700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84d4055360 0x7f84d4057820 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f84e400d000 tx=0x7f84e4007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:19.756 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.746+0000 7f84e37fe700 1 -- 172.21.15.57:0/1646668477 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f84f0043ae0 con 0x7f84f405c520 2021-06-25T04:57:19.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.914+0000 7f84fb278700 1 -- 172.21.15.57:0/1646668477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f84f40698a0 con 0x7f84f405c520 2021-06-25T04:57:19.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.922+0000 7f84e37fe700 1 -- 172.21.15.57:0/1646668477 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7f84f0001b30 con 0x7f84f405c520 2021-06-25T04:57:19.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 -- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84d4055360 msgr2=0x7f84d4057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84d4055360 0x7f84d4057820 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f84e400d000 tx=0x7f84e4007a20).stop 2021-06-25T04:57:19.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 -- 172.21.15.57:0/1646668477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84f405c520 msgr2=0x7f84f414f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:19.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84f405c520 0x7f84f414f1c0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f84f0001860 tx=0x7f84f0001a30).stop 2021-06-25T04:57:19.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 -- 172.21.15.57:0/1646668477 shutdown_connections 2021-06-25T04:57:19.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f84d4055360 0x7f84d4057820 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40af380 0x7f84f41553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f4060160 0x7f84f414f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 --2- 172.21.15.57:0/1646668477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84f405c520 0x7f84f414f1c0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:19.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 -- 172.21.15.57:0/1646668477 >> 172.21.15.57:0/1646668477 conn(0x7f84f4061100 msgr2=0x7f84f40aa640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:19.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 -- 172.21.15.57:0/1646668477 shutdown_connections 2021-06-25T04:57:19.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:19.926+0000 7f84fb278700 1 -- 172.21.15.57:0/1646668477 wait complete. 2021-06-25T04:57:19.935 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.1 2021-06-25T04:57:19.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:57:20.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.038+0000 7f562c788700 1 Processor -- start 2021-06-25T04:57:20.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.038+0000 7f562c788700 1 -- start start 2021-06-25T04:57:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5624067140 0x7f562405f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56240a7a50 con 0x7f56240b1930 2021-06-25T04:57:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56241475e0 con 0x7f56240a7670 2021-06-25T04:57:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5624147880 con 0x7f5624067140 2021-06-25T04:57:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f5629d23700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5624067140 0x7f562405f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562ad25700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f56240b1930 0x7f562405fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33674/0 (socket says 172.21.15.57:33674) 2021-06-25T04:57:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562ad25700 1 -- 172.21.15.57:0/2765122816 learned_addr learned my addr 172.21.15.57:0/2765122816 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:20.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f5629d23700 1 -- 172.21.15.57:0/2765122816 >> v1:172.21.15.87:6789/0 conn(0x7f56240a7670 legacy=0x7f5624066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f5629d23700 1 -- 172.21.15.57:0/2765122816 >> v1:172.21.15.57:6789/0 conn(0x7f56240b1930 legacy=0x7f562405fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f5629d23700 1 -- 172.21.15.57:0/2765122816 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5624147b20 con 0x7f5624067140 2021-06-25T04:57:20.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f5629522700 1 -- 172.21.15.57:0/2765122816 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000083610 0 0) 0x7f56240a7a50 con 0x7f56240b1930 2021-06-25T04:57:20.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f5629d23700 1 --2- 172.21.15.57:0/2765122816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5624067140 0x7f562405f670 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f56200032f0 tx=0x7f56200091d0).ready entity=mon.0 client_cookie=af95f07d7b6a7e13 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:20.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f5629522700 1 -- 172.21.15.57:0/2765122816 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5620009ea0 con 0x7f5624067140 2021-06-25T04:57:20.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f5629522700 1 -- 172.21.15.57:0/2765122816 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562000b8a0 con 0x7f5624067140 2021-06-25T04:57:20.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 -- 172.21.15.57:0/2765122816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5624067140 msgr2=0x7f562405f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 --2- 172.21.15.57:0/2765122816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5624067140 0x7f562405f670 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f56200032f0 tx=0x7f56200091d0).stop 2021-06-25T04:57:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f5629522700 1 -- 172.21.15.57:0/2765122816 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562000ba10 con 0x7f5624067140 2021-06-25T04:57:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 -- 172.21.15.57:0/2765122816 shutdown_connections 2021-06-25T04:57:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 --2- 172.21.15.57:0/2765122816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5624067140 0x7f562405f670 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 -- 172.21.15.57:0/2765122816 >> 172.21.15.57:0/2765122816 conn(0x7f56240b53a0 msgr2=0x7f56240b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 -- 172.21.15.57:0/2765122816 shutdown_connections 2021-06-25T04:57:20.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 -- 172.21.15.57:0/2765122816 wait complete. 2021-06-25T04:57:20.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 Processor -- start 2021-06-25T04:57:20.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.042+0000 7f562c788700 1 -- start start 2021-06-25T04:57:20.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562c788700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5624067140 0x7f56240ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562c788700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56240a7670 0x7f56240adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562c788700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56240b1930 0x7f56240ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562c788700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56240af710 con 0x7f56240a7670 2021-06-25T04:57:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562c788700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56240ac010 con 0x7f56240b1930 2021-06-25T04:57:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562c788700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56240abd70 con 0x7f5624067140 2021-06-25T04:57:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f5629d23700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56240a7670 0x7f56240adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f5629d23700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56240a7670 0x7f56240adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44692/0 (socket says 172.21.15.57:44692) 2021-06-25T04:57:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f5629d23700 1 -- 172.21.15.57:0/1533395818 learned_addr learned my addr 172.21.15.57:0/1533395818 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562ad25700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56240b1930 0x7f56240ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562a524700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5624067140 0x7f56240ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f5629d23700 1 -- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5624067140 msgr2=0x7f56240ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f5629d23700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5624067140 0x7f56240ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f5629d23700 1 -- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56240b1930 msgr2=0x7f56240ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f5629d23700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56240b1930 0x7f56240ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f5629d23700 1 -- 172.21.15.57:0/1533395818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5620009470 con 0x7f56240a7670 2021-06-25T04:57:20.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562a524700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5624067140 0x7f56240ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:20.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f5629d23700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56240a7670 0x7f56240adf20 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f56200032f0 tx=0x7f5620016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:20.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f56137fe700 1 -- 172.21.15.57:0/1533395818 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5620021440 con 0x7f56240a7670 2021-06-25T04:57:20.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f56137fe700 1 -- 172.21.15.57:0/1533395818 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56200215a0 con 0x7f56240a7670 2021-06-25T04:57:20.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f56137fe700 1 -- 172.21.15.57:0/1533395818 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5620021900 con 0x7f56240a7670 2021-06-25T04:57:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562c788700 1 -- 172.21.15.57:0/1533395818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56240aa540 con 0x7f56240a7670 2021-06-25T04:57:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562c788700 1 -- 172.21.15.57:0/1533395818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56240ae900 con 0x7f56240a7670 2021-06-25T04:57:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.046+0000 7f562c788700 1 -- 172.21.15.57:0/1533395818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56240aa6d0 con 0x7f56240a7670 2021-06-25T04:57:20.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.050+0000 7f56137fe700 1 -- 172.21.15.57:0/1533395818 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5620027020 con 0x7f56240a7670 2021-06-25T04:57:20.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.050+0000 7f56137fe700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56040554e0 0x7f56040579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.050+0000 7f56137fe700 1 -- 172.21.15.57:0/1533395818 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f562006f320 con 0x7f56240a7670 2021-06-25T04:57:20.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.050+0000 7f562a524700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56040554e0 0x7f56040579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.050+0000 7f562a524700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56040554e0 0x7f56040579a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f561400b000 tx=0x7f5614009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:20.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.054+0000 7f56137fe700 1 -- 172.21.15.57:0/1533395818 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f56200454d0 con 0x7f56240a7670 2021-06-25T04:57:20.225 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.218+0000 7f562c788700 1 -- 172.21.15.57:0/1533395818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5624057310 con 0x7f56240a7670 2021-06-25T04:57:20.226 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f56137fe700 1 -- 172.21.15.57:0/1533395818 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f56200159d0 con 0x7f56240a7670 2021-06-25T04:57:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:20.227 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/982651038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":982651038},{"type":"v1","addr":"172.21.15.57:6833","nonce":982651038}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/58225035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":58225035},{"type":"v1","addr":"172.21.15.57:6835","nonce":58225035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:57:17.702431+0000","modified":"2021-06-25T04:57:18.706360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8778":{"gid":8778,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3809657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3809657492},{"type":"v1","addr":"172.21.15.87:6835","nonce":3809657492}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-06-25T04:57:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 -- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56040554e0 msgr2=0x7f56040579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56040554e0 0x7f56040579a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f561400b000 tx=0x7f5614009040).stop 2021-06-25T04:57:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 -- 172.21.15.57:0/1533395818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56240a7670 msgr2=0x7f56240adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56240a7670 0x7f56240adf20 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f56200032f0 tx=0x7f5620016000).stop 2021-06-25T04:57:20.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 -- 172.21.15.57:0/1533395818 shutdown_connections 2021-06-25T04:57:20.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f56040554e0 0x7f56040579a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56240b1930 0x7f56240ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56240a7670 0x7f56240adf20 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 --2- 172.21.15.57:0/1533395818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5624067140 0x7f56240ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 -- 172.21.15.57:0/1533395818 >> 172.21.15.57:0/1533395818 conn(0x7f56240b53a0 msgr2=0x7f562405f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:20.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 -- 172.21.15.57:0/1533395818 shutdown_connections 2021-06-25T04:57:20.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.222+0000 7f562c788700 1 -- 172.21.15.57:0/1533395818 wait complete. 2021-06-25T04:57:20.232 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 80 2021-06-25T04:57:20.542 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:57:17.702431+0000', 'modified': '2021-06-25T04:57:18.706360+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8778}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8778': {'gid': 8778, 'name': 'b', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/3809657492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 3809657492}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 3809657492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:57:20.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:57:20.543 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-06-25T04:57:20.661 INFO:teuthology.orchestra.run.smithi087.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":8778,"want_state":"up:active","state":"up:active","rank_uptime":2.9437945170000002,"mdsmap_epoch":80,"osdmap_epoch":159,"osdmap_epoch_barrier":158,"uptime":7.3081462669999997} 2021-06-25T04:57:20.663 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 8778, "mdsmap_epoch": 80, "osdmap_epoch": 159, "osdmap_epoch_barrier": 158, "rank_uptime": 2.943794517, "state": "up:active", "uptime": 7.308146267, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:57:20.664 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:57:20.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.770+0000 7f8218017700 1 Processor -- start 2021-06-25T04:57:20.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 -- start start 2021-06-25T04:57:20.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82100a7670 0x7f8210066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82100b1930 0x7f8210066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f82100b0020 0x7f821005f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8210067410 con 0x7f82100b0020 2021-06-25T04:57:20.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82100a7a50 con 0x7f82100b1930 2021-06-25T04:57:20.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82101475e0 con 0x7f82100a7670 2021-06-25T04:57:20.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f82165b4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f82100b0020 0x7f821005f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f82165b4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f82100b0020 0x7f821005f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44702/0 (socket says 172.21.15.57:44702) 2021-06-25T04:57:20.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f82165b4700 1 -- 172.21.15.57:0/2144110186 learned_addr learned my addr 172.21.15.57:0/2144110186 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:20.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f82155b2700 1 --2- 172.21.15.57:0/2144110186 >> v2:172.21.15.87:3300/0 conn(0x7f82100b1930 0x7f8210066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8215db3700 1 --2- 172.21.15.57:0/2144110186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82100a7670 0x7f8210066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f82165b4700 1 -- 172.21.15.57:0/2144110186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82100a7670 msgr2=0x7f8210066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:20.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f82165b4700 1 --2- 172.21.15.57:0/2144110186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82100a7670 0x7f8210066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f82165b4700 1 -- 172.21.15.57:0/2144110186 >> v2:172.21.15.87:3300/0 conn(0x7f82100b1930 msgr2=0x7f8210066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:20.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f82165b4700 1 --2- 172.21.15.57:0/2144110186 >> v2:172.21.15.87:3300/0 conn(0x7f82100b1930 0x7f8210066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f82165b4700 1 -- 172.21.15.57:0/2144110186 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8210147880 con 0x7f82100b0020 2021-06-25T04:57:20.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f82155b2700 1 --2- 172.21.15.57:0/2144110186 >> v2:172.21.15.87:3300/0 conn(0x7f82100b1930 0x7f8210066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:20.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f82165b4700 1 --2- 172.21.15.57:0/2144110186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82100b0020 0x7f821005f670 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f82080032f0 tx=0x7f8208009290).ready entity=mon.0 client_cookie=6c51451f65ded0f5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:20.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8214db1700 1 -- 172.21.15.57:0/2144110186 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f820800b680 con 0x7f82100b0020 2021-06-25T04:57:20.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8214db1700 1 -- 172.21.15.57:0/2144110186 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820800b7e0 con 0x7f82100b0020 2021-06-25T04:57:20.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8214db1700 1 -- 172.21.15.57:0/2144110186 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f820800b950 con 0x7f82100b0020 2021-06-25T04:57:20.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 -- 172.21.15.57:0/2144110186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82100b0020 msgr2=0x7f821005f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 --2- 172.21.15.57:0/2144110186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82100b0020 0x7f821005f670 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f82080032f0 tx=0x7f8208009290).stop 2021-06-25T04:57:20.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 -- 172.21.15.57:0/2144110186 shutdown_connections 2021-06-25T04:57:20.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 --2- 172.21.15.57:0/2144110186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82100b0020 0x7f821005f670 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 --2- 172.21.15.57:0/2144110186 >> v2:172.21.15.87:3300/0 conn(0x7f82100b1930 0x7f8210066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 --2- 172.21.15.57:0/2144110186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82100a7670 0x7f8210066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 -- 172.21.15.57:0/2144110186 >> 172.21.15.57:0/2144110186 conn(0x7f82100b53a0 msgr2=0x7f82100b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:20.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 -- 172.21.15.57:0/2144110186 shutdown_connections 2021-06-25T04:57:20.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.774+0000 7f8218017700 1 -- 172.21.15.57:0/2144110186 wait complete. 2021-06-25T04:57:20.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f8218017700 1 Processor -- start 2021-06-25T04:57:20.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f8218017700 1 -- start start 2021-06-25T04:57:20.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f8218017700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82100a7670 0x7f82100ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f8218017700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82100b0020 0x7f82101446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f8218017700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82100b1930 0x7f8210144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f8218017700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82100aed70 con 0x7f82100b1930 2021-06-25T04:57:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f8218017700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82100af010 con 0x7f82100a7670 2021-06-25T04:57:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f8218017700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82100af2b0 con 0x7f82100b0020 2021-06-25T04:57:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f82165b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82100b1930 0x7f8210144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f82165b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82100b1930 0x7f8210144bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44708/0 (socket says 172.21.15.57:44708) 2021-06-25T04:57:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f8215db3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82100a7670 0x7f82100ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f82155b2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82100b0020 0x7f82101446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f82165b4700 1 -- 172.21.15.57:0/3441394256 learned_addr learned my addr 172.21.15.57:0/3441394256 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f82165b4700 1 -- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82100b0020 msgr2=0x7f82101446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f82165b4700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82100b0020 0x7f82101446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f82165b4700 1 -- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82100a7670 msgr2=0x7f82100ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f82165b4700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82100a7670 0x7f82100ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f82165b4700 1 -- 172.21.15.57:0/3441394256 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c00b180 con 0x7f82100b1930 2021-06-25T04:57:20.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f82155b2700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82100b0020 0x7f82101446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:20.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f82165b4700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82100b1930 0x7f8210144bb0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f82080032f0 tx=0x7f8208017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:20.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f81feffd700 1 -- 172.21.15.57:0/3441394256 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f820801f070 con 0x7f82100b1930 2021-06-25T04:57:20.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f81feffd700 1 -- 172.21.15.57:0/3441394256 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8208011c30 con 0x7f82100b1930 2021-06-25T04:57:20.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f8218017700 1 -- 172.21.15.57:0/3441394256 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8208009530 con 0x7f82100b1930 2021-06-25T04:57:20.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f81feffd700 1 -- 172.21.15.57:0/3441394256 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f820801b440 con 0x7f82100b1930 2021-06-25T04:57:20.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.778+0000 7f8218017700 1 -- 172.21.15.57:0/3441394256 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82101450a0 con 0x7f82100b1930 2021-06-25T04:57:20.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.782+0000 7f8218017700 1 -- 172.21.15.57:0/3441394256 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82100ab610 con 0x7f82100b1930 2021-06-25T04:57:20.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.782+0000 7f81feffd700 1 -- 172.21.15.57:0/3441394256 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f820800f070 con 0x7f82100b1930 2021-06-25T04:57:20.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.782+0000 7f81feffd700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81f0055450 0x7f81f0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.782+0000 7f81feffd700 1 -- 172.21.15.57:0/3441394256 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f820806f1e0 con 0x7f82100b1930 2021-06-25T04:57:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.782+0000 7f8215db3700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81f0055450 0x7f81f0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.782+0000 7f8215db3700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81f0055450 0x7f81f0057910 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f820000b000 tx=0x7f8200006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.790+0000 7f81feffd700 1 -- 172.21.15.57:0/3441394256 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8208045390 con 0x7f82100b1930 2021-06-25T04:57:20.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.918+0000 7f8218017700 1 -- 172.21.15.57:0/3441394256 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8210057310 con 0x7f82100b1930 2021-06-25T04:57:20.924 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.918+0000 7f81feffd700 1 -- 172.21.15.57:0/3441394256 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f82080489b0 con 0x7f82100b1930 2021-06-25T04:57:20.925 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:20.926 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":159,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:57:18.707220+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:57:16.192470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-06-25T04:57:17.377680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:57:20.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 -- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81f0055450 msgr2=0x7f81f0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81f0055450 0x7f81f0057910 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f820000b000 tx=0x7f8200006df0).stop 2021-06-25T04:57:20.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 -- 172.21.15.57:0/3441394256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82100b1930 msgr2=0x7f8210144bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:20.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82100b1930 0x7f8210144bb0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f82080032f0 tx=0x7f8208017000).stop 2021-06-25T04:57:20.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 -- 172.21.15.57:0/3441394256 shutdown_connections 2021-06-25T04:57:20.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f81f0055450 0x7f81f0057910 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.929 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82100b1930 0x7f8210144bb0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82100b0020 0x7f82101446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 --2- 172.21.15.57:0/3441394256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82100a7670 0x7f82100ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:20.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 -- 172.21.15.57:0/3441394256 >> 172.21.15.57:0/3441394256 conn(0x7f82100b53a0 msgr2=0x7f821005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:20.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 -- 172.21.15.57:0/3441394256 shutdown_connections 2021-06-25T04:57:20.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:20.922+0000 7f8218017700 1 -- 172.21.15.57:0/3441394256 wait complete. 2021-06-25T04:57:20.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:57:16.192470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:57:17.377680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:57:20.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:57:21.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.038+0000 7f37127f0700 1 Processor -- start 2021-06-25T04:57:21.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.038+0000 7f37127f0700 1 -- start start 2021-06-25T04:57:21.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f370c0b1e80 0x7f370c0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f370c0aff70 0x7f370c0b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f370c0a7080 0x7f370c141210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c0b03e0 con 0x7f370c0aff70 2021-06-25T04:57:21.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c0b2750 con 0x7f370c0b1e80 2021-06-25T04:57:21.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0b0610 con 0x7f370c0a7080 2021-06-25T04:57:21.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f370c0aff70 0x7f370c0b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f370c0aff70 0x7f370c0b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44712/0 (socket says 172.21.15.57:44712) 2021-06-25T04:57:21.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370b7fe700 1 -- 172.21.15.57:0/3934249402 learned_addr learned my addr 172.21.15.57:0/3934249402 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:21.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f3710d8d700 1 --2- 172.21.15.57:0/3934249402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f370c0a7080 0x7f370c141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370bfff700 1 --2- 172.21.15.57:0/3934249402 >> v2:172.21.15.87:3300/0 conn(0x7f370c0b1e80 0x7f370c0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370b7fe700 1 -- 172.21.15.57:0/3934249402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f370c0a7080 msgr2=0x7f370c141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:21.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370b7fe700 1 --2- 172.21.15.57:0/3934249402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f370c0a7080 0x7f370c141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370b7fe700 1 -- 172.21.15.57:0/3934249402 >> v2:172.21.15.87:3300/0 conn(0x7f370c0b1e80 msgr2=0x7f370c0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:21.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370b7fe700 1 --2- 172.21.15.57:0/3934249402 >> v2:172.21.15.87:3300/0 conn(0x7f370c0b1e80 0x7f370c0b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370b7fe700 1 -- 172.21.15.57:0/3934249402 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0b08b0 con 0x7f370c0aff70 2021-06-25T04:57:21.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370bfff700 1 --2- 172.21.15.57:0/3934249402 >> v2:172.21.15.87:3300/0 conn(0x7f370c0b1e80 0x7f370c0b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:57:21.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370b7fe700 1 --2- 172.21.15.57:0/3934249402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370c0aff70 0x7f370c0b2260 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f37000032f0 tx=0x7f3700009290).ready entity=mon.0 client_cookie=4d26b1b39a1f8e1f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370affd700 1 -- 172.21.15.57:0/3934249402 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f370000b870 con 0x7f370c0aff70 2021-06-25T04:57:21.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370affd700 1 -- 172.21.15.57:0/3934249402 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370000b9d0 con 0x7f370c0aff70 2021-06-25T04:57:21.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f370affd700 1 -- 172.21.15.57:0/3934249402 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f370000bb40 con 0x7f370c0aff70 2021-06-25T04:57:21.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 -- 172.21.15.57:0/3934249402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370c0aff70 msgr2=0x7f370c0b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 --2- 172.21.15.57:0/3934249402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370c0aff70 0x7f370c0b2260 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f37000032f0 tx=0x7f3700009290).stop 2021-06-25T04:57:21.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 -- 172.21.15.57:0/3934249402 shutdown_connections 2021-06-25T04:57:21.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 --2- 172.21.15.57:0/3934249402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f370c0a7080 0x7f370c141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 --2- 172.21.15.57:0/3934249402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370c0aff70 0x7f370c0b2260 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 --2- 172.21.15.57:0/3934249402 >> v2:172.21.15.87:3300/0 conn(0x7f370c0b1e80 0x7f370c0b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 -- 172.21.15.57:0/3934249402 >> 172.21.15.57:0/3934249402 conn(0x7f370c05f670 msgr2=0x7f370c05fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:21.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 -- 172.21.15.57:0/3934249402 shutdown_connections 2021-06-25T04:57:21.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 -- 172.21.15.57:0/3934249402 wait complete. 2021-06-25T04:57:21.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.042+0000 7f37127f0700 1 Processor -- start 2021-06-25T04:57:21.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37127f0700 1 -- start start 2021-06-25T04:57:21.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37127f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370c0a7080 0x7f370c13de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37127f0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370c0aff70 0x7f370c13cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37127f0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f370c0b1e80 0x7f370c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37127f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c14a0c0 con 0x7f370c0a7080 2021-06-25T04:57:21.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37127f0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c149e20 con 0x7f370c0aff70 2021-06-25T04:57:21.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37127f0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c14b720 con 0x7f370c0b1e80 2021-06-25T04:57:21.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f370bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370c0a7080 0x7f370c13de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f370bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370c0a7080 0x7f370c13de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44718/0 (socket says 172.21.15.57:44718) 2021-06-25T04:57:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f370bfff700 1 -- 172.21.15.57:0/2086077456 learned_addr learned my addr 172.21.15.57:0/2086077456 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f370b7fe700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370c0aff70 0x7f370c13cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f3710d8d700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f370c0b1e80 0x7f370c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f370bfff700 1 -- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f370c0b1e80 msgr2=0x7f370c0b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f370bfff700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f370c0b1e80 0x7f370c0b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f370bfff700 1 -- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370c0aff70 msgr2=0x7f370c13cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f370bfff700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370c0aff70 0x7f370c13cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f370bfff700 1 -- 172.21.15.57:0/2086077456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3700009530 con 0x7f370c0a7080 2021-06-25T04:57:21.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f370b7fe700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370c0aff70 0x7f370c13cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:21.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f370bfff700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370c0a7080 0x7f370c13de20 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f36fc007000 tx=0x7f36fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37097fa700 1 -- 172.21.15.57:0/2086077456 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36fc010580 con 0x7f370c0a7080 2021-06-25T04:57:21.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37097fa700 1 -- 172.21.15.57:0/2086077456 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc0106e0 con 0x7f370c0a7080 2021-06-25T04:57:21.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37127f0700 1 -- 172.21.15.57:0/2086077456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c14a4b0 con 0x7f370c0a7080 2021-06-25T04:57:21.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37097fa700 1 -- 172.21.15.57:0/2086077456 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36fc010a40 con 0x7f370c0a7080 2021-06-25T04:57:21.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.046+0000 7f37127f0700 1 -- 172.21.15.57:0/2086077456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c0ab7f0 con 0x7f370c0a7080 2021-06-25T04:57:21.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.050+0000 7f37127f0700 1 -- 172.21.15.57:0/2086077456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c14b8e0 con 0x7f370c0a7080 2021-06-25T04:57:21.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.050+0000 7f37097fa700 1 -- 172.21.15.57:0/2086077456 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f36fc010ba0 con 0x7f370c0a7080 2021-06-25T04:57:21.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.050+0000 7f37097fa700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36ec055340 0x7f36ec057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.050+0000 7f37097fa700 1 -- 172.21.15.57:0/2086077456 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f36fc06de50 con 0x7f370c0a7080 2021-06-25T04:57:21.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.050+0000 7f370b7fe700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36ec055340 0x7f36ec057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.050+0000 7f370b7fe700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36ec055340 0x7f36ec057800 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f3700018000 tx=0x7f3700016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.054+0000 7f37097fa700 1 -- 172.21.15.57:0/2086077456 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f36fc043f00 con 0x7f370c0a7080 2021-06-25T04:57:21.187 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.182+0000 7f37127f0700 1 -- 172.21.15.57:0/2086077456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f370c057310 con 0x7f370c0a7080 2021-06-25T04:57:21.188 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.182+0000 7f37097fa700 1 -- 172.21.15.57:0/2086077456 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v159) v1 ==== 110+0+10 (secure 0 0 0) 0x7f36fc047520 con 0x7f370c0a7080 2021-06-25T04:57:21.188 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:57:21.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 -- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36ec055340 msgr2=0x7f36ec057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36ec055340 0x7f36ec057800 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f3700018000 tx=0x7f3700016000).stop 2021-06-25T04:57:21.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 -- 172.21.15.57:0/2086077456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370c0a7080 msgr2=0x7f370c13de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370c0a7080 0x7f370c13de20 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f36fc007000 tx=0x7f36fc008040).stop 2021-06-25T04:57:21.192 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 -- 172.21.15.57:0/2086077456 shutdown_connections 2021-06-25T04:57:21.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36ec055340 0x7f36ec057800 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f370c0b1e80 0x7f370c0b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370c0aff70 0x7f370c13cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 --2- 172.21.15.57:0/2086077456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370c0a7080 0x7f370c13de20 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 -- 172.21.15.57:0/2086077456 >> 172.21.15.57:0/2086077456 conn(0x7f370c05f670 msgr2=0x7f370c0a7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:21.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 -- 172.21.15.57:0/2086077456 shutdown_connections 2021-06-25T04:57:21.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.186+0000 7f37127f0700 1 -- 172.21.15.57:0/2086077456 wait complete. 2021-06-25T04:57:21.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:57:21.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.314+0000 7efc468f2700 1 Processor -- start 2021-06-25T04:57:21.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.314+0000 7efc468f2700 1 -- start start 2021-06-25T04:57:21.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc400b0b40 0x7efc40146c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc400b0390 0x7efc40140180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc400b1100 con 0x7efc400a9150 2021-06-25T04:57:21.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc400a9530 con 0x7efc400b0b40 2021-06-25T04:57:21.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc400b1330 con 0x7efc400b0390 2021-06-25T04:57:21.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc450ef700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc400b0b40 0x7efc40146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc450ef700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc400b0b40 0x7efc40146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44728/0 (socket says 172.21.15.57:44728) 2021-06-25T04:57:21.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc450ef700 1 -- 172.21.15.57:0/1205735779 learned_addr learned my addr 172.21.15.57:0/1205735779 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:21.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc460f1700 1 --2- 172.21.15.57:0/1205735779 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc400b0390 0x7efc40140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc458f0700 1 --1- 172.21.15.57:0/1205735779 >> v1:172.21.15.87:6789/0 conn(0x7efc400a9150 0x7efc40146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:34460/0 (socket says 172.21.15.57:34460) 2021-06-25T04:57:21.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc450ef700 1 -- 172.21.15.57:0/1205735779 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc400b0390 msgr2=0x7efc40140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:21.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc450ef700 1 --2- 172.21.15.57:0/1205735779 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc400b0390 0x7efc40140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc450ef700 1 -- 172.21.15.57:0/1205735779 >> v1:172.21.15.87:6789/0 conn(0x7efc400a9150 legacy=0x7efc40146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc450ef700 1 -- 172.21.15.57:0/1205735779 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc400b15d0 con 0x7efc400b0b40 2021-06-25T04:57:21.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc450ef700 1 --2- 172.21.15.57:0/1205735779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400b0b40 0x7efc40146c20 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7efc30002f70 tx=0x7efc30006eb0).ready entity=mon.0 client_cookie=61b42c46f0be8c57 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc448ee700 1 -- 172.21.15.57:0/1205735779 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3000d570 con 0x7efc400b0b40 2021-06-25T04:57:21.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc448ee700 1 -- 172.21.15.57:0/1205735779 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc30000e90 con 0x7efc400b0b40 2021-06-25T04:57:21.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 -- 172.21.15.57:0/1205735779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400b0b40 msgr2=0x7efc40146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc448ee700 1 -- 172.21.15.57:0/1205735779 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3000d900 con 0x7efc400b0b40 2021-06-25T04:57:21.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 --2- 172.21.15.57:0/1205735779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400b0b40 0x7efc40146c20 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7efc30002f70 tx=0x7efc30006eb0).stop 2021-06-25T04:57:21.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 -- 172.21.15.57:0/1205735779 shutdown_connections 2021-06-25T04:57:21.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 --2- 172.21.15.57:0/1205735779 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc400b0390 0x7efc40140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 --2- 172.21.15.57:0/1205735779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400b0b40 0x7efc40146c20 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 -- 172.21.15.57:0/1205735779 >> 172.21.15.57:0/1205735779 conn(0x7efc40061100 msgr2=0x7efc40062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:21.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 -- 172.21.15.57:0/1205735779 shutdown_connections 2021-06-25T04:57:21.332 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.318+0000 7efc468f2700 1 -- 172.21.15.57:0/1205735779 wait complete. 2021-06-25T04:57:21.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc468f2700 1 Processor -- start 2021-06-25T04:57:21.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc468f2700 1 -- start start 2021-06-25T04:57:21.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc468f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc400a9150 0x7efc401455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc468f2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400b0390 0x7efc40152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc468f2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc400b0b40 0x7efc40152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc468f2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc40141880 con 0x7efc400b0390 2021-06-25T04:57:21.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc468f2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc40141340 con 0x7efc400a9150 2021-06-25T04:57:21.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc468f2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc401415e0 con 0x7efc400b0b40 2021-06-25T04:57:21.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc450ef700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400b0390 0x7efc40152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc450ef700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400b0390 0x7efc40152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44732/0 (socket says 172.21.15.57:44732) 2021-06-25T04:57:21.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc450ef700 1 -- 172.21.15.57:0/2614177290 learned_addr learned my addr 172.21.15.57:0/2614177290 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:21.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc458f0700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc400a9150 0x7efc401455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc460f1700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc400b0b40 0x7efc40152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc450ef700 1 -- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc400b0b40 msgr2=0x7efc40152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc450ef700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc400b0b40 0x7efc40152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc450ef700 1 -- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc400a9150 msgr2=0x7efc401455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc450ef700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc400a9150 0x7efc401455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc450ef700 1 -- 172.21.15.57:0/2614177290 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3000b1e0 con 0x7efc400b0390 2021-06-25T04:57:21.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc460f1700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc400b0b40 0x7efc40152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:57:21.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc450ef700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400b0390 0x7efc40152630 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7efc30002f70 tx=0x7efc30015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc2effd700 1 -- 172.21.15.57:0/2614177290 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc30021070 con 0x7efc400b0390 2021-06-25T04:57:21.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc2effd700 1 -- 172.21.15.57:0/2614177290 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc30000e90 con 0x7efc400b0390 2021-06-25T04:57:21.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc468f2700 1 -- 172.21.15.57:0/2614177290 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc40152190 con 0x7efc400b0390 2021-06-25T04:57:21.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc2effd700 1 -- 172.21.15.57:0/2614177290 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc30006be0 con 0x7efc400b0390 2021-06-25T04:57:21.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.322+0000 7efc468f2700 1 -- 172.21.15.57:0/2614177290 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc400a97e0 con 0x7efc400b0390 2021-06-25T04:57:21.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.326+0000 7efc468f2700 1 -- 172.21.15.57:0/2614177290 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc40152320 con 0x7efc400b0390 2021-06-25T04:57:21.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.326+0000 7efc2effd700 1 -- 172.21.15.57:0/2614177290 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7efc3000f070 con 0x7efc400b0390 2021-06-25T04:57:21.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.326+0000 7efc2effd700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc20055450 0x7efc20057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.326+0000 7efc2effd700 1 -- 172.21.15.57:0/2614177290 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efc3006f430 con 0x7efc400b0390 2021-06-25T04:57:21.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.326+0000 7efc458f0700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc20055450 0x7efc20057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.326+0000 7efc458f0700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc20055450 0x7efc20057910 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7efc3c00b000 tx=0x7efc3c007120).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.334+0000 7efc2effd700 1 -- 172.21.15.57:0/2614177290 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7efc300455e0 con 0x7efc400b0390 2021-06-25T04:57:21.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.458+0000 7efc468f2700 1 -- 172.21.15.57:0/2614177290 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efc40057310 con 0x7efc400b0390 2021-06-25T04:57:21.464 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.458+0000 7efc2effd700 1 -- 172.21.15.57:0/2614177290 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v159) v1 ==== 92+0+10 (secure 0 0 0) 0x7efc30048c00 con 0x7efc400b0390 2021-06-25T04:57:21.464 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:57:21.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.458+0000 7efc468f2700 1 -- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc20055450 msgr2=0x7efc20057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.458+0000 7efc468f2700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc20055450 0x7efc20057910 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7efc3c00b000 tx=0x7efc3c007120).stop 2021-06-25T04:57:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.458+0000 7efc468f2700 1 -- 172.21.15.57:0/2614177290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400b0390 msgr2=0x7efc40152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.458+0000 7efc468f2700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400b0390 0x7efc40152630 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7efc30002f70 tx=0x7efc30015000).stop 2021-06-25T04:57:21.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.458+0000 7efc468f2700 1 -- 172.21.15.57:0/2614177290 shutdown_connections 2021-06-25T04:57:21.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.458+0000 7efc468f2700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efc20055450 0x7efc20057910 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.458+0000 7efc468f2700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc400b0b40 0x7efc40152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.458+0000 7efc468f2700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc400b0390 0x7efc40152630 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.458+0000 7efc468f2700 1 --2- 172.21.15.57:0/2614177290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc400a9150 0x7efc401455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.462+0000 7efc468f2700 1 -- 172.21.15.57:0/2614177290 >> 172.21.15.57:0/2614177290 conn(0x7efc40061100 msgr2=0x7efc4013cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.462+0000 7efc468f2700 1 -- 172.21.15.57:0/2614177290 shutdown_connections 2021-06-25T04:57:21.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.462+0000 7efc468f2700 1 -- 172.21.15.57:0/2614177290 wait complete. 2021-06-25T04:57:21.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:57:21.588 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.582+0000 7ff4ff59e700 1 Processor -- start 2021-06-25T04:57:21.589 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.582+0000 7ff4ff59e700 1 -- start start 2021-06-25T04:57:21.591 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.582+0000 7ff4ff59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff5000b2540 0x7ff50014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.582+0000 7ff4ff59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5000a8a80 0x7ff50014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.582+0000 7ff4ff59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000a7080 con 0x7ff5000affd0 2021-06-25T04:57:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.582+0000 7ff4ff59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5000a72b0 con 0x7ff5000b2540 2021-06-25T04:57:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.582+0000 7ff4ff59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000a7550 con 0x7ff5000a8a80 2021-06-25T04:57:21.592 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.582+0000 7ff4fdd9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff5000affd0 0x7ff5000a8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33726/0 (socket says 172.21.15.57:33726) 2021-06-25T04:57:21.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.582+0000 7ff4fdd9b700 1 -- 172.21.15.57:0/2875633187 learned_addr learned my addr 172.21.15.57:0/2875633187 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:21.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fed9d700 1 --2- 172.21.15.57:0/2875633187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5000a8a80 0x7ff50014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fe59c700 1 --2- 172.21.15.57:0/2875633187 >> v2:172.21.15.87:3300/0 conn(0x7ff5000b2540 0x7ff50014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.593 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fd59a700 1 -- 172.21.15.57:0/2875633187 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015599671 0 0) 0x7ff5000a7080 con 0x7ff5000affd0 2021-06-25T04:57:21.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fd59a700 1 -- 172.21.15.57:0/2875633187 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e4003260 con 0x7ff5000affd0 2021-06-25T04:57:21.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fed9d700 1 -- 172.21.15.57:0/2875633187 >> v2:172.21.15.87:3300/0 conn(0x7ff5000b2540 msgr2=0x7ff50014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:21.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fed9d700 1 --2- 172.21.15.57:0/2875633187 >> v2:172.21.15.87:3300/0 conn(0x7ff5000b2540 0x7ff50014ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fed9d700 1 -- 172.21.15.57:0/2875633187 >> v1:172.21.15.57:6789/0 conn(0x7ff5000affd0 legacy=0x7ff5000a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.594 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fed9d700 1 -- 172.21.15.57:0/2875633187 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000a77f0 con 0x7ff5000a8a80 2021-06-25T04:57:21.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fed9d700 1 --2- 172.21.15.57:0/2875633187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5000a8a80 0x7ff50014b2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7ff4f80032f0 tx=0x7ff4f80091d0).ready entity=mon.2 client_cookie=9baac4d762199803 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fd59a700 1 -- 172.21.15.57:0/2875633187 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4f800b600 con 0x7ff5000a8a80 2021-06-25T04:57:21.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fd59a700 1 -- 172.21.15.57:0/2875633187 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f800b760 con 0x7ff5000a8a80 2021-06-25T04:57:21.595 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4fd59a700 1 -- 172.21.15.57:0/2875633187 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4f800b8d0 con 0x7ff5000a8a80 2021-06-25T04:57:21.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4ff59e700 1 -- 172.21.15.57:0/2875633187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5000a8a80 msgr2=0x7ff50014b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.596 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4ff59e700 1 --2- 172.21.15.57:0/2875633187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5000a8a80 0x7ff50014b2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7ff4f80032f0 tx=0x7ff4f80091d0).stop 2021-06-25T04:57:21.599 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4ff59e700 1 -- 172.21.15.57:0/2875633187 shutdown_connections 2021-06-25T04:57:21.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4ff59e700 1 --2- 172.21.15.57:0/2875633187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5000a8a80 0x7ff50014b2f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4ff59e700 1 --2- 172.21.15.57:0/2875633187 >> v2:172.21.15.87:3300/0 conn(0x7ff5000b2540 0x7ff50014ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4ff59e700 1 -- 172.21.15.57:0/2875633187 >> 172.21.15.57:0/2875633187 conn(0x7ff500060140 msgr2=0x7ff5000b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:21.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4ff59e700 1 -- 172.21.15.57:0/2875633187 shutdown_connections 2021-06-25T04:57:21.600 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4ff59e700 1 -- 172.21.15.57:0/2875633187 wait complete. 2021-06-25T04:57:21.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4ff59e700 1 Processor -- start 2021-06-25T04:57:21.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.586+0000 7ff4ff59e700 1 -- start start 2021-06-25T04:57:21.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4ff59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5000a8a80 0x7ff5001597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.601 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4ff59e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5000affd0 0x7ff5000b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4ff59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5000b2540 0x7ff500156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4ff59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000ac5f0 con 0x7ff5000b2540 2021-06-25T04:57:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4ff59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000ac350 con 0x7ff5000a8a80 2021-06-25T04:57:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4ff59e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff500156370 con 0x7ff5000affd0 2021-06-25T04:57:21.602 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5000b2540 0x7ff500156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fe59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5000a8a80 0x7ff5001597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5000b2540 0x7ff500156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44748/0 (socket says 172.21.15.57:44748) 2021-06-25T04:57:21.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fe59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5000a8a80 0x7ff5001597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:53238/0 (socket says 172.21.15.57:53238) 2021-06-25T04:57:21.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fed9d700 1 -- 172.21.15.57:0/3673488473 learned_addr learned my addr 172.21.15.57:0/3673488473 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:21.603 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fdd9b700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5000affd0 0x7ff5000b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fed9d700 1 -- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5000affd0 msgr2=0x7ff5000b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fed9d700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5000affd0 0x7ff5000b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fed9d700 1 -- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5000a8a80 msgr2=0x7ff5001597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.604 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fed9d700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5000a8a80 0x7ff5001597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fed9d700 1 -- 172.21.15.57:0/3673488473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f8009470 con 0x7ff5000b2540 2021-06-25T04:57:21.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4fed9d700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5000b2540 0x7ff500156ab0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7ff4f80032f0 tx=0x7ff4f8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4ef7fe700 1 -- 172.21.15.57:0/3673488473 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4f8006ea0 con 0x7ff5000b2540 2021-06-25T04:57:21.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4ef7fe700 1 -- 172.21.15.57:0/3673488473 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8011d30 con 0x7ff5000b2540 2021-06-25T04:57:21.605 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4ef7fe700 1 -- 172.21.15.57:0/3673488473 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4f8011ea0 con 0x7ff5000b2540 2021-06-25T04:57:21.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4ff59e700 1 -- 172.21.15.57:0/3673488473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff500156610 con 0x7ff5000b2540 2021-06-25T04:57:21.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.590+0000 7ff4ff59e700 1 -- 172.21.15.57:0/3673488473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5000b55f0 con 0x7ff5000b2540 2021-06-25T04:57:21.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.594+0000 7ff4ff59e700 1 -- 172.21.15.57:0/3673488473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5001567a0 con 0x7ff5000b2540 2021-06-25T04:57:21.606 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.594+0000 7ff4ef7fe700 1 -- 172.21.15.57:0/3673488473 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff4f800f070 con 0x7ff5000b2540 2021-06-25T04:57:21.607 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.594+0000 7ff4ef7fe700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4dc055450 0x7ff4dc057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.594+0000 7ff4ef7fe700 1 -- 172.21.15.57:0/3673488473 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff4f806e850 con 0x7ff5000b2540 2021-06-25T04:57:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.594+0000 7ff4fe59c700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4dc055450 0x7ff4dc057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.594+0000 7ff4fe59c700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4dc055450 0x7ff4dc057910 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7ff4f400b000 tx=0x7ff4f4006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.608 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.598+0000 7ff4ef7fe700 1 -- 172.21.15.57:0/3673488473 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff4f80448f0 con 0x7ff5000b2540 2021-06-25T04:57:21.733 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.726+0000 7ff4ff59e700 1 -- 172.21.15.57:0/3673488473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff500057310 con 0x7ff5000b2540 2021-06-25T04:57:21.734 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.726+0000 7ff4ef7fe700 1 -- 172.21.15.57:0/3673488473 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff4f80150a0 con 0x7ff5000b2540 2021-06-25T04:57:21.734 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:57:21.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 -- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4dc055450 msgr2=0x7ff4dc057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.736 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4dc055450 0x7ff4dc057910 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7ff4f400b000 tx=0x7ff4f4006df0).stop 2021-06-25T04:57:21.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 -- 172.21.15.57:0/3673488473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5000b2540 msgr2=0x7ff500156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5000b2540 0x7ff500156ab0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7ff4f80032f0 tx=0x7ff4f8016000).stop 2021-06-25T04:57:21.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 -- 172.21.15.57:0/3673488473 shutdown_connections 2021-06-25T04:57:21.737 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff4dc055450 0x7ff4dc057910 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5000b2540 0x7ff500156ab0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5000affd0 0x7ff5000b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 --2- 172.21.15.57:0/3673488473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5000a8a80 0x7ff5001597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 -- 172.21.15.57:0/3673488473 >> 172.21.15.57:0/3673488473 conn(0x7ff500060140 msgr2=0x7ff5001499b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:21.738 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 -- 172.21.15.57:0/3673488473 shutdown_connections 2021-06-25T04:57:21.739 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.730+0000 7ff4ff59e700 1 -- 172.21.15.57:0/3673488473 wait complete. 2021-06-25T04:57:21.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:57:21.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69fd305700 1 Processor -- start 2021-06-25T04:57:21.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69fd305700 1 -- start start 2021-06-25T04:57:21.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69fd305700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80b3090 0x7f69f81433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69fd305700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f81438e0 con 0x7f69f80b06d0 2021-06-25T04:57:21.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69fd305700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f80b0ab0 con 0x7f69f80ace30 2021-06-25T04:57:21.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69fd305700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80ae640 con 0x7f69f80b3090 2021-06-25T04:57:21.857 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f69f80b06d0 0x7f69f8142ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33738/0 (socket says 172.21.15.57:33738) 2021-06-25T04:57:21.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f7fff700 1 -- 172.21.15.57:0/2871187123 learned_addr learned my addr 172.21.15.57:0/2871187123 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:21.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f77fe700 1 --2- 172.21.15.57:0/2871187123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80b3090 0x7f69f81433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f6ffd700 1 -- 172.21.15.57:0/2871187123 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257109987 0 0) 0x7f69f81438e0 con 0x7f69f80b06d0 2021-06-25T04:57:21.858 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f6ffd700 1 -- 172.21.15.57:0/2871187123 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d8003260 con 0x7f69f80b06d0 2021-06-25T04:57:21.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f77fe700 1 -- 172.21.15.57:0/2871187123 >> v1:172.21.15.87:6789/0 conn(0x7f69f80ace30 legacy=0x7f69f813f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f6ffd700 1 -- 172.21.15.57:0/2871187123 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291975962 0 0) 0x7f69f80b0ab0 con 0x7f69f80ace30 2021-06-25T04:57:21.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f77fe700 1 -- 172.21.15.57:0/2871187123 >> v1:172.21.15.57:6789/0 conn(0x7f69f80b06d0 legacy=0x7f69f8142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f77fe700 1 -- 172.21.15.57:0/2871187123 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f80ae8e0 con 0x7f69f80b3090 2021-06-25T04:57:21.859 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f77fe700 1 --2- 172.21.15.57:0/2871187123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80b3090 0x7f69f81433f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f69e80032f0 tx=0x7f69e80091d0).ready entity=mon.2 client_cookie=ba5e592c26ea58b9 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f6ffd700 1 -- 172.21.15.57:0/2871187123 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e800b6c0 con 0x7f69f80b3090 2021-06-25T04:57:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f6ffd700 1 -- 172.21.15.57:0/2871187123 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e800b820 con 0x7f69f80b3090 2021-06-25T04:57:21.861 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69f6ffd700 1 -- 172.21.15.57:0/2871187123 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e800b990 con 0x7f69f80b3090 2021-06-25T04:57:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69fd305700 1 -- 172.21.15.57:0/2871187123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80b3090 msgr2=0x7f69f81433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.850+0000 7f69fd305700 1 --2- 172.21.15.57:0/2871187123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80b3090 0x7f69f81433f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f69e80032f0 tx=0x7f69e80091d0).stop 2021-06-25T04:57:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.854+0000 7f69fd305700 1 -- 172.21.15.57:0/2871187123 shutdown_connections 2021-06-25T04:57:21.862 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.854+0000 7f69fd305700 1 --2- 172.21.15.57:0/2871187123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80b3090 0x7f69f81433f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.854+0000 7f69fd305700 1 -- 172.21.15.57:0/2871187123 >> 172.21.15.57:0/2871187123 conn(0x7f69f8061100 msgr2=0x7f69f8062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.854+0000 7f69fd305700 1 -- 172.21.15.57:0/2871187123 shutdown_connections 2021-06-25T04:57:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.854+0000 7f69fd305700 1 -- 172.21.15.57:0/2871187123 wait complete. 2021-06-25T04:57:21.863 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.854+0000 7f69fd305700 1 Processor -- start 2021-06-25T04:57:21.864 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.854+0000 7f69fd305700 1 -- start start 2021-06-25T04:57:21.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69fd305700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80ace30 0x7f69f8065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.866 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69fd305700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80b06d0 0x7f69f814db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69fd305700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69f80b3090 0x7f69f814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69fd305700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f813a460 con 0x7f69f80ace30 2021-06-25T04:57:21.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69fd305700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8139b50 con 0x7f69f80b3090 2021-06-25T04:57:21.867 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69fd305700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f805eef0 con 0x7f69f80b06d0 2021-06-25T04:57:21.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80ace30 0x7f69f8065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80ace30 0x7f69f8065ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44758/0 (socket says 172.21.15.57:44758) 2021-06-25T04:57:21.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f7fff700 1 -- 172.21.15.57:0/1766446317 learned_addr learned my addr 172.21.15.57:0/1766446317 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:21.868 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f77fe700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80b06d0 0x7f69f814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69fcb04700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69f80b3090 0x7f69f814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f7fff700 1 -- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80b06d0 msgr2=0x7f69f814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f7fff700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80b06d0 0x7f69f814db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.869 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f7fff700 1 -- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69f80b3090 msgr2=0x7f69f814f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:21.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f7fff700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69f80b3090 0x7f69f814f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:21.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f7fff700 1 -- 172.21.15.57:0/1766446317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8009470 con 0x7f69f80ace30 2021-06-25T04:57:21.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f7fff700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80ace30 0x7f69f8065ae0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f69e0001110 tx=0x7f69e0007b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f57fa700 1 -- 172.21.15.57:0/1766446317 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e00072e0 con 0x7f69f80ace30 2021-06-25T04:57:21.870 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f57fa700 1 -- 172.21.15.57:0/1766446317 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e0007440 con 0x7f69f80ace30 2021-06-25T04:57:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69fd305700 1 -- 172.21.15.57:0/1766446317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f80672f0 con 0x7f69f80ace30 2021-06-25T04:57:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69f57fa700 1 -- 172.21.15.57:0/1766446317 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e0005800 con 0x7f69f80ace30 2021-06-25T04:57:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69fd305700 1 -- 172.21.15.57:0/1766446317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f8139d80 con 0x7f69f80ace30 2021-06-25T04:57:21.871 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.858+0000 7f69fd305700 1 -- 172.21.15.57:0/1766446317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f8057310 con 0x7f69f80ace30 2021-06-25T04:57:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.862+0000 7f69f57fa700 1 -- 172.21.15.57:0/1766446317 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f69e0005960 con 0x7f69f80ace30 2021-06-25T04:57:21.872 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.862+0000 7f69f57fa700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69dc055510 0x7f69dc0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:21.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.862+0000 7f69f57fa700 1 -- 172.21.15.57:0/1766446317 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f69e0070340 con 0x7f69f80ace30 2021-06-25T04:57:21.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.862+0000 7f69f77fe700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69dc055510 0x7f69dc0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:21.873 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.862+0000 7f69f77fe700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69dc055510 0x7f69dc0579d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f69e801b000 tx=0x7f69e8016000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:21.874 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.866+0000 7f69f57fa700 1 -- 172.21.15.57:0/1766446317 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f69e00463e0 con 0x7f69f80ace30 2021-06-25T04:57:21.999 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.994+0000 7f69fd305700 1 -- 172.21.15.57:0/1766446317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69f80b2c30 con 0x7f69f80ace30 2021-06-25T04:57:22.000 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.994+0000 7f69f57fa700 1 -- 172.21.15.57:0/1766446317 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v159) v1 ==== 100+0+10 (secure 0 0 0) 0x7f69e0049a00 con 0x7f69f80ace30 2021-06-25T04:57:22.000 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:57:22.002 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 -- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69dc055510 msgr2=0x7f69dc0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:22.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69dc055510 0x7f69dc0579d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f69e801b000 tx=0x7f69e8016000).stop 2021-06-25T04:57:22.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 -- 172.21.15.57:0/1766446317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80ace30 msgr2=0x7f69f8065ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:22.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80ace30 0x7f69f8065ae0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f69e0001110 tx=0x7f69e0007b30).stop 2021-06-25T04:57:22.003 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 -- 172.21.15.57:0/1766446317 shutdown_connections 2021-06-25T04:57:22.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f69dc055510 0x7f69dc0579d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69f80b3090 0x7f69f814f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69f80b06d0 0x7f69f814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 --2- 172.21.15.57:0/1766446317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f80ace30 0x7f69f8065ae0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.004 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 -- 172.21.15.57:0/1766446317 >> 172.21.15.57:0/1766446317 conn(0x7f69f8061100 msgr2=0x7f69f813fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:22.005 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 -- 172.21.15.57:0/1766446317 shutdown_connections 2021-06-25T04:57:22.006 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:21.998+0000 7f69fd305700 1 -- 172.21.15.57:0/1766446317 wait complete. 2021-06-25T04:57:22.014 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:57:22.015 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:57:22.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d31d2700 1 Processor -- start 2021-06-25T04:57:22.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d31d2700 1 -- start start 2021-06-25T04:57:22.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d31d2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc0b5460 0x7fe9cc0af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:22.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d31d2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe9cc0b05d0 0x7fe9cc147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:22.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d31d2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc0b5840 con 0x7fe9cc067560 2021-06-25T04:57:22.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d31d2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9cc1452a0 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d31d2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0adfb0 con 0x7fe9cc0b5460 2021-06-25T04:57:22.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d19cf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe9cc0b05d0 0x7fe9cc147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:22.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d19cf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe9cc0b05d0 0x7fe9cc147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44766/0 (socket says 172.21.15.57:44766) 2021-06-25T04:57:22.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d19cf700 1 -- 172.21.15.57:0/367279619 learned_addr learned my addr 172.21.15.57:0/367279619 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:22.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d21d0700 1 --2- 172.21.15.57:0/367279619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc0b5460 0x7fe9cc0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:22.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d19cf700 1 -- 172.21.15.57:0/367279619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc0b5460 msgr2=0x7fe9cc0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:22.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d19cf700 1 --2- 172.21.15.57:0/367279619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc0b5460 0x7fe9cc0af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d19cf700 1 -- 172.21.15.57:0/367279619 >> v1:172.21.15.57:6789/0 conn(0x7fe9cc067560 legacy=0x7fe9cc0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:22.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d19cf700 1 -- 172.21.15.57:0/367279619 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc0ac7c0 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d21d0700 1 --2- 172.21.15.57:0/367279619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc0b5460 0x7fe9cc0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:57:22.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d19cf700 1 --2- 172.21.15.57:0/367279619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b05d0 0x7fe9cc147560 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fe9c80032f0 tx=0x7fe9c8009290).ready entity=mon.0 client_cookie=16373a11aeae57a5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:22.127 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d11ce700 1 -- 172.21.15.57:0/367279619 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c800b8a0 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d11ce700 1 -- 172.21.15.57:0/367279619 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c800ba00 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d11ce700 1 -- 172.21.15.57:0/367279619 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c800bb70 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d31d2700 1 -- 172.21.15.57:0/367279619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b05d0 msgr2=0x7fe9cc147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:22.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.114+0000 7fe9d31d2700 1 --2- 172.21.15.57:0/367279619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b05d0 0x7fe9cc147560 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fe9c80032f0 tx=0x7fe9c8009290).stop 2021-06-25T04:57:22.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.118+0000 7fe9d31d2700 1 -- 172.21.15.57:0/367279619 shutdown_connections 2021-06-25T04:57:22.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.118+0000 7fe9d31d2700 1 --2- 172.21.15.57:0/367279619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b05d0 0x7fe9cc147560 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.118+0000 7fe9d31d2700 1 --2- 172.21.15.57:0/367279619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc0b5460 0x7fe9cc0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.118+0000 7fe9d31d2700 1 -- 172.21.15.57:0/367279619 >> 172.21.15.57:0/367279619 conn(0x7fe9cc062520 msgr2=0x7fe9cc062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:22.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.118+0000 7fe9d31d2700 1 -- 172.21.15.57:0/367279619 shutdown_connections 2021-06-25T04:57:22.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.118+0000 7fe9d31d2700 1 -- 172.21.15.57:0/367279619 wait complete. 2021-06-25T04:57:22.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.118+0000 7fe9d31d2700 1 Processor -- start 2021-06-25T04:57:22.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.118+0000 7fe9d31d2700 1 -- start start 2021-06-25T04:57:22.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d31d2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc067560 0x7fe9cc14d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:22.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d31d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b05d0 0x7fe9cc0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:22.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d31d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0b5460 0x7fe9cc146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:22.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d31d2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0b3b10 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d31d2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0b2f20 con 0x7fe9cc0b5460 2021-06-25T04:57:22.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d31d2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc1460b0 con 0x7fe9cc067560 2021-06-25T04:57:22.135 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d19cf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b05d0 0x7fe9cc0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:22.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d19cf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b05d0 0x7fe9cc0b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44774/0 (socket says 172.21.15.57:44774) 2021-06-25T04:57:22.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d19cf700 1 -- 172.21.15.57:0/2350546974 learned_addr learned my addr 172.21.15.57:0/2350546974 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:22.136 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d21d0700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc067560 0x7fe9cc14d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:22.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d29d1700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0b5460 0x7fe9cc146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:22.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d19cf700 1 -- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc067560 msgr2=0x7fe9cc14d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:22.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d19cf700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc067560 0x7fe9cc14d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d19cf700 1 -- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0b5460 msgr2=0x7fe9cc146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:22.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d19cf700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0b5460 0x7fe9cc146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d19cf700 1 -- 172.21.15.57:0/2350546974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8009530 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d29d1700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0b5460 0x7fe9cc146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:22.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d19cf700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b05d0 0x7fe9cc0b3620 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7fe9c80032f0 tx=0x7fe9c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:22.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9bb7fe700 1 -- 172.21.15.57:0/2350546974 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c8011bd0 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9bb7fe700 1 -- 172.21.15.57:0/2350546974 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c8011d30 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9bb7fe700 1 -- 172.21.15.57:0/2350546974 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c8011ea0 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d31d2700 1 -- 172.21.15.57:0/2350546974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc145e10 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d31d2700 1 -- 172.21.15.57:0/2350546974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc14d7e0 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.122+0000 7fe9d31d2700 1 -- 172.21.15.57:0/2350546974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc057310 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.126+0000 7fe9bb7fe700 1 -- 172.21.15.57:0/2350546974 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fe9c800f070 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.126+0000 7fe9bb7fe700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9ac055510 0x7fe9ac0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:22.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.126+0000 7fe9bb7fe700 1 -- 172.21.15.57:0/2350546974 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe9c806e5c0 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.126+0000 7fe9d21d0700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9ac055510 0x7fe9ac0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:22.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.126+0000 7fe9d21d0700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9ac055510 0x7fe9ac0579d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fe9bc00d000 tx=0x7fe9bc008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:22.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.130+0000 7fe9bb7fe700 1 -- 172.21.15.57:0/2350546974 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fe9c8044770 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.298 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 -- 172.21.15.57:0/2350546974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9cc060e50 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.299 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9bb7fe700 1 -- 172.21.15.57:0/2350546974 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2486 (secure 0 0 0) 0x7fe9c8024090 con 0x7fe9cc0b05d0 2021-06-25T04:57:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:22.300 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/982651038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":982651038},{"type":"v1","addr":"172.21.15.57:6833","nonce":982651038}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/58225035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":58225035},{"type":"v1","addr":"172.21.15.57:6835","nonce":58225035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:57:17.702431+0000","modified":"2021-06-25T04:57:18.706360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8778":{"gid":8778,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3809657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3809657492},{"type":"v1","addr":"172.21.15.87:6835","nonce":3809657492}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-06-25T04:57:22.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 -- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9ac055510 msgr2=0x7fe9ac0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:22.301 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9ac055510 0x7fe9ac0579d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fe9bc00d000 tx=0x7fe9bc008040).stop 2021-06-25T04:57:22.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 -- 172.21.15.57:0/2350546974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b05d0 msgr2=0x7fe9cc0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:22.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b05d0 0x7fe9cc0b3620 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7fe9c80032f0 tx=0x7fe9c8016000).stop 2021-06-25T04:57:22.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 -- 172.21.15.57:0/2350546974 shutdown_connections 2021-06-25T04:57:22.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fe9ac055510 0x7fe9ac0579d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0b5460 0x7fe9cc146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9cc0b05d0 0x7fe9cc0b3620 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 --2- 172.21.15.57:0/2350546974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc067560 0x7fe9cc14d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:22.303 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 -- 172.21.15.57:0/2350546974 >> 172.21.15.57:0/2350546974 conn(0x7fe9cc062520 msgr2=0x7fe9cc14c020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:22.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 -- 172.21.15.57:0/2350546974 shutdown_connections 2021-06-25T04:57:22.304 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:22.294+0000 7fe9d31d2700 1 -- 172.21.15.57:0/2350546974 wait complete. 2021-06-25T04:57:22.304 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 80 2021-06-25T04:57:22.614 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:57:17.702431+0000', 'modified': '2021-06-25T04:57:18.706360+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8778}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8778': {'gid': 8778, 'name': 'b', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/3809657492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 3809657492}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 3809657492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:57:22.615 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:57:22.615 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-06-25T04:57:22.727 INFO:teuthology.orchestra.run.smithi087.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":8778,"want_state":"up:active","state":"up:active","rank_uptime":5.0103583909999996,"mdsmap_epoch":80,"osdmap_epoch":159,"osdmap_epoch_barrier":158,"uptime":9.3747101910000001} 2021-06-25T04:57:22.728 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 8778, "mdsmap_epoch": 80, "osdmap_epoch": 159, "osdmap_epoch_barrier": 158, "rank_uptime": 5.010358391, "state": "up:active", "uptime": 9.374710191, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:57:22.729 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:57:22.729 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-06-25T04:57:22.730 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi102.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-06-25T04:57:22.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:22.731 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:57:22.741 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:57:22.800 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:57:22.800 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:57:22.813 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:57:22.815 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:57:22.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:22.816 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:57:22.821 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:57:22.822 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:57:22.865 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:57:22.881 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:57:22.882 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:57:22.891 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:57:22.892 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:57:22.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:22.894 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:57:22.939 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2021-06-25T04:57:22.933+0000 7fe772947080 -1 init, newargv = 0x557ebe197920 newargc=9ceph-fuse[15747]: starting ceph client 2021-06-25T04:57:22.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr: 2021-06-25T04:57:22.949 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[15747]: starting fuse 2021-06-25T04:57:24.042 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2021-06-25T04:57:24.062 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:57:24.063 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:57:24.074 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:57:24.075 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:57:24.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:24.077 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2021-06-25T04:57:24.125 INFO:teuthology.orchestra.run.smithi102.stdout:52 2021-06-25T04:57:24.125 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:57:24.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:24.126 DEBUG:teuthology.orchestra.run.smithi102:> sudo python3 -c ' 2021-06-25T04:57:24.127 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2021-06-25T04:57:24.127 DEBUG:teuthology.orchestra.run.smithi102:> import re 2021-06-25T04:57:24.128 DEBUG:teuthology.orchestra.run.smithi102:> import os 2021-06-25T04:57:24.128 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2021-06-25T04:57:24.129 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:57:24.129 DEBUG:teuthology.orchestra.run.smithi102:> def find_socket(client_name): 2021-06-25T04:57:24.130 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-06-25T04:57:24.130 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2021-06-25T04:57:24.131 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:57:24.131 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2021-06-25T04:57:24.132 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2021-06-25T04:57:24.132 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2021-06-25T04:57:24.133 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2021-06-25T04:57:24.133 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:57:24.134 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2021-06-25T04:57:24.134 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:57:24.135 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:57:24.135 DEBUG:teuthology.orchestra.run.smithi102:> return f 2021-06-25T04:57:24.136 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:57:24.136 DEBUG:teuthology.orchestra.run.smithi102:> 2021-06-25T04:57:24.137 DEBUG:teuthology.orchestra.run.smithi102:> print(find_socket("client.0")) 2021-06-25T04:57:24.137 DEBUG:teuthology.orchestra.run.smithi102:> ' 2021-06-25T04:57:24.181 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.15747.asok 2021-06-25T04:57:24.186 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15747.asok 2021-06-25T04:57:24.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:24.187 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15747.asok status 2021-06-25T04:57:24.275 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2021-06-25T04:57:24.275 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2021-06-25T04:57:24.275 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:57:24.276 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:57:24.276 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2021-06-25T04:57:24.276 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2021-06-25T04:57:24.276 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-06-25T04:57:24.277 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "15747", 2021-06-25T04:57:24.277 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2021-06-25T04:57:24.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:57:24.277 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2021-06-25T04:57:24.277 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2021-06-25T04:57:24.278 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 8931, 2021-06-25T04:57:24.278 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2021-06-25T04:57:24.278 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2021-06-25T04:57:24.278 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2021-06-25T04:57:24.279 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 8931 2021-06-25T04:57:24.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:57:24.279 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:57:24.279 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:57:24.279 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:57:24.280 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4266420452 2021-06-25T04:57:24.280 INFO:teuthology.orchestra.run.smithi102.stdout: } 2021-06-25T04:57:24.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:57:24.281 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2021-06-25T04:57:24.281 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2021-06-25T04:57:24.282 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2021-06-25T04:57:24.282 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4266420452 2021-06-25T04:57:24.282 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2021-06-25T04:57:24.282 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.8931 172.21.15.102:0/4266420452", 2021-06-25T04:57:24.283 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "172.21.15.102:0/4266420452", 2021-06-25T04:57:24.283 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2021-06-25T04:57:24.283 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 80, 2021-06-25T04:57:24.283 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 159, 2021-06-25T04:57:24.283 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:57:24.284 INFO:teuthology.orchestra.run.smithi102.stdout: "blacklisted": false, 2021-06-25T04:57:24.284 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2021-06-25T04:57:24.284 INFO:teuthology.orchestra.run.smithi102.stdout:} 2021-06-25T04:57:24.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:24.286 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:24.286 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:57:24.294 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2021-06-25T04:57:24.295 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-06-25T04:57:24.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:24.296 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:57:24.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T04:57:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.418+0000 7f31b4a88700 1 Processor -- start 2021-06-25T04:57:24.426 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.418+0000 7f31b4a88700 1 -- start start 2021-06-25T04:57:24.428 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.418+0000 7f31b4a88700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31b00b05d0 0x7f31b00af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.418+0000 7f31b4a88700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31b0147560 0x7f31b00acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.418+0000 7f31b4a88700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b00b5840 con 0x7f31b00b5460 2021-06-25T04:57:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.418+0000 7f31b4a88700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b01452a0 con 0x7f31b0147560 2021-06-25T04:57:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.418+0000 7f31b4a88700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b00adfb0 con 0x7f31b00b05d0 2021-06-25T04:57:24.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.418+0000 7f31af7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f31b00b5460 0x7f31b0067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33766/0 (socket says 172.21.15.57:33766) 2021-06-25T04:57:24.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.418+0000 7f31af7fe700 1 -- 172.21.15.57:0/3115015476 learned_addr learned my addr 172.21.15.57:0/3115015476 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:24.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.418+0000 7f31aeffd700 1 --2- 172.21.15.57:0/3115015476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31b00b05d0 0x7f31b00af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.430 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.418+0000 7f31affff700 1 --2- 172.21.15.57:0/3115015476 >> v2:172.21.15.87:3300/0 conn(0x7f31b0147560 0x7f31b00acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31ae7fc700 1 -- 172.21.15.57:0/3115015476 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965365357 0 0) 0x7f31b00b5840 con 0x7f31b00b5460 2021-06-25T04:57:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31aeffd700 1 -- 172.21.15.57:0/3115015476 >> v2:172.21.15.87:3300/0 conn(0x7f31b0147560 msgr2=0x7f31b00acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31aeffd700 1 --2- 172.21.15.57:0/3115015476 >> v2:172.21.15.87:3300/0 conn(0x7f31b0147560 0x7f31b00acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31aeffd700 1 -- 172.21.15.57:0/3115015476 >> v1:172.21.15.57:6789/0 conn(0x7f31b00b5460 legacy=0x7f31b0067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31aeffd700 1 -- 172.21.15.57:0/3115015476 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00ac7c0 con 0x7f31b00b05d0 2021-06-25T04:57:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31aeffd700 1 --2- 172.21.15.57:0/3115015476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31b00b05d0 0x7f31b00af510 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f31a0002f70 tx=0x7f31a0006df0).ready entity=mon.2 client_cookie=8594fe6fdb46ef4b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31ae7fc700 1 -- 172.21.15.57:0/3115015476 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31a000d570 con 0x7f31b00b05d0 2021-06-25T04:57:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31ae7fc700 1 -- 172.21.15.57:0/3115015476 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a0000e90 con 0x7f31b00b05d0 2021-06-25T04:57:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31ae7fc700 1 -- 172.21.15.57:0/3115015476 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31a000d8c0 con 0x7f31b00b05d0 2021-06-25T04:57:24.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31b4a88700 1 -- 172.21.15.57:0/3115015476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31b00b05d0 msgr2=0x7f31b00af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31b4a88700 1 --2- 172.21.15.57:0/3115015476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31b00b05d0 0x7f31b00af510 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f31a0002f70 tx=0x7f31a0006df0).stop 2021-06-25T04:57:24.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31b4a88700 1 -- 172.21.15.57:0/3115015476 shutdown_connections 2021-06-25T04:57:24.433 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31b4a88700 1 --2- 172.21.15.57:0/3115015476 >> v2:172.21.15.87:3300/0 conn(0x7f31b0147560 0x7f31b00acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31b4a88700 1 --2- 172.21.15.57:0/3115015476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31b00b05d0 0x7f31b00af510 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31b4a88700 1 -- 172.21.15.57:0/3115015476 >> 172.21.15.57:0/3115015476 conn(0x7f31b0062520 msgr2=0x7f31b0062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:24.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31b4a88700 1 -- 172.21.15.57:0/3115015476 shutdown_connections 2021-06-25T04:57:24.434 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31b4a88700 1 -- 172.21.15.57:0/3115015476 wait complete. 2021-06-25T04:57:24.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31b4a88700 1 Processor -- start 2021-06-25T04:57:24.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.422+0000 7f31b4a88700 1 -- start start 2021-06-25T04:57:24.437 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31b4a88700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b00b05d0 0x7f31b00abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31b4a88700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31b00b5460 0x7f31b0159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31b4a88700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b0147560 0x7f31b015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31b4a88700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b01574e0 con 0x7f31b0147560 2021-06-25T04:57:24.438 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31b4a88700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b00668f0 con 0x7f31b00b05d0 2021-06-25T04:57:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31b4a88700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b0066b90 con 0x7f31b00b5460 2021-06-25T04:57:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31affff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b0147560 0x7f31b015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31affff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b0147560 0x7f31b015a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44788/0 (socket says 172.21.15.57:44788) 2021-06-25T04:57:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31af7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b00b05d0 0x7f31b00abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31affff700 1 -- 172.21.15.57:0/2257896444 learned_addr learned my addr 172.21.15.57:0/2257896444 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31aeffd700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31b00b5460 0x7f31b0159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31affff700 1 -- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31b00b5460 msgr2=0x7f31b0159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31affff700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31b00b5460 0x7f31b0159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31affff700 1 -- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b00b05d0 msgr2=0x7f31b00abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31affff700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b00b05d0 0x7f31b00abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31affff700 1 -- 172.21.15.57:0/2257896444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a000b180 con 0x7f31b0147560 2021-06-25T04:57:24.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31affff700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b0147560 0x7f31b015a210 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f31a8006e00 tx=0x7f31a80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:24.441 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31acff9700 1 -- 172.21.15.57:0/2257896444 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31a800c670 con 0x7f31b0147560 2021-06-25T04:57:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31acff9700 1 -- 172.21.15.57:0/2257896444 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a800c7d0 con 0x7f31b0147560 2021-06-25T04:57:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31acff9700 1 -- 172.21.15.57:0/2257896444 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31a800cb30 con 0x7f31b0147560 2021-06-25T04:57:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31b4a88700 1 -- 172.21.15.57:0/2257896444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b01571d0 con 0x7f31b0147560 2021-06-25T04:57:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.426+0000 7f31b4a88700 1 -- 172.21.15.57:0/2257896444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b0065070 con 0x7f31b0147560 2021-06-25T04:57:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.430+0000 7f31b4a88700 1 -- 172.21.15.57:0/2257896444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b01576e0 con 0x7f31b0147560 2021-06-25T04:57:24.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.430+0000 7f31acff9700 1 -- 172.21.15.57:0/2257896444 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f31a8022070 con 0x7f31b0147560 2021-06-25T04:57:24.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.430+0000 7f31acff9700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3190055450 0x7f3190057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.430+0000 7f31acff9700 1 -- 172.21.15.57:0/2257896444 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f31a806e5f0 con 0x7f31b0147560 2021-06-25T04:57:24.443 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.430+0000 7f31af7fe700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3190055450 0x7f3190057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.430+0000 7f31af7fe700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3190055450 0x7f3190057910 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f31a400d000 tx=0x7f31a4007a20).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:24.444 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.438+0000 7f31acff9700 1 -- 172.21.15.57:0/2257896444 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f31a8044700 con 0x7f31b0147560 2021-06-25T04:57:24.570 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.562+0000 7f31b4a88700 1 -- 172.21.15.57:0/2257896444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31b0066d50 con 0x7f31b0147560 2021-06-25T04:57:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.566+0000 7f31acff9700 1 -- 172.21.15.57:0/2257896444 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f31a8016090 con 0x7f31b0147560 2021-06-25T04:57:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":159,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:57:18.707220+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-06-25T04:57:16.192470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-06-25T04:57:17.377680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T04:57:24.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 -- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3190055450 msgr2=0x7f3190057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.577 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3190055450 0x7f3190057910 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f31a400d000 tx=0x7f31a4007a20).stop 2021-06-25T04:57:24.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 -- 172.21.15.57:0/2257896444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b0147560 msgr2=0x7f31b015a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b0147560 0x7f31b015a210 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f31a8006e00 tx=0x7f31a80091d0).stop 2021-06-25T04:57:24.578 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 -- 172.21.15.57:0/2257896444 shutdown_connections 2021-06-25T04:57:24.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f3190055450 0x7f3190057910 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b0147560 0x7f31b015a210 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31b00b5460 0x7f31b0159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 --2- 172.21.15.57:0/2257896444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b00b05d0 0x7f31b00abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.579 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 -- 172.21.15.57:0/2257896444 >> 172.21.15.57:0/2257896444 conn(0x7f31b0062520 msgr2=0x7f31b00acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:24.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 -- 172.21.15.57:0/2257896444 shutdown_connections 2021-06-25T04:57:24.580 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.570+0000 7f31b4a88700 1 -- 172.21.15.57:0/2257896444 wait complete. 2021-06-25T04:57:24.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-06-25T04:47:24.504320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-06-25T04:47:31.724400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-06-25T04:57:16.192470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-06-25T04:57:17.377680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-06-25T04:57:24.593 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-06-25T04:57:24.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.690+0000 7fa6a68a5700 1 Processor -- start 2021-06-25T04:57:24.697 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.690+0000 7fa6a68a5700 1 -- start start 2021-06-25T04:57:24.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6a00affd0 0x7fa6a00a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.699 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa6a00afb90 0x7fa6a00a8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a00a7080 con 0x7fa6a00b2540 2021-06-25T04:57:24.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a00a72b0 con 0x7fa6a00afb90 2021-06-25T04:57:24.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a00a7550 con 0x7fa6a00affd0 2021-06-25T04:57:24.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a60a4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa6a00afb90 0x7fa6a00a8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a50a2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6a00affd0 0x7fa6a00a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.701 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a60a4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa6a00afb90 0x7fa6a00a8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:53292/0 (socket says 172.21.15.57:53292) 2021-06-25T04:57:24.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a60a4700 1 -- 172.21.15.57:0/3211443186 learned_addr learned my addr 172.21.15.57:0/3211443186 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:24.702 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a58a3700 1 --1- 172.21.15.57:0/3211443186 >> v1:172.21.15.87:6789/0 conn(0x7fa6a00b2540 0x7fa6a014ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:34528/0 (socket says 172.21.15.57:34528) 2021-06-25T04:57:24.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a60a4700 1 -- 172.21.15.57:0/3211443186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6a00affd0 msgr2=0x7fa6a00a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:24.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a60a4700 1 --2- 172.21.15.57:0/3211443186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6a00affd0 0x7fa6a00a8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a60a4700 1 -- 172.21.15.57:0/3211443186 >> v1:172.21.15.87:6789/0 conn(0x7fa6a00b2540 legacy=0x7fa6a014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a60a4700 1 -- 172.21.15.57:0/3211443186 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a00a77f0 con 0x7fa6a00afb90 2021-06-25T04:57:24.703 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a50a2700 1 --2- 172.21.15.57:0/3211443186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6a00affd0 0x7fa6a00a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:24.704 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a60a4700 1 --2- 172.21.15.57:0/3211443186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a00afb90 0x7fa6a00a8860 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fa6980032f0 tx=0x7fa698009290).ready entity=mon.1 client_cookie=b104113a4000ad2d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:24.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a48a1700 1 -- 172.21.15.57:0/3211443186 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa69800b8a0 con 0x7fa6a00afb90 2021-06-25T04:57:24.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a48a1700 1 -- 172.21.15.57:0/3211443186 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69800ba00 con 0x7fa6a00afb90 2021-06-25T04:57:24.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a48a1700 1 -- 172.21.15.57:0/3211443186 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa69800bb70 con 0x7fa6a00afb90 2021-06-25T04:57:24.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 -- 172.21.15.57:0/3211443186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a00afb90 msgr2=0x7fa6a00a8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 --2- 172.21.15.57:0/3211443186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a00afb90 0x7fa6a00a8860 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fa6980032f0 tx=0x7fa698009290).stop 2021-06-25T04:57:24.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 -- 172.21.15.57:0/3211443186 shutdown_connections 2021-06-25T04:57:24.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 --2- 172.21.15.57:0/3211443186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a00afb90 0x7fa6a00a8860 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 --2- 172.21.15.57:0/3211443186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6a00affd0 0x7fa6a00a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 -- 172.21.15.57:0/3211443186 >> 172.21.15.57:0/3211443186 conn(0x7fa6a0060140 msgr2=0x7fa6a00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:24.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 -- 172.21.15.57:0/3211443186 shutdown_connections 2021-06-25T04:57:24.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.694+0000 7fa6a68a5700 1 -- 172.21.15.57:0/3211443186 wait complete. 2021-06-25T04:57:24.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a68a5700 1 Processor -- start 2021-06-25T04:57:24.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a68a5700 1 -- start start 2021-06-25T04:57:24.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a68a5700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6a00afb90 0x7fa6a00b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a68a5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a00affd0 0x7fa6a00ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a68a5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a00b2540 0x7fa6a00a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a68a5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a00b5300 con 0x7fa6a00affd0 2021-06-25T04:57:24.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a68a5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a00b4dc0 con 0x7fa6a00b2540 2021-06-25T04:57:24.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a68a5700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a00b5060 con 0x7fa6a00afb90 2021-06-25T04:57:24.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a50a2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a00affd0 0x7fa6a00ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a50a2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a00affd0 0x7fa6a00ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44802/0 (socket says 172.21.15.57:44802) 2021-06-25T04:57:24.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a50a2700 1 -- 172.21.15.57:0/432310270 learned_addr learned my addr 172.21.15.57:0/432310270 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:24.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a60a4700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a00b2540 0x7fa6a00a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a58a3700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6a00afb90 0x7fa6a00b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a50a2700 1 -- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6a00afb90 msgr2=0x7fa6a00b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a50a2700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6a00afb90 0x7fa6a00b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a50a2700 1 -- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a00b2540 msgr2=0x7fa6a00a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a50a2700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a00b2540 0x7fa6a00a9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a50a2700 1 -- 172.21.15.57:0/432310270 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c00b180 con 0x7fa6a00affd0 2021-06-25T04:57:24.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a60a4700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a00b2540 0x7fa6a00a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:24.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a50a2700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a00affd0 0x7fa6a00ae6f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fa69c00c000 tx=0x7fa69c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:24.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa68effd700 1 -- 172.21.15.57:0/432310270 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa69c00c7e0 con 0x7fa6a00affd0 2021-06-25T04:57:24.715 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa68effd700 1 -- 172.21.15.57:0/432310270 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69c00c940 con 0x7fa6a00affd0 2021-06-25T04:57:24.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a68a5700 1 -- 172.21.15.57:0/432310270 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa698009530 con 0x7fa6a00affd0 2021-06-25T04:57:24.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa68effd700 1 -- 172.21.15.57:0/432310270 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa69c00cca0 con 0x7fa6a00affd0 2021-06-25T04:57:24.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.698+0000 7fa6a68a5700 1 -- 172.21.15.57:0/432310270 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a00abbe0 con 0x7fa6a00affd0 2021-06-25T04:57:24.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.702+0000 7fa6a68a5700 1 -- 172.21.15.57:0/432310270 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a00b4330 con 0x7fa6a00affd0 2021-06-25T04:57:24.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.702+0000 7fa68effd700 1 -- 172.21.15.57:0/432310270 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa69c01c460 con 0x7fa6a00affd0 2021-06-25T04:57:24.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.702+0000 7fa68effd700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa680055510 0x7fa6800579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.702+0000 7fa68effd700 1 -- 172.21.15.57:0/432310270 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa69c06e410 con 0x7fa6a00affd0 2021-06-25T04:57:24.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.702+0000 7fa6a58a3700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa680055510 0x7fa6800579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.702+0000 7fa6a58a3700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa680055510 0x7fa6800579d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fa69000d000 tx=0x7fa690007b80).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:24.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.710+0000 7fa68effd700 1 -- 172.21.15.57:0/432310270 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fa69c044560 con 0x7fa6a00affd0 2021-06-25T04:57:24.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.834+0000 7fa6a68a5700 1 -- 172.21.15.57:0/432310270 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa6a0057310 con 0x7fa6a00affd0 2021-06-25T04:57:24.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa68effd700 1 -- 172.21.15.57:0/432310270 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v159) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa69c047b80 con 0x7fa6a00affd0 2021-06-25T04:57:24.844 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2021-06-25T04:57:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 -- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa680055510 msgr2=0x7fa6800579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa680055510 0x7fa6800579d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fa69000d000 tx=0x7fa690007b80).stop 2021-06-25T04:57:24.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 -- 172.21.15.57:0/432310270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a00affd0 msgr2=0x7fa6a00ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a00affd0 0x7fa6a00ae6f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fa69c00c000 tx=0x7fa69c006df0).stop 2021-06-25T04:57:24.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 -- 172.21.15.57:0/432310270 shutdown_connections 2021-06-25T04:57:24.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa680055510 0x7fa6800579d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a00b2540 0x7fa6a00a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a00affd0 0x7fa6a00ae6f0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 --2- 172.21.15.57:0/432310270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6a00afb90 0x7fa6a00b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 -- 172.21.15.57:0/432310270 >> 172.21.15.57:0/432310270 conn(0x7fa6a0060140 msgr2=0x7fa6a0146380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:24.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 -- 172.21.15.57:0/432310270 shutdown_connections 2021-06-25T04:57:24.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.838+0000 7fa6a68a5700 1 -- 172.21.15.57:0/432310270 wait complete. 2021-06-25T04:57:24.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-06-25T04:57:24.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.958+0000 7f9df359e700 1 Processor -- start 2021-06-25T04:57:24.966 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.958+0000 7f9df359e700 1 -- start start 2021-06-25T04:57:24.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9df40b2760 0x7f9df4061120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9df4143230 0x7f9df41436c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df4067010 con 0x7f9df40b7670 2021-06-25T04:57:24.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df4065370 con 0x7f9df4143230 2021-06-25T04:57:24.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df40b7a50 con 0x7f9df40b2760 2021-06-25T04:57:24.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df2d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9df4143230 0x7f9df41436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df2d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9df4143230 0x7f9df41436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44812/0 (socket says 172.21.15.57:44812) 2021-06-25T04:57:24.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df2d9d700 1 -- 172.21.15.57:0/2747621549 learned_addr learned my addr 172.21.15.57:0/2747621549 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:24.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df1d9b700 1 --2- 172.21.15.57:0/2747621549 >> v2:172.21.15.87:3300/0 conn(0x7f9df40b2760 0x7f9df4061120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df2d9d700 1 -- 172.21.15.57:0/2747621549 >> v2:172.21.15.87:3300/0 conn(0x7f9df40b2760 msgr2=0x7f9df4061120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:24.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df2d9d700 1 --2- 172.21.15.57:0/2747621549 >> v2:172.21.15.87:3300/0 conn(0x7f9df40b2760 0x7f9df4061120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.971 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df2d9d700 1 -- 172.21.15.57:0/2747621549 >> v1:172.21.15.87:6789/0 conn(0x7f9df40b7670 legacy=0x7f9df4060a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df2d9d700 1 -- 172.21.15.57:0/2747621549 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4061610 con 0x7f9df4143230 2021-06-25T04:57:24.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df2d9d700 1 --2- 172.21.15.57:0/2747621549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df4143230 0x7f9df41436c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f9dec0032f0 tx=0x7f9dec009290).ready entity=mon.0 client_cookie=9579dfb812b8380e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:24.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df159a700 1 -- 172.21.15.57:0/2747621549 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dec00b870 con 0x7f9df4143230 2021-06-25T04:57:24.972 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df159a700 1 -- 172.21.15.57:0/2747621549 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00b9d0 con 0x7f9df4143230 2021-06-25T04:57:24.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df159a700 1 -- 172.21.15.57:0/2747621549 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dec00bb40 con 0x7f9df4143230 2021-06-25T04:57:24.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 -- 172.21.15.57:0/2747621549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df4143230 msgr2=0x7f9df41436c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 --2- 172.21.15.57:0/2747621549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df4143230 0x7f9df41436c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f9dec0032f0 tx=0x7f9dec009290).stop 2021-06-25T04:57:24.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 -- 172.21.15.57:0/2747621549 shutdown_connections 2021-06-25T04:57:24.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 --2- 172.21.15.57:0/2747621549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df4143230 0x7f9df41436c0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 --2- 172.21.15.57:0/2747621549 >> v2:172.21.15.87:3300/0 conn(0x7f9df40b2760 0x7f9df4061120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 -- 172.21.15.57:0/2747621549 >> 172.21.15.57:0/2747621549 conn(0x7f9df405f670 msgr2=0x7f9df405fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:24.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 -- 172.21.15.57:0/2747621549 shutdown_connections 2021-06-25T04:57:24.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.962+0000 7f9df359e700 1 -- 172.21.15.57:0/2747621549 wait complete. 2021-06-25T04:57:24.979 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df359e700 1 Processor -- start 2021-06-25T04:57:24.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df359e700 1 -- start start 2021-06-25T04:57:24.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40b2760 0x7f9df4145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df40b7670 0x7f9df40b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.980 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df359e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df4143230 0x7f9df4142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df41568b0 con 0x7f9df40b2760 2021-06-25T04:57:24.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df4155990 con 0x7f9df40b7670 2021-06-25T04:57:24.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df359e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df4155c30 con 0x7f9df4143230 2021-06-25T04:57:24.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40b2760 0x7f9df4145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.981 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40b2760 0x7f9df4145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44814/0 (socket says 172.21.15.57:44814) 2021-06-25T04:57:24.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df259c700 1 -- 172.21.15.57:0/624811729 learned_addr learned my addr 172.21.15.57:0/624811729 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:24.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df1d9b700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df40b7670 0x7f9df40b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df2d9d700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df4143230 0x7f9df4142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.982 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df259c700 1 -- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df4143230 msgr2=0x7f9df4142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df259c700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df4143230 0x7f9df4142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df259c700 1 -- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df40b7670 msgr2=0x7f9df40b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:24.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df259c700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df40b7670 0x7f9df40b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:24.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df259c700 1 -- 172.21.15.57:0/624811729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec009530 con 0x7f9df40b2760 2021-06-25T04:57:24.983 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df259c700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40b2760 0x7f9df4145a90 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f9df40641f0 tx=0x7f9de4007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9deb7fe700 1 -- 172.21.15.57:0/624811729 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9de4012400 con 0x7f9df40b2760 2021-06-25T04:57:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9deb7fe700 1 -- 172.21.15.57:0/624811729 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de4012560 con 0x7f9df40b2760 2021-06-25T04:57:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df359e700 1 -- 172.21.15.57:0/624811729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df4155ed0 con 0x7f9df40b2760 2021-06-25T04:57:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9deb7fe700 1 -- 172.21.15.57:0/624811729 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9de40128c0 con 0x7f9df40b2760 2021-06-25T04:57:24.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.966+0000 7f9df359e700 1 -- 172.21.15.57:0/624811729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df4156410 con 0x7f9df40b2760 2021-06-25T04:57:24.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.970+0000 7f9df359e700 1 -- 172.21.15.57:0/624811729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df4057310 con 0x7f9df40b2760 2021-06-25T04:57:24.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.970+0000 7f9deb7fe700 1 -- 172.21.15.57:0/624811729 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9de4019030 con 0x7f9df40b2760 2021-06-25T04:57:24.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.970+0000 7f9deb7fe700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9dd80553d0 0x7f9dd8057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:24.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.970+0000 7f9deb7fe700 1 -- 172.21.15.57:0/624811729 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9de406d210 con 0x7f9df40b2760 2021-06-25T04:57:24.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.970+0000 7f9df1d9b700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9dd80553d0 0x7f9dd8057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:24.986 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.970+0000 7f9df1d9b700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9dd80553d0 0x7f9dd8057890 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f9ddc00b000 tx=0x7f9ddc006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:24.987 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:24.974+0000 7f9deb7fe700 1 -- 172.21.15.57:0/624811729 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f9de40433c0 con 0x7f9df40b2760 2021-06-25T04:57:25.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.102+0000 7f9df359e700 1 -- 172.21.15.57:0/624811729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9df40b7110 con 0x7f9df40b2760 2021-06-25T04:57:25.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.102+0000 7f9deb7fe700 1 -- 172.21.15.57:0/624811729 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v159) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9de40469e0 con 0x7f9df40b2760 2021-06-25T04:57:25.110 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:57:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 -- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9dd80553d0 msgr2=0x7f9dd8057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9dd80553d0 0x7f9dd8057890 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f9ddc00b000 tx=0x7f9ddc006df0).stop 2021-06-25T04:57:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 -- 172.21.15.57:0/624811729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40b2760 msgr2=0x7f9df4145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40b2760 0x7f9df4145a90 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f9df40641f0 tx=0x7f9de4007c00).stop 2021-06-25T04:57:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 -- 172.21.15.57:0/624811729 shutdown_connections 2021-06-25T04:57:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f9dd80553d0 0x7f9dd8057890 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9df4143230 0x7f9df4142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df40b7670 0x7f9df40b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 --2- 172.21.15.57:0/624811729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df40b2760 0x7f9df4145a90 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 -- 172.21.15.57:0/624811729 >> 172.21.15.57:0/624811729 conn(0x7f9df405f670 msgr2=0x7f9df405c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 -- 172.21.15.57:0/624811729 shutdown_connections 2021-06-25T04:57:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.106+0000 7f9df359e700 1 -- 172.21.15.57:0/624811729 wait complete. 2021-06-25T04:57:25.124 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-06-25T04:57:25.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf6edd700 1 Processor -- start 2021-06-25T04:57:25.236 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf6edd700 1 -- start start 2021-06-25T04:57:25.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf6edd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cf00ad580 0x7f2cf00616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.240 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf6edd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cf0140400 0x7f2cf01408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf6edd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf00aecb0 con 0x7f2cf00612e0 2021-06-25T04:57:25.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf6edd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00b6ee0 con 0x7f2cf0140400 2021-06-25T04:57:25.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf6edd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00aeee0 con 0x7f2cf00ad580 2021-06-25T04:57:25.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf66dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cf0140400 0x7f2cf01408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf66dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cf0140400 0x7f2cf01408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44826/0 (socket says 172.21.15.57:44826) 2021-06-25T04:57:25.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf66dc700 1 -- 172.21.15.57:0/1051831079 learned_addr learned my addr 172.21.15.57:0/1051831079 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:25.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf5edb700 1 --1- 172.21.15.57:0/1051831079 >> v1:172.21.15.57:6789/0 conn(0x7f2cf00612e0 0x7f2cf00b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33808/0 (socket says 172.21.15.57:33808) 2021-06-25T04:57:25.242 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf56da700 1 --2- 172.21.15.57:0/1051831079 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cf00ad580 0x7f2cf00616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf66dc700 1 -- 172.21.15.57:0/1051831079 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cf00ad580 msgr2=0x7f2cf00616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:25.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf66dc700 1 --2- 172.21.15.57:0/1051831079 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cf00ad580 0x7f2cf00616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf66dc700 1 -- 172.21.15.57:0/1051831079 >> v1:172.21.15.57:6789/0 conn(0x7f2cf00612e0 legacy=0x7f2cf00b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.243 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf4ed9700 1 -- 172.21.15.57:0/1051831079 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740461230 0 0) 0x7f2cf00aecb0 con 0x7f2cf00612e0 2021-06-25T04:57:25.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.230+0000 7f2cf66dc700 1 -- 172.21.15.57:0/1051831079 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00af180 con 0x7f2cf0140400 2021-06-25T04:57:25.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf66dc700 1 --2- 172.21.15.57:0/1051831079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cf0140400 0x7f2cf01408b0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f2ce80032f0 tx=0x7f2ce8009290).ready entity=mon.0 client_cookie=cccd7fe1dbdaffe5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:25.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf4ed9700 1 -- 172.21.15.57:0/1051831079 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce800b8a0 con 0x7f2cf0140400 2021-06-25T04:57:25.244 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf4ed9700 1 -- 172.21.15.57:0/1051831079 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce800ba00 con 0x7f2cf0140400 2021-06-25T04:57:25.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf4ed9700 1 -- 172.21.15.57:0/1051831079 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce800bb70 con 0x7f2cf0140400 2021-06-25T04:57:25.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf6edd700 1 -- 172.21.15.57:0/1051831079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cf0140400 msgr2=0x7f2cf01408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.245 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf6edd700 1 --2- 172.21.15.57:0/1051831079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cf0140400 0x7f2cf01408b0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f2ce80032f0 tx=0x7f2ce8009290).stop 2021-06-25T04:57:25.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf6edd700 1 -- 172.21.15.57:0/1051831079 shutdown_connections 2021-06-25T04:57:25.246 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf6edd700 1 --2- 172.21.15.57:0/1051831079 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cf00ad580 0x7f2cf00616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf6edd700 1 --2- 172.21.15.57:0/1051831079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cf0140400 0x7f2cf01408b0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf6edd700 1 -- 172.21.15.57:0/1051831079 >> 172.21.15.57:0/1051831079 conn(0x7f2cf0066da0 msgr2=0x7f2cf0067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:25.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf6edd700 1 -- 172.21.15.57:0/1051831079 shutdown_connections 2021-06-25T04:57:25.248 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf6edd700 1 -- 172.21.15.57:0/1051831079 wait complete. 2021-06-25T04:57:25.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf6edd700 1 Processor -- start 2021-06-25T04:57:25.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.234+0000 7f2cf6edd700 1 -- start start 2021-06-25T04:57:25.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf6edd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cf00612e0 0x7f2cf00b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf6edd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cf00ad580 0x7f2cf0152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.255 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf6edd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cf0140400 0x7f2cf013f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf6edd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf014a270 con 0x7f2cf00612e0 2021-06-25T04:57:25.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf6edd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00b1600 con 0x7f2cf0140400 2021-06-25T04:57:25.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf6edd700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0152ff0 con 0x7f2cf00ad580 2021-06-25T04:57:25.256 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf5edb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cf00612e0 0x7f2cf00b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf5edb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cf00612e0 0x7f2cf00b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44828/0 (socket says 172.21.15.57:44828) 2021-06-25T04:57:25.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf5edb700 1 -- 172.21.15.57:0/3311627126 learned_addr learned my addr 172.21.15.57:0/3311627126 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:25.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf56da700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cf00ad580 0x7f2cf0152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.257 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf66dc700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cf0140400 0x7f2cf013f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf5edb700 1 -- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cf00ad580 msgr2=0x7f2cf0152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf5edb700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cf00ad580 0x7f2cf0152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf5edb700 1 -- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cf0140400 msgr2=0x7f2cf013f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf5edb700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cf0140400 0x7f2cf013f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.258 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf5edb700 1 -- 172.21.15.57:0/3311627126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8009530 con 0x7f2cf00612e0 2021-06-25T04:57:25.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf5edb700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cf00612e0 0x7f2cf00b1ed0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f2cf00b3bf0 tx=0x7f2ce0007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:25.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cdeffd700 1 -- 172.21.15.57:0/3311627126 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce00070d0 con 0x7f2cf00612e0 2021-06-25T04:57:25.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cdeffd700 1 -- 172.21.15.57:0/3311627126 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce0007230 con 0x7f2cf00612e0 2021-06-25T04:57:25.259 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf6edd700 1 -- 172.21.15.57:0/3311627126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf00b1360 con 0x7f2cf00612e0 2021-06-25T04:57:25.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cdeffd700 1 -- 172.21.15.57:0/3311627126 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ce0005740 con 0x7f2cf00612e0 2021-06-25T04:57:25.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.238+0000 7f2cf6edd700 1 -- 172.21.15.57:0/3311627126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf00b3ca0 con 0x7f2cf00612e0 2021-06-25T04:57:25.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.242+0000 7f2cf6edd700 1 -- 172.21.15.57:0/3311627126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf0057310 con 0x7f2cf00612e0 2021-06-25T04:57:25.260 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.242+0000 7f2cdeffd700 1 -- 172.21.15.57:0/3311627126 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2ce001a060 con 0x7f2cf00612e0 2021-06-25T04:57:25.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.242+0000 7f2cdeffd700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2cd00554e0 0x7f2cd00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.242+0000 7f2cdeffd700 1 -- 172.21.15.57:0/3311627126 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2ce006d680 con 0x7f2cf00612e0 2021-06-25T04:57:25.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.242+0000 7f2cf56da700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2cd00554e0 0x7f2cd00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.261 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.242+0000 7f2cf56da700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2cd00554e0 0x7f2cd00579a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f2cec00b000 tx=0x7f2cec006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:25.262 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.250+0000 7f2cdeffd700 1 -- 172.21.15.57:0/3311627126 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2ce0043830 con 0x7f2cf00612e0 2021-06-25T04:57:25.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.378+0000 7f2cf6edd700 1 -- 172.21.15.57:0/3311627126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2cf00620c0 con 0x7f2cf00612e0 2021-06-25T04:57:25.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.378+0000 7f2cdeffd700 1 -- 172.21.15.57:0/3311627126 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2ce00180a0 con 0x7f2cf00612e0 2021-06-25T04:57:25.384 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:57:25.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 -- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2cd00554e0 msgr2=0x7f2cd00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2cd00554e0 0x7f2cd00579a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f2cec00b000 tx=0x7f2cec006df0).stop 2021-06-25T04:57:25.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 -- 172.21.15.57:0/3311627126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cf00612e0 msgr2=0x7f2cf00b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cf00612e0 0x7f2cf00b1ed0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f2cf00b3bf0 tx=0x7f2ce0007a60).stop 2021-06-25T04:57:25.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 -- 172.21.15.57:0/3311627126 shutdown_connections 2021-06-25T04:57:25.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f2cd00554e0 0x7f2cd00579a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cf0140400 0x7f2cf013f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cf00ad580 0x7f2cf0152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 --2- 172.21.15.57:0/3311627126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cf00612e0 0x7f2cf00b1ed0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 -- 172.21.15.57:0/3311627126 >> 172.21.15.57:0/3311627126 conn(0x7f2cf0066da0 msgr2=0x7f2cf0143000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:25.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 -- 172.21.15.57:0/3311627126 shutdown_connections 2021-06-25T04:57:25.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.382+0000 7f2cf6edd700 1 -- 172.21.15.57:0/3311627126 wait complete. 2021-06-25T04:57:25.401 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-06-25T04:57:25.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.506+0000 7f948a0b6700 1 Processor -- start 2021-06-25T04:57:25.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.506+0000 7f948a0b6700 1 -- start start 2021-06-25T04:57:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f948a0b6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94840b0390 0x7f9484146c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f948a0b6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94840b1100 con 0x7f94840a9150 2021-06-25T04:57:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f948a0b6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94840a9530 con 0x7f94840b0b40 2021-06-25T04:57:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f948a0b6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94840b1330 con 0x7f94840b0390 2021-06-25T04:57:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f94890b4700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f94840a9150 0x7f9484146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33822/0 (socket says 172.21.15.57:33822) 2021-06-25T04:57:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f94890b4700 1 -- 172.21.15.57:0/3483434655 learned_addr learned my addr 172.21.15.57:0/3483434655 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f94898b5700 1 --2- 172.21.15.57:0/3483434655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94840b0390 0x7f9484146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f9477fff700 1 -- 172.21.15.57:0/3483434655 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717944773 0 0) 0x7f94840b1100 con 0x7f94840a9150 2021-06-25T04:57:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f9477fff700 1 -- 172.21.15.57:0/3483434655 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9468003260 con 0x7f94840a9150 2021-06-25T04:57:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f9477fff700 1 -- 172.21.15.57:0/3483434655 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346049418 0 0) 0x7f94840a9530 con 0x7f94840b0b40 2021-06-25T04:57:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f9477fff700 1 -- 172.21.15.57:0/3483434655 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94840b1100 con 0x7f94840b0b40 2021-06-25T04:57:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f94898b5700 1 -- 172.21.15.57:0/3483434655 >> v1:172.21.15.87:6789/0 conn(0x7f94840b0b40 legacy=0x7f9484140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f94898b5700 1 -- 172.21.15.57:0/3483434655 >> v1:172.21.15.57:6789/0 conn(0x7f94840a9150 legacy=0x7f9484146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f94898b5700 1 -- 172.21.15.57:0/3483434655 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94840b15d0 con 0x7f94840b0390 2021-06-25T04:57:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f94898b5700 1 --2- 172.21.15.57:0/3483434655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94840b0390 0x7f9484146c20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f947c0032f0 tx=0x7f947c0091d0).ready entity=mon.2 client_cookie=9edb1f930c8209a1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f9477fff700 1 -- 172.21.15.57:0/3483434655 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f947c00b640 con 0x7f94840b0390 2021-06-25T04:57:25.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f9477fff700 1 -- 172.21.15.57:0/3483434655 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00b7a0 con 0x7f94840b0390 2021-06-25T04:57:25.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f9477fff700 1 -- 172.21.15.57:0/3483434655 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f947c00b910 con 0x7f94840b0390 2021-06-25T04:57:25.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f948a0b6700 1 -- 172.21.15.57:0/3483434655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94840b0390 msgr2=0x7f9484146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f948a0b6700 1 --2- 172.21.15.57:0/3483434655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94840b0390 0x7f9484146c20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f947c0032f0 tx=0x7f947c0091d0).stop 2021-06-25T04:57:25.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f948a0b6700 1 -- 172.21.15.57:0/3483434655 shutdown_connections 2021-06-25T04:57:25.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f948a0b6700 1 --2- 172.21.15.57:0/3483434655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94840b0390 0x7f9484146c20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f948a0b6700 1 -- 172.21.15.57:0/3483434655 >> 172.21.15.57:0/3483434655 conn(0x7f9484061100 msgr2=0x7f9484062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:25.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f948a0b6700 1 -- 172.21.15.57:0/3483434655 shutdown_connections 2021-06-25T04:57:25.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.510+0000 7f948a0b6700 1 -- 172.21.15.57:0/3483434655 wait complete. 2021-06-25T04:57:25.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f948a0b6700 1 Processor -- start 2021-06-25T04:57:25.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f948a0b6700 1 -- start start 2021-06-25T04:57:25.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f948a0b6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840a9150 0x7f9484145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f948a0b6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94840b0390 0x7f94840a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f948a0b6700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94840b0b40 0x7f94840a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f948a0b6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94841425e0 con 0x7f94840a9150 2021-06-25T04:57:25.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f948a0b6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9484142bf0 con 0x7f94840b0390 2021-06-25T04:57:25.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f948a0b6700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9484142810 con 0x7f94840b0b40 2021-06-25T04:57:25.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f94890b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840a9150 0x7f9484145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f94890b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840a9150 0x7f9484145670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44842/0 (socket says 172.21.15.57:44842) 2021-06-25T04:57:25.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f94890b4700 1 -- 172.21.15.57:0/1843945904 learned_addr learned my addr 172.21.15.57:0/1843945904 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:25.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f94898b5700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94840b0b40 0x7f94840a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f94888b3700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94840b0390 0x7f94840a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f94890b4700 1 -- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94840b0b40 msgr2=0x7f94840a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f94890b4700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94840b0b40 0x7f94840a9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f94890b4700 1 -- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94840b0390 msgr2=0x7f94840a97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f94890b4700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94840b0390 0x7f94840a97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.514+0000 7f94890b4700 1 -- 172.21.15.57:0/1843945904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c009470 con 0x7f94840a9150 2021-06-25T04:57:25.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.518+0000 7f94890b4700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840a9150 0x7f9484145670 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f9480001110 tx=0x7f9480007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:25.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.518+0000 7f94767fc700 1 -- 172.21.15.57:0/1843945904 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94800070d0 con 0x7f94840a9150 2021-06-25T04:57:25.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.518+0000 7f94767fc700 1 -- 172.21.15.57:0/1843945904 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9480007230 con 0x7f94840a9150 2021-06-25T04:57:25.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.518+0000 7f94767fc700 1 -- 172.21.15.57:0/1843945904 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9480005610 con 0x7f94840a9150 2021-06-25T04:57:25.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.518+0000 7f948a0b6700 1 -- 172.21.15.57:0/1843945904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9484142e50 con 0x7f94840a9150 2021-06-25T04:57:25.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.518+0000 7f948a0b6700 1 -- 172.21.15.57:0/1843945904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9484143690 con 0x7f94840a9150 2021-06-25T04:57:25.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.518+0000 7f948a0b6700 1 -- 172.21.15.57:0/1843945904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94841433d0 con 0x7f94840a9150 2021-06-25T04:57:25.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.518+0000 7f94767fc700 1 -- 172.21.15.57:0/1843945904 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f9480010070 con 0x7f94840a9150 2021-06-25T04:57:25.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.518+0000 7f94767fc700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f946c055510 0x7f946c0579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.518+0000 7f94767fc700 1 -- 172.21.15.57:0/1843945904 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f948006d730 con 0x7f94840a9150 2021-06-25T04:57:25.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.518+0000 7f94888b3700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f946c055510 0x7f946c0579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.522+0000 7f94888b3700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f946c055510 0x7f946c0579d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f947800d000 tx=0x7f9478007a00).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:25.537 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.526+0000 7f94767fc700 1 -- 172.21.15.57:0/1843945904 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f94841433d0 con 0x7f94840a9150 2021-06-25T04:57:25.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.658+0000 7f948a0b6700 1 -- 172.21.15.57:0/1843945904 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94841433d0 con 0x7f94840a9150 2021-06-25T04:57:25.664 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.658+0000 7f94767fc700 1 -- 172.21.15.57:0/1843945904 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v159) v1 ==== 100+0+10 (secure 0 0 0) 0x7f94841433d0 con 0x7f94840a9150 2021-06-25T04:57:25.664 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2021-06-25T04:57:25.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 -- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f946c055510 msgr2=0x7f946c0579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f946c055510 0x7f946c0579d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f947800d000 tx=0x7f9478007a00).stop 2021-06-25T04:57:25.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 -- 172.21.15.57:0/1843945904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840a9150 msgr2=0x7f9484145670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840a9150 0x7f9484145670 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f9480001110 tx=0x7f9480007ad0).stop 2021-06-25T04:57:25.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 -- 172.21.15.57:0/1843945904 shutdown_connections 2021-06-25T04:57:25.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f946c055510 0x7f946c0579d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94840b0b40 0x7f94840a9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94840b0390 0x7f94840a97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 --2- 172.21.15.57:0/1843945904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840a9150 0x7f9484145670 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 -- 172.21.15.57:0/1843945904 >> 172.21.15.57:0/1843945904 conn(0x7f9484061100 msgr2=0x7f94840add10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:25.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 -- 172.21.15.57:0/1843945904 shutdown_connections 2021-06-25T04:57:25.670 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.662+0000 7f948a0b6700 1 -- 172.21.15.57:0/1843945904 wait complete. 2021-06-25T04:57:25.680 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-06-25T04:57:25.681 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:57:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f4091e26700 1 Processor -- start 2021-06-25T04:57:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f4091e26700 1 -- start start 2021-06-25T04:57:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f4091e26700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c0ac9f0 0x7f408c0b5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f4091e26700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f408c0b13f0 0x7f408c066fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f4091e26700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c0acdd0 con 0x7f408c0ad830 2021-06-25T04:57:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f4091e26700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c0b5120 con 0x7f408c0b13f0 2021-06-25T04:57:25.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f4091e26700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0adea0 con 0x7f408c0ac9f0 2021-06-25T04:57:25.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f408bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f408c0ad830 0x7f408c143480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33840/0 (socket says 172.21.15.57:33840) 2021-06-25T04:57:25.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f408bfff700 1 -- 172.21.15.57:0/4284636512 learned_addr learned my addr 172.21.15.57:0/4284636512 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:25.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f4090e24700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c0ac9f0 0x7f408c0b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f4091625700 1 --2- 172.21.15.57:0/4284636512 >> v2:172.21.15.87:3300/0 conn(0x7f408c0b13f0 0x7f408c066fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451022378 0 0) 0x7f408c0acdd0 con 0x7f408c0ad830 2021-06-25T04:57:25.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4070003260 con 0x7f408c0ad830 2021-06-25T04:57:25.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.778+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2221266186 0 0) 0x7f4070003260 con 0x7f408c0ad830 2021-06-25T04:57:25.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c0ac9f0 msgr2=0x7f408c0b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:25.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c0ac9f0 0x7f408c0b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 >> v2:172.21.15.87:3300/0 conn(0x7f408c0b13f0 msgr2=0x7f408c066fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:25.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 --2- 172.21.15.57:0/4284636512 >> v2:172.21.15.87:3300/0 conn(0x7f408c0b13f0 0x7f408c066fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0ae140 con 0x7f408c0ad830 2021-06-25T04:57:25.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f4078001660 con 0x7f408c0ad830 2021-06-25T04:57:25.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4090e24700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c0ac9f0 0x7f408c0b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:25.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4091625700 1 --2- 172.21.15.57:0/4284636512 >> v2:172.21.15.87:3300/0 conn(0x7f408c0b13f0 0x7f408c066fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:25.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 >> v1:172.21.15.57:6789/0 conn(0x7f408c0ad830 legacy=0x7f408c143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4070003750 0x7f4070003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4070004500 0x7f4070004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c0ac9f0 0x7f4070004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0b5120 con 0x7f4070004500 2021-06-25T04:57:25.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0adea0 con 0x7f4070003750 2021-06-25T04:57:25.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407000b750 con 0x7f408c0ac9f0 2021-06-25T04:57:25.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408bfff700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4070004500 0x7f4070004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4090e24700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4070003750 0x7f4070003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4091625700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c0ac9f0 0x7f4070004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408bfff700 1 -- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c0ac9f0 msgr2=0x7f4070004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:25.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408bfff700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c0ac9f0 0x7f4070004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408bfff700 1 -- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4070003750 msgr2=0x7f4070003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:25.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408bfff700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4070003750 0x7f4070003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408bfff700 1 -- 172.21.15.57:0/4284636512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408000b180 con 0x7f4070004500 2021-06-25T04:57:25.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4091625700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c0ac9f0 0x7f4070004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T04:57:25.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408bfff700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4070004500 0x7f4070004980 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f4078001370 tx=0x7f408c0aed50).ready entity=mon.0 client_cookie=2937f3538bb289d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:25.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40780070d0 con 0x7f4070004500 2021-06-25T04:57:25.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4078007230 con 0x7f4070004500 2021-06-25T04:57:25.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f408b7fe700 1 -- 172.21.15.57:0/4284636512 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f407800c8f0 con 0x7f4070004500 2021-06-25T04:57:25.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4091e26700 1 -- 172.21.15.57:0/4284636512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4070004500 msgr2=0x7f4070004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4091e26700 1 --2- 172.21.15.57:0/4284636512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4070004500 0x7f4070004980 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f4078001370 tx=0x7f408c0aed50).stop 2021-06-25T04:57:25.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4091625700 1 -- 172.21.15.57:0/4284636512 reap_dead start 2021-06-25T04:57:25.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4091e26700 1 -- 172.21.15.57:0/4284636512 shutdown_connections 2021-06-25T04:57:25.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4091e26700 1 -- 172.21.15.57:0/4284636512 >> 172.21.15.57:0/4284636512 conn(0x7f408c062520 msgr2=0x7f408c062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:25.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4091e26700 1 -- 172.21.15.57:0/4284636512 shutdown_connections 2021-06-25T04:57:25.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.782+0000 7f4091e26700 1 -- 172.21.15.57:0/4284636512 wait complete. 2021-06-25T04:57:25.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091e26700 1 Processor -- start 2021-06-25T04:57:25.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091e26700 1 -- start start 2021-06-25T04:57:25.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091e26700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f408c0b2040 0x7f408c066ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091e26700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f408c141db0 0x7f408c142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091e26700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c147b10 0x7f408c147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091e26700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c064e80 con 0x7f408c141db0 2021-06-25T04:57:25.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091e26700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c066190 con 0x7f408c0b2040 2021-06-25T04:57:25.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091e26700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c142720 con 0x7f408c147b10 2021-06-25T04:57:25.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f408bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f408c141db0 0x7f408c142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f408bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f408c141db0 0x7f408c142230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44864/0 (socket says 172.21.15.57:44864) 2021-06-25T04:57:25.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4090e24700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f408c0b2040 0x7f408c066ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f408bfff700 1 -- 172.21.15.57:0/1823484409 learned_addr learned my addr 172.21.15.57:0/1823484409 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091625700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c147b10 0x7f408c147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f408bfff700 1 -- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c147b10 msgr2=0x7f408c147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f408bfff700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c147b10 0x7f408c147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f408bfff700 1 -- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f408c0b2040 msgr2=0x7f408c066ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f408bfff700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f408c0b2040 0x7f408c066ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f408bfff700 1 -- 172.21.15.57:0/1823484409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0b2420 con 0x7f408c141db0 2021-06-25T04:57:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091625700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c147b10 0x7f408c147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f408bfff700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f408c141db0 0x7f408c142230 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f408c141b70 tx=0x7f4078015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:25.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4089ffb700 1 -- 172.21.15.57:0/1823484409 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f407800ce90 con 0x7f408c141db0 2021-06-25T04:57:25.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4089ffb700 1 -- 172.21.15.57:0/1823484409 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40780045e0 con 0x7f408c141db0 2021-06-25T04:57:25.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4089ffb700 1 -- 172.21.15.57:0/1823484409 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4078004940 con 0x7f408c141db0 2021-06-25T04:57:25.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091e26700 1 -- 172.21.15.57:0/1823484409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c141820 con 0x7f408c141db0 2021-06-25T04:57:25.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.786+0000 7f4091e26700 1 -- 172.21.15.57:0/1823484409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c066380 con 0x7f408c141db0 2021-06-25T04:57:25.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.790+0000 7f4091e26700 1 -- 172.21.15.57:0/1823484409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c0667c0 con 0x7f408c141db0 2021-06-25T04:57:25.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.790+0000 7f4089ffb700 1 -- 172.21.15.57:0/1823484409 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f4078010070 con 0x7f408c141db0 2021-06-25T04:57:25.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.790+0000 7f4089ffb700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4074055450 0x7f4074057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:25.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.790+0000 7f4089ffb700 1 -- 172.21.15.57:0/1823484409 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f407806ee90 con 0x7f408c141db0 2021-06-25T04:57:25.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.790+0000 7f4090e24700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4074055450 0x7f4074057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:25.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.790+0000 7f4090e24700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4074055450 0x7f4074057910 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f408000b000 tx=0x7f4080008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:25.815 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.794+0000 7f4089ffb700 1 -- 172.21.15.57:0/1823484409 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f4078044f30 con 0x7f408c141db0 2021-06-25T04:57:25.969 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.962+0000 7f4091e26700 1 -- 172.21.15.57:0/1823484409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f408c057310 con 0x7f408c141db0 2021-06-25T04:57:25.970 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4089ffb700 1 -- 172.21.15.57:0/1823484409 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f40780259d0 con 0x7f408c141db0 2021-06-25T04:57:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:25.971 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/982651038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":982651038},{"type":"v1","addr":"172.21.15.57:6833","nonce":982651038}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/58225035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":58225035},{"type":"v1","addr":"172.21.15.57:6835","nonce":58225035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:57:17.702431+0000","modified":"2021-06-25T04:57:18.706360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8778":{"gid":8778,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3809657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3809657492},{"type":"v1","addr":"172.21.15.87:6835","nonce":3809657492}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-06-25T04:57:25.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 -- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4074055450 msgr2=0x7f4074057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4074055450 0x7f4074057910 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f408000b000 tx=0x7f4080008040).stop 2021-06-25T04:57:25.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 -- 172.21.15.57:0/1823484409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f408c141db0 msgr2=0x7f408c142230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:25.973 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f408c141db0 0x7f408c142230 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f408c141b70 tx=0x7f4078015000).stop 2021-06-25T04:57:25.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 -- 172.21.15.57:0/1823484409 shutdown_connections 2021-06-25T04:57:25.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4074055450 0x7f4074057910 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f408c147b10 0x7f408c147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.974 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f408c141db0 0x7f408c142230 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 --2- 172.21.15.57:0/1823484409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f408c0b2040 0x7f408c066ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:25.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 -- 172.21.15.57:0/1823484409 >> 172.21.15.57:0/1823484409 conn(0x7f408c062520 msgr2=0x7f408c0b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:25.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 -- 172.21.15.57:0/1823484409 shutdown_connections 2021-06-25T04:57:25.975 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:25.966+0000 7f4091e26700 1 -- 172.21.15.57:0/1823484409 wait complete. 2021-06-25T04:57:25.976 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 80 2021-06-25T04:57:26.286 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-06-25T04:57:17.702431+0000', 'modified': '2021-06-25T04:57:18.706360+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8778}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8778': {'gid': 8778, 'name': 'b', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/3809657492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 3809657492}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 3809657492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-06-25T04:57:26.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-06-25T04:57:26.288 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-06-25T04:57:26.403 INFO:teuthology.orchestra.run.smithi087.stdout:{"cluster_fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","whoami":0,"id":8778,"want_state":"up:active","state":"up:active","rank_uptime":8.6862492160000002,"mdsmap_epoch":80,"osdmap_epoch":159,"osdmap_epoch_barrier":158,"uptime":13.05060286} 2021-06-25T04:57:26.404 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", "id": 8778, "mdsmap_epoch": 80, "osdmap_epoch": 159, "osdmap_epoch_barrier": 158, "rank_uptime": 8.686249216, "state": "up:active", "uptime": 13.05060286, "want_state": "up:active", "whoami": 0 } 2021-06-25T04:57:26.404 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-06-25T04:57:26.405 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-06-25T04:57:26.405 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi161.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-06-25T04:57:26.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:26.406 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:26.414 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:57:26.432 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:57:26.432 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:57:26.488 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:57:26.489 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:57:26.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:26.490 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:57:26.496 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-06-25T04:57:26.496 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:26.499 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:57:26.514 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:57:26.514 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:57:26.571 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:57:26.572 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:57:26.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:26.574 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:57:26.575 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:2021-06-25T04:57:26.570+0000 7fac2437d080 -1 init, newargv = 0x561f3ef299d0 newargc=9 2021-06-25T04:57:26.575 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[15252]: starting ceph client 2021-06-25T04:57:26.583 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[15252]: starting fuse 2021-06-25T04:57:27.684 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2021-06-25T04:57:27.704 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-06-25T04:57:27.705 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-06-25T04:57:27.760 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-06-25T04:57:27.761 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-06-25T04:57:27.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:27.763 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2021-06-25T04:57:27.767 INFO:teuthology.orchestra.run.smithi161.stdout:52 2021-06-25T04:57:27.768 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-06-25T04:57:27.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:27.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo python3 -c ' 2021-06-25T04:57:27.769 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2021-06-25T04:57:27.770 DEBUG:teuthology.orchestra.run.smithi161:> import re 2021-06-25T04:57:27.770 DEBUG:teuthology.orchestra.run.smithi161:> import os 2021-06-25T04:57:27.770 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2021-06-25T04:57:27.771 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:57:27.771 DEBUG:teuthology.orchestra.run.smithi161:> def find_socket(client_name): 2021-06-25T04:57:27.772 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-06-25T04:57:27.772 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2021-06-25T04:57:27.773 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:57:27.773 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2021-06-25T04:57:27.773 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2021-06-25T04:57:27.774 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2021-06-25T04:57:27.774 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2021-06-25T04:57:27.775 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:57:27.775 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2021-06-25T04:57:27.776 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-06-25T04:57:27.776 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2021-06-25T04:57:27.776 DEBUG:teuthology.orchestra.run.smithi161:> return f 2021-06-25T04:57:27.777 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-06-25T04:57:27.777 DEBUG:teuthology.orchestra.run.smithi161:> 2021-06-25T04:57:27.778 DEBUG:teuthology.orchestra.run.smithi161:> print(find_socket("client.1")) 2021-06-25T04:57:27.778 DEBUG:teuthology.orchestra.run.smithi161:> ' 2021-06-25T04:57:27.819 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.15252.asok 2021-06-25T04:57:27.824 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.15252.asok 2021-06-25T04:57:27.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:27.825 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.15252.asok status 2021-06-25T04:57:27.956 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2021-06-25T04:57:27.956 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2021-06-25T04:57:27.957 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "da5e8184007182fa3cd5c8385fee4e08c5620fe2", 2021-06-25T04:57:27.957 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 15.2.13-65-gda5e8184 (da5e8184007182fa3cd5c8385fee4e08c5620fe2) octopus (stable)", 2021-06-25T04:57:27.957 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2021-06-25T04:57:27.957 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2021-06-25T04:57:27.958 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-06-25T04:57:27.958 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "15252", 2021-06-25T04:57:27.958 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2021-06-25T04:57:27.958 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:57:27.959 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2021-06-25T04:57:27.959 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2021-06-25T04:57:27.959 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 8973, 2021-06-25T04:57:27.959 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2021-06-25T04:57:27.960 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2021-06-25T04:57:27.960 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2021-06-25T04:57:27.960 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 8973 2021-06-25T04:57:27.960 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:57:27.960 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:57:27.961 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:57:27.961 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:57:27.961 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 4165011057 2021-06-25T04:57:27.962 INFO:teuthology.orchestra.run.smithi161.stdout: } 2021-06-25T04:57:27.962 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:57:27.962 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2021-06-25T04:57:27.962 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2021-06-25T04:57:27.963 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "172.21.15.161:0", 2021-06-25T04:57:27.963 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 4165011057 2021-06-25T04:57:27.963 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2021-06-25T04:57:27.963 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.8973 172.21.15.161:0/4165011057", 2021-06-25T04:57:27.964 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "172.21.15.161:0/4165011057", 2021-06-25T04:57:27.964 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2021-06-25T04:57:27.964 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 80, 2021-06-25T04:57:27.964 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 159, 2021-06-25T04:57:27.964 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2021-06-25T04:57:27.965 INFO:teuthology.orchestra.run.smithi161.stdout: "blacklisted": false, 2021-06-25T04:57:27.965 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2021-06-25T04:57:27.965 INFO:teuthology.orchestra.run.smithi161.stdout:} 2021-06-25T04:57:27.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:27.967 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:27.967 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:27.974 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:57:27.975 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:57:27.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:27.976 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:27.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:27.993 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:27.994 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:28.040 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:57:28.042 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:57:28.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:28.043 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:28.043 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:28.052 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2021-06-25T04:57:28.053 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-06-25T04:57:28.053 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2021-06-25T04:57:28.053 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-06-25T04:57:28.054 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:28.069 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[15252]: fuse finished with error 0 and tester_r 0 2021-06-25T04:57:28.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:57:28.071 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:57:28.072 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:28.119 INFO:teuthology.orchestra.run.smithi161.stdout:ext2/ext3 2021-06-25T04:57:28.120 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-06-25T04:57:28.120 INFO:teuthology.orchestra.run:waiting for 900 2021-06-25T04:57:28.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-06-25T04:57:28.167 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-06-25T04:57:28.174 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-06-25T04:57:28.175 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-06-25T04:57:28.196 INFO:teuthology.orchestra.run.smithi102.stdout: File: "." 2021-06-25T04:57:28.197 INFO:teuthology.orchestra.run.smithi102.stdout: ID: 0 Namelen: 255 Type: fuseblk 2021-06-25T04:57:28.197 INFO:teuthology.orchestra.run.smithi102.stdout:Block size: 4194304 Fundamental block size: 4194304 2021-06-25T04:57:28.197 INFO:teuthology.orchestra.run.smithi102.stdout:Blocks: Total: 86526 Free: 86526 Available: 86526 2021-06-25T04:57:28.197 INFO:teuthology.orchestra.run.smithi102.stdout:Inodes: Total: 1 Free: 0 2021-06-25T04:57:28.199 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-06-25T04:57:28.309 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.302+0000 7fb9bd368700 1 Processor -- start 2021-06-25T04:57:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.302+0000 7fb9bd368700 1 -- start start 2021-06-25T04:57:28.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9bd368700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9b8061850 0x7fb9b80b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9bd368700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb9b812b830 0x7fb9b81466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.312 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9bd368700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b8061c30 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9bd368700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b80b2c70 con 0x7fb9b8061850 2021-06-25T04:57:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9bd368700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b812bec0 con 0x7fb9b812b830 2021-06-25T04:57:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9b8061850 0x7fb9b80b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9b8061850 0x7fb9b80b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44872/0 (socket says 172.21.15.57:44872) 2021-06-25T04:57:28.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b6ffd700 1 -- 172.21.15.57:0/3467543849 learned_addr learned my addr 172.21.15.57:0/3467543849 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:28.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b77fe700 1 --2- 172.21.15.57:0/3467543849 >> v2:172.21.15.87:3300/0 conn(0x7fb9b812b830 0x7fb9b81466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b5ffb700 1 -- 172.21.15.57:0/3467543849 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193409322 0 0) 0x7fb9b8061c30 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.314 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b6ffd700 1 -- 172.21.15.57:0/3467543849 >> v2:172.21.15.87:3300/0 conn(0x7fb9b812b830 msgr2=0x7fb9b81466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b6ffd700 1 --2- 172.21.15.57:0/3467543849 >> v2:172.21.15.87:3300/0 conn(0x7fb9b812b830 0x7fb9b81466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b6ffd700 1 -- 172.21.15.57:0/3467543849 >> v1:172.21.15.87:6789/0 conn(0x7fb9b80b6eb0 legacy=0x7fb9b812b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b6ffd700 1 -- 172.21.15.57:0/3467543849 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b812c160 con 0x7fb9b8061850 2021-06-25T04:57:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b6ffd700 1 --2- 172.21.15.57:0/3467543849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9b8061850 0x7fb9b80b4130 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7fb9ac002f70 tx=0x7fb9ac006eb0).ready entity=mon.0 client_cookie=4c89f041b5d24c8a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:28.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b5ffb700 1 -- 172.21.15.57:0/3467543849 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9ac00d5c0 con 0x7fb9b8061850 2021-06-25T04:57:28.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b5ffb700 1 -- 172.21.15.57:0/3467543849 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac000e90 con 0x7fb9b8061850 2021-06-25T04:57:28.319 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9b5ffb700 1 -- 172.21.15.57:0/3467543849 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9ac00d910 con 0x7fb9b8061850 2021-06-25T04:57:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9bd368700 1 -- 172.21.15.57:0/3467543849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9b8061850 msgr2=0x7fb9b80b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9bd368700 1 --2- 172.21.15.57:0/3467543849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9b8061850 0x7fb9b80b4130 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7fb9ac002f70 tx=0x7fb9ac006eb0).stop 2021-06-25T04:57:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9bd368700 1 -- 172.21.15.57:0/3467543849 shutdown_connections 2021-06-25T04:57:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9bd368700 1 --2- 172.21.15.57:0/3467543849 >> v2:172.21.15.87:3300/0 conn(0x7fb9b812b830 0x7fb9b81466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9bd368700 1 --2- 172.21.15.57:0/3467543849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9b8061850 0x7fb9b80b4130 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.306+0000 7fb9bd368700 1 -- 172.21.15.57:0/3467543849 >> 172.21.15.57:0/3467543849 conn(0x7fb9b8066da0 msgr2=0x7fb9b80671b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9bd368700 1 -- 172.21.15.57:0/3467543849 shutdown_connections 2021-06-25T04:57:28.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9bd368700 1 -- 172.21.15.57:0/3467543849 wait complete. 2021-06-25T04:57:28.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9bd368700 1 Processor -- start 2021-06-25T04:57:28.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9bd368700 1 -- start start 2021-06-25T04:57:28.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9bd368700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9b8061850 0x7fb9b80b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9bd368700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9b80b6eb0 0x7fb9b8152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9bd368700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b812b830 0x7fb9b8152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9bd368700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8143f60 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9bd368700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b80b7ca0 con 0x7fb9b8061850 2021-06-25T04:57:28.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9bd368700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8156200 con 0x7fb9b812b830 2021-06-25T04:57:28.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9b67fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9b80b6eb0 0x7fb9b8152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9b67fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9b80b6eb0 0x7fb9b8152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44876/0 (socket says 172.21.15.57:44876) 2021-06-25T04:57:28.324 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9b67fc700 1 -- 172.21.15.57:0/4160517858 learned_addr learned my addr 172.21.15.57:0/4160517858 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:28.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9b6ffd700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9b8061850 0x7fb9b80b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.310+0000 7fb9b77fe700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b812b830 0x7fb9b8152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9b67fc700 1 -- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b812b830 msgr2=0x7fb9b8152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:28.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9b67fc700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b812b830 0x7fb9b8152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9b67fc700 1 -- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9b8061850 msgr2=0x7fb9b80b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9b67fc700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9b8061850 0x7fb9b80b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9b67fc700 1 -- 172.21.15.57:0/4160517858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac00b1e0 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9b67fc700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9b80b6eb0 0x7fb9b8152110 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fb9a8000bc0 tx=0x7fb9a8007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9a7fff700 1 -- 172.21.15.57:0/4160517858 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9a8013450 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9a7fff700 1 -- 172.21.15.57:0/4160517858 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a80135b0 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9bd368700 1 -- 172.21.15.57:0/4160517858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b81564a0 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9a7fff700 1 -- 172.21.15.57:0/4160517858 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9a8013910 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9bd368700 1 -- 172.21.15.57:0/4160517858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b80b78a0 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.331 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9bd368700 1 -- 172.21.15.57:0/4160517858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b8057310 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9a7fff700 1 -- 172.21.15.57:0/4160517858 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb9a801a060 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9a7fff700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb994055450 0x7fb994057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9a7fff700 1 -- 172.21.15.57:0/4160517858 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb9a806d6e0 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.314+0000 7fb9b6ffd700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb994055450 0x7fb994057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.318+0000 7fb9b6ffd700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb994055450 0x7fb994057910 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fb9ac01b000 tx=0x7fb9ac015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:28.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.322+0000 7fb9a7fff700 1 -- 172.21.15.57:0/4160517858 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb9a8043830 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.455 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.450+0000 7fb9bd368700 1 -- 172.21.15.57:0/4160517858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb9b80698a0 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.457 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.450+0000 7fb9a7fff700 1 -- 172.21.15.57:0/4160517858 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v159) v1 ==== 81+0+34051 (secure 0 0 0) 0x7fb9a8018020 con 0x7fb9b80b6eb0 2021-06-25T04:57:28.458 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:28.459 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T04:57:28.459 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 159, 2021-06-25T04:57:28.459 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "d067c0ce-62d7-4088-9fe1-bc0002e5c6e5", 2021-06-25T04:57:28.460 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2021-06-25T04:47:20.414431+0000", 2021-06-25T04:57:28.460 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2021-06-25T04:57:18.707220+0000", 2021-06-25T04:57:28.460 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:57:28.460 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2021-06-25T04:47:27.475755+0000", 2021-06-25T04:57:28.461 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-06-25T04:57:28.461 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2021-06-25T04:57:28.461 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2021-06-25T04:57:28.461 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2021-06-25T04:57:28.462 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2021-06-25T04:57:28.462 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2021-06-25T04:57:28.462 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2021-06-25T04:57:28.462 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:28.462 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 5, 2021-06-25T04:57:28.463 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2021-06-25T04:57:28.463 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-06-25T04:57:28.463 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2021-06-25T04:57:28.463 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2021-06-25T04:57:28.464 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 30, 2021-06-25T04:57:28.464 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 8, 2021-06-25T04:57:28.464 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "jewel", 2021-06-25T04:57:28.464 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2021-06-25T04:57:28.465 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2021-06-25T04:57:28.465 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2021-06-25T04:57:28.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.465 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2021-06-25T04:57:28.466 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "device_health_metrics", 2021-06-25T04:57:28.466 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:24.504320+0000", 2021-06-25T04:57:28.466 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:57:28.466 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:57:28.467 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:57:28.467 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:57:28.467 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:57:28.467 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:57:28.467 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:57:28.468 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:57:28.468 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2021-06-25T04:57:28.468 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2021-06-25T04:57:28.469 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2021-06-25T04:57:28.469 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2021-06-25T04:57:28.469 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2021-06-25T04:57:28.469 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:57:28.470 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:57:28.470 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:57:28.470 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:57:28.470 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:57:28.470 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:57:28.471 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:57:28.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.471 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2021-06-25T04:57:28.471 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:57:28.472 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:57:28.472 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:57:28.472 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:57:28.472 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:57:28.472 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:57:28.473 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:57:28.473 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:57:28.473 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:57:28.473 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:57:28.474 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:57:28.474 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:57:28.474 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:57:28.474 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:57:28.474 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:57:28.475 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:57:28.475 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:57:28.475 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:57:28.475 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:57:28.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:57:28.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:57:28.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:57:28.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:57:28.476 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:57:28.477 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:57:28.477 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:57:28.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.477 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:57:28.478 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:57:28.478 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:57:28.478 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:57:28.478 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:57:28.479 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:57:28.479 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:57:28.479 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:57:28.480 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:57:28.480 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:57:28.480 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:57:28.480 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:57:28.480 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2021-06-25T04:57:28.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.481 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:57:28.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2021-06-25T04:57:28.481 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.482 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2021-06-25T04:57:28.482 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2021-06-25T04:57:28.482 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:47:31.724400+0000", 2021-06-25T04:57:28.483 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:57:28.483 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:57:28.483 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:57:28.483 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:57:28.484 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:57:28.484 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:57:28.484 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:57:28.484 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:57:28.484 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:57:28.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:57:28.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:57:28.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:57:28.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:57:28.486 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:57:28.486 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:57:28.486 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:57:28.486 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:57:28.487 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:57:28.487 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:57:28.487 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:57:28.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.487 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2021-06-25T04:57:28.488 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:57:28.488 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:57:28.488 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:57:28.488 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:57:28.489 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:57:28.489 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:57:28.489 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:57:28.489 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:57:28.489 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:57:28.490 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:57:28.490 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:57:28.490 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:57:28.491 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:57:28.491 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:57:28.491 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:57:28.491 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:57:28.492 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:57:28.492 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:57:28.492 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:57:28.492 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:57:28.493 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:57:28.493 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:57:28.493 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:57:28.493 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:57:28.493 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:57:28.494 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:57:28.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.497 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:57:28.497 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:57:28.498 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:57:28.498 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:57:28.498 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:57:28.498 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:57:28.499 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:57:28.499 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:57:28.499 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:57:28.499 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:57:28.500 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:57:28.500 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:57:28.500 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:57:28.501 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2021-06-25T04:57:28.501 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.501 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 29, 2021-06-25T04:57:28.502 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2021-06-25T04:57:28.502 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:57:16.192470+0000", 2021-06-25T04:57:28.502 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:57:28.502 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:57:28.503 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:57:28.503 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:57:28.503 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:57:28.503 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:57:28.504 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:57:28.504 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:57:28.504 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:57:28.504 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:57:28.504 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:57:28.505 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:57:28.505 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:57:28.505 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:57:28.505 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:57:28.506 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:57:28.506 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:57:28.506 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:57:28.506 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:57:28.506 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:57:28.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.507 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "158", 2021-06-25T04:57:28.507 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:57:28.507 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:57:28.508 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:57:28.508 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:57:28.508 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:57:28.508 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:57:28.508 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:57:28.509 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:57:28.509 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:57:28.509 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:57:28.509 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:57:28.510 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:57:28.510 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:57:28.510 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:57:28.510 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:57:28.511 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:57:28.511 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:57:28.511 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:57:28.511 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:57:28.512 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:57:28.512 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:57:28.512 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:57:28.512 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:57:28.513 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:57:28.513 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:57:28.513 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:57:28.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.514 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:57:28.514 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:57:28.514 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:57:28.514 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:57:28.515 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:57:28.515 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:57:28.515 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:57:28.515 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:57:28.515 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:57:28.516 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:57:28.516 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:57:28.516 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2021-06-25T04:57:28.516 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2021-06-25T04:57:28.517 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2021-06-25T04:57:28.517 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2021-06-25T04:57:28.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.517 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:57:28.517 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:57:28.518 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2021-06-25T04:57:28.518 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.518 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.519 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 30, 2021-06-25T04:57:28.519 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2021-06-25T04:57:28.519 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2021-06-25T04:57:17.377680+0000", 2021-06-25T04:57:28.519 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2021-06-25T04:57:28.520 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2021-06-25T04:57:28.520 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2021-06-25T04:57:28.520 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2021-06-25T04:57:28.520 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2021-06-25T04:57:28.521 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2021-06-25T04:57:28.521 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2021-06-25T04:57:28.521 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2021-06-25T04:57:28.521 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2021-06-25T04:57:28.522 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2021-06-25T04:57:28.522 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2021-06-25T04:57:28.522 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2021-06-25T04:57:28.522 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2021-06-25T04:57:28.523 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2021-06-25T04:57:28.523 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2021-06-25T04:57:28.523 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2021-06-25T04:57:28.523 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2021-06-25T04:57:28.524 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2021-06-25T04:57:28.524 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2021-06-25T04:57:28.524 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2021-06-25T04:57:28.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.525 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "159", 2021-06-25T04:57:28.525 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2021-06-25T04:57:28.525 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2021-06-25T04:57:28.525 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2021-06-25T04:57:28.526 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2021-06-25T04:57:28.526 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2021-06-25T04:57:28.526 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2021-06-25T04:57:28.526 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2021-06-25T04:57:28.527 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2021-06-25T04:57:28.527 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2021-06-25T04:57:28.527 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2021-06-25T04:57:28.527 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2021-06-25T04:57:28.528 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2021-06-25T04:57:28.528 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2021-06-25T04:57:28.528 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2021-06-25T04:57:28.528 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2021-06-25T04:57:28.528 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2021-06-25T04:57:28.529 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2021-06-25T04:57:28.529 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2021-06-25T04:57:28.529 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-06-25T04:57:28.529 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-06-25T04:57:28.530 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2021-06-25T04:57:28.530 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2021-06-25T04:57:28.530 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2021-06-25T04:57:28.530 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2021-06-25T04:57:28.530 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2021-06-25T04:57:28.531 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2021-06-25T04:57:28.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.531 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2021-06-25T04:57:28.531 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2021-06-25T04:57:28.532 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2021-06-25T04:57:28.532 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2021-06-25T04:57:28.532 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2021-06-25T04:57:28.533 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2021-06-25T04:57:28.533 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2021-06-25T04:57:28.533 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2021-06-25T04:57:28.533 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2021-06-25T04:57:28.534 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2021-06-25T04:57:28.534 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2021-06-25T04:57:28.534 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2021-06-25T04:57:28.534 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2021-06-25T04:57:28.535 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2021-06-25T04:57:28.535 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2021-06-25T04:57:28.535 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.535 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.536 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.536 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:28.536 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2021-06-25T04:57:28.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.537 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:57:28.537 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "99a627d2-6f82-4862-b866-ad32e153b1a3", 2021-06-25T04:57:28.537 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:28.537 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:28.538 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:28.538 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:28.538 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:28.538 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:28.538 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:28.539 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 156, 2021-06-25T04:57:28.539 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:28.539 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:28.539 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:28.540 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.540 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.540 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2021-06-25T04:57:28.541 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:28.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.541 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.541 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2021-06-25T04:57:28.542 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:28.542 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.542 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2021-06-25T04:57:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2021-06-25T04:57:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2021-06-25T04:57:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2021-06-25T04:57:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2021-06-25T04:57:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2021-06-25T04:57:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15205 2021-06-25T04:57:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6801/15205", 2021-06-25T04:57:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6803/15205", 2021-06-25T04:57:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/15205", 2021-06-25T04:57:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6805/15205", 2021-06-25T04:57:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:57:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "1ce151cf-5006-4549-98dd-18dddd863605", 2021-06-25T04:57:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 155, 2021-06-25T04:57:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2021-06-25T04:57:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2021-06-25T04:57:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2021-06-25T04:57:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2021-06-25T04:57:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2021-06-25T04:57:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2021-06-25T04:57:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2021-06-25T04:57:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2021-06-25T04:57:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15206 2021-06-25T04:57:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6809/15206", 2021-06-25T04:57:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6811/15206", 2021-06-25T04:57:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/15206", 2021-06-25T04:57:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6813/15206", 2021-06-25T04:57:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:57:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f55562f2-e1ee-45bf-8a10-1538ce97cd5b", 2021-06-25T04:57:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 156, 2021-06-25T04:57:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6824", 2021-06-25T04:57:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6825", 2021-06-25T04:57:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6826", 2021-06-25T04:57:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6827", 2021-06-25T04:57:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6830", 2021-06-25T04:57:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6831", 2021-06-25T04:57:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6828", 2021-06-25T04:57:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6829", 2021-06-25T04:57:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15216 2021-06-25T04:57:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6825/15216", 2021-06-25T04:57:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6827/15216", 2021-06-25T04:57:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6831/15216", 2021-06-25T04:57:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6829/15216", 2021-06-25T04:57:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:57:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c", 2021-06-25T04:57:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 156, 2021-06-25T04:57:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6816", 2021-06-25T04:57:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2021-06-25T04:57:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2021-06-25T04:57:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2021-06-25T04:57:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6822", 2021-06-25T04:57:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6823", 2021-06-25T04:57:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6820", 2021-06-25T04:57:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6821", 2021-06-25T04:57:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15207 2021-06-25T04:57:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6817/15207", 2021-06-25T04:57:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6819/15207", 2021-06-25T04:57:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6823/15207", 2021-06-25T04:57:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6821/15207", 2021-06-25T04:57:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:57:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "6b6d8788-2f26-4b45-84bd-651eaa34cada", 2021-06-25T04:57:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 155, 2021-06-25T04:57:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6808", 2021-06-25T04:57:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6809", 2021-06-25T04:57:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6810", 2021-06-25T04:57:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6811", 2021-06-25T04:57:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6814", 2021-06-25T04:57:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6815", 2021-06-25T04:57:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6812", 2021-06-25T04:57:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6813", 2021-06-25T04:57:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15528 2021-06-25T04:57:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6809/15528", 2021-06-25T04:57:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6811/15528", 2021-06-25T04:57:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6815/15528", 2021-06-25T04:57:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6813/15528", 2021-06-25T04:57:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:57:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "b57c1968-cc07-4542-82e5-5c924cb09858", 2021-06-25T04:57:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 156, 2021-06-25T04:57:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6824", 2021-06-25T04:57:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6825", 2021-06-25T04:57:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6826", 2021-06-25T04:57:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6827", 2021-06-25T04:57:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6830", 2021-06-25T04:57:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6831", 2021-06-25T04:57:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6828", 2021-06-25T04:57:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6829", 2021-06-25T04:57:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15545 2021-06-25T04:57:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6825/15545", 2021-06-25T04:57:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6827/15545", 2021-06-25T04:57:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6831/15545", 2021-06-25T04:57:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6829/15545", 2021-06-25T04:57:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:57:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "72622640-3724-4a46-8f2d-9c797e8d7fcf", 2021-06-25T04:57:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 156, 2021-06-25T04:57:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6816", 2021-06-25T04:57:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6817", 2021-06-25T04:57:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6818", 2021-06-25T04:57:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6819", 2021-06-25T04:57:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6822", 2021-06-25T04:57:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6823", 2021-06-25T04:57:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6820", 2021-06-25T04:57:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6821", 2021-06-25T04:57:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15529 2021-06-25T04:57:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6817/15529", 2021-06-25T04:57:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6819/15529", 2021-06-25T04:57:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6823/15529", 2021-06-25T04:57:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6821/15529", 2021-06-25T04:57:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:57:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f58d446d-b419-4746-b3ca-f6b61e89abb7", 2021-06-25T04:57:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2021-06-25T04:57:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2021-06-25T04:57:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2021-06-25T04:57:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2021-06-25T04:57:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2021-06-25T04:57:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2021-06-25T04:57:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 13, 2021-06-25T04:57:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 156, 2021-06-25T04:57:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2021-06-25T04:57:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2021-06-25T04:57:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2021-06-25T04:57:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.673 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.673 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6800", 2021-06-25T04:57:28.673 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:28.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.674 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.674 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6801", 2021-06-25T04:57:28.674 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:28.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.675 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.675 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2021-06-25T04:57:28.675 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6802", 2021-06-25T04:57:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6803", 2021-06-25T04:57:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:28.678 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.678 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.678 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2021-06-25T04:57:28.679 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.679 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.679 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6806", 2021-06-25T04:57:28.679 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:28.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.680 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.680 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6807", 2021-06-25T04:57:28.681 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:28.681 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.681 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.682 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2021-06-25T04:57:28.682 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2021-06-25T04:57:28.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.682 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2021-06-25T04:57:28.683 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6804", 2021-06-25T04:57:28.683 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:28.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.684 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2021-06-25T04:57:28.684 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.87:6805", 2021-06-25T04:57:28.684 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 15530 2021-06-25T04:57:28.684 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.685 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.685 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.87:6801/15530", 2021-06-25T04:57:28.685 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.87:6803/15530", 2021-06-25T04:57:28.686 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.87:6807/15530", 2021-06-25T04:57:28.686 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.87:6805/15530", 2021-06-25T04:57:28.686 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2021-06-25T04:57:28.686 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2021-06-25T04:57:28.687 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2021-06-25T04:57:28.687 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2021-06-25T04:57:28.687 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.687 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:28.688 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2021-06-25T04:57:28.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.688 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2021-06-25T04:57:28.688 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:28.689 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:28.689 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:28.689 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:28.689 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:28.690 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.943419+0000", 2021-06-25T04:57:28.690 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:28.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.691 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2021-06-25T04:57:28.691 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:28.691 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:28.691 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:28.691 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:28.692 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:28.692 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.933590+0000", 2021-06-25T04:57:28.692 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:28.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.693 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2021-06-25T04:57:28.693 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:28.693 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:28.694 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:28.694 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:28.694 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:28.694 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.226103+0000", 2021-06-25T04:57:28.695 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:28.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.695 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2021-06-25T04:57:28.695 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:28.696 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:28.696 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:28.696 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:28.696 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:28.697 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.172651+0000", 2021-06-25T04:57:28.697 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:28.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.697 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 4, 2021-06-25T04:57:28.698 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:28.698 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:28.698 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:28.698 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:28.699 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:28.699 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.117116+0000", 2021-06-25T04:57:28.699 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:28.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.700 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 5, 2021-06-25T04:57:28.700 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:28.700 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:28.700 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:28.701 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:28.701 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:28.701 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.005133+0000", 2021-06-25T04:57:28.701 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:28.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.702 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 6, 2021-06-25T04:57:28.702 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:28.702 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:28.703 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:28.703 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:28.703 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:28.703 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:26.195111+0000", 2021-06-25T04:57:28.704 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:28.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2021-06-25T04:57:28.704 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 7, 2021-06-25T04:57:28.705 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2021-06-25T04:57:28.705 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2021-06-25T04:57:28.705 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2021-06-25T04:57:28.705 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138292840890367, 2021-06-25T04:57:28.706 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2021-06-25T04:57:28.706 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2021-06-25T04:47:25.966764+0000", 2021-06-25T04:57:28.706 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2021-06-25T04:57:28.706 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.707 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2021-06-25T04:57:28.707 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2021-06-25T04:57:28.707 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2021-06-25T04:57:28.707 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2021-06-25T04:57:28.707 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2021-06-25T04:57:28.708 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": {}, 2021-06-25T04:57:28.708 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2021-06-25T04:57:28.708 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_data": { 2021-06-25T04:57:28.708 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-device-class": "", 2021-06-25T04:57:28.709 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:57:28.709 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-root": "default", 2021-06-25T04:57:28.709 INFO:teuthology.orchestra.run.smithi057.stdout: "jerasure-per-chunk-alignment": "false", 2021-06-25T04:57:28.709 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:57:28.709 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "2", 2021-06-25T04:57:28.710 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:57:28.710 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:57:28.710 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van", 2021-06-25T04:57:28.710 INFO:teuthology.orchestra.run.smithi057.stdout: "w": "8" 2021-06-25T04:57:28.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.711 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2021-06-25T04:57:28.711 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2021-06-25T04:57:28.711 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2021-06-25T04:57:28.711 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2021-06-25T04:57:28.712 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2021-06-25T04:57:28.712 INFO:teuthology.orchestra.run.smithi057.stdout: "ruleset-failure-domain": "osd", 2021-06-25T04:57:28.712 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2021-06-25T04:57:28.712 INFO:teuthology.orchestra.run.smithi057.stdout: } 2021-06-25T04:57:28.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2021-06-25T04:57:28.713 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2021-06-25T04:57:28.713 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2021-06-25T04:57:28.713 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2021-06-25T04:57:28.714 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2021-06-25T04:57:28.714 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2021-06-25T04:57:28.714 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T04:57:28.716 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 -- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb994055450 msgr2=0x7fb994057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:28.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb994055450 0x7fb994057910 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fb9ac01b000 tx=0x7fb9ac015000).stop 2021-06-25T04:57:28.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 -- 172.21.15.57:0/4160517858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9b80b6eb0 msgr2=0x7fb9b8152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:28.717 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9b80b6eb0 0x7fb9b8152110 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fb9a8000bc0 tx=0x7fb9a8007a60).stop 2021-06-25T04:57:28.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 -- 172.21.15.57:0/4160517858 shutdown_connections 2021-06-25T04:57:28.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb994055450 0x7fb994057910 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b812b830 0x7fb9b8152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9b80b6eb0 0x7fb9b8152110 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.718 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 --2- 172.21.15.57:0/4160517858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9b8061850 0x7fb9b80b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 -- 172.21.15.57:0/4160517858 >> 172.21.15.57:0/4160517858 conn(0x7fb9b8066da0 msgr2=0x7fb9b8129750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:28.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 -- 172.21.15.57:0/4160517858 shutdown_connections 2021-06-25T04:57:28.719 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.454+0000 7fb9bd368700 1 -- 172.21.15.57:0/4160517858 wait complete. 2021-06-25T04:57:28.720 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:57:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ba903700 1 Processor -- start 2021-06-25T04:57:28.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ba903700 1 -- start start 2021-06-25T04:57:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ba903700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f36b40b3200 0x7f36b405f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ba903700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b4065750 0x7f36b4060eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ba903700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b40b35e0 con 0x7f36b40613a0 2021-06-25T04:57:28.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ba903700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b4060230 con 0x7f36b40b3200 2021-06-25T04:57:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ba903700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40604d0 con 0x7f36b4065750 2021-06-25T04:57:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ab7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b4065750 0x7f36b4060eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36b3fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f36b40b3200 0x7f36b405f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ab7fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b4065750 0x7f36b4060eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:56050/0 (socket says 172.21.15.57:56050) 2021-06-25T04:57:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36b8ea0700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f36b40613a0 0x7f36b414ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:34622/0 (socket says 172.21.15.57:34622) 2021-06-25T04:57:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ab7fe700 1 -- 172.21.15.57:0/307808421 learned_addr learned my addr 172.21.15.57:0/307808421 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ab7fe700 1 -- 172.21.15.57:0/307808421 >> v2:172.21.15.87:3300/0 conn(0x7f36b40b3200 msgr2=0x7f36b405f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ab7fe700 1 --2- 172.21.15.57:0/307808421 >> v2:172.21.15.87:3300/0 conn(0x7f36b40b3200 0x7f36b405f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ab7fe700 1 -- 172.21.15.57:0/307808421 >> v1:172.21.15.87:6789/0 conn(0x7f36b40613a0 legacy=0x7f36b414ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ab7fe700 1 -- 172.21.15.57:0/307808421 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b4060770 con 0x7f36b4065750 2021-06-25T04:57:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ab7fe700 1 --2- 172.21.15.57:0/307808421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b4065750 0x7f36b4060eb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f369c002f70 tx=0x7f369c006eb0).ready entity=mon.2 client_cookie=3352efbac6a6b500 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36b37fe700 1 -- 172.21.15.57:0/307808421 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c00d570 con 0x7f36b4065750 2021-06-25T04:57:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36b37fe700 1 -- 172.21.15.57:0/307808421 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c000e90 con 0x7f36b4065750 2021-06-25T04:57:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ba903700 1 -- 172.21.15.57:0/307808421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b4065750 msgr2=0x7f36b4060eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:28.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36ba903700 1 --2- 172.21.15.57:0/307808421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b4065750 0x7f36b4060eb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f369c002f70 tx=0x7f369c006eb0).stop 2021-06-25T04:57:28.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.826+0000 7f36b37fe700 1 -- 172.21.15.57:0/307808421 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c00d900 con 0x7f36b4065750 2021-06-25T04:57:28.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 -- 172.21.15.57:0/307808421 shutdown_connections 2021-06-25T04:57:28.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 --2- 172.21.15.57:0/307808421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b4065750 0x7f36b4060eb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 --2- 172.21.15.57:0/307808421 >> v2:172.21.15.87:3300/0 conn(0x7f36b40b3200 0x7f36b405f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 -- 172.21.15.57:0/307808421 >> 172.21.15.57:0/307808421 conn(0x7f36b405c450 msgr2=0x7f36b405c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:28.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 -- 172.21.15.57:0/307808421 shutdown_connections 2021-06-25T04:57:28.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 -- 172.21.15.57:0/307808421 wait complete. 2021-06-25T04:57:28.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 Processor -- start 2021-06-25T04:57:28.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 -- start start 2021-06-25T04:57:28.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b40613a0 0x7f36b409e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36b4065750 0x7f36b40a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b40b3200 0x7f36b40ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40abaf0 con 0x7f36b40613a0 2021-06-25T04:57:28.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40aae60 con 0x7f36b4065750 2021-06-25T04:57:28.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ba903700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b4157180 con 0x7f36b40b3200 2021-06-25T04:57:28.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36b3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b40613a0 0x7f36b409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36b3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b40613a0 0x7f36b409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44890/0 (socket says 172.21.15.57:44890) 2021-06-25T04:57:28.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36b3fff700 1 -- 172.21.15.57:0/3319096883 learned_addr learned my addr 172.21.15.57:0/3319096883 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:28.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36b8ea0700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b40b3200 0x7f36b40ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36ab7fe700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36b4065750 0x7f36b40a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36b3fff700 1 -- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b40b3200 msgr2=0x7f36b40ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36b3fff700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b40b3200 0x7f36b40ac430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36b3fff700 1 -- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36b4065750 msgr2=0x7f36b40a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:28.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36b3fff700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36b4065750 0x7f36b40a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:28.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.830+0000 7f36b3fff700 1 -- 172.21.15.57:0/3319096883 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c00b1e0 con 0x7f36b40613a0 2021-06-25T04:57:28.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36b3fff700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b40613a0 0x7f36b409e870 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f36a400c000 tx=0x7f36a4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:28.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36b1ffb700 1 -- 172.21.15.57:0/3319096883 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36a4010780 con 0x7f36b40613a0 2021-06-25T04:57:28.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36b1ffb700 1 -- 172.21.15.57:0/3319096883 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a40108e0 con 0x7f36b40613a0 2021-06-25T04:57:28.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36b1ffb700 1 -- 172.21.15.57:0/3319096883 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36a4010c40 con 0x7f36b40613a0 2021-06-25T04:57:28.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36ba903700 1 -- 172.21.15.57:0/3319096883 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b4157420 con 0x7f36b40613a0 2021-06-25T04:57:28.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36ba903700 1 -- 172.21.15.57:0/3319096883 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b40ab2c0 con 0x7f36b40613a0 2021-06-25T04:57:28.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36ba903700 1 -- 172.21.15.57:0/3319096883 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b4156fc0 con 0x7f36b40613a0 2021-06-25T04:57:28.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36b1ffb700 1 -- 172.21.15.57:0/3319096883 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f36a401c460 con 0x7f36b40613a0 2021-06-25T04:57:28.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36b1ffb700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36980554e0 0x7f36980579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:28.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36b1ffb700 1 -- 172.21.15.57:0/3319096883 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f36a406e350 con 0x7f36b40613a0 2021-06-25T04:57:28.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36ab7fe700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36980554e0 0x7f36980579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:28.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.834+0000 7f36ab7fe700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36980554e0 0x7f36980579a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f369c01b000 tx=0x7f369c015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:28.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:28.842+0000 7f36b1ffb700 1 -- 172.21.15.57:0/3319096883 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f36a4044400 con 0x7f36b40613a0 2021-06-25T04:57:29.012 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.006+0000 7f36ba903700 1 -- 172.21.15.57:0/3319096883 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36b40aafd0 con 0x7f36b40613a0 2021-06-25T04:57:29.013 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.006+0000 7f36b1ffb700 1 -- 172.21.15.57:0/3319096883 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f36a4047a20 con 0x7f36b40613a0 2021-06-25T04:57:29.013 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:29.013 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/982651038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":982651038},{"type":"v1","addr":"172.21.15.57:6833","nonce":982651038}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/58225035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":58225035},{"type":"v1","addr":"172.21.15.57:6835","nonce":58225035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:57:17.702431+0000","modified":"2021-06-25T04:57:18.706360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8778":{"gid":8778,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/3809657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3809657492},{"type":"v1","addr":"172.21.15.87:6835","nonce":3809657492}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-06-25T04:57:29.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 -- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36980554e0 msgr2=0x7f36980579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36980554e0 0x7f36980579a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f369c01b000 tx=0x7f369c015000).stop 2021-06-25T04:57:29.015 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 -- 172.21.15.57:0/3319096883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b40613a0 msgr2=0x7f36b409e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b40613a0 0x7f36b409e870 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f36a400c000 tx=0x7f36a4006df0).stop 2021-06-25T04:57:29.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 -- 172.21.15.57:0/3319096883 shutdown_connections 2021-06-25T04:57:29.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f36980554e0 0x7f36980579a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.016 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36b40b3200 0x7f36b40ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36b4065750 0x7f36b40a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 --2- 172.21.15.57:0/3319096883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b40613a0 0x7f36b409e870 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 -- 172.21.15.57:0/3319096883 >> 172.21.15.57:0/3319096883 conn(0x7f36b405c450 msgr2=0x7f36b40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:29.017 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 -- 172.21.15.57:0/3319096883 shutdown_connections 2021-06-25T04:57:29.018 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.010+0000 7f36ba903700 1 -- 172.21.15.57:0/3319096883 wait complete. 2021-06-25T04:57:29.018 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 80 2021-06-25T04:57:29.026 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-06-25T04:57:29.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.118+0000 7f8dcf3ec700 1 Processor -- start 2021-06-25T04:57:29.126 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.118+0000 7f8dcf3ec700 1 -- start start 2021-06-25T04:57:29.128 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8139aa0 0x7f8dc8142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8dc8143260 0x7f8dc80ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8dc80b1c10 0x7f8dc80ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc80b2fd0 con 0x7f8dc80b1c10 2021-06-25T04:57:29.129 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc80af2e0 con 0x7f8dc8143260 2021-06-25T04:57:29.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80ac430 con 0x7f8dc8139aa0 2021-06-25T04:57:29.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcd989700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8dc80b1c10 0x7f8dc80ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcd989700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8dc80b1c10 0x7f8dc80ab9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44902/0 (socket says 172.21.15.57:44902) 2021-06-25T04:57:29.130 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcd989700 1 -- 172.21.15.57:0/4256200292 learned_addr learned my addr 172.21.15.57:0/4256200292 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:29.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcc987700 1 --2- 172.21.15.57:0/4256200292 >> v2:172.21.15.87:3300/0 conn(0x7f8dc8143260 0x7f8dc80ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.131 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcd188700 1 --2- 172.21.15.57:0/4256200292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8139aa0 0x7f8dc8142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcd989700 1 -- 172.21.15.57:0/4256200292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8139aa0 msgr2=0x7f8dc8142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:29.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcd989700 1 --2- 172.21.15.57:0/4256200292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8139aa0 0x7f8dc8142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcd989700 1 -- 172.21.15.57:0/4256200292 >> v2:172.21.15.87:3300/0 conn(0x7f8dc8143260 msgr2=0x7f8dc80ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:29.132 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcd989700 1 --2- 172.21.15.57:0/4256200292 >> v2:172.21.15.87:3300/0 conn(0x7f8dc8143260 0x7f8dc80ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcd989700 1 -- 172.21.15.57:0/4256200292 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc81436f0 con 0x7f8dc80b1c10 2021-06-25T04:57:29.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcd989700 1 --2- 172.21.15.57:0/4256200292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc80b1c10 0x7f8dc80ab9e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f8dc80602b0 tx=0x7f8dc0009290).ready entity=mon.0 client_cookie=410428376bc90e2f server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:29.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dbffff700 1 -- 172.21.15.57:0/4256200292 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dc000b830 con 0x7f8dc80b1c10 2021-06-25T04:57:29.133 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dbffff700 1 -- 172.21.15.57:0/4256200292 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc000b990 con 0x7f8dc80b1c10 2021-06-25T04:57:29.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dbffff700 1 -- 172.21.15.57:0/4256200292 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dc000bb40 con 0x7f8dc80b1c10 2021-06-25T04:57:29.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/4256200292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc80b1c10 msgr2=0x7f8dc80ab9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.134 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 --2- 172.21.15.57:0/4256200292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc80b1c10 0x7f8dc80ab9e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f8dc80602b0 tx=0x7f8dc0009290).stop 2021-06-25T04:57:29.137 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/4256200292 shutdown_connections 2021-06-25T04:57:29.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 --2- 172.21.15.57:0/4256200292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc80b1c10 0x7f8dc80ab9e0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 --2- 172.21.15.57:0/4256200292 >> v2:172.21.15.87:3300/0 conn(0x7f8dc8143260 0x7f8dc80ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 --2- 172.21.15.57:0/4256200292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8139aa0 0x7f8dc8142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.138 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/4256200292 >> 172.21.15.57:0/4256200292 conn(0x7f8dc805f670 msgr2=0x7f8dc805fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:29.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/4256200292 shutdown_connections 2021-06-25T04:57:29.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.122+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/4256200292 wait complete. 2021-06-25T04:57:29.139 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcf3ec700 1 Processor -- start 2021-06-25T04:57:29.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcf3ec700 1 -- start start 2021-06-25T04:57:29.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcf3ec700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc80b1c10 0x7f8dc8150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcf3ec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc8151070 0x7f8dc8066870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.140 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcf3ec700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8066d60 0x7f8dc80645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcf3ec700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc813ca20 con 0x7f8dc8151070 2021-06-25T04:57:29.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcf3ec700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8150720 con 0x7f8dc80b1c10 2021-06-25T04:57:29.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcf3ec700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc8062b70 con 0x7f8dc8066d60 2021-06-25T04:57:29.141 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcc987700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc8151070 0x7f8dc8066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcc987700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc8151070 0x7f8dc8066870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44908/0 (socket says 172.21.15.57:44908) 2021-06-25T04:57:29.142 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcc987700 1 -- 172.21.15.57:0/1924125253 learned_addr learned my addr 172.21.15.57:0/1924125253 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:29.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcd188700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc80b1c10 0x7f8dc8150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcd989700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8066d60 0x7f8dc80645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcc987700 1 -- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8066d60 msgr2=0x7f8dc80645b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.143 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcc987700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8066d60 0x7f8dc80645b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcc987700 1 -- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc80b1c10 msgr2=0x7f8dc8150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcc987700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc80b1c10 0x7f8dc8150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcc987700 1 -- 172.21.15.57:0/1924125253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc0009530 con 0x7f8dc8151070 2021-06-25T04:57:29.144 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcc987700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc8151070 0x7f8dc8066870 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f8dc40030b0 tx=0x7f8dc4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:29.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dbe7fc700 1 -- 172.21.15.57:0/1924125253 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dc4011780 con 0x7f8dc8151070 2021-06-25T04:57:29.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dbe7fc700 1 -- 172.21.15.57:0/1924125253 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc40118e0 con 0x7f8dc8151070 2021-06-25T04:57:29.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/1924125253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc8062ed0 con 0x7f8dc8151070 2021-06-25T04:57:29.145 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dbe7fc700 1 -- 172.21.15.57:0/1924125253 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dc4011c40 con 0x7f8dc8151070 2021-06-25T04:57:29.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.126+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/1924125253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc8063df0 con 0x7f8dc8151070 2021-06-25T04:57:29.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.130+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/1924125253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc8057310 con 0x7f8dc8151070 2021-06-25T04:57:29.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.130+0000 7f8dbe7fc700 1 -- 172.21.15.57:0/1924125253 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f8dc401c460 con 0x7f8dc8151070 2021-06-25T04:57:29.146 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.130+0000 7f8dbe7fc700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8db00553d0 0x7f8db0057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.130+0000 7f8dbe7fc700 1 -- 172.21.15.57:0/1924125253 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8dc406dfb0 con 0x7f8dc8151070 2021-06-25T04:57:29.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.130+0000 7f8dcd188700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8db00553d0 0x7f8db0057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.147 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.130+0000 7f8dcd188700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8db00553d0 0x7f8db0057890 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f8db800c000 tx=0x7f8db8008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:29.148 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.138+0000 7f8dbe7fc700 1 -- 172.21.15.57:0/1924125253 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f8dc4044100 con 0x7f8dc8151070 2021-06-25T04:57:29.302 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.294+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/1924125253 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8dc8044610 con 0x7f8dc8151070 2021-06-25T04:57:29.669 INFO:tasks.ceph.mon.a.smithi057.stderr:2021-06-25T04:57:29.666+0000 7f8c40e05700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-06-25T04:57:29.677 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.670+0000 7f8dbe7fc700 1 -- 172.21.15.57:0/1924125253 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v81) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8dc4047720 con 0x7f8dc8151070 2021-06-25T04:57:29.681 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8db00553d0 msgr2=0x7f8db0057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8db00553d0 0x7f8db0057890 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f8db800c000 tx=0x7f8db8008040).stop 2021-06-25T04:57:29.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/1924125253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc8151070 msgr2=0x7f8dc8066870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc8151070 0x7f8dc8066870 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f8dc40030b0 tx=0x7f8dc4008040).stop 2021-06-25T04:57:29.682 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/1924125253 shutdown_connections 2021-06-25T04:57:29.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f8db00553d0 0x7f8db0057890 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8dc8066d60 0x7f8dc80645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.683 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dc8151070 0x7f8dc8066870 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 --2- 172.21.15.57:0/1924125253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc80b1c10 0x7f8dc8150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/1924125253 >> 172.21.15.57:0/1924125253 conn(0x7f8dc805f670 msgr2=0x7f8dc8142a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/1924125253 shutdown_connections 2021-06-25T04:57:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.674+0000 7f8dcf3ec700 1 -- 172.21.15.57:0/1924125253 wait complete. 2021-06-25T04:57:29.685 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-06-25T04:57:29.698 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-06-25T04:57:29.708 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2021-06-25T04:57:29.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.798+0000 7fb513485700 1 Processor -- start 2021-06-25T04:57:29.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 -- start start 2021-06-25T04:57:29.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb50c0b2cb0 0x7fb50c0b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb50c143f70 0x7fb50c0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c0b2230 con 0x7fb50c064b00 2021-06-25T04:57:29.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c0621f0 con 0x7fb50c143f70 2021-06-25T04:57:29.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c064ee0 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb512c84700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb50c143f70 0x7fb50c0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb512c84700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb50c143f70 0x7fb50c0b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44916/0 (socket says 172.21.15.57:44916) 2021-06-25T04:57:29.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb512c84700 1 -- 172.21.15.57:0/3293603628 learned_addr learned my addr 172.21.15.57:0/3293603628 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:29.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb511c82700 1 --2- 172.21.15.57:0/3293603628 >> v2:172.21.15.87:3300/0 conn(0x7fb50c0b2cb0 0x7fb50c0b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb512c84700 1 -- 172.21.15.57:0/3293603628 >> v2:172.21.15.87:3300/0 conn(0x7fb50c0b2cb0 msgr2=0x7fb50c0b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:29.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb512c84700 1 --2- 172.21.15.57:0/3293603628 >> v2:172.21.15.87:3300/0 conn(0x7fb50c0b2cb0 0x7fb50c0b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb512c84700 1 -- 172.21.15.57:0/3293603628 >> v1:172.21.15.87:6789/0 conn(0x7fb50c064b00 legacy=0x7fb50c143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb512c84700 1 -- 172.21.15.57:0/3293603628 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c065720 con 0x7fb50c143f70 2021-06-25T04:57:29.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb511c82700 1 --2- 172.21.15.57:0/3293603628 >> v2:172.21.15.87:3300/0 conn(0x7fb50c0b2cb0 0x7fb50c0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T04:57:29.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb512c84700 1 --2- 172.21.15.57:0/3293603628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb50c143f70 0x7fb50c0b36e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7fb5040032f0 tx=0x7fb504009290).ready entity=mon.0 client_cookie=3d8c18617af9b31d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:29.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb511481700 1 -- 172.21.15.57:0/3293603628 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb50400b870 con 0x7fb50c143f70 2021-06-25T04:57:29.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb511481700 1 -- 172.21.15.57:0/3293603628 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50400b9d0 con 0x7fb50c143f70 2021-06-25T04:57:29.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb511481700 1 -- 172.21.15.57:0/3293603628 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb50400bb40 con 0x7fb50c143f70 2021-06-25T04:57:29.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 -- 172.21.15.57:0/3293603628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb50c143f70 msgr2=0x7fb50c0b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 --2- 172.21.15.57:0/3293603628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb50c143f70 0x7fb50c0b36e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7fb5040032f0 tx=0x7fb504009290).stop 2021-06-25T04:57:29.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 -- 172.21.15.57:0/3293603628 shutdown_connections 2021-06-25T04:57:29.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 --2- 172.21.15.57:0/3293603628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb50c143f70 0x7fb50c0b36e0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 --2- 172.21.15.57:0/3293603628 >> v2:172.21.15.87:3300/0 conn(0x7fb50c0b2cb0 0x7fb50c0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.818 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 -- 172.21.15.57:0/3293603628 >> 172.21.15.57:0/3293603628 conn(0x7fb50c062ba0 msgr2=0x7fb50c05f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:29.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 -- 172.21.15.57:0/3293603628 shutdown_connections 2021-06-25T04:57:29.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.802+0000 7fb513485700 1 -- 172.21.15.57:0/3293603628 wait complete. 2021-06-25T04:57:29.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb513485700 1 Processor -- start 2021-06-25T04:57:29.819 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb513485700 1 -- start start 2021-06-25T04:57:29.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb513485700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb50c064b00 0x7fb50c155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb513485700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb50c0b2cb0 0x7fb50c155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb513485700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb50c143f70 0x7fb50c0b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.820 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb513485700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0b57d0 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb513485700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c152be0 con 0x7fb50c143f70 2021-06-25T04:57:29.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb513485700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c146c70 con 0x7fb50c064b00 2021-06-25T04:57:29.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb511c82700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb50c0b2cb0 0x7fb50c155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.821 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb512483700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb50c064b00 0x7fb50c155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb511c82700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb50c0b2cb0 0x7fb50c155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44922/0 (socket says 172.21.15.57:44922) 2021-06-25T04:57:29.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb511c82700 1 -- 172.21.15.57:0/343207124 learned_addr learned my addr 172.21.15.57:0/343207124 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:29.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb512c84700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb50c143f70 0x7fb50c0b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb511c82700 1 -- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb50c064b00 msgr2=0x7fb50c155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.822 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb511c82700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb50c064b00 0x7fb50c155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb511c82700 1 -- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb50c143f70 msgr2=0x7fb50c0b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb511c82700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb50c143f70 0x7fb50c0b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb511c82700 1 -- 172.21.15.57:0/343207124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504009530 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.823 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb512c84700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb50c143f70 0x7fb50c0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:29.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb511c82700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb50c0b2cb0 0x7fb50c155f10 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fb4fc0068e0 tx=0x7fb4fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:29.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb4fb7fe700 1 -- 172.21.15.57:0/343207124 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4fc011780 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb4fb7fe700 1 -- 172.21.15.57:0/343207124 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc0118e0 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.824 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb4fb7fe700 1 -- 172.21.15.57:0/343207124 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4fc011c40 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb513485700 1 -- 172.21.15.57:0/343207124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c0b5a00 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.806+0000 7fb513485700 1 -- 172.21.15.57:0/343207124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c0b5200 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.810+0000 7fb513485700 1 -- 172.21.15.57:0/343207124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50c146db0 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.810+0000 7fb4fb7fe700 1 -- 172.21.15.57:0/343207124 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb4fc012420 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.810+0000 7fb4fb7fe700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb4ec0553f0 0x7fb4ec0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.810+0000 7fb4fb7fe700 1 -- 172.21.15.57:0/343207124 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fb4fc06ddd0 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.810+0000 7fb512483700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb4ec0553f0 0x7fb4ec0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.810+0000 7fb512483700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb4ec0553f0 0x7fb4ec0578b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fb50800d000 tx=0x7fb508000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:29.827 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.814+0000 7fb4fb7fe700 1 -- 172.21.15.57:0/343207124 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb4fc043ed0 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.982+0000 7fb513485700 1 -- 172.21.15.57:0/343207124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb50c057310 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.989 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.982+0000 7fb4fb7fe700 1 -- 172.21.15.57:0/343207124 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2126 (secure 0 0 0) 0x7fb4fc0474f0 con 0x7fb50c0b2cb0 2021-06-25T04:57:29.989 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T04:57:29.990 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":81,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6833/982651038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":982651038},{"type":"v1","addr":"172.21.15.57:6833","nonce":982651038}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/58225035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":58225035},{"type":"v1","addr":"172.21.15.57:6835","nonce":58225035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-06-25T04:57:17.702431+0000","modified":"2021-06-25T04:57:29.668225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":160,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-06-25T04:57:29.991 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 -- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb4ec0553f0 msgr2=0x7fb4ec0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb4ec0553f0 0x7fb4ec0578b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fb50800d000 tx=0x7fb508000bc0).stop 2021-06-25T04:57:29.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 -- 172.21.15.57:0/343207124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb50c0b2cb0 msgr2=0x7fb50c155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:29.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb50c0b2cb0 0x7fb50c155f10 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fb4fc0068e0 tx=0x7fb4fc008040).stop 2021-06-25T04:57:29.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 -- 172.21.15.57:0/343207124 shutdown_connections 2021-06-25T04:57:29.992 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb4ec0553f0 0x7fb4ec0578b0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb50c143f70 0x7fb50c0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb50c0b2cb0 0x7fb50c155f10 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 --2- 172.21.15.57:0/343207124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb50c064b00 0x7fb50c155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:29.993 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 -- 172.21.15.57:0/343207124 >> 172.21.15.57:0/343207124 conn(0x7fb50c062ba0 msgr2=0x7fb50c05bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:29.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 -- 172.21.15.57:0/343207124 shutdown_connections 2021-06-25T04:57:29.994 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:29.986+0000 7fb513485700 1 -- 172.21.15.57:0/343207124 wait complete. 2021-06-25T04:57:29.994 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 81 2021-06-25T04:57:30.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-06-25T04:57:30.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.098+0000 7fae68255700 1 Processor -- start 2021-06-25T04:57:30.105 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.098+0000 7fae68255700 1 -- start start 2021-06-25T04:57:30.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae68255700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 0x7fae60140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:30.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae68255700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae600abf40 con 0x7fae60143590 2021-06-25T04:57:30.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae68255700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae600ac170 con 0x7fae60060ff0 2021-06-25T04:57:30.108 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae68255700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae60143c40 con 0x7fae600afed0 2021-06-25T04:57:30.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae65ff1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fae60143590 0x7fae601403b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33912/0 (socket says 172.21.15.57:33912) 2021-06-25T04:57:30.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae65ff1700 1 -- 172.21.15.57:0/508878046 learned_addr learned my addr 172.21.15.57:0/508878046 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:30.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae667f2700 1 --2- 172.21.15.57:0/508878046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 0x7fae60140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:30.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae64fef700 1 -- 172.21.15.57:0/508878046 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428171603 0 0) 0x7fae600ac170 con 0x7fae60060ff0 2021-06-25T04:57:30.109 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae64fef700 1 -- 172.21.15.57:0/508878046 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae48003260 con 0x7fae60060ff0 2021-06-25T04:57:30.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae64fef700 1 -- 172.21.15.57:0/508878046 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790275918 0 0) 0x7fae600abf40 con 0x7fae60143590 2021-06-25T04:57:30.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae64fef700 1 -- 172.21.15.57:0/508878046 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae600ac170 con 0x7fae60143590 2021-06-25T04:57:30.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae667f2700 1 -- 172.21.15.57:0/508878046 >> v1:172.21.15.87:6789/0 conn(0x7fae60060ff0 legacy=0x7fae600b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:30.110 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae667f2700 1 -- 172.21.15.57:0/508878046 >> v1:172.21.15.57:6789/0 conn(0x7fae60143590 legacy=0x7fae601403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:30.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae667f2700 1 -- 172.21.15.57:0/508878046 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60143ee0 con 0x7fae600afed0 2021-06-25T04:57:30.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae667f2700 1 --2- 172.21.15.57:0/508878046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 0x7fae60140ac0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fae580032f0 tx=0x7fae580091d0).ready entity=mon.2 client_cookie=dcc5f71a9eafb1c1 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:30.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae64fef700 1 -- 172.21.15.57:0/508878046 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae5800b640 con 0x7fae600afed0 2021-06-25T04:57:30.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae64fef700 1 -- 172.21.15.57:0/508878046 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5800b7a0 con 0x7fae600afed0 2021-06-25T04:57:30.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae64fef700 1 -- 172.21.15.57:0/508878046 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae5800b910 con 0x7fae600afed0 2021-06-25T04:57:30.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae68255700 1 -- 172.21.15.57:0/508878046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 msgr2=0x7fae60140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:30.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae68255700 1 --2- 172.21.15.57:0/508878046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 0x7fae60140ac0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fae580032f0 tx=0x7fae580091d0).stop 2021-06-25T04:57:30.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae68255700 1 -- 172.21.15.57:0/508878046 shutdown_connections 2021-06-25T04:57:30.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae68255700 1 --2- 172.21.15.57:0/508878046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 0x7fae60140ac0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae68255700 1 -- 172.21.15.57:0/508878046 >> 172.21.15.57:0/508878046 conn(0x7fae600b5530 msgr2=0x7fae600b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:30.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae68255700 1 -- 172.21.15.57:0/508878046 shutdown_connections 2021-06-25T04:57:30.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.102+0000 7fae68255700 1 -- 172.21.15.57:0/508878046 wait complete. 2021-06-25T04:57:30.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae68255700 1 Processor -- start 2021-06-25T04:57:30.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae68255700 1 -- start start 2021-06-25T04:57:30.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae68255700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60060ff0 0x7fae601486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:30.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae68255700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 0x7fae60149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:30.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae68255700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae60143590 0x7fae60155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:30.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae68255700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae60147fb0 con 0x7fae60060ff0 2021-06-25T04:57:30.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae68255700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae60144df0 con 0x7fae60143590 2021-06-25T04:57:30.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae68255700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae60144b50 con 0x7fae600afed0 2021-06-25T04:57:30.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae65ff1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60060ff0 0x7fae601486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:30.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae657f0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 0x7fae60149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:30.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae657f0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 0x7fae60149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:56096/0 (socket says 172.21.15.57:56096) 2021-06-25T04:57:30.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae65ff1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60060ff0 0x7fae601486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44934/0 (socket says 172.21.15.57:44934) 2021-06-25T04:57:30.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae657f0700 1 -- 172.21.15.57:0/322559819 learned_addr learned my addr 172.21.15.57:0/322559819 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:30.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae667f2700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae60143590 0x7fae60155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:30.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae65ff1700 1 -- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 msgr2=0x7fae60149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:30.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae65ff1700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 0x7fae60149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae65ff1700 1 -- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae60143590 msgr2=0x7fae60155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:30.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae65ff1700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae60143590 0x7fae60155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae65ff1700 1 -- 172.21.15.57:0/322559819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae58009470 con 0x7fae60060ff0 2021-06-25T04:57:30.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae667f2700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae60143590 0x7fae60155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:30.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae65ff1700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60060ff0 0x7fae601486b0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7fae50001110 tx=0x7fae500079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:30.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae4effd700 1 -- 172.21.15.57:0/322559819 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae5000cd00 con 0x7fae60060ff0 2021-06-25T04:57:30.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae4effd700 1 -- 172.21.15.57:0/322559819 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5000ce60 con 0x7fae60060ff0 2021-06-25T04:57:30.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae4effd700 1 -- 172.21.15.57:0/322559819 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae500072c0 con 0x7fae60060ff0 2021-06-25T04:57:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae68255700 1 -- 172.21.15.57:0/322559819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae60148210 con 0x7fae60060ff0 2021-06-25T04:57:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.106+0000 7fae68255700 1 -- 172.21.15.57:0/322559819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae600b50c0 con 0x7fae60060ff0 2021-06-25T04:57:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.110+0000 7fae4effd700 1 -- 172.21.15.57:0/322559819 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fae50010070 con 0x7fae60060ff0 2021-06-25T04:57:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.110+0000 7fae68255700 1 -- 172.21.15.57:0/322559819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae601483a0 con 0x7fae60060ff0 2021-06-25T04:57:30.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.110+0000 7fae4effd700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fae40055450 0x7fae40057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:30.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.110+0000 7fae4effd700 1 -- 172.21.15.57:0/322559819 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fae5006d3e0 con 0x7fae60060ff0 2021-06-25T04:57:30.124 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.110+0000 7fae657f0700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fae40055450 0x7fae40057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:30.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.110+0000 7fae657f0700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fae40055450 0x7fae40057910 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fae5c00d000 tx=0x7fae5c000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:30.125 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.114+0000 7fae4effd700 1 -- 172.21.15.57:0/322559819 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fae500434a0 con 0x7fae60060ff0 2021-06-25T04:57:30.290 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.282+0000 7fae68255700 1 -- 172.21.15.57:0/322559819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fae60057310 con 0x7fae60060ff0 2021-06-25T04:57:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.694+0000 7fae4effd700 1 -- 172.21.15.57:0/322559819 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v82) v1 ==== 104+0+0 (secure 0 0 0) 0x7fae500180a0 con 0x7fae60060ff0 2021-06-25T04:57:30.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 -- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fae40055450 msgr2=0x7fae40057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:30.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fae40055450 0x7fae40057910 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fae5c00d000 tx=0x7fae5c000bc0).stop 2021-06-25T04:57:30.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 -- 172.21.15.57:0/322559819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60060ff0 msgr2=0x7fae601486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:30.706 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60060ff0 0x7fae601486b0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7fae50001110 tx=0x7fae500079e0).stop 2021-06-25T04:57:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 -- 172.21.15.57:0/322559819 shutdown_connections 2021-06-25T04:57:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fae40055450 0x7fae40057910 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae60143590 0x7fae60155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae600afed0 0x7fae60149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 --2- 172.21.15.57:0/322559819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60060ff0 0x7fae601486b0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 -- 172.21.15.57:0/322559819 >> 172.21.15.57:0/322559819 conn(0x7fae600b5530 msgr2=0x7fae60060750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:30.708 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 -- 172.21.15.57:0/322559819 shutdown_connections 2021-06-25T04:57:30.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.698+0000 7fae68255700 1 -- 172.21.15.57:0/322559819 wait complete. 2021-06-25T04:57:30.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-06-25T04:57:30.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd38778700 1 Processor -- start 2021-06-25T04:57:30.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd38778700 1 -- start start 2021-06-25T04:57:30.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd38778700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbd300b1240 0x7fbd300b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:30.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd38778700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd30140cb0 0x7fbd300b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:30.839 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd38778700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd301402d0 con 0x7fbd300a8c30 2021-06-25T04:57:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd38778700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd30140570 con 0x7fbd300b1240 2021-06-25T04:57:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd38778700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30140810 con 0x7fbd30140cb0 2021-06-25T04:57:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd36d15700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbd300a8c30 0x7fbd300ae670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33930/0 (socket says 172.21.15.57:33930) 2021-06-25T04:57:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd36d15700 1 -- 172.21.15.57:0/4242679338 learned_addr learned my addr 172.21.15.57:0/4242679338 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd35d13700 1 --2- 172.21.15.57:0/4242679338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd30140cb0 0x7fbd300b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd36514700 1 --2- 172.21.15.57:0/4242679338 >> v2:172.21.15.87:3300/0 conn(0x7fbd300b1240 0x7fbd300b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd35512700 1 -- 172.21.15.57:0/4242679338 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173499769 0 0) 0x7fbd301402d0 con 0x7fbd300a8c30 2021-06-25T04:57:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.830+0000 7fbd35512700 1 -- 172.21.15.57:0/4242679338 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd18003260 con 0x7fbd300a8c30 2021-06-25T04:57:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd35d13700 1 -- 172.21.15.57:0/4242679338 >> v2:172.21.15.87:3300/0 conn(0x7fbd300b1240 msgr2=0x7fbd300b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T04:57:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd35d13700 1 --2- 172.21.15.57:0/4242679338 >> v2:172.21.15.87:3300/0 conn(0x7fbd300b1240 0x7fbd300b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd35d13700 1 -- 172.21.15.57:0/4242679338 >> v1:172.21.15.57:6789/0 conn(0x7fbd300a8c30 legacy=0x7fbd300ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd35d13700 1 -- 172.21.15.57:0/4242679338 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3013ffc0 con 0x7fbd30140cb0 2021-06-25T04:57:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd35d13700 1 --2- 172.21.15.57:0/4242679338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd30140cb0 0x7fbd300b2120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fbd2c002f70 tx=0x7fbd2c006df0).ready entity=mon.2 client_cookie=49f7bcad272a637a server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd35512700 1 -- 172.21.15.57:0/4242679338 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd2c00d4a0 con 0x7fbd30140cb0 2021-06-25T04:57:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd35512700 1 -- 172.21.15.57:0/4242679338 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c000e90 con 0x7fbd30140cb0 2021-06-25T04:57:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd38778700 1 -- 172.21.15.57:0/4242679338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd30140cb0 msgr2=0x7fbd300b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd38778700 1 --2- 172.21.15.57:0/4242679338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd30140cb0 0x7fbd300b2120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fbd2c002f70 tx=0x7fbd2c006df0).stop 2021-06-25T04:57:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd35512700 1 -- 172.21.15.57:0/4242679338 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd2c00d7f0 con 0x7fbd30140cb0 2021-06-25T04:57:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd38778700 1 -- 172.21.15.57:0/4242679338 shutdown_connections 2021-06-25T04:57:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd38778700 1 --2- 172.21.15.57:0/4242679338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd30140cb0 0x7fbd300b2120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd38778700 1 --2- 172.21.15.57:0/4242679338 >> v2:172.21.15.87:3300/0 conn(0x7fbd300b1240 0x7fbd300b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd38778700 1 -- 172.21.15.57:0/4242679338 >> 172.21.15.57:0/4242679338 conn(0x7fbd3005f670 msgr2=0x7fbd3005fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd38778700 1 -- 172.21.15.57:0/4242679338 shutdown_connections 2021-06-25T04:57:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd38778700 1 -- 172.21.15.57:0/4242679338 wait complete. 2021-06-25T04:57:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd38778700 1 Processor -- start 2021-06-25T04:57:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.834+0000 7fbd38778700 1 -- start start 2021-06-25T04:57:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd38778700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd300a8c30 0x7fbd300abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd38778700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd300b1240 0x7fbd3013a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd38778700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd30140cb0 0x7fbd3013aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd38778700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3013bb90 con 0x7fbd30140cb0 2021-06-25T04:57:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd38778700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301433a0 con 0x7fbd300a8c30 2021-06-25T04:57:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd38778700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3013c7f0 con 0x7fbd300b1240 2021-06-25T04:57:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd36d15700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd30140cb0 0x7fbd3013aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd35d13700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd300b1240 0x7fbd3013a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd36d15700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd30140cb0 0x7fbd3013aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44950/0 (socket says 172.21.15.57:44950) 2021-06-25T04:57:30.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd36d15700 1 -- 172.21.15.57:0/4064938118 learned_addr learned my addr 172.21.15.57:0/4064938118 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:30.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd36514700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd300a8c30 0x7fbd300abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:30.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd36d15700 1 -- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd300b1240 msgr2=0x7fbd3013a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:30.851 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd36d15700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd300b1240 0x7fbd3013a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd36d15700 1 -- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd300a8c30 msgr2=0x7fbd300abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd36d15700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd300a8c30 0x7fbd300abbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd36d15700 1 -- 172.21.15.57:0/4064938118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c00b180 con 0x7fbd30140cb0 2021-06-25T04:57:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd36d15700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd30140cb0 0x7fbd3013aac0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7fbd28001490 tx=0x7fbd28007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:30.852 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd1f7fe700 1 -- 172.21.15.57:0/4064938118 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd28005ba0 con 0x7fbd30140cb0 2021-06-25T04:57:30.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd1f7fe700 1 -- 172.21.15.57:0/4064938118 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd28005d00 con 0x7fbd30140cb0 2021-06-25T04:57:30.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd1f7fe700 1 -- 172.21.15.57:0/4064938118 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd280072c0 con 0x7fbd30140cb0 2021-06-25T04:57:30.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd38778700 1 -- 172.21.15.57:0/4064938118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3013ca90 con 0x7fbd30140cb0 2021-06-25T04:57:30.853 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd38778700 1 -- 172.21.15.57:0/4064938118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd300ac4b0 con 0x7fbd30140cb0 2021-06-25T04:57:30.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.838+0000 7fbd1f7fe700 1 -- 172.21.15.57:0/4064938118 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fbd28010070 con 0x7fbd30140cb0 2021-06-25T04:57:30.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.842+0000 7fbd1f7fe700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbd100554e0 0x7fbd100579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:30.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.842+0000 7fbd1f7fe700 1 -- 172.21.15.57:0/4064938118 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fbd2806d9b0 con 0x7fbd30140cb0 2021-06-25T04:57:30.854 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.842+0000 7fbd36514700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbd100554e0 0x7fbd100579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:30.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.842+0000 7fbd38778700 1 -- 172.21.15.57:0/4064938118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd30057310 con 0x7fbd30140cb0 2021-06-25T04:57:30.855 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.842+0000 7fbd36514700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbd100554e0 0x7fbd100579a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fbd2000b000 tx=0x7fbd20006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:30.856 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.846+0000 7fbd1f7fe700 1 -- 172.21.15.57:0/4064938118 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fbd28043b10 con 0x7fbd30140cb0 2021-06-25T04:57:30.985 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:30.978+0000 7fbd38778700 1 -- 172.21.15.57:0/4064938118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbd3013cc20 con 0x7fbd30140cb0 2021-06-25T04:57:31.707 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.698+0000 7fbd1f7fe700 1 -- 172.21.15.57:0/4064938118 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v161) v1 ==== 185+0+0 (secure 0 0 0) 0x7fbd28047130 con 0x7fbd30140cb0 2021-06-25T04:57:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.702+0000 7fbd38778700 1 -- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbd100554e0 msgr2=0x7fbd100579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.702+0000 7fbd38778700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbd100554e0 0x7fbd100579a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fbd2000b000 tx=0x7fbd20006df0).stop 2021-06-25T04:57:31.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.702+0000 7fbd38778700 1 -- 172.21.15.57:0/4064938118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd30140cb0 msgr2=0x7fbd3013aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:31.710 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.702+0000 7fbd38778700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd30140cb0 0x7fbd3013aac0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7fbd28001490 tx=0x7fbd28007e00).stop 2021-06-25T04:57:31.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.702+0000 7fbd38778700 1 -- 172.21.15.57:0/4064938118 shutdown_connections 2021-06-25T04:57:31.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.702+0000 7fbd38778700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fbd100554e0 0x7fbd100579a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:31.711 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.702+0000 7fbd38778700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd30140cb0 0x7fbd3013aac0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:31.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.702+0000 7fbd38778700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd300b1240 0x7fbd3013a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:31.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.702+0000 7fbd38778700 1 --2- 172.21.15.57:0/4064938118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd300a8c30 0x7fbd300abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:31.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.702+0000 7fbd38778700 1 -- 172.21.15.57:0/4064938118 >> 172.21.15.57:0/4064938118 conn(0x7fbd3005f670 msgr2=0x7fbd300b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:31.712 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.706+0000 7fbd38778700 1 -- 172.21.15.57:0/4064938118 shutdown_connections 2021-06-25T04:57:31.713 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.706+0000 7fbd38778700 1 -- 172.21.15.57:0/4064938118 wait complete. 2021-06-25T04:57:31.713 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2021-06-25T04:57:31.724 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-06-25T04:57:31.828 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.822+0000 7fb08882a700 1 Processor -- start 2021-06-25T04:57:31.829 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.822+0000 7fb08882a700 1 -- start start 2021-06-25T04:57:31.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.822+0000 7fb08882a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0840670e0 0x7fb0840b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:31.830 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.822+0000 7fb08882a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840b9b90 con 0x7fb08413ffb0 2021-06-25T04:57:31.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.822+0000 7fb08882a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840674c0 con 0x7fb084143970 2021-06-25T04:57:31.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.822+0000 7fb08882a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb084143040 con 0x7fb0840670e0 2021-06-25T04:57:31.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb082d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb08413ffb0 0x7fb084140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33944/0 (socket says 172.21.15.57:33944) 2021-06-25T04:57:31.831 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb082d9d700 1 -- 172.21.15.57:0/763275502 learned_addr learned my addr 172.21.15.57:0/763275502 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T04:57:31.832 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08259c700 1 --2- 172.21.15.57:0/763275502 >> v2:172.21.15.87:3300/0 conn(0x7fb0840670e0 0x7fb0840b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:31.833 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08159a700 1 -- 172.21.15.57:0/763275502 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181693525 0 0) 0x7fb07c001490 con 0x7fb08413ffb0 2021-06-25T04:57:31.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08159a700 1 -- 172.21.15.57:0/763275502 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb064003260 con 0x7fb08413ffb0 2021-06-25T04:57:31.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08259c700 1 -- 172.21.15.57:0/763275502 >> v1:172.21.15.87:6789/0 conn(0x7fb084143970 legacy=0x7fb0840aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:31.834 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08259c700 1 -- 172.21.15.57:0/763275502 >> v1:172.21.15.57:6789/0 conn(0x7fb08413ffb0 legacy=0x7fb084140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:31.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08259c700 1 -- 172.21.15.57:0/763275502 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840af490 con 0x7fb0840670e0 2021-06-25T04:57:31.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08259c700 1 --2- 172.21.15.57:0/763275502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0840670e0 0x7fb0840b96a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fb06c002f70 tx=0x7fb06c006df0).ready entity=mon.1 client_cookie=edcecc8e9077d2c2 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:31.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08159a700 1 -- 172.21.15.57:0/763275502 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb06c00d610 con 0x7fb0840670e0 2021-06-25T04:57:31.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08159a700 1 -- 172.21.15.57:0/763275502 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c000e90 con 0x7fb0840670e0 2021-06-25T04:57:31.835 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08159a700 1 -- 172.21.15.57:0/763275502 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb06c00d960 con 0x7fb0840670e0 2021-06-25T04:57:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08882a700 1 -- 172.21.15.57:0/763275502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0840670e0 msgr2=0x7fb0840b96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08882a700 1 --2- 172.21.15.57:0/763275502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0840670e0 0x7fb0840b96a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fb06c002f70 tx=0x7fb06c006df0).stop 2021-06-25T04:57:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08882a700 1 -- 172.21.15.57:0/763275502 shutdown_connections 2021-06-25T04:57:31.836 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08882a700 1 --2- 172.21.15.57:0/763275502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0840670e0 0x7fb0840b96a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:31.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08882a700 1 -- 172.21.15.57:0/763275502 >> 172.21.15.57:0/763275502 conn(0x7fb08405f9b0 msgr2=0x7fb084061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:31.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08882a700 1 -- 172.21.15.57:0/763275502 shutdown_connections 2021-06-25T04:57:31.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08882a700 1 -- 172.21.15.57:0/763275502 wait complete. 2021-06-25T04:57:31.837 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08882a700 1 Processor -- start 2021-06-25T04:57:31.838 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.826+0000 7fb08882a700 1 -- start start 2021-06-25T04:57:31.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08882a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0840670e0 0x7fb084144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:31.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08882a700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb08413ffb0 0x7fb0840b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:31.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08882a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb084143970 0x7fb08413f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:31.841 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08882a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840b87b0 con 0x7fb0840670e0 2021-06-25T04:57:31.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08882a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841459c0 con 0x7fb084143970 2021-06-25T04:57:31.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08882a700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840b89e0 con 0x7fb08413ffb0 2021-06-25T04:57:31.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0840670e0 0x7fb084144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:31.842 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0840670e0 0x7fb084144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44960/0 (socket says 172.21.15.57:44960) 2021-06-25T04:57:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08259c700 1 -- 172.21.15.57:0/3987190818 learned_addr learned my addr 172.21.15.57:0/3987190818 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T04:57:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb081d9b700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb08413ffb0 0x7fb0840b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb082d9d700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb084143970 0x7fb08413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08259c700 1 -- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb08413ffb0 msgr2=0x7fb0840b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08259c700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb08413ffb0 0x7fb0840b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08259c700 1 -- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb084143970 msgr2=0x7fb08413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08259c700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb084143970 0x7fb08413f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08259c700 1 -- 172.21.15.57:0/3987190818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c00b180 con 0x7fb0840670e0 2021-06-25T04:57:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb082d9d700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb084143970 0x7fb08413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T04:57:31.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08259c700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0840670e0 0x7fb084144d30 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fb06c002f70 tx=0x7fb06c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:31.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb07b7fe700 1 -- 172.21.15.57:0/3987190818 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb06c012dd0 con 0x7fb0840670e0 2021-06-25T04:57:31.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb07b7fe700 1 -- 172.21.15.57:0/3987190818 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c00d290 con 0x7fb0840670e0 2021-06-25T04:57:31.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08882a700 1 -- 172.21.15.57:0/3987190818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0840b8f70 con 0x7fb0840670e0 2021-06-25T04:57:31.845 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb07b7fe700 1 -- 172.21.15.57:0/3987190818 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb06c01f670 con 0x7fb0840670e0 2021-06-25T04:57:31.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.830+0000 7fb08882a700 1 -- 172.21.15.57:0/3987190818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0840b8450 con 0x7fb0840670e0 2021-06-25T04:57:31.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.834+0000 7fb08882a700 1 -- 172.21.15.57:0/3987190818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0840b9410 con 0x7fb0840670e0 2021-06-25T04:57:31.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.834+0000 7fb07b7fe700 1 -- 172.21.15.57:0/3987190818 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb06c00f030 con 0x7fb0840670e0 2021-06-25T04:57:31.846 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.834+0000 7fb07b7fe700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb068055340 0x7fb068057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T04:57:31.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.834+0000 7fb07b7fe700 1 -- 172.21.15.57:0/3987190818 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fb06c06ef50 con 0x7fb0840670e0 2021-06-25T04:57:31.847 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.834+0000 7fb081d9b700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb068055340 0x7fb068057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T04:57:31.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.838+0000 7fb081d9b700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb068055340 0x7fb068057800 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fb07400d000 tx=0x7fb074007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T04:57:31.848 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.842+0000 7fb07b7fe700 1 -- 172.21.15.57:0/3987190818 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fb06c0450d0 con 0x7fb0840670e0 2021-06-25T04:57:31.978 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:31.974+0000 7fb08882a700 1 -- 172.21.15.57:0/3987190818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb084057310 con 0x7fb0840670e0 2021-06-25T04:57:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.714+0000 7fb07b7fe700 1 -- 172.21.15.57:0/3987190818 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v162) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb06c024070 con 0x7fb0840670e0 2021-06-25T04:57:32.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 -- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb068055340 msgr2=0x7fb068057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:32.728 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb068055340 0x7fb068057800 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fb07400d000 tx=0x7fb074007b90).stop 2021-06-25T04:57:32.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 -- 172.21.15.57:0/3987190818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0840670e0 msgr2=0x7fb084144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T04:57:32.729 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0840670e0 0x7fb084144d30 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7fb06c002f70 tx=0x7fb06c014000).stop 2021-06-25T04:57:32.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 -- 172.21.15.57:0/3987190818 shutdown_connections 2021-06-25T04:57:32.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb068055340 0x7fb068057800 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:32.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb084143970 0x7fb08413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:32.730 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb08413ffb0 0x7fb0840b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:32.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 --2- 172.21.15.57:0/3987190818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0840670e0 0x7fb084144d30 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T04:57:32.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 -- 172.21.15.57:0/3987190818 >> 172.21.15.57:0/3987190818 conn(0x7fb08405f9b0 msgr2=0x7fb084061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T04:57:32.731 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 -- 172.21.15.57:0/3987190818 shutdown_connections 2021-06-25T04:57:32.732 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T04:57:32.722+0000 7fb08882a700 1 -- 172.21.15.57:0/3987190818 wait complete. 2021-06-25T04:57:32.732 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2021-06-25T04:57:32.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-06-25T04:57:32.741 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-06-25T04:57:38.625 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:57:38.628 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:57:38.631 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:57:38.633 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:58:02.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T04:58:02.847 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T04:58:02.847 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T04:58:08.703 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:58:08.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:58:08.710 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:58:08.713 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:58:32.748 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-06-25T04:58:32.754 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-06-25T04:58:38.764 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:58:38.768 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:58:38.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:58:38.775 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:59:08.827 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:59:08.830 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:59:08.833 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:59:08.835 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:59:38.900 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:59:38.903 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:59:38.906 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T04:59:38.909 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:00:08.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:00:08.974 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:00:08.977 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:00:08.980 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:00:39.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:00:39.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:00:39.055 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:00:39.059 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:01:09.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:01:09.124 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:01:09.127 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:01:09.130 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:01:39.194 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:01:39.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:01:39.200 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:01:39.202 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:02:09.254 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:02:09.257 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:02:09.261 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:02:09.264 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:02:39.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:02:39.320 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:02:39.323 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:02:39.325 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:03:09.379 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:03:09.382 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:03:09.385 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:03:09.388 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:03:39.439 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:03:39.442 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:03:39.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:03:39.448 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:04:09.496 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:04:09.501 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:04:09.508 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:04:09.511 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:04:39.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:04:39.571 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:04:39.574 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:04:39.577 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:05:09.648 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:05:09.651 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:05:09.654 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:05:09.657 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:05:39.744 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:05:39.747 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:05:39.750 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:05:39.752 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:06:09.818 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:06:09.821 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:06:09.824 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:06:09.827 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:06:39.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:06:39.892 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:06:39.898 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:06:39.901 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:07:09.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:07:09.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:07:09.958 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:07:09.963 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:07:40.018 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:07:40.023 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:07:40.026 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:07:40.030 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:08:10.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:08:10.101 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:08:10.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:08:10.107 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:08:40.159 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:08:40.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:08:40.165 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:08:40.168 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:09:10.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:09:10.239 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:09:10.241 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:09:10.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:09:40.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:09:40.300 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:09:40.303 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:09:40.306 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:10:10.359 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:10:10.362 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:10:10.364 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:10:10.367 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:10:40.449 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:10:40.452 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:10:40.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:10:40.458 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:11:10.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:11:10.515 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:11:10.518 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:11:10.520 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:11:40.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:11:40.586 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:11:40.588 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:11:40.591 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:12:10.645 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:12:10.649 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:12:10.651 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:12:10.654 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:12:40.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:12:40.711 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:12:40.714 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:12:40.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:13:02.853 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-06-25T05:13:02.854 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-06-25T05:13:02.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T05:13:02.865 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-06-25T05:13:02.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T05:13:02.887 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T05:13:02.909 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T05:13:02.932 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-06-25T05:13:02.962 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-06-25T05:13:02.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T05:13:02.963 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T05:13:02.963 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T05:13:10.771 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:13:10.774 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:13:10.777 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:13:10.779 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:13:40.848 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:13:40.852 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:13:40.855 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:13:40.859 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:14:10.905 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:14:10.909 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:14:10.912 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:14:10.915 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:14:40.962 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:14:40.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:14:40.968 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:14:40.970 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:15:11.035 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:15:11.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:15:11.041 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:15:11.043 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:15:41.134 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:15:41.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:15:41.140 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:15:41.143 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:16:11.198 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:16:11.202 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:16:11.204 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:16:11.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:16:41.290 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:16:41.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:16:41.296 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:16:41.299 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:17:11.360 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:17:11.364 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:17:11.366 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:17:11.369 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:17:41.448 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:17:41.452 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:17:41.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:17:41.458 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:18:11.514 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:18:11.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:18:11.521 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:18:11.524 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:18:41.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:18:41.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:18:41.583 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:18:41.586 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:19:11.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:19:11.638 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:19:11.642 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:19:11.644 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:19:41.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:19:41.733 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:19:41.735 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:19:41.738 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:20:11.854 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:20:11.857 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:20:11.860 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:20:11.862 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:20:41.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:20:41.971 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:20:41.973 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:20:41.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:21:12.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:21:12.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:21:12.041 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:21:12.043 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:21:42.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:21:42.094 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:21:42.099 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:21:42.101 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:22:12.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:22:12.164 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:22:12.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:22:12.170 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:22:42.218 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:22:42.221 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:22:42.224 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:22:42.226 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:23:12.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:23:12.284 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:23:12.288 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:23:12.291 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:23:42.386 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:23:42.390 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:23:42.392 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:23:42.395 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:24:12.503 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:24:12.507 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:24:12.510 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:24:12.512 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:24:42.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:24:42.574 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:24:42.577 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:24:42.581 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:25:12.630 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:25:12.634 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:25:12.636 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:25:12.639 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:25:42.712 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:25:42.715 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:25:42.718 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:25:42.720 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:26:12.773 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:26:12.776 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:26:12.779 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:26:12.782 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:26:42.838 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:26:42.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:26:42.844 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:26:42.847 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:27:12.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:27:12.916 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:27:12.919 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:27:12.921 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:27:42.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:27:42.981 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:27:42.984 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:27:42.987 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:28:02.978 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-06-25T05:28:02.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T05:28:02.984 INFO:tasks.cephfs_test_runner:test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) ... ERROR 2021-06-25T05:28:02.985 INFO:tasks.cephfs_test_runner:ERROR 2021-06-25T05:28:02.986 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:02.986 INFO:tasks.cephfs_test_runner:====================================================================== 2021-06-25T05:28:02.987 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-06-25T05:28:02.987 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-06-25T05:28:02.987 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-06-25T05:28:02.988 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-06-25T05:28:02.988 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-06-25T05:28:02.988 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-06-25T05:28:02.989 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-06-25T05:28:02.989 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-06-25T05:28:02.989 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:02.990 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-06-25T05:28:02.990 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:02.990 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-06-25T05:28:02.991 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-06-25T05:28:02.991 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-06-25T05:28:02.991 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-06-25T05:28:02.992 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-06-25T05:28:02.992 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-06-25T05:28:02.993 INFO:tasks.cephfs_test_runner: proc.wait() 2021-06-25T05:28:02.993 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 148, in wait 2021-06-25T05:28:02.994 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-06-25T05:28:02.994 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-06-25T05:28:02.994 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-06-25T05:28:02.995 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-06-25T05:28:02.995 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-06-25T05:28:02.995 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-06-25T05:28:02.995 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-06-25T05:28:02.996 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-06-25T05:28:02.996 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-06-25T05:28:02.996 INFO:tasks.cephfs_test_runner: for line in f: 2021-06-25T05:28:02.997 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-06-25T05:28:02.997 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-06-25T05:28:02.997 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-06-25T05:28:02.997 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-06-25T05:28:02.998 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-06-25T05:28:02.998 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-06-25T05:28:02.998 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-06-25T05:28:02.999 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-06-25T05:28:02.999 INFO:tasks.cephfs_test_runner:socket.timeout 2021-06-25T05:28:02.999 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.000 INFO:tasks.cephfs_test_runner:====================================================================== 2021-06-25T05:28:03.000 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-06-25T05:28:03.000 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-06-25T05:28:03.001 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-06-25T05:28:03.001 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-06-25T05:28:03.001 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-06-25T05:28:03.002 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-06-25T05:28:03.002 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-06-25T05:28:03.003 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-06-25T05:28:03.003 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.003 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-06-25T05:28:03.004 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.004 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-06-25T05:28:03.004 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-06-25T05:28:03.004 INFO:tasks.cephfs_test_runner: m.teardown() 2021-06-25T05:28:03.005 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-06-25T05:28:03.005 INFO:tasks.cephfs_test_runner: self.umount() 2021-06-25T05:28:03.005 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-06-25T05:28:03.006 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-06-25T05:28:03.006 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-06-25T05:28:03.006 INFO:tasks.cephfs_test_runner: proc.wait() 2021-06-25T05:28:03.007 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 148, in wait 2021-06-25T05:28:03.007 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-06-25T05:28:03.007 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-06-25T05:28:03.008 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-06-25T05:28:03.008 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-06-25T05:28:03.008 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-06-25T05:28:03.009 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-06-25T05:28:03.009 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-06-25T05:28:03.009 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-06-25T05:28:03.010 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-06-25T05:28:03.010 INFO:tasks.cephfs_test_runner: for line in f: 2021-06-25T05:28:03.010 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-06-25T05:28:03.010 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-06-25T05:28:03.011 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-06-25T05:28:03.011 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-06-25T05:28:03.012 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-06-25T05:28:03.012 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-06-25T05:28:03.012 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-06-25T05:28:03.013 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-06-25T05:28:03.013 INFO:tasks.cephfs_test_runner:socket.timeout 2021-06-25T05:28:03.013 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.014 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-06-25T05:28:03.014 INFO:tasks.cephfs_test_runner:Ran 12 tests in 2398.011s 2021-06-25T05:28:03.014 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.015 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2021-06-25T05:28:03.015 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.015 INFO:tasks.cephfs_test_runner:====================================================================== 2021-06-25T05:28:03.016 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-06-25T05:28:03.016 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-06-25T05:28:03.016 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-06-25T05:28:03.017 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-06-25T05:28:03.017 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-06-25T05:28:03.017 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-06-25T05:28:03.017 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-06-25T05:28:03.018 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-06-25T05:28:03.018 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.018 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-06-25T05:28:03.019 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.019 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-06-25T05:28:03.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-06-25T05:28:03.020 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-06-25T05:28:03.020 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-06-25T05:28:03.020 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-06-25T05:28:03.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-06-25T05:28:03.021 INFO:tasks.cephfs_test_runner: proc.wait() 2021-06-25T05:28:03.022 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 148, in wait 2021-06-25T05:28:03.022 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-06-25T05:28:03.022 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-06-25T05:28:03.023 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-06-25T05:28:03.023 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-06-25T05:28:03.023 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-06-25T05:28:03.024 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-06-25T05:28:03.024 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-06-25T05:28:03.024 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-06-25T05:28:03.024 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-06-25T05:28:03.025 INFO:tasks.cephfs_test_runner: for line in f: 2021-06-25T05:28:03.025 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-06-25T05:28:03.025 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-06-25T05:28:03.026 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-06-25T05:28:03.026 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-06-25T05:28:03.026 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-06-25T05:28:03.027 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-06-25T05:28:03.027 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-06-25T05:28:03.027 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-06-25T05:28:03.027 INFO:tasks.cephfs_test_runner:socket.timeout 2021-06-25T05:28:03.028 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.028 INFO:tasks.cephfs_test_runner:====================================================================== 2021-06-25T05:28:03.028 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-06-25T05:28:03.029 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-06-25T05:28:03.029 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-06-25T05:28:03.029 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-06-25T05:28:03.029 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-06-25T05:28:03.030 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-06-25T05:28:03.030 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-06-25T05:28:03.031 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-06-25T05:28:03.031 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.031 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-06-25T05:28:03.031 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.032 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-06-25T05:28:03.032 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-06-25T05:28:03.032 INFO:tasks.cephfs_test_runner: m.teardown() 2021-06-25T05:28:03.033 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-06-25T05:28:03.033 INFO:tasks.cephfs_test_runner: self.umount() 2021-06-25T05:28:03.033 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-06-25T05:28:03.033 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-06-25T05:28:03.034 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-06-25T05:28:03.034 INFO:tasks.cephfs_test_runner: proc.wait() 2021-06-25T05:28:03.034 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 148, in wait 2021-06-25T05:28:03.035 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-06-25T05:28:03.035 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-06-25T05:28:03.035 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-06-25T05:28:03.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-06-25T05:28:03.036 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-06-25T05:28:03.036 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-06-25T05:28:03.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-06-25T05:28:03.037 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-06-25T05:28:03.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-06-25T05:28:03.037 INFO:tasks.cephfs_test_runner: for line in f: 2021-06-25T05:28:03.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-06-25T05:28:03.038 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-06-25T05:28:03.038 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-06-25T05:28:03.038 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-06-25T05:28:03.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-06-25T05:28:03.039 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-06-25T05:28:03.040 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-06-25T05:28:03.040 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-06-25T05:28:03.040 INFO:tasks.cephfs_test_runner:socket.timeout 2021-06-25T05:28:03.040 INFO:tasks.cephfs_test_runner: 2021-06-25T05:28:03.041 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-06-25T05:28:03.232 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-06-25T05:28:03.245 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d0e9c189dd36490e951317f37f00ea49 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-06-25T05:28:03.250 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2021-06-25T05:28:03.260 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2021-06-25T05:28:03.313 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2021-06-25T05:28:03.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-06-25T05:28:03.315 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-06-25T05:28:03.315 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-06-25T05:28:13.040 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:28:13.044 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:28:13.046 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:28:13.050 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:28:43.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:28:43.100 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:28:43.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:28:43.105 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:29:13.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:29:13.164 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:29:13.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:29:13.169 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:29:43.224 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:29:43.228 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:29:43.231 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:29:43.234 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:30:13.290 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:30:13.293 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:30:13.296 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:30:13.298 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:30:43.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:30:43.380 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:30:43.383 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:30:43.386 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:31:13.466 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:31:13.474 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:31:13.482 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:31:13.486 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:31:43.535 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:31:43.539 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:31:43.541 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:31:43.544 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:32:13.594 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:32:13.599 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:32:13.603 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:32:13.607 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:32:43.656 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:32:43.660 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:32:43.662 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:32:43.665 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:33:13.838 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:33:13.842 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:33:13.845 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:33:13.847 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:33:43.898 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:33:43.903 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:33:43.907 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:33:43.909 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:34:13.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:34:13.991 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:34:13.994 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:34:13.996 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:34:44.051 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:34:44.055 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:34:44.057 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:34:44.060 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:35:14.116 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:35:14.120 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:35:14.123 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:35:14.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:35:44.193 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:35:44.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:35:44.199 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:35:44.202 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:36:14.277 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:36:14.281 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:36:14.284 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:36:14.287 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:36:44.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:36:44.359 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:36:44.362 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:36:44.364 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:37:14.422 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:37:14.426 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:37:14.430 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:37:14.433 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:37:44.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:37:44.489 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:37:44.491 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:37:44.494 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:38:14.573 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:38:14.576 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:38:14.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:38:14.583 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:38:44.636 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:38:44.640 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:38:44.643 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:38:44.645 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:39:14.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:39:14.712 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:39:14.715 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:39:14.718 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:39:44.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:39:44.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:39:44.803 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:39:44.806 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:40:14.908 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:40:14.911 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:40:14.914 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:40:14.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:40:44.985 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:40:44.988 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:40:44.991 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:40:44.994 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:41:15.047 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:41:15.050 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:41:15.052 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:41:15.055 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:41:45.105 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:41:45.109 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:41:45.112 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:41:45.115 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:42:15.234 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:42:15.237 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:42:15.240 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:42:15.243 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:42:45.301 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:42:45.305 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:42:45.308 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:42:45.310 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:03.330 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-06-25T05:43:03.341 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-06-25T05:43:03.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T05:43:03.344 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-06-25T05:43:03.363 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-06-25T05:43:03.375 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-06-25T05:43:03.376 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T05:43:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.506+0000 7f755da63700 1 Processor -- start 2021-06-25T05:43:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.506+0000 7f755da63700 1 -- start start 2021-06-25T05:43:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f75580b96a0 0x7f75580aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f755813ffb0 0x7f7558140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75580674c0 con 0x7f75580670e0 2021-06-25T05:43:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7558143040 con 0x7f755813ffb0 2021-06-25T05:43:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75580af490 con 0x7f75580b96a0 2021-06-25T05:43:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f75577fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f75580670e0 0x7f7558143970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33996/0 (socket says 172.21.15.57:33996) 2021-06-25T05:43:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f75577fe700 1 -- 172.21.15.57:0/1559065155 learned_addr learned my addr 172.21.15.57:0/1559065155 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f7557fff700 1 --2- 172.21.15.57:0/1559065155 >> v2:172.21.15.57:3300/0 conn(0x7f755813ffb0 0x7f7558140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f7556ffd700 1 --2- 172.21.15.57:0/1559065155 >> v2:172.21.15.87:3300/0 conn(0x7f75580b96a0 0x7f75580aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f75567fc700 1 -- 172.21.15.57:0/1559065155 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318293627 0 0) 0x7f75580674c0 con 0x7f75580670e0 2021-06-25T05:43:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f75567fc700 1 -- 172.21.15.57:0/1559065155 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7538003260 con 0x7f75580670e0 2021-06-25T05:43:03.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f7557fff700 1 -- 172.21.15.57:0/1559065155 >> v2:172.21.15.87:3300/0 conn(0x7f75580b96a0 msgr2=0x7f75580aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:03.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f7557fff700 1 --2- 172.21.15.57:0/1559065155 >> v2:172.21.15.87:3300/0 conn(0x7f75580b96a0 0x7f75580aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.515 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f7557fff700 1 -- 172.21.15.57:0/1559065155 >> v1:172.21.15.57:6789/0 conn(0x7f75580670e0 legacy=0x7f7558143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:03.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f7557fff700 1 -- 172.21.15.57:0/1559065155 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7558143230 con 0x7f755813ffb0 2021-06-25T05:43:03.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f7557fff700 1 --2- 172.21.15.57:0/1559065155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f755813ffb0 0x7f7558140440 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f75500032f0 tx=0x7f75500091d0).ready entity=mon.0 client_cookie=ea0533944ee8a21 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:03.516 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f75567fc700 1 -- 172.21.15.57:0/1559065155 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755000b600 con 0x7f755813ffb0 2021-06-25T05:43:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f75567fc700 1 -- 172.21.15.57:0/1559065155 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755000b760 con 0x7f755813ffb0 2021-06-25T05:43:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f75567fc700 1 -- 172.21.15.57:0/1559065155 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755000b8d0 con 0x7f755813ffb0 2021-06-25T05:43:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 -- 172.21.15.57:0/1559065155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f755813ffb0 msgr2=0x7f7558140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:03.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 --2- 172.21.15.57:0/1559065155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f755813ffb0 0x7f7558140440 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f75500032f0 tx=0x7f75500091d0).stop 2021-06-25T05:43:03.518 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 -- 172.21.15.57:0/1559065155 shutdown_connections 2021-06-25T05:43:03.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 --2- 172.21.15.57:0/1559065155 >> v2:172.21.15.87:3300/0 conn(0x7f75580b96a0 0x7f75580aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 --2- 172.21.15.57:0/1559065155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f755813ffb0 0x7f7558140440 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 -- 172.21.15.57:0/1559065155 >> 172.21.15.57:0/1559065155 conn(0x7f755805f9b0 msgr2=0x7f7558061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:03.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 -- 172.21.15.57:0/1559065155 shutdown_connections 2021-06-25T05:43:03.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.510+0000 7f755da63700 1 -- 172.21.15.57:0/1559065155 wait complete. 2021-06-25T05:43:03.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f755da63700 1 Processor -- start 2021-06-25T05:43:03.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f755da63700 1 -- start start 2021-06-25T05:43:03.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f755da63700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75580670e0 0x7f75580b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f755da63700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580b96a0 0x7f75580b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f755da63700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f755813ffb0 0x7f75580b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f755da63700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75580b0550 con 0x7f75580b96a0 2021-06-25T05:43:03.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f755da63700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755814a5b0 con 0x7f755813ffb0 2021-06-25T05:43:03.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f755da63700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75580b3880 con 0x7f75580670e0 2021-06-25T05:43:03.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f7556ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580b96a0 0x7f75580b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f7556ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580b96a0 0x7f75580b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45018/0 (socket says 172.21.15.57:45018) 2021-06-25T05:43:03.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f7556ffd700 1 -- 172.21.15.57:0/530971842 learned_addr learned my addr 172.21.15.57:0/530971842 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:03.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f7557fff700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f755813ffb0 0x7f75580b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f75577fe700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75580670e0 0x7f75580b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f7556ffd700 1 -- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75580670e0 msgr2=0x7f75580b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:03.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f7556ffd700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75580670e0 0x7f75580b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f7556ffd700 1 -- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f755813ffb0 msgr2=0x7f75580b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:03.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.514+0000 7f7556ffd700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f755813ffb0 0x7f75580b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.518+0000 7f7556ffd700 1 -- 172.21.15.57:0/530971842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7550009470 con 0x7f75580b96a0 2021-06-25T05:43:03.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.518+0000 7f7556ffd700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580b96a0 0x7f75580b2ea0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f754000c000 tx=0x7f7540006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:03.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.518+0000 7f7554ff9700 1 -- 172.21.15.57:0/530971842 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7540010780 con 0x7f75580b96a0 2021-06-25T05:43:03.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.518+0000 7f7554ff9700 1 -- 172.21.15.57:0/530971842 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75400108e0 con 0x7f75580b96a0 2021-06-25T05:43:03.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.518+0000 7f755da63700 1 -- 172.21.15.57:0/530971842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755814a310 con 0x7f75580b96a0 2021-06-25T05:43:03.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.518+0000 7f7554ff9700 1 -- 172.21.15.57:0/530971842 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7540010c40 con 0x7f75580b96a0 2021-06-25T05:43:03.533 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.518+0000 7f755da63700 1 -- 172.21.15.57:0/530971842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7558149fc0 con 0x7f75580b96a0 2021-06-25T05:43:03.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.518+0000 7f755da63700 1 -- 172.21.15.57:0/530971842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7558057310 con 0x7f75580b96a0 2021-06-25T05:43:03.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.518+0000 7f7554ff9700 1 -- 172.21.15.57:0/530971842 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f754001c460 con 0x7f75580b96a0 2021-06-25T05:43:03.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.522+0000 7f7554ff9700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f753c0554e0 0x7f753c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.534 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.522+0000 7f7554ff9700 1 -- 172.21.15.57:0/530971842 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f754006df60 con 0x7f75580b96a0 2021-06-25T05:43:03.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.522+0000 7f75577fe700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f753c0554e0 0x7f753c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.535 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.522+0000 7f75577fe700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f753c0554e0 0x7f753c0579a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f754800d000 tx=0x7f7548009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:03.536 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.526+0000 7f7554ff9700 1 -- 172.21.15.57:0/530971842 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7540044390 con 0x7f75580b96a0 2021-06-25T05:43:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.662+0000 7f755da63700 1 -- 172.21.15.57:0/530971842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75580698a0 con 0x7f75580b96a0 2021-06-25T05:43:03.663 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.662+0000 7f7554ff9700 1 -- 172.21.15.57:0/530971842 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+13553 (secure 0 0 0) 0x7f75400479b0 con 0x7f75580b96a0 2021-06-25T05:43:03.663 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T05:43:03.664 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":162,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:57:32.700920+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.87:6835/3809657492":"2021-06-26T04:57:29.301196+0000","172.21.15.87:6834/3809657492":"2021-06-26T04:57:29.301196+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T05:43:03.665 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 -- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f753c0554e0 msgr2=0x7f753c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:03.666 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f753c0554e0 0x7f753c0579a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f754800d000 tx=0x7f7548009040).stop 2021-06-25T05:43:03.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 -- 172.21.15.57:0/530971842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580b96a0 msgr2=0x7f75580b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:03.667 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580b96a0 0x7f75580b2ea0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f754000c000 tx=0x7f7540006df0).stop 2021-06-25T05:43:03.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 -- 172.21.15.57:0/530971842 shutdown_connections 2021-06-25T05:43:03.668 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f753c0554e0 0x7f753c0579a0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.669 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f755813ffb0 0x7f75580b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580b96a0 0x7f75580b2ea0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 --2- 172.21.15.57:0/530971842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75580670e0 0x7f75580b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.671 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 -- 172.21.15.57:0/530971842 >> 172.21.15.57:0/530971842 conn(0x7f755805f9b0 msgr2=0x7f75580b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:03.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 -- 172.21.15.57:0/530971842 shutdown_connections 2021-06-25T05:43:03.672 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.666+0000 7f755da63700 1 -- 172.21.15.57:0/530971842 wait complete. 2021-06-25T05:43:03.681 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-06-25T05:43:03.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.782+0000 7fccedba0700 1 Processor -- start 2021-06-25T05:43:03.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.782+0000 7fccedba0700 1 -- start start 2021-06-25T05:43:03.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcce80a7670 0x7fcce8066a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcce80b1930 0x7fcce8066f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcce80b0020 0x7fcce805f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce8067410 con 0x7fcce80b1930 2021-06-25T05:43:03.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce80a7a50 con 0x7fcce80b0020 2021-06-25T05:43:03.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce81475e0 con 0x7fcce80a7670 2021-06-25T05:43:03.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcce80b1930 0x7fcce8066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcce80b1930 0x7fcce8066f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45024/0 (socket says 172.21.15.57:45024) 2021-06-25T05:43:03.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce6ffd700 1 -- 172.21.15.57:0/628301867 learned_addr learned my addr 172.21.15.57:0/628301867 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:03.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce6ffd700 1 -- 172.21.15.57:0/628301867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcce80a7670 msgr2=0x7fcce8066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce77fe700 1 --2- 172.21.15.57:0/628301867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcce80a7670 0x7fcce8066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce7fff700 1 --2- 172.21.15.57:0/628301867 >> v2:172.21.15.87:3300/0 conn(0x7fcce80b0020 0x7fcce805f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce6ffd700 1 --2- 172.21.15.57:0/628301867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcce80a7670 0x7fcce8066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce6ffd700 1 -- 172.21.15.57:0/628301867 >> v2:172.21.15.87:3300/0 conn(0x7fcce80b0020 msgr2=0x7fcce805f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:03.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce6ffd700 1 --2- 172.21.15.57:0/628301867 >> v2:172.21.15.87:3300/0 conn(0x7fcce80b0020 0x7fcce805f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce6ffd700 1 -- 172.21.15.57:0/628301867 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce8147880 con 0x7fcce80b1930 2021-06-25T05:43:03.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce77fe700 1 --2- 172.21.15.57:0/628301867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcce80a7670 0x7fcce8066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T05:43:03.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce7fff700 1 --2- 172.21.15.57:0/628301867 >> v2:172.21.15.87:3300/0 conn(0x7fcce80b0020 0x7fcce805f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-06-25T05:43:03.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce6ffd700 1 --2- 172.21.15.57:0/628301867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcce80b1930 0x7fcce8066f20 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fccd80032f0 tx=0x7fccd8009290).ready entity=mon.0 client_cookie=ef0dd4792dbde25 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:03.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce67fc700 1 -- 172.21.15.57:0/628301867 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd800b870 con 0x7fcce80b1930 2021-06-25T05:43:03.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce67fc700 1 -- 172.21.15.57:0/628301867 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd800b9d0 con 0x7fcce80b1930 2021-06-25T05:43:03.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 -- 172.21.15.57:0/628301867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcce80b1930 msgr2=0x7fcce8066f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:03.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 --2- 172.21.15.57:0/628301867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcce80b1930 0x7fcce8066f20 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fccd80032f0 tx=0x7fccd8009290).stop 2021-06-25T05:43:03.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fcce67fc700 1 -- 172.21.15.57:0/628301867 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd800bb40 con 0x7fcce80b1930 2021-06-25T05:43:03.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 -- 172.21.15.57:0/628301867 shutdown_connections 2021-06-25T05:43:03.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 --2- 172.21.15.57:0/628301867 >> v2:172.21.15.87:3300/0 conn(0x7fcce80b0020 0x7fcce805f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 --2- 172.21.15.57:0/628301867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcce80b1930 0x7fcce8066f20 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 --2- 172.21.15.57:0/628301867 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcce80a7670 0x7fcce8066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 -- 172.21.15.57:0/628301867 >> 172.21.15.57:0/628301867 conn(0x7fcce80b53a0 msgr2=0x7fcce80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:03.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 -- 172.21.15.57:0/628301867 shutdown_connections 2021-06-25T05:43:03.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 -- 172.21.15.57:0/628301867 wait complete. 2021-06-25T05:43:03.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.786+0000 7fccedba0700 1 Processor -- start 2021-06-25T05:43:03.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fccedba0700 1 -- start start 2021-06-25T05:43:03.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fccedba0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcce80a7670 0x7fcce8159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fccedba0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80b0020 0x7fcce815a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fccedba0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcce80b1930 0x7fcce8140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fccedba0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce81416f0 con 0x7fcce80b1930 2021-06-25T05:43:03.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fccedba0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80b3b30 con 0x7fcce80b0020 2021-06-25T05:43:03.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fccedba0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8141450 con 0x7fcce80a7670 2021-06-25T05:43:03.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcce80b1930 0x7fcce8140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce77fe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcce80a7670 0x7fcce8159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcce80b1930 0x7fcce8140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45034/0 (socket says 172.21.15.57:45034) 2021-06-25T05:43:03.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce7fff700 1 -- 172.21.15.57:0/250491052 learned_addr learned my addr 172.21.15.57:0/250491052 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:03.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce6ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80b0020 0x7fcce815a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce7fff700 1 -- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcce80a7670 msgr2=0x7fcce8159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:03.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce7fff700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcce80a7670 0x7fcce8159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce7fff700 1 -- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80b0020 msgr2=0x7fcce815a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:03.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce7fff700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80b0020 0x7fcce815a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce7fff700 1 -- 172.21.15.57:0/250491052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd8009530 con 0x7fcce80b1930 2021-06-25T05:43:03.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce7fff700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcce80b1930 0x7fcce8140930 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fcce0007000 tx=0x7fcce0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:03.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce4ff9700 1 -- 172.21.15.57:0/250491052 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce000f4e0 con 0x7fcce80b1930 2021-06-25T05:43:03.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce4ff9700 1 -- 172.21.15.57:0/250491052 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce000f640 con 0x7fcce80b1930 2021-06-25T05:43:03.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fccedba0700 1 -- 172.21.15.57:0/250491052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce80b3d90 con 0x7fcce80b1930 2021-06-25T05:43:03.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fcce4ff9700 1 -- 172.21.15.57:0/250491052 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce000f9a0 con 0x7fcce80b1930 2021-06-25T05:43:03.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fccedba0700 1 -- 172.21.15.57:0/250491052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce8140e20 con 0x7fcce80b1930 2021-06-25T05:43:03.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.790+0000 7fccedba0700 1 -- 172.21.15.57:0/250491052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce815a250 con 0x7fcce80b1930 2021-06-25T05:43:03.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.794+0000 7fcce4ff9700 1 -- 172.21.15.57:0/250491052 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fcce0019030 con 0x7fcce80b1930 2021-06-25T05:43:03.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.794+0000 7fcce4ff9700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fccc8055450 0x7fccc8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:03.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.794+0000 7fcce4ff9700 1 -- 172.21.15.57:0/250491052 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fcce006d730 con 0x7fcce80b1930 2021-06-25T05:43:03.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.794+0000 7fcce77fe700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fccc8055450 0x7fccc8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:03.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.794+0000 7fcce77fe700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fccc8055450 0x7fccc8057910 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fccdc00d000 tx=0x7fccdc008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:03.814 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.802+0000 7fcce4ff9700 1 -- 172.21.15.57:0/250491052 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fcce0043ab0 con 0x7fcce80b1930 2021-06-25T05:43:03.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.930+0000 7fccedba0700 1 -- 172.21.15.57:0/250491052 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcce80b3990 con 0x7fccc8055450 2021-06-25T05:43:03.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fcce4ff9700 1 -- 172.21.15.57:0/250491052 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68622 (secure 0 0 0) 0x7fcce80b3990 con 0x7fccc8055450 2021-06-25T05:43:03.936 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T05:43:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 -- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fccc8055450 msgr2=0x7fccc8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:03.938 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fccc8055450 0x7fccc8057910 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fccdc00d000 tx=0x7fccdc008040).stop 2021-06-25T05:43:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 -- 172.21.15.57:0/250491052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcce80b1930 msgr2=0x7fcce8140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcce80b1930 0x7fcce8140930 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fcce0007000 tx=0x7fcce0008040).stop 2021-06-25T05:43:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 -- 172.21.15.57:0/250491052 shutdown_connections 2021-06-25T05:43:03.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fccc8055450 0x7fccc8057910 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcce80b1930 0x7fcce8140930 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80b0020 0x7fcce815a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 --2- 172.21.15.57:0/250491052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcce80a7670 0x7fcce8159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 -- 172.21.15.57:0/250491052 >> 172.21.15.57:0/250491052 conn(0x7fcce80b53a0 msgr2=0x7fcce805fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 -- 172.21.15.57:0/250491052 shutdown_connections 2021-06-25T05:43:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:03.938+0000 7fccedba0700 1 -- 172.21.15.57:0/250491052 wait complete. 2021-06-25T05:43:03.942 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2021-06-25T05:43:03.953 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":1822,"stamp":"2021-06-25T05:43:03.392761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8404800,"kb_used_data":16128,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569920,"statfs":{"total":773094113280,"available":764487598080,"internally_reserved":8589934592,"allocated":16515072,"data_stored":8087560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003233"},"pg_stats":[{"pgid":"1.0","version":"14'2","reported_seq":"142","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.711169+0000","last_change":"2021-06-25T04:47:29.030351+0000","last_active":"2021-06-25T04:57:31.711169+0000","last_peered":"2021-06-25T04:57:31.711169+0000","last_clean":"2021-06-25T04:57:31.711169+0000","last_became_active":"2021-06-25T04:47:29.028725+0000","last_became_peered":"2021-06-25T04:47:29.028725+0000","last_unstale":"2021-06-25T04:57:31.711169+0000","last_undegraded":"2021-06-25T04:57:31.711169+0000","last_fullsized":"2021-06-25T04:57:31.711169+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:25.443883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:25.443883+0000","last_clean_scrub_stamp":"2021-06-25T04:47:25.443883+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"138","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.711523+0000","last_change":"2021-06-25T04:47:33.562610+0000","last_active":"2021-06-25T04:57:31.711523+0000","last_peered":"2021-06-25T04:57:31.711523+0000","last_clean":"2021-06-25T04:57:31.711523+0000","last_became_active":"2021-06-25T04:47:33.562250+0000","last_became_peered":"2021-06-25T04:47:33.562250+0000","last_unstale":"2021-06-25T04:57:31.711523+0000","last_undegraded":"2021-06-25T04:57:31.711523+0000","last_fullsized":"2021-06-25T04:57:31.711523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"137","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.711175+0000","last_change":"2021-06-25T04:47:33.560332+0000","last_active":"2021-06-25T04:57:31.711175+0000","last_peered":"2021-06-25T04:57:31.711175+0000","last_clean":"2021-06-25T04:57:31.711175+0000","last_became_active":"2021-06-25T04:47:33.559708+0000","last_became_peered":"2021-06-25T04:47:33.559708+0000","last_unstale":"2021-06-25T04:57:31.711175+0000","last_undegraded":"2021-06-25T04:57:31.711175+0000","last_fullsized":"2021-06-25T04:57:31.711175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"145","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.712126+0000","last_change":"2021-06-25T04:47:33.608982+0000","last_active":"2021-06-25T04:57:31.712126+0000","last_peered":"2021-06-25T04:57:31.712126+0000","last_clean":"2021-06-25T04:57:31.712126+0000","last_became_active":"2021-06-25T04:47:33.608340+0000","last_became_peered":"2021-06-25T04:47:33.608340+0000","last_unstale":"2021-06-25T04:57:31.712126+0000","last_undegraded":"2021-06-25T04:57:31.712126+0000","last_fullsized":"2021-06-25T04:57:31.712126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"138","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.711332+0000","last_change":"2021-06-25T04:47:33.562562+0000","last_active":"2021-06-25T04:57:31.711332+0000","last_peered":"2021-06-25T04:57:31.711332+0000","last_clean":"2021-06-25T04:57:31.711332+0000","last_became_active":"2021-06-25T04:47:33.561980+0000","last_became_peered":"2021-06-25T04:47:33.561980+0000","last_unstale":"2021-06-25T04:57:31.711332+0000","last_undegraded":"2021-06-25T04:57:31.711332+0000","last_fullsized":"2021-06-25T04:57:31.711332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"143","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.705132+0000","last_change":"2021-06-25T04:47:33.607795+0000","last_active":"2021-06-25T04:57:31.705132+0000","last_peered":"2021-06-25T04:57:31.705132+0000","last_clean":"2021-06-25T04:57:31.705132+0000","last_became_active":"2021-06-25T04:47:33.607259+0000","last_became_peered":"2021-06-25T04:47:33.607259+0000","last_unstale":"2021-06-25T04:57:31.705132+0000","last_undegraded":"2021-06-25T04:57:31.705132+0000","last_fullsized":"2021-06-25T04:57:31.705132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"137","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.711359+0000","last_change":"2021-06-25T04:47:33.614414+0000","last_active":"2021-06-25T04:57:31.711359+0000","last_peered":"2021-06-25T04:57:31.711359+0000","last_clean":"2021-06-25T04:57:31.711359+0000","last_became_active":"2021-06-25T04:47:33.613559+0000","last_became_peered":"2021-06-25T04:47:33.613559+0000","last_unstale":"2021-06-25T04:57:31.711359+0000","last_undegraded":"2021-06-25T04:57:31.711359+0000","last_fullsized":"2021-06-25T04:57:31.711359+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"143","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.705417+0000","last_change":"2021-06-25T04:47:33.555017+0000","last_active":"2021-06-25T04:57:31.705417+0000","last_peered":"2021-06-25T04:57:31.705417+0000","last_clean":"2021-06-25T04:57:31.705417+0000","last_became_active":"2021-06-25T04:47:33.554237+0000","last_became_peered":"2021-06-25T04:47:33.554237+0000","last_unstale":"2021-06-25T04:57:31.705417+0000","last_undegraded":"2021-06-25T04:57:31.705417+0000","last_fullsized":"2021-06-25T04:57:31.705417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"152","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.706328+0000","last_change":"2021-06-25T04:47:33.560136+0000","last_active":"2021-06-25T04:57:31.706328+0000","last_peered":"2021-06-25T04:57:31.706328+0000","last_clean":"2021-06-25T04:57:31.706328+0000","last_became_active":"2021-06-25T04:47:33.559590+0000","last_became_peered":"2021-06-25T04:47:33.559590+0000","last_unstale":"2021-06-25T04:57:31.706328+0000","last_undegraded":"2021-06-25T04:57:31.706328+0000","last_fullsized":"2021-06-25T04:57:31.706328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575517,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.54800000000000004},"max":{"1min":0.93700000000000006,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80800000000000005,"15min":0.78600000000000003},"min":{"1min":0.60699999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.012,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.78700000000000003}]},{"osd":1,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78900000000000003,"15min":0.79000000000000004},"min":{"1min":0.57399999999999995,"5min":0.57199999999999995,"15min":0.52100000000000002},"max":{"1min":0.99199999999999999,"5min":1.081,"15min":1.0820000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.82099999999999995},"min":{"1min":0.626,"5min":0.60799999999999998,"15min":0.58699999999999997},"max":{"1min":1.137,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.91200000000000003}]},{"osd":2,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.57599999999999996},"max":{"1min":0.96199999999999997,"5min":1.1080000000000001,"15min":1.147},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83399999999999996,"15min":0.83199999999999996},"min":{"1min":0.63200000000000001,"5min":0.59799999999999998,"15min":0.57399999999999995},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92800000000000005}]},{"osd":3,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86099999999999999,"15min":0.872},"min":{"1min":0.66700000000000004,"5min":0.60799999999999998,"15min":0.59999999999999998},"max":{"1min":1.024,"5min":1.1950000000000001,"15min":1.264},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91700000000000004,"15min":0.90800000000000003},"min":{"1min":0.82299999999999995,"5min":0.58999999999999997,"15min":0.57199999999999995},"max":{"1min":1.0920000000000001,"5min":1.115,"15min":1.137},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52500000000000002,"5min":0.499,"15min":0.435},"max":{"1min":1.0680000000000001,"5min":1.159,"15min":1.159},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0700000000000001,"5min":1.216,"15min":1.216},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.56999999999999995,"5min":0.51500000000000001,"15min":0.48799999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2889999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85999999999999999,"15min":0.85499999999999998},"min":{"1min":0.623,"5min":0.57199999999999995,"15min":0.54600000000000004},"max":{"1min":1.0569999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.97399999999999998}]},{"osd":6,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.95799999999999996,"15min":0.93300000000000005},"min":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.54400000000000004},"max":{"1min":1.1919999999999999,"5min":1.417,"15min":1.417},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.93700000000000006,"15min":0.92500000000000004},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.56100000000000005},"max":{"1min":1.1759999999999999,"5min":1.3859999999999999,"15min":1.399},"last":1.018}]}]},{"osd":6,"up_from":13,"seq":55834575517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.46899999999999997},"max":{"1min":0.98399999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80900000000000005,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.46899999999999997},"max":{"1min":1.0269999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.82399999999999995}]},{"osd":1,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80300000000000005,"15min":0.79500000000000004},"min":{"1min":0.58499999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.093},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80800000000000005,"15min":0.81699999999999995},"min":{"1min":0.65400000000000003,"5min":0.501,"15min":0.438},"max":{"1min":1.107,"5min":1.163,"15min":1.163},"last":0.98499999999999999}]},{"osd":2,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82699999999999996,"15min":0.81299999999999994},"min":{"1min":0.63,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.05,"5min":1.0549999999999999,"15min":1.1639999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.84299999999999997,"15min":0.82999999999999996},"min":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.59299999999999997},"max":{"1min":1.026,"5min":1.079,"15min":1.1000000000000001},"last":1.002}]},{"osd":3,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.68600000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.98499999999999999,"5min":1.0740000000000001,"15min":1.1559999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.875,"5min":0.89200000000000002,"15min":0.89300000000000002},"min":{"1min":0.67200000000000004,"5min":0.64500000000000002,"15min":0.58699999999999997},"max":{"1min":1.0369999999999999,"5min":1.125,"15min":1.1970000000000001},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0509999999999999,"5min":1.109,"15min":1.165},"last":0.624},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84499999999999997,"15min":0.85899999999999999},"min":{"1min":0.60499999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0669999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80000000000000004,"15min":0.83699999999999997},"min":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1140000000000001,"5min":1.157,"15min":1.1910000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.93000000000000005},"min":{"1min":0.66700000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.2450000000000001},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.92500000000000004,"15min":0.93700000000000006},"min":{"1min":0.65700000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.181,"5min":1.224,"15min":1.331},"last":0.88},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.92000000000000004,"15min":0.94099999999999995},"min":{"1min":0.76500000000000001,"5min":0.60999999999999999,"15min":0.56499999999999995},"max":{"1min":1.1930000000000001,"5min":1.3,"15min":1.3},"last":0.90000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:00 2021","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76400000000000001,"15min":0.77600000000000002},"min":{"1min":0.55100000000000005,"5min":0.51100000000000001,"15min":0.435},"max":{"1min":0.95799999999999996,"5min":0.996,"15min":1.1950000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84299999999999997,"15min":0.80700000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.47399999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1339999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Jun 25 05:42:00 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91700000000000004,"15min":0.90700000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.024,"5min":1.123,"15min":1.7609999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.90000000000000002,"15min":0.89300000000000002},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.58899999999999997},"max":{"1min":1.0640000000000001,"5min":1.1419999999999999,"15min":1.6930000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Jun 25 05:42:00 2021","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.628,"5min":0.58599999999999997,"15min":0.58199999999999996},"max":{"1min":1.075,"5min":1.149,"15min":1.149},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81299999999999994,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56399999999999995},"max":{"1min":1.03,"5min":1.105,"15min":1.196},"last":0.92400000000000004}]},{"osd":3,"last update":"Fri Jun 25 05:42:00 2021","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.875,"15min":0.85199999999999998},"min":{"1min":0.65200000000000002,"5min":0.64300000000000002,"15min":0.56100000000000005},"max":{"1min":1.069,"5min":1.147,"15min":1.22},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85499999999999998,"15min":0.85999999999999999},"min":{"1min":0.69699999999999995,"5min":0.60299999999999998,"15min":0.59399999999999997},"max":{"1min":1.0469999999999999,"5min":1.107,"15min":1.2110000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Jun 25 05:42:00 2021","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":0.73899999999999999},"min":{"1min":0.52200000000000002,"5min":0.51400000000000001,"15min":0.502},"max":{"1min":1.0109999999999999,"5min":1.125,"15min":1.2270000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82799999999999996,"15min":0.83299999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.53800000000000003},"max":{"1min":1.1599999999999999,"5min":1.252,"15min":1.252},"last":1.0029999999999999}]},{"osd":6,"last update":"Fri Jun 25 05:42:00 2021","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81299999999999994,"15min":0.81999999999999995},"min":{"1min":0.61099999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0780000000000001,"5min":1.1060000000000001,"15min":1.159},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.85599999999999998,"15min":0.85399999999999998},"min":{"1min":0.621,"5min":0.53500000000000003,"15min":0.53100000000000003},"max":{"1min":1.052,"5min":1.1859999999999999,"15min":1.27},"last":0.98099999999999998}]},{"osd":7,"last update":"Fri Jun 25 05:42:00 2021","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.90300000000000002,"15min":0.90900000000000003},"min":{"1min":0.66600000000000004,"5min":0.60899999999999999,"15min":0.60099999999999998},"max":{"1min":1.1000000000000001,"5min":1.2230000000000001,"15min":1.238},"last":1.071},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.93799999999999994,"15min":0.94299999999999995},"min":{"1min":0.69399999999999995,"5min":0.65500000000000003,"15min":0.65100000000000002},"max":{"1min":1.0589999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0269999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77900000000000003,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.53000000000000003},"max":{"1min":0.95799999999999996,"5min":1.0089999999999999,"15min":1.1120000000000001},"last":0.877},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.97699999999999998}]},{"osd":1,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.75700000000000001,"15min":0.78400000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.504},"max":{"1min":1.0780000000000001,"5min":1.089,"15min":1.2330000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.79500000000000004},"min":{"1min":0.66600000000000004,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.0229999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.76300000000000001}]},{"osd":2,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79600000000000004,"15min":0.81499999999999995},"min":{"1min":0.61499999999999999,"5min":0.57999999999999996,"15min":0.55600000000000005},"max":{"1min":1.02,"5min":1.107,"15min":1.1120000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.85299999999999998,"15min":0.84199999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.56499999999999995},"max":{"1min":1.04,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82499999999999996,"15min":0.82799999999999996},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.92800000000000005},"min":{"1min":0.77200000000000002,"5min":0.71599999999999997,"15min":0.68400000000000005},"max":{"1min":1.107,"5min":1.107,"15min":1.175},"last":0.997}]},{"osd":5,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.501},"max":{"1min":0.98599999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.47599999999999998},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.88500000000000001}]},{"osd":6,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.46700000000000003},"max":{"1min":1.0469999999999999,"5min":1.103,"15min":1.21},"last":1.042},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.94099999999999995,"15min":0.94599999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.103,"5min":1.214,"15min":1.276},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88800000000000001,"15min":0.86599999999999999},"min":{"1min":0.59899999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.63,"5min":0.628,"15min":0.59099999999999997},"max":{"1min":1.1559999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.083}]}]},{"osd":3,"up_from":13,"seq":55834575518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.47699999999999998,"5min":0.46000000000000002,"15min":0.44},"max":{"1min":0.73799999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.52300000000000002,"5min":0.50600000000000001,"15min":0.45000000000000001},"max":{"1min":0.95999999999999996,"5min":1.107,"15min":1.218},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":0.81399999999999995,"5min":0.97999999999999998,"15min":1.073},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.57999999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0920000000000001,"5min":1.196,"15min":1.196},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.497},"max":{"1min":1.0960000000000001,"5min":1.1200000000000001,"15min":1.1879999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.46100000000000002},"max":{"1min":0.89600000000000002,"5min":1.028,"15min":1.2490000000000001},"last":0.65600000000000003}]},{"osd":4,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90600000000000003,"15min":0.90700000000000003},"min":{"1min":0.67300000000000004,"5min":0.622,"15min":0.61199999999999999},"max":{"1min":1.212,"5min":1.2769999999999999,"15min":1.284},"last":0.879},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.69699999999999995},"max":{"1min":1.294,"5min":1.417,"15min":1.417},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.73999999999999999,"5min":0.66600000000000004,"15min":0.58999999999999997},"max":{"1min":1.3979999999999999,"5min":1.4299999999999999,"15min":1.472},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.93300000000000005,"15min":0.92300000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.58599999999999997},"max":{"1min":1.202,"5min":1.359,"15min":1.359},"last":1.032}]},{"osd":6,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96899999999999997,"15min":0.95999999999999996},"min":{"1min":0.75600000000000001,"5min":0.68500000000000005,"15min":0.66200000000000003},"max":{"1min":1.127,"5min":1.407,"15min":1.4490000000000001},"last":1.016},{"interface":"front","average":{"1min":1.05,"5min":1.024,"15min":1.0109999999999999},"min":{"1min":0.90500000000000003,"5min":0.77000000000000002,"15min":0.65200000000000002},"max":{"1min":1.29,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.1699999999999999}]},{"osd":7,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.032,"15min":1.026},"min":{"1min":0.84099999999999997,"5min":0.70099999999999996,"15min":0.68500000000000005},"max":{"1min":1.3600000000000001,"5min":1.4870000000000001,"15min":1.52},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0469999999999999,"15min":1.038},"min":{"1min":0.79600000000000004,"5min":0.752,"15min":0.65400000000000003},"max":{"1min":1.1839999999999999,"5min":1.458,"15min":1.5780000000000001},"last":1.05}]}]},{"osd":2,"up_from":13,"seq":55834575517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:41:59 2021","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.45800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":1.012},"last":0.624},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.83499999999999996,"5min":0.98499999999999999,"15min":1.181},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Jun 25 05:41:59 2021","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.51900000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.002,"5min":1.002,"15min":1.143},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77100000000000002,"15min":0.755},"min":{"1min":0.623,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91600000000000004,"5min":1.151,"15min":1.151},"last":0.84999999999999998}]},{"osd":3,"last update":"Fri Jun 25 05:41:59 2021","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.49399999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86899999999999999,"5min":1.0289999999999999,"15min":1.1519999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.63800000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89200000000000002,"5min":1.179,"15min":1.2290000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Fri Jun 25 05:41:59 2021","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88400000000000001,"15min":0.89500000000000002},"min":{"1min":0.70599999999999996,"5min":0.625,"15min":0.61599999999999999},"max":{"1min":1.0760000000000001,"5min":1.093,"15min":1.2190000000000001},"last":0.873},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.90800000000000003,"15min":0.91500000000000004},"min":{"1min":0.70599999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.302,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Jun 25 05:41:59 2021","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.86699999999999999,"15min":0.86299999999999999},"min":{"1min":0.60599999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0609999999999999,"5min":1.228,"15min":1.2529999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.70499999999999996},"max":{"1min":1.1180000000000001,"5min":1.1799999999999999,"15min":1.3879999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Jun 25 05:41:59 2021","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94699999999999995,"15min":0.94199999999999995},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.64200000000000002},"max":{"1min":1.2629999999999999,"5min":1.371,"15min":1.589},"last":0.997},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.91500000000000004,"15min":0.91800000000000004},"min":{"1min":0.747,"5min":0.69899999999999995,"15min":0.64500000000000002},"max":{"1min":1.0329999999999999,"5min":1.286,"15min":1.3899999999999999},"last":1.0129999999999999}]},{"osd":7,"last update":"Fri Jun 25 05:41:59 2021","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0009999999999999,"15min":1.002},"min":{"1min":0.86199999999999999,"5min":0.76600000000000001,"15min":0.65800000000000003},"max":{"1min":1.2130000000000001,"5min":1.4530000000000001,"15min":1.5389999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0029999999999999,"15min":1.006},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.117,"5min":1.3220000000000001,"15min":1.448},"last":1.083}]}]},{"osd":1,"up_from":13,"seq":55834575517,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.46100000000000002,"5min":0.44,"15min":0.39100000000000001},"max":{"1min":0.83899999999999997,"5min":0.99399999999999999,"15min":1.077},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.46999999999999997,"15min":0.46100000000000002},"max":{"1min":0.91700000000000004,"5min":0.96899999999999997,"15min":1.1830000000000001},"last":0.89900000000000002}]},{"osd":2,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.45800000000000002},"max":{"1min":0.80000000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.46300000000000002},"max":{"1min":0.99199999999999999,"5min":1.0049999999999999,"15min":1.107},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78900000000000003,"15min":0.78700000000000003},"min":{"1min":0.63400000000000001,"5min":0.61199999999999999,"15min":0.53700000000000003},"max":{"1min":0.97599999999999998,"5min":1.1020000000000001,"15min":1.1659999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.54000000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0089999999999999,"5min":1.0629999999999999,"15min":1.3100000000000001},"last":0.71299999999999997}]},{"osd":4,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.84699999999999998,"15min":0.84899999999999998},"min":{"1min":0.72499999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.169,"5min":1.2010000000000001,"15min":3.1059999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93799999999999994,"15min":0.93999999999999995},"min":{"1min":0.754,"5min":0.70999999999999996,"15min":0.65400000000000003},"max":{"1min":1.1479999999999999,"5min":1.272,"15min":3.5270000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94499999999999995,"15min":0.93899999999999995},"min":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.624},"max":{"1min":1.1879999999999999,"5min":1.371,"15min":3.4489999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.749,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.139,"5min":1.5329999999999999,"15min":3.2160000000000002},"last":1.1299999999999999}]},{"osd":6,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.751,"5min":0.69799999999999995,"15min":0.69699999999999995},"max":{"1min":1.2390000000000001,"5min":1.304,"15min":3.3620000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98099999999999998,"15min":0.98199999999999998},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1779999999999999,"5min":1.6220000000000001,"15min":3.4089999999999998},"last":1}]},{"osd":7,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.012},"min":{"1min":0.76500000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.2170000000000001,"5min":1.5009999999999999,"15min":3.1440000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.042,"15min":1.042},"min":{"1min":0.82599999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.276,"5min":1.369,"15min":3.2389999999999999},"last":1.2130000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575518,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.39900000000000002},"max":{"1min":0.83499999999999996,"5min":0.91400000000000003,"15min":1.151},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.0589999999999999,"15min":1.0629999999999999},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.67100000000000004,"15min":0.68200000000000005},"min":{"1min":0.501,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92400000000000004,"5min":1.111,"15min":1.111},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.54700000000000004,"5min":0.49399999999999999,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.153,"15min":1.2090000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.501,"5min":0.46999999999999997,"15min":0.45600000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.0649999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78200000000000003,"15min":0.79700000000000004},"min":{"1min":0.61599999999999999,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.0309999999999999,"5min":1.0589999999999999,"15min":1.1679999999999999},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.89500000000000002,"15min":0.89600000000000002},"min":{"1min":0.71099999999999997,"5min":0.65100000000000002,"15min":0.625},"max":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.2290000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84599999999999997,"15min":0.86699999999999999},"min":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.0760000000000001,"5min":1.1779999999999999,"15min":1.2889999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93700000000000006,"15min":0.95699999999999996},"min":{"1min":0.77200000000000002,"5min":0.624,"15min":0.624},"max":{"1min":1.163,"5min":1.3049999999999999,"15min":1.4410000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":0.95099999999999996},"min":{"1min":0.77300000000000002,"5min":0.69499999999999995,"15min":0.67000000000000004},"max":{"1min":1.0720000000000001,"5min":1.2609999999999999,"15min":1.365},"last":1.21}]},{"osd":6,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.70699999999999996,"5min":0.68899999999999995,"15min":0.66600000000000004},"max":{"1min":1.214,"5min":1.2609999999999999,"15min":1.5},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.996,"15min":1.0129999999999999},"min":{"1min":0.72099999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.1830000000000001,"5min":1.3720000000000001,"15min":1.5209999999999999},"last":1.133}]},{"osd":7,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0169999999999999,"15min":1.0189999999999999},"min":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.135,"5min":1.448,"15min":1.5349999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0189999999999999,"15min":1.018},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.66000000000000003},"max":{"1min":1.2210000000000001,"5min":1.421,"15min":1.4570000000000001},"last":0.92500000000000004}]}]}]}} 2021-06-25T05:43:03.957 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-06-25T05:43:04.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd2f60700 1 Processor -- start 2021-06-25T05:43:04.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd2f60700 1 -- start start 2021-06-25T05:43:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd2f60700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc061640 0x7f5ccc0b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd2f60700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5ccc0b46d0 0x7f5ccc0ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:04.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd2f60700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ccc0b68d0 con 0x7f5ccc143960 2021-06-25T05:43:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd2f60700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ccc0b9640 con 0x7f5ccc0b46d0 2021-06-25T05:43:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd2f60700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0b6b70 con 0x7f5ccc061640 2021-06-25T05:43:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd1f5e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc061640 0x7f5ccc0b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd175d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5ccc0b46d0 0x7f5ccc0ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd1f5e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc061640 0x7f5ccc0b9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:56202/0 (socket says 172.21.15.57:56202) 2021-06-25T05:43:04.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd1f5e700 1 -- 172.21.15.57:0/1890278478 learned_addr learned my addr 172.21.15.57:0/1890278478 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:04.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd275f700 1 --1- 172.21.15.57:0/1890278478 >> v1:172.21.15.87:6789/0 conn(0x7f5ccc143960 0x7f5ccc13fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:34776/0 (socket says 172.21.15.57:34776) 2021-06-25T05:43:04.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd1f5e700 1 -- 172.21.15.57:0/1890278478 >> v2:172.21.15.87:3300/0 conn(0x7f5ccc0b46d0 msgr2=0x7f5ccc0ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:04.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd1f5e700 1 --2- 172.21.15.57:0/1890278478 >> v2:172.21.15.87:3300/0 conn(0x7f5ccc0b46d0 0x7f5ccc0ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:04.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd1f5e700 1 -- 172.21.15.57:0/1890278478 >> v1:172.21.15.87:6789/0 conn(0x7f5ccc143960 legacy=0x7f5ccc13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:04.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd1f5e700 1 -- 172.21.15.57:0/1890278478 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc0b6e10 con 0x7f5ccc061640 2021-06-25T05:43:04.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd175d700 1 --2- 172.21.15.57:0/1890278478 >> v2:172.21.15.87:3300/0 conn(0x7f5ccc0b46d0 0x7f5ccc0ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T05:43:04.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd1f5e700 1 --2- 172.21.15.57:0/1890278478 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc061640 0x7f5ccc0b9cd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f5cc8002f70 tx=0x7f5cc8006eb0).ready entity=mon.2 client_cookie=aafb3f527e0a41ec server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:04.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd0f5c700 1 -- 172.21.15.57:0/1890278478 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc800d570 con 0x7f5ccc061640 2021-06-25T05:43:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd0f5c700 1 -- 172.21.15.57:0/1890278478 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc8000e90 con 0x7f5ccc061640 2021-06-25T05:43:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd0f5c700 1 -- 172.21.15.57:0/1890278478 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc800d900 con 0x7f5ccc061640 2021-06-25T05:43:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1890278478 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc061640 msgr2=0x7f5ccc0b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:04.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.062+0000 7f5cd2f60700 1 --2- 172.21.15.57:0/1890278478 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc061640 0x7f5ccc0b9cd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f5cc8002f70 tx=0x7f5cc8006eb0).stop 2021-06-25T05:43:04.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.066+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1890278478 shutdown_connections 2021-06-25T05:43:04.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.066+0000 7f5cd2f60700 1 --2- 172.21.15.57:0/1890278478 >> v2:172.21.15.87:3300/0 conn(0x7f5ccc0b46d0 0x7f5ccc0ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:04.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.066+0000 7f5cd2f60700 1 --2- 172.21.15.57:0/1890278478 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc061640 0x7f5ccc0b9cd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:04.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.066+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1890278478 >> 172.21.15.57:0/1890278478 conn(0x7f5ccc06adb0 msgr2=0x7f5ccc05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:04.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.066+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1890278478 shutdown_connections 2021-06-25T05:43:04.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.066+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1890278478 wait complete. 2021-06-25T05:43:04.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.066+0000 7f5cd2f60700 1 Processor -- start 2021-06-25T05:43:04.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.066+0000 7f5cd2f60700 1 -- start start 2021-06-25T05:43:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd2f60700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ccc061640 0x7f5ccc05bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd2f60700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ccc143960 0x7f5ccc152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd2f60700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc139470 0x7f5ccc152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:04.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd2f60700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc152c40 con 0x7f5ccc061640 2021-06-25T05:43:04.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd2f60700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc155850 con 0x7f5ccc143960 2021-06-25T05:43:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd2f60700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc155af0 con 0x7f5ccc139470 2021-06-25T05:43:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd1f5e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ccc061640 0x7f5ccc05bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd1f5e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ccc061640 0x7f5ccc05bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45044/0 (socket says 172.21.15.57:45044) 2021-06-25T05:43:04.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd1f5e700 1 -- 172.21.15.57:0/1003167942 learned_addr learned my addr 172.21.15.57:0/1003167942 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:04.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd175d700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ccc143960 0x7f5ccc152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:04.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd275f700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc139470 0x7f5ccc152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd175d700 1 -- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc139470 msgr2=0x7f5ccc152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd175d700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc139470 0x7f5ccc152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd175d700 1 -- 172.21.15.57:0/1003167942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ccc061640 msgr2=0x7f5ccc05bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:04.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd175d700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ccc061640 0x7f5ccc05bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:04.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd175d700 1 -- 172.21.15.57:0/1003167942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc00b180 con 0x7f5ccc143960 2021-06-25T05:43:04.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd1f5e700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ccc061640 0x7f5ccc05bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T05:43:04.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd175d700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ccc143960 0x7f5ccc152260 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f5ccc138f30 tx=0x7f5cbc006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cbaffd700 1 -- 172.21.15.57:0/1003167942 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cbc010780 con 0x7f5ccc143960 2021-06-25T05:43:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cbaffd700 1 -- 172.21.15.57:0/1003167942 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc0108e0 con 0x7f5ccc143960 2021-06-25T05:43:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1003167942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc800b1e0 con 0x7f5ccc143960 2021-06-25T05:43:04.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cbaffd700 1 -- 172.21.15.57:0/1003167942 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cbc010c40 con 0x7f5ccc143960 2021-06-25T05:43:04.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.070+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1003167942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ccc05c490 con 0x7f5ccc143960 2021-06-25T05:43:04.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.074+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1003167942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ccc0b93d0 con 0x7f5ccc143960 2021-06-25T05:43:04.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.074+0000 7f5cbaffd700 1 -- 172.21.15.57:0/1003167942 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5cbc01c460 con 0x7f5ccc143960 2021-06-25T05:43:04.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.074+0000 7f5cbaffd700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5cac0554e0 0x7f5cac0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:04.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.074+0000 7f5cbaffd700 1 -- 172.21.15.57:0/1003167942 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f5cbc06e2a0 con 0x7f5ccc143960 2021-06-25T05:43:04.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.074+0000 7f5cd1f5e700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5cac0554e0 0x7f5cac0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:04.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.074+0000 7f5cd1f5e700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5cac0554e0 0x7f5cac0579a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f5cc801b000 tx=0x7f5cc8015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:04.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.082+0000 7f5cbaffd700 1 -- 172.21.15.57:0/1003167942 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f5ccc0b93d0 con 0x7f5ccc143960 2021-06-25T05:43:04.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.210+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1003167942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ccc0b93d0 con 0x7f5ccc143960 2021-06-25T05:43:04.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cbaffd700 1 -- 172.21.15.57:0/1003167942 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+13553 (secure 0 0 0) 0x7f5ccc0b93d0 con 0x7f5ccc143960 2021-06-25T05:43:04.212 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T05:43:04.212 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":162,"fsid":"d067c0ce-62d7-4088-9fe1-bc0002e5c6e5","created":"2021-06-25T04:47:20.414431+0000","modified":"2021-06-25T04:57:32.700920+0000","last_up_change":"2021-06-25T04:47:27.475755+0000","last_in_change":"2021-06-25T04:47:27.475755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-06-25T04:47:24.504320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-06-25T04:47:31.724400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"99a627d2-6f82-4862-b866-ad32e153b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":15205},{"type":"v1","addr":"172.21.15.57:6801","nonce":15205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":15205},{"type":"v1","addr":"172.21.15.57:6803","nonce":15205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":15205},{"type":"v1","addr":"172.21.15.57:6807","nonce":15205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":15205},{"type":"v1","addr":"172.21.15.57:6805","nonce":15205}]},"public_addr":"172.21.15.57:6801/15205","cluster_addr":"172.21.15.57:6803/15205","heartbeat_back_addr":"172.21.15.57:6807/15205","heartbeat_front_addr":"172.21.15.57:6805/15205","state":["exists","up"]},{"osd":1,"uuid":"1ce151cf-5006-4549-98dd-18dddd863605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":15206},{"type":"v1","addr":"172.21.15.57:6809","nonce":15206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":15206},{"type":"v1","addr":"172.21.15.57:6811","nonce":15206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":15206},{"type":"v1","addr":"172.21.15.57:6815","nonce":15206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":15206},{"type":"v1","addr":"172.21.15.57:6813","nonce":15206}]},"public_addr":"172.21.15.57:6809/15206","cluster_addr":"172.21.15.57:6811/15206","heartbeat_back_addr":"172.21.15.57:6815/15206","heartbeat_front_addr":"172.21.15.57:6813/15206","state":["exists","up"]},{"osd":2,"uuid":"f55562f2-e1ee-45bf-8a10-1538ce97cd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":15216},{"type":"v1","addr":"172.21.15.57:6825","nonce":15216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":15216},{"type":"v1","addr":"172.21.15.57:6827","nonce":15216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":15216},{"type":"v1","addr":"172.21.15.57:6831","nonce":15216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":15216},{"type":"v1","addr":"172.21.15.57:6829","nonce":15216}]},"public_addr":"172.21.15.57:6825/15216","cluster_addr":"172.21.15.57:6827/15216","heartbeat_back_addr":"172.21.15.57:6831/15216","heartbeat_front_addr":"172.21.15.57:6829/15216","state":["exists","up"]},{"osd":3,"uuid":"42c1cff5-3c6f-488a-bd93-7de6fdbf1f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":15207},{"type":"v1","addr":"172.21.15.57:6817","nonce":15207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":15207},{"type":"v1","addr":"172.21.15.57:6819","nonce":15207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":15207},{"type":"v1","addr":"172.21.15.57:6823","nonce":15207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":15207},{"type":"v1","addr":"172.21.15.57:6821","nonce":15207}]},"public_addr":"172.21.15.57:6817/15207","cluster_addr":"172.21.15.57:6819/15207","heartbeat_back_addr":"172.21.15.57:6823/15207","heartbeat_front_addr":"172.21.15.57:6821/15207","state":["exists","up"]},{"osd":4,"uuid":"6b6d8788-2f26-4b45-84bd-651eaa34cada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":15528},{"type":"v1","addr":"172.21.15.87:6809","nonce":15528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":15528},{"type":"v1","addr":"172.21.15.87:6811","nonce":15528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":15528},{"type":"v1","addr":"172.21.15.87:6815","nonce":15528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":15528},{"type":"v1","addr":"172.21.15.87:6813","nonce":15528}]},"public_addr":"172.21.15.87:6809/15528","cluster_addr":"172.21.15.87:6811/15528","heartbeat_back_addr":"172.21.15.87:6815/15528","heartbeat_front_addr":"172.21.15.87:6813/15528","state":["exists","up"]},{"osd":5,"uuid":"b57c1968-cc07-4542-82e5-5c924cb09858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":15545},{"type":"v1","addr":"172.21.15.87:6825","nonce":15545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":15545},{"type":"v1","addr":"172.21.15.87:6827","nonce":15545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":15545},{"type":"v1","addr":"172.21.15.87:6831","nonce":15545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":15545},{"type":"v1","addr":"172.21.15.87:6829","nonce":15545}]},"public_addr":"172.21.15.87:6825/15545","cluster_addr":"172.21.15.87:6827/15545","heartbeat_back_addr":"172.21.15.87:6831/15545","heartbeat_front_addr":"172.21.15.87:6829/15545","state":["exists","up"]},{"osd":6,"uuid":"72622640-3724-4a46-8f2d-9c797e8d7fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":15529},{"type":"v1","addr":"172.21.15.87:6817","nonce":15529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":15529},{"type":"v1","addr":"172.21.15.87:6819","nonce":15529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":15529},{"type":"v1","addr":"172.21.15.87:6823","nonce":15529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":15529},{"type":"v1","addr":"172.21.15.87:6821","nonce":15529}]},"public_addr":"172.21.15.87:6817/15529","cluster_addr":"172.21.15.87:6819/15529","heartbeat_back_addr":"172.21.15.87:6823/15529","heartbeat_front_addr":"172.21.15.87:6821/15529","state":["exists","up"]},{"osd":7,"uuid":"f58d446d-b419-4746-b3ca-f6b61e89abb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":15530},{"type":"v1","addr":"172.21.15.87:6801","nonce":15530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":15530},{"type":"v1","addr":"172.21.15.87:6803","nonce":15530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":15530},{"type":"v1","addr":"172.21.15.87:6807","nonce":15530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":15530},{"type":"v1","addr":"172.21.15.87:6805","nonce":15530}]},"public_addr":"172.21.15.87:6801/15530","cluster_addr":"172.21.15.87:6803/15530","heartbeat_back_addr":"172.21.15.87:6807/15530","heartbeat_front_addr":"172.21.15.87:6805/15530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.943419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.933590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.226103+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.172651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.117116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.005133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:26.195111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-06-25T04:47:25.966764+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.87:6835/3809657492":"2021-06-26T04:57:29.301196+0000","172.21.15.87:6834/3809657492":"2021-06-26T04:57:29.301196+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-06-25T05:43:04.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5cac0554e0 msgr2=0x7f5cac0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:04.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cd2f60700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5cac0554e0 0x7f5cac0579a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f5cc801b000 tx=0x7f5cc8015000).stop 2021-06-25T05:43:04.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ccc143960 msgr2=0x7f5ccc152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:04.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cd2f60700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ccc143960 0x7f5ccc152260 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f5ccc138f30 tx=0x7f5cbc006df0).stop 2021-06-25T05:43:04.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1003167942 shutdown_connections 2021-06-25T05:43:04.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cd2f60700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5cac0554e0 0x7f5cac0579a0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:04.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cd2f60700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5ccc139470 0x7f5ccc152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:04.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cd2f60700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ccc143960 0x7f5ccc152260 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:04.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cd2f60700 1 --2- 172.21.15.57:0/1003167942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ccc061640 0x7f5ccc05bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:04.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1003167942 >> 172.21.15.57:0/1003167942 conn(0x7f5ccc06adb0 msgr2=0x7f5ccc05f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:04.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.214+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1003167942 shutdown_connections 2021-06-25T05:43:04.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:04.218+0000 7f5cd2f60700 1 -- 172.21.15.57:0/1003167942 wait complete. 2021-06-25T05:43:05.230 INFO:tasks.ceph:Scrubbing osd.0 2021-06-25T05:43:05.231 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-06-25T05:43:05.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb20198700 1 Processor -- start 2021-06-25T05:43:05.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb20198700 1 -- start start 2021-06-25T05:43:05.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb20198700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb180b6540 0x7ffb180b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb20198700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb180b6920 0x7ffb1812b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb20198700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb18144070 con 0x7ffb180b4380 2021-06-25T05:43:05.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb20198700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb18143b30 con 0x7ffb180b6920 2021-06-25T05:43:05.352 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb20198700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18143dd0 con 0x7ffb180b6540 2021-06-25T05:43:05.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1d733700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffb180b4380 0x7ffb18061cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34040/0 (socket says 172.21.15.57:34040) 2021-06-25T05:43:05.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1d733700 1 -- 172.21.15.57:0/3999328222 learned_addr learned my addr 172.21.15.57:0/3999328222 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:05.353 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1df34700 1 --2- 172.21.15.57:0/3999328222 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb180b6540 0x7ffb180b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1e735700 1 --2- 172.21.15.57:0/3999328222 >> v2:172.21.15.87:3300/0 conn(0x7ffb180b6920 0x7ffb1812b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1cf32700 1 -- 172.21.15.57:0/3999328222 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020647271 0 0) 0x7ffb18144070 con 0x7ffb180b4380 2021-06-25T05:43:05.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1cf32700 1 -- 172.21.15.57:0/3999328222 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb00003260 con 0x7ffb180b4380 2021-06-25T05:43:05.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1df34700 1 -- 172.21.15.57:0/3999328222 >> v2:172.21.15.87:3300/0 conn(0x7ffb180b6920 msgr2=0x7ffb1812b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:05.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1df34700 1 --2- 172.21.15.57:0/3999328222 >> v2:172.21.15.87:3300/0 conn(0x7ffb180b6920 0x7ffb1812b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1df34700 1 -- 172.21.15.57:0/3999328222 >> v1:172.21.15.57:6789/0 conn(0x7ffb180b4380 legacy=0x7ffb18061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1df34700 1 -- 172.21.15.57:0/3999328222 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb180615b0 con 0x7ffb180b6540 2021-06-25T05:43:05.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1e735700 1 --2- 172.21.15.57:0/3999328222 >> v2:172.21.15.87:3300/0 conn(0x7ffb180b6920 0x7ffb1812b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T05:43:05.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1df34700 1 --2- 172.21.15.57:0/3999328222 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb180b6540 0x7ffb180b5bb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7ffb14002f70 tx=0x7ffb14006df0).ready entity=mon.2 client_cookie=97b3e577686ee232 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.350+0000 7ffb1cf32700 1 -- 172.21.15.57:0/3999328222 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb1400d4a0 con 0x7ffb180b6540 2021-06-25T05:43:05.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1cf32700 1 -- 172.21.15.57:0/3999328222 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb14000e90 con 0x7ffb180b6540 2021-06-25T05:43:05.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1cf32700 1 -- 172.21.15.57:0/3999328222 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb1400d7f0 con 0x7ffb180b6540 2021-06-25T05:43:05.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 -- 172.21.15.57:0/3999328222 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb180b6540 msgr2=0x7ffb180b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 --2- 172.21.15.57:0/3999328222 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb180b6540 0x7ffb180b5bb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7ffb14002f70 tx=0x7ffb14006df0).stop 2021-06-25T05:43:05.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 -- 172.21.15.57:0/3999328222 shutdown_connections 2021-06-25T05:43:05.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 --2- 172.21.15.57:0/3999328222 >> v2:172.21.15.87:3300/0 conn(0x7ffb180b6920 0x7ffb1812b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 --2- 172.21.15.57:0/3999328222 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb180b6540 0x7ffb180b5bb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.365 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 -- 172.21.15.57:0/3999328222 >> 172.21.15.57:0/3999328222 conn(0x7ffb1805c450 msgr2=0x7ffb1805c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:05.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 -- 172.21.15.57:0/3999328222 shutdown_connections 2021-06-25T05:43:05.366 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 -- 172.21.15.57:0/3999328222 wait complete. 2021-06-25T05:43:05.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 Processor -- start 2021-06-25T05:43:05.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 -- start start 2021-06-25T05:43:05.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb180b4380 0x7ffb1812abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb180b6540 0x7ffb1812b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb180b6920 0x7ffb1812b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18151ff0 con 0x7ffb180b6920 2021-06-25T05:43:05.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb180b0410 con 0x7ffb180b6540 2021-06-25T05:43:05.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb20198700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb180b0170 con 0x7ffb180b4380 2021-06-25T05:43:05.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1e735700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb180b6920 0x7ffb1812b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1e735700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb180b6920 0x7ffb1812b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45062/0 (socket says 172.21.15.57:45062) 2021-06-25T05:43:05.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1e735700 1 -- 172.21.15.57:0/3036369095 learned_addr learned my addr 172.21.15.57:0/3036369095 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:05.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1df34700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb180b4380 0x7ffb1812abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1d733700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb180b6540 0x7ffb1812b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1e735700 1 -- 172.21.15.57:0/3036369095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb180b4380 msgr2=0x7ffb1812abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1e735700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb180b4380 0x7ffb1812abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1e735700 1 -- 172.21.15.57:0/3036369095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb180b6540 msgr2=0x7ffb1812b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1e735700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb180b6540 0x7ffb1812b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1e735700 1 -- 172.21.15.57:0/3036369095 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10009470 con 0x7ffb180b6920 2021-06-25T05:43:05.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.354+0000 7ffb1e735700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb180b6920 0x7ffb1812b930 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7ffb180b0550 tx=0x7ffb100091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.358+0000 7ffb0affd700 1 -- 172.21.15.57:0/3036369095 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb1000ee90 con 0x7ffb180b6920 2021-06-25T05:43:05.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.358+0000 7ffb0affd700 1 -- 172.21.15.57:0/3036369095 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1000c850 con 0x7ffb180b6920 2021-06-25T05:43:05.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.358+0000 7ffb0affd700 1 -- 172.21.15.57:0/3036369095 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb1000cbb0 con 0x7ffb180b6920 2021-06-25T05:43:05.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.358+0000 7ffb20198700 1 -- 172.21.15.57:0/3036369095 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1400b180 con 0x7ffb180b6920 2021-06-25T05:43:05.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.358+0000 7ffb20198700 1 -- 172.21.15.57:0/3036369095 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb180b3780 con 0x7ffb180b6920 2021-06-25T05:43:05.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.358+0000 7ffb20198700 1 -- 172.21.15.57:0/3036369095 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb1812b630 con 0x7ffb180b6920 2021-06-25T05:43:05.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.358+0000 7ffb0affd700 1 -- 172.21.15.57:0/3036369095 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ffb10022070 con 0x7ffb180b6920 2021-06-25T05:43:05.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.358+0000 7ffb0affd700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffaf8055450 0x7ffaf8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.358+0000 7ffb0affd700 1 -- 172.21.15.57:0/3036369095 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ffb1006e2d0 con 0x7ffb180b6920 2021-06-25T05:43:05.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.362+0000 7ffb1df34700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffaf8055450 0x7ffaf8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.362+0000 7ffb0affd700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x7ffaf805c1e0 0x7ffaf805e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.362+0000 7ffb0affd700 1 -- 172.21.15.57:0/3036369095 --> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffaf805ebc0 con 0x7ffaf805c1e0 2021-06-25T05:43:05.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.362+0000 7ffb0affd700 1 -- 172.21.15.57:0/3036369095 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb10070900 con 0x7ffb180b6920 2021-06-25T05:43:05.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.362+0000 7ffb1d733700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x7ffaf805c1e0 0x7ffaf805e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.362+0000 7ffb1df34700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffaf8055450 0x7ffaf8057910 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7ffb14019000 tx=0x7ffb14014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.362+0000 7ffb1d733700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x7ffaf805c1e0 0x7ffaf805e600 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.362+0000 7ffb0affd700 1 -- 172.21.15.57:0/3036369095 <== osd.0 v2:172.21.15.57:6800/15205 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7ffaf805ebc0 con 0x7ffaf805c1e0 2021-06-25T05:43:05.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.378+0000 7ffb20198700 1 -- 172.21.15.57:0/3036369095 --> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffb18141270 con 0x7ffaf805c1e0 2021-06-25T05:43:05.385 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.378+0000 7ffb0affd700 1 -- 172.21.15.57:0/3036369095 <== osd.0 v2:172.21.15.57:6800/15205 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ffb18141270 con 0x7ffaf805c1e0 2021-06-25T05:43:05.385 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T05:43:05.386 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-06-25T05:43:05.386 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T05:43:05.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.382+0000 7ffb20198700 1 -- 172.21.15.57:0/3036369095 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x7ffaf805c1e0 msgr2=0x7ffaf805e600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.382+0000 7ffb20198700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.57:6800/15205,v1:172.21.15.57:6801/15205] conn(0x7ffaf805c1e0 0x7ffaf805e600 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.382+0000 7ffb20198700 1 -- 172.21.15.57:0/3036369095 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffaf8055450 msgr2=0x7ffaf8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.382+0000 7ffb20198700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ffaf8055450 0x7ffaf8057910 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7ffb14019000 tx=0x7ffb14014000).stop 2021-06-25T05:43:05.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.382+0000 7ffb20198700 1 -- 172.21.15.57:0/3036369095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb180b6920 msgr2=0x7ffb1812b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.382+0000 7ffb20198700 1 --2- 172.21.15.57:0/3036369095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb180b6920 0x7ffb1812b930 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7ffb180b0550 tx=0x7ffb100091d0).stop 2021-06-25T05:43:05.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.382+0000 7ffb1e735700 1 -- 172.21.15.57:0/3036369095 reap_dead start 2021-06-25T05:43:05.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.382+0000 7ffb20198700 1 -- 172.21.15.57:0/3036369095 shutdown_connections 2021-06-25T05:43:05.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.382+0000 7ffb20198700 1 -- 172.21.15.57:0/3036369095 >> 172.21.15.57:0/3036369095 conn(0x7ffb1805c450 msgr2=0x7ffb181284b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:05.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.382+0000 7ffb20198700 1 -- 172.21.15.57:0/3036369095 shutdown_connections 2021-06-25T05:43:05.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.382+0000 7ffb20198700 1 -- 172.21.15.57:0/3036369095 wait complete. 2021-06-25T05:43:05.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2021-06-25T05:43:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9f4afe700 1 Processor -- start 2021-06-25T05:43:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9f4afe700 1 -- start start 2021-06-25T05:43:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9f4afe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f00670e0 0x7fc9f00b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9f4afe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9f0143970 0x7fc9f00aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9f4afe700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f00b9b90 con 0x7fc9f013ffb0 2021-06-25T05:43:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9f4afe700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f0143040 con 0x7fc9f0143970 2021-06-25T05:43:05.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9f4afe700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00674c0 con 0x7fc9f00670e0 2021-06-25T05:43:05.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9edd9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9f0143970 0x7fc9f00aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9edd9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9f0143970 0x7fc9f00aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45070/0 (socket says 172.21.15.57:45070) 2021-06-25T05:43:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9edd9b700 1 -- 172.21.15.57:0/1122165785 learned_addr learned my addr 172.21.15.57:0/1122165785 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9ee59c700 1 --2- 172.21.15.57:0/1122165785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f00670e0 0x7fc9f00b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9edd9b700 1 -- 172.21.15.57:0/1122165785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f00670e0 msgr2=0x7fc9f00b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:05.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9edd9b700 1 --2- 172.21.15.57:0/1122165785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f00670e0 0x7fc9f00b96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9edd9b700 1 -- 172.21.15.57:0/1122165785 >> v1:172.21.15.87:6789/0 conn(0x7fc9f013ffb0 legacy=0x7fc9f0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.512 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.506+0000 7fc9edd9b700 1 -- 172.21.15.57:0/1122165785 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f00af490 con 0x7fc9f0143970 2021-06-25T05:43:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9edd9b700 1 --2- 172.21.15.57:0/1122165785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f0143970 0x7fc9f00aebc0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7fc9e0002f70 tx=0x7fc9e0006eb0).ready entity=mon.0 client_cookie=4eda86311dd734a5 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9ed59a700 1 -- 172.21.15.57:0/1122165785 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e000d570 con 0x7fc9f0143970 2021-06-25T05:43:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9ed59a700 1 -- 172.21.15.57:0/1122165785 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0000e90 con 0x7fc9f0143970 2021-06-25T05:43:05.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9ed59a700 1 -- 172.21.15.57:0/1122165785 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e000d900 con 0x7fc9f0143970 2021-06-25T05:43:05.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9f4afe700 1 -- 172.21.15.57:0/1122165785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f0143970 msgr2=0x7fc9f00aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.514 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9f4afe700 1 --2- 172.21.15.57:0/1122165785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f0143970 0x7fc9f00aebc0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7fc9e0002f70 tx=0x7fc9e0006eb0).stop 2021-06-25T05:43:05.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9f4afe700 1 -- 172.21.15.57:0/1122165785 shutdown_connections 2021-06-25T05:43:05.519 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9f4afe700 1 --2- 172.21.15.57:0/1122165785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f0143970 0x7fc9f00aebc0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9f4afe700 1 --2- 172.21.15.57:0/1122165785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f00670e0 0x7fc9f00b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9f4afe700 1 -- 172.21.15.57:0/1122165785 >> 172.21.15.57:0/1122165785 conn(0x7fc9f005f9b0 msgr2=0x7fc9f0061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9f4afe700 1 -- 172.21.15.57:0/1122165785 shutdown_connections 2021-06-25T05:43:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9f4afe700 1 -- 172.21.15.57:0/1122165785 wait complete. 2021-06-25T05:43:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9f4afe700 1 Processor -- start 2021-06-25T05:43:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.510+0000 7fc9f4afe700 1 -- start start 2021-06-25T05:43:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9f4afe700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f00670e0 0x7fc9f00b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9f4afe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f013ffb0 0x7fc9f0152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9f4afe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f0143970 0x7fc9f01527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9f4afe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00b2750 con 0x7fc9f0143970 2021-06-25T05:43:05.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9f4afe700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0155a50 con 0x7fc9f013ffb0 2021-06-25T05:43:05.523 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9f4afe700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0155cf0 con 0x7fc9f00670e0 2021-06-25T05:43:05.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9eed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f0143970 0x7fc9f01527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9eed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f0143970 0x7fc9f01527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45078/0 (socket says 172.21.15.57:45078) 2021-06-25T05:43:05.524 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9eed9d700 1 -- 172.21.15.57:0/3716691806 learned_addr learned my addr 172.21.15.57:0/3716691806 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:05.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9ee59c700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f00670e0 0x7fc9f00b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.525 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9edd9b700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f013ffb0 0x7fc9f0152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9eed9d700 1 -- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f00670e0 msgr2=0x7fc9f00b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9eed9d700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f00670e0 0x7fc9f00b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9eed9d700 1 -- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f013ffb0 msgr2=0x7fc9f0152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9eed9d700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f013ffb0 0x7fc9f0152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9eed9d700 1 -- 172.21.15.57:0/3716691806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e000b1e0 con 0x7fc9f0143970 2021-06-25T05:43:05.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9eed9d700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f0143970 0x7fc9f01527f0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7fc9f00b0b00 tx=0x7fc9e8007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9e77fe700 1 -- 172.21.15.57:0/3716691806 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e800e4a0 con 0x7fc9f0143970 2021-06-25T05:43:05.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9e77fe700 1 -- 172.21.15.57:0/3716691806 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e800e600 con 0x7fc9f0143970 2021-06-25T05:43:05.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9f4afe700 1 -- 172.21.15.57:0/3716691806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f0155f90 con 0x7fc9f0143970 2021-06-25T05:43:05.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9e77fe700 1 -- 172.21.15.57:0/3716691806 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e800e960 con 0x7fc9f0143970 2021-06-25T05:43:05.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.514+0000 7fc9f4afe700 1 -- 172.21.15.57:0/3716691806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f0152ce0 con 0x7fc9f0143970 2021-06-25T05:43:05.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.518+0000 7fc9e77fe700 1 -- 172.21.15.57:0/3716691806 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fc9e8019030 con 0x7fc9f0143970 2021-06-25T05:43:05.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.518+0000 7fc9f4afe700 1 -- 172.21.15.57:0/3716691806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f0146330 con 0x7fc9f0143970 2021-06-25T05:43:05.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.518+0000 7fc9e77fe700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9d40554e0 0x7fc9d40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.518+0000 7fc9e77fe700 1 -- 172.21.15.57:0/3716691806 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc9e806d220 con 0x7fc9f0143970 2021-06-25T05:43:05.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.518+0000 7fc9ee59c700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9d40554e0 0x7fc9d40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.531 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.518+0000 7fc9ee59c700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9d40554e0 0x7fc9d40579a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fc9d800b000 tx=0x7fc9d8006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.532 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.522+0000 7fc9e77fe700 1 -- 172.21.15.57:0/3716691806 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fc9e8043520 con 0x7fc9f0143970 2021-06-25T05:43:05.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.646+0000 7fc9f4afe700 1 -- 172.21.15.57:0/3716691806 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9f0156430 con 0x7fc9d40554e0 2021-06-25T05:43:05.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.646+0000 7fc9e77fe700 1 -- 172.21.15.57:0/3716691806 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc9d80116f0 con 0x7fc9d40554e0 2021-06-25T05:43:05.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 -- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9d40554e0 msgr2=0x7fc9d40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9d40554e0 0x7fc9d40579a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fc9d800b000 tx=0x7fc9d8006df0).stop 2021-06-25T05:43:05.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 -- 172.21.15.57:0/3716691806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f0143970 msgr2=0x7fc9f01527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f0143970 0x7fc9f01527f0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7fc9f00b0b00 tx=0x7fc9e8007f40).stop 2021-06-25T05:43:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 -- 172.21.15.57:0/3716691806 shutdown_connections 2021-06-25T05:43:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fc9d40554e0 0x7fc9d40579a0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f0143970 0x7fc9f01527f0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f013ffb0 0x7fc9f0152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 --2- 172.21.15.57:0/3716691806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f00670e0 0x7fc9f00b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 -- 172.21.15.57:0/3716691806 >> 172.21.15.57:0/3716691806 conn(0x7fc9f005f9b0 msgr2=0x7fc9f0140440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:05.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 -- 172.21.15.57:0/3716691806 shutdown_connections 2021-06-25T05:43:05.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.650+0000 7fc9f4afe700 1 -- 172.21.15.57:0/3716691806 wait complete. 2021-06-25T05:43:05.653 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2021-06-25T05:43:05.659 INFO:tasks.ceph:Scrubbing osd.1 2021-06-25T05:43:05.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-06-25T05:43:05.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.774+0000 7f48b93a0700 1 Processor -- start 2021-06-25T05:43:05.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.774+0000 7f48b93a0700 1 -- start start 2021-06-25T05:43:05.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f48b40ad580 0x7f48b40616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48b4140400 0x7f48b41408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b40aecb0 con 0x7f48b40612e0 2021-06-25T05:43:05.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b40b6ee0 con 0x7f48b40ad580 2021-06-25T05:43:05.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40aeee0 con 0x7f48b4140400 2021-06-25T05:43:05.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48ab7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f48b40ad580 0x7f48b40616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f48b40612e0 0x7f48b40b9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34068/0 (socket says 172.21.15.57:34068) 2021-06-25T05:43:05.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b3fff700 1 -- 172.21.15.57:0/1361228980 learned_addr learned my addr 172.21.15.57:0/1361228980 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:05.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b8b9f700 1 --2- 172.21.15.57:0/1361228980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48b4140400 0x7f48b41408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48ab7fe700 1 -- 172.21.15.57:0/1361228980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48b4140400 msgr2=0x7f48b41408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:05.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48ab7fe700 1 --2- 172.21.15.57:0/1361228980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48b4140400 0x7f48b41408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48ab7fe700 1 -- 172.21.15.57:0/1361228980 >> v1:172.21.15.57:6789/0 conn(0x7f48b40612e0 legacy=0x7f48b40b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48ab7fe700 1 -- 172.21.15.57:0/1361228980 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40af180 con 0x7f48b40ad580 2021-06-25T05:43:05.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48ab7fe700 1 --2- 172.21.15.57:0/1361228980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48b40ad580 0x7f48b40616c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f489c002f70 tx=0x7f489c006df0).ready entity=mon.0 client_cookie=29bcd7ae32f51068 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b37fe700 1 -- 172.21.15.57:0/1361228980 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489c00d570 con 0x7f48b40ad580 2021-06-25T05:43:05.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b37fe700 1 -- 172.21.15.57:0/1361228980 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c000e90 con 0x7f48b40ad580 2021-06-25T05:43:05.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b37fe700 1 -- 172.21.15.57:0/1361228980 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489c00d8c0 con 0x7f48b40ad580 2021-06-25T05:43:05.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 -- 172.21.15.57:0/1361228980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48b40ad580 msgr2=0x7f48b40616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 --2- 172.21.15.57:0/1361228980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48b40ad580 0x7f48b40616c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f489c002f70 tx=0x7f489c006df0).stop 2021-06-25T05:43:05.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 -- 172.21.15.57:0/1361228980 shutdown_connections 2021-06-25T05:43:05.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 --2- 172.21.15.57:0/1361228980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48b4140400 0x7f48b41408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 --2- 172.21.15.57:0/1361228980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48b40ad580 0x7f48b40616c0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 -- 172.21.15.57:0/1361228980 >> 172.21.15.57:0/1361228980 conn(0x7f48b4066da0 msgr2=0x7f48b4067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:05.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 -- 172.21.15.57:0/1361228980 shutdown_connections 2021-06-25T05:43:05.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 -- 172.21.15.57:0/1361228980 wait complete. 2021-06-25T05:43:05.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 Processor -- start 2021-06-25T05:43:05.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.778+0000 7f48b93a0700 1 -- start start 2021-06-25T05:43:05.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b93a0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b40612e0 0x7f48b40b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b93a0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48b40ad580 0x7f48b40abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b93a0700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48b4140400 0x7f48b40ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b93a0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b41527c0 con 0x7f48b40ad580 2021-06-25T05:43:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b93a0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4152a60 con 0x7f48b40612e0 2021-06-25T05:43:05.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b93a0700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4152d00 con 0x7f48b4140400 2021-06-25T05:43:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48ab7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48b40ad580 0x7f48b40abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48ab7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48b40ad580 0x7f48b40abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45090/0 (socket says 172.21.15.57:45090) 2021-06-25T05:43:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48ab7fe700 1 -- 172.21.15.57:0/506999052 learned_addr learned my addr 172.21.15.57:0/506999052 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:05.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b3fff700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b40612e0 0x7f48b40b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b8b9f700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48b4140400 0x7f48b40ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48ab7fe700 1 -- 172.21.15.57:0/506999052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48b4140400 msgr2=0x7f48b40ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48ab7fe700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48b4140400 0x7f48b40ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48ab7fe700 1 -- 172.21.15.57:0/506999052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b40612e0 msgr2=0x7f48b40b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48ab7fe700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b40612e0 0x7f48b40b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.797 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48ab7fe700 1 -- 172.21.15.57:0/506999052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c00b180 con 0x7f48b40ad580 2021-06-25T05:43:05.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48ab7fe700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48b40ad580 0x7f48b40abd80 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f489c002f70 tx=0x7f489c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b1ffb700 1 -- 172.21.15.57:0/506999052 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489c021070 con 0x7f48b40ad580 2021-06-25T05:43:05.798 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b93a0700 1 -- 172.21.15.57:0/506999052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b4152fa0 con 0x7f48b40ad580 2021-06-25T05:43:05.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b93a0700 1 -- 172.21.15.57:0/506999052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b40ac760 con 0x7f48b40ad580 2021-06-25T05:43:05.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b1ffb700 1 -- 172.21.15.57:0/506999052 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c000e90 con 0x7f48b40ad580 2021-06-25T05:43:05.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b1ffb700 1 -- 172.21.15.57:0/506999052 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489c00bed0 con 0x7f48b40ad580 2021-06-25T05:43:05.799 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.782+0000 7f48b93a0700 1 -- 172.21.15.57:0/506999052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f488c003660 con 0x7f48b40ad580 2021-06-25T05:43:05.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.786+0000 7f48b1ffb700 1 -- 172.21.15.57:0/506999052 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f489c00f070 con 0x7f48b40ad580 2021-06-25T05:43:05.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.786+0000 7f48b1ffb700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4898055340 0x7f4898057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.786+0000 7f48b1ffb700 1 -- 172.21.15.57:0/506999052 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f489c06efa0 con 0x7f48b40ad580 2021-06-25T05:43:05.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.786+0000 7f48b1ffb700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] conn(0x7f489805c000 0x7f489805e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.786+0000 7f48b1ffb700 1 -- 172.21.15.57:0/506999052 --> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f489805ea80 con 0x7f489805c000 2021-06-25T05:43:05.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.786+0000 7f48b1ffb700 1 -- 172.21.15.57:0/506999052 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7f489c071540 con 0x7f48b40ad580 2021-06-25T05:43:05.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.786+0000 7f48b3fff700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4898055340 0x7f4898057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.786+0000 7f48b8b9f700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] conn(0x7f489805c000 0x7f489805e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.786+0000 7f48b3fff700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4898055340 0x7f4898057800 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f48a400d000 tx=0x7f48a4009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.786+0000 7f48b8b9f700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] conn(0x7f489805c000 0x7f489805e420 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.786+0000 7f48b1ffb700 1 -- 172.21.15.57:0/506999052 <== osd.1 v2:172.21.15.57:6808/15206 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f489805ea80 con 0x7f489805c000 2021-06-25T05:43:05.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.806+0000 7f48b93a0700 1 -- 172.21.15.57:0/506999052 --> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f488c002870 con 0x7f489805c000 2021-06-25T05:43:05.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.806+0000 7f48b1ffb700 1 -- 172.21.15.57:0/506999052 <== osd.1 v2:172.21.15.57:6808/15206 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f488c002870 con 0x7f489805c000 2021-06-25T05:43:05.807 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T05:43:05.808 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-06-25T05:43:05.808 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T05:43:05.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.810+0000 7f48b93a0700 1 -- 172.21.15.57:0/506999052 >> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] conn(0x7f489805c000 msgr2=0x7f489805e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.810+0000 7f48b93a0700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.57:6808/15206,v1:172.21.15.57:6809/15206] conn(0x7f489805c000 0x7f489805e420 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.810+0000 7f48b93a0700 1 -- 172.21.15.57:0/506999052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4898055340 msgr2=0x7f4898057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.810+0000 7f48b93a0700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f4898055340 0x7f4898057800 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f48a400d000 tx=0x7f48a4009040).stop 2021-06-25T05:43:05.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.810+0000 7f48b93a0700 1 -- 172.21.15.57:0/506999052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48b40ad580 msgr2=0x7f48b40abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.810+0000 7f48b93a0700 1 --2- 172.21.15.57:0/506999052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48b40ad580 0x7f48b40abd80 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f489c002f70 tx=0x7f489c015000).stop 2021-06-25T05:43:05.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.810+0000 7f48b8b9f700 1 -- 172.21.15.57:0/506999052 reap_dead start 2021-06-25T05:43:05.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.810+0000 7f48b93a0700 1 -- 172.21.15.57:0/506999052 shutdown_connections 2021-06-25T05:43:05.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.810+0000 7f48b93a0700 1 -- 172.21.15.57:0/506999052 >> 172.21.15.57:0/506999052 conn(0x7f48b4066da0 msgr2=0x7f48b4140e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:05.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.810+0000 7f48b93a0700 1 -- 172.21.15.57:0/506999052 shutdown_connections 2021-06-25T05:43:05.813 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.810+0000 7f48b93a0700 1 -- 172.21.15.57:0/506999052 wait complete. 2021-06-25T05:43:05.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2021-06-25T05:43:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 Processor -- start 2021-06-25T05:43:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 -- start start 2021-06-25T05:43:05.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb200b1f90 0x7feb200619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.930 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb20066bc0 con 0x7feb20064b60 2021-06-25T05:43:05.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb20066e60 con 0x7feb20061eb0 2021-06-25T05:43:05.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb20066110 con 0x7feb200b1f90 2021-06-25T05:43:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2508b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7feb20064b60 0x7feb200b7de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34084/0 (socket says 172.21.15.57:34084) 2021-06-25T05:43:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2508b700 1 -- 172.21.15.57:0/3159068175 learned_addr learned my addr 172.21.15.57:0/3159068175 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2488a700 1 --2- 172.21.15.57:0/3159068175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb200b1f90 0x7feb200619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2488a700 1 -- 172.21.15.57:0/3159068175 >> v1:172.21.15.87:6789/0 conn(0x7feb20061eb0 legacy=0x7feb200b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2488a700 1 -- 172.21.15.57:0/3159068175 >> v1:172.21.15.57:6789/0 conn(0x7feb20064b60 legacy=0x7feb200b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb17fff700 1 -- 172.21.15.57:0/3159068175 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116305621 0 0) 0x7feb20066bc0 con 0x7feb20064b60 2021-06-25T05:43:05.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2488a700 1 -- 172.21.15.57:0/3159068175 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb20067100 con 0x7feb200b1f90 2021-06-25T05:43:05.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2488a700 1 --2- 172.21.15.57:0/3159068175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb200b1f90 0x7feb200619c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7feb180032f0 tx=0x7feb180091a0).ready entity=mon.2 client_cookie=f3fdbfa0e06c93f3 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb17fff700 1 -- 172.21.15.57:0/3159068175 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb18009ea0 con 0x7feb200b1f90 2021-06-25T05:43:05.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb17fff700 1 -- 172.21.15.57:0/3159068175 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1800b8a0 con 0x7feb200b1f90 2021-06-25T05:43:05.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb17fff700 1 -- 172.21.15.57:0/3159068175 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb1800ba10 con 0x7feb200b1f90 2021-06-25T05:43:05.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 -- 172.21.15.57:0/3159068175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb200b1f90 msgr2=0x7feb200619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 --2- 172.21.15.57:0/3159068175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb200b1f90 0x7feb200619c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7feb180032f0 tx=0x7feb180091a0).stop 2021-06-25T05:43:05.939 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 -- 172.21.15.57:0/3159068175 shutdown_connections 2021-06-25T05:43:05.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 --2- 172.21.15.57:0/3159068175 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb200b1f90 0x7feb200619c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 -- 172.21.15.57:0/3159068175 >> 172.21.15.57:0/3159068175 conn(0x7feb20062ba0 msgr2=0x7feb2005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:05.940 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 -- 172.21.15.57:0/3159068175 shutdown_connections 2021-06-25T05:43:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.930+0000 7feb2608d700 1 -- 172.21.15.57:0/3159068175 wait complete. 2021-06-25T05:43:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2608d700 1 Processor -- start 2021-06-25T05:43:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2608d700 1 -- start start 2021-06-25T05:43:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2608d700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb20061eb0 0x7feb200b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2608d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb20064b60 0x7feb201457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2608d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb200b1f90 0x7feb20145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.942 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2608d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200afb60 con 0x7feb20064b60 2021-06-25T05:43:05.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2608d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200b6e00 con 0x7feb200b1f90 2021-06-25T05:43:05.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2608d700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb200ae310 con 0x7feb20061eb0 2021-06-25T05:43:05.943 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2488a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb20064b60 0x7feb201457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2488a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb20064b60 0x7feb201457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45104/0 (socket says 172.21.15.57:45104) 2021-06-25T05:43:05.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2488a700 1 -- 172.21.15.57:0/1862249171 learned_addr learned my addr 172.21.15.57:0/1862249171 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:05.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2508b700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb20061eb0 0x7feb200b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.944 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2588c700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb200b1f90 0x7feb20145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2488a700 1 -- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb20061eb0 msgr2=0x7feb200b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2488a700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb20061eb0 0x7feb200b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.945 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2488a700 1 -- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb200b1f90 msgr2=0x7feb20145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:05.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2488a700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb200b1f90 0x7feb20145ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:05.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2488a700 1 -- 172.21.15.57:0/1862249171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb18009420 con 0x7feb20064b60 2021-06-25T05:43:05.946 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2488a700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb20064b60 0x7feb201457b0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7feb180032f0 tx=0x7feb18016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb167fc700 1 -- 172.21.15.57:0/1862249171 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb18006440 con 0x7feb20064b60 2021-06-25T05:43:05.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb167fc700 1 -- 172.21.15.57:0/1862249171 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb180065a0 con 0x7feb20064b60 2021-06-25T05:43:05.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb167fc700 1 -- 172.21.15.57:0/1862249171 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb18006900 con 0x7feb20064b60 2021-06-25T05:43:05.947 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2608d700 1 -- 172.21.15.57:0/1862249171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb200ac550 con 0x7feb20064b60 2021-06-25T05:43:05.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.934+0000 7feb2608d700 1 -- 172.21.15.57:0/1862249171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb200aca90 con 0x7feb20064b60 2021-06-25T05:43:05.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.938+0000 7feb2608d700 1 -- 172.21.15.57:0/1862249171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb200acc50 con 0x7feb20064b60 2021-06-25T05:43:05.948 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.938+0000 7feb167fc700 1 -- 172.21.15.57:0/1862249171 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7feb18027020 con 0x7feb20064b60 2021-06-25T05:43:05.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.938+0000 7feb167fc700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb00055450 0x7feb00057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:05.949 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.938+0000 7feb167fc700 1 -- 172.21.15.57:0/1862249171 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7feb1806eef0 con 0x7feb20064b60 2021-06-25T05:43:05.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.938+0000 7feb2508b700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb00055450 0x7feb00057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:05.950 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.938+0000 7feb2508b700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb00055450 0x7feb00057910 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7feb1c00d000 tx=0x7feb1c0011a0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:05.951 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:05.942+0000 7feb167fc700 1 -- 172.21.15.57:0/1862249171 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7feb180451f0 con 0x7feb20064b60 2021-06-25T05:43:06.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 -- 172.21.15.57:0/1862249171 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7feb20057310 con 0x7feb00055450 2021-06-25T05:43:06.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb167fc700 1 -- 172.21.15.57:0/1862249171 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feb20057310 con 0x7feb00055450 2021-06-25T05:43:06.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 -- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb00055450 msgr2=0x7feb00057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb00055450 0x7feb00057910 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7feb1c00d000 tx=0x7feb1c0011a0).stop 2021-06-25T05:43:06.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 -- 172.21.15.57:0/1862249171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb20064b60 msgr2=0x7feb201457b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb20064b60 0x7feb201457b0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7feb180032f0 tx=0x7feb18016000).stop 2021-06-25T05:43:06.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 -- 172.21.15.57:0/1862249171 shutdown_connections 2021-06-25T05:43:06.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7feb00055450 0x7feb00057910 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb200b1f90 0x7feb20145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb20064b60 0x7feb201457b0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 --2- 172.21.15.57:0/1862249171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb20061eb0 0x7feb200b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 -- 172.21.15.57:0/1862249171 >> 172.21.15.57:0/1862249171 conn(0x7feb20062ba0 msgr2=0x7feb20148680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:06.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 -- 172.21.15.57:0/1862249171 shutdown_connections 2021-06-25T05:43:06.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.066+0000 7feb2608d700 1 -- 172.21.15.57:0/1862249171 wait complete. 2021-06-25T05:43:06.071 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2021-06-25T05:43:06.079 INFO:tasks.ceph:Scrubbing osd.2 2021-06-25T05:43:06.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-06-25T05:43:06.193 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5385c75700 1 Processor -- start 2021-06-25T05:43:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5385c75700 1 -- start start 2021-06-25T05:43:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5385c75700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53800ad850 0x7f53800b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5385c75700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5380143b30 0x7f53800a8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5385c75700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538005c450 con 0x7f53800b2560 2021-06-25T05:43:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5385c75700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53800ae270 con 0x7f5380143b30 2021-06-25T05:43:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5385c75700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538005c680 con 0x7f53800ad850 2021-06-25T05:43:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5385474700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5380143b30 0x7f53800a8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5384c73700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f53800b2560 0x7f538013fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34098/0 (socket says 172.21.15.57:34098) 2021-06-25T05:43:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5384c73700 1 -- 172.21.15.57:0/3432592590 learned_addr learned my addr 172.21.15.57:0/3432592590 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5377fff700 1 --2- 172.21.15.57:0/3432592590 >> v2:172.21.15.87:3300/0 conn(0x7f53800ad850 0x7f53800b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5385474700 1 -- 172.21.15.57:0/3432592590 >> v2:172.21.15.87:3300/0 conn(0x7f53800ad850 msgr2=0x7f53800b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:06.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5385474700 1 --2- 172.21.15.57:0/3432592590 >> v2:172.21.15.87:3300/0 conn(0x7f53800ad850 0x7f53800b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f5385474700 1 -- 172.21.15.57:0/3432592590 >> v1:172.21.15.57:6789/0 conn(0x7f53800b2560 legacy=0x7f538013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385474700 1 -- 172.21.15.57:0/3432592590 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53801433f0 con 0x7f5380143b30 2021-06-25T05:43:06.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.194+0000 7f53777fe700 1 -- 172.21.15.57:0/3432592590 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333907559 0 0) 0x7f538005c450 con 0x7f53800b2560 2021-06-25T05:43:06.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385474700 1 --2- 172.21.15.57:0/3432592590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5380143b30 0x7f53800a8c10 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f53780032f0 tx=0x7f53780091d0).ready entity=mon.0 client_cookie=2621424e0a8c425 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f53777fe700 1 -- 172.21.15.57:0/3432592590 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f537800b680 con 0x7f5380143b30 2021-06-25T05:43:06.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f53777fe700 1 -- 172.21.15.57:0/3432592590 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537800b7e0 con 0x7f5380143b30 2021-06-25T05:43:06.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 -- 172.21.15.57:0/3432592590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5380143b30 msgr2=0x7f53800a8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f53777fe700 1 -- 172.21.15.57:0/3432592590 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f537800b950 con 0x7f5380143b30 2021-06-25T05:43:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 --2- 172.21.15.57:0/3432592590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5380143b30 0x7f53800a8c10 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f53780032f0 tx=0x7f53780091d0).stop 2021-06-25T05:43:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 -- 172.21.15.57:0/3432592590 shutdown_connections 2021-06-25T05:43:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 --2- 172.21.15.57:0/3432592590 >> v2:172.21.15.87:3300/0 conn(0x7f53800ad850 0x7f53800b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 --2- 172.21.15.57:0/3432592590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5380143b30 0x7f53800a8c10 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 -- 172.21.15.57:0/3432592590 >> 172.21.15.57:0/3432592590 conn(0x7f5380061190 msgr2=0x7f5380062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:06.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 -- 172.21.15.57:0/3432592590 shutdown_connections 2021-06-25T05:43:06.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 -- 172.21.15.57:0/3432592590 wait complete. 2021-06-25T05:43:06.211 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 Processor -- start 2021-06-25T05:43:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 -- start start 2021-06-25T05:43:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53800ad850 0x7f53800abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53800b2560 0x7f538013eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5380143b30 0x7f5380152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5380145380 con 0x7f53800b2560 2021-06-25T05:43:06.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53801447a0 con 0x7f5380143b30 2021-06-25T05:43:06.213 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385c75700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5380144500 con 0x7f53800ad850 2021-06-25T05:43:06.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5377fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53800b2560 0x7f538013eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5377fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53800b2560 0x7f538013eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45118/0 (socket says 172.21.15.57:45118) 2021-06-25T05:43:06.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5377fff700 1 -- 172.21.15.57:0/3478010938 learned_addr learned my addr 172.21.15.57:0/3478010938 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:06.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5385474700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5380143b30 0x7f5380152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5384c73700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53800ad850 0x7f53800abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5377fff700 1 -- 172.21.15.57:0/3478010938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53800ad850 msgr2=0x7f53800abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5377fff700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53800ad850 0x7f53800abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5377fff700 1 -- 172.21.15.57:0/3478010938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5380143b30 msgr2=0x7f5380152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5377fff700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5380143b30 0x7f5380152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.198+0000 7f5377fff700 1 -- 172.21.15.57:0/3478010938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5378009470 con 0x7f53800b2560 2021-06-25T05:43:06.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5377fff700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53800b2560 0x7f538013eee0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f537000c000 tx=0x7f5370006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5375ffb700 1 -- 172.21.15.57:0/3478010938 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5370010590 con 0x7f53800b2560 2021-06-25T05:43:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5375ffb700 1 -- 172.21.15.57:0/3478010938 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53700106f0 con 0x7f53800b2560 2021-06-25T05:43:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5385c75700 1 -- 172.21.15.57:0/3478010938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53800ab5a0 con 0x7f53800b2560 2021-06-25T05:43:06.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5375ffb700 1 -- 172.21.15.57:0/3478010938 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5370010a50 con 0x7f53800b2560 2021-06-25T05:43:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5385c75700 1 -- 172.21.15.57:0/3478010938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538013f3d0 con 0x7f53800b2560 2021-06-25T05:43:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5385c75700 1 -- 172.21.15.57:0/3478010938 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53800aba40 con 0x7f53800b2560 2021-06-25T05:43:06.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5375ffb700 1 -- 172.21.15.57:0/3478010938 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f5370010bb0 con 0x7f53800b2560 2021-06-25T05:43:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5375ffb700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5360055510 0x7f53600579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5375ffb700 1 -- 172.21.15.57:0/3478010938 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f537006dd30 con 0x7f53800b2560 2021-06-25T05:43:06.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5375ffb700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] conn(0x7f536005c2a0 0x7f536005e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5375ffb700 1 -- 172.21.15.57:0/3478010938 --> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f536005ec80 con 0x7f536005c2a0 2021-06-25T05:43:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5375ffb700 1 -- 172.21.15.57:0/3478010938 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5370070340 con 0x7f53800b2560 2021-06-25T05:43:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.202+0000 7f5384c73700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5360055510 0x7f53600579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.206+0000 7f5385474700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] conn(0x7f536005c2a0 0x7f536005e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.206+0000 7f5384c73700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5360055510 0x7f53600579d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f537c00b000 tx=0x7f537c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.206+0000 7f5385474700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] conn(0x7f536005c2a0 0x7f536005e6c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.206+0000 7f5375ffb700 1 -- 172.21.15.57:0/3478010938 <== osd.2 v2:172.21.15.57:6824/15216 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f536005ec80 con 0x7f536005c2a0 2021-06-25T05:43:06.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385c75700 1 -- 172.21.15.57:0/3478010938 --> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5380146680 con 0x7f536005c2a0 2021-06-25T05:43:06.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5375ffb700 1 -- 172.21.15.57:0/3478010938 <== osd.2 v2:172.21.15.57:6824/15216 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5380146680 con 0x7f536005c2a0 2021-06-25T05:43:06.225 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T05:43:06.225 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-06-25T05:43:06.226 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T05:43:06.227 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385c75700 1 -- 172.21.15.57:0/3478010938 >> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] conn(0x7f536005c2a0 msgr2=0x7f536005e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385c75700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.57:6824/15216,v1:172.21.15.57:6825/15216] conn(0x7f536005c2a0 0x7f536005e6c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385c75700 1 -- 172.21.15.57:0/3478010938 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5360055510 msgr2=0x7f53600579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.228 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385c75700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f5360055510 0x7f53600579d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f537c00b000 tx=0x7f537c009040).stop 2021-06-25T05:43:06.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385c75700 1 -- 172.21.15.57:0/3478010938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53800b2560 msgr2=0x7f538013eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385c75700 1 --2- 172.21.15.57:0/3478010938 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53800b2560 0x7f538013eee0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f537000c000 tx=0x7f5370006df0).stop 2021-06-25T05:43:06.229 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385474700 1 -- 172.21.15.57:0/3478010938 reap_dead start 2021-06-25T05:43:06.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385c75700 1 -- 172.21.15.57:0/3478010938 shutdown_connections 2021-06-25T05:43:06.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385c75700 1 -- 172.21.15.57:0/3478010938 >> 172.21.15.57:0/3478010938 conn(0x7f5380061190 msgr2=0x7f538005f670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:06.230 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385c75700 1 -- 172.21.15.57:0/3478010938 shutdown_connections 2021-06-25T05:43:06.231 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.226+0000 7f5385c75700 1 -- 172.21.15.57:0/3478010938 wait complete. 2021-06-25T05:43:06.240 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2021-06-25T05:43:06.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff07a005700 1 Processor -- start 2021-06-25T05:43:06.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff07a005700 1 -- start start 2021-06-25T05:43:06.350 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff07a005700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff074061640 0x7ff0740b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff07a005700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0740b68d0 con 0x7ff074143960 2021-06-25T05:43:06.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff07a005700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0740b6b70 con 0x7ff0740b46d0 2021-06-25T05:43:06.351 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff07a005700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0740b9640 con 0x7ff074061640 2021-06-25T05:43:06.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff079804700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff074143960 0x7ff07414d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34118/0 (socket says 172.21.15.57:34118) 2021-06-25T05:43:06.354 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff079804700 1 -- 172.21.15.57:0/2041956911 learned_addr learned my addr 172.21.15.57:0/2041956911 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:06.355 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff079003700 1 --2- 172.21.15.57:0/2041956911 >> v2:172.21.15.87:3300/0 conn(0x7ff074061640 0x7ff0740b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff073fff700 1 -- 172.21.15.57:0/2041956911 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896482242 0 0) 0x7ff0740b68d0 con 0x7ff074143960 2021-06-25T05:43:06.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff073fff700 1 -- 172.21.15.57:0/2041956911 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff054003260 con 0x7ff074143960 2021-06-25T05:43:06.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff079003700 1 -- 172.21.15.57:0/2041956911 >> v1:172.21.15.87:6789/0 conn(0x7ff0740b46d0 legacy=0x7ff07413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff079003700 1 -- 172.21.15.57:0/2041956911 >> v1:172.21.15.57:6789/0 conn(0x7ff074143960 legacy=0x7ff07414d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff079003700 1 -- 172.21.15.57:0/2041956911 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0740b6e10 con 0x7ff074061640 2021-06-25T05:43:06.358 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff079003700 1 --2- 172.21.15.57:0/2041956911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff074061640 0x7ff0740b9cd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7ff0640032f0 tx=0x7ff0640091d0).ready entity=mon.1 client_cookie=eecda3aec2376307 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.359 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff073fff700 1 -- 172.21.15.57:0/2041956911 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff06400b6c0 con 0x7ff074061640 2021-06-25T05:43:06.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff073fff700 1 -- 172.21.15.57:0/2041956911 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06400b820 con 0x7ff074061640 2021-06-25T05:43:06.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff073fff700 1 -- 172.21.15.57:0/2041956911 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff06400b990 con 0x7ff074061640 2021-06-25T05:43:06.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff07a005700 1 -- 172.21.15.57:0/2041956911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff074061640 msgr2=0x7ff0740b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.350+0000 7ff07a005700 1 --2- 172.21.15.57:0/2041956911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff074061640 0x7ff0740b9cd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7ff0640032f0 tx=0x7ff0640091d0).stop 2021-06-25T05:43:06.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 -- 172.21.15.57:0/2041956911 shutdown_connections 2021-06-25T05:43:06.367 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 --2- 172.21.15.57:0/2041956911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff074061640 0x7ff0740b9cd0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 -- 172.21.15.57:0/2041956911 >> 172.21.15.57:0/2041956911 conn(0x7ff07406adb0 msgr2=0x7ff07405f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 -- 172.21.15.57:0/2041956911 shutdown_connections 2021-06-25T05:43:06.368 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 -- 172.21.15.57:0/2041956911 wait complete. 2021-06-25T05:43:06.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 Processor -- start 2021-06-25T05:43:06.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 -- start start 2021-06-25T05:43:06.369 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff074061640 0x7ff074155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff074143960 0x7ff0741484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff074147eb0 0x7ff07413cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.370 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0741562b0 con 0x7ff074061640 2021-06-25T05:43:06.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0741489b0 con 0x7ff074147eb0 2021-06-25T05:43:06.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff07a005700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff074148fe0 con 0x7ff074143960 2021-06-25T05:43:06.371 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff079003700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff074061640 0x7ff074155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff079003700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff074061640 0x7ff074155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45134/0 (socket says 172.21.15.57:45134) 2021-06-25T05:43:06.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff079003700 1 -- 172.21.15.57:0/2814169852 learned_addr learned my addr 172.21.15.57:0/2814169852 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:06.372 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff078802700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff074143960 0x7ff0741484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.354+0000 7ff079804700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff074147eb0 0x7ff07413cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff079003700 1 -- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff074143960 msgr2=0x7ff0741484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff079003700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff074143960 0x7ff0741484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff079003700 1 -- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff074147eb0 msgr2=0x7ff07413cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff079003700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff074147eb0 0x7ff07413cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff079003700 1 -- 172.21.15.57:0/2814169852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff064009470 con 0x7ff074061640 2021-06-25T05:43:06.374 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff078802700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff074143960 0x7ff0741484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T05:43:06.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff079003700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff074061640 0x7ff074155dc0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7ff074148b40 tx=0x7ff064016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff0727fc700 1 -- 172.21.15.57:0/2814169852 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff064011d30 con 0x7ff074061640 2021-06-25T05:43:06.375 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff0727fc700 1 -- 172.21.15.57:0/2814169852 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff064011e90 con 0x7ff074061640 2021-06-25T05:43:06.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff07a005700 1 -- 172.21.15.57:0/2814169852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0741564e0 con 0x7ff074061640 2021-06-25T05:43:06.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff0727fc700 1 -- 172.21.15.57:0/2814169852 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff064021630 con 0x7ff074061640 2021-06-25T05:43:06.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff07a005700 1 -- 172.21.15.57:0/2814169852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07413ddc0 con 0x7ff074061640 2021-06-25T05:43:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff07a005700 1 -- 172.21.15.57:0/2814169852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff074057310 con 0x7ff074061640 2021-06-25T05:43:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff0727fc700 1 -- 172.21.15.57:0/2814169852 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7ff064027020 con 0x7ff074061640 2021-06-25T05:43:06.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff0727fc700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0580553f0 0x7ff0580578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff0727fc700 1 -- 172.21.15.57:0/2814169852 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ff06406ed70 con 0x7ff074061640 2021-06-25T05:43:06.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.358+0000 7ff078802700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0580553f0 0x7ff0580578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.362+0000 7ff078802700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0580553f0 0x7ff0580578b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7ff05c00d000 tx=0x7ff05c009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.366+0000 7ff0727fc700 1 -- 172.21.15.57:0/2814169852 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7ff064045200 con 0x7ff074061640 2021-06-25T05:43:06.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 -- 172.21.15.57:0/2814169852 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff074156980 con 0x7ff0580553f0 2021-06-25T05:43:06.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff0727fc700 1 -- 172.21.15.57:0/2814169852 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff05c00f680 con 0x7ff0580553f0 2021-06-25T05:43:06.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 -- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0580553f0 msgr2=0x7ff0580578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0580553f0 0x7ff0580578b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7ff05c00d000 tx=0x7ff05c009040).stop 2021-06-25T05:43:06.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 -- 172.21.15.57:0/2814169852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff074061640 msgr2=0x7ff074155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff074061640 0x7ff074155dc0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7ff074148b40 tx=0x7ff064016000).stop 2021-06-25T05:43:06.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 -- 172.21.15.57:0/2814169852 shutdown_connections 2021-06-25T05:43:06.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7ff0580553f0 0x7ff0580578b0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff074147eb0 0x7ff07413cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff074143960 0x7ff0741484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 --2- 172.21.15.57:0/2814169852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff074061640 0x7ff074155dc0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 -- 172.21.15.57:0/2814169852 >> 172.21.15.57:0/2814169852 conn(0x7ff07406adb0 msgr2=0x7ff074142080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:06.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 -- 172.21.15.57:0/2814169852 shutdown_connections 2021-06-25T05:43:06.498 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.494+0000 7ff07a005700 1 -- 172.21.15.57:0/2814169852 wait complete. 2021-06-25T05:43:06.498 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2021-06-25T05:43:06.505 INFO:tasks.ceph:Scrubbing osd.3 2021-06-25T05:43:06.506 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-06-25T05:43:06.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.614+0000 7fb7b5493700 1 Processor -- start 2021-06-25T05:43:06.615 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.614+0000 7fb7b5493700 1 -- start start 2021-06-25T05:43:06.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.618+0000 7fb7b5493700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb7b0066bf0 0x7fb7b014e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.618 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.618+0000 7fb7b5493700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b00652f0 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.618+0000 7fb7b5493700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b00b33a0 con 0x7fb7b00b2560 2021-06-25T05:43:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.618+0000 7fb7b5493700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b0061fc0 con 0x7fb7b0066bf0 2021-06-25T05:43:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.618+0000 7fb7b4c92700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb7b0066bf0 0x7fb7b014e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.618+0000 7fb7a7fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb7b00b2560 0x7fb7b00664e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:34876/0 (socket says 172.21.15.57:34876) 2021-06-25T05:43:06.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.618+0000 7fb7a7fff700 1 -- 172.21.15.57:0/3874372245 learned_addr learned my addr 172.21.15.57:0/3874372245 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:06.620 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.618+0000 7fb7b4c92700 1 -- 172.21.15.57:0/3874372245 >> v1:172.21.15.87:6789/0 conn(0x7fb7b00b2560 legacy=0x7fb7b00664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.618+0000 7fb7b4c92700 1 -- 172.21.15.57:0/3874372245 >> v1:172.21.15.57:6789/0 conn(0x7fb7b00b2fc0 legacy=0x7fb7b0060ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.621 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.618+0000 7fb7b4c92700 1 -- 172.21.15.57:0/3874372245 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b005fa20 con 0x7fb7b0066bf0 2021-06-25T05:43:06.622 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.618+0000 7fb7b4c92700 1 --2- 172.21.15.57:0/3874372245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b0066bf0 0x7fb7b014e8f0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fb7a80032f0 tx=0x7fb7a80091d0).ready entity=mon.0 client_cookie=821f04307c1e5889 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.622+0000 7fb7af7fe700 1 -- 172.21.15.57:0/3874372245 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a800b8a0 con 0x7fb7b0066bf0 2021-06-25T05:43:06.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.622+0000 7fb7af7fe700 1 -- 172.21.15.57:0/3874372245 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a800ba00 con 0x7fb7b0066bf0 2021-06-25T05:43:06.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.622+0000 7fb7af7fe700 1 -- 172.21.15.57:0/3874372245 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a800bb70 con 0x7fb7b0066bf0 2021-06-25T05:43:06.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.622+0000 7fb7b5493700 1 -- 172.21.15.57:0/3874372245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b0066bf0 msgr2=0x7fb7b014e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.625 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.622+0000 7fb7b5493700 1 --2- 172.21.15.57:0/3874372245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b0066bf0 0x7fb7b014e8f0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fb7a80032f0 tx=0x7fb7a80091d0).stop 2021-06-25T05:43:06.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 -- 172.21.15.57:0/3874372245 shutdown_connections 2021-06-25T05:43:06.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 --2- 172.21.15.57:0/3874372245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b0066bf0 0x7fb7b014e8f0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 -- 172.21.15.57:0/3874372245 >> 172.21.15.57:0/3874372245 conn(0x7fb7b00636a0 msgr2=0x7fb7b0063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:06.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 -- 172.21.15.57:0/3874372245 shutdown_connections 2021-06-25T05:43:06.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 -- 172.21.15.57:0/3874372245 wait complete. 2021-06-25T05:43:06.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 Processor -- start 2021-06-25T05:43:06.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 -- start start 2021-06-25T05:43:06.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b0066bf0 0x7fb7b00b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7b00b2560 0x7fb7b00a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b00b2fc0 0x7fb7b0155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00b4410 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00b46b0 con 0x7fb7b0066bf0 2021-06-25T05:43:06.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b5493700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00b4950 con 0x7fb7b00b2560 2021-06-25T05:43:06.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b4c92700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b00b2fc0 0x7fb7b0155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b4c92700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b00b2fc0 0x7fb7b0155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45152/0 (socket says 172.21.15.57:45152) 2021-06-25T05:43:06.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7b4c92700 1 -- 172.21.15.57:0/900773510 learned_addr learned my addr 172.21.15.57:0/900773510 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:06.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7a7fff700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7b00b2560 0x7fb7b00a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.626+0000 7fb7affff700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b0066bf0 0x7fb7b00b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7b4c92700 1 -- 172.21.15.57:0/900773510 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7b00b2560 msgr2=0x7fb7b00a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7b4c92700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7b00b2560 0x7fb7b00a3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7b4c92700 1 -- 172.21.15.57:0/900773510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b0066bf0 msgr2=0x7fb7b00b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7b4c92700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b0066bf0 0x7fb7b00b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7b4c92700 1 -- 172.21.15.57:0/900773510 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8009470 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7b4c92700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b00b2fc0 0x7fb7b0155a70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fb7a80032f0 tx=0x7fb7a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7adffb700 1 -- 172.21.15.57:0/900773510 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a8006ea0 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7adffb700 1 -- 172.21.15.57:0/900773510 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a8011e80 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7adffb700 1 -- 172.21.15.57:0/900773510 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a8021630 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7b5493700 1 -- 172.21.15.57:0/900773510 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b01555d0 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7b5493700 1 -- 172.21.15.57:0/900773510 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b0152080 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7b5493700 1 -- 172.21.15.57:0/900773510 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7b00a45f0 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7adffb700 1 -- 172.21.15.57:0/900773510 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fb7a8027020 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7adffb700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb794055340 0x7fb794057800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7adffb700 1 -- 172.21.15.57:0/900773510 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb7a806ef80 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7adffb700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] conn(0x7fb79405c170 0x7fb79405e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7adffb700 1 -- 172.21.15.57:0/900773510 --> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb79405ebf0 con 0x7fb79405c170 2021-06-25T05:43:06.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7adffb700 1 -- 172.21.15.57:0/900773510 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7a80715f0 con 0x7fb7b00b2fc0 2021-06-25T05:43:06.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7affff700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb794055340 0x7fb794057800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.630+0000 7fb7a7fff700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] conn(0x7fb79405c170 0x7fb79405e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.634+0000 7fb7a7fff700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] conn(0x7fb79405c170 0x7fb79405e590 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.634+0000 7fb7affff700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb794055340 0x7fb794057800 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fb7a000d000 tx=0x7fb7a0007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.634+0000 7fb7adffb700 1 -- 172.21.15.57:0/900773510 <== osd.3 v2:172.21.15.57:6816/15207 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fb79405ebf0 con 0x7fb79405c170 2021-06-25T05:43:06.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.650+0000 7fb7b5493700 1 -- 172.21.15.57:0/900773510 --> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb7b0156280 con 0x7fb79405c170 2021-06-25T05:43:06.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.650+0000 7fb7adffb700 1 -- 172.21.15.57:0/900773510 <== osd.3 v2:172.21.15.57:6816/15207 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb7b0156280 con 0x7fb79405c170 2021-06-25T05:43:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T05:43:06.651 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-06-25T05:43:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T05:43:06.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.650+0000 7fb7b5493700 1 -- 172.21.15.57:0/900773510 >> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] conn(0x7fb79405c170 msgr2=0x7fb79405e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.653 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.650+0000 7fb7b5493700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.57:6816/15207,v1:172.21.15.57:6817/15207] conn(0x7fb79405c170 0x7fb79405e590 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.650+0000 7fb7b5493700 1 -- 172.21.15.57:0/900773510 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb794055340 msgr2=0x7fb794057800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.650+0000 7fb7b5493700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fb794055340 0x7fb794057800 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fb7a000d000 tx=0x7fb7a0007b90).stop 2021-06-25T05:43:06.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.650+0000 7fb7b5493700 1 -- 172.21.15.57:0/900773510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b00b2fc0 msgr2=0x7fb7b0155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.650+0000 7fb7b5493700 1 --2- 172.21.15.57:0/900773510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7b00b2fc0 0x7fb7b0155a70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fb7a80032f0 tx=0x7fb7a8016000).stop 2021-06-25T05:43:06.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.650+0000 7fb7b4c92700 1 -- 172.21.15.57:0/900773510 reap_dead start 2021-06-25T05:43:06.655 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.650+0000 7fb7b5493700 1 -- 172.21.15.57:0/900773510 shutdown_connections 2021-06-25T05:43:06.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.650+0000 7fb7b5493700 1 -- 172.21.15.57:0/900773510 >> 172.21.15.57:0/900773510 conn(0x7fb7b00636a0 msgr2=0x7fb7b0063a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:06.657 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.654+0000 7fb7b5493700 1 -- 172.21.15.57:0/900773510 shutdown_connections 2021-06-25T05:43:06.659 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.654+0000 7fb7b5493700 1 -- 172.21.15.57:0/900773510 wait complete. 2021-06-25T05:43:06.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2021-06-25T05:43:06.766 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda850c8700 1 Processor -- start 2021-06-25T05:43:06.767 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda850c8700 1 -- start start 2021-06-25T05:43:06.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda850c8700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fda800670e0 0x7fda800b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda850c8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda80143970 0x7fda800aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda850c8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda800b9b90 con 0x7fda8013ffb0 2021-06-25T05:43:06.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda850c8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda80143040 con 0x7fda80143970 2021-06-25T05:43:06.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda850c8700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda800674c0 con 0x7fda800670e0 2021-06-25T05:43:06.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda77fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda80143970 0x7fda800aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda7f59e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fda8013ffb0 0x7fda80140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34148/0 (socket says 172.21.15.57:34148) 2021-06-25T05:43:06.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda7f59e700 1 -- 172.21.15.57:0/2589281072 learned_addr learned my addr 172.21.15.57:0/2589281072 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:06.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda77fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda80143970 0x7fda800aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45158/0 (socket says 172.21.15.57:45158) 2021-06-25T05:43:06.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.766+0000 7fda7ed9d700 1 --2- 172.21.15.57:0/2589281072 >> v2:172.21.15.87:3300/0 conn(0x7fda800670e0 0x7fda800b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda77fff700 1 -- 172.21.15.57:0/2589281072 >> v2:172.21.15.87:3300/0 conn(0x7fda800670e0 msgr2=0x7fda800b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:06.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda77fff700 1 --2- 172.21.15.57:0/2589281072 >> v2:172.21.15.87:3300/0 conn(0x7fda800670e0 0x7fda800b96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.772 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda77fff700 1 -- 172.21.15.57:0/2589281072 >> v1:172.21.15.57:6789/0 conn(0x7fda8013ffb0 legacy=0x7fda80140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda7e59c700 1 -- 172.21.15.57:0/2589281072 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488480532 0 0) 0x7fda78001490 con 0x7fda8013ffb0 2021-06-25T05:43:06.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda77fff700 1 -- 172.21.15.57:0/2589281072 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda800af490 con 0x7fda80143970 2021-06-25T05:43:06.773 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda77fff700 1 --2- 172.21.15.57:0/2589281072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda80143970 0x7fda800aebc0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7fda68002f70 tx=0x7fda68006df0).ready entity=mon.0 client_cookie=5d4f6f3d1ee40697 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda7e59c700 1 -- 172.21.15.57:0/2589281072 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6800d570 con 0x7fda80143970 2021-06-25T05:43:06.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda7e59c700 1 -- 172.21.15.57:0/2589281072 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda68000e90 con 0x7fda80143970 2021-06-25T05:43:06.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda7e59c700 1 -- 172.21.15.57:0/2589281072 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6800d8c0 con 0x7fda80143970 2021-06-25T05:43:06.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda850c8700 1 -- 172.21.15.57:0/2589281072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda80143970 msgr2=0x7fda800aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda850c8700 1 --2- 172.21.15.57:0/2589281072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda80143970 0x7fda800aebc0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7fda68002f70 tx=0x7fda68006df0).stop 2021-06-25T05:43:06.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda850c8700 1 -- 172.21.15.57:0/2589281072 shutdown_connections 2021-06-25T05:43:06.778 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda850c8700 1 --2- 172.21.15.57:0/2589281072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda80143970 0x7fda800aebc0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda850c8700 1 --2- 172.21.15.57:0/2589281072 >> v2:172.21.15.87:3300/0 conn(0x7fda800670e0 0x7fda800b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda850c8700 1 -- 172.21.15.57:0/2589281072 >> 172.21.15.57:0/2589281072 conn(0x7fda8005f9b0 msgr2=0x7fda80061660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:06.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda850c8700 1 -- 172.21.15.57:0/2589281072 shutdown_connections 2021-06-25T05:43:06.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda850c8700 1 -- 172.21.15.57:0/2589281072 wait complete. 2021-06-25T05:43:06.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda850c8700 1 Processor -- start 2021-06-25T05:43:06.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.770+0000 7fda850c8700 1 -- start start 2021-06-25T05:43:06.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda850c8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda800670e0 0x7fda8005cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.781 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda850c8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda8013ffb0 0x7fda800b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda850c8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda80143970 0x7fda801524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda850c8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda80144640 con 0x7fda80143970 2021-06-25T05:43:06.782 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda850c8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda80144870 con 0x7fda800670e0 2021-06-25T05:43:06.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda850c8700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda80144b10 con 0x7fda8013ffb0 2021-06-25T05:43:06.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda80143970 0x7fda801524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.783 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda80143970 0x7fda801524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45168/0 (socket says 172.21.15.57:45168) 2021-06-25T05:43:06.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7f59e700 1 -- 172.21.15.57:0/704334254 learned_addr learned my addr 172.21.15.57:0/704334254 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:06.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda77fff700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda8013ffb0 0x7fda800b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7ed9d700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda800670e0 0x7fda8005cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.784 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7f59e700 1 -- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda8013ffb0 msgr2=0x7fda800b90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7f59e700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda8013ffb0 0x7fda800b90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7f59e700 1 -- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda800670e0 msgr2=0x7fda8005cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.785 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7f59e700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda800670e0 0x7fda8005cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7f59e700 1 -- 172.21.15.57:0/704334254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6800b180 con 0x7fda80143970 2021-06-25T05:43:06.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7f59e700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda80143970 0x7fda801524c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fda78000f40 tx=0x7fda78007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.786 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7cd99700 1 -- 172.21.15.57:0/704334254 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda78005ba0 con 0x7fda80143970 2021-06-25T05:43:06.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7cd99700 1 -- 172.21.15.57:0/704334254 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda78005d00 con 0x7fda80143970 2021-06-25T05:43:06.787 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda850c8700 1 -- 172.21.15.57:0/704334254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda80144db0 con 0x7fda80143970 2021-06-25T05:43:06.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda7cd99700 1 -- 172.21.15.57:0/704334254 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda780072c0 con 0x7fda80143970 2021-06-25T05:43:06.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda850c8700 1 -- 172.21.15.57:0/704334254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda80151ff0 con 0x7fda80143970 2021-06-25T05:43:06.788 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.774+0000 7fda850c8700 1 -- 172.21.15.57:0/704334254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda80057310 con 0x7fda80143970 2021-06-25T05:43:06.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.778+0000 7fda7cd99700 1 -- 172.21.15.57:0/704334254 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fda7801a060 con 0x7fda80143970 2021-06-25T05:43:06.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.778+0000 7fda7cd99700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda64055450 0x7fda64057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:06.789 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.778+0000 7fda7cd99700 1 -- 172.21.15.57:0/704334254 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fda7806dcb0 con 0x7fda80143970 2021-06-25T05:43:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.778+0000 7fda7ed9d700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda64055450 0x7fda64057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.778+0000 7fda7ed9d700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda64055450 0x7fda64057910 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fda7000b000 tx=0x7fda70006df0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.782+0000 7fda7cd99700 1 -- 172.21.15.57:0/704334254 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fda78044030 con 0x7fda80143970 2021-06-25T05:43:06.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 -- 172.21.15.57:0/704334254 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fda800b9b90 con 0x7fda64055450 2021-06-25T05:43:06.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda7cd99700 1 -- 172.21.15.57:0/704334254 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fda800b9b90 con 0x7fda64055450 2021-06-25T05:43:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 -- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda64055450 msgr2=0x7fda64057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda64055450 0x7fda64057910 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fda7000b000 tx=0x7fda70006df0).stop 2021-06-25T05:43:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 -- 172.21.15.57:0/704334254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda80143970 msgr2=0x7fda801524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:06.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda80143970 0x7fda801524c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fda78000f40 tx=0x7fda78007be0).stop 2021-06-25T05:43:06.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 -- 172.21.15.57:0/704334254 shutdown_connections 2021-06-25T05:43:06.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fda64055450 0x7fda64057910 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda80143970 0x7fda801524c0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda8013ffb0 0x7fda800b90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 --2- 172.21.15.57:0/704334254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda800670e0 0x7fda8005cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:06.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 -- 172.21.15.57:0/704334254 >> 172.21.15.57:0/704334254 conn(0x7fda8005f9b0 msgr2=0x7fda801411e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:06.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 -- 172.21.15.57:0/704334254 shutdown_connections 2021-06-25T05:43:06.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:06.910+0000 7fda850c8700 1 -- 172.21.15.57:0/704334254 wait complete. 2021-06-25T05:43:06.915 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 3 to deep-scrub 2021-06-25T05:43:06.921 INFO:tasks.ceph:Scrubbing osd.4 2021-06-25T05:43:06.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-06-25T05:43:07.034 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.034+0000 7f1176f6b700 1 Processor -- start 2021-06-25T05:43:07.035 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.034+0000 7f1176f6b700 1 -- start start 2021-06-25T05:43:07.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1176f6b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f11700b06d0 0x7f1170142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.040 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1176f6b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11701438e0 con 0x7f11700b3090 2021-06-25T05:43:07.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1176f6b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700b0ab0 con 0x7f11700ace30 2021-06-25T05:43:07.041 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1176f6b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700ae640 con 0x7f11700b06d0 2021-06-25T05:43:07.042 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1175768700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f11700b3090 0x7f11701431d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34162/0 (socket says 172.21.15.57:34162) 2021-06-25T05:43:07.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1175768700 1 -- 172.21.15.57:0/432661880 learned_addr learned my addr 172.21.15.57:0/432661880 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:07.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1175f69700 1 --2- 172.21.15.57:0/432661880 >> v2:172.21.15.87:3300/0 conn(0x7f11700b06d0 0x7f1170142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.043 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349570837 0 0) 0x7f11701438e0 con 0x7f11700b3090 2021-06-25T05:43:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1158004370 con 0x7f11700b3090 2021-06-25T05:43:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880930233 0 0) 0x7f11700b0ab0 con 0x7f11700ace30 2021-06-25T05:43:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11701438e0 con 0x7f11700ace30 2021-06-25T05:43:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256564233 0 0) 0x7f1158004370 con 0x7f11700b3090 2021-06-25T05:43:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 >> v2:172.21.15.87:3300/0 conn(0x7f11700b06d0 msgr2=0x7f1170142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 --2- 172.21.15.57:0/432661880 >> v2:172.21.15.87:3300/0 conn(0x7f11700b06d0 0x7f1170142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 >> v1:172.21.15.87:6789/0 conn(0x7f11700ace30 legacy=0x7f117013f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700ae8e0 con 0x7f11700b3090 2021-06-25T05:43:07.046 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f1164001660 con 0x7f11700b3090 2021-06-25T05:43:07.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 >> v1:172.21.15.57:6789/0 conn(0x7f11700b3090 legacy=0x7f11701431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1158004a40 0x7f1158004e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.047 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1158005610 0x7f1158005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1158005f80 0x7f115800c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700ae640 con 0x7f1158005610 2021-06-25T05:43:07.048 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115800ceb0 con 0x7f1158005f80 2021-06-25T05:43:07.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115800d070 con 0x7f1158004a40 2021-06-25T05:43:07.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1175768700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1158005610 0x7f1158005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.049 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1175f69700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1158004a40 0x7f1158004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f117676a700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1158005f80 0x7f115800c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1175768700 1 -- 172.21.15.57:0/432661880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1158004a40 msgr2=0x7f1158004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:07.050 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1175768700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1158004a40 0x7f1158004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1175768700 1 -- 172.21.15.57:0/432661880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1158005f80 msgr2=0x7f115800c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:07.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1175768700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1158005f80 0x7f115800c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.051 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1175768700 1 -- 172.21.15.57:0/432661880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1158004370 con 0x7f1158005610 2021-06-25T05:43:07.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f117676a700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1158005f80 0x7f115800c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T05:43:07.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f117676a700 1 -- 172.21.15.57:0/432661880 reap_dead start 2021-06-25T05:43:07.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1175768700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1158005610 0x7f1158005a90 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f1164001430 tx=0x7f11700616e0).ready entity=mon.0 client_cookie=13b7b098b277ad1b server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.052 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11640070d0 con 0x7f1158005610 2021-06-25T05:43:07.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1164007230 con 0x7f1158005610 2021-06-25T05:43:07.053 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1174f67700 1 -- 172.21.15.57:0/432661880 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f116400c8f0 con 0x7f1158005610 2021-06-25T05:43:07.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1176f6b700 1 -- 172.21.15.57:0/432661880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1158005610 msgr2=0x7f1158005a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1176f6b700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1158005610 0x7f1158005a90 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f1164001430 tx=0x7f11700616e0).stop 2021-06-25T05:43:07.054 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1176f6b700 1 -- 172.21.15.57:0/432661880 shutdown_connections 2021-06-25T05:43:07.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1176f6b700 1 --2- 172.21.15.57:0/432661880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1158005610 0x7f1158005a90 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.038+0000 7f1176f6b700 1 -- 172.21.15.57:0/432661880 >> 172.21.15.57:0/432661880 conn(0x7f1170061100 msgr2=0x7f1170062dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:07.055 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.042+0000 7f1176f6b700 1 -- 172.21.15.57:0/432661880 shutdown_connections 2021-06-25T05:43:07.056 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.042+0000 7f1176f6b700 1 -- 172.21.15.57:0/432661880 wait complete. 2021-06-25T05:43:07.060 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.042+0000 7f1176f6b700 1 Processor -- start 2021-06-25T05:43:07.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.042+0000 7f1176f6b700 1 -- start start 2021-06-25T05:43:07.061 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1176f6b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1158005610 0x7f117013dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1176f6b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1170065020 0x7f1170066740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1176f6b700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1170063f30 0x7f1170066c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.062 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1176f6b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1170063ad0 con 0x7f1170065020 2021-06-25T05:43:07.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1176f6b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700b4a60 con 0x7f1158005610 2021-06-25T05:43:07.063 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1176f6b700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700b4d00 con 0x7f1170063f30 2021-06-25T05:43:07.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1175768700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1170065020 0x7f1170066740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1175768700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1170065020 0x7f1170066740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45186/0 (socket says 172.21.15.57:45186) 2021-06-25T05:43:07.064 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1175768700 1 -- 172.21.15.57:0/1943105422 learned_addr learned my addr 172.21.15.57:0/1943105422 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f117676a700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1170063f30 0x7f1170066c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1175f69700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1158005610 0x7f117013dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.065 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1175768700 1 -- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1170063f30 msgr2=0x7f1170066c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1175768700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1170063f30 0x7f1170066c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1175768700 1 -- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1158005610 msgr2=0x7f117013dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1175768700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1158005610 0x7f117013dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1175768700 1 -- 172.21.15.57:0/1943105422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700b4fa0 con 0x7f1170065020 2021-06-25T05:43:07.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1175768700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1170065020 0x7f1170066740 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f1164001430 tx=0x7f1164013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.067 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1162ffd700 1 -- 172.21.15.57:0/1943105422 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f116401a070 con 0x7f1170065020 2021-06-25T05:43:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1162ffd700 1 -- 172.21.15.57:0/1943105422 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116401b040 con 0x7f1170065020 2021-06-25T05:43:07.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1176f6b700 1 -- 172.21.15.57:0/1943105422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11700b55a0 con 0x7f1170065020 2021-06-25T05:43:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1162ffd700 1 -- 172.21.15.57:0/1943105422 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1164004520 con 0x7f1170065020 2021-06-25T05:43:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1176f6b700 1 -- 172.21.15.57:0/1943105422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11700675c0 con 0x7f1170065020 2021-06-25T05:43:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1176f6b700 1 -- 172.21.15.57:0/1943105422 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1170063c90 con 0x7f1170065020 2021-06-25T05:43:07.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.046+0000 7f1162ffd700 1 -- 172.21.15.57:0/1943105422 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f1164027070 con 0x7f1170065020 2021-06-25T05:43:07.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.050+0000 7f1162ffd700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1150055490 0x7f1150057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.050+0000 7f1162ffd700 1 -- 172.21.15.57:0/1943105422 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f116406e100 con 0x7f1170065020 2021-06-25T05:43:07.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.050+0000 7f1162ffd700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] conn(0x7f115005c220 0x7f115005e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.050+0000 7f1162ffd700 1 -- 172.21.15.57:0/1943105422 --> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f115005ec00 con 0x7f115005c220 2021-06-25T05:43:07.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.050+0000 7f1162ffd700 1 -- 172.21.15.57:0/1943105422 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1164070790 con 0x7f1170065020 2021-06-25T05:43:07.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.050+0000 7f1175f69700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1150055490 0x7f1150057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.050+0000 7f117676a700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] conn(0x7f115005c220 0x7f115005e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.050+0000 7f1175f69700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1150055490 0x7f1150057950 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f116c00b000 tx=0x7f116c0091d0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.050+0000 7f117676a700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] conn(0x7f115005c220 0x7f115005e640 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.050+0000 7f1162ffd700 1 -- 172.21.15.57:0/1943105422 <== osd.4 v2:172.21.15.87:6808/15528 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f115005ec00 con 0x7f115005c220 2021-06-25T05:43:07.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.070+0000 7f1176f6b700 1 -- 172.21.15.57:0/1943105422 --> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1170057310 con 0x7f115005c220 2021-06-25T05:43:07.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.070+0000 7f1162ffd700 1 -- 172.21.15.57:0/1943105422 <== osd.4 v2:172.21.15.87:6808/15528 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1170057310 con 0x7f115005c220 2021-06-25T05:43:07.075 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T05:43:07.075 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-06-25T05:43:07.076 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T05:43:07.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.070+0000 7f1176f6b700 1 -- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] conn(0x7f115005c220 msgr2=0x7f115005e640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.070+0000 7f1176f6b700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:6808/15528,v1:172.21.15.87:6809/15528] conn(0x7f115005c220 0x7f115005e640 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.070+0000 7f1176f6b700 1 -- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1150055490 msgr2=0x7f1150057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.070+0000 7f1176f6b700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f1150055490 0x7f1150057950 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f116c00b000 tx=0x7f116c0091d0).stop 2021-06-25T05:43:07.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.070+0000 7f1176f6b700 1 -- 172.21.15.57:0/1943105422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1170065020 msgr2=0x7f1170066740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.070+0000 7f1176f6b700 1 --2- 172.21.15.57:0/1943105422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1170065020 0x7f1170066740 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f1164001430 tx=0x7f1164013000).stop 2021-06-25T05:43:07.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.070+0000 7f117676a700 1 -- 172.21.15.57:0/1943105422 reap_dead start 2021-06-25T05:43:07.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.070+0000 7f1176f6b700 1 -- 172.21.15.57:0/1943105422 shutdown_connections 2021-06-25T05:43:07.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.070+0000 7f1176f6b700 1 -- 172.21.15.57:0/1943105422 >> 172.21.15.57:0/1943105422 conn(0x7f1170061100 msgr2=0x7f1170062cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:07.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.074+0000 7f1176f6b700 1 -- 172.21.15.57:0/1943105422 shutdown_connections 2021-06-25T05:43:07.080 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.074+0000 7f1176f6b700 1 -- 172.21.15.57:0/1943105422 wait complete. 2021-06-25T05:43:07.082 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-06-25T05:43:07.190 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.190+0000 7f25157d2700 1 Processor -- start 2021-06-25T05:43:07.191 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.190+0000 7f25157d2700 1 -- start start 2021-06-25T05:43:07.195 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.190+0000 7f25157d2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25100b5460 0x7f25100af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.190+0000 7f25157d2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25100b5840 con 0x7f25100b05d0 2021-06-25T05:43:07.196 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.190+0000 7f25157d2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25100ac7c0 con 0x7f2510147560 2021-06-25T05:43:07.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.190+0000 7f25157d2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25101452a0 con 0x7f25100b5460 2021-06-25T05:43:07.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f25100b05d0 0x7f2510067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34180/0 (socket says 172.21.15.57:34180) 2021-06-25T05:43:07.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250f7fe700 1 -- 172.21.15.57:0/3843105462 learned_addr learned my addr 172.21.15.57:0/3843105462 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:07.197 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250ffff700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25100b5460 0x7f25100af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780558129 0 0) 0x7f25100b5840 con 0x7f25100b05d0 2021-06-25T05:43:07.198 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24fc003260 con 0x7f25100b05d0 2021-06-25T05:43:07.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162923821 0 0) 0x7f25100ac7c0 con 0x7f2510147560 2021-06-25T05:43:07.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25100b5840 con 0x7f2510147560 2021-06-25T05:43:07.199 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1216943925 0 0) 0x7f24fc003260 con 0x7f25100b05d0 2021-06-25T05:43:07.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25100b5460 msgr2=0x7f25100af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:07.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25100b5460 0x7f25100af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.200 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 >> v1:172.21.15.87:6789/0 conn(0x7f2510147560 legacy=0x7f25100acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25100b19f0 con 0x7f25100b05d0 2021-06-25T05:43:07.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3909678725 0 0) 0x7f2500001660 con 0x7f25100b05d0 2021-06-25T05:43:07.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250ffff700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25100b5460 0x7f25100af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T05:43:07.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 >> v1:172.21.15.57:6789/0 conn(0x7f25100b05d0 legacy=0x7f2510067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25100b5460 0x7f24fc003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24fc003e00 0x7f24fc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24fc0049f0 0x7f24fc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25101452a0 con 0x7f24fc0049f0 2021-06-25T05:43:07.203 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc00b7b0 con 0x7f24fc003e00 2021-06-25T05:43:07.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc00b970 con 0x7f25100b5460 2021-06-25T05:43:07.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f2514fd1700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24fc0049f0 0x7f24fc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.204 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250f7fe700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24fc003e00 0x7f24fc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250ffff700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25100b5460 0x7f24fc003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f2514fd1700 1 -- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25100b5460 msgr2=0x7f24fc003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:07.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f2514fd1700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25100b5460 0x7f24fc003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.205 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f2514fd1700 1 -- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24fc003e00 msgr2=0x7f24fc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:07.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f2514fd1700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24fc003e00 0x7f24fc004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f2514fd1700 1 -- 172.21.15.57:0/3843105462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250400b180 con 0x7f24fc0049f0 2021-06-25T05:43:07.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f2514fd1700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24fc0049f0 0x7f24fc004e70 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f2508001490 tx=0x7f2508007d80).ready entity=mon.0 client_cookie=63c368c255193ca7 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2508001780 con 0x7f24fc0049f0 2021-06-25T05:43:07.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508006890 con 0x7f24fc0049f0 2021-06-25T05:43:07.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f250effd700 1 -- 172.21.15.57:0/3843105462 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2508006bf0 con 0x7f24fc0049f0 2021-06-25T05:43:07.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f25157d2700 1 -- 172.21.15.57:0/3843105462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24fc0049f0 msgr2=0x7f24fc004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f25157d2700 1 --2- 172.21.15.57:0/3843105462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24fc0049f0 0x7f24fc004e70 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f2508001490 tx=0x7f2508007d80).stop 2021-06-25T05:43:07.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f2514fd1700 1 -- 172.21.15.57:0/3843105462 reap_dead start 2021-06-25T05:43:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f25157d2700 1 -- 172.21.15.57:0/3843105462 shutdown_connections 2021-06-25T05:43:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f25157d2700 1 -- 172.21.15.57:0/3843105462 >> 172.21.15.57:0/3843105462 conn(0x7f2510062520 msgr2=0x7f2510062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:07.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f25157d2700 1 -- 172.21.15.57:0/3843105462 shutdown_connections 2021-06-25T05:43:07.210 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.194+0000 7f25157d2700 1 -- 172.21.15.57:0/3843105462 wait complete. 2021-06-25T05:43:07.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f25157d2700 1 Processor -- start 2021-06-25T05:43:07.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f25157d2700 1 -- start start 2021-06-25T05:43:07.214 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f25157d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2510140e50 0x7f2510143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f25157d2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2510143530 0x7f25101457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f25157d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2510143990 0x7f2510145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.215 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f25157d2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25100adfb0 con 0x7f2510140e50 2021-06-25T05:43:07.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f25157d2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25100b4700 con 0x7f2510143990 2021-06-25T05:43:07.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f25157d2700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2510140600 con 0x7f2510143530 2021-06-25T05:43:07.216 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2510140e50 0x7f2510143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2510140e50 0x7f2510143040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45206/0 (socket says 172.21.15.57:45206) 2021-06-25T05:43:07.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250ffff700 1 -- 172.21.15.57:0/1095049582 learned_addr learned my addr 172.21.15.57:0/1095049582 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:07.217 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f2514fd1700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2510143990 0x7f2510145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250f7fe700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2510143530 0x7f25101457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250ffff700 1 -- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2510143530 msgr2=0x7f25101457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.218 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250ffff700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2510143530 0x7f25101457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250ffff700 1 -- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2510143990 msgr2=0x7f2510145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250ffff700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2510143990 0x7f2510145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.219 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250ffff700 1 -- 172.21.15.57:0/1095049582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2510141230 con 0x7f2510140e50 2021-06-25T05:43:07.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250f7fe700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2510143530 0x7f25101457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T05:43:07.220 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250ffff700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2510140e50 0x7f2510143040 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f25101456f0 tx=0x7f2504006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250d7fa700 1 -- 172.21.15.57:0/1095049582 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f250400f940 con 0x7f2510140e50 2021-06-25T05:43:07.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250d7fa700 1 -- 172.21.15.57:0/1095049582 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250400faa0 con 0x7f2510140e50 2021-06-25T05:43:07.221 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f25157d2700 1 -- 172.21.15.57:0/1095049582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25101402a0 con 0x7f2510140e50 2021-06-25T05:43:07.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f250d7fa700 1 -- 172.21.15.57:0/1095049582 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f250400fc10 con 0x7f2510140e50 2021-06-25T05:43:07.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.198+0000 7f25157d2700 1 -- 172.21.15.57:0/1095049582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2510140830 con 0x7f2510140e50 2021-06-25T05:43:07.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.202+0000 7f250d7fa700 1 -- 172.21.15.57:0/1095049582 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f2504024070 con 0x7f2510140e50 2021-06-25T05:43:07.222 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.202+0000 7f25157d2700 1 -- 172.21.15.57:0/1095049582 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25100b33a0 con 0x7f2510140e50 2021-06-25T05:43:07.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.202+0000 7f250d7fa700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f24f0055360 0x7f24f0057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.223 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.202+0000 7f250d7fa700 1 -- 172.21.15.57:0/1095049582 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f250406e5f0 con 0x7f2510140e50 2021-06-25T05:43:07.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.202+0000 7f250f7fe700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f24f0055360 0x7f24f0057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.202+0000 7f250f7fe700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f24f0055360 0x7f24f0057820 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f2500005000 tx=0x7f2500009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.224 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.206+0000 7f250d7fa700 1 -- 172.21.15.57:0/1095049582 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f2504044a80 con 0x7f2510140e50 2021-06-25T05:43:07.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 -- 172.21.15.57:0/1095049582 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2510057310 con 0x7f24f0055360 2021-06-25T05:43:07.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f250d7fa700 1 -- 172.21.15.57:0/1095049582 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2510057310 con 0x7f24f0055360 2021-06-25T05:43:07.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 -- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f24f0055360 msgr2=0x7f24f0057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f24f0055360 0x7f24f0057820 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f2500005000 tx=0x7f2500009040).stop 2021-06-25T05:43:07.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 -- 172.21.15.57:0/1095049582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2510140e50 msgr2=0x7f2510143040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2510140e50 0x7f2510143040 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f25101456f0 tx=0x7f2504006df0).stop 2021-06-25T05:43:07.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 -- 172.21.15.57:0/1095049582 shutdown_connections 2021-06-25T05:43:07.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f24f0055360 0x7f24f0057820 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2510143990 0x7f2510145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2510143530 0x7f25101457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 --2- 172.21.15.57:0/1095049582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2510140e50 0x7f2510143040 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 -- 172.21.15.57:0/1095049582 >> 172.21.15.57:0/1095049582 conn(0x7f2510062520 msgr2=0x7f25100b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:07.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 -- 172.21.15.57:0/1095049582 shutdown_connections 2021-06-25T05:43:07.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.338+0000 7f25157d2700 1 -- 172.21.15.57:0/1095049582 wait complete. 2021-06-25T05:43:07.343 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 4 to deep-scrub 2021-06-25T05:43:07.349 INFO:tasks.ceph:Scrubbing osd.5 2021-06-25T05:43:07.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-06-25T05:43:07.462 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.462+0000 7fddd73b4700 1 Processor -- start 2021-06-25T05:43:07.463 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.462+0000 7fddd73b4700 1 -- start start 2021-06-25T05:43:07.465 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddd00612e0 0x7fddd00616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fddd00ad580 0x7fddd00b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd00aecb0 con 0x7fddd0140400 2021-06-25T05:43:07.466 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd00b6ee0 con 0x7fddd00ad580 2021-06-25T05:43:07.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00aeee0 con 0x7fddd00612e0 2021-06-25T05:43:07.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd63b2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddd00612e0 0x7fddd00616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.467 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd5bb1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fddd00ad580 0x7fddd00b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd6bb3700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fddd0140400 0x7fddd01464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:34948/0 (socket says 172.21.15.57:34948) 2021-06-25T05:43:07.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd6bb3700 1 -- 172.21.15.57:0/1621206658 learned_addr learned my addr 172.21.15.57:0/1621206658 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:07.468 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd63b2700 1 -- 172.21.15.57:0/1621206658 >> v2:172.21.15.87:3300/0 conn(0x7fddd00ad580 msgr2=0x7fddd00b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:07.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd63b2700 1 --2- 172.21.15.57:0/1621206658 >> v2:172.21.15.87:3300/0 conn(0x7fddd00ad580 0x7fddd00b9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd63b2700 1 -- 172.21.15.57:0/1621206658 >> v1:172.21.15.87:6789/0 conn(0x7fddd0140400 legacy=0x7fddd01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.469 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd63b2700 1 -- 172.21.15.57:0/1621206658 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00af180 con 0x7fddd00612e0 2021-06-25T05:43:07.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd63b2700 1 --2- 172.21.15.57:0/1621206658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddd00612e0 0x7fddd00616c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fddcc002f70 tx=0x7fddcc006df0).ready entity=mon.2 client_cookie=47c73c07b35080e4 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd53b0700 1 -- 172.21.15.57:0/1621206658 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddcc00d570 con 0x7fddd00612e0 2021-06-25T05:43:07.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd53b0700 1 -- 172.21.15.57:0/1621206658 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc000e90 con 0x7fddd00612e0 2021-06-25T05:43:07.470 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 -- 172.21.15.57:0/1621206658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddd00612e0 msgr2=0x7fddd00616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.471 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 --2- 172.21.15.57:0/1621206658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddd00612e0 0x7fddd00616c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fddcc002f70 tx=0x7fddcc006df0).stop 2021-06-25T05:43:07.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 -- 172.21.15.57:0/1621206658 shutdown_connections 2021-06-25T05:43:07.475 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 --2- 172.21.15.57:0/1621206658 >> v2:172.21.15.87:3300/0 conn(0x7fddd00ad580 0x7fddd00b9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 --2- 172.21.15.57:0/1621206658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddd00612e0 0x7fddd00616c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 -- 172.21.15.57:0/1621206658 >> 172.21.15.57:0/1621206658 conn(0x7fddd0066da0 msgr2=0x7fddd0067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:07.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 -- 172.21.15.57:0/1621206658 shutdown_connections 2021-06-25T05:43:07.476 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.466+0000 7fddd73b4700 1 -- 172.21.15.57:0/1621206658 wait complete. 2021-06-25T05:43:07.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd73b4700 1 Processor -- start 2021-06-25T05:43:07.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd73b4700 1 -- start start 2021-06-25T05:43:07.477 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd73b4700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddd00612e0 0x7fddd00ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd73b4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddd00ad580 0x7fddd00b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd73b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd0140400 0x7fddd0155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.478 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd73b4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd0153120 con 0x7fddd0140400 2021-06-25T05:43:07.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd73b4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00b0200 con 0x7fddd00ad580 2021-06-25T05:43:07.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd73b4700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd0153320 con 0x7fddd00612e0 2021-06-25T05:43:07.479 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd6bb3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd0140400 0x7fddd0155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd6bb3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd0140400 0x7fddd0155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45224/0 (socket says 172.21.15.57:45224) 2021-06-25T05:43:07.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd63b2700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddd00612e0 0x7fddd00ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd6bb3700 1 -- 172.21.15.57:0/3450511921 learned_addr learned my addr 172.21.15.57:0/3450511921 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:07.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd5bb1700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddd00ad580 0x7fddd00b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd6bb3700 1 -- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddd00612e0 msgr2=0x7fddd00ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd6bb3700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddd00612e0 0x7fddd00ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd6bb3700 1 -- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddd00ad580 msgr2=0x7fddd00b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd6bb3700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddd00ad580 0x7fddd00b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd6bb3700 1 -- 172.21.15.57:0/3450511921 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc00b180 con 0x7fddd0140400 2021-06-25T05:43:07.482 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd6bb3700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd0140400 0x7fddd0155dd0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7fddd00b6aa0 tx=0x7fddc80013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddbf7fe700 1 -- 172.21.15.57:0/3450511921 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc8005ba0 con 0x7fddd0140400 2021-06-25T05:43:07.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd73b4700 1 -- 172.21.15.57:0/3450511921 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd00ac030 con 0x7fddd0140400 2021-06-25T05:43:07.483 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddbf7fe700 1 -- 172.21.15.57:0/3450511921 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc8005d00 con 0x7fddd0140400 2021-06-25T05:43:07.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddbf7fe700 1 -- 172.21.15.57:0/3450511921 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc80072c0 con 0x7fddd0140400 2021-06-25T05:43:07.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.470+0000 7fddd73b4700 1 -- 172.21.15.57:0/3450511921 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd0153580 con 0x7fddd0140400 2021-06-25T05:43:07.484 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.474+0000 7fddd73b4700 1 -- 172.21.15.57:0/3450511921 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fddd0153740 con 0x7fddd0140400 2021-06-25T05:43:07.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.474+0000 7fddbf7fe700 1 -- 172.21.15.57:0/3450511921 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fddc8010070 con 0x7fddd0140400 2021-06-25T05:43:07.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.474+0000 7fddbf7fe700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fddb0055450 0x7fddb0057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.474+0000 7fddbf7fe700 1 -- 172.21.15.57:0/3450511921 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fddc806de50 con 0x7fddd0140400 2021-06-25T05:43:07.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.474+0000 7fddbf7fe700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] conn(0x7fddb005c1e0 0x7fddb005e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.474+0000 7fddbf7fe700 1 -- 172.21.15.57:0/3450511921 --> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fddb005ebc0 con 0x7fddb005c1e0 2021-06-25T05:43:07.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.474+0000 7fddd63b2700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fddb0055450 0x7fddb0057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.474+0000 7fddbf7fe700 1 -- 172.21.15.57:0/3450511921 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddc806e210 con 0x7fddd0140400 2021-06-25T05:43:07.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.474+0000 7fddd5bb1700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] conn(0x7fddb005c1e0 0x7fddb005e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.478+0000 7fddd63b2700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fddb0055450 0x7fddb0057910 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fddcc01a000 tx=0x7fddcc014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.478+0000 7fddd5bb1700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] conn(0x7fddb005c1e0 0x7fddb005e600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.478+0000 7fddbf7fe700 1 -- 172.21.15.57:0/3450511921 <== osd.5 v2:172.21.15.87:6824/15545 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fddb005ebc0 con 0x7fddb005c1e0 2021-06-25T05:43:07.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd73b4700 1 -- 172.21.15.57:0/3450511921 --> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fddd0057310 con 0x7fddb005c1e0 2021-06-25T05:43:07.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddbf7fe700 1 -- 172.21.15.57:0/3450511921 <== osd.5 v2:172.21.15.87:6824/15545 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fddd0057310 con 0x7fddb005c1e0 2021-06-25T05:43:07.497 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T05:43:07.498 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-06-25T05:43:07.498 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T05:43:07.499 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd73b4700 1 -- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] conn(0x7fddb005c1e0 msgr2=0x7fddb005e600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd73b4700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:6824/15545,v1:172.21.15.87:6825/15545] conn(0x7fddb005c1e0 0x7fddb005e600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd73b4700 1 -- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fddb0055450 msgr2=0x7fddb0057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd73b4700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fddb0055450 0x7fddb0057910 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fddcc01a000 tx=0x7fddcc014000).stop 2021-06-25T05:43:07.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd73b4700 1 -- 172.21.15.57:0/3450511921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd0140400 msgr2=0x7fddd0155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd73b4700 1 --2- 172.21.15.57:0/3450511921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd0140400 0x7fddd0155dd0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7fddd00b6aa0 tx=0x7fddc80013a0).stop 2021-06-25T05:43:07.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd6bb3700 1 -- 172.21.15.57:0/3450511921 reap_dead start 2021-06-25T05:43:07.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd73b4700 1 -- 172.21.15.57:0/3450511921 shutdown_connections 2021-06-25T05:43:07.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd73b4700 1 -- 172.21.15.57:0/3450511921 >> 172.21.15.57:0/3450511921 conn(0x7fddd0066da0 msgr2=0x7fddd0141710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:07.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd73b4700 1 -- 172.21.15.57:0/3450511921 shutdown_connections 2021-06-25T05:43:07.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.498+0000 7fddd73b4700 1 -- 172.21.15.57:0/3450511921 wait complete. 2021-06-25T05:43:07.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2021-06-25T05:43:07.623 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ffcc77700 1 Processor -- start 2021-06-25T05:43:07.624 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ffcc77700 1 -- start start 2021-06-25T05:43:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ffcc77700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ff80aea00 0x7f7ff8143770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ffcc77700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ff80acfc0 0x7f7ff8143c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.627 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ffcc77700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7ff80b0440 0x7f7ff8146af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ffcc77700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff80adc10 con 0x7f7ff80aea00 2021-06-25T05:43:07.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ffcc77700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff80b0950 con 0x7f7ff80b0440 2021-06-25T05:43:07.628 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ffcc77700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff81466c0 con 0x7f7ff80acfc0 2021-06-25T05:43:07.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff77fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ff80aea00 0x7f7ff8143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff77fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ff80aea00 0x7f7ff8143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45230/0 (socket says 172.21.15.57:45230) 2021-06-25T05:43:07.629 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff77fe700 1 -- 172.21.15.57:0/2525654614 learned_addr learned my addr 172.21.15.57:0/2525654614 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:07.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff7fff700 1 --2- 172.21.15.57:0/2525654614 >> v2:172.21.15.87:3300/0 conn(0x7f7ff80b0440 0x7f7ff8146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff6ffd700 1 --2- 172.21.15.57:0/2525654614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ff80acfc0 0x7f7ff8143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff77fe700 1 -- 172.21.15.57:0/2525654614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ff80acfc0 msgr2=0x7f7ff8143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff77fe700 1 --2- 172.21.15.57:0/2525654614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ff80acfc0 0x7f7ff8143c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff77fe700 1 -- 172.21.15.57:0/2525654614 >> v2:172.21.15.87:3300/0 conn(0x7f7ff80b0440 msgr2=0x7f7ff8146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:07.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff77fe700 1 --2- 172.21.15.57:0/2525654614 >> v2:172.21.15.87:3300/0 conn(0x7f7ff80b0440 0x7f7ff8146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff77fe700 1 -- 172.21.15.57:0/2525654614 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff80aede0 con 0x7f7ff80aea00 2021-06-25T05:43:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff77fe700 1 --2- 172.21.15.57:0/2525654614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff80aea00 0x7f7ff8143770 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f7fe8002f70 tx=0x7f7fe8006eb0).ready entity=mon.0 client_cookie=585eea661d6354ba server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff67fc700 1 -- 172.21.15.57:0/2525654614 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fe800d570 con 0x7f7ff80aea00 2021-06-25T05:43:07.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff67fc700 1 -- 172.21.15.57:0/2525654614 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe8000e90 con 0x7f7ff80aea00 2021-06-25T05:43:07.633 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ff67fc700 1 -- 172.21.15.57:0/2525654614 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fe800d900 con 0x7f7ff80aea00 2021-06-25T05:43:07.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ffcc77700 1 -- 172.21.15.57:0/2525654614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff80aea00 msgr2=0x7f7ff8143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.626+0000 7f7ffcc77700 1 --2- 172.21.15.57:0/2525654614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff80aea00 0x7f7ff8143770 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f7fe8002f70 tx=0x7f7fe8006eb0).stop 2021-06-25T05:43:07.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 -- 172.21.15.57:0/2525654614 shutdown_connections 2021-06-25T05:43:07.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 --2- 172.21.15.57:0/2525654614 >> v2:172.21.15.87:3300/0 conn(0x7f7ff80b0440 0x7f7ff8146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 --2- 172.21.15.57:0/2525654614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ff80acfc0 0x7f7ff8143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 --2- 172.21.15.57:0/2525654614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff80aea00 0x7f7ff8143770 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 -- 172.21.15.57:0/2525654614 >> 172.21.15.57:0/2525654614 conn(0x7f7ff80611f0 msgr2=0x7f7ff8062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 -- 172.21.15.57:0/2525654614 shutdown_connections 2021-06-25T05:43:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 -- 172.21.15.57:0/2525654614 wait complete. 2021-06-25T05:43:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 Processor -- start 2021-06-25T05:43:07.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 -- start start 2021-06-25T05:43:07.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff80acfc0 0x7f7ff8145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.642 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ff80aea00 0x7f7ff813acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff80b0440 0x7f7ff813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.643 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8141ac0 con 0x7f7ff80b0440 2021-06-25T05:43:07.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8141cb0 con 0x7f7ff80acfc0 2021-06-25T05:43:07.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ffcc77700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff81421e0 con 0x7f7ff80aea00 2021-06-25T05:43:07.644 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ff7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff80b0440 0x7f7ff813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ff6ffd700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ff80aea00 0x7f7ff813acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ff7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff80b0440 0x7f7ff813b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45240/0 (socket says 172.21.15.57:45240) 2021-06-25T05:43:07.645 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ff7fff700 1 -- 172.21.15.57:0/1736861274 learned_addr learned my addr 172.21.15.57:0/1736861274 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:07.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.630+0000 7f7ff77fe700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff80acfc0 0x7f7ff8145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff7fff700 1 -- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ff80aea00 msgr2=0x7f7ff813acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.646 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff7fff700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ff80aea00 0x7f7ff813acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff7fff700 1 -- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff80acfc0 msgr2=0x7f7ff8145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.647 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff7fff700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff80acfc0 0x7f7ff8145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff7fff700 1 -- 172.21.15.57:0/1736861274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe800b1e0 con 0x7f7ff80b0440 2021-06-25T05:43:07.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff7fff700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff80b0440 0x7f7ff813b1a0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7f7ff0006e00 tx=0x7f7ff00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.648 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff4ff9700 1 -- 172.21.15.57:0/1736861274 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff000c670 con 0x7f7ff80b0440 2021-06-25T05:43:07.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff4ff9700 1 -- 172.21.15.57:0/1736861274 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff000c7d0 con 0x7f7ff80b0440 2021-06-25T05:43:07.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ffcc77700 1 -- 172.21.15.57:0/1736861274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff8142480 con 0x7f7ff80b0440 2021-06-25T05:43:07.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff4ff9700 1 -- 172.21.15.57:0/1736861274 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff000cb30 con 0x7f7ff80b0440 2021-06-25T05:43:07.649 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ffcc77700 1 -- 172.21.15.57:0/1736861274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff805fb30 con 0x7f7ff80b0440 2021-06-25T05:43:07.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ffcc77700 1 -- 172.21.15.57:0/1736861274 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff8141860 con 0x7f7ff80b0440 2021-06-25T05:43:07.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff4ff9700 1 -- 172.21.15.57:0/1736861274 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f7ff0022070 con 0x7f7ff80b0440 2021-06-25T05:43:07.650 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff4ff9700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fd80553f0 0x7f7fd80578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff4ff9700 1 -- 172.21.15.57:0/1736861274 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f7ff006e160 con 0x7f7ff80b0440 2021-06-25T05:43:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.634+0000 7f7ff77fe700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fd80553f0 0x7f7fd80578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.652 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.638+0000 7f7ff77fe700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fd80553f0 0x7f7fd80578b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f7fe801b000 tx=0x7f7fe8015000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.654 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.642+0000 7f7ff4ff9700 1 -- 172.21.15.57:0/1736861274 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f7ff00445f0 con 0x7f7ff80b0440 2021-06-25T05:43:07.764 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.766+0000 7f7ffcc77700 1 -- 172.21.15.57:0/1736861274 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ff813b830 con 0x7f7fd80553f0 2021-06-25T05:43:07.765 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.766+0000 7f7ff4ff9700 1 -- 172.21.15.57:0/1736861274 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7fe800db70 con 0x7f7fd80553f0 2021-06-25T05:43:07.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 -- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fd80553f0 msgr2=0x7f7fd80578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.768 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fd80553f0 0x7f7fd80578b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f7fe801b000 tx=0x7f7fe8015000).stop 2021-06-25T05:43:07.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 -- 172.21.15.57:0/1736861274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff80b0440 msgr2=0x7f7ff813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff80b0440 0x7f7ff813b1a0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7f7ff0006e00 tx=0x7f7ff00091d0).stop 2021-06-25T05:43:07.769 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 -- 172.21.15.57:0/1736861274 shutdown_connections 2021-06-25T05:43:07.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f7fd80553f0 0x7f7fd80578b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ff80b0440 0x7f7ff813b1a0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.770 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ff80aea00 0x7f7ff813acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 --2- 172.21.15.57:0/1736861274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff80acfc0 0x7f7ff8145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.771 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 -- 172.21.15.57:0/1736861274 >> 172.21.15.57:0/1736861274 conn(0x7f7ff80611f0 msgr2=0x7f7ff813ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:07.774 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 -- 172.21.15.57:0/1736861274 shutdown_connections 2021-06-25T05:43:07.775 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.770+0000 7f7ffcc77700 1 -- 172.21.15.57:0/1736861274 wait complete. 2021-06-25T05:43:07.776 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 5 to deep-scrub 2021-06-25T05:43:07.784 INFO:tasks.ceph:Scrubbing osd.6 2021-06-25T05:43:07.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-06-25T05:43:07.897 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.898+0000 7fafa421c700 1 Processor -- start 2021-06-25T05:43:07.898 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.898+0000 7fafa421c700 1 -- start start 2021-06-25T05:43:07.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.898+0000 7fafa421c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf9c0b5bb0 0x7faf9c0b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.899 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.898+0000 7fafa421c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c144070 con 0x7faf9c0b6540 2021-06-25T05:43:07.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.898+0000 7fafa421c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c0b6e10 con 0x7faf9c0b4380 2021-06-25T05:43:07.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.898+0000 7fafa421c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c143b30 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.900 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.898+0000 7fafa27b9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf9c0b5bb0 0x7faf9c0b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.901 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.898+0000 7fafa1fb8700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faf9c0b6540 0x7faf9c061cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34230/0 (socket says 172.21.15.57:34230) 2021-06-25T05:43:07.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.898+0000 7fafa1fb8700 1 -- 172.21.15.57:0/2748340951 learned_addr learned my addr 172.21.15.57:0/2748340951 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:07.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.898+0000 7fafa27b9700 1 -- 172.21.15.57:0/2748340951 >> v1:172.21.15.87:6789/0 conn(0x7faf9c0b4380 legacy=0x7faf9c12b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.902 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa27b9700 1 -- 172.21.15.57:0/2748340951 >> v1:172.21.15.57:6789/0 conn(0x7faf9c0b6540 legacy=0x7faf9c061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa27b9700 1 -- 172.21.15.57:0/2748340951 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c143dd0 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.903 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa27b9700 1 --2- 172.21.15.57:0/2748340951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0b5bb0 0x7faf9c0b6920 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7faf940032f0 tx=0x7faf940091d0).ready entity=mon.0 client_cookie=c73aad289d95240e server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa0fb6700 1 -- 172.21.15.57:0/2748340951 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf94009ea0 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa0fb6700 1 -- 172.21.15.57:0/2748340951 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9400b8a0 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.907 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa0fb6700 1 -- 172.21.15.57:0/2748340951 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf9400ba10 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa421c700 1 -- 172.21.15.57:0/2748340951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0b5bb0 msgr2=0x7faf9c0b6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa421c700 1 --2- 172.21.15.57:0/2748340951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0b5bb0 0x7faf9c0b6920 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7faf940032f0 tx=0x7faf940091d0).stop 2021-06-25T05:43:07.908 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa421c700 1 -- 172.21.15.57:0/2748340951 shutdown_connections 2021-06-25T05:43:07.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa421c700 1 --2- 172.21.15.57:0/2748340951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0b5bb0 0x7faf9c0b6920 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa421c700 1 -- 172.21.15.57:0/2748340951 >> 172.21.15.57:0/2748340951 conn(0x7faf9c05c450 msgr2=0x7faf9c05c860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:07.909 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa421c700 1 -- 172.21.15.57:0/2748340951 shutdown_connections 2021-06-25T05:43:07.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.902+0000 7fafa421c700 1 -- 172.21.15.57:0/2748340951 wait complete. 2021-06-25T05:43:07.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa421c700 1 Processor -- start 2021-06-25T05:43:07.910 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa421c700 1 -- start start 2021-06-25T05:43:07.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa421c700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf9c0b4380 0x7faf9c12a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.911 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa421c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0b5bb0 0x7faf9c0af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa421c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf9c0b6540 0x7faf9c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.912 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa421c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c155bf0 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa421c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0af180 con 0x7faf9c0b6540 2021-06-25T05:43:07.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa421c700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c155950 con 0x7faf9c0b4380 2021-06-25T05:43:07.913 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa17b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0b5bb0 0x7faf9c0af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa17b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0b5bb0 0x7faf9c0af880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45252/0 (socket says 172.21.15.57:45252) 2021-06-25T05:43:07.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa17b7700 1 -- 172.21.15.57:0/3634559967 learned_addr learned my addr 172.21.15.57:0/3634559967 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:07.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa1fb8700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf9c0b4380 0x7faf9c12a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.914 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa27b9700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf9c0b6540 0x7faf9c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa17b7700 1 -- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf9c0b4380 msgr2=0x7faf9c12a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa17b7700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf9c0b4380 0x7faf9c12a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.915 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa17b7700 1 -- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf9c0b6540 msgr2=0x7faf9c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa17b7700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf9c0b6540 0x7faf9c0ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa17b7700 1 -- 172.21.15.57:0/3634559967 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94009470 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.916 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa17b7700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0b5bb0 0x7faf9c0af880 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7faf9c060870 tx=0x7faf90007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7faf8effd700 1 -- 172.21.15.57:0/3634559967 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf90012400 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7faf8effd700 1 -- 172.21.15.57:0/3634559967 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf90012560 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7fafa421c700 1 -- 172.21.15.57:0/3634559967 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c0af3e0 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.917 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.906+0000 7faf8effd700 1 -- 172.21.15.57:0/3634559967 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf900128c0 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.918 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.910+0000 7fafa421c700 1 -- 172.21.15.57:0/3634559967 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c0b7640 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.919 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.910+0000 7fafa421c700 1 -- 172.21.15.57:0/3634559967 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf9c0af5c0 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.910+0000 7faf8effd700 1 -- 172.21.15.57:0/3634559967 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7faf90019030 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.910+0000 7faf8effd700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faf7c0553d0 0x7faf7c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.910+0000 7faf8effd700 1 -- 172.21.15.57:0/3634559967 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7faf9006cee0 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.910+0000 7faf8effd700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] conn(0x7faf7c05c160 0x7faf7c05e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:07.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.910+0000 7fafa1fb8700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faf7c0553d0 0x7faf7c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.921 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.910+0000 7faf8effd700 1 -- 172.21.15.57:0/3634559967 --> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf7c05ebe0 con 0x7faf7c05c160 2021-06-25T05:43:07.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.910+0000 7faf8effd700 1 -- 172.21.15.57:0/3634559967 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf9006f570 con 0x7faf9c0b5bb0 2021-06-25T05:43:07.922 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.910+0000 7fafa27b9700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] conn(0x7faf7c05c160 0x7faf7c05e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:07.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.914+0000 7fafa1fb8700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faf7c0553d0 0x7faf7c057890 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7faf9800d000 tx=0x7faf98000bc0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.914+0000 7fafa27b9700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] conn(0x7faf7c05c160 0x7faf7c05e580 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:07.923 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.914+0000 7faf8effd700 1 -- 172.21.15.57:0/3634559967 <== osd.6 v2:172.21.15.87:6816/15529 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7faf7c05ebe0 con 0x7faf7c05c160 2021-06-25T05:43:07.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.930+0000 7fafa421c700 1 -- 172.21.15.57:0/3634559967 --> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faf9c0aee50 con 0x7faf7c05c160 2021-06-25T05:43:07.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7faf8effd700 1 -- 172.21.15.57:0/3634559967 <== osd.6 v2:172.21.15.87:6816/15529 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7faf9c0aee50 con 0x7faf7c05c160 2021-06-25T05:43:07.932 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T05:43:07.932 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-06-25T05:43:07.933 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T05:43:07.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7fafa421c700 1 -- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] conn(0x7faf7c05c160 msgr2=0x7faf7c05e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7fafa421c700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:6816/15529,v1:172.21.15.87:6817/15529] conn(0x7faf7c05c160 0x7faf7c05e580 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:07.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7fafa421c700 1 -- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faf7c0553d0 msgr2=0x7faf7c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7fafa421c700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7faf7c0553d0 0x7faf7c057890 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7faf9800d000 tx=0x7faf98000bc0).stop 2021-06-25T05:43:07.935 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7fafa421c700 1 -- 172.21.15.57:0/3634559967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0b5bb0 msgr2=0x7faf9c0af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:07.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7fafa421c700 1 --2- 172.21.15.57:0/3634559967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0b5bb0 0x7faf9c0af880 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7faf9c060870 tx=0x7faf90007c20).stop 2021-06-25T05:43:07.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7fafa27b9700 1 -- 172.21.15.57:0/3634559967 reap_dead start 2021-06-25T05:43:07.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7fafa421c700 1 -- 172.21.15.57:0/3634559967 shutdown_connections 2021-06-25T05:43:07.936 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7fafa421c700 1 -- 172.21.15.57:0/3634559967 >> 172.21.15.57:0/3634559967 conn(0x7faf9c05c450 msgr2=0x7faf9c1282d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:07.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7fafa421c700 1 -- 172.21.15.57:0/3634559967 shutdown_connections 2021-06-25T05:43:07.937 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:07.934+0000 7fafa421c700 1 -- 172.21.15.57:0/3634559967 wait complete. 2021-06-25T05:43:07.948 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2021-06-25T05:43:08.058 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.058+0000 7efdc125f700 1 Processor -- start 2021-06-25T05:43:08.059 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.058+0000 7efdc125f700 1 -- start start 2021-06-25T05:43:08.066 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdbc0aea00 0x7efdbc143770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efdbc0b0440 0x7efdbc143c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.068 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc0b0950 con 0x7efdbc0acfc0 2021-06-25T05:43:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc0adc10 con 0x7efdbc0b0440 2021-06-25T05:43:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0aede0 con 0x7efdbc0aea00 2021-06-25T05:43:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdbb7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efdbc0acfc0 0x7efdbc146af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34246/0 (socket says 172.21.15.57:34246) 2021-06-25T05:43:08.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdbb7fe700 1 -- 172.21.15.57:0/3112351979 learned_addr learned my addr 172.21.15.57:0/3112351979 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:08.070 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdbbfff700 1 --2- 172.21.15.57:0/3112351979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdbc0aea00 0x7efdbc143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc0a5e700 1 --2- 172.21.15.57:0/3112351979 >> v2:172.21.15.87:3300/0 conn(0x7efdbc0b0440 0x7efdbc143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.071 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdbaffd700 1 -- 172.21.15.57:0/3112351979 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701858663 0 0) 0x7efdbc0b0950 con 0x7efdbc0acfc0 2021-06-25T05:43:08.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdbaffd700 1 -- 172.21.15.57:0/3112351979 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda8003260 con 0x7efdbc0acfc0 2021-06-25T05:43:08.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdbaffd700 1 -- 172.21.15.57:0/3112351979 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 432272058 0 0) 0x7efda8003260 con 0x7efdbc0acfc0 2021-06-25T05:43:08.072 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc0a5e700 1 -- 172.21.15.57:0/3112351979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdbc0aea00 msgr2=0x7efdbc143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:08.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc0a5e700 1 --2- 172.21.15.57:0/3112351979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdbc0aea00 0x7efdbc143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.073 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc0a5e700 1 -- 172.21.15.57:0/3112351979 >> v1:172.21.15.57:6789/0 conn(0x7efdbc0acfc0 legacy=0x7efdbc146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc0a5e700 1 -- 172.21.15.57:0/3112351979 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc1466c0 con 0x7efdbc0b0440 2021-06-25T05:43:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdbbfff700 1 --2- 172.21.15.57:0/3112351979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdbc0aea00 0x7efdbc143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T05:43:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc0a5e700 1 --2- 172.21.15.57:0/3112351979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdbc0b0440 0x7efdbc143c60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7efdb0001800 tx=0x7efdb40091d0).ready entity=mon.1 client_cookie=423a451f7638227d server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdbaffd700 1 -- 172.21.15.57:0/3112351979 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdb0001660 con 0x7efdbc0b0440 2021-06-25T05:43:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdbaffd700 1 -- 172.21.15.57:0/3112351979 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb400f510 con 0x7efdbc0b0440 2021-06-25T05:43:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdbaffd700 1 -- 172.21.15.57:0/3112351979 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdb400f680 con 0x7efdbc0b0440 2021-06-25T05:43:08.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 -- 172.21.15.57:0/3112351979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdbc0b0440 msgr2=0x7efdbc143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.076 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 --2- 172.21.15.57:0/3112351979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdbc0b0440 0x7efdbc143c60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7efdb0001800 tx=0x7efdb40091d0).stop 2021-06-25T05:43:08.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 -- 172.21.15.57:0/3112351979 shutdown_connections 2021-06-25T05:43:08.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 --2- 172.21.15.57:0/3112351979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdbc0b0440 0x7efdbc143c60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.077 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 --2- 172.21.15.57:0/3112351979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdbc0aea00 0x7efdbc143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 -- 172.21.15.57:0/3112351979 >> 172.21.15.57:0/3112351979 conn(0x7efdbc0611f0 msgr2=0x7efdbc062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:08.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 -- 172.21.15.57:0/3112351979 shutdown_connections 2021-06-25T05:43:08.078 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.062+0000 7efdc125f700 1 -- 172.21.15.57:0/3112351979 wait complete. 2021-06-25T05:43:08.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.066+0000 7efdc125f700 1 Processor -- start 2021-06-25T05:43:08.079 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.066+0000 7efdc125f700 1 -- start start 2021-06-25T05:43:08.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.066+0000 7efdc125f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdbc0acfc0 0x7efdbc155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.066+0000 7efdc125f700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdbc0aea00 0x7efdbc145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.083 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.066+0000 7efdc125f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdbc0b0440 0x7efdbc152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdc125f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc142e80 con 0x7efdbc0acfc0 2021-06-25T05:43:08.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdc125f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc152640 con 0x7efdbc0b0440 2021-06-25T05:43:08.084 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdc125f700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0b4740 con 0x7efdbc0aea00 2021-06-25T05:43:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdbbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdbc0acfc0 0x7efdbc155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.085 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdbbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdbc0acfc0 0x7efdbc155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45266/0 (socket says 172.21.15.57:45266) 2021-06-25T05:43:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdbbfff700 1 -- 172.21.15.57:0/3312631946 learned_addr learned my addr 172.21.15.57:0/3312631946 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdc0a5e700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdbc0b0440 0x7efdbc152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdbb7fe700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdbc0aea00 0x7efdbc145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdbbfff700 1 -- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdbc0aea00 msgr2=0x7efdbc145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.087 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdbbfff700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdbc0aea00 0x7efdbc145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdbbfff700 1 -- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdbc0b0440 msgr2=0x7efdbc152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdbbfff700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdbc0b0440 0x7efdbc152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.088 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdbbfff700 1 -- 172.21.15.57:0/3312631946 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac00b180 con 0x7efdbc0acfc0 2021-06-25T05:43:08.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdbbfff700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdbc0acfc0 0x7efdbc155a80 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7efdac00c000 tx=0x7efdac006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.089 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdb97fa700 1 -- 172.21.15.57:0/3312631946 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdac00c7e0 con 0x7efdbc0acfc0 2021-06-25T05:43:08.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdb97fa700 1 -- 172.21.15.57:0/3312631946 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac00c940 con 0x7efdbc0acfc0 2021-06-25T05:43:08.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdc125f700 1 -- 172.21.15.57:0/3312631946 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb4009470 con 0x7efdbc0acfc0 2021-06-25T05:43:08.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdb97fa700 1 -- 172.21.15.57:0/3312631946 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdac00cca0 con 0x7efdbc0acfc0 2021-06-25T05:43:08.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdc125f700 1 -- 172.21.15.57:0/3312631946 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc146150 con 0x7efdbc0acfc0 2021-06-25T05:43:08.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdc125f700 1 -- 172.21.15.57:0/3312631946 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc1527b0 con 0x7efdbc0acfc0 2021-06-25T05:43:08.091 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.070+0000 7efdb97fa700 1 -- 172.21.15.57:0/3312631946 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7efdac01c460 con 0x7efdbc0acfc0 2021-06-25T05:43:08.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.074+0000 7efdb97fa700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efd9c0553d0 0x7efd9c057890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.092 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.074+0000 7efdb97fa700 1 -- 172.21.15.57:0/3312631946 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7efdac06e160 con 0x7efdbc0acfc0 2021-06-25T05:43:08.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.074+0000 7efdbb7fe700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efd9c0553d0 0x7efd9c057890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.074+0000 7efdbb7fe700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efd9c0553d0 0x7efd9c057890 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7efdb000d000 tx=0x7efdb0001180).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.093 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.082+0000 7efdb97fa700 1 -- 172.21.15.57:0/3312631946 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7efdac044590 con 0x7efdbc0acfc0 2021-06-25T05:43:08.201 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.202+0000 7efdc125f700 1 -- 172.21.15.57:0/3312631946 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7efdbc0b4520 con 0x7efd9c0553d0 2021-06-25T05:43:08.202 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.202+0000 7efdb97fa700 1 -- 172.21.15.57:0/3312631946 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efdb000f620 con 0x7efd9c0553d0 2021-06-25T05:43:08.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 -- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efd9c0553d0 msgr2=0x7efd9c057890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efd9c0553d0 0x7efd9c057890 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7efdb000d000 tx=0x7efdb0001180).stop 2021-06-25T05:43:08.206 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 -- 172.21.15.57:0/3312631946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdbc0acfc0 msgr2=0x7efdbc155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdbc0acfc0 0x7efdbc155a80 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7efdac00c000 tx=0x7efdac006df0).stop 2021-06-25T05:43:08.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 -- 172.21.15.57:0/3312631946 shutdown_connections 2021-06-25T05:43:08.207 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7efd9c0553d0 0x7efd9c057890 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdbc0b0440 0x7efdbc152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdbc0aea00 0x7efdbc145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.208 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 --2- 172.21.15.57:0/3312631946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdbc0acfc0 0x7efdbc155a80 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 -- 172.21.15.57:0/3312631946 >> 172.21.15.57:0/3312631946 conn(0x7efdbc0611f0 msgr2=0x7efdbc145240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:08.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 -- 172.21.15.57:0/3312631946 shutdown_connections 2021-06-25T05:43:08.209 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.206+0000 7efdc125f700 1 -- 172.21.15.57:0/3312631946 wait complete. 2021-06-25T05:43:08.210 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 6 to deep-scrub 2021-06-25T05:43:08.215 INFO:tasks.ceph:Scrubbing osd.7 2021-06-25T05:43:08.216 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-06-25T05:43:08.322 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.322+0000 7fa1d9877700 1 Processor -- start 2021-06-25T05:43:08.323 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.322+0000 7fa1d9877700 1 -- start start 2021-06-25T05:43:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d9877700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1d413d3c0 0x7fa1d41467a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d9877700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d41473a0 con 0x7fa1d40aa040 2021-06-25T05:43:08.325 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d9877700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d40ac510 con 0x7fa1d40b6720 2021-06-25T05:43:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d9877700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d40ac7b0 con 0x7fa1d413d3c0 2021-06-25T05:43:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d37fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa1d40aa040 0x7fa1d4146c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34264/0 (socket says 172.21.15.57:34264) 2021-06-25T05:43:08.326 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d37fe700 1 -- 172.21.15.57:0/620735324 learned_addr learned my addr 172.21.15.57:0/620735324 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d27fc700 1 --2- 172.21.15.57:0/620735324 >> v2:172.21.15.87:3300/0 conn(0x7fa1d413d3c0 0x7fa1d41467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d1ffb700 1 -- 172.21.15.57:0/620735324 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788466829 0 0) 0x7fa1d41473a0 con 0x7fa1d40aa040 2021-06-25T05:43:08.327 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d1ffb700 1 -- 172.21.15.57:0/620735324 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1b4003260 con 0x7fa1d40aa040 2021-06-25T05:43:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d27fc700 1 -- 172.21.15.57:0/620735324 >> v1:172.21.15.87:6789/0 conn(0x7fa1d40b6720 legacy=0x7fa1d413ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d27fc700 1 -- 172.21.15.57:0/620735324 >> v1:172.21.15.57:6789/0 conn(0x7fa1d40aa040 legacy=0x7fa1d4146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.328 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d27fc700 1 -- 172.21.15.57:0/620735324 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40aca50 con 0x7fa1d413d3c0 2021-06-25T05:43:08.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d27fc700 1 --2- 172.21.15.57:0/620735324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d413d3c0 0x7fa1d41467a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fa1c4002f70 tx=0x7fa1c4006df0).ready entity=mon.1 client_cookie=967e4e09a273d128 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d1ffb700 1 -- 172.21.15.57:0/620735324 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c400d610 con 0x7fa1d413d3c0 2021-06-25T05:43:08.333 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d1ffb700 1 -- 172.21.15.57:0/620735324 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c4000e90 con 0x7fa1d413d3c0 2021-06-25T05:43:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d1ffb700 1 -- 172.21.15.57:0/620735324 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c400d960 con 0x7fa1d413d3c0 2021-06-25T05:43:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d9877700 1 -- 172.21.15.57:0/620735324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d413d3c0 msgr2=0x7fa1d41467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d9877700 1 --2- 172.21.15.57:0/620735324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d413d3c0 0x7fa1d41467a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fa1c4002f70 tx=0x7fa1c4006df0).stop 2021-06-25T05:43:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d9877700 1 -- 172.21.15.57:0/620735324 shutdown_connections 2021-06-25T05:43:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d9877700 1 --2- 172.21.15.57:0/620735324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d413d3c0 0x7fa1d41467a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d9877700 1 -- 172.21.15.57:0/620735324 >> 172.21.15.57:0/620735324 conn(0x7fa1d40b3440 msgr2=0x7fa1d40b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d9877700 1 -- 172.21.15.57:0/620735324 shutdown_connections 2021-06-25T05:43:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.326+0000 7fa1d9877700 1 -- 172.21.15.57:0/620735324 wait complete. 2021-06-25T05:43:08.336 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d9877700 1 Processor -- start 2021-06-25T05:43:08.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d9877700 1 -- start start 2021-06-25T05:43:08.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d9877700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d40aa040 0x7fa1d4065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.337 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d9877700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1d40b6720 0x7fa1d414a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d9877700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1d413d3c0 0x7fa1d413f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d9877700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d40653c0 con 0x7fa1d40b6720 2021-06-25T05:43:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d9877700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4063db0 con 0x7fa1d40aa040 2021-06-25T05:43:08.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d9877700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4063b10 con 0x7fa1d413d3c0 2021-06-25T05:43:08.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1d40b6720 0x7fa1d414a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.339 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1d40b6720 0x7fa1d414a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45282/0 (socket says 172.21.15.57:45282) 2021-06-25T05:43:08.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d27fc700 1 -- 172.21.15.57:0/476832371 learned_addr learned my addr 172.21.15.57:0/476832371 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:08.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d2ffd700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d40aa040 0x7fa1d4065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.330+0000 7fa1d37fe700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1d413d3c0 0x7fa1d413f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.340 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1d27fc700 1 -- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1d413d3c0 msgr2=0x7fa1d413f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1d27fc700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1d413d3c0 0x7fa1d413f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1d27fc700 1 -- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d40aa040 msgr2=0x7fa1d4065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.341 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1d27fc700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d40aa040 0x7fa1d4065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1d27fc700 1 -- 172.21.15.57:0/476832371 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c400b180 con 0x7fa1d40b6720 2021-06-25T05:43:08.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1d27fc700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1d40b6720 0x7fa1d414a290 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fa1c4002f70 tx=0x7fa1c4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.342 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1cbfff700 1 -- 172.21.15.57:0/476832371 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c4006b20 con 0x7fa1d40b6720 2021-06-25T05:43:08.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1cbfff700 1 -- 172.21.15.57:0/476832371 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c400d290 con 0x7fa1d40b6720 2021-06-25T05:43:08.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1cbfff700 1 -- 172.21.15.57:0/476832371 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c401f440 con 0x7fa1d40b6720 2021-06-25T05:43:08.343 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1d9877700 1 -- 172.21.15.57:0/476832371 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d4065620 con 0x7fa1d40b6720 2021-06-25T05:43:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1d9877700 1 -- 172.21.15.57:0/476832371 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d413ea60 con 0x7fa1d40b6720 2021-06-25T05:43:08.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1d9877700 1 -- 172.21.15.57:0/476832371 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa1d4057310 con 0x7fa1d40b6720 2021-06-25T05:43:08.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1cbfff700 1 -- 172.21.15.57:0/476832371 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fa1c4025020 con 0x7fa1d40b6720 2021-06-25T05:43:08.346 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1cbfff700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa1b8055450 0x7fa1b8057910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1cbfff700 1 -- 172.21.15.57:0/476832371 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fa1c406eb60 con 0x7fa1d40b6720 2021-06-25T05:43:08.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1cbfff700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] conn(0x7fa1b805c1e0 0x7fa1b805e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.347 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1cbfff700 1 -- 172.21.15.57:0/476832371 --> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1b805ebc0 con 0x7fa1b805c1e0 2021-06-25T05:43:08.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.334+0000 7fa1cbfff700 1 -- 172.21.15.57:0/476832371 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1c4073220 con 0x7fa1d40b6720 2021-06-25T05:43:08.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.338+0000 7fa1d2ffd700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa1b8055450 0x7fa1b8057910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.338+0000 7fa1d37fe700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] conn(0x7fa1b805c1e0 0x7fa1b805e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.348 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.338+0000 7fa1d37fe700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] conn(0x7fa1b805c1e0 0x7fa1b805e600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.338+0000 7fa1d2ffd700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa1b8055450 0x7fa1b8057910 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fa1bc00d000 tx=0x7fa1bc007b90).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.349 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.338+0000 7fa1cbfff700 1 -- 172.21.15.57:0/476832371 <== osd.7 v2:172.21.15.87:6800/15530 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fa1b805ebc0 con 0x7fa1b805c1e0 2021-06-25T05:43:08.356 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d9877700 1 -- 172.21.15.57:0/476832371 --> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa1d4140ad0 con 0x7fa1b805c1e0 2021-06-25T05:43:08.357 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1cbfff700 1 -- 172.21.15.57:0/476832371 <== osd.7 v2:172.21.15.87:6800/15530 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa1d4140ad0 con 0x7fa1b805c1e0 2021-06-25T05:43:08.358 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2021-06-25T05:43:08.358 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-06-25T05:43:08.358 INFO:teuthology.orchestra.run.smithi057.stdout:} 2021-06-25T05:43:08.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d9877700 1 -- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] conn(0x7fa1b805c1e0 msgr2=0x7fa1b805e600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d9877700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:6800/15530,v1:172.21.15.87:6801/15530] conn(0x7fa1b805c1e0 0x7fa1b805e600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.360 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d9877700 1 -- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa1b8055450 msgr2=0x7fa1b8057910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d9877700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fa1b8055450 0x7fa1b8057910 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fa1bc00d000 tx=0x7fa1bc007b90).stop 2021-06-25T05:43:08.361 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d9877700 1 -- 172.21.15.57:0/476832371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1d40b6720 msgr2=0x7fa1d414a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d9877700 1 --2- 172.21.15.57:0/476832371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1d40b6720 0x7fa1d414a290 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fa1c4002f70 tx=0x7fa1c4014000).stop 2021-06-25T05:43:08.362 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d37fe700 1 -- 172.21.15.57:0/476832371 reap_dead start 2021-06-25T05:43:08.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d9877700 1 -- 172.21.15.57:0/476832371 shutdown_connections 2021-06-25T05:43:08.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d9877700 1 -- 172.21.15.57:0/476832371 >> 172.21.15.57:0/476832371 conn(0x7fa1d40b3440 msgr2=0x7fa1d40b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:08.363 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d9877700 1 -- 172.21.15.57:0/476832371 shutdown_connections 2021-06-25T05:43:08.364 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.358+0000 7fa1d9877700 1 -- 172.21.15.57:0/476832371 wait complete. 2021-06-25T05:43:08.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2021-06-25T05:43:08.480 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd711b4e700 1 Processor -- start 2021-06-25T05:43:08.481 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd711b4e700 1 -- start start 2021-06-25T05:43:08.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd711b4e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 0x7fd70c147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.485 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd711b4e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd70c05f670 0x7fd70c060c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.486 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd711b4e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c05fac0 con 0x7fd70c0b3200 2021-06-25T05:43:08.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd711b4e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c0b35e0 con 0x7fd70c05f670 2021-06-25T05:43:08.487 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd711b4e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c146830 con 0x7fd70c0b2770 2021-06-25T05:43:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd703fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 0x7fd70c147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.488 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd70b7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd70c0b3200 0x7fd70c060120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.57:35024/0 (socket says 172.21.15.57:35024) 2021-06-25T05:43:08.489 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd70b7fe700 1 -- 172.21.15.57:0/461091455 learned_addr learned my addr 172.21.15.57:0/461091455 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd70bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd70c05f670 0x7fd70c060c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.490 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd703fff700 1 -- 172.21.15.57:0/461091455 >> v2:172.21.15.57:3300/0 conn(0x7fd70c05f670 msgr2=0x7fd70c060c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:08.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd703fff700 1 --2- 172.21.15.57:0/461091455 >> v2:172.21.15.57:3300/0 conn(0x7fd70c05f670 0x7fd70c060c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.491 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd703fff700 1 -- 172.21.15.57:0/461091455 >> v1:172.21.15.87:6789/0 conn(0x7fd70c0b3200 legacy=0x7fd70c060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd703fff700 1 -- 172.21.15.57:0/461091455 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c146ad0 con 0x7fd70c0b2770 2021-06-25T05:43:08.492 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd703fff700 1 --2- 172.21.15.57:0/461091455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 0x7fd70c147210 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fd6f4002f70 tx=0x7fd6f4006df0).ready entity=mon.2 client_cookie=d68c62eb5b368723 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd70affd700 1 -- 172.21.15.57:0/461091455 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f400d570 con 0x7fd70c0b2770 2021-06-25T05:43:08.493 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd70affd700 1 -- 172.21.15.57:0/461091455 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f4000e90 con 0x7fd70c0b2770 2021-06-25T05:43:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd711b4e700 1 -- 172.21.15.57:0/461091455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 msgr2=0x7fd70c147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.494 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.482+0000 7fd711b4e700 1 --2- 172.21.15.57:0/461091455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 0x7fd70c147210 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fd6f4002f70 tx=0x7fd6f4006df0).stop 2021-06-25T05:43:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 -- 172.21.15.57:0/461091455 shutdown_connections 2021-06-25T05:43:08.495 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 --2- 172.21.15.57:0/461091455 >> v2:172.21.15.57:3300/0 conn(0x7fd70c05f670 0x7fd70c060c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 --2- 172.21.15.57:0/461091455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 0x7fd70c147210 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 -- 172.21.15.57:0/461091455 >> 172.21.15.57:0/461091455 conn(0x7fd70c05c450 msgr2=0x7fd70c05c830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:08.496 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 -- 172.21.15.57:0/461091455 shutdown_connections 2021-06-25T05:43:08.497 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 -- 172.21.15.57:0/461091455 wait complete. 2021-06-25T05:43:08.500 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 Processor -- start 2021-06-25T05:43:08.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 -- start start 2021-06-25T05:43:08.501 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd70c05f670 0x7fd70c145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 0x7fd70c140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.502 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd70c0b3200 0x7fd70c141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0acdc0 con 0x7fd70c0b3200 2021-06-25T05:43:08.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0ab830 con 0x7fd70c05f670 2021-06-25T05:43:08.503 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd711b4e700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0acff0 con 0x7fd70c0b2770 2021-06-25T05:43:08.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd703fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 0x7fd70c140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd70bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd70c0b3200 0x7fd70c141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.504 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd703fff700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 0x7fd70c140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:56462/0 (socket says 172.21.15.57:56462) 2021-06-25T05:43:08.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd70b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd70c05f670 0x7fd70c145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.486+0000 7fd703fff700 1 -- 172.21.15.57:0/3470771165 learned_addr learned my addr 172.21.15.57:0/3470771165 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:08.505 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd703fff700 1 -- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd70c05f670 msgr2=0x7fd70c145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd703fff700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd70c05f670 0x7fd70c145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd703fff700 1 -- 172.21.15.57:0/3470771165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd70c0b3200 msgr2=0x7fd70c141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd703fff700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd70c0b3200 0x7fd70c141270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd703fff700 1 -- 172.21.15.57:0/3470771165 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f400b180 con 0x7fd70c0b2770 2021-06-25T05:43:08.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd70bfff700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd70c0b3200 0x7fd70c141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T05:43:08.507 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd703fff700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 0x7fd70c140d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fd6f4002f70 tx=0x7fd6f4014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd7097fa700 1 -- 172.21.15.57:0/3470771165 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f4000e90 con 0x7fd70c0b2770 2021-06-25T05:43:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd7097fa700 1 -- 172.21.15.57:0/3470771165 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f4013e90 con 0x7fd70c0b2770 2021-06-25T05:43:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd711b4e700 1 -- 172.21.15.57:0/3470771165 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c144990 con 0x7fd70c0b2770 2021-06-25T05:43:08.508 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd7097fa700 1 -- 172.21.15.57:0/3470771165 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f401e5f0 con 0x7fd70c0b2770 2021-06-25T05:43:08.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd711b4e700 1 -- 172.21.15.57:0/3470771165 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c0adab0 con 0x7fd70c0b2770 2021-06-25T05:43:08.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd711b4e700 1 -- 172.21.15.57:0/3470771165 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c0ad1b0 con 0x7fd70c0b2770 2021-06-25T05:43:08.509 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.490+0000 7fd7097fa700 1 -- 172.21.15.57:0/3470771165 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fd6f4025030 con 0x7fd70c0b2770 2021-06-25T05:43:08.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.494+0000 7fd7097fa700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6f0055490 0x7fd6f0057950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.494+0000 7fd7097fa700 1 -- 172.21.15.57:0/3470771165 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fd6f406e840 con 0x7fd70c0b2770 2021-06-25T05:43:08.510 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.494+0000 7fd70b7fe700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6f0055490 0x7fd6f0057950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.494+0000 7fd70b7fe700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6f0055490 0x7fd6f0057950 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fd6fc00d000 tx=0x7fd6fc007be0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.511 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.502+0000 7fd7097fa700 1 -- 172.21.15.57:0/3470771165 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fd6f4044c00 con 0x7fd70c0b2770 2021-06-25T05:43:08.630 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.630+0000 7fd711b4e700 1 -- 172.21.15.57:0/3470771165 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd70c05d720 con 0x7fd6f0055490 2021-06-25T05:43:08.631 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.630+0000 7fd7097fa700 1 -- 172.21.15.57:0/3470771165 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd70c05d720 con 0x7fd6f0055490 2021-06-25T05:43:08.634 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 -- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6f0055490 msgr2=0x7fd6f0057950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6f0055490 0x7fd6f0057950 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fd6fc00d000 tx=0x7fd6fc007be0).stop 2021-06-25T05:43:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 -- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 msgr2=0x7fd70c140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.635 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 0x7fd70c140d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fd6f4002f70 tx=0x7fd6f4014000).stop 2021-06-25T05:43:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 -- 172.21.15.57:0/3470771165 shutdown_connections 2021-06-25T05:43:08.636 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fd6f0055490 0x7fd6f0057950 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd70c0b3200 0x7fd70c141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd70c0b2770 0x7fd70c140d80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 --2- 172.21.15.57:0/3470771165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd70c05f670 0x7fd70c145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 -- 172.21.15.57:0/3470771165 >> 172.21.15.57:0/3470771165 conn(0x7fd70c05c450 msgr2=0x7fd70c142050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:08.638 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 -- 172.21.15.57:0/3470771165 shutdown_connections 2021-06-25T05:43:08.639 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.634+0000 7fd711b4e700 1 -- 172.21.15.57:0/3470771165 wait complete. 2021-06-25T05:43:08.639 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 7 to deep-scrub 2021-06-25T05:43:08.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-06-25T05:43:08.776 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86fa165700 1 Processor -- start 2021-06-25T05:43:08.777 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86fa165700 1 -- start start 2021-06-25T05:43:08.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86fa165700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f86f40b5460 0x7f86f40af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86fa165700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f41479b0 con 0x7f86f40b05d0 2021-06-25T05:43:08.779 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86fa165700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f40b5840 con 0x7f86f4147560 2021-06-25T05:43:08.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86fa165700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f41452a0 con 0x7f86f40b5460 2021-06-25T05:43:08.780 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86f8962700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f86f40b05d0 0x7f86f4067560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34290/0 (socket says 172.21.15.57:34290) 2021-06-25T05:43:08.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86f8962700 1 -- 172.21.15.57:0/900064876 learned_addr learned my addr 172.21.15.57:0/900064876 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:08.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86f9163700 1 --2- 172.21.15.57:0/900064876 >> v2:172.21.15.87:3300/0 conn(0x7f86f40b5460 0x7f86f40af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.792 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86ebfff700 1 -- 172.21.15.57:0/900064876 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811721360 0 0) 0x7f86f41479b0 con 0x7f86f40b05d0 2021-06-25T05:43:08.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86ebfff700 1 -- 172.21.15.57:0/900064876 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86e0003260 con 0x7f86f40b05d0 2021-06-25T05:43:08.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86f9163700 1 -- 172.21.15.57:0/900064876 >> v1:172.21.15.87:6789/0 conn(0x7f86f4147560 legacy=0x7f86f40acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.793 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86f9163700 1 -- 172.21.15.57:0/900064876 >> v1:172.21.15.57:6789/0 conn(0x7f86f40b05d0 legacy=0x7f86f4067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86f9163700 1 -- 172.21.15.57:0/900064876 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f40ac7c0 con 0x7f86f40b5460 2021-06-25T05:43:08.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86f9163700 1 --2- 172.21.15.57:0/900064876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f40b5460 0x7f86f40af510 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f86f0002f70 tx=0x7f86f0006df0).ready entity=mon.1 client_cookie=6e3364fc2789de20 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.794 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86ebfff700 1 -- 172.21.15.57:0/900064876 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86f000d5c0 con 0x7f86f40b5460 2021-06-25T05:43:08.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86ebfff700 1 -- 172.21.15.57:0/900064876 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f0000e90 con 0x7f86f40b5460 2021-06-25T05:43:08.795 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86fa165700 1 -- 172.21.15.57:0/900064876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f40b5460 msgr2=0x7f86f40af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86fa165700 1 --2- 172.21.15.57:0/900064876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f40b5460 0x7f86f40af510 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f86f0002f70 tx=0x7f86f0006df0).stop 2021-06-25T05:43:08.796 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.778+0000 7f86ebfff700 1 -- 172.21.15.57:0/900064876 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86f000d910 con 0x7f86f40b5460 2021-06-25T05:43:08.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 -- 172.21.15.57:0/900064876 shutdown_connections 2021-06-25T05:43:08.800 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 --2- 172.21.15.57:0/900064876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f40b5460 0x7f86f40af510 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 -- 172.21.15.57:0/900064876 >> 172.21.15.57:0/900064876 conn(0x7f86f4062520 msgr2=0x7f86f4062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:08.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 -- 172.21.15.57:0/900064876 shutdown_connections 2021-06-25T05:43:08.801 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 -- 172.21.15.57:0/900064876 wait complete. 2021-06-25T05:43:08.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 Processor -- start 2021-06-25T05:43:08.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 -- start start 2021-06-25T05:43:08.802 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f40b05d0 0x7f86f40b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86f40b5460 0x7f86f4144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86f4147560 0x7f86f4140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.803 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40adfb0 con 0x7f86f4147560 2021-06-25T05:43:08.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4140840 con 0x7f86f40b05d0 2021-06-25T05:43:08.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86fa165700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4140a20 con 0x7f86f40b5460 2021-06-25T05:43:08.804 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86f9163700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f40b05d0 0x7f86f40b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86f9163700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f40b05d0 0x7f86f40b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.57:53804/0 (socket says 172.21.15.57:53804) 2021-06-25T05:43:08.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86f9163700 1 -- 172.21.15.57:0/3896416807 learned_addr learned my addr 172.21.15.57:0/3896416807 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:08.805 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86f9964700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86f4147560 0x7f86f4140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.782+0000 7f86f8962700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86f40b5460 0x7f86f4144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86f9163700 1 -- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86f40b5460 msgr2=0x7f86f4144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.806 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86f9163700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86f40b5460 0x7f86f4144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86f9163700 1 -- 172.21.15.57:0/3896416807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86f4147560 msgr2=0x7f86f4140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86f9163700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86f4147560 0x7f86f4140350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86f9163700 1 -- 172.21.15.57:0/3896416807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f000b180 con 0x7f86f40b05d0 2021-06-25T05:43:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86f9964700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86f4147560 0x7f86f4140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T05:43:08.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86f9163700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f40b05d0 0x7f86f40b3350 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f86f40b32a0 tx=0x7f86f0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.808 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86ea7fc700 1 -- 172.21.15.57:0/3896416807 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86f0006b20 con 0x7f86f40b05d0 2021-06-25T05:43:08.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86ea7fc700 1 -- 172.21.15.57:0/3896416807 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f0012d50 con 0x7f86f40b05d0 2021-06-25T05:43:08.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86fa165700 1 -- 172.21.15.57:0/3896416807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f413fd50 con 0x7f86f40b05d0 2021-06-25T05:43:08.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86ea7fc700 1 -- 172.21.15.57:0/3896416807 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86f001f630 con 0x7f86f40b05d0 2021-06-25T05:43:08.809 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86fa165700 1 -- 172.21.15.57:0/3896416807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f4145790 con 0x7f86f40b05d0 2021-06-25T05:43:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86fa165700 1 -- 172.21.15.57:0/3896416807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f4145bd0 con 0x7f86f40b05d0 2021-06-25T05:43:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.786+0000 7f86ea7fc700 1 -- 172.21.15.57:0/3896416807 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f86f0025020 con 0x7f86f40b05d0 2021-06-25T05:43:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.790+0000 7f86ea7fc700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f86d40554e0 0x7f86d40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:08.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.790+0000 7f86ea7fc700 1 -- 172.21.15.57:0/3896416807 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f86f006eb20 con 0x7f86f40b05d0 2021-06-25T05:43:08.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.790+0000 7f86f8962700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f86d40554e0 0x7f86d40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:08.811 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.790+0000 7f86f8962700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f86d40554e0 0x7f86d40579a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f86ec00d000 tx=0x7f86ec009040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:08.812 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.798+0000 7f86ea7fc700 1 -- 172.21.15.57:0/3896416807 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f86f0044f10 con 0x7f86f40b05d0 2021-06-25T05:43:08.920 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.922+0000 7f86fa165700 1 -- 172.21.15.57:0/3896416807 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86f4060e50 con 0x7f86d40554e0 2021-06-25T05:43:08.927 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.926+0000 7f86ea7fc700 1 -- 172.21.15.57:0/3896416807 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68628 (secure 0 0 0) 0x7f86f4060e50 con 0x7f86d40554e0 2021-06-25T05:43:08.928 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T05:43:08.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 -- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f86d40554e0 msgr2=0x7f86d40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.931 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f86d40554e0 0x7f86d40579a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f86ec00d000 tx=0x7f86ec009040).stop 2021-06-25T05:43:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 -- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f40b05d0 msgr2=0x7f86f40b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f40b05d0 0x7f86f40b3350 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f86f40b32a0 tx=0x7f86f0014000).stop 2021-06-25T05:43:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 -- 172.21.15.57:0/3896416807 shutdown_connections 2021-06-25T05:43:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f86d40554e0 0x7f86d40579a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86f4147560 0x7f86f4140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86f40b5460 0x7f86f4144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 --2- 172.21.15.57:0/3896416807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f40b05d0 0x7f86f40b3350 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:08.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 -- 172.21.15.57:0/3896416807 >> 172.21.15.57:0/3896416807 conn(0x7f86f4062520 msgr2=0x7f86f40ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:08.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 -- 172.21.15.57:0/3896416807 shutdown_connections 2021-06-25T05:43:08.934 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:08.930+0000 7f86fa165700 1 -- 172.21.15.57:0/3896416807 wait complete. 2021-06-25T05:43:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2021-06-25T05:43:08.944 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":1824,"stamp":"2021-06-25T05:43:07.393873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8404800,"kb_used_data":16128,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569920,"statfs":{"total":773094113280,"available":764487598080,"internally_reserved":8589934592,"allocated":16515072,"data_stored":8087560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003357"},"pg_stats":[{"pgid":"1.0","version":"14'2","reported_seq":"142","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.711169+0000","last_change":"2021-06-25T04:47:29.030351+0000","last_active":"2021-06-25T04:57:31.711169+0000","last_peered":"2021-06-25T04:57:31.711169+0000","last_clean":"2021-06-25T04:57:31.711169+0000","last_became_active":"2021-06-25T04:47:29.028725+0000","last_became_peered":"2021-06-25T04:47:29.028725+0000","last_unstale":"2021-06-25T04:57:31.711169+0000","last_undegraded":"2021-06-25T04:57:31.711169+0000","last_fullsized":"2021-06-25T04:57:31.711169+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:25.443883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:25.443883+0000","last_clean_scrub_stamp":"2021-06-25T04:47:25.443883+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"138","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.711523+0000","last_change":"2021-06-25T04:47:33.562610+0000","last_active":"2021-06-25T04:57:31.711523+0000","last_peered":"2021-06-25T04:57:31.711523+0000","last_clean":"2021-06-25T04:57:31.711523+0000","last_became_active":"2021-06-25T04:47:33.562250+0000","last_became_peered":"2021-06-25T04:47:33.562250+0000","last_unstale":"2021-06-25T04:57:31.711523+0000","last_undegraded":"2021-06-25T04:57:31.711523+0000","last_fullsized":"2021-06-25T04:57:31.711523+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"137","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.711175+0000","last_change":"2021-06-25T04:47:33.560332+0000","last_active":"2021-06-25T04:57:31.711175+0000","last_peered":"2021-06-25T04:57:31.711175+0000","last_clean":"2021-06-25T04:57:31.711175+0000","last_became_active":"2021-06-25T04:47:33.559708+0000","last_became_peered":"2021-06-25T04:47:33.559708+0000","last_unstale":"2021-06-25T04:57:31.711175+0000","last_undegraded":"2021-06-25T04:57:31.711175+0000","last_fullsized":"2021-06-25T04:57:31.711175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"145","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.712126+0000","last_change":"2021-06-25T04:47:33.608982+0000","last_active":"2021-06-25T04:57:31.712126+0000","last_peered":"2021-06-25T04:57:31.712126+0000","last_clean":"2021-06-25T04:57:31.712126+0000","last_became_active":"2021-06-25T04:47:33.608340+0000","last_became_peered":"2021-06-25T04:47:33.608340+0000","last_unstale":"2021-06-25T04:57:31.712126+0000","last_undegraded":"2021-06-25T04:57:31.712126+0000","last_fullsized":"2021-06-25T04:57:31.712126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"138","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.711332+0000","last_change":"2021-06-25T04:47:33.562562+0000","last_active":"2021-06-25T04:57:31.711332+0000","last_peered":"2021-06-25T04:57:31.711332+0000","last_clean":"2021-06-25T04:57:31.711332+0000","last_became_active":"2021-06-25T04:47:33.561980+0000","last_became_peered":"2021-06-25T04:47:33.561980+0000","last_unstale":"2021-06-25T04:57:31.711332+0000","last_undegraded":"2021-06-25T04:57:31.711332+0000","last_fullsized":"2021-06-25T04:57:31.711332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"143","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.705132+0000","last_change":"2021-06-25T04:47:33.607795+0000","last_active":"2021-06-25T04:57:31.705132+0000","last_peered":"2021-06-25T04:57:31.705132+0000","last_clean":"2021-06-25T04:57:31.705132+0000","last_became_active":"2021-06-25T04:47:33.607259+0000","last_became_peered":"2021-06-25T04:47:33.607259+0000","last_unstale":"2021-06-25T04:57:31.705132+0000","last_undegraded":"2021-06-25T04:57:31.705132+0000","last_fullsized":"2021-06-25T04:57:31.705132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"137","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.711359+0000","last_change":"2021-06-25T04:47:33.614414+0000","last_active":"2021-06-25T04:57:31.711359+0000","last_peered":"2021-06-25T04:57:31.711359+0000","last_clean":"2021-06-25T04:57:31.711359+0000","last_became_active":"2021-06-25T04:47:33.613559+0000","last_became_peered":"2021-06-25T04:47:33.613559+0000","last_unstale":"2021-06-25T04:57:31.711359+0000","last_undegraded":"2021-06-25T04:57:31.711359+0000","last_fullsized":"2021-06-25T04:57:31.711359+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"143","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.705417+0000","last_change":"2021-06-25T04:47:33.555017+0000","last_active":"2021-06-25T04:57:31.705417+0000","last_peered":"2021-06-25T04:57:31.705417+0000","last_clean":"2021-06-25T04:57:31.705417+0000","last_became_active":"2021-06-25T04:47:33.554237+0000","last_became_peered":"2021-06-25T04:47:33.554237+0000","last_unstale":"2021-06-25T04:57:31.705417+0000","last_undegraded":"2021-06-25T04:57:31.705417+0000","last_fullsized":"2021-06-25T04:57:31.705417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"152","reported_epoch":"161","state":"active+clean","last_fresh":"2021-06-25T04:57:31.706328+0000","last_change":"2021-06-25T04:47:33.560136+0000","last_active":"2021-06-25T04:57:31.706328+0000","last_peered":"2021-06-25T04:57:31.706328+0000","last_clean":"2021-06-25T04:57:31.706328+0000","last_became_active":"2021-06-25T04:47:33.559590+0000","last_became_peered":"2021-06-25T04:47:33.559590+0000","last_unstale":"2021-06-25T04:57:31.706328+0000","last_undegraded":"2021-06-25T04:57:31.706328+0000","last_fullsized":"2021-06-25T04:57:31.706328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T04:47:32.520218+0000","last_clean_scrub_stamp":"2021-06-25T04:47:32.520218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575518,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.54800000000000004},"max":{"1min":0.93700000000000006,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.751},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80800000000000005,"15min":0.78600000000000003},"min":{"1min":0.60699999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.012,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78900000000000003,"15min":0.79000000000000004},"min":{"1min":0.57399999999999995,"5min":0.57199999999999995,"15min":0.52100000000000002},"max":{"1min":0.99199999999999999,"5min":1.081,"15min":1.0820000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.83299999999999996,"15min":0.82099999999999995},"min":{"1min":0.626,"5min":0.60799999999999998,"15min":0.58699999999999997},"max":{"1min":1.137,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.57599999999999996},"max":{"1min":0.96199999999999997,"5min":1.1080000000000001,"15min":1.147},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83399999999999996,"15min":0.83199999999999996},"min":{"1min":0.63200000000000001,"5min":0.59799999999999998,"15min":0.57399999999999995},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86099999999999999,"15min":0.872},"min":{"1min":0.66700000000000004,"5min":0.60799999999999998,"15min":0.59999999999999998},"max":{"1min":1.024,"5min":1.1950000000000001,"15min":1.264},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91700000000000004,"15min":0.90800000000000003},"min":{"1min":0.82299999999999995,"5min":0.58999999999999997,"15min":0.57199999999999995},"max":{"1min":1.0920000000000001,"5min":1.115,"15min":1.137},"last":0.80200000000000005}]},{"osd":4,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52500000000000002,"5min":0.499,"15min":0.435},"max":{"1min":1.0680000000000001,"5min":1.159,"15min":1.159},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0700000000000001,"5min":1.216,"15min":1.216},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.82699999999999996,"15min":0.81999999999999995},"min":{"1min":0.56999999999999995,"5min":0.51500000000000001,"15min":0.48799999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2889999999999999},"last":1.052},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85999999999999999,"15min":0.85499999999999998},"min":{"1min":0.623,"5min":0.57199999999999995,"15min":0.54600000000000004},"max":{"1min":1.0569999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.0029999999999999}]},{"osd":6,"last update":"Fri Jun 25 05:42:09 2021","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.95799999999999996,"15min":0.93300000000000005},"min":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.54400000000000004},"max":{"1min":1.1919999999999999,"5min":1.417,"15min":1.417},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.93700000000000006,"15min":0.92500000000000004},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.56100000000000005},"max":{"1min":1.1759999999999999,"5min":1.3859999999999999,"15min":1.399},"last":0.97299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.46899999999999997},"max":{"1min":0.98399999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.63},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80900000000000005,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.46899999999999997},"max":{"1min":1.0269999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80300000000000005,"15min":0.79500000000000004},"min":{"1min":0.58499999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.093},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80800000000000005,"15min":0.81699999999999995},"min":{"1min":0.65400000000000003,"5min":0.501,"15min":0.438},"max":{"1min":1.107,"5min":1.163,"15min":1.163},"last":1.014}]},{"osd":2,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82699999999999996,"15min":0.81299999999999994},"min":{"1min":0.63,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.05,"5min":1.0549999999999999,"15min":1.1639999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.84299999999999997,"15min":0.82999999999999996},"min":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.59299999999999997},"max":{"1min":1.026,"5min":1.079,"15min":1.1000000000000001},"last":0.95599999999999996}]},{"osd":3,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.68600000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.98499999999999999,"5min":1.0740000000000001,"15min":1.1559999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.89200000000000002,"15min":0.89300000000000002},"min":{"1min":0.67200000000000004,"5min":0.64500000000000002,"15min":0.58699999999999997},"max":{"1min":1.0369999999999999,"5min":1.125,"15min":1.1970000000000001},"last":0.81899999999999995}]},{"osd":4,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0509999999999999,"5min":1.109,"15min":1.165},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84499999999999997,"15min":0.85899999999999999},"min":{"1min":0.60499999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0669999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":1.115}]},{"osd":5,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80000000000000004,"15min":0.83699999999999997},"min":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1140000000000001,"5min":1.157,"15min":1.1910000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.93000000000000005},"min":{"1min":0.66700000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.2450000000000001},"last":0.86899999999999999}]},{"osd":7,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.92500000000000004,"15min":0.93700000000000006},"min":{"1min":0.65700000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.181,"5min":1.224,"15min":1.331},"last":1.042},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.92000000000000004,"15min":0.94099999999999995},"min":{"1min":0.76500000000000001,"5min":0.60999999999999999,"15min":0.56499999999999995},"max":{"1min":1.1930000000000001,"5min":1.3,"15min":1.3},"last":0.85299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.53200000000000003,"5min":0.51100000000000001,"15min":0.435},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.1950000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82999999999999996,"15min":0.80400000000000005},"min":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.47399999999999998},"max":{"1min":0.98699999999999999,"5min":1.1259999999999999,"15min":1.1339999999999999},"last":0.81699999999999995}]},{"osd":1,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.91600000000000004,"15min":0.90100000000000002},"min":{"1min":0.69999999999999996,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.079,"5min":1.123,"15min":1.1830000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.091,"5min":1.1419999999999999,"15min":1.196},"last":0.96699999999999997}]},{"osd":2,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83899999999999997,"15min":0.81799999999999995},"min":{"1min":0.69499999999999995,"5min":0.58599999999999997,"15min":0.58199999999999996},"max":{"1min":1.0589999999999999,"5min":1.149,"15min":1.149},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80200000000000005,"15min":0.81399999999999995},"min":{"1min":0.622,"5min":0.58499999999999996,"15min":0.56399999999999995},"max":{"1min":0.97399999999999998,"5min":1.03,"15min":1.196},"last":0.622}]},{"osd":3,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.877,"15min":0.85699999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.56100000000000005},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.22},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.68700000000000006,"5min":0.61799999999999999,"15min":0.59399999999999997},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.2110000000000001},"last":0.84599999999999997}]},{"osd":4,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.56499999999999995,"5min":0.51400000000000001,"15min":0.502},"max":{"1min":0.91100000000000003,"5min":1.125,"15min":1.2270000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.81499999999999995,"15min":0.83199999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1060000000000001,"5min":1.1599999999999999,"15min":1.252},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.79400000000000004,"15min":0.81699999999999995},"min":{"1min":0.60599999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.018,"5min":1.1060000000000001,"15min":1.159},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.85599999999999998},"min":{"1min":0.64200000000000002,"5min":0.53500000000000003,"15min":0.53100000000000003},"max":{"1min":0.98499999999999999,"5min":1.0629999999999999,"15min":1.27},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89600000000000002,"15min":0.91300000000000003},"min":{"1min":0.70099999999999996,"5min":0.60899999999999999,"15min":0.60099999999999998},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.93000000000000005,"15min":0.94399999999999995},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1259999999999999,"5min":1.2849999999999999,"15min":1.3140000000000001},"last":1.0089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77900000000000003,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.53000000000000003},"max":{"1min":0.95799999999999996,"5min":1.0089999999999999,"15min":1.1120000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.75700000000000001,"15min":0.78400000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.504},"max":{"1min":1.0780000000000001,"5min":1.089,"15min":1.2330000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.79500000000000004},"min":{"1min":0.66600000000000004,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":1.0229999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79600000000000004,"15min":0.81499999999999995},"min":{"1min":0.61499999999999999,"5min":0.57999999999999996,"15min":0.55600000000000005},"max":{"1min":1.02,"5min":1.107,"15min":1.1120000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.85299999999999998,"15min":0.84199999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.56499999999999995},"max":{"1min":1.04,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.93300000000000005}]},{"osd":3,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82499999999999996,"15min":0.82799999999999996},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.92800000000000005},"min":{"1min":0.77200000000000002,"5min":0.71599999999999997,"15min":0.68400000000000005},"max":{"1min":1.107,"5min":1.107,"15min":1.175},"last":0.872}]},{"osd":5,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.501},"max":{"1min":0.98599999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80000000000000004,"15min":0.79000000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.47599999999999998},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.89300000000000002}]},{"osd":6,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84899999999999998,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.46700000000000003},"max":{"1min":1.0469999999999999,"5min":1.103,"15min":1.21},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.94099999999999995,"15min":0.94599999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.103,"5min":1.214,"15min":1.276},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Jun 25 05:42:22 2021","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88800000000000001,"15min":0.86599999999999999},"min":{"1min":0.59899999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.626},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.63,"5min":0.628,"15min":0.59099999999999997},"max":{"1min":1.1559999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.47699999999999998,"5min":0.46000000000000002,"15min":0.44},"max":{"1min":0.73799999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.52300000000000002,"5min":0.50600000000000001,"15min":0.45000000000000001},"max":{"1min":0.95999999999999996,"5min":1.107,"15min":1.218},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":0.81399999999999995,"5min":0.97999999999999998,"15min":1.073},"last":0.746},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.57999999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0920000000000001,"5min":1.196,"15min":1.196},"last":0.61099999999999999}]},{"osd":2,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.497},"max":{"1min":1.0960000000000001,"5min":1.1200000000000001,"15min":1.1879999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.46100000000000002},"max":{"1min":0.89600000000000002,"5min":1.028,"15min":1.2490000000000001},"last":0.85899999999999999}]},{"osd":4,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90600000000000003,"15min":0.90700000000000003},"min":{"1min":0.67300000000000004,"5min":0.622,"15min":0.61199999999999999},"max":{"1min":1.212,"5min":1.2769999999999999,"15min":1.284},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.69699999999999995},"max":{"1min":1.294,"5min":1.417,"15min":1.417},"last":0.99299999999999999}]},{"osd":5,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.73999999999999999,"5min":0.66600000000000004,"15min":0.58999999999999997},"max":{"1min":1.3979999999999999,"5min":1.4299999999999999,"15min":1.472},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.93300000000000005,"15min":0.92300000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.58599999999999997},"max":{"1min":1.202,"5min":1.359,"15min":1.359},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96899999999999997,"15min":0.95999999999999996},"min":{"1min":0.75600000000000001,"5min":0.68500000000000005,"15min":0.66200000000000003},"max":{"1min":1.127,"5min":1.407,"15min":1.4490000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.024,"15min":1.0109999999999999},"min":{"1min":0.90500000000000003,"5min":0.77000000000000002,"15min":0.65200000000000002},"max":{"1min":1.29,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.88300000000000001}]},{"osd":7,"last update":"Fri Jun 25 05:42:05 2021","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.032,"15min":1.026},"min":{"1min":0.84099999999999997,"5min":0.70099999999999996,"15min":0.68500000000000005},"max":{"1min":1.3600000000000001,"5min":1.4870000000000001,"15min":1.52},"last":1.071},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0469999999999999,"15min":1.038},"min":{"1min":0.79600000000000004,"5min":0.752,"15min":0.65400000000000003},"max":{"1min":1.1839999999999999,"5min":1.458,"15min":1.5780000000000001},"last":0.93400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.54900000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.012},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.58699999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.181},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.70399999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.45800000000000002},"max":{"1min":0.97599999999999998,"5min":1.151,"15min":1.151},"last":0.96799999999999997}]},{"osd":3,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.48099999999999998,"5min":0.47599999999999998,"15min":0.35899999999999999},"max":{"1min":0.96299999999999997,"5min":1.0289999999999999,"15min":1.1519999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.66900000000000004,"5min":0.61799999999999999,"15min":0.48599999999999999},"max":{"1min":1.0720000000000001,"5min":1.179,"15min":1.2290000000000001},"last":0.77400000000000002}]},{"osd":4,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.89900000000000002,"15min":0.89600000000000002},"min":{"1min":0.66000000000000003,"5min":0.625,"15min":0.61599999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.2190000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.91600000000000004},"min":{"1min":0.77300000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.381,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.381}]},{"osd":5,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.873,"15min":0.86399999999999999},"min":{"1min":0.69399999999999995,"5min":0.60599999999999998,"15min":0.54800000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.04,"5min":0.999,"15min":0.98699999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.70499999999999996},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.0149999999999999}]},{"osd":6,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.95899999999999996,"15min":0.94599999999999995},"min":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.64200000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.589},"last":1.4239999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.93100000000000005,"15min":0.92100000000000004},"min":{"1min":0.75600000000000001,"5min":0.73199999999999998,"15min":0.64500000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.3899999999999999},"last":1.0009999999999999}]},{"osd":7,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.01,"15min":1.004},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.65800000000000003},"max":{"1min":1.3149999999999999,"5min":1.4530000000000001,"15min":1.5389999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.0109999999999999,"15min":1.006},"min":{"1min":0.81299999999999994,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.448},"last":0.94099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575518,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.46100000000000002,"5min":0.44,"15min":0.39100000000000001},"max":{"1min":0.83899999999999997,"5min":0.99399999999999999,"15min":1.077},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.46999999999999997,"15min":0.46100000000000002},"max":{"1min":0.91700000000000004,"5min":0.96899999999999997,"15min":1.1830000000000001},"last":0.71399999999999997}]},{"osd":2,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.45800000000000002},"max":{"1min":0.80000000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.46300000000000002},"max":{"1min":0.99199999999999999,"5min":1.0049999999999999,"15min":1.107},"last":0.92500000000000004}]},{"osd":3,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78900000000000003,"15min":0.78700000000000003},"min":{"1min":0.63400000000000001,"5min":0.61199999999999999,"15min":0.53700000000000003},"max":{"1min":0.97599999999999998,"5min":1.1020000000000001,"15min":1.1659999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.54000000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0089999999999999,"5min":1.0629999999999999,"15min":1.3100000000000001},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.84699999999999998,"15min":0.84899999999999998},"min":{"1min":0.72499999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.169,"5min":1.2010000000000001,"15min":3.1059999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93799999999999994,"15min":0.93999999999999995},"min":{"1min":0.754,"5min":0.70999999999999996,"15min":0.65400000000000003},"max":{"1min":1.1479999999999999,"5min":1.272,"15min":3.5270000000000001},"last":1.0229999999999999}]},{"osd":5,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94499999999999995,"15min":0.93899999999999995},"min":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.624},"max":{"1min":1.1879999999999999,"5min":1.371,"15min":3.4489999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.749,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.139,"5min":1.5329999999999999,"15min":3.2160000000000002},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.751,"5min":0.69799999999999995,"15min":0.69699999999999995},"max":{"1min":1.2390000000000001,"5min":1.304,"15min":3.3620000000000001},"last":0.745},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98099999999999998,"15min":0.98199999999999998},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1779999999999999,"5min":1.6220000000000001,"15min":3.4089999999999998},"last":1.099}]},{"osd":7,"last update":"Fri Jun 25 05:42:03 2021","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.012},"min":{"1min":0.76500000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.2170000000000001,"5min":1.5009999999999999,"15min":3.1440000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.042,"15min":1.042},"min":{"1min":0.82599999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.276,"5min":1.369,"15min":3.2389999999999999},"last":0.89500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575519,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.39900000000000002},"max":{"1min":0.83499999999999996,"5min":0.91400000000000003,"15min":1.151},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.0589999999999999,"15min":1.0629999999999999},"last":0.64100000000000001}]},{"osd":2,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.67100000000000004,"15min":0.68200000000000005},"min":{"1min":0.501,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92400000000000004,"5min":1.111,"15min":1.111},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.54700000000000004,"5min":0.49399999999999999,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.153,"15min":1.2090000000000001},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.501,"5min":0.46999999999999997,"15min":0.45600000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.0649999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78200000000000003,"15min":0.79700000000000004},"min":{"1min":0.61599999999999999,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.0309999999999999,"5min":1.0589999999999999,"15min":1.1679999999999999},"last":0.89800000000000002}]},{"osd":4,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.89500000000000002,"15min":0.89600000000000002},"min":{"1min":0.71099999999999997,"5min":0.65100000000000002,"15min":0.625},"max":{"1min":0.98799999999999999,"5min":1.2230000000000001,"15min":1.2290000000000001},"last":1.159},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84599999999999997,"15min":0.86699999999999999},"min":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.0760000000000001,"5min":1.1779999999999999,"15min":1.2889999999999999},"last":0.87}]},{"osd":5,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93700000000000006,"15min":0.95699999999999996},"min":{"1min":0.77200000000000002,"5min":0.624,"15min":0.624},"max":{"1min":1.163,"5min":1.3049999999999999,"15min":1.4410000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.95299999999999996,"15min":0.95099999999999996},"min":{"1min":0.77300000000000002,"5min":0.69499999999999995,"15min":0.67000000000000004},"max":{"1min":1.0720000000000001,"5min":1.2609999999999999,"15min":1.365},"last":0.96399999999999997}]},{"osd":6,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.70699999999999996,"5min":0.68899999999999995,"15min":0.66600000000000004},"max":{"1min":1.214,"5min":1.2609999999999999,"15min":1.5},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.996,"15min":1.0129999999999999},"min":{"1min":0.72099999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.1830000000000001,"5min":1.3720000000000001,"15min":1.5209999999999999},"last":1.1930000000000001}]},{"osd":7,"last update":"Fri Jun 25 05:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0169999999999999,"15min":1.0189999999999999},"min":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.135,"5min":1.448,"15min":1.5349999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0189999999999999,"15min":1.018},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.66000000000000003},"max":{"1min":1.2210000000000001,"5min":1.421,"15min":1.4570000000000001},"last":1.109}]}]}]}} 2021-06-25T05:43:08.956 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-06-25T04:47:25.443883+0000 time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=4, tm_min=47, tm_sec=25, tm_wday=4, tm_yday=176, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=5, tm_min=43, tm_sec=4, tm_wday=4, tm_yday=176, tm_isdst=0) 2021-06-25T05:43:08.958 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-06-25T04:47:32.520218+0000 time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=4, tm_min=47, tm_sec=32, tm_wday=4, tm_yday=176, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=5, tm_min=43, tm_sec=4, tm_wday=4, tm_yday=176, tm_isdst=0) 2021-06-25T05:43:08.959 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-06-25T04:47:32.520218+0000 time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=4, tm_min=47, tm_sec=32, tm_wday=4, tm_yday=176, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=5, tm_min=43, tm_sec=4, tm_wday=4, tm_yday=176, tm_isdst=0) 2021-06-25T05:43:08.961 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2021-06-25T04:47:32.520218+0000 time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=4, tm_min=47, tm_sec=32, tm_wday=4, tm_yday=176, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=5, tm_min=43, tm_sec=4, tm_wday=4, tm_yday=176, tm_isdst=0) 2021-06-25T05:43:08.962 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-06-25T04:47:32.520218+0000 time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=4, tm_min=47, tm_sec=32, tm_wday=4, tm_yday=176, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=5, tm_min=43, tm_sec=4, tm_wday=4, tm_yday=176, tm_isdst=0) 2021-06-25T05:43:08.966 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2021-06-25T04:47:32.520218+0000 time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=4, tm_min=47, tm_sec=32, tm_wday=4, tm_yday=176, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=5, tm_min=43, tm_sec=4, tm_wday=4, tm_yday=176, tm_isdst=0) 2021-06-25T05:43:08.967 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-06-25T04:47:32.520218+0000 time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=4, tm_min=47, tm_sec=32, tm_wday=4, tm_yday=176, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=5, tm_min=43, tm_sec=4, tm_wday=4, tm_yday=176, tm_isdst=0) 2021-06-25T05:43:08.969 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2021-06-25T04:47:32.520218+0000 time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=4, tm_min=47, tm_sec=32, tm_wday=4, tm_yday=176, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=5, tm_min=43, tm_sec=4, tm_wday=4, tm_yday=176, tm_isdst=0) 2021-06-25T05:43:08.970 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-06-25T04:47:32.520218+0000 time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=4, tm_min=47, tm_sec=32, tm_wday=4, tm_yday=176, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=6, tm_mday=25, tm_hour=5, tm_min=43, tm_sec=4, tm_wday=4, tm_yday=176, tm_isdst=0) 2021-06-25T05:43:08.972 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-06-25T05:43:15.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:15.371 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:15.374 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:15.377 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:28.975 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-06-25T05:43:29.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.090+0000 7f08cdcda700 1 Processor -- start 2021-06-25T05:43:29.090 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.090+0000 7f08cdcda700 1 -- start start 2021-06-25T05:43:29.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.090+0000 7f08cdcda700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80b11f0 0x7f08c80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.095 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.090+0000 7f08cdcda700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f08c80ae6a0 0x7f08c80aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.090+0000 7f08cdcda700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c80ac350 con 0x7f08c80afbb0 2021-06-25T05:43:29.096 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.090+0000 7f08cdcda700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c80b15d0 con 0x7f08c80ae6a0 2021-06-25T05:43:29.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.090+0000 7f08cdcda700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80b0280 con 0x7f08c80b11f0 2021-06-25T05:43:29.097 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.090+0000 7f08c7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f08c80afbb0 0x7f08c8142740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34306/0 (socket says 172.21.15.57:34306) 2021-06-25T05:43:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.090+0000 7f08c7fff700 1 -- 172.21.15.57:0/381060874 learned_addr learned my addr 172.21.15.57:0/381060874 (peer_addr_for_me v1:172.21.15.57:0/0) 2021-06-25T05:43:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.090+0000 7f08cccd8700 1 --2- 172.21.15.57:0/381060874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80b11f0 0x7f08c80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cd4d9700 1 --2- 172.21.15.57:0/381060874 >> v2:172.21.15.87:3300/0 conn(0x7f08c80ae6a0 0x7f08c80aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.099 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08c77fe700 1 -- 172.21.15.57:0/381060874 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499089690 0 0) 0x7f08c80ac350 con 0x7f08c80afbb0 2021-06-25T05:43:29.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08c77fe700 1 -- 172.21.15.57:0/381060874 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08b4003260 con 0x7f08c80afbb0 2021-06-25T05:43:29.100 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cccd8700 1 -- 172.21.15.57:0/381060874 >> v2:172.21.15.87:3300/0 conn(0x7f08c80ae6a0 msgr2=0x7f08c80aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cccd8700 1 --2- 172.21.15.57:0/381060874 >> v2:172.21.15.87:3300/0 conn(0x7f08c80ae6a0 0x7f08c80aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cccd8700 1 -- 172.21.15.57:0/381060874 >> v1:172.21.15.57:6789/0 conn(0x7f08c80afbb0 legacy=0x7f08c8142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08c77fe700 1 -- 172.21.15.57:0/381060874 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 32197058 0 0) 0x7f08b4003260 con 0x7f08c80afbb0 2021-06-25T05:43:29.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cccd8700 1 -- 172.21.15.57:0/381060874 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c80b0520 con 0x7f08c80b11f0 2021-06-25T05:43:29.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cccd8700 1 --2- 172.21.15.57:0/381060874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80b11f0 0x7f08c80b0950 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f08b8001800 tx=0x7f08bc006df0).ready entity=mon.2 client_cookie=e98c0b272c33eff8 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:29.103 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08c77fe700 1 -- 172.21.15.57:0/381060874 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08b8001660 con 0x7f08c80b11f0 2021-06-25T05:43:29.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08c77fe700 1 -- 172.21.15.57:0/381060874 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc000e90 con 0x7f08c80b11f0 2021-06-25T05:43:29.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08c77fe700 1 -- 172.21.15.57:0/381060874 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08bc012460 con 0x7f08c80b11f0 2021-06-25T05:43:29.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cdcda700 1 -- 172.21.15.57:0/381060874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80b11f0 msgr2=0x7f08c80b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.104 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cdcda700 1 --2- 172.21.15.57:0/381060874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80b11f0 0x7f08c80b0950 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f08b8001800 tx=0x7f08bc006df0).stop 2021-06-25T05:43:29.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cdcda700 1 -- 172.21.15.57:0/381060874 shutdown_connections 2021-06-25T05:43:29.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cdcda700 1 --2- 172.21.15.57:0/381060874 >> v2:172.21.15.87:3300/0 conn(0x7f08c80ae6a0 0x7f08c80aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.106 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cdcda700 1 --2- 172.21.15.57:0/381060874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80b11f0 0x7f08c80b0950 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cdcda700 1 -- 172.21.15.57:0/381060874 >> 172.21.15.57:0/381060874 conn(0x7f08c8062520 msgr2=0x7f08c8062900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cdcda700 1 -- 172.21.15.57:0/381060874 shutdown_connections 2021-06-25T05:43:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.094+0000 7f08cdcda700 1 -- 172.21.15.57:0/381060874 wait complete. 2021-06-25T05:43:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cdcda700 1 Processor -- start 2021-06-25T05:43:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cdcda700 1 -- start start 2021-06-25T05:43:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cdcda700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80ae6a0 0x7f08c81557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cdcda700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c80afbb0 0x7f08c8155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cdcda700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08c80b11f0 0x7f08c8145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cdcda700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c813b4b0 con 0x7f08c80afbb0 2021-06-25T05:43:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cdcda700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8140630 con 0x7f08c80b11f0 2021-06-25T05:43:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cdcda700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8156310 con 0x7f08c80ae6a0 2021-06-25T05:43:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08c7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c80afbb0 0x7f08c8155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cccd8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80ae6a0 0x7f08c81557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cccd8700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80ae6a0 0x7f08c81557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:56488/0 (socket says 172.21.15.57:56488) 2021-06-25T05:43:29.114 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cd4d9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08c80b11f0 0x7f08c8145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.115 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.098+0000 7f08cccd8700 1 -- 172.21.15.57:0/3691708298 learned_addr learned my addr 172.21.15.57:0/3691708298 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:29.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08cd4d9700 1 -- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80ae6a0 msgr2=0x7f08c81557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.116 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08cd4d9700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80ae6a0 0x7f08c81557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08cd4d9700 1 -- 172.21.15.57:0/3691708298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c80afbb0 msgr2=0x7f08c8155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08cd4d9700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c80afbb0 0x7f08c8155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.117 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08cd4d9700 1 -- 172.21.15.57:0/3691708298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc00b180 con 0x7f08c80b11f0 2021-06-25T05:43:29.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08cccd8700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80ae6a0 0x7f08c81557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-06-25T05:43:29.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08cd4d9700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08c80b11f0 0x7f08c8145100 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f08c000c000 tx=0x7f08c00091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:29.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08c5ffb700 1 -- 172.21.15.57:0/3691708298 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08c0012600 con 0x7f08c80b11f0 2021-06-25T05:43:29.118 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08c5ffb700 1 -- 172.21.15.57:0/3691708298 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c0012760 con 0x7f08c80b11f0 2021-06-25T05:43:29.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08cdcda700 1 -- 172.21.15.57:0/3691708298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c81565b0 con 0x7f08c80b11f0 2021-06-25T05:43:29.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08c5ffb700 1 -- 172.21.15.57:0/3691708298 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08c0012ac0 con 0x7f08c80b11f0 2021-06-25T05:43:29.119 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08cdcda700 1 -- 172.21.15.57:0/3691708298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c813fce0 con 0x7f08c80b11f0 2021-06-25T05:43:29.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08cdcda700 1 -- 172.21.15.57:0/3691708298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c8057310 con 0x7f08c80b11f0 2021-06-25T05:43:29.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.102+0000 7f08c5ffb700 1 -- 172.21.15.57:0/3691708298 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7f08c0022070 con 0x7f08c80b11f0 2021-06-25T05:43:29.120 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.106+0000 7f08c5ffb700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f08a80554e0 0x7f08a80579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.106+0000 7f08c5ffb700 1 -- 172.21.15.57:0/3691708298 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f08c006e2d0 con 0x7f08c80b11f0 2021-06-25T05:43:29.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.106+0000 7f08cccd8700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f08a80554e0 0x7f08a80579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.121 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.106+0000 7f08cccd8700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f08a80554e0 0x7f08a80579a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f08bc019000 tx=0x7f08bc014000).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:29.122 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.114+0000 7f08c5ffb700 1 -- 172.21.15.57:0/3691708298 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7f08c00445f0 con 0x7f08c80b11f0 2021-06-25T05:43:29.241 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.242+0000 7f08cdcda700 1 -- 172.21.15.57:0/3691708298 --> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08c805f200 con 0x7f08a80554e0 2021-06-25T05:43:29.247 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08c5ffb700 1 -- 172.21.15.57:0/3691708298 <== mgr.4114 v2:172.21.15.87:6832/15156 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68448 (secure 0 0 0) 0x7f08c805f200 con 0x7f08a80554e0 2021-06-25T05:43:29.249 INFO:teuthology.orchestra.run.smithi057.stdout: 2021-06-25T05:43:29.250 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 -- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f08a80554e0 msgr2=0x7f08a80579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f08a80554e0 0x7f08a80579a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f08bc019000 tx=0x7f08bc014000).stop 2021-06-25T05:43:29.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 -- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08c80b11f0 msgr2=0x7f08c8145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.251 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08c80b11f0 0x7f08c8145100 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f08c000c000 tx=0x7f08c00091d0).stop 2021-06-25T05:43:29.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 -- 172.21.15.57:0/3691708298 shutdown_connections 2021-06-25T05:43:29.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7f08a80554e0 0x7f08a80579a0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.252 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08c80b11f0 0x7f08c8145100 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c80afbb0 0x7f08c8155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 --2- 172.21.15.57:0/3691708298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c80ae6a0 0x7f08c81557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.253 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 -- 172.21.15.57:0/3691708298 >> 172.21.15.57:0/3691708298 conn(0x7f08c8062520 msgr2=0x7f08c80b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:29.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 -- 172.21.15.57:0/3691708298 shutdown_connections 2021-06-25T05:43:29.254 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.250+0000 7f08cdcda700 1 -- 172.21.15.57:0/3691708298 wait complete. 2021-06-25T05:43:29.255 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2021-06-25T05:43:29.261 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":1834,"stamp":"2021-06-25T05:43:27.399328+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9954,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8404800,"kb_used_data":16128,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569920,"statfs":{"total":773094113280,"available":764487598080,"internally_reserved":8589934592,"allocated":16515072,"data_stored":8087560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003364"},"pg_stats":[{"pgid":"1.0","version":"162'4","reported_seq":"147","reported_epoch":"162","state":"active+clean","last_fresh":"2021-06-25T05:43:09.430399+0000","last_change":"2021-06-25T05:43:09.430580+0000","last_active":"2021-06-25T05:43:09.430399+0000","last_peered":"2021-06-25T05:43:09.430399+0000","last_clean":"2021-06-25T05:43:09.430399+0000","last_became_active":"2021-06-25T04:47:29.028725+0000","last_became_peered":"2021-06-25T04:47:29.028725+0000","last_unstale":"2021-06-25T05:43:09.430399+0000","last_undegraded":"2021-06-25T05:43:09.430399+0000","last_fullsized":"2021-06-25T05:43:09.430399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"162'4","last_scrub_stamp":"2021-06-25T05:43:09.430398+0000","last_deep_scrub":"162'4","last_deep_scrub_stamp":"2021-06-25T05:43:09.430398+0000","last_clean_scrub_stamp":"2021-06-25T05:43:09.430398+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9954,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"141","reported_epoch":"162","state":"active+clean","last_fresh":"2021-06-25T05:43:10.028979+0000","last_change":"2021-06-25T05:43:10.029091+0000","last_active":"2021-06-25T05:43:10.028979+0000","last_peered":"2021-06-25T05:43:10.028979+0000","last_clean":"2021-06-25T05:43:10.028979+0000","last_became_active":"2021-06-25T04:47:33.562250+0000","last_became_peered":"2021-06-25T04:47:33.562250+0000","last_unstale":"2021-06-25T05:43:10.028979+0000","last_undegraded":"2021-06-25T05:43:10.028979+0000","last_fullsized":"2021-06-25T05:43:10.028979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T05:43:10.028979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T05:43:10.028979+0000","last_clean_scrub_stamp":"2021-06-25T05:43:10.028979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"140","reported_epoch":"162","state":"active+clean","last_fresh":"2021-06-25T05:43:11.421766+0000","last_change":"2021-06-25T05:43:11.421965+0000","last_active":"2021-06-25T05:43:11.421766+0000","last_peered":"2021-06-25T05:43:11.421766+0000","last_clean":"2021-06-25T05:43:11.421766+0000","last_became_active":"2021-06-25T04:47:33.559708+0000","last_became_peered":"2021-06-25T04:47:33.559708+0000","last_unstale":"2021-06-25T05:43:11.421766+0000","last_undegraded":"2021-06-25T05:43:11.421766+0000","last_fullsized":"2021-06-25T05:43:11.421766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T05:43:11.421765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T05:43:11.421765+0000","last_clean_scrub_stamp":"2021-06-25T05:43:11.421765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"148","reported_epoch":"162","state":"active+clean","last_fresh":"2021-06-25T05:43:13.797027+0000","last_change":"2021-06-25T05:43:13.797128+0000","last_active":"2021-06-25T05:43:13.797027+0000","last_peered":"2021-06-25T05:43:13.797027+0000","last_clean":"2021-06-25T05:43:13.797027+0000","last_became_active":"2021-06-25T04:47:33.608340+0000","last_became_peered":"2021-06-25T04:47:33.608340+0000","last_unstale":"2021-06-25T05:43:13.797027+0000","last_undegraded":"2021-06-25T05:43:13.797027+0000","last_fullsized":"2021-06-25T05:43:13.797027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T05:43:13.797027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T05:43:13.797027+0000","last_clean_scrub_stamp":"2021-06-25T05:43:13.797027+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"141","reported_epoch":"162","state":"active+clean","last_fresh":"2021-06-25T05:43:08.005698+0000","last_change":"2021-06-25T05:43:08.005880+0000","last_active":"2021-06-25T05:43:08.005698+0000","last_peered":"2021-06-25T05:43:08.005698+0000","last_clean":"2021-06-25T05:43:08.005698+0000","last_became_active":"2021-06-25T04:47:33.561980+0000","last_became_peered":"2021-06-25T04:47:33.561980+0000","last_unstale":"2021-06-25T05:43:08.005698+0000","last_undegraded":"2021-06-25T05:43:08.005698+0000","last_fullsized":"2021-06-25T05:43:08.005698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T05:43:08.005698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T05:43:08.005698+0000","last_clean_scrub_stamp":"2021-06-25T05:43:08.005698+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"146","reported_epoch":"162","state":"active+clean","last_fresh":"2021-06-25T05:43:09.160894+0000","last_change":"2021-06-25T05:43:09.161167+0000","last_active":"2021-06-25T05:43:09.160894+0000","last_peered":"2021-06-25T05:43:09.160894+0000","last_clean":"2021-06-25T05:43:09.160894+0000","last_became_active":"2021-06-25T04:47:33.607259+0000","last_became_peered":"2021-06-25T04:47:33.607259+0000","last_unstale":"2021-06-25T05:43:09.160894+0000","last_undegraded":"2021-06-25T05:43:09.160894+0000","last_fullsized":"2021-06-25T05:43:09.160894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T05:43:09.160893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T05:43:09.160893+0000","last_clean_scrub_stamp":"2021-06-25T05:43:09.160893+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"140","reported_epoch":"162","state":"active+clean","last_fresh":"2021-06-25T05:43:12.431405+0000","last_change":"2021-06-25T05:43:12.431593+0000","last_active":"2021-06-25T05:43:12.431405+0000","last_peered":"2021-06-25T05:43:12.431405+0000","last_clean":"2021-06-25T05:43:12.431405+0000","last_became_active":"2021-06-25T04:47:33.613559+0000","last_became_peered":"2021-06-25T04:47:33.613559+0000","last_unstale":"2021-06-25T05:43:12.431405+0000","last_undegraded":"2021-06-25T05:43:12.431405+0000","last_fullsized":"2021-06-25T05:43:12.431405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T05:43:12.431404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T05:43:12.431404+0000","last_clean_scrub_stamp":"2021-06-25T05:43:12.431404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"146","reported_epoch":"162","state":"active+clean","last_fresh":"2021-06-25T05:43:10.129582+0000","last_change":"2021-06-25T05:43:10.129676+0000","last_active":"2021-06-25T05:43:10.129582+0000","last_peered":"2021-06-25T05:43:10.129582+0000","last_clean":"2021-06-25T05:43:10.129582+0000","last_became_active":"2021-06-25T04:47:33.554237+0000","last_became_peered":"2021-06-25T04:47:33.554237+0000","last_unstale":"2021-06-25T05:43:10.129582+0000","last_undegraded":"2021-06-25T05:43:10.129582+0000","last_fullsized":"2021-06-25T05:43:10.129582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T05:43:10.129581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T05:43:10.129581+0000","last_clean_scrub_stamp":"2021-06-25T05:43:10.129581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"155","reported_epoch":"162","state":"active+clean","last_fresh":"2021-06-25T05:43:11.873257+0000","last_change":"2021-06-25T05:43:11.873338+0000","last_active":"2021-06-25T05:43:11.873257+0000","last_peered":"2021-06-25T05:43:11.873257+0000","last_clean":"2021-06-25T05:43:11.873257+0000","last_became_active":"2021-06-25T04:47:33.559590+0000","last_became_peered":"2021-06-25T04:47:33.559590+0000","last_unstale":"2021-06-25T05:43:11.873257+0000","last_undegraded":"2021-06-25T05:43:11.873257+0000","last_fullsized":"2021-06-25T05:43:11.873257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-06-25T05:43:11.873256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-06-25T05:43:11.873256+0000","last_clean_scrub_stamp":"2021-06-25T05:43:11.873256+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9954,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575522,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:43:09 2021","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.54800000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.014,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Jun 25 05:43:09 2021","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.80300000000000005,"15min":0.79400000000000004},"min":{"1min":0.60999999999999999,"5min":0.57399999999999995,"15min":0.52100000000000002},"max":{"1min":1.052,"5min":1.081,"15min":1.0820000000000001},"last":0.877},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83099999999999996,"15min":0.81899999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.097,"5min":1.137,"15min":1.1439999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Jun 25 05:43:09 2021","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81200000000000006,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0249999999999999,"5min":1.1080000000000001,"15min":1.147},"last":0.755},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82899999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.57399999999999995},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Jun 25 05:43:09 2021","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86299999999999999,"15min":0.86899999999999999},"min":{"1min":0.68400000000000005,"5min":0.60799999999999998,"15min":0.59999999999999998},"max":{"1min":1.0680000000000001,"5min":1.125,"15min":1.1950000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92300000000000004,"15min":0.90700000000000003},"min":{"1min":0.66700000000000004,"5min":0.58999999999999997,"15min":0.57199999999999995},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.80100000000000005}]},{"osd":4,"last update":"Fri Jun 25 05:43:09 2021","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.72399999999999998},"min":{"1min":0.53900000000000003,"5min":0.499,"15min":0.435},"max":{"1min":1.1439999999999999,"5min":1.159,"15min":1.159},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.998,"5min":1.216,"15min":1.216},"last":1.0209999999999999}]},{"osd":5,"last update":"Fri Jun 25 05:43:09 2021","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.48799999999999999},"max":{"1min":1.1859999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.63,"5min":0.57199999999999995,"15min":0.54600000000000004},"max":{"1min":1.1950000000000001,"5min":1.22,"15min":1.2250000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Jun 25 05:43:09 2021","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95299999999999996,"15min":0.93200000000000005},"min":{"1min":0.76600000000000001,"5min":0.70899999999999996,"15min":0.54400000000000004},"max":{"1min":1.236,"5min":1.417,"15min":1.417},"last":0.999},{"interface":"front","average":{"1min":0.87,"5min":0.92500000000000004,"15min":0.91900000000000004},"min":{"1min":0.58599999999999997,"5min":0.58499999999999996,"15min":0.56100000000000005},"max":{"1min":1.022,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.96099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575522,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.46899999999999997},"max":{"1min":0.98399999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80900000000000005,"15min":0.78700000000000003},"min":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.46899999999999997},"max":{"1min":1.0269999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.97399999999999998}]},{"osd":1,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80300000000000005,"15min":0.79500000000000004},"min":{"1min":0.58499999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.093},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80800000000000005,"15min":0.81699999999999995},"min":{"1min":0.65400000000000003,"5min":0.501,"15min":0.438},"max":{"1min":1.107,"5min":1.163,"15min":1.163},"last":0.69499999999999995}]},{"osd":2,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82699999999999996,"15min":0.81299999999999994},"min":{"1min":0.63,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.05,"5min":1.0549999999999999,"15min":1.1639999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.84299999999999997,"15min":0.82999999999999996},"min":{"1min":0.63600000000000001,"5min":0.59399999999999997,"15min":0.59299999999999997},"max":{"1min":1.026,"5min":1.079,"15min":1.1000000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.68600000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.98499999999999999,"5min":1.0740000000000001,"15min":1.1559999999999999},"last":0.751},{"interface":"front","average":{"1min":0.875,"5min":0.89200000000000002,"15min":0.89300000000000002},"min":{"1min":0.67200000000000004,"5min":0.64500000000000002,"15min":0.58699999999999997},"max":{"1min":1.0369999999999999,"5min":1.125,"15min":1.1970000000000001},"last":0.876}]},{"osd":4,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0509999999999999,"5min":1.109,"15min":1.165},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84499999999999997,"15min":0.85899999999999999},"min":{"1min":0.60499999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0669999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.93899999999999995}]},{"osd":5,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80000000000000004,"15min":0.83699999999999997},"min":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1140000000000001,"5min":1.157,"15min":1.1910000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90800000000000003,"15min":0.93000000000000005},"min":{"1min":0.66700000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.2450000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Jun 25 05:42:32 2021","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.92500000000000004,"15min":0.93700000000000006},"min":{"1min":0.65700000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.181,"5min":1.224,"15min":1.331},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.92000000000000004,"15min":0.94099999999999995},"min":{"1min":0.76500000000000001,"5min":0.60999999999999999,"15min":0.56499999999999995},"max":{"1min":1.1930000000000001,"5min":1.3,"15min":1.3},"last":0.91300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575522,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76000000000000001,"15min":0.77700000000000002},"min":{"1min":0.53200000000000003,"5min":0.51100000000000001,"15min":0.435},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.1950000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82999999999999996,"15min":0.80400000000000005},"min":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.47399999999999998},"max":{"1min":0.98699999999999999,"5min":1.1259999999999999,"15min":1.1339999999999999},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.91600000000000004,"15min":0.90100000000000002},"min":{"1min":0.69999999999999996,"5min":0.57599999999999996,"15min":0.52300000000000002},"max":{"1min":1.079,"5min":1.123,"15min":1.1830000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.091,"5min":1.1419999999999999,"15min":1.196},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83899999999999997,"15min":0.81799999999999995},"min":{"1min":0.69499999999999995,"5min":0.58599999999999997,"15min":0.58199999999999996},"max":{"1min":1.0589999999999999,"5min":1.149,"15min":1.149},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80200000000000005,"15min":0.81399999999999995},"min":{"1min":0.622,"5min":0.58499999999999996,"15min":0.56399999999999995},"max":{"1min":0.97399999999999998,"5min":1.03,"15min":1.196},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.877,"15min":0.85699999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.56100000000000005},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.22},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.68700000000000006,"5min":0.61799999999999999,"15min":0.59399999999999997},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.2110000000000001},"last":0.99199999999999999}]},{"osd":4,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.56499999999999995,"5min":0.51400000000000001,"15min":0.502},"max":{"1min":0.91100000000000003,"5min":1.125,"15min":1.2270000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.81499999999999995,"15min":0.83199999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1060000000000001,"5min":1.1599999999999999,"15min":1.252},"last":0.81100000000000005}]},{"osd":6,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.79400000000000004,"15min":0.81699999999999995},"min":{"1min":0.60599999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.018,"5min":1.1060000000000001,"15min":1.159},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.85599999999999998},"min":{"1min":0.64200000000000002,"5min":0.53500000000000003,"15min":0.53100000000000003},"max":{"1min":0.98499999999999999,"5min":1.0629999999999999,"15min":1.27},"last":0.78100000000000003}]},{"osd":7,"last update":"Fri Jun 25 05:43:00 2021","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89600000000000002,"15min":0.91300000000000003},"min":{"1min":0.70099999999999996,"5min":0.60899999999999999,"15min":0.60099999999999998},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.93000000000000005,"15min":0.94399999999999995},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1259999999999999,"5min":1.2849999999999999,"15min":1.3140000000000001},"last":1.026}]}]},{"osd":4,"up_from":13,"seq":55834575523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:43:22 2021","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79300000000000004,"15min":0.78600000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53000000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.1120000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.56599999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0329999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61199999999999999}]},{"osd":1,"last update":"Fri Jun 25 05:43:22 2021","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76200000000000001,"15min":0.77800000000000002},"min":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.504},"max":{"1min":1.038,"5min":1.089,"15min":1.2330000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79700000000000004,"15min":0.79000000000000004},"min":{"1min":0.59599999999999997,"5min":0.55700000000000005,"15min":0.53000000000000003},"max":{"1min":0.98199999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.87}]},{"osd":2,"last update":"Fri Jun 25 05:43:22 2021","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79300000000000004,"15min":0.81000000000000005},"min":{"1min":0.64700000000000002,"5min":0.58699999999999997,"15min":0.55600000000000005},"max":{"1min":1.0549999999999999,"5min":1.0940000000000001,"15min":1.107},"last":0.754},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.63200000000000001,"5min":0.61499999999999999,"15min":0.56499999999999995},"max":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Jun 25 05:43:22 2021","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82199999999999995,"15min":0.82699999999999996},"min":{"1min":0.628,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0249999999999999,"5min":1.145,"15min":1.145},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.91300000000000003,"15min":0.93100000000000005},"min":{"1min":0.82599999999999996,"5min":0.71599999999999997,"15min":0.68400000000000005},"max":{"1min":1.151,"5min":1.151,"15min":1.175},"last":0.90600000000000003}]},{"osd":5,"last update":"Fri Jun 25 05:43:22 2021","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.501},"max":{"1min":1.014,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80900000000000005,"15min":0.79300000000000004},"min":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.47599999999999998},"max":{"1min":1.1180000000000001,"5min":1.179,"15min":1.179},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Jun 25 05:43:22 2021","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.85099999999999998,"15min":0.84499999999999997},"min":{"1min":0.59999999999999998,"5min":0.56299999999999994,"15min":0.46700000000000003},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.052},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.94799999999999995,"15min":0.94499999999999995},"min":{"1min":0.68000000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.151,"5min":1.214,"15min":1.276},"last":1.0329999999999999}]},{"osd":7,"last update":"Fri Jun 25 05:43:22 2021","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89300000000000002,"15min":0.86699999999999999},"min":{"1min":0.60699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.405,"15min":1.405},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.01,"5min":0.93600000000000005,"15min":0.92800000000000005},"min":{"1min":0.73199999999999998,"5min":0.628,"15min":0.59099999999999997},"max":{"1min":1.2669999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.97499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.44},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":1.2709999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.66700000000000004,"15min":0.66800000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":1.107,"15min":1.218},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67200000000000004,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94399999999999995,"5min":0.97999999999999998,"15min":1.073},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.61099999999999999,"5min":0.57999999999999996,"15min":0.47799999999999998},"max":{"1min":0.86699999999999999,"5min":1.0920000000000001,"15min":1.196},"last":0.86799999999999999}]},{"osd":2,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.54500000000000004,"5min":0.52600000000000002,"15min":0.497},"max":{"1min":0.96799999999999997,"5min":1.1200000000000001,"15min":1.1879999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.755,"15min":0.751},"min":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.46100000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.2490000000000001},"last":0.625}]},{"osd":4,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89800000000000002,"15min":0.90200000000000002},"min":{"1min":0.64700000000000002,"5min":0.63,"15min":0.61199999999999999},"max":{"1min":1.0189999999999999,"5min":1.2769999999999999,"15min":1.284},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.95499999999999996,"15min":0.95599999999999996},"min":{"1min":0.73499999999999999,"5min":0.72799999999999998,"15min":0.69699999999999995},"max":{"1min":1.0469999999999999,"5min":1.417,"15min":1.417},"last":0.91200000000000003}]},{"osd":5,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91900000000000004,"15min":0.91800000000000004},"min":{"1min":0.71299999999999997,"5min":0.66600000000000004,"15min":0.58999999999999997},"max":{"1min":1.181,"5min":1.4299999999999999,"15min":1.472},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.93100000000000005,"15min":0.91900000000000004},"min":{"1min":0.71599999999999997,"5min":0.65800000000000003,"15min":0.58599999999999997},"max":{"1min":1.101,"5min":1.359,"15min":1.359},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.97899999999999998,"15min":0.95899999999999996},"min":{"1min":0.79200000000000004,"5min":0.75600000000000001,"15min":0.66200000000000003},"max":{"1min":1.353,"5min":1.407,"15min":1.4490000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.997,"5min":1.02,"15min":1.0089999999999999},"min":{"1min":0.81599999999999995,"5min":0.79300000000000004,"15min":0.65200000000000002},"max":{"1min":1.216,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.0469999999999999}]},{"osd":7,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.03,"15min":1.02},"min":{"1min":0.79300000000000004,"5min":0.70099999999999996,"15min":0.68500000000000005},"max":{"1min":1.28,"5min":1.4870000000000001,"15min":1.52},"last":1.02},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0569999999999999,"15min":1.028},"min":{"1min":0.82499999999999996,"5min":0.79600000000000004,"15min":0.65400000000000003},"max":{"1min":1.46,"5min":1.46,"15min":1.5229999999999999},"last":0.94299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575522,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.54900000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.012},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.58699999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.181},"last":0.86899999999999999}]},{"osd":1,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.70399999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.45800000000000002},"max":{"1min":0.97599999999999998,"5min":1.151,"15min":1.151},"last":0.66000000000000003}]},{"osd":3,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.48099999999999998,"5min":0.47599999999999998,"15min":0.35899999999999999},"max":{"1min":0.96299999999999997,"5min":1.0289999999999999,"15min":1.1519999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.66900000000000004,"5min":0.61799999999999999,"15min":0.48599999999999999},"max":{"1min":1.0720000000000001,"5min":1.179,"15min":1.2290000000000001},"last":0.95199999999999996}]},{"osd":4,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.89900000000000002,"15min":0.89600000000000002},"min":{"1min":0.66000000000000003,"5min":0.625,"15min":0.61599999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.2190000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.91600000000000004},"min":{"1min":0.77300000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.381,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.163}]},{"osd":5,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.873,"15min":0.86399999999999999},"min":{"1min":0.69399999999999995,"5min":0.60599999999999998,"15min":0.54800000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.04,"5min":0.999,"15min":0.98699999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.70499999999999996},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":1.1160000000000001}]},{"osd":6,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.95899999999999996,"15min":0.94599999999999995},"min":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.64200000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.589},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.93100000000000005,"15min":0.92100000000000004},"min":{"1min":0.75600000000000001,"5min":0.73199999999999998,"15min":0.64500000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.3899999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jun 25 05:42:59 2021","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.01,"15min":1.004},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.65800000000000003},"max":{"1min":1.3149999999999999,"5min":1.4530000000000001,"15min":1.5389999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0109999999999999,"15min":1.006},"min":{"1min":0.81299999999999994,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.448},"last":0.91500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575522,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58699999999999997,"15min":0.58399999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.39100000000000001},"max":{"1min":0.77900000000000003,"5min":0.99399999999999999,"15min":1.077},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68000000000000005,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.119},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0289999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.754},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73199999999999998,"15min":0.72199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.107},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0409999999999999,"5min":1.1020000000000001,"15min":1.1659999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.48699999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1}]},{"osd":4,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.85099999999999998,"15min":0.84699999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0700000000000001,"5min":1.2010000000000001,"15min":3.1059999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.92800000000000005,"15min":0.93400000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.21,"5min":1.226,"15min":3.5270000000000001},"last":0.88900000000000001}]},{"osd":5,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93500000000000005,"15min":0.93799999999999994},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.284,"5min":1.371,"15min":3.4489999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.91300000000000003,"15min":0.92900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1559999999999999,"5min":1.5329999999999999,"15min":3.2160000000000002},"last":0.94399999999999995}]},{"osd":6,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.97099999999999997,"15min":0.97499999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":3.3620000000000001},"last":1.073},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.97799999999999998,"15min":0.97999999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2390000000000001,"5min":1.6220000000000001,"15min":3.4089999999999998},"last":1.0369999999999999}]},{"osd":7,"last update":"Fri Jun 25 05:43:07 2021","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.006,"15min":1.006},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.379,"5min":1.5009999999999999,"15min":3.1440000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.038,"15min":1.0389999999999999},"min":{"1min":0.70499999999999996,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":3.2389999999999999},"last":1.137}]}]},{"osd":0,"up_from":13,"seq":55834575523,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 25 05:43:15 2021","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.97399999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.621,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96599999999999997,"5min":1.0589999999999999,"15min":1.0629999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Jun 25 05:43:15 2021","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.46200000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85499999999999998,"5min":1.111,"15min":1.111},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68700000000000006,"15min":0.68799999999999994},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.443},"max":{"1min":1.002,"5min":1.002,"15min":1.153},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Jun 25 05:43:15 2021","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65400000000000003,"15min":0.66500000000000004},"min":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.45600000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":0.94399999999999995,"5min":1.0309999999999999,"15min":1.1679999999999999},"last":0.877}]},{"osd":4,"last update":"Fri Jun 25 05:43:15 2021","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.89800000000000002},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.625},"max":{"1min":1.159,"5min":1.2230000000000001,"15min":1.2290000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84999999999999998,"15min":0.86499999999999999},"min":{"1min":0.70099999999999996,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.034,"5min":1.1779999999999999,"15min":1.2889999999999999},"last":0.752}]},{"osd":5,"last update":"Fri Jun 25 05:43:15 2021","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93100000000000005,"15min":0.95599999999999996},"min":{"1min":0.72899999999999998,"5min":0.624,"15min":0.624},"max":{"1min":1.238,"5min":1.3049999999999999,"15min":1.4410000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95099999999999996,"15min":0.95299999999999996},"min":{"1min":0.86399999999999999,"5min":0.71099999999999997,"15min":0.67000000000000004},"max":{"1min":1.21,"5min":1.2609999999999999,"15min":1.2649999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Jun 25 05:43:15 2021","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91700000000000004,"15min":0.92600000000000005},"min":{"1min":0.81100000000000005,"5min":0.68899999999999995,"15min":0.66600000000000004},"max":{"1min":1.1339999999999999,"5min":1.2609999999999999,"15min":1.5},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.002,"5min":0.98599999999999999,"15min":1.012},"min":{"1min":0.81299999999999994,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.2889999999999999,"5min":1.3720000000000001,"15min":1.5209999999999999},"last":1.022}]},{"osd":7,"last update":"Fri Jun 25 05:43:15 2021","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.016,"15min":1.0209999999999999},"min":{"1min":0.879,"5min":0.73299999999999998,"15min":0.69899999999999995},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.5349999999999999},"last":1.085},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.012,"15min":1.0189999999999999},"min":{"1min":0.86199999999999999,"5min":0.75600000000000001,"15min":0.72299999999999998},"max":{"1min":1.2030000000000001,"5min":1.3240000000000001,"15min":1.4570000000000001},"last":1.0569999999999999}]}]}]}} 2021-06-25T05:43:29.264 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2021-06-25T05:43:29.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe9123700 1 Processor -- start 2021-06-25T05:43:29.373 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe9123700 1 -- start start 2021-06-25T05:43:29.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe9123700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fafe40612e0 0x7fafe40616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.376 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe9123700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe4140400 0x7fafe4140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe9123700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe40aecb0 con 0x7fafe40ad580 2021-06-25T05:43:29.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe9123700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe40b6ee0 con 0x7fafe40612e0 2021-06-25T05:43:29.377 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe9123700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40aeee0 con 0x7fafe4140400 2021-06-25T05:43:29.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe8922700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe4140400 0x7fafe4140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe8922700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe4140400 0x7fafe4140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.57:56496/0 (socket says 172.21.15.57:56496) 2021-06-25T05:43:29.378 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe8922700 1 -- 172.21.15.57:0/2802212190 learned_addr learned my addr 172.21.15.57:0/2802212190 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:29.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe3fff700 1 --2- 172.21.15.57:0/2802212190 >> v2:172.21.15.87:3300/0 conn(0x7fafe40612e0 0x7fafe40616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe2ffd700 1 -- 172.21.15.57:0/2802212190 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170956540 0 0) 0x7fafe40aecb0 con 0x7fafe40ad580 2021-06-25T05:43:29.379 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe8922700 1 -- 172.21.15.57:0/2802212190 >> v2:172.21.15.87:3300/0 conn(0x7fafe40612e0 msgr2=0x7fafe40616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-06-25T05:43:29.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe8922700 1 --2- 172.21.15.57:0/2802212190 >> v2:172.21.15.87:3300/0 conn(0x7fafe40612e0 0x7fafe40616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe8922700 1 -- 172.21.15.57:0/2802212190 >> v1:172.21.15.87:6789/0 conn(0x7fafe40ad580 legacy=0x7fafe40b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.380 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe8922700 1 -- 172.21.15.57:0/2802212190 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40af180 con 0x7fafe4140400 2021-06-25T05:43:29.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe8922700 1 --2- 172.21.15.57:0/2802212190 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe4140400 0x7fafe4140890 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fafe40aeb60 tx=0x7fafdc009290).ready entity=mon.2 client_cookie=e1c6858c59bcf831 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:29.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe2ffd700 1 -- 172.21.15.57:0/2802212190 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafdc00b860 con 0x7fafe4140400 2021-06-25T05:43:29.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe2ffd700 1 -- 172.21.15.57:0/2802212190 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc00b9c0 con 0x7fafe4140400 2021-06-25T05:43:29.381 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe2ffd700 1 -- 172.21.15.57:0/2802212190 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafdc00bb30 con 0x7fafe4140400 2021-06-25T05:43:29.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe9123700 1 -- 172.21.15.57:0/2802212190 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe4140400 msgr2=0x7fafe4140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.374+0000 7fafe9123700 1 --2- 172.21.15.57:0/2802212190 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe4140400 0x7fafe4140890 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fafe40aeb60 tx=0x7fafdc009290).stop 2021-06-25T05:43:29.382 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 -- 172.21.15.57:0/2802212190 shutdown_connections 2021-06-25T05:43:29.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 --2- 172.21.15.57:0/2802212190 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe4140400 0x7fafe4140890 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 --2- 172.21.15.57:0/2802212190 >> v2:172.21.15.87:3300/0 conn(0x7fafe40612e0 0x7fafe40616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.383 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 -- 172.21.15.57:0/2802212190 >> 172.21.15.57:0/2802212190 conn(0x7fafe4066da0 msgr2=0x7fafe4067180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:29.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 -- 172.21.15.57:0/2802212190 shutdown_connections 2021-06-25T05:43:29.384 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 -- 172.21.15.57:0/2802212190 wait complete. 2021-06-25T05:43:29.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 Processor -- start 2021-06-25T05:43:29.387 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 -- start start 2021-06-25T05:43:29.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe40612e0 0x7fafe40b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe40ad580 0x7fafe40b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.388 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe4140400 0x7fafe40b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40b2990 con 0x7fafe4140400 2021-06-25T05:43:29.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40ab930 con 0x7fafe40ad580 2021-06-25T05:43:29.389 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe9123700 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40b2bc0 con 0x7fafe40612e0 2021-06-25T05:43:29.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe8922700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe4140400 0x7fafe40b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe8922700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe4140400 0x7fafe40b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45340/0 (socket says 172.21.15.57:45340) 2021-06-25T05:43:29.390 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe8922700 1 -- 172.21.15.57:0/1324000555 learned_addr learned my addr 172.21.15.57:0/1324000555 (peer_addr_for_me v2:172.21.15.57:0/0) 2021-06-25T05:43:29.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe3fff700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe40612e0 0x7fafe40b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.391 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.378+0000 7fafe37fe700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe40ad580 0x7fafe40b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe8922700 1 -- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe40612e0 msgr2=0x7fafe40b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe8922700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe40612e0 0x7fafe40b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe8922700 1 -- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe40ad580 msgr2=0x7fafe40b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.392 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe8922700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe40ad580 0x7fafe40b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe8922700 1 -- 172.21.15.57:0/1324000555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc009530 con 0x7fafe4140400 2021-06-25T05:43:29.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe3fff700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe40612e0 0x7fafe40b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T05:43:29.393 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe37fe700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe40ad580 0x7fafe40b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-06-25T05:43:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe8922700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe4140400 0x7fafe40b3300 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fafe40aeb60 tx=0x7fafdc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe17fa700 1 -- 172.21.15.57:0/1324000555 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafdc011ca0 con 0x7fafe4140400 2021-06-25T05:43:29.394 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe17fa700 1 -- 172.21.15.57:0/1324000555 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc011e00 con 0x7fafe4140400 2021-06-25T05:43:29.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe9123700 1 -- 172.21.15.57:0/1324000555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe40b2e60 con 0x7fafe4140400 2021-06-25T05:43:29.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe17fa700 1 -- 172.21.15.57:0/1324000555 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafdc01f610 con 0x7fafe4140400 2021-06-25T05:43:29.395 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe9123700 1 -- 172.21.15.57:0/1324000555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe41522d0 con 0x7fafe4140400 2021-06-25T05:43:29.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe9123700 1 -- 172.21.15.57:0/1324000555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe40b2ff0 con 0x7fafe4140400 2021-06-25T05:43:29.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe17fa700 1 -- 172.21.15.57:0/1324000555 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 67188+0+0 (secure 0 0 0) 0x7fafdc026030 con 0x7fafe4140400 2021-06-25T05:43:29.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe17fa700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafc4055360 0x7fafc4057820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-06-25T05:43:29.396 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe17fa700 1 -- 172.21.15.57:0/1324000555 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fafdc06e5c0 con 0x7fafe4140400 2021-06-25T05:43:29.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.382+0000 7fafe3fff700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafc4055360 0x7fafc4057820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-06-25T05:43:29.397 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.386+0000 7fafe3fff700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafc4055360 0x7fafc4057820 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fafd800b000 tx=0x7fafd8008040).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-06-25T05:43:29.398 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.390+0000 7fafe17fa700 1 -- 172.21.15.57:0/1324000555 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138303 (secure 0 0 0) 0x7fafdc044b40 con 0x7fafe4140400 2021-06-25T05:43:29.513 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.514+0000 7fafe9123700 1 -- 172.21.15.57:0/1324000555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fafe40620c0 con 0x7fafe4140400 2021-06-25T05:43:29.521 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.522+0000 7fafe17fa700 1 -- 172.21.15.57:0/1324000555 <== mon.0 v2:172.21.15.57:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fafdc044b40 con 0x7fafe4140400 2021-06-25T05:43:29.522 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.522+0000 7fafe17fa700 1 -- 172.21.15.57:0/1324000555 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v25)=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7fafdc024020 con 0x7fafe4140400 2021-06-25T05:43:29.526 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 -- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafc4055360 msgr2=0x7fafc4057820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafc4055360 0x7fafc4057820 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fafd800b000 tx=0x7fafd8008040).stop 2021-06-25T05:43:29.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 -- 172.21.15.57:0/1324000555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe4140400 msgr2=0x7fafe40b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-06-25T05:43:29.527 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe4140400 0x7fafe40b3300 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fafe40aeb60 tx=0x7fafdc016000).stop 2021-06-25T05:43:29.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 -- 172.21.15.57:0/1324000555 shutdown_connections 2021-06-25T05:43:29.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:6832/15156,v1:172.21.15.87:6833/15156] conn(0x7fafc4055360 0x7fafc4057820 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafe4140400 0x7fafe40b3300 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.528 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe40ad580 0x7fafe40b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 --2- 172.21.15.57:0/1324000555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe40612e0 0x7fafe40b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-06-25T05:43:29.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 -- 172.21.15.57:0/1324000555 >> 172.21.15.57:0/1324000555 conn(0x7fafe4066da0 msgr2=0x7fafe4149860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-06-25T05:43:29.529 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 -- 172.21.15.57:0/1324000555 shutdown_connections 2021-06-25T05:43:29.530 INFO:teuthology.orchestra.run.smithi057.stderr:2021-06-25T05:43:29.526+0000 7fafe9123700 1 -- 172.21.15.57:0/1324000555 wait complete. 2021-06-25T05:43:29.539 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/ceph.py", line 1839, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-06-25T05:43:29.542 INFO:teuthology.misc:Shutting down mds daemons... 2021-06-25T05:43:29.543 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-06-25T05:43:29.544 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:29.562 INFO:tasks.ceph.mds.a:Stopped 2021-06-25T05:43:29.563 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-06-25T05:43:29.564 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:29.623 INFO:tasks.ceph.mds.c:Stopped 2021-06-25T05:43:29.624 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-06-25T05:43:29.624 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:29.640 INFO:tasks.ceph.mds.b:Stopped 2021-06-25T05:43:29.641 INFO:teuthology.misc:Shutting down osd daemons... 2021-06-25T05:43:29.642 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-06-25T05:43:29.644 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:29.719 INFO:tasks.ceph.osd.0:Stopped 2021-06-25T05:43:29.720 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-06-25T05:43:29.721 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:29.789 INFO:tasks.ceph.osd.1:Stopped 2021-06-25T05:43:29.790 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-06-25T05:43:29.791 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:29.868 INFO:tasks.ceph.osd.2:Stopped 2021-06-25T05:43:29.869 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-06-25T05:43:29.870 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:29.936 INFO:tasks.ceph.osd.3:Stopped 2021-06-25T05:43:29.938 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-06-25T05:43:29.938 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:30.023 INFO:tasks.ceph.osd.4:Stopped 2021-06-25T05:43:30.024 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-06-25T05:43:30.025 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:30.095 INFO:tasks.ceph.osd.5:Stopped 2021-06-25T05:43:30.096 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2021-06-25T05:43:30.096 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:30.167 INFO:tasks.ceph.osd.6:Stopped 2021-06-25T05:43:30.169 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2021-06-25T05:43:30.169 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:30.245 INFO:tasks.ceph.osd.7:Stopped 2021-06-25T05:43:30.246 INFO:teuthology.misc:Shutting down mgr daemons... 2021-06-25T05:43:30.247 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2021-06-25T05:43:30.248 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:30.277 INFO:tasks.ceph.mgr.y:Stopped 2021-06-25T05:43:30.278 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-06-25T05:43:30.279 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:30.305 INFO:tasks.ceph.mgr.x:Stopped 2021-06-25T05:43:30.306 INFO:teuthology.misc:Shutting down mon daemons... 2021-06-25T05:43:30.307 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-06-25T05:43:30.308 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:30.336 INFO:tasks.ceph.mon.a:Stopped 2021-06-25T05:43:30.337 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-06-25T05:43:30.337 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:30.357 INFO:tasks.ceph.mon.b:Stopped 2021-06-25T05:43:30.358 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-06-25T05:43:30.358 INFO:teuthology.orchestra.run:waiting for 300 2021-06-25T05:43:30.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2021-06-25T05:43:30.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2021-06-25T05:43:30.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2021-06-25T05:43:30.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2021-06-25T05:43:30.423 INFO:tasks.ceph.mon.c:Stopped 2021-06-25T05:43:30.424 INFO:tasks.ceph:Checking cluster log for badness... 2021-06-25T05:43:30.425 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'Failed to load ceph-mgr modules: rook' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'has not responded to cap revoke by MDS for over' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 'responding to mclientcaps' | head -n 1 2021-06-25T05:43:30.450 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T05:43:30.451 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-06-25T05:43:30.790 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T05:43:30.791 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-06-25T05:43:30.973 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T05:43:30.974 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-06-25T05:43:31.114 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T05:43:31.115 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-06-25T05:43:31.381 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T05:43:31.382 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-06-25T05:43:31.656 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T05:43:31.657 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-06-25T05:43:31.957 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T05:43:31.958 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2021-06-25T05:43:32.110 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T05:43:32.111 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2021-06-25T05:43:32.270 INFO:tasks.ceph:Archiving mon data... 2021-06-25T05:43:32.272 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/data/mon.a.tgz 2021-06-25T05:43:32.272 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2021-06-25T05:43:32.280 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.v7b9t1rXW0 2021-06-25T05:43:32.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.v7b9t1rXW0 2021-06-25T05:43:32.533 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.v7b9t1rXW0 2021-06-25T05:43:32.558 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.v7b9t1rXW0 is 496KB 2021-06-25T05:43:32.618 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.v7b9t1rXW0 2021-06-25T05:43:32.625 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/data/mon.b.tgz 2021-06-25T05:43:32.626 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T05:43:32.634 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.ucgxQTuzSx 2021-06-25T05:43:32.634 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ucgxQTuzSx 2021-06-25T05:43:32.893 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.ucgxQTuzSx 2021-06-25T05:43:32.963 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.ucgxQTuzSx is 546KB 2021-06-25T05:43:33.030 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.ucgxQTuzSx 2021-06-25T05:43:33.038 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/data/mon.c.tgz 2021-06-25T05:43:33.039 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-06-25T05:43:33.047 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.f0pfBJToQP 2021-06-25T05:43:33.047 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.f0pfBJToQP 2021-06-25T05:43:33.302 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.f0pfBJToQP 2021-06-25T05:43:33.323 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.f0pfBJToQP is 546KB 2021-06-25T05:43:33.395 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.f0pfBJToQP 2021-06-25T05:43:33.402 INFO:tasks.ceph:Cleaning ceph cluster... 2021-06-25T05:43:33.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-06-25T05:43:33.406 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-06-25T05:43:33.408 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-06-25T05:43:33.411 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-06-25T05:43:33.428 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-06-25T05:43:33.429 DEBUG:teuthology.orchestra.run.smithi057:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-06-25T05:43:33.432 DEBUG:teuthology.orchestra.run.smithi087:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-06-25T05:43:33.462 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-06-25T05:43:33.465 DEBUG:teuthology.orchestra.run.smithi102:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-06-25T05:43:33.468 DEBUG:teuthology.orchestra.run.smithi161:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-06-25T05:43:33.484 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-06-25T05:43:33.498 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-06-25T05:43:33.502 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-06-25T05:43:33.511 INFO:tasks.ceph:Archiving crash dumps... 2021-06-25T05:43:33.514 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi057/crash 2021-06-25T05:43:33.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-06-25T05:43:33.536 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi087/crash 2021-06-25T05:43:33.538 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-06-25T05:43:33.559 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi102/crash 2021-06-25T05:43:33.561 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-06-25T05:43:33.581 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi161/crash 2021-06-25T05:43:33.583 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-06-25T05:43:33.604 INFO:tasks.ceph:Shutting down logrotate 2021-06-25T05:43:33.605 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:33.607 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:33.609 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:33.612 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:33.689 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:33.706 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:33.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:33.739 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-06-25T05:43:33.756 INFO:tasks.ceph:Compressing logs... 2021-06-25T05:43:33.757 DEBUG:teuthology.orchestra.run.smithi057:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-06-25T05:43:33.760 DEBUG:teuthology.orchestra.run.smithi087:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-06-25T05:43:33.763 DEBUG:teuthology.orchestra.run.smithi102:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-06-25T05:43:33.766 DEBUG:teuthology.orchestra.run.smithi161:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-06-25T05:43:35.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2021-06-25T05:43:35.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2021-06-25T05:43:35.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2021-06-25T05:43:35.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2021-06-25T05:43:48.291 INFO:tasks.ceph:Archiving logs... 2021-06-25T05:43:48.292 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi057/log 2021-06-25T05:43:48.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/log/ceph -- . 2021-06-25T05:43:52.018 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi087/log 2021-06-25T05:43:52.020 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/log/ceph -- . 2021-06-25T05:43:54.288 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi102/log 2021-06-25T05:43:54.290 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/log/ceph -- . 2021-06-25T05:43:54.713 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi161/log 2021-06-25T05:43:54.714 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/log/ceph -- . 2021-06-25T05:43:54.750 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-06-25T05:43:54.765 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph-c_da5e8184007182fa3cd5c8385fee4e08c5620fe2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-06-25T05:43:54.768 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-06-25T05:43:54.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-06-25T05:43:54.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-06-25T05:43:54.776 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-06-25T05:43:54.779 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-06-25T05:43:54.867 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-06-25T05:43:54.879 INFO:teuthology.task.clock:Checking final clock skew... 2021-06-25T05:43:54.879 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-06-25T05:43:54.902 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2021-06-25T05:43:54.902 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2021-06-25T05:43:54.903 INFO:teuthology.orchestra.run.smithi057.stdout:-hv01.front.sepi 216.240.36.24 3 u 123 128 377 0.110 1.662 2.099 2021-06-25T05:43:54.903 INFO:teuthology.orchestra.run.smithi057.stdout:*hv02.front.sepi 163.237.218.18 2 u 58 128 377 0.184 -5.439 1.939 2021-06-25T05:43:54.903 INFO:teuthology.orchestra.run.smithi057.stdout:+hv03.front.sepi 74.6.168.72 3 u 122 128 377 0.097 -7.244 2.307 2021-06-25T05:43:54.904 INFO:teuthology.orchestra.run.smithi057.stdout:+hv04.front.sepi 144.172.126.201 3 u 42 128 377 0.126 -2.255 2.566 2021-06-25T05:43:54.905 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-06-25T05:43:54.929 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2021-06-25T05:43:54.930 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2021-06-25T05:43:54.930 INFO:teuthology.orchestra.run.smithi087.stdout:-hv01.front.sepi 216.240.36.24 3 u 91 128 377 0.104 7.412 0.921 2021-06-25T05:43:54.930 INFO:teuthology.orchestra.run.smithi087.stdout:*hv02.front.sepi 163.237.218.18 2 u 110 128 377 0.067 0.861 0.769 2021-06-25T05:43:54.931 INFO:teuthology.orchestra.run.smithi087.stdout:+hv03.front.sepi 74.6.168.72 3 u 38 128 377 0.132 -1.560 0.901 2021-06-25T05:43:54.931 INFO:teuthology.orchestra.run.smithi087.stdout:+hv04.front.sepi 144.172.126.201 3 u 41 128 377 0.099 3.624 0.618 2021-06-25T05:43:54.932 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-06-25T05:43:54.957 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2021-06-25T05:43:54.957 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2021-06-25T05:43:54.958 INFO:teuthology.orchestra.run.smithi102.stdout:+hv01.front.sepi 216.240.36.24 3 u 31 128 377 0.146 9.261 1.880 2021-06-25T05:43:54.958 INFO:teuthology.orchestra.run.smithi102.stdout:*hv02.front.sepi 163.237.218.18 2 u 81 128 377 0.123 4.556 1.087 2021-06-25T05:43:54.958 INFO:teuthology.orchestra.run.smithi102.stdout:-hv03.front.sepi 74.6.168.72 3 u 37 128 377 0.151 2.141 0.931 2021-06-25T05:43:54.959 INFO:teuthology.orchestra.run.smithi102.stdout:+hv04.front.sepi 144.172.126.201 3 u 82 128 377 0.131 5.334 1.630 2021-06-25T05:43:54.959 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-06-25T05:43:54.984 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2021-06-25T05:43:54.985 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2021-06-25T05:43:54.985 INFO:teuthology.orchestra.run.smithi161.stdout:-hv01.front.sepi 216.240.36.24 3 u 64 128 377 0.112 1.938 0.956 2021-06-25T05:43:54.985 INFO:teuthology.orchestra.run.smithi161.stdout:*hv02.front.sepi 163.237.218.18 2 u 84 128 377 0.122 -4.611 1.096 2021-06-25T05:43:54.986 INFO:teuthology.orchestra.run.smithi161.stdout:+hv03.front.sepi 74.6.168.72 3 u 19 128 377 0.125 -6.872 1.232 2021-06-25T05:43:54.986 INFO:teuthology.orchestra.run.smithi161.stdout:+hv04.front.sepi 144.172.126.201 3 u 25 128 377 0.120 -1.710 1.507 2021-06-25T05:43:54.987 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-06-25T05:43:55.000 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-06-25T05:43:55.000 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-06-25T05:43:55.039 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-06-25T05:43:55.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-06-25T05:43:55.223 INFO:teuthology.task.internal:Duration was 3834.552741 seconds 2021-06-25T05:43:55.224 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-06-25T05:43:55.297 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-06-25T05:43:55.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-06-25T05:43:55.301 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-06-25T05:43:55.304 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-06-25T05:43:55.307 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-06-25T05:43:55.360 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-06-25T05:43:55.360 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2021-06-25T05:43:55.361 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-06-25T05:43:55.375 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2021-06-25T05:43:55.376 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-06-25T05:43:55.391 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2021-06-25T05:43:55.391 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-06-25T05:43:55.407 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2021-06-25T05:43:55.408 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-06-25T05:43:55.423 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-06-25T05:43:55.424 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-06-25T05:43:55.427 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-06-25T05:43:55.430 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-06-25T05:43:55.433 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-06-25T05:43:55.502 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-06-25T05:43:55.514 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-06-25T05:43:55.515 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-06-25T05:43:55.531 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-06-25T05:43:55.548 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-06-25T05:43:55.565 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-06-25T05:43:55.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-06-25T05:43:55.594 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-06-25T05:43:55.597 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-06-25T05:43:55.599 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-06-25T05:43:55.602 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-06-25T05:43:55.609 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2021-06-25T05:43:55.612 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2021-06-25T05:43:55.615 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2021-06-25T05:43:55.637 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2021-06-25T05:43:55.653 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2021-06-25T05:43:55.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T05:43:55.660 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2021-06-25T05:43:55.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T05:43:55.686 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2021-06-25T05:43:55.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T05:43:55.693 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2021-06-25T05:43:55.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-06-25T05:43:55.700 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-06-25T05:43:55.712 INFO:teuthology.task.internal:Transferring archived files... 2021-06-25T05:43:55.714 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi057 2021-06-25T05:43:55.715 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-06-25T05:43:55.742 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi087 2021-06-25T05:43:55.743 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-06-25T05:43:55.772 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi102 2021-06-25T05:43:55.773 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-06-25T05:43:55.802 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-06-24_14:36:33-fs-wip-yuri8-testing-2021-06-15-0839-octopus-distro-basic-smithi/6189131/remote/smithi161 2021-06-25T05:43:55.803 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-06-25T05:43:55.833 INFO:teuthology.task.internal:Removing archive directory... 2021-06-25T05:43:55.834 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2021-06-25T05:43:55.837 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2021-06-25T05:43:55.840 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2021-06-25T05:43:55.843 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2021-06-25T05:43:55.851 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-06-25T05:43:55.863 INFO:teuthology.task.internal:Not uploading archives. 2021-06-25T05:43:55.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-06-25T05:43:55.914 INFO:teuthology.task.internal:Tidying up after the test... 2021-06-25T05:43:55.915 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-06-25T05:43:55.919 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-06-25T05:43:55.922 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-06-25T05:43:55.925 INFO:teuthology.orchestra.run.smithi057.stdout: 524322 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 25 05:43 /home/ubuntu/cephtest 2021-06-25T05:43:55.926 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-06-25T05:43:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: 524322 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 25 05:43 /home/ubuntu/cephtest 2021-06-25T05:43:55.934 INFO:teuthology.orchestra.run.smithi161.stdout: 524322 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 25 05:43 /home/ubuntu/cephtest 2021-06-25T16:34:38.159 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-06-25T16:34:38.198 DEBUG:teuthology.task.console_log:Killing console logger for smithi057 2021-06-25T16:34:38.199 DEBUG:teuthology.task.console_log:Killing console logger for smithi087 2021-06-25T16:34:38.199 DEBUG:teuthology.task.console_log:Killing console logger for smithi102 2021-06-25T16:34:38.200 DEBUG:teuthology.task.console_log:Killing console logger for smithi161 2021-06-25T16:34:38.201 DEBUG:teuthology.exit:Finished running handlers